2024-09-19T06:20:11.680 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T06:20:11.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:20:11.814 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911740' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8QvSScHyvG2c0xCB3OmLq0BNqosky5FZ97Kv6aG+17kpVgMfqU6PESXjyQmMPkHIaa1YKn66xA9sFpS/rAdXg= smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKpyqyxOWPBUr8l7EVlZYtmmQVCruTu8YVtvCanRMb+0deo7gVMD61j0wDRUxQhBl6ocJynd4s1mXM1LXedMcJA= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGtD/kCuOykU+hWqID4SYlvhaMqRYQTo+UpNOcr2F53kpzuxWTUl2OvBLPlsW7C9CgMTwOvDtEKR5Ft4BdPbDZs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T06:20:11.815 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T06:20:11.816 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T06:20:11.816 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T06:20:11.817 INFO:teuthology.task.internal:Checking packages... 2024-09-19T06:20:11.838 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T06:20:11.838 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:20:11.838 INFO:teuthology.packaging:ref: None 2024-09-19T06:20:11.838 INFO:teuthology.packaging:tag: None 2024-09-19T06:20:11.838 INFO:teuthology.packaging:branch: squid 2024-09-19T06:20:11.838 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:20:11.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T06:20:12.060 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T06:20:12.062 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T06:20:12.068 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T06:20:12.069 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T06:20:12.078 INFO:teuthology.task.internal:Saving configuration 2024-09-19T06:20:12.101 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T06:20:12.108 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T06:20:12.131 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:15:07.591374', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8QvSScHyvG2c0xCB3OmLq0BNqosky5FZ97Kv6aG+17kpVgMfqU6PESXjyQmMPkHIaa1YKn66xA9sFpS/rAdXg='} 2024-09-19T06:20:12.155 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:15:07.592964', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKpyqyxOWPBUr8l7EVlZYtmmQVCruTu8YVtvCanRMb+0deo7gVMD61j0wDRUxQhBl6ocJynd4s1mXM1LXedMcJA='} 2024-09-19T06:20:12.179 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:15:07.594144', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGtD/kCuOykU+hWqID4SYlvhaMqRYQTo+UpNOcr2F53kpzuxWTUl2OvBLPlsW7C9CgMTwOvDtEKR5Ft4BdPbDZs='} 2024-09-19T06:20:12.179 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T06:20:12.188 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T06:20:12.188 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T06:20:12.188 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T06:20:12.188 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T06:20:12.272 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2b993c75b0>, signals=[15]) 2024-09-19T06:20:12.272 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T06:20:12.278 INFO:teuthology.task.internal:Opening connections... 2024-09-19T06:20:12.278 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:20:12.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:20:12.357 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-09-19T06:20:12.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:20:12.431 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-09-19T06:20:12.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:20:12.508 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T06:20:12.515 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-09-19T06:20:12.533 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-09-19T06:20:12.534 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-09-19T06:20:12.591 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:20:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:20:12.593 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-09-19T06:20:12.612 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-09-19T06:20:12.630 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-09-19T06:20:12.631 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-09-19T06:20:12.688 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-09-19T06:20:12.688 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-09-19T06:20:12.688 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-09-19T06:20:12.688 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:20:12.688 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-09-19T06:20:12.688 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:20:12.689 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:20:12.689 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-09-19T06:20:12.689 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:20:12.689 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:20:12.689 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:20:12.689 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:20:12.689 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:20:12.689 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:20:12.689 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-09-19T06:20:12.712 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-09-19T06:20:12.731 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-09-19T06:20:12.731 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-09-19T06:20:12.789 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-09-19T06:20:12.789 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-09-19T06:20:12.789 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-09-19T06:20:12.789 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:20:12.789 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-09-19T06:20:12.790 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:20:12.790 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:20:12.790 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-09-19T06:20:12.790 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:20:12.790 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:20:12.790 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:20:12.790 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:20:12.790 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:20:12.790 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:20:12.790 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-09-19T06:20:12.812 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T06:20:12.822 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T06:20:12.827 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T06:20:12.827 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:20:12.830 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:20:12.832 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:20:12.849 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T06:20:12.855 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T06:20:12.855 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:20:12.887 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:20:12.890 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:20:12.925 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T06:20:13.005 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T06:20:13.021 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T06:20:13.021 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T06:20:13.021 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T06:20:13.021 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:20:13.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:20:13.038 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-19T06:20:13.097 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-503.el9.x86_64 2024-09-19T06:20:13.097 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.14.0-503.el9.x86_64 2024-09-19T06:20:13.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum install -y kernel 2024-09-19T06:20:15.691 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.3 MB 00:00 2024-09-19T06:20:21.682 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 4.2 MB/s | 20 MB 00:04 2024-09-19T06:20:26.358 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.5 MB 00:00 2024-09-19T06:20:27.850 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-19T06:20:29.087 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-19T06:20:34.835 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T06:20:36.816 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T06:20:36.816 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T06:20:36.906 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-19T06:20:36.916 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-19T06:20:36.917 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-09-19T06:20:36.918 INFO:teuthology.orchestra.run.smithi012.stdout:Install 4 Packages 2024-09-19T06:20:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:20:36.918 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 79 M 2024-09-19T06:20:36.918 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 126 M 2024-09-19T06:20:36.918 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-19T06:20:37.119 INFO:teuthology.orchestra.run.smithi012.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 468 kB/s | 36 kB 00:00 2024-09-19T06:20:41.069 INFO:teuthology.orchestra.run.smithi012.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-19T06:20:44.260 INFO:teuthology.orchestra.run.smithi012.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 4.0 MB/s | 29 MB 00:07 2024-09-19T06:20:46.102 INFO:teuthology.orchestra.run.smithi012.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 35 MB 00:09 2024-09-19T06:20:46.102 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:20:46.102 INFO:teuthology.orchestra.run.smithi012.stdout:Total 8.6 MB/s | 79 MB 00:09 2024-09-19T06:20:46.819 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-19T06:20:47.216 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-19T06:20:47.216 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-19T06:20:48.190 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-19T06:20:48.190 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-19T06:20:50.747 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-19T06:20:51.438 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:20:51.544 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:20:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:20:54.440 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:20:59.567 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:20:59.607 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:21:04.746 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:21:43.685 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:21:43.726 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:21:44.066 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:21:44.066 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:21:44.066 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:21:44.066 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:21:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:21:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:21:44.959 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-19T06:21:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T06:21:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T06:21:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T06:21:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T06:21:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:21:44.960 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-19T06:21:45.295 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:21:45.381 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:21:45.382 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:21:45.382 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T06:21:45.382 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T06:21:45.382 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T06:21:45.382 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T06:21:45.383 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T06:21:45.383 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:21:45.441 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:21:45.441 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:21:45.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2024-09-19T06:21:45.480 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.06 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 82.el9 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Group : Unspecified 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 8274670 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : builder@centos.org 2024-09-19T06:21:45.481 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : CentOS 2024-09-19T06:21:45.482 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T06:21:45.482 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2024-09-19T06:21:45.482 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2024-09-19T06:21:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:21:45.482 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T06:21:45.482 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T06:21:45.482 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T06:21:45.482 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2024-09-19T06:21:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:21:45.482 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T06:21:45.483 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T06:21:45.483 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 5.14.0-508.el9.x86_64 2024-09-19T06:21:45.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T06:21:46.109 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2024-09-19T06:21:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T06:21:47.449 INFO:teuthology.orchestra.run.smithi012.stderr:done 2024-09-19T06:21:47.451 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-19T06:21:47.484 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.rfUVBMPU0E 2024-09-19T06:21:47.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rfUVBMPU0E 2024-09-19T06:21:47.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.rfUVBMPU0E 2024-09-19T06:21:47.699 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.rfUVBMPU0E is 6KB 2024-09-19T06:21:47.749 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.rfUVBMPU0E 2024-09-19T06:21:47.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T06:21:47.826 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T06:21:47.827 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T06:21:47.827 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T06:21:47.827 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T06:21:47.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T06:21:47.972 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2024-09-19T06:22:17.975 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T06:22:17.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-19T06:22:17.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:22:36.349 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-19T06:22:45.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-19T06:22:45.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:23:03.741 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-19T06:23:15.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-19T06:23:15.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:23:16.299 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-19T06:23:16.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-19T06:23:16.745 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T06:23:16.745 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-19T06:23:16.760 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-508.el9.x86_64 2024-09-19T06:23:16.760 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T06:23:16.760 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T06:23:16.761 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T06:23:17.761 DEBUG:teuthology.parallel:result is None 2024-09-19T06:23:17.762 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T06:23:17.773 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T06:23:17.773 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:23:17.775 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:23:17.778 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:23:17.796 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T06:23:17.803 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T06:23:17.813 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T06:23:17.813 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:23:17.831 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:23:17.836 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:23:17.968 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T06:23:17.974 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T06:23:17.974 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:23:17.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:23:17.991 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:23:18.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:23:18.009 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:23:18.011 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:23:18.033 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:23:18.064 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:23:18.083 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:23:18.087 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:23:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:23:18.119 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:23:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:23:18.128 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T06:23:18.136 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T06:23:18.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:23:18.138 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:23:18.140 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:23:18.168 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T06:23:18.177 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T06:23:18.177 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:23:18.205 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:23:18.208 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:23:18.225 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:23:18.303 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:23:18.353 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:23:18.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:23:18.478 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:23:18.478 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:23:18.555 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:23:18.599 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:23:18.651 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:23:18.733 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:23:18.777 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:23:18.777 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:23:18.843 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:23:18.887 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:23:18.950 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:23:18.987 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:23:19.037 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:23:19.038 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:23:19.104 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-09-19T06:23:19.106 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-09-19T06:23:19.109 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-09-19T06:23:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:23:19.158 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:23:19.185 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:23:19.548 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T06:23:19.555 INFO:teuthology.task.internal:Starting timer... 2024-09-19T06:23:19.555 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T06:23:19.567 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T06:23:19.576 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T06:23:19.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-09-19T06:23:19.619 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-09-19T06:23:19.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2024-09-19T06:23:19.694 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: 2024-09-19T06:23:19.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2024-09-19T06:23:19.751 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2024-09-19T06:23:19.753 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T06:23:19.753 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-09-19T06:23:19.772 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-09-19T06:23:19.772 DEBUG:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2024-09-19T06:23:19.796 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2024-09-19T06:23:19.797 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2024-09-19T06:23:19.819 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2024-09-19T06:23:19.820 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2024-09-19T06:23:19.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:23:19.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:23:19.847 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:23:19.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:23:19.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:23:19.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:23:19.900 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T06:23:19.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:23:19.951 DEBUG:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:23:19.983 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:23:20.016 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T06:23:20.026 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T06:23:20.029 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T06:23:20.143 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T06:23:20.154 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T06:23:20.155 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi016.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T06:27:27.772 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-09-19T06:27:27.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-19T06:27:27.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:27:27.855 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-19T06:27:27.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-19T06:27:27.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-19T06:27:27.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:27:28.010 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-09-19T06:27:28.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-09-19T06:27:28.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-19T06:27:28.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:27:28.123 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-09-19T06:27:28.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-19T06:27:28.207 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T06:27:28.222 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T06:27:28.222 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:27:28.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:27:28.225 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:27:28.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:27:28.228 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:27:28.228 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:27:28.258 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:27:28.259 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:27:28.275 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:27:28.276 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:27:28.277 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:27:28.293 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:27:28.301 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-09-19T06:27:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: ntpd: command not found 2024-09-19T06:27:28.313 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-09-19T06:27:28.314 INFO:teuthology.orchestra.run.smithi016.stdout:506 Cannot talk to daemon 2024-09-19T06:27:28.318 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2024-09-19T06:27:28.329 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:27:28.329 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:27:28.330 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2024-09-19T06:27:28.345 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:27:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:27:28.345 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:27:28.358 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:27:28.401 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:27:28.404 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:27:28.404 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-09-19T06:27:28.404 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.404 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.404 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.404 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.409 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:27:28.412 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:27:28.412 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-19T06:27:28.412 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.412 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.412 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.412 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.418 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:27:28.421 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:27:28.421 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-09-19T06:27:28.421 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.422 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.422 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.422 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:27:28.423 INFO:teuthology.run_tasks:Running task install... 2024-09-19T06:27:28.431 DEBUG:teuthology.task.install:project ceph 2024-09-19T06:27:28.431 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T06:27:28.431 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T06:27:28.432 INFO:teuthology.task.install:Using flavor: default 2024-09-19T06:27:28.437 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T06:27:28.437 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T06:27:28.438 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:27:28.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:27:28.440 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:27:28.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:27:28.442 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:27:28.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:27:28.592 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:27:28.592 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:27:28.597 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:27:28.597 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:27:28.600 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:27:28.600 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:27:28.706 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:27:28.706 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:27:28.706 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:27:28.712 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:27:28.712 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:27:28.712 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:27:28.717 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:27:28.717 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:27:28.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:27:28.733 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:27:28.733 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:27:28.738 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:27:28.738 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:27:28.743 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:27:28.743 DEBUG:teuthology.orchestra.run.smithi016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:27:28.800 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:27:28.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:27:28.809 DEBUG:teuthology.orchestra.run.smithi016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:27:28.876 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:27:28.880 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:27:28.885 DEBUG:teuthology.orchestra.run.smithi016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:27:28.941 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-09-19T06:27:28.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-09-19T06:27:28.944 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2024-09-19T06:27:28.945 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2024-09-19T06:27:28.949 INFO:teuthology.orchestra.run.smithi016.stdout:check_obsoletes = 1 2024-09-19T06:27:28.951 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum clean all 2024-09-19T06:27:29.171 INFO:teuthology.orchestra.run.smithi173.stdout:45 files removed 2024-09-19T06:27:29.183 INFO:teuthology.orchestra.run.smithi016.stdout:45 files removed 2024-09-19T06:27:29.183 INFO:teuthology.orchestra.run.smithi012.stdout:45 files removed 2024-09-19T06:27:29.198 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:27:29.210 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:27:29.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:27:29.732 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 322 kB/s | 84 kB 00:00 2024-09-19T06:27:29.764 INFO:teuthology.orchestra.run.smithi016.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-19T06:27:29.793 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 296 kB/s | 84 kB 00:00 2024-09-19T06:27:30.016 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-19T06:27:30.057 INFO:teuthology.orchestra.run.smithi016.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T06:27:30.077 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T06:27:30.301 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-19T06:27:30.332 INFO:teuthology.orchestra.run.smithi016.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T06:27:30.353 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T06:27:30.893 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-19T06:27:31.091 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-19T06:27:32.744 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-19T06:27:33.053 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.3 MB 00:02 2024-09-19T06:27:33.075 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-19T06:27:37.836 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.5 MB 00:01 2024-09-19T06:27:38.809 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-19T06:27:39.429 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 19 kB 00:00 2024-09-19T06:27:40.319 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 20 MB 00:06 2024-09-19T06:27:40.466 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T06:27:40.518 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-19T06:27:41.448 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T06:27:46.030 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-19T06:27:47.112 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T06:27:48.167 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:27:48.168 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:27:48.181 INFO:teuthology.orchestra.run.smithi173.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:27:48.182 INFO:teuthology.orchestra.run.smithi173.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:27:48.183 INFO:teuthology.orchestra.run.smithi173.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:27:48.184 INFO:teuthology.orchestra.run.smithi173.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:27:48.186 INFO:teuthology.orchestra.run.smithi173.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:27:48.189 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:27:48.190 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:27:48.253 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-19T06:27:48.272 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-09-19T06:27:48.272 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:27:48.273 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:27:48.274 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:27:48.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:27:48.276 INFO:teuthology.orchestra.run.smithi173.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:27:48.277 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:27:48.278 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:27:48.279 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:27:48.280 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:27:48.281 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:27:48.282 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:27:48.283 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:27:48.284 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:27:48.285 INFO:teuthology.orchestra.run.smithi173.stdout:Installing weak dependencies: 2024-09-19T06:27:48.286 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:27:48.286 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:27:48.286 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-19T06:27:48.286 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-09-19T06:27:48.286 INFO:teuthology.orchestra.run.smithi173.stdout:Install 148 Packages 2024-09-19T06:27:48.286 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 8 Packages 2024-09-19T06:27:48.286 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:27:48.287 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 226 M 2024-09-19T06:27:48.287 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-19T06:27:48.882 INFO:teuthology.orchestra.run.smithi173.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-19T06:27:48.902 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.5 MB 00:04 2024-09-19T06:27:49.099 INFO:teuthology.orchestra.run.smithi173.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.0 MB/s | 896 kB 00:00 2024-09-19T06:27:49.190 INFO:teuthology.orchestra.run.smithi173.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.6 MB/s | 145 kB 00:00 2024-09-19T06:27:49.299 INFO:teuthology.orchestra.run.smithi173.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-19T06:27:49.359 INFO:teuthology.orchestra.run.smithi016.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:27:49.360 INFO:teuthology.orchestra.run.smithi016.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:27:49.375 INFO:teuthology.orchestra.run.smithi016.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:27:49.376 INFO:teuthology.orchestra.run.smithi016.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:27:49.377 INFO:teuthology.orchestra.run.smithi016.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:27:49.378 INFO:teuthology.orchestra.run.smithi016.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:27:49.380 INFO:teuthology.orchestra.run.smithi016.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:27:49.383 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:27:49.384 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:27:49.433 INFO:teuthology.orchestra.run.smithi173.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 9.9 MB/s | 2.4 MB 00:00 2024-09-19T06:27:49.453 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-09-19T06:27:49.466 INFO:teuthology.orchestra.run.smithi173.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-19T06:27:49.479 INFO:teuthology.orchestra.run.smithi016.stdout:====================================================================================== 2024-09-19T06:27:49.479 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-09-19T06:27:49.479 INFO:teuthology.orchestra.run.smithi016.stdout:====================================================================================== 2024-09-19T06:27:49.479 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-09-19T06:27:49.479 INFO:teuthology.orchestra.run.smithi016.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:27:49.480 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:27:49.481 INFO:teuthology.orchestra.run.smithi016.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:27:49.482 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:27:49.483 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:27:49.484 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:27:49.485 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:27:49.486 INFO:teuthology.orchestra.run.smithi016.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:27:49.487 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:27:49.488 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:27:49.489 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:27:49.490 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:27:49.491 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:27:49.491 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:27:49.491 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:27:49.491 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:27:49.491 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:27:49.491 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:27:49.491 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:27:49.491 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:27:49.491 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout:Installing weak dependencies: 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-09-19T06:27:49.492 INFO:teuthology.orchestra.run.smithi016.stdout:====================================================================================== 2024-09-19T06:27:49.493 INFO:teuthology.orchestra.run.smithi016.stdout:Install 148 Packages 2024-09-19T06:27:49.493 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 8 Packages 2024-09-19T06:27:49.493 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:27:49.493 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 226 M 2024-09-19T06:27:49.493 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-09-19T06:27:49.850 INFO:teuthology.orchestra.run.smithi173.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 19 MB/s | 21 MB 00:01 2024-09-19T06:27:49.933 INFO:teuthology.orchestra.run.smithi173.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 9.4 MB/s | 4.7 MB 00:00 2024-09-19T06:27:49.956 INFO:teuthology.orchestra.run.smithi016.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-19T06:27:49.975 INFO:teuthology.orchestra.run.smithi173.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 607 kB/s | 25 kB 00:00 2024-09-19T06:27:50.334 INFO:teuthology.orchestra.run.smithi173.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 19 MB/s | 17 MB 00:00 2024-09-19T06:27:50.339 INFO:teuthology.orchestra.run.smithi016.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.3 MB/s | 896 kB 00:00 2024-09-19T06:27:50.384 INFO:teuthology.orchestra.run.smithi173.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T06:27:50.414 INFO:teuthology.orchestra.run.smithi016.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.9 MB/s | 145 kB 00:00 2024-09-19T06:27:50.443 INFO:teuthology.orchestra.run.smithi173.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 465 kB/s | 27 kB 00:00 2024-09-19T06:27:50.469 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-19T06:27:50.501 INFO:teuthology.orchestra.run.smithi173.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 544 kB/s | 32 kB 00:00 2024-09-19T06:27:50.585 INFO:teuthology.orchestra.run.smithi173.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-19T06:27:50.640 INFO:teuthology.orchestra.run.smithi016.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 6.6 MB/s | 5.4 MB 00:00 2024-09-19T06:27:50.643 INFO:teuthology.orchestra.run.smithi173.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T06:27:50.710 INFO:teuthology.orchestra.run.smithi173.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T06:27:50.786 INFO:teuthology.orchestra.run.smithi173.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T06:27:50.815 INFO:teuthology.orchestra.run.smithi016.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-19T06:27:51.036 INFO:teuthology.orchestra.run.smithi173.stdout:(18/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 8.9 MB/s | 11 MB 00:01 2024-09-19T06:27:51.063 INFO:teuthology.orchestra.run.smithi016.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.7 MB/s | 2.4 MB 00:00 2024-09-19T06:27:51.120 INFO:teuthology.orchestra.run.smithi173.stdout:(19/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-19T06:27:51.136 INFO:teuthology.orchestra.run.smithi173.stdout:(20/156): python3-ceph-argparse-19.1.1-361.g2f5 451 kB/s | 45 kB 00:00 2024-09-19T06:27:51.187 INFO:teuthology.orchestra.run.smithi173.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T06:27:51.212 INFO:teuthology.orchestra.run.smithi173.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T06:27:51.238 INFO:teuthology.orchestra.run.smithi173.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T06:27:51.249 INFO:teuthology.orchestra.run.smithi016.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-19T06:27:51.263 INFO:teuthology.orchestra.run.smithi173.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.8 MB/s | 300 kB 00:00 2024-09-19T06:27:51.297 INFO:teuthology.orchestra.run.smithi173.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T06:27:51.330 INFO:teuthology.orchestra.run.smithi173.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-19T06:27:51.431 INFO:teuthology.orchestra.run.smithi173.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-19T06:27:51.539 INFO:teuthology.orchestra.run.smithi173.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-19T06:27:51.592 INFO:teuthology.orchestra.run.smithi173.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 198 kB/s | 32 kB 00:00 2024-09-19T06:27:51.623 INFO:teuthology.orchestra.run.smithi173.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T06:27:51.698 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-19T06:27:52.065 INFO:teuthology.orchestra.run.smithi173.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.5 MB/s | 3.6 MB 00:00 2024-09-19T06:27:52.074 INFO:teuthology.orchestra.run.smithi016.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 13 MB/s | 11 MB 00:00 2024-09-19T06:27:52.124 INFO:teuthology.orchestra.run.smithi173.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.2 MB/s | 249 kB 00:00 2024-09-19T06:27:52.141 INFO:teuthology.orchestra.run.smithi016.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 378 kB/s | 25 kB 00:00 2024-09-19T06:27:52.216 INFO:teuthology.orchestra.run.smithi173.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-19T06:27:52.241 INFO:teuthology.orchestra.run.smithi173.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 422 kB/s | 49 kB 00:00 2024-09-19T06:27:52.283 INFO:teuthology.orchestra.run.smithi173.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 247 kB/s | 16 kB 00:00 2024-09-19T06:27:52.309 INFO:teuthology.orchestra.run.smithi173.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.1 MB/s | 285 kB 00:00 2024-09-19T06:27:52.376 INFO:teuthology.orchestra.run.smithi173.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-19T06:27:52.401 INFO:teuthology.orchestra.run.smithi173.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 198 kB/s | 18 kB 00:00 2024-09-19T06:27:52.510 INFO:teuthology.orchestra.run.smithi173.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-19T06:27:52.577 INFO:teuthology.orchestra.run.smithi173.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-19T06:27:52.602 INFO:teuthology.orchestra.run.smithi173.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-19T06:27:52.644 INFO:teuthology.orchestra.run.smithi173.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-19T06:27:52.675 INFO:teuthology.orchestra.run.smithi016.stdout:(10/156): ceph-common-19.1.1-361.g2f599a46.el9. 7.4 MB/s | 21 MB 00:02 2024-09-19T06:27:52.703 INFO:teuthology.orchestra.run.smithi173.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T06:27:52.733 INFO:teuthology.orchestra.run.smithi016.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T06:27:52.744 INFO:teuthology.orchestra.run.smithi173.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-09-19T06:27:52.770 INFO:teuthology.orchestra.run.smithi173.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-19T06:27:52.800 INFO:teuthology.orchestra.run.smithi016.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 405 kB/s | 27 kB 00:00 2024-09-19T06:27:52.812 INFO:teuthology.orchestra.run.smithi173.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-19T06:27:52.845 INFO:teuthology.orchestra.run.smithi173.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-19T06:27:52.851 INFO:teuthology.orchestra.run.smithi016.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 636 kB/s | 32 kB 00:00 2024-09-19T06:27:52.960 INFO:teuthology.orchestra.run.smithi016.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-19T06:27:52.996 INFO:teuthology.orchestra.run.smithi173.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-19T06:27:53.026 INFO:teuthology.orchestra.run.smithi016.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T06:27:53.029 INFO:teuthology.orchestra.run.smithi173.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-19T06:27:53.055 INFO:teuthology.orchestra.run.smithi173.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-19T06:27:53.071 INFO:teuthology.orchestra.run.smithi173.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 517 kB/s | 22 kB 00:00 2024-09-19T06:27:53.094 INFO:teuthology.orchestra.run.smithi016.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T06:27:53.105 INFO:teuthology.orchestra.run.smithi173.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-19T06:27:53.131 INFO:teuthology.orchestra.run.smithi173.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-09-19T06:27:53.160 INFO:teuthology.orchestra.run.smithi016.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T06:27:53.369 INFO:teuthology.orchestra.run.smithi016.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 7.3 MB/s | 17 MB 00:02 2024-09-19T06:27:53.411 INFO:teuthology.orchestra.run.smithi016.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.1 MB/s | 45 kB 00:00 2024-09-19T06:27:53.470 INFO:teuthology.orchestra.run.smithi016.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.3 MB/s | 136 kB 00:00 2024-09-19T06:27:53.537 INFO:teuthology.orchestra.run.smithi016.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.4 MB/s | 161 kB 00:00 2024-09-19T06:27:53.556 INFO:teuthology.orchestra.run.smithi173.stdout:(54/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 14 MB/s | 49 MB 00:03 2024-09-19T06:27:53.581 INFO:teuthology.orchestra.run.smithi173.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 40 kB/s | 18 kB 00:00 2024-09-19T06:27:53.637 INFO:teuthology.orchestra.run.smithi016.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-19T06:27:53.648 INFO:teuthology.orchestra.run.smithi173.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.5 MB/s | 3.0 MB 00:00 2024-09-19T06:27:53.662 INFO:teuthology.orchestra.run.smithi016.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 2.5 MB/s | 320 kB 00:00 2024-09-19T06:27:53.674 INFO:teuthology.orchestra.run.smithi173.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-09-19T06:27:53.688 INFO:teuthology.orchestra.run.smithi016.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.8 MB/s | 300 kB 00:00 2024-09-19T06:27:53.699 INFO:teuthology.orchestra.run.smithi173.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-19T06:27:53.713 INFO:teuthology.orchestra.run.smithi016.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T06:27:53.724 INFO:teuthology.orchestra.run.smithi173.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-19T06:27:53.738 INFO:teuthology.orchestra.run.smithi016.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:27:53.749 INFO:teuthology.orchestra.run.smithi173.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 11 MB/s | 581 kB 00:00 2024-09-19T06:27:53.775 INFO:teuthology.orchestra.run.smithi173.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-19T06:27:53.788 INFO:teuthology.orchestra.run.smithi016.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T06:27:53.800 INFO:teuthology.orchestra.run.smithi173.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-19T06:27:53.842 INFO:teuthology.orchestra.run.smithi173.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-19T06:27:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 546 kB/s | 32 kB 00:00 2024-09-19T06:27:53.867 INFO:teuthology.orchestra.run.smithi173.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-09-19T06:27:53.901 INFO:teuthology.orchestra.run.smithi173.stdout:(65/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2024-09-19T06:27:53.906 INFO:teuthology.orchestra.run.smithi016.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.5 MB/s | 146 kB 00:00 2024-09-19T06:27:53.926 INFO:teuthology.orchestra.run.smithi173.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-19T06:27:54.018 INFO:teuthology.orchestra.run.smithi173.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-19T06:27:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 10 MB/s | 3.1 MB 00:00 2024-09-19T06:27:54.068 INFO:teuthology.orchestra.run.smithi173.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-19T06:27:54.102 INFO:teuthology.orchestra.run.smithi173.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-19T06:27:54.127 INFO:teuthology.orchestra.run.smithi173.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T06:27:54.194 INFO:teuthology.orchestra.run.smithi173.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-19T06:27:54.215 INFO:teuthology.orchestra.run.smithi016.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 12 MB/s | 3.6 MB 00:00 2024-09-19T06:27:54.236 INFO:teuthology.orchestra.run.smithi173.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-19T06:27:54.261 INFO:teuthology.orchestra.run.smithi173.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T06:27:54.353 INFO:teuthology.orchestra.run.smithi173.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-19T06:27:54.379 INFO:teuthology.orchestra.run.smithi173.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 524 kB/s | 61 kB 00:00 2024-09-19T06:27:54.413 INFO:teuthology.orchestra.run.smithi173.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-19T06:27:54.437 INFO:teuthology.orchestra.run.smithi173.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-19T06:27:54.462 INFO:teuthology.orchestra.run.smithi173.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-19T06:27:54.488 INFO:teuthology.orchestra.run.smithi173.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-19T06:27:54.513 INFO:teuthology.orchestra.run.smithi173.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-19T06:27:54.539 INFO:teuthology.orchestra.run.smithi173.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 690 kB/s | 35 kB 00:00 2024-09-19T06:27:54.630 INFO:teuthology.orchestra.run.smithi173.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-19T06:27:54.656 INFO:teuthology.orchestra.run.smithi173.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-19T06:27:54.657 INFO:teuthology.orchestra.run.smithi016.stdout:(32/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 19 MB/s | 49 MB 00:02 2024-09-19T06:27:54.690 INFO:teuthology.orchestra.run.smithi173.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-19T06:27:54.707 INFO:teuthology.orchestra.run.smithi016.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 507 kB/s | 249 kB 00:00 2024-09-19T06:27:54.715 INFO:teuthology.orchestra.run.smithi173.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T06:27:54.724 INFO:teuthology.orchestra.run.smithi016.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 740 kB/s | 49 kB 00:00 2024-09-19T06:27:54.732 INFO:teuthology.orchestra.run.smithi173.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T06:27:54.749 INFO:teuthology.orchestra.run.smithi016.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 393 kB/s | 16 kB 00:00 2024-09-19T06:27:54.765 INFO:teuthology.orchestra.run.smithi173.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-19T06:27:54.783 INFO:teuthology.orchestra.run.smithi016.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.8 MB/s | 285 kB 00:00 2024-09-19T06:27:54.790 INFO:teuthology.orchestra.run.smithi173.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-19T06:27:54.816 INFO:teuthology.orchestra.run.smithi173.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T06:27:54.825 INFO:teuthology.orchestra.run.smithi016.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 441 kB/s | 18 kB 00:00 2024-09-19T06:27:54.841 INFO:teuthology.orchestra.run.smithi173.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T06:27:54.858 INFO:teuthology.orchestra.run.smithi173.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-19T06:27:54.859 INFO:teuthology.orchestra.run.smithi016.stdout:(38/156): cephadm-19.1.1-361.g2f599a46.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-19T06:27:54.933 INFO:teuthology.orchestra.run.smithi173.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T06:27:54.942 INFO:teuthology.orchestra.run.smithi016.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 8.0 MB/s | 7.4 MB 00:00 2024-09-19T06:27:54.958 INFO:teuthology.orchestra.run.smithi173.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-19T06:27:54.968 INFO:teuthology.orchestra.run.smithi016.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 560 kB/s | 80 kB 00:00 2024-09-19T06:27:54.984 INFO:teuthology.orchestra.run.smithi173.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-19T06:27:55.017 INFO:teuthology.orchestra.run.smithi173.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T06:27:55.043 INFO:teuthology.orchestra.run.smithi173.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-19T06:27:55.068 INFO:teuthology.orchestra.run.smithi173.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-19T06:27:55.076 INFO:teuthology.orchestra.run.smithi016.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-19T06:27:55.093 INFO:teuthology.orchestra.run.smithi173.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T06:27:55.102 INFO:teuthology.orchestra.run.smithi016.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-19T06:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T06:27:55.139 INFO:teuthology.orchestra.run.smithi016.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-19T06:27:55.144 INFO:teuthology.orchestra.run.smithi173.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T06:27:55.164 INFO:teuthology.orchestra.run.smithi016.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.7 MB/s | 106 kB 00:00 2024-09-19T06:27:55.169 INFO:teuthology.orchestra.run.smithi173.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T06:27:55.189 INFO:teuthology.orchestra.run.smithi016.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T06:27:55.194 INFO:teuthology.orchestra.run.smithi173.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-19T06:27:55.231 INFO:teuthology.orchestra.run.smithi016.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 7.9 MB/s | 1.2 MB 00:00 2024-09-19T06:27:55.257 INFO:teuthology.orchestra.run.smithi016.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-19T06:27:55.282 INFO:teuthology.orchestra.run.smithi016.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-19T06:27:55.453 INFO:teuthology.orchestra.run.smithi173.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-19T06:27:55.503 INFO:teuthology.orchestra.run.smithi173.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T06:27:55.537 INFO:teuthology.orchestra.run.smithi173.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T06:27:55.562 INFO:teuthology.orchestra.run.smithi173.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-19T06:27:55.704 INFO:teuthology.orchestra.run.smithi173.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-19T06:27:55.729 INFO:teuthology.orchestra.run.smithi173.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T06:27:55.754 INFO:teuthology.orchestra.run.smithi173.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T06:27:55.780 INFO:teuthology.orchestra.run.smithi173.stdout:(110/156): lua-devel-5.4.4-4.el9.x86_64.rpm 36 kB/s | 22 kB 00:00 2024-09-19T06:27:55.805 INFO:teuthology.orchestra.run.smithi173.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T06:27:55.864 INFO:teuthology.orchestra.run.smithi173.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T06:27:55.890 INFO:teuthology.orchestra.run.smithi016.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 176 kB/s | 107 kB 00:00 2024-09-19T06:27:55.897 INFO:teuthology.orchestra.run.smithi173.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-09-19T06:27:55.931 INFO:teuthology.orchestra.run.smithi173.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-19T06:27:55.956 INFO:teuthology.orchestra.run.smithi173.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T06:27:55.982 INFO:teuthology.orchestra.run.smithi173.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-19T06:27:56.008 INFO:teuthology.orchestra.run.smithi173.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T06:27:56.032 INFO:teuthology.orchestra.run.smithi173.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-19T06:27:56.066 INFO:teuthology.orchestra.run.smithi173.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-19T06:27:56.099 INFO:teuthology.orchestra.run.smithi173.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-19T06:27:56.125 INFO:teuthology.orchestra.run.smithi173.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T06:27:56.158 INFO:teuthology.orchestra.run.smithi173.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T06:27:56.175 INFO:teuthology.orchestra.run.smithi173.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-09-19T06:27:56.192 INFO:teuthology.orchestra.run.smithi173.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-19T06:27:56.209 INFO:teuthology.orchestra.run.smithi173.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-19T06:27:56.226 INFO:teuthology.orchestra.run.smithi173.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-19T06:27:56.243 INFO:teuthology.orchestra.run.smithi173.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-19T06:27:56.302 INFO:teuthology.orchestra.run.smithi173.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-09-19T06:27:56.327 INFO:teuthology.orchestra.run.smithi173.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:27:56.352 INFO:teuthology.orchestra.run.smithi173.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T06:27:56.386 INFO:teuthology.orchestra.run.smithi173.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-19T06:27:56.411 INFO:teuthology.orchestra.run.smithi173.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 982 kB/s | 58 kB 00:00 2024-09-19T06:27:56.436 INFO:teuthology.orchestra.run.smithi173.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-19T06:27:56.470 INFO:teuthology.orchestra.run.smithi173.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-19T06:27:56.495 INFO:teuthology.orchestra.run.smithi173.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T06:27:56.512 INFO:teuthology.orchestra.run.smithi173.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-09-19T06:27:56.529 INFO:teuthology.orchestra.run.smithi173.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 920 kB/s | 31 kB 00:00 2024-09-19T06:27:56.554 INFO:teuthology.orchestra.run.smithi173.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T06:27:56.580 INFO:teuthology.orchestra.run.smithi173.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-19T06:27:56.605 INFO:teuthology.orchestra.run.smithi173.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T06:27:56.630 INFO:teuthology.orchestra.run.smithi173.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T06:27:56.655 INFO:teuthology.orchestra.run.smithi173.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T06:27:56.681 INFO:teuthology.orchestra.run.smithi173.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T06:27:56.706 INFO:teuthology.orchestra.run.smithi173.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 792 kB/s | 20 kB 00:00 2024-09-19T06:27:56.731 INFO:teuthology.orchestra.run.smithi173.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-19T06:27:56.757 INFO:teuthology.orchestra.run.smithi173.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T06:27:56.824 INFO:teuthology.orchestra.run.smithi173.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-19T06:27:57.032 INFO:teuthology.orchestra.run.smithi173.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T06:27:57.116 INFO:teuthology.orchestra.run.smithi173.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-19T06:27:57.184 INFO:teuthology.orchestra.run.smithi173.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-09-19T06:27:57.241 INFO:teuthology.orchestra.run.smithi173.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 14 MB/s | 1.8 MB 00:00 2024-09-19T06:27:57.267 INFO:teuthology.orchestra.run.smithi173.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 490 kB/s | 41 kB 00:00 2024-09-19T06:27:57.317 INFO:teuthology.orchestra.run.smithi173.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-19T06:27:57.320 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-19T06:27:57.359 INFO:teuthology.orchestra.run.smithi173.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-19T06:27:57.426 INFO:teuthology.orchestra.run.smithi173.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-19T06:27:57.790 INFO:teuthology.orchestra.run.smithi016.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 11 kB/s | 22 kB 00:01 2024-09-19T06:27:57.891 INFO:teuthology.orchestra.run.smithi016.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 259 kB/s | 689 kB 00:02 2024-09-19T06:27:57.924 INFO:teuthology.orchestra.run.smithi016.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-19T06:27:59.300 INFO:teuthology.orchestra.run.smithi016.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 23 kB/s | 33 kB 00:01 2024-09-19T06:27:59.341 INFO:teuthology.orchestra.run.smithi016.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-19T06:27:59.375 INFO:teuthology.orchestra.run.smithi016.stdout:(55/156): bison-3.7.4-5.el9.x86_64.rpm 229 kB/s | 943 kB 00:04 2024-09-19T06:27:59.392 INFO:teuthology.orchestra.run.smithi016.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T06:27:59.442 INFO:teuthology.orchestra.run.smithi016.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-19T06:27:59.509 INFO:teuthology.orchestra.run.smithi173.stdout:(156/156): protobuf-compiler-3.14.0-13.el9.x86_ 200 kB/s | 863 kB 00:04 2024-09-19T06:27:59.514 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:27:59.515 INFO:teuthology.orchestra.run.smithi173.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-19T06:27:59.526 INFO:teuthology.orchestra.run.smithi016.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.9 MB/s | 3.0 MB 00:01 2024-09-19T06:27:59.551 INFO:teuthology.orchestra.run.smithi016.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 911 kB/s | 160 kB 00:00 2024-09-19T06:27:59.616 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:27:59.617 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:27:59.630 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:27:59.631 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:27:59.632 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:27:59.633 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:27:59.635 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:27:59.638 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:27:59.639 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:27:59.709 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:27:59.730 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:27:59.731 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:27:59.732 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:27:59.733 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:27:59.734 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:27:59.734 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:27:59.734 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:27:59.734 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:27:59.734 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:27:59.734 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:27:59.734 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:27:59.735 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:27:59.736 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:27:59.737 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:27:59.738 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:27:59.739 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:27:59.740 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:27:59.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:27:59.742 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-19T06:27:59.742 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-19T06:27:59.742 INFO:teuthology.orchestra.run.smithi012.stdout:Install 148 Packages 2024-09-19T06:27:59.742 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 8 Packages 2024-09-19T06:27:59.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:27:59.742 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 226 M 2024-09-19T06:27:59.742 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-19T06:28:00.546 INFO:teuthology.orchestra.run.smithi012.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-19T06:28:00.744 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-19T06:28:00.789 INFO:teuthology.orchestra.run.smithi012.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.6 MB/s | 896 kB 00:00 2024-09-19T06:28:00.864 INFO:teuthology.orchestra.run.smithi012.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T06:28:00.889 INFO:teuthology.orchestra.run.smithi012.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.4 MB/s | 145 kB 00:00 2024-09-19T06:28:00.894 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-19T06:28:00.894 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-19T06:28:00.997 INFO:teuthology.orchestra.run.smithi012.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 2.4 MB 00:00 2024-09-19T06:28:01.214 INFO:teuthology.orchestra.run.smithi012.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.7 MB/s | 1.5 MB 00:00 2024-09-19T06:28:01.281 INFO:teuthology.orchestra.run.smithi012.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-19T06:28:01.551 INFO:teuthology.orchestra.run.smithi016.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 12 kB/s | 24 kB 00:01 2024-09-19T06:28:01.565 INFO:teuthology.orchestra.run.smithi012.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T06:28:01.615 INFO:teuthology.orchestra.run.smithi012.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 506 kB/s | 25 kB 00:00 2024-09-19T06:28:01.627 INFO:teuthology.orchestra.run.smithi016.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 303 kB/s | 662 kB 00:02 2024-09-19T06:28:01.711 INFO:teuthology.orchestra.run.smithi016.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 266 kB/s | 581 kB 00:02 2024-09-19T06:28:01.815 INFO:teuthology.orchestra.run.smithi012.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 20 MB/s | 11 MB 00:00 2024-09-19T06:28:01.874 INFO:teuthology.orchestra.run.smithi012.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T06:28:01.949 INFO:teuthology.orchestra.run.smithi012.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 361 kB/s | 27 kB 00:00 2024-09-19T06:28:02.024 INFO:teuthology.orchestra.run.smithi012.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 424 kB/s | 32 kB 00:00 2024-09-19T06:28:02.125 INFO:teuthology.orchestra.run.smithi012.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 7.3 MB/s | 751 kB 00:00 2024-09-19T06:28:02.217 INFO:teuthology.orchestra.run.smithi012.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.7 MB/s | 163 kB 00:00 2024-09-19T06:28:02.309 INFO:teuthology.orchestra.run.smithi012.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.4 MB/s | 127 kB 00:00 2024-09-19T06:28:02.409 INFO:teuthology.orchestra.run.smithi012.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.0 MB/s | 506 kB 00:00 2024-09-19T06:28:02.618 INFO:teuthology.orchestra.run.smithi012.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 17 MB 00:01 2024-09-19T06:28:02.660 INFO:teuthology.orchestra.run.smithi012.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.1 MB/s | 45 kB 00:00 2024-09-19T06:28:02.760 INFO:teuthology.orchestra.run.smithi012.stdout:(20/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-19T06:28:02.775 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-19T06:28:02.776 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-19T06:28:02.785 INFO:teuthology.orchestra.run.smithi012.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 1.1 MB/s | 136 kB 00:00 2024-09-19T06:28:02.819 INFO:teuthology.orchestra.run.smithi012.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T06:28:02.844 INFO:teuthology.orchestra.run.smithi012.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 5.3 MB/s | 320 kB 00:00 2024-09-19T06:28:02.894 INFO:teuthology.orchestra.run.smithi012.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T06:28:02.920 INFO:teuthology.orchestra.run.smithi012.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.3 MB/s | 99 kB 00:00 2024-09-19T06:28:02.945 INFO:teuthology.orchestra.run.smithi012.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:28:03.004 INFO:teuthology.orchestra.run.smithi012.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T06:28:03.079 INFO:teuthology.orchestra.run.smithi012.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-19T06:28:03.104 INFO:teuthology.orchestra.run.smithi012.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 317 kB/s | 32 kB 00:00 2024-09-19T06:28:03.130 INFO:teuthology.orchestra.run.smithi012.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.8 MB/s | 146 kB 00:00 2024-09-19T06:28:03.594 INFO:teuthology.orchestra.run.smithi016.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 23 kB/s | 47 kB 00:02 2024-09-19T06:28:03.702 INFO:teuthology.orchestra.run.smithi016.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 95 kB/s | 188 kB 00:01 2024-09-19T06:28:03.753 INFO:teuthology.orchestra.run.smithi016.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 138 kB/s | 292 kB 00:02 2024-09-19T06:28:03.797 INFO:teuthology.orchestra.run.smithi012.stdout:(31/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 22 MB/s | 49 MB 00:02 2024-09-19T06:28:03.855 INFO:teuthology.orchestra.run.smithi012.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 4.8 MB/s | 3.6 MB 00:00 2024-09-19T06:28:03.880 INFO:teuthology.orchestra.run.smithi012.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T06:28:03.897 INFO:teuthology.orchestra.run.smithi012.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 1.2 MB/s | 49 kB 00:00 2024-09-19T06:28:03.914 INFO:teuthology.orchestra.run.smithi012.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 491 kB/s | 16 kB 00:00 2024-09-19T06:28:04.014 INFO:teuthology.orchestra.run.smithi012.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 8.4 MB/s | 7.4 MB 00:00 2024-09-19T06:28:04.040 INFO:teuthology.orchestra.run.smithi012.stdout:(37/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.0 MB/s | 285 kB 00:00 2024-09-19T06:28:04.065 INFO:teuthology.orchestra.run.smithi012.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 365 kB/s | 18 kB 00:00 2024-09-19T06:28:04.098 INFO:teuthology.orchestra.run.smithi012.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-19T06:28:04.449 INFO:teuthology.orchestra.run.smithi012.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 195 kB/s | 80 kB 00:00 2024-09-19T06:28:04.649 INFO:teuthology.orchestra.run.smithi012.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-19T06:28:04.733 INFO:teuthology.orchestra.run.smithi012.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 893 kB/s | 253 kB 00:00 2024-09-19T06:28:04.850 INFO:teuthology.orchestra.run.smithi012.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 912 kB/s | 106 kB 00:00 2024-09-19T06:28:04.883 INFO:teuthology.orchestra.run.smithi012.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 980 kB/s | 801 kB 00:00 2024-09-19T06:28:04.992 INFO:teuthology.orchestra.run.smithi012.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 953 kB/s | 135 kB 00:00 2024-09-19T06:28:05.017 INFO:teuthology.orchestra.run.smithi012.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 932 kB/s | 125 kB 00:00 2024-09-19T06:28:05.118 INFO:teuthology.orchestra.run.smithi012.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-19T06:28:05.160 INFO:teuthology.orchestra.run.smithi012.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.4 MB/s | 1.2 MB 00:00 2024-09-19T06:28:05.268 INFO:teuthology.orchestra.run.smithi012.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 986 kB/s | 107 kB 00:00 2024-09-19T06:28:05.310 INFO:teuthology.orchestra.run.smithi012.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-19T06:28:05.377 INFO:teuthology.orchestra.run.smithi012.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-19T06:28:05.427 INFO:teuthology.orchestra.run.smithi012.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-19T06:28:05.461 INFO:teuthology.orchestra.run.smithi012.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-09-19T06:28:05.486 INFO:teuthology.orchestra.run.smithi012.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 300 kB/s | 33 kB 00:00 2024-09-19T06:28:05.578 INFO:teuthology.orchestra.run.smithi012.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-19T06:28:05.603 INFO:teuthology.orchestra.run.smithi012.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-09-19T06:28:05.695 INFO:teuthology.orchestra.run.smithi012.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-19T06:28:05.721 INFO:teuthology.orchestra.run.smithi012.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-19T06:28:05.821 INFO:teuthology.orchestra.run.smithi012.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-19T06:28:05.846 INFO:teuthology.orchestra.run.smithi012.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-19T06:28:05.930 INFO:teuthology.orchestra.run.smithi012.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-19T06:28:05.955 INFO:teuthology.orchestra.run.smithi012.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-19T06:28:06.047 INFO:teuthology.orchestra.run.smithi012.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-19T06:28:06.072 INFO:teuthology.orchestra.run.smithi012.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-19T06:28:06.156 INFO:teuthology.orchestra.run.smithi012.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-19T06:28:06.839 INFO:teuthology.orchestra.run.smithi012.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.1 MB/s | 3.0 MB 00:01 2024-09-19T06:28:07.619 INFO:teuthology.orchestra.run.smithi016.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 9.6 kB/s | 38 kB 00:04 2024-09-19T06:28:07.820 INFO:teuthology.orchestra.run.smithi016.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 1.2 MB/s | 4.9 MB 00:04 2024-09-19T06:28:07.870 INFO:teuthology.orchestra.run.smithi016.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-09-19T06:28:08.164 INFO:teuthology.orchestra.run.smithi012.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 4.4 MB 00:02 2024-09-19T06:28:09.031 INFO:teuthology.orchestra.run.smithi012.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 1.7 MB/s | 4.9 MB 00:02 2024-09-19T06:28:09.172 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-19T06:28:09.206 INFO:teuthology.orchestra.run.smithi012.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 686 kB/s | 1.6 MB 00:02 2024-09-19T06:28:09.279 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:28:09.318 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:28:09.323 INFO:teuthology.orchestra.run.smithi012.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 471 kB/s | 137 kB 00:00 2024-09-19T06:28:09.371 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:28:09.387 INFO:teuthology.orchestra.run.smithi016.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 581 kB/s | 910 kB 00:01 2024-09-19T06:28:09.405 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:28:09.430 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:28:09.473 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:28:09.598 INFO:teuthology.orchestra.run.smithi012.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 635 kB/s | 910 kB 00:01 2024-09-19T06:28:09.797 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:28:09.798 INFO:teuthology.orchestra.run.smithi012.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 437 kB/s | 87 kB 00:00 2024-09-19T06:28:09.906 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:28:10.012 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:28:10.033 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:28:10.123 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:28:10.145 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:28:10.300 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:28:10.358 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:28:10.386 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:28:10.489 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:28:10.537 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:28:10.600 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:28:10.622 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:28:10.641 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:28:10.782 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:28:10.857 INFO:teuthology.orchestra.run.smithi012.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 674 kB/s | 1.0 MB 00:01 2024-09-19T06:28:10.909 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:28:10.966 INFO:teuthology.orchestra.run.smithi012.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-19T06:28:11.020 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:28:11.129 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:28:11.197 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:28:11.341 INFO:teuthology.orchestra.run.smithi012.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-19T06:28:11.370 INFO:teuthology.orchestra.run.smithi016.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 39 kB/s | 137 kB 00:03 2024-09-19T06:28:11.417 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:28:11.526 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:28:11.554 INFO:teuthology.orchestra.run.smithi016.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-09-19T06:28:11.624 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:28:11.629 INFO:teuthology.orchestra.run.smithi016.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 2.6 MB/s | 5.8 MB 00:02 2024-09-19T06:28:11.660 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:28:11.695 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:28:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 647 kB/s | 248 kB 00:00 2024-09-19T06:28:11.769 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:28:11.821 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:28:11.841 INFO:teuthology.orchestra.run.smithi012.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-19T06:28:11.873 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:28:11.917 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:28:11.950 INFO:teuthology.orchestra.run.smithi012.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-19T06:28:11.957 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:28:11.985 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:28:12.054 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:28:12.107 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:28:12.138 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:28:12.182 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:28:12.259 INFO:teuthology.orchestra.run.smithi012.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 558 kB/s | 172 kB 00:00 2024-09-19T06:28:12.259 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:28:12.292 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:28:12.335 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:28:12.364 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:28:12.367 INFO:teuthology.orchestra.run.smithi012.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-09-19T06:28:12.425 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:28:12.470 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:28:12.545 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:28:12.678 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:28:12.731 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:28:13.254 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:28:13.343 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:28:13.373 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:28:13.407 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:28:13.445 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:28:13.487 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:28:13.638 INFO:teuthology.orchestra.run.smithi016.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 42 kB/s | 87 kB 00:02 2024-09-19T06:28:13.662 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:28:13.723 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:28:13.779 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:28:13.851 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:28:13.883 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:28:13.919 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:28:13.966 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:28:14.003 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:28:14.044 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:28:14.091 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:28:14.358 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:28:14.480 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:28:14.530 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:28:14.633 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:28:14.844 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:28:15.022 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:28:15.055 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:28:15.079 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:28:15.161 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:28:15.292 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:28:15.336 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:28:15.364 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:28:15.399 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:28:15.438 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:28:15.477 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:28:15.507 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:28:15.541 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:28:15.575 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:28:15.616 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:28:15.659 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:28:15.663 INFO:teuthology.orchestra.run.smithi016.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 30 kB/s | 61 kB 00:02 2024-09-19T06:28:15.745 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:28:15.746 INFO:teuthology.orchestra.run.smithi016.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 1.4 MB/s | 6.0 MB 00:04 2024-09-19T06:28:15.789 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:28:15.829 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:28:15.933 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:28:15.998 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:28:16.716 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:28:16.754 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:28:16.787 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:28:16.885 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:28:16.943 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:28:16.987 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:28:17.078 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:28:17.115 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:28:17.301 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:28:17.330 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:28:17.407 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:28:17.733 INFO:teuthology.orchestra.run.smithi012.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 694 kB/s | 5.8 MB 00:08 2024-09-19T06:28:18.049 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:28:18.096 INFO:teuthology.orchestra.run.smithi016.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 101 kB/s | 245 kB 00:02 2024-09-19T06:28:18.121 INFO:teuthology.orchestra.run.smithi016.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 104 kB/s | 248 kB 00:02 2024-09-19T06:28:18.133 INFO:teuthology.orchestra.run.smithi012.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 627 kB/s | 250 kB 00:00 2024-09-19T06:28:18.178 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:28:18.238 INFO:teuthology.orchestra.run.smithi016.stdout:(78/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 313 kB/s | 4.4 MB 00:14 2024-09-19T06:28:18.525 INFO:teuthology.orchestra.run.smithi012.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 567 kB/s | 222 kB 00:00 2024-09-19T06:28:18.609 INFO:teuthology.orchestra.run.smithi012.stdout:(84/156): python3-babel-2.9.1-2.el9.noarch.rpm 693 kB/s | 6.0 MB 00:08 2024-09-19T06:28:18.709 INFO:teuthology.orchestra.run.smithi012.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 423 kB/s | 42 kB 00:00 2024-09-19T06:28:18.736 INFO:teuthology.orchestra.run.smithi012.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 369 kB/s | 77 kB 00:00 2024-09-19T06:28:19.018 INFO:teuthology.orchestra.run.smithi012.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 560 kB/s | 159 kB 00:00 2024-09-19T06:28:19.177 INFO:teuthology.orchestra.run.smithi012.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 577 kB/s | 269 kB 00:00 2024-09-19T06:28:19.285 INFO:teuthology.orchestra.run.smithi012.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-19T06:28:19.394 INFO:teuthology.orchestra.run.smithi012.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-19T06:28:19.410 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:28:19.494 INFO:teuthology.orchestra.run.smithi012.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 586 kB/s | 279 kB 00:00 2024-09-19T06:28:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:28:19.536 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:28:19.569 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:28:19.602 INFO:teuthology.orchestra.run.smithi012.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-09-19T06:28:19.703 INFO:teuthology.orchestra.run.smithi012.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-09-19T06:28:19.878 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:28:19.911 INFO:teuthology.orchestra.run.smithi012.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 692 kB/s | 5.1 MB 00:07 2024-09-19T06:28:19.923 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:28:20.014 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:28:20.028 INFO:teuthology.orchestra.run.smithi012.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 308 kB/s | 36 kB 00:00 2024-09-19T06:28:20.045 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:28:20.081 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:28:20.120 INFO:teuthology.orchestra.run.smithi012.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 529 kB/s | 221 kB 00:00 2024-09-19T06:28:20.122 INFO:teuthology.orchestra.run.smithi016.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 13 kB/s | 26 kB 00:02 2024-09-19T06:28:20.145 INFO:teuthology.orchestra.run.smithi012.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-19T06:28:20.147 INFO:teuthology.orchestra.run.smithi016.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 9.4 kB/s | 19 kB 00:02 2024-09-19T06:28:20.172 INFO:teuthology.orchestra.run.smithi016.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 89 kB/s | 172 kB 00:01 2024-09-19T06:28:20.262 INFO:teuthology.orchestra.run.smithi012.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 497 kB/s | 58 kB 00:00 2024-09-19T06:28:20.463 INFO:teuthology.orchestra.run.smithi012.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 479 kB/s | 96 kB 00:00 2024-09-19T06:28:20.569 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:28:20.610 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:28:20.638 INFO:teuthology.orchestra.run.smithi012.stdout:(100/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-19T06:28:20.663 INFO:teuthology.orchestra.run.smithi012.stdout:(101/156): socat-1.7.4.1-6.el9.x86_64.rpm 561 kB/s | 304 kB 00:00 2024-09-19T06:28:20.664 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:28:20.687 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:28:20.705 INFO:teuthology.orchestra.run.smithi012.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 263 kB/s | 64 kB 00:00 2024-09-19T06:28:20.747 INFO:teuthology.orchestra.run.smithi012.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-19T06:28:20.850 INFO:teuthology.orchestra.run.smithi012.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 119 kB/s | 22 kB 00:00 2024-09-19T06:28:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 3.0 MB/s | 548 kB 00:00 2024-09-19T06:28:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.1 MB/s | 308 kB 00:00 2024-09-19T06:28:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-19T06:28:20.999 INFO:teuthology.orchestra.run.smithi012.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T06:28:21.074 INFO:teuthology.orchestra.run.smithi012.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-19T06:28:21.099 INFO:teuthology.orchestra.run.smithi012.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-09-19T06:28:21.141 INFO:teuthology.orchestra.run.smithi012.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-19T06:28:21.175 INFO:teuthology.orchestra.run.smithi012.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 670 kB/s | 67 kB 00:00 2024-09-19T06:28:21.225 INFO:teuthology.orchestra.run.smithi012.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 10 MB/s | 839 kB 00:00 2024-09-19T06:28:21.250 INFO:teuthology.orchestra.run.smithi012.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:28:21.275 INFO:teuthology.orchestra.run.smithi012.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T06:28:21.442 INFO:teuthology.orchestra.run.smithi012.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 2.0 MB/s | 548 kB 00:00 2024-09-19T06:28:21.476 INFO:teuthology.orchestra.run.smithi012.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 70 kB/s | 14 kB 00:00 2024-09-19T06:28:21.501 INFO:teuthology.orchestra.run.smithi012.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.8 MB/s | 172 kB 00:00 2024-09-19T06:28:21.543 INFO:teuthology.orchestra.run.smithi012.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-19T06:28:21.610 INFO:teuthology.orchestra.run.smithi012.stdout:(120/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-19T06:28:21.636 INFO:teuthology.orchestra.run.smithi012.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-19T06:28:21.661 INFO:teuthology.orchestra.run.smithi012.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-19T06:28:21.678 INFO:teuthology.orchestra.run.smithi012.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 648 kB/s | 11 kB 00:00 2024-09-19T06:28:21.711 INFO:teuthology.orchestra.run.smithi012.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-19T06:28:21.728 INFO:teuthology.orchestra.run.smithi012.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-19T06:28:21.745 INFO:teuthology.orchestra.run.smithi012.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 693 kB/s | 23 kB 00:00 2024-09-19T06:28:21.762 INFO:teuthology.orchestra.run.smithi012.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 578 kB/s | 19 kB 00:00 2024-09-19T06:28:21.779 INFO:teuthology.orchestra.run.smithi012.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2024-09-19T06:28:21.804 INFO:teuthology.orchestra.run.smithi012.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:28:21.830 INFO:teuthology.orchestra.run.smithi012.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T06:28:21.847 INFO:teuthology.orchestra.run.smithi012.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-19T06:28:21.880 INFO:teuthology.orchestra.run.smithi012.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T06:28:21.897 INFO:teuthology.orchestra.run.smithi012.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 998 kB/s | 16 kB 00:00 2024-09-19T06:28:21.922 INFO:teuthology.orchestra.run.smithi012.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T06:28:21.940 INFO:teuthology.orchestra.run.smithi012.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.6 MB/s | 28 kB 00:00 2024-09-19T06:28:21.973 INFO:teuthology.orchestra.run.smithi012.stdout:(136/156): python3-kubernetes-26.1.0-2.el9.noar 4.8 MB/s | 1.0 MB 00:00 2024-09-19T06:28:21.990 INFO:teuthology.orchestra.run.smithi012.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-19T06:28:22.007 INFO:teuthology.orchestra.run.smithi012.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-19T06:28:22.025 INFO:teuthology.orchestra.run.smithi012.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-19T06:28:22.050 INFO:teuthology.orchestra.run.smithi012.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T06:28:22.075 INFO:teuthology.orchestra.run.smithi012.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T06:28:22.100 INFO:teuthology.orchestra.run.smithi012.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T06:28:22.142 INFO:teuthology.orchestra.run.smithi012.stdout:(143/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-19T06:28:22.167 INFO:teuthology.orchestra.run.smithi012.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T06:28:22.181 INFO:teuthology.orchestra.run.smithi016.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 17 kB/s | 35 kB 00:02 2024-09-19T06:28:22.192 INFO:teuthology.orchestra.run.smithi012.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-19T06:28:22.206 INFO:teuthology.orchestra.run.smithi016.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 123 kB/s | 250 kB 00:02 2024-09-19T06:28:22.218 INFO:teuthology.orchestra.run.smithi012.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T06:28:22.243 INFO:teuthology.orchestra.run.smithi012.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-19T06:28:22.368 INFO:teuthology.orchestra.run.smithi012.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-19T06:28:22.440 INFO:teuthology.orchestra.run.smithi016.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.2 MB/s | 5.1 MB 00:02 2024-09-19T06:28:22.502 INFO:teuthology.orchestra.run.smithi012.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T06:28:22.561 INFO:teuthology.orchestra.run.smithi012.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-19T06:28:22.677 INFO:teuthology.orchestra.run.smithi012.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 351 kB/s | 41 kB 00:00 2024-09-19T06:28:22.811 INFO:teuthology.orchestra.run.smithi012.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 5.2 MB/s | 2.3 MB 00:00 2024-09-19T06:28:22.937 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:28:22.945 INFO:teuthology.orchestra.run.smithi012.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-19T06:28:22.983 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:28:23.003 INFO:teuthology.orchestra.run.smithi012.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 764 kB/s | 249 kB 00:00 2024-09-19T06:28:23.220 INFO:teuthology.orchestra.run.smithi012.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.7 MB/s | 2.4 MB 00:00 2024-09-19T06:28:23.437 INFO:teuthology.orchestra.run.smithi012.stdout:(156/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.9 MB/s | 1.8 MB 00:00 2024-09-19T06:28:23.442 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:28:23.442 INFO:teuthology.orchestra.run.smithi012.stdout:Total 9.5 MB/s | 226 MB 00:23 2024-09-19T06:28:23.524 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:28:23.562 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:28:23.649 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:28:23.650 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:28:23.650 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:28:23.650 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:23.679 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:28:24.282 INFO:teuthology.orchestra.run.smithi016.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 37 kB/s | 77 kB 00:02 2024-09-19T06:28:24.332 INFO:teuthology.orchestra.run.smithi016.stdout:(86/156): python3-oauthlib-3.1.1-5.el9.noarch.r 103 kB/s | 222 kB 00:02 2024-09-19T06:28:24.728 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-19T06:28:24.897 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-19T06:28:24.897 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-19T06:28:26.307 INFO:teuthology.orchestra.run.smithi016.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 11 kB/s | 42 kB 00:03 2024-09-19T06:28:26.374 INFO:teuthology.orchestra.run.smithi016.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 78 kB/s | 159 kB 00:02 2024-09-19T06:28:26.425 INFO:teuthology.orchestra.run.smithi016.stdout:(89/156): python3-protobuf-3.14.0-13.el9.noarch 126 kB/s | 269 kB 00:02 2024-09-19T06:28:26.775 INFO:teuthology.orchestra.run.smithi016.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 127 kB/s | 51 kB 00:00 2024-09-19T06:28:26.800 INFO:teuthology.orchestra.run.smithi016.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 143 kB/s | 54 kB 00:00 2024-09-19T06:28:26.842 INFO:teuthology.orchestra.run.smithi016.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 999 kB/s | 42 kB 00:00 2024-09-19T06:28:26.892 INFO:teuthology.orchestra.run.smithi016.stdout:(93/156): python3-pyasn1-modules-0.4.8-6.el9.no 477 kB/s | 279 kB 00:00 2024-09-19T06:28:26.909 INFO:teuthology.orchestra.run.smithi016.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 662 kB/s | 44 kB 00:00 2024-09-19T06:28:26.959 INFO:teuthology.orchestra.run.smithi016.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-19T06:28:26.985 INFO:teuthology.orchestra.run.smithi016.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-19T06:28:27.230 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-19T06:28:27.231 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-19T06:28:29.043 INFO:teuthology.orchestra.run.smithi016.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 23 kB/s | 47 kB 00:02 2024-09-19T06:28:29.135 INFO:teuthology.orchestra.run.smithi016.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 141 kB/s | 304 kB 00:02 2024-09-19T06:28:31.085 INFO:teuthology.orchestra.run.smithi016.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 28 kB/s | 58 kB 00:02 2024-09-19T06:28:31.119 INFO:teuthology.orchestra.run.smithi016.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 48 kB/s | 96 kB 00:01 2024-09-19T06:28:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 21 kB/s | 45 kB 00:02 2024-09-19T06:28:33.261 INFO:teuthology.orchestra.run.smithi016.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 29 kB/s | 64 kB 00:02 2024-09-19T06:28:33.345 INFO:teuthology.orchestra.run.smithi016.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-19T06:28:33.395 INFO:teuthology.orchestra.run.smithi016.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 6.3 MB/s | 863 kB 00:00 2024-09-19T06:28:33.445 INFO:teuthology.orchestra.run.smithi016.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.3 MB/s | 548 kB 00:00 2024-09-19T06:28:33.471 INFO:teuthology.orchestra.run.smithi016.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-19T06:28:33.504 INFO:teuthology.orchestra.run.smithi016.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-19T06:28:33.530 INFO:teuthology.orchestra.run.smithi016.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T06:28:33.555 INFO:teuthology.orchestra.run.smithi016.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T06:28:33.580 INFO:teuthology.orchestra.run.smithi016.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T06:28:33.614 INFO:teuthology.orchestra.run.smithi016.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-19T06:28:33.664 INFO:teuthology.orchestra.run.smithi016.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T06:28:33.731 INFO:teuthology.orchestra.run.smithi016.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-19T06:28:33.757 INFO:teuthology.orchestra.run.smithi016.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:28:33.773 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-19T06:28:33.782 INFO:teuthology.orchestra.run.smithi016.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T06:28:33.807 INFO:teuthology.orchestra.run.smithi016.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-19T06:28:33.833 INFO:teuthology.orchestra.run.smithi016.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-09-19T06:28:33.858 INFO:teuthology.orchestra.run.smithi016.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T06:28:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:28:33.883 INFO:teuthology.orchestra.run.smithi016.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T06:28:33.908 INFO:teuthology.orchestra.run.smithi016.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T06:28:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:28:33.934 INFO:teuthology.orchestra.run.smithi016.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T06:28:33.967 INFO:teuthology.orchestra.run.smithi016.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-19T06:28:33.984 INFO:teuthology.orchestra.run.smithi016.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 638 kB/s | 11 kB 00:00 2024-09-19T06:28:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:28:34.001 INFO:teuthology.orchestra.run.smithi016.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-19T06:28:34.018 INFO:teuthology.orchestra.run.smithi016.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.3 MB/s | 23 kB 00:00 2024-09-19T06:28:34.035 INFO:teuthology.orchestra.run.smithi016.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-19T06:28:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:28:34.052 INFO:teuthology.orchestra.run.smithi016.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-19T06:28:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:28:34.111 INFO:teuthology.orchestra.run.smithi016.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-09-19T06:28:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:28:34.128 INFO:teuthology.orchestra.run.smithi016.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T06:28:34.153 INFO:teuthology.orchestra.run.smithi016.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T06:28:34.187 INFO:teuthology.orchestra.run.smithi016.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-19T06:28:34.204 INFO:teuthology.orchestra.run.smithi016.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T06:28:34.221 INFO:teuthology.orchestra.run.smithi016.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 990 kB/s | 16 kB 00:00 2024-09-19T06:28:34.246 INFO:teuthology.orchestra.run.smithi016.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T06:28:34.271 INFO:teuthology.orchestra.run.smithi016.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-19T06:28:34.297 INFO:teuthology.orchestra.run.smithi016.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-19T06:28:34.313 INFO:teuthology.orchestra.run.smithi016.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 733 kB/s | 31 kB 00:00 2024-09-19T06:28:34.339 INFO:teuthology.orchestra.run.smithi016.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-09-19T06:28:34.356 INFO:teuthology.orchestra.run.smithi016.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-19T06:28:34.373 INFO:teuthology.orchestra.run.smithi016.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-19T06:28:34.398 INFO:teuthology.orchestra.run.smithi016.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-19T06:28:34.424 INFO:teuthology.orchestra.run.smithi016.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T06:28:34.449 INFO:teuthology.orchestra.run.smithi016.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T06:28:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:28:34.474 INFO:teuthology.orchestra.run.smithi016.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-19T06:28:34.508 INFO:teuthology.orchestra.run.smithi016.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-19T06:28:34.533 INFO:teuthology.orchestra.run.smithi016.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-19T06:28:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:28:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:28:34.709 INFO:teuthology.orchestra.run.smithi016.stdout:(147/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.0 MB/s | 16 MB 00:07 2024-09-19T06:28:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:28:34.768 INFO:teuthology.orchestra.run.smithi016.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-19T06:28:34.815 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:28:34.858 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:28:34.959 INFO:teuthology.orchestra.run.smithi016.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 3.4 MB 00:00 2024-09-19T06:28:35.035 INFO:teuthology.orchestra.run.smithi016.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 9.7 MB/s | 3.2 MB 00:00 2024-09-19T06:28:35.049 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:28:35.102 INFO:teuthology.orchestra.run.smithi016.stdout:(151/156): NetworkManager-1.51.0-1.el9.x86_64.r 7.0 MB/s | 2.3 MB 00:00 2024-09-19T06:28:35.104 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:28:35.143 INFO:teuthology.orchestra.run.smithi016.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 377 kB/s | 41 kB 00:00 2024-09-19T06:28:35.150 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:28:35.169 INFO:teuthology.orchestra.run.smithi016.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.7 MB/s | 249 kB 00:00 2024-09-19T06:28:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:28:35.261 INFO:teuthology.orchestra.run.smithi016.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-19T06:28:35.282 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:28:35.311 INFO:teuthology.orchestra.run.smithi016.stdout:(155/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.1 MB/s | 1.8 MB 00:00 2024-09-19T06:28:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:28:35.375 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:28:35.394 INFO:teuthology.orchestra.run.smithi016.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-19T06:28:35.396 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:28:35.400 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:28:35.400 INFO:teuthology.orchestra.run.smithi016.stdout:Total 4.9 MB/s | 226 MB 00:45 2024-09-19T06:28:35.451 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:28:35.451 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2024-09-19T06:28:35.451 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2024-09-19T06:28:35.451 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2024-09-19T06:28:35.452 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2024-09-19T06:28:35.452 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2024-09-19T06:28:35.452 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /root 2024-09-19T06:28:35.452 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2024-09-19T06:28:35.452 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:35.570 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:28:35.623 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:28:35.640 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:28:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:28:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:28:35.640 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:35.729 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:28:35.848 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:28:35.968 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:28:36.041 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:28:36.280 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:28:36.392 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:28:36.495 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:28:36.530 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:28:36.573 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:28:36.586 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-09-19T06:28:36.648 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:28:36.707 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:28:36.748 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:28:36.749 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-09-19T06:28:36.749 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-09-19T06:28:36.792 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:28:36.824 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:28:36.851 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:28:36.922 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:28:36.975 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:28:37.005 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:28:37.057 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:28:37.118 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:28:37.135 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:28:37.146 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:28:37.146 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:28:37.146 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:28:37.146 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:28:37.146 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:28:37.146 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:37.167 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:28:37.211 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:28:37.239 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:28:37.312 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:28:37.354 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:28:37.369 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:28:37.392 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:28:37.392 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:28:37.392 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:28:37.392 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:28:37.393 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:28:37.393 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:37.431 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:28:37.584 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:28:37.641 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:28:37.828 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:28:37.852 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:28:37.852 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:28:37.852 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:28:37.852 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:28:37.852 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:28:37.853 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:37.958 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:28:38.005 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:28:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:28:38.193 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:28:38.253 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:28:38.279 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:28:38.303 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:28:38.322 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:28:38.367 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:28:38.381 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:28:38.404 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:28:38.446 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:28:38.469 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:28:38.600 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:28:38.605 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:28:38.645 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:28:38.657 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-09-19T06:28:38.657 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-09-19T06:28:38.665 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:28:38.677 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:28:38.704 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:28:38.721 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:28:38.804 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:28:38.849 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:28:38.885 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:28:38.933 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:28:38.968 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:28:39.012 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:28:39.054 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:28:39.084 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:28:39.120 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:28:39.151 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:28:39.197 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:28:39.214 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:28:39.243 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:28:39.246 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:28:39.289 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:28:39.395 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:28:39.430 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:28:39.471 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:28:39.503 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:28:39.528 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:28:39.629 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:28:39.760 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:28:39.802 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:28:39.831 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:28:39.864 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:28:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:28:39.944 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:28:39.973 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:28:40.008 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:28:40.041 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:28:40.083 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:28:40.125 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:28:40.217 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:28:40.260 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:28:40.291 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:28:40.299 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:28:40.336 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:28:40.417 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:28:40.484 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:28:41.250 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:28:41.301 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:28:41.305 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:28:41.336 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:28:41.339 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:28:41.441 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:28:41.451 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:28:41.503 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:28:41.548 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:28:41.608 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:28:41.639 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:28:41.639 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:28:41.664 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:28:41.664 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:28:41.664 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:28:41.664 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:28:41.664 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:28:41.664 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:41.691 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:28:41.715 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:28:41.728 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:28:41.826 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:28:41.871 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:28:41.900 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:28:41.939 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:28:42.019 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:28:42.715 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:28:42.800 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:28:42.834 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:28:42.839 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:28:42.857 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:28:42.858 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:28:42.858 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:28:42.858 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:28:42.858 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:28:42.858 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:42.901 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:28:42.924 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:28:42.924 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:28:42.924 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:28:42.925 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:42.976 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:28:43.000 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:28:43.001 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:28:43.001 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:28:43.001 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:28:43.001 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:28:43.001 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:43.302 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:28:43.326 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:28:43.326 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:28:43.326 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:28:43.326 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:28:43.326 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:28:43.327 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:44.193 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:28:44.292 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:28:44.329 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:28:44.386 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:28:44.713 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:28:44.766 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:28:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:28:44.896 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:28:44.933 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:28:45.137 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-09-19T06:28:45.257 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:28:45.296 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:28:45.358 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:28:45.391 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:28:45.417 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:28:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:28:45.459 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:28:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:28:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:28:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:28:45.807 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:28:45.909 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:28:46.034 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:28:46.069 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:28:46.144 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:28:46.181 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:28:46.336 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:28:46.396 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:28:46.423 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:28:46.528 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:28:46.558 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:28:46.620 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:28:46.642 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:28:46.665 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:28:46.869 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:28:47.007 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:28:47.141 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:28:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:28:47.317 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:28:47.545 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:28:47.657 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:28:47.761 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:28:47.797 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:28:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:28:47.880 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:28:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:28:47.922 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:28:47.962 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:28:47.967 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:28:47.995 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:28:48.005 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:28:48.007 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:28:48.030 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:28:48.043 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:28:48.054 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:28:48.087 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:28:48.123 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:28:48.193 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:28:48.215 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:28:48.254 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:28:48.260 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:28:48.284 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:28:48.290 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:28:48.320 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:28:48.328 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:28:48.366 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:28:48.407 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:28:48.439 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:28:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:28:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:28:48.593 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:28:48.636 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:28:48.643 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:28:48.671 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:28:48.719 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:28:48.763 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:28:48.763 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:28:48.763 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:28:48.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:28:48.814 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:28:48.855 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:28:48.914 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:28:49.010 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:28:49.048 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:28:49.069 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:28:49.459 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:28:49.544 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:28:49.579 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:28:49.614 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:28:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:28:49.694 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:28:49.859 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:28:49.917 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:28:49.919 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:28:49.972 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:28:50.003 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:28:50.035 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:28:50.047 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:28:50.084 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:28:50.116 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:28:50.129 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:28:50.155 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:28:50.181 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:28:50.185 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:28:50.207 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:28:50.207 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:28:50.220 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:28:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:28:50.291 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:28:50.291 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:28:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:28:50.366 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:28:50.391 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:28:50.397 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:28:50.397 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:28:50.448 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:28:50.491 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:28:50.532 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:28:50.585 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:28:50.585 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:28:50.639 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:28:50.669 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:28:50.682 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:28:50.722 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:28:50.733 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:28:50.748 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:28:50.773 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:28:50.849 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:28:50.986 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:28:51.022 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:28:51.059 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:28:51.093 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:28:51.133 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:28:51.172 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:28:51.210 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:28:51.253 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:28:51.286 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:28:51.328 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:28:51.363 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:28:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:28:51.502 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:28:51.533 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:28:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:28:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:28:52.454 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:28:52.498 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:28:52.532 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:28:52.634 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:28:52.696 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:28:52.749 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:28:52.840 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:28:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:28:53.067 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:28:53.099 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:28:53.178 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:28:53.847 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:28:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:28:55.237 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:28:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:28:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:28:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:28:55.727 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:28:55.780 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:28:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:28:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:28:55.938 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:28:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:28:56.463 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:28:56.463 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:28:56.463 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:28:56.463 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:28:56.463 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:28:56.463 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:28:56.463 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:28:56.463 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:28:56.464 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:28:56.465 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:28:56.466 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:28:56.467 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:28:56.468 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:28:56.468 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:28:56.468 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:28:56.468 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:28:56.468 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:28:56.468 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:28:56.468 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:28:56.468 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:28:56.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:28:56.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:28:56.471 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:28:56.472 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:28:56.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:28:56.474 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:28:56.475 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:28:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:28:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:28:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:28:56.576 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:28:58.960 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:28:58.996 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:28:58.996 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:58.996 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-09-19T06:28:58.996 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:28:58.996 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:28:58.996 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:28:58.996 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:28:58.996 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.996 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.996 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:28:58.997 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.998 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:28:58.999 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.000 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:28:59.001 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.002 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:28:59.003 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:28:59.004 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:28:59.005 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:28:59.006 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:28:59.007 INFO:teuthology.orchestra.run.smithi173.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:28:59.008 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:28:59.008 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:28:59.008 INFO:teuthology.orchestra.run.smithi173.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:28:59.008 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:28:59.008 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:28:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:28:59.009 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:28:59.009 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:28:59.009 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-19T06:28:59.415 DEBUG:teuthology.parallel:result is None 2024-09-19T06:28:59.571 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:28:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:28:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:28:59.708 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:28:59.708 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:28:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:28:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:29:00.961 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:29:00.961 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-09-19T06:29:00.961 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-09-19T06:29:00.961 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-09-19T06:29:00.961 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-09-19T06:29:00.962 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-09-19T06:29:00.962 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-09-19T06:29:00.962 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-09-19T06:29:00.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:01.153 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:29:01.170 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:29:01.170 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:01.170 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:29:01.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:02.711 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:29:02.740 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:29:02.740 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:02.740 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:29:02.740 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:29:02.740 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:29:02.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:02.978 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:29:03.003 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:29:03.004 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:03.004 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:29:03.004 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:29:03.004 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:29:03.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:03.462 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:29:03.488 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:29:03.488 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:03.488 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:29:03.488 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:29:03.488 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:29:03.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:03.593 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:29:03.651 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:29:03.723 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:29:03.926 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:29:03.972 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:29:04.052 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:29:04.151 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:29:04.309 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:29:04.357 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:29:04.395 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:29:04.431 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:29:04.903 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:29:04.930 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:29:04.962 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:29:05.027 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:29:05.061 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:29:06.174 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:29:06.212 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:29:07.231 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:29:07.262 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:29:07.373 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:29:07.558 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:29:07.590 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:29:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:29:07.616 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:07.616 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:29:07.616 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:29:07.616 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:29:07.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:07.666 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:29:07.678 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:29:07.780 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:29:07.842 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:29:08.817 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:29:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:29:08.877 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:29:08.877 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:08.877 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:29:08.878 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:29:08.878 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:29:08.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:08.918 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:29:08.944 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:29:08.945 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:08.945 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:29:08.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:08.994 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:29:09.019 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:29:09.019 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:09.019 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:29:09.020 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:29:09.020 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:29:09.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:29:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:29:09.362 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:09.362 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:29:09.362 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:29:09.362 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:29:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:29:12.200 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /sys 2024-09-19T06:29:12.200 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /proc 2024-09-19T06:29:12.200 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /mnt 2024-09-19T06:29:12.200 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /var/tmp 2024-09-19T06:29:12.200 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /home 2024-09-19T06:29:12.200 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /root 2024-09-19T06:29:12.200 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /tmp 2024-09-19T06:29:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:12.376 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:29:12.391 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:29:12.391 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:12.391 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:29:12.391 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:13.921 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:29:13.947 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:29:13.947 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:13.947 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:29:13.947 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:29:13.947 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:29:13.947 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:14.180 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:29:14.203 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:29:14.203 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:14.203 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:29:14.203 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:29:14.203 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:29:14.204 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:29:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:29:14.290 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:29:14.321 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:29:14.349 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:29:14.556 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:29:14.604 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:29:14.633 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:29:14.664 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:29:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:29:14.687 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:29:14.687 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:14.687 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:29:14.687 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:29:14.688 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:29:14.688 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:29:14.804 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:29:14.861 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:29:14.925 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:29:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:29:15.166 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:29:15.247 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:29:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:29:15.336 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:29:15.349 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:29:15.371 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:29:15.476 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:29:15.524 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:29:15.556 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:29:15.584 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:29:16.038 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:29:16.066 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:29:16.098 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:29:16.162 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:29:16.189 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:29:16.290 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:29:16.370 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:29:16.417 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:29:16.518 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:29:16.556 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:29:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:29:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:29:16.633 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:29:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:29:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:29:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:29:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:29:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:29:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:29:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:29:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:29:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:29:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:29:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:29:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:29:18.344 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:29:18.375 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:29:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:29:18.653 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:29:18.685 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:29:18.708 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:29:18.709 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:18.709 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:29:18.709 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:29:18.709 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:29:18.709 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:29:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:29:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:29:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:29:19.903 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:29:19.947 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:29:19.970 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:29:19.970 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:19.970 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:29:19.970 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:29:19.971 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:29:19.971 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:20.023 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:29:20.045 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:29:20.045 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:20.045 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:29:20.045 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:20.099 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:29:20.121 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:29:20.121 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:20.121 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:29:20.121 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:29:20.121 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:29:20.121 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:20.449 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:29:20.472 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:29:20.472 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:20.473 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:29:20.473 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:29:20.473 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:29:20.473 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:29:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:29:23.103 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:29:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:29:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:29:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:29:23.104 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:29:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:29:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:29:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:29:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:29:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:29:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:29:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:29:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:29:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:29:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:29:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:29:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:29:23.106 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:29:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:29:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:29:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:29:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:29:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:29:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:29:23.107 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:29:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:29:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:29:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:29:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:29:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:29:23.108 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:29:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:29:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:29:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:29:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:29:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:29:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:29:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:29:23.109 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:29:23.110 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:29:23.111 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:29:23.112 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:29:23.113 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:29:23.114 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:29:23.115 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:29:23.116 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:29:23.117 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:29:23.118 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:29:23.119 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:29:25.279 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:29:25.320 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:29:25.361 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:29:25.393 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:29:25.420 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:29:25.612 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:29:25.659 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:29:25.689 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:29:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:29:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:29:25.781 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:29:25.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:25.781 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-09-19T06:29:25.781 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:29:25.781 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:29:25.781 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:29:25.781 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:29:25.781 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.781 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.781 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:29:25.784 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:25.785 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.786 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:29:25.787 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:29:25.788 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:29:25.789 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:29:25.790 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:29:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:29:25.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:29:25.793 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:29:25.794 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:29:25.795 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:29:25.796 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.796 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.796 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:25.796 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:29:25.796 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:29:25.796 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:29:25.796 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:29:25.796 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:29:25.796 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:29:25.797 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:29:25.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:29:25.797 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-19T06:29:26.206 DEBUG:teuthology.parallel:result is None 2024-09-19T06:29:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:29:26.421 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:29:26.441 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:29:27.320 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:29:27.410 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:29:27.451 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:29:27.543 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:29:27.588 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:29:27.614 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:29:27.640 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:29:27.640 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:29:27.707 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:29:27.707 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:29:27.775 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:29:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:29:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:29:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:29:27.993 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:29:27.993 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:29:28.086 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:29:28.153 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:29:33.793 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:29:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:29:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:29:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:29:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:29:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:29:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:29:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:29:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:29:33.794 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:29:33.795 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:29:33.796 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:29:33.797 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:29:33.798 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:29:33.799 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:29:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:29:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:29:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:29:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:29:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:29:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:29:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:29:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:29:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:29:33.800 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:29:33.801 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:29:33.802 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:29:33.803 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:29:33.804 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:29:33.805 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:29:33.806 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:29:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:29:33.807 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:29:36.789 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:29:36.789 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:36.789 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2024-09-19T06:29:36.789 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:29:36.789 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:29:36.789 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:29:36.789 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:29:36.789 INFO:teuthology.orchestra.run.smithi016.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.789 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.790 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:29:36.790 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:29:36.790 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-09-19T06:29:36.790 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:29:36.790 INFO:teuthology.orchestra.run.smithi016.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:29:36.790 INFO:teuthology.orchestra.run.smithi016.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:29:36.790 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:29:36.790 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.790 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:36.791 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:29:36.792 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:29:36.793 INFO:teuthology.orchestra.run.smithi016.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:29:36.793 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:29:36.793 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:29:36.793 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:29:36.793 INFO:teuthology.orchestra.run.smithi016.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:29:36.793 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:29:36.793 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:29:36.793 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:29:36.793 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:29:36.793 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:29:36.794 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.794 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.794 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.794 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:29:36.794 INFO:teuthology.orchestra.run.smithi016.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:29:36.794 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:29:36.794 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:29:36.794 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:29:36.794 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.794 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:29:36.795 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:29:36.796 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:29:36.797 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:29:36.798 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:29:36.799 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:29:36.800 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:29:36.801 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.802 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:29:36.803 INFO:teuthology.orchestra.run.smithi016.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:29:36.803 INFO:teuthology.orchestra.run.smithi016.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:29:36.803 INFO:teuthology.orchestra.run.smithi016.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:29:36.803 INFO:teuthology.orchestra.run.smithi016.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:29:36.803 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:29:36.803 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:29:36.803 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:29:36.804 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:29:36.804 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-09-19T06:29:37.322 DEBUG:teuthology.parallel:result is None 2024-09-19T06:29:37.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:29:37.471 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:29:37.498 INFO:teuthology.orchestra.run.smithi012.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:29:37.499 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:29:37.499 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:29:37.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:29:37.641 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:29:37.665 INFO:teuthology.orchestra.run.smithi016.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:29:37.666 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:29:37.666 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:29:37.669 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:29:37.829 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:29:37.856 INFO:teuthology.orchestra.run.smithi173.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:29:37.856 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:29:37.856 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:29:37.858 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T06:29:37.858 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:29:37.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:29:37.892 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:29:37.892 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:29:37.924 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:29:37.924 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:29:37.956 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T06:29:37.956 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:29:37.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:29:37.985 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:29:38.055 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:29:38.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:29:38.085 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:29:38.154 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:29:38.154 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:29:38.183 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:29:38.252 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T06:29:38.252 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:29:38.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:29:38.282 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:29:38.350 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:29:38.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:29:38.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:29:38.449 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:29:38.450 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:29:38.475 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:29:38.540 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T06:29:38.540 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:29:38.541 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:29:38.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:29:38.633 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:29:38.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:29:38.662 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:29:38.731 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:29:38.731 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:29:38.757 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:29:38.822 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T06:29:38.919 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T06:29:38.919 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:29:38.920 INFO:tasks.cephadm:Cluster fsid is 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:29:38.920 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T06:29:38.920 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.12', 'mon.b': '172.21.15.16', 'mon.c': '172.21.15.173'} 2024-09-19T06:29:38.920 INFO:tasks.cephadm:First mon is mon.a on smithi012 2024-09-19T06:29:38.920 INFO:tasks.cephadm:First mgr is x 2024-09-19T06:29:38.920 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T06:29:38.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname $(hostname -s) 2024-09-19T06:29:38.946 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname $(hostname -s) 2024-09-19T06:29:38.976 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname $(hostname -s) 2024-09-19T06:29:39.002 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T06:29:39.002 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:29:39.154 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T06:29:39.293 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:29:39.294 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T06:29:39.295 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T06:29:39.295 DEBUG:teuthology.orchestra.run.smithi012:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:29:39.670 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:29 /home/ubuntu/cephtest/cephadm 2024-09-19T06:29:39.671 DEBUG:teuthology.orchestra.run.smithi016:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:29:40.057 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:29 /home/ubuntu/cephtest/cephadm 2024-09-19T06:29:40.057 DEBUG:teuthology.orchestra.run.smithi173:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:29:40.443 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:29 /home/ubuntu/cephtest/cephadm 2024-09-19T06:29:40.443 DEBUG:teuthology.orchestra.run.smithi012:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:29:40.463 DEBUG:teuthology.orchestra.run.smithi016:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:29:40.482 DEBUG:teuthology.orchestra.run.smithi173:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:29:40.515 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T06:29:40.515 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:29:40.518 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:29:40.524 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:29:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:29:42.114 INFO:teuthology.orchestra.run.smithi012.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:29:42.362 INFO:teuthology.orchestra.run.smithi016.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:30:10.190 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-19T06:30:10.191 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:30:10.191 INFO:teuthology.orchestra.run.smithi173.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:30:10.191 INFO:teuthology.orchestra.run.smithi173.stdout: "repo_digests": [ 2024-09-19T06:30:10.191 INFO:teuthology.orchestra.run.smithi173.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:30:10.191 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-19T06:30:10.191 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-19T06:30:11.425 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:30:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:30:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:30:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: "repo_digests": [ 2024-09-19T06:30:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:30:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:30:11.426 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:30:11.948 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-19T06:30:11.948 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:30:11.948 INFO:teuthology.orchestra.run.smithi016.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:30:11.949 INFO:teuthology.orchestra.run.smithi016.stdout: "repo_digests": [ 2024-09-19T06:30:11.949 INFO:teuthology.orchestra.run.smithi016.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:30:11.949 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-09-19T06:30:11.949 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-19T06:30:11.979 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph 2024-09-19T06:30:12.010 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph 2024-09-19T06:30:12.040 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph 2024-09-19T06:30:12.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /etc/ceph 2024-09-19T06:30:12.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /etc/ceph 2024-09-19T06:30:12.131 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /etc/ceph 2024-09-19T06:30:12.160 INFO:tasks.cephadm:Writing seed config... 2024-09-19T06:30:12.161 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T06:30:12.161 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T06:30:12.161 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T06:30:12.161 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T06:30:12.161 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T06:30:12.161 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T06:30:12.161 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T06:30:12.161 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T06:30:12.161 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T06:30:12.161 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T06:30:12.162 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T06:30:12.163 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T06:30:12.164 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T06:30:12.165 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T06:30:12.166 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:30:12.166 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T06:30:12.185 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 8bf314c8-7650-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T06:30:12.186 DEBUG:teuthology.orchestra.run.smithi012:mon.a> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T06:30:12.228 DEBUG:teuthology.orchestra.run.smithi012:mgr.x> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T06:30:12.271 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T06:30:12.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.12 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:30:12.485 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:12.486 INFO:teuthology.orchestra.run.smithi012.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '8bf314c8-7650-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.12', '--skip-admin-label'] 2024-09-19T06:30:12.486 INFO:teuthology.orchestra.run.smithi012.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T06:30:12.486 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying podman|docker is present... 2024-09-19T06:30:12.510 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:30:12.511 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying lvm2 is present... 2024-09-19T06:30:12.511 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying time synchronization is in place... 2024-09-19T06:30:12.519 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:30:12.519 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:30:12.525 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:30:12.525 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-19T06:30:12.532 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2024-09-19T06:30:12.539 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2024-09-19T06:30:12.539 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:30:12.539 INFO:teuthology.orchestra.run.smithi012.stdout:Repeating the final host check... 2024-09-19T06:30:12.561 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:30:12.561 INFO:teuthology.orchestra.run.smithi012.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T06:30:12.561 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl is present 2024-09-19T06:30:12.561 INFO:teuthology.orchestra.run.smithi012.stdout:lvcreate is present 2024-09-19T06:30:12.568 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:30:12.568 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:30:12.574 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:30:12.574 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-19T06:30:12.581 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2024-09-19T06:30:12.588 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2024-09-19T06:30:12.588 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:30:12.589 INFO:teuthology.orchestra.run.smithi012.stdout:Host looks OK 2024-09-19T06:30:12.589 INFO:teuthology.orchestra.run.smithi012.stdout:Cluster fsid: 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:12.589 INFO:teuthology.orchestra.run.smithi012.stdout:Acquiring lock 139847768687616 on /run/cephadm/8bf314c8-7650-11ef-bceb-c7b262605968.lock 2024-09-19T06:30:12.589 INFO:teuthology.orchestra.run.smithi012.stdout:Lock 139847768687616 acquired on /run/cephadm/8bf314c8-7650-11ef-bceb-c7b262605968.lock 2024-09-19T06:30:12.589 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 3300 ... 2024-09-19T06:30:12.589 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 6789 ... 2024-09-19T06:30:12.590 INFO:teuthology.orchestra.run.smithi012.stdout:Base mon IP(s) is [172.21.15.12:3300, 172.21.15.12:6789], mon addrv is [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-19T06:30:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.12 metric 100 2024-09-19T06:30:12.593 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.12 metric 100 2024-09-19T06:30:12.596 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T06:30:12.596 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T06:30:12.596 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1796sec hoplimit 64 pref medium 2024-09-19T06:30:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T06:30:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T06:30:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:30:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T06:30:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-19T06:30:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:30:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2024-09-19T06:30:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2024-09-19T06:30:12.600 INFO:teuthology.orchestra.run.smithi012.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T06:30:12.600 INFO:teuthology.orchestra.run.smithi012.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T06:30:12.600 INFO:teuthology.orchestra.run.smithi012.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:30:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T06:30:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:30:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T06:30:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T06:30:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T06:30:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T06:30:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T06:30:23.477 INFO:teuthology.orchestra.run.smithi012.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T06:30:23.477 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T06:30:23.477 INFO:teuthology.orchestra.run.smithi012.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T06:30:26.530 INFO:teuthology.orchestra.run.smithi012.stdout:stat: stdout 167 167 2024-09-19T06:30:26.530 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial keys... 2024-09-19T06:30:27.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQACxetmV7J8MhAALAwJkea+wiwu4X7KR8Sd5Q== 2024-09-19T06:30:28.441 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQADxetmrjFRMxAAdcDYDCEjhpRpI91NPGTopQ== 2024-09-19T06:30:29.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQAExetmpk2jLRAAYNfUpXU3loTHlzP2DPVmfg== 2024-09-19T06:30:29.390 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial monmap... 2024-09-19T06:30:30.503 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:30:30.503 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T06:30:30.503 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:30.503 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:30:30.503 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool for a [v2:172.21.15.12:3300,v1:172.21.15.12:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:30:30.503 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-09-19T06:30:30.504 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: set fsid to 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:30.504 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:30:30.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:30:30.504 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mon... 2024-09-19T06:30:32.718 INFO:teuthology.orchestra.run.smithi012.stdout:create mon.a on 2024-09-19T06:30:32.927 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T06:30:33.081 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T06:30:33.272 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-8bf314c8-7650-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-8bf314c8-7650-11ef-bceb-c7b262605968.target. 2024-09-19T06:30:33.272 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-8bf314c8-7650-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-8bf314c8-7650-11ef-bceb-c7b262605968.target. 2024-09-19T06:30:33.522 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:30:33.522 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T06:30:33.692 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8bf314c8-7650-11ef-bceb-c7b262605968.target.wants/ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-8bf314c8-7650-11ef-bceb-c7b262605968@.service. 2024-09-19T06:30:34.178 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:34 smithi012 ceph-mon[30570]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:30:34.192 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:30:34.193 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-19T06:30:34.200 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:30:34.200 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-19T06:30:34.200 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-19T06:30:34.200 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:30:34.201 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon to start... 2024-09-19T06:30:34.201 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon... 2024-09-19T06:30:34.434 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:34 smithi012 bash[30551]: 64cb4589600989088208b6871f817d10de25aa23897ff68ffa6ecb866821013d 2024-09-19T06:30:34.434 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:34 smithi012 systemd[1]: Started Ceph mon.a for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:30:35.242 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout id: 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout services: 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.547502s) 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout data: 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T06:30:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T06:30:35.244 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T06:30:35.244 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:35.244 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.617+0000 7f99c87da640 1 Processor -- start 2024-09-19T06:30:35.244 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.617+0000 7f99c87da640 1 -- start start 2024-09-19T06:30:35.244 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.617+0000 7f99c87da640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c0107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:35.244 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.617+0000 7f99c87da640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01081a0 con 0x7f99c01077d0 2024-09-19T06:30:35.244 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.618+0000 7f99c6576640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c0107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:35.244 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.618+0000 7f99c6576640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c0107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35930/0 (socket says 172.21.15.12:35930) 2024-09-19T06:30:35.244 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.618+0000 7f99c6576640 1 -- 172.21.15.12:0/1310845408 learned_addr learned my addr 172.21.15.12:0/1310845408 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.618+0000 7f99c6576640 1 -- 172.21.15.12:0/1310845408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c01089d0 con 0x7f99c01077d0 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.620+0000 7f99c6576640 1 --2- 172.21.15.12:0/1310845408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c0107bd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009e80 tx=0x7f99b002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73c5262d59b42c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.620+0000 7f99c5574640 1 -- 172.21.15.12:0/1310845408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b0036070 con 0x7f99c01077d0 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.621+0000 7f99c5574640 1 -- 172.21.15.12:0/1310845408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b0031400 con 0x7f99c01077d0 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.621+0000 7f99c5574640 1 -- 172.21.15.12:0/1310845408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b0031700 con 0x7f99c01077d0 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.621+0000 7f99c87da640 1 -- 172.21.15.12:0/1310845408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 msgr2=0x7f99c0107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.621+0000 7f99c87da640 1 --2- 172.21.15.12:0/1310845408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c0107bd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009e80 tx=0x7f99b002a7a0 comp rx=0 tx=0).stop 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.621+0000 7f99c87da640 1 -- 172.21.15.12:0/1310845408 shutdown_connections 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.621+0000 7f99c87da640 1 --2- 172.21.15.12:0/1310845408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c0107bd0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.621+0000 7f99c87da640 1 -- 172.21.15.12:0/1310845408 >> 172.21.15.12:0/1310845408 conn(0x7f99c0102f60 msgr2=0x7f99c01053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.621+0000 7f99c87da640 1 -- 172.21.15.12:0/1310845408 shutdown_connections 2024-09-19T06:30:35.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.621+0000 7f99c87da640 1 -- 172.21.15.12:0/1310845408 wait complete. 2024-09-19T06:30:35.246 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.622+0000 7f99c87da640 1 Processor -- start 2024-09-19T06:30:35.246 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.622+0000 7f99c87da640 1 -- start start 2024-09-19T06:30:35.246 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.622+0000 7f99c87da640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c007daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:35.246 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.622+0000 7f99c87da640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0108f00 con 0x7f99c01077d0 2024-09-19T06:30:35.246 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.622+0000 7f99c6576640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c007daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:35.246 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.622+0000 7f99c6576640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c007daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35942/0 (socket says 172.21.15.12:35942) 2024-09-19T06:30:35.246 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.622+0000 7f99c6576640 1 -- 172.21.15.12:0/2847751990 learned_addr learned my addr 172.21.15.12:0/2847751990 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.623+0000 7f99c6576640 1 -- 172.21.15.12:0/2847751990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c007e030 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.623+0000 7f99c6576640 1 --2- 172.21.15.12:0/2847751990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c007daf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f99b0034040 tx=0x7f99b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.623+0000 7f99bf7fe640 1 -- 172.21.15.12:0/2847751990 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b0041070 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.623+0000 7f99bf7fe640 1 -- 172.21.15.12:0/2847751990 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b003c650 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.623+0000 7f99bf7fe640 1 -- 172.21.15.12:0/2847751990 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99b0036040 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.623+0000 7f99c87da640 1 -- 172.21.15.12:0/2847751990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c007c220 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.623+0000 7f99c87da640 1 -- 172.21.15.12:0/2847751990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c007c760 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.623+0000 7f99bf7fe640 1 -- 172.21.15.12:0/2847751990 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f99b0044070 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.623+0000 7f99bf7fe640 1 -- 172.21.15.12:0/2847751990 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f99b0046c10 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.624+0000 7f99c87da640 1 -- 172.21.15.12:0/2847751990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c0109550 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.626+0000 7f99bf7fe640 1 -- 172.21.15.12:0/2847751990 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f99b003c950 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.688+0000 7f99c87da640 1 -- 172.21.15.12:0/2847751990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f99c007cec0 con 0x7f99c01077d0 2024-09-19T06:30:35.247 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.688+0000 7f99bf7fe640 1 -- 172.21.15.12:0/2847751990 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f99b003cb30 con 0x7f99c01077d0 2024-09-19T06:30:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.689+0000 7f99c87da640 1 -- 172.21.15.12:0/2847751990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 msgr2=0x7f99c007daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.689+0000 7f99c87da640 1 --2- 172.21.15.12:0/2847751990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c007daf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f99b0034040 tx=0x7f99b0004a40 comp rx=0 tx=0).stop 2024-09-19T06:30:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.689+0000 7f99c87da640 1 -- 172.21.15.12:0/2847751990 shutdown_connections 2024-09-19T06:30:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.689+0000 7f99c87da640 1 --2- 172.21.15.12:0/2847751990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c01077d0 0x7f99c007daf0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.690+0000 7f99c87da640 1 -- 172.21.15.12:0/2847751990 >> 172.21.15.12:0/2847751990 conn(0x7f99c0102f60 msgr2=0x7f99c018f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.690+0000 7f99c87da640 1 -- 172.21.15.12:0/2847751990 shutdown_connections 2024-09-19T06:30:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:34.690+0000 7f99c87da640 1 -- 172.21.15.12:0/2847751990 wait complete. 2024-09-19T06:30:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:mon is available 2024-09-19T06:30:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T06:30:35.335 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: monmap epoch 1 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: last_changed 2024-09-19T06:30:29.711565+0000 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: created 2024-09-19T06:30:29.711565+0000 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: min_mon_release 19 (squid) 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: election_strategy: 1 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: fsmap 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: mgrmap e1: no daemons active 2024-09-19T06:30:35.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:35 smithi012 ceph-mon[30570]: from='client.? 172.21.15.12:0/2847751990' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T06:30:36.224 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:36 smithi012 ceph-mon[30570]: from='client.? 172.21.15.12:0/3441900596' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:30:36.224 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:36 smithi012 ceph-mon[30570]: from='client.? 172.21.15.12:0/3441900596' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T06:30:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:30:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:30:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.598+0000 7fc7541b1640 1 Processor -- start 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.598+0000 7fc7541b1640 1 -- start start 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.598+0000 7fc7541b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c07c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.598+0000 7fc7541b1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c07c830 con 0x7fc74c07de00 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.598+0000 7fc751f4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c07c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.598+0000 7fc751f4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c07c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35958/0 (socket says 172.21.15.12:35958) 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.598+0000 7fc751f4d640 1 -- 172.21.15.12:0/435464915 learned_addr learned my addr 172.21.15.12:0/435464915 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.599+0000 7fc751f4d640 1 -- 172.21.15.12:0/435464915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74c07c9b0 con 0x7fc74c07de00 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.599+0000 7fc751f4d640 1 --2- 172.21.15.12:0/435464915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c07c260 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc740009820 tx=0x7fc74002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a972087a559457 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.600+0000 7fc750f4b640 1 -- 172.21.15.12:0/435464915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc740037070 con 0x7fc74c07de00 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.600+0000 7fc750f4b640 1 -- 172.21.15.12:0/435464915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc740032440 con 0x7fc74c07de00 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.600+0000 7fc750f4b640 1 -- 172.21.15.12:0/435464915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc740032740 con 0x7fc74c07de00 2024-09-19T06:30:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.600+0000 7fc7541b1640 1 -- 172.21.15.12:0/435464915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 msgr2=0x7fc74c07c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.600+0000 7fc7541b1640 1 --2- 172.21.15.12:0/435464915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c07c260 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc740009820 tx=0x7fc74002a270 comp rx=0 tx=0).stop 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.600+0000 7fc7541b1640 1 -- 172.21.15.12:0/435464915 shutdown_connections 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.600+0000 7fc7541b1640 1 --2- 172.21.15.12:0/435464915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c07c260 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.600+0000 7fc7541b1640 1 -- 172.21.15.12:0/435464915 >> 172.21.15.12:0/435464915 conn(0x7fc74c102f60 msgr2=0x7fc74c1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.600+0000 7fc7541b1640 1 -- 172.21.15.12:0/435464915 shutdown_connections 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.600+0000 7fc7541b1640 1 -- 172.21.15.12:0/435464915 wait complete. 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.601+0000 7fc7541b1640 1 Processor -- start 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.601+0000 7fc7541b1640 1 -- start start 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.601+0000 7fc7541b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c19d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.601+0000 7fc7541b1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c07cee0 con 0x7fc74c07de00 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.601+0000 7fc751f4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c19d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.601+0000 7fc751f4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c19d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35960/0 (socket says 172.21.15.12:35960) 2024-09-19T06:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.601+0000 7fc751f4d640 1 -- 172.21.15.12:0/3441900596 learned_addr learned my addr 172.21.15.12:0/3441900596 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.601+0000 7fc751f4d640 1 -- 172.21.15.12:0/3441900596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74c19d6e0 con 0x7fc74c07de00 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.602+0000 7fc751f4d640 1 --2- 172.21.15.12:0/3441900596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c19d1a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc7400090b0 tx=0x7fc7400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.602+0000 7fc73effd640 1 -- 172.21.15.12:0/3441900596 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc740041070 con 0x7fc74c07de00 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.602+0000 7fc73effd640 1 -- 172.21.15.12:0/3441900596 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74003c7a0 con 0x7fc74c07de00 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.602+0000 7fc7541b1640 1 -- 172.21.15.12:0/3441900596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc74c19d970 con 0x7fc74c07de00 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.602+0000 7fc73effd640 1 -- 172.21.15.12:0/3441900596 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc740037040 con 0x7fc74c07de00 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.602+0000 7fc7541b1640 1 -- 172.21.15.12:0/3441900596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc74c1a0660 con 0x7fc74c07de00 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.602+0000 7fc73effd640 1 -- 172.21.15.12:0/3441900596 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc740044070 con 0x7fc74c07de00 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.602+0000 7fc73effd640 1 -- 172.21.15.12:0/3441900596 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc74003d730 con 0x7fc74c07de00 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.603+0000 7fc7541b1640 1 -- 172.21.15.12:0/3441900596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc74c07c2e0 con 0x7fc74c07de00 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.606+0000 7fc73effd640 1 -- 172.21.15.12:0/3441900596 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc74003cbe0 con 0x7fc74c07de00 2024-09-19T06:30:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.666+0000 7fc7541b1640 1 -- 172.21.15.12:0/3441900596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc74c02d910 con 0x7fc74c07de00 2024-09-19T06:30:36.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.669+0000 7fc73effd640 1 -- 172.21.15.12:0/3441900596 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fc74003cdc0 con 0x7fc74c07de00 2024-09-19T06:30:36.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.670+0000 7fc7541b1640 1 -- 172.21.15.12:0/3441900596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 msgr2=0x7fc74c19d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:36.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.670+0000 7fc7541b1640 1 --2- 172.21.15.12:0/3441900596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c19d1a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc7400090b0 tx=0x7fc7400046c0 comp rx=0 tx=0).stop 2024-09-19T06:30:36.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.670+0000 7fc7541b1640 1 -- 172.21.15.12:0/3441900596 shutdown_connections 2024-09-19T06:30:36.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.670+0000 7fc7541b1640 1 --2- 172.21.15.12:0/3441900596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc74c07de00 0x7fc74c19d1a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:36.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.670+0000 7fc7541b1640 1 -- 172.21.15.12:0/3441900596 >> 172.21.15.12:0/3441900596 conn(0x7fc74c102f60 msgr2=0x7fc74c103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:36.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.670+0000 7fc7541b1640 1 -- 172.21.15.12:0/3441900596 shutdown_connections 2024-09-19T06:30:36.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:35.670+0000 7fc7541b1640 1 -- 172.21.15.12:0/3441900596 wait complete. 2024-09-19T06:30:36.237 INFO:teuthology.orchestra.run.smithi012.stdout:Generating new minimal ceph.conf... 2024-09-19T06:30:37.431 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:37 smithi012 ceph-mon[30570]: from='client.? 172.21.15.12:0/254294359' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:30:37.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.768+0000 7f96a59cd640 1 Processor -- start 2024-09-19T06:30:37.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.768+0000 7f96a59cd640 1 -- start start 2024-09-19T06:30:37.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.768+0000 7f96a59cd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a0107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:37.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.768+0000 7f96a59cd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01081a0 con 0x7f96a01077d0 2024-09-19T06:30:37.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.768+0000 7f969effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a0107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:37.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.768+0000 7f969effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a0107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35964/0 (socket says 172.21.15.12:35964) 2024-09-19T06:30:37.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.768+0000 7f969effd640 1 -- 172.21.15.12:0/3598081152 learned_addr learned my addr 172.21.15.12:0/3598081152 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:37.438 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.769+0000 7f969effd640 1 -- 172.21.15.12:0/3598081152 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a01089d0 con 0x7f96a01077d0 2024-09-19T06:30:37.438 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.769+0000 7f969effd640 1 --2- 172.21.15.12:0/3598081152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a0107bd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9690009e80 tx=0x7f969002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5d65fe12321e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:37.438 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.770+0000 7f969dffb640 1 -- 172.21.15.12:0/3598081152 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9690036070 con 0x7f96a01077d0 2024-09-19T06:30:37.438 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.770+0000 7f969dffb640 1 -- 172.21.15.12:0/3598081152 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96900318c0 con 0x7f96a01077d0 2024-09-19T06:30:37.438 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.770+0000 7f969dffb640 1 -- 172.21.15.12:0/3598081152 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9690007ab0 con 0x7f96a01077d0 2024-09-19T06:30:37.438 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.770+0000 7f96a59cd640 1 -- 172.21.15.12:0/3598081152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 msgr2=0x7f96a0107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:37.438 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.770+0000 7f96a59cd640 1 --2- 172.21.15.12:0/3598081152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a0107bd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9690009e80 tx=0x7f969002a7a0 comp rx=0 tx=0).stop 2024-09-19T06:30:37.438 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.770+0000 7f96a59cd640 1 -- 172.21.15.12:0/3598081152 shutdown_connections 2024-09-19T06:30:37.438 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.770+0000 7f96a59cd640 1 --2- 172.21.15.12:0/3598081152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a0107bd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.770+0000 7f96a59cd640 1 -- 172.21.15.12:0/3598081152 >> 172.21.15.12:0/3598081152 conn(0x7f96a0102f60 msgr2=0x7f96a01053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.770+0000 7f96a59cd640 1 -- 172.21.15.12:0/3598081152 shutdown_connections 2024-09-19T06:30:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.770+0000 7f96a59cd640 1 -- 172.21.15.12:0/3598081152 wait complete. 2024-09-19T06:30:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.771+0000 7f96a59cd640 1 Processor -- start 2024-09-19T06:30:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.771+0000 7f96a59cd640 1 -- start start 2024-09-19T06:30:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.771+0000 7f96a59cd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.771+0000 7f96a59cd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f96a010bd80 con 0x7f96a01077d0 2024-09-19T06:30:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.772+0000 7f969effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.772+0000 7f969effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a019b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35978/0 (socket says 172.21.15.12:35978) 2024-09-19T06:30:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.772+0000 7f969effd640 1 -- 172.21.15.12:0/254294359 learned_addr learned my addr 172.21.15.12:0/254294359 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.772+0000 7f969effd640 1 -- 172.21.15.12:0/254294359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a019bca0 con 0x7f96a01077d0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.772+0000 7f969effd640 1 --2- 172.21.15.12:0/254294359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a019b760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f969002acc0 tx=0x7f9690031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.772+0000 7f96a49cb640 1 -- 172.21.15.12:0/254294359 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9690036050 con 0x7f96a01077d0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.772+0000 7f96a49cb640 1 -- 172.21.15.12:0/254294359 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9690037040 con 0x7f96a01077d0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.772+0000 7f96a59cd640 1 -- 172.21.15.12:0/254294359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a019bf30 con 0x7f96a01077d0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.772+0000 7f96a49cb640 1 -- 172.21.15.12:0/254294359 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f969003d8c0 con 0x7f96a01077d0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.772+0000 7f96a59cd640 1 -- 172.21.15.12:0/254294359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a019ec20 con 0x7f96a01077d0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.773+0000 7f96a49cb640 1 -- 172.21.15.12:0/254294359 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9690044020 con 0x7f96a01077d0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.773+0000 7f96a49cb640 1 -- 172.21.15.12:0/254294359 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9690042020 con 0x7f96a01077d0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.773+0000 7f96a59cd640 1 -- 172.21.15.12:0/254294359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a0107c50 con 0x7f96a01077d0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.776+0000 7f96a49cb640 1 -- 172.21.15.12:0/254294359 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f969004b020 con 0x7f96a01077d0 2024-09-19T06:30:37.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.835+0000 7f96a59cd640 1 -- 172.21.15.12:0/254294359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f96a019f1a0 con 0x7f96a01077d0 2024-09-19T06:30:37.441 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.836+0000 7f96a49cb640 1 -- 172.21.15.12:0/254294359 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f96900073b0 con 0x7f96a01077d0 2024-09-19T06:30:37.441 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.836+0000 7f96a59cd640 1 -- 172.21.15.12:0/254294359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 msgr2=0x7f96a019b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:37.441 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.836+0000 7f96a59cd640 1 --2- 172.21.15.12:0/254294359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a019b760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f969002acc0 tx=0x7f9690031ca0 comp rx=0 tx=0).stop 2024-09-19T06:30:37.441 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.837+0000 7f96a59cd640 1 -- 172.21.15.12:0/254294359 shutdown_connections 2024-09-19T06:30:37.441 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.837+0000 7f96a59cd640 1 --2- 172.21.15.12:0/254294359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a01077d0 0x7f96a019b760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:37.441 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.837+0000 7f96a59cd640 1 -- 172.21.15.12:0/254294359 >> 172.21.15.12:0/254294359 conn(0x7f96a0102f60 msgr2=0x7f96a0103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:37.441 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.837+0000 7f96a59cd640 1 -- 172.21.15.12:0/254294359 shutdown_connections 2024-09-19T06:30:37.441 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:36.837+0000 7f96a59cd640 1 -- 172.21.15.12:0/254294359 wait complete. 2024-09-19T06:30:37.442 INFO:teuthology.orchestra.run.smithi012.stdout:Restarting the monitor... 2024-09-19T06:30:37.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:37 smithi012 systemd[1]: Stopping Ceph mon.a for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:30:38.118 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:37 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a[30566]: 2024-09-19T06:30:37.724+0000 7fc8c46ea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:30:38.118 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:37 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a[30566]: 2024-09-19T06:30:37.724+0000 7fc8c46ea640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T06:30:38.118 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:37 smithi012 podman[30811]: 2024-09-19 06:30:37.838167782 +0000 UTC m=+0.239496516 container died 64cb4589600989088208b6871f817d10de25aa23897ff68ffa6ecb866821013d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T06:30:38.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:38 smithi012 podman[30811]: 2024-09-19 06:30:38.216598029 +0000 UTC m=+0.617926754 container cleanup 64cb4589600989088208b6871f817d10de25aa23897ff68ffa6ecb866821013d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T06:30:38.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:38 smithi012 bash[30811]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:30:38.852 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:38 smithi012 podman[30823]: 2024-09-19 06:30:38.475813624 +0000 UTC m=+0.638154937 container remove 64cb4589600989088208b6871f817d10de25aa23897ff68ffa6ecb866821013d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T06:30:38.852 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:38 smithi012 systemd[1]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T06:30:38.852 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:38 smithi012 systemd[1]: Stopped Ceph mon.a for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:30:38.852 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:38 smithi012 systemd[1]: Starting Ceph mon.a for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:30:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:38 smithi012 podman[30918]: 2024-09-19 06:30:38.851511694 +0000 UTC m=+0.111713311 container create 56166a7b626f5015fce66fdcbd95c1e43a2cf1f47092837c31bbd4693cf04430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:30:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:38 smithi012 podman[30918]: 2024-09-19 06:30:38.756016134 +0000 UTC m=+0.016217761 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:30:39.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 podman[30918]: 2024-09-19 06:30:39.154039748 +0000 UTC m=+0.414241370 container init 56166a7b626f5015fce66fdcbd95c1e43a2cf1f47092837c31bbd4693cf04430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T06:30:39.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 podman[30918]: 2024-09-19 06:30:39.157382263 +0000 UTC m=+0.417583877 container start 56166a7b626f5015fce66fdcbd95c1e43a2cf1f47092837c31bbd4693cf04430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:30:39.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:30:39.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:30:39.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: pidfile_write: ignore empty --pid-file 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: load: jerasure load: lrc 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Git sha 0 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: DB SUMMARY 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: DB Session ID: ONEEB43RSRZMD4PCOIDB 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106630 ; 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:30:39.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:30:39.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:30:39.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:30:39.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:30:39.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.env: 0x56113768c940 2024-09-19T06:30:39.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:30:39.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.info_log: 0x5611395496e0 2024-09-19T06:30:39.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:30:39.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.statistics: (nil) 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.use_fsync: 0 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:30:39.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.db_log_dir: 2024-09-19T06:30:39.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.wal_dir: 2024-09-19T06:30:39.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:30:39.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:30:39.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:30:39.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:30:39.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:30:39.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.write_buffer_manager: 0x561139558dc0 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.unordered_write: 0 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:30:39.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.row_cache: None 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.wal_filter: None 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.wal_compression: 0 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:30:39.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:30:39.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_open_files: -1 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:30:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Compression algorithms supported: 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: kZSTD supported: 0 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:30:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.merge_operator: 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_filter: None 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561139549320) 2024-09-19T06:30:39.608 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_type: 0 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_index_type: 0 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_shortening: 1 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: checksum: 4 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: no_block_cache: 0 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache: 0x56113953d1f0 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_options: 2024-09-19T06:30:39.609 INFO:journalctl@ceph.mon.a.smithi012.stdout: capacity : 536870912 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_shard_bits : 4 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: strict_capacity_limit : 0 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_compressed: (nil) 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: persistent_cache: (nil) 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size: 4096 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size_deviation: 10 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_restart_interval: 16 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_block_restart_interval: 1 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: metadata_block_size: 4096 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: partition_filters: 0 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: use_delta_encoding: 1 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: filter_policy: bloomfilter 2024-09-19T06:30:39.610 INFO:journalctl@ceph.mon.a.smithi012.stdout: whole_key_filtering: 1 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout: verify_compression: 0 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout: format_version: 5 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_index_compression: 1 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_align: 0 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout: max_auto_readahead_size: 262144 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout: prepopulate_block_cache: 0 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compression: NoCompression 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:30:39.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.num_levels: 7 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:30:39.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:30:39.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:30:39.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:30:39.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:30:39.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:30:39.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:30:39.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:30:39.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:30:39.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:30:39.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:30:39.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:30:39.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:30:39.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:30:39.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:30:39.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:30:39.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:30:39.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:30:39.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:30:39.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.ttl: 2592000 2024-09-19T06:30:39.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:30:39.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:30:39.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:30:39.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:30:39.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7923e188-28c0-4fce-8f2d-532ced455a3e 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727439185352, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T06:30:39.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727439186512, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101518, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 334, "table_properties": {"data_size": 99403, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14641, "raw_average_key_size": 49, "raw_value_size": 91534, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726727439, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7923e188-28c0-4fce-8f2d-532ced455a3e", "db_session_id": "ONEEB43RSRZMD4PCOIDB", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727439186615, "job": 1, "event": "recovery_finished"} 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56113956ae00 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: DB pointer 0x561139666000 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** DB Stats ** 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:30:39.619 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: L0 2/0 101.00 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: Sum 2/0 101.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:30:39.620 INFO:journalctl@ceph.mon.a.smithi012.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:30:39.621 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-19T06:30:39.621 INFO:journalctl@ceph.mon.a.smithi012.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:30:39.621 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-19T06:30:39.621 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:30:39.621 INFO:journalctl@ceph.mon.a.smithi012.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:30:39.621 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:30:39.621 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:30:39.621 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:30:39.622 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:30:39.622 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative compaction: 0.00 GB write, 28.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:30:39.622 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval compaction: 0.00 GB write, 28.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:30:39.622 INFO:journalctl@ceph.mon.a.smithi012.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:30:39.622 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache BinnedLRUCache@0x56113953d1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T06:30:39.622 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:30:39.623 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-19T06:30:39.623 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:30:39.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: starting mon.a rank 0 at public addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] at bind addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:39.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: mon.a@-1(???) e1 preinit fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:39.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: mon.a@-1(???).mds e1 new map 2024-09-19T06:30:39.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: mon.a@-1(???).mds e1 print_map 2024-09-19T06:30:39.624 INFO:journalctl@ceph.mon.a.smithi012.stdout: e1 2024-09-19T06:30:39.624 INFO:journalctl@ceph.mon.a.smithi012.stdout: btime 2024-09-19T06:30:34:142717+0000 2024-09-19T06:30:39.624 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:30:39.624 INFO:journalctl@ceph.mon.a.smithi012.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:30:39.624 INFO:journalctl@ceph.mon.a.smithi012.stdout: legacy client fscid: -1 2024-09-19T06:30:39.624 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-19T06:30:39.625 INFO:journalctl@ceph.mon.a.smithi012.stdout: No filesystems configured 2024-09-19T06:30:39.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:30:39.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:30:39.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:30:39.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:30:39.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T06:30:39.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:30:39.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: monmap epoch 1 2024-09-19T06:30:39.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:39.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: last_changed 2024-09-19T06:30:29.711565+0000 2024-09-19T06:30:39.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: created 2024-09-19T06:30:29.711565+0000 2024-09-19T06:30:39.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: min_mon_release 19 (squid) 2024-09-19T06:30:39.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: election_strategy: 1 2024-09-19T06:30:39.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-19T06:30:39.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: fsmap 2024-09-19T06:30:39.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:30:39.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 ceph-mon[30937]: mgrmap e1: no daemons active 2024-09-19T06:30:39.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 bash[30918]: 56166a7b626f5015fce66fdcbd95c1e43a2cf1f47092837c31bbd4693cf04430 2024-09-19T06:30:39.628 INFO:teuthology.orchestra.run.smithi012.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T06:30:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:39 smithi012 systemd[1]: Started Ceph mon.a for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.023+0000 7efe78360640 1 Processor -- start 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.023+0000 7efe78360640 1 -- start start 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.024+0000 7efe78360640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7010a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.024+0000 7efe78360640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efe7007bdd0 con 0x7efe701082a0 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.024+0000 7efe760fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7010a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.024+0000 7efe760fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7010a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35986/0 (socket says 172.21.15.12:35986) 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.024+0000 7efe760fc640 1 -- 172.21.15.12:0/2010150462 learned_addr learned my addr 172.21.15.12:0/2010150462 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.024+0000 7efe760fc640 1 -- 172.21.15.12:0/2010150462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7010abd0 con 0x7efe701082a0 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.026+0000 7efe760fc640 1 --2- 172.21.15.12:0/2010150462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7010a690 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efe68009820 tx=0x7efe6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50dec714604662fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.026+0000 7efe750fa640 1 -- 172.21.15.12:0/2010150462 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe68037070 con 0x7efe701082a0 2024-09-19T06:30:40.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.026+0000 7efe750fa640 1 -- 172.21.15.12:0/2010150462 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe68032900 con 0x7efe701082a0 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.026+0000 7efe750fa640 1 -- 172.21.15.12:0/2010150462 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe68030850 con 0x7efe701082a0 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.027+0000 7efe78360640 1 -- 172.21.15.12:0/2010150462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 msgr2=0x7efe7010a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.027+0000 7efe78360640 1 --2- 172.21.15.12:0/2010150462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7010a690 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efe68009820 tx=0x7efe6802a270 comp rx=0 tx=0).stop 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.027+0000 7efe78360640 1 -- 172.21.15.12:0/2010150462 shutdown_connections 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.027+0000 7efe78360640 1 --2- 172.21.15.12:0/2010150462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7010a690 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.027+0000 7efe78360640 1 -- 172.21.15.12:0/2010150462 >> 172.21.15.12:0/2010150462 conn(0x7efe70101e60 msgr2=0x7efe701042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.027+0000 7efe78360640 1 -- 172.21.15.12:0/2010150462 shutdown_connections 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.027+0000 7efe78360640 1 -- 172.21.15.12:0/2010150462 wait complete. 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.028+0000 7efe78360640 1 Processor -- start 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.028+0000 7efe78360640 1 -- start start 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.028+0000 7efe78360640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7019b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.028+0000 7efe78360640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efe7010bba0 con 0x7efe701082a0 2024-09-19T06:30:40.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.028+0000 7efe760fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7019b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.028+0000 7efe760fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7019b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35990/0 (socket says 172.21.15.12:35990) 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.028+0000 7efe760fc640 1 -- 172.21.15.12:0/4270903135 learned_addr learned my addr 172.21.15.12:0/4270903135 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.028+0000 7efe760fc640 1 -- 172.21.15.12:0/4270903135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7019bcc0 con 0x7efe701082a0 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.029+0000 7efe760fc640 1 --2- 172.21.15.12:0/4270903135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7019b780 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efe68032ce0 tx=0x7efe68032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.029+0000 7efe6f7fe640 1 -- 172.21.15.12:0/4270903135 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe68042070 con 0x7efe701082a0 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.029+0000 7efe6f7fe640 1 -- 172.21.15.12:0/4270903135 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe680308c0 con 0x7efe701082a0 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.029+0000 7efe78360640 1 -- 172.21.15.12:0/4270903135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7019bf50 con 0x7efe701082a0 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.029+0000 7efe6f7fe640 1 -- 172.21.15.12:0/4270903135 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe68037040 con 0x7efe701082a0 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.029+0000 7efe78360640 1 -- 172.21.15.12:0/4270903135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7019ec40 con 0x7efe701082a0 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.029+0000 7efe6f7fe640 1 -- 172.21.15.12:0/4270903135 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe68045070 con 0x7efe701082a0 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.029+0000 7efe6f7fe640 1 -- 172.21.15.12:0/4270903135 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efe68047bd0 con 0x7efe701082a0 2024-09-19T06:30:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.030+0000 7efe78360640 1 -- 172.21.15.12:0/4270903135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe70108700 con 0x7efe701082a0 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.032+0000 7efe6f7fe640 1 -- 172.21.15.12:0/4270903135 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efe6803c830 con 0x7efe701082a0 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.092+0000 7efe78360640 1 -- 172.21.15.12:0/4270903135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7efe7019ee10 con 0x7efe701082a0 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.094+0000 7efe6f7fe640 1 -- 172.21.15.12:0/4270903135 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7efe6803ca10 con 0x7efe701082a0 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.095+0000 7efe78360640 1 -- 172.21.15.12:0/4270903135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 msgr2=0x7efe7019b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.095+0000 7efe78360640 1 --2- 172.21.15.12:0/4270903135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7019b780 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efe68032ce0 tx=0x7efe68032d10 comp rx=0 tx=0).stop 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.095+0000 7efe78360640 1 -- 172.21.15.12:0/4270903135 shutdown_connections 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.095+0000 7efe78360640 1 --2- 172.21.15.12:0/4270903135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe701082a0 0x7efe7019b780 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.095+0000 7efe78360640 1 -- 172.21.15.12:0/4270903135 >> 172.21.15.12:0/4270903135 conn(0x7efe70101e60 msgr2=0x7efe70102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.095+0000 7efe78360640 1 -- 172.21.15.12:0/4270903135 shutdown_connections 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:40.095+0000 7efe78360640 1 -- 172.21.15.12:0/4270903135 wait complete. 2024-09-19T06:30:40.722 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T06:30:40.744 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:30:40.744 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mgr... 2024-09-19T06:30:40.745 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T06:30:40.745 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T06:30:41.002 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:30:41.002 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T06:30:41.166 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8bf314c8-7650-11ef-bceb-c7b262605968.target.wants/ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-8bf314c8-7650-11ef-bceb-c7b262605968@.service. 2024-09-19T06:30:41.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:41 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/4270903135' entity='client.admin' 2024-09-19T06:30:41.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:41 smithi012 systemd[1]: Starting Ceph mgr.x for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:30:41.759 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:41 smithi012 podman[31148]: 2024-09-19 06:30:41.299497457 +0000 UTC m=+0.016404588 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:30:41.759 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:41 smithi012 podman[31148]: 2024-09-19 06:30:41.40475222 +0000 UTC m=+0.121659337 container create 0b352ea0c27cee8c717b3e67bf8f1b03b2e4daf5bb5bcd421db202dc7aa09eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T06:30:41.759 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:41 smithi012 podman[31148]: 2024-09-19 06:30:41.757880019 +0000 UTC m=+0.474787148 container init 0b352ea0c27cee8c717b3e67bf8f1b03b2e4daf5bb5bcd421db202dc7aa09eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T06:30:41.839 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:30:41.840 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-19T06:30:41.847 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:30:41.847 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-19T06:30:41.847 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-19T06:30:41.847 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:30:41.856 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:30:41.856 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-19T06:30:41.864 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:30:41.864 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-19T06:30:41.864 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-19T06:30:41.864 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T06:30:41.864 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr to start... 2024-09-19T06:30:41.864 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr... 2024-09-19T06:30:42.009 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:41 smithi012 podman[31148]: 2024-09-19 06:30:41.761291907 +0000 UTC m=+0.478199024 container start 0b352ea0c27cee8c717b3e67bf8f1b03b2e4daf5bb5bcd421db202dc7aa09eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T06:30:42.009 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:41 smithi012 bash[31148]: 0b352ea0c27cee8c717b3e67bf8f1b03b2e4daf5bb5bcd421db202dc7aa09eed 2024-09-19T06:30:42.009 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:41 smithi012 systemd[1]: Started Ceph mgr.x for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:30:42.009 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:41.892+0000 7ff126886040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:30:42.009 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:41.952+0000 7ff126886040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:30:42.301 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:42.113+0000 7ff126886040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:30:42.301 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:42.185+0000 7ff126886040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:30:42.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:42 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/680464495' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:30:42.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:42.344+0000 7ff126886040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:30:42.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:42.498+0000 7ff126886040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:30:42.990 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:42.832+0000 7ff126886040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:30:42.990 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:42.896+0000 7ff126886040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:30:42.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:42.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:30:42.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:30:42.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:30:43.006 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:30:34:142717+0000", 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:30:43.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:30:34.143404+0000", 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:30:43.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.299+0000 7faf91a0e640 1 Processor -- start 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.299+0000 7faf91a0e640 1 -- start start 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.299+0000 7faf91a0e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c10a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.299+0000 7faf91a0e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c07bdd0 con 0x7faf8c1082c0 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.300+0000 7faf8affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c10a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.300+0000 7faf8affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c10a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54936/0 (socket says 172.21.15.12:54936) 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.300+0000 7faf8affd640 1 -- 172.21.15.12:0/3329250889 learned_addr learned my addr 172.21.15.12:0/3329250889 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.300+0000 7faf8affd640 1 -- 172.21.15.12:0/3329250889 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c10abf0 con 0x7faf8c1082c0 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.301+0000 7faf8affd640 1 --2- 172.21.15.12:0/3329250889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c10a6b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009820 tx=0x7faf7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337b9840a0a3bc40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.301+0000 7faf8a7fc640 1 -- 172.21.15.12:0/3329250889 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf7c037070 con 0x7faf8c1082c0 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.301+0000 7faf8a7fc640 1 -- 172.21.15.12:0/3329250889 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf7c032900 con 0x7faf8c1082c0 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.301+0000 7faf8a7fc640 1 -- 172.21.15.12:0/3329250889 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf7c030850 con 0x7faf8c1082c0 2024-09-19T06:30:43.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.302+0000 7faf91a0e640 1 -- 172.21.15.12:0/3329250889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 msgr2=0x7faf8c10a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.302+0000 7faf91a0e640 1 --2- 172.21.15.12:0/3329250889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c10a6b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009820 tx=0x7faf7c02a270 comp rx=0 tx=0).stop 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.302+0000 7faf91a0e640 1 -- 172.21.15.12:0/3329250889 shutdown_connections 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.302+0000 7faf91a0e640 1 --2- 172.21.15.12:0/3329250889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c10a6b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.302+0000 7faf91a0e640 1 -- 172.21.15.12:0/3329250889 >> 172.21.15.12:0/3329250889 conn(0x7faf8c101e80 msgr2=0x7faf8c1042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.302+0000 7faf91a0e640 1 -- 172.21.15.12:0/3329250889 shutdown_connections 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.302+0000 7faf91a0e640 1 -- 172.21.15.12:0/3329250889 wait complete. 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.303+0000 7faf91a0e640 1 Processor -- start 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.303+0000 7faf91a0e640 1 -- start start 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.303+0000 7faf91a0e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c107b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.303+0000 7faf91a0e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c10bbc0 con 0x7faf8c1082c0 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.303+0000 7faf8affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.303+0000 7faf8affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54948/0 (socket says 172.21.15.12:54948) 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.303+0000 7faf8affd640 1 -- 172.21.15.12:0/680464495 learned_addr learned my addr 172.21.15.12:0/680464495 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:43.010 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.303+0000 7faf8affd640 1 -- 172.21.15.12:0/680464495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c108080 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.304+0000 7faf8affd640 1 --2- 172.21.15.12:0/680464495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c107b40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faf7c032ce0 tx=0x7faf7c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.304+0000 7faf90a0c640 1 -- 172.21.15.12:0/680464495 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf7c042070 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.304+0000 7faf91a0e640 1 -- 172.21.15.12:0/680464495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c106270 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.304+0000 7faf90a0c640 1 -- 172.21.15.12:0/680464495 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf7c0308c0 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.304+0000 7faf90a0c640 1 -- 172.21.15.12:0/680464495 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf7c037040 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.304+0000 7faf91a0e640 1 -- 172.21.15.12:0/680464495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c1067b0 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.304+0000 7faf90a0c640 1 -- 172.21.15.12:0/680464495 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faf7c045070 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.304+0000 7faf90a0c640 1 -- 172.21.15.12:0/680464495 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faf7c047bd0 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.305+0000 7faf91a0e640 1 -- 172.21.15.12:0/680464495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8c108720 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.307+0000 7faf90a0c640 1 -- 172.21.15.12:0/680464495 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7faf7c03c830 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.369+0000 7faf91a0e640 1 -- 172.21.15.12:0/680464495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faf8c106ce0 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.370+0000 7faf90a0c640 1 -- 172.21.15.12:0/680464495 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7faf7c03ca10 con 0x7faf8c1082c0 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.371+0000 7faf91a0e640 1 -- 172.21.15.12:0/680464495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 msgr2=0x7faf8c107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:43.011 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.371+0000 7faf91a0e640 1 --2- 172.21.15.12:0/680464495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c107b40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faf7c032ce0 tx=0x7faf7c032d10 comp rx=0 tx=0).stop 2024-09-19T06:30:43.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.371+0000 7faf91a0e640 1 -- 172.21.15.12:0/680464495 shutdown_connections 2024-09-19T06:30:43.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.371+0000 7faf91a0e640 1 --2- 172.21.15.12:0/680464495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf8c1082c0 0x7faf8c107b40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:43.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.371+0000 7faf91a0e640 1 -- 172.21.15.12:0/680464495 >> 172.21.15.12:0/680464495 conn(0x7faf8c101e80 msgr2=0x7faf8c102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:43.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.371+0000 7faf91a0e640 1 -- 172.21.15.12:0/680464495 shutdown_connections 2024-09-19T06:30:43.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:42.371+0000 7faf91a0e640 1 -- 172.21.15.12:0/680464495 wait complete. 2024-09-19T06:30:43.012 INFO:teuthology.orchestra.run.smithi012.stdout:mgr not available, waiting (1/15)... 2024-09-19T06:30:43.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:43 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:43.091+0000 7ff126886040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:30:44.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:44 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:44.020+0000 7ff126886040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:30:44.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:44 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:44.090+0000 7ff126886040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:30:45.122 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:44 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:44.851+0000 7ff126886040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:30:45.122 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:44 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:44.971+0000 7ff126886040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:30:45.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:45.124+0000 7ff126886040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:30:45.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:45.189+0000 7ff126886040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:30:45.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:45.350+0000 7ff126886040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:30:45.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2245391077' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:30:45.733 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:45.424+0000 7ff126886040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:30:45.733 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:45.489+0000 7ff126886040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:30:45.733 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:45.660+0000 7ff126886040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:30:45.733 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:45.730+0000 7ff126886040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:30:46.014 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:45.800+0000 7ff126886040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:30:46.014 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:45.888+0000 7ff126886040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:30:46.014 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:45.950+0000 7ff126886040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:30:46.014 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:46.012+0000 7ff126886040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:30:46.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:46.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:30:46.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:30:46.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:30:46.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:30:46.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:46.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:30:46.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:30:46.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:46.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:30:46.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:46.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:30:46.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:30:46.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:30:46.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:30:46.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:30:46.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:30:46.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:46.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:30:46.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:30:46.145 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:30:34:142717+0000", 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:30:46.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:30:46.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:30:34.143404+0000", 2024-09-19T06:30:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:30:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:30:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:30:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.429+0000 7fc6f4f52640 1 Processor -- start 2024-09-19T06:30:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.429+0000 7fc6f4f52640 1 -- start start 2024-09-19T06:30:46.148 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.429+0000 7fc6f4f52640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f0107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.429+0000 7fc6f4f52640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f01081a0 con 0x7fc6f01077d0 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.429+0000 7fc6ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f0107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.429+0000 7fc6ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f0107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54954/0 (socket says 172.21.15.12:54954) 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.430+0000 7fc6ee59c640 1 -- 172.21.15.12:0/3706194062 learned_addr learned my addr 172.21.15.12:0/3706194062 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.430+0000 7fc6ee59c640 1 -- 172.21.15.12:0/3706194062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f01089d0 con 0x7fc6f01077d0 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.430+0000 7fc6ee59c640 1 --2- 172.21.15.12:0/3706194062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f0107bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009820 tx=0x7fc6e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ee940d6ebbc49a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.431+0000 7fc6ed59a640 1 -- 172.21.15.12:0/3706194062 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e0037070 con 0x7fc6f01077d0 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.431+0000 7fc6ed59a640 1 -- 172.21.15.12:0/3706194062 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6e0032900 con 0x7fc6f01077d0 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.431+0000 7fc6ed59a640 1 -- 172.21.15.12:0/3706194062 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e0030850 con 0x7fc6f01077d0 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.431+0000 7fc6f4f52640 1 -- 172.21.15.12:0/3706194062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 msgr2=0x7fc6f0107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.431+0000 7fc6f4f52640 1 --2- 172.21.15.12:0/3706194062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f0107bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009820 tx=0x7fc6e002a270 comp rx=0 tx=0).stop 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.431+0000 7fc6f4f52640 1 -- 172.21.15.12:0/3706194062 shutdown_connections 2024-09-19T06:30:46.149 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.431+0000 7fc6f4f52640 1 --2- 172.21.15.12:0/3706194062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f0107bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.431+0000 7fc6f4f52640 1 -- 172.21.15.12:0/3706194062 >> 172.21.15.12:0/3706194062 conn(0x7fc6f0102fc0 msgr2=0x7fc6f01053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.431+0000 7fc6f4f52640 1 -- 172.21.15.12:0/3706194062 shutdown_connections 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.431+0000 7fc6f4f52640 1 -- 172.21.15.12:0/3706194062 wait complete. 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.432+0000 7fc6f4f52640 1 Processor -- start 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.432+0000 7fc6f4f52640 1 -- start start 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.432+0000 7fc6f4f52640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f007daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.432+0000 7fc6f4f52640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f010bd80 con 0x7fc6f01077d0 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.433+0000 7fc6ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f007daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.433+0000 7fc6ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f007daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54962/0 (socket says 172.21.15.12:54962) 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.433+0000 7fc6ee59c640 1 -- 172.21.15.12:0/2245391077 learned_addr learned my addr 172.21.15.12:0/2245391077 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.433+0000 7fc6ee59c640 1 -- 172.21.15.12:0/2245391077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f007e030 con 0x7fc6f01077d0 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.433+0000 7fc6ee59c640 1 --2- 172.21.15.12:0/2245391077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f007daf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009940 tx=0x7fc6e0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.433+0000 7fc6df7fe640 1 -- 172.21.15.12:0/2245391077 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e0042070 con 0x7fc6f01077d0 2024-09-19T06:30:46.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.433+0000 7fc6df7fe640 1 -- 172.21.15.12:0/2245391077 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6e00308c0 con 0x7fc6f01077d0 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.433+0000 7fc6df7fe640 1 -- 172.21.15.12:0/2245391077 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e0037040 con 0x7fc6f01077d0 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.433+0000 7fc6f4f52640 1 -- 172.21.15.12:0/2245391077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f007c220 con 0x7fc6f01077d0 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.433+0000 7fc6f4f52640 1 -- 172.21.15.12:0/2245391077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f007c760 con 0x7fc6f01077d0 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.434+0000 7fc6df7fe640 1 -- 172.21.15.12:0/2245391077 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc6e0045070 con 0x7fc6f01077d0 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.434+0000 7fc6df7fe640 1 -- 172.21.15.12:0/2245391077 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc6e0047bc0 con 0x7fc6f01077d0 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.434+0000 7fc6f4f52640 1 -- 172.21.15.12:0/2245391077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f0107c50 con 0x7fc6f01077d0 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.436+0000 7fc6df7fe640 1 -- 172.21.15.12:0/2245391077 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc6e00327b0 con 0x7fc6f01077d0 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.499+0000 7fc6f4f52640 1 -- 172.21.15.12:0/2245391077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc6f007ca60 con 0x7fc6f01077d0 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.499+0000 7fc6df7fe640 1 -- 172.21.15.12:0/2245391077 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fc6e003c870 con 0x7fc6f01077d0 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.500+0000 7fc6f4f52640 1 -- 172.21.15.12:0/2245391077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 msgr2=0x7fc6f007daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.500+0000 7fc6f4f52640 1 --2- 172.21.15.12:0/2245391077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f007daf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009940 tx=0x7fc6e0032ce0 comp rx=0 tx=0).stop 2024-09-19T06:30:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.500+0000 7fc6f4f52640 1 -- 172.21.15.12:0/2245391077 shutdown_connections 2024-09-19T06:30:46.152 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.500+0000 7fc6f4f52640 1 --2- 172.21.15.12:0/2245391077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6f01077d0 0x7fc6f007daf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:46.152 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.500+0000 7fc6f4f52640 1 -- 172.21.15.12:0/2245391077 >> 172.21.15.12:0/2245391077 conn(0x7fc6f0102fc0 msgr2=0x7fc6f0103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:46.152 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.501+0000 7fc6f4f52640 1 -- 172.21.15.12:0/2245391077 shutdown_connections 2024-09-19T06:30:46.152 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:45.501+0000 7fc6f4f52640 1 -- 172.21.15.12:0/2245391077 wait complete. 2024-09-19T06:30:46.152 INFO:teuthology.orchestra.run.smithi012.stdout:mgr not available, waiting (2/15)... 2024-09-19T06:30:47.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:46.844+0000 7ff126886040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:30:47.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: Activating manager daemon x 2024-09-19T06:30:47.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: mgrmap e2: x(active, starting, since 0.00312374s) 2024-09-19T06:30:47.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: from='mgr.14100 172.21.15.12:0/3028136061' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:30:47.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: from='mgr.14100 172.21.15.12:0/3028136061' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:30:47.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: from='mgr.14100 172.21.15.12:0/3028136061' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:30:47.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: from='mgr.14100 172.21.15.12:0/3028136061' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:30:47.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: from='mgr.14100 172.21.15.12:0/3028136061' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:30:47.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: Manager daemon x is now available 2024-09-19T06:30:47.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: from='mgr.14100 172.21.15.12:0/3028136061' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:30:47.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: from='mgr.14100 172.21.15.12:0/3028136061' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:30:47.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: from='mgr.14100 172.21.15.12:0/3028136061' entity='mgr.x' 2024-09-19T06:30:47.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: from='mgr.14100 172.21.15.12:0/3028136061' entity='mgr.x' 2024-09-19T06:30:47.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:46 smithi012 ceph-mon[30937]: from='mgr.14100 172.21.15.12:0/3028136061' entity='mgr.x' 2024-09-19T06:30:49.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:48 smithi012 ceph-mon[30937]: mgrmap e3: x(active, since 1.00728s) 2024-09-19T06:30:49.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:48 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2300316762' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:30:49.383 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:49.383 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:30:49.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:30:49.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:30:49.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:30:49.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:30:49.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:30:49.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:49.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:30:49.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:30:49.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:30:49.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:30:49.385 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:30:49.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:30:34:142717+0000", 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:30:49.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:49.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:30:49.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:30:49.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:30:49.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:30:49.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:30:49.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:30:49.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:30:49.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:30:49.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:30:49.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:30:34.143404+0000", 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.569+0000 7fd54a485640 1 Processor -- start 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.570+0000 7fd54a485640 1 -- start start 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.570+0000 7fd54a485640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd544106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:49.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.570+0000 7fd54a485640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd5441070a0 con 0x7fd5441066d0 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.570+0000 7fd543fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd544106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.570+0000 7fd543fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd544106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55024/0 (socket says 172.21.15.12:55024) 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.570+0000 7fd543fff640 1 -- 172.21.15.12:0/1150725896 learned_addr learned my addr 172.21.15.12:0/1150725896 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.571+0000 7fd543fff640 1 -- 172.21.15.12:0/1150725896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5441078d0 con 0x7fd5441066d0 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.571+0000 7fd543fff640 1 --2- 172.21.15.12:0/1150725896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd544106ad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd534009820 tx=0x7fd53402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3983ddf71ab8672 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.572+0000 7fd5437fe640 1 -- 172.21.15.12:0/1150725896 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd534037070 con 0x7fd5441066d0 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.572+0000 7fd5437fe640 1 -- 172.21.15.12:0/1150725896 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd534032900 con 0x7fd5441066d0 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.572+0000 7fd5437fe640 1 -- 172.21.15.12:0/1150725896 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd534030850 con 0x7fd5441066d0 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.572+0000 7fd54a485640 1 -- 172.21.15.12:0/1150725896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 msgr2=0x7fd544106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.572+0000 7fd54a485640 1 --2- 172.21.15.12:0/1150725896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd544106ad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd534009820 tx=0x7fd53402a270 comp rx=0 tx=0).stop 2024-09-19T06:30:49.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.572+0000 7fd54a485640 1 -- 172.21.15.12:0/1150725896 shutdown_connections 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.572+0000 7fd54a485640 1 --2- 172.21.15.12:0/1150725896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd544106ad0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.572+0000 7fd54a485640 1 -- 172.21.15.12:0/1150725896 >> 172.21.15.12:0/1150725896 conn(0x7fd544101e60 msgr2=0x7fd5441042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.572+0000 7fd54a485640 1 -- 172.21.15.12:0/1150725896 shutdown_connections 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.572+0000 7fd54a485640 1 -- 172.21.15.12:0/1150725896 wait complete. 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.573+0000 7fd54a485640 1 Processor -- start 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.573+0000 7fd54a485640 1 -- start start 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.573+0000 7fd54a485640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd54419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.573+0000 7fd54a485640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd54410ac80 con 0x7fd5441066d0 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.573+0000 7fd543fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd54419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.573+0000 7fd543fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd54419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55040/0 (socket says 172.21.15.12:55040) 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.573+0000 7fd543fff640 1 -- 172.21.15.12:0/2300316762 learned_addr learned my addr 172.21.15.12:0/2300316762 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:49.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.574+0000 7fd543fff640 1 -- 172.21.15.12:0/2300316762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54419bd60 con 0x7fd5441066d0 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.574+0000 7fd543fff640 1 --2- 172.21.15.12:0/2300316762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd54419b820 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd534009940 tx=0x7fd534032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.574+0000 7fd541ffb640 1 -- 172.21.15.12:0/2300316762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd534042070 con 0x7fd5441066d0 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.574+0000 7fd541ffb640 1 -- 172.21.15.12:0/2300316762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5340308c0 con 0x7fd5441066d0 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.574+0000 7fd54a485640 1 -- 172.21.15.12:0/2300316762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54419bff0 con 0x7fd5441066d0 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.574+0000 7fd541ffb640 1 -- 172.21.15.12:0/2300316762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd534037040 con 0x7fd5441066d0 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.574+0000 7fd54a485640 1 -- 172.21.15.12:0/2300316762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54419ece0 con 0x7fd5441066d0 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.575+0000 7fd541ffb640 1 -- 172.21.15.12:0/2300316762 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7fd534045070 con 0x7fd5441066d0 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.575+0000 7fd54a485640 1 -- 172.21.15.12:0/2300316762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd544106b50 con 0x7fd5441066d0 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.575+0000 7fd541ffb640 1 --2- 172.21.15.12:0/2300316762 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7fd5300390a0 0x7fd53003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.575+0000 7fd541ffb640 1 -- 172.21.15.12:0/2300316762 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd53406c010 con 0x7fd5441066d0 2024-09-19T06:30:49.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.575+0000 7fd53bfff640 1 --2- 172.21.15.12:0/2300316762 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7fd5300390a0 0x7fd53003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.576+0000 7fd53bfff640 1 --2- 172.21.15.12:0/2300316762 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7fd5300390a0 0x7fd53003b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0098c0 tx=0x7fd52c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.581+0000 7fd541ffb640 1 -- 172.21.15.12:0/2300316762 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd53404b170 con 0x7fd5441066d0 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.831+0000 7fd54a485640 1 -- 172.21.15.12:0/2300316762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd54402da40 con 0x7fd5441066d0 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.832+0000 7fd541ffb640 1 -- 172.21.15.12:0/2300316762 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fd53404ba40 con 0x7fd5441066d0 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.834+0000 7fd54a485640 1 -- 172.21.15.12:0/2300316762 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7fd5300390a0 msgr2=0x7fd53003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.834+0000 7fd54a485640 1 --2- 172.21.15.12:0/2300316762 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7fd5300390a0 0x7fd53003b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0098c0 tx=0x7fd52c006db0 comp rx=0 tx=0).stop 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.834+0000 7fd54a485640 1 -- 172.21.15.12:0/2300316762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 msgr2=0x7fd54419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.834+0000 7fd54a485640 1 --2- 172.21.15.12:0/2300316762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd54419b820 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd534009940 tx=0x7fd534032ce0 comp rx=0 tx=0).stop 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.834+0000 7fd54a485640 1 -- 172.21.15.12:0/2300316762 shutdown_connections 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.834+0000 7fd54a485640 1 --2- 172.21.15.12:0/2300316762 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7fd5300390a0 0x7fd53003b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:49.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.834+0000 7fd54a485640 1 --2- 172.21.15.12:0/2300316762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5441066d0 0x7fd54419b820 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:49.394 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.834+0000 7fd54a485640 1 -- 172.21.15.12:0/2300316762 >> 172.21.15.12:0/2300316762 conn(0x7fd544101e60 msgr2=0x7fd544102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:49.394 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.834+0000 7fd54a485640 1 -- 172.21.15.12:0/2300316762 shutdown_connections 2024-09-19T06:30:49.394 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:48.834+0000 7fd54a485640 1 -- 172.21.15.12:0/2300316762 wait complete. 2024-09-19T06:30:49.394 INFO:teuthology.orchestra.run.smithi012.stdout:mgr is available 2024-09-19T06:30:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:49 smithi012 ceph-mon[30937]: mgrmap e4: x(active, since 2s) 2024-09-19T06:30:50.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:50.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:30:50.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:50.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-19T06:30:50.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:30:50.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:30:50.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:30:50.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:30:50.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:50.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.778+0000 7f0204970640 1 Processor -- start 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.778+0000 7f0204970640 1 -- start start 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.778+0000 7f0204970640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f0200105ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:50.628 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.778+0000 7f0204970640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f02001064a0 con 0x7f0200105ad0 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.778+0000 7f01fe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f0200105ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.778+0000 7f01fe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f0200105ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55056/0 (socket says 172.21.15.12:55056) 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.778+0000 7f01fe59c640 1 -- 172.21.15.12:0/385165820 learned_addr learned my addr 172.21.15.12:0/385165820 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.779+0000 7f01fe59c640 1 -- 172.21.15.12:0/385165820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0200106620 con 0x7f0200105ad0 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.779+0000 7f01fe59c640 1 --2- 172.21.15.12:0/385165820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f0200105ed0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009820 tx=0x7f01f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a160d7c5347fe7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.780+0000 7f01fd59a640 1 -- 172.21.15.12:0/385165820 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0037070 con 0x7f0200105ad0 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.780+0000 7f01fd59a640 1 -- 172.21.15.12:0/385165820 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01f0032900 con 0x7f0200105ad0 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.780+0000 7f01fd59a640 1 -- 172.21.15.12:0/385165820 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0030850 con 0x7f0200105ad0 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.780+0000 7f0204970640 1 -- 172.21.15.12:0/385165820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 msgr2=0x7f0200105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.780+0000 7f0204970640 1 --2- 172.21.15.12:0/385165820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f0200105ed0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009820 tx=0x7f01f002a270 comp rx=0 tx=0).stop 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.780+0000 7f0204970640 1 -- 172.21.15.12:0/385165820 shutdown_connections 2024-09-19T06:30:50.629 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.780+0000 7f0204970640 1 --2- 172.21.15.12:0/385165820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f0200105ed0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.780+0000 7f0204970640 1 -- 172.21.15.12:0/385165820 >> 172.21.15.12:0/385165820 conn(0x7f0200101600 msgr2=0x7f0200103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.780+0000 7f0204970640 1 -- 172.21.15.12:0/385165820 shutdown_connections 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.780+0000 7f0204970640 1 -- 172.21.15.12:0/385165820 wait complete. 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.781+0000 7f0204970640 1 Processor -- start 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.781+0000 7f0204970640 1 -- start start 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.781+0000 7f0204970640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f020019b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.781+0000 7f0204970640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0200109940 con 0x7f0200105ad0 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.781+0000 7f01fe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f020019b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.781+0000 7f01fe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f020019b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55064/0 (socket says 172.21.15.12:55064) 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.781+0000 7f01fe59c640 1 -- 172.21.15.12:0/3643732110 learned_addr learned my addr 172.21.15.12:0/3643732110 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.782+0000 7f01fe59c640 1 -- 172.21.15.12:0/3643732110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020019bc90 con 0x7f0200105ad0 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.782+0000 7f01fe59c640 1 --2- 172.21.15.12:0/3643732110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f020019b750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f01f00097f0 tx=0x7f01f0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:50.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.782+0000 7f01ef7fe640 1 -- 172.21.15.12:0/3643732110 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0037040 con 0x7f0200105ad0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.782+0000 7f01ef7fe640 1 -- 172.21.15.12:0/3643732110 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01f0040070 con 0x7f0200105ad0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.782+0000 7f0204970640 1 -- 172.21.15.12:0/3643732110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020019bf20 con 0x7f0200105ad0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.782+0000 7f01ef7fe640 1 -- 172.21.15.12:0/3643732110 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f003a390 con 0x7f0200105ad0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.782+0000 7f0204970640 1 -- 172.21.15.12:0/3643732110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020019ec10 con 0x7f0200105ad0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.783+0000 7f01ef7fe640 1 -- 172.21.15.12:0/3643732110 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f01f003a5e0 con 0x7f0200105ad0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.783+0000 7f01ef7fe640 1 --2- 172.21.15.12:0/3643732110 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f01e80391b0 0x7f01e803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.783+0000 7f0204970640 1 -- 172.21.15.12:0/3643732110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0200105f50 con 0x7f0200105ad0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.783+0000 7f01ef7fe640 1 -- 172.21.15.12:0/3643732110 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f01f006c2f0 con 0x7f0200105ad0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.783+0000 7f01fdd9b640 1 --2- 172.21.15.12:0/3643732110 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f01e80391b0 0x7f01e803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.784+0000 7f01fdd9b640 1 --2- 172.21.15.12:0/3643732110 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f01e80391b0 0x7f01e803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01f40098c0 tx=0x7f01f4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.788+0000 7f01ef7fe640 1 -- 172.21.15.12:0/3643732110 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f01f006c050 con 0x7f0200105ad0 2024-09-19T06:30:50.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.966+0000 7f0204970640 1 -- 172.21.15.12:0/3643732110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f020019ede0 con 0x7f0200105ad0 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.967+0000 7f01ef7fe640 1 -- 172.21.15.12:0/3643732110 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f01f003a8d0 con 0x7f0200105ad0 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.969+0000 7f0204970640 1 -- 172.21.15.12:0/3643732110 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f01e80391b0 msgr2=0x7f01e803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.969+0000 7f0204970640 1 --2- 172.21.15.12:0/3643732110 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f01e80391b0 0x7f01e803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01f40098c0 tx=0x7f01f4006db0 comp rx=0 tx=0).stop 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.969+0000 7f0204970640 1 -- 172.21.15.12:0/3643732110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 msgr2=0x7f020019b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.969+0000 7f0204970640 1 --2- 172.21.15.12:0/3643732110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f020019b750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f01f00097f0 tx=0x7f01f0030d80 comp rx=0 tx=0).stop 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.969+0000 7f0204970640 1 -- 172.21.15.12:0/3643732110 shutdown_connections 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.969+0000 7f0204970640 1 --2- 172.21.15.12:0/3643732110 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f01e80391b0 0x7f01e803b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.969+0000 7f0204970640 1 --2- 172.21.15.12:0/3643732110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0200105ad0 0x7f020019b750 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.969+0000 7f0204970640 1 -- 172.21.15.12:0/3643732110 >> 172.21.15.12:0/3643732110 conn(0x7f0200101600 msgr2=0x7f02001021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.969+0000 7f0204970640 1 -- 172.21.15.12:0/3643732110 shutdown_connections 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:49.969+0000 7f0204970640 1 -- 172.21.15.12:0/3643732110 wait complete. 2024-09-19T06:30:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling cephadm module... 2024-09-19T06:30:50.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:50 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3643732110' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:30:52.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:51 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3504736374' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T06:30:52.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:51 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: ignoring --setuser ceph since I am not root 2024-09-19T06:30:52.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:51 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: ignoring --setgroup ceph since I am not root 2024-09-19T06:30:52.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:52 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:52.003+0000 7fdcd0a22040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:30:52.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:52 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:52.062+0000 7fdcd0a22040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:30:52.450 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:52 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:52.224+0000 7fdcd0a22040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:30:52.451 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:52 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:52.293+0000 7fdcd0a22040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:30:52.451 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:52 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:52.448+0000 7fdcd0a22040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:30:52.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.019+0000 7f240191e640 1 Processor -- start 2024-09-19T06:30:52.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.019+0000 7f240191e640 1 -- start start 2024-09-19T06:30:52.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.020+0000 7f240191e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc108170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:52.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.020+0000 7f240191e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc108740 con 0x7f23fc107d70 2024-09-19T06:30:52.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.020+0000 7f23faffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc108170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:52.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.020+0000 7f23faffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc108170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41354/0 (socket says 172.21.15.12:41354) 2024-09-19T06:30:52.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.020+0000 7f23faffd640 1 -- 172.21.15.12:0/3126994106 learned_addr learned my addr 172.21.15.12:0/3126994106 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:52.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.020+0000 7f23faffd640 1 -- 172.21.15.12:0/3126994106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc1088c0 con 0x7f23fc107d70 2024-09-19T06:30:52.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.021+0000 7f23faffd640 1 --2- 172.21.15.12:0/3126994106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc108170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009820 tx=0x7f23ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee62259c21a179c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:52.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.021+0000 7f23f9ffb640 1 -- 172.21.15.12:0/3126994106 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23ec037070 con 0x7f23fc107d70 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.021+0000 7f23f9ffb640 1 -- 172.21.15.12:0/3126994106 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f23ec032900 con 0x7f23fc107d70 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.021+0000 7f23f9ffb640 1 -- 172.21.15.12:0/3126994106 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23ec030850 con 0x7f23fc107d70 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.022+0000 7f240191e640 1 -- 172.21.15.12:0/3126994106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 msgr2=0x7f23fc108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.022+0000 7f240191e640 1 --2- 172.21.15.12:0/3126994106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc108170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009820 tx=0x7f23ec02a270 comp rx=0 tx=0).stop 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.022+0000 7f240191e640 1 -- 172.21.15.12:0/3126994106 shutdown_connections 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.022+0000 7f240191e640 1 --2- 172.21.15.12:0/3126994106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc108170 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.022+0000 7f240191e640 1 -- 172.21.15.12:0/3126994106 >> 172.21.15.12:0/3126994106 conn(0x7f23fc101600 msgr2=0x7f23fc103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.022+0000 7f240191e640 1 -- 172.21.15.12:0/3126994106 shutdown_connections 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.022+0000 7f240191e640 1 -- 172.21.15.12:0/3126994106 wait complete. 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.022+0000 7f240191e640 1 Processor -- start 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.022+0000 7f240191e640 1 -- start start 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f240191e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc19d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:52.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f240191e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc106720 con 0x7f23fc107d70 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f23faffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc19d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f23faffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc19d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41362/0 (socket says 172.21.15.12:41362) 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f23faffd640 1 -- 172.21.15.12:0/3504736374 learned_addr learned my addr 172.21.15.12:0/3504736374 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f23faffd640 1 -- 172.21.15.12:0/3504736374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc19dee0 con 0x7f23fc107d70 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f23faffd640 1 --2- 172.21.15.12:0/3504736374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc19d9a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f23ec032ce0 tx=0x7f23ec032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f240091c640 1 -- 172.21.15.12:0/3504736374 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23ec042070 con 0x7f23fc107d70 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f240191e640 1 -- 172.21.15.12:0/3504736374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc19e170 con 0x7f23fc107d70 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f240191e640 1 -- 172.21.15.12:0/3504736374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc1a0e60 con 0x7f23fc107d70 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f240091c640 1 -- 172.21.15.12:0/3504736374 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f23ec032900 con 0x7f23fc107d70 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.023+0000 7f240091c640 1 -- 172.21.15.12:0/3504736374 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23ec037040 con 0x7f23fc107d70 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.024+0000 7f240091c640 1 -- 172.21.15.12:0/3504736374 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f23ec045070 con 0x7f23fc107d70 2024-09-19T06:30:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.024+0000 7f240191e640 1 -- 172.21.15.12:0/3504736374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e80052c0 con 0x7f23fc107d70 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.025+0000 7f240091c640 1 --2- 172.21.15.12:0/3504736374 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f23e4039160 0x7f23e403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.025+0000 7f240091c640 1 -- 172.21.15.12:0/3504736374 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f23ec06c3e0 con 0x7f23fc107d70 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.025+0000 7f23fa7fc640 1 --2- 172.21.15.12:0/3504736374 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f23e4039160 0x7f23e403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.025+0000 7f23fa7fc640 1 --2- 172.21.15.12:0/3504736374 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f23e4039160 0x7f23e403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f23f00098c0 tx=0x7f23f0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.030+0000 7f240091c640 1 -- 172.21.15.12:0/3504736374 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23ec0308c0 con 0x7f23fc107d70 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.251+0000 7f240191e640 1 -- 172.21.15.12:0/3504736374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f23e80055b0 con 0x7f23fc107d70 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.855+0000 7f240091c640 1 -- 172.21.15.12:0/3504736374 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f23ec06be00 con 0x7f23fc107d70 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.857+0000 7f240091c640 1 -- 172.21.15.12:0/3504736374 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f23ec047440 con 0x7f23fc107d70 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.858+0000 7f240191e640 1 -- 172.21.15.12:0/3504736374 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f23e4039160 msgr2=0x7f23e403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.858+0000 7f240191e640 1 --2- 172.21.15.12:0/3504736374 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f23e4039160 0x7f23e403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f23f00098c0 tx=0x7f23f0006db0 comp rx=0 tx=0).stop 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.858+0000 7f240191e640 1 -- 172.21.15.12:0/3504736374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 msgr2=0x7f23fc19d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.858+0000 7f240191e640 1 --2- 172.21.15.12:0/3504736374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc19d9a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f23ec032ce0 tx=0x7f23ec032d10 comp rx=0 tx=0).stop 2024-09-19T06:30:52.510 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.858+0000 7f240191e640 1 -- 172.21.15.12:0/3504736374 shutdown_connections 2024-09-19T06:30:52.511 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.858+0000 7f240191e640 1 --2- 172.21.15.12:0/3504736374 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f23e4039160 0x7f23e403b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:52.511 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.858+0000 7f240191e640 1 --2- 172.21.15.12:0/3504736374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc107d70 0x7f23fc19d9a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:52.511 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.858+0000 7f240191e640 1 -- 172.21.15.12:0/3504736374 >> 172.21.15.12:0/3504736374 conn(0x7f23fc101600 msgr2=0x7f23fc194020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:52.511 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.859+0000 7f240191e640 1 -- 172.21.15.12:0/3504736374 shutdown_connections 2024-09-19T06:30:52.511 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:51.859+0000 7f240191e640 1 -- 172.21.15.12:0/3504736374 wait complete. 2024-09-19T06:30:52.759 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:52 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:52.605+0000 7fdcd0a22040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:30:53.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:52 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3504736374' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T06:30:53.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:52 smithi012 ceph-mon[30937]: mgrmap e5: x(active, since 5s) 2024-09-19T06:30:53.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:52 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:52.937+0000 7fdcd0a22040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:30:53.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:53 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:53.006+0000 7fdcd0a22040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:30:53.480 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:53 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:53.204+0000 7fdcd0a22040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:30:53.773 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:30:53.773 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T06:30:53.773 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:30:53.773 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T06:30:53.773 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.938+0000 7f97b0fdd640 1 Processor -- start 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.938+0000 7f97b0fdd640 1 -- start start 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.938+0000 7f97b0fdd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.938+0000 7f97b0fdd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1070a0 con 0x7f97ac1066d0 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.938+0000 7f97aa59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.939+0000 7f97aa59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41392/0 (socket says 172.21.15.12:41392) 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.939+0000 7f97aa59c640 1 -- 172.21.15.12:0/1582041207 learned_addr learned my addr 172.21.15.12:0/1582041207 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.939+0000 7f97aa59c640 1 -- 172.21.15.12:0/1582041207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac1078d0 con 0x7f97ac1066d0 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.940+0000 7f97aa59c640 1 --2- 172.21.15.12:0/1582041207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac106ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f979c009820 tx=0x7f979c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faf388db2992054 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.940+0000 7f97a959a640 1 -- 172.21.15.12:0/1582041207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f979c037070 con 0x7f97ac1066d0 2024-09-19T06:30:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.940+0000 7f97a959a640 1 -- 172.21.15.12:0/1582041207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f979c032900 con 0x7f97ac1066d0 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.940+0000 7f97a959a640 1 -- 172.21.15.12:0/1582041207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f979c030850 con 0x7f97ac1066d0 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.941+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1582041207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 msgr2=0x7f97ac106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.941+0000 7f97b0fdd640 1 --2- 172.21.15.12:0/1582041207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac106ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f979c009820 tx=0x7f979c02a270 comp rx=0 tx=0).stop 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.941+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1582041207 shutdown_connections 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.941+0000 7f97b0fdd640 1 --2- 172.21.15.12:0/1582041207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac106ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.941+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1582041207 >> 172.21.15.12:0/1582041207 conn(0x7f97ac101e60 msgr2=0x7f97ac1042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.941+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1582041207 shutdown_connections 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.941+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1582041207 wait complete. 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.942+0000 7f97b0fdd640 1 Processor -- start 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.942+0000 7f97b0fdd640 1 -- start start 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.942+0000 7f97b0fdd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac191890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:53.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.942+0000 7f97b0fdd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac10ac80 con 0x7f97ac1066d0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.942+0000 7f97aa59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac191890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.942+0000 7f97aa59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac191890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41402/0 (socket says 172.21.15.12:41402) 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.942+0000 7f97aa59c640 1 -- 172.21.15.12:0/1399766359 learned_addr learned my addr 172.21.15.12:0/1399766359 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.942+0000 7f97aa59c640 1 -- 172.21.15.12:0/1399766359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac191dd0 con 0x7f97ac1066d0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.943+0000 7f97aa59c640 1 --2- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac191890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f979c009940 tx=0x7f979c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.943+0000 7f979b7fe640 1 -- 172.21.15.12:0/1399766359 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f979c042070 con 0x7f97ac1066d0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.943+0000 7f979b7fe640 1 -- 172.21.15.12:0/1399766359 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f979c0308c0 con 0x7f97ac1066d0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.943+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1399766359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ac18ffc0 con 0x7f97ac1066d0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.943+0000 7f979b7fe640 1 -- 172.21.15.12:0/1399766359 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f979c037040 con 0x7f97ac1066d0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.943+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1399766359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac190500 con 0x7f97ac1066d0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.944+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1399766359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97ac106b50 con 0x7f97ac1066d0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.944+0000 7f979b7fe640 1 -- 172.21.15.12:0/1399766359 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f979c045070 con 0x7f97ac1066d0 2024-09-19T06:30:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.944+0000 7f979b7fe640 1 --2- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f9794039200 0x7f979403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.944+0000 7f979b7fe640 1 -- 172.21.15.12:0/1399766359 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f979c06c210 con 0x7f97ac1066d0 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.944+0000 7f97a9d9b640 1 -- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f9794039200 msgr2=0x7f979403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4034653914 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.944+0000 7f97a9d9b640 1 --2- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f9794039200 0x7f979403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:52.953+0000 7f979b7fe640 1 -- 172.21.15.12:0/1399766359 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f979c04b170 con 0x7f97ac1066d0 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.145+0000 7f97a9d9b640 1 -- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f9794039200 msgr2=0x7f979403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4034653914 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.145+0000 7f97a9d9b640 1 --2- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f9794039200 0x7f979403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.178+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1399766359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f97ac190d40 con 0x7f97ac1066d0 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.178+0000 7f979b7fe640 1 -- 172.21.15.12:0/1399766359 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f979c02fd90 con 0x7f97ac1066d0 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.180+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f9794039200 msgr2=0x7f979403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.180+0000 7f97b0fdd640 1 --2- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f9794039200 0x7f979403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.180+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 msgr2=0x7f97ac191890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:53.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.180+0000 7f97b0fdd640 1 --2- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac191890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f979c009940 tx=0x7f979c032ce0 comp rx=0 tx=0).stop 2024-09-19T06:30:53.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.180+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1399766359 shutdown_connections 2024-09-19T06:30:53.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.180+0000 7f97b0fdd640 1 --2- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f9794039200 0x7f979403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:53.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.180+0000 7f97b0fdd640 1 --2- 172.21.15.12:0/1399766359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97ac1066d0 0x7f97ac191890 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:53.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.180+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1399766359 >> 172.21.15.12:0/1399766359 conn(0x7f97ac101e60 msgr2=0x7f97ac102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:53.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.180+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1399766359 shutdown_connections 2024-09-19T06:30:53.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:53.180+0000 7f97b0fdd640 1 -- 172.21.15.12:0/1399766359 wait complete. 2024-09-19T06:30:53.778 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2024-09-19T06:30:53.778 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 5... 2024-09-19T06:30:54.092 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:53 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1399766359' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:30:54.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:54 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:54.144+0000 7fdcd0a22040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:30:54.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:54 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:54.216+0000 7fdcd0a22040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:30:55.086 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:54 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:54.964+0000 7fdcd0a22040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:30:55.086 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:55.084+0000 7fdcd0a22040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:30:55.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:55.234+0000 7fdcd0a22040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:30:55.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:55.297+0000 7fdcd0a22040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:30:55.754 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:55.453+0000 7fdcd0a22040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:30:55.754 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:55.524+0000 7fdcd0a22040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:30:55.754 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:55.586+0000 7fdcd0a22040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:30:55.754 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:55.751+0000 7fdcd0a22040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:30:56.038 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:55.819+0000 7fdcd0a22040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:30:56.038 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:55.888+0000 7fdcd0a22040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:30:56.039 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:55.974+0000 7fdcd0a22040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:30:56.039 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:56.037+0000 7fdcd0a22040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:30:56.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:56.098+0000 7fdcd0a22040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:30:57.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:56.924+0000 7fdcd0a22040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:30:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: Active manager daemon x restarted 2024-09-19T06:30:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: Activating manager daemon x 2024-09-19T06:30:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T06:30:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: mgrmap e6: x(active, starting, since 0.00336363s) 2024-09-19T06:30:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:30:57.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:30:57.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:30:57.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:30:57.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:30:57.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: Manager daemon x is now available 2024-09-19T06:30:57.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:30:57.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:30:57.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:30:57.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:30:57.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:30:57.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:56 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:30:58.595 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:30:58.595 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T06:30:58.595 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:30:58.595 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:30:58.595 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.171+0000 7f76f6bc0640 1 Processor -- start 2024-09-19T06:30:58.595 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.171+0000 7f76f6bc0640 1 -- start start 2024-09-19T06:30:58.595 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.171+0000 7f76f6bc0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f01064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.171+0000 7f76f6bc0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f76f007bdd0 con 0x7f76f01060b0 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.172+0000 7f76f495c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f01064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.172+0000 7f76f495c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f01064b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41408/0 (socket says 172.21.15.12:41408) 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.172+0000 7f76f495c640 1 -- 172.21.15.12:0/1260625308 learned_addr learned my addr 172.21.15.12:0/1260625308 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.172+0000 7f76f495c640 1 -- 172.21.15.12:0/1260625308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f01069f0 con 0x7f76f01060b0 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.173+0000 7f76f495c640 1 --2- 172.21.15.12:0/1260625308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f01064b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009820 tx=0x7f76e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71780fc93cca6962 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.173+0000 7f76ef7fe640 1 -- 172.21.15.12:0/1260625308 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e4037070 con 0x7f76f01060b0 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.173+0000 7f76ef7fe640 1 -- 172.21.15.12:0/1260625308 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76e4032900 con 0x7f76f01060b0 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.173+0000 7f76ef7fe640 1 -- 172.21.15.12:0/1260625308 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e4030850 con 0x7f76f01060b0 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.174+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1260625308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 msgr2=0x7f76f01064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:58.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.174+0000 7f76f6bc0640 1 --2- 172.21.15.12:0/1260625308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f01064b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009820 tx=0x7f76e402a270 comp rx=0 tx=0).stop 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.174+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1260625308 shutdown_connections 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.174+0000 7f76f6bc0640 1 --2- 172.21.15.12:0/1260625308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f01064b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.174+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1260625308 >> 172.21.15.12:0/1260625308 conn(0x7f76f0101e60 msgr2=0x7f76f01042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.174+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1260625308 shutdown_connections 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.174+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1260625308 wait complete. 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.175+0000 7f76f6bc0640 1 Processor -- start 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.175+0000 7f76f6bc0640 1 -- start start 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.175+0000 7f76f6bc0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f019d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.175+0000 7f76f6bc0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0107a80 con 0x7f76f01060b0 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.175+0000 7f76f495c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f019d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.175+0000 7f76f495c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f019d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41416/0 (socket says 172.21.15.12:41416) 2024-09-19T06:30:58.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.175+0000 7f76f495c640 1 -- 172.21.15.12:0/1566193645 learned_addr learned my addr 172.21.15.12:0/1566193645 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.175+0000 7f76f495c640 1 -- 172.21.15.12:0/1566193645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f019dee0 con 0x7f76f01060b0 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.176+0000 7f76f495c640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f019d9a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f76e4032ce0 tx=0x7f76e4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.176+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e4042070 con 0x7f76f01060b0 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.176+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76e40308c0 con 0x7f76f01060b0 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.176+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e4037040 con 0x7f76f01060b0 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.176+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1566193645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f019e170 con 0x7f76f01060b0 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.176+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1566193645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f01a0e60 con 0x7f76f01060b0 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.177+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f76e4045070 con 0x7f76f01060b0 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.177+0000 7f76edffb640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 0x7f76e003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.177+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 --> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f76e003bdd0 con 0x7f76e0039200 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.177+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f76e406c1e0 con 0x7f76f01060b0 2024-09-19T06:30:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.177+0000 7f76effff640 1 -- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 msgr2=0x7f76e003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4034653914 2024-09-19T06:30:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.177+0000 7f76effff640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 0x7f76e003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:30:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.378+0000 7f76effff640 1 -- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 msgr2=0x7f76e003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4034653914 2024-09-19T06:30:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.378+0000 7f76effff640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 0x7f76e003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:30:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.779+0000 7f76effff640 1 -- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 msgr2=0x7f76e003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4034653914 2024-09-19T06:30:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:54.779+0000 7f76effff640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 0x7f76e003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T06:30:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:55.580+0000 7f76effff640 1 -- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 msgr2=0x7f76e003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4034653914 2024-09-19T06:30:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:55.580+0000 7f76effff640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 0x7f76e003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T06:30:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:56.928+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f76e406ad60 con 0x7f76f01060b0 2024-09-19T06:30:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:56.928+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 msgr2=0x7f76e003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:30:58.599 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:56.928+0000 7f76edffb640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 0x7f76e003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:58.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.929+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f76e403cca0 con 0x7f76f01060b0 2024-09-19T06:30:58.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.929+0000 7f76edffb640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f76e003cb30 0x7f76e003ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:58.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.929+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 --> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f76e406ab50 con 0x7f76e003cb30 2024-09-19T06:30:58.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.930+0000 7f76effff640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f76e003cb30 0x7f76e003ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:58.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.930+0000 7f76effff640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f76e003cb30 0x7f76e003ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f76dc003980 tx=0x7f76dc0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:58.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.931+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 <== mgr.14118 v2:172.21.15.12:6800/1073027972 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f76e406ab50 con 0x7f76e003cb30 2024-09-19T06:30:58.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.938+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1566193645 --> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f76f01064b0 con 0x7f76e003cb30 2024-09-19T06:30:58.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.938+0000 7f76edffb640 1 -- 172.21.15.12:0/1566193645 <== mgr.14118 v2:172.21.15.12:6800/1073027972 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f76f01064b0 con 0x7f76e003cb30 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f76e003cb30 msgr2=0x7f76e003ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f76e003cb30 0x7f76e003ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f76dc003980 tx=0x7f76dc0092b0 comp rx=0 tx=0).stop 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 msgr2=0x7f76f019d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f019d9a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f76e4032ce0 tx=0x7f76e4032d10 comp rx=0 tx=0).stop 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1566193645 shutdown_connections 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f76e003cb30 0x7f76e003ef20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:6800/4034653914,v1:172.21.15.12:6801/4034653914] conn(0x7f76e0039200 0x7f76e003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 --2- 172.21.15.12:0/1566193645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76f01060b0 0x7f76f019d9a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1566193645 >> 172.21.15.12:0/1566193645 conn(0x7f76f0101e60 msgr2=0x7f76f0191cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1566193645 shutdown_connections 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:57.939+0000 7f76f6bc0640 1 -- 172.21.15.12:0/1566193645 wait complete. 2024-09-19T06:30:58.601 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 5 is available 2024-09-19T06:30:58.602 INFO:teuthology.orchestra.run.smithi012.stdout:Setting orchestrator backend to cephadm... 2024-09-19T06:30:58.838 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:58 smithi012 ceph-mon[30937]: Found migration_current of "None". Setting to last migration. 2024-09-19T06:30:58.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:58 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:30:58.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:58 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:30:58.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:58 smithi012 ceph-mon[30937]: mgrmap e7: x(active, since 1.00563s) 2024-09-19T06:30:59.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:59.010+0000 7fdc37d7c640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:30:59] ENGINE Error in HTTPServer.serve 2024-09-19T06:30:59.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: Traceback (most recent call last): 2024-09-19T06:30:59.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:30:59.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self._connections.run(self.expiration_interval) 2024-09-19T06:30:59.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self._run(expiration_interval) 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: s = self.context.wrap_socket( 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: return self.sslsocket_class._create( 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self.do_handshake() 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:30:59.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self._sslobj.do_handshake() 2024-09-19T06:30:59.131 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:30:59.131 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:30:59.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-mon[30937]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T06:30:59.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-mon[30937]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T06:30:59.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-mon[30937]: [19/Sep/2024:06:30:58] ENGINE Bus STARTING 2024-09-19T06:30:59.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-mon[30937]: [19/Sep/2024:06:30:58] ENGINE Serving on http://172.21.15.12:8765 2024-09-19T06:30:59.794 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:30:59.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:30:59.795 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:30:59 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:30:59.806 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.011+0000 7fb3a5bb7640 1 Processor -- start 2024-09-19T06:30:59.806 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.011+0000 7fb3a5bb7640 1 -- start start 2024-09-19T06:30:59.806 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.011+0000 7fb3a5bb7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a0107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:59.806 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.011+0000 7fb3a5bb7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a01081a0 con 0x7fb3a01077d0 2024-09-19T06:30:59.806 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.011+0000 7fb39f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a0107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:59.807 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.011+0000 7fb39f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a0107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41490/0 (socket says 172.21.15.12:41490) 2024-09-19T06:30:59.807 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.011+0000 7fb39f7fe640 1 -- 172.21.15.12:0/2231700606 learned_addr learned my addr 172.21.15.12:0/2231700606 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:59.807 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.011+0000 7fb39f7fe640 1 -- 172.21.15.12:0/2231700606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a01089d0 con 0x7fb3a01077d0 2024-09-19T06:30:59.807 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.012+0000 7fb39f7fe640 1 --2- 172.21.15.12:0/2231700606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a0107bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb390009820 tx=0x7fb39002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68110fbed00252b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:59.807 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.012+0000 7fb39e7fc640 1 -- 172.21.15.12:0/2231700606 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb390037070 con 0x7fb3a01077d0 2024-09-19T06:30:59.807 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.012+0000 7fb39e7fc640 1 -- 172.21.15.12:0/2231700606 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb390032900 con 0x7fb3a01077d0 2024-09-19T06:30:59.807 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.012+0000 7fb39e7fc640 1 -- 172.21.15.12:0/2231700606 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb390030850 con 0x7fb3a01077d0 2024-09-19T06:30:59.807 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.013+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/2231700606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 msgr2=0x7fb3a0107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:59.807 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.013+0000 7fb3a5bb7640 1 --2- 172.21.15.12:0/2231700606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a0107bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb390009820 tx=0x7fb39002a270 comp rx=0 tx=0).stop 2024-09-19T06:30:59.807 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.013+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/2231700606 shutdown_connections 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.013+0000 7fb3a5bb7640 1 --2- 172.21.15.12:0/2231700606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a0107bd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.013+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/2231700606 >> 172.21.15.12:0/2231700606 conn(0x7fb3a0102fc0 msgr2=0x7fb3a01053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.013+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/2231700606 shutdown_connections 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.013+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/2231700606 wait complete. 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.014+0000 7fb3a5bb7640 1 Processor -- start 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.014+0000 7fb3a5bb7640 1 -- start start 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.014+0000 7fb3a5bb7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a019b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.014+0000 7fb3a5bb7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a010bd80 con 0x7fb3a01077d0 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.014+0000 7fb39f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a019b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.014+0000 7fb39f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a019b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41502/0 (socket says 172.21.15.12:41502) 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.014+0000 7fb39f7fe640 1 -- 172.21.15.12:0/1566040245 learned_addr learned my addr 172.21.15.12:0/1566040245 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:30:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.014+0000 7fb39f7fe640 1 -- 172.21.15.12:0/1566040245 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a019bcc0 con 0x7fb3a01077d0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.015+0000 7fb39f7fe640 1 --2- 172.21.15.12:0/1566040245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a019b780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb3900097f0 tx=0x7fb390030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.015+0000 7fb39cff9640 1 -- 172.21.15.12:0/1566040245 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb390037040 con 0x7fb3a01077d0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.015+0000 7fb39cff9640 1 -- 172.21.15.12:0/1566040245 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb390040070 con 0x7fb3a01077d0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.015+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/1566040245 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a019bf50 con 0x7fb3a01077d0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.015+0000 7fb39cff9640 1 -- 172.21.15.12:0/1566040245 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb39003a390 con 0x7fb3a01077d0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.015+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/1566040245 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a019ec40 con 0x7fb3a01077d0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.016+0000 7fb39cff9640 1 -- 172.21.15.12:0/1566040245 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fb39003a630 con 0x7fb3a01077d0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.016+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/1566040245 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a0107c50 con 0x7fb3a01077d0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.016+0000 7fb39cff9640 1 --2- 172.21.15.12:0/1566040245 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fb3880390a0 0x7fb38803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.016+0000 7fb39cff9640 1 -- 172.21.15.12:0/1566040245 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb39006c5b0 con 0x7fb3a01077d0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.016+0000 7fb39effd640 1 --2- 172.21.15.12:0/1566040245 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fb3880390a0 0x7fb38803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.016+0000 7fb39effd640 1 --2- 172.21.15.12:0/1566040245 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fb3880390a0 0x7fb38803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb3940098c0 tx=0x7fb394006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:30:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.021+0000 7fb39cff9640 1 -- 172.21.15.12:0/1566040245 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb39004a200 con 0x7fb3a01077d0 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.212+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/1566040245 --> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fb3a0104250 con 0x7fb3880390a0 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.217+0000 7fb39cff9640 1 -- 172.21.15.12:0/1566040245 <== mgr.14118 v2:172.21.15.12:6800/1073027972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb3a0104250 con 0x7fb3880390a0 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.219+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/1566040245 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fb3880390a0 msgr2=0x7fb38803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.219+0000 7fb3a5bb7640 1 --2- 172.21.15.12:0/1566040245 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fb3880390a0 0x7fb38803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb3940098c0 tx=0x7fb394006db0 comp rx=0 tx=0).stop 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.219+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/1566040245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 msgr2=0x7fb3a019b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.219+0000 7fb3a5bb7640 1 --2- 172.21.15.12:0/1566040245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a019b780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb3900097f0 tx=0x7fb390030d80 comp rx=0 tx=0).stop 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.219+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/1566040245 shutdown_connections 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.219+0000 7fb3a5bb7640 1 --2- 172.21.15.12:0/1566040245 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fb3880390a0 0x7fb38803b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.219+0000 7fb3a5bb7640 1 --2- 172.21.15.12:0/1566040245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a01077d0 0x7fb3a019b780 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.219+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/1566040245 >> 172.21.15.12:0/1566040245 conn(0x7fb3a0102fc0 msgr2=0x7fb3a0103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:30:59.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.219+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/1566040245 shutdown_connections 2024-09-19T06:30:59.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:30:59.219+0000 7fb3a5bb7640 1 -- 172.21.15.12:0/1566040245 wait complete. 2024-09-19T06:31:00.733 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:00 smithi012 ceph-mon[30937]: [19/Sep/2024:06:30:59] ENGINE Serving on https://172.21.15.12:7150 2024-09-19T06:31:00.733 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:00 smithi012 ceph-mon[30937]: [19/Sep/2024:06:30:59] ENGINE Bus STARTED 2024-09-19T06:31:00.733 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:00 smithi012 ceph-mon[30937]: [19/Sep/2024:06:30:59] ENGINE Error in HTTPServer.serve 2024-09-19T06:31:00.733 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-19T06:31:00.733 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:31:00.733 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:31:00.733 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:31:00.734 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-19T06:31:00.734 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:31:00.734 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:31:00.734 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:31:00.734 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:31:00.734 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:31:00.734 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-19T06:31:00.734 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:31:00.734 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-19T06:31:00.734 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:31:00.735 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-19T06:31:00.735 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:31:00.735 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-19T06:31:00.735 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:31:00.735 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:00 smithi012 ceph-mon[30937]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:00.735 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:00 smithi012 ceph-mon[30937]: mgrmap e8: x(active, since 2s) 2024-09-19T06:31:01.024 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T06:31:01.024 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.212+0000 7f6d1f769640 1 Processor -- start 2024-09-19T06:31:01.024 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.212+0000 7f6d1f769640 1 -- start start 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.212+0000 7f6d1f769640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d1810a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.212+0000 7f6d1f769640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1807bdf0 con 0x7f6d181082f0 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.212+0000 7f6d1d505640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d1810a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.212+0000 7f6d1d505640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d1810a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41504/0 (socket says 172.21.15.12:41504) 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.212+0000 7f6d1d505640 1 -- 172.21.15.12:0/4284950635 learned_addr learned my addr 172.21.15.12:0/4284950635 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.213+0000 7f6d1d505640 1 -- 172.21.15.12:0/4284950635 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1810ac20 con 0x7f6d181082f0 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.213+0000 7f6d1d505640 1 --2- 172.21.15.12:0/4284950635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d1810a6e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009820 tx=0x7f6d1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b0c9cf3c64bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.214+0000 7f6d0ffff640 1 -- 172.21.15.12:0/4284950635 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d14037070 con 0x7f6d181082f0 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.214+0000 7f6d0ffff640 1 -- 172.21.15.12:0/4284950635 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d14032900 con 0x7f6d181082f0 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.214+0000 7f6d0ffff640 1 -- 172.21.15.12:0/4284950635 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d14030850 con 0x7f6d181082f0 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.214+0000 7f6d1f769640 1 -- 172.21.15.12:0/4284950635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 msgr2=0x7f6d1810a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.214+0000 7f6d1f769640 1 --2- 172.21.15.12:0/4284950635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d1810a6e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009820 tx=0x7f6d1402a270 comp rx=0 tx=0).stop 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.214+0000 7f6d1f769640 1 -- 172.21.15.12:0/4284950635 shutdown_connections 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.214+0000 7f6d1f769640 1 --2- 172.21.15.12:0/4284950635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d1810a6e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.214+0000 7f6d1f769640 1 -- 172.21.15.12:0/4284950635 >> 172.21.15.12:0/4284950635 conn(0x7f6d18101f10 msgr2=0x7f6d18104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.214+0000 7f6d1f769640 1 -- 172.21.15.12:0/4284950635 shutdown_connections 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.214+0000 7f6d1f769640 1 -- 172.21.15.12:0/4284950635 wait complete. 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.215+0000 7f6d1f769640 1 Processor -- start 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.215+0000 7f6d1f769640 1 -- start start 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.215+0000 7f6d1f769640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d18107b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.215+0000 7f6d1f769640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1810bbf0 con 0x7f6d181082f0 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.215+0000 7f6d1d505640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d18107b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.215+0000 7f6d1d505640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d18107b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41506/0 (socket says 172.21.15.12:41506) 2024-09-19T06:31:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.215+0000 7f6d1d505640 1 -- 172.21.15.12:0/4041932000 learned_addr learned my addr 172.21.15.12:0/4041932000 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.215+0000 7f6d1d505640 1 -- 172.21.15.12:0/4041932000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d181080b0 con 0x7f6d181082f0 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.216+0000 7f6d1d505640 1 --2- 172.21.15.12:0/4041932000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d18107b70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6d140097f0 tx=0x7f6d14030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.216+0000 7f6d0e7fc640 1 -- 172.21.15.12:0/4041932000 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d14037040 con 0x7f6d181082f0 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.216+0000 7f6d0e7fc640 1 -- 172.21.15.12:0/4041932000 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d14040070 con 0x7f6d181082f0 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.216+0000 7f6d0e7fc640 1 -- 172.21.15.12:0/4041932000 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1403a390 con 0x7f6d181082f0 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.216+0000 7f6d1f769640 1 -- 172.21.15.12:0/4041932000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d181062a0 con 0x7f6d181082f0 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.216+0000 7f6d1f769640 1 -- 172.21.15.12:0/4041932000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d18106780 con 0x7f6d181082f0 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.217+0000 7f6d0e7fc640 1 -- 172.21.15.12:0/4041932000 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6d14032900 con 0x7f6d181082f0 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.217+0000 7f6d1f769640 1 -- 172.21.15.12:0/4041932000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d18108750 con 0x7f6d181082f0 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.217+0000 7f6d0e7fc640 1 --2- 172.21.15.12:0/4041932000 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6d040391b0 0x7f6d0403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.217+0000 7f6d0e7fc640 1 -- 172.21.15.12:0/4041932000 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6d1406c7c0 con 0x7f6d181082f0 2024-09-19T06:31:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.217+0000 7f6d1cd04640 1 --2- 172.21.15.12:0/4041932000 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6d040391b0 0x7f6d0403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.218+0000 7f6d1cd04640 1 --2- 172.21.15.12:0/4041932000 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6d040391b0 0x7f6d0403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d080098c0 tx=0x7f6d08006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.222+0000 7f6d0e7fc640 1 -- 172.21.15.12:0/4041932000 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d14040cc0 con 0x7f6d181082f0 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.402+0000 7f6d1f769640 1 -- 172.21.15.12:0/4041932000 --> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f6d181070d0 con 0x7f6d040391b0 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.402+0000 7f6d0e7fc640 1 -- 172.21.15.12:0/4041932000 <== mgr.14118 v2:172.21.15.12:6800/1073027972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f6d181070d0 con 0x7f6d040391b0 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.405+0000 7f6d1f769640 1 -- 172.21.15.12:0/4041932000 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6d040391b0 msgr2=0x7f6d0403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.405+0000 7f6d1f769640 1 --2- 172.21.15.12:0/4041932000 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6d040391b0 0x7f6d0403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d080098c0 tx=0x7f6d08006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.405+0000 7f6d1f769640 1 -- 172.21.15.12:0/4041932000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 msgr2=0x7f6d18107b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.405+0000 7f6d1f769640 1 --2- 172.21.15.12:0/4041932000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d18107b70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6d140097f0 tx=0x7f6d14030d80 comp rx=0 tx=0).stop 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.405+0000 7f6d1f769640 1 -- 172.21.15.12:0/4041932000 shutdown_connections 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.405+0000 7f6d1f769640 1 --2- 172.21.15.12:0/4041932000 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6d040391b0 0x7f6d0403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.405+0000 7f6d1f769640 1 --2- 172.21.15.12:0/4041932000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d181082f0 0x7f6d18107b70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:01.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.405+0000 7f6d1f769640 1 -- 172.21.15.12:0/4041932000 >> 172.21.15.12:0/4041932000 conn(0x7f6d18101f10 msgr2=0x7f6d18102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:01.029 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.405+0000 7f6d1f769640 1 -- 172.21.15.12:0/4041932000 shutdown_connections 2024-09-19T06:31:01.029 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:00.405+0000 7f6d1f769640 1 -- 172.21.15.12:0/4041932000 wait complete. 2024-09-19T06:31:01.029 INFO:teuthology.orchestra.run.smithi012.stdout:Generating ssh key... 2024-09-19T06:31:01.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:01 smithi012 ceph-mon[30937]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:02.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: Generating public/private rsa key pair. 2024-09-19T06:31:02.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: Your identification has been saved in /tmp/tmpwm56ngp6/key 2024-09-19T06:31:02.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: Your public key has been saved in /tmp/tmpwm56ngp6/key.pub 2024-09-19T06:31:02.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: The key fingerprint is: 2024-09-19T06:31:02.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: SHA256:hHPdCQR1x0sAkd/vNQwxr+0WozSEQCeCAXWHdTxsNVo ceph-8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:02.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: The key's randomart image is: 2024-09-19T06:31:02.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: +---[RSA 3072]----+ 2024-09-19T06:31:02.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: | .oooo=OO*+E. | 2024-09-19T06:31:02.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: | ..ooo=Oo=+ | 2024-09-19T06:31:02.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: | o o +o=o+. | 2024-09-19T06:31:02.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: | + ..oo. | 2024-09-19T06:31:02.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: | S . =. | 2024-09-19T06:31:02.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: | + *o| 2024-09-19T06:31:02.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: | . +.=| 2024-09-19T06:31:02.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: | . o.| 2024-09-19T06:31:02.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: | . | 2024-09-19T06:31:02.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: +----[SHA256]-----+ 2024-09-19T06:31:02.675 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-mon[30937]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:02.675 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-mon[30937]: Generating ssh key... 2024-09-19T06:31:02.675 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:31:02.675 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:02 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:31:02.682 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.399+0000 7fea8eae3640 1 Processor -- start 2024-09-19T06:31:02.682 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.399+0000 7fea8eae3640 1 -- start start 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.399+0000 7fea8eae3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8807c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.399+0000 7fea8eae3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fea8807c850 con 0x7fea8807de20 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.400+0000 7fea8c87f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8807c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.400+0000 7fea8c87f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8807c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57854/0 (socket says 172.21.15.12:57854) 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.400+0000 7fea8c87f640 1 -- 172.21.15.12:0/1167121243 learned_addr learned my addr 172.21.15.12:0/1167121243 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.400+0000 7fea8c87f640 1 -- 172.21.15.12:0/1167121243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8807c9d0 con 0x7fea8807de20 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.400+0000 7fea8c87f640 1 --2- 172.21.15.12:0/1167121243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8807c280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fea78009820 tx=0x7fea7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a05a473e8cb4f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.401+0000 7fea877fe640 1 -- 172.21.15.12:0/1167121243 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea78037070 con 0x7fea8807de20 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.401+0000 7fea877fe640 1 -- 172.21.15.12:0/1167121243 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea78032900 con 0x7fea8807de20 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.401+0000 7fea877fe640 1 -- 172.21.15.12:0/1167121243 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea78030850 con 0x7fea8807de20 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.401+0000 7fea8eae3640 1 -- 172.21.15.12:0/1167121243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 msgr2=0x7fea8807c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.401+0000 7fea8eae3640 1 --2- 172.21.15.12:0/1167121243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8807c280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fea78009820 tx=0x7fea7802a270 comp rx=0 tx=0).stop 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.401+0000 7fea8eae3640 1 -- 172.21.15.12:0/1167121243 shutdown_connections 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.401+0000 7fea8eae3640 1 --2- 172.21.15.12:0/1167121243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8807c280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.401+0000 7fea8eae3640 1 -- 172.21.15.12:0/1167121243 >> 172.21.15.12:0/1167121243 conn(0x7fea88102f60 msgr2=0x7fea881053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.401+0000 7fea8eae3640 1 -- 172.21.15.12:0/1167121243 shutdown_connections 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.401+0000 7fea8eae3640 1 -- 172.21.15.12:0/1167121243 wait complete. 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.402+0000 7fea8eae3640 1 Processor -- start 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.402+0000 7fea8eae3640 1 -- start start 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.402+0000 7fea8eae3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8819d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.402+0000 7fea8eae3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fea8810dde0 con 0x7fea8807de20 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.402+0000 7fea8c87f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8819d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.402+0000 7fea8c87f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8819d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57864/0 (socket says 172.21.15.12:57864) 2024-09-19T06:31:02.684 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.402+0000 7fea8c87f640 1 -- 172.21.15.12:0/2366693090 learned_addr learned my addr 172.21.15.12:0/2366693090 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.402+0000 7fea8c87f640 1 -- 172.21.15.12:0/2366693090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8819df10 con 0x7fea8807de20 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.403+0000 7fea8c87f640 1 --2- 172.21.15.12:0/2366693090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8819d9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea780097f0 tx=0x7fea78030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.403+0000 7fea85ffb640 1 -- 172.21.15.12:0/2366693090 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea78037040 con 0x7fea8807de20 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.403+0000 7fea85ffb640 1 -- 172.21.15.12:0/2366693090 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea78040070 con 0x7fea8807de20 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.403+0000 7fea8eae3640 1 -- 172.21.15.12:0/2366693090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8819e1a0 con 0x7fea8807de20 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.403+0000 7fea85ffb640 1 -- 172.21.15.12:0/2366693090 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea7803a390 con 0x7fea8807de20 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.403+0000 7fea8eae3640 1 -- 172.21.15.12:0/2366693090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea881a0e90 con 0x7fea8807de20 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.404+0000 7fea85ffb640 1 -- 172.21.15.12:0/2366693090 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fea7803a5e0 con 0x7fea8807de20 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.404+0000 7fea8eae3640 1 -- 172.21.15.12:0/2366693090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8807c300 con 0x7fea8807de20 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.404+0000 7fea85ffb640 1 --2- 172.21.15.12:0/2366693090 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fea74039200 0x7fea7403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.404+0000 7fea85ffb640 1 -- 172.21.15.12:0/2366693090 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fea7806c970 con 0x7fea8807de20 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.404+0000 7fea87fff640 1 --2- 172.21.15.12:0/2366693090 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fea74039200 0x7fea7403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:02.685 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.405+0000 7fea87fff640 1 --2- 172.21.15.12:0/2366693090 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fea74039200 0x7fea7403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea7000ad30 tx=0x7fea700093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.409+0000 7fea85ffb640 1 -- 172.21.15.12:0/2366693090 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea78043360 con 0x7fea8807de20 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:01.586+0000 7fea8eae3640 1 -- 172.21.15.12:0/2366693090 --> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fea88104250 con 0x7fea74039200 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.106+0000 7fea85ffb640 1 -- 172.21.15.12:0/2366693090 <== mgr.14118 v2:172.21.15.12:6800/1073027972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fea88104250 con 0x7fea74039200 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.108+0000 7fea8eae3640 1 -- 172.21.15.12:0/2366693090 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fea74039200 msgr2=0x7fea7403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.108+0000 7fea8eae3640 1 --2- 172.21.15.12:0/2366693090 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fea74039200 0x7fea7403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea7000ad30 tx=0x7fea700093f0 comp rx=0 tx=0).stop 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.108+0000 7fea8eae3640 1 -- 172.21.15.12:0/2366693090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 msgr2=0x7fea8819d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.108+0000 7fea8eae3640 1 --2- 172.21.15.12:0/2366693090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8819d9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea780097f0 tx=0x7fea78030d80 comp rx=0 tx=0).stop 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.108+0000 7fea8eae3640 1 -- 172.21.15.12:0/2366693090 shutdown_connections 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.108+0000 7fea8eae3640 1 --2- 172.21.15.12:0/2366693090 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fea74039200 0x7fea7403b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.108+0000 7fea8eae3640 1 --2- 172.21.15.12:0/2366693090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8807de20 0x7fea8819d9d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.108+0000 7fea8eae3640 1 -- 172.21.15.12:0/2366693090 >> 172.21.15.12:0/2366693090 conn(0x7fea88102f60 msgr2=0x7fea88103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.108+0000 7fea8eae3640 1 -- 172.21.15.12:0/2366693090 shutdown_connections 2024-09-19T06:31:02.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:02.108+0000 7fea8eae3640 1 -- 172.21.15.12:0/2366693090 wait complete. 2024-09-19T06:31:03.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzNgxFJXrmdMsV28cPqDUbeAUbUgx0B+VTFtMuit3zzBufvum3wcrxGHzzlUCSYz3xJ/dM3U0mDBwBiYhbcK61Lnk/mL3Thu4KBP6N/5HMIN39yGw7NBM05vJKC0smaWjl7iOUtgXDh6A1ba5F0rR6gOHc/cEv08e2ChiD3JEY/17uqxH/EBwuamO/zyRn1CZgLtbEHsNMTq58sbPTSaS0iVBoLX+dg1dyn3nFhNUwPlZ/xwLtYgoS3ay1iJ/teappKZalQ77qHR6TWrvGkSK8kWV3LctSlmdgMth1wmh2gzWKVyenqusHFDHEnQPToNgmkMkOOj7kblLibjsT5c+XO95Vr2XfD9pWp9N9Fic/Cp/C6Vn8VyaUeIAUk+svl8kygCGSbZBfCDFbxx9nPnMKkVd/UUbR9wp8XQqpFUulKSh4UeQpFCysnewpVFQaAl+04vQs8Pv7z8bBsuiOOB7X/MSGnXxv16N7Ef5xgA4IraF/1Ogo4PgVQOSkFBNrxTM= ceph-8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:03.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.090+0000 7f7882271640 1 Processor -- start 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.090+0000 7f7882271640 1 -- start start 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.090+0000 7f7882271640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c106ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.090+0000 7f7882271640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1070b0 con 0x7f787c1066e0 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.090+0000 7f787bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c106ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.090+0000 7f787bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c106ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57880/0 (socket says 172.21.15.12:57880) 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.090+0000 7f787bfff640 1 -- 172.21.15.12:0/2492728498 learned_addr learned my addr 172.21.15.12:0/2492728498 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.091+0000 7f787bfff640 1 -- 172.21.15.12:0/2492728498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c1078e0 con 0x7f787c1066e0 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.091+0000 7f787bfff640 1 --2- 172.21.15.12:0/2492728498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c106ae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f786c009820 tx=0x7f786c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453fe0393435491b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.092+0000 7f787affd640 1 -- 172.21.15.12:0/2492728498 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c037070 con 0x7f787c1066e0 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.092+0000 7f787affd640 1 -- 172.21.15.12:0/2492728498 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f786c032900 con 0x7f787c1066e0 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.092+0000 7f787affd640 1 -- 172.21.15.12:0/2492728498 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c030850 con 0x7f787c1066e0 2024-09-19T06:31:03.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.092+0000 7f7882271640 1 -- 172.21.15.12:0/2492728498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 msgr2=0x7f787c106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.092+0000 7f7882271640 1 --2- 172.21.15.12:0/2492728498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c106ae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f786c009820 tx=0x7f786c02a270 comp rx=0 tx=0).stop 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.092+0000 7f7882271640 1 -- 172.21.15.12:0/2492728498 shutdown_connections 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.092+0000 7f7882271640 1 --2- 172.21.15.12:0/2492728498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c106ae0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.092+0000 7f7882271640 1 -- 172.21.15.12:0/2492728498 >> 172.21.15.12:0/2492728498 conn(0x7f787c101ed0 msgr2=0x7f787c1042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.092+0000 7f7882271640 1 -- 172.21.15.12:0/2492728498 shutdown_connections 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.092+0000 7f7882271640 1 -- 172.21.15.12:0/2492728498 wait complete. 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.093+0000 7f7882271640 1 Processor -- start 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.093+0000 7f7882271640 1 -- start start 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.093+0000 7f7882271640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c07b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.093+0000 7f7882271640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f787c10ac90 con 0x7f787c1066e0 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.093+0000 7f787bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c07b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.093+0000 7f787bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c07b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57890/0 (socket says 172.21.15.12:57890) 2024-09-19T06:31:03.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.093+0000 7f787bfff640 1 -- 172.21.15.12:0/3311315442 learned_addr learned my addr 172.21.15.12:0/3311315442 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.094+0000 7f787bfff640 1 -- 172.21.15.12:0/3311315442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c19e4f0 con 0x7f787c1066e0 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.094+0000 7f787bfff640 1 --2- 172.21.15.12:0/3311315442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c07b9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f786c009940 tx=0x7f786c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.094+0000 7f78797fa640 1 -- 172.21.15.12:0/3311315442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c042070 con 0x7f787c1066e0 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.094+0000 7f78797fa640 1 -- 172.21.15.12:0/3311315442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f786c0308c0 con 0x7f787c1066e0 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.094+0000 7f7882271640 1 -- 172.21.15.12:0/3311315442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c19e6c0 con 0x7f787c1066e0 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.094+0000 7f78797fa640 1 -- 172.21.15.12:0/3311315442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c037040 con 0x7f787c1066e0 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.094+0000 7f7882271640 1 -- 172.21.15.12:0/3311315442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c19ea60 con 0x7f787c1066e0 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.095+0000 7f78797fa640 1 -- 172.21.15.12:0/3311315442 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f786c045070 con 0x7f787c1066e0 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.095+0000 7f78797fa640 1 --2- 172.21.15.12:0/3311315442 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f78640391b0 0x7f786403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.095+0000 7f78797fa640 1 -- 172.21.15.12:0/3311315442 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f786c06c380 con 0x7f787c1066e0 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.095+0000 7f7882271640 1 -- 172.21.15.12:0/3311315442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c106b60 con 0x7f787c1066e0 2024-09-19T06:31:03.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.095+0000 7f787b7fe640 1 --2- 172.21.15.12:0/3311315442 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f78640391b0 0x7f786403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.096+0000 7f787b7fe640 1 --2- 172.21.15.12:0/3311315442 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f78640391b0 0x7f786403b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f78700098c0 tx=0x7f7870006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.100+0000 7f78797fa640 1 -- 172.21.15.12:0/3311315442 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f786c03cd90 con 0x7f787c1066e0 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.276+0000 7f7882271640 1 -- 172.21.15.12:0/3311315442 --> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f787c103190 con 0x7f78640391b0 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.277+0000 7f78797fa640 1 -- 172.21.15.12:0/3311315442 <== mgr.14118 v2:172.21.15.12:6800/1073027972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f787c103190 con 0x7f78640391b0 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.279+0000 7f7882271640 1 -- 172.21.15.12:0/3311315442 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f78640391b0 msgr2=0x7f786403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.279+0000 7f7882271640 1 --2- 172.21.15.12:0/3311315442 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f78640391b0 0x7f786403b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f78700098c0 tx=0x7f7870006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.279+0000 7f7882271640 1 -- 172.21.15.12:0/3311315442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 msgr2=0x7f787c07b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.279+0000 7f7882271640 1 --2- 172.21.15.12:0/3311315442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c07b9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f786c009940 tx=0x7f786c032ce0 comp rx=0 tx=0).stop 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.279+0000 7f7882271640 1 -- 172.21.15.12:0/3311315442 shutdown_connections 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.279+0000 7f7882271640 1 --2- 172.21.15.12:0/3311315442 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f78640391b0 0x7f786403b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.279+0000 7f7882271640 1 --2- 172.21.15.12:0/3311315442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f787c1066e0 0x7f787c07b9d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.279+0000 7f7882271640 1 -- 172.21.15.12:0/3311315442 >> 172.21.15.12:0/3311315442 conn(0x7f787c101ed0 msgr2=0x7f787c102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.279+0000 7f7882271640 1 -- 172.21.15.12:0/3311315442 shutdown_connections 2024-09-19T06:31:03.835 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:03.279+0000 7f7882271640 1 -- 172.21.15.12:0/3311315442 wait complete. 2024-09-19T06:31:03.835 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:31:03.835 INFO:teuthology.orchestra.run.smithi012.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T06:31:03.837 INFO:teuthology.orchestra.run.smithi012.stdout:Adding host smithi012... 2024-09-19T06:31:04.067 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:03 smithi012 ceph-mon[30937]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:05.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:04 smithi012 ceph-mon[30937]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:06.104 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:05 smithi012 ceph-mon[30937]: Deploying cephadm binary to smithi012 2024-09-19T06:31:08.921 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Added host 'smithi012' with addr '172.21.15.12' 2024-09-19T06:31:08.921 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.272+0000 7f0ad50d1640 1 Processor -- start 2024-09-19T06:31:08.921 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.272+0000 7f0ad50d1640 1 -- start start 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.272+0000 7f0ad50d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad007c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.272+0000 7f0ad50d1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad007c850 con 0x7f0ad007de20 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.272+0000 7f0aced9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad007c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.272+0000 7f0aced9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad007c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57894/0 (socket says 172.21.15.12:57894) 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.272+0000 7f0aced9d640 1 -- 172.21.15.12:0/2325788312 learned_addr learned my addr 172.21.15.12:0/2325788312 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.272+0000 7f0aced9d640 1 -- 172.21.15.12:0/2325788312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad007c9d0 con 0x7f0ad007de20 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.273+0000 7f0aced9d640 1 --2- 172.21.15.12:0/2325788312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad007c280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009820 tx=0x7f0ac002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda55837edf3fe80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.273+0000 7f0acdd9b640 1 -- 172.21.15.12:0/2325788312 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ac0037070 con 0x7f0ad007de20 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.273+0000 7f0acdd9b640 1 -- 172.21.15.12:0/2325788312 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ac0032900 con 0x7f0ad007de20 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.273+0000 7f0acdd9b640 1 -- 172.21.15.12:0/2325788312 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ac0030850 con 0x7f0ad007de20 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.274+0000 7f0ad50d1640 1 -- 172.21.15.12:0/2325788312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 msgr2=0x7f0ad007c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.274+0000 7f0ad50d1640 1 --2- 172.21.15.12:0/2325788312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad007c280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009820 tx=0x7f0ac002a270 comp rx=0 tx=0).stop 2024-09-19T06:31:08.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.274+0000 7f0ad50d1640 1 -- 172.21.15.12:0/2325788312 shutdown_connections 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.274+0000 7f0ad50d1640 1 --2- 172.21.15.12:0/2325788312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad007c280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.274+0000 7f0ad50d1640 1 -- 172.21.15.12:0/2325788312 >> 172.21.15.12:0/2325788312 conn(0x7f0ad0102f60 msgr2=0x7f0ad01053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.274+0000 7f0ad50d1640 1 -- 172.21.15.12:0/2325788312 shutdown_connections 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.274+0000 7f0ad50d1640 1 -- 172.21.15.12:0/2325788312 wait complete. 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.275+0000 7f0ad50d1640 1 Processor -- start 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.275+0000 7f0ad50d1640 1 -- start start 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.275+0000 7f0ad50d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.275+0000 7f0ad50d1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad010dde0 con 0x7f0ad007de20 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.275+0000 7f0aced9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.275+0000 7f0aced9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad019d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57906/0 (socket says 172.21.15.12:57906) 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.275+0000 7f0aced9d640 1 -- 172.21.15.12:0/3343557336 learned_addr learned my addr 172.21.15.12:0/3343557336 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.276+0000 7f0aced9d640 1 -- 172.21.15.12:0/3343557336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad019df10 con 0x7f0ad007de20 2024-09-19T06:31:08.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.276+0000 7f0aced9d640 1 --2- 172.21.15.12:0/3343557336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad019d9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0032ce0 tx=0x7f0ac0032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.276+0000 7f0ab7fff640 1 -- 172.21.15.12:0/3343557336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ac0042070 con 0x7f0ad007de20 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.276+0000 7f0ad50d1640 1 -- 172.21.15.12:0/3343557336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad019e1a0 con 0x7f0ad007de20 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.276+0000 7f0ab7fff640 1 -- 172.21.15.12:0/3343557336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ac00308c0 con 0x7f0ad007de20 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.276+0000 7f0ab7fff640 1 -- 172.21.15.12:0/3343557336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ac0037040 con 0x7f0ad007de20 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.276+0000 7f0ad50d1640 1 -- 172.21.15.12:0/3343557336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad01a0e90 con 0x7f0ad007de20 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.277+0000 7f0ab7fff640 1 -- 172.21.15.12:0/3343557336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0ac0045070 con 0x7f0ad007de20 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.277+0000 7f0ad50d1640 1 -- 172.21.15.12:0/3343557336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad007c300 con 0x7f0ad007de20 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.278+0000 7f0ab7fff640 1 --2- 172.21.15.12:0/3343557336 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0ab8039200 0x7f0ab803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.278+0000 7f0ab7fff640 1 -- 172.21.15.12:0/3343557336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0ac006c320 con 0x7f0ad007de20 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.278+0000 7f0ace59c640 1 --2- 172.21.15.12:0/3343557336 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0ab8039200 0x7f0ab803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.278+0000 7f0ace59c640 1 --2- 172.21.15.12:0/3343557336 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0ab8039200 0x7f0ab803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40098c0 tx=0x7f0ac4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:08.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.283+0000 7f0ab7fff640 1 -- 172.21.15.12:0/3343557336 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ac0045360 con 0x7f0ad007de20 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:04.464+0000 7f0ad50d1640 1 -- 172.21.15.12:0/3343557336 --> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}) -- 0x7f0ad0104250 con 0x7f0ab8039200 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.373+0000 7f0ab7fff640 1 -- 172.21.15.12:0/3343557336 <== mgr.14118 v2:172.21.15.12:6800/1073027972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f0ad0104250 con 0x7f0ab8039200 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.376+0000 7f0ad50d1640 1 -- 172.21.15.12:0/3343557336 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0ab8039200 msgr2=0x7f0ab803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.376+0000 7f0ad50d1640 1 --2- 172.21.15.12:0/3343557336 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0ab8039200 0x7f0ab803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40098c0 tx=0x7f0ac4006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.376+0000 7f0ad50d1640 1 -- 172.21.15.12:0/3343557336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 msgr2=0x7f0ad019d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.376+0000 7f0ad50d1640 1 --2- 172.21.15.12:0/3343557336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad019d9d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0032ce0 tx=0x7f0ac0032d10 comp rx=0 tx=0).stop 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.376+0000 7f0ad50d1640 1 -- 172.21.15.12:0/3343557336 shutdown_connections 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.376+0000 7f0ad50d1640 1 --2- 172.21.15.12:0/3343557336 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0ab8039200 0x7f0ab803b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.376+0000 7f0ad50d1640 1 --2- 172.21.15.12:0/3343557336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ad007de20 0x7f0ad019d9d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.376+0000 7f0ad50d1640 1 -- 172.21.15.12:0/3343557336 >> 172.21.15.12:0/3343557336 conn(0x7f0ad0102f60 msgr2=0x7f0ad0103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.376+0000 7f0ad50d1640 1 -- 172.21.15.12:0/3343557336 shutdown_connections 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.376+0000 7f0ad50d1640 1 -- 172.21.15.12:0/3343557336 wait complete. 2024-09-19T06:31:08.925 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mon service... 2024-09-19T06:31:09.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:09 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:31:09.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:09 smithi012 ceph-mon[30937]: Added host smithi012 2024-09-19T06:31:09.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:09 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:10.172 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T06:31:10.172 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.358+0000 7f978544d640 1 Processor -- start 2024-09-19T06:31:10.172 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.358+0000 7f978544d640 1 -- start start 2024-09-19T06:31:10.172 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.358+0000 7f978544d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f97801064a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:10.172 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.358+0000 7f978544d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f978007bdd0 con 0x7f97801060a0 2024-09-19T06:31:10.172 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.358+0000 7f977effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f97801064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:10.172 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.358+0000 7f977effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f97801064a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57918/0 (socket says 172.21.15.12:57918) 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.358+0000 7f977effd640 1 -- 172.21.15.12:0/1181500509 learned_addr learned my addr 172.21.15.12:0/1181500509 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.359+0000 7f977effd640 1 -- 172.21.15.12:0/1181500509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97801069e0 con 0x7f97801060a0 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.359+0000 7f977effd640 1 --2- 172.21.15.12:0/1181500509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f97801064a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9770009820 tx=0x7f977002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca96356d6cc8aca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.360+0000 7f977dffb640 1 -- 172.21.15.12:0/1181500509 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9770037070 con 0x7f97801060a0 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.360+0000 7f977dffb640 1 -- 172.21.15.12:0/1181500509 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9770032900 con 0x7f97801060a0 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.360+0000 7f977dffb640 1 -- 172.21.15.12:0/1181500509 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9770030850 con 0x7f97801060a0 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.360+0000 7f978544d640 1 -- 172.21.15.12:0/1181500509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 msgr2=0x7f97801064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.360+0000 7f978544d640 1 --2- 172.21.15.12:0/1181500509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f97801064a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9770009820 tx=0x7f977002a270 comp rx=0 tx=0).stop 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.360+0000 7f978544d640 1 -- 172.21.15.12:0/1181500509 shutdown_connections 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.360+0000 7f978544d640 1 --2- 172.21.15.12:0/1181500509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f97801064a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:10.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.360+0000 7f978544d640 1 -- 172.21.15.12:0/1181500509 >> 172.21.15.12:0/1181500509 conn(0x7f9780101ed0 msgr2=0x7f97801042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.360+0000 7f978544d640 1 -- 172.21.15.12:0/1181500509 shutdown_connections 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.360+0000 7f978544d640 1 -- 172.21.15.12:0/1181500509 wait complete. 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.361+0000 7f978544d640 1 Processor -- start 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.361+0000 7f978544d640 1 -- start start 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.361+0000 7f978544d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f978019d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.361+0000 7f978544d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9780107a70 con 0x7f97801060a0 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.361+0000 7f977effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f978019d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.361+0000 7f977effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f978019d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57926/0 (socket says 172.21.15.12:57926) 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.361+0000 7f977effd640 1 -- 172.21.15.12:0/473493373 learned_addr learned my addr 172.21.15.12:0/473493373 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.362+0000 7f977effd640 1 -- 172.21.15.12:0/473493373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978019deb0 con 0x7f97801060a0 2024-09-19T06:31:10.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.362+0000 7f977effd640 1 --2- 172.21.15.12:0/473493373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f978019d970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9770032ce0 tx=0x7f9770032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:10.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.362+0000 7f9767fff640 1 -- 172.21.15.12:0/473493373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9770042070 con 0x7f97801060a0 2024-09-19T06:31:10.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.362+0000 7f9767fff640 1 -- 172.21.15.12:0/473493373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97700308c0 con 0x7f97801060a0 2024-09-19T06:31:10.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.362+0000 7f9767fff640 1 -- 172.21.15.12:0/473493373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9770037040 con 0x7f97801060a0 2024-09-19T06:31:10.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.362+0000 7f978544d640 1 -- 172.21.15.12:0/473493373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978019e140 con 0x7f97801060a0 2024-09-19T06:31:10.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.362+0000 7f978544d640 1 -- 172.21.15.12:0/473493373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97801a0e30 con 0x7f97801060a0 2024-09-19T06:31:10.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.363+0000 7f9767fff640 1 -- 172.21.15.12:0/473493373 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9770045070 con 0x7f97801060a0 2024-09-19T06:31:10.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.363+0000 7f9767fff640 1 --2- 172.21.15.12:0/473493373 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f97680391b0 0x7f976803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:10.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.363+0000 7f9767fff640 1 -- 172.21.15.12:0/473493373 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f977006c5a0 con 0x7f97801060a0 2024-09-19T06:31:10.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.363+0000 7f978544d640 1 -- 172.21.15.12:0/473493373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97801064a0 con 0x7f97801060a0 2024-09-19T06:31:10.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.363+0000 7f977e7fc640 1 --2- 172.21.15.12:0/473493373 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f97680391b0 0x7f976803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.364+0000 7f977e7fc640 1 --2- 172.21.15.12:0/473493373 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f97680391b0 0x7f976803b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f977400ad30 tx=0x7f97740093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.368+0000 7f9767fff640 1 -- 172.21.15.12:0/473493373 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9770045520 con 0x7f97801060a0 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.561+0000 7f978544d640 1 -- 172.21.15.12:0/473493373 --> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f9780074c70 con 0x7f97680391b0 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.565+0000 7f9767fff640 1 -- 172.21.15.12:0/473493373 <== mgr.14118 v2:172.21.15.12:6800/1073027972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9780074c70 con 0x7f97680391b0 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.568+0000 7f978544d640 1 -- 172.21.15.12:0/473493373 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f97680391b0 msgr2=0x7f976803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.568+0000 7f978544d640 1 --2- 172.21.15.12:0/473493373 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f97680391b0 0x7f976803b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f977400ad30 tx=0x7f97740093f0 comp rx=0 tx=0).stop 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.568+0000 7f978544d640 1 -- 172.21.15.12:0/473493373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 msgr2=0x7f978019d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.568+0000 7f978544d640 1 --2- 172.21.15.12:0/473493373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f978019d970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9770032ce0 tx=0x7f9770032d10 comp rx=0 tx=0).stop 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.568+0000 7f978544d640 1 -- 172.21.15.12:0/473493373 shutdown_connections 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.568+0000 7f978544d640 1 --2- 172.21.15.12:0/473493373 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f97680391b0 0x7f976803b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:10.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.568+0000 7f978544d640 1 --2- 172.21.15.12:0/473493373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97801060a0 0x7f978019d970 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:10.177 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.568+0000 7f978544d640 1 -- 172.21.15.12:0/473493373 >> 172.21.15.12:0/473493373 conn(0x7f9780101ed0 msgr2=0x7f9780191c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:10.177 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.568+0000 7f978544d640 1 -- 172.21.15.12:0/473493373 shutdown_connections 2024-09-19T06:31:10.177 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.568+0000 7f978544d640 1 -- 172.21.15.12:0/473493373 wait complete. 2024-09-19T06:31:10.177 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mgr service... 2024-09-19T06:31:10.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:10 smithi012 ceph-mon[30937]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:10.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:10 smithi012 ceph-mon[30937]: Saving service mon spec with placement count:5 2024-09-19T06:31:10.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:10 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:31:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T06:31:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.599+0000 7f0e3e648640 1 Processor -- start 2024-09-19T06:31:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.599+0000 7f0e3e648640 1 -- start start 2024-09-19T06:31:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.600+0000 7f0e3e648640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e38107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.600+0000 7f0e3e648640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e381081a0 con 0x7f0e381077d0 2024-09-19T06:31:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.600+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e38107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.600+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e38107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42866/0 (socket says 172.21.15.12:42866) 2024-09-19T06:31:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.600+0000 7f0e37fff640 1 -- 172.21.15.12:0/2505164307 learned_addr learned my addr 172.21.15.12:0/2505164307 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.600+0000 7f0e37fff640 1 -- 172.21.15.12:0/2505164307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e381089d0 con 0x7f0e381077d0 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.601+0000 7f0e37fff640 1 --2- 172.21.15.12:0/2505164307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e38107bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009820 tx=0x7f0e2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f1304cb7727931 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.601+0000 7f0e36ffd640 1 -- 172.21.15.12:0/2505164307 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e28037070 con 0x7f0e381077d0 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.601+0000 7f0e36ffd640 1 -- 172.21.15.12:0/2505164307 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e28032900 con 0x7f0e381077d0 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.601+0000 7f0e36ffd640 1 -- 172.21.15.12:0/2505164307 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e28030850 con 0x7f0e381077d0 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.602+0000 7f0e3e648640 1 -- 172.21.15.12:0/2505164307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 msgr2=0x7f0e38107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.602+0000 7f0e3e648640 1 --2- 172.21.15.12:0/2505164307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e38107bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009820 tx=0x7f0e2802a270 comp rx=0 tx=0).stop 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.602+0000 7f0e3e648640 1 -- 172.21.15.12:0/2505164307 shutdown_connections 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.602+0000 7f0e3e648640 1 --2- 172.21.15.12:0/2505164307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e38107bd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.602+0000 7f0e3e648640 1 -- 172.21.15.12:0/2505164307 >> 172.21.15.12:0/2505164307 conn(0x7f0e38102fc0 msgr2=0x7f0e381053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.602+0000 7f0e3e648640 1 -- 172.21.15.12:0/2505164307 shutdown_connections 2024-09-19T06:31:11.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.602+0000 7f0e3e648640 1 -- 172.21.15.12:0/2505164307 wait complete. 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.602+0000 7f0e3e648640 1 Processor -- start 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.603+0000 7f0e3e648640 1 -- start start 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.603+0000 7f0e3e648640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e3819b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.603+0000 7f0e3e648640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3810bd80 con 0x7f0e381077d0 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.603+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e3819b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.603+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e3819b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42870/0 (socket says 172.21.15.12:42870) 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.603+0000 7f0e37fff640 1 -- 172.21.15.12:0/2309438638 learned_addr learned my addr 172.21.15.12:0/2309438638 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.603+0000 7f0e37fff640 1 -- 172.21.15.12:0/2309438638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3819bcc0 con 0x7f0e381077d0 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.603+0000 7f0e37fff640 1 --2- 172.21.15.12:0/2309438638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e3819b780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009940 tx=0x7f0e28032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.603+0000 7f0e357fa640 1 -- 172.21.15.12:0/2309438638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e28042070 con 0x7f0e381077d0 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.604+0000 7f0e3e648640 1 -- 172.21.15.12:0/2309438638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3819bf50 con 0x7f0e381077d0 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.604+0000 7f0e357fa640 1 -- 172.21.15.12:0/2309438638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e280308c0 con 0x7f0e381077d0 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.604+0000 7f0e357fa640 1 -- 172.21.15.12:0/2309438638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e28037040 con 0x7f0e381077d0 2024-09-19T06:31:11.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.604+0000 7f0e3e648640 1 -- 172.21.15.12:0/2309438638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3819ec40 con 0x7f0e381077d0 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.605+0000 7f0e357fa640 1 -- 172.21.15.12:0/2309438638 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0e28045070 con 0x7f0e381077d0 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.605+0000 7f0e3e648640 1 -- 172.21.15.12:0/2309438638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e38107c50 con 0x7f0e381077d0 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.605+0000 7f0e357fa640 1 --2- 172.21.15.12:0/2309438638 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0e200391b0 0x7f0e2003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.605+0000 7f0e357fa640 1 -- 172.21.15.12:0/2309438638 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0e2806c320 con 0x7f0e381077d0 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.605+0000 7f0e377fe640 1 --2- 172.21.15.12:0/2309438638 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0e200391b0 0x7f0e2003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.605+0000 7f0e377fe640 1 --2- 172.21.15.12:0/2309438638 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0e200391b0 0x7f0e2003b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0098c0 tx=0x7f0e2c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.609+0000 7f0e357fa640 1 -- 172.21.15.12:0/2309438638 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0e2803cd90 con 0x7f0e381077d0 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.799+0000 7f0e3e648640 1 -- 172.21.15.12:0/2309438638 --> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f0e38104250 con 0x7f0e200391b0 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.806+0000 7f0e357fa640 1 -- 172.21.15.12:0/2309438638 <== mgr.14118 v2:172.21.15.12:6800/1073027972 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0e38104250 con 0x7f0e200391b0 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.808+0000 7f0e3e648640 1 -- 172.21.15.12:0/2309438638 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0e200391b0 msgr2=0x7f0e2003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.808+0000 7f0e3e648640 1 --2- 172.21.15.12:0/2309438638 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0e200391b0 0x7f0e2003b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0098c0 tx=0x7f0e2c006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:11.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.808+0000 7f0e3e648640 1 -- 172.21.15.12:0/2309438638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 msgr2=0x7f0e3819b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.808+0000 7f0e3e648640 1 --2- 172.21.15.12:0/2309438638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e3819b780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009940 tx=0x7f0e28032ce0 comp rx=0 tx=0).stop 2024-09-19T06:31:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.808+0000 7f0e3e648640 1 -- 172.21.15.12:0/2309438638 shutdown_connections 2024-09-19T06:31:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.808+0000 7f0e3e648640 1 --2- 172.21.15.12:0/2309438638 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f0e200391b0 0x7f0e2003b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.808+0000 7f0e3e648640 1 --2- 172.21.15.12:0/2309438638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e381077d0 0x7f0e3819b780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.808+0000 7f0e3e648640 1 -- 172.21.15.12:0/2309438638 >> 172.21.15.12:0/2309438638 conn(0x7f0e38102fc0 msgr2=0x7f0e38103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.808+0000 7f0e3e648640 1 -- 172.21.15.12:0/2309438638 shutdown_connections 2024-09-19T06:31:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.808+0000 7f0e3e648640 1 -- 172.21.15.12:0/2309438638 wait complete. 2024-09-19T06:31:12.119 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:11 smithi012 ceph-mon[30937]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:12.119 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:11 smithi012 ceph-mon[30937]: Saving service mgr spec with placement count:2 2024-09-19T06:31:12.119 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:11 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:31:13.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:13 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:31:13.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:13 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:31:13.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:13 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3285357558' entity='client.admin' 2024-09-19T06:31:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.564+0000 7f4b2c444640 1 Processor -- start 2024-09-19T06:31:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.564+0000 7f4b2c444640 1 -- start start 2024-09-19T06:31:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.565+0000 7f4b2c444640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b24106ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.565+0000 7f4b2c444640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4b241070b0 con 0x7f4b241066e0 2024-09-19T06:31:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.565+0000 7f4b2a1e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b24106ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.565+0000 7f4b2a1e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b24106ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42876/0 (socket says 172.21.15.12:42876) 2024-09-19T06:31:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.565+0000 7f4b2a1e0640 1 -- 172.21.15.12:0/1809841961 learned_addr learned my addr 172.21.15.12:0/1809841961 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.565+0000 7f4b2a1e0640 1 -- 172.21.15.12:0/1809841961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b241078e0 con 0x7f4b241066e0 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.566+0000 7f4b2a1e0640 1 --2- 172.21.15.12:0/1809841961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b24106ae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009820 tx=0x7f4b2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cfb0c9f383e746 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.566+0000 7f4b291de640 1 -- 172.21.15.12:0/1809841961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b20037070 con 0x7f4b241066e0 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.566+0000 7f4b291de640 1 -- 172.21.15.12:0/1809841961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b20032920 con 0x7f4b241066e0 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.566+0000 7f4b291de640 1 -- 172.21.15.12:0/1809841961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b20030810 con 0x7f4b241066e0 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.567+0000 7f4b2c444640 1 -- 172.21.15.12:0/1809841961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 msgr2=0x7f4b24106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.567+0000 7f4b2c444640 1 --2- 172.21.15.12:0/1809841961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b24106ae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009820 tx=0x7f4b2002a270 comp rx=0 tx=0).stop 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.567+0000 7f4b2c444640 1 -- 172.21.15.12:0/1809841961 shutdown_connections 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.567+0000 7f4b2c444640 1 --2- 172.21.15.12:0/1809841961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b24106ae0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.567+0000 7f4b2c444640 1 -- 172.21.15.12:0/1809841961 >> 172.21.15.12:0/1809841961 conn(0x7f4b24101ed0 msgr2=0x7f4b241042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.567+0000 7f4b2c444640 1 -- 172.21.15.12:0/1809841961 shutdown_connections 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.567+0000 7f4b2c444640 1 -- 172.21.15.12:0/1809841961 wait complete. 2024-09-19T06:31:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.568+0000 7f4b2c444640 1 Processor -- start 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.568+0000 7f4b2c444640 1 -- start start 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.568+0000 7f4b2c444640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b2419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.568+0000 7f4b2c444640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2410ac90 con 0x7f4b241066e0 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.568+0000 7f4b2a1e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b2419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.568+0000 7f4b2a1e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b2419b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42882/0 (socket says 172.21.15.12:42882) 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.568+0000 7f4b2a1e0640 1 -- 172.21.15.12:0/3285357558 learned_addr learned my addr 172.21.15.12:0/3285357558 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.568+0000 7f4b2a1e0640 1 -- 172.21.15.12:0/3285357558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2419bd00 con 0x7f4b241066e0 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.568+0000 7f4b2a1e0640 1 --2- 172.21.15.12:0/3285357558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b2419b7c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4b200097f0 tx=0x7f4b200327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.569+0000 7f4b1b7fe640 1 -- 172.21.15.12:0/3285357558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b20037040 con 0x7f4b241066e0 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.569+0000 7f4b1b7fe640 1 -- 172.21.15.12:0/3285357558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b20030cc0 con 0x7f4b241066e0 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.569+0000 7f4b2c444640 1 -- 172.21.15.12:0/3285357558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2419bf90 con 0x7f4b241066e0 2024-09-19T06:31:13.360 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.569+0000 7f4b1b7fe640 1 -- 172.21.15.12:0/3285357558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b2003a640 con 0x7f4b241066e0 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.569+0000 7f4b2c444640 1 -- 172.21.15.12:0/3285357558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2419ec80 con 0x7f4b241066e0 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.570+0000 7f4b1b7fe640 1 -- 172.21.15.12:0/3285357558 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4b2003a940 con 0x7f4b241066e0 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.570+0000 7f4b1b7fe640 1 --2- 172.21.15.12:0/3285357558 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f4b100391b0 0x7f4b1003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.570+0000 7f4b1b7fe640 1 -- 172.21.15.12:0/3285357558 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4b2006d810 con 0x7f4b241066e0 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.570+0000 7f4b299df640 1 --2- 172.21.15.12:0/3285357558 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f4b100391b0 0x7f4b1003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.570+0000 7f4b2c444640 1 -- 172.21.15.12:0/3285357558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b24106b60 con 0x7f4b241066e0 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.570+0000 7f4b299df640 1 --2- 172.21.15.12:0/3285357558 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f4b100391b0 0x7f4b1003b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4b140098c0 tx=0x7f4b14006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.575+0000 7f4b1b7fe640 1 -- 172.21.15.12:0/3285357558 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b2003ba40 con 0x7f4b241066e0 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.760+0000 7f4b2c444640 1 -- 172.21.15.12:0/3285357558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f4b2402d7f0 con 0x7f4b241066e0 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.765+0000 7f4b1b7fe640 1 -- 172.21.15.12:0/3285357558 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f4b2002fd60 con 0x7f4b241066e0 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.767+0000 7f4b2c444640 1 -- 172.21.15.12:0/3285357558 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f4b100391b0 msgr2=0x7f4b1003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:13.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.767+0000 7f4b2c444640 1 --2- 172.21.15.12:0/3285357558 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f4b100391b0 0x7f4b1003b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4b140098c0 tx=0x7f4b14006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:13.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.767+0000 7f4b2c444640 1 -- 172.21.15.12:0/3285357558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 msgr2=0x7f4b2419b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:13.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.767+0000 7f4b2c444640 1 --2- 172.21.15.12:0/3285357558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b2419b7c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4b200097f0 tx=0x7f4b200327b0 comp rx=0 tx=0).stop 2024-09-19T06:31:13.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.767+0000 7f4b2c444640 1 -- 172.21.15.12:0/3285357558 shutdown_connections 2024-09-19T06:31:13.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.767+0000 7f4b2c444640 1 --2- 172.21.15.12:0/3285357558 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f4b100391b0 0x7f4b1003b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:13.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.767+0000 7f4b2c444640 1 --2- 172.21.15.12:0/3285357558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b241066e0 0x7f4b2419b7c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:13.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.767+0000 7f4b2c444640 1 -- 172.21.15.12:0/3285357558 >> 172.21.15.12:0/3285357558 conn(0x7f4b24101ed0 msgr2=0x7f4b24102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:13.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.767+0000 7f4b2c444640 1 -- 172.21.15.12:0/3285357558 shutdown_connections 2024-09-19T06:31:13.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:12.768+0000 7f4b2c444640 1 -- 172.21.15.12:0/3285357558 wait complete. 2024-09-19T06:31:15.093 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:14 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/653632986' entity='client.admin' 2024-09-19T06:31:15.093 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:14 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:31:15.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.793+0000 7f1a09fc9640 1 Processor -- start 2024-09-19T06:31:15.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.793+0000 7f1a09fc9640 1 -- start start 2024-09-19T06:31:15.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.793+0000 7f1a09fc9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0407c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:15.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.793+0000 7f1a09fc9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0407c830 con 0x7f1a0407de00 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.794+0000 7f1a037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0407c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.794+0000 7f1a037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0407c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42888/0 (socket says 172.21.15.12:42888) 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.794+0000 7f1a037fe640 1 -- 172.21.15.12:0/1247908125 learned_addr learned my addr 172.21.15.12:0/1247908125 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.794+0000 7f1a037fe640 1 -- 172.21.15.12:0/1247908125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0407c9b0 con 0x7f1a0407de00 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.795+0000 7f1a037fe640 1 --2- 172.21.15.12:0/1247908125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0407c260 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009e80 tx=0x7f19f402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f9350f3630ac8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.795+0000 7f1a027fc640 1 -- 172.21.15.12:0/1247908125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f4036070 con 0x7f1a0407de00 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.795+0000 7f1a027fc640 1 -- 172.21.15.12:0/1247908125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f40318e0 con 0x7f1a0407de00 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.795+0000 7f1a027fc640 1 -- 172.21.15.12:0/1247908125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f4007a00 con 0x7f1a0407de00 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.796+0000 7f1a09fc9640 1 -- 172.21.15.12:0/1247908125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 msgr2=0x7f1a0407c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.796+0000 7f1a09fc9640 1 --2- 172.21.15.12:0/1247908125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0407c260 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009e80 tx=0x7f19f402a7a0 comp rx=0 tx=0).stop 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.796+0000 7f1a09fc9640 1 -- 172.21.15.12:0/1247908125 shutdown_connections 2024-09-19T06:31:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.796+0000 7f1a09fc9640 1 --2- 172.21.15.12:0/1247908125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0407c260 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.796+0000 7f1a09fc9640 1 -- 172.21.15.12:0/1247908125 >> 172.21.15.12:0/1247908125 conn(0x7f1a04102f60 msgr2=0x7f1a041053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.796+0000 7f1a09fc9640 1 -- 172.21.15.12:0/1247908125 shutdown_connections 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.796+0000 7f1a09fc9640 1 -- 172.21.15.12:0/1247908125 wait complete. 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.796+0000 7f1a09fc9640 1 Processor -- start 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.797+0000 7f1a09fc9640 1 -- start start 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.797+0000 7f1a09fc9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0419d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.797+0000 7f1a09fc9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0410ddf0 con 0x7f1a0407de00 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.797+0000 7f1a037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0419d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.797+0000 7f1a037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0419d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42892/0 (socket says 172.21.15.12:42892) 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.797+0000 7f1a037fe640 1 -- 172.21.15.12:0/653632986 learned_addr learned my addr 172.21.15.12:0/653632986 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.797+0000 7f1a037fe640 1 -- 172.21.15.12:0/653632986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0419dec0 con 0x7f1a0407de00 2024-09-19T06:31:15.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.798+0000 7f1a037fe640 1 --2- 172.21.15.12:0/653632986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0419d980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19f4031cf0 tx=0x7f19f4031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.798+0000 7f1a00ff9640 1 -- 172.21.15.12:0/653632986 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f4036050 con 0x7f1a0407de00 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.798+0000 7f1a00ff9640 1 -- 172.21.15.12:0/653632986 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f4042070 con 0x7f1a0407de00 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.798+0000 7f1a09fc9640 1 -- 172.21.15.12:0/653632986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0419e150 con 0x7f1a0407de00 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.798+0000 7f1a00ff9640 1 -- 172.21.15.12:0/653632986 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f403d9b0 con 0x7f1a0407de00 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.798+0000 7f1a09fc9640 1 -- 172.21.15.12:0/653632986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a041a0e40 con 0x7f1a0407de00 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.799+0000 7f1a00ff9640 1 -- 172.21.15.12:0/653632986 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f19f403db50 con 0x7f1a0407de00 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.799+0000 7f1a09fc9640 1 -- 172.21.15.12:0/653632986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0407c2e0 con 0x7f1a0407de00 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.799+0000 7f1a00ff9640 1 --2- 172.21.15.12:0/653632986 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f19f0039200 0x7f19f003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.799+0000 7f1a00ff9640 1 -- 172.21.15.12:0/653632986 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f19f406d790 con 0x7f1a0407de00 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.799+0000 7f1a02ffd640 1 --2- 172.21.15.12:0/653632986 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f19f0039200 0x7f19f003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.800+0000 7f1a02ffd640 1 --2- 172.21.15.12:0/653632986 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f19f0039200 0x7f19f003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0098c0 tx=0x7f19ec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.804+0000 7f1a00ff9640 1 -- 172.21.15.12:0/653632986 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f19f4044310 con 0x7f1a0407de00 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.984+0000 7f1a09fc9640 1 -- 172.21.15.12:0/653632986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f1a041a14a0 con 0x7f1a0407de00 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.986+0000 7f1a00ff9640 1 -- 172.21.15.12:0/653632986 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f19f4045520 con 0x7f1a0407de00 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.989+0000 7f1a09fc9640 1 -- 172.21.15.12:0/653632986 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f19f0039200 msgr2=0x7f19f003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.989+0000 7f1a09fc9640 1 --2- 172.21.15.12:0/653632986 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f19f0039200 0x7f19f003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0098c0 tx=0x7f19ec006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.989+0000 7f1a09fc9640 1 -- 172.21.15.12:0/653632986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 msgr2=0x7f1a0419d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.989+0000 7f1a09fc9640 1 --2- 172.21.15.12:0/653632986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0419d980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19f4031cf0 tx=0x7f19f4031d20 comp rx=0 tx=0).stop 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.989+0000 7f1a09fc9640 1 -- 172.21.15.12:0/653632986 shutdown_connections 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.989+0000 7f1a09fc9640 1 --2- 172.21.15.12:0/653632986 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f19f0039200 0x7f19f003b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.989+0000 7f1a09fc9640 1 --2- 172.21.15.12:0/653632986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a0407de00 0x7f1a0419d980 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.989+0000 7f1a09fc9640 1 -- 172.21.15.12:0/653632986 >> 172.21.15.12:0/653632986 conn(0x7f1a04102f60 msgr2=0x7f1a04103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.989+0000 7f1a09fc9640 1 -- 172.21.15.12:0/653632986 shutdown_connections 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.989+0000 7f1a09fc9640 1 -- 172.21.15.12:0/653632986 wait complete. 2024-09-19T06:31:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling the dashboard module... 2024-09-19T06:31:16.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:16 smithi012 ceph-mon[30937]: from='mgr.14118 172.21.15.12:0/736211256' entity='mgr.x' 2024-09-19T06:31:16.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:16 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/830042450' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T06:31:16.879 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: ignoring --setuser ceph since I am not root 2024-09-19T06:31:16.879 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: ignoring --setgroup ceph since I am not root 2024-09-19T06:31:16.879 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:16.709+0000 7f955b829040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:31:16.880 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:16.769+0000 7f955b829040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:31:17.212 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:16.924+0000 7f955b829040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:31:17.212 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:16.993+0000 7f955b829040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:31:17.213 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:17.148+0000 7f955b829040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:31:17.221 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.502+0000 7fe917708640 1 Processor -- start 2024-09-19T06:31:17.221 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.503+0000 7fe917708640 1 -- start start 2024-09-19T06:31:17.221 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.503+0000 7fe917708640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe910106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:17.221 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.503+0000 7fe917708640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe9101070a0 con 0x7fe9101066d0 2024-09-19T06:31:17.221 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.503+0000 7fe9154a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe910106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:17.221 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.503+0000 7fe9154a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe910106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42904/0 (socket says 172.21.15.12:42904) 2024-09-19T06:31:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.503+0000 7fe9154a4640 1 -- 172.21.15.12:0/3348335122 learned_addr learned my addr 172.21.15.12:0/3348335122 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.504+0000 7fe9154a4640 1 -- 172.21.15.12:0/3348335122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9101078d0 con 0x7fe9101066d0 2024-09-19T06:31:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.505+0000 7fe9154a4640 1 --2- 172.21.15.12:0/3348335122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe910106ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009820 tx=0x7fe90c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d36b9af32d73d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.505+0000 7fe907fff640 1 -- 172.21.15.12:0/3348335122 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe90c037070 con 0x7fe9101066d0 2024-09-19T06:31:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.505+0000 7fe907fff640 1 -- 172.21.15.12:0/3348335122 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe90c032920 con 0x7fe9101066d0 2024-09-19T06:31:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.505+0000 7fe907fff640 1 -- 172.21.15.12:0/3348335122 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe90c030810 con 0x7fe9101066d0 2024-09-19T06:31:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.506+0000 7fe917708640 1 -- 172.21.15.12:0/3348335122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 msgr2=0x7fe910106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.506+0000 7fe917708640 1 --2- 172.21.15.12:0/3348335122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe910106ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009820 tx=0x7fe90c02a270 comp rx=0 tx=0).stop 2024-09-19T06:31:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.506+0000 7fe917708640 1 -- 172.21.15.12:0/3348335122 shutdown_connections 2024-09-19T06:31:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.506+0000 7fe917708640 1 --2- 172.21.15.12:0/3348335122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe910106ad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.506+0000 7fe917708640 1 -- 172.21.15.12:0/3348335122 >> 172.21.15.12:0/3348335122 conn(0x7fe910101e60 msgr2=0x7fe9101042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.506+0000 7fe917708640 1 -- 172.21.15.12:0/3348335122 shutdown_connections 2024-09-19T06:31:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.506+0000 7fe917708640 1 -- 172.21.15.12:0/3348335122 wait complete. 2024-09-19T06:31:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.507+0000 7fe917708640 1 Processor -- start 2024-09-19T06:31:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.507+0000 7fe917708640 1 -- start start 2024-09-19T06:31:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.507+0000 7fe917708640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe91007b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.507+0000 7fe917708640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe91010ac80 con 0x7fe9101066d0 2024-09-19T06:31:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.507+0000 7fe9154a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe91007b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.507+0000 7fe9154a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe91007b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42918/0 (socket says 172.21.15.12:42918) 2024-09-19T06:31:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.507+0000 7fe9154a4640 1 -- 172.21.15.12:0/830042450 learned_addr learned my addr 172.21.15.12:0/830042450 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.507+0000 7fe9154a4640 1 -- 172.21.15.12:0/830042450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91019e540 con 0x7fe9101066d0 2024-09-19T06:31:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.508+0000 7fe9154a4640 1 --2- 172.21.15.12:0/830042450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe91007b9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0097f0 tx=0x7fe90c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.508+0000 7fe9067fc640 1 -- 172.21.15.12:0/830042450 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe90c037040 con 0x7fe9101066d0 2024-09-19T06:31:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.508+0000 7fe917708640 1 -- 172.21.15.12:0/830042450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91019e710 con 0x7fe9101066d0 2024-09-19T06:31:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.508+0000 7fe9067fc640 1 -- 172.21.15.12:0/830042450 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe90c030cc0 con 0x7fe9101066d0 2024-09-19T06:31:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.508+0000 7fe9067fc640 1 -- 172.21.15.12:0/830042450 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe90c03a640 con 0x7fe9101066d0 2024-09-19T06:31:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.509+0000 7fe917708640 1 -- 172.21.15.12:0/830042450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91019eab0 con 0x7fe9101066d0 2024-09-19T06:31:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.509+0000 7fe9067fc640 1 -- 172.21.15.12:0/830042450 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe90c03a8f0 con 0x7fe9101066d0 2024-09-19T06:31:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.509+0000 7fe9067fc640 1 --2- 172.21.15.12:0/830042450 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fe8fc039200 0x7fe8fc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.509+0000 7fe9067fc640 1 -- 172.21.15.12:0/830042450 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe90c072060 con 0x7fe9101066d0 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.509+0000 7fe914ca3640 1 --2- 172.21.15.12:0/830042450 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fe8fc039200 0x7fe8fc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.510+0000 7fe917708640 1 -- 172.21.15.12:0/830042450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe910106b50 con 0x7fe9101066d0 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.510+0000 7fe914ca3640 1 --2- 172.21.15.12:0/830042450 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fe8fc039200 0x7fe8fc03b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9000098c0 tx=0x7fe900006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.515+0000 7fe9067fc640 1 -- 172.21.15.12:0/830042450 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe90c039950 con 0x7fe9101066d0 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.743+0000 7fe917708640 1 -- 172.21.15.12:0/830042450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fe91019ed60 con 0x7fe9101066d0 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.550+0000 7fe9067fc640 1 -- 172.21.15.12:0/830042450 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fe90c040210 con 0x7fe9101066d0 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.552+0000 7fe9067fc640 1 -- 172.21.15.12:0/830042450 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fe90c03ac80 con 0x7fe9101066d0 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.553+0000 7fe917708640 1 -- 172.21.15.12:0/830042450 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fe8fc039200 msgr2=0x7fe8fc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.553+0000 7fe917708640 1 --2- 172.21.15.12:0/830042450 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fe8fc039200 0x7fe8fc03b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9000098c0 tx=0x7fe900006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.554+0000 7fe917708640 1 -- 172.21.15.12:0/830042450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 msgr2=0x7fe91007b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:17.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.554+0000 7fe917708640 1 --2- 172.21.15.12:0/830042450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe91007b9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0097f0 tx=0x7fe90c0327b0 comp rx=0 tx=0).stop 2024-09-19T06:31:17.226 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.554+0000 7fe917708640 1 -- 172.21.15.12:0/830042450 shutdown_connections 2024-09-19T06:31:17.226 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.554+0000 7fe917708640 1 --2- 172.21.15.12:0/830042450 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7fe8fc039200 0x7fe8fc03b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:17.226 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.554+0000 7fe917708640 1 --2- 172.21.15.12:0/830042450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9101066d0 0x7fe91007b9d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:17.226 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.554+0000 7fe917708640 1 -- 172.21.15.12:0/830042450 >> 172.21.15.12:0/830042450 conn(0x7fe910101e60 msgr2=0x7fe910102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:17.226 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.554+0000 7fe917708640 1 -- 172.21.15.12:0/830042450 shutdown_connections 2024-09-19T06:31:17.226 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:16.554+0000 7fe917708640 1 -- 172.21.15.12:0/830042450 wait complete. 2024-09-19T06:31:17.466 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:17.297+0000 7f955b829040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:31:17.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:17 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/830042450' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T06:31:17.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:17 smithi012 ceph-mon[30937]: mgrmap e9: x(active, since 19s) 2024-09-19T06:31:17.801 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:17.629+0000 7f955b829040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:31:17.801 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:17.694+0000 7f955b829040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:31:18.088 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:17.891+0000 7f955b829040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:31:18.679 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:18 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2071026641' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:31:18.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.880+0000 7f6e20408640 1 Processor -- start 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.880+0000 7f6e20408640 1 -- start start 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.880+0000 7f6e20408640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e181080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.880+0000 7f6e20408640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6e181086a0 con 0x7f6e18107cd0 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.881+0000 7f6e1e1a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e181080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.881+0000 7f6e1e1a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e181080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42938/0 (socket says 172.21.15.12:42938) 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.881+0000 7f6e1e1a4640 1 -- 172.21.15.12:0/1865740874 learned_addr learned my addr 172.21.15.12:0/1865740874 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.881+0000 7f6e1e1a4640 1 -- 172.21.15.12:0/1865740874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e18108820 con 0x7f6e18107cd0 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.882+0000 7f6e1e1a4640 1 --2- 172.21.15.12:0/1865740874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e181080d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009820 tx=0x7f6e1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c20ad603a3ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.882+0000 7f6e1d1a2640 1 -- 172.21.15.12:0/1865740874 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e14037070 con 0x7f6e18107cd0 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.882+0000 7f6e1d1a2640 1 -- 172.21.15.12:0/1865740874 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e14032920 con 0x7f6e18107cd0 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.882+0000 7f6e1d1a2640 1 -- 172.21.15.12:0/1865740874 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e14030810 con 0x7f6e18107cd0 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.883+0000 7f6e20408640 1 -- 172.21.15.12:0/1865740874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 msgr2=0x7f6e181080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.883+0000 7f6e20408640 1 --2- 172.21.15.12:0/1865740874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e181080d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009820 tx=0x7f6e1402a270 comp rx=0 tx=0).stop 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.883+0000 7f6e20408640 1 -- 172.21.15.12:0/1865740874 shutdown_connections 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.883+0000 7f6e20408640 1 --2- 172.21.15.12:0/1865740874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e181080d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.883+0000 7f6e20408640 1 -- 172.21.15.12:0/1865740874 >> 172.21.15.12:0/1865740874 conn(0x7f6e18101630 msgr2=0x7f6e18103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.883+0000 7f6e20408640 1 -- 172.21.15.12:0/1865740874 shutdown_connections 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.883+0000 7f6e20408640 1 -- 172.21.15.12:0/1865740874 wait complete. 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.884+0000 7f6e20408640 1 Processor -- start 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.884+0000 7f6e20408640 1 -- start start 2024-09-19T06:31:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.884+0000 7f6e20408640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e1819d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.884+0000 7f6e20408640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6e181066f0 con 0x7f6e18107cd0 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.884+0000 7f6e1e1a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e1819d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.884+0000 7f6e1e1a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e1819d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42948/0 (socket says 172.21.15.12:42948) 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.884+0000 7f6e1e1a4640 1 -- 172.21.15.12:0/2071026641 learned_addr learned my addr 172.21.15.12:0/2071026641 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.884+0000 7f6e1e1a4640 1 -- 172.21.15.12:0/2071026641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1819deb0 con 0x7f6e18107cd0 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.884+0000 7f6e1e1a4640 1 --2- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e1819d970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e14030380 tx=0x7f6e14032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.885+0000 7f6e0b7fe640 1 -- 172.21.15.12:0/2071026641 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e14037040 con 0x7f6e18107cd0 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.885+0000 7f6e0b7fe640 1 -- 172.21.15.12:0/2071026641 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e14040070 con 0x7f6e18107cd0 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.885+0000 7f6e0b7fe640 1 -- 172.21.15.12:0/2071026641 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1403a7b0 con 0x7f6e18107cd0 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.885+0000 7f6e20408640 1 -- 172.21.15.12:0/2071026641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1819e140 con 0x7f6e18107cd0 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.885+0000 7f6e20408640 1 -- 172.21.15.12:0/2071026641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e181a0e30 con 0x7f6e18107cd0 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.885+0000 7f6e0b7fe640 1 -- 172.21.15.12:0/2071026641 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f6e1403aa30 con 0x7f6e18107cd0 2024-09-19T06:31:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.886+0000 7f6e0b7fe640 1 --2- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6e04039200 0x7f6e0403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.886+0000 7f6e0b7fe640 1 -- 172.21.15.12:0/2071026641 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6e1406c9c0 con 0x7f6e18107cd0 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.886+0000 7f6e1d9a3640 1 -- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6e04039200 msgr2=0x7f6e0403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1073027972 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.886+0000 7f6e1d9a3640 1 --2- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6e04039200 0x7f6e0403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.886+0000 7f6e20408640 1 -- 172.21.15.12:0/2071026641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e18108150 con 0x7f6e18107cd0 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:17.891+0000 7f6e0b7fe640 1 -- 172.21.15.12:0/2071026641 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e14042df0 con 0x7f6e18107cd0 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.087+0000 7f6e1d9a3640 1 -- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6e04039200 msgr2=0x7f6e0403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1073027972 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.087+0000 7f6e1d9a3640 1 --2- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6e04039200 0x7f6e0403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.116+0000 7f6e20408640 1 -- 172.21.15.12:0/2071026641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f6e18196de0 con 0x7f6e18107cd0 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.116+0000 7f6e0b7fe640 1 -- 172.21.15.12:0/2071026641 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f6e1403adc0 con 0x7f6e18107cd0 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.118+0000 7f6e20408640 1 -- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6e04039200 msgr2=0x7f6e0403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:31:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.118+0000 7f6e20408640 1 --2- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6e04039200 0x7f6e0403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.119+0000 7f6e20408640 1 -- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 msgr2=0x7f6e1819d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.119+0000 7f6e20408640 1 --2- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e1819d970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e14030380 tx=0x7f6e14032670 comp rx=0 tx=0).stop 2024-09-19T06:31:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.119+0000 7f6e20408640 1 -- 172.21.15.12:0/2071026641 shutdown_connections 2024-09-19T06:31:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.119+0000 7f6e20408640 1 --2- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f6e04039200 0x7f6e0403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.119+0000 7f6e20408640 1 --2- 172.21.15.12:0/2071026641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e18107cd0 0x7f6e1819d970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.119+0000 7f6e20408640 1 -- 172.21.15.12:0/2071026641 >> 172.21.15.12:0/2071026641 conn(0x7f6e18101630 msgr2=0x7f6e18193f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.119+0000 7f6e20408640 1 -- 172.21.15.12:0/2071026641 shutdown_connections 2024-09-19T06:31:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.119+0000 7f6e20408640 1 -- 172.21.15.12:0/2071026641 wait complete. 2024-09-19T06:31:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2024-09-19T06:31:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 9... 2024-09-19T06:31:18.936 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:18 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:18.837+0000 7f955b829040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:31:18.936 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:18 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:18.907+0000 7f955b829040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:31:19.928 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:19.657+0000 7f955b829040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:31:19.929 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:19.778+0000 7f955b829040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:31:20.220 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:19.927+0000 7f955b829040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:31:20.220 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:19.991+0000 7f955b829040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:31:20.220 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:20.147+0000 7f955b829040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:31:20.220 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:20.218+0000 7f955b829040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:31:20.516 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:20.281+0000 7f955b829040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:31:20.516 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:20.446+0000 7f955b829040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:31:20.516 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:20.514+0000 7f955b829040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:31:20.795 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:20.584+0000 7f955b829040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:31:20.795 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:20.670+0000 7f955b829040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:31:20.795 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:20.732+0000 7f955b829040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:31:20.795 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:20.793+0000 7f955b829040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:31:21.875 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:21.620+0000 7f955b829040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:31:21.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: Active manager daemon x restarted 2024-09-19T06:31:21.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: Activating manager daemon x 2024-09-19T06:31:21.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T06:31:21.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: mgrmap e10: x(active, starting, since 0.00335484s) 2024-09-19T06:31:21.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:31:21.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:31:21.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:31:21.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:31:21.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:31:21.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: Manager daemon x is now available 2024-09-19T06:31:21.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:21.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:31:21.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:31:23.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:31:23.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T06:31:23.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:31:23.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:31:23.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.129+0000 7f2558efd640 1 Processor -- start 2024-09-19T06:31:23.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.129+0000 7f2558efd640 1 -- start start 2024-09-19T06:31:23.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.129+0000 7f2558efd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f2554106af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:23.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.129+0000 7f2558efd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f25541070c0 con 0x7f25541066f0 2024-09-19T06:31:23.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.129+0000 7f255259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f2554106af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:23.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.129+0000 7f255259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f2554106af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42954/0 (socket says 172.21.15.12:42954) 2024-09-19T06:31:23.538 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.129+0000 7f255259c640 1 -- 172.21.15.12:0/2168468241 learned_addr learned my addr 172.21.15.12:0/2168468241 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:23.538 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.130+0000 7f255259c640 1 -- 172.21.15.12:0/2168468241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25541078f0 con 0x7f25541066f0 2024-09-19T06:31:23.538 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.130+0000 7f255259c640 1 --2- 172.21.15.12:0/2168468241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f2554106af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2544009820 tx=0x7f254402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c10ed6bc66ab38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:23.538 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.131+0000 7f2551d9b640 1 -- 172.21.15.12:0/2168468241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2544037070 con 0x7f25541066f0 2024-09-19T06:31:23.538 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.131+0000 7f2551d9b640 1 -- 172.21.15.12:0/2168468241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2544032920 con 0x7f25541066f0 2024-09-19T06:31:23.538 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.131+0000 7f2551d9b640 1 -- 172.21.15.12:0/2168468241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2544030810 con 0x7f25541066f0 2024-09-19T06:31:23.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.131+0000 7f2558efd640 1 -- 172.21.15.12:0/2168468241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 msgr2=0x7f2554106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:23.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.131+0000 7f2558efd640 1 --2- 172.21.15.12:0/2168468241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f2554106af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2544009820 tx=0x7f254402a270 comp rx=0 tx=0).stop 2024-09-19T06:31:23.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.132+0000 7f2558efd640 1 -- 172.21.15.12:0/2168468241 shutdown_connections 2024-09-19T06:31:23.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.132+0000 7f2558efd640 1 --2- 172.21.15.12:0/2168468241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f2554106af0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.132+0000 7f2558efd640 1 -- 172.21.15.12:0/2168468241 >> 172.21.15.12:0/2168468241 conn(0x7f2554101e80 msgr2=0x7f25541042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:23.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.132+0000 7f2558efd640 1 -- 172.21.15.12:0/2168468241 shutdown_connections 2024-09-19T06:31:23.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.132+0000 7f2558efd640 1 -- 172.21.15.12:0/2168468241 wait complete. 2024-09-19T06:31:23.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.132+0000 7f2558efd640 1 Processor -- start 2024-09-19T06:31:23.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.132+0000 7f2558efd640 1 -- start start 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f2558efd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f255419da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f2558efd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f255410aca0 con 0x7f25541066f0 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f255259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f255419da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f255259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f255419da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42956/0 (socket says 172.21.15.12:42956) 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f255259c640 1 -- 172.21.15.12:0/1286006460 learned_addr learned my addr 172.21.15.12:0/1286006460 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f255259c640 1 -- 172.21.15.12:0/1286006460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255419df60 con 0x7f25541066f0 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f255259c640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f255419da20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f25440097f0 tx=0x7f25440327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2544037040 con 0x7f25541066f0 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2544030cc0 con 0x7f25541066f0 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f2558efd640 1 -- 172.21.15.12:0/1286006460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255419e1f0 con 0x7f25541066f0 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.133+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f254403a640 con 0x7f25541066f0 2024-09-19T06:31:23.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.134+0000 7f2558efd640 1 -- 172.21.15.12:0/1286006460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25541a0ee0 con 0x7f25541066f0 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.134+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f254403a8f0 con 0x7f25541066f0 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.135+0000 7f254b7fe640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 0x7f254003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.135+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 --> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f254003be30 con 0x7f2540039260 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.135+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f254406c800 con 0x7f25541066f0 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.135+0000 7f254bfff640 1 -- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 msgr2=0x7f254003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1073027972 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.135+0000 7f254bfff640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 0x7f254003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.336+0000 7f254bfff640 1 -- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 msgr2=0x7f254003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1073027972 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.336+0000 7f254bfff640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 0x7f254003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.737+0000 7f254bfff640 1 -- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 msgr2=0x7f254003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1073027972 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:19.737+0000 7f254bfff640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 0x7f254003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:20.538+0000 7f254bfff640 1 -- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 msgr2=0x7f254003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1073027972 2024-09-19T06:31:23.541 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:20.538+0000 7f254bfff640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 0x7f254003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.624+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f254406b2b0 con 0x7f25541066f0 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.624+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 msgr2=0x7f254003b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.624+0000 7f254b7fe640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 0x7f254003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.625+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f2544044920 con 0x7f25541066f0 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.625+0000 7f254b7fe640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f254003cd20 0x7f254003f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.625+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2544001d30 con 0x7f254003cd20 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.626+0000 7f254bfff640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f254003cd20 0x7f254003f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.626+0000 7f254bfff640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f254003cd20 0x7f254003f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f253c003980 tx=0x7f253c0092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.627+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f2544001d30 con 0x7f254003cd20 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 -- 172.21.15.12:0/1286006460 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f2554106b70 con 0x7f254003cd20 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f254b7fe640 1 -- 172.21.15.12:0/1286006460 <== mgr.14150 v2:172.21.15.12:6800/4060248487 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f2554106b70 con 0x7f254003cd20 2024-09-19T06:31:23.542 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 -- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f254003cd20 msgr2=0x7f254003f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f254003cd20 0x7f254003f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f253c003980 tx=0x7f253c0092b0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 -- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 msgr2=0x7f255419da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f255419da20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f25440097f0 tx=0x7f25440327b0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 -- 172.21.15.12:0/1286006460 shutdown_connections 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f254003cd20 0x7f254003f110 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:6800/1073027972,v1:172.21.15.12:6801/1073027972] conn(0x7f2540039260 0x7f254003b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 --2- 172.21.15.12:0/1286006460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25541066f0 0x7f255419da20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 -- 172.21.15.12:0/1286006460 >> 172.21.15.12:0/1286006460 conn(0x7f2554101e80 msgr2=0x7f2554102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 -- 172.21.15.12:0/1286006460 shutdown_connections 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.635+0000 7f2558efd640 1 -- 172.21.15.12:0/1286006460 wait complete. 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 9 is available 2024-09-19T06:31:23.543 INFO:teuthology.orchestra.run.smithi012.stdout:Generating a dashboard self-signed certificate... 2024-09-19T06:31:23.778 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-mon[30937]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T06:31:23.778 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-mon[30937]: mgrmap e11: x(active, since 1.00595s) 2024-09-19T06:31:23.778 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-mon[30937]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T06:31:23.778 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:24.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:23.979+0000 7f94c6afd640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:31:23] ENGINE Error in HTTPServer.serve 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: Traceback (most recent call last): 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self._connections.run(self.expiration_interval) 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self._run(expiration_interval) 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: s = self.context.wrap_socket( 2024-09-19T06:31:24.130 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:31:24.131 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: return self.sslsocket_class._create( 2024-09-19T06:31:24.131 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:31:24.131 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self.do_handshake() 2024-09-19T06:31:24.131 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:31:24.131 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self._sslobj.do_handshake() 2024-09-19T06:31:24.131 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:31:24.131 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:31:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:31:24.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T06:31:24.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.947+0000 7f88b3371640 1 Processor -- start 2024-09-19T06:31:24.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.948+0000 7f88b3371640 1 -- start start 2024-09-19T06:31:24.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.948+0000 7f88b3371640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:24.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.948+0000 7f88b3371640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac1081a0 con 0x7f88ac1077d0 2024-09-19T06:31:24.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.948+0000 7f88b110d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:24.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.948+0000 7f88b110d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32776/0 (socket says 172.21.15.12:32776) 2024-09-19T06:31:24.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.948+0000 7f88b110d640 1 -- 172.21.15.12:0/613441391 learned_addr learned my addr 172.21.15.12:0/613441391 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:24.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.948+0000 7f88b110d640 1 -- 172.21.15.12:0/613441391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac1089d0 con 0x7f88ac1077d0 2024-09-19T06:31:24.721 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.949+0000 7f88b110d640 1 --2- 172.21.15.12:0/613441391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac107bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009820 tx=0x7f88a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1796622ec75886 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.949+0000 7f88a3fff640 1 -- 172.21.15.12:0/613441391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a8037070 con 0x7f88ac1077d0 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.949+0000 7f88a3fff640 1 -- 172.21.15.12:0/613441391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88a8032920 con 0x7f88ac1077d0 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.949+0000 7f88a3fff640 1 -- 172.21.15.12:0/613441391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a8030810 con 0x7f88ac1077d0 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.950+0000 7f88b3371640 1 -- 172.21.15.12:0/613441391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 msgr2=0x7f88ac107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.950+0000 7f88b3371640 1 --2- 172.21.15.12:0/613441391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac107bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009820 tx=0x7f88a802a270 comp rx=0 tx=0).stop 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.950+0000 7f88b3371640 1 -- 172.21.15.12:0/613441391 shutdown_connections 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.950+0000 7f88b3371640 1 --2- 172.21.15.12:0/613441391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac107bd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.950+0000 7f88b3371640 1 -- 172.21.15.12:0/613441391 >> 172.21.15.12:0/613441391 conn(0x7f88ac102f60 msgr2=0x7f88ac1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.950+0000 7f88b3371640 1 -- 172.21.15.12:0/613441391 shutdown_connections 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.950+0000 7f88b3371640 1 -- 172.21.15.12:0/613441391 wait complete. 2024-09-19T06:31:24.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.951+0000 7f88b3371640 1 Processor -- start 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.951+0000 7f88b3371640 1 -- start start 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.951+0000 7f88b3371640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.951+0000 7f88b3371640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac10bd80 con 0x7f88ac1077d0 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.951+0000 7f88b110d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.951+0000 7f88b110d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac19b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32790/0 (socket says 172.21.15.12:32790) 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.951+0000 7f88b110d640 1 -- 172.21.15.12:0/2922064729 learned_addr learned my addr 172.21.15.12:0/2922064729 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.951+0000 7f88b110d640 1 -- 172.21.15.12:0/2922064729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac19bcf0 con 0x7f88ac1077d0 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.951+0000 7f88b110d640 1 --2- 172.21.15.12:0/2922064729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac19b7b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f88a8030560 tx=0x7f88a8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.952+0000 7f88a27fc640 1 -- 172.21.15.12:0/2922064729 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a8037040 con 0x7f88ac1077d0 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.952+0000 7f88a27fc640 1 -- 172.21.15.12:0/2922064729 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88a8040070 con 0x7f88ac1077d0 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.952+0000 7f88b3371640 1 -- 172.21.15.12:0/2922064729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac19bf80 con 0x7f88ac1077d0 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.952+0000 7f88a27fc640 1 -- 172.21.15.12:0/2922064729 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a803a740 con 0x7f88ac1077d0 2024-09-19T06:31:24.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.952+0000 7f88b3371640 1 -- 172.21.15.12:0/2922064729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac19ec70 con 0x7f88ac1077d0 2024-09-19T06:31:24.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.953+0000 7f88a27fc640 1 -- 172.21.15.12:0/2922064729 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f88a803bb90 con 0x7f88ac1077d0 2024-09-19T06:31:24.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.953+0000 7f88b3371640 1 -- 172.21.15.12:0/2922064729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac107c50 con 0x7f88ac1077d0 2024-09-19T06:31:24.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.953+0000 7f88a27fc640 1 --2- 172.21.15.12:0/2922064729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8898039140 0x7f889803b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:24.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.953+0000 7f88a27fc640 1 -- 172.21.15.12:0/2922064729 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f88a806c790 con 0x7f88ac1077d0 2024-09-19T06:31:24.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.953+0000 7f88b090c640 1 --2- 172.21.15.12:0/2922064729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8898039140 0x7f889803b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:24.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.953+0000 7f88b090c640 1 --2- 172.21.15.12:0/2922064729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8898039140 0x7f889803b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f889c0098c0 tx=0x7f889c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:24.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.957+0000 7f88a27fc640 1 -- 172.21.15.12:0/2922064729 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f88a804a200 con 0x7f88ac1077d0 2024-09-19T06:31:24.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.993+0000 7f88a27fc640 1 -- 172.21.15.12:0/2922064729 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f88a803a8e0 con 0x7f88ac1077d0 2024-09-19T06:31:24.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.142+0000 7f88b3371640 1 -- 172.21.15.12:0/2922064729 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f88ac104250 con 0x7f8898039140 2024-09-19T06:31:24.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.215+0000 7f88a27fc640 1 -- 172.21.15.12:0/2922064729 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f88ac104250 con 0x7f8898039140 2024-09-19T06:31:24.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.217+0000 7f88b3371640 1 -- 172.21.15.12:0/2922064729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8898039140 msgr2=0x7f889803b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:24.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.217+0000 7f88b3371640 1 --2- 172.21.15.12:0/2922064729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8898039140 0x7f889803b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f889c0098c0 tx=0x7f889c006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:24.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.217+0000 7f88b3371640 1 -- 172.21.15.12:0/2922064729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 msgr2=0x7f88ac19b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:24.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.217+0000 7f88b3371640 1 --2- 172.21.15.12:0/2922064729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac19b7b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f88a8030560 tx=0x7f88a8032670 comp rx=0 tx=0).stop 2024-09-19T06:31:24.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.217+0000 7f88b3371640 1 -- 172.21.15.12:0/2922064729 shutdown_connections 2024-09-19T06:31:24.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.217+0000 7f88b3371640 1 --2- 172.21.15.12:0/2922064729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8898039140 0x7f889803b600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:24.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.217+0000 7f88b3371640 1 --2- 172.21.15.12:0/2922064729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88ac1077d0 0x7f88ac19b7b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:24.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.217+0000 7f88b3371640 1 -- 172.21.15.12:0/2922064729 >> 172.21.15.12:0/2922064729 conn(0x7f88ac102f60 msgr2=0x7f88ac103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:24.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.217+0000 7f88b3371640 1 -- 172.21.15.12:0/2922064729 shutdown_connections 2024-09-19T06:31:24.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:24.217+0000 7f88b3371640 1 -- 172.21.15.12:0/2922064729 wait complete. 2024-09-19T06:31:24.726 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial admin user... 2024-09-19T06:31:25.123 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:24 smithi012 ceph-mon[30937]: [19/Sep/2024:06:31:23] ENGINE Bus STARTING 2024-09-19T06:31:25.123 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:24 smithi012 ceph-mon[30937]: [19/Sep/2024:06:31:23] ENGINE Serving on https://172.21.15.12:7150 2024-09-19T06:31:25.123 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:24 smithi012 ceph-mon[30937]: [19/Sep/2024:06:31:23] ENGINE Error in HTTPServer.serve 2024-09-19T06:31:25.123 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:31:25.124 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:24 smithi012 ceph-mon[30937]: mgrmap e12: x(active, since 2s) 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:24 smithi012 ceph-mon[30937]: [19/Sep/2024:06:31:24] ENGINE Serving on http://172.21.15.12:8765 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:24 smithi012 ceph-mon[30937]: [19/Sep/2024:06:31:24] ENGINE Bus STARTED 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:24 smithi012 ceph-mon[30937]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:25.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:25.126 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:26.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:26 smithi012 ceph-mon[30937]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:26.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:26 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:27.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$LXydcpLT3pjBDKuiLqG2.O182F3WrlkT7m5ODVwabxrsgAFxKVffy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726727485, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T06:31:27.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.125+0000 7f5efc0fa640 1 Processor -- start 2024-09-19T06:31:27.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.125+0000 7f5efc0fa640 1 -- start start 2024-09-19T06:31:27.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.125+0000 7f5efc0fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef407c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:27.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.125+0000 7f5efc0fa640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef407c830 con 0x7f5ef407de00 2024-09-19T06:31:27.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.126+0000 7f5ef9e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef407c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:27.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.126+0000 7f5ef9e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef407c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32802/0 (socket says 172.21.15.12:32802) 2024-09-19T06:31:27.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.126+0000 7f5ef9e96640 1 -- 172.21.15.12:0/2544446325 learned_addr learned my addr 172.21.15.12:0/2544446325 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.126+0000 7f5ef9e96640 1 -- 172.21.15.12:0/2544446325 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef407c9b0 con 0x7f5ef407de00 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.126+0000 7f5ef9e96640 1 --2- 172.21.15.12:0/2544446325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef407c260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009820 tx=0x7f5ef002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3f9ecf6eaa8145 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.127+0000 7f5ef8e94640 1 -- 172.21.15.12:0/2544446325 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ef0037070 con 0x7f5ef407de00 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.127+0000 7f5ef8e94640 1 -- 172.21.15.12:0/2544446325 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ef0032920 con 0x7f5ef407de00 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.127+0000 7f5ef8e94640 1 -- 172.21.15.12:0/2544446325 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ef0030810 con 0x7f5ef407de00 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.127+0000 7f5efc0fa640 1 -- 172.21.15.12:0/2544446325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 msgr2=0x7f5ef407c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.127+0000 7f5efc0fa640 1 --2- 172.21.15.12:0/2544446325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef407c260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009820 tx=0x7f5ef002a270 comp rx=0 tx=0).stop 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.127+0000 7f5efc0fa640 1 -- 172.21.15.12:0/2544446325 shutdown_connections 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.127+0000 7f5efc0fa640 1 --2- 172.21.15.12:0/2544446325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef407c260 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.127+0000 7f5efc0fa640 1 -- 172.21.15.12:0/2544446325 >> 172.21.15.12:0/2544446325 conn(0x7f5ef4102f60 msgr2=0x7f5ef41053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.128+0000 7f5efc0fa640 1 -- 172.21.15.12:0/2544446325 shutdown_connections 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.128+0000 7f5efc0fa640 1 -- 172.21.15.12:0/2544446325 wait complete. 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.128+0000 7f5efc0fa640 1 Processor -- start 2024-09-19T06:31:27.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.128+0000 7f5efc0fa640 1 -- start start 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.128+0000 7f5efc0fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef419d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.128+0000 7f5efc0fa640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef410ddf0 con 0x7f5ef407de00 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.129+0000 7f5ef9e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef419d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.129+0000 7f5ef9e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef419d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32806/0 (socket says 172.21.15.12:32806) 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.129+0000 7f5ef9e96640 1 -- 172.21.15.12:0/3647248836 learned_addr learned my addr 172.21.15.12:0/3647248836 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.129+0000 7f5ef9e96640 1 -- 172.21.15.12:0/3647248836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef419dec0 con 0x7f5ef407de00 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.129+0000 7f5ef9e96640 1 --2- 172.21.15.12:0/3647248836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef419d980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0030380 tx=0x7f5ef0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.129+0000 7f5eeaffd640 1 -- 172.21.15.12:0/3647248836 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ef0037040 con 0x7f5ef407de00 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.129+0000 7f5eeaffd640 1 -- 172.21.15.12:0/3647248836 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ef0040070 con 0x7f5ef407de00 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.129+0000 7f5efc0fa640 1 -- 172.21.15.12:0/3647248836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef419e150 con 0x7f5ef407de00 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.129+0000 7f5eeaffd640 1 -- 172.21.15.12:0/3647248836 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ef003a7b0 con 0x7f5ef407de00 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.129+0000 7f5efc0fa640 1 -- 172.21.15.12:0/3647248836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef41a0e40 con 0x7f5ef407de00 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.130+0000 7f5eeaffd640 1 -- 172.21.15.12:0/3647248836 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f5ef003bc00 con 0x7f5ef407de00 2024-09-19T06:31:27.100 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.130+0000 7f5eeaffd640 1 --2- 172.21.15.12:0/3647248836 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5ee0039260 0x7f5ee003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.130+0000 7f5eeaffd640 1 -- 172.21.15.12:0/3647248836 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5ef006ca40 con 0x7f5ef407de00 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.130+0000 7f5efc0fa640 1 -- 172.21.15.12:0/3647248836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef407c2e0 con 0x7f5ef407de00 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.130+0000 7f5ef9695640 1 --2- 172.21.15.12:0/3647248836 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5ee0039260 0x7f5ee003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.131+0000 7f5ef9695640 1 --2- 172.21.15.12:0/3647248836 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5ee0039260 0x7f5ee003b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40098c0 tx=0x7f5ee4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.135+0000 7f5eeaffd640 1 -- 172.21.15.12:0/3647248836 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ef0040220 con 0x7f5ef407de00 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.354+0000 7f5efc0fa640 1 -- 172.21.15.12:0/3647248836 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f5ef41a10d0 con 0x7f5ee0039260 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.603+0000 7f5eeaffd640 1 -- 172.21.15.12:0/3647248836 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f5ef41a10d0 con 0x7f5ee0039260 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.605+0000 7f5efc0fa640 1 -- 172.21.15.12:0/3647248836 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5ee0039260 msgr2=0x7f5ee003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.605+0000 7f5efc0fa640 1 --2- 172.21.15.12:0/3647248836 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5ee0039260 0x7f5ee003b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40098c0 tx=0x7f5ee4006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.605+0000 7f5efc0fa640 1 -- 172.21.15.12:0/3647248836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 msgr2=0x7f5ef419d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.605+0000 7f5efc0fa640 1 --2- 172.21.15.12:0/3647248836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef419d980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0030380 tx=0x7f5ef0032670 comp rx=0 tx=0).stop 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.605+0000 7f5efc0fa640 1 -- 172.21.15.12:0/3647248836 shutdown_connections 2024-09-19T06:31:27.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.605+0000 7f5efc0fa640 1 --2- 172.21.15.12:0/3647248836 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5ee0039260 0x7f5ee003b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:27.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.605+0000 7f5efc0fa640 1 --2- 172.21.15.12:0/3647248836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ef407de00 0x7f5ef419d980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:27.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.605+0000 7f5efc0fa640 1 -- 172.21.15.12:0/3647248836 >> 172.21.15.12:0/3647248836 conn(0x7f5ef4102f60 msgr2=0x7f5ef4103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:27.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.605+0000 7f5efc0fa640 1 -- 172.21.15.12:0/3647248836 shutdown_connections 2024-09-19T06:31:27.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:25.605+0000 7f5efc0fa640 1 -- 172.21.15.12:0/3647248836 wait complete. 2024-09-19T06:31:27.102 INFO:teuthology.orchestra.run.smithi012.stdout:Fetching dashboard port number... 2024-09-19T06:31:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T06:31:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.523+0000 7f55581ae640 1 Processor -- start 2024-09-19T06:31:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.523+0000 7f55581ae640 1 -- start start 2024-09-19T06:31:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.524+0000 7f55581ae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f5550106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.524+0000 7f55581ae640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55501070a0 con 0x7f55501066d0 2024-09-19T06:31:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.524+0000 7f5555f4a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f5550106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.524+0000 7f5555f4a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f5550106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32818/0 (socket says 172.21.15.12:32818) 2024-09-19T06:31:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.524+0000 7f5555f4a640 1 -- 172.21.15.12:0/1971686622 learned_addr learned my addr 172.21.15.12:0/1971686622 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:28.255 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.524+0000 7f5555f4a640 1 -- 172.21.15.12:0/1971686622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55501078d0 con 0x7f55501066d0 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.525+0000 7f5555f4a640 1 --2- 172.21.15.12:0/1971686622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f5550106ad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5548009820 tx=0x7f554802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec5cecfbe04b6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.525+0000 7f5554f48640 1 -- 172.21.15.12:0/1971686622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5548037070 con 0x7f55501066d0 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.525+0000 7f5554f48640 1 -- 172.21.15.12:0/1971686622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5548032920 con 0x7f55501066d0 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.525+0000 7f5554f48640 1 -- 172.21.15.12:0/1971686622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5548030810 con 0x7f55501066d0 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.526+0000 7f55581ae640 1 -- 172.21.15.12:0/1971686622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 msgr2=0x7f5550106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.526+0000 7f55581ae640 1 --2- 172.21.15.12:0/1971686622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f5550106ad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5548009820 tx=0x7f554802a270 comp rx=0 tx=0).stop 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.526+0000 7f55581ae640 1 -- 172.21.15.12:0/1971686622 shutdown_connections 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.526+0000 7f55581ae640 1 --2- 172.21.15.12:0/1971686622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f5550106ad0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.526+0000 7f55581ae640 1 -- 172.21.15.12:0/1971686622 >> 172.21.15.12:0/1971686622 conn(0x7f5550101e60 msgr2=0x7f55501042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.526+0000 7f55581ae640 1 -- 172.21.15.12:0/1971686622 shutdown_connections 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.526+0000 7f55581ae640 1 -- 172.21.15.12:0/1971686622 wait complete. 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.526+0000 7f55581ae640 1 Processor -- start 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.526+0000 7f55581ae640 1 -- start start 2024-09-19T06:31:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f55581ae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f555019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f55581ae640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f555010ac80 con 0x7f55501066d0 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f5555f4a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f555019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f5555f4a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f555019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32834/0 (socket says 172.21.15.12:32834) 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f5555f4a640 1 -- 172.21.15.12:0/3833327776 learned_addr learned my addr 172.21.15.12:0/3833327776 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f5555f4a640 1 -- 172.21.15.12:0/3833327776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555019bd70 con 0x7f55501066d0 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f5555f4a640 1 --2- 172.21.15.12:0/3833327776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f555019b830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f55480097f0 tx=0x7f55480327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f554effd640 1 -- 172.21.15.12:0/3833327776 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5548037040 con 0x7f55501066d0 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f554effd640 1 -- 172.21.15.12:0/3833327776 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5548030cc0 con 0x7f55501066d0 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f55581ae640 1 -- 172.21.15.12:0/3833327776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555019c000 con 0x7f55501066d0 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f554effd640 1 -- 172.21.15.12:0/3833327776 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f554803a640 con 0x7f55501066d0 2024-09-19T06:31:28.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.527+0000 7f55581ae640 1 -- 172.21.15.12:0/3833327776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555019ecf0 con 0x7f55501066d0 2024-09-19T06:31:28.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.528+0000 7f554effd640 1 -- 172.21.15.12:0/3833327776 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f554803a8f0 con 0x7f55501066d0 2024-09-19T06:31:28.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.528+0000 7f55581ae640 1 -- 172.21.15.12:0/3833327776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5550106b50 con 0x7f55501066d0 2024-09-19T06:31:28.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.528+0000 7f554effd640 1 --2- 172.21.15.12:0/3833327776 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5538039260 0x7f553803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:28.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.529+0000 7f554effd640 1 -- 172.21.15.12:0/3833327776 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f554806ca50 con 0x7f55501066d0 2024-09-19T06:31:28.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.529+0000 7f5555749640 1 --2- 172.21.15.12:0/3833327776 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5538039260 0x7f553803b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:28.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.529+0000 7f5555749640 1 --2- 172.21.15.12:0/3833327776 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5538039260 0x7f553803b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f55440098c0 tx=0x7f5544006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:28.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.533+0000 7f554effd640 1 -- 172.21.15.12:0/3833327776 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55480392f0 con 0x7f55501066d0 2024-09-19T06:31:28.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.676+0000 7f554effd640 1 -- 172.21.15.12:0/3833327776 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f554803ad30 con 0x7f55501066d0 2024-09-19T06:31:28.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.712+0000 7f55581ae640 1 -- 172.21.15.12:0/3833327776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f555002d9b0 con 0x7f55501066d0 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.712+0000 7f554effd640 1 -- 172.21.15.12:0/3833327776 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f5548039d60 con 0x7f55501066d0 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.715+0000 7f55581ae640 1 -- 172.21.15.12:0/3833327776 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5538039260 msgr2=0x7f553803b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.715+0000 7f55581ae640 1 --2- 172.21.15.12:0/3833327776 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5538039260 0x7f553803b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f55440098c0 tx=0x7f5544006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.715+0000 7f55581ae640 1 -- 172.21.15.12:0/3833327776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 msgr2=0x7f555019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.715+0000 7f55581ae640 1 --2- 172.21.15.12:0/3833327776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f555019b830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f55480097f0 tx=0x7f55480327b0 comp rx=0 tx=0).stop 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.715+0000 7f55581ae640 1 -- 172.21.15.12:0/3833327776 shutdown_connections 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.715+0000 7f55581ae640 1 --2- 172.21.15.12:0/3833327776 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5538039260 0x7f553803b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.715+0000 7f55581ae640 1 --2- 172.21.15.12:0/3833327776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55501066d0 0x7f555019b830 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.715+0000 7f55581ae640 1 -- 172.21.15.12:0/3833327776 >> 172.21.15.12:0/3833327776 conn(0x7f5550101e60 msgr2=0x7f5550102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.715+0000 7f55581ae640 1 -- 172.21.15.12:0/3833327776 shutdown_connections 2024-09-19T06:31:28.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:27.715+0000 7f55581ae640 1 -- 172.21.15.12:0/3833327776 wait complete. 2024-09-19T06:31:28.263 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:31:28.264 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-19T06:31:28.271 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:31:28.271 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-19T06:31:28.271 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-19T06:31:28.272 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T06:31:28.273 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph Dashboard is now available at: 2024-09-19T06:31:28.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:28.273 INFO:teuthology.orchestra.run.smithi012.stdout: URL: https://smithi012.front.sepia.ceph.com:8443/ 2024-09-19T06:31:28.273 INFO:teuthology.orchestra.run.smithi012.stdout: User: admin 2024-09-19T06:31:28.273 INFO:teuthology.orchestra.run.smithi012.stdout: Password: sxasd8vfd8 2024-09-19T06:31:28.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:28.274 INFO:teuthology.orchestra.run.smithi012.stdout:Saving cluster configuration to /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config directory 2024-09-19T06:31:28.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:28 smithi012 ceph-mon[30937]: mgrmap e13: x(active, since 6s) 2024-09-19T06:31:28.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:28 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3833327776' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T06:31:29.669 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.700+0000 7f537c1f1640 1 Processor -- start 2024-09-19T06:31:29.669 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.700+0000 7f537c1f1640 1 -- start start 2024-09-19T06:31:29.669 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.700+0000 7f537c1f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f5374107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:29.669 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.700+0000 7f537c1f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f53741081a0 con 0x7f53741077d0 2024-09-19T06:31:29.670 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.700+0000 7f5379f8d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f5374107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:29.670 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.700+0000 7f5379f8d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f5374107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32846/0 (socket says 172.21.15.12:32846) 2024-09-19T06:31:29.670 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.700+0000 7f5379f8d640 1 -- 172.21.15.12:0/1457021466 learned_addr learned my addr 172.21.15.12:0/1457021466 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:29.670 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.700+0000 7f5379f8d640 1 -- 172.21.15.12:0/1457021466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53741089d0 con 0x7f53741077d0 2024-09-19T06:31:29.670 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.701+0000 7f5379f8d640 1 --2- 172.21.15.12:0/1457021466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f5374107bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5370009820 tx=0x7f537002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca46af01a3ffbae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:29.670 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.701+0000 7f5378f8b640 1 -- 172.21.15.12:0/1457021466 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5370037070 con 0x7f53741077d0 2024-09-19T06:31:29.670 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.701+0000 7f5378f8b640 1 -- 172.21.15.12:0/1457021466 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5370032920 con 0x7f53741077d0 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.701+0000 7f5378f8b640 1 -- 172.21.15.12:0/1457021466 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5370030810 con 0x7f53741077d0 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.702+0000 7f537c1f1640 1 -- 172.21.15.12:0/1457021466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 msgr2=0x7f5374107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.702+0000 7f537c1f1640 1 --2- 172.21.15.12:0/1457021466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f5374107bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5370009820 tx=0x7f537002a270 comp rx=0 tx=0).stop 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.702+0000 7f537c1f1640 1 -- 172.21.15.12:0/1457021466 shutdown_connections 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.702+0000 7f537c1f1640 1 --2- 172.21.15.12:0/1457021466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f5374107bd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.702+0000 7f537c1f1640 1 -- 172.21.15.12:0/1457021466 >> 172.21.15.12:0/1457021466 conn(0x7f5374102f60 msgr2=0x7f53741053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.702+0000 7f537c1f1640 1 -- 172.21.15.12:0/1457021466 shutdown_connections 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.702+0000 7f537c1f1640 1 -- 172.21.15.12:0/1457021466 wait complete. 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.703+0000 7f537c1f1640 1 Processor -- start 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.703+0000 7f537c1f1640 1 -- start start 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.703+0000 7f537c1f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f537419da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:29.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.703+0000 7f537c1f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f537410bd80 con 0x7f53741077d0 2024-09-19T06:31:29.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.703+0000 7f5379f8d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f537419da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:29.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.703+0000 7f5379f8d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f537419da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32854/0 (socket says 172.21.15.12:32854) 2024-09-19T06:31:29.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.703+0000 7f5379f8d640 1 -- 172.21.15.12:0/2089012821 learned_addr learned my addr 172.21.15.12:0/2089012821 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:29.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.703+0000 7f5379f8d640 1 -- 172.21.15.12:0/2089012821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537419dfb0 con 0x7f53741077d0 2024-09-19T06:31:29.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.704+0000 7f5379f8d640 1 --2- 172.21.15.12:0/2089012821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f537419da70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5370030560 tx=0x7f5370032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:29.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.704+0000 7f536affd640 1 -- 172.21.15.12:0/2089012821 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5370037040 con 0x7f53741077d0 2024-09-19T06:31:29.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.704+0000 7f536affd640 1 -- 172.21.15.12:0/2089012821 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5370040070 con 0x7f53741077d0 2024-09-19T06:31:29.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.704+0000 7f537c1f1640 1 -- 172.21.15.12:0/2089012821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537419e240 con 0x7f53741077d0 2024-09-19T06:31:29.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.704+0000 7f536affd640 1 -- 172.21.15.12:0/2089012821 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f537003a740 con 0x7f53741077d0 2024-09-19T06:31:29.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.704+0000 7f537c1f1640 1 -- 172.21.15.12:0/2089012821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53741a0f30 con 0x7f53741077d0 2024-09-19T06:31:29.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.705+0000 7f536affd640 1 -- 172.21.15.12:0/2089012821 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f537003bb90 con 0x7f53741077d0 2024-09-19T06:31:29.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.705+0000 7f536affd640 1 --2- 172.21.15.12:0/2089012821 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5360039300 0x7f536003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:29.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.705+0000 7f537c1f1640 1 -- 172.21.15.12:0/2089012821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5374107c50 con 0x7f53741077d0 2024-09-19T06:31:29.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.705+0000 7f536affd640 1 -- 172.21.15.12:0/2089012821 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f537006ca50 con 0x7f53741077d0 2024-09-19T06:31:29.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.705+0000 7f537978c640 1 --2- 172.21.15.12:0/2089012821 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5360039300 0x7f536003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:29.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.705+0000 7f537978c640 1 --2- 172.21.15.12:0/2089012821 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5360039300 0x7f536003b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f53640098c0 tx=0x7f5364006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:29.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.710+0000 7f536affd640 1 -- 172.21.15.12:0/2089012821 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5370042940 con 0x7f53741077d0 2024-09-19T06:31:29.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.977+0000 7f537c1f1640 1 -- 172.21.15.12:0/2089012821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f53741a1100 con 0x7f53741077d0 2024-09-19T06:31:29.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.980+0000 7f536affd640 1 -- 172.21.15.12:0/2089012821 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f537004a200 con 0x7f53741077d0 2024-09-19T06:31:29.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.982+0000 7f537c1f1640 1 -- 172.21.15.12:0/2089012821 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5360039300 msgr2=0x7f536003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.982+0000 7f537c1f1640 1 --2- 172.21.15.12:0/2089012821 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5360039300 0x7f536003b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f53640098c0 tx=0x7f5364006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.982+0000 7f537c1f1640 1 -- 172.21.15.12:0/2089012821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 msgr2=0x7f537419da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.982+0000 7f537c1f1640 1 --2- 172.21.15.12:0/2089012821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f537419da70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5370030560 tx=0x7f5370032670 comp rx=0 tx=0).stop 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.982+0000 7f537c1f1640 1 -- 172.21.15.12:0/2089012821 shutdown_connections 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.982+0000 7f537c1f1640 1 --2- 172.21.15.12:0/2089012821 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5360039300 0x7f536003b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.982+0000 7f537c1f1640 1 --2- 172.21.15.12:0/2089012821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53741077d0 0x7f537419da70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.982+0000 7f537c1f1640 1 -- 172.21.15.12:0/2089012821 >> 172.21.15.12:0/2089012821 conn(0x7f5374102f60 msgr2=0x7f5374103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.982+0000 7f537c1f1640 1 -- 172.21.15.12:0/2089012821 shutdown_connections 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:28.982+0000 7f537c1f1640 1 -- 172.21.15.12:0/2089012821 wait complete. 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:31:29.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout: ceph telemetry on 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout:For more information see: 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:29.675 INFO:teuthology.orchestra.run.smithi012.stdout:Bootstrap complete. 2024-09-19T06:31:29.712 INFO:tasks.cephadm:Fetching config... 2024-09-19T06:31:29.712 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:31:29.712 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T06:31:29.730 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T06:31:29.731 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:31:29.731 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T06:31:29.787 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T06:31:29.788 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:31:29.788 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T06:31:29.855 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T06:31:29.855 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:31:29.855 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T06:31:29.911 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T06:31:29.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzNgxFJXrmdMsV28cPqDUbeAUbUgx0B+VTFtMuit3zzBufvum3wcrxGHzzlUCSYz3xJ/dM3U0mDBwBiYhbcK61Lnk/mL3Thu4KBP6N/5HMIN39yGw7NBM05vJKC0smaWjl7iOUtgXDh6A1ba5F0rR6gOHc/cEv08e2ChiD3JEY/17uqxH/EBwuamO/zyRn1CZgLtbEHsNMTq58sbPTSaS0iVBoLX+dg1dyn3nFhNUwPlZ/xwLtYgoS3ay1iJ/teappKZalQ77qHR6TWrvGkSK8kWV3LctSlmdgMth1wmh2gzWKVyenqusHFDHEnQPToNgmkMkOOj7kblLibjsT5c+XO95Vr2XfD9pWp9N9Fic/Cp/C6Vn8VyaUeIAUk+svl8kygCGSbZBfCDFbxx9nPnMKkVd/UUbR9wp8XQqpFUulKSh4UeQpFCysnewpVFQaAl+04vQs8Pv7z8bBsuiOOB7X/MSGnXxv16N7Ef5xgA4IraF/1Ogo4PgVQOSkFBNrxTM= ceph-8bf314c8-7650-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:31:29.989 INFO:teuthology.orchestra.run.smithi012.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzNgxFJXrmdMsV28cPqDUbeAUbUgx0B+VTFtMuit3zzBufvum3wcrxGHzzlUCSYz3xJ/dM3U0mDBwBiYhbcK61Lnk/mL3Thu4KBP6N/5HMIN39yGw7NBM05vJKC0smaWjl7iOUtgXDh6A1ba5F0rR6gOHc/cEv08e2ChiD3JEY/17uqxH/EBwuamO/zyRn1CZgLtbEHsNMTq58sbPTSaS0iVBoLX+dg1dyn3nFhNUwPlZ/xwLtYgoS3ay1iJ/teappKZalQ77qHR6TWrvGkSK8kWV3LctSlmdgMth1wmh2gzWKVyenqusHFDHEnQPToNgmkMkOOj7kblLibjsT5c+XO95Vr2XfD9pWp9N9Fic/Cp/C6Vn8VyaUeIAUk+svl8kygCGSbZBfCDFbxx9nPnMKkVd/UUbR9wp8XQqpFUulKSh4UeQpFCysnewpVFQaAl+04vQs8Pv7z8bBsuiOOB7X/MSGnXxv16N7Ef5xgA4IraF/1Ogo4PgVQOSkFBNrxTM= ceph-8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:30.001 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzNgxFJXrmdMsV28cPqDUbeAUbUgx0B+VTFtMuit3zzBufvum3wcrxGHzzlUCSYz3xJ/dM3U0mDBwBiYhbcK61Lnk/mL3Thu4KBP6N/5HMIN39yGw7NBM05vJKC0smaWjl7iOUtgXDh6A1ba5F0rR6gOHc/cEv08e2ChiD3JEY/17uqxH/EBwuamO/zyRn1CZgLtbEHsNMTq58sbPTSaS0iVBoLX+dg1dyn3nFhNUwPlZ/xwLtYgoS3ay1iJ/teappKZalQ77qHR6TWrvGkSK8kWV3LctSlmdgMth1wmh2gzWKVyenqusHFDHEnQPToNgmkMkOOj7kblLibjsT5c+XO95Vr2XfD9pWp9N9Fic/Cp/C6Vn8VyaUeIAUk+svl8kygCGSbZBfCDFbxx9nPnMKkVd/UUbR9wp8XQqpFUulKSh4UeQpFCysnewpVFQaAl+04vQs8Pv7z8bBsuiOOB7X/MSGnXxv16N7Ef5xgA4IraF/1Ogo4PgVQOSkFBNrxTM= ceph-8bf314c8-7650-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:31:30.043 INFO:teuthology.orchestra.run.smithi016.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzNgxFJXrmdMsV28cPqDUbeAUbUgx0B+VTFtMuit3zzBufvum3wcrxGHzzlUCSYz3xJ/dM3U0mDBwBiYhbcK61Lnk/mL3Thu4KBP6N/5HMIN39yGw7NBM05vJKC0smaWjl7iOUtgXDh6A1ba5F0rR6gOHc/cEv08e2ChiD3JEY/17uqxH/EBwuamO/zyRn1CZgLtbEHsNMTq58sbPTSaS0iVBoLX+dg1dyn3nFhNUwPlZ/xwLtYgoS3ay1iJ/teappKZalQ77qHR6TWrvGkSK8kWV3LctSlmdgMth1wmh2gzWKVyenqusHFDHEnQPToNgmkMkOOj7kblLibjsT5c+XO95Vr2XfD9pWp9N9Fic/Cp/C6Vn8VyaUeIAUk+svl8kygCGSbZBfCDFbxx9nPnMKkVd/UUbR9wp8XQqpFUulKSh4UeQpFCysnewpVFQaAl+04vQs8Pv7z8bBsuiOOB7X/MSGnXxv16N7Ef5xgA4IraF/1Ogo4PgVQOSkFBNrxTM= ceph-8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:30.055 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzNgxFJXrmdMsV28cPqDUbeAUbUgx0B+VTFtMuit3zzBufvum3wcrxGHzzlUCSYz3xJ/dM3U0mDBwBiYhbcK61Lnk/mL3Thu4KBP6N/5HMIN39yGw7NBM05vJKC0smaWjl7iOUtgXDh6A1ba5F0rR6gOHc/cEv08e2ChiD3JEY/17uqxH/EBwuamO/zyRn1CZgLtbEHsNMTq58sbPTSaS0iVBoLX+dg1dyn3nFhNUwPlZ/xwLtYgoS3ay1iJ/teappKZalQ77qHR6TWrvGkSK8kWV3LctSlmdgMth1wmh2gzWKVyenqusHFDHEnQPToNgmkMkOOj7kblLibjsT5c+XO95Vr2XfD9pWp9N9Fic/Cp/C6Vn8VyaUeIAUk+svl8kygCGSbZBfCDFbxx9nPnMKkVd/UUbR9wp8XQqpFUulKSh4UeQpFCysnewpVFQaAl+04vQs8Pv7z8bBsuiOOB7X/MSGnXxv16N7Ef5xgA4IraF/1Ogo4PgVQOSkFBNrxTM= ceph-8bf314c8-7650-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:31:30.097 INFO:teuthology.orchestra.run.smithi173.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzNgxFJXrmdMsV28cPqDUbeAUbUgx0B+VTFtMuit3zzBufvum3wcrxGHzzlUCSYz3xJ/dM3U0mDBwBiYhbcK61Lnk/mL3Thu4KBP6N/5HMIN39yGw7NBM05vJKC0smaWjl7iOUtgXDh6A1ba5F0rR6gOHc/cEv08e2ChiD3JEY/17uqxH/EBwuamO/zyRn1CZgLtbEHsNMTq58sbPTSaS0iVBoLX+dg1dyn3nFhNUwPlZ/xwLtYgoS3ay1iJ/teappKZalQ77qHR6TWrvGkSK8kWV3LctSlmdgMth1wmh2gzWKVyenqusHFDHEnQPToNgmkMkOOj7kblLibjsT5c+XO95Vr2XfD9pWp9N9Fic/Cp/C6Vn8VyaUeIAUk+svl8kygCGSbZBfCDFbxx9nPnMKkVd/UUbR9wp8XQqpFUulKSh4UeQpFCysnewpVFQaAl+04vQs8Pv7z8bBsuiOOB7X/MSGnXxv16N7Ef5xgA4IraF/1Ogo4PgVQOSkFBNrxTM= ceph-8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:30.109 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T06:31:30.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:29 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2089012821' entity='client.admin' 2024-09-19T06:31:30.367 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:31:31.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.830+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/2204383737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08076220 msgr2=0x7f7c08074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:31.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.830+0000 7f7c0f9cf640 1 --2- 172.21.15.12:0/2204383737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08076220 0x7f7c08074680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009880 tx=0x7f7c0402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:31:31.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.830+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/2204383737 shutdown_connections 2024-09-19T06:31:31.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.830+0000 7f7c0f9cf640 1 --2- 172.21.15.12:0/2204383737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08076220 0x7f7c08074680 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:31.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.830+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/2204383737 >> 172.21.15.12:0/2204383737 conn(0x7f7c080fcdb0 msgr2=0x7f7c080ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.830+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/2204383737 shutdown_connections 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.830+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/2204383737 wait complete. 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.831+0000 7f7c0f9cf640 1 Processor -- start 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.831+0000 7f7c0f9cf640 1 -- start start 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.831+0000 7f7c0f9cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08076220 0x7f7c08198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.831+0000 7f7c0f9cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7c08109920 con 0x7f7c08076220 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.831+0000 7f7c0d76b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08076220 0x7f7c08198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.831+0000 7f7c0d76b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08076220 0x7f7c08198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53696/0 (socket says 172.21.15.12:53696) 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.831+0000 7f7c0d76b640 1 -- 172.21.15.12:0/1128970486 learned_addr learned my addr 172.21.15.12:0/1128970486 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.832+0000 7f7c0d76b640 1 -- 172.21.15.12:0/1128970486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c081994b0 con 0x7f7c08076220 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.832+0000 7f7c0d76b640 1 --2- 172.21.15.12:0/1128970486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08076220 0x7f7c08198f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c04004f60 tx=0x7f7c040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.832+0000 7f7bfe7fc640 1 -- 172.21.15.12:0/1128970486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0403f070 con 0x7f7c08076220 2024-09-19T06:31:31.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.832+0000 7f7bfe7fc640 1 -- 172.21.15.12:0/1128970486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c04004d40 con 0x7f7c08076220 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.832+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/1128970486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c08199740 con 0x7f7c08076220 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.832+0000 7f7bfe7fc640 1 -- 172.21.15.12:0/1128970486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c04035030 con 0x7f7c08076220 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.832+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/1128970486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0819c430 con 0x7f7c08076220 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.833+0000 7f7bfe7fc640 1 -- 172.21.15.12:0/1128970486 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7c04042070 con 0x7f7c08076220 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.833+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/1128970486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0810a0a0 con 0x7f7c08076220 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.833+0000 7f7bfe7fc640 1 --2- 172.21.15.12:0/1128970486 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7bf4039300 0x7f7bf403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.833+0000 7f7bfe7fc640 1 -- 172.21.15.12:0/1128970486 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7c0406d0c0 con 0x7f7c08076220 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.833+0000 7f7c0cf6a640 1 --2- 172.21.15.12:0/1128970486 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7bf4039300 0x7f7bf403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.834+0000 7f7c0cf6a640 1 --2- 172.21.15.12:0/1128970486 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7bf4039300 0x7f7bf403b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80098c0 tx=0x7f7bf8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:30.838+0000 7f7bfe7fc640 1 -- 172.21.15.12:0/1128970486 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c0403b460 con 0x7f7c08076220 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.016+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/1128970486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f7c0802d830 con 0x7f7c08076220 2024-09-19T06:31:31.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.018+0000 7f7bfe7fc640 1 -- 172.21.15.12:0/1128970486 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f7c04031b30 con 0x7f7c08076220 2024-09-19T06:31:31.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.021+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/1128970486 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7bf4039300 msgr2=0x7f7bf403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:31.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.021+0000 7f7c0f9cf640 1 --2- 172.21.15.12:0/1128970486 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7bf4039300 0x7f7bf403b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80098c0 tx=0x7f7bf8006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:31.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.021+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/1128970486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08076220 msgr2=0x7f7c08198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:31.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.021+0000 7f7c0f9cf640 1 --2- 172.21.15.12:0/1128970486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08076220 0x7f7c08198f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c04004f60 tx=0x7f7c040048f0 comp rx=0 tx=0).stop 2024-09-19T06:31:31.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.021+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/1128970486 shutdown_connections 2024-09-19T06:31:31.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.021+0000 7f7c0f9cf640 1 --2- 172.21.15.12:0/1128970486 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7bf4039300 0x7f7bf403b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:31.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.021+0000 7f7c0f9cf640 1 --2- 172.21.15.12:0/1128970486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08076220 0x7f7c08198f70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:31.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.021+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/1128970486 >> 172.21.15.12:0/1128970486 conn(0x7f7c080fcdb0 msgr2=0x7f7c080fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:31.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.021+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/1128970486 shutdown_connections 2024-09-19T06:31:31.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:31.021+0000 7f7c0f9cf640 1 -- 172.21.15.12:0/1128970486 wait complete. 2024-09-19T06:31:31.661 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T06:31:31.661 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T06:31:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:31:32.341 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:32 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1128970486' entity='client.admin' 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.794+0000 7f3b19738640 1 -- 172.21.15.12:0/549371787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b141020a0 msgr2=0x7f3b14104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.794+0000 7f3b19738640 1 --2- 172.21.15.12:0/549371787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b141020a0 0x7f3b14104490 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009880 tx=0x7f3b0402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.794+0000 7f3b19738640 1 -- 172.21.15.12:0/549371787 shutdown_connections 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.794+0000 7f3b19738640 1 --2- 172.21.15.12:0/549371787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b141020a0 0x7f3b14104490 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.794+0000 7f3b19738640 1 -- 172.21.15.12:0/549371787 >> 172.21.15.12:0/549371787 conn(0x7f3b140fbc80 msgr2=0x7f3b140fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.794+0000 7f3b19738640 1 -- 172.21.15.12:0/549371787 shutdown_connections 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.794+0000 7f3b19738640 1 -- 172.21.15.12:0/549371787 wait complete. 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.795+0000 7f3b19738640 1 Processor -- start 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.795+0000 7f3b19738640 1 -- start start 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.795+0000 7f3b19738640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b141020a0 0x7f3b14101920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.795+0000 7f3b19738640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3b141076b0 con 0x7f3b141020a0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.795+0000 7f3b12ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b141020a0 0x7f3b14101920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.795+0000 7f3b12ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b141020a0 0x7f3b14101920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53718/0 (socket says 172.21.15.12:53718) 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.795+0000 7f3b12ffd640 1 -- 172.21.15.12:0/1213205745 learned_addr learned my addr 172.21.15.12:0/1213205745 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.796+0000 7f3b12ffd640 1 -- 172.21.15.12:0/1213205745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b14101e60 con 0x7f3b141020a0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.796+0000 7f3b12ffd640 1 --2- 172.21.15.12:0/1213205745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b141020a0 0x7f3b14101920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3b04004f60 tx=0x7f3b040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.796+0000 7f3afbfff640 1 -- 172.21.15.12:0/1213205745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b0403f070 con 0x7f3b141020a0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.796+0000 7f3afbfff640 1 -- 172.21.15.12:0/1213205745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b04003ad0 con 0x7f3b141020a0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.796+0000 7f3b19738640 1 -- 172.21.15.12:0/1213205745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b14100050 con 0x7f3b141020a0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.796+0000 7f3afbfff640 1 -- 172.21.15.12:0/1213205745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b04035030 con 0x7f3b141020a0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.796+0000 7f3b19738640 1 -- 172.21.15.12:0/1213205745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b14100590 con 0x7f3b141020a0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.797+0000 7f3afbfff640 1 -- 172.21.15.12:0/1213205745 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3b04042070 con 0x7f3b141020a0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.797+0000 7f3b19738640 1 -- 172.21.15.12:0/1213205745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b14107e30 con 0x7f3b141020a0 2024-09-19T06:31:33.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.797+0000 7f3afbfff640 1 --2- 172.21.15.12:0/1213205745 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3afc0392a0 0x7f3afc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.797+0000 7f3afbfff640 1 -- 172.21.15.12:0/1213205745 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3b0406d1e0 con 0x7f3b141020a0 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.797+0000 7f3b127fc640 1 --2- 172.21.15.12:0/1213205745 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3afc0392a0 0x7f3afc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.798+0000 7f3b127fc640 1 --2- 172.21.15.12:0/1213205745 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3afc0392a0 0x7f3afc03b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b080098c0 tx=0x7f3b08006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.802+0000 7f3afbfff640 1 -- 172.21.15.12:0/1213205745 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b04039350 con 0x7f3b141020a0 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.983+0000 7f3b19738640 1 -- 172.21.15.12:0/1213205745 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f3b14190390 con 0x7f3afc0392a0 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.986+0000 7f3afbfff640 1 -- 172.21.15.12:0/1213205745 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3b14190390 con 0x7f3afc0392a0 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.988+0000 7f3b19738640 1 -- 172.21.15.12:0/1213205745 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3afc0392a0 msgr2=0x7f3afc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.988+0000 7f3b19738640 1 --2- 172.21.15.12:0/1213205745 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3afc0392a0 0x7f3afc03b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b080098c0 tx=0x7f3b08006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.988+0000 7f3b19738640 1 -- 172.21.15.12:0/1213205745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b141020a0 msgr2=0x7f3b14101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.988+0000 7f3b19738640 1 --2- 172.21.15.12:0/1213205745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b141020a0 0x7f3b14101920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3b04004f60 tx=0x7f3b040048f0 comp rx=0 tx=0).stop 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.988+0000 7f3b19738640 1 -- 172.21.15.12:0/1213205745 shutdown_connections 2024-09-19T06:31:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.988+0000 7f3b19738640 1 --2- 172.21.15.12:0/1213205745 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3afc0392a0 0x7f3afc03b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.988+0000 7f3b19738640 1 --2- 172.21.15.12:0/1213205745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b141020a0 0x7f3b14101920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.988+0000 7f3b19738640 1 -- 172.21.15.12:0/1213205745 >> 172.21.15.12:0/1213205745 conn(0x7f3b140fbc80 msgr2=0x7f3b140fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.988+0000 7f3b19738640 1 -- 172.21.15.12:0/1213205745 shutdown_connections 2024-09-19T06:31:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:32.988+0000 7f3b19738640 1 -- 172.21.15.12:0/1213205745 wait complete. 2024-09-19T06:31:33.657 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi016 2024-09-19T06:31:33.657 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:31:33.657 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:31:33.677 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:31:33.677 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:31:33.735 INFO:tasks.cephadm:Adding host smithi016 to orchestrator... 2024-09-19T06:31:33.735 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch host add smithi016 2024-09-19T06:31:34.240 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:33 smithi012 ceph-mon[30937]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:34.240 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:34.320 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:31:34.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.838+0000 7f5a8a651640 1 -- 172.21.15.12:0/1300262700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a84100540 msgr2=0x7f5a84100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:34.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.838+0000 7f5a8a651640 1 --2- 172.21.15.12:0/1300262700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a84100540 0x7f5a84100940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009880 tx=0x7f5a7402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.838+0000 7f5a8a651640 1 -- 172.21.15.12:0/1300262700 shutdown_connections 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.838+0000 7f5a8a651640 1 --2- 172.21.15.12:0/1300262700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a84100540 0x7f5a84100940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.838+0000 7f5a8a651640 1 -- 172.21.15.12:0/1300262700 >> 172.21.15.12:0/1300262700 conn(0x7f5a840fbcd0 msgr2=0x7f5a840fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.838+0000 7f5a8a651640 1 -- 172.21.15.12:0/1300262700 shutdown_connections 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.838+0000 7f5a8a651640 1 -- 172.21.15.12:0/1300262700 wait complete. 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.839+0000 7f5a8a651640 1 Processor -- start 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.839+0000 7f5a8a651640 1 -- start start 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.839+0000 7f5a8a651640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a84100540 0x7f5a84196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.839+0000 7f5a8a651640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5a841065f0 con 0x7f5a84100540 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.839+0000 7f5a83fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a84100540 0x7f5a84196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.839+0000 7f5a83fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a84100540 0x7f5a84196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53740/0 (socket says 172.21.15.12:53740) 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.839+0000 7f5a83fff640 1 -- 172.21.15.12:0/1323018524 learned_addr learned my addr 172.21.15.12:0/1323018524 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.840+0000 7f5a83fff640 1 -- 172.21.15.12:0/1323018524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a841972d0 con 0x7f5a84100540 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.840+0000 7f5a83fff640 1 --2- 172.21.15.12:0/1323018524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a84100540 0x7f5a84196d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a74004f60 tx=0x7f5a740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.840+0000 7f5a817fa640 1 -- 172.21.15.12:0/1323018524 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a7403f070 con 0x7f5a84100540 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.840+0000 7f5a817fa640 1 -- 172.21.15.12:0/1323018524 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a74004d40 con 0x7f5a84100540 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.840+0000 7f5a8a651640 1 -- 172.21.15.12:0/1323018524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a84197560 con 0x7f5a84100540 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.840+0000 7f5a817fa640 1 -- 172.21.15.12:0/1323018524 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a74035030 con 0x7f5a84100540 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.840+0000 7f5a8a651640 1 -- 172.21.15.12:0/1323018524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a8419a210 con 0x7f5a84100540 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.841+0000 7f5a817fa640 1 -- 172.21.15.12:0/1323018524 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5a74042070 con 0x7f5a84100540 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.841+0000 7f5a8a651640 1 -- 172.21.15.12:0/1323018524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a84106d70 con 0x7f5a84100540 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.842+0000 7f5a817fa640 1 --2- 172.21.15.12:0/1323018524 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a6c039300 0x7f5a6c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.842+0000 7f5a817fa640 1 -- 172.21.15.12:0/1323018524 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5a7406cfa0 con 0x7f5a84100540 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.842+0000 7f5a837fe640 1 --2- 172.21.15.12:0/1323018524 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a6c039300 0x7f5a6c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.842+0000 7f5a837fe640 1 --2- 172.21.15.12:0/1323018524 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a6c039300 0x7f5a6c03b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5a780098c0 tx=0x7f5a78006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:34.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:34.846+0000 7f5a817fa640 1 -- 172.21.15.12:0/1323018524 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a74042360 con 0x7f5a84100540 2024-09-19T06:31:35.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:35.031+0000 7f5a8a651640 1 -- 172.21.15.12:0/1323018524 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi016", "target": ["mon-mgr", ""]}) -- 0x7f5a8402d940 con 0x7f5a6c039300 2024-09-19T06:31:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi012", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:31:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:31:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-19T06:31:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: Updating smithi012:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:31:35.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:35.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:35.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:35.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:35.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:35.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:31:35.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:36.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:36 smithi012 ceph-mon[30937]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:31:36.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:36 smithi012 ceph-mon[30937]: Updating smithi012:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:31:36.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:36 smithi012 ceph-mon[30937]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi016", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:37.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:37 smithi012 ceph-mon[30937]: Deploying cephadm binary to smithi016 2024-09-19T06:31:38.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.926+0000 7f5a817fa640 1 -- 172.21.15.12:0/1323018524 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f5a8402d940 con 0x7f5a6c039300 2024-09-19T06:31:38.928 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi016' with addr '172.21.15.16' 2024-09-19T06:31:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.929+0000 7f5a8a651640 1 -- 172.21.15.12:0/1323018524 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a6c039300 msgr2=0x7f5a6c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.929+0000 7f5a8a651640 1 --2- 172.21.15.12:0/1323018524 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a6c039300 0x7f5a6c03b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5a780098c0 tx=0x7f5a78006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.929+0000 7f5a8a651640 1 -- 172.21.15.12:0/1323018524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a84100540 msgr2=0x7f5a84196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.929+0000 7f5a8a651640 1 --2- 172.21.15.12:0/1323018524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a84100540 0x7f5a84196d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a74004f60 tx=0x7f5a740048f0 comp rx=0 tx=0).stop 2024-09-19T06:31:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.929+0000 7f5a8a651640 1 -- 172.21.15.12:0/1323018524 shutdown_connections 2024-09-19T06:31:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.929+0000 7f5a8a651640 1 --2- 172.21.15.12:0/1323018524 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a6c039300 0x7f5a6c03b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.929+0000 7f5a8a651640 1 --2- 172.21.15.12:0/1323018524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a84100540 0x7f5a84196d90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.929+0000 7f5a8a651640 1 -- 172.21.15.12:0/1323018524 >> 172.21.15.12:0/1323018524 conn(0x7f5a840fbcd0 msgr2=0x7f5a84069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.929+0000 7f5a8a651640 1 -- 172.21.15.12:0/1323018524 shutdown_connections 2024-09-19T06:31:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:38.929+0000 7f5a8a651640 1 -- 172.21.15.12:0/1323018524 wait complete. 2024-09-19T06:31:39.578 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:31:39.829 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:31:40.235 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:40.235 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:39 smithi012 ceph-mon[30937]: Added host smithi016 2024-09-19T06:31:40.236 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:40.236 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:40.236 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.320+0000 7f5636136640 1 -- 172.21.15.12:0/1949748894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5630106560 msgr2=0x7f5630106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.320+0000 7f5636136640 1 --2- 172.21.15.12:0/1949748894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5630106560 0x7f5630106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5620009880 tx=0x7f562002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:31:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.320+0000 7f5636136640 1 -- 172.21.15.12:0/1949748894 shutdown_connections 2024-09-19T06:31:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.320+0000 7f5636136640 1 --2- 172.21.15.12:0/1949748894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5630106560 0x7f5630106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.320+0000 7f5636136640 1 -- 172.21.15.12:0/1949748894 >> 172.21.15.12:0/1949748894 conn(0x7f56300fc1b0 msgr2=0x7f56300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.320+0000 7f5636136640 1 -- 172.21.15.12:0/1949748894 shutdown_connections 2024-09-19T06:31:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.320+0000 7f5636136640 1 -- 172.21.15.12:0/1949748894 wait complete. 2024-09-19T06:31:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.321+0000 7f5636136640 1 Processor -- start 2024-09-19T06:31:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.321+0000 7f5636136640 1 -- start start 2024-09-19T06:31:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.321+0000 7f5636136640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5630106560 0x7f5630197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.321+0000 7f5636136640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f563010ab90 con 0x7f5630106560 2024-09-19T06:31:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.321+0000 7f562f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5630106560 0x7f5630197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.321+0000 7f562f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5630106560 0x7f5630197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53756/0 (socket says 172.21.15.12:53756) 2024-09-19T06:31:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.321+0000 7f562f7fe640 1 -- 172.21.15.12:0/3103266426 learned_addr learned my addr 172.21.15.12:0/3103266426 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.322+0000 7f562f7fe640 1 -- 172.21.15.12:0/3103266426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56301976a0 con 0x7f5630106560 2024-09-19T06:31:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.322+0000 7f562f7fe640 1 --2- 172.21.15.12:0/3103266426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5630106560 0x7f5630197160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5620009230 tx=0x7f5620003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.322+0000 7f562cff9640 1 -- 172.21.15.12:0/3103266426 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f562003f070 con 0x7f5630106560 2024-09-19T06:31:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.322+0000 7f562cff9640 1 -- 172.21.15.12:0/3103266426 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f562003bd40 con 0x7f5630106560 2024-09-19T06:31:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.322+0000 7f5636136640 1 -- 172.21.15.12:0/3103266426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5630197930 con 0x7f5630106560 2024-09-19T06:31:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.322+0000 7f562cff9640 1 -- 172.21.15.12:0/3103266426 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5620035030 con 0x7f5630106560 2024-09-19T06:31:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.322+0000 7f5636136640 1 -- 172.21.15.12:0/3103266426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563019ba30 con 0x7f5630106560 2024-09-19T06:31:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.323+0000 7f562cff9640 1 -- 172.21.15.12:0/3103266426 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5620042070 con 0x7f5630106560 2024-09-19T06:31:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.323+0000 7f5636136640 1 -- 172.21.15.12:0/3103266426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5630101bd0 con 0x7f5630106560 2024-09-19T06:31:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.323+0000 7f562cff9640 1 --2- 172.21.15.12:0/3103266426 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56180392a0 0x7f561803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.323+0000 7f562cff9640 1 -- 172.21.15.12:0/3103266426 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f562006dc60 con 0x7f5630106560 2024-09-19T06:31:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.323+0000 7f562effd640 1 --2- 172.21.15.12:0/3103266426 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56180392a0 0x7f561803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.324+0000 7f562effd640 1 --2- 172.21.15.12:0/3103266426 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56180392a0 0x7f561803b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56240098c0 tx=0x7f5624006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.328+0000 7f562cff9640 1 -- 172.21.15.12:0/3103266426 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5620040260 con 0x7f5630106560 2024-09-19T06:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.512+0000 7f5636136640 1 -- 172.21.15.12:0/3103266426 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56301069c0 con 0x7f56180392a0 2024-09-19T06:31:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.514+0000 7f562cff9640 1 -- 172.21.15.12:0/3103266426 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f56301069c0 con 0x7f56180392a0 2024-09-19T06:31:40.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:40.515 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.16", "hostname": "smithi016", "labels": [], "status": ""}] 2024-09-19T06:31:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.516+0000 7f5636136640 1 -- 172.21.15.12:0/3103266426 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56180392a0 msgr2=0x7f561803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.516+0000 7f5636136640 1 --2- 172.21.15.12:0/3103266426 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56180392a0 0x7f561803b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56240098c0 tx=0x7f5624006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.516+0000 7f5636136640 1 -- 172.21.15.12:0/3103266426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5630106560 msgr2=0x7f5630197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.516+0000 7f5636136640 1 --2- 172.21.15.12:0/3103266426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5630106560 0x7f5630197160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5620009230 tx=0x7f5620003d80 comp rx=0 tx=0).stop 2024-09-19T06:31:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.516+0000 7f5636136640 1 -- 172.21.15.12:0/3103266426 shutdown_connections 2024-09-19T06:31:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.516+0000 7f5636136640 1 --2- 172.21.15.12:0/3103266426 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56180392a0 0x7f561803b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.516+0000 7f5636136640 1 --2- 172.21.15.12:0/3103266426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5630106560 0x7f5630197160 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.516+0000 7f5636136640 1 -- 172.21.15.12:0/3103266426 >> 172.21.15.12:0/3103266426 conn(0x7f56300fc1b0 msgr2=0x7f5630069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.516+0000 7f5636136640 1 -- 172.21.15.12:0/3103266426 shutdown_connections 2024-09-19T06:31:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:40.516+0000 7f5636136640 1 -- 172.21.15.12:0/3103266426 wait complete. 2024-09-19T06:31:41.136 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi173 2024-09-19T06:31:41.137 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:31:41.137 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:31:41.156 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:31:41.156 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:31:41.215 INFO:tasks.cephadm:Adding host smithi173 to orchestrator... 2024-09-19T06:31:41.215 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch host add smithi173 2024-09-19T06:31:41.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:41 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:41.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:41 smithi012 ceph-mon[30937]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:31:41.467 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:31:41.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.892+0000 7f02e00f0640 1 -- 172.21.15.12:0/300279513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d8107660 msgr2=0x7f02d8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:41.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.892+0000 7f02e00f0640 1 --2- 172.21.15.12:0/300279513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d8107660 0x7f02d8107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009880 tx=0x7f02d402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.892+0000 7f02e00f0640 1 -- 172.21.15.12:0/300279513 shutdown_connections 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.892+0000 7f02e00f0640 1 --2- 172.21.15.12:0/300279513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d8107660 0x7f02d8107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.892+0000 7f02e00f0640 1 -- 172.21.15.12:0/300279513 >> 172.21.15.12:0/300279513 conn(0x7f02d80fd290 msgr2=0x7f02d80ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.892+0000 7f02e00f0640 1 -- 172.21.15.12:0/300279513 shutdown_connections 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.892+0000 7f02e00f0640 1 -- 172.21.15.12:0/300279513 wait complete. 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.893+0000 7f02e00f0640 1 Processor -- start 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.893+0000 7f02e00f0640 1 -- start start 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.893+0000 7f02e00f0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d8107660 0x7f02d81970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.893+0000 7f02e00f0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f02d810bc90 con 0x7f02d8107660 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.893+0000 7f02dde8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d8107660 0x7f02d81970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.893+0000 7f02dde8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d8107660 0x7f02d81970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59642/0 (socket says 172.21.15.12:59642) 2024-09-19T06:31:41.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.893+0000 7f02dde8c640 1 -- 172.21.15.12:0/3940316466 learned_addr learned my addr 172.21.15.12:0/3940316466 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.893+0000 7f02dde8c640 1 -- 172.21.15.12:0/3940316466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d8197600 con 0x7f02d8107660 2024-09-19T06:31:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.894+0000 7f02dde8c640 1 --2- 172.21.15.12:0/3940316466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d8107660 0x7f02d81970c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009230 tx=0x7f02d4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.894+0000 7f02ceffd640 1 -- 172.21.15.12:0/3940316466 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02d403f070 con 0x7f02d8107660 2024-09-19T06:31:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.894+0000 7f02e00f0640 1 -- 172.21.15.12:0/3940316466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d8197890 con 0x7f02d8107660 2024-09-19T06:31:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.894+0000 7f02ceffd640 1 -- 172.21.15.12:0/3940316466 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02d403bc80 con 0x7f02d8107660 2024-09-19T06:31:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.894+0000 7f02ceffd640 1 -- 172.21.15.12:0/3940316466 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02d4035030 con 0x7f02d8107660 2024-09-19T06:31:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.894+0000 7f02e00f0640 1 -- 172.21.15.12:0/3940316466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d819b990 con 0x7f02d8107660 2024-09-19T06:31:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.895+0000 7f02ceffd640 1 -- 172.21.15.12:0/3940316466 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f02d4042070 con 0x7f02d8107660 2024-09-19T06:31:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.895+0000 7f02e00f0640 1 -- 172.21.15.12:0/3940316466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d8102cd0 con 0x7f02d8107660 2024-09-19T06:31:41.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.895+0000 7f02ceffd640 1 --2- 172.21.15.12:0/3940316466 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f02c40392a0 0x7f02c403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:41.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.895+0000 7f02ceffd640 1 -- 172.21.15.12:0/3940316466 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f02d406d160 con 0x7f02d8107660 2024-09-19T06:31:41.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.895+0000 7f02dd68b640 1 --2- 172.21.15.12:0/3940316466 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f02c40392a0 0x7f02c403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:41.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.896+0000 7f02dd68b640 1 --2- 172.21.15.12:0/3940316466 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f02c40392a0 0x7f02c403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f02c80098c0 tx=0x7f02c8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:41.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:41.900+0000 7f02ceffd640 1 -- 172.21.15.12:0/3940316466 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02d4031e20 con 0x7f02d8107660 2024-09-19T06:31:42.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:42.081+0000 7f02e00f0640 1 -- 172.21.15.12:0/3940316466 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}) -- 0x7f02d8198420 con 0x7f02c40392a0 2024-09-19T06:31:43.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:42 smithi012 ceph-mon[30937]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:43.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:42 smithi012 ceph-mon[30937]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:44.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:44.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:44.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:44.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:44.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi016", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:31:44.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:44.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:31:44.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-19T06:31:44.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: Deploying cephadm binary to smithi173 2024-09-19T06:31:44.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: Updating smithi016:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:31:44.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:31:44.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:44.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:44.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:45 smithi012 ceph-mon[30937]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:45 smithi012 ceph-mon[30937]: Updating smithi016:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:31:46.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.015+0000 7f02ceffd640 1 -- 172.21.15.12:0/3940316466 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f02d8198420 con 0x7f02c40392a0 2024-09-19T06:31:46.017 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi173' with addr '172.21.15.173' 2024-09-19T06:31:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.017+0000 7f02e00f0640 1 -- 172.21.15.12:0/3940316466 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f02c40392a0 msgr2=0x7f02c403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.017+0000 7f02e00f0640 1 --2- 172.21.15.12:0/3940316466 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f02c40392a0 0x7f02c403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f02c80098c0 tx=0x7f02c8006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.017+0000 7f02e00f0640 1 -- 172.21.15.12:0/3940316466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d8107660 msgr2=0x7f02d81970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.017+0000 7f02e00f0640 1 --2- 172.21.15.12:0/3940316466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d8107660 0x7f02d81970c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009230 tx=0x7f02d4003d40 comp rx=0 tx=0).stop 2024-09-19T06:31:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.017+0000 7f02e00f0640 1 -- 172.21.15.12:0/3940316466 shutdown_connections 2024-09-19T06:31:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.017+0000 7f02e00f0640 1 --2- 172.21.15.12:0/3940316466 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f02c40392a0 0x7f02c403b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.017+0000 7f02e00f0640 1 --2- 172.21.15.12:0/3940316466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02d8107660 0x7f02d81970c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.017+0000 7f02e00f0640 1 -- 172.21.15.12:0/3940316466 >> 172.21.15.12:0/3940316466 conn(0x7f02d80fd290 msgr2=0x7f02d80febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.017+0000 7f02e00f0640 1 -- 172.21.15.12:0/3940316466 shutdown_connections 2024-09-19T06:31:46.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:46.017+0000 7f02e00f0640 1 -- 172.21.15.12:0/3940316466 wait complete. 2024-09-19T06:31:46.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:31:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:31:47.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:47 smithi012 ceph-mon[30937]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:47.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:47 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:47.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:47 smithi012 ceph-mon[30937]: Added host smithi173 2024-09-19T06:31:47.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:47 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:47.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:47 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:47.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:47 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.329+0000 7fbd61c49640 1 -- 172.21.15.12:0/1866899427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd5c102750 msgr2=0x7fbd5c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.329+0000 7fbd61c49640 1 --2- 172.21.15.12:0/1866899427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd5c102750 0x7fbd5c102b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009880 tx=0x7fbd4c02a670 comp rx=0 tx=0).stop 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.329+0000 7fbd61c49640 1 -- 172.21.15.12:0/1866899427 shutdown_connections 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.329+0000 7fbd61c49640 1 --2- 172.21.15.12:0/1866899427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd5c102750 0x7fbd5c102b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.329+0000 7fbd61c49640 1 -- 172.21.15.12:0/1866899427 >> 172.21.15.12:0/1866899427 conn(0x7fbd5c0fc1b0 msgr2=0x7fbd5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.329+0000 7fbd61c49640 1 -- 172.21.15.12:0/1866899427 shutdown_connections 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.329+0000 7fbd61c49640 1 -- 172.21.15.12:0/1866899427 wait complete. 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.330+0000 7fbd61c49640 1 Processor -- start 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.330+0000 7fbd61c49640 1 -- start start 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.330+0000 7fbd61c49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd5c102750 0x7fbd5c1971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:47.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.330+0000 7fbd61c49640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c10bcc0 con 0x7fbd5c102750 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.330+0000 7fbd5b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd5c102750 0x7fbd5c1971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.330+0000 7fbd5b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd5c102750 0x7fbd5c1971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59662/0 (socket says 172.21.15.12:59662) 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.330+0000 7fbd5b7fe640 1 -- 172.21.15.12:0/2982236462 learned_addr learned my addr 172.21.15.12:0/2982236462 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.331+0000 7fbd5b7fe640 1 -- 172.21.15.12:0/2982236462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c197710 con 0x7fbd5c102750 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.331+0000 7fbd5b7fe640 1 --2- 172.21.15.12:0/2982236462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd5c102750 0x7fbd5c1971d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009230 tx=0x7fbd4c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.331+0000 7fbd58ff9640 1 -- 172.21.15.12:0/2982236462 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd4c03f070 con 0x7fbd5c102750 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.331+0000 7fbd61c49640 1 -- 172.21.15.12:0/2982236462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5c1979a0 con 0x7fbd5c102750 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.331+0000 7fbd58ff9640 1 -- 172.21.15.12:0/2982236462 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd4c03bc80 con 0x7fbd5c102750 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.331+0000 7fbd58ff9640 1 -- 172.21.15.12:0/2982236462 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd4c035030 con 0x7fbd5c102750 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.331+0000 7fbd61c49640 1 -- 172.21.15.12:0/2982236462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5c197e00 con 0x7fbd5c102750 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.332+0000 7fbd58ff9640 1 -- 172.21.15.12:0/2982236462 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fbd4c042070 con 0x7fbd5c102750 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.332+0000 7fbd61c49640 1 -- 172.21.15.12:0/2982236462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd5c06a7b0 con 0x7fbd5c102750 2024-09-19T06:31:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.332+0000 7fbd58ff9640 1 --2- 172.21.15.12:0/2982236462 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd440392a0 0x7fbd4403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.332+0000 7fbd58ff9640 1 -- 172.21.15.12:0/2982236462 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbd4c06d180 con 0x7fbd5c102750 2024-09-19T06:31:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.332+0000 7fbd5affd640 1 --2- 172.21.15.12:0/2982236462 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd440392a0 0x7fbd4403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.333+0000 7fbd5affd640 1 --2- 172.21.15.12:0/2982236462 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd440392a0 0x7fbd4403b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbd500098c0 tx=0x7fbd50006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:47.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.337+0000 7fbd58ff9640 1 -- 172.21.15.12:0/2982236462 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd4c04c350 con 0x7fbd5c102750 2024-09-19T06:31:47.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.518+0000 7fbd61c49640 1 -- 172.21.15.12:0/2982236462 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd5c198530 con 0x7fbd440392a0 2024-09-19T06:31:47.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.520+0000 7fbd58ff9640 1 -- 172.21.15.12:0/2982236462 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fbd5c198530 con 0x7fbd440392a0 2024-09-19T06:31:47.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:31:47.522 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.16", "hostname": "smithi016", "labels": [], "status": ""}, {"addr": "172.21.15.173", "hostname": "smithi173", "labels": [], "status": ""}] 2024-09-19T06:31:47.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.522+0000 7fbd61c49640 1 -- 172.21.15.12:0/2982236462 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd440392a0 msgr2=0x7fbd4403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:47.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.522+0000 7fbd61c49640 1 --2- 172.21.15.12:0/2982236462 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd440392a0 0x7fbd4403b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbd500098c0 tx=0x7fbd50006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:47.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.522+0000 7fbd61c49640 1 -- 172.21.15.12:0/2982236462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd5c102750 msgr2=0x7fbd5c1971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:47.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.522+0000 7fbd61c49640 1 --2- 172.21.15.12:0/2982236462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd5c102750 0x7fbd5c1971d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009230 tx=0x7fbd4c003d40 comp rx=0 tx=0).stop 2024-09-19T06:31:47.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.522+0000 7fbd61c49640 1 -- 172.21.15.12:0/2982236462 shutdown_connections 2024-09-19T06:31:47.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.522+0000 7fbd61c49640 1 --2- 172.21.15.12:0/2982236462 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd440392a0 0x7fbd4403b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:47.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.522+0000 7fbd61c49640 1 --2- 172.21.15.12:0/2982236462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd5c102750 0x7fbd5c1971d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:47.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.522+0000 7fbd61c49640 1 -- 172.21.15.12:0/2982236462 >> 172.21.15.12:0/2982236462 conn(0x7fbd5c0fc1b0 msgr2=0x7fbd5c105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:47.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.522+0000 7fbd61c49640 1 -- 172.21.15.12:0/2982236462 shutdown_connections 2024-09-19T06:31:47.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:47.522+0000 7fbd61c49640 1 -- 172.21.15.12:0/2982236462 wait complete. 2024-09-19T06:31:48.167 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T06:31:48.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T06:31:48.421 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:31:48.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:48 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:48.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:48 smithi012 ceph-mon[30937]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:31:48.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.847+0000 7f355df73640 1 -- 172.21.15.12:0/294376599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3558107660 msgr2=0x7f3558107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:48.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.847+0000 7f355df73640 1 --2- 172.21.15.12:0/294376599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3558107660 0x7f3558107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3548009880 tx=0x7f354802a5d0 comp rx=0 tx=0).stop 2024-09-19T06:31:48.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.847+0000 7f355df73640 1 -- 172.21.15.12:0/294376599 shutdown_connections 2024-09-19T06:31:48.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.847+0000 7f355df73640 1 --2- 172.21.15.12:0/294376599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3558107660 0x7f3558107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:48.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.847+0000 7f355df73640 1 -- 172.21.15.12:0/294376599 >> 172.21.15.12:0/294376599 conn(0x7f35580fd290 msgr2=0x7f35580ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:48.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.847+0000 7f355df73640 1 -- 172.21.15.12:0/294376599 shutdown_connections 2024-09-19T06:31:48.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.847+0000 7f355df73640 1 -- 172.21.15.12:0/294376599 wait complete. 2024-09-19T06:31:48.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.848+0000 7f355df73640 1 Processor -- start 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.848+0000 7f355df73640 1 -- start start 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.848+0000 7f355df73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3558107660 0x7f35581992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.848+0000 7f355df73640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f355810bc90 con 0x7f3558107660 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.848+0000 7f35577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3558107660 0x7f35581992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.848+0000 7f35577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3558107660 0x7f35581992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59676/0 (socket says 172.21.15.12:59676) 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.848+0000 7f35577fe640 1 -- 172.21.15.12:0/2959275153 learned_addr learned my addr 172.21.15.12:0/2959275153 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.849+0000 7f35577fe640 1 -- 172.21.15.12:0/2959275153 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3558199800 con 0x7f3558107660 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.849+0000 7f35577fe640 1 --2- 172.21.15.12:0/2959275153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3558107660 0x7f35581992c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3548009230 tx=0x7f3548003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.849+0000 7f3554ff9640 1 -- 172.21.15.12:0/2959275153 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f354803f070 con 0x7f3558107660 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.849+0000 7f3554ff9640 1 -- 172.21.15.12:0/2959275153 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f354803bc80 con 0x7f3558107660 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.849+0000 7f355df73640 1 -- 172.21.15.12:0/2959275153 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3558199a90 con 0x7f3558107660 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.849+0000 7f3554ff9640 1 -- 172.21.15.12:0/2959275153 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3548035030 con 0x7f3558107660 2024-09-19T06:31:48.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.849+0000 7f355df73640 1 -- 172.21.15.12:0/2959275153 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f355819db90 con 0x7f3558107660 2024-09-19T06:31:48.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.850+0000 7f3554ff9640 1 -- 172.21.15.12:0/2959275153 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3548042070 con 0x7f3558107660 2024-09-19T06:31:48.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.850+0000 7f3554ff9640 1 --2- 172.21.15.12:0/2959275153 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f35400392a0 0x7f354003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:48.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.850+0000 7f355df73640 1 -- 172.21.15.12:0/2959275153 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3558102cd0 con 0x7f3558107660 2024-09-19T06:31:48.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.850+0000 7f3554ff9640 1 -- 172.21.15.12:0/2959275153 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f354806d0b0 con 0x7f3558107660 2024-09-19T06:31:48.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.850+0000 7f3556ffd640 1 --2- 172.21.15.12:0/2959275153 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f35400392a0 0x7f354003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:48.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.851+0000 7f3556ffd640 1 --2- 172.21.15.12:0/2959275153 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f35400392a0 0x7f354003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f354c0098c0 tx=0x7f354c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:48.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:48.855+0000 7f3554ff9640 1 -- 172.21.15.12:0/2959275153 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3548042db0 con 0x7f3558107660 2024-09-19T06:31:49.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.038+0000 7f355df73640 1 -- 172.21.15.12:0/2959275153 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f3558107ac0 con 0x7f3558107660 2024-09-19T06:31:49.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.377+0000 7f3554ff9640 1 -- 172.21.15.12:0/2959275153 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f3548031e20 con 0x7f3558107660 2024-09-19T06:31:49.379 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-09-19T06:31:49.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.380+0000 7f355df73640 1 -- 172.21.15.12:0/2959275153 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f35400392a0 msgr2=0x7f354003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:49.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.380+0000 7f355df73640 1 --2- 172.21.15.12:0/2959275153 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f35400392a0 0x7f354003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f354c0098c0 tx=0x7f354c006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:49.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.380+0000 7f355df73640 1 -- 172.21.15.12:0/2959275153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3558107660 msgr2=0x7f35581992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:49.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.380+0000 7f355df73640 1 --2- 172.21.15.12:0/2959275153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3558107660 0x7f35581992c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3548009230 tx=0x7f3548003d40 comp rx=0 tx=0).stop 2024-09-19T06:31:49.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.380+0000 7f355df73640 1 -- 172.21.15.12:0/2959275153 shutdown_connections 2024-09-19T06:31:49.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.380+0000 7f355df73640 1 --2- 172.21.15.12:0/2959275153 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f35400392a0 0x7f354003b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:49.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.380+0000 7f355df73640 1 --2- 172.21.15.12:0/2959275153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3558107660 0x7f35581992c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:49.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.380+0000 7f355df73640 1 -- 172.21.15.12:0/2959275153 >> 172.21.15.12:0/2959275153 conn(0x7f35580fd290 msgr2=0x7f3558075df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:49.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.380+0000 7f355df73640 1 -- 172.21.15.12:0/2959275153 shutdown_connections 2024-09-19T06:31:49.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:31:49.380+0000 7f355df73640 1 -- 172.21.15.12:0/2959275153 wait complete. 2024-09-19T06:31:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:49 smithi012 ceph-mon[30937]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:49 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2959275153' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:31:50.006 INFO:tasks.cephadm:Adding mon.a on smithi012 2024-09-19T06:31:50.006 INFO:tasks.cephadm:Adding mon.b on smithi016 2024-09-19T06:31:50.007 INFO:tasks.cephadm:Adding mon.c on smithi173 2024-09-19T06:31:50.007 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi012:172.21.15.12=a;smithi016:172.21.15.16=b;smithi173:172.21.15.173=c' 2024-09-19T06:31:50.259 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:31:50.303 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:31:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:50 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2959275153' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:31:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:50 smithi012 ceph-mon[30937]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:31:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:50.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:50.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:31:50.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:50.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:31:50.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.834+0000 7f17f62e7640 1 -- 172.21.15.173:0/2976099202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f0100540 msgr2=0x7f17f0100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:50.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.834+0000 7f17f62e7640 1 --2- 172.21.15.173:0/2976099202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f0100540 0x7f17f0100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009880 tx=0x7f17e002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:31:50.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.834+0000 7f17f62e7640 1 -- 172.21.15.173:0/2976099202 shutdown_connections 2024-09-19T06:31:50.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.834+0000 7f17f62e7640 1 --2- 172.21.15.173:0/2976099202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f0100540 0x7f17f0100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:50.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.834+0000 7f17f62e7640 1 -- 172.21.15.173:0/2976099202 >> 172.21.15.173:0/2976099202 conn(0x7f17f00fbcd0 msgr2=0x7f17f00fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:50.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.834+0000 7f17f62e7640 1 -- 172.21.15.173:0/2976099202 shutdown_connections 2024-09-19T06:31:50.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.834+0000 7f17f62e7640 1 -- 172.21.15.173:0/2976099202 wait complete. 2024-09-19T06:31:50.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.835+0000 7f17f62e7640 1 Processor -- start 2024-09-19T06:31:50.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.835+0000 7f17f62e7640 1 -- start start 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.835+0000 7f17f62e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f0100540 0x7f17f006a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.835+0000 7f17f62e7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01065f0 con 0x7f17f0100540 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.835+0000 7f17effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f0100540 0x7f17f006a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.836+0000 7f17effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f0100540 0x7f17f006a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.173:35952/0 (socket says 172.21.15.173:35952) 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.836+0000 7f17effff640 1 -- 172.21.15.173:0/3255154976 learned_addr learned my addr 172.21.15.173:0/3255154976 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.836+0000 7f17effff640 1 -- 172.21.15.173:0/3255154976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f0199ab0 con 0x7f17f0100540 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.836+0000 7f17effff640 1 --2- 172.21.15.173:0/3255154976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f0100540 0x7f17f006a130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17e0004f60 tx=0x7f17e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.836+0000 7f17ed7fa640 1 -- 172.21.15.173:0/3255154976 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e003f070 con 0x7f17f0100540 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.836+0000 7f17ed7fa640 1 -- 172.21.15.173:0/3255154976 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17e0004d40 con 0x7f17f0100540 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.836+0000 7f17f62e7640 1 -- 172.21.15.173:0/3255154976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f0199c80 con 0x7f17f0100540 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.836+0000 7f17ed7fa640 1 -- 172.21.15.173:0/3255154976 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e0035030 con 0x7f17f0100540 2024-09-19T06:31:50.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.836+0000 7f17f62e7640 1 -- 172.21.15.173:0/3255154976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f019a020 con 0x7f17f0100540 2024-09-19T06:31:50.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.837+0000 7f17f62e7640 1 -- 172.21.15.173:0/3255154976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f0106d70 con 0x7f17f0100540 2024-09-19T06:31:50.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.837+0000 7f17ed7fa640 1 -- 172.21.15.173:0/3255154976 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f17e0042070 con 0x7f17f0100540 2024-09-19T06:31:50.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.838+0000 7f17ed7fa640 1 --2- 172.21.15.173:0/3255154976 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f17d8039300 0x7f17d803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:50.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.838+0000 7f17ed7fa640 1 -- 172.21.15.173:0/3255154976 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f17e006cff0 con 0x7f17f0100540 2024-09-19T06:31:50.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.838+0000 7f17ef7fe640 1 --2- 172.21.15.173:0/3255154976 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f17d8039300 0x7f17d803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:50.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.839+0000 7f17ef7fe640 1 --2- 172.21.15.173:0/3255154976 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f17d8039300 0x7f17d803b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f17e40098c0 tx=0x7f17e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:50.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:50.843+0000 7f17ed7fa640 1 -- 172.21.15.173:0/3255154976 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f17e004a260 con 0x7f17f0100540 2024-09-19T06:31:51.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.035+0000 7f17f62e7640 1 -- 172.21.15.173:0/3255154976 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi016:172.21.15.16=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}) -- 0x7f17f002db40 con 0x7f17d8039300 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.041+0000 7f17ed7fa640 1 -- 172.21.15.173:0/3255154976 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f17f002db40 con 0x7f17d8039300 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mon update... 2024-09-19T06:31:51.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.043+0000 7f17f62e7640 1 -- 172.21.15.173:0/3255154976 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f17d8039300 msgr2=0x7f17d803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.043+0000 7f17f62e7640 1 --2- 172.21.15.173:0/3255154976 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f17d8039300 0x7f17d803b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f17e40098c0 tx=0x7f17e4006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.043+0000 7f17f62e7640 1 -- 172.21.15.173:0/3255154976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f0100540 msgr2=0x7f17f006a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.043+0000 7f17f62e7640 1 --2- 172.21.15.173:0/3255154976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f0100540 0x7f17f006a130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17e0004f60 tx=0x7f17e00048f0 comp rx=0 tx=0).stop 2024-09-19T06:31:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.043+0000 7f17f62e7640 1 -- 172.21.15.173:0/3255154976 shutdown_connections 2024-09-19T06:31:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.043+0000 7f17f62e7640 1 --2- 172.21.15.173:0/3255154976 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f17d8039300 0x7f17d803b7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.043+0000 7f17f62e7640 1 --2- 172.21.15.173:0/3255154976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f0100540 0x7f17f006a130 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.043+0000 7f17f62e7640 1 -- 172.21.15.173:0/3255154976 >> 172.21.15.173:0/3255154976 conn(0x7f17f00fbcd0 msgr2=0x7f17f00fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.043+0000 7f17f62e7640 1 -- 172.21.15.173:0/3255154976 shutdown_connections 2024-09-19T06:31:51.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:51.043+0000 7f17f62e7640 1 -- 172.21.15.173:0/3255154976 wait complete. 2024-09-19T06:31:51.614 DEBUG:teuthology.orchestra.run.smithi016:mon.b> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T06:31:51.617 DEBUG:teuthology.orchestra.run.smithi173:mon.c> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T06:31:51.621 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:31:51.621 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:31:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-19T06:31:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: Updating smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:31:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:31:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:51.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:51.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:51.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:51.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:51.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:51.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:31:51.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:31:51.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:51 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:51.888 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:31:52.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.317+0000 7fed0a68d640 1 -- 172.21.15.173:0/3179573861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed04106560 msgr2=0x7fed04106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:52.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.317+0000 7fed0a68d640 1 --2- 172.21.15.173:0/3179573861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed04106560 0x7fed04106940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009880 tx=0x7fecf402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.317+0000 7fed0a68d640 1 -- 172.21.15.173:0/3179573861 shutdown_connections 2024-09-19T06:31:52.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.317+0000 7fed0a68d640 1 --2- 172.21.15.173:0/3179573861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed04106560 0x7fed04106940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.317+0000 7fed0a68d640 1 -- 172.21.15.173:0/3179573861 >> 172.21.15.173:0/3179573861 conn(0x7fed040fc1b0 msgr2=0x7fed040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:52.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.317+0000 7fed0a68d640 1 -- 172.21.15.173:0/3179573861 shutdown_connections 2024-09-19T06:31:52.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.317+0000 7fed0a68d640 1 -- 172.21.15.173:0/3179573861 wait complete. 2024-09-19T06:31:52.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.318+0000 7fed0a68d640 1 Processor -- start 2024-09-19T06:31:52.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.318+0000 7fed0a68d640 1 -- start start 2024-09-19T06:31:52.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.318+0000 7fed0a68d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed040fc660 0x7fed040fca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:52.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.318+0000 7fed0a68d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fed0410ab90 con 0x7fed040fc660 2024-09-19T06:31:52.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.319+0000 7fed03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed040fc660 0x7fed040fca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:52.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.319+0000 7fed03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed040fc660 0x7fed040fca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.173:35976/0 (socket says 172.21.15.173:35976) 2024-09-19T06:31:52.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.319+0000 7fed03fff640 1 -- 172.21.15.173:0/2994823869 learned_addr learned my addr 172.21.15.173:0/2994823869 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:31:52.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.319+0000 7fed03fff640 1 -- 172.21.15.173:0/2994823869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed040fe550 con 0x7fed040fc660 2024-09-19T06:31:52.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.319+0000 7fed03fff640 1 --2- 172.21.15.173:0/2994823869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed040fc660 0x7fed040fca40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fecf4006010 tx=0x7fecf4003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:52.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.319+0000 7fed017fa640 1 -- 172.21.15.173:0/2994823869 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf403f070 con 0x7fed040fc660 2024-09-19T06:31:52.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.319+0000 7fed0a68d640 1 -- 172.21.15.173:0/2994823869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed040fcf80 con 0x7fed040fc660 2024-09-19T06:31:52.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.319+0000 7fed017fa640 1 -- 172.21.15.173:0/2994823869 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecf403bc80 con 0x7fed040fc660 2024-09-19T06:31:52.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.319+0000 7fed017fa640 1 -- 172.21.15.173:0/2994823869 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf4035030 con 0x7fed040fc660 2024-09-19T06:31:52.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.319+0000 7fed0a68d640 1 -- 172.21.15.173:0/2994823869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed040fd440 con 0x7fed040fc660 2024-09-19T06:31:52.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.320+0000 7fed017fa640 1 -- 172.21.15.173:0/2994823869 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fecf4042070 con 0x7fed040fc660 2024-09-19T06:31:52.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.320+0000 7fed0a68d640 1 -- 172.21.15.173:0/2994823869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed04101bd0 con 0x7fed040fc660 2024-09-19T06:31:52.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.321+0000 7fed017fa640 1 --2- 172.21.15.173:0/2994823869 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fecec0392a0 0x7fecec03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:52.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.321+0000 7fed017fa640 1 -- 172.21.15.173:0/2994823869 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fecf406ce30 con 0x7fed040fc660 2024-09-19T06:31:52.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.321+0000 7fed037fe640 1 --2- 172.21.15.173:0/2994823869 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fecec0392a0 0x7fecec03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:52.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.321+0000 7fed037fe640 1 --2- 172.21.15.173:0/2994823869 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fecec0392a0 0x7fecec03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fecf80098c0 tx=0x7fecf8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:52.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.326+0000 7fed017fa640 1 -- 172.21.15.173:0/2994823869 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fecf4030df0 con 0x7fed040fc660 2024-09-19T06:31:52.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.561+0000 7fed0a68d640 1 -- 172.21.15.173:0/2994823869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fed040fdb90 con 0x7fed040fc660 2024-09-19T06:31:52.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.561+0000 7fed017fa640 1 -- 172.21.15.173:0/2994823869 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fecf40412c0 con 0x7fed040fc660 2024-09-19T06:31:52.563 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:31:52.563 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:30:29.711565Z","created":"2024-09-19T06:30:29.711565Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:31:52.563 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-09-19T06:31:52.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.563+0000 7fed0a68d640 1 -- 172.21.15.173:0/2994823869 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fecec0392a0 msgr2=0x7fecec03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:52.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.563+0000 7fed0a68d640 1 --2- 172.21.15.173:0/2994823869 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fecec0392a0 0x7fecec03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fecf80098c0 tx=0x7fecf8006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.563+0000 7fed0a68d640 1 -- 172.21.15.173:0/2994823869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed040fc660 msgr2=0x7fed040fca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:52.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.563+0000 7fed0a68d640 1 --2- 172.21.15.173:0/2994823869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed040fc660 0x7fed040fca40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fecf4006010 tx=0x7fecf4003e10 comp rx=0 tx=0).stop 2024-09-19T06:31:52.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.563+0000 7fed0a68d640 1 -- 172.21.15.173:0/2994823869 shutdown_connections 2024-09-19T06:31:52.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.563+0000 7fed0a68d640 1 --2- 172.21.15.173:0/2994823869 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fecec0392a0 0x7fecec03b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.563+0000 7fed0a68d640 1 --2- 172.21.15.173:0/2994823869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed040fc660 0x7fed040fca40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.563+0000 7fed0a68d640 1 -- 172.21.15.173:0/2994823869 >> 172.21.15.173:0/2994823869 conn(0x7fed040fc1b0 msgr2=0x7fed04069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:52.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.564+0000 7fed0a68d640 1 -- 172.21.15.173:0/2994823869 shutdown_connections 2024-09-19T06:31:52.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:52.564+0000 7fed0a68d640 1 -- 172.21.15.173:0/2994823869 wait complete. 2024-09-19T06:31:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:52 smithi012 ceph-mon[30937]: Updating smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:31:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:52 smithi012 ceph-mon[30937]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi016:172.21.15.16=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:52 smithi012 ceph-mon[30937]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi016:172.21.15.16=b;smithi173:172.21.15.173=c;count:3 2024-09-19T06:31:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:52 smithi012 ceph-mon[30937]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T06:31:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:52 smithi012 ceph-mon[30937]: Reconfiguring daemon mon.a on smithi012 2024-09-19T06:31:53.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: Deploying daemon mon.c on smithi173 2024-09-19T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:53 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/2994823869' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:31:54.111 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:31:54.111 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:31:54.806 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:31:55.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.777+0000 7f4d021d6640 1 -- 172.21.15.173:0/2781670533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cfc106540 msgr2=0x7f4cfc106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.777+0000 7f4d021d6640 1 --2- 172.21.15.173:0/2781670533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cfc106540 0x7f4cfc106920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009810 tx=0x7f4cec02a540 comp rx=0 tx=0).stop 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.777+0000 7f4d021d6640 1 -- 172.21.15.173:0/2781670533 shutdown_connections 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.777+0000 7f4d021d6640 1 --2- 172.21.15.173:0/2781670533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cfc106540 0x7f4cfc106920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.777+0000 7f4d021d6640 1 -- 172.21.15.173:0/2781670533 >> 172.21.15.173:0/2781670533 conn(0x7f4cfc077310 msgr2=0x7f4cfc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.777+0000 7f4d021d6640 1 -- 172.21.15.173:0/2781670533 shutdown_connections 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.777+0000 7f4d021d6640 1 -- 172.21.15.173:0/2781670533 wait complete. 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.777+0000 7f4d021d6640 1 Processor -- start 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.777+0000 7f4d021d6640 1 -- start start 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.778+0000 7f4d021d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cfc106540 0x7f4cfc1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.778+0000 7f4d021d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc10ab70 con 0x7f4cfc106540 2024-09-19T06:31:55.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.778+0000 7f4cfb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cfc106540 0x7f4cfc1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.778+0000 7f4cfb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cfc106540 0x7f4cfc1970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.173:35996/0 (socket says 172.21.15.173:35996) 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.778+0000 7f4cfb7fe640 1 -- 172.21.15.173:0/83016469 learned_addr learned my addr 172.21.15.173:0/83016469 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.778+0000 7f4cfb7fe640 1 -- 172.21.15.173:0/83016469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc197620 con 0x7f4cfc106540 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.778+0000 7f4cfb7fe640 1 --2- 172.21.15.173:0/83016469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cfc106540 0x7f4cfc1970e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0045e0 tx=0x7f4cec004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.778+0000 7f4cf8ff9640 1 -- 172.21.15.173:0/83016469 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cec030e70 con 0x7f4cfc106540 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.779+0000 7f4d021d6640 1 -- 172.21.15.173:0/83016469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cfc1978b0 con 0x7f4cfc106540 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.779+0000 7f4cf8ff9640 1 -- 172.21.15.173:0/83016469 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cec0318e0 con 0x7f4cfc106540 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.779+0000 7f4cf8ff9640 1 -- 172.21.15.173:0/83016469 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cec0049c0 con 0x7f4cfc106540 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.779+0000 7f4d021d6640 1 -- 172.21.15.173:0/83016469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cfc19b9b0 con 0x7f4cfc106540 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.779+0000 7f4cf8ff9640 1 -- 172.21.15.173:0/83016469 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4cec039040 con 0x7f4cfc106540 2024-09-19T06:31:55.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.780+0000 7f4d021d6640 1 -- 172.21.15.173:0/83016469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cfc101bb0 con 0x7f4cfc106540 2024-09-19T06:31:55.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.780+0000 7f4cf8ff9640 1 --2- 172.21.15.173:0/83016469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4ce40392a0 0x7f4ce403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:55.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.780+0000 7f4cf8ff9640 1 -- 172.21.15.173:0/83016469 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4cec06d690 con 0x7f4cfc106540 2024-09-19T06:31:55.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.780+0000 7f4cfaffd640 1 --2- 172.21.15.173:0/83016469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4ce40392a0 0x7f4ce403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:55.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.780+0000 7f4cfaffd640 1 --2- 172.21.15.173:0/83016469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4ce40392a0 0x7f4ce403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00098c0 tx=0x7f4cf0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:55.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:55.785+0000 7f4cf8ff9640 1 -- 172.21.15.173:0/83016469 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4cec040030 con 0x7f4cfc106540 2024-09-19T06:31:55.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:55 smithi012 ceph-mon[30937]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.036+0000 7f4d021d6640 1 -- 172.21.15.173:0/83016469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4cfc198440 con 0x7f4cfc106540 2024-09-19T06:31:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.037+0000 7f4cf8ff9640 1 -- 172.21.15.173:0/83016469 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f4cec037d70 con 0x7f4cfc106540 2024-09-19T06:31:56.039 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:31:56.039 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:30:29.711565Z","created":"2024-09-19T06:30:29.711565Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:31:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-09-19T06:31:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.039+0000 7f4d021d6640 1 -- 172.21.15.173:0/83016469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4ce40392a0 msgr2=0x7f4ce403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.039+0000 7f4d021d6640 1 --2- 172.21.15.173:0/83016469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4ce40392a0 0x7f4ce403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00098c0 tx=0x7f4cf0006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.039+0000 7f4d021d6640 1 -- 172.21.15.173:0/83016469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cfc106540 msgr2=0x7f4cfc1970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.039+0000 7f4d021d6640 1 --2- 172.21.15.173:0/83016469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cfc106540 0x7f4cfc1970e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0045e0 tx=0x7f4cec004610 comp rx=0 tx=0).stop 2024-09-19T06:31:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.039+0000 7f4d021d6640 1 -- 172.21.15.173:0/83016469 shutdown_connections 2024-09-19T06:31:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.039+0000 7f4d021d6640 1 --2- 172.21.15.173:0/83016469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4ce40392a0 0x7f4ce403b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.039+0000 7f4d021d6640 1 --2- 172.21.15.173:0/83016469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cfc106540 0x7f4cfc1970e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.039+0000 7f4d021d6640 1 -- 172.21.15.173:0/83016469 >> 172.21.15.173:0/83016469 conn(0x7f4cfc077310 msgr2=0x7f4cfc0696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.039+0000 7f4d021d6640 1 -- 172.21.15.173:0/83016469 shutdown_connections 2024-09-19T06:31:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:31:56.039+0000 7f4d021d6640 1 -- 172.21.15.173:0/83016469 wait complete. 2024-09-19T06:31:56.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:56 smithi173 systemd[1]: Starting Ceph mon.c for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:31:56.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:31:56 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/83016469' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:31:57.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:56 smithi173 podman[35330]: 2024-09-19 06:31:56.705411375 +0000 UTC m=+0.015509758 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:31:57.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:56 smithi173 podman[35330]: 2024-09-19 06:31:56.803456233 +0000 UTC m=+0.113554618 container create fadca08d8e989038c503d07193248e62e4a3541f94f32b29e893a4c727345844 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:31:57.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 podman[35330]: 2024-09-19 06:31:57.134869303 +0000 UTC m=+0.444967701 container init fadca08d8e989038c503d07193248e62e4a3541f94f32b29e893a4c727345844 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-19T06:31:57.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 podman[35330]: 2024-09-19 06:31:57.138427221 +0000 UTC m=+0.448525617 container start fadca08d8e989038c503d07193248e62e4a3541f94f32b29e893a4c727345844 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T06:31:57.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:31:57.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:31:57.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: pidfile_write: ignore empty --pid-file 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: load: jerasure load: lrc 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Git sha 0 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: DB SUMMARY 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: DB Session ID: BWQ3H3A3AX4C39GL6E9Y 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:31:57.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:31:57.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:31:57.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:31:57.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:31:57.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:31:57.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.env: 0x55c58e508940 2024-09-19T06:31:57.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:31:57.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.info_log: 0x55c5905636e0 2024-09-19T06:31:57.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:31:57.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.statistics: (nil) 2024-09-19T06:31:57.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.use_fsync: 0 2024-09-19T06:31:57.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:31:57.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:31:57.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:31:57.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:31:57.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:31:57.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.db_log_dir: 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.wal_dir: 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:31:57.588 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.write_buffer_manager: 0x55c590572dc0 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.unordered_write: 0 2024-09-19T06:31:57.589 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.row_cache: None 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.wal_filter: None 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.wal_compression: 0 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:31:57.590 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:31:57.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_open_files: -1 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:31:57.592 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Compression algorithms supported: 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: kZSTD supported: 0 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:31:57.593 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.merge_operator: 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_filter: None 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c590563320) 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_type: 0 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_index_type: 0 2024-09-19T06:31:57.594 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_shortening: 1 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: checksum: 4 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: no_block_cache: 0 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache: 0x55c5905571f0 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_options: 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: capacity : 536870912 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_shard_bits : 4 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: strict_capacity_limit : 0 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_compressed: (nil) 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: persistent_cache: (nil) 2024-09-19T06:31:57.595 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size: 4096 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size_deviation: 10 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_restart_interval: 16 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_block_restart_interval: 1 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: metadata_block_size: 4096 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: partition_filters: 0 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: use_delta_encoding: 1 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: filter_policy: bloomfilter 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: whole_key_filtering: 1 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: verify_compression: 0 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: format_version: 5 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_index_compression: 1 2024-09-19T06:31:57.596 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_align: 0 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout: max_auto_readahead_size: 262144 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout: prepopulate_block_cache: 0 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compression: NoCompression 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.num_levels: 7 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:31:57.597 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:31:57.598 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:31:57.599 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:31:57.600 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:31:57.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.ttl: 2592000 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:31:57.602 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T06:31:57.603 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 83b91349-1640-4b50-8d30-d764811f8c66 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727517165138, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727517165541, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726727517, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "83b91349-1640-4b50-8d30-d764811f8c66", "db_session_id": "BWQ3H3A3AX4C39GL6E9Y", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727517165633, "job": 1, "event": "recovery_finished"} 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c590584e00 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: DB pointer 0x55c590680000 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:31:57.604 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** DB Stats ** 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:31:57.605 INFO:journalctl@ceph.mon.c.smithi173.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:31:57.606 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout: Block cache BinnedLRUCache@0x55c5905571f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: using public_addr v2:172.21.15.173:0/0 -> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: starting mon.c rank -1 at public addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] at bind addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(???) e0 preinit fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T06:31:57.607 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout: e1 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout: btime 2024-09-19T06:30:34:142717+0000 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout: legacy client fscid: -1 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout: No filesystems configured 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:31:57.608 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2959275153' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2959275153' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:31:57.609 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: Updating smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:31:57.610 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: Updating smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi016:172.21.15.16=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi016:172.21.15.16=b;smithi173:172.21.15.173=c;count:3 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: Reconfiguring daemon mon.a on smithi012 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:31:57.611 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:31:57.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:31:57.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:57.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: Deploying daemon mon.c on smithi173 2024-09-19T06:31:57.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/2994823869' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:31:57.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:57.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/83016469' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:31:57.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 ceph-mon[35349]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T06:31:57.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 bash[35330]: fadca08d8e989038c503d07193248e62e4a3541f94f32b29e893a4c727345844 2024-09-19T06:31:57.612 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:31:57 smithi173 systemd[1]: Started Ceph mon.c for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:31:57.651 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:31:57.652 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:31:57.903 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:32:02.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:32:02.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: mon.a calling monitor election 2024-09-19T06:32:02.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:02.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: mon.c calling monitor election 2024-09-19T06:32:02.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:02.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:32:02.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: monmap epoch 2 2024-09-19T06:32:02.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:02.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: last_changed 2024-09-19T06:31:57.190928+0000 2024-09-19T06:32:02.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: created 2024-09-19T06:30:29.711565+0000 2024-09-19T06:32:02.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: min_mon_release 19 (squid) 2024-09-19T06:32:02.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: election_strategy: 1 2024-09-19T06:32:02.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-19T06:32:02.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-19T06:32:02.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: fsmap 2024-09-19T06:32:02.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:32:02.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: mgrmap e13: x(active, since 40s) 2024-09-19T06:32:02.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: overall HEALTH_OK 2024-09-19T06:32:02.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:02.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:02.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:02.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:32:02.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:02.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:32:02.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: mon.a calling monitor election 2024-09-19T06:32:02.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:02.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: mon.c calling monitor election 2024-09-19T06:32:02.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:02.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:02.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:32:02.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: monmap epoch 2 2024-09-19T06:32:02.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: last_changed 2024-09-19T06:31:57.190928+0000 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: created 2024-09-19T06:30:29.711565+0000 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: min_mon_release 19 (squid) 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: election_strategy: 1 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: fsmap 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: mgrmap e13: x(active, since 40s) 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: overall HEALTH_OK 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:02.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:32:02.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.771+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/2423496774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a98003530 msgr2=0x7f2a980059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.771+0000 7f2ab5a6e640 1 --2- 172.21.15.173:0/2423496774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a98003530 0x7f2a980059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ab006aa60 tx=0x7f2aa002c490 comp rx=0 tx=0).stop 2024-09-19T06:32:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.771+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/2423496774 shutdown_connections 2024-09-19T06:32:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.771+0000 7f2ab5a6e640 1 --2- 172.21.15.173:0/2423496774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a98003530 0x7f2a980059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.771+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/2423496774 >> 172.21.15.173:0/2423496774 conn(0x7f2ab00fc220 msgr2=0x7f2ab00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.771+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/2423496774 shutdown_connections 2024-09-19T06:32:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.771+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/2423496774 wait complete. 2024-09-19T06:32:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.772+0000 7f2ab5a6e640 1 Processor -- start 2024-09-19T06:32:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2ab5a6e640 1 -- start start 2024-09-19T06:32:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2ab5a6e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a98003530 0x7f2ab0197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2ab5a6e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ab01978c0 0x7f2ab019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2ab5a6e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab0109780 con 0x7f2ab01978c0 2024-09-19T06:32:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2ab5a6e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab0109600 con 0x7f2a98003530 2024-09-19T06:32:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2aaf7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a98003530 0x7f2ab0197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2aaf7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a98003530 0x7f2ab0197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55742/0 (socket says 172.21.15.173:55742) 2024-09-19T06:32:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2aaf7fe640 1 -- 172.21.15.173:0/527600197 learned_addr learned my addr 172.21.15.173:0/527600197 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:32:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2aaeffd640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ab01978c0 0x7f2ab019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2aaf7fe640 1 -- 172.21.15.173:0/527600197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a98003530 msgr2=0x7f2ab0197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T06:32:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2aaf7fe640 1 -- 172.21.15.173:0/527600197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a98003530 msgr2=0x7f2ab0197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:32:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2aaf7fe640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a98003530 0x7f2ab0197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:32:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.773+0000 7f2aaf7fe640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a98003530 0x7f2ab0197380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:32:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.774+0000 7f2aaeffd640 1 -- 172.21.15.173:0/527600197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a98003530 msgr2=0x7f2ab0197380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:32:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.774+0000 7f2aaeffd640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a98003530 0x7f2ab0197380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.774+0000 7f2aaeffd640 1 -- 172.21.15.173:0/527600197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab0197ee0 con 0x7f2ab01978c0 2024-09-19T06:32:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.774+0000 7f2aaeffd640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ab01978c0 0x7f2ab019bc00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400b3d0 tx=0x7f2aa400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.774+0000 7f2aacff9640 1 -- 172.21.15.173:0/527600197 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2aa4011630 con 0x7f2ab01978c0 2024-09-19T06:32:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.774+0000 7f2aacff9640 1 -- 172.21.15.173:0/527600197 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2aa4011cb0 con 0x7f2ab01978c0 2024-09-19T06:32:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.774+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/527600197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab019c140 con 0x7f2ab01978c0 2024-09-19T06:32:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.774+0000 7f2aacff9640 1 -- 172.21.15.173:0/527600197 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2aa4010df0 con 0x7f2ab01978c0 2024-09-19T06:32:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.774+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/527600197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab019c680 con 0x7f2ab01978c0 2024-09-19T06:32:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.775+0000 7f2aacff9640 1 -- 172.21.15.173:0/527600197 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2aa4018020 con 0x7f2ab01978c0 2024-09-19T06:32:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.776+0000 7f2aacff9640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2a9c039090 0x7f2a9c03b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.776+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/527600197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab006ad10 con 0x7f2ab01978c0 2024-09-19T06:32:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.776+0000 7f2aacff9640 1 -- 172.21.15.173:0/527600197 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2aa404bf50 con 0x7f2ab01978c0 2024-09-19T06:32:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.776+0000 7f2aaf7fe640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2a9c039090 0x7f2a9c03b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:02.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.776+0000 7f2aaf7fe640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2a9c039090 0x7f2a9c03b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0012c10 tx=0x7f2aa00323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:02.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:02.781+0000 7f2aacff9640 1 -- 172.21.15.173:0/527600197 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2aa401f020 con 0x7f2ab01978c0 2024-09-19T06:32:03.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.019+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/527600197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2ab0190f40 con 0x7f2ab01978c0 2024-09-19T06:32:03.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.019+0000 7f2aacff9640 1 -- 172.21.15.173:0/527600197 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f2aa4018310 con 0x7f2ab01978c0 2024-09-19T06:32:03.022 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:32:03.022 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:57.190928Z","created":"2024-09-19T06:30:29.711565Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:32:03.022 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-09-19T06:32:03.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.021+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2a9c039090 msgr2=0x7f2a9c03b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:03.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.021+0000 7f2ab5a6e640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2a9c039090 0x7f2a9c03b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0012c10 tx=0x7f2aa00323a0 comp rx=0 tx=0).stop 2024-09-19T06:32:03.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.022+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ab01978c0 msgr2=0x7f2ab019bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:03.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.022+0000 7f2ab5a6e640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ab01978c0 0x7f2ab019bc00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400b3d0 tx=0x7f2aa400b890 comp rx=0 tx=0).stop 2024-09-19T06:32:03.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.022+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/527600197 shutdown_connections 2024-09-19T06:32:03.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.022+0000 7f2ab5a6e640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2a9c039090 0x7f2a9c03b550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:03.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.022+0000 7f2ab5a6e640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ab01978c0 0x7f2ab019bc00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:03.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.022+0000 7f2ab5a6e640 1 --2- 172.21.15.173:0/527600197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a98003530 0x7f2ab0197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:03.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.022+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/527600197 >> 172.21.15.173:0/527600197 conn(0x7f2ab00fc220 msgr2=0x7f2ab00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:03.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.022+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/527600197 shutdown_connections 2024-09-19T06:32:03.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:03.022+0000 7f2ab5a6e640 1 -- 172.21.15.173:0/527600197 wait complete. 2024-09-19T06:32:03.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:03 smithi173 ceph-mon[35349]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:03.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:03 smithi173 ceph-mon[35349]: Deploying daemon mon.b on smithi016 2024-09-19T06:32:03.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:03 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/527600197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:32:03.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:03 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:03 smithi012 ceph-mon[30937]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:03 smithi012 ceph-mon[30937]: Deploying daemon mon.b on smithi016 2024-09-19T06:32:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:03 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/527600197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:32:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:03 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:04.621 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:32:04.621 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:32:04.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:32:04 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:32:04.190+0000 7f94fa532640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T06:32:04.873 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:32:05.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.298+0000 7f70b4d1f640 1 -- 172.21.15.173:0/3660976843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b0106660 msgr2=0x7f70b0106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:05.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.298+0000 7f70b4d1f640 1 --2- 172.21.15.173:0/3660976843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b0106660 0x7f70b0106a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009880 tx=0x7f70a002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:32:05.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.298+0000 7f70b4d1f640 1 -- 172.21.15.173:0/3660976843 shutdown_connections 2024-09-19T06:32:05.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.298+0000 7f70b4d1f640 1 --2- 172.21.15.173:0/3660976843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b0106660 0x7f70b0106a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:05.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.298+0000 7f70b4d1f640 1 -- 172.21.15.173:0/3660976843 >> 172.21.15.173:0/3660976843 conn(0x7f70b00fc250 msgr2=0x7f70b00fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:05.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.298+0000 7f70b4d1f640 1 -- 172.21.15.173:0/3660976843 shutdown_connections 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.298+0000 7f70b4d1f640 1 -- 172.21.15.173:0/3660976843 wait complete. 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.299+0000 7f70b4d1f640 1 Processor -- start 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.299+0000 7f70b4d1f640 1 -- start start 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.299+0000 7f70b4d1f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b0106660 0x7f70b0198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.299+0000 7f70b4d1f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0198760 0x7f70b0198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.299+0000 7f70b4d1f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f70b010ac90 con 0x7f70b0106660 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.299+0000 7f70b4d1f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f70b010ab10 con 0x7f70b0198760 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.299+0000 7f70a5d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0198760 0x7f70b0198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70ae59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b0106660 0x7f70b0198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70a5d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0198760 0x7f70b0198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55750/0 (socket says 172.21.15.173:55750) 2024-09-19T06:32:05.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70a5d9b640 1 -- 172.21.15.173:0/1485869781 learned_addr learned my addr 172.21.15.173:0/1485869781 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70a5d9b640 1 -- 172.21.15.173:0/1485869781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0198760 msgr2=0x7f70b0198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70a5d9b640 1 -- 172.21.15.173:0/1485869781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0198760 msgr2=0x7f70b0198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70a5d9b640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0198760 0x7f70b0198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70a5d9b640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0198760 0x7f70b0198bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70ae59c640 1 -- 172.21.15.173:0/1485869781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0198760 msgr2=0x7f70b0198bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70ae59c640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0198760 0x7f70b0198bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70ae59c640 1 -- 172.21.15.173:0/1485869781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b01a1290 con 0x7f70b0106660 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70ae59c640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b0106660 0x7f70b0198220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f70a0005ab0 tx=0x7f70a0032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70a7fff640 1 -- 172.21.15.173:0/1485869781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f70a0035070 con 0x7f70b0106660 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70b4d1f640 1 -- 172.21.15.173:0/1485869781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b01a1460 con 0x7f70b0106660 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70a7fff640 1 -- 172.21.15.173:0/1485869781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a0032e40 con 0x7f70b0106660 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70a7fff640 1 -- 172.21.15.173:0/1485869781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f70a003bc10 con 0x7f70b0106660 2024-09-19T06:32:05.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.300+0000 7f70b4d1f640 1 -- 172.21.15.173:0/1485869781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b01a1940 con 0x7f70b0106660 2024-09-19T06:32:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.301+0000 7f70a7fff640 1 -- 172.21.15.173:0/1485869781 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f70a0042030 con 0x7f70b0106660 2024-09-19T06:32:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.301+0000 7f70b4d1f640 1 -- 172.21.15.173:0/1485869781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b0101cd0 con 0x7f70b0106660 2024-09-19T06:32:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.302+0000 7f70a7fff640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f709c039040 0x7f709c03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.302+0000 7f70a7fff640 1 -- 172.21.15.173:0/1485869781 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f70a0040070 con 0x7f70b0106660 2024-09-19T06:32:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.302+0000 7f70a5d9b640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f709c039040 0x7f709c03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:05.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.303+0000 7f70a5d9b640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f709c039040 0x7f709c03b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7098009100 tx=0x7f7098008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:05.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.307+0000 7f70a7fff640 1 -- 172.21.15.173:0/1485869781 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70a003bdf0 con 0x7f70b0106660 2024-09-19T06:32:05.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.535+0000 7f70b4d1f640 1 -- 172.21.15.173:0/1485869781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f70b01a1c20 con 0x7f70b0106660 2024-09-19T06:32:05.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:05 smithi173 ceph-mon[35349]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:05.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.536+0000 7f70a7fff640 1 -- 172.21.15.173:0/1485869781 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f70a004ad00 con 0x7f70b0106660 2024-09-19T06:32:05.539 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:32:05.539 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:57.190928Z","created":"2024-09-19T06:30:29.711565Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:32:05.539 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-09-19T06:32:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 -- 172.21.15.173:0/1485869781 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f709c039040 msgr2=0x7f709c03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f709c039040 0x7f709c03b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7098009100 tx=0x7f7098008040 comp rx=0 tx=0).stop 2024-09-19T06:32:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 -- 172.21.15.173:0/1485869781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b0106660 msgr2=0x7f70b0198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b0106660 0x7f70b0198220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f70a0005ab0 tx=0x7f70a0032c50 comp rx=0 tx=0).stop 2024-09-19T06:32:05.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 -- 172.21.15.173:0/1485869781 shutdown_connections 2024-09-19T06:32:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f709c039040 0x7f709c03b500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0198760 0x7f70b0198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 --2- 172.21.15.173:0/1485869781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b0106660 0x7f70b0198220 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 -- 172.21.15.173:0/1485869781 >> 172.21.15.173:0/1485869781 conn(0x7f70b00fc250 msgr2=0x7f70b00fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 -- 172.21.15.173:0/1485869781 shutdown_connections 2024-09-19T06:32:05.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:05.539+0000 7f70b4d1f640 1 -- 172.21.15.173:0/1485869781 wait complete. 2024-09-19T06:32:05.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:05 smithi012 ceph-mon[30937]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:06.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:06 smithi016 systemd[1]: Started Ceph mon.b for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:32:07.109 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:32:07.110 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:32:07.357 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:32:11.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:11.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: mon.c calling monitor election 2024-09-19T06:32:11.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:32:11.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: mon.a calling monitor election 2024-09-19T06:32:11.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: monmap epoch 3 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:11.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: last_changed 2024-09-19T06:32:06.011298+0000 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: created 2024-09-19T06:30:29.711565+0000 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: min_mon_release 19 (squid) 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: election_strategy: 1 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: 2: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.b 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: fsmap 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: mgrmap e13: x(active, since 49s) 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: overall HEALTH_OK 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:11.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:11.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:11.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: mon.c calling monitor election 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: mon.a calling monitor election 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:11.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: monmap epoch 3 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: last_changed 2024-09-19T06:32:06.011298+0000 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: created 2024-09-19T06:30:29.711565+0000 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: min_mon_release 19 (squid) 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: election_strategy: 1 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: 2: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.b 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: fsmap 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: mgrmap e13: x(active, since 49s) 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: overall HEALTH_OK 2024-09-19T06:32:11.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:11.382 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:11.382 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:11.382 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:11.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.417+0000 7fc2fa10a640 1 -- 172.21.15.173:0/113084034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2dc005740 msgr2=0x7fc2dc007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.417+0000 7fc2fa10a640 1 --2- 172.21.15.173:0/113084034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2dc005740 0x7fc2dc007bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2f41016a0 tx=0x7fc2e402c3f0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.417+0000 7fc2fa10a640 1 -- 172.21.15.173:0/113084034 shutdown_connections 2024-09-19T06:32:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.417+0000 7fc2fa10a640 1 --2- 172.21.15.173:0/113084034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2dc005740 0x7fc2dc007bd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.417+0000 7fc2fa10a640 1 -- 172.21.15.173:0/113084034 >> 172.21.15.173:0/113084034 conn(0x7fc2f40fc220 msgr2=0x7fc2f40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.417+0000 7fc2fa10a640 1 -- 172.21.15.173:0/113084034 shutdown_connections 2024-09-19T06:32:11.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.417+0000 7fc2fa10a640 1 -- 172.21.15.173:0/113084034 wait complete. 2024-09-19T06:32:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.418+0000 7fc2fa10a640 1 Processor -- start 2024-09-19T06:32:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.418+0000 7fc2fa10a640 1 -- start start 2024-09-19T06:32:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2fa10a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2dc005740 0x7fc2f4195080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2fa10a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f41955c0 0x7fc2f4199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2fa10a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4199e90 0x7fc2f419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2fa10a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f41075a0 con 0x7fc2f41955c0 2024-09-19T06:32:11.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2fa10a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4107420 con 0x7fc2dc005740 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2fa10a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4107720 con 0x7fc2f4199e90 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4199e90 0x7fc2f419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4199e90 0x7fc2f419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33248/0 (socket says 172.21.15.173:33248) 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f3fff640 1 -- 172.21.15.173:0/2555674708 learned_addr learned my addr 172.21.15.173:0/2555674708 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f2ffd640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f41955c0 0x7fc2f4199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f37fe640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2dc005740 0x7fc2f4195080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f3fff640 1 -- 172.21.15.173:0/2555674708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4199e90 msgr2=0x7fc2f419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f3fff640 1 -- 172.21.15.173:0/2555674708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4199e90 msgr2=0x7fc2f419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f3fff640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4199e90 0x7fc2f419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f37fe640 1 -- 172.21.15.173:0/2555674708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2dc005740 msgr2=0x7fc2f4195080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f37fe640 1 -- 172.21.15.173:0/2555674708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2dc005740 msgr2=0x7fc2f4195080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:32:11.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f37fe640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2dc005740 0x7fc2f4195080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f3fff640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4199e90 0x7fc2f419a340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f37fe640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2dc005740 0x7fc2f4195080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f2ffd640 1 -- 172.21.15.173:0/2555674708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4199e90 msgr2=0x7fc2f419a340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f2ffd640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4199e90 0x7fc2f419a340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f2ffd640 1 -- 172.21.15.173:0/2555674708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2dc005740 msgr2=0x7fc2f4195080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f2ffd640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2dc005740 0x7fc2f4195080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.419+0000 7fc2f2ffd640 1 -- 172.21.15.173:0/2555674708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f41a1c00 con 0x7fc2f41955c0 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.420+0000 7fc2f2ffd640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f41955c0 0x7fc2f4199950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800b450 tx=0x7fc2e800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.420+0000 7fc2f0ff9640 1 -- 172.21.15.173:0/2555674708 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8004230 con 0x7fc2f41955c0 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.420+0000 7fc2fa10a640 1 -- 172.21.15.173:0/2555674708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f41a1e30 con 0x7fc2f41955c0 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.420+0000 7fc2f0ff9640 1 -- 172.21.15.173:0/2555674708 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2e80043d0 con 0x7fc2f41955c0 2024-09-19T06:32:11.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.420+0000 7fc2f0ff9640 1 -- 172.21.15.173:0/2555674708 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8003cb0 con 0x7fc2f41955c0 2024-09-19T06:32:11.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.420+0000 7fc2fa10a640 1 -- 172.21.15.173:0/2555674708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f41a2360 con 0x7fc2f41955c0 2024-09-19T06:32:11.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.421+0000 7fc2f0ff9640 1 -- 172.21.15.173:0/2555674708 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc2e800f050 con 0x7fc2f41955c0 2024-09-19T06:32:11.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.421+0000 7fc2fa10a640 1 -- 172.21.15.173:0/2555674708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f4108690 con 0x7fc2f41955c0 2024-09-19T06:32:11.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.421+0000 7fc2f0ff9640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e0039730 0x7fc2e003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:11.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.421+0000 7fc2f0ff9640 1 -- 172.21.15.173:0/2555674708 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc2e804c130 con 0x7fc2f41955c0 2024-09-19T06:32:11.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.422+0000 7fc2f37fe640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e0039730 0x7fc2e003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:11.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.422+0000 7fc2f37fe640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e0039730 0x7fc2e003bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4014cc0 tx=0x7fc2e4005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:11.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.430+0000 7fc2f0ff9640 1 -- 172.21.15.173:0/2555674708 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc2e800d040 con 0x7fc2f41955c0 2024-09-19T06:32:11.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.679+0000 7fc2fa10a640 1 -- 172.21.15.173:0/2555674708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc2f402d7c0 con 0x7fc2f41955c0 2024-09-19T06:32:11.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.679+0000 7fc2f0ff9640 1 -- 172.21.15.173:0/2555674708 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7fc2e8018e00 con 0x7fc2f41955c0 2024-09-19T06:32:11.682 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:32:11.682 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":3,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:32:06.011298Z","created":"2024-09-19T06:30:29.711565Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:32:11.682 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 3 2024-09-19T06:32:11.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 -- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e0039730 msgr2=0x7fc2e003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:11.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e0039730 0x7fc2e003bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4014cc0 tx=0x7fc2e4005f60 comp rx=0 tx=0).stop 2024-09-19T06:32:11.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 -- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f41955c0 msgr2=0x7fc2f4199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:11.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f41955c0 0x7fc2f4199950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800b450 tx=0x7fc2e800b910 comp rx=0 tx=0).stop 2024-09-19T06:32:11.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 -- 172.21.15.173:0/2555674708 shutdown_connections 2024-09-19T06:32:11.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e0039730 0x7fc2e003bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4199e90 0x7fc2f419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f41955c0 0x7fc2f4199950 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 --2- 172.21.15.173:0/2555674708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2dc005740 0x7fc2f4195080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 -- 172.21.15.173:0/2555674708 >> 172.21.15.173:0/2555674708 conn(0x7fc2f40fc220 msgr2=0x7fc2f40fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:11.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 -- 172.21.15.173:0/2555674708 shutdown_connections 2024-09-19T06:32:11.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:11.682+0000 7fc2fa10a640 1 -- 172.21.15.173:0/2555674708 wait complete. 2024-09-19T06:32:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:12 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:12.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:12 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:12.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:12 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/2555674708' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:32:12.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:12 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:12.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:12 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:12.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:12 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:12.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:12 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/2555674708' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:32:12.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:12 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:12.833 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T06:32:12.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T06:32:13.093 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:32:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: mon.c calling monitor election 2024-09-19T06:32:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:32:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: mon.a calling monitor election 2024-09-19T06:32:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:32:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: monmap epoch 3 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: last_changed 2024-09-19T06:32:06.011298+0000 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: created 2024-09-19T06:30:29.711565+0000 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: min_mon_release 19 (squid) 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: election_strategy: 1 2024-09-19T06:32:13.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: 2: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.b 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: fsmap 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: mgrmap e13: x(active, since 49s) 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: overall HEALTH_OK 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:13.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='client.? 172.21.15.173:0/2555674708' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:32:13.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.555+0000 7f0368c35640 1 -- 172.21.15.12:0/1937370167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0364106680 msgr2=0x7f0364106a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.555+0000 7f0368c35640 1 --2- 172.21.15.12:0/1937370167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0364106680 0x7f0364106a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0354009880 tx=0x7f035402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:32:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.555+0000 7f0368c35640 1 -- 172.21.15.12:0/1937370167 shutdown_connections 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.555+0000 7f0368c35640 1 --2- 172.21.15.12:0/1937370167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0364106680 0x7f0364106a60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.555+0000 7f0368c35640 1 -- 172.21.15.12:0/1937370167 >> 172.21.15.12:0/1937370167 conn(0x7f03640fc290 msgr2=0x7f03640fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.555+0000 7f0368c35640 1 -- 172.21.15.12:0/1937370167 shutdown_connections 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.555+0000 7f0368c35640 1 -- 172.21.15.12:0/1937370167 wait complete. 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.555+0000 7f0368c35640 1 Processor -- start 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0368c35640 1 -- start start 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0368c35640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0364106680 0x7f03641a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0368c35640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03641a3c40 0x7f036419d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0368c35640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f036419de00 0x7f036419e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0368c35640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f036410ac60 con 0x7f036419de00 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0368c35640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f036410aae0 con 0x7f03641a3c40 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0368c35640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f036410ade0 con 0x7f0364106680 2024-09-19T06:32:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0362d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f036419de00 0x7f036419e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0362d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f036419de00 0x7f036419e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59762/0 (socket says 172.21.15.12:59762) 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0362d9d640 1 -- 172.21.15.12:0/1483969416 learned_addr learned my addr 172.21.15.12:0/1483969416 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f036259c640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0364106680 0x7f03641a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0361d9b640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03641a3c40 0x7f036419d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0362d9d640 1 -- 172.21.15.12:0/1483969416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0364106680 msgr2=0x7f03641a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0362d9d640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0364106680 0x7f03641a3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0362d9d640 1 -- 172.21.15.12:0/1483969416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03641a3c40 msgr2=0x7f036419d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0362d9d640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03641a3c40 0x7f036419d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.556+0000 7f0362d9d640 1 -- 172.21.15.12:0/1483969416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03641aa5d0 con 0x7f036419de00 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.557+0000 7f0362d9d640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f036419de00 0x7f036419e280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f035c00ba50 tx=0x7f035c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.557+0000 7f03537fe640 1 -- 172.21.15.12:0/1483969416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c019070 con 0x7f036419de00 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.557+0000 7f03537fe640 1 -- 172.21.15.12:0/1483969416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c00cbe0 con 0x7f036419de00 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.557+0000 7f03537fe640 1 -- 172.21.15.12:0/1483969416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c0076a0 con 0x7f036419de00 2024-09-19T06:32:13.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.557+0000 7f0368c35640 1 -- 172.21.15.12:0/1483969416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03641aa800 con 0x7f036419de00 2024-09-19T06:32:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.557+0000 7f0368c35640 1 -- 172.21.15.12:0/1483969416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03641aad70 con 0x7f036419de00 2024-09-19T06:32:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.558+0000 7f03537fe640 1 -- 172.21.15.12:0/1483969416 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f035c01c070 con 0x7f036419de00 2024-09-19T06:32:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.558+0000 7f0368c35640 1 -- 172.21.15.12:0/1483969416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0364106ae0 con 0x7f036419de00 2024-09-19T06:32:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.558+0000 7f03537fe640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f034c039730 0x7f034c03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.558+0000 7f03537fe640 1 -- 172.21.15.12:0/1483969416 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f035c04bce0 con 0x7f036419de00 2024-09-19T06:32:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.558+0000 7f036259c640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f034c039730 0x7f034c03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.558+0000 7f036259c640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f034c039730 0x7f034c03bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f036419ea00 tx=0x7f0354005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:13.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.563+0000 7f03537fe640 1 -- 172.21.15.12:0/1483969416 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f035c0112a0 con 0x7f036419de00 2024-09-19T06:32:13.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.739+0000 7f0368c35640 1 -- 172.21.15.12:0/1483969416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f036402d7c0 con 0x7f036419de00 2024-09-19T06:32:13.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.739+0000 7f03537fe640 1 -- 172.21.15.12:0/1483969416 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f035c00e090 con 0x7f036419de00 2024-09-19T06:32:13.741 INFO:teuthology.orchestra.run.smithi012.stdout:# minimal ceph.conf for 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:13.741 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-09-19T06:32:13.741 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:13.741 INFO:teuthology.orchestra.run.smithi012.stdout: mon_host = [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-09-19T06:32:13.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.741+0000 7f0368c35640 1 -- 172.21.15.12:0/1483969416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f034c039730 msgr2=0x7f034c03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:13.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.741+0000 7f0368c35640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f034c039730 0x7f034c03bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f036419ea00 tx=0x7f0354005a40 comp rx=0 tx=0).stop 2024-09-19T06:32:13.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.741+0000 7f0368c35640 1 -- 172.21.15.12:0/1483969416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f036419de00 msgr2=0x7f036419e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:13.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.741+0000 7f0368c35640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f036419de00 0x7f036419e280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f035c00ba50 tx=0x7f035c00bf10 comp rx=0 tx=0).stop 2024-09-19T06:32:13.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.741+0000 7f0368c35640 1 -- 172.21.15.12:0/1483969416 shutdown_connections 2024-09-19T06:32:13.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.741+0000 7f0368c35640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f034c039730 0x7f034c03bbf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:13.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.741+0000 7f0368c35640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f036419de00 0x7f036419e280 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:13.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.741+0000 7f0368c35640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03641a3c40 0x7f036419d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:13.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.741+0000 7f0368c35640 1 --2- 172.21.15.12:0/1483969416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0364106680 0x7f03641a3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:13.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.742+0000 7f0368c35640 1 -- 172.21.15.12:0/1483969416 >> 172.21.15.12:0/1483969416 conn(0x7f03640fc290 msgr2=0x7f0364102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:13.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.742+0000 7f0368c35640 1 -- 172.21.15.12:0/1483969416 shutdown_connections 2024-09-19T06:32:13.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:13.742+0000 7f0368c35640 1 -- 172.21.15.12:0/1483969416 wait complete. 2024-09-19T06:32:14.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: mon.b calling monitor election 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: Reconfiguring mon.a (monmap changed)... 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: Reconfiguring daemon mon.a on smithi012 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: mon.b calling monitor election 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: mon.c calling monitor election 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: mon.a calling monitor election 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: monmap epoch 3 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: last_changed 2024-09-19T06:32:06.011298+0000 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: created 2024-09-19T06:30:29.711565+0000 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: min_mon_release 19 (squid) 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: election_strategy: 1 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-19T06:32:14.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-19T06:32:14.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: 2: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.b 2024-09-19T06:32:14.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: fsmap 2024-09-19T06:32:14.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:32:14.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: mgrmap e13: x(active, since 51s) 2024-09-19T06:32:14.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: overall HEALTH_OK 2024-09-19T06:32:14.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:13 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1483969416' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:14.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: mon.b calling monitor election 2024-09-19T06:32:14.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: Reconfiguring mon.a (monmap changed)... 2024-09-19T06:32:14.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: Reconfiguring daemon mon.a on smithi012 2024-09-19T06:32:14.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: mon.b calling monitor election 2024-09-19T06:32:14.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: mon.c calling monitor election 2024-09-19T06:32:14.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: mon.a calling monitor election 2024-09-19T06:32:14.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:32:14.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: monmap epoch 3 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: last_changed 2024-09-19T06:32:06.011298+0000 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: created 2024-09-19T06:30:29.711565+0000 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: min_mon_release 19 (squid) 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: election_strategy: 1 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: 2: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.b 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: fsmap 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: mgrmap e13: x(active, since 51s) 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: overall HEALTH_OK 2024-09-19T06:32:14.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:13 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1483969416' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: mon.b calling monitor election 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: Reconfiguring mon.a (monmap changed)... 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: Reconfiguring daemon mon.a on smithi012 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: mon.b calling monitor election 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: mon.c calling monitor election 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: mon.a calling monitor election 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: monmap epoch 3 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: last_changed 2024-09-19T06:32:06.011298+0000 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: created 2024-09-19T06:30:29.711565+0000 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: min_mon_release 19 (squid) 2024-09-19T06:32:14.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: election_strategy: 1 2024-09-19T06:32:14.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-19T06:32:14.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-19T06:32:14.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: 2: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.b 2024-09-19T06:32:14.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: fsmap 2024-09-19T06:32:14.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:32:14.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: mgrmap e13: x(active, since 51s) 2024-09-19T06:32:14.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: overall HEALTH_OK 2024-09-19T06:32:14.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:13 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1483969416' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:14.779 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T06:32:14.779 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:32:14.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:32:14.809 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:32:14.810 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:32:14.878 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:32:14.878 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:32:14.907 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:32:14.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:32:14.973 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:32:14.973 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:32:15.006 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:32:15.006 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:32:15.014 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:14 smithi012 ceph-mon[30937]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:15.014 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:15.076 INFO:tasks.cephadm:Adding mgr.x on smithi012 2024-09-19T06:32:15.076 INFO:tasks.cephadm:Adding mgr.y on smithi016 2024-09-19T06:32:15.076 INFO:tasks.cephadm:Adding mgr.z on smithi173 2024-09-19T06:32:15.077 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi012=x;smithi016=y;smithi173=z' 2024-09-19T06:32:15.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:14 smithi173 ceph-mon[35349]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:15.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:15.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:14 smithi016 ceph-mon[34911]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:15.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:32:15.359 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:32:15.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:32:15 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:32:15.012+0000 7f94fa532640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T06:32:15.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.760+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1067185989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e01005f0 msgr2=0x7f28e01009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:15.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.760+0000 7f28e5fb0640 1 --2- 172.21.15.173:0/1067185989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e01005f0 0x7f28e01009f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009880 tx=0x7f28d002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:32:15.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.760+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1067185989 shutdown_connections 2024-09-19T06:32:15.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.760+0000 7f28e5fb0640 1 --2- 172.21.15.173:0/1067185989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e01005f0 0x7f28e01009f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:15.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.760+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1067185989 >> 172.21.15.173:0/1067185989 conn(0x7f28e00fbda0 msgr2=0x7f28e00fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:15.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.760+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1067185989 shutdown_connections 2024-09-19T06:32:15.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.760+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1067185989 wait complete. 2024-09-19T06:32:15.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.760+0000 7f28e5fb0640 1 Processor -- start 2024-09-19T06:32:15.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28e5fb0640 1 -- start start 2024-09-19T06:32:15.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28e5fb0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e01005f0 0x7f28e01991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28e5fb0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e0199710 0x7f28e019e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28e5fb0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28e0199b90 0x7f28e01a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28e5fb0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f28e01055c0 con 0x7f28e0199710 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28e5fb0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f28e0105440 con 0x7f28e01005f0 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28e5fb0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f28e0105740 con 0x7f28e0199b90 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28dffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28e0199b90 0x7f28e01a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28dffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28e0199b90 0x7f28e01a0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33258/0 (socket says 172.21.15.173:33258) 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28dffff640 1 -- 172.21.15.173:0/1131161784 learned_addr learned my addr 172.21.15.173:0/1131161784 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28deffd640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e0199710 0x7f28e019e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28df7fe640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e01005f0 0x7f28e01991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:15.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28dffff640 1 -- 172.21.15.173:0/1131161784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e01005f0 msgr2=0x7f28e01991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:15.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28dffff640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e01005f0 0x7f28e01991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:15.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28dffff640 1 -- 172.21.15.173:0/1131161784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e0199710 msgr2=0x7f28e019e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:15.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28dffff640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e0199710 0x7f28e019e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:15.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28dffff640 1 -- 172.21.15.173:0/1131161784 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e01a15d0 con 0x7f28e0199b90 2024-09-19T06:32:15.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.761+0000 7f28dffff640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28e0199b90 0x7f28e01a0d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f28d800ba50 tx=0x7f28d800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:15.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.762+0000 7f28dcff9640 1 -- 172.21.15.173:0/1131161784 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d8019070 con 0x7f28e0199b90 2024-09-19T06:32:15.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.762+0000 7f28dcff9640 1 -- 172.21.15.173:0/1131161784 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28d800cbe0 con 0x7f28e0199b90 2024-09-19T06:32:15.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.762+0000 7f28dcff9640 1 -- 172.21.15.173:0/1131161784 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d80076a0 con 0x7f28e0199b90 2024-09-19T06:32:15.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.762+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1131161784 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e01a18c0 con 0x7f28e0199b90 2024-09-19T06:32:15.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.762+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1131161784 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e01a1e80 con 0x7f28e0199b90 2024-09-19T06:32:15.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.763+0000 7f28dcff9640 1 -- 172.21.15.173:0/1131161784 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f28d801c070 con 0x7f28e0199b90 2024-09-19T06:32:15.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.763+0000 7f28dcff9640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f28cc039720 0x7f28cc03bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:15.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.763+0000 7f28dcff9640 1 -- 172.21.15.173:0/1131161784 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f28d804bd50 con 0x7f28e0199b90 2024-09-19T06:32:15.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.763+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1131161784 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e018e380 con 0x7f28e0199b90 2024-09-19T06:32:15.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.763+0000 7f28df7fe640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f28cc039720 0x7f28cc03bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:15.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.764+0000 7f28df7fe640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f28cc039720 0x7f28cc03bbe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f28d0000c00 tx=0x7f28d0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:15.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.768+0000 7f28dcff9640 1 -- 172.21.15.173:0/1131161784 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f28d800e0a0 con 0x7f28e0199b90 2024-09-19T06:32:15.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.944+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1131161784 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi016=y;smithi173=z", "target": ["mon-mgr", ""]}) -- 0x7f28e00626c0 con 0x7f28cc039720 2024-09-19T06:32:15.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.950+0000 7f28dcff9640 1 -- 172.21.15.173:0/1131161784 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f28e00626c0 con 0x7f28cc039720 2024-09-19T06:32:15.952 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mgr update... 2024-09-19T06:32:15.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.952+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1131161784 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f28cc039720 msgr2=0x7f28cc03bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:15.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.952+0000 7f28e5fb0640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f28cc039720 0x7f28cc03bbe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f28d0000c00 tx=0x7f28d0031400 comp rx=0 tx=0).stop 2024-09-19T06:32:15.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.952+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1131161784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28e0199b90 msgr2=0x7f28e01a0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:15.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.952+0000 7f28e5fb0640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28e0199b90 0x7f28e01a0d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f28d800ba50 tx=0x7f28d800bf10 comp rx=0 tx=0).stop 2024-09-19T06:32:15.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.953+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1131161784 shutdown_connections 2024-09-19T06:32:15.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.953+0000 7f28e5fb0640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f28cc039720 0x7f28cc03bbe0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:15.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.953+0000 7f28e5fb0640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f28e0199b90 0x7f28e01a0d10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:15.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.953+0000 7f28e5fb0640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e0199710 0x7f28e019e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:15.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.953+0000 7f28e5fb0640 1 --2- 172.21.15.173:0/1131161784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28e01005f0 0x7f28e01991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:15.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.953+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1131161784 >> 172.21.15.173:0/1131161784 conn(0x7f28e00fbda0 msgr2=0x7f28e00fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:15.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.953+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1131161784 shutdown_connections 2024-09-19T06:32:15.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:32:15.953+0000 7f28e5fb0640 1 -- 172.21.15.173:0/1131161784 wait complete. 2024-09-19T06:32:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:16 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:16 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:16 smithi016 ceph-mon[34911]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:32:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:16 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:32:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:16 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:32:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:16 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:16 smithi016 ceph-mon[34911]: Reconfiguring daemon mon.b on smithi016 2024-09-19T06:32:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:16 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:16.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:16 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:16.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:16 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:16.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:16 smithi173 ceph-mon[35349]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:32:16.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:16 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:32:16.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:16 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:32:16.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:16 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:16.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:16 smithi173 ceph-mon[35349]: Reconfiguring daemon mon.b on smithi016 2024-09-19T06:32:16.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:16 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:16.606 DEBUG:teuthology.orchestra.run.smithi016:mgr.y> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T06:32:16.609 DEBUG:teuthology.orchestra.run.smithi173:mgr.z> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T06:32:16.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:16 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:16.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:16 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:16.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:16 smithi012 ceph-mon[30937]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:32:16.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:16 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:32:16.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:16 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:32:16.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:16 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:16.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:16 smithi012 ceph-mon[30937]: Reconfiguring daemon mon.b on smithi016 2024-09-19T06:32:16.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:16 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:16.649 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T06:32:16.649 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:32:16.649 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:32:16.669 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:32:16.669 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-09-19T06:32:16.728 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:32:16.728 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:16.728 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T06:32:16.728 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:16.728 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:16.729 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-19 06:31:33.251214109 +0000 2024-09-19T06:32:16.729 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-19 06:26:51.096262273 +0000 2024-09-19T06:32:16.729 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-19 06:26:51.096262273 +0000 2024-09-19T06:32:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-19 06:26:51.096262273 +0000 2024-09-19T06:32:16.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:32:16.797 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-19T06:32:16.797 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-19T06:32:16.798 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000233399 s, 2.2 MB/s 2024-09-19T06:32:16.799 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:32:16.860 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-09-19T06:32:16.919 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:32:16.919 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:16.919 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T06:32:16.919 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:16.919 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:16.919 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-19 06:31:33.279213847 +0000 2024-09-19T06:32:16.919 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-19 06:26:51.443259068 +0000 2024-09-19T06:32:16.920 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-19 06:26:51.443259068 +0000 2024-09-19T06:32:16.920 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-19 06:26:51.443259068 +0000 2024-09-19T06:32:16.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:32:16.987 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-19T06:32:16.987 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-19T06:32:16.987 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00028443 s, 1.8 MB/s 2024-09-19T06:32:16.988 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:32:17.049 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-09-19T06:32:17.107 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:32:17.107 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T06:32:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-19 06:31:33.306213594 +0000 2024-09-19T06:32:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-19 06:26:51.790255863 +0000 2024-09-19T06:32:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-19 06:26:51.790255863 +0000 2024-09-19T06:32:17.107 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-19 06:26:51.790255863 +0000 2024-09-19T06:32:17.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:32:17.174 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-19T06:32:17.174 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-19T06:32:17.174 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000224108 s, 2.3 MB/s 2024-09-19T06:32:17.175 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:32:17.233 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-09-19T06:32:17.290 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:32:17.290 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T06:32:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-19 06:31:33.333213342 +0000 2024-09-19T06:32:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-19 06:26:52.119252825 +0000 2024-09-19T06:32:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-19 06:26:52.119252825 +0000 2024-09-19T06:32:17.290 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-19 06:26:52.119252825 +0000 2024-09-19T06:32:17.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:32:17.355 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-19T06:32:17.355 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-19T06:32:17.356 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000226565 s, 2.3 MB/s 2024-09-19T06:32:17.357 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:32:17.415 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-09-19T06:32:17.415 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:32:17.434 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:32:17.434 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-09-19T06:32:17.492 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:32:17.492 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:17.492 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T06:32:17.492 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:17.492 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:17.492 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-19 06:32:05.471663924 +0000 2024-09-19T06:32:17.493 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-19 06:27:09.364572786 +0000 2024-09-19T06:32:17.493 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-19 06:27:09.364572786 +0000 2024-09-19T06:32:17.493 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-19 06:27:09.364572786 +0000 2024-09-19T06:32:17.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:32:17.560 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-19T06:32:17.560 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-19T06:32:17.560 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000105819 s, 4.8 MB/s 2024-09-19T06:32:17.561 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:32:17.621 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-09-19T06:32:17.678 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:32:17.678 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:17.678 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T06:32:17.678 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:17.678 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:17.678 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-19 06:32:05.471663924 +0000 2024-09-19T06:32:17.678 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-19 06:27:09.687567841 +0000 2024-09-19T06:32:17.678 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-19 06:27:09.687567841 +0000 2024-09-19T06:32:17.678 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-19 06:27:09.687567841 +0000 2024-09-19T06:32:17.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:32:17.744 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-19T06:32:17.744 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-19T06:32:17.744 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000120436 s, 4.3 MB/s 2024-09-19T06:32:17.745 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:32:17.784 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:17 smithi173 ceph-mon[35349]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:17.784 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:17 smithi173 ceph-mon[35349]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi016=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:17.785 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:17 smithi173 ceph-mon[35349]: Saving service mgr spec with placement smithi012=x;smithi016=y;smithi173=z;count:3 2024-09-19T06:32:17.785 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:17.785 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:17.785 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:17 smithi173 ceph-mon[35349]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:32:17.785 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:32:17.785 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:32:17.785 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:17.785 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:17 smithi173 ceph-mon[35349]: Reconfiguring daemon mon.c on smithi173 2024-09-19T06:32:17.804 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-09-19T06:32:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:32:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:17.863 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T06:32:17.863 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:17.863 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:17.863 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-19 06:32:05.472663909 +0000 2024-09-19T06:32:17.863 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-19 06:27:10.020562744 +0000 2024-09-19T06:32:17.863 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-19 06:27:10.020562744 +0000 2024-09-19T06:32:17.863 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-19 06:27:10.020562744 +0000 2024-09-19T06:32:17.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:32:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:17 smithi012 ceph-mon[30937]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:17 smithi012 ceph-mon[30937]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi016=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:17 smithi012 ceph-mon[30937]: Saving service mgr spec with placement smithi012=x;smithi016=y;smithi173=z;count:3 2024-09-19T06:32:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:17 smithi012 ceph-mon[30937]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:32:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:32:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:32:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:17 smithi012 ceph-mon[30937]: Reconfiguring daemon mon.c on smithi173 2024-09-19T06:32:17.926 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:17 smithi016 ceph-mon[34911]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:17.926 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:17 smithi016 ceph-mon[34911]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi016=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:17.926 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:17 smithi016 ceph-mon[34911]: Saving service mgr spec with placement smithi012=x;smithi016=y;smithi173=z;count:3 2024-09-19T06:32:17.926 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:17.926 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:17.926 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:17 smithi016 ceph-mon[34911]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:32:17.926 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:32:17.926 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:32:17.926 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:17.926 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:17 smithi016 ceph-mon[34911]: Reconfiguring daemon mon.c on smithi173 2024-09-19T06:32:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-19T06:32:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-19T06:32:17.928 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000112087 s, 4.6 MB/s 2024-09-19T06:32:17.930 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:32:17.987 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-09-19T06:32:18.044 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:32:18.045 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:18.045 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T06:32:18.045 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:18.045 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:18.046 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-09-19 06:32:05.472663909 +0000 2024-09-19T06:32:18.046 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-09-19 06:27:10.333557952 +0000 2024-09-19T06:32:18.046 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-09-19 06:27:10.333557952 +0000 2024-09-19T06:32:18.046 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-09-19 06:27:10.333557952 +0000 2024-09-19T06:32:18.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:32:18.109 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-09-19T06:32:18.109 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-09-19T06:32:18.109 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.00011202 s, 4.6 MB/s 2024-09-19T06:32:18.111 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:32:18.167 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-19T06:32:18.168 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:32:18.184 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:32:18.185 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-09-19T06:32:18.241 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:32:18.241 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T06:32:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-19 06:31:56.182148686 +0000 2024-09-19T06:32:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-19 06:27:00.053545758 +0000 2024-09-19T06:32:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-19 06:27:00.053545758 +0000 2024-09-19T06:32:18.242 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-19 06:27:00.053545758 +0000 2024-09-19T06:32:18.242 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:32:18.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-19T06:32:18.305 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-19T06:32:18.305 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000274532 s, 1.9 MB/s 2024-09-19T06:32:18.307 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:32:18.363 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-09-19T06:32:18.419 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:32:18.419 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T06:32:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-19 06:31:56.182148686 +0000 2024-09-19T06:32:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-19 06:27:00.386538326 +0000 2024-09-19T06:32:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-19 06:27:00.386538326 +0000 2024-09-19T06:32:18.420 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-19 06:27:00.386538326 +0000 2024-09-19T06:32:18.420 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:32:18.483 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-19T06:32:18.483 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-19T06:32:18.484 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000288183 s, 1.8 MB/s 2024-09-19T06:32:18.485 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:32:18.541 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-09-19T06:32:18.596 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:32:18.596 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T06:32:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-19 06:31:56.182148686 +0000 2024-09-19T06:32:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-19 06:27:00.734530561 +0000 2024-09-19T06:32:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-19 06:27:00.734530561 +0000 2024-09-19T06:32:18.597 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-19 06:27:00.734530561 +0000 2024-09-19T06:32:18.597 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:32:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-19T06:32:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-19T06:32:18.659 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00021325 s, 2.4 MB/s 2024-09-19T06:32:18.660 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:32:18.717 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-09-19T06:32:18.772 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:32:18.772 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:32:18.773 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T06:32:18.773 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:32:18.773 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:32:18.773 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-19 06:31:56.182148686 +0000 2024-09-19T06:32:18.773 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-19 06:27:01.059523309 +0000 2024-09-19T06:32:18.773 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-19 06:27:01.059523309 +0000 2024-09-19T06:32:18.773 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-19 06:27:01.059523309 +0000 2024-09-19T06:32:18.773 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:32:18.836 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-19T06:32:18.836 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-19T06:32:18.836 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00019404 s, 2.6 MB/s 2024-09-19T06:32:18.838 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:32:18.895 INFO:tasks.cephadm:Deploying osd.0 on smithi012 with /dev/vg_nvme/lv_4... 2024-09-19T06:32:18.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:32:18.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:18.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:18.948 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:18.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:18.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:18.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:18.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:18.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:32:18.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:32:18.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:32:18.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:18.949 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:18 smithi173 ceph-mon[35349]: Deploying daemon mgr.z on smithi173 2024-09-19T06:32:19.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:19.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:19.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:19.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:19.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:19.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:19.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:19.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:32:19.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:32:19.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:32:19.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:19.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:18 smithi012 ceph-mon[30937]: Deploying daemon mgr.z on smithi173 2024-09-19T06:32:19.156 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:32:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:19.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:19.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:19.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:19.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:32:19.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:32:19.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:32:19.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:19.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:18 smithi016 ceph-mon[34911]: Deploying daemon mgr.z on smithi173 2024-09-19T06:32:19.833 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:19 smithi173 systemd[1]: Starting Ceph mgr.z for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:32:20.107 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:19 smithi173 podman[37146]: 2024-09-19 06:32:19.756553804 +0000 UTC m=+0.015659858 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:32:20.107 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:19 smithi173 podman[37146]: 2024-09-19 06:32:19.858929891 +0000 UTC m=+0.118035998 container create b767e544145e2465e00d1f31aa51039cab2aa23289ebd6e7befe9adc93971e9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T06:32:20.107 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 podman[37146]: 2024-09-19 06:32:20.103027828 +0000 UTC m=+0.362133892 container init b767e544145e2465e00d1f31aa51039cab2aa23289ebd6e7befe9adc93971e9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T06:32:20.107 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 podman[37146]: 2024-09-19 06:32:20.10594514 +0000 UTC m=+0.365051203 container start b767e544145e2465e00d1f31aa51039cab2aa23289ebd6e7befe9adc93971e9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:32:20.435 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 ceph-mgr[37166]: -- 172.21.15.173:0/2828443527 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56123f0e90e0 con 0x56123f0c6800 2024-09-19T06:32:20.435 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 bash[37146]: b767e544145e2465e00d1f31aa51039cab2aa23289ebd6e7befe9adc93971e9c 2024-09-19T06:32:20.435 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 systemd[1]: Started Ceph mgr.z for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:32:20.436 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:20.229+0000 7fa0df7cb040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:32:20.436 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:20.288+0000 7fa0df7cb040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:32:20.436 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:20.434+0000 7fa0df7cb040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:32:20.783 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:20.500+0000 7fa0df7cb040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:32:20.784 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:20.645+0000 7fa0df7cb040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:32:20.784 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:20.782+0000 7fa0df7cb040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:32:21.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:21 smithi016 ceph-mon[34911]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:21.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:21.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:21.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:21.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:32:21.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:32:21.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:32:21.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:21.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:21 smithi016 ceph-mon[34911]: Deploying daemon mgr.y on smithi016 2024-09-19T06:32:21.582 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:21.094+0000 7fa0df7cb040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:32:21.583 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:21.153+0000 7fa0df7cb040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:32:21.583 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:21.336+0000 7fa0df7cb040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:32:21.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-mon[35349]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:21.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:21.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:21.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:21.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:32:21.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:32:21.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:32:21.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:21.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:21 smithi173 ceph-mon[35349]: Deploying daemon mgr.y on smithi016 2024-09-19T06:32:21.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:21 smithi012 ceph-mon[30937]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:21.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:21.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:21.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:21.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:32:21.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:32:21.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:32:21.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:21.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:21 smithi012 ceph-mon[30937]: Deploying daemon mgr.y on smithi016 2024-09-19T06:32:21.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:32:21.645 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_4 2024-09-19T06:32:21.899 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:32:22.259 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 systemd[1]: Starting Ceph mgr.y for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:32:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.359+0000 7f173692b640 1 -- 172.21.15.12:0/3735095923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1730101d10 msgr2=0x7f1730102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.359+0000 7f173692b640 1 --2- 172.21.15.12:0/3735095923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1730101d10 0x7f1730102190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1724009900 tx=0x7f172402a410 comp rx=0 tx=0).stop 2024-09-19T06:32:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.359+0000 7f173692b640 1 -- 172.21.15.12:0/3735095923 shutdown_connections 2024-09-19T06:32:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.359+0000 7f173692b640 1 --2- 172.21.15.12:0/3735095923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17301026d0 0x7f1730108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.359+0000 7f173692b640 1 --2- 172.21.15.12:0/3735095923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1730101d10 0x7f1730102190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.359+0000 7f173692b640 1 --2- 172.21.15.12:0/3735095923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1730100b10 0x7f1730100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.359+0000 7f173692b640 1 -- 172.21.15.12:0/3735095923 >> 172.21.15.12:0/3735095923 conn(0x7f17300fc2a0 msgr2=0x7f17300fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.359+0000 7f173692b640 1 -- 172.21.15.12:0/3735095923 shutdown_connections 2024-09-19T06:32:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.359+0000 7f173692b640 1 -- 172.21.15.12:0/3735095923 wait complete. 2024-09-19T06:32:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f173692b640 1 Processor -- start 2024-09-19T06:32:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f173692b640 1 -- start start 2024-09-19T06:32:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f173692b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1730100b10 0x7f1730197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f173692b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1730101d10 0x7f1730198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f173692b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17301026d0 0x7f173019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f173692b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f173010d8c0 con 0x7f1730100b10 2024-09-19T06:32:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f173692b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f173010d740 con 0x7f17301026d0 2024-09-19T06:32:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f173692b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f173010da40 con 0x7f1730101d10 2024-09-19T06:32:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f172ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1730100b10 0x7f1730197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f172ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1730100b10 0x7f1730197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60878/0 (socket says 172.21.15.12:60878) 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f172ffff640 1 -- 172.21.15.12:0/2803215056 learned_addr learned my addr 172.21.15.12:0/2803215056 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f172f7fe640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1730101d10 0x7f1730198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f1734ec8640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17301026d0 0x7f173019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f172ffff640 1 -- 172.21.15.12:0/2803215056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1730101d10 msgr2=0x7f1730198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f172ffff640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1730101d10 0x7f1730198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f172ffff640 1 -- 172.21.15.12:0/2803215056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17301026d0 msgr2=0x7f173019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f172ffff640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17301026d0 0x7f173019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.360+0000 7f172ffff640 1 -- 172.21.15.12:0/2803215056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173019fb60 con 0x7f1730100b10 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.361+0000 7f172ffff640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1730100b10 0x7f1730197f30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f172000d950 tx=0x7f172000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.361+0000 7f172d7fa640 1 -- 172.21.15.12:0/2803215056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720017020 con 0x7f1730100b10 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.361+0000 7f172d7fa640 1 -- 172.21.15.12:0/2803215056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1720009c30 con 0x7f1730100b10 2024-09-19T06:32:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.361+0000 7f173692b640 1 -- 172.21.15.12:0/2803215056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173019fe50 con 0x7f1730100b10 2024-09-19T06:32:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.361+0000 7f172d7fa640 1 -- 172.21.15.12:0/2803215056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172000f740 con 0x7f1730100b10 2024-09-19T06:32:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.361+0000 7f173692b640 1 -- 172.21.15.12:0/2803215056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17301a02b0 con 0x7f1730100b10 2024-09-19T06:32:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.362+0000 7f172d7fa640 1 -- 172.21.15.12:0/2803215056 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f172001a020 con 0x7f1730100b10 2024-09-19T06:32:22.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.362+0000 7f173692b640 1 -- 172.21.15.12:0/2803215056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1730107f60 con 0x7f1730100b10 2024-09-19T06:32:22.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.362+0000 7f172d7fa640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1718039500 0x7f171803b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:22.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.362+0000 7f172d7fa640 1 -- 172.21.15.12:0/2803215056 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f172004c0f0 con 0x7f1730100b10 2024-09-19T06:32:22.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.362+0000 7f172f7fe640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1718039500 0x7f171803b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:22.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.363+0000 7f172f7fe640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1718039500 0x7f171803b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17240314e0 tx=0x7f1724000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:22.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.367+0000 7f172d7fa640 1 -- 172.21.15.12:0/2803215056 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1720021070 con 0x7f1730100b10 2024-09-19T06:32:22.548 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 podman[36261]: 2024-09-19 06:32:22.198675399 +0000 UTC m=+0.016088359 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:32:22.549 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 podman[36261]: 2024-09-19 06:32:22.324924809 +0000 UTC m=+0.142337752 container create 3a4caf458dc7844d16a70f7f6ef58f802f0157c5f530ea27224b25aab8c707a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:32:22.549 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 podman[36261]: 2024-09-19 06:32:22.54409433 +0000 UTC m=+0.361507274 container init 3a4caf458dc7844d16a70f7f6ef58f802f0157c5f530ea27224b25aab8c707a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T06:32:22.549 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 podman[36261]: 2024-09-19 06:32:22.547654998 +0000 UTC m=+0.365067943 container start 3a4caf458dc7844d16a70f7f6ef58f802f0157c5f530ea27224b25aab8c707a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T06:32:22.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:22.550+0000 7f173692b640 1 -- 172.21.15.12:0/2803215056 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1730062630 con 0x7f1718039500 2024-09-19T06:32:22.582 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:22 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:22.206+0000 7fa0df7cb040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:32:22.582 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:22 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:22.273+0000 7fa0df7cb040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:32:22.893 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 ceph-mgr[36280]: -- 172.21.15.16:0/672336223 <== mon.2 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55af160810e0 con 0x55af1605f000 2024-09-19T06:32:22.893 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 bash[36261]: 3a4caf458dc7844d16a70f7f6ef58f802f0157c5f530ea27224b25aab8c707a5 2024-09-19T06:32:22.893 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 systemd[1]: Started Ceph mgr.y for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:32:22.894 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:22.669+0000 7f930adf1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:32:22.894 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:22.735+0000 7f930adf1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:32:22.894 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:22.892+0000 7f930adf1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:32:23.244 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:22.962+0000 7f930adf1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:32:23.245 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:23.122+0000 7f930adf1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:32:23.292 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:22.999+0000 7fa0df7cb040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:32:23.292 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:23.131+0000 7fa0df7cb040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:32:23.292 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:23.290+0000 7fa0df7cb040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:32:23.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-mon[35349]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:23.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-mon[35349]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:23.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:32:23.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:32:23.292 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:23.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:23.508 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:23.278+0000 7f930adf1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:32:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-mon[34911]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-mon[34911]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:32:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:32:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:23.552 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:23.351+0000 7fa0df7cb040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:32:23.553 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:23.509+0000 7fa0df7cb040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:32:23.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:23 smithi012 ceph-mon[30937]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:23.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:23 smithi012 ceph-mon[30937]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:23.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:32:23.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:32:23.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:23.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:23.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:23.832 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:23.580+0000 7fa0df7cb040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:32:23.833 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:23.641+0000 7fa0df7cb040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:32:23.833 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:23.800+0000 7fa0df7cb040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:32:23.874 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:23.613+0000 7f930adf1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:32:23.875 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:23.677+0000 7f930adf1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:32:23.875 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:23.873+0000 7f930adf1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:32:24.149 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:23.874+0000 7fa0df7cb040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:32:24.149 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:23.944+0000 7fa0df7cb040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:32:24.149 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:24.029+0000 7fa0df7cb040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:32:24.149 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:24.089+0000 7fa0df7cb040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:32:24.149 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:24.147+0000 7fa0df7cb040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:32:25.180 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:25.180 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.180 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.180 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.180 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.180 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:25.180 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:25.180 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.181 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:32:25.181 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:32:25.181 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:32:25.181 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:25.181 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:24 smithi012 ceph-mon[30937]: Reconfiguring daemon mgr.x on smithi012 2024-09-19T06:32:25.258 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:24.795+0000 7f930adf1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:32:25.259 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:24.864+0000 7f930adf1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:32:25.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:25.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:25.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:25.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:32:25.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:32:25.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:32:25.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:25.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:24 smithi016 ceph-mon[34911]: Reconfiguring daemon mgr.x on smithi012 2024-09-19T06:32:25.333 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:32:24.930+0000 7fa0df7cb040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:32:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:25.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:25.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:32:25.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:32:25.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:32:25.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:25.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:24 smithi173 ceph-mon[35349]: Reconfiguring daemon mgr.x on smithi012 2024-09-19T06:32:25.884 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:25.614+0000 7f930adf1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:32:25.884 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:25.734+0000 7f930adf1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:32:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:26.021+0000 7f172d7fa640 1 -- 172.21.15.12:0/2803215056 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f172000f8e0 con 0x7f1730100b10 2024-09-19T06:32:26.173 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-mon[34911]: Standby manager daemon z started 2024-09-19T06:32:26.174 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:32:26.174 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:32:26.174 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:32:26.174 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:32:26.174 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1334653289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b91bda9f-2b6e-4186-b0fe-7e0b5a50121a"}]: dispatch 2024-09-19T06:32:26.174 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1334653289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b91bda9f-2b6e-4186-b0fe-7e0b5a50121a"}]': finished 2024-09-19T06:32:26.174 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-mon[34911]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:32:26.174 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:26.174 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3804425089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:32:26.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:25.882+0000 7f930adf1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:32:26.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:25.946+0000 7f930adf1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:32:26.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:26.102+0000 7f930adf1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:32:26.175 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:26.172+0000 7f930adf1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:32:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:25 smithi173 ceph-mon[35349]: Standby manager daemon z started 2024-09-19T06:32:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:25 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:32:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:25 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:32:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:25 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:32:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:25 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:32:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:25 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1334653289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b91bda9f-2b6e-4186-b0fe-7e0b5a50121a"}]: dispatch 2024-09-19T06:32:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:25 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1334653289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b91bda9f-2b6e-4186-b0fe-7e0b5a50121a"}]': finished 2024-09-19T06:32:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:25 smithi173 ceph-mon[35349]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:32:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:25 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:25 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3804425089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:32:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:25 smithi012 ceph-mon[30937]: Standby manager daemon z started 2024-09-19T06:32:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:25 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:32:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:25 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:32:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:25 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:32:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:25 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.173:0/4274754738' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:32:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:25 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1334653289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b91bda9f-2b6e-4186-b0fe-7e0b5a50121a"}]: dispatch 2024-09-19T06:32:26.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:25 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1334653289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b91bda9f-2b6e-4186-b0fe-7e0b5a50121a"}]': finished 2024-09-19T06:32:26.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:25 smithi012 ceph-mon[30937]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:32:26.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:25 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:26.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:25 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3804425089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:32:26.467 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:26.234+0000 7f930adf1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:32:26.467 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:26.398+0000 7f930adf1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:32:26.467 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:26.465+0000 7f930adf1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:32:26.744 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:26.534+0000 7f930adf1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:32:26.744 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:26.620+0000 7f930adf1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:32:26.745 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:26.682+0000 7f930adf1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:32:26.745 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:26.743+0000 7f930adf1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:32:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:27 smithi173 ceph-mon[35349]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:27 smithi173 ceph-mon[35349]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-19T06:32:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:27 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:32:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:27 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:27 smithi012 ceph-mon[30937]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:27 smithi012 ceph-mon[30937]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-19T06:32:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:27 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:32:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:27 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:27.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:27 smithi016 ceph-mon[34911]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:27.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:27 smithi016 ceph-mon[34911]: mgrmap e14: x(active, since 64s), standbys: z 2024-09-19T06:32:27.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:27 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:32:27.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:27 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:28.008 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:32:27 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:32:27.567+0000 7f930adf1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:32:28.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:28.031+0000 7f172d7fa640 1 -- 172.21.15.12:0/2803215056 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f1720010460 con 0x7f1730100b10 2024-09-19T06:32:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:28 smithi173 ceph-mon[35349]: Standby manager daemon y started 2024-09-19T06:32:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:28 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:32:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:28 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:32:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:28 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:32:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:28 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:32:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:28 smithi012 ceph-mon[30937]: Standby manager daemon y started 2024-09-19T06:32:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:28 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:32:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:28 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:32:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:28 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:32:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:28 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:32:28.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:28 smithi016 ceph-mon[34911]: Standby manager daemon y started 2024-09-19T06:32:28.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:28 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:32:28.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:28 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:32:28.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:28 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:32:28.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:28 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.16:0/3442113086' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:32:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:29 smithi173 ceph-mon[35349]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:29.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:29 smithi173 ceph-mon[35349]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T06:32:29.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:32:29.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:29 smithi012 ceph-mon[30937]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:29.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:29 smithi012 ceph-mon[30937]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T06:32:29.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:32:29.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:29 smithi016 ceph-mon[34911]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:29.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:29 smithi016 ceph-mon[34911]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T06:32:29.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:32:31.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:31 smithi173 ceph-mon[35349]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:31.342 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:31 smithi012 ceph-mon[30937]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:31.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:31 smithi016 ceph-mon[34911]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:33.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:33 smithi012 ceph-mon[30937]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:33.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:33.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:33.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:33.411 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:33 smithi173 ceph-mon[35349]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:33.411 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:33.411 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:33.411 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:33.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:33 smithi016 ceph-mon[34911]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:33.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:33.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:33.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:34.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:34.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:34.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:34.377 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:34.377 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:34.377 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:34.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:34.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:34.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:35.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:35 smithi173 ceph-mon[35349]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:32:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:35 smithi173 ceph-mon[35349]: Deploying daemon osd.0 on smithi012 2024-09-19T06:32:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:35 smithi012 ceph-mon[30937]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:32:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:35 smithi012 ceph-mon[30937]: Deploying daemon osd.0 on smithi012 2024-09-19T06:32:35.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:35 smithi016 ceph-mon[34911]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:32:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:35 smithi016 ceph-mon[34911]: Deploying daemon osd.0 on smithi012 2024-09-19T06:32:37.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:37 smithi012 ceph-mon[30937]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:37.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:37 smithi173 ceph-mon[35349]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:37.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:37 smithi016 ceph-mon[34911]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:39.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:39 smithi173 ceph-mon[35349]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:39.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:39 smithi012 ceph-mon[30937]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:39.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:39 smithi016 ceph-mon[34911]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:41.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:41 smithi012 ceph-mon[30937]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:41.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:41 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:41.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:41 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:41.465 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:41 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:41.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:41 smithi173 ceph-mon[35349]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:41.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:41 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:41.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:41 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:41.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:41 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:41.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:41 smithi016 ceph-mon[34911]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:41.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:41 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:41.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:41 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:41.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:41 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:43.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:43 smithi012 ceph-mon[30937]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:43.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:43.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:43.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:43.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:43.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:43.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:43 smithi173 ceph-mon[35349]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:43.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:43.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:43.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:43.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:43.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:43.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:43 smithi016 ceph-mon[34911]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:43.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:43.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:43.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:43.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:43.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:45.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.192+0000 7f172d7fa640 1 -- 172.21.15.12:0/2803215056 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1730062630 con 0x7f1718039500 2024-09-19T06:32:45.195 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 0 on host 'smithi012' 2024-09-19T06:32:45.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 -- 172.21.15.12:0/2803215056 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1718039500 msgr2=0x7f171803b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:45.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1718039500 0x7f171803b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17240314e0 tx=0x7f1724000bc0 comp rx=0 tx=0).stop 2024-09-19T06:32:45.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 -- 172.21.15.12:0/2803215056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1730100b10 msgr2=0x7f1730197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1730100b10 0x7f1730197f30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f172000d950 tx=0x7f172000de10 comp rx=0 tx=0).stop 2024-09-19T06:32:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 -- 172.21.15.12:0/2803215056 shutdown_connections 2024-09-19T06:32:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1718039500 0x7f171803b9c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17301026d0 0x7f173019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1730101d10 0x7f1730198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 --2- 172.21.15.12:0/2803215056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1730100b10 0x7f1730197f30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 -- 172.21.15.12:0/2803215056 >> 172.21.15.12:0/2803215056 conn(0x7f17300fc2a0 msgr2=0x7f1730105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 -- 172.21.15.12:0/2803215056 shutdown_connections 2024-09-19T06:32:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:32:45.196+0000 7f173692b640 1 -- 172.21.15.12:0/2803215056 wait complete. 2024-09-19T06:32:45.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:45 smithi012 ceph-mon[30937]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:45.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:45.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:45.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:45.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:45 smithi173 ceph-mon[35349]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:45.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:45.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:45 smithi016 ceph-mon[34911]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:45.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:45.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:45.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:45.804 DEBUG:teuthology.orchestra.run.smithi012:osd.0> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T06:32:45.806 INFO:tasks.cephadm:Deploying osd.1 on smithi016 with /dev/vg_nvme/lv_4... 2024-09-19T06:32:45.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:32:46.067 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:32:47.330 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:32:47 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0[44703]: 2024-09-19T06:32:47.220+0000 7fc64dada640 -1 osd.0 0 log_to_monitors true 2024-09-19T06:32:47.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:47 smithi173 ceph-mon[35349]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:47.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:47 smithi173 ceph-mon[35349]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:32:47.591 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:47 smithi016 ceph-mon[34911]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:47.591 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:47 smithi016 ceph-mon[34911]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:32:47.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:47 smithi012 ceph-mon[30937]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:47.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:47 smithi012 ceph-mon[30937]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:32:48.372 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:32:48.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_4 2024-09-19T06:32:48.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:48 smithi016 ceph-mon[34911]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:32:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:48 smithi016 ceph-mon[34911]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:32:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:48 smithi016 ceph-mon[34911]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:32:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:48 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:48 smithi016 ceph-mon[34911]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:32:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:48 smithi016 ceph-mon[34911]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:32:48.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:48 smithi012 ceph-mon[30937]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:32:48.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:48 smithi012 ceph-mon[30937]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:32:48.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:48 smithi012 ceph-mon[30937]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:32:48.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:48 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:48.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:48 smithi012 ceph-mon[30937]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:32:48.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:48 smithi012 ceph-mon[30937]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:32:48.661 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:32:48.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:48 smithi173 ceph-mon[35349]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:32:48.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:48 smithi173 ceph-mon[35349]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:32:48.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:48 smithi173 ceph-mon[35349]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:32:48.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:48 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:48.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:48 smithi173 ceph-mon[35349]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:32:48.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:48 smithi173 ceph-mon[35349]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:32:49.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.139+0000 7fbb673ad640 1 -- 172.21.15.16:0/3762620200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb60100b00 msgr2=0x7fbb60100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:49.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.139+0000 7fbb673ad640 1 --2- 172.21.15.16:0/3762620200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb60100b00 0x7fbb60100f00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009900 tx=0x7fbb5c02a410 comp rx=0 tx=0).stop 2024-09-19T06:32:49.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.139+0000 7fbb673ad640 1 -- 172.21.15.16:0/3762620200 shutdown_connections 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.139+0000 7fbb673ad640 1 --2- 172.21.15.16:0/3762620200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb601026c0 0x7fbb60108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.139+0000 7fbb673ad640 1 --2- 172.21.15.16:0/3762620200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60101d00 0x7fbb60102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.139+0000 7fbb673ad640 1 --2- 172.21.15.16:0/3762620200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb60100b00 0x7fbb60100f00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.139+0000 7fbb673ad640 1 -- 172.21.15.16:0/3762620200 >> 172.21.15.16:0/3762620200 conn(0x7fbb600fc290 msgr2=0x7fbb600fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.140+0000 7fbb673ad640 1 -- 172.21.15.16:0/3762620200 shutdown_connections 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.140+0000 7fbb673ad640 1 -- 172.21.15.16:0/3762620200 wait complete. 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.140+0000 7fbb673ad640 1 Processor -- start 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.140+0000 7fbb673ad640 1 -- start start 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.140+0000 7fbb673ad640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb60100b00 0x7fbb6006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.140+0000 7fbb673ad640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60101d00 0x7fbb6019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.140+0000 7fbb673ad640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb601026c0 0x7fbb6019f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:49.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb673ad640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6010c760 con 0x7fbb601026c0 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb673ad640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6010c5e0 con 0x7fbb60100b00 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb673ad640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6010c8e0 con 0x7fbb60101d00 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb65149640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb60100b00 0x7fbb6006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb65149640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb60100b00 0x7fbb6006b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55592/0 (socket says 172.21.15.16:55592) 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb65149640 1 -- 172.21.15.16:0/444275319 learned_addr learned my addr 172.21.15.16:0/444275319 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb6594a640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb601026c0 0x7fbb6019f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb64948640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60101d00 0x7fbb6019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb65149640 1 -- 172.21.15.16:0/444275319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60101d00 msgr2=0x7fbb6019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb65149640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60101d00 0x7fbb6019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb65149640 1 -- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb601026c0 msgr2=0x7fbb6019f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb65149640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb601026c0 0x7fbb6019f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb65149640 1 -- 172.21.15.16:0/444275319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6019fbb0 con 0x7fbb60100b00 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb64948640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60101d00 0x7fbb6019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:32:49.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb6594a640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb601026c0 0x7fbb6019f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:32:49.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb65149640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb60100b00 0x7fbb6006b2f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c031610 tx=0x7fbb5c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:49.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.141+0000 7fbb567fc640 1 -- 172.21.15.16:0/444275319 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c03f030 con 0x7fbb60100b00 2024-09-19T06:32:49.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.142+0000 7fbb567fc640 1 -- 172.21.15.16:0/444275319 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb5c003ad0 con 0x7fbb60100b00 2024-09-19T06:32:49.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.142+0000 7fbb673ad640 1 -- 172.21.15.16:0/444275319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6019fde0 con 0x7fbb60100b00 2024-09-19T06:32:49.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.142+0000 7fbb567fc640 1 -- 172.21.15.16:0/444275319 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c035070 con 0x7fbb60100b00 2024-09-19T06:32:49.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.142+0000 7fbb673ad640 1 -- 172.21.15.16:0/444275319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb601a0260 con 0x7fbb60100b00 2024-09-19T06:32:49.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.143+0000 7fbb673ad640 1 -- 172.21.15.16:0/444275319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb60100f00 con 0x7fbb60100b00 2024-09-19T06:32:49.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.144+0000 7fbb567fc640 1 -- 172.21.15.16:0/444275319 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fbb5c042030 con 0x7fbb60100b00 2024-09-19T06:32:49.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.145+0000 7fbb567fc640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb4c0a31b0 0x7fbb4c0a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:49.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.145+0000 7fbb567fc640 1 -- 172.21.15.16:0/444275319 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fbb5c0ee870 con 0x7fbb60100b00 2024-09-19T06:32:49.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.145+0000 7fbb64948640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb4c0a31b0 0x7fbb4c0a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:49.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.145+0000 7fbb64948640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb4c0a31b0 0x7fbb4c0a5670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbb500058c0 tx=0x7fbb50005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.149+0000 7fbb567fc640 1 -- 172.21.15.16:0/444275319 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb5c0bd080 con 0x7fbb60100b00 2024-09-19T06:32:49.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:32:49.335+0000 7fbb673ad640 1 -- 172.21.15.16:0/444275319 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbb60062630 con 0x7fbb4c0a31b0 2024-09-19T06:32:49.629 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0[44703]: 2024-09-19T06:32:49.179+0000 7fc64923a640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T06:32:49.629 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0[44703]: 2024-09-19T06:32:49.184+0000 7fc64186c640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:32:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi012 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:49.704 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:49.704 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi012 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:49.705 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:32:49.706 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:32:49.706 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi012 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:32:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:32:49.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058]' entity='osd.0' 2024-09-19T06:32:49.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:49.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:32:49.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:32:49.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:50.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:50 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:32:50.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:50 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:32:50.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:50 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi012 to 17092M 2024-09-19T06:32:50.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:50 smithi016 ceph-mon[34911]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:50.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:50 smithi016 ceph-mon[34911]: osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] boot 2024-09-19T06:32:50.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:50 smithi016 ceph-mon[34911]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:32:50.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:50 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:32:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:50 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:32:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:50 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi012 to 17092M 2024-09-19T06:32:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:50 smithi012 ceph-mon[30937]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:50 smithi012 ceph-mon[30937]: osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] boot 2024-09-19T06:32:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:50 smithi012 ceph-mon[30937]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:32:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:50 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:32:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:50 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:32:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:50 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi012 to 17092M 2024-09-19T06:32:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:50 smithi173 ceph-mon[35349]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:50 smithi173 ceph-mon[35349]: osd.0 [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] boot 2024-09-19T06:32:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:50 smithi173 ceph-mon[35349]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:32:50.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:32:51.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:51 smithi016 ceph-mon[34911]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:51.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:51 smithi016 ceph-mon[34911]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:32:51.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:51 smithi012 ceph-mon[30937]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:51.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:51 smithi012 ceph-mon[30937]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:32:51.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:51 smithi173 ceph-mon[35349]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:51.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:51 smithi173 ceph-mon[35349]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:32:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:52 smithi012 ceph-mon[30937]: from='client.? 172.21.15.16:0/4189479864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "07e58c8d-382e-4acb-b271-116ef907125d"}]: dispatch 2024-09-19T06:32:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:52 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "07e58c8d-382e-4acb-b271-116ef907125d"}]: dispatch 2024-09-19T06:32:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:52 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "07e58c8d-382e-4acb-b271-116ef907125d"}]': finished 2024-09-19T06:32:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:52 smithi012 ceph-mon[30937]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:32:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:52 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:32:52.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:52 smithi012 ceph-mon[30937]: from='client.? 172.21.15.16:0/232297945' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:32:52.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:52 smithi016 ceph-mon[34911]: from='client.? 172.21.15.16:0/4189479864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "07e58c8d-382e-4acb-b271-116ef907125d"}]: dispatch 2024-09-19T06:32:52.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:52 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "07e58c8d-382e-4acb-b271-116ef907125d"}]: dispatch 2024-09-19T06:32:52.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:52 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "07e58c8d-382e-4acb-b271-116ef907125d"}]': finished 2024-09-19T06:32:52.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:52 smithi016 ceph-mon[34911]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:32:52.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:52 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:32:52.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:52 smithi016 ceph-mon[34911]: from='client.? 172.21.15.16:0/232297945' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:32:52.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:52 smithi173 ceph-mon[35349]: from='client.? 172.21.15.16:0/4189479864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "07e58c8d-382e-4acb-b271-116ef907125d"}]: dispatch 2024-09-19T06:32:52.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:52 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "07e58c8d-382e-4acb-b271-116ef907125d"}]: dispatch 2024-09-19T06:32:52.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:52 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "07e58c8d-382e-4acb-b271-116ef907125d"}]': finished 2024-09-19T06:32:52.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:52 smithi173 ceph-mon[35349]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:32:52.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:52 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:32:52.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:52 smithi173 ceph-mon[35349]: from='client.? 172.21.15.16:0/232297945' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:32:53.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:53 smithi173 ceph-mon[35349]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:53.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:53 smithi012 ceph-mon[30937]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:54.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:53 smithi016 ceph-mon[34911]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:55.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:55 smithi173 ceph-mon[35349]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:55.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:55 smithi012 ceph-mon[30937]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:56.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:55 smithi016 ceph-mon[34911]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:57.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:57 smithi173 ceph-mon[35349]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:57.864 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:57 smithi016 ceph-mon[34911]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:57.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:57 smithi012 ceph-mon[30937]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:59.574 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:32:59 smithi016 ceph-mon[34911]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:59.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:32:59 smithi173 ceph-mon[35349]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:32:59.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:32:59 smithi012 ceph-mon[30937]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:00.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:33:00.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:00.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:00 smithi173 ceph-mon[35349]: Deploying daemon osd.1 on smithi016 2024-09-19T06:33:00.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:33:00.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:00.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:00 smithi012 ceph-mon[30937]: Deploying daemon osd.1 on smithi016 2024-09-19T06:33:00.896 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:33:00.897 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:00.897 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:00 smithi016 ceph-mon[34911]: Deploying daemon osd.1 on smithi016 2024-09-19T06:33:01.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:01 smithi016 ceph-mon[34911]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:01.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:01 smithi173 ceph-mon[35349]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:01.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:01 smithi012 ceph-mon[30937]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:03.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:03 smithi173 ceph-mon[35349]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:03.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:03 smithi012 ceph-mon[30937]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:04.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:03 smithi016 ceph-mon[34911]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:05 smithi173 ceph-mon[35349]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:05.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:05 smithi012 ceph-mon[30937]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:06.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:05 smithi016 ceph-mon[34911]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:06.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:06.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:06.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:06.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:06.920 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:06.920 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:06.920 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:07.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:07 smithi016 ceph-mon[34911]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:07.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:07 smithi173 ceph-mon[35349]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:07.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:07 smithi012 ceph-mon[30937]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:09.357 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 1 on host 'smithi016' 2024-09-19T06:33:09.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.355+0000 7fbb567fc640 1 -- 172.21.15.16:0/444275319 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbb60062630 con 0x7fbb4c0a31b0 2024-09-19T06:33:09.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 -- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb4c0a31b0 msgr2=0x7fbb4c0a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb4c0a31b0 0x7fbb4c0a5670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbb500058c0 tx=0x7fbb50005850 comp rx=0 tx=0).stop 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 -- 172.21.15.16:0/444275319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb60100b00 msgr2=0x7fbb6006b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb60100b00 0x7fbb6006b2f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c031610 tx=0x7fbb5c004270 comp rx=0 tx=0).stop 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 -- 172.21.15.16:0/444275319 shutdown_connections 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb4c0a31b0 0x7fbb4c0a5670 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb601026c0 0x7fbb6019f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb60101d00 0x7fbb6019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 --2- 172.21.15.16:0/444275319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb60100b00 0x7fbb6006b2f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 -- 172.21.15.16:0/444275319 >> 172.21.15.16:0/444275319 conn(0x7fbb600fc290 msgr2=0x7fbb60105110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 -- 172.21.15.16:0/444275319 shutdown_connections 2024-09-19T06:33:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:33:09.358+0000 7fbb673ad640 1 -- 172.21.15.16:0/444275319 wait complete. 2024-09-19T06:33:09.694 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:09 smithi016 ceph-mon[34911]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:09.695 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.695 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.695 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:09.695 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:09.695 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.696 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:09.696 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.696 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:09 smithi173 ceph-mon[35349]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:09.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:09.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:09.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:09.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:09 smithi012 ceph-mon[30937]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:09.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:09.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:09.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:09.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:09.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:10.014 DEBUG:teuthology.orchestra.run.smithi016:osd.1> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T06:33:10.017 INFO:tasks.cephadm:Deploying osd.2 on smithi173 with /dev/vg_nvme/lv_4... 2024-09-19T06:33:10.017 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:33:10.269 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:33:11.622 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:11 smithi173 ceph-mon[35349]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:11.720 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:11 smithi016 ceph-mon[34911]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:11.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:11 smithi012 ceph-mon[30937]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:12.465 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:12 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1[39404]: 2024-09-19T06:33:12.125+0000 7f5f77629640 -1 osd.1 0 log_to_monitors true 2024-09-19T06:33:12.702 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:12 smithi173 ceph-mon[35349]: from='osd.1 [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:33:12.702 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:12 smithi173 ceph-mon[35349]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:33:12.705 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:33:12.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_4 2024-09-19T06:33:12.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:12 smithi016 ceph-mon[34911]: from='osd.1 [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:33:12.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:12 smithi016 ceph-mon[34911]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:33:12.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:12 smithi012 ceph-mon[30937]: from='osd.1 [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:33:12.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:12 smithi012 ceph-mon[30937]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:33:12.985 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:33:13.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.413+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/1383471459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5dc102de0 msgr2=0x7fa5dc105250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:13.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.413+0000 7fa5e3d2a640 1 --2- 172.21.15.173:0/1383471459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5dc102de0 0x7fa5dc105250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009900 tx=0x7fa5cc02a410 comp rx=0 tx=0).stop 2024-09-19T06:33:13.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.413+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/1383471459 shutdown_connections 2024-09-19T06:33:13.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.413+0000 7fa5e3d2a640 1 --2- 172.21.15.173:0/1383471459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5dc105790 0x7fa5dc105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:13.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.413+0000 7fa5e3d2a640 1 --2- 172.21.15.173:0/1383471459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5dc102de0 0x7fa5dc105250 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.413+0000 7fa5e3d2a640 1 --2- 172.21.15.173:0/1383471459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc100490 0x7fa5dc1028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.413+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/1383471459 >> 172.21.15.173:0/1383471459 conn(0x7fa5dc0fc2a0 msgr2=0x7fa5dc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.414+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/1383471459 shutdown_connections 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.414+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/1383471459 wait complete. 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.414+0000 7fa5e3d2a640 1 Processor -- start 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.414+0000 7fa5e3d2a640 1 -- start start 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.414+0000 7fa5e3d2a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc100490 0x7fa5dc19e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.414+0000 7fa5e3d2a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5dc102de0 0x7fa5dc19ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.414+0000 7fa5e3d2a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5dc105790 0x7fa5dc1a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.414+0000 7fa5e3d2a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc113ef0 con 0x7fa5dc100490 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.414+0000 7fa5e3d2a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc113d70 con 0x7fa5dc105790 2024-09-19T06:33:13.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.414+0000 7fa5e3d2a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc114070 con 0x7fa5dc102de0 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e12c5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5dc102de0 0x7fa5dc19ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e12c5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5dc102de0 0x7fa5dc19ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:35706/0 (socket says 172.21.15.173:35706) 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e12c5640 1 -- 172.21.15.173:0/2606334683 learned_addr learned my addr 172.21.15.173:0/2606334683 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e1ac6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc100490 0x7fa5dc19e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e22c7640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5dc105790 0x7fa5dc1a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e12c5640 1 -- 172.21.15.173:0/2606334683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5dc105790 msgr2=0x7fa5dc1a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e12c5640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5dc105790 0x7fa5dc1a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e12c5640 1 -- 172.21.15.173:0/2606334683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc100490 msgr2=0x7fa5dc19e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e12c5640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc100490 0x7fa5dc19e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e12c5640 1 -- 172.21.15.173:0/2606334683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc1a6130 con 0x7fa5dc102de0 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e12c5640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5dc102de0 0x7fa5dc19ea40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc031440 tx=0x7fa5cc032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5d2ffd640 1 -- 172.21.15.173:0/2606334683 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc03f030 con 0x7fa5dc102de0 2024-09-19T06:33:13.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5d2ffd640 1 -- 172.21.15.173:0/2606334683 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5cc003ce0 con 0x7fa5dc102de0 2024-09-19T06:33:13.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5d2ffd640 1 -- 172.21.15.173:0/2606334683 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc035070 con 0x7fa5dc102de0 2024-09-19T06:33:13.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/2606334683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5dc1a63c0 con 0x7fa5dc102de0 2024-09-19T06:33:13.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.415+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/2606334683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5dc1a68f0 con 0x7fa5dc102de0 2024-09-19T06:33:13.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.416+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/2606334683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5dc0fdd90 con 0x7fa5dc102de0 2024-09-19T06:33:13.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.417+0000 7fa5d2ffd640 1 -- 172.21.15.173:0/2606334683 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fa5cc042030 con 0x7fa5dc102de0 2024-09-19T06:33:13.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.418+0000 7fa5d2ffd640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa5c80a3260 0x7fa5c80a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:13.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.418+0000 7fa5d2ffd640 1 -- 172.21.15.173:0/2606334683 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7fa5cc0ee060 con 0x7fa5dc102de0 2024-09-19T06:33:13.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.418+0000 7fa5e1ac6640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa5c80a3260 0x7fa5c80a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:13.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.419+0000 7fa5e1ac6640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa5c80a3260 0x7fa5c80a5720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800bbe0 tx=0x7fa5d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:13.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.423+0000 7fa5d2ffd640 1 -- 172.21.15.173:0/2606334683 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa5cc0bc120 con 0x7fa5dc102de0 2024-09-19T06:33:13.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:13.601+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/2606334683 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa5dc062630 con 0x7fa5c80a3260 2024-09-19T06:33:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:33:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:33:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='osd.1 [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:33:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:33:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:33:13.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:13.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:13.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:13 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='osd.1 [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:13.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:13 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:13.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:33:13.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:33:13.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:13.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='osd.1 [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:33:13.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:33:13.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:33:13.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:13.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:13.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:13.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:13 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:14.471 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1[39404]: 2024-09-19T06:33:14.155+0000 7f5f72d89640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T06:33:14.471 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1[39404]: 2024-09-19T06:33:14.159+0000 7f5f6b3bb640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:33:14.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi016 2024-09-19T06:33:14.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi016 to 17092M 2024-09-19T06:33:14.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:33:14.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:33:14.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:14.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:14.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:33:14.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:33:14.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:33:14.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:14.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:14 smithi173 ceph-mon[35349]: from='osd.1 ' entity='osd.1' 2024-09-19T06:33:14.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi016 2024-09-19T06:33:14.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi016 to 17092M 2024-09-19T06:33:14.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:33:14.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:33:14.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:14.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:14.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:33:14.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:33:14.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:33:14.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:14.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:14 smithi016 ceph-mon[34911]: from='osd.1 ' entity='osd.1' 2024-09-19T06:33:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi016 2024-09-19T06:33:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi016 to 17092M 2024-09-19T06:33:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:33:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:33:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:33:14.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:33:14.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:33:14.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:14.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:14 smithi012 ceph-mon[30937]: from='osd.1 ' entity='osd.1' 2024-09-19T06:33:15.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:15 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:33:15.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:15 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:33:15.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:15 smithi016 ceph-mon[34911]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:15.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:15 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:15.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:15 smithi016 ceph-mon[34911]: osd.1 [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] boot 2024-09-19T06:33:15.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:15 smithi016 ceph-mon[34911]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:33:15.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:15 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:15.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:15 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:33:15.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:15 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:33:15.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:15 smithi173 ceph-mon[35349]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:15.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:15 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:15.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:15 smithi173 ceph-mon[35349]: osd.1 [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] boot 2024-09-19T06:33:15.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:15 smithi173 ceph-mon[35349]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:33:15.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:15 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:15.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:15 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:33:15.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:15 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:33:15.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:15 smithi012 ceph-mon[30937]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:33:15.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:15 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:15.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:15 smithi012 ceph-mon[30937]: osd.1 [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] boot 2024-09-19T06:33:15.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:15 smithi012 ceph-mon[30937]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:33:15.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:15 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:33:16.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:16 smithi016 ceph-mon[34911]: from='client.? 172.21.15.173:0/2416187483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7438fe31-c81a-4f07-a580-8cccad16f0ec"}]: dispatch 2024-09-19T06:33:16.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:16 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7438fe31-c81a-4f07-a580-8cccad16f0ec"}]: dispatch 2024-09-19T06:33:16.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:16 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7438fe31-c81a-4f07-a580-8cccad16f0ec"}]': finished 2024-09-19T06:33:16.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:16 smithi016 ceph-mon[34911]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:33:16.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:16 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:16.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:16 smithi016 ceph-mon[34911]: from='client.? 172.21.15.173:0/3514338149' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:33:16.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:16 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/2416187483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7438fe31-c81a-4f07-a580-8cccad16f0ec"}]: dispatch 2024-09-19T06:33:16.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:16 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7438fe31-c81a-4f07-a580-8cccad16f0ec"}]: dispatch 2024-09-19T06:33:16.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:16 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7438fe31-c81a-4f07-a580-8cccad16f0ec"}]': finished 2024-09-19T06:33:16.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:16 smithi173 ceph-mon[35349]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:33:16.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:16 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:16.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:16 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/3514338149' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:33:16.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:16 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/2416187483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7438fe31-c81a-4f07-a580-8cccad16f0ec"}]: dispatch 2024-09-19T06:33:16.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:16 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7438fe31-c81a-4f07-a580-8cccad16f0ec"}]: dispatch 2024-09-19T06:33:16.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:16 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7438fe31-c81a-4f07-a580-8cccad16f0ec"}]': finished 2024-09-19T06:33:16.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:16 smithi012 ceph-mon[30937]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T06:33:16.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:16 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:16.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:16 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/3514338149' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:33:17.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:17 smithi016 ceph-mon[34911]: pgmap v60: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:17.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:17 smithi016 ceph-mon[34911]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:33:17.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:17.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:17 smithi173 ceph-mon[35349]: pgmap v60: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:17 smithi173 ceph-mon[35349]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:33:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:17 smithi012 ceph-mon[30937]: pgmap v60: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:17 smithi012 ceph-mon[30937]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:33:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:19.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:19 smithi016 ceph-mon[34911]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:19 smithi173 ceph-mon[35349]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:19 smithi012 ceph-mon[30937]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:21.521 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:21 smithi173 ceph-mon[35349]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:21.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:21 smithi016 ceph-mon[34911]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:21 smithi012 ceph-mon[30937]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:23.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:23 smithi016 ceph-mon[34911]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:23.760 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:23 smithi173 ceph-mon[35349]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:23 smithi012 ceph-mon[30937]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:24.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:33:24.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:24.771 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:33:24.771 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:33:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:25.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:25 smithi016 ceph-mon[34911]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:25.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:25 smithi016 ceph-mon[34911]: Deploying daemon osd.2 on smithi173 2024-09-19T06:33:25.811 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:25 smithi173 ceph-mon[35349]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:25.811 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:25 smithi173 ceph-mon[35349]: Deploying daemon osd.2 on smithi173 2024-09-19T06:33:25.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:25 smithi012 ceph-mon[30937]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:25.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:25 smithi012 ceph-mon[30937]: Deploying daemon osd.2 on smithi173 2024-09-19T06:33:27.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:27 smithi016 ceph-mon[34911]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:27.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:27 smithi173 ceph-mon[35349]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:27.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:27 smithi012 ceph-mon[30937]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:29.579 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:29 smithi173 ceph-mon[35349]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:29.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:29 smithi016 ceph-mon[34911]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:29.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:29 smithi012 ceph-mon[30937]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:30.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:30 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:30.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:30 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:30.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:30 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:30.818 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:30 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:30.818 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:30 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:30.818 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:30 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:30 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:30 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:30 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:31.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:31 smithi016 ceph-mon[34911]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:31.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:31 smithi173 ceph-mon[35349]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:31 smithi012 ceph-mon[30937]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:33.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:33 smithi173 ceph-mon[35349]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:33.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:33.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:33.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:33.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:33.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:33.844 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:33 smithi016 ceph-mon[34911]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:33.844 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:33.844 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:33.844 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:33.844 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:33.845 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:33.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:33 smithi012 ceph-mon[30937]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:33.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:33.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:33.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:33.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:33.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:34.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.269+0000 7fa5d2ffd640 1 -- 172.21.15.173:0/2606334683 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa5dc062630 con 0x7fa5c80a3260 2024-09-19T06:33:34.280 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 2 on host 'smithi173' 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/2606334683 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa5c80a3260 msgr2=0x7fa5c80a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa5c80a3260 0x7fa5c80a5720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800bbe0 tx=0x7fa5d800b390 comp rx=0 tx=0).stop 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/2606334683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5dc102de0 msgr2=0x7fa5dc19ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5dc102de0 0x7fa5dc19ea40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc031440 tx=0x7fa5cc032ce0 comp rx=0 tx=0).stop 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/2606334683 shutdown_connections 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa5c80a3260 0x7fa5c80a5720 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5dc105790 0x7fa5dc1a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5dc102de0 0x7fa5dc19ea40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 --2- 172.21.15.173:0/2606334683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5dc100490 0x7fa5dc19e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/2606334683 >> 172.21.15.173:0/2606334683 conn(0x7fa5dc0fc2a0 msgr2=0x7fa5dc100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/2606334683 shutdown_connections 2024-09-19T06:33:34.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:33:34.271+0000 7fa5e3d2a640 1 -- 172.21.15.173:0/2606334683 wait complete. 2024-09-19T06:33:34.828 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:34.828 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:34.828 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:34.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:34.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:34.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:34.866 DEBUG:teuthology.orchestra.run.smithi173:osd.2> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T06:33:34.869 INFO:tasks.cephadm:Deploying osd.3 on smithi012 with /dev/vg_nvme/lv_3... 2024-09-19T06:33:34.869 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:33:34.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:34.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:34.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:35.119 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:33:35.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:35 smithi173 ceph-mon[35349]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:35.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:35 smithi012 ceph-mon[30937]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:36.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:35 smithi016 ceph-mon[34911]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:36.525 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:36 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2[40312]: 2024-09-19T06:33:36.197+0000 7fed3664e640 -1 osd.2 0 log_to_monitors true 2024-09-19T06:33:36.820 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:36 smithi173 ceph-mon[35349]: from='osd.2 [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:33:36.820 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:36 smithi173 ceph-mon[35349]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:33:36.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:36 smithi012 ceph-mon[30937]: from='osd.2 [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:33:36.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:36 smithi012 ceph-mon[30937]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:33:37.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:36 smithi016 ceph-mon[34911]: from='osd.2 [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:33:37.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:36 smithi016 ceph-mon[34911]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:33:37.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:37.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:33:37.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:33:37.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:37.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='osd.2 [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:33:37.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:33:37.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:37.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:37.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:33:37.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:37.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:37.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:37.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:37 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:37.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:33:37.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='osd.2 [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:37.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:37 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:37.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_3 2024-09-19T06:33:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:33:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:33:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='osd.2 [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:33:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:33:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:33:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:38.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:38.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:38.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:37 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:38.142 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:33:38.534 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:38 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2[40312]: 2024-09-19T06:33:38.278+0000 7fed31dae640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T06:33:38.535 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:38 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2[40312]: 2024-09-19T06:33:38.287+0000 7fed2a3e0640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:33:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.735+0000 7f1bcb373640 1 -- 172.21.15.12:0/2283557299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bc4102e00 msgr2=0x7f1bc4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.735+0000 7f1bcb373640 1 --2- 172.21.15.12:0/2283557299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bc4102e00 0x7f1bc4103280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009900 tx=0x7f1bb402a410 comp rx=0 tx=0).stop 2024-09-19T06:33:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.735+0000 7f1bcb373640 1 -- 172.21.15.12:0/2283557299 shutdown_connections 2024-09-19T06:33:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.735+0000 7f1bcb373640 1 --2- 172.21.15.12:0/2283557299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc41037c0 0x7f1bc410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.735+0000 7f1bcb373640 1 --2- 172.21.15.12:0/2283557299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bc4102e00 0x7f1bc4103280 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.735+0000 7f1bcb373640 1 --2- 172.21.15.12:0/2283557299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc4101c00 0x7f1bc4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.735+0000 7f1bcb373640 1 -- 172.21.15.12:0/2283557299 >> 172.21.15.12:0/2283557299 conn(0x7f1bc40fd3b0 msgr2=0x7f1bc40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bcb373640 1 -- 172.21.15.12:0/2283557299 shutdown_connections 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bcb373640 1 -- 172.21.15.12:0/2283557299 wait complete. 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bcb373640 1 Processor -- start 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bcb373640 1 -- start start 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bcb373640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bc4101c00 0x7f1bc4197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bcb373640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc4102e00 0x7f1bc4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bcb373640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc41037c0 0x7f1bc419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bcb373640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc410d860 con 0x7f1bc4101c00 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bcb373640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc410d6e0 con 0x7f1bc41037c0 2024-09-19T06:33:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bcb373640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc410d9e0 con 0x7f1bc4102e00 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.736+0000 7f1bc910f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bc4101c00 0x7f1bc4197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc910f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bc4101c00 0x7f1bc4197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36438/0 (socket says 172.21.15.12:36438) 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc910f640 1 -- 172.21.15.12:0/1228424368 learned_addr learned my addr 172.21.15.12:0/1228424368 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc890e640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc4102e00 0x7f1bc4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc9910640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc41037c0 0x7f1bc419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc910f640 1 -- 172.21.15.12:0/1228424368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc4102e00 msgr2=0x7f1bc4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc910f640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc4102e00 0x7f1bc4198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc910f640 1 -- 172.21.15.12:0/1228424368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc41037c0 msgr2=0x7f1bc419f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc910f640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc41037c0 0x7f1bc419f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc910f640 1 -- 172.21.15.12:0/1228424368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc419fb20 con 0x7f1bc4101c00 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc9910640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc41037c0 0x7f1bc419f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:33:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bc910f640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bc4101c00 0x7f1bc4197ef0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000d770 tx=0x7f1bc000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bba7fc640 1 -- 172.21.15.12:0/1228424368 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0017070 con 0x7f1bc4101c00 2024-09-19T06:33:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bba7fc640 1 -- 172.21.15.12:0/1228424368 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bc0009c30 con 0x7f1bc4101c00 2024-09-19T06:33:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bcb373640 1 -- 172.21.15.12:0/1228424368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc419fe10 con 0x7f1bc4101c00 2024-09-19T06:33:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bba7fc640 1 -- 172.21.15.12:0/1228424368 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0003dd0 con 0x7f1bc4101c00 2024-09-19T06:33:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.737+0000 7f1bcb373640 1 -- 172.21.15.12:0/1228424368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc41a0260 con 0x7f1bc4101c00 2024-09-19T06:33:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.738+0000 7f1bcb373640 1 -- 172.21.15.12:0/1228424368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc4109070 con 0x7f1bc4101c00 2024-09-19T06:33:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.740+0000 7f1bba7fc640 1 -- 172.21.15.12:0/1228424368 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f1bc0004000 con 0x7f1bc4101c00 2024-09-19T06:33:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.740+0000 7f1bba7fc640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1bb00a3260 0x7f1bb00a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.741+0000 7f1bc890e640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1bb00a3260 0x7f1bb00a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.741+0000 7f1bba7fc640 1 -- 172.21.15.12:0/1228424368 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f1bc00ce010 con 0x7f1bc4101c00 2024-09-19T06:33:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.741+0000 7f1bc890e640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1bb00a3260 0x7f1bb00a5720 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4000c00 tx=0x7f1bb40315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:38.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.745+0000 7f1bba7fc640 1 -- 172.21.15.12:0/1228424368 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1bc009c3e0 con 0x7f1bc4101c00 2024-09-19T06:33:38.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:38 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi173 2024-09-19T06:33:38.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:38 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-19T06:33:38.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:38 smithi173 ceph-mon[35349]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:33:38.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:38 smithi173 ceph-mon[35349]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T06:33:38.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:38 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:38.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:38 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:38.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:38 smithi173 ceph-mon[35349]: from='osd.2 ' entity='osd.2' 2024-09-19T06:33:38.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:38 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi173 2024-09-19T06:33:38.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:38 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-19T06:33:38.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:38 smithi012 ceph-mon[30937]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:33:38.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:38 smithi012 ceph-mon[30937]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T06:33:38.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:38 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:38.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:38 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:38.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:38 smithi012 ceph-mon[30937]: from='osd.2 ' entity='osd.2' 2024-09-19T06:33:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:38.930+0000 7f1bcb373640 1 -- 172.21.15.12:0/1228424368 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1bc4062630 con 0x7f1bb00a3260 2024-09-19T06:33:39.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:38 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi173 2024-09-19T06:33:39.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:38 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-19T06:33:39.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:38 smithi016 ceph-mon[34911]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:33:39.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:38 smithi016 ceph-mon[34911]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T06:33:39.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:38 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:39.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:38 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:39.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:38 smithi016 ceph-mon[34911]: from='osd.2 ' entity='osd.2' 2024-09-19T06:33:39.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:39 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:33:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:39 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:33:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:39 smithi012 ceph-mon[30937]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:33:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:33:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:39 smithi012 ceph-mon[30937]: osd.2 [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] boot 2024-09-19T06:33:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:39 smithi012 ceph-mon[30937]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:33:39.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:39 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:33:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:39 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:33:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:39 smithi173 ceph-mon[35349]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:33:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:33:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:39 smithi173 ceph-mon[35349]: osd.2 [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] boot 2024-09-19T06:33:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:39 smithi173 ceph-mon[35349]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:33:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:40.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:39 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:33:40.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:39 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:33:40.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:39 smithi016 ceph-mon[34911]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:33:40.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:40.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:33:40.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:33:40.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:40.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:39 smithi016 ceph-mon[34911]: osd.2 [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] boot 2024-09-19T06:33:40.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:39 smithi016 ceph-mon[34911]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:33:40.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:33:40.747 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:40 smithi012 ceph-mon[30937]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:33:40.748 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:40 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:33:40.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:40 smithi173 ceph-mon[35349]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:33:40.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:40 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:33:41.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:40 smithi016 ceph-mon[34911]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:33:41.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:40 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:33:41.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:41 smithi173 ceph-mon[35349]: pgmap v77: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:41.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:41 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:33:41.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:41 smithi173 ceph-mon[35349]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:33:41.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:41 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:33:41.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:41 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3916318587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba9ac3c0-f7da-4ee8-9102-3909f8b8504b"}]: dispatch 2024-09-19T06:33:41.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:41 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:33:41.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:41 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3916318587' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba9ac3c0-f7da-4ee8-9102-3909f8b8504b"}]': finished 2024-09-19T06:33:41.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:41 smithi173 ceph-mon[35349]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:33:41.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:41 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:33:41.873 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:41 smithi012 ceph-mon[30937]: pgmap v77: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:41.873 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:41 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:33:41.873 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:41 smithi012 ceph-mon[30937]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:33:41.873 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:41 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:33:41.873 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:41 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3916318587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba9ac3c0-f7da-4ee8-9102-3909f8b8504b"}]: dispatch 2024-09-19T06:33:41.873 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:41 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:33:41.873 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:41 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3916318587' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba9ac3c0-f7da-4ee8-9102-3909f8b8504b"}]': finished 2024-09-19T06:33:41.873 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:41 smithi012 ceph-mon[30937]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:33:41.873 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:41 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:33:42.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:41 smithi016 ceph-mon[34911]: pgmap v77: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:42.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:41 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:33:42.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:41 smithi016 ceph-mon[34911]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:33:42.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:41 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:33:42.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:41 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3916318587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba9ac3c0-f7da-4ee8-9102-3909f8b8504b"}]: dispatch 2024-09-19T06:33:42.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:41 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:33:42.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:41 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3916318587' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba9ac3c0-f7da-4ee8-9102-3909f8b8504b"}]': finished 2024-09-19T06:33:42.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:41 smithi016 ceph-mon[34911]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T06:33:42.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:41 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:33:42.129 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:33:41 smithi012 sudo[49624]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:33:42.129 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:33:41 smithi012 sudo[49624]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:42.129 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:33:41 smithi012 sudo[49624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:42.129 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:33:41 smithi012 sudo[49624]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:42.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:33:42.581+0000 7f1bba7fc640 1 -- 172.21.15.12:0/1228424368 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1bc0098350 con 0x7f1bc4101c00 2024-09-19T06:33:42.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:42 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2989875609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:33:42.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:42 smithi012 ceph-mon[30937]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:33:42.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:33:42.629 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:33:42 smithi012 sudo[49653]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:33:42.630 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:33:42 smithi012 sudo[49653]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:42.630 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:33:42 smithi012 sudo[49653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:42.630 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:33:42 smithi012 sudo[49653]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:42.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:42 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2989875609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:33:42.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:42 smithi173 ceph-mon[35349]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:33:42.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:33:42.856 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:42 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2989875609' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:33:42.856 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:42 smithi016 ceph-mon[34911]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T06:33:42.856 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:33:43.123 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:42 smithi016 sudo[43135]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:33:43.123 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:42 smithi016 sudo[43135]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:43.123 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:42 smithi016 sudo[43135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:43.123 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:42 smithi016 sudo[43135]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:43.509 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:43 smithi016 sudo[43138]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:33:43.509 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:43 smithi016 sudo[43138]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:43.509 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:43 smithi016 sudo[43138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:43.509 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:33:43 smithi016 sudo[43138]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:43.657 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:43 smithi173 sudo[43972]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:33:43.658 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:43 smithi173 sudo[43972]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:43.658 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:43 smithi173 sudo[43972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:43.658 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:43 smithi173 sudo[43972]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:43.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:43 smithi173 ceph-mon[35349]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:43.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:43 smithi173 ceph-mon[35349]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:33:43.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:43.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:43.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:43 smithi012 ceph-mon[30937]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:43.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:43 smithi012 ceph-mon[30937]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:33:43.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:43.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:44.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:43 smithi016 ceph-mon[34911]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:43 smithi016 ceph-mon[34911]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:33:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:44.082 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:43 smithi173 sudo[43975]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:33:44.083 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:43 smithi173 sudo[43975]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:44.083 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:43 smithi173 sudo[43975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:44.083 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:33:43 smithi173 sudo[43975]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:44.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:44 smithi012 sudo[50061]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:33:44.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:44 smithi012 sudo[50061]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:44.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:44 smithi012 sudo[50061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:44.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:44 smithi012 sudo[50061]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:44.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:44 smithi012 sudo[50256]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:33:44.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:44 smithi012 sudo[50256]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:44.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:44 smithi012 sudo[50256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:44.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:44 smithi012 sudo[50256]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:45.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:44 smithi173 sudo[43978]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:33:45.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:44 smithi173 sudo[43978]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:45.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:44 smithi173 sudo[43978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:45.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:44 smithi173 sudo[43978]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:45.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 ceph-mon[34911]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 ceph-mon[34911]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:33:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 ceph-mon[34911]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:33:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:33:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:33:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:33:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:33:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:33:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:33:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:45 smithi012 ceph-mon[30937]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:45 smithi012 ceph-mon[30937]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:33:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:45 smithi012 ceph-mon[30937]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:33:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:33:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:33:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:33:45.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:33:45.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:33:45.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:33:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 sudo[43981]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:33:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 sudo[43981]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 sudo[43981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 sudo[43981]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 ceph-mon[35349]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 ceph-mon[35349]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:33:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 ceph-mon[35349]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:33:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:33:45.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:33:45.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:33:45.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:33:45.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:33:45.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:33:45.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 sudo[43141]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:33:45.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 sudo[43141]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:45.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 sudo[43141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:45.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 sudo[43141]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 sudo[43144]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:33:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 sudo[43144]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:33:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 sudo[43144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:33:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:45 smithi016 sudo[43144]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:33:46.364 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:46 smithi012 ceph-mon[30937]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:33:46.365 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:46 smithi012 ceph-mon[30937]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:33:46.365 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:46 smithi012 ceph-mon[30937]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:33:46.365 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:46 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:33:46.365 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:46 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:33:46.365 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:46 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:33:46.365 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:46 smithi012 ceph-mon[30937]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:33:46.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:46 smithi173 ceph-mon[35349]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:33:46.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:46 smithi173 ceph-mon[35349]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:33:46.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:46 smithi173 ceph-mon[35349]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:33:46.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:46 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:33:46.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:46 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:33:46.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:46 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:33:46.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:46 smithi173 ceph-mon[35349]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:33:46.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:46 smithi016 ceph-mon[34911]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:33:46.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:46 smithi016 ceph-mon[34911]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:33:46.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:46 smithi016 ceph-mon[34911]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:33:46.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:46 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:33:46.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:46 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:33:46.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:46 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:33:46.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:46 smithi016 ceph-mon[34911]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:33:47.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:47 smithi012 ceph-mon[30937]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:47.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:47 smithi016 ceph-mon[34911]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:47.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:47 smithi173 ceph-mon[35349]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:49.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:49 smithi012 ceph-mon[30937]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:49.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:49 smithi016 ceph-mon[34911]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:49.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:49 smithi173 ceph-mon[35349]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:50.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:33:50.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:50.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:33:50.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:50.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:33:50.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:51.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:51 smithi012 ceph-mon[30937]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:51.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:51 smithi012 ceph-mon[30937]: Deploying daemon osd.3 on smithi012 2024-09-19T06:33:51.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:51 smithi016 ceph-mon[34911]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:51.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:51 smithi016 ceph-mon[34911]: Deploying daemon osd.3 on smithi012 2024-09-19T06:33:51.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:51 smithi173 ceph-mon[35349]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:33:51.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:51 smithi173 ceph-mon[35349]: Deploying daemon osd.3 on smithi012 2024-09-19T06:33:53.369 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:53 smithi012 ceph-mon[30937]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:33:53.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:53 smithi016 ceph-mon[34911]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:33:53.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:53 smithi173 ceph-mon[35349]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:33:55.265 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:55 smithi012 ceph-mon[30937]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:33:55.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:55 smithi016 ceph-mon[34911]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:33:55.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:55 smithi173 ceph-mon[35349]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:33:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:57 smithi012 ceph-mon[30937]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:33:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:57 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:57.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:57 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:57.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:57 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:57.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:57 smithi016 ceph-mon[34911]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:33:57.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:57 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:57.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:57 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:57.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:57 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:57.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:57 smithi173 ceph-mon[35349]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:33:57.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:57.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:57.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:59.776 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:59 smithi012 ceph-mon[30937]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:33:59.776 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:59 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:59.776 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:59 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:59.777 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:59 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:59.777 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:59 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:59.777 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:33:59 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:59.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:59 smithi173 ceph-mon[35349]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:33:59.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:59 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:59.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:59 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:33:59.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:59 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:59.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:59 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:59.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:33:59 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:00.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:59 smithi016 ceph-mon[34911]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:34:00.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:59 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:00.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:59 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:00.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:59 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:00.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:59 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:00.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:33:59 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:00.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.057+0000 7f1bba7fc640 1 -- 172.21.15.12:0/1228424368 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1bc4062630 con 0x7f1bb00a3260 2024-09-19T06:34:00.059 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 3 on host 'smithi012' 2024-09-19T06:34:00.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.059+0000 7f1bcb373640 1 -- 172.21.15.12:0/1228424368 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1bb00a3260 msgr2=0x7f1bb00a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:00.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.059+0000 7f1bcb373640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1bb00a3260 0x7f1bb00a5720 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4000c00 tx=0x7f1bb40315d0 comp rx=0 tx=0).stop 2024-09-19T06:34:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.059+0000 7f1bcb373640 1 -- 172.21.15.12:0/1228424368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bc4101c00 msgr2=0x7f1bc4197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.059+0000 7f1bcb373640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bc4101c00 0x7f1bc4197ef0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000d770 tx=0x7f1bc000dc30 comp rx=0 tx=0).stop 2024-09-19T06:34:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.059+0000 7f1bcb373640 1 -- 172.21.15.12:0/1228424368 shutdown_connections 2024-09-19T06:34:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.059+0000 7f1bcb373640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1bb00a3260 0x7f1bb00a5720 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.059+0000 7f1bcb373640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc41037c0 0x7f1bc419f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.059+0000 7f1bcb373640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bc4102e00 0x7f1bc4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.059+0000 7f1bcb373640 1 --2- 172.21.15.12:0/1228424368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bc4101c00 0x7f1bc4197ef0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.059+0000 7f1bcb373640 1 -- 172.21.15.12:0/1228424368 >> 172.21.15.12:0/1228424368 conn(0x7f1bc40fd3b0 msgr2=0x7f1bc4106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:34:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.060+0000 7f1bcb373640 1 -- 172.21.15.12:0/1228424368 shutdown_connections 2024-09-19T06:34:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:00.060+0000 7f1bcb373640 1 -- 172.21.15.12:0/1228424368 wait complete. 2024-09-19T06:34:00.689 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:00.689 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:00.689 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:00.716 DEBUG:teuthology.orchestra.run.smithi012:osd.3> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T06:34:00.718 INFO:tasks.cephadm:Deploying osd.4 on smithi016 with /dev/vg_nvme/lv_3... 2024-09-19T06:34:00.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:34:00.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:00.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:00.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:00.978 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:34:01.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:01.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:01.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:01.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:01 smithi016 ceph-mon[34911]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:34:01.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:01 smithi173 ceph-mon[35349]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:34:01.864 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:01 smithi012 ceph-mon[30937]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:34:02.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:02 smithi173 ceph-mon[35349]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:34:02.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:02 smithi012 ceph-mon[30937]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:34:02.879 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:34:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3[51647]: 2024-09-19T06:34:02.449+0000 7f75b208b640 -1 osd.3 0 log_to_monitors true 2024-09-19T06:34:03.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:02 smithi016 ceph-mon[34911]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:34:03.272 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:34:03.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_3 2024-09-19T06:34:03.560 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:34:03.817 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:03 smithi016 ceph-mon[34911]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:34:03.817 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:03 smithi016 ceph-mon[34911]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:34:03.817 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:03 smithi016 ceph-mon[34911]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:34:03.817 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:03 smithi016 ceph-mon[34911]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:34:03.817 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:03 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:03.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:03 smithi173 ceph-mon[35349]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:34:03.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:03 smithi173 ceph-mon[35349]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:34:03.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:03 smithi173 ceph-mon[35349]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:34:03.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:03 smithi173 ceph-mon[35349]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:34:03.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:03 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:03.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:03 smithi012 ceph-mon[30937]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:34:03.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:03 smithi012 ceph-mon[30937]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:34:03.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:03 smithi012 ceph-mon[30937]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T06:34:03.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:03 smithi012 ceph-mon[30937]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:34:03.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:03 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:03.879 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:34:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3[51647]: 2024-09-19T06:34:03.545+0000 7f75ad7eb640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T06:34:03.879 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:34:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3[51647]: 2024-09-19T06:34:03.552+0000 7f75a9e25640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:34:04.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 -- 172.21.15.16:0/2777209342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b9c101d10 msgr2=0x7f7b9c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:04.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 --2- 172.21.15.16:0/2777209342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b9c101d10 0x7f7b9c102190 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c009900 tx=0x7f7b8c02a410 comp rx=0 tx=0).stop 2024-09-19T06:34:04.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 -- 172.21.15.16:0/2777209342 shutdown_connections 2024-09-19T06:34:04.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 --2- 172.21.15.16:0/2777209342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b9c1026d0 0x7f7b9c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 --2- 172.21.15.16:0/2777209342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b9c101d10 0x7f7b9c102190 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 --2- 172.21.15.16:0/2777209342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c100b10 0x7f7b9c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 -- 172.21.15.16:0/2777209342 >> 172.21.15.16:0/2777209342 conn(0x7f7b9c0fc2a0 msgr2=0x7f7b9c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 -- 172.21.15.16:0/2777209342 shutdown_connections 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 -- 172.21.15.16:0/2777209342 wait complete. 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 Processor -- start 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.006+0000 7f7ba1620640 1 -- start start 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7ba1620640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b9c100b10 0x7f7b9c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7ba1620640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b9c101d10 0x7f7b9c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7ba1620640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c1026d0 0x7f7b9c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:04.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7ba1620640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c10c790 con 0x7f7b9c100b10 2024-09-19T06:34:04.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7ba1620640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c10c610 con 0x7f7b9c101d10 2024-09-19T06:34:04.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7ba1620640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c10c910 con 0x7f7b9c1026d0 2024-09-19T06:34:04.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b9c101d10 0x7f7b9c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:04.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b9c101d10 0x7f7b9c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50836/0 (socket says 172.21.15.16:50836) 2024-09-19T06:34:04.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9a7fc640 1 -- 172.21.15.16:0/2333223203 learned_addr learned my addr 172.21.15.16:0/2333223203 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-19T06:34:04.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9affd640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b9c100b10 0x7f7b9c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:04.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9b7fe640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c1026d0 0x7f7b9c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:04.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9affd640 1 -- 172.21.15.16:0/2333223203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c1026d0 msgr2=0x7f7b9c19f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:04.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9affd640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c1026d0 0x7f7b9c19f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:04.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9affd640 1 -- 172.21.15.16:0/2333223203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b9c101d10 msgr2=0x7f7b9c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:04.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9affd640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b9c101d10 0x7f7b9c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:04.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9affd640 1 -- 172.21.15.16:0/2333223203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c19fb70 con 0x7f7b9c100b10 2024-09-19T06:34:04.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9a7fc640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b9c101d10 0x7f7b9c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:34:04.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.007+0000 7f7b9affd640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b9c100b10 0x7f7b9c197f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400e9c0 tx=0x7f7b8400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:34:04.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.008+0000 7f7b93fff640 1 -- 172.21.15.16:0/2333223203 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8400ccc0 con 0x7f7b9c100b10 2024-09-19T06:34:04.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.008+0000 7f7ba1620640 1 -- 172.21.15.16:0/2333223203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b9c19fe60 con 0x7f7b9c100b10 2024-09-19T06:34:04.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.008+0000 7f7b93fff640 1 -- 172.21.15.16:0/2333223203 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b840035f0 con 0x7f7b9c100b10 2024-09-19T06:34:04.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.008+0000 7f7b93fff640 1 -- 172.21.15.16:0/2333223203 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8400ce60 con 0x7f7b9c100b10 2024-09-19T06:34:04.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.008+0000 7f7ba1620640 1 -- 172.21.15.16:0/2333223203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b9c1a02b0 con 0x7f7b9c100b10 2024-09-19T06:34:04.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.009+0000 7f7ba1620640 1 -- 172.21.15.16:0/2333223203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b9c1a0540 con 0x7f7b9c100b10 2024-09-19T06:34:04.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.010+0000 7f7b93fff640 1 -- 172.21.15.16:0/2333223203 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7b840037a0 con 0x7f7b9c100b10 2024-09-19T06:34:04.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.011+0000 7f7b93fff640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7b880a3270 0x7f7b880a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:04.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.011+0000 7f7b93fff640 1 -- 172.21.15.16:0/2333223203 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7f7b840ce9f0 con 0x7f7b9c100b10 2024-09-19T06:34:04.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.011+0000 7f7b9a7fc640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7b880a3270 0x7f7b880a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:04.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.011+0000 7f7b9a7fc640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7b880a3270 0x7f7b880a5730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c031440 tx=0x7f7b8c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:34:04.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.015+0000 7f7b93fff640 1 -- 172.21.15.16:0/2333223203 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b8409c9b0 con 0x7f7b9c100b10 2024-09-19T06:34:04.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:04.199+0000 7f7ba1620640 1 -- 172.21.15.16:0/2333223203 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7b9c1a0710 con 0x7f7b880a3270 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:04.795 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:04.796 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.796 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:04.796 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:04.796 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:34:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:34:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:04.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:04.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:04.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:04.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:04.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:34:04.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:34:04.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:04.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:04.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:04.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:04.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:04.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:04.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:04.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:04.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:04.881 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:05.806 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:34:05.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:34:05.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:34:05.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi012 2024-09-19T06:34:05.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi012 to 8546M 2024-09-19T06:34:05.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: from='client.14337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:05.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:05.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] boot 2024-09-19T06:34:05.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:34:05.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:05.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:05 smithi016 ceph-mon[34911]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T06:34:05.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:34:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:34:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:34:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi012 2024-09-19T06:34:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi012 to 8546M 2024-09-19T06:34:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: from='client.14337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] boot 2024-09-19T06:34:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:34:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:05.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:05 smithi173 ceph-mon[35349]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T06:34:05.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:34:05.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:34:05.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:34:05.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi012 2024-09-19T06:34:05.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi012 to 8546M 2024-09-19T06:34:05.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: from='client.14337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:05.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:05.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: osd.3 [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] boot 2024-09-19T06:34:05.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T06:34:05.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:34:05.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:05 smithi012 ceph-mon[30937]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T06:34:06.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:06 smithi012 ceph-mon[30937]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T06:34:06.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:06 smithi012 ceph-mon[30937]: from='client.? 172.21.15.16:0/4158959017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20aad675-3694-46a0-a7f3-d3ebd60aee5e"}]: dispatch 2024-09-19T06:34:06.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:06 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20aad675-3694-46a0-a7f3-d3ebd60aee5e"}]: dispatch 2024-09-19T06:34:06.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:06 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20aad675-3694-46a0-a7f3-d3ebd60aee5e"}]': finished 2024-09-19T06:34:06.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:06 smithi012 ceph-mon[30937]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:34:06.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:07.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:06 smithi016 ceph-mon[34911]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T06:34:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:06 smithi016 ceph-mon[34911]: from='client.? 172.21.15.16:0/4158959017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20aad675-3694-46a0-a7f3-d3ebd60aee5e"}]: dispatch 2024-09-19T06:34:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:06 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20aad675-3694-46a0-a7f3-d3ebd60aee5e"}]: dispatch 2024-09-19T06:34:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:06 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20aad675-3694-46a0-a7f3-d3ebd60aee5e"}]': finished 2024-09-19T06:34:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:06 smithi016 ceph-mon[34911]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:34:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:07.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:06 smithi173 ceph-mon[35349]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T06:34:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:06 smithi173 ceph-mon[35349]: from='client.? 172.21.15.16:0/4158959017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20aad675-3694-46a0-a7f3-d3ebd60aee5e"}]: dispatch 2024-09-19T06:34:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:06 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20aad675-3694-46a0-a7f3-d3ebd60aee5e"}]: dispatch 2024-09-19T06:34:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:06 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20aad675-3694-46a0-a7f3-d3ebd60aee5e"}]': finished 2024-09-19T06:34:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:06 smithi173 ceph-mon[35349]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T06:34:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:07.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:07 smithi012 ceph-mon[30937]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:07.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:07 smithi012 ceph-mon[30937]: from='client.? 172.21.15.16:0/2012834627' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:07.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:07 smithi012 ceph-mon[30937]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:34:07.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:08.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:07 smithi016 ceph-mon[34911]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:07 smithi016 ceph-mon[34911]: from='client.? 172.21.15.16:0/2012834627' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:07 smithi016 ceph-mon[34911]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:34:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:08.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:07 smithi173 ceph-mon[35349]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:07 smithi173 ceph-mon[35349]: from='client.? 172.21.15.16:0/2012834627' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:07 smithi173 ceph-mon[35349]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T06:34:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:09.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:09 smithi016 ceph-mon[34911]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:09.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:09 smithi016 ceph-mon[34911]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:34:09.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:09.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:09 smithi173 ceph-mon[35349]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:09.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:09 smithi173 ceph-mon[35349]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:34:09.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:09.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:09 smithi012 ceph-mon[30937]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:09.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:09 smithi012 ceph-mon[30937]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T06:34:09.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:11.637 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:11 smithi016 ceph-mon[34911]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:11.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:11 smithi173 ceph-mon[35349]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:11.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:11 smithi012 ceph-mon[30937]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:13.713 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:13 smithi016 ceph-mon[34911]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:34:13.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:13 smithi173 ceph-mon[35349]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:34:13.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:13 smithi012 ceph-mon[30937]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:34:15.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:15 smithi016 ceph-mon[34911]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T06:34:15.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:15 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:34:15.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:15 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:15.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:15 smithi173 ceph-mon[35349]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T06:34:15.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:15 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:34:15.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:15 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:15.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:15 smithi012 ceph-mon[30937]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T06:34:15.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:15 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:34:15.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:15 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:16.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:16 smithi173 ceph-mon[35349]: Deploying daemon osd.4 on smithi016 2024-09-19T06:34:16.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:16 smithi016 ceph-mon[34911]: Deploying daemon osd.4 on smithi016 2024-09-19T06:34:16.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:16 smithi012 ceph-mon[30937]: Deploying daemon osd.4 on smithi016 2024-09-19T06:34:17.807 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:17 smithi016 ceph-mon[34911]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:34:17.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:17 smithi173 ceph-mon[35349]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:34:17.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:17 smithi012 ceph-mon[30937]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:34:19.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:19 smithi016 ceph-mon[34911]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:34:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:19 smithi173 ceph-mon[35349]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:34:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:19 smithi012 ceph-mon[30937]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:34:21.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:21 smithi016 ceph-mon[34911]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T06:34:21.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:21.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:21.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:21.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:21 smithi173 ceph-mon[35349]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T06:34:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:21 smithi012 ceph-mon[30937]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T06:34:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:23 smithi173 ceph-mon[35349]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:34:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:23 smithi012 ceph-mon[30937]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:34:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:23.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:23.903 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:23 smithi016 ceph-mon[34911]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:34:23.904 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:23.904 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:23.904 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:23.904 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:23.904 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:24.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.518+0000 7f7b93fff640 1 -- 172.21.15.16:0/2333223203 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7b9c1a0710 con 0x7f7b880a3270 2024-09-19T06:34:24.520 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 4 on host 'smithi016' 2024-09-19T06:34:24.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 -- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7b880a3270 msgr2=0x7f7b880a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7b880a3270 0x7f7b880a5730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c031440 tx=0x7f7b8c0315b0 comp rx=0 tx=0).stop 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 -- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b9c100b10 msgr2=0x7f7b9c197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b9c100b10 0x7f7b9c197f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7b8400e9c0 tx=0x7f7b8400ee80 comp rx=0 tx=0).stop 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 -- 172.21.15.16:0/2333223203 shutdown_connections 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f7b880a3270 0x7f7b880a5730 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b9c1026d0 0x7f7b9c19f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b9c101d10 0x7f7b9c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 --2- 172.21.15.16:0/2333223203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b9c100b10 0x7f7b9c197f40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 -- 172.21.15.16:0/2333223203 >> 172.21.15.16:0/2333223203 conn(0x7f7b9c0fc2a0 msgr2=0x7f7b9c06a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 -- 172.21.15.16:0/2333223203 shutdown_connections 2024-09-19T06:34:24.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:34:24.521+0000 7f7ba1620640 1 -- 172.21.15.16:0/2333223203 wait complete. 2024-09-19T06:34:24.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:24.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:24.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:24 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:24.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:24.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:24.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:24 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:24 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:25.138 DEBUG:teuthology.orchestra.run.smithi016:osd.4> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T06:34:25.141 INFO:tasks.cephadm:Deploying osd.5 on smithi173 with /dev/vg_nvme/lv_3... 2024-09-19T06:34:25.141 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:34:25.400 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:34:25.673 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:25 smithi016 ceph-mon[34911]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:25.830 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:25 smithi173 ceph-mon[35349]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:25.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:25 smithi012 ceph-mon[30937]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:27.259 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:34:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4[45913]: 2024-09-19T06:34:26.915+0000 7fd6a2df0640 -1 osd.4 0 log_to_monitors true 2024-09-19T06:34:27.632 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:27 smithi016 ceph-mon[34911]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:27.632 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:27 smithi016 ceph-mon[34911]: from='osd.4 [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:34:27.633 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:27 smithi016 ceph-mon[34911]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:34:27.731 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:27 smithi173 ceph-mon[35349]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:27.731 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:27 smithi173 ceph-mon[35349]: from='osd.4 [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:34:27.731 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:27 smithi173 ceph-mon[35349]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:34:27.734 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:34:27.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_3 2024-09-19T06:34:27.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:27 smithi012 ceph-mon[30937]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:27.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:27 smithi012 ceph-mon[30937]: from='osd.4 [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:34:27.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:27 smithi012 ceph-mon[30937]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:34:28.009 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:34:28.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.433+0000 7fe721837640 1 -- 172.21.15.173:0/176605830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe71c101c00 msgr2=0x7fe71c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:28.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.433+0000 7fe721837640 1 --2- 172.21.15.173:0/176605830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe71c101c00 0x7fe71c102000 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe714009ca0 tx=0x7fe71402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:34:28.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.433+0000 7fe721837640 1 -- 172.21.15.173:0/176605830 shutdown_connections 2024-09-19T06:34:28.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.433+0000 7fe721837640 1 --2- 172.21.15.173:0/176605830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe71c1037c0 0x7fe71c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:28.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.433+0000 7fe721837640 1 --2- 172.21.15.173:0/176605830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe71c102e00 0x7fe71c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:28.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.433+0000 7fe721837640 1 --2- 172.21.15.173:0/176605830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe71c101c00 0x7fe71c102000 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:28.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.433+0000 7fe721837640 1 -- 172.21.15.173:0/176605830 >> 172.21.15.173:0/176605830 conn(0x7fe71c0fd390 msgr2=0x7fe71c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:34:28.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.433+0000 7fe721837640 1 -- 172.21.15.173:0/176605830 shutdown_connections 2024-09-19T06:34:28.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.433+0000 7fe721837640 1 -- 172.21.15.173:0/176605830 wait complete. 2024-09-19T06:34:28.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe721837640 1 Processor -- start 2024-09-19T06:34:28.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe721837640 1 -- start start 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe721837640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe71c101c00 0x7fe71c19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe721837640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe71c102e00 0x7fe71c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe721837640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe71c1037c0 0x7fe71c1a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe721837640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c10d960 con 0x7fe71c1037c0 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe721837640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c10d7e0 con 0x7fe71c101c00 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe721837640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c10dae0 con 0x7fe71c102e00 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe71a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe71c102e00 0x7fe71c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe71a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe71c102e00 0x7fe71c19a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48944/0 (socket says 172.21.15.173:48944) 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe71a7fc640 1 -- 172.21.15.173:0/1074164355 learned_addr learned my addr 172.21.15.173:0/1074164355 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe71affd640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe71c101c00 0x7fe71c19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.434+0000 7fe71b7fe640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe71c1037c0 0x7fe71c1a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:28.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe71a7fc640 1 -- 172.21.15.173:0/1074164355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe71c101c00 msgr2=0x7fe71c19a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe71a7fc640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe71c101c00 0x7fe71c19a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe71a7fc640 1 -- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe71c1037c0 msgr2=0x7fe71c1a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe71a7fc640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe71c1037c0 0x7fe71c1a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe71a7fc640 1 -- 172.21.15.173:0/1074164355 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c1a1f00 con 0x7fe71c102e00 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe71b7fe640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe71c1037c0 0x7fe71c1a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe71a7fc640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe71c102e00 0x7fe71c19a810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe70400b4a0 tx=0x7fe70400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe720835640 1 -- 172.21.15.173:0/1074164355 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704014070 con 0x7fe71c102e00 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe721837640 1 -- 172.21.15.173:0/1074164355 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c1a21f0 con 0x7fe71c102e00 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe720835640 1 -- 172.21.15.173:0/1074164355 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe704010af0 con 0x7fe71c102e00 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe720835640 1 -- 172.21.15.173:0/1074164355 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704017d10 con 0x7fe71c102e00 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.435+0000 7fe721837640 1 -- 172.21.15.173:0/1074164355 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71c1a2800 con 0x7fe71c102e00 2024-09-19T06:34:28.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.436+0000 7fe721837640 1 -- 172.21.15.173:0/1074164355 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe71c1a2ac0 con 0x7fe71c102e00 2024-09-19T06:34:28.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.437+0000 7fe720835640 1 -- 172.21.15.173:0/1074164355 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe704017070 con 0x7fe71c102e00 2024-09-19T06:34:28.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.438+0000 7fe720835640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7080a32f0 0x7fe7080a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:28.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.438+0000 7fe720835640 1 -- 172.21.15.173:0/1074164355 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3805+0+0 (secure 0 0 0) 0x7fe7040cda30 con 0x7fe71c102e00 2024-09-19T06:34:28.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.439+0000 7fe71affd640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7080a32f0 0x7fe7080a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:28.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.439+0000 7fe71affd640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7080a32f0 0x7fe7080a57b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe714006010 tx=0x7fe714000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:34:28.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.443+0000 7fe720835640 1 -- 172.21.15.173:0/1074164355 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe70409b8f0 con 0x7fe71c102e00 2024-09-19T06:34:28.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:28.622+0000 7fe721837640 1 -- 172.21.15.173:0/1074164355 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe71c109d60 con 0x7fe7080a32f0 2024-09-19T06:34:28.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:34:28.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='osd.4 [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:28.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:34:28.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:34:28.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:28 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:28.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:34:28.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='osd.4 [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:34:28.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:34:28.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:28.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:34:28.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:28.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:28.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:28.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:28.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:28.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:28.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:28.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:28.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:34:28.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:34:28.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:28 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:29.008 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4[45913]: 2024-09-19T06:34:28.548+0000 7fd69e550640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T06:34:29.009 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4[45913]: 2024-09-19T06:34:28.556+0000 7fd69ab8a640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:34:29.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:34:29.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='osd.4 [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:34:29.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:34:29.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:29.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:34:29.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:29.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:29.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:29.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:29.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:29.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:29.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:29.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:29.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:34:29.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:34:29.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:28 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:29.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:29 smithi173 ceph-mon[35349]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:29.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:29 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi016 2024-09-19T06:34:29.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:29 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi016 to 8546M 2024-09-19T06:34:29.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:29.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:29 smithi173 ceph-mon[35349]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:29.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:29.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:29.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:29.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:29.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:29 smithi012 ceph-mon[30937]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:29.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:29 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi016 2024-09-19T06:34:29.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:29 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi016 to 8546M 2024-09-19T06:34:29.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:29.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:29 smithi012 ceph-mon[30937]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:29.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:29.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:29.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:29.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:30.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:29 smithi016 ceph-mon[34911]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:30.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:29 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi016 2024-09-19T06:34:30.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:29 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi016 to 8546M 2024-09-19T06:34:30.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:30.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:29 smithi016 ceph-mon[34911]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:30.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:30.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:30.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:30.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:30.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:30 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:34:30.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:30 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:34:30.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:30 smithi173 ceph-mon[35349]: osd.4 [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] boot 2024-09-19T06:34:30.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:30 smithi173 ceph-mon[35349]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T06:34:30.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:30 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:30 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:34:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:30 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:34:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:30 smithi012 ceph-mon[30937]: osd.4 [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] boot 2024-09-19T06:34:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:30 smithi012 ceph-mon[30937]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T06:34:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:30 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:30 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:34:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:30 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:34:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:30 smithi016 ceph-mon[34911]: osd.4 [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] boot 2024-09-19T06:34:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:30 smithi016 ceph-mon[34911]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T06:34:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:30 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:34:31.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:31 smithi173 ceph-mon[35349]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:31.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:31 smithi173 ceph-mon[35349]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:34:31.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:31 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/3404681354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "583dbaf5-4f1f-45a1-b839-67a5d21c483d"}]: dispatch 2024-09-19T06:34:31.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:31 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "583dbaf5-4f1f-45a1-b839-67a5d21c483d"}]: dispatch 2024-09-19T06:34:31.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:31 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "583dbaf5-4f1f-45a1-b839-67a5d21c483d"}]': finished 2024-09-19T06:34:31.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:31 smithi173 ceph-mon[35349]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:34:31.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:31 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:31.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:31 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/2614926588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:31 smithi012 ceph-mon[30937]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:31 smithi012 ceph-mon[30937]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:34:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:31 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/3404681354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "583dbaf5-4f1f-45a1-b839-67a5d21c483d"}]: dispatch 2024-09-19T06:34:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:31 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "583dbaf5-4f1f-45a1-b839-67a5d21c483d"}]: dispatch 2024-09-19T06:34:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:31 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "583dbaf5-4f1f-45a1-b839-67a5d21c483d"}]': finished 2024-09-19T06:34:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:31 smithi012 ceph-mon[30937]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:34:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:31 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:31 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/2614926588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:32.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:31 smithi016 ceph-mon[34911]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:34:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:31 smithi016 ceph-mon[34911]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:34:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:31 smithi016 ceph-mon[34911]: from='client.? 172.21.15.173:0/3404681354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "583dbaf5-4f1f-45a1-b839-67a5d21c483d"}]: dispatch 2024-09-19T06:34:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:31 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "583dbaf5-4f1f-45a1-b839-67a5d21c483d"}]: dispatch 2024-09-19T06:34:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:31 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "583dbaf5-4f1f-45a1-b839-67a5d21c483d"}]': finished 2024-09-19T06:34:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:31 smithi016 ceph-mon[34911]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:34:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:31 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:31 smithi016 ceph-mon[34911]: from='client.? 172.21.15.173:0/2614926588' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:33.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:33 smithi173 ceph-mon[35349]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:33.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:33 smithi012 ceph-mon[30937]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:34.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:33 smithi016 ceph-mon[34911]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:35.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:35 smithi173 ceph-mon[35349]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:35.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:35 smithi012 ceph-mon[30937]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:36.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:35 smithi016 ceph-mon[34911]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:37.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:37 smithi173 ceph-mon[35349]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:37.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:37 smithi012 ceph-mon[30937]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:38.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:37 smithi016 ceph-mon[34911]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:39.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:39 smithi173 ceph-mon[35349]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:39.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:34:39.869 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:39 smithi012 ceph-mon[30937]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:34:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:40.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:39 smithi016 ceph-mon[34911]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:40.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:34:40.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:40.859 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:40 smithi173 ceph-mon[35349]: Deploying daemon osd.5 on smithi173 2024-09-19T06:34:40.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:40 smithi012 ceph-mon[30937]: Deploying daemon osd.5 on smithi173 2024-09-19T06:34:41.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:40 smithi016 ceph-mon[34911]: Deploying daemon osd.5 on smithi173 2024-09-19T06:34:41.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:41 smithi012 ceph-mon[30937]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:41.922 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:41 smithi173 ceph-mon[35349]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:42.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:41 smithi016 ceph-mon[34911]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:43.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:43 smithi012 ceph-mon[30937]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:43.936 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:43 smithi173 ceph-mon[35349]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:43 smithi016 ceph-mon[34911]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:45.817 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:45 smithi173 ceph-mon[35349]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:45.817 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:45.817 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:45.817 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:45.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:45 smithi012 ceph-mon[30937]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:45.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:45.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:45.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:45 smithi016 ceph-mon[34911]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:47.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:47 smithi173 ceph-mon[35349]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:47.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:47 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:47.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:47 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:47.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:47 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:47.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:47 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:47.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:47 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:47.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:47 smithi012 ceph-mon[30937]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:47.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:47 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:47.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:47 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:47.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:47 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:47.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:47 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:47.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:47 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:48.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:47 smithi016 ceph-mon[34911]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:48.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:47 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:48.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:47 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:48.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:47 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:48.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:47 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:48.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:47 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:48.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.966+0000 7fe720835640 1 -- 172.21.15.173:0/1074164355 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe71c109d60 con 0x7fe7080a32f0 2024-09-19T06:34:48.969 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 5 on host 'smithi173' 2024-09-19T06:34:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.968+0000 7fe721837640 1 -- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7080a32f0 msgr2=0x7fe7080a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.968+0000 7fe721837640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7080a32f0 0x7fe7080a57b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe714006010 tx=0x7fe714000f40 comp rx=0 tx=0).stop 2024-09-19T06:34:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.968+0000 7fe721837640 1 -- 172.21.15.173:0/1074164355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe71c102e00 msgr2=0x7fe71c19a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.968+0000 7fe721837640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe71c102e00 0x7fe71c19a810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe70400b4a0 tx=0x7fe70400b960 comp rx=0 tx=0).stop 2024-09-19T06:34:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.968+0000 7fe721837640 1 -- 172.21.15.173:0/1074164355 shutdown_connections 2024-09-19T06:34:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.969+0000 7fe721837640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7080a32f0 0x7fe7080a57b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:48.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.969+0000 7fe721837640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe71c1037c0 0x7fe71c1a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.969+0000 7fe721837640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe71c102e00 0x7fe71c19a810 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.969+0000 7fe721837640 1 --2- 172.21.15.173:0/1074164355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe71c101c00 0x7fe71c19a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.969+0000 7fe721837640 1 -- 172.21.15.173:0/1074164355 >> 172.21.15.173:0/1074164355 conn(0x7fe71c0fd390 msgr2=0x7fe71c108640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:34:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.969+0000 7fe721837640 1 -- 172.21.15.173:0/1074164355 shutdown_connections 2024-09-19T06:34:48.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:34:48.969+0000 7fe721837640 1 -- 172.21.15.173:0/1074164355 wait complete. 2024-09-19T06:34:49.584 DEBUG:teuthology.orchestra.run.smithi173:osd.5> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T06:34:49.586 INFO:tasks.cephadm:Deploying osd.6 on smithi012 with /dev/vg_nvme/lv_2... 2024-09-19T06:34:49.586 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:34:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:49 smithi173 ceph-mon[35349]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:49.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:49 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:49.853 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:34:49.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:49 smithi012 ceph-mon[30937]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:49.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:49.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:49.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:49 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:50.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:49 smithi016 ceph-mon[34911]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:50.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:50.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:50.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:49 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:51.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:51 smithi173 ceph-mon[35349]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:51.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:51 smithi173 ceph-mon[35349]: from='osd.5 [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:34:51.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:51 smithi173 ceph-mon[35349]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:34:51.659 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:34:51 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:34:51.397+0000 7fb9ea881640 -1 osd.5 0 log_to_monitors true 2024-09-19T06:34:51.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:51 smithi012 ceph-mon[30937]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:51.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:51 smithi012 ceph-mon[30937]: from='osd.5 [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:34:51.875 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:51 smithi012 ceph-mon[30937]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:34:52.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:51 smithi016 ceph-mon[34911]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:52.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:51 smithi016 ceph-mon[34911]: from='osd.5 [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:34:52.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:51 smithi016 ceph-mon[34911]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:34:52.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:34:52.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_2 2024-09-19T06:34:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:34:52.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:34:52.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:34:52.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:52.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='osd.5 [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:34:52.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:34:52.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:52.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:52.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:52.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:52.834 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:52.834 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:52.834 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:52.834 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:52 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:53.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:34:53.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:34:53.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:53.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='osd.5 [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:34:53.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:34:53.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:53.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:53.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:53.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:53.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:53.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:53.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:53.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:52 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:53.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:34:53.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:34:53.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:53.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='osd.5 [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:34:53.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:34:53.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:53.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:53.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:53.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:53.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:53.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:53.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:53.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:52 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:34:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.173+0000 7f34c3db1640 1 -- 172.21.15.12:0/667116238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc100ad0 msgr2=0x7f34bc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.173+0000 7f34c3db1640 1 --2- 172.21.15.12:0/667116238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc100ad0 0x7f34bc100ed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009900 tx=0x7f34ac02a410 comp rx=0 tx=0).stop 2024-09-19T06:34:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.173+0000 7f34c3db1640 1 -- 172.21.15.12:0/667116238 shutdown_connections 2024-09-19T06:34:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.173+0000 7f34c3db1640 1 --2- 172.21.15.12:0/667116238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34bc102690 0x7f34bc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.173+0000 7f34c3db1640 1 --2- 172.21.15.12:0/667116238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34bc101cd0 0x7f34bc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.173+0000 7f34c3db1640 1 --2- 172.21.15.12:0/667116238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc100ad0 0x7f34bc100ed0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.173+0000 7f34c3db1640 1 -- 172.21.15.12:0/667116238 >> 172.21.15.12:0/667116238 conn(0x7f34bc0fc280 msgr2=0x7f34bc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:34:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.173+0000 7f34c3db1640 1 -- 172.21.15.12:0/667116238 shutdown_connections 2024-09-19T06:34:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.173+0000 7f34c3db1640 1 -- 172.21.15.12:0/667116238 wait complete. 2024-09-19T06:34:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c3db1640 1 Processor -- start 2024-09-19T06:34:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c3db1640 1 -- start start 2024-09-19T06:34:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c3db1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34bc100ad0 0x7f34bc104bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c3db1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc101cd0 0x7f34bc103270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c3db1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34bc102690 0x7f34bc1037b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c3db1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc10c760 con 0x7f34bc101cd0 2024-09-19T06:34:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c3db1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc10c5e0 con 0x7f34bc100ad0 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c3db1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc10c8e0 con 0x7f34bc102690 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c134c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc101cd0 0x7f34bc103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c234e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34bc102690 0x7f34bc1037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c134c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc101cd0 0x7f34bc103270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60926/0 (socket says 172.21.15.12:60926) 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c234e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34bc102690 0x7f34bc1037b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49060/0 (socket says 172.21.15.12:49060) 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c1b4d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34bc100ad0 0x7f34bc104bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.174+0000 7f34c134c640 1 -- 172.21.15.12:0/284883648 learned_addr learned my addr 172.21.15.12:0/284883648 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34c134c640 1 -- 172.21.15.12:0/284883648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34bc102690 msgr2=0x7f34bc1037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34c134c640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34bc102690 0x7f34bc1037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34c134c640 1 -- 172.21.15.12:0/284883648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34bc100ad0 msgr2=0x7f34bc104bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34c134c640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34bc100ad0 0x7f34bc104bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34c134c640 1 -- 172.21.15.12:0/284883648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34bc103fe0 con 0x7f34bc101cd0 2024-09-19T06:34:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34c234e640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34bc102690 0x7f34bc1037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:34:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34c1b4d640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34bc100ad0 0x7f34bc104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:34:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34c134c640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc101cd0 0x7f34bc103270 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34b800d950 tx=0x7f34b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:34:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34b2ffd640 1 -- 172.21.15.12:0/284883648 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8017030 con 0x7f34bc101cd0 2024-09-19T06:34:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34b2ffd640 1 -- 172.21.15.12:0/284883648 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b8004020 con 0x7f34bc101cd0 2024-09-19T06:34:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34c3db1640 1 -- 172.21.15.12:0/284883648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34bc1a1ff0 con 0x7f34bc101cd0 2024-09-19T06:34:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34b2ffd640 1 -- 172.21.15.12:0/284883648 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b80047a0 con 0x7f34bc101cd0 2024-09-19T06:34:53.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.175+0000 7f34c3db1640 1 -- 172.21.15.12:0/284883648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34bc1a2440 con 0x7f34bc101cd0 2024-09-19T06:34:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.177+0000 7f34c3db1640 1 -- 172.21.15.12:0/284883648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34bc1a2730 con 0x7f34bc101cd0 2024-09-19T06:34:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.178+0000 7f34b2ffd640 1 -- 172.21.15.12:0/284883648 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f34b80041d0 con 0x7f34bc101cd0 2024-09-19T06:34:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.178+0000 7f34b2ffd640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f34a80a3240 0x7f34a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.178+0000 7f34c1b4d640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f34a80a3240 0x7f34a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.178+0000 7f34b2ffd640 1 -- 172.21.15.12:0/284883648 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7f34b80ce2d0 con 0x7f34bc101cd0 2024-09-19T06:34:53.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.179+0000 7f34c1b4d640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f34a80a3240 0x7f34a80a5700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34ac005ab0 tx=0x7f34ac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:34:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.183+0000 7f34b2ffd640 1 -- 172.21.15.12:0/284883648 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f34b809bfd0 con 0x7f34bc101cd0 2024-09-19T06:34:53.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:34:53.387+0000 7f34c3db1640 1 -- 172.21.15.12:0/284883648 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f34bc1a2900 con 0x7f34a80a3240 2024-09-19T06:34:53.621 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:34:53.364+0000 7fb9e7018640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T06:34:53.621 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:34:53.373+0000 7fb9de613640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:34:53.648 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:53.648 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi173 2024-09-19T06:34:53.648 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-19T06:34:53.648 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:34:53.648 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:34:53.648 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:53.648 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:53.649 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: from='osd.5 ' entity='osd.5' 2024-09-19T06:34:53.649 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:53.649 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:53.649 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:53.649 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: osd.5 [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] boot 2024-09-19T06:34:53.649 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:34:53.649 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi173 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: from='osd.5 ' entity='osd.5' 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:54.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: osd.5 [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] boot 2024-09-19T06:34:54.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:34:54.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:54.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:34:54.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi173 2024-09-19T06:34:54.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-19T06:34:54.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:34:54.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:34:54.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:54.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:54.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: from='osd.5 ' entity='osd.5' 2024-09-19T06:34:54.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:54.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:54.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:54.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: osd.5 [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] boot 2024-09-19T06:34:54.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:34:54.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:34:54.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:54 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:34:54.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:54 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:34:54.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:54 smithi012 ceph-mon[30937]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:54.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:54 smithi012 ceph-mon[30937]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:34:55.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:54 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:34:55.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:54 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:34:55.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:54 smithi016 ceph-mon[34911]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:55.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:54 smithi016 ceph-mon[34911]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:34:55.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:54 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:34:55.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:54 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:34:55.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:54 smithi173 ceph-mon[35349]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:55.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:54 smithi173 ceph-mon[35349]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:34:55.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:55 smithi012 ceph-mon[30937]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:34:55.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:55 smithi012 ceph-mon[30937]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:34:56.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:55 smithi016 ceph-mon[34911]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:34:56.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:55 smithi016 ceph-mon[34911]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:34:56.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:55 smithi173 ceph-mon[35349]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:34:56.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:55 smithi173 ceph-mon[35349]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:34:56.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:56 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1395036917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0b6ef77-21e2-4950-a37f-57ccbf9101d7"}]: dispatch 2024-09-19T06:34:56.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:56 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1395036917' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0b6ef77-21e2-4950-a37f-57ccbf9101d7"}]': finished 2024-09-19T06:34:56.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:56 smithi012 ceph-mon[30937]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:34:56.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:56 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:34:56.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:56 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/605300659' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:57.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:56 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1395036917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0b6ef77-21e2-4950-a37f-57ccbf9101d7"}]: dispatch 2024-09-19T06:34:57.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:56 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1395036917' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0b6ef77-21e2-4950-a37f-57ccbf9101d7"}]': finished 2024-09-19T06:34:57.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:56 smithi016 ceph-mon[34911]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:34:57.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:56 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:34:57.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:56 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/605300659' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:57.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:56 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1395036917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0b6ef77-21e2-4950-a37f-57ccbf9101d7"}]: dispatch 2024-09-19T06:34:57.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:56 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1395036917' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0b6ef77-21e2-4950-a37f-57ccbf9101d7"}]': finished 2024-09-19T06:34:57.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:56 smithi173 ceph-mon[35349]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T06:34:57.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:56 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:34:57.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:56 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/605300659' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:58.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:57 smithi016 ceph-mon[34911]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:34:58.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:57 smithi016 ceph-mon[34911]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:34:58.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:57 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:34:58.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:57 smithi173 ceph-mon[35349]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:34:58.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:57 smithi173 ceph-mon[35349]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:34:58.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:57 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:34:58.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:57 smithi012 ceph-mon[30937]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:34:58.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:57 smithi012 ceph-mon[30937]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:34:58.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:57 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:34:59.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:58 smithi016 ceph-mon[34911]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:34:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:58 smithi016 ceph-mon[34911]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T06:34:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:34:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:34:59.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:58 smithi173 ceph-mon[35349]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:34:59.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:58 smithi173 ceph-mon[35349]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T06:34:59.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:34:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:34:59.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:58 smithi012 ceph-mon[30937]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:34:59.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:58 smithi012 ceph-mon[30937]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T06:34:59.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:34:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:01.231 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:00 smithi012 ceph-mon[30937]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:01.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:00 smithi016 ceph-mon[34911]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:01.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:00 smithi173 ceph-mon[35349]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:03.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:02 smithi016 ceph-mon[34911]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:35:03.291 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:02 smithi012 ceph-mon[30937]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:35:03.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:02 smithi173 ceph-mon[35349]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:35:05.148 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:04 smithi012 ceph-mon[30937]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T06:35:05.149 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:35:05.149 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:05.149 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:04 smithi012 ceph-mon[30937]: Deploying daemon osd.6 on smithi012 2024-09-19T06:35:05.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:04 smithi016 ceph-mon[34911]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T06:35:05.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:35:05.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:05.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:04 smithi016 ceph-mon[34911]: Deploying daemon osd.6 on smithi012 2024-09-19T06:35:05.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:04 smithi173 ceph-mon[35349]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T06:35:05.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:35:05.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:05.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:04 smithi173 ceph-mon[35349]: Deploying daemon osd.6 on smithi012 2024-09-19T06:35:07.228 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:06 smithi012 ceph-mon[30937]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T06:35:07.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:06 smithi016 ceph-mon[34911]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T06:35:07.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:06 smithi173 ceph-mon[35349]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T06:35:09.180 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:08 smithi012 ceph-mon[30937]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:35:09.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:08 smithi016 ceph-mon[34911]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:35:09.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:08 smithi173 ceph-mon[35349]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:35:11.250 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:10 smithi012 ceph-mon[30937]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T06:35:11.250 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:10 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:11.250 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:10 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:11.250 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:10 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:11.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:10 smithi016 ceph-mon[34911]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T06:35:11.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:10 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:11.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:10 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:11.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:10 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:11.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:10 smithi173 ceph-mon[35349]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T06:35:11.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:10 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:11.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:10 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:11.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:10 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:13.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:12 smithi012 ceph-mon[30937]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:35:13.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:12 smithi016 ceph-mon[34911]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:35:13.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:12 smithi173 ceph-mon[35349]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:35:14.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.003+0000 7f34b2ffd640 1 -- 172.21.15.12:0/284883648 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f34bc1a2900 con 0x7f34a80a3240 2024-09-19T06:35:14.005 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 6 on host 'smithi012' 2024-09-19T06:35:14.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 -- 172.21.15.12:0/284883648 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f34a80a3240 msgr2=0x7f34a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:14.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f34a80a3240 0x7f34a80a5700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34ac005ab0 tx=0x7f34ac000bc0 comp rx=0 tx=0).stop 2024-09-19T06:35:14.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 -- 172.21.15.12:0/284883648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc101cd0 msgr2=0x7f34bc103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:14.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc101cd0 0x7f34bc103270 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34b800d950 tx=0x7f34b800de10 comp rx=0 tx=0).stop 2024-09-19T06:35:14.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 -- 172.21.15.12:0/284883648 shutdown_connections 2024-09-19T06:35:14.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f34a80a3240 0x7f34a80a5700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:14.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f34bc102690 0x7f34bc1037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:14.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34bc101cd0 0x7f34bc103270 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:14.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 --2- 172.21.15.12:0/284883648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34bc100ad0 0x7f34bc104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:14.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 -- 172.21.15.12:0/284883648 >> 172.21.15.12:0/284883648 conn(0x7f34bc0fc280 msgr2=0x7f34bc069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:35:14.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 -- 172.21.15.12:0/284883648 shutdown_connections 2024-09-19T06:35:14.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:35:14.006+0000 7f34c3db1640 1 -- 172.21.15.12:0/284883648 wait complete. 2024-09-19T06:35:14.617 DEBUG:teuthology.orchestra.run.smithi012:osd.6> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T06:35:14.619 INFO:tasks.cephadm:Deploying osd.7 on smithi016 with /dev/vg_nvme/lv_2... 2024-09-19T06:35:14.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:35:14.881 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:35:15.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:14 smithi016 ceph-mon[34911]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:15.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:14 smithi012 ceph-mon[30937]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:15.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:14 smithi173 ceph-mon[35349]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:15.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:15.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:35:17.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_2 2024-09-19T06:35:17.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:17 smithi016 ceph-mon[34911]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:17.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:17 smithi173 ceph-mon[35349]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:17.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:17 smithi012 ceph-mon[30937]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:17.379 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:35:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:35:17.067+0000 7fde94aad640 -1 osd.6 0 log_to_monitors true 2024-09-19T06:35:17.506 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:35:17.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 -- 172.21.15.16:0/4025592120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628101c00 msgr2=0x7f5628102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 --2- 172.21.15.16:0/4025592120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628101c00 0x7f5628102000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5618009900 tx=0x7f561802a410 comp rx=0 tx=0).stop 2024-09-19T06:35:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 -- 172.21.15.16:0/4025592120 shutdown_connections 2024-09-19T06:35:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 --2- 172.21.15.16:0/4025592120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56281037c0 0x7f562810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 --2- 172.21.15.16:0/4025592120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5628102e00 0x7f5628103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 --2- 172.21.15.16:0/4025592120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628101c00 0x7f5628102000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 -- 172.21.15.16:0/4025592120 >> 172.21.15.16:0/4025592120 conn(0x7f56280fd390 msgr2=0x7f56280ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:35:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 -- 172.21.15.16:0/4025592120 shutdown_connections 2024-09-19T06:35:17.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 -- 172.21.15.16:0/4025592120 wait complete. 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 Processor -- start 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.961+0000 7f562ff18640 1 -- start start 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562ff18640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5628101c00 0x7f5628197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562ff18640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628102e00 0x7f5628198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562ff18640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56281037c0 0x7f562819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562ff18640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f562810d880 con 0x7f56281037c0 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562ff18640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f562810d700 con 0x7f5628102e00 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562ff18640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f562810da00 con 0x7f5628101c00 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562d4b3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628102e00 0x7f5628198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562d4b3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628102e00 0x7f5628198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40222/0 (socket says 172.21.15.16:40222) 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562d4b3640 1 -- 172.21.15.16:0/3417872487 learned_addr learned my addr 172.21.15.16:0/3417872487 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562dcb4640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5628101c00 0x7f5628197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:17.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562e4b5640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56281037c0 0x7f562819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562d4b3640 1 -- 172.21.15.16:0/3417872487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5628101c00 msgr2=0x7f5628197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562d4b3640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5628101c00 0x7f5628197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562d4b3640 1 -- 172.21.15.16:0/3417872487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56281037c0 msgr2=0x7f562819f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562d4b3640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56281037c0 0x7f562819f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562d4b3640 1 -- 172.21.15.16:0/3417872487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562819fb70 con 0x7f5628102e00 2024-09-19T06:35:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562dcb4640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5628101c00 0x7f5628197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:35:17.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f562d4b3640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628102e00 0x7f5628198480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f562400d770 tx=0x7f562400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:35:17.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.962+0000 7f561effd640 1 -- 172.21.15.16:0/3417872487 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624017070 con 0x7f5628102e00 2024-09-19T06:35:17.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.963+0000 7f561effd640 1 -- 172.21.15.16:0/3417872487 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5624005500 con 0x7f5628102e00 2024-09-19T06:35:17.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.963+0000 7f562ff18640 1 -- 172.21.15.16:0/3417872487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562819fe60 con 0x7f5628102e00 2024-09-19T06:35:17.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.963+0000 7f561effd640 1 -- 172.21.15.16:0/3417872487 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624004e00 con 0x7f5628102e00 2024-09-19T06:35:17.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.963+0000 7f562ff18640 1 -- 172.21.15.16:0/3417872487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56281a02c0 con 0x7f5628102e00 2024-09-19T06:35:17.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.964+0000 7f562ff18640 1 -- 172.21.15.16:0/3417872487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5628109070 con 0x7f5628102e00 2024-09-19T06:35:17.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.965+0000 7f561effd640 1 -- 172.21.15.16:0/3417872487 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5624004fa0 con 0x7f5628102e00 2024-09-19T06:35:17.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.966+0000 7f561effd640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56140a3270 0x7f56140a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:17.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.966+0000 7f561effd640 1 -- 172.21.15.16:0/3417872487 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4648+0+0 (secure 0 0 0) 0x7f56240ce8a0 con 0x7f5628102e00 2024-09-19T06:35:17.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.966+0000 7f562dcb4640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56140a3270 0x7f56140a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:17.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.967+0000 7f562dcb4640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56140a3270 0x7f56140a5730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5618006010 tx=0x7f5618032cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:35:17.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:17.969+0000 7f561effd640 1 -- 172.21.15.16:0/3417872487 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f562409c410 con 0x7f5628102e00 2024-09-19T06:35:18.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:18.154+0000 7f562ff18640 1 -- 172.21.15.16:0/3417872487 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5628062630 con 0x7f56140a3270 2024-09-19T06:35:18.156 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:35:18.156 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.156 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.156 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.156 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.156 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.156 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.156 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:18.157 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:18.157 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.157 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:18.157 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:18.157 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:18.157 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:35:18.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:18.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:18.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:18.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:18.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:18.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:35:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:18.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:18.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:18.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:18.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:18.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:18.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:19.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi012 2024-09-19T06:35:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi012 to 5697M 2024-09-19T06:35:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:35:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T06:35:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:35:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:19.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:35:19.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:35:19.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:35:19.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:19.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi012 2024-09-19T06:35:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi012 to 5697M 2024-09-19T06:35:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:35:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T06:35:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:35:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:35:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:35:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:35:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:19.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:19.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi012 2024-09-19T06:35:19.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi012 to 5697M 2024-09-19T06:35:19.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:35:19.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T06:35:19.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:35:19.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:19.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:35:19.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:35:19.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:35:19.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:20 smithi012 ceph-mon[30937]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:35:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:20 smithi012 ceph-mon[30937]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T06:35:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:20 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:20 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:20 smithi012 ceph-mon[30937]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' 2024-09-19T06:35:20.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:35:19.837+0000 7fde91244640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T06:35:20.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:35:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:35:19.852+0000 7fde8883f640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:35:20.239 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:20 smithi016 ceph-mon[34911]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:35:20.240 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:20 smithi016 ceph-mon[34911]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T06:35:20.240 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:20 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:20.240 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:20 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:20.240 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:20 smithi016 ceph-mon[34911]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' 2024-09-19T06:35:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:20 smithi173 ceph-mon[35349]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:35:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:20 smithi173 ceph-mon[35349]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T06:35:20.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:20 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:20.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:20 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:20.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:20 smithi173 ceph-mon[35349]: from='osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084]' entity='osd.6' 2024-09-19T06:35:21.153 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:35:21.153 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:35:21.153 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:21.153 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:21.153 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: from='client.? 172.21.15.16:0/2432924182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "657d94ae-3aee-432c-84c1-1535d2806aa0"}]: dispatch 2024-09-19T06:35:21.153 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "657d94ae-3aee-432c-84c1-1535d2806aa0"}]: dispatch 2024-09-19T06:35:21.154 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "657d94ae-3aee-432c-84c1-1535d2806aa0"}]': finished 2024-09-19T06:35:21.154 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] boot 2024-09-19T06:35:21.154 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:35:21.154 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:21.154 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:21.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:35:21.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:35:21.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:21.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:21.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: from='client.? 172.21.15.16:0/2432924182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "657d94ae-3aee-432c-84c1-1535d2806aa0"}]: dispatch 2024-09-19T06:35:21.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "657d94ae-3aee-432c-84c1-1535d2806aa0"}]: dispatch 2024-09-19T06:35:21.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "657d94ae-3aee-432c-84c1-1535d2806aa0"}]': finished 2024-09-19T06:35:21.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] boot 2024-09-19T06:35:21.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:35:21.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:21.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:21.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:35:21.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:35:21.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:35:21.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:21.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: from='client.? 172.21.15.16:0/2432924182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "657d94ae-3aee-432c-84c1-1535d2806aa0"}]: dispatch 2024-09-19T06:35:21.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "657d94ae-3aee-432c-84c1-1535d2806aa0"}]: dispatch 2024-09-19T06:35:21.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "657d94ae-3aee-432c-84c1-1535d2806aa0"}]': finished 2024-09-19T06:35:21.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: osd.6 [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] boot 2024-09-19T06:35:21.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T06:35:21.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:35:21.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:22 smithi173 ceph-mon[35349]: from='client.? 172.21.15.16:0/1478302433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:35:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:22 smithi012 ceph-mon[30937]: from='client.? 172.21.15.16:0/1478302433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:35:22.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:22 smithi016 ceph-mon[34911]: from='client.? 172.21.15.16:0/1478302433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:35:23.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:23 smithi173 ceph-mon[35349]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:23 smithi173 ceph-mon[35349]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:35:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:23.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:23 smithi012 ceph-mon[30937]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:23.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:23 smithi012 ceph-mon[30937]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:35:23.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:23.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:23 smithi016 ceph-mon[34911]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:23 smithi016 ceph-mon[34911]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:35:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:25.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:25 smithi173 ceph-mon[35349]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:25.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:25 smithi012 ceph-mon[30937]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:25.387 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:25 smithi016 ceph-mon[34911]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:27.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:27 smithi016 ceph-mon[34911]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:27 smithi173 ceph-mon[35349]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:27 smithi012 ceph-mon[30937]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:29 smithi173 ceph-mon[35349]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:29.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:35:29.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:29.363 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:29 smithi016 ceph-mon[34911]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:29.363 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:35:29.363 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:29.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:29 smithi012 ceph-mon[30937]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:29.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:35:29.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:30.319 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:30 smithi016 ceph-mon[34911]: Deploying daemon osd.7 on smithi016 2024-09-19T06:35:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:30 smithi173 ceph-mon[35349]: Deploying daemon osd.7 on smithi016 2024-09-19T06:35:30.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:30 smithi012 ceph-mon[30937]: Deploying daemon osd.7 on smithi016 2024-09-19T06:35:31.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:31 smithi016 ceph-mon[34911]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:31.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:31 smithi173 ceph-mon[35349]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:31.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:31 smithi012 ceph-mon[30937]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:33.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:33 smithi173 ceph-mon[35349]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:33.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:33 smithi012 ceph-mon[30937]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:33.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:33 smithi016 ceph-mon[34911]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:35.326 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:35 smithi016 ceph-mon[34911]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:35.326 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:35.326 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:35.326 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:35.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:35 smithi173 ceph-mon[35349]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:35.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:35.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:35 smithi012 ceph-mon[30937]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:35.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:37.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:37 smithi016 ceph-mon[34911]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:37.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:37 smithi173 ceph-mon[35349]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:37.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:37 smithi012 ceph-mon[30937]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:38.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.578+0000 7f561effd640 1 -- 172.21.15.16:0/3417872487 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5628062630 con 0x7f56140a3270 2024-09-19T06:35:38.580 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 7 on host 'smithi016' 2024-09-19T06:35:38.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 -- 172.21.15.16:0/3417872487 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56140a3270 msgr2=0x7f56140a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:38.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56140a3270 0x7f56140a5730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5618006010 tx=0x7f5618032cf0 comp rx=0 tx=0).stop 2024-09-19T06:35:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 -- 172.21.15.16:0/3417872487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628102e00 msgr2=0x7f5628198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628102e00 0x7f5628198480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f562400d770 tx=0x7f562400dc30 comp rx=0 tx=0).stop 2024-09-19T06:35:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 -- 172.21.15.16:0/3417872487 shutdown_connections 2024-09-19T06:35:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f56140a3270 0x7f56140a5730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56281037c0 0x7f562819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628102e00 0x7f5628198480 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 --2- 172.21.15.16:0/3417872487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5628101c00 0x7f5628197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 -- 172.21.15.16:0/3417872487 >> 172.21.15.16:0/3417872487 conn(0x7f56280fd390 msgr2=0x7f5628106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:35:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 -- 172.21.15.16:0/3417872487 shutdown_connections 2024-09-19T06:35:38.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:35:38.580+0000 7f562ff18640 1 -- 172.21.15.16:0/3417872487 wait complete. 2024-09-19T06:35:38.892 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:38 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:38.893 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:38 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:38.893 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:38 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:38.893 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:38 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:38.893 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:38 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:38.893 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:38 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:38.893 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:38 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:38.893 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:38 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:38 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:38 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:38 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:39.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:38 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:39.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:38 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:38 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:39.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:38 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:38 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:38 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:38 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:38 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:38 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:38 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:38 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:38 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:38 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:39.239 DEBUG:teuthology.orchestra.run.smithi016:osd.7> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T06:35:39.281 INFO:tasks.cephadm:Deploying osd.8 on smithi173 with /dev/vg_nvme/lv_2... 2024-09-19T06:35:39.282 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:35:39.537 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:35:39.944 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:39 smithi173 ceph-mon[35349]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:40.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:39 smithi016 ceph-mon[34911]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:40.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:39 smithi012 ceph-mon[30937]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:41.509 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:35:41 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:35:41.190+0000 7f0ffe6fe640 -1 osd.7 0 log_to_monitors true 2024-09-19T06:35:41.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:41 smithi012 ceph-mon[30937]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:41.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:41 smithi012 ceph-mon[30937]: from='osd.7 [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:35:41.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:41 smithi012 ceph-mon[30937]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:35:41.999 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:41 smithi016 ceph-mon[34911]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:42.000 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:41 smithi016 ceph-mon[34911]: from='osd.7 [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:35:42.000 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:41 smithi016 ceph-mon[34911]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:35:42.021 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:41 smithi173 ceph-mon[35349]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:42.021 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:41 smithi173 ceph-mon[35349]: from='osd.7 [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:35:42.021 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:41 smithi173 ceph-mon[35349]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:35:42.023 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:35:42.052 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_2 2024-09-19T06:35:42.298 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:35:42.733 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:35:42.733 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='osd.7 [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:35:42.733 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T06:35:42.733 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:42.733 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:35:42.733 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:42.734 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:42.734 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:42.734 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:42.734 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:42.734 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:42.734 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:42.734 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:42.734 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:42.734 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:42 smithi173 ceph-mon[35349]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:35:42.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.731+0000 7f418a86b640 1 -- 172.21.15.173:0/1233474532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184102720 msgr2=0x7f4184104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:42.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.731+0000 7f418a86b640 1 --2- 172.21.15.173:0/1233474532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184102720 0x7f4184104b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4174009900 tx=0x7f417402a410 comp rx=0 tx=0).stop 2024-09-19T06:35:42.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.731+0000 7f418a86b640 1 -- 172.21.15.173:0/1233474532 shutdown_connections 2024-09-19T06:35:42.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.731+0000 7f418a86b640 1 --2- 172.21.15.173:0/1233474532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184107980 0x7f4184109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:42.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.731+0000 7f418a86b640 1 --2- 172.21.15.173:0/1233474532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184105050 0x7f4184107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:42.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.731+0000 7f418a86b640 1 --2- 172.21.15.173:0/1233474532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184102720 0x7f4184104b10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:42.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.731+0000 7f418a86b640 1 -- 172.21.15.173:0/1233474532 >> 172.21.15.173:0/1233474532 conn(0x7f41840fc2a0 msgr2=0x7f41840fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:35:42.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.731+0000 7f418a86b640 1 -- 172.21.15.173:0/1233474532 shutdown_connections 2024-09-19T06:35:42.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.731+0000 7f418a86b640 1 -- 172.21.15.173:0/1233474532 wait complete. 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f418a86b640 1 Processor -- start 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f418a86b640 1 -- start start 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f418a86b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102720 0x7f4184197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f418a86b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184105050 0x7f41841984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f418a86b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184107980 0x7f418419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f418a86b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f418410d920 con 0x7f4184105050 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f418a86b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f418410d7a0 con 0x7f4184102720 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f418a86b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f418410daa0 con 0x7f4184107980 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f4188e08640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184107980 0x7f418419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f4188e08640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184107980 0x7f418419f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34484/0 (socket says 172.21.15.173:34484) 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f4188e08640 1 -- 172.21.15.173:0/1082838451 learned_addr learned my addr 172.21.15.173:0/1082838451 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:35:42.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f41837fe640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184105050 0x7f41841984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f4183fff640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102720 0x7f4184197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f4188e08640 1 -- 172.21.15.173:0/1082838451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102720 msgr2=0x7f4184197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f4188e08640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102720 0x7f4184197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f4188e08640 1 -- 172.21.15.173:0/1082838451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184105050 msgr2=0x7f41841984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f4188e08640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184105050 0x7f41841984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.733+0000 7f4188e08640 1 -- 172.21.15.173:0/1082838451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418419fbd0 con 0x7f4184107980 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.734+0000 7f4188e08640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184107980 0x7f418419f560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b970 tx=0x7f417c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.734+0000 7f41817fa640 1 -- 172.21.15.173:0/1082838451 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c019070 con 0x7f4184107980 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.734+0000 7f41817fa640 1 -- 172.21.15.173:0/1082838451 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417c00cb40 con 0x7f4184107980 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.734+0000 7f418a86b640 1 -- 172.21.15.173:0/1082838451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418419fec0 con 0x7f4184107980 2024-09-19T06:35:42.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.734+0000 7f41817fa640 1 -- 172.21.15.173:0/1082838451 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c007650 con 0x7f4184107980 2024-09-19T06:35:42.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.734+0000 7f418a86b640 1 -- 172.21.15.173:0/1082838451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41841a03a0 con 0x7f4184107980 2024-09-19T06:35:42.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.735+0000 7f418a86b640 1 -- 172.21.15.173:0/1082838451 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41840fdd90 con 0x7f4184107980 2024-09-19T06:35:42.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.736+0000 7f41817fa640 1 -- 172.21.15.173:0/1082838451 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f417c01c070 con 0x7f4184107980 2024-09-19T06:35:42.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.737+0000 7f41817fa640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f416c0a3270 0x7f416c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:42.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.737+0000 7f41817fa640 1 -- 172.21.15.173:0/1082838451 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5117+0+0 (secure 0 0 0) 0x7f417c0ce6a0 con 0x7f4184107980 2024-09-19T06:35:42.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.737+0000 7f4183fff640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f416c0a3270 0x7f416c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:42.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.737+0000 7f4183fff640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f416c0a3270 0x7f416c0a5730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4174000c00 tx=0x7f41740315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:35:42.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.741+0000 7f41817fa640 1 -- 172.21.15.173:0/1082838451 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f417c09b9d0 con 0x7f4184107980 2024-09-19T06:35:42.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:35:42.917+0000 7f418a86b640 1 -- 172.21.15.173:0/1082838451 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4184062630 con 0x7f416c0a3270 2024-09-19T06:35:43.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:35:42.656+0000 7f0ff9e5e640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T06:35:43.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:35:42.667+0000 7f0ff6498640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:35:43.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:35:43.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='osd.7 [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:35:43.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T06:35:43.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:43.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:35:43.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:43.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:43.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:43.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:43.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:43.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:43.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:43.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:43.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:43.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:42 smithi016 ceph-mon[34911]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:35:43.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:35:43.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='osd.7 [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:35:43.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T06:35:43.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:43.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:35:43.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:43.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:43.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:43.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:43.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:43.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:43.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:43.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:43.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:35:43.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:42 smithi012 ceph-mon[30937]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:35:43.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:43 smithi173 ceph-mon[35349]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:43.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:43 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi016 2024-09-19T06:35:43.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:43 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi016 to 5697M 2024-09-19T06:35:43.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:43 smithi173 ceph-mon[35349]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T06:35:43.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:43.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:43.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:35:43.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:35:43.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:43 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:44.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:43 smithi016 ceph-mon[34911]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:43 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi016 2024-09-19T06:35:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:43 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi016 to 5697M 2024-09-19T06:35:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:43 smithi016 ceph-mon[34911]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T06:35:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:35:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:35:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:43 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:43 smithi012 ceph-mon[30937]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:43 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi016 2024-09-19T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:43 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi016 to 5697M 2024-09-19T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:43 smithi012 ceph-mon[30937]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:35:44.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:35:44.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:43 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:44.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:44 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:35:44.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:44 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:35:44.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:44 smithi173 ceph-mon[35349]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:35:44.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:44 smithi173 ceph-mon[35349]: osd.7 [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] boot 2024-09-19T06:35:44.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:44 smithi173 ceph-mon[35349]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T06:35:44.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:44 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:44.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:44 smithi173 ceph-mon[35349]: pgmap v170: 1 pgs: 1 unknown; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:44.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:44 smithi173 ceph-mon[35349]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T06:35:45.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:44 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:35:45.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:44 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:35:45.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:44 smithi016 ceph-mon[34911]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:35:45.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:44 smithi016 ceph-mon[34911]: osd.7 [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] boot 2024-09-19T06:35:45.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:44 smithi016 ceph-mon[34911]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T06:35:45.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:44 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:45.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:44 smithi016 ceph-mon[34911]: pgmap v170: 1 pgs: 1 unknown; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:45.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:44 smithi016 ceph-mon[34911]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T06:35:45.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:44 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:35:45.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:44 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:35:45.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:44 smithi012 ceph-mon[30937]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:35:45.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:44 smithi012 ceph-mon[30937]: osd.7 [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] boot 2024-09-19T06:35:45.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:44 smithi012 ceph-mon[30937]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T06:35:45.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:35:45.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:44 smithi012 ceph-mon[30937]: pgmap v170: 1 pgs: 1 unknown; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:35:45.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:44 smithi012 ceph-mon[30937]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T06:35:46.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:45 smithi016 ceph-mon[34911]: from='client.? 172.21.15.173:0/4008899979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d"}]: dispatch 2024-09-19T06:35:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:45 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d"}]: dispatch 2024-09-19T06:35:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:45 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d"}]': finished 2024-09-19T06:35:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:45 smithi016 ceph-mon[34911]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:35:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:35:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:45 smithi016 ceph-mon[34911]: from='client.? 172.21.15.173:0/2009147550' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:35:46.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:45 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/4008899979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d"}]: dispatch 2024-09-19T06:35:46.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:45 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d"}]: dispatch 2024-09-19T06:35:46.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:45 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d"}]': finished 2024-09-19T06:35:46.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:45 smithi173 ceph-mon[35349]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:35:46.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:35:46.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:45 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/2009147550' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:35:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:45 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/4008899979' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d"}]: dispatch 2024-09-19T06:35:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:45 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d"}]: dispatch 2024-09-19T06:35:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:45 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d"}]': finished 2024-09-19T06:35:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:45 smithi012 ceph-mon[30937]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T06:35:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:35:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:45 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/2009147550' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:35:47.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:47 smithi173 ceph-mon[35349]: pgmap v173: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:47.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:47 smithi173 ceph-mon[35349]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:35:47.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:47 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:35:47.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:47 smithi012 ceph-mon[30937]: pgmap v173: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:47.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:47 smithi012 ceph-mon[30937]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:35:47.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:47 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:35:47.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:47 smithi016 ceph-mon[34911]: pgmap v173: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:47.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:47 smithi016 ceph-mon[34911]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:35:47.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:47 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:35:48.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:48 smithi173 ceph-mon[35349]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:35:48.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:48 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:35:48.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:48 smithi012 ceph-mon[30937]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:35:48.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:48 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:35:48.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:48 smithi016 ceph-mon[34911]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:35:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:48 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:35:49.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:49 smithi173 ceph-mon[35349]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:49.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:49 smithi012 ceph-mon[30937]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:49.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:49 smithi016 ceph-mon[34911]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:51.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:51 smithi173 ceph-mon[35349]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:51.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:51 smithi012 ceph-mon[30937]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:51.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:51 smithi016 ceph-mon[34911]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:53.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:53 smithi012 ceph-mon[30937]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:53.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:53 smithi173 ceph-mon[35349]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:53 smithi016 ceph-mon[34911]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:54.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:54 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:35:54.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:54 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:54.294 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:54 smithi173 ceph-mon[35349]: Deploying daemon osd.8 on smithi173 2024-09-19T06:35:54.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:54 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:35:54.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:54 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:54.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:54 smithi012 ceph-mon[30937]: Deploying daemon osd.8 on smithi173 2024-09-19T06:35:54.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:54 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:35:54.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:54 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:54.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:54 smithi016 ceph-mon[34911]: Deploying daemon osd.8 on smithi173 2024-09-19T06:35:55.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:55 smithi173 ceph-mon[35349]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:55 smithi012 ceph-mon[30937]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:55.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:55 smithi016 ceph-mon[34911]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:57.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:57 smithi173 ceph-mon[35349]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:57 smithi012 ceph-mon[30937]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:57.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:57 smithi016 ceph-mon[34911]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:59.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:35:59 smithi173 ceph-mon[35349]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:59.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:35:59 smithi012 ceph-mon[30937]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:35:59.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:35:59 smithi016 ceph-mon[34911]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:00.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:00.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:00.244 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:00.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:01.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:01 smithi173 ceph-mon[35349]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:01.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:01 smithi016 ceph-mon[34911]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:01.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:01 smithi012 ceph-mon[30937]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.568+0000 7f41817fa640 1 -- 172.21.15.173:0/1082838451 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4184062630 con 0x7f416c0a3270 2024-09-19T06:36:02.570 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 8 on host 'smithi173' 2024-09-19T06:36:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 -- 172.21.15.173:0/1082838451 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f416c0a3270 msgr2=0x7f416c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f416c0a3270 0x7f416c0a5730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4174000c00 tx=0x7f41740315d0 comp rx=0 tx=0).stop 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 -- 172.21.15.173:0/1082838451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184107980 msgr2=0x7f418419f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184107980 0x7f418419f560 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b970 tx=0x7f417c00be30 comp rx=0 tx=0).stop 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 -- 172.21.15.173:0/1082838451 shutdown_connections 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f416c0a3270 0x7f416c0a5730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184107980 0x7f418419f560 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184105050 0x7f41841984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 --2- 172.21.15.173:0/1082838451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102720 0x7f4184197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 -- 172.21.15.173:0/1082838451 >> 172.21.15.173:0/1082838451 conn(0x7f41840fc2a0 msgr2=0x7f41841030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 -- 172.21.15.173:0/1082838451 shutdown_connections 2024-09-19T06:36:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:02.570+0000 7f418a86b640 1 -- 172.21.15.173:0/1082838451 wait complete. 2024-09-19T06:36:02.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:02.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:02.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:02.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:02.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:02.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:02.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:02.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:02 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:02 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:02 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:02 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:02 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:02 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:02 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:02 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:03.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:03.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:03.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:03.152 DEBUG:teuthology.orchestra.run.smithi173:osd.8> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T06:36:03.154 INFO:tasks.cephadm:Deploying osd.9 on smithi012 with /dev/vg_nvme/lv_1... 2024-09-19T06:36:03.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:36:03.422 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:36:03.720 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:03 smithi173 ceph-mon[35349]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:03.840 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:03 smithi012 ceph-mon[30937]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:04.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:03 smithi016 ceph-mon[34911]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:05.651 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:36:05 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:36:05.466+0000 7fb416baa640 -1 osd.8 0 log_to_monitors true 2024-09-19T06:36:05.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:05 smithi173 ceph-mon[35349]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:05.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:05 smithi173 ceph-mon[35349]: from='osd.8 [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:36:05.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:05 smithi173 ceph-mon[35349]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:36:05.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:05 smithi012 ceph-mon[30937]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:05.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:05 smithi012 ceph-mon[30937]: from='osd.8 [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:36:05.970 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:05 smithi012 ceph-mon[30937]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:36:05.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:36:06.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_1 2024-09-19T06:36:06.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:05 smithi016 ceph-mon[34911]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:06.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:05 smithi016 ceph-mon[34911]: from='osd.8 [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:36:06.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:05 smithi016 ceph-mon[34911]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:36:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:36:06.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.727+0000 7ff92ef2b640 1 -- 172.21.15.12:0/663548415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9281037c0 msgr2=0x7ff92810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:06.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.727+0000 7ff92ef2b640 1 --2- 172.21.15.12:0/663548415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9281037c0 0x7ff92810a050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff920009ca0 tx=0x7ff92002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:36:06.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.727+0000 7ff92ef2b640 1 -- 172.21.15.12:0/663548415 shutdown_connections 2024-09-19T06:36:06.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 --2- 172.21.15.12:0/663548415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9281037c0 0x7ff92810a050 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:06.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 --2- 172.21.15.12:0/663548415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff928102e00 0x7ff928103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:06.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 --2- 172.21.15.12:0/663548415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff928101c00 0x7ff928102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:06.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 -- 172.21.15.12:0/663548415 >> 172.21.15.12:0/663548415 conn(0x7ff9280fd3b0 msgr2=0x7ff9280ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:06.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 -- 172.21.15.12:0/663548415 shutdown_connections 2024-09-19T06:36:06.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 -- 172.21.15.12:0/663548415 wait complete. 2024-09-19T06:36:06.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 Processor -- start 2024-09-19T06:36:06.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 -- start start 2024-09-19T06:36:06.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff928101c00 0x7ff928197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:06.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff928102e00 0x7ff9281983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:06.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9281037c0 0x7ff92819f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:06.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810d880 con 0x7ff9281037c0 2024-09-19T06:36:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810d700 con 0x7ff928101c00 2024-09-19T06:36:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.728+0000 7ff92ef2b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810da00 con 0x7ff928102e00 2024-09-19T06:36:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92d4c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9281037c0 0x7ff92819f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92d4c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9281037c0 0x7ff92819f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46108/0 (socket says 172.21.15.12:46108) 2024-09-19T06:36:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92d4c8640 1 -- 172.21.15.12:0/2903452441 learned_addr learned my addr 172.21.15.12:0/2903452441 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:36:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff927fff640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff928102e00 0x7ff9281983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92ccc7640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff928101c00 0x7ff928197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:06.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92d4c8640 1 -- 172.21.15.12:0/2903452441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff928102e00 msgr2=0x7ff9281983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:06.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92d4c8640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff928102e00 0x7ff9281983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:06.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92d4c8640 1 -- 172.21.15.12:0/2903452441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff928101c00 msgr2=0x7ff928197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92d4c8640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff928101c00 0x7ff928197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92d4c8640 1 -- 172.21.15.12:0/2903452441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92819faa0 con 0x7ff9281037c0 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92d4c8640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9281037c0 0x7ff92819f430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff920005e30 tx=0x7ff920031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff925ffb640 1 -- 172.21.15.12:0/2903452441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920003c30 con 0x7ff9281037c0 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff925ffb640 1 -- 172.21.15.12:0/2903452441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff920003dd0 con 0x7ff9281037c0 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff92ef2b640 1 -- 172.21.15.12:0/2903452441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92819fd30 con 0x7ff9281037c0 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.729+0000 7ff925ffb640 1 -- 172.21.15.12:0/2903452441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92002fde0 con 0x7ff9281037c0 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.730+0000 7ff92ef2b640 1 -- 172.21.15.12:0/2903452441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9281a0210 con 0x7ff9281037c0 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.731+0000 7ff92ef2b640 1 -- 172.21.15.12:0/2903452441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff928108f30 con 0x7ff9281037c0 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.732+0000 7ff925ffb640 1 -- 172.21.15.12:0/2903452441 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff920004050 con 0x7ff9281037c0 2024-09-19T06:36:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.733+0000 7ff925ffb640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff9180a3270 0x7ff9180a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.733+0000 7ff92ccc7640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff9180a3270 0x7ff9180a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.733+0000 7ff925ffb640 1 -- 172.21.15.12:0/2903452441 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5549+0+0 (secure 0 0 0) 0x7ff9200f0060 con 0x7ff9281037c0 2024-09-19T06:36:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.733+0000 7ff92ccc7640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff9180a3270 0x7ff9180a5730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff928102c60 tx=0x7ff91c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.737+0000 7ff925ffb640 1 -- 172.21.15.12:0/2903452441 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9200bd7b0 con 0x7ff9281037c0 2024-09-19T06:36:06.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:06.922+0000 7ff92ef2b640 1 -- 172.21.15.12:0/2903452441 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff928062630 con 0x7ff9180a3270 2024-09-19T06:36:06.924 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:36:06.924 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='osd.8 [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:36:06.924 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T06:36:06.924 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:06.924 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:36:06.924 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:06.924 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:06.924 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:06.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:06.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:06.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:06.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:06.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:06.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:06.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:36:06.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T06:36:06.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:06 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:36:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='osd.8 [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:36:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T06:36:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:36:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:07.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:07.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:07.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:07.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:07.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:07.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:36:07.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T06:36:07.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:06 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:07.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:36:06.653+0000 7fb41230a640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T06:36:07.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:36:06.665+0000 7fb40e944640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:36:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='osd.8 [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:36:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T06:36:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:36:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:07.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:07.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:07.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:07.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:07.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:07.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:36:07.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T06:36:07.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:06 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:07 smithi016 ceph-mon[34911]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:07 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi173 2024-09-19T06:36:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:07 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-19T06:36:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:07 smithi016 ceph-mon[34911]: osd.8 [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] boot 2024-09-19T06:36:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:07 smithi016 ceph-mon[34911]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:36:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:08.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:07 smithi012 ceph-mon[30937]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:08.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:07 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi173 2024-09-19T06:36:08.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:07 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-19T06:36:08.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:08.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:08.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:08.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:08.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:07 smithi012 ceph-mon[30937]: osd.8 [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] boot 2024-09-19T06:36:08.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:07 smithi012 ceph-mon[30937]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:36:08.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:08.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:07 smithi173 ceph-mon[35349]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:07 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi173 2024-09-19T06:36:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:07 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-19T06:36:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:07 smithi173 ceph-mon[35349]: osd.8 [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] boot 2024-09-19T06:36:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:07 smithi173 ceph-mon[35349]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:36:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:36:08.837 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:08 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:36:08.837 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:08 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:36:08.837 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:08 smithi012 ceph-mon[30937]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:09.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:08 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:36:09.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:08 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:36:09.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:08 smithi016 ceph-mon[34911]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:09.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:08 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:36:09.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:08 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:36:09.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:08 smithi173 ceph-mon[35349]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:10.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:09 smithi016 ceph-mon[34911]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:10.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:09 smithi016 ceph-mon[34911]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T06:36:10.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:09 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/563702289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74fa5ae1-a2ed-45df-9456-d1b8b9cdd961"}]: dispatch 2024-09-19T06:36:10.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:09 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/563702289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74fa5ae1-a2ed-45df-9456-d1b8b9cdd961"}]': finished 2024-09-19T06:36:10.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:09 smithi016 ceph-mon[34911]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:36:10.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:10.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:09 smithi173 ceph-mon[35349]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:10.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:09 smithi173 ceph-mon[35349]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T06:36:10.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:09 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/563702289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74fa5ae1-a2ed-45df-9456-d1b8b9cdd961"}]: dispatch 2024-09-19T06:36:10.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:09 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/563702289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74fa5ae1-a2ed-45df-9456-d1b8b9cdd961"}]': finished 2024-09-19T06:36:10.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:09 smithi173 ceph-mon[35349]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:36:10.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:10.124 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:09 smithi012 ceph-mon[30937]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:36:10.124 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:09 smithi012 ceph-mon[30937]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T06:36:10.124 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:09 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/563702289' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "74fa5ae1-a2ed-45df-9456-d1b8b9cdd961"}]: dispatch 2024-09-19T06:36:10.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:09 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/563702289' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74fa5ae1-a2ed-45df-9456-d1b8b9cdd961"}]': finished 2024-09-19T06:36:10.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:09 smithi012 ceph-mon[30937]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T06:36:10.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:11.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:10 smithi016 ceph-mon[34911]: pgmap v192: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T06:36:11.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:10 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1276499396' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:36:11.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:10 smithi173 ceph-mon[35349]: pgmap v192: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T06:36:11.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:10 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1276499396' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:36:11.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:10 smithi012 ceph-mon[30937]: pgmap v192: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T06:36:11.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:10 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1276499396' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:36:12.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:11 smithi016 ceph-mon[34911]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T06:36:12.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:11 smithi016 ceph-mon[34911]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:36:12.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:11 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:12.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:11 smithi173 ceph-mon[35349]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T06:36:12.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:11 smithi173 ceph-mon[35349]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:36:12.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:11 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:12.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:11 smithi012 ceph-mon[30937]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T06:36:12.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:11 smithi012 ceph-mon[30937]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:36:12.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:11 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:13.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:12 smithi016 ceph-mon[34911]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T06:36:13.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:12 smithi016 ceph-mon[34911]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:36:13.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:12 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:13.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:12 smithi173 ceph-mon[35349]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T06:36:13.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:12 smithi173 ceph-mon[35349]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:36:13.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:12 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:13.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:12 smithi012 ceph-mon[30937]: pgmap v194: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T06:36:13.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:12 smithi012 ceph-mon[30937]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:36:13.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:12 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:14 smithi012 ceph-mon[30937]: pgmap v196: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T06:36:15.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:14 smithi173 ceph-mon[35349]: pgmap v196: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T06:36:15.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:14 smithi016 ceph-mon[34911]: pgmap v196: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T06:36:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:15 smithi173 ceph-mon[35349]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T06:36:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:15 smithi173 ceph-mon[35349]: Cluster is now healthy 2024-09-19T06:36:16.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:15 smithi012 ceph-mon[30937]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T06:36:16.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:15 smithi012 ceph-mon[30937]: Cluster is now healthy 2024-09-19T06:36:16.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:15 smithi016 ceph-mon[34911]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T06:36:16.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:15 smithi016 ceph-mon[34911]: Cluster is now healthy 2024-09-19T06:36:16.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:16 smithi012 ceph-mon[30937]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T06:36:17.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:16 smithi173 ceph-mon[35349]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T06:36:17.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:16 smithi016 ceph-mon[34911]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T06:36:19.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:18 smithi173 ceph-mon[35349]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:36:19.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:18 smithi012 ceph-mon[30937]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:36:19.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:18 smithi016 ceph-mon[34911]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:36:20.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:36:20.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:20.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:19 smithi173 ceph-mon[35349]: Deploying daemon osd.9 on smithi012 2024-09-19T06:36:20.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:36:20.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:20.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:19 smithi012 ceph-mon[30937]: Deploying daemon osd.9 on smithi012 2024-09-19T06:36:20.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:36:20.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:20.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:19 smithi016 ceph-mon[34911]: Deploying daemon osd.9 on smithi012 2024-09-19T06:36:21.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:20 smithi012 ceph-mon[30937]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T06:36:21.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:20 smithi173 ceph-mon[35349]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T06:36:21.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:20 smithi016 ceph-mon[34911]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T06:36:22.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:22 smithi012 ceph-mon[30937]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:36:23.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:22 smithi173 ceph-mon[35349]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:36:23.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:22 smithi016 ceph-mon[34911]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:36:25.073 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:24 smithi012 ceph-mon[30937]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:36:25.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:24 smithi016 ceph-mon[34911]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:36:25.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:24 smithi173 ceph-mon[35349]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:36:26.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:25 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:26.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:25 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:26.061 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:25 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:25 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:25 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:25 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:25 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:25 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:25 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:27 smithi012 ceph-mon[30937]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:36:27.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:27 smithi173 ceph-mon[35349]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:36:27.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:27 smithi016 ceph-mon[34911]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:36:28.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.965+0000 7ff925ffb640 1 -- 172.21.15.12:0/2903452441 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff928062630 con 0x7ff9180a3270 2024-09-19T06:36:28.967 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 9 on host 'smithi012' 2024-09-19T06:36:28.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.967+0000 7ff92ef2b640 1 -- 172.21.15.12:0/2903452441 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff9180a3270 msgr2=0x7ff9180a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:28.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.967+0000 7ff92ef2b640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff9180a3270 0x7ff9180a5730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff928102c60 tx=0x7ff91c00b390 comp rx=0 tx=0).stop 2024-09-19T06:36:28.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.967+0000 7ff92ef2b640 1 -- 172.21.15.12:0/2903452441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9281037c0 msgr2=0x7ff92819f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:28.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.967+0000 7ff92ef2b640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9281037c0 0x7ff92819f430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff920005e30 tx=0x7ff920031ee0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.968+0000 7ff92ef2b640 1 -- 172.21.15.12:0/2903452441 shutdown_connections 2024-09-19T06:36:28.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.968+0000 7ff92ef2b640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff9180a3270 0x7ff9180a5730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.968+0000 7ff92ef2b640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9281037c0 0x7ff92819f430 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.968+0000 7ff92ef2b640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff928102e00 0x7ff9281983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.968+0000 7ff92ef2b640 1 --2- 172.21.15.12:0/2903452441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff928101c00 0x7ff928197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.968+0000 7ff92ef2b640 1 -- 172.21.15.12:0/2903452441 >> 172.21.15.12:0/2903452441 conn(0x7ff9280fd3b0 msgr2=0x7ff928106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:28.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.968+0000 7ff92ef2b640 1 -- 172.21.15.12:0/2903452441 shutdown_connections 2024-09-19T06:36:28.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:36:28.968+0000 7ff92ef2b640 1 -- 172.21.15.12:0/2903452441 wait complete. 2024-09-19T06:36:29.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:29 smithi012 ceph-mon[30937]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:29.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:29.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:29.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:29.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:29 smithi016 ceph-mon[34911]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:29.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:29.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:29.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:29.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:29 smithi173 ceph-mon[35349]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:29.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:29.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:29.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:29.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:29.607 DEBUG:teuthology.orchestra.run.smithi012:osd.9> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T06:36:29.610 INFO:tasks.cephadm:Deploying osd.10 on smithi016 with /dev/vg_nvme/lv_1... 2024-09-19T06:36:29.610 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:36:29.876 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:36:31.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:31 smithi012 ceph-mon[30937]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:31.233 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:31 smithi016 ceph-mon[34911]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:31.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:31 smithi173 ceph-mon[35349]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:31.879 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:36:31 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:36:31.496+0000 7f2277618640 -1 osd.9 0 log_to_monitors true 2024-09-19T06:36:32.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:32 smithi012 ceph-mon[30937]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:36:32.446 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:32 smithi016 ceph-mon[34911]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:36:32.450 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-09-19T06:36:32.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi016:vg_nvme/lv_1 2024-09-19T06:36:32.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:32 smithi173 ceph-mon[35349]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:36:32.739 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:36:33.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.196+0000 7f1201e45640 1 -- 172.21.15.16:0/439974872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11fc102690 msgr2=0x7f11fc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:33.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.196+0000 7f1201e45640 1 --2- 172.21.15.16:0/439974872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11fc102690 0x7f11fc108f20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009ca0 tx=0x7f11f402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.196+0000 7f1201e45640 1 -- 172.21.15.16:0/439974872 shutdown_connections 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.196+0000 7f1201e45640 1 --2- 172.21.15.16:0/439974872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11fc102690 0x7f11fc108f20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.196+0000 7f1201e45640 1 --2- 172.21.15.16:0/439974872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11fc101cd0 0x7f11fc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.196+0000 7f1201e45640 1 --2- 172.21.15.16:0/439974872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11fc100ad0 0x7f11fc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.196+0000 7f1201e45640 1 -- 172.21.15.16:0/439974872 >> 172.21.15.16:0/439974872 conn(0x7f11fc0fc280 msgr2=0x7f11fc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.196+0000 7f1201e45640 1 -- 172.21.15.16:0/439974872 shutdown_connections 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.196+0000 7f1201e45640 1 -- 172.21.15.16:0/439974872 wait complete. 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f1201e45640 1 Processor -- start 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f1201e45640 1 -- start start 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f1201e45640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11fc100ad0 0x7f11fc19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:33.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f1201e45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11fc101cd0 0x7f11fc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f1201e45640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11fc102690 0x7f11fc1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f1201e45640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f11fc10c730 con 0x7f11fc102690 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f1201e45640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f11fc10c5b0 con 0x7f11fc101cd0 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f1201e45640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11fc10c8b0 con 0x7f11fc100ad0 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f11f2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11fc101cd0 0x7f11fc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f11f2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11fc101cd0 0x7f11fc19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49536/0 (socket says 172.21.15.16:49536) 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f11f2ffd640 1 -- 172.21.15.16:0/867729133 learned_addr learned my addr 172.21.15.16:0/867729133 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f11fb7fe640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11fc100ad0 0x7f11fc19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.197+0000 7f11fbfff640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11fc102690 0x7f11fc1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f11f2ffd640 1 -- 172.21.15.16:0/867729133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11fc100ad0 msgr2=0x7f11fc19a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:33.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f11f2ffd640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11fc100ad0 0x7f11fc19a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:33.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f11f2ffd640 1 -- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11fc102690 msgr2=0x7f11fc1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:33.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f11f2ffd640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11fc102690 0x7f11fc1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:33.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f11f2ffd640 1 -- 172.21.15.16:0/867729133 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11fc1a1c80 con 0x7f11fc101cd0 2024-09-19T06:36:33.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f11fbfff640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11fc102690 0x7f11fc1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:36:33.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f11f2ffd640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11fc101cd0 0x7f11fc19a590 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f11e400e9f0 tx=0x7f11e400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:33.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f11f97fa640 1 -- 172.21.15.16:0/867729133 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e400cd80 con 0x7f11fc101cd0 2024-09-19T06:36:33.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f11f97fa640 1 -- 172.21.15.16:0/867729133 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11e4010910 con 0x7f11fc101cd0 2024-09-19T06:36:33.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f1201e45640 1 -- 172.21.15.16:0/867729133 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11fc1a1f70 con 0x7f11fc101cd0 2024-09-19T06:36:33.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f11f97fa640 1 -- 172.21.15.16:0/867729133 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e4018990 con 0x7f11fc101cd0 2024-09-19T06:36:33.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.198+0000 7f1201e45640 1 -- 172.21.15.16:0/867729133 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11fc1a2420 con 0x7f11fc101cd0 2024-09-19T06:36:33.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.199+0000 7f1201e45640 1 -- 172.21.15.16:0/867729133 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11fc1a2710 con 0x7f11fc101cd0 2024-09-19T06:36:33.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.200+0000 7f11f97fa640 1 -- 172.21.15.16:0/867729133 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f11e4010ac0 con 0x7f11fc101cd0 2024-09-19T06:36:33.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.201+0000 7f11f97fa640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f11e80a3270 0x7f11e80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:33.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.201+0000 7f11f97fa640 1 -- 172.21.15.16:0/867729133 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5981+0+0 (secure 0 0 0) 0x7f11e40cf370 con 0x7f11fc101cd0 2024-09-19T06:36:33.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.201+0000 7f11fb7fe640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f11e80a3270 0x7f11e80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:33.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.202+0000 7f11fb7fe640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f11e80a3270 0x7f11e80a5730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11fc101b30 tx=0x7f11ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:33.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.205+0000 7f11f97fa640 1 -- 172.21.15.16:0/867729133 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f11e409c9b0 con 0x7f11fc101cd0 2024-09-19T06:36:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:33.391+0000 7f1201e45640 1 -- 172.21.15.16:0/867729133 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f11fc0fe4b0 con 0x7f11e80a3270 2024-09-19T06:36:33.393 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:33.393 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:36:33.393 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T06:36:33.393 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi012 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:33.394 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:33.395 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.484 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:33.484 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:36:33.484 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T06:36:33.484 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi012 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:33.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:33.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.629 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:36:33.131+0000 7f2272d78640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T06:36:33.629 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:36:33.148+0000 7f226f3b2640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:33.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:33.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:36:33.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi012 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:33.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:33.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:34.441 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:34 smithi016 ceph-mon[34911]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:36:34.441 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:34 smithi016 ceph-mon[34911]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T06:36:34.441 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:34.441 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:34.441 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:34 smithi016 ceph-mon[34911]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:34.442 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:34.442 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:34.442 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:34 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:34.499 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:34 smithi173 ceph-mon[35349]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:36:34.499 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:34 smithi173 ceph-mon[35349]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T06:36:34.499 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:34.499 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:34.500 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:34 smithi173 ceph-mon[35349]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:34.500 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:34.500 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:34.500 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:34 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:34 smithi012 ceph-mon[30937]: from='osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-19T06:36:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:34 smithi012 ceph-mon[30937]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T06:36:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:34 smithi012 ceph-mon[30937]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:34 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:35.401 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:35 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:36:35.401 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:35 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:36:35.402 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:35 smithi016 ceph-mon[34911]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:35.402 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:35.402 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:35 smithi016 ceph-mon[34911]: osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] boot 2024-09-19T06:36:35.402 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:35 smithi016 ceph-mon[34911]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T06:36:35.402 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:35.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:35 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:36:35.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:35 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:36:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:35 smithi173 ceph-mon[35349]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:35 smithi173 ceph-mon[35349]: osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] boot 2024-09-19T06:36:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:35 smithi173 ceph-mon[35349]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T06:36:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:35 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:36:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:35 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:36:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:35 smithi012 ceph-mon[30937]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:36:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:35 smithi012 ceph-mon[30937]: osd.9 [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] boot 2024-09-19T06:36:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:35 smithi012 ceph-mon[30937]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T06:36:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:36:36.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:36 smithi016 ceph-mon[34911]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T06:36:36.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:36 smithi016 ceph-mon[34911]: from='client.? 172.21.15.16:0/4061044434' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2491092-90ed-40f4-ac16-0b21acb8da6b"}]: dispatch 2024-09-19T06:36:36.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:36 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2491092-90ed-40f4-ac16-0b21acb8da6b"}]: dispatch 2024-09-19T06:36:36.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:36 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2491092-90ed-40f4-ac16-0b21acb8da6b"}]': finished 2024-09-19T06:36:36.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:36 smithi016 ceph-mon[34911]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:36:36.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:36 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:36.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:36 smithi173 ceph-mon[35349]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T06:36:36.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:36 smithi173 ceph-mon[35349]: from='client.? 172.21.15.16:0/4061044434' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2491092-90ed-40f4-ac16-0b21acb8da6b"}]: dispatch 2024-09-19T06:36:36.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:36 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2491092-90ed-40f4-ac16-0b21acb8da6b"}]: dispatch 2024-09-19T06:36:36.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:36 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2491092-90ed-40f4-ac16-0b21acb8da6b"}]': finished 2024-09-19T06:36:36.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:36 smithi173 ceph-mon[35349]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:36:36.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:36 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:36.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:36 smithi012 ceph-mon[30937]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T06:36:36.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:36 smithi012 ceph-mon[30937]: from='client.? 172.21.15.16:0/4061044434' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2491092-90ed-40f4-ac16-0b21acb8da6b"}]: dispatch 2024-09-19T06:36:36.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:36 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d2491092-90ed-40f4-ac16-0b21acb8da6b"}]: dispatch 2024-09-19T06:36:36.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:36 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2491092-90ed-40f4-ac16-0b21acb8da6b"}]': finished 2024-09-19T06:36:36.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:36 smithi012 ceph-mon[30937]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:36:36.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:36 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:37.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:37 smithi016 ceph-mon[34911]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:37.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:37 smithi016 ceph-mon[34911]: from='client.? 172.21.15.16:0/1630089157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:36:37.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:37 smithi173 ceph-mon[35349]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:37.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:37 smithi173 ceph-mon[35349]: from='client.? 172.21.15.16:0/1630089157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:36:37.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:37 smithi012 ceph-mon[30937]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:37.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:37 smithi012 ceph-mon[30937]: from='client.? 172.21.15.16:0/1630089157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:36:39.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:39 smithi016 ceph-mon[34911]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:39.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:39 smithi173 ceph-mon[35349]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:39.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:39 smithi012 ceph-mon[30937]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:41.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:41 smithi016 ceph-mon[34911]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:41.431 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:41 smithi012 ceph-mon[30937]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:41.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:41 smithi173 ceph-mon[35349]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:43.443 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:43 smithi016 ceph-mon[34911]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:43.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:43 smithi173 ceph-mon[35349]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:43.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:43 smithi012 ceph-mon[30937]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:45.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:45 smithi016 ceph-mon[34911]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:36:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:45 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:45 smithi016 ceph-mon[34911]: Deploying daemon osd.10 on smithi016 2024-09-19T06:36:45.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:45 smithi173 ceph-mon[35349]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:45.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:36:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:45 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:45.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:45 smithi173 ceph-mon[35349]: Deploying daemon osd.10 on smithi016 2024-09-19T06:36:45.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:45 smithi012 ceph-mon[30937]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:45.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:36:45.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:45 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:45.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:45 smithi012 ceph-mon[30937]: Deploying daemon osd.10 on smithi016 2024-09-19T06:36:47.255 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:47 smithi016 ceph-mon[34911]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:47.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:47 smithi173 ceph-mon[35349]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:47.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:47 smithi012 ceph-mon[30937]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:49.256 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:49 smithi016 ceph-mon[34911]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:49.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:49 smithi173 ceph-mon[35349]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:49 smithi012 ceph-mon[30937]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:50.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:50.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:50.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:50.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:50.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:50.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:50.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:51.483 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:51 smithi016 ceph-mon[34911]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:51.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:51 smithi173 ceph-mon[35349]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:51.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:51 smithi012 ceph-mon[30937]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:53.177 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 10 on host 'smithi016' 2024-09-19T06:36:53.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.176+0000 7f11f97fa640 1 -- 172.21.15.16:0/867729133 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f11fc0fe4b0 con 0x7f11e80a3270 2024-09-19T06:36:53.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.178+0000 7f1201e45640 1 -- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f11e80a3270 msgr2=0x7f11e80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.178+0000 7f1201e45640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f11e80a3270 0x7f11e80a5730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11fc101b30 tx=0x7f11ec00b390 comp rx=0 tx=0).stop 2024-09-19T06:36:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.178+0000 7f1201e45640 1 -- 172.21.15.16:0/867729133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11fc101cd0 msgr2=0x7f11fc19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.178+0000 7f1201e45640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11fc101cd0 0x7f11fc19a590 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f11e400e9f0 tx=0x7f11e400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:36:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.179+0000 7f1201e45640 1 -- 172.21.15.16:0/867729133 shutdown_connections 2024-09-19T06:36:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.179+0000 7f1201e45640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f11e80a3270 0x7f11e80a5730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.179+0000 7f1201e45640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11fc102690 0x7f11fc1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:53.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.179+0000 7f1201e45640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11fc101cd0 0x7f11fc19a590 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:53.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.179+0000 7f1201e45640 1 --2- 172.21.15.16:0/867729133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11fc100ad0 0x7f11fc19a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:53.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.179+0000 7f1201e45640 1 -- 172.21.15.16:0/867729133 >> 172.21.15.16:0/867729133 conn(0x7f11fc0fc280 msgr2=0x7f11fc0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:53.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.179+0000 7f1201e45640 1 -- 172.21.15.16:0/867729133 shutdown_connections 2024-09-19T06:36:53.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-09-19T06:36:53.179+0000 7f1201e45640 1 -- 172.21.15.16:0/867729133 wait complete. 2024-09-19T06:36:53.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:53 smithi016 ceph-mon[34911]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:53.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:53.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:53 smithi173 ceph-mon[35349]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:53 smithi012 ceph-mon[30937]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:53.909 DEBUG:teuthology.orchestra.run.smithi016:osd.10> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T06:36:53.912 INFO:tasks.cephadm:Deploying osd.11 on smithi173 with /dev/vg_nvme/lv_1... 2024-09-19T06:36:53.912 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:36:54.168 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:36:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:55 smithi012 ceph-mon[30937]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:55 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:55 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:55.397 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:55 smithi173 ceph-mon[35349]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:55.397 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:55 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:55.397 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:55 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:55.447 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:55 smithi016 ceph-mon[34911]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:55.447 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:55 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:55.447 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:55 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:56.727 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-19T06:36:56.754 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_1 2024-09-19T06:36:56.759 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:36:56 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:36:56.435+0000 7fb20c1b0640 -1 osd.10 0 log_to_monitors true 2024-09-19T06:36:57.003 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:36:57.360 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:57 smithi173 ceph-mon[35349]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:57.360 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:57 smithi173 ceph-mon[35349]: from='osd.10 [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:36:57.360 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:57 smithi173 ceph-mon[35349]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:36:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:57 smithi012 ceph-mon[30937]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:57 smithi012 ceph-mon[30937]: from='osd.10 [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:36:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:57 smithi012 ceph-mon[30937]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:36:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.445+0000 7f5a75e13640 1 -- 172.21.15.173:0/378047124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a701078c0 msgr2=0x7f5a70109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.445+0000 7f5a75e13640 1 --2- 172.21.15.173:0/378047124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a701078c0 0x7f5a70109d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009ca0 tx=0x7f5a6802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.445+0000 7f5a75e13640 1 -- 172.21.15.173:0/378047124 shutdown_connections 2024-09-19T06:36:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.445+0000 7f5a75e13640 1 --2- 172.21.15.173:0/378047124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a701078c0 0x7f5a70109d10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.445+0000 7f5a75e13640 1 --2- 172.21.15.173:0/378047124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a70104f90 0x7f5a70107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.445+0000 7f5a75e13640 1 --2- 172.21.15.173:0/378047124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a70102660 0x7f5a70104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.445+0000 7f5a75e13640 1 -- 172.21.15.173:0/378047124 >> 172.21.15.173:0/378047124 conn(0x7f5a700fc280 msgr2=0x7f5a700fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:57.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.445+0000 7f5a75e13640 1 -- 172.21.15.173:0/378047124 shutdown_connections 2024-09-19T06:36:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.445+0000 7f5a75e13640 1 -- 172.21.15.173:0/378047124 wait complete. 2024-09-19T06:36:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a75e13640 1 Processor -- start 2024-09-19T06:36:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a75e13640 1 -- start start 2024-09-19T06:36:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a75e13640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a70102660 0x7f5a70197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a75e13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a70104f90 0x7f5a70198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a75e13640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a701078c0 0x7f5a7019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a75e13640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7010d880 con 0x7f5a70104f90 2024-09-19T06:36:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a75e13640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7010d700 con 0x7f5a70102660 2024-09-19T06:36:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a75e13640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7010da00 con 0x7f5a701078c0 2024-09-19T06:36:57.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a701078c0 0x7f5a7019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a701078c0 0x7f5a7019f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:60570/0 (socket says 172.21.15.173:60570) 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a6ffff640 1 -- 172.21.15.173:0/2436272489 learned_addr learned my addr 172.21.15.173:0/2436272489 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.446+0000 7f5a6f7fe640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a70102660 0x7f5a70197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6effd640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a70104f90 0x7f5a70198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6ffff640 1 -- 172.21.15.173:0/2436272489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a70102660 msgr2=0x7f5a70197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6ffff640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a70102660 0x7f5a70197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6ffff640 1 -- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a70104f90 msgr2=0x7f5a70198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6ffff640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a70104f90 0x7f5a70198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6ffff640 1 -- 172.21.15.173:0/2436272489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7019fb00 con 0x7f5a701078c0 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6effd640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a70104f90 0x7f5a70198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6ffff640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a701078c0 0x7f5a7019f490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5a68005e30 tx=0x7f5a68031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:57.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6cff9640 1 -- 172.21.15.173:0/2436272489 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68003c30 con 0x7f5a701078c0 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6cff9640 1 -- 172.21.15.173:0/2436272489 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a68003dd0 con 0x7f5a701078c0 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a75e13640 1 -- 172.21.15.173:0/2436272489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7019fd90 con 0x7f5a701078c0 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a6cff9640 1 -- 172.21.15.173:0/2436272489 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6802fde0 con 0x7f5a701078c0 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.447+0000 7f5a75e13640 1 -- 172.21.15.173:0/2436272489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a701a0270 con 0x7f5a701078c0 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.448+0000 7f5a75e13640 1 -- 172.21.15.173:0/2436272489 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a700fdd70 con 0x7f5a701078c0 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.449+0000 7f5a6cff9640 1 -- 172.21.15.173:0/2436272489 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5a68004050 con 0x7f5a701078c0 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.450+0000 7f5a6cff9640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a580a3270 0x7f5a580a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.450+0000 7f5a6cff9640 1 -- 172.21.15.173:0/2436272489 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6398+0+0 (secure 0 0 0) 0x7f5a680f06d0 con 0x7f5a701078c0 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.451+0000 7f5a6f7fe640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a580a3270 0x7f5a580a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.451+0000 7f5a6f7fe640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a580a3270 0x7f5a580a5730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a60005d00 tx=0x7f5a6000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:57.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.454+0000 7f5a6cff9640 1 -- 172.21.15.173:0/2436272489 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a680bdad0 con 0x7f5a701078c0 2024-09-19T06:36:57.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:57 smithi016 ceph-mon[34911]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:57.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:57 smithi016 ceph-mon[34911]: from='osd.10 [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:36:57.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:57 smithi016 ceph-mon[34911]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:36:57.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:36:57.628+0000 7f5a75e13640 1 -- 172.21.15.173:0/2436272489 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5a70062630 con 0x7f5a580a3270 2024-09-19T06:36:58.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:36:58.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T06:36:58.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:58.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='osd.10 [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:36:58.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:36:58.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi016 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi016 to 4273M 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:58.306 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:58.307 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:58.307 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.307 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:58.307 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:58.307 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:58.307 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:58.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:36:58.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T06:36:58.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:58.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='osd.10 [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:36:58.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi016 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi016 to 4273M 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:58.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:58.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:58.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:58.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:58.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:58.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:58.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:36:58.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T06:36:58.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:58.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='osd.10 [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:36:58.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2024-09-19T06:36:58.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi016 2024-09-19T06:36:58.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi016 to 4273M 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:36:58.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:58.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:58.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:58.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:59.134 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:36:58.791+0000 7fb208947640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T06:36:59.134 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:36:58 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:36:58.803+0000 7fb1fff42640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:59.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:59 smithi173 ceph-mon[35349]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:59.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:59 smithi173 ceph-mon[35349]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:36:59.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:59 smithi173 ceph-mon[35349]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T06:36:59.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:59 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:59.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:59 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:59.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:36:59 smithi173 ceph-mon[35349]: from='osd.10 ' entity='osd.10' 2024-09-19T06:36:59.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:59 smithi016 ceph-mon[34911]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:59.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:59 smithi016 ceph-mon[34911]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:36:59.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:59 smithi016 ceph-mon[34911]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T06:36:59.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:59 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:59.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:59 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:59.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:36:59 smithi016 ceph-mon[34911]: from='osd.10 ' entity='osd.10' 2024-09-19T06:36:59.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:59 smithi012 ceph-mon[30937]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:36:59.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:59 smithi012 ceph-mon[30937]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2024-09-19T06:36:59.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:59 smithi012 ceph-mon[30937]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T06:36:59.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:59 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:59.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:59 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:36:59.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:36:59 smithi012 ceph-mon[30937]: from='osd.10 ' entity='osd.10' 2024-09-19T06:37:00.409 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:37:00.409 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:37:00.409 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:37:00.409 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: osd.10 [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] boot 2024-09-19T06:37:00.409 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T06:37:00.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:37:00.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T06:37:00.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/2044626710' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e5cfd54-d273-4af7-b672-7c3ffef495c9"}]: dispatch 2024-09-19T06:37:00.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e5cfd54-d273-4af7-b672-7c3ffef495c9"}]: dispatch 2024-09-19T06:37:00.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e5cfd54-d273-4af7-b672-7c3ffef495c9"}]': finished 2024-09-19T06:37:00.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:37:00.410 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:00 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: osd.10 [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] boot 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: from='client.? 172.21.15.173:0/2044626710' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e5cfd54-d273-4af7-b672-7c3ffef495c9"}]: dispatch 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e5cfd54-d273-4af7-b672-7c3ffef495c9"}]: dispatch 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e5cfd54-d273-4af7-b672-7c3ffef495c9"}]': finished 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:37:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:00 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:00.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:37:00.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:37:00.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:37:00.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: osd.10 [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] boot 2024-09-19T06:37:00.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T06:37:00.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:37:00.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T06:37:00.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/2044626710' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e5cfd54-d273-4af7-b672-7c3ffef495c9"}]: dispatch 2024-09-19T06:37:00.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e5cfd54-d273-4af7-b672-7c3ffef495c9"}]: dispatch 2024-09-19T06:37:00.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e5cfd54-d273-4af7-b672-7c3ffef495c9"}]': finished 2024-09-19T06:37:00.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T06:37:00.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:00 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:01.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:01 smithi016 ceph-mon[34911]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:37:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:01 smithi016 ceph-mon[34911]: from='client.? 172.21.15.173:0/3164814300' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:37:01.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:01 smithi173 ceph-mon[35349]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:37:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:01 smithi173 ceph-mon[35349]: from='client.? 172.21.15.173:0/3164814300' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:37:01.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:01 smithi012 ceph-mon[30937]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:37:01.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:01 smithi012 ceph-mon[30937]: from='client.? 172.21.15.173:0/3164814300' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:37:02.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:02 smithi016 ceph-mon[34911]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:37:02.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:02 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:02.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:02 smithi173 ceph-mon[35349]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:37:02.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:02.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:02 smithi012 ceph-mon[30937]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T06:37:02.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:03.409 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:03 smithi016 ceph-mon[34911]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:03.409 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:03 smithi016 ceph-mon[34911]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:37:03.410 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:03 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:03.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:03 smithi173 ceph-mon[35349]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:03.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:03 smithi173 ceph-mon[35349]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:37:03.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:03 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:03 smithi012 ceph-mon[30937]: pgmap v231: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:03 smithi012 ceph-mon[30937]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:37:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:03 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:05.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:05 smithi016 ceph-mon[34911]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:05.566 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:05 smithi173 ceph-mon[35349]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:05.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:05 smithi012 ceph-mon[30937]: pgmap v233: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:07.289 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:07 smithi173 ceph-mon[35349]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:37:07.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:07 smithi016 ceph-mon[34911]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:37:07.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:07 smithi012 ceph-mon[30937]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:37:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:09 smithi016 ceph-mon[34911]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T06:37:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:37:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:09 smithi016 ceph-mon[34911]: Deploying daemon osd.11 on smithi173 2024-09-19T06:37:09.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:09 smithi173 ceph-mon[35349]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T06:37:09.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:37:09.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:09.544 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:09 smithi173 ceph-mon[35349]: Deploying daemon osd.11 on smithi173 2024-09-19T06:37:09.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:09 smithi012 ceph-mon[30937]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T06:37:09.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:37:09.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:09.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:09 smithi012 ceph-mon[30937]: Deploying daemon osd.11 on smithi173 2024-09-19T06:37:11.304 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:11 smithi173 ceph-mon[35349]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T06:37:11.431 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:11 smithi012 ceph-mon[30937]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T06:37:11.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:11 smithi016 ceph-mon[34911]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T06:37:13.424 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:13 smithi173 ceph-mon[35349]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:37:13.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:13 smithi016 ceph-mon[34911]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:37:13.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:13 smithi012 ceph-mon[30937]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:37:14.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:14.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:14.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:14 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:14.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:14.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:14.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:14 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:14.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:14.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:14.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:14 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:15.475 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:15 smithi173 ceph-mon[35349]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T06:37:15.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:15 smithi016 ceph-mon[34911]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T06:37:15.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:15 smithi012 ceph-mon[30937]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T06:37:17.445 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:17 smithi173 ceph-mon[35349]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:37:17.445 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:17.445 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:17.446 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:17.446 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:17.446 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:17 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:17.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.489+0000 7f5a6cff9640 1 -- 172.21.15.173:0/2436272489 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5a70062630 con 0x7f5a580a3270 2024-09-19T06:37:17.490 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 11 on host 'smithi173' 2024-09-19T06:37:17.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.491+0000 7f5a75e13640 1 -- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a580a3270 msgr2=0x7f5a580a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:17.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.491+0000 7f5a75e13640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a580a3270 0x7f5a580a5730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a60005d00 tx=0x7f5a6000b410 comp rx=0 tx=0).stop 2024-09-19T06:37:17.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.491+0000 7f5a75e13640 1 -- 172.21.15.173:0/2436272489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a701078c0 msgr2=0x7f5a7019f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:17.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.491+0000 7f5a75e13640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a701078c0 0x7f5a7019f490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5a68005e30 tx=0x7f5a68031ee0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.491+0000 7f5a75e13640 1 -- 172.21.15.173:0/2436272489 shutdown_connections 2024-09-19T06:37:17.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.491+0000 7f5a75e13640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5a580a3270 0x7f5a580a5730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.491+0000 7f5a75e13640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a701078c0 0x7f5a7019f490 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.491+0000 7f5a75e13640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a70104f90 0x7f5a70198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.491+0000 7f5a75e13640 1 --2- 172.21.15.173:0/2436272489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a70102660 0x7f5a70197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.491+0000 7f5a75e13640 1 -- 172.21.15.173:0/2436272489 >> 172.21.15.173:0/2436272489 conn(0x7f5a700fc280 msgr2=0x7f5a70102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:17.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.492+0000 7f5a75e13640 1 -- 172.21.15.173:0/2436272489 shutdown_connections 2024-09-19T06:37:17.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:17.492+0000 7f5a75e13640 1 -- 172.21.15.173:0/2436272489 wait complete. 2024-09-19T06:37:17.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:17 smithi016 ceph-mon[34911]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:37:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:17 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:17.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:17 smithi012 ceph-mon[30937]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:37:17.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:17.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:17.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:17.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:17.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:17 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:18.025 DEBUG:teuthology.orchestra.run.smithi173:osd.11> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T06:37:18.027 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T06:37:18.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:37:18.296 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:18 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:18 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:18.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:18.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:18.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:18 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:18.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 -- 172.21.15.12:0/584940225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e68102e00 msgr2=0x7f1e68103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:18.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 --2- 172.21.15.12:0/584940225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e68102e00 0x7f1e68103280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009900 tx=0x7f1e5002a410 comp rx=0 tx=0).stop 2024-09-19T06:37:18.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 -- 172.21.15.12:0/584940225 shutdown_connections 2024-09-19T06:37:18.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 --2- 172.21.15.12:0/584940225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e681037c0 0x7f1e6810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 --2- 172.21.15.12:0/584940225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e68102e00 0x7f1e68103280 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 --2- 172.21.15.12:0/584940225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e68101c00 0x7f1e68102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 -- 172.21.15.12:0/584940225 >> 172.21.15.12:0/584940225 conn(0x7f1e680fd390 msgr2=0x7f1e680ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 -- 172.21.15.12:0/584940225 shutdown_connections 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 -- 172.21.15.12:0/584940225 wait complete. 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 Processor -- start 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.900+0000 7f1e6e31a640 1 -- start start 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e6e31a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e68101c00 0x7f1e68197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e6e31a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e68102e00 0x7f1e68198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e6e31a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e681037c0 0x7f1e6819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e6e31a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6810d880 con 0x7f1e68102e00 2024-09-19T06:37:18.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e6e31a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6810d700 con 0x7f1e68101c00 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e6e31a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6810da00 con 0x7f1e681037c0 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e68102e00 0x7f1e68198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e67fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e68101c00 0x7f1e68197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e68102e00 0x7f1e68198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33180/0 (socket says 172.21.15.12:33180) 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e5ffff640 1 -- 172.21.15.12:0/1952372449 learned_addr learned my addr 172.21.15.12:0/1952372449 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e6c8b7640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e681037c0 0x7f1e6819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e5ffff640 1 -- 172.21.15.12:0/1952372449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e681037c0 msgr2=0x7f1e6819f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e5ffff640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e681037c0 0x7f1e6819f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e5ffff640 1 -- 172.21.15.12:0/1952372449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e68101c00 msgr2=0x7f1e68197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e5ffff640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e68101c00 0x7f1e68197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:18.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e5ffff640 1 -- 172.21.15.12:0/1952372449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6819fb00 con 0x7f1e68102e00 2024-09-19T06:37:18.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e67fff640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e68101c00 0x7f1e68197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:18.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e5ffff640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e68102e00 0x7f1e68198410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009230 tx=0x7f1e500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:18.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.901+0000 7f1e65ffb640 1 -- 172.21.15.12:0/1952372449 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5003f030 con 0x7f1e68102e00 2024-09-19T06:37:18.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.902+0000 7f1e6e31a640 1 -- 172.21.15.12:0/1952372449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6819fd90 con 0x7f1e68102e00 2024-09-19T06:37:18.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.902+0000 7f1e65ffb640 1 -- 172.21.15.12:0/1952372449 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e50003ce0 con 0x7f1e68102e00 2024-09-19T06:37:18.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.902+0000 7f1e65ffb640 1 -- 172.21.15.12:0/1952372449 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50035070 con 0x7f1e68102e00 2024-09-19T06:37:18.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.902+0000 7f1e6e31a640 1 -- 172.21.15.12:0/1952372449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e681a0260 con 0x7f1e68102e00 2024-09-19T06:37:18.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.903+0000 7f1e6e31a640 1 -- 172.21.15.12:0/1952372449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e68108fd0 con 0x7f1e68102e00 2024-09-19T06:37:18.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.904+0000 7f1e65ffb640 1 -- 172.21.15.12:0/1952372449 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1e50042030 con 0x7f1e68102e00 2024-09-19T06:37:18.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.905+0000 7f1e65ffb640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e540a3270 0x7f1e540a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:18.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.905+0000 7f1e67fff640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e540a3270 0x7f1e540a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:18.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.905+0000 7f1e65ffb640 1 -- 172.21.15.12:0/1952372449 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7f1e500ef7f0 con 0x7f1e68102e00 2024-09-19T06:37:18.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.906+0000 7f1e67fff640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e540a3270 0x7f1e540a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e68102c60 tx=0x7f1e58005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:18.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:18.909+0000 7f1e65ffb640 1 -- 172.21.15.12:0/1952372449 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e500bc400 con 0x7f1e68102e00 2024-09-19T06:37:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.087+0000 7f1e6e31a640 1 -- 172.21.15.12:0/1952372449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1e68062e20 con 0x7f1e68102e00 2024-09-19T06:37:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.088+0000 7f1e65ffb640 1 -- 172.21.15.12:0/1952372449 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f1e500c0700 con 0x7f1e68102e00 2024-09-19T06:37:19.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 -- 172.21.15.12:0/1952372449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e540a3270 msgr2=0x7f1e540a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e540a3270 0x7f1e540a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e68102c60 tx=0x7f1e58005f90 comp rx=0 tx=0).stop 2024-09-19T06:37:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 -- 172.21.15.12:0/1952372449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e68102e00 msgr2=0x7f1e68198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e68102e00 0x7f1e68198410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009230 tx=0x7f1e500042f0 comp rx=0 tx=0).stop 2024-09-19T06:37:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 -- 172.21.15.12:0/1952372449 shutdown_connections 2024-09-19T06:37:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e540a3270 0x7f1e540a5730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e681037c0 0x7f1e6819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e68102e00 0x7f1e68198410 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 --2- 172.21.15.12:0/1952372449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e68101c00 0x7f1e68197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 -- 172.21.15.12:0/1952372449 >> 172.21.15.12:0/1952372449 conn(0x7f1e680fd390 msgr2=0x7f1e681061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 -- 172.21.15.12:0/1952372449 shutdown_connections 2024-09-19T06:37:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:19.090+0000 7f1e6e31a640 1 -- 172.21.15.12:0/1952372449 wait complete. 2024-09-19T06:37:19.499 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:19 smithi173 ceph-mon[35349]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:19.499 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:19 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1952372449' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:37:19.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:19 smithi016 ceph-mon[34911]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:19.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:19 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1952372449' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:37:19.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:19 smithi012 ceph-mon[30937]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:19.840 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:19 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1952372449' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:37:19.868 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726727819,"num_in_osds":12,"osd_in_since":1726727819,"num_remapped_pgs":0} 2024-09-19T06:37:20.334 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:37:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:37:20.061+0000 7f0af232b640 -1 osd.11 0 log_to_monitors true 2024-09-19T06:37:20.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:20 smithi016 ceph-mon[34911]: from='osd.11 [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:37:20.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:20 smithi016 ceph-mon[34911]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:37:20.786 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:20 smithi173 ceph-mon[35349]: from='osd.11 [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:37:20.786 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:20 smithi173 ceph-mon[35349]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:37:20.869 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:37:20.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:20 smithi012 ceph-mon[30937]: from='osd.11 [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:37:20.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:20 smithi012 ceph-mon[30937]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:37:21.127 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:21.820 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:21.820 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:37:21.820 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='osd.11 [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:21.821 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:21.822 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:21.822 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:21 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:21.832 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:37:21.510+0000 7f0aeda8b640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T06:37:21.832 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:37:21.523+0000 7f0aea0c5640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:37:21.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='osd.11 [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:21.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:21.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:21.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:21 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.817+0000 7f9cc0def640 1 -- 172.21.15.12:0/1055536009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cbc101c00 msgr2=0x7f9cbc102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.817+0000 7f9cc0def640 1 --2- 172.21.15.12:0/1055536009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cbc101c00 0x7f9cbc102000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009900 tx=0x7f9cac02a410 comp rx=0 tx=0).stop 2024-09-19T06:37:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.817+0000 7f9cc0def640 1 -- 172.21.15.12:0/1055536009 shutdown_connections 2024-09-19T06:37:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.817+0000 7f9cc0def640 1 --2- 172.21.15.12:0/1055536009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc1037c0 0x7f9cbc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.817+0000 7f9cc0def640 1 --2- 172.21.15.12:0/1055536009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cbc102e00 0x7f9cbc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.817+0000 7f9cc0def640 1 --2- 172.21.15.12:0/1055536009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cbc101c00 0x7f9cbc102000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.817+0000 7f9cc0def640 1 -- 172.21.15.12:0/1055536009 >> 172.21.15.12:0/1055536009 conn(0x7f9cbc0fd390 msgr2=0x7f9cbc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.817+0000 7f9cc0def640 1 -- 172.21.15.12:0/1055536009 shutdown_connections 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.817+0000 7f9cc0def640 1 -- 172.21.15.12:0/1055536009 wait complete. 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cc0def640 1 Processor -- start 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cc0def640 1 -- start start 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cc0def640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc101c00 0x7f9cbc197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cc0def640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cbc102e00 0x7f9cbc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cc0def640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cbc1037c0 0x7f9cbc19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cc0def640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc10d890 con 0x7f9cbc102e00 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cc0def640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc10d710 con 0x7f9cbc1037c0 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cc0def640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc10da10 con 0x7f9cbc101c00 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cb9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cbc102e00 0x7f9cbc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cb9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cbc102e00 0x7f9cbc1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48580/0 (socket says 172.21.15.12:48580) 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.818+0000 7f9cb9d9b640 1 -- 172.21.15.12:0/1241293871 learned_addr learned my addr 172.21.15.12:0/1241293871 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cbad9d640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cbc1037c0 0x7f9cbc19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cba59c640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc101c00 0x7f9cbc197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cb9d9b640 1 -- 172.21.15.12:0/1241293871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc101c00 msgr2=0x7f9cbc197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cb9d9b640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc101c00 0x7f9cbc197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cb9d9b640 1 -- 172.21.15.12:0/1241293871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cbc1037c0 msgr2=0x7f9cbc19f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cb9d9b640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cbc1037c0 0x7f9cbc19f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cb9d9b640 1 -- 172.21.15.12:0/1241293871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc19fac0 con 0x7f9cbc102e00 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cb9d9b640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cbc102e00 0x7f9cbc1983d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c920 tx=0x7f9ca400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cb37fe640 1 -- 172.21.15.12:0/1241293871 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4007c70 con 0x7f9cbc102e00 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cc0def640 1 -- 172.21.15.12:0/1241293871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cbc19fdb0 con 0x7f9cbc102e00 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cb37fe640 1 -- 172.21.15.12:0/1241293871 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ca4007e10 con 0x7f9cbc102e00 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cb37fe640 1 -- 172.21.15.12:0/1241293871 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4018890 con 0x7f9cbc102e00 2024-09-19T06:37:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.819+0000 7f9cc0def640 1 -- 172.21.15.12:0/1241293871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cbc1a0270 con 0x7f9cbc102e00 2024-09-19T06:37:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.820+0000 7f9cc0def640 1 -- 172.21.15.12:0/1241293871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cbc102000 con 0x7f9cbc102e00 2024-09-19T06:37:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.821+0000 7f9cb37fe640 1 -- 172.21.15.12:0/1241293871 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9ca4018a30 con 0x7f9cbc102e00 2024-09-19T06:37:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.822+0000 7f9cb37fe640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9ca80a3270 0x7f9ca80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.822+0000 7f9cba59c640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9ca80a3270 0x7f9ca80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.822+0000 7f9cb37fe640 1 -- 172.21.15.12:0/1241293871 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7f9ca40cf3c0 con 0x7f9cbc102e00 2024-09-19T06:37:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.823+0000 7f9cba59c640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9ca80a3270 0x7f9ca80a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9cac005ab0 tx=0x7f9cac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:21.826+0000 7f9cb37fe640 1 -- 172.21.15.12:0/1241293871 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ca4014030 con 0x7f9cbc102e00 2024-09-19T06:37:22.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.004+0000 7f9cc0def640 1 -- 172.21.15.12:0/1241293871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9cbc02d7f0 con 0x7f9cbc102e00 2024-09-19T06:37:22.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.004+0000 7f9cb37fe640 1 -- 172.21.15.12:0/1241293871 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f9ca409c6a0 con 0x7f9cbc102e00 2024-09-19T06:37:22.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:22.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:22.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:37:22.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T06:37:22.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:22.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='osd.11 [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:37:22.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-19T06:37:22.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:22.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:22.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:22.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:22.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:22.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:37:22.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:22.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:22.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:22.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:21 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.006+0000 7f9cc0def640 1 -- 172.21.15.12:0/1241293871 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9ca80a3270 msgr2=0x7f9ca80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:22.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.006+0000 7f9cc0def640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9ca80a3270 0x7f9ca80a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9cac005ab0 tx=0x7f9cac000bc0 comp rx=0 tx=0).stop 2024-09-19T06:37:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.006+0000 7f9cc0def640 1 -- 172.21.15.12:0/1241293871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cbc102e00 msgr2=0x7f9cbc1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.006+0000 7f9cc0def640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cbc102e00 0x7f9cbc1983d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c920 tx=0x7f9ca400cde0 comp rx=0 tx=0).stop 2024-09-19T06:37:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.006+0000 7f9cc0def640 1 -- 172.21.15.12:0/1241293871 shutdown_connections 2024-09-19T06:37:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.006+0000 7f9cc0def640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9ca80a3270 0x7f9ca80a5730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.006+0000 7f9cc0def640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cbc1037c0 0x7f9cbc19f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.006+0000 7f9cc0def640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cbc102e00 0x7f9cbc1983d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.006+0000 7f9cc0def640 1 --2- 172.21.15.12:0/1241293871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9cbc101c00 0x7f9cbc197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.006+0000 7f9cc0def640 1 -- 172.21.15.12:0/1241293871 >> 172.21.15.12:0/1241293871 conn(0x7f9cbc0fd390 msgr2=0x7f9cbc1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.007+0000 7f9cc0def640 1 -- 172.21.15.12:0/1241293871 shutdown_connections 2024-09-19T06:37:22.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:22.007+0000 7f9cc0def640 1 -- 172.21.15.12:0/1241293871 wait complete. 2024-09-19T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:22 smithi012 ceph-mon[30937]: Detected new or changed devices on smithi173 2024-09-19T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:22 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-19T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:22 smithi012 ceph-mon[30937]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:22 smithi012 ceph-mon[30937]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:22.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:22 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1241293871' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:37:22.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:22.806 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726727819,"num_in_osds":12,"osd_in_since":1726727819,"num_remapped_pgs":0} 2024-09-19T06:37:22.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:22 smithi173 ceph-mon[35349]: Detected new or changed devices on smithi173 2024-09-19T06:37:22.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:22 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-19T06:37:22.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:22 smithi173 ceph-mon[35349]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:37:22.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:22 smithi173 ceph-mon[35349]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T06:37:22.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:22.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:22.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:22 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1241293871' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:37:22.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:22 smithi016 ceph-mon[34911]: Detected new or changed devices on smithi173 2024-09-19T06:37:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:22 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-19T06:37:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:22 smithi016 ceph-mon[34911]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-19T06:37:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:22 smithi016 ceph-mon[34911]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T06:37:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:22 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1241293871' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:37:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:23.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:37:23.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:23 smithi173 ceph-mon[35349]: purged_snaps scrub starts 2024-09-19T06:37:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:23 smithi173 ceph-mon[35349]: purged_snaps scrub ok 2024-09-19T06:37:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:23 smithi173 ceph-mon[35349]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:23 smithi173 ceph-mon[35349]: osd.11 [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] boot 2024-09-19T06:37:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:23 smithi173 ceph-mon[35349]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:37:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:23.836 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:23 smithi012 ceph-mon[30937]: purged_snaps scrub starts 2024-09-19T06:37:23.836 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:23 smithi012 ceph-mon[30937]: purged_snaps scrub ok 2024-09-19T06:37:23.836 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:23 smithi012 ceph-mon[30937]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:23.836 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:23 smithi012 ceph-mon[30937]: osd.11 [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] boot 2024-09-19T06:37:23.836 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:23 smithi012 ceph-mon[30937]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:37:23.837 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:24.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:23 smithi016 ceph-mon[34911]: purged_snaps scrub starts 2024-09-19T06:37:24.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:23 smithi016 ceph-mon[34911]: purged_snaps scrub ok 2024-09-19T06:37:24.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:23 smithi016 ceph-mon[34911]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:37:24.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:23 smithi016 ceph-mon[34911]: osd.11 [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] boot 2024-09-19T06:37:24.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:23 smithi016 ceph-mon[34911]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:37:24.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:37:24.076 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:24.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.565+0000 7fcbe2736640 1 -- 172.21.15.12:0/739390401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbdc101c10 msgr2=0x7fcbdc102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.565+0000 7fcbe2736640 1 --2- 172.21.15.12:0/739390401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbdc101c10 0x7fcbdc102010 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009900 tx=0x7fcbcc02a410 comp rx=0 tx=0).stop 2024-09-19T06:37:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.565+0000 7fcbe2736640 1 -- 172.21.15.12:0/739390401 shutdown_connections 2024-09-19T06:37:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.565+0000 7fcbe2736640 1 --2- 172.21.15.12:0/739390401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbdc1037d0 0x7fcbdc10a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.565+0000 7fcbe2736640 1 --2- 172.21.15.12:0/739390401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbdc102e10 0x7fcbdc103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.565+0000 7fcbe2736640 1 --2- 172.21.15.12:0/739390401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbdc101c10 0x7fcbdc102010 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.565+0000 7fcbe2736640 1 -- 172.21.15.12:0/739390401 >> 172.21.15.12:0/739390401 conn(0x7fcbdc0fd3c0 msgr2=0x7fcbdc0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.565+0000 7fcbe2736640 1 -- 172.21.15.12:0/739390401 shutdown_connections 2024-09-19T06:37:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.565+0000 7fcbe2736640 1 -- 172.21.15.12:0/739390401 wait complete. 2024-09-19T06:37:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe2736640 1 Processor -- start 2024-09-19T06:37:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe2736640 1 -- start start 2024-09-19T06:37:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe2736640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbdc101c10 0x7fcbdc19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe2736640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbdc102e10 0x7fcbdc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe2736640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbdc1037d0 0x7fcbdc1a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe2736640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc10d8a0 con 0x7fcbdc1037d0 2024-09-19T06:37:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe2736640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc10d720 con 0x7fcbdc101c10 2024-09-19T06:37:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe2736640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc10da20 con 0x7fcbdc102e10 2024-09-19T06:37:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe0cd3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbdc1037d0 0x7fcbdc1a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe0cd3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbdc1037d0 0x7fcbdc1a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48598/0 (socket says 172.21.15.12:48598) 2024-09-19T06:37:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe0cd3640 1 -- 172.21.15.12:0/853610169 learned_addr learned my addr 172.21.15.12:0/853610169 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbdb7fe640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbdc102e10 0x7fcbdc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbdbfff640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbdc101c10 0x7fcbdc19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe0cd3640 1 -- 172.21.15.12:0/853610169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbdc102e10 msgr2=0x7fcbdc19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe0cd3640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbdc102e10 0x7fcbdc19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe0cd3640 1 -- 172.21.15.12:0/853610169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbdc101c10 msgr2=0x7fcbdc19a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe0cd3640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbdc101c10 0x7fcbdc19a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.566+0000 7fcbe0cd3640 1 -- 172.21.15.12:0/853610169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbdc1a1d90 con 0x7fcbdc1037d0 2024-09-19T06:37:24.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.567+0000 7fcbe0cd3640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbdc1037d0 0x7fcbdc1a1720 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400eaa0 tx=0x7fcbd400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:24.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.567+0000 7fcbd97fa640 1 -- 172.21.15.12:0/853610169 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400cdb0 con 0x7fcbdc1037d0 2024-09-19T06:37:24.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.567+0000 7fcbd97fa640 1 -- 172.21.15.12:0/853610169 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbd4005020 con 0x7fcbdc1037d0 2024-09-19T06:37:24.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.567+0000 7fcbe2736640 1 -- 172.21.15.12:0/853610169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbdc1a2080 con 0x7fcbdc1037d0 2024-09-19T06:37:24.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.567+0000 7fcbd97fa640 1 -- 172.21.15.12:0/853610169 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40116b0 con 0x7fcbdc1037d0 2024-09-19T06:37:24.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.567+0000 7fcbe2736640 1 -- 172.21.15.12:0/853610169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbdc1a25c0 con 0x7fcbdc1037d0 2024-09-19T06:37:24.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.568+0000 7fcbe2736640 1 -- 172.21.15.12:0/853610169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbdc1a2880 con 0x7fcbdc1037d0 2024-09-19T06:37:24.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.569+0000 7fcbd97fa640 1 -- 172.21.15.12:0/853610169 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcbd4005560 con 0x7fcbdc1037d0 2024-09-19T06:37:24.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.570+0000 7fcbd97fa640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fcbc40a3270 0x7fcbc40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:24.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.570+0000 7fcbdbfff640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fcbc40a3270 0x7fcbc40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:24.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.570+0000 7fcbd97fa640 1 -- 172.21.15.12:0/853610169 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fcbd40cf530 con 0x7fcbdc1037d0 2024-09-19T06:37:24.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.571+0000 7fcbdbfff640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fcbc40a3270 0x7fcbc40a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc005ab0 tx=0x7fcbcc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:24.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.574+0000 7fcbd97fa640 1 -- 172.21.15.12:0/853610169 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcbd4016030 con 0x7fcbdc1037d0 2024-09-19T06:37:24.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.751+0000 7fcbe2736640 1 -- 172.21.15.12:0/853610169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fcbdc1a2a50 con 0x7fcbdc1037d0 2024-09-19T06:37:24.754 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:24 smithi012 ceph-mon[30937]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:37:24.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.752+0000 7fcbd97fa640 1 -- 172.21.15.12:0/853610169 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7fcbd409c0a0 con 0x7fcbdc1037d0 2024-09-19T06:37:24.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:24.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 -- 172.21.15.12:0/853610169 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fcbc40a3270 msgr2=0x7fcbc40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fcbc40a3270 0x7fcbc40a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc005ab0 tx=0x7fcbcc000bc0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 -- 172.21.15.12:0/853610169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbdc1037d0 msgr2=0x7fcbdc1a1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:24.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbdc1037d0 0x7fcbdc1a1720 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400eaa0 tx=0x7fcbd400ef60 comp rx=0 tx=0).stop 2024-09-19T06:37:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 -- 172.21.15.12:0/853610169 shutdown_connections 2024-09-19T06:37:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fcbc40a3270 0x7fcbc40a5730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbdc1037d0 0x7fcbdc1a1720 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbdc102e10 0x7fcbdc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 --2- 172.21.15.12:0/853610169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbdc101c10 0x7fcbdc19a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 -- 172.21.15.12:0/853610169 >> 172.21.15.12:0/853610169 conn(0x7fcbdc0fd3c0 msgr2=0x7fcbdc074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 -- 172.21.15.12:0/853610169 shutdown_connections 2024-09-19T06:37:24.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:24.754+0000 7fcbe2736640 1 -- 172.21.15.12:0/853610169 wait complete. 2024-09-19T06:37:24.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:24 smithi173 ceph-mon[35349]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:37:25.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:24 smithi016 ceph-mon[34911]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:37:25.537 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726727842,"num_in_osds":12,"osd_in_since":1726727819,"num_remapped_pgs":0} 2024-09-19T06:37:25.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:37:25.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:25 smithi173 ceph-mon[35349]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:25.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:25 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/853610169' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:37:25.833 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:25.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:25 smithi012 ceph-mon[30937]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:25.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:25 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/853610169' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:37:26.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:25 smithi016 ceph-mon[34911]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:26.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:25 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/853610169' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:37:26.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.264+0000 7ffbc498b640 1 -- 172.21.15.12:0/2759021312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc0100e20 msgr2=0x7ffbc0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.264+0000 7ffbc498b640 1 --2- 172.21.15.12:0/2759021312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc0100e20 0x7ffbc0101200 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009900 tx=0x7ffbb002a480 comp rx=0 tx=0).stop 2024-09-19T06:37:26.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.264+0000 7ffbc498b640 1 -- 172.21.15.12:0/2759021312 shutdown_connections 2024-09-19T06:37:26.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.264+0000 7ffbc498b640 1 --2- 172.21.15.12:0/2759021312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbc0102ef0 0x7ffbc010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.264+0000 7ffbc498b640 1 --2- 172.21.15.12:0/2759021312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc0102570 0x7ffbc01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.264+0000 7ffbc498b640 1 --2- 172.21.15.12:0/2759021312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc0100e20 0x7ffbc0101200 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.264+0000 7ffbc498b640 1 -- 172.21.15.12:0/2759021312 >> 172.21.15.12:0/2759021312 conn(0x7ffbc00fc7d0 msgr2=0x7ffbc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:26.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.264+0000 7ffbc498b640 1 -- 172.21.15.12:0/2759021312 shutdown_connections 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.264+0000 7ffbc498b640 1 -- 172.21.15.12:0/2759021312 wait complete. 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbc498b640 1 Processor -- start 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbc498b640 1 -- start start 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbc498b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc0100e20 0x7ffbc010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbc498b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbc0102570 0x7ffbc010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbc498b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc0102ef0 0x7ffbc010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbc498b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01120a0 con 0x7ffbc0100e20 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbc498b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0111f20 con 0x7ffbc0102ef0 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbc498b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0112220 con 0x7ffbc0102570 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbbe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc0100e20 0x7ffbc010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbbe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc0100e20 0x7ffbc010e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48618/0 (socket says 172.21.15.12:48618) 2024-09-19T06:37:26.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbbe59c640 1 -- 172.21.15.12:0/3210700657 learned_addr learned my addr 172.21.15.12:0/3210700657 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbbed9d640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc0102ef0 0x7ffbc010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.265+0000 7ffbbdd9b640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbc0102570 0x7ffbc010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbbe59c640 1 -- 172.21.15.12:0/3210700657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbc0102570 msgr2=0x7ffbc010ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbbe59c640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbc0102570 0x7ffbc010ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbbe59c640 1 -- 172.21.15.12:0/3210700657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc0102ef0 msgr2=0x7ffbc010ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbbe59c640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc0102ef0 0x7ffbc010ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbbe59c640 1 -- 172.21.15.12:0/3210700657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc01a6a60 con 0x7ffbc0100e20 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbbe59c640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc0100e20 0x7ffbc010e4d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0006010 tx=0x7ffbb0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbaf7fe640 1 -- 172.21.15.12:0/3210700657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb003f070 con 0x7ffbc0100e20 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbaf7fe640 1 -- 172.21.15.12:0/3210700657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb0031c30 con 0x7ffbc0100e20 2024-09-19T06:37:26.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbc498b640 1 -- 172.21.15.12:0/3210700657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc01a6cf0 con 0x7ffbc0100e20 2024-09-19T06:37:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbaf7fe640 1 -- 172.21.15.12:0/3210700657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0035030 con 0x7ffbc0100e20 2024-09-19T06:37:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.266+0000 7ffbc498b640 1 -- 172.21.15.12:0/3210700657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc01a71c0 con 0x7ffbc0100e20 2024-09-19T06:37:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.267+0000 7ffbc498b640 1 -- 172.21.15.12:0/3210700657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc0101200 con 0x7ffbc0100e20 2024-09-19T06:37:26.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.269+0000 7ffbaf7fe640 1 -- 172.21.15.12:0/3210700657 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ffbb0042070 con 0x7ffbc0100e20 2024-09-19T06:37:26.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.269+0000 7ffbaf7fe640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ffba80a32c0 0x7ffba80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:26.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.269+0000 7ffbbdd9b640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ffba80a32c0 0x7ffba80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:26.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.269+0000 7ffbaf7fe640 1 -- 172.21.15.12:0/3210700657 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ffbb00eff00 con 0x7ffbc0100e20 2024-09-19T06:37:26.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.270+0000 7ffbbdd9b640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ffba80a32c0 0x7ffba80a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffbc010ff60 tx=0x7ffbb4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:26.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.272+0000 7ffbaf7fe640 1 -- 172.21.15.12:0/3210700657 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffbb00bca70 con 0x7ffbc0100e20 2024-09-19T06:37:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.453+0000 7ffbc498b640 1 -- 172.21.15.12:0/3210700657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbc0109090 con 0x7ffbc0100e20 2024-09-19T06:37:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.454+0000 7ffbaf7fe640 1 -- 172.21.15.12:0/3210700657 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18396 (secure 0 0 0) 0x7ffbb00c0d70 con 0x7ffbc0100e20 2024-09-19T06:37:26.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:26.457 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":76,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:37:23.532796+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:37:26.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 -- 172.21.15.12:0/3210700657 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ffba80a32c0 msgr2=0x7ffba80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ffba80a32c0 0x7ffba80a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffbc010ff60 tx=0x7ffbb4005f90 comp rx=0 tx=0).stop 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 -- 172.21.15.12:0/3210700657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc0100e20 msgr2=0x7ffbc010e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc0100e20 0x7ffbc010e4d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0006010 tx=0x7ffbb0003c10 comp rx=0 tx=0).stop 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 -- 172.21.15.12:0/3210700657 shutdown_connections 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ffba80a32c0 0x7ffba80a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc0102ef0 0x7ffbc010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffbc0102570 0x7ffbc010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 --2- 172.21.15.12:0/3210700657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc0100e20 0x7ffbc010e4d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 -- 172.21.15.12:0/3210700657 >> 172.21.15.12:0/3210700657 conn(0x7ffbc00fc7d0 msgr2=0x7ffbc00fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 -- 172.21.15.12:0/3210700657 shutdown_connections 2024-09-19T06:37:26.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:26.456+0000 7ffbc498b640 1 -- 172.21.15.12:0/3210700657 wait complete. 2024-09-19T06:37:26.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:26 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3210700657' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:37:26.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:26 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3210700657' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:37:27.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:26 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3210700657' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:37:27.111 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:33:40.130755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:37:27.111 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T06:37:27.365 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:27.750 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:27 smithi012 ceph-mon[30937]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:27.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:27 smithi173 ceph-mon[35349]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.833+0000 7f8834a0b640 1 -- 172.21.15.12:0/852160657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8830101de0 msgr2=0x7f88301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.833+0000 7f8834a0b640 1 --2- 172.21.15.12:0/852160657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8830101de0 0x7f88301021c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8820009900 tx=0x7f882002a410 comp rx=0 tx=0).stop 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.833+0000 7f8834a0b640 1 -- 172.21.15.12:0/852160657 shutdown_connections 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.833+0000 7f8834a0b640 1 --2- 172.21.15.12:0/852160657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830106f10 0x7f883010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.833+0000 7f8834a0b640 1 --2- 172.21.15.12:0/852160657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8830102790 0x7f88301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.833+0000 7f8834a0b640 1 --2- 172.21.15.12:0/852160657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8830101de0 0x7f88301021c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.833+0000 7f8834a0b640 1 -- 172.21.15.12:0/852160657 >> 172.21.15.12:0/852160657 conn(0x7f88300fd8c0 msgr2=0x7f88300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.833+0000 7f8834a0b640 1 -- 172.21.15.12:0/852160657 shutdown_connections 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.833+0000 7f8834a0b640 1 -- 172.21.15.12:0/852160657 wait complete. 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f8834a0b640 1 Processor -- start 2024-09-19T06:37:27.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f8834a0b640 1 -- start start 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f8834a0b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830101de0 0x7f8830198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f8834a0b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8830102790 0x7f8830198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f8834a0b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8830106f10 0x7f883019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f8834a0b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8830111f30 con 0x7f8830106f10 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f8834a0b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8830111db0 con 0x7f8830102790 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f8834a0b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f88301120b0 con 0x7f8830101de0 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f882ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8830106f10 0x7f883019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f882ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8830106f10 0x7f883019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48644/0 (socket says 172.21.15.12:48644) 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f882ed9d640 1 -- 172.21.15.12:0/1134863228 learned_addr learned my addr 172.21.15.12:0/1134863228 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f8825d9b640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8830102790 0x7f8830198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.834+0000 7f882e59c640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830101de0 0x7f8830198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:27.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f882ed9d640 1 -- 172.21.15.12:0/1134863228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830101de0 msgr2=0x7f8830198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f882ed9d640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830101de0 0x7f8830198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f882ed9d640 1 -- 172.21.15.12:0/1134863228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8830102790 msgr2=0x7f8830198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f882ed9d640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8830102790 0x7f8830198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f882ed9d640 1 -- 172.21.15.12:0/1134863228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883019d4c0 con 0x7f8830106f10 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f882ed9d640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8830106f10 0x7f883019cde0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f882800eaa0 tx=0x7f882800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f8827fff640 1 -- 172.21.15.12:0/1134863228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882800cdb0 con 0x7f8830106f10 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f8834a0b640 1 -- 172.21.15.12:0/1134863228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883019d7b0 con 0x7f8830106f10 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f8827fff640 1 -- 172.21.15.12:0/1134863228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8828005020 con 0x7f8830106f10 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f8827fff640 1 -- 172.21.15.12:0/1134863228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88280116b0 con 0x7f8830106f10 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.835+0000 7f8834a0b640 1 -- 172.21.15.12:0/1134863228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88301a5090 con 0x7f8830106f10 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.836+0000 7f8834a0b640 1 -- 172.21.15.12:0/1134863228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88301021c0 con 0x7f8830106f10 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.837+0000 7f8827fff640 1 -- 172.21.15.12:0/1134863228 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8828005560 con 0x7f8830106f10 2024-09-19T06:37:27.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.838+0000 7f8827fff640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f881c0a3240 0x7f881c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:27.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.838+0000 7f882e59c640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f881c0a3240 0x7f881c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:27.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.838+0000 7f8827fff640 1 -- 172.21.15.12:0/1134863228 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f88280cfb70 con 0x7f8830106f10 2024-09-19T06:37:27.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.838+0000 7f882e59c640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f881c0a3240 0x7f881c0a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8820005ab0 tx=0x7f8820005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:27.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:27.841+0000 7f8827fff640 1 -- 172.21.15.12:0/1134863228 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8828016030 con 0x7f8830106f10 2024-09-19T06:37:28.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:27 smithi016 ceph-mon[34911]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:28.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.017+0000 7f8834a0b640 1 -- 172.21.15.12:0/1134863228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f883010a0f0 con 0x7f8830106f10 2024-09-19T06:37:28.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.018+0000 7f8827fff640 1 -- 172.21.15.12:0/1134863228 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f882809cc90 con 0x7f8830106f10 2024-09-19T06:37:28.020 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-19T06:37:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.020+0000 7f8834a0b640 1 -- 172.21.15.12:0/1134863228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f881c0a3240 msgr2=0x7f881c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.020+0000 7f8834a0b640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f881c0a3240 0x7f881c0a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8820005ab0 tx=0x7f8820005a20 comp rx=0 tx=0).stop 2024-09-19T06:37:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.020+0000 7f8834a0b640 1 -- 172.21.15.12:0/1134863228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8830106f10 msgr2=0x7f883019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.020+0000 7f8834a0b640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8830106f10 0x7f883019cde0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f882800eaa0 tx=0x7f882800ef60 comp rx=0 tx=0).stop 2024-09-19T06:37:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.020+0000 7f8834a0b640 1 -- 172.21.15.12:0/1134863228 shutdown_connections 2024-09-19T06:37:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.020+0000 7f8834a0b640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f881c0a3240 0x7f881c0a5700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.020+0000 7f8834a0b640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8830106f10 0x7f883019cde0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.020+0000 7f8834a0b640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8830102790 0x7f8830198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.020+0000 7f8834a0b640 1 --2- 172.21.15.12:0/1134863228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830101de0 0x7f8830198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.020+0000 7f8834a0b640 1 -- 172.21.15.12:0/1134863228 >> 172.21.15.12:0/1134863228 conn(0x7f88300fd8c0 msgr2=0x7f88300fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.021+0000 7f8834a0b640 1 -- 172.21.15.12:0/1134863228 shutdown_connections 2024-09-19T06:37:28.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:28.021+0000 7f8834a0b640 1 -- 172.21.15.12:0/1134863228 wait complete. 2024-09-19T06:37:28.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:28 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1134863228' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:37:28.652 INFO:tasks.cephadm:Adding mds.a on smithi012 2024-09-19T06:37:28.652 INFO:tasks.cephadm:Adding mds.d on smithi012 2024-09-19T06:37:28.653 INFO:tasks.cephadm:Adding mds.g on smithi012 2024-09-19T06:37:28.653 INFO:tasks.cephadm:Adding mds.j on smithi012 2024-09-19T06:37:28.653 INFO:tasks.cephadm:Adding mds.b on smithi016 2024-09-19T06:37:28.653 INFO:tasks.cephadm:Adding mds.e on smithi016 2024-09-19T06:37:28.653 INFO:tasks.cephadm:Adding mds.h on smithi016 2024-09-19T06:37:28.653 INFO:tasks.cephadm:Adding mds.k on smithi016 2024-09-19T06:37:28.653 INFO:tasks.cephadm:Adding mds.c on smithi173 2024-09-19T06:37:28.653 INFO:tasks.cephadm:Adding mds.f on smithi173 2024-09-19T06:37:28.653 INFO:tasks.cephadm:Adding mds.i on smithi173 2024-09-19T06:37:28.653 INFO:tasks.cephadm:Adding mds.l on smithi173 2024-09-19T06:37:28.653 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi016=b;smithi016=e;smithi016=h;smithi016=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l' 2024-09-19T06:37:28.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:28 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1134863228' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:37:28.911 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:37:29.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:28 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1134863228' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:37:29.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.304+0000 7fa12fdb0640 1 -- 172.21.15.173:0/295330089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa128101c00 msgr2=0x7fa128102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.304+0000 7fa12fdb0640 1 --2- 172.21.15.173:0/295330089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa128101c00 0x7fa128102000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa124009900 tx=0x7fa12402a410 comp rx=0 tx=0).stop 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.304+0000 7fa12fdb0640 1 -- 172.21.15.173:0/295330089 shutdown_connections 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.304+0000 7fa12fdb0640 1 --2- 172.21.15.173:0/295330089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1281037c0 0x7fa12810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.304+0000 7fa12fdb0640 1 --2- 172.21.15.173:0/295330089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa128102e00 0x7fa128103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.304+0000 7fa12fdb0640 1 --2- 172.21.15.173:0/295330089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa128101c00 0x7fa128102000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.304+0000 7fa12fdb0640 1 -- 172.21.15.173:0/295330089 >> 172.21.15.173:0/295330089 conn(0x7fa1280fd390 msgr2=0x7fa1280ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12fdb0640 1 -- 172.21.15.173:0/295330089 shutdown_connections 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12fdb0640 1 -- 172.21.15.173:0/295330089 wait complete. 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12fdb0640 1 Processor -- start 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12fdb0640 1 -- start start 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12fdb0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa128101c00 0x7fa128075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12fdb0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa128102e00 0x7fa1280745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12fdb0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1281037c0 0x7fa128074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12fdb0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa12810d890 con 0x7fa128101c00 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12fdb0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa12810d710 con 0x7fa1281037c0 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12fdb0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa12810da10 con 0x7fa128102e00 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12d34b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa128102e00 0x7fa1280745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12d34b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa128102e00 0x7fa1280745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:33470/0 (socket says 172.21.15.173:33470) 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12d34b640 1 -- 172.21.15.173:0/2785560133 learned_addr learned my addr 172.21.15.173:0/2785560133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.305+0000 7fa12db4c640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa128101c00 0x7fa128075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa12e34d640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1281037c0 0x7fa128074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa12d34b640 1 -- 172.21.15.173:0/2785560133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1281037c0 msgr2=0x7fa128074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa12d34b640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1281037c0 0x7fa128074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa12d34b640 1 -- 172.21.15.173:0/2785560133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa128101c00 msgr2=0x7fa128075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa12d34b640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa128101c00 0x7fa128075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa12d34b640 1 -- 172.21.15.173:0/2785560133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1280753e0 con 0x7fa128102e00 2024-09-19T06:37:29.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa12e34d640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1281037c0 0x7fa128074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:29.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa12d34b640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa128102e00 0x7fa1280745e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c890 tx=0x7fa11800cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa11effd640 1 -- 172.21.15.173:0/2785560133 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118004220 con 0x7fa128102e00 2024-09-19T06:37:29.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa11effd640 1 -- 172.21.15.173:0/2785560133 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1180043c0 con 0x7fa128102e00 2024-09-19T06:37:29.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa12fdb0640 1 -- 172.21.15.173:0/2785560133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1281a2070 con 0x7fa128102e00 2024-09-19T06:37:29.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa11effd640 1 -- 172.21.15.173:0/2785560133 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1180049e0 con 0x7fa128102e00 2024-09-19T06:37:29.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.306+0000 7fa12fdb0640 1 -- 172.21.15.173:0/2785560133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1281a2580 con 0x7fa128102e00 2024-09-19T06:37:29.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.307+0000 7fa12fdb0640 1 -- 172.21.15.173:0/2785560133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa128102000 con 0x7fa128102e00 2024-09-19T06:37:29.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.308+0000 7fa11effd640 1 -- 172.21.15.173:0/2785560133 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa1180079b0 con 0x7fa128102e00 2024-09-19T06:37:29.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.309+0000 7fa11effd640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa1140a3240 0x7fa1140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:29.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.309+0000 7fa11effd640 1 -- 172.21.15.173:0/2785560133 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fa1180cf490 con 0x7fa128102e00 2024-09-19T06:37:29.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.309+0000 7fa12db4c640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa1140a3240 0x7fa1140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:29.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.310+0000 7fa12db4c640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa1140a3240 0x7fa1140a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa124005ab0 tx=0x7fa124000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:29.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.313+0000 7fa11effd640 1 -- 172.21.15.173:0/2785560133 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa118014030 con 0x7fa128102e00 2024-09-19T06:37:29.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.496+0000 7fa12fdb0640 1 -- 172.21.15.173:0/2785560133 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi016=b;smithi016=e;smithi016=h;smithi016=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}) -- 0x7fa128062830 con 0x7fa1140a3240 2024-09-19T06:37:29.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.504+0000 7fa11effd640 1 -- 172.21.15.173:0/2785560133 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fa128062830 con 0x7fa1140a3240 2024-09-19T06:37:29.507 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mds.all update... 2024-09-19T06:37:29.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.506+0000 7fa12fdb0640 1 -- 172.21.15.173:0/2785560133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa1140a3240 msgr2=0x7fa1140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.506+0000 7fa12fdb0640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa1140a3240 0x7fa1140a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa124005ab0 tx=0x7fa124000bc0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.506+0000 7fa12fdb0640 1 -- 172.21.15.173:0/2785560133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa128102e00 msgr2=0x7fa1280745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:29.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.506+0000 7fa12fdb0640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa128102e00 0x7fa1280745e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c890 tx=0x7fa11800cd50 comp rx=0 tx=0).stop 2024-09-19T06:37:29.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.507+0000 7fa12fdb0640 1 -- 172.21.15.173:0/2785560133 shutdown_connections 2024-09-19T06:37:29.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.507+0000 7fa12fdb0640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa1140a3240 0x7fa1140a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.507+0000 7fa12fdb0640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1281037c0 0x7fa128074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.507+0000 7fa12fdb0640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa128102e00 0x7fa1280745e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.507+0000 7fa12fdb0640 1 --2- 172.21.15.173:0/2785560133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa128101c00 0x7fa128075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:29.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.507+0000 7fa12fdb0640 1 -- 172.21.15.173:0/2785560133 >> 172.21.15.173:0/2785560133 conn(0x7fa1280fd390 msgr2=0x7fa128106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:29.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.507+0000 7fa12fdb0640 1 -- 172.21.15.173:0/2785560133 shutdown_connections 2024-09-19T06:37:29.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-19T06:37:29.507+0000 7fa12fdb0640 1 -- 172.21.15.173:0/2785560133 wait complete. 2024-09-19T06:37:29.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:29 smithi173 ceph-mon[35349]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:29.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:29.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:29 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:29.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:29 smithi012 ceph-mon[30937]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:29.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:29.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:29 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:30.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:29 smithi016 ceph-mon[34911]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:30.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:30.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:29 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:30.161 DEBUG:teuthology.orchestra.run.smithi012:mds.a> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T06:37:30.164 DEBUG:teuthology.orchestra.run.smithi012:mds.d> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T06:37:30.207 DEBUG:teuthology.orchestra.run.smithi012:mds.g> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T06:37:30.251 DEBUG:teuthology.orchestra.run.smithi012:mds.j> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T06:37:30.294 DEBUG:teuthology.orchestra.run.smithi016:mds.b> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T06:37:30.297 DEBUG:teuthology.orchestra.run.smithi016:mds.e> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T06:37:30.340 DEBUG:teuthology.orchestra.run.smithi016:mds.h> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T06:37:30.383 DEBUG:teuthology.orchestra.run.smithi016:mds.k> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T06:37:30.426 DEBUG:teuthology.orchestra.run.smithi173:mds.c> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T06:37:30.428 DEBUG:teuthology.orchestra.run.smithi173:mds.f> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T06:37:30.471 DEBUG:teuthology.orchestra.run.smithi173:mds.i> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T06:37:30.514 DEBUG:teuthology.orchestra.run.smithi173:mds.l> sudo journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T06:37:30.557 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T06:37:30.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:37:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:30 smithi173 ceph-mon[35349]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi016=b;smithi016=e;smithi016=h;smithi016=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:30 smithi173 ceph-mon[35349]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi016=b;smithi016=e;smithi016=h;smithi016=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-19T06:37:30.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:30 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:30.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:30 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:30.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:30 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:30.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:30 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:30.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:30 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:30.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:30 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:30.813 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:30 smithi012 ceph-mon[30937]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi016=b;smithi016=e;smithi016=h;smithi016=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:30 smithi012 ceph-mon[30937]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi016=b;smithi016=e;smithi016=h;smithi016=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-19T06:37:30.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:30 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:30.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:30 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:30.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:30 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:30.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:30 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:30.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:30 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:30.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:30 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:30 smithi016 ceph-mon[34911]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi016=b;smithi016=e;smithi016=h;smithi016=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:30 smithi016 ceph-mon[34911]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi016=b;smithi016=e;smithi016=h;smithi016=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-19T06:37:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:30 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:30 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:30 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:31.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:30 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:31.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:30 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:31.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:30 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:31.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.195+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2623477508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb0101de0 msgr2=0x7f0cb01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.195+0000 7f0cb52e7640 1 --2- 172.21.15.12:0/2623477508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb0101de0 0x7f0cb01021c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009900 tx=0x7f0ca002a410 comp rx=0 tx=0).stop 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.195+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2623477508 shutdown_connections 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.195+0000 7f0cb52e7640 1 --2- 172.21.15.12:0/2623477508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb0106f10 0x7f0cb010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.195+0000 7f0cb52e7640 1 --2- 172.21.15.12:0/2623477508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cb0102790 0x7f0cb01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.195+0000 7f0cb52e7640 1 --2- 172.21.15.12:0/2623477508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb0101de0 0x7f0cb01021c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.195+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2623477508 >> 172.21.15.12:0/2623477508 conn(0x7f0cb00fd8c0 msgr2=0x7f0cb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.195+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2623477508 shutdown_connections 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.195+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2623477508 wait complete. 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0cb52e7640 1 Processor -- start 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0cb52e7640 1 -- start start 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0cb52e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb0101de0 0x7f0cb01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0cb52e7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cb0102790 0x7f0cb0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0cb52e7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb0106f10 0x7f0cb019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0cb52e7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb0111f70 con 0x7f0cb0101de0 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0cb52e7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb0111df0 con 0x7f0cb0106f10 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0cb52e7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb01120f0 con 0x7f0cb0102790 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0caeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb0101de0 0x7f0cb01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0caeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb0101de0 0x7f0cb01983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47136/0 (socket says 172.21.15.12:47136) 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.196+0000 7f0caeffd640 1 -- 172.21.15.12:0/2989521270 learned_addr learned my addr 172.21.15.12:0/2989521270 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0caf7fe640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb0106f10 0x7f0cb019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0cae7fc640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cb0102790 0x7f0cb0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0caeffd640 1 -- 172.21.15.12:0/2989521270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cb0102790 msgr2=0x7f0cb0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0caeffd640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cb0102790 0x7f0cb0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0caeffd640 1 -- 172.21.15.12:0/2989521270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb0106f10 msgr2=0x7f0cb019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0caeffd640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb0106f10 0x7f0cb019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0caeffd640 1 -- 172.21.15.12:0/2989521270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb019d380 con 0x7f0cb0101de0 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0caeffd640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb0101de0 0x7f0cb01983d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0006010 tx=0x7f0ca00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0c97fff640 1 -- 172.21.15.12:0/2989521270 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca003f030 con 0x7f0cb0101de0 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0c97fff640 1 -- 172.21.15.12:0/2989521270 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ca0003ce0 con 0x7f0cb0101de0 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2989521270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb019d610 con 0x7f0cb0101de0 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0c97fff640 1 -- 172.21.15.12:0/2989521270 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0035070 con 0x7f0cb0101de0 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.197+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2989521270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb01a4f50 con 0x7f0cb0101de0 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.199+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2989521270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb01021c0 con 0x7f0cb0101de0 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.199+0000 7f0c97fff640 1 -- 172.21.15.12:0/2989521270 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0ca0042030 con 0x7f0cb0101de0 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.200+0000 7f0c97fff640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0c980a32c0 0x7f0c980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.200+0000 7f0cae7fc640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0c980a32c0 0x7f0c980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.200+0000 7f0c97fff640 1 -- 172.21.15.12:0/2989521270 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f0ca00ef880 con 0x7f0cb0101de0 2024-09-19T06:37:31.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.201+0000 7f0cae7fc640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0c980a32c0 0x7f0c980a5780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00fdce0 tx=0x7f0ca400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.204+0000 7f0c97fff640 1 -- 172.21.15.12:0/2989521270 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ca00bc4b0 con 0x7f0cb0101de0 2024-09-19T06:37:31.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.416+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2989521270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cb010a0f0 con 0x7f0cb0101de0 2024-09-19T06:37:31.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.417+0000 7f0c97fff640 1 -- 172.21.15.12:0/2989521270 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f0ca00c07b0 con 0x7f0cb0101de0 2024-09-19T06:37:31.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:31.420 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":1,"btime":"2024-09-19T06:30:34:142717+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T06:37:31.420 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 1 2024-09-19T06:37:31.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2989521270 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0c980a32c0 msgr2=0x7f0c980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0c980a32c0 0x7f0c980a5780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00fdce0 tx=0x7f0ca400b410 comp rx=0 tx=0).stop 2024-09-19T06:37:31.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2989521270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb0101de0 msgr2=0x7f0cb01983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb0101de0 0x7f0cb01983d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0006010 tx=0x7f0ca00042f0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2989521270 shutdown_connections 2024-09-19T06:37:31.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0c980a32c0 0x7f0c980a5780 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb0106f10 0x7f0cb019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cb0102790 0x7f0cb0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 --2- 172.21.15.12:0/2989521270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb0101de0 0x7f0cb01983d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2989521270 >> 172.21.15.12:0/2989521270 conn(0x7f0cb00fd8c0 msgr2=0x7f0cb00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2989521270 shutdown_connections 2024-09-19T06:37:31.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:31.419+0000 7f0cb52e7640 1 -- 172.21.15.12:0/2989521270 wait complete. 2024-09-19T06:37:31.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:31 smithi173 ceph-mon[35349]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:31.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:31 smithi173 ceph-mon[35349]: Deploying daemon mds.l on smithi173 2024-09-19T06:37:31.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:31 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2989521270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:31.833 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:37:31 smithi173 systemd[1]: Starting Ceph mds.l for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:37:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:31 smithi012 ceph-mon[30937]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:31 smithi012 ceph-mon[30937]: Deploying daemon mds.l on smithi173 2024-09-19T06:37:31.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:31 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2989521270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:32.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:31 smithi016 ceph-mon[34911]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:31 smithi016 ceph-mon[34911]: Deploying daemon mds.l on smithi173 2024-09-19T06:37:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:31 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2989521270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:32.221 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:37:31 smithi173 podman[64928]: 2024-09-19 06:37:31.803798741 +0000 UTC m=+0.015749702 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:37:32.221 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:37:31 smithi173 podman[64928]: 2024-09-19 06:37:31.909153489 +0000 UTC m=+0.121104483 container create 65c61c6c3f8c9499984d2ea638096e5d08ead3f2262bd9f09248af41288aa370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T06:37:32.221 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:37:32 smithi173 podman[64928]: 2024-09-19 06:37:32.111332253 +0000 UTC m=+0.323283211 container init 65c61c6c3f8c9499984d2ea638096e5d08ead3f2262bd9f09248af41288aa370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T06:37:32.221 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:37:32 smithi173 podman[64928]: 2024-09-19 06:37:32.114233847 +0000 UTC m=+0.326184800 container start 65c61c6c3f8c9499984d2ea638096e5d08ead3f2262bd9f09248af41288aa370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T06:37:32.221 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:37:32 smithi173 ceph-mds[64947]: -- 172.21.15.173:0/491660307 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55872410b860 con 0x5587240e8800 2024-09-19T06:37:32.221 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:37:32 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l[64943]: starting mds.l at 2024-09-19T06:37:32.221 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:37:32 smithi173 bash[64928]: 65c61c6c3f8c9499984d2ea638096e5d08ead3f2262bd9f09248af41288aa370 2024-09-19T06:37:32.582 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:37:32 smithi173 systemd[1]: Started Ceph mds.l for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:37:33.484 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:33.484 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] up:boot 2024-09-19T06:37:33.484 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: fsmap 1 up:standby 2024-09-19T06:37:33.484 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:37:33.484 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:33.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:33 smithi173 ceph-mon[35349]: Deploying daemon mds.k on smithi016 2024-09-19T06:37:33.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:33.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] up:boot 2024-09-19T06:37:33.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: fsmap 1 up:standby 2024-09-19T06:37:33.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:37:33.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:33.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:33.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:33.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:33.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:33.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:33.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:33 smithi016 ceph-mon[34911]: Deploying daemon mds.k on smithi016 2024-09-19T06:37:33.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:33.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] up:boot 2024-09-19T06:37:33.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: fsmap 1 up:standby 2024-09-19T06:37:33.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:37:33.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:33.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:33 smithi012 ceph-mon[30937]: Deploying daemon mds.k on smithi016 2024-09-19T06:37:34.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:37:34.489 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:34.615 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:37:34 smithi016 podman[63345]: 2024-09-19 06:37:34.491116863 +0000 UTC m=+0.016959104 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:37:34.615 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:37:34 smithi016 podman[63345]: 2024-09-19 06:37:34.61364123 +0000 UTC m=+0.139483464 container create 2b0605a75a93da61cbab7322ff89d1fc15a78ab7d27d3ed380c9b9d594771e98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T06:37:34.887 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:37:34 smithi016 podman[63345]: 2024-09-19 06:37:34.857906052 +0000 UTC m=+0.383748287 container init 2b0605a75a93da61cbab7322ff89d1fc15a78ab7d27d3ed380c9b9d594771e98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T06:37:34.887 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:37:34 smithi016 podman[63345]: 2024-09-19 06:37:34.860829621 +0000 UTC m=+0.386671856 container start 2b0605a75a93da61cbab7322ff89d1fc15a78ab7d27d3ed380c9b9d594771e98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T06:37:34.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.987+0000 7f491bb05640 1 -- 172.21.15.12:0/81916305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4914101420 msgr2=0x7f491410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.987+0000 7f491bb05640 1 --2- 172.21.15.12:0/81916305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4914101420 0x7f491410d950 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f490c009cd0 tx=0x7f490c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.987+0000 7f491bb05640 1 -- 172.21.15.12:0/81916305 shutdown_connections 2024-09-19T06:37:34.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.987+0000 7f491bb05640 1 --2- 172.21.15.12:0/81916305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4914101420 0x7f491410d950 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.987+0000 7f491bb05640 1 --2- 172.21.15.12:0/81916305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4914100a80 0x7f4914100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.987+0000 7f491bb05640 1 --2- 172.21.15.12:0/81916305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4914106a80 0x7f4914106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.987+0000 7f491bb05640 1 -- 172.21.15.12:0/81916305 >> 172.21.15.12:0/81916305 conn(0x7f49140fc7a0 msgr2=0x7f49140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.987+0000 7f491bb05640 1 -- 172.21.15.12:0/81916305 shutdown_connections 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.987+0000 7f491bb05640 1 -- 172.21.15.12:0/81916305 wait complete. 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f491bb05640 1 Processor -- start 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f491bb05640 1 -- start start 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f491bb05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4914100a80 0x7f4914198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f491bb05640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4914101420 0x7f4914198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f491bb05640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4914106a80 0x7f491419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f491bb05640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4914111f90 con 0x7f4914100a80 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f491bb05640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4914111e10 con 0x7f4914106a80 2024-09-19T06:37:34.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f491bb05640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4914112110 con 0x7f4914101420 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f49198a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4914100a80 0x7f4914198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f49198a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4914100a80 0x7f4914198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47166/0 (socket says 172.21.15.12:47166) 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f49198a1640 1 -- 172.21.15.12:0/1119571216 learned_addr learned my addr 172.21.15.12:0/1119571216 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.988+0000 7f491a0a2640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4914106a80 0x7f491419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f49190a0640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4914101420 0x7f4914198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f49198a1640 1 -- 172.21.15.12:0/1119571216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4914101420 msgr2=0x7f4914198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f49198a1640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4914101420 0x7f4914198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f49198a1640 1 -- 172.21.15.12:0/1119571216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4914106a80 msgr2=0x7f491419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f49198a1640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4914106a80 0x7f491419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f49198a1640 1 -- 172.21.15.12:0/1119571216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491419d400 con 0x7f4914100a80 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f49190a0640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4914101420 0x7f4914198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:34.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f49198a1640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4914100a80 0x7f4914198450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f491000e9f0 tx=0x7f491000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f490affd640 1 -- 172.21.15.12:0/1119571216 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491000cd80 con 0x7f4914100a80 2024-09-19T06:37:34.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f490affd640 1 -- 172.21.15.12:0/1119571216 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4910010910 con 0x7f4914100a80 2024-09-19T06:37:34.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f491bb05640 1 -- 172.21.15.12:0/1119571216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f491419d6f0 con 0x7f4914100a80 2024-09-19T06:37:34.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f490affd640 1 -- 172.21.15.12:0/1119571216 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910018990 con 0x7f4914100a80 2024-09-19T06:37:34.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.989+0000 7f491bb05640 1 -- 172.21.15.12:0/1119571216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49141a4fd0 con 0x7f4914100a80 2024-09-19T06:37:34.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.990+0000 7f491bb05640 1 -- 172.21.15.12:0/1119571216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4914100ee0 con 0x7f4914100a80 2024-09-19T06:37:34.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.991+0000 7f490affd640 1 -- 172.21.15.12:0/1119571216 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4910010ac0 con 0x7f4914100a80 2024-09-19T06:37:34.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.992+0000 7f490affd640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49000a32c0 0x7f49000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:34.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.992+0000 7f49190a0640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49000a32c0 0x7f49000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:34.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.992+0000 7f490affd640 1 -- 172.21.15.12:0/1119571216 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f49100cf790 con 0x7f4914100a80 2024-09-19T06:37:34.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.993+0000 7f49190a0640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49000a32c0 0x7f49000a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f49040058c0 tx=0x7f4904005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:34.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:34.996+0000 7f490affd640 1 -- 172.21.15.12:0/1119571216 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f491009c8b0 con 0x7f4914100a80 2024-09-19T06:37:35.150 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:37:34 smithi016 ceph-mds[63372]: -- 172.21.15.16:0/4194159676 <== mon.2 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c2e7c5b860 con 0x55c2e7c38800 2024-09-19T06:37:35.151 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:37:34 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k[63368]: starting mds.k at 2024-09-19T06:37:35.151 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:37:35 smithi016 bash[63345]: 2b0605a75a93da61cbab7322ff89d1fc15a78ab7d27d3ed380c9b9d594771e98 2024-09-19T06:37:35.151 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:37:35 smithi016 systemd[1]: Started Ceph mds.k for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:37:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.211+0000 7f491bb05640 1 -- 172.21.15.12:0/1119571216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f491402d7c0 con 0x7f4914100a80 2024-09-19T06:37:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.211+0000 7f490affd640 1 -- 172.21.15.12:0/1119571216 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f491009c1b0 con 0x7f4914100a80 2024-09-19T06:37:35.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:35 smithi012 ceph-mon[30937]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:35.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:35.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:35.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:35.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:35.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:35.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:35 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:35.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:35.214 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"btime":"2024-09-19T06:37:35:146836+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:37:35.214 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-09-19T06:37:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 -- 172.21.15.12:0/1119571216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49000a32c0 msgr2=0x7f49000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49000a32c0 0x7f49000a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f49040058c0 tx=0x7f4904005850 comp rx=0 tx=0).stop 2024-09-19T06:37:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 -- 172.21.15.12:0/1119571216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4914100a80 msgr2=0x7f4914198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4914100a80 0x7f4914198450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f491000e9f0 tx=0x7f491000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 -- 172.21.15.12:0/1119571216 shutdown_connections 2024-09-19T06:37:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49000a32c0 0x7f49000a5780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4914106a80 0x7f491419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4914101420 0x7f4914198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 --2- 172.21.15.12:0/1119571216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4914100a80 0x7f4914198450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 -- 172.21.15.12:0/1119571216 >> 172.21.15.12:0/1119571216 conn(0x7f49140fc7a0 msgr2=0x7f49140fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 -- 172.21.15.12:0/1119571216 shutdown_connections 2024-09-19T06:37:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:35.215+0000 7f491bb05640 1 -- 172.21.15.12:0/1119571216 wait complete. 2024-09-19T06:37:35.442 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:35 smithi016 ceph-mon[34911]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:35.442 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:35.442 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:35.443 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:35.443 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:35.443 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:35.443 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:35 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:35 smithi173 ceph-mon[35349]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:35 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:36.324 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:36 smithi012 ceph-mon[30937]: Deploying daemon mds.j on smithi012 2024-09-19T06:37:36.325 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:36 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] up:boot 2024-09-19T06:37:36.325 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:36 smithi012 ceph-mon[30937]: fsmap 2 up:standby 2024-09-19T06:37:36.325 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:36 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:37:36.325 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:36 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1119571216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:36.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:36 smithi016 ceph-mon[34911]: Deploying daemon mds.j on smithi012 2024-09-19T06:37:36.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:36 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] up:boot 2024-09-19T06:37:36.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:36 smithi016 ceph-mon[34911]: fsmap 2 up:standby 2024-09-19T06:37:36.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:36 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:37:36.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:36 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1119571216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:36.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:36 smithi173 ceph-mon[35349]: Deploying daemon mds.j on smithi012 2024-09-19T06:37:36.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:36 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] up:boot 2024-09-19T06:37:36.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:36 smithi173 ceph-mon[35349]: fsmap 2 up:standby 2024-09-19T06:37:36.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:36 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:37:36.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:36 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1119571216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:37.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:37 smithi016 ceph-mon[34911]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:37.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:37 smithi012 ceph-mon[30937]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:37.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:37 smithi173 ceph-mon[35349]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:37.879 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:37:37 smithi012 systemd[1]: Starting Ceph mds.j for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:37:37.991 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:37:38.216 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:37:37 smithi012 podman[70899]: 2024-09-19 06:37:37.854615301 +0000 UTC m=+0.016245667 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:37:38.216 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:37:37 smithi012 podman[70899]: 2024-09-19 06:37:37.9712629 +0000 UTC m=+0.132893248 container create b79df0ecf29ca36165467983933d5c58b948aa7758094d6413043ba47d3286f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:37:38.217 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:37:38 smithi012 podman[70899]: 2024-09-19 06:37:38.215599836 +0000 UTC m=+0.377230200 container init b79df0ecf29ca36165467983933d5c58b948aa7758094d6413043ba47d3286f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T06:37:38.437 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:38.563 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:37:38 smithi012 podman[70899]: 2024-09-19 06:37:38.219045053 +0000 UTC m=+0.380675403 container start b79df0ecf29ca36165467983933d5c58b948aa7758094d6413043ba47d3286f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:37:38.563 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:37:38 smithi012 ceph-mds[70949]: -- 172.21.15.12:0/2223056977 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558590923860 con 0x558590901400 2024-09-19T06:37:38.563 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:37:38 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-j[70932]: starting mds.j at 2024-09-19T06:37:38.563 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:37:38 smithi012 bash[70899]: b79df0ecf29ca36165467983933d5c58b948aa7758094d6413043ba47d3286f5 2024-09-19T06:37:38.563 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:37:38 smithi012 systemd[1]: Started Ceph mds.j for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:37:38.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.929+0000 7fce1d718640 1 -- 172.21.15.12:0/288717737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18101410 msgr2=0x7fce1810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:38.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.929+0000 7fce1d718640 1 --2- 172.21.15.12:0/288717737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18101410 0x7fce1810d940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fce10009cd0 tx=0x7fce1002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.929+0000 7fce1d718640 1 -- 172.21.15.12:0/288717737 shutdown_connections 2024-09-19T06:37:38.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.929+0000 7fce1d718640 1 --2- 172.21.15.12:0/288717737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18101410 0x7fce1810d940 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.929+0000 7fce1d718640 1 --2- 172.21.15.12:0/288717737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce18100a70 0x7fce18100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.929+0000 7fce1d718640 1 --2- 172.21.15.12:0/288717737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce18106a70 0x7fce18106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.929+0000 7fce1d718640 1 -- 172.21.15.12:0/288717737 >> 172.21.15.12:0/288717737 conn(0x7fce180fc7d0 msgr2=0x7fce180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.929+0000 7fce1d718640 1 -- 172.21.15.12:0/288717737 shutdown_connections 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.929+0000 7fce1d718640 1 -- 172.21.15.12:0/288717737 wait complete. 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.929+0000 7fce1d718640 1 Processor -- start 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce1d718640 1 -- start start 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce1d718640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce18100a70 0x7fce18196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce1d718640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18101410 0x7fce18197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce1d718640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce18106a70 0x7fce18197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce1d718640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fce18110e70 con 0x7fce18101410 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce1d718640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fce18110cf0 con 0x7fce18100a70 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce1d718640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fce18110ff0 con 0x7fce18106a70 2024-09-19T06:37:38.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce167fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18101410 0x7fce18197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:38.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce167fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18101410 0x7fce18197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47198/0 (socket says 172.21.15.12:47198) 2024-09-19T06:37:38.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce167fc640 1 -- 172.21.15.12:0/4056291610 learned_addr learned my addr 172.21.15.12:0/4056291610 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:38.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce16ffd640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce18100a70 0x7fce18196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:38.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce177fe640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce18106a70 0x7fce18197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce167fc640 1 -- 172.21.15.12:0/4056291610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce18106a70 msgr2=0x7fce18197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce167fc640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce18106a70 0x7fce18197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce167fc640 1 -- 172.21.15.12:0/4056291610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce18100a70 msgr2=0x7fce18196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce167fc640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce18100a70 0x7fce18196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce167fc640 1 -- 172.21.15.12:0/4056291610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce181a6830 con 0x7fce18101410 2024-09-19T06:37:39.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce177fe640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce18106a70 0x7fce18197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:39.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce167fc640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18101410 0x7fce18197500 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fce0000d950 tx=0x7fce0000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.930+0000 7fce0ffff640 1 -- 172.21.15.12:0/4056291610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00017070 con 0x7fce18101410 2024-09-19T06:37:39.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.931+0000 7fce1d718640 1 -- 172.21.15.12:0/4056291610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce181a6b20 con 0x7fce18101410 2024-09-19T06:37:39.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.931+0000 7fce1d718640 1 -- 172.21.15.12:0/4056291610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce181a70b0 con 0x7fce18101410 2024-09-19T06:37:39.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.931+0000 7fce0ffff640 1 -- 172.21.15.12:0/4056291610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce0000de80 con 0x7fce18101410 2024-09-19T06:37:39.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.931+0000 7fce0ffff640 1 -- 172.21.15.12:0/4056291610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00020060 con 0x7fce18101410 2024-09-19T06:37:39.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.932+0000 7fce1d718640 1 -- 172.21.15.12:0/4056291610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce18100ed0 con 0x7fce18101410 2024-09-19T06:37:39.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.933+0000 7fce0ffff640 1 -- 172.21.15.12:0/4056291610 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fce00009c30 con 0x7fce18101410 2024-09-19T06:37:39.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.933+0000 7fce0ffff640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fce040a3240 0x7fce040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.933+0000 7fce16ffd640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fce040a3240 0x7fce040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.934+0000 7fce0ffff640 1 -- 172.21.15.12:0/4056291610 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fce000ced70 con 0x7fce18101410 2024-09-19T06:37:39.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.934+0000 7fce16ffd640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fce040a3240 0x7fce040a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce0800ab60 tx=0x7fce0800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:38.938+0000 7fce0ffff640 1 -- 172.21.15.12:0/4056291610 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce0009bf30 con 0x7fce18101410 2024-09-19T06:37:39.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.160+0000 7fce1d718640 1 -- 172.21.15.12:0/4056291610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce181a7440 con 0x7fce18101410 2024-09-19T06:37:39.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.160+0000 7fce0ffff640 1 -- 172.21.15.12:0/4056291610 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7fce0009b830 con 0x7fce18101410 2024-09-19T06:37:39.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"btime":"2024-09-19T06:37:35:146836+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:37:39.163 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-09-19T06:37:39.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.163+0000 7fce1d718640 1 -- 172.21.15.12:0/4056291610 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fce040a3240 msgr2=0x7fce040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.163+0000 7fce1d718640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fce040a3240 0x7fce040a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce0800ab60 tx=0x7fce0800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.163+0000 7fce1d718640 1 -- 172.21.15.12:0/4056291610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18101410 msgr2=0x7fce18197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.163+0000 7fce1d718640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18101410 0x7fce18197500 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fce0000d950 tx=0x7fce0000dd50 comp rx=0 tx=0).stop 2024-09-19T06:37:39.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.163+0000 7fce1d718640 1 -- 172.21.15.12:0/4056291610 shutdown_connections 2024-09-19T06:37:39.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.163+0000 7fce1d718640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fce040a3240 0x7fce040a5700 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce0800ab60 tx=0x7fce0800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.163+0000 7fce1d718640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce18106a70 0x7fce18197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.163+0000 7fce1d718640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18101410 0x7fce18197500 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.163+0000 7fce1d718640 1 --2- 172.21.15.12:0/4056291610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce18100a70 0x7fce18196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.163+0000 7fce1d718640 1 -- 172.21.15.12:0/4056291610 >> 172.21.15.12:0/4056291610 conn(0x7fce180fc7d0 msgr2=0x7fce180fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:39.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.164+0000 7fce1d718640 1 -- 172.21.15.12:0/4056291610 shutdown_connections 2024-09-19T06:37:39.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:39.164+0000 7fce1d718640 1 -- 172.21.15.12:0/4056291610 wait complete. 2024-09-19T06:37:39.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:39.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:39.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:39.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:39.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:39.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:39.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:39.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: Deploying daemon mds.d on smithi012 2024-09-19T06:37:39.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/4056291610' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:39.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.12:6834/1831354583,v1:172.21.15.12:6835/1831354583] up:boot 2024-09-19T06:37:39.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: fsmap 3 up:standby 2024-09-19T06:37:39.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:39 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:37:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: Deploying daemon mds.d on smithi012 2024-09-19T06:37:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/4056291610' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:39.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.12:6834/1831354583,v1:172.21.15.12:6835/1831354583] up:boot 2024-09-19T06:37:39.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: fsmap 3 up:standby 2024-09-19T06:37:39.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:39 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: Deploying daemon mds.d on smithi012 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/4056291610' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.12:6834/1831354583,v1:172.21.15.12:6835/1831354583] up:boot 2024-09-19T06:37:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: fsmap 3 up:standby 2024-09-19T06:37:39.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:39 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:37:41.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:41 smithi012 ceph-mon[30937]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:41.597 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:37:41 smithi012 systemd[1]: Starting Ceph mds.d for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:37:41.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:41 smithi016 ceph-mon[34911]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:41.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:41 smithi173 ceph-mon[35349]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:41.864 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:37:41 smithi012 podman[71316]: 2024-09-19 06:37:41.498609704 +0000 UTC m=+0.016696045 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:37:41.864 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:37:41 smithi012 podman[71316]: 2024-09-19 06:37:41.613072239 +0000 UTC m=+0.131158613 container create 16d7996e63df0c488f38e02b1099031d1234ee423cf30bb27f19831c1f133210 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T06:37:41.864 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:37:41 smithi012 podman[71316]: 2024-09-19 06:37:41.836715967 +0000 UTC m=+0.354802309 container init 16d7996e63df0c488f38e02b1099031d1234ee423cf30bb27f19831c1f133210 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T06:37:41.864 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:37:41 smithi012 podman[71316]: 2024-09-19 06:37:41.839752082 +0000 UTC m=+0.357838423 container start 16d7996e63df0c488f38e02b1099031d1234ee423cf30bb27f19831c1f133210 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T06:37:41.997 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:37:42.129 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:37:41 smithi012 ceph-mds[71335]: -- 172.21.15.12:0/394319872 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c8f99a3860 con 0x55c8f9981000 2024-09-19T06:37:42.129 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:37:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-d[71331]: starting mds.d at 2024-09-19T06:37:42.129 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:37:41 smithi012 bash[71316]: 16d7996e63df0c488f38e02b1099031d1234ee423cf30bb27f19831c1f133210 2024-09-19T06:37:42.129 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:37:41 smithi012 systemd[1]: Started Ceph mds.d for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:37:42.257 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.707+0000 7f08ad6bf640 1 -- 172.21.15.12:0/1832587691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a8100350 msgr2=0x7f08a8100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.707+0000 7f08ad6bf640 1 --2- 172.21.15.12:0/1832587691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a8100350 0x7f08a8100730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0898009930 tx=0x7f089802a420 comp rx=0 tx=0).stop 2024-09-19T06:37:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.707+0000 7f08ad6bf640 1 -- 172.21.15.12:0/1832587691 shutdown_connections 2024-09-19T06:37:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.707+0000 7f08ad6bf640 1 --2- 172.21.15.12:0/1832587691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08a8106f50 0x7f08a810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.707+0000 7f08ad6bf640 1 --2- 172.21.15.12:0/1832587691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a8100d00 0x7f08a8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.707+0000 7f08ad6bf640 1 --2- 172.21.15.12:0/1832587691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a8100350 0x7f08a8100730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.707+0000 7f08ad6bf640 1 -- 172.21.15.12:0/1832587691 >> 172.21.15.12:0/1832587691 conn(0x7f08a8077210 msgr2=0x7f08a80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.707+0000 7f08ad6bf640 1 -- 172.21.15.12:0/1832587691 shutdown_connections 2024-09-19T06:37:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.707+0000 7f08ad6bf640 1 -- 172.21.15.12:0/1832587691 wait complete. 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08ad6bf640 1 Processor -- start 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08ad6bf640 1 -- start start 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08ad6bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a8100350 0x7f08a819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08ad6bf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08a8100d00 0x7f08a819ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08ad6bf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a8106f50 0x7f08a819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08ad6bf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8111fa0 con 0x7f08a8100350 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08ad6bf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8111e20 con 0x7f08a8100d00 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08ad6bf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8112120 con 0x7f08a8106f50 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08a6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a8100350 0x7f08a819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08a6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a8100350 0x7f08a819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36960/0 (socket says 172.21.15.12:36960) 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08a6ffd640 1 -- 172.21.15.12:0/824808820 learned_addr learned my addr 172.21.15.12:0/824808820 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.708+0000 7f08a67fc640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08a8100d00 0x7f08a819ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08a77fe640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a8106f50 0x7f08a819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08a6ffd640 1 -- 172.21.15.12:0/824808820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a8106f50 msgr2=0x7f08a819efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08a6ffd640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a8106f50 0x7f08a819efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08a6ffd640 1 -- 172.21.15.12:0/824808820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08a8100d00 msgr2=0x7f08a819ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08a6ffd640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08a8100d00 0x7f08a819ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08a6ffd640 1 -- 172.21.15.12:0/824808820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a819f6c0 con 0x7f08a8100350 2024-09-19T06:37:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08a67fc640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08a8100d00 0x7f08a819ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08a77fe640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a8106f50 0x7f08a819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08a6ffd640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a8100350 0x7f08a819a710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0898009230 tx=0x7f0898004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:42.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f089ffff640 1 -- 172.21.15.12:0/824808820 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089803f030 con 0x7f08a8100350 2024-09-19T06:37:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f089ffff640 1 -- 172.21.15.12:0/824808820 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0898003ad0 con 0x7f08a8100350 2024-09-19T06:37:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08ad6bf640 1 -- 172.21.15.12:0/824808820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a819f950 con 0x7f08a8100350 2024-09-19T06:37:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f089ffff640 1 -- 172.21.15.12:0/824808820 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898035070 con 0x7f08a8100350 2024-09-19T06:37:42.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.709+0000 7f08ad6bf640 1 -- 172.21.15.12:0/824808820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a81a7290 con 0x7f08a8100350 2024-09-19T06:37:42.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.710+0000 7f08ad6bf640 1 -- 172.21.15.12:0/824808820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a8100730 con 0x7f08a8100350 2024-09-19T06:37:42.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.711+0000 7f089ffff640 1 -- 172.21.15.12:0/824808820 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0898042030 con 0x7f08a8100350 2024-09-19T06:37:42.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.712+0000 7f089ffff640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f08940a3240 0x7f08940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:42.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.712+0000 7f08a67fc640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f08940a3240 0x7f08940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:42.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.712+0000 7f089ffff640 1 -- 172.21.15.12:0/824808820 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f08980eff90 con 0x7f08a8100350 2024-09-19T06:37:42.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.713+0000 7f08a67fc640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f08940a3240 0x7f08940a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f08a810ef30 tx=0x7f089000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:42.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.716+0000 7f089ffff640 1 -- 172.21.15.12:0/824808820 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08980bd0b0 con 0x7f08a8100350 2024-09-19T06:37:42.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.927+0000 7f08ad6bf640 1 -- 172.21.15.12:0/824808820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08a81a7460 con 0x7f08a8100350 2024-09-19T06:37:42.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.927+0000 7f089ffff640 1 -- 172.21.15.12:0/824808820 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f08980bc9b0 con 0x7f08a8100350 2024-09-19T06:37:42.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:42.929 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"btime":"2024-09-19T06:37:42:377296+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:37:42.930 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 5 2024-09-19T06:37:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.929+0000 7f08ad6bf640 1 -- 172.21.15.12:0/824808820 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f08940a3240 msgr2=0x7f08940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.929+0000 7f08ad6bf640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f08940a3240 0x7f08940a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f08a810ef30 tx=0x7f089000b390 comp rx=0 tx=0).stop 2024-09-19T06:37:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.929+0000 7f08ad6bf640 1 -- 172.21.15.12:0/824808820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a8100350 msgr2=0x7f08a819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.929+0000 7f08ad6bf640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a8100350 0x7f08a819a710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0898009230 tx=0x7f0898004270 comp rx=0 tx=0).stop 2024-09-19T06:37:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.929+0000 7f08ad6bf640 1 -- 172.21.15.12:0/824808820 shutdown_connections 2024-09-19T06:37:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.929+0000 7f08ad6bf640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f08940a3240 0x7f08940a5700 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.929+0000 7f08ad6bf640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08a8106f50 0x7f08a819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.929+0000 7f08ad6bf640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08a8100d00 0x7f08a819ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:42.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.929+0000 7f08ad6bf640 1 --2- 172.21.15.12:0/824808820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a8100350 0x7f08a819a710 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:42.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.929+0000 7f08ad6bf640 1 -- 172.21.15.12:0/824808820 >> 172.21.15.12:0/824808820 conn(0x7f08a8077210 msgr2=0x7f08a81057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:42.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.930+0000 7f08ad6bf640 1 -- 172.21.15.12:0/824808820 shutdown_connections 2024-09-19T06:37:42.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:42.930+0000 7f08ad6bf640 1 -- 172.21.15.12:0/824808820 wait complete. 2024-09-19T06:37:43.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:43.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:43.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:43.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:43.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:43.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:43.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:43.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: Deploying daemon mds.e on smithi016 2024-09-19T06:37:43.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.12:6836/2426691660,v1:172.21.15.12:6837/2426691660] up:boot 2024-09-19T06:37:43.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: fsmap 4 up:standby 2024-09-19T06:37:43.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:37:43.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:42 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/824808820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:43.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:43.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:43.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:43.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:43.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:43.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:43.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:43.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: Deploying daemon mds.e on smithi016 2024-09-19T06:37:43.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.12:6836/2426691660,v1:172.21.15.12:6837/2426691660] up:boot 2024-09-19T06:37:43.296 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: fsmap 4 up:standby 2024-09-19T06:37:43.296 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:37:43.296 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:42 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/824808820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:43.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:43.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:43.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:43.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:43.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:43.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:43.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:43.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: Deploying daemon mds.e on smithi016 2024-09-19T06:37:43.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.12:6836/2426691660,v1:172.21.15.12:6837/2426691660] up:boot 2024-09-19T06:37:43.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: fsmap 4 up:standby 2024-09-19T06:37:43.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:37:43.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:42 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/824808820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:44.194 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:37:43 smithi016 systemd[1]: Starting Ceph mds.e for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:37:44.509 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:37:44 smithi016 podman[63659]: 2024-09-19 06:37:44.09594643 +0000 UTC m=+0.015825672 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:37:44.509 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:37:44 smithi016 podman[63659]: 2024-09-19 06:37:44.22738196 +0000 UTC m=+0.147261201 container create f0d1477f8ec71263c0c7f9c8d17bce6c2a94d7091494c4d474c57378d485043e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T06:37:44.998 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:37:44 smithi016 podman[63659]: 2024-09-19 06:37:44.553994449 +0000 UTC m=+0.473873706 container init f0d1477f8ec71263c0c7f9c8d17bce6c2a94d7091494c4d474c57378d485043e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:37:44.999 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:37:44 smithi016 podman[63659]: 2024-09-19 06:37:44.556993094 +0000 UTC m=+0.476872336 container start f0d1477f8ec71263c0c7f9c8d17bce6c2a94d7091494c4d474c57378d485043e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T06:37:44.999 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:37:44 smithi016 ceph-mds[63678]: -- 172.21.15.16:0/2413679439 <== mon.2 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ffcf4c3860 con 0x55ffcf4a0800 2024-09-19T06:37:44.999 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:37:44 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e[63674]: starting mds.e at 2024-09-19T06:37:44.999 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:37:44 smithi016 bash[63659]: f0d1477f8ec71263c0c7f9c8d17bce6c2a94d7091494c4d474c57378d485043e 2024-09-19T06:37:44.999 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:37:44 smithi016 systemd[1]: Started Ceph mds.e for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:37:45.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:44 smithi016 ceph-mon[34911]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:44 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:44 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:44 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:44 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:44 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:44 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:45.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:44 smithi173 ceph-mon[35349]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:45.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:44 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:44 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:44 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:44 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:44 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:44 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:44 smithi012 ceph-mon[30937]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:45.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:45.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:45.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:45.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:44 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:45.791 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:37:46.065 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:46 smithi012 ceph-mon[30937]: Deploying daemon mds.f on smithi173 2024-09-19T06:37:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:46 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.16:6834/549418858,v1:172.21.15.16:6835/549418858] up:boot 2024-09-19T06:37:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:46 smithi012 ceph-mon[30937]: fsmap 5 up:standby 2024-09-19T06:37:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:46 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:37:46.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:46 smithi016 ceph-mon[34911]: Deploying daemon mds.f on smithi173 2024-09-19T06:37:46.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:46 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.16:6834/549418858,v1:172.21.15.16:6835/549418858] up:boot 2024-09-19T06:37:46.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:46 smithi016 ceph-mon[34911]: fsmap 5 up:standby 2024-09-19T06:37:46.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:46 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:37:46.280 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:46 smithi173 ceph-mon[35349]: Deploying daemon mds.f on smithi173 2024-09-19T06:37:46.280 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:46 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.16:6834/549418858,v1:172.21.15.16:6835/549418858] up:boot 2024-09-19T06:37:46.280 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:46 smithi173 ceph-mon[35349]: fsmap 5 up:standby 2024-09-19T06:37:46.280 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:46 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:37:46.582 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:37:46 smithi173 systemd[1]: Starting Ceph mds.f for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:37:46.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.563+0000 7f67fa92b640 1 -- 172.21.15.12:0/193066868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67f4101de0 msgr2=0x7f67f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.563+0000 7f67fa92b640 1 --2- 172.21.15.12:0/193066868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67f4101de0 0x7f67f41021c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009900 tx=0x7f67e402a410 comp rx=0 tx=0).stop 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.563+0000 7f67fa92b640 1 -- 172.21.15.12:0/193066868 shutdown_connections 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.563+0000 7f67fa92b640 1 --2- 172.21.15.12:0/193066868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f4106f10 0x7f67f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.563+0000 7f67fa92b640 1 --2- 172.21.15.12:0/193066868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67f4102790 0x7f67f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.563+0000 7f67fa92b640 1 --2- 172.21.15.12:0/193066868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67f4101de0 0x7f67f41021c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.563+0000 7f67fa92b640 1 -- 172.21.15.12:0/193066868 >> 172.21.15.12:0/193066868 conn(0x7f67f40fd8c0 msgr2=0x7f67f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.563+0000 7f67fa92b640 1 -- 172.21.15.12:0/193066868 shutdown_connections 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.563+0000 7f67fa92b640 1 -- 172.21.15.12:0/193066868 wait complete. 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67fa92b640 1 Processor -- start 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67fa92b640 1 -- start start 2024-09-19T06:37:46.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67fa92b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f4101de0 0x7f67f41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67fa92b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67f4102790 0x7f67f4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67fa92b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67f4106f10 0x7f67f419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67fa92b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f67f4111f70 con 0x7f67f4102790 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67fa92b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f67f4111df0 con 0x7f67f4106f10 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67fa92b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41120f0 con 0x7f67f4101de0 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67f37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67f4102790 0x7f67f4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67f3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f4101de0 0x7f67f41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67f37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67f4102790 0x7f67f4198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36986/0 (socket says 172.21.15.12:36986) 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.564+0000 7f67f37fe640 1 -- 172.21.15.12:0/1229450634 learned_addr learned my addr 172.21.15.12:0/1229450634 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f8ec8640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67f4106f10 0x7f67f419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f37fe640 1 -- 172.21.15.12:0/1229450634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f4101de0 msgr2=0x7f67f41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:46.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f37fe640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f4101de0 0x7f67f41984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f37fe640 1 -- 172.21.15.12:0/1229450634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67f4106f10 msgr2=0x7f67f419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f37fe640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67f4106f10 0x7f67f419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f37fe640 1 -- 172.21.15.12:0/1229450634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f419d480 con 0x7f67f4102790 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f8ec8640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67f4106f10 0x7f67f419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f37fe640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67f4102790 0x7f67f4198a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67e800d950 tx=0x7f67e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f17fa640 1 -- 172.21.15.12:0/1229450634 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8017070 con 0x7f67f4102790 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f17fa640 1 -- 172.21.15.12:0/1229450634 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67e8009c30 con 0x7f67f4102790 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67fa92b640 1 -- 172.21.15.12:0/1229450634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f419d770 con 0x7f67f4102790 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67f17fa640 1 -- 172.21.15.12:0/1229450634 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e800f6b0 con 0x7f67f4102790 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.565+0000 7f67fa92b640 1 -- 172.21.15.12:0/1229450634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f41a5050 con 0x7f67f4102790 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.566+0000 7f67fa92b640 1 -- 172.21.15.12:0/1229450634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f41021c0 con 0x7f67f4102790 2024-09-19T06:37:46.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.567+0000 7f67f17fa640 1 -- 172.21.15.12:0/1229450634 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f67e80109d0 con 0x7f67f4102790 2024-09-19T06:37:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.568+0000 7f67f17fa640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f67dc0a32c0 0x7f67dc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.568+0000 7f67f3fff640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f67dc0a32c0 0x7f67dc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.569+0000 7f67f17fa640 1 -- 172.21.15.12:0/1229450634 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f67e80cf100 con 0x7f67f4102790 2024-09-19T06:37:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.569+0000 7f67f3fff640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f67dc0a32c0 0x7f67dc0a5780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009230 tx=0x7f67e40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.573+0000 7f67f17fa640 1 -- 172.21.15.12:0/1229450634 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67e8009de0 con 0x7f67f4102790 2024-09-19T06:37:46.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.787+0000 7f67fa92b640 1 -- 172.21.15.12:0/1229450634 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67f4109b60 con 0x7f67f4102790 2024-09-19T06:37:46.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.787+0000 7f67f17fa640 1 -- 172.21.15.12:0/1229450634 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7f67e809c220 con 0x7f67f4102790 2024-09-19T06:37:46.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:46.789 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":6,"btime":"2024-09-19T06:37:44:996669+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T06:37:46.789 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 6 2024-09-19T06:37:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 -- 172.21.15.12:0/1229450634 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f67dc0a32c0 msgr2=0x7f67dc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f67dc0a32c0 0x7f67dc0a5780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009230 tx=0x7f67e40058d0 comp rx=0 tx=0).stop 2024-09-19T06:37:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 -- 172.21.15.12:0/1229450634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67f4102790 msgr2=0x7f67f4198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67f4102790 0x7f67f4198a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67e800d950 tx=0x7f67e800de10 comp rx=0 tx=0).stop 2024-09-19T06:37:46.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 -- 172.21.15.12:0/1229450634 shutdown_connections 2024-09-19T06:37:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f67dc0a32c0 0x7f67dc0a5780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67f4106f10 0x7f67f419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67f4102790 0x7f67f4198a10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 --2- 172.21.15.12:0/1229450634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67f4101de0 0x7f67f41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 -- 172.21.15.12:0/1229450634 >> 172.21.15.12:0/1229450634 conn(0x7f67f40fd8c0 msgr2=0x7f67f40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 -- 172.21.15.12:0/1229450634 shutdown_connections 2024-09-19T06:37:46.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:46.790+0000 7f67fa92b640 1 -- 172.21.15.12:0/1229450634 wait complete. 2024-09-19T06:37:46.972 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:37:46 smithi173 podman[65231]: 2024-09-19 06:37:46.572126928 +0000 UTC m=+0.016138979 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:37:46.972 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:37:46 smithi173 podman[65231]: 2024-09-19 06:37:46.677635162 +0000 UTC m=+0.121647209 container create df73eaf33d65bbcf309b127d11cf38166f57d5d6823cf410805df58d56e1fbc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T06:37:46.972 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:37:46 smithi173 podman[65231]: 2024-09-19 06:37:46.871276774 +0000 UTC m=+0.315288831 container init df73eaf33d65bbcf309b127d11cf38166f57d5d6823cf410805df58d56e1fbc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T06:37:46.972 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:37:46 smithi173 podman[65231]: 2024-09-19 06:37:46.874023095 +0000 UTC m=+0.318035140 container start df73eaf33d65bbcf309b127d11cf38166f57d5d6823cf410805df58d56e1fbc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:37:46.972 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:37:46 smithi173 ceph-mds[65252]: -- 172.21.15.173:0/4191868526 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555dfc703860 con 0x555dfc6e1400 2024-09-19T06:37:46.972 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:37:46 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f[65248]: starting mds.f at 2024-09-19T06:37:46.972 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:37:46 smithi173 bash[65231]: df73eaf33d65bbcf309b127d11cf38166f57d5d6823cf410805df58d56e1fbc4 2024-09-19T06:37:47.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:47 smithi012 ceph-mon[30937]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:47.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:47 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1229450634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:47.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:47 smithi173 ceph-mon[35349]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:47.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:47 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1229450634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:47.333 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:37:46 smithi173 systemd[1]: Started Ceph mds.f for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:37:47.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:47 smithi016 ceph-mon[34911]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:47.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:47 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1229450634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:48.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:48 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6834/2501878004,v1:172.21.15.173:6835/2501878004] up:boot 2024-09-19T06:37:48.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:48 smithi173 ceph-mon[35349]: fsmap 6 up:standby 2024-09-19T06:37:48.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:48 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:37:48.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:48 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:48.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:48 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:48.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:48 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:48.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:48 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:48.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:48 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:48.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:48 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:48.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:48 smithi173 ceph-mon[35349]: Deploying daemon mds.c on smithi173 2024-09-19T06:37:48.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:48 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6834/2501878004,v1:172.21.15.173:6835/2501878004] up:boot 2024-09-19T06:37:48.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:48 smithi012 ceph-mon[30937]: fsmap 6 up:standby 2024-09-19T06:37:48.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:48 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:37:48.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:48 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:48.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:48 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:48.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:48 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:48.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:48 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:48.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:48 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:48.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:48 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:48.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:48 smithi012 ceph-mon[30937]: Deploying daemon mds.c on smithi173 2024-09-19T06:37:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:48 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6834/2501878004,v1:172.21.15.173:6835/2501878004] up:boot 2024-09-19T06:37:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:48 smithi016 ceph-mon[34911]: fsmap 6 up:standby 2024-09-19T06:37:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:48 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:37:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:48 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:48 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:48 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:48 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:48 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:48 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:48.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:48 smithi016 ceph-mon[34911]: Deploying daemon mds.c on smithi173 2024-09-19T06:37:49.041 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:37:48 smithi173 systemd[1]: Starting Ceph mds.c for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:37:49.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:49 smithi173 ceph-mon[35349]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:49.333 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:37:49 smithi173 podman[65530]: 2024-09-19 06:37:49.037209844 +0000 UTC m=+0.015811073 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:37:49.333 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:37:49 smithi173 podman[65530]: 2024-09-19 06:37:49.155393418 +0000 UTC m=+0.133994676 container create ac9838b1d70aefcb9d9a674ee19e965e8b999a9c5801bdc825344a27b457194e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T06:37:49.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:49 smithi012 ceph-mon[30937]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:49.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:49 smithi016 ceph-mon[34911]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:49.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:37:49.833 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:37:49 smithi173 podman[65530]: 2024-09-19 06:37:49.369399781 +0000 UTC m=+0.348000997 container init ac9838b1d70aefcb9d9a674ee19e965e8b999a9c5801bdc825344a27b457194e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T06:37:49.833 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:37:49 smithi173 podman[65530]: 2024-09-19 06:37:49.372202978 +0000 UTC m=+0.350804209 container start ac9838b1d70aefcb9d9a674ee19e965e8b999a9c5801bdc825344a27b457194e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:37:49.833 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:37:49 smithi173 ceph-mds[65549]: -- 172.21.15.173:0/3920563433 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b942c05860 con 0x55b942be3000 2024-09-19T06:37:49.833 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:37:49 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c[65545]: starting mds.c at 2024-09-19T06:37:49.833 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:37:49 smithi173 bash[65530]: ac9838b1d70aefcb9d9a674ee19e965e8b999a9c5801bdc825344a27b457194e 2024-09-19T06:37:49.833 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:37:49 smithi173 systemd[1]: Started Ceph mds.c for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:37:49.911 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:50.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:50.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:50.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:50.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:50.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:50.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:50.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:50 smithi012 ceph-mon[30937]: Deploying daemon mds.h on smithi016 2024-09-19T06:37:50.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:50 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] up:boot 2024-09-19T06:37:50.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:50 smithi012 ceph-mon[30937]: fsmap 7 up:standby 2024-09-19T06:37:50.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:50 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:37:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.555+0000 7fb1c1d54640 1 -- 172.21.15.12:0/87877568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1bc106f10 msgr2=0x7fb1bc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.556+0000 7fb1c1d54640 1 --2- 172.21.15.12:0/87877568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1bc106f10 0x7fb1bc10ea90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009ca0 tx=0x7fb1b402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.556+0000 7fb1c1d54640 1 -- 172.21.15.12:0/87877568 shutdown_connections 2024-09-19T06:37:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.556+0000 7fb1c1d54640 1 --2- 172.21.15.12:0/87877568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1bc106f10 0x7fb1bc10ea90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.556+0000 7fb1c1d54640 1 --2- 172.21.15.12:0/87877568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc102790 0x7fb1bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.556+0000 7fb1c1d54640 1 --2- 172.21.15.12:0/87877568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1bc101de0 0x7fb1bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.556+0000 7fb1c1d54640 1 -- 172.21.15.12:0/87877568 >> 172.21.15.12:0/87877568 conn(0x7fb1bc0fd8c0 msgr2=0x7fb1bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.556+0000 7fb1c1d54640 1 -- 172.21.15.12:0/87877568 shutdown_connections 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.556+0000 7fb1c1d54640 1 -- 172.21.15.12:0/87877568 wait complete. 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.556+0000 7fb1c1d54640 1 Processor -- start 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.556+0000 7fb1c1d54640 1 -- start start 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1c1d54640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1bc101de0 0x7fb1bc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1c1d54640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc102790 0x7fb1bc198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1c1d54640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1c1d54640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc111f70 con 0x7fb1bc106f10 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1c1d54640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc111df0 con 0x7fb1bc101de0 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1c1d54640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc1120f0 con 0x7fb1bc102790 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1bc101de0 0x7fb1bc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55152/0 (socket says 172.21.15.12:55152) 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bbfff640 1 -- 172.21.15.12:0/2801025918 learned_addr learned my addr 172.21.15.12:0/2801025918 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1baffd640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc102790 0x7fb1bc198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bbfff640 1 -- 172.21.15.12:0/2801025918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc102790 msgr2=0x7fb1bc198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bbfff640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc102790 0x7fb1bc198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bbfff640 1 -- 172.21.15.12:0/2801025918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1bc101de0 msgr2=0x7fb1bc198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bbfff640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1bc101de0 0x7fb1bc198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bbfff640 1 -- 172.21.15.12:0/2801025918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc19d3c0 con 0x7fb1bc106f10 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bb7fe640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1bc101de0 0x7fb1bc198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1bbfff640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4031a20 tx=0x7fb1b4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1b8ff9640 1 -- 172.21.15.12:0/2801025918 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4003c30 con 0x7fb1bc106f10 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.557+0000 7fb1b8ff9640 1 -- 172.21.15.12:0/2801025918 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1b4003dd0 con 0x7fb1bc106f10 2024-09-19T06:37:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.558+0000 7fb1b8ff9640 1 -- 172.21.15.12:0/2801025918 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b402fc40 con 0x7fb1bc106f10 2024-09-19T06:37:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.558+0000 7fb1c1d54640 1 -- 172.21.15.12:0/2801025918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1bc19d650 con 0x7fb1bc106f10 2024-09-19T06:37:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.558+0000 7fb1c1d54640 1 -- 172.21.15.12:0/2801025918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1bc1a4f90 con 0x7fb1bc106f10 2024-09-19T06:37:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.559+0000 7fb1c1d54640 1 -- 172.21.15.12:0/2801025918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1bc1021c0 con 0x7fb1bc106f10 2024-09-19T06:37:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.560+0000 7fb1b8ff9640 1 -- 172.21.15.12:0/2801025918 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb1b4004050 con 0x7fb1bc106f10 2024-09-19T06:37:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.560+0000 7fb1b8ff9640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb1a40a32c0 0x7fb1a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.560+0000 7fb1bb7fe640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb1a40a32c0 0x7fb1a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.561+0000 7fb1b8ff9640 1 -- 172.21.15.12:0/2801025918 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fb1b40f0580 con 0x7fb1bc106f10 2024-09-19T06:37:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.561+0000 7fb1bb7fe640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb1a40a32c0 0x7fb1a40a5780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009fc0 tx=0x7fb1ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.565+0000 7fb1b8ff9640 1 -- 172.21.15.12:0/2801025918 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1b40bd8f0 con 0x7fb1bc106f10 2024-09-19T06:37:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:50 smithi016 ceph-mon[34911]: Deploying daemon mds.h on smithi016 2024-09-19T06:37:50.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:50 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] up:boot 2024-09-19T06:37:50.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:50 smithi016 ceph-mon[34911]: fsmap 7 up:standby 2024-09-19T06:37:50.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:50 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:37:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.783+0000 7fb1c1d54640 1 -- 172.21.15.12:0/2801025918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1bc199770 con 0x7fb1bc106f10 2024-09-19T06:37:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.784+0000 7fb1b8ff9640 1 -- 172.21.15.12:0/2801025918 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7fb1b40bd1f0 con 0x7fb1bc106f10 2024-09-19T06:37:50.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:50.786 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"btime":"2024-09-19T06:37:50:040201+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T06:37:50.786 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2024-09-19T06:37:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 -- 172.21.15.12:0/2801025918 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb1a40a32c0 msgr2=0x7fb1a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb1a40a32c0 0x7fb1a40a5780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009fc0 tx=0x7fb1ac005f90 comp rx=0 tx=0).stop 2024-09-19T06:37:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 -- 172.21.15.12:0/2801025918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1bc106f10 msgr2=0x7fb1bc19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4031a20 tx=0x7fb1b4031a50 comp rx=0 tx=0).stop 2024-09-19T06:37:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 -- 172.21.15.12:0/2801025918 shutdown_connections 2024-09-19T06:37:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb1a40a32c0 0x7fb1a40a5780 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1bc106f10 0x7fb1bc19cce0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1bc102790 0x7fb1bc198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 --2- 172.21.15.12:0/2801025918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1bc101de0 0x7fb1bc198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 -- 172.21.15.12:0/2801025918 >> 172.21.15.12:0/2801025918 conn(0x7fb1bc0fd8c0 msgr2=0x7fb1bc0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 -- 172.21.15.12:0/2801025918 shutdown_connections 2024-09-19T06:37:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:50.786+0000 7fb1c1d54640 1 -- 172.21.15.12:0/2801025918 wait complete. 2024-09-19T06:37:50.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:50 smithi173 ceph-mon[35349]: Deploying daemon mds.h on smithi016 2024-09-19T06:37:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:50 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] up:boot 2024-09-19T06:37:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:50 smithi173 ceph-mon[35349]: fsmap 7 up:standby 2024-09-19T06:37:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:50 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:37:51.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:51 smithi173 ceph-mon[35349]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:51.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:51 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2801025918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:51.840 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:51 smithi016 ceph-mon[34911]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:51.840 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:51 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2801025918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:51.840 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:37:51 smithi016 systemd[1]: Starting Ceph mds.h for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:37:51.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:51 smithi012 ceph-mon[30937]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:51.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:51 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2801025918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:52.151 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:37:51 smithi016 podman[63961]: 2024-09-19 06:37:51.839325917 +0000 UTC m=+0.100306601 container create 8dc3901a3abdfe9e76ec8cbf52637a66664b846cdeceea034a899f6ff13f31b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T06:37:52.151 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:37:51 smithi016 podman[63961]: 2024-09-19 06:37:51.75512427 +0000 UTC m=+0.016104925 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:37:52.151 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:37:52 smithi016 podman[63961]: 2024-09-19 06:37:52.050207723 +0000 UTC m=+0.311188371 container init 8dc3901a3abdfe9e76ec8cbf52637a66664b846cdeceea034a899f6ff13f31b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T06:37:52.152 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:37:52 smithi016 podman[63961]: 2024-09-19 06:37:52.053591698 +0000 UTC m=+0.314572337 container start 8dc3901a3abdfe9e76ec8cbf52637a66664b846cdeceea034a899f6ff13f31b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T06:37:52.152 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:37:52 smithi016 ceph-mds[63980]: -- 172.21.15.16:0/3132681211 <== mon.2 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560254deb860 con 0x560254dc9400 2024-09-19T06:37:52.152 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:37:52 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h[63976]: starting mds.h at 2024-09-19T06:37:52.152 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:37:52 smithi016 bash[63961]: 8dc3901a3abdfe9e76ec8cbf52637a66664b846cdeceea034a899f6ff13f31b9 2024-09-19T06:37:52.508 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:37:52 smithi016 systemd[1]: Started Ceph mds.h for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: Deploying daemon mds.i on smithi173 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.16:6836/2891393100,v1:172.21.15.16:6837/2891393100] up:boot 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: fsmap 8 up:standby 2024-09-19T06:37:53.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:53 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:37:53.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:37:53.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:53.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:53.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:53.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:53.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:53.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:53.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:53.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: Deploying daemon mds.i on smithi173 2024-09-19T06:37:53.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.16:6836/2891393100,v1:172.21.15.16:6837/2891393100] up:boot 2024-09-19T06:37:53.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: fsmap 8 up:standby 2024-09-19T06:37:53.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:53 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:37:53.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: Deploying daemon mds.i on smithi173 2024-09-19T06:37:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.16:6836/2891393100,v1:172.21.15.16:6837/2891393100] up:boot 2024-09-19T06:37:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: fsmap 8 up:standby 2024-09-19T06:37:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:53 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:37:53.689 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:54.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.188+0000 7f8202c48640 1 -- 172.21.15.12:0/3826558720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81fc106f20 msgr2=0x7f81fc10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.188+0000 7f8202c48640 1 --2- 172.21.15.12:0/3826558720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81fc106f20 0x7f81fc10eaa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009ca0 tx=0x7f81f402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.188+0000 7f8202c48640 1 -- 172.21.15.12:0/3826558720 shutdown_connections 2024-09-19T06:37:54.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.188+0000 7f8202c48640 1 --2- 172.21.15.12:0/3826558720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81fc106f20 0x7f81fc10eaa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.188+0000 7f8202c48640 1 --2- 172.21.15.12:0/3826558720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81fc1027a0 0x7f81fc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.188+0000 7f8202c48640 1 --2- 172.21.15.12:0/3826558720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81fc101df0 0x7f81fc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.188+0000 7f8202c48640 1 -- 172.21.15.12:0/3826558720 >> 172.21.15.12:0/3826558720 conn(0x7f81fc0fd8f0 msgr2=0x7f81fc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.188+0000 7f8202c48640 1 -- 172.21.15.12:0/3826558720 shutdown_connections 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.188+0000 7f8202c48640 1 -- 172.21.15.12:0/3826558720 wait complete. 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f8202c48640 1 Processor -- start 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f8202c48640 1 -- start start 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f8202c48640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81fc101df0 0x7f81fc1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f8202c48640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81fc1027a0 0x7f81fc198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f8202c48640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81fc106f20 0x7f81fc19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f8202c48640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc111fd0 con 0x7f81fc106f20 2024-09-19T06:37:54.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f8202c48640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc111e50 con 0x7f81fc1027a0 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f8202c48640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc112150 con 0x7f81fc101df0 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f82011e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81fc106f20 0x7f81fc19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f82011e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81fc106f20 0x7f81fc19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55168/0 (socket says 172.21.15.12:55168) 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f82011e5640 1 -- 172.21.15.12:0/3117168416 learned_addr learned my addr 172.21.15.12:0/3117168416 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f82009e4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81fc101df0 0x7f81fc1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f81f3fff640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81fc1027a0 0x7f81fc198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f82011e5640 1 -- 172.21.15.12:0/3117168416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81fc101df0 msgr2=0x7f81fc1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f82011e5640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81fc101df0 0x7f81fc1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f82011e5640 1 -- 172.21.15.12:0/3117168416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81fc1027a0 msgr2=0x7f81fc198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f82011e5640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81fc1027a0 0x7f81fc198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f82011e5640 1 -- 172.21.15.12:0/3117168416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc19d3a0 con 0x7f81fc106f20 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.189+0000 7f82011e5640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81fc106f20 0x7f81fc19ccc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f81f4033040 tx=0x7f81f4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:54.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.190+0000 7f81f1ffb640 1 -- 172.21.15.12:0/3117168416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4031650 con 0x7f81fc106f20 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.190+0000 7f81f1ffb640 1 -- 172.21.15.12:0/3117168416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81f40317f0 con 0x7f81fc106f20 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.190+0000 7f8202c48640 1 -- 172.21.15.12:0/3117168416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc19d630 con 0x7f81fc106f20 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.190+0000 7f81f1ffb640 1 -- 172.21.15.12:0/3117168416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f402fa40 con 0x7f81fc106f20 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.190+0000 7f8202c48640 1 -- 172.21.15.12:0/3117168416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc1a4f70 con 0x7f81fc106f20 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.191+0000 7f8202c48640 1 -- 172.21.15.12:0/3117168416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81fc1021d0 con 0x7f81fc106f20 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.192+0000 7f81f1ffb640 1 -- 172.21.15.12:0/3117168416 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f81f402fc60 con 0x7f81fc106f20 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.193+0000 7f81f1ffb640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f81e40a3240 0x7f81e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.193+0000 7f82009e4640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f81e40a3240 0x7f81e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.193+0000 7f81f1ffb640 1 -- 172.21.15.12:0/3117168416 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f81f40f0950 con 0x7f81fc106f20 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.193+0000 7f82009e4640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f81e40a3240 0x7f81e40a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009bd0 tx=0x7f81f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:54.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.197+0000 7f81f1ffb640 1 -- 172.21.15.12:0/3117168416 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81f40bdc30 con 0x7f81fc106f20 2024-09-19T06:37:54.333 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:37:54 smithi173 systemd[1]: Starting Ceph mds.i for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:37:54.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.425+0000 7f8202c48640 1 -- 172.21.15.12:0/3117168416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81fc10a1c0 con 0x7f81fc106f20 2024-09-19T06:37:54.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.426+0000 7f81f1ffb640 1 -- 172.21.15.12:0/3117168416 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7216 (secure 0 0 0) 0x7f81f40bd530 con 0x7f81fc106f20 2024-09-19T06:37:54.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:54.428 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"btime":"2024-09-19T06:37:52:540502+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T06:37:54.428 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-09-19T06:37:54.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 -- 172.21.15.12:0/3117168416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f81e40a3240 msgr2=0x7f81e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f81e40a3240 0x7f81e40a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009bd0 tx=0x7f81f8005f90 comp rx=0 tx=0).stop 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 -- 172.21.15.12:0/3117168416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81fc106f20 msgr2=0x7f81fc19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81fc106f20 0x7f81fc19ccc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f81f4033040 tx=0x7f81f4003f10 comp rx=0 tx=0).stop 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 -- 172.21.15.12:0/3117168416 shutdown_connections 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f81e40a3240 0x7f81e40a5700 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81fc106f20 0x7f81fc19ccc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81fc1027a0 0x7f81fc198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 --2- 172.21.15.12:0/3117168416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81fc101df0 0x7f81fc1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 -- 172.21.15.12:0/3117168416 >> 172.21.15.12:0/3117168416 conn(0x7f81fc0fd8f0 msgr2=0x7f81fc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 -- 172.21.15.12:0/3117168416 shutdown_connections 2024-09-19T06:37:54.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:54.428+0000 7f8202c48640 1 -- 172.21.15.12:0/3117168416 wait complete. 2024-09-19T06:37:54.636 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:37:54 smithi173 podman[65832]: 2024-09-19 06:37:54.234245329 +0000 UTC m=+0.015706056 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:37:54.636 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:37:54 smithi173 podman[65832]: 2024-09-19 06:37:54.333224774 +0000 UTC m=+0.114685487 container create bdfdc3d17e553fe804bc552006a8b22e78b756351b6b0160f6dc13aa29e384af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:37:54.636 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:37:54 smithi173 podman[65832]: 2024-09-19 06:37:54.527261001 +0000 UTC m=+0.308721714 container init bdfdc3d17e553fe804bc552006a8b22e78b756351b6b0160f6dc13aa29e384af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T06:37:54.636 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:37:54 smithi173 podman[65832]: 2024-09-19 06:37:54.530341591 +0000 UTC m=+0.311802305 container start bdfdc3d17e553fe804bc552006a8b22e78b756351b6b0160f6dc13aa29e384af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T06:37:54.636 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:37:54 smithi173 ceph-mds[65852]: -- 172.21.15.173:0/1791487030 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555cacfbb860 con 0x555cacf99000 2024-09-19T06:37:54.636 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:37:54 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i[65848]: starting mds.i at 2024-09-19T06:37:54.636 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:37:54 smithi173 bash[65832]: bdfdc3d17e553fe804bc552006a8b22e78b756351b6b0160f6dc13aa29e384af 2024-09-19T06:37:55.082 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:37:54 smithi173 systemd[1]: Started Ceph mds.i for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:37:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:55 smithi012 ceph-mon[30937]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:55 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3117168416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:55 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:55 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:55 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:55 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:55 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:55.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:55 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:55.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:55 smithi016 ceph-mon[34911]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:55.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:55 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3117168416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:55.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:55 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:55.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:55 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:55.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:55 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:55.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:55 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:55.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:55 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:55.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:55 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:55.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:55 smithi173 ceph-mon[35349]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:55.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:55 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3117168416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:55.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:55 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:55.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:55 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:55.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:55 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:55.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:55 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:55.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:55 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:55.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:55 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:56.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:56 smithi012 ceph-mon[30937]: Deploying daemon mds.g on smithi012 2024-09-19T06:37:56.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:56 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] up:boot 2024-09-19T06:37:56.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:56 smithi012 ceph-mon[30937]: fsmap 9 up:standby 2024-09-19T06:37:56.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:56 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:37:56.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:56 smithi016 ceph-mon[34911]: Deploying daemon mds.g on smithi012 2024-09-19T06:37:56.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:56 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] up:boot 2024-09-19T06:37:56.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:56 smithi016 ceph-mon[34911]: fsmap 9 up:standby 2024-09-19T06:37:56.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:56 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:37:56.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:56 smithi173 ceph-mon[35349]: Deploying daemon mds.g on smithi012 2024-09-19T06:37:56.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:56 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] up:boot 2024-09-19T06:37:56.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:56 smithi173 ceph-mon[35349]: fsmap 9 up:standby 2024-09-19T06:37:56.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:56 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:37:57.128 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:37:56 smithi012 systemd[1]: Starting Ceph mds.g for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:37:57.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:37:57.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:57 smithi012 ceph-mon[30937]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:57.379 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:37:57 smithi012 podman[72084]: 2024-09-19 06:37:57.030152514 +0000 UTC m=+0.016518437 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:37:57.379 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:37:57 smithi012 podman[72084]: 2024-09-19 06:37:57.16629185 +0000 UTC m=+0.152657764 container create b8ed9b1e4cfd2b960634983e7be886f7d3faec6b91b164cedadc7f67244e2c9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T06:37:57.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:57 smithi016 ceph-mon[34911]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:57.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:57 smithi173 ceph-mon[35349]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:37:57.636 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:37:57.759 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:37:57 smithi012 podman[72084]: 2024-09-19 06:37:57.456679252 +0000 UTC m=+0.443045164 container init b8ed9b1e4cfd2b960634983e7be886f7d3faec6b91b164cedadc7f67244e2c9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:37:57.759 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:37:57 smithi012 podman[72084]: 2024-09-19 06:37:57.459891362 +0000 UTC m=+0.446257291 container start b8ed9b1e4cfd2b960634983e7be886f7d3faec6b91b164cedadc7f67244e2c9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T06:37:57.759 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:37:57 smithi012 ceph-mds[72133]: -- 172.21.15.12:0/1719028851 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f387c0dc20 con 0x55f387beb000 2024-09-19T06:37:57.759 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:37:57 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g[72117]: starting mds.g at 2024-09-19T06:37:57.759 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:37:57 smithi012 bash[72084]: b8ed9b1e4cfd2b960634983e7be886f7d3faec6b91b164cedadc7f67244e2c9d 2024-09-19T06:37:57.759 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:37:57 smithi012 systemd[1]: Started Ceph mds.g for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:37:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.134+0000 7f061f209640 1 -- 172.21.15.12:0/2538865868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0618100a80 msgr2=0x7f0618100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.134+0000 7f061f209640 1 --2- 172.21.15.12:0/2538865868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0618100a80 0x7f0618100ee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0604009930 tx=0x7f060402a420 comp rx=0 tx=0).stop 2024-09-19T06:37:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.134+0000 7f061f209640 1 -- 172.21.15.12:0/2538865868 shutdown_connections 2024-09-19T06:37:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.134+0000 7f061f209640 1 --2- 172.21.15.12:0/2538865868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0618101420 0x7f061810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.134+0000 7f061f209640 1 --2- 172.21.15.12:0/2538865868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0618100a80 0x7f0618100ee0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.134+0000 7f061f209640 1 --2- 172.21.15.12:0/2538865868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0618106a80 0x7f0618106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.134+0000 7f061f209640 1 -- 172.21.15.12:0/2538865868 >> 172.21.15.12:0/2538865868 conn(0x7f06180fc7a0 msgr2=0x7f06180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f061f209640 1 -- 172.21.15.12:0/2538865868 shutdown_connections 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f061f209640 1 -- 172.21.15.12:0/2538865868 wait complete. 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f061f209640 1 Processor -- start 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f061f209640 1 -- start start 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f061f209640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0618100a80 0x7f0618199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f061f209640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0618101420 0x7f0618199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f061f209640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0618106a80 0x7f06181a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f061f209640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0618110e80 con 0x7f0618101420 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f061f209640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0618110d00 con 0x7f0618100a80 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f061f209640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0618111000 con 0x7f0618106a80 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f0617fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0618101420 0x7f0618199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.135+0000 7f0617fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0618101420 0x7f0618199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55198/0 (socket says 172.21.15.12:55198) 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f0617fff640 1 -- 172.21.15.12:0/1956090135 learned_addr learned my addr 172.21.15.12:0/1956090135 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f061cfa5640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0618100a80 0x7f0618199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f061d7a6640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0618106a80 0x7f06181a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f0617fff640 1 -- 172.21.15.12:0/1956090135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0618106a80 msgr2=0x7f06181a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f0617fff640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0618106a80 0x7f06181a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f0617fff640 1 -- 172.21.15.12:0/1956090135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0618100a80 msgr2=0x7f0618199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f0617fff640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0618100a80 0x7f0618199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f0617fff640 1 -- 172.21.15.12:0/1956090135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06181a48d0 con 0x7f0618101420 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f061cfa5640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0618100a80 0x7f0618199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f0617fff640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0618101420 0x7f0618199850 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0604009230 tx=0x7f0604004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f0615ffb640 1 -- 172.21.15.12:0/1956090135 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060403f030 con 0x7f0618101420 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f061f209640 1 -- 172.21.15.12:0/1956090135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06181a4aa0 con 0x7f0618101420 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f0615ffb640 1 -- 172.21.15.12:0/1956090135 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0604003ad0 con 0x7f0618101420 2024-09-19T06:37:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f0615ffb640 1 -- 172.21.15.12:0/1956090135 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604035070 con 0x7f0618101420 2024-09-19T06:37:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.136+0000 7f061f209640 1 -- 172.21.15.12:0/1956090135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06181a4f50 con 0x7f0618101420 2024-09-19T06:37:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.138+0000 7f061f209640 1 -- 172.21.15.12:0/1956090135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0618100ee0 con 0x7f0618101420 2024-09-19T06:37:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.139+0000 7f0615ffb640 1 -- 172.21.15.12:0/1956090135 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0604042030 con 0x7f0618101420 2024-09-19T06:37:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.139+0000 7f0615ffb640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f06080a3240 0x7f06080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.139+0000 7f061cfa5640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f06080a3240 0x7f06080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.140+0000 7f0615ffb640 1 -- 172.21.15.12:0/1956090135 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f06040efa10 con 0x7f0618101420 2024-09-19T06:37:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.140+0000 7f061cfa5640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f06080a3240 0x7f06080a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f060c005fd0 tx=0x7f060c00b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.144+0000 7f0615ffb640 1 -- 172.21.15.12:0/1956090135 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f06040bcbd0 con 0x7f0618101420 2024-09-19T06:37:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.363+0000 7f061f209640 1 -- 172.21.15.12:0/1956090135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0618108ff0 con 0x7f0618101420 2024-09-19T06:37:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.363+0000 7f0615ffb640 1 -- 172.21.15.12:0/1956090135 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8869 (secure 0 0 0) 0x7f06040bc4d0 con 0x7f0618101420 2024-09-19T06:37:58.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:37:58.365 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":11,"btime":"2024-09-19T06:37:58:215259+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:37:58.366 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 11 2024-09-19T06:37:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 -- 172.21.15.12:0/1956090135 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f06080a3240 msgr2=0x7f06080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f06080a3240 0x7f06080a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f060c005fd0 tx=0x7f060c00b5d0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 -- 172.21.15.12:0/1956090135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0618101420 msgr2=0x7f0618199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0618101420 0x7f0618199850 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0604009230 tx=0x7f0604004270 comp rx=0 tx=0).stop 2024-09-19T06:37:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 -- 172.21.15.12:0/1956090135 shutdown_connections 2024-09-19T06:37:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f06080a3240 0x7f06080a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0618106a80 0x7f06181a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0618101420 0x7f0618199850 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 --2- 172.21.15.12:0/1956090135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0618100a80 0x7f0618199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 -- 172.21.15.12:0/1956090135 >> 172.21.15.12:0/1956090135 conn(0x7f06180fc7a0 msgr2=0x7f06180fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 -- 172.21.15.12:0/1956090135 shutdown_connections 2024-09-19T06:37:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:37:58.366+0000 7f061f209640 1 -- 172.21.15.12:0/1956090135 wait complete. 2024-09-19T06:37:58.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:58.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:58.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:58.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:58.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:58.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:58.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: Deploying daemon mds.a on smithi012 2024-09-19T06:37:58.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.12:6838/523853421,v1:172.21.15.12:6839/523853421] up:boot 2024-09-19T06:37:58.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: fsmap 10 up:standby 2024-09-19T06:37:58.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:37:58.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:58 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1956090135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: Deploying daemon mds.a on smithi012 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.12:6838/523853421,v1:172.21.15.12:6839/523853421] up:boot 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: fsmap 10 up:standby 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:37:59.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:58 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1956090135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:59.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:59.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:37:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: Deploying daemon mds.a on smithi012 2024-09-19T06:37:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.12:6838/523853421,v1:172.21.15.12:6839/523853421] up:boot 2024-09-19T06:37:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: fsmap 10 up:standby 2024-09-19T06:37:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:37:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:58 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1956090135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:37:59.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:37:59 smithi012 ceph-mon[30937]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:00.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:37:59 smithi016 ceph-mon[34911]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:00.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:37:59 smithi173 ceph-mon[35349]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:00.879 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:38:00 smithi012 systemd[1]: Started Ceph mds.a for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:38:01.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:01 smithi016 ceph-mon[34911]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:01.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:01 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:01.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:01 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:01.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:01 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:01.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:01 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:38:01.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:01 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:38:01.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:01 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:02.060 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:38:02.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:01 smithi173 ceph-mon[35349]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:02.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:01 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:02.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:01 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:02.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:01 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:02.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:01 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:38:02.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:01 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:38:02.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:01 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:02.090 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:01 smithi012 ceph-mon[30937]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:02.090 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:01 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:02.090 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:01 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:02.090 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:01 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:02.090 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:01 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:38:02.090 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:01 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:38:02.090 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:01 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:02.335 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:02.772 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:02 smithi012 ceph-mon[30937]: Deploying daemon mds.b on smithi016 2024-09-19T06:38:02.772 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:02 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.12:6840/1524660797,v1:172.21.15.12:6841/1524660797] up:boot 2024-09-19T06:38:02.772 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:02 smithi012 ceph-mon[30937]: fsmap 11 up:standby 2024-09-19T06:38:02.772 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:02 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.854+0000 7f25e2b5d640 1 -- 172.21.15.12:0/3104738470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25dc102570 msgr2=0x7f25dc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.854+0000 7f25e2b5d640 1 --2- 172.21.15.12:0/3104738470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25dc102570 0x7f25dc1029b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009900 tx=0x7f25cc02a480 comp rx=0 tx=0).stop 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.854+0000 7f25e2b5d640 1 -- 172.21.15.12:0/3104738470 shutdown_connections 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.854+0000 7f25e2b5d640 1 --2- 172.21.15.12:0/3104738470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25dc102ef0 0x7f25dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.854+0000 7f25e2b5d640 1 --2- 172.21.15.12:0/3104738470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25dc102570 0x7f25dc1029b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.854+0000 7f25e2b5d640 1 --2- 172.21.15.12:0/3104738470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25dc100e20 0x7f25dc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.854+0000 7f25e2b5d640 1 -- 172.21.15.12:0/3104738470 >> 172.21.15.12:0/3104738470 conn(0x7f25dc0fc7d0 msgr2=0x7f25dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.854+0000 7f25e2b5d640 1 -- 172.21.15.12:0/3104738470 shutdown_connections 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.854+0000 7f25e2b5d640 1 -- 172.21.15.12:0/3104738470 wait complete. 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e2b5d640 1 Processor -- start 2024-09-19T06:38:02.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e2b5d640 1 -- start start 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e2b5d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25dc100e20 0x7f25dc197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e2b5d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25dc102570 0x7f25dc1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e2b5d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25dc102ef0 0x7f25dc19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e2b5d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc110f80 con 0x7f25dc102ef0 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e2b5d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc110e00 con 0x7f25dc100e20 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e2b5d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc111100 con 0x7f25dc102570 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e10fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25dc102ef0 0x7f25dc19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e10fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25dc102ef0 0x7f25dc19bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38512/0 (socket says 172.21.15.12:38512) 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e10fa640 1 -- 172.21.15.12:0/757163228 learned_addr learned my addr 172.21.15.12:0/757163228 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25e08f9640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25dc100e20 0x7f25dc197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.855+0000 7f25d3fff640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25dc102570 0x7f25dc1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25e10fa640 1 -- 172.21.15.12:0/757163228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25dc102570 msgr2=0x7f25dc1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:02.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25e10fa640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25dc102570 0x7f25dc1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25e10fa640 1 -- 172.21.15.12:0/757163228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25dc100e20 msgr2=0x7f25dc197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:02.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25e10fa640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25dc100e20 0x7f25dc197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25e10fa640 1 -- 172.21.15.12:0/757163228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25dc19c310 con 0x7f25dc102ef0 2024-09-19T06:38:02.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25e10fa640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25dc102ef0 0x7f25dc19bc30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f25d400cce0 tx=0x7f25d400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:02.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25d1ffb640 1 -- 172.21.15.12:0/757163228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d400f450 con 0x7f25dc102ef0 2024-09-19T06:38:02.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25d1ffb640 1 -- 172.21.15.12:0/757163228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25d400fad0 con 0x7f25dc102ef0 2024-09-19T06:38:02.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25e2b5d640 1 -- 172.21.15.12:0/757163228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25dc19c600 con 0x7f25dc102ef0 2024-09-19T06:38:02.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25d1ffb640 1 -- 172.21.15.12:0/757163228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4018c10 con 0x7f25dc102ef0 2024-09-19T06:38:02.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.856+0000 7f25e2b5d640 1 -- 172.21.15.12:0/757163228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25dc1a3ee0 con 0x7f25dc102ef0 2024-09-19T06:38:02.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.857+0000 7f25e2b5d640 1 -- 172.21.15.12:0/757163228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25dc101200 con 0x7f25dc102ef0 2024-09-19T06:38:02.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.858+0000 7f25d1ffb640 1 -- 172.21.15.12:0/757163228 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f25d400f5f0 con 0x7f25dc102ef0 2024-09-19T06:38:02.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.859+0000 7f25d1ffb640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f25c40a3240 0x7f25c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:02.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.859+0000 7f25e08f9640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f25c40a3240 0x7f25c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:02.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.859+0000 7f25d1ffb640 1 -- 172.21.15.12:0/757163228 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f25d40cfab0 con 0x7f25dc102ef0 2024-09-19T06:38:02.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.860+0000 7f25e08f9640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f25c40a3240 0x7f25c40a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f25d80058c0 tx=0x7f25d800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:02.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:02.863+0000 7f25d1ffb640 1 -- 172.21.15.12:0/757163228 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25d4014030 con 0x7f25dc102ef0 2024-09-19T06:38:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:02 smithi016 ceph-mon[34911]: Deploying daemon mds.b on smithi016 2024-09-19T06:38:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:02 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.12:6840/1524660797,v1:172.21.15.12:6841/1524660797] up:boot 2024-09-19T06:38:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:02 smithi016 ceph-mon[34911]: fsmap 11 up:standby 2024-09-19T06:38:03.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:02 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:38:03.009 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:02 smithi016 systemd[1]: Starting Ceph mds.b for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:38:03.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.075+0000 7f25e2b5d640 1 -- 172.21.15.12:0/757163228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25dc109090 con 0x7f25dc102ef0 2024-09-19T06:38:03.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.076+0000 7f25d1ffb640 1 -- 172.21.15.12:0/757163228 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9695 (secure 0 0 0) 0x7f25d40bc090 con 0x7f25dc102ef0 2024-09-19T06:38:03.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:03.078 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":12,"btime":"2024-09-19T06:38:01:627384+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:38:03.078 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 12 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 -- 172.21.15.12:0/757163228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f25c40a3240 msgr2=0x7f25c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f25c40a3240 0x7f25c40a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f25d80058c0 tx=0x7f25d800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 -- 172.21.15.12:0/757163228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25dc102ef0 msgr2=0x7f25dc19bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25dc102ef0 0x7f25dc19bc30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f25d400cce0 tx=0x7f25d400a620 comp rx=0 tx=0).stop 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 -- 172.21.15.12:0/757163228 shutdown_connections 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f25c40a3240 0x7f25c40a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25dc102ef0 0x7f25dc19bc30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25dc102570 0x7f25dc1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 --2- 172.21.15.12:0/757163228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25dc100e20 0x7f25dc197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 -- 172.21.15.12:0/757163228 >> 172.21.15.12:0/757163228 conn(0x7f25dc0fc7d0 msgr2=0x7f25dc105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 -- 172.21.15.12:0/757163228 shutdown_connections 2024-09-19T06:38:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:03.078+0000 7f25e2b5d640 1 -- 172.21.15.12:0/757163228 wait complete. 2024-09-19T06:38:03.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:02 smithi173 ceph-mon[35349]: Deploying daemon mds.b on smithi016 2024-09-19T06:38:03.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:02 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.12:6840/1524660797,v1:172.21.15.12:6841/1524660797] up:boot 2024-09-19T06:38:03.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:02 smithi173 ceph-mon[35349]: fsmap 11 up:standby 2024-09-19T06:38:03.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:02 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:38:03.276 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:03 smithi016 podman[64265]: 2024-09-19 06:38:02.971735438 +0000 UTC m=+0.015915648 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:38:03.276 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:03 smithi016 podman[64265]: 2024-09-19 06:38:03.143389442 +0000 UTC m=+0.187569679 container create b5e9449ec3259d991d376e29f7a48a819b96c4bafb37391ee9f0a7b977e64aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T06:38:03.644 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:03 smithi016 podman[64265]: 2024-09-19 06:38:03.379212511 +0000 UTC m=+0.423392709 container init b5e9449ec3259d991d376e29f7a48a819b96c4bafb37391ee9f0a7b977e64aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T06:38:03.644 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:03 smithi016 podman[64265]: 2024-09-19 06:38:03.382110698 +0000 UTC m=+0.426290903 container start b5e9449ec3259d991d376e29f7a48a819b96c4bafb37391ee9f0a7b977e64aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T06:38:03.645 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:03 smithi016 ceph-mds[64283]: -- 172.21.15.16:0/2476887602 <== mon.2 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a160d03860 con 0x55a160ce0800 2024-09-19T06:38:03.645 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:03 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: starting mds.b at 2024-09-19T06:38:03.645 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:03 smithi016 bash[64265]: b5e9449ec3259d991d376e29f7a48a819b96c4bafb37391ee9f0a7b977e64aaa 2024-09-19T06:38:03.645 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:03 smithi016 systemd[1]: Started Ceph mds.b for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:38:03.760 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:03 smithi012 ceph-mon[30937]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:03.760 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:03 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/757163228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:03.760 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:03 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:03.760 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:03 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:03.760 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:03 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:03.760 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:03 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:03.761 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:03 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:03.983 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:03 smithi173 ceph-mon[35349]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:03.983 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:03 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/757163228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:03.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:03 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:03.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:03 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:03.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:03 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:03.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:03 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:03.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:03 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:04.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:03 smithi016 ceph-mon[34911]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:04.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:03 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/757163228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:04.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:03 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:04.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:03 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:04.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:03 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:04.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:03 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:04.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:03 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:04.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:04 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] up:boot 2024-09-19T06:38:04.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:04 smithi173 ceph-mon[35349]: fsmap 12 up:standby 2024-09-19T06:38:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:38:04.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:04 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:05.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:04 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] up:boot 2024-09-19T06:38:05.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:04 smithi016 ceph-mon[34911]: fsmap 12 up:standby 2024-09-19T06:38:05.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:38:05.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:04 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:05.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:04 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] up:boot 2024-09-19T06:38:05.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:04 smithi012 ceph-mon[30937]: fsmap 12 up:standby 2024-09-19T06:38:05.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:38:05.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:04 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:05.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:38:06.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:06.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:06.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:06.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:05 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:06.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:06.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:06.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:06.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:05 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:06.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:06.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:06.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:06.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:06.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:05 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:06.701 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.176+0000 7fe1aef31640 1 -- 172.21.15.12:0/3787536979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1a8101de0 msgr2=0x7fe1a81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.176+0000 7fe1aef31640 1 --2- 172.21.15.12:0/3787536979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1a8101de0 0x7fe1a81021c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009900 tx=0x7fe19c02a410 comp rx=0 tx=0).stop 2024-09-19T06:38:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.176+0000 7fe1aef31640 1 -- 172.21.15.12:0/3787536979 shutdown_connections 2024-09-19T06:38:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.176+0000 7fe1aef31640 1 --2- 172.21.15.12:0/3787536979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1a8106f10 0x7fe1a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.176+0000 7fe1aef31640 1 --2- 172.21.15.12:0/3787536979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1a8102790 0x7fe1a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.176+0000 7fe1aef31640 1 --2- 172.21.15.12:0/3787536979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1a8101de0 0x7fe1a81021c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.176+0000 7fe1aef31640 1 -- 172.21.15.12:0/3787536979 >> 172.21.15.12:0/3787536979 conn(0x7fe1a80fd8c0 msgr2=0x7fe1a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.176+0000 7fe1aef31640 1 -- 172.21.15.12:0/3787536979 shutdown_connections 2024-09-19T06:38:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.176+0000 7fe1aef31640 1 -- 172.21.15.12:0/3787536979 wait complete. 2024-09-19T06:38:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1aef31640 1 Processor -- start 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1aef31640 1 -- start start 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1aef31640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1a8101de0 0x7fe1a8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1aef31640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1a8102790 0x7fe1a8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1aef31640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1a8106f10 0x7fe1a819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1aef31640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8111f70 con 0x7fe1a8101de0 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1aef31640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8111df0 con 0x7fe1a8106f10 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1aef31640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a81120f0 con 0x7fe1a8102790 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1acccd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1a8101de0 0x7fe1a8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1acccd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1a8101de0 0x7fe1a8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38524/0 (socket says 172.21.15.12:38524) 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1acccd640 1 -- 172.21.15.12:0/67085788 learned_addr learned my addr 172.21.15.12:0/67085788 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1ad4ce640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1a8106f10 0x7fe1a819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1a7fff640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1a8102790 0x7fe1a8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1acccd640 1 -- 172.21.15.12:0/67085788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1a8102790 msgr2=0x7fe1a8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1acccd640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1a8102790 0x7fe1a8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1acccd640 1 -- 172.21.15.12:0/67085788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1a8106f10 msgr2=0x7fe1a819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1acccd640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1a8106f10 0x7fe1a819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.177+0000 7fe1acccd640 1 -- 172.21.15.12:0/67085788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a819d400 con 0x7fe1a8101de0 2024-09-19T06:38:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.178+0000 7fe1acccd640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1a8101de0 0x7fe1a8198450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe19c006010 tx=0x7fe19c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.178+0000 7fe1a5ffb640 1 -- 172.21.15.12:0/67085788 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c03f030 con 0x7fe1a8101de0 2024-09-19T06:38:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.178+0000 7fe1aef31640 1 -- 172.21.15.12:0/67085788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a819d690 con 0x7fe1a8101de0 2024-09-19T06:38:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.178+0000 7fe1a5ffb640 1 -- 172.21.15.12:0/67085788 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe19c004440 con 0x7fe1a8101de0 2024-09-19T06:38:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.178+0000 7fe1a5ffb640 1 -- 172.21.15.12:0/67085788 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c035070 con 0x7fe1a8101de0 2024-09-19T06:38:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.178+0000 7fe1aef31640 1 -- 172.21.15.12:0/67085788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a81a4fd0 con 0x7fe1a8101de0 2024-09-19T06:38:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.179+0000 7fe1aef31640 1 -- 172.21.15.12:0/67085788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a81032c0 con 0x7fe1a8101de0 2024-09-19T06:38:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.180+0000 7fe1a5ffb640 1 -- 172.21.15.12:0/67085788 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe19c042030 con 0x7fe1a8101de0 2024-09-19T06:38:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.181+0000 7fe1a5ffb640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1980a3240 0x7fe1980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.181+0000 7fe1a7fff640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1980a3240 0x7fe1980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.181+0000 7fe1a5ffb640 1 -- 172.21.15.12:0/67085788 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fe19c0ef7b0 con 0x7fe1a8101de0 2024-09-19T06:38:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.181+0000 7fe1a7fff640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1980a3240 0x7fe1980a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80fdce0 tx=0x7fe194005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.185+0000 7fe1a5ffb640 1 -- 172.21.15.12:0/67085788 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe19c0bc320 con 0x7fe1a8101de0 2024-09-19T06:38:07.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.413+0000 7fe1aef31640 1 -- 172.21.15.12:0/67085788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1a810a0f0 con 0x7fe1a8101de0 2024-09-19T06:38:07.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.414+0000 7fe1a5ffb640 1 -- 172.21.15.12:0/67085788 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10521 (secure 0 0 0) 0x7fe19c0c0620 con 0x7fe1a8101de0 2024-09-19T06:38:07.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:07.416 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"btime":"2024-09-19T06:38:03:640616+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T06:38:07.416 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2024-09-19T06:38:07.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 -- 172.21.15.12:0/67085788 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1980a3240 msgr2=0x7fe1980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1980a3240 0x7fe1980a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80fdce0 tx=0x7fe194005f90 comp rx=0 tx=0).stop 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 -- 172.21.15.12:0/67085788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1a8101de0 msgr2=0x7fe1a8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1a8101de0 0x7fe1a8198450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe19c006010 tx=0x7fe19c004040 comp rx=0 tx=0).stop 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 -- 172.21.15.12:0/67085788 shutdown_connections 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1980a3240 0x7fe1980a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1a8106f10 0x7fe1a819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1a8102790 0x7fe1a8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 --2- 172.21.15.12:0/67085788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1a8101de0 0x7fe1a8198450 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 -- 172.21.15.12:0/67085788 >> 172.21.15.12:0/67085788 conn(0x7fe1a80fd8c0 msgr2=0x7fe1a80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 -- 172.21.15.12:0/67085788 shutdown_connections 2024-09-19T06:38:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:07.416+0000 7fe1aef31640 1 -- 172.21.15.12:0/67085788 wait complete. 2024-09-19T06:38:07.740 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:07 smithi012 ceph-mon[30937]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:07.740 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:07.740 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:07.740 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:07.740 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:07.741 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:07 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:07.741 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:07 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/67085788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:08.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:07 smithi016 ceph-mon[34911]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:07 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:08.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:07 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/67085788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:08.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:07 smithi173 ceph-mon[35349]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:07 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:08.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:07 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/67085788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:08.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T06:38:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.783+0000 7fbd31572640 1 -- 172.21.15.12:0/2953399126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd2c100350 msgr2=0x7fbd2c100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.783+0000 7fbd31572640 1 --2- 172.21.15.12:0/2953399126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd2c100350 0x7fbd2c100730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009930 tx=0x7fbd1c02a420 comp rx=0 tx=0).stop 2024-09-19T06:38:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.783+0000 7fbd31572640 1 -- 172.21.15.12:0/2953399126 shutdown_connections 2024-09-19T06:38:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.783+0000 7fbd31572640 1 --2- 172.21.15.12:0/2953399126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd2c106f50 0x7fbd2c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:08.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.783+0000 7fbd31572640 1 --2- 172.21.15.12:0/2953399126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd2c100d00 0x7fbd2c106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:08.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.783+0000 7fbd31572640 1 --2- 172.21.15.12:0/2953399126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd2c100350 0x7fbd2c100730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:08.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.783+0000 7fbd31572640 1 -- 172.21.15.12:0/2953399126 >> 172.21.15.12:0/2953399126 conn(0x7fbd2c077210 msgr2=0x7fbd2c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:08.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.783+0000 7fbd31572640 1 -- 172.21.15.12:0/2953399126 shutdown_connections 2024-09-19T06:38:08.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.783+0000 7fbd31572640 1 -- 172.21.15.12:0/2953399126 wait complete. 2024-09-19T06:38:08.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.783+0000 7fbd31572640 1 Processor -- start 2024-09-19T06:38:08.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd31572640 1 -- start start 2024-09-19T06:38:08.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd31572640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd2c100350 0x7fbd2c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:08.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd31572640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd2c100d00 0x7fbd2c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:08.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd31572640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd2c106f50 0x7fbd2c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:08.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd31572640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c111fa0 con 0x7fbd2c100350 2024-09-19T06:38:08.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd31572640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c111e20 con 0x7fbd2c100d00 2024-09-19T06:38:08.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd31572640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c112120 con 0x7fbd2c106f50 2024-09-19T06:38:08.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd2c100350 0x7fbd2c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:08.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd2c100350 0x7fbd2c198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38556/0 (socket says 172.21.15.12:38556) 2024-09-19T06:38:08.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2affd640 1 -- 172.21.15.12:0/3994536474 learned_addr learned my addr 172.21.15.12:0/3994536474 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:08.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2b7fe640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd2c106f50 0x7fbd2c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:08.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2a7fc640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd2c100d00 0x7fbd2c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:08.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2affd640 1 -- 172.21.15.12:0/3994536474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd2c106f50 msgr2=0x7fbd2c19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:08.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2affd640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd2c106f50 0x7fbd2c19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:08.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2affd640 1 -- 172.21.15.12:0/3994536474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd2c100d00 msgr2=0x7fbd2c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:08.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2affd640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd2c100d00 0x7fbd2c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:08.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2affd640 1 -- 172.21.15.12:0/3994536474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2c19d510 con 0x7fbd2c100350 2024-09-19T06:38:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.784+0000 7fbd2a7fc640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd2c100d00 0x7fbd2c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:38:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.785+0000 7fbd2affd640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd2c100350 0x7fbd2c198560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009230 tx=0x7fbd1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.785+0000 7fbd13fff640 1 -- 172.21.15.12:0/3994536474 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c03f030 con 0x7fbd2c100350 2024-09-19T06:38:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.785+0000 7fbd13fff640 1 -- 172.21.15.12:0/3994536474 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd1c003ad0 con 0x7fbd2c100350 2024-09-19T06:38:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.785+0000 7fbd31572640 1 -- 172.21.15.12:0/3994536474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2c19d7a0 con 0x7fbd2c100350 2024-09-19T06:38:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.785+0000 7fbd13fff640 1 -- 172.21.15.12:0/3994536474 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c035070 con 0x7fbd2c100350 2024-09-19T06:38:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.785+0000 7fbd31572640 1 -- 172.21.15.12:0/3994536474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2c1a50e0 con 0x7fbd2c100350 2024-09-19T06:38:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.786+0000 7fbd31572640 1 -- 172.21.15.12:0/3994536474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd2c103410 con 0x7fbd2c100350 2024-09-19T06:38:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.788+0000 7fbd13fff640 1 -- 172.21.15.12:0/3994536474 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbd1c042030 con 0x7fbd2c100350 2024-09-19T06:38:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.788+0000 7fbd13fff640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd140a3240 0x7fbd140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.788+0000 7fbd2a7fc640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd140a3240 0x7fbd140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.788+0000 7fbd13fff640 1 -- 172.21.15.12:0/3994536474 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fbd1c0effe0 con 0x7fbd2c100350 2024-09-19T06:38:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.789+0000 7fbd2a7fc640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd140a3240 0x7fbd140a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbd200058c0 tx=0x7fbd20005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.791+0000 7fbd13fff640 1 -- 172.21.15.12:0/3994536474 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd1c0bd1a0 con 0x7fbd2c100350 2024-09-19T06:38:08.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.970+0000 7fbd31572640 1 -- 172.21.15.12:0/3994536474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbd2c10a120 con 0x7fbd2c100350 2024-09-19T06:38:08.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.970+0000 7fbd13fff640 1 -- 172.21.15.12:0/3994536474 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7fbd1c0bcaa0 con 0x7fbd2c100350 2024-09-19T06:38:08.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:08.972 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-19T06:38:08.972 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:38:08.972 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-19T06:38:08.972 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-19T06:38:08.972 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:38:08.972 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-19T06:38:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.972+0000 7fbd31572640 1 -- 172.21.15.12:0/3994536474 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd140a3240 msgr2=0x7fbd140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.972+0000 7fbd31572640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd140a3240 0x7fbd140a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbd200058c0 tx=0x7fbd20005850 comp rx=0 tx=0).stop 2024-09-19T06:38:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.973+0000 7fbd31572640 1 -- 172.21.15.12:0/3994536474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd2c100350 msgr2=0x7fbd2c198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.973+0000 7fbd31572640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd2c100350 0x7fbd2c198560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009230 tx=0x7fbd1c004270 comp rx=0 tx=0).stop 2024-09-19T06:38:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.973+0000 7fbd31572640 1 -- 172.21.15.12:0/3994536474 shutdown_connections 2024-09-19T06:38:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.973+0000 7fbd31572640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbd140a3240 0x7fbd140a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:08.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.973+0000 7fbd31572640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd2c106f50 0x7fbd2c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:08.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.973+0000 7fbd31572640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd2c100d00 0x7fbd2c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:08.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.973+0000 7fbd31572640 1 --2- 172.21.15.12:0/3994536474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd2c100350 0x7fbd2c198560 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:08.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.973+0000 7fbd31572640 1 -- 172.21.15.12:0/3994536474 >> 172.21.15.12:0/3994536474 conn(0x7fbd2c077210 msgr2=0x7fbd2c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:08.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.973+0000 7fbd31572640 1 -- 172.21.15.12:0/3994536474 shutdown_connections 2024-09-19T06:38:08.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:08.973+0000 7fbd31572640 1 -- 172.21.15.12:0/3994536474 wait complete. 2024-09-19T06:38:09.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:09 smithi016 ceph-mon[34911]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:09 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:09 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3994536474' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:38:09.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:09 smithi173 ceph-mon[35349]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:09.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:09.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:09.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:09.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:09.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:09 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:09.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:09 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3994536474' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:38:09.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:09 smithi012 ceph-mon[30937]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:09.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:09.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:09.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:09.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:09.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:09 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:38:09.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:09 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3994536474' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:38:09.637 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T06:38:09.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T06:38:09.897 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:10.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.352+0000 7f96a7cff640 1 -- 172.21.15.12:0/1349781633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a0101420 msgr2=0x7f96a010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.352+0000 7f96a7cff640 1 --2- 172.21.15.12:0/1349781633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a0101420 0x7f96a010d950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9698009cd0 tx=0x7f969802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:38:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.352+0000 7f96a7cff640 1 -- 172.21.15.12:0/1349781633 shutdown_connections 2024-09-19T06:38:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.352+0000 7f96a7cff640 1 --2- 172.21.15.12:0/1349781633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a0101420 0x7f96a010d950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.352+0000 7f96a7cff640 1 --2- 172.21.15.12:0/1349781633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a0100a80 0x7f96a0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.352+0000 7f96a7cff640 1 --2- 172.21.15.12:0/1349781633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0106a80 0x7f96a0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.352+0000 7f96a7cff640 1 -- 172.21.15.12:0/1349781633 >> 172.21.15.12:0/1349781633 conn(0x7f96a00fc7a0 msgr2=0x7f96a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.352+0000 7f96a7cff640 1 -- 172.21.15.12:0/1349781633 shutdown_connections 2024-09-19T06:38:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.352+0000 7f96a7cff640 1 -- 172.21.15.12:0/1349781633 wait complete. 2024-09-19T06:38:10.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a7cff640 1 Processor -- start 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a7cff640 1 -- start start 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a7cff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0100a80 0x7f96a0198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a7cff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a0101420 0x7f96a0198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a7cff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a0106a80 0x7f96a019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a7cff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0110f20 con 0x7f96a0101420 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a7cff640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0110da0 con 0x7f96a0106a80 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a7cff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f96a01110a0 con 0x7f96a0100a80 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a529a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a0101420 0x7f96a0198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a529a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a0101420 0x7f96a0198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38582/0 (socket says 172.21.15.12:38582) 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a529a640 1 -- 172.21.15.12:0/1874826046 learned_addr learned my addr 172.21.15.12:0/1874826046 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:10.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a5a9b640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0100a80 0x7f96a0198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a529a640 1 -- 172.21.15.12:0/1874826046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0100a80 msgr2=0x7f96a0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a629c640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a0106a80 0x7f96a019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a529a640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0100a80 0x7f96a0198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a529a640 1 -- 172.21.15.12:0/1874826046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a0106a80 msgr2=0x7f96a019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a529a640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a0106a80 0x7f96a019ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a529a640 1 -- 172.21.15.12:0/1874826046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a019d500 con 0x7f96a0101420 2024-09-19T06:38:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.353+0000 7f96a5a9b640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0100a80 0x7f96a0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:38:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.354+0000 7f96a529a640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a0101420 0x7f96a0198a90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f969000b4a0 tx=0x7f969000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.354+0000 7f9696ffd640 1 -- 172.21.15.12:0/1874826046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690014070 con 0x7f96a0101420 2024-09-19T06:38:10.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.354+0000 7f96a7cff640 1 -- 172.21.15.12:0/1874826046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a019d7f0 con 0x7f96a0101420 2024-09-19T06:38:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.354+0000 7f9696ffd640 1 -- 172.21.15.12:0/1874826046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9690010af0 con 0x7f96a0101420 2024-09-19T06:38:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.354+0000 7f9696ffd640 1 -- 172.21.15.12:0/1874826046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690017d10 con 0x7f96a0101420 2024-09-19T06:38:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.354+0000 7f96a7cff640 1 -- 172.21.15.12:0/1874826046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a01a50d0 con 0x7f96a0101420 2024-09-19T06:38:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.355+0000 7f96a7cff640 1 -- 172.21.15.12:0/1874826046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a0100f60 con 0x7f96a0101420 2024-09-19T06:38:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.356+0000 7f9696ffd640 1 -- 172.21.15.12:0/1874826046 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9690017070 con 0x7f96a0101420 2024-09-19T06:38:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.357+0000 7f9696ffd640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f968c0a3240 0x7f968c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.357+0000 7f96a5a9b640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f968c0a3240 0x7f968c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.357+0000 7f9696ffd640 1 -- 172.21.15.12:0/1874826046 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f96900ce8f0 con 0x7f96a0101420 2024-09-19T06:38:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.357+0000 7f96a5a9b640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f968c0a3240 0x7f968c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f969c009930 tx=0x7f969c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:10.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.361+0000 7f9696ffd640 1 -- 172.21.15.12:0/1874826046 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f969009bab0 con 0x7f96a0101420 2024-09-19T06:38:10.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:10.538+0000 7f96a7cff640 1 -- 172.21.15.12:0/1874826046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f96a01a53d0 con 0x7f96a0101420 2024-09-19T06:38:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.022+0000 7f9696ffd640 1 -- 172.21.15.12:0/1874826046 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7f969009b3b0 con 0x7f96a0101420 2024-09-19T06:38:11.024 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-19T06:38:11.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 -- 172.21.15.12:0/1874826046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f968c0a3240 msgr2=0x7f968c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f968c0a3240 0x7f968c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f969c009930 tx=0x7f969c008040 comp rx=0 tx=0).stop 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 -- 172.21.15.12:0/1874826046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a0101420 msgr2=0x7f96a0198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a0101420 0x7f96a0198a90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f969000b4a0 tx=0x7f969000b960 comp rx=0 tx=0).stop 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 -- 172.21.15.12:0/1874826046 shutdown_connections 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f968c0a3240 0x7f968c0a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96a0106a80 0x7f96a019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a0101420 0x7f96a0198a90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 --2- 172.21.15.12:0/1874826046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96a0100a80 0x7f96a0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 -- 172.21.15.12:0/1874826046 >> 172.21.15.12:0/1874826046 conn(0x7f96a00fc7a0 msgr2=0x7f96a01048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 -- 172.21.15.12:0/1874826046 shutdown_connections 2024-09-19T06:38:11.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:11.025+0000 7f96a7cff640 1 -- 172.21.15.12:0/1874826046 wait complete. 2024-09-19T06:38:11.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:11 smithi173 ceph-mon[35349]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:11.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:11 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1874826046' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:38:11.346 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:11 smithi012 ceph-mon[30937]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:11.346 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:11 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1874826046' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:38:11.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:11 smithi016 ceph-mon[34911]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:11.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:11 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1874826046' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:38:11.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T06:38:11.927 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:12.308 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:12 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1874826046' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:38:12.308 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:12 smithi012 ceph-mon[30937]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:38:12.308 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:12 smithi012 ceph-mon[30937]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:38:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:12 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1874826046' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:38:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:12 smithi173 ceph-mon[35349]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:38:12.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:12 smithi173 ceph-mon[35349]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:38:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.396+0000 7f91ec24d640 1 -- 172.21.15.12:0/1256756629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91e4100b20 msgr2=0x7f91e4100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.396+0000 7f91ec24d640 1 --2- 172.21.15.12:0/1256756629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91e4100b20 0x7f91e4100f00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009900 tx=0x7f91e002a410 comp rx=0 tx=0).stop 2024-09-19T06:38:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.396+0000 7f91ec24d640 1 -- 172.21.15.12:0/1256756629 shutdown_connections 2024-09-19T06:38:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.396+0000 7f91ec24d640 1 --2- 172.21.15.12:0/1256756629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91e410e500 0x7f91e4110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.396+0000 7f91ec24d640 1 --2- 172.21.15.12:0/1256756629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91e4101440 0x7f91e410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.396+0000 7f91ec24d640 1 --2- 172.21.15.12:0/1256756629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91e4100b20 0x7f91e4100f00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.396+0000 7f91ec24d640 1 -- 172.21.15.12:0/1256756629 >> 172.21.15.12:0/1256756629 conn(0x7f91e40fc7d0 msgr2=0x7f91e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.396+0000 7f91ec24d640 1 -- 172.21.15.12:0/1256756629 shutdown_connections 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.396+0000 7f91ec24d640 1 -- 172.21.15.12:0/1256756629 wait complete. 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ec24d640 1 Processor -- start 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ec24d640 1 -- start start 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ec24d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91e4100b20 0x7f91e419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ec24d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91e4101440 0x7f91e419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ec24d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91e410e500 0x7f91e419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ec24d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91e41142d0 con 0x7f91e410e500 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ec24d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f91e4114150 con 0x7f91e4100b20 2024-09-19T06:38:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ec24d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f91e4114450 con 0x7f91e4101440 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ea7ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91e410e500 0x7f91e419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ea7ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91e410e500 0x7f91e419efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56514/0 (socket says 172.21.15.12:56514) 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ea7ea640 1 -- 172.21.15.12:0/1012153848 learned_addr learned my addr 172.21.15.12:0/1012153848 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91e97e8640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91e4101440 0x7f91e419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91e9fe9640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91e4100b20 0x7f91e419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ea7ea640 1 -- 172.21.15.12:0/1012153848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91e4101440 msgr2=0x7f91e419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ea7ea640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91e4101440 0x7f91e419ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ea7ea640 1 -- 172.21.15.12:0/1012153848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91e4100b20 msgr2=0x7f91e419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ea7ea640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91e4100b20 0x7f91e419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.397+0000 7f91ea7ea640 1 -- 172.21.15.12:0/1012153848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e419f6c0 con 0x7f91e410e500 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.398+0000 7f91e97e8640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91e4101440 0x7f91e419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.398+0000 7f91e9fe9640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91e4100b20 0x7f91e419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:12.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.398+0000 7f91ea7ea640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91e410e500 0x7f91e419efe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00b9e0 tx=0x7f91dc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:12.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.398+0000 7f91daffd640 1 -- 172.21.15.12:0/1012153848 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc019070 con 0x7f91e410e500 2024-09-19T06:38:12.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.398+0000 7f91daffd640 1 -- 172.21.15.12:0/1012153848 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91dc014440 con 0x7f91e410e500 2024-09-19T06:38:12.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.398+0000 7f91ec24d640 1 -- 172.21.15.12:0/1012153848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e419f9b0 con 0x7f91e410e500 2024-09-19T06:38:12.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.398+0000 7f91daffd640 1 -- 172.21.15.12:0/1012153848 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0125e0 con 0x7f91e410e500 2024-09-19T06:38:12.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.398+0000 7f91ec24d640 1 -- 172.21.15.12:0/1012153848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e41a7290 con 0x7f91e410e500 2024-09-19T06:38:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.399+0000 7f91ec24d640 1 -- 172.21.15.12:0/1012153848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e4100f00 con 0x7f91e410e500 2024-09-19T06:38:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.401+0000 7f91daffd640 1 -- 172.21.15.12:0/1012153848 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f91dc01c070 con 0x7f91e410e500 2024-09-19T06:38:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.402+0000 7f91daffd640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91d00a32c0 0x7f91d00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.402+0000 7f91e9fe9640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91d00a32c0 0x7f91d00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.402+0000 7f91daffd640 1 -- 172.21.15.12:0/1012153848 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f91dc0cf2b0 con 0x7f91e410e500 2024-09-19T06:38:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.402+0000 7f91e9fe9640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91d00a32c0 0x7f91d00a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91e0000c00 tx=0x7f91e0032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.405+0000 7f91daffd640 1 -- 172.21.15.12:0/1012153848 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91dc09c260 con 0x7f91e410e500 2024-09-19T06:38:12.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:12 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1874826046' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:38:12.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:12 smithi016 ceph-mon[34911]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:38:12.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:12 smithi016 ceph-mon[34911]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:38:12.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:12.583+0000 7f91ec24d640 1 -- 172.21.15.12:0/1012153848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f91e41a74c0 con 0x7f91e410e500 2024-09-19T06:38:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.027+0000 7f91daffd640 1 -- 172.21.15.12:0/1012153848 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7f91dc09bb60 con 0x7f91e410e500 2024-09-19T06:38:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-19T06:38:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.029+0000 7f91ec24d640 1 -- 172.21.15.12:0/1012153848 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91d00a32c0 msgr2=0x7f91d00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.029+0000 7f91ec24d640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91d00a32c0 0x7f91d00a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91e0000c00 tx=0x7f91e0032d50 comp rx=0 tx=0).stop 2024-09-19T06:38:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.029+0000 7f91ec24d640 1 -- 172.21.15.12:0/1012153848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91e410e500 msgr2=0x7f91e419efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.029+0000 7f91ec24d640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91e410e500 0x7f91e419efe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00b9e0 tx=0x7f91dc00bea0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.030+0000 7f91ec24d640 1 -- 172.21.15.12:0/1012153848 shutdown_connections 2024-09-19T06:38:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.030+0000 7f91ec24d640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91d00a32c0 0x7f91d00a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.030+0000 7f91ec24d640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91e410e500 0x7f91e419efe0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.030+0000 7f91ec24d640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91e4101440 0x7f91e419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.030+0000 7f91ec24d640 1 --2- 172.21.15.12:0/1012153848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91e4100b20 0x7f91e419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.030+0000 7f91ec24d640 1 -- 172.21.15.12:0/1012153848 >> 172.21.15.12:0/1012153848 conn(0x7f91e40fc7d0 msgr2=0x7f91e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.030+0000 7f91ec24d640 1 -- 172.21.15.12:0/1012153848 shutdown_connections 2024-09-19T06:38:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:13.030+0000 7f91ec24d640 1 -- 172.21.15.12:0/1012153848 wait complete. 2024-09-19T06:38:13.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:13 smithi012 ceph-mon[30937]: pgmap v272: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:13.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:13 smithi012 ceph-mon[30937]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:38:13.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:13 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1012153848' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:38:13.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:13 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1012153848' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:38:13.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:13 smithi012 ceph-mon[30937]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:38:13.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:13 smithi173 ceph-mon[35349]: pgmap v272: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:13.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:13 smithi173 ceph-mon[35349]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:38:13.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:13 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1012153848' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:38:13.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:13 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1012153848' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:38:13.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:13 smithi173 ceph-mon[35349]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:38:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:13 smithi016 ceph-mon[34911]: pgmap v272: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:13 smithi016 ceph-mon[34911]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:38:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:13 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1012153848' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:38:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:13 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1012153848' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:38:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:13 smithi016 ceph-mon[34911]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:38:13.706 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T06:38:13.972 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:14.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 -- 172.21.15.12:0/3370199651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f98102ef0 msgr2=0x7f4f9810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:14.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 --2- 172.21.15.12:0/3370199651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f98102ef0 0x7f4f9810da40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009ca0 tx=0x7f4f9002a950 comp rx=0 tx=0).stop 2024-09-19T06:38:14.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 -- 172.21.15.12:0/3370199651 shutdown_connections 2024-09-19T06:38:14.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 --2- 172.21.15.12:0/3370199651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f98102ef0 0x7f4f9810da40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:14.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 --2- 172.21.15.12:0/3370199651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f98102570 0x7f4f981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:14.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 --2- 172.21.15.12:0/3370199651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f98100e20 0x7f4f98101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:14.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 -- 172.21.15.12:0/3370199651 >> 172.21.15.12:0/3370199651 conn(0x7f4f980fc7d0 msgr2=0x7f4f980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 -- 172.21.15.12:0/3370199651 shutdown_connections 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 -- 172.21.15.12:0/3370199651 wait complete. 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 Processor -- start 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.443+0000 7f4f9efbd640 1 -- start start 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9efbd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f98100e20 0x7f4f980fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9efbd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f98102570 0x7f4f980fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9efbd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f98102ef0 0x7f4f980fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9efbd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98110ff0 con 0x7f4f98102ef0 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9efbd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98110e70 con 0x7f4f98102570 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9efbd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98111170 con 0x7f4f98100e20 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9d55a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f98102ef0 0x7f4f980fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:14.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9d55a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f98102ef0 0x7f4f980fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56544/0 (socket says 172.21.15.12:56544) 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9d55a640 1 -- 172.21.15.12:0/2433146763 learned_addr learned my addr 172.21.15.12:0/2433146763 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f97fff640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f98102570 0x7f4f980fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9cd59640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f98100e20 0x7f4f980fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9d55a640 1 -- 172.21.15.12:0/2433146763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f98100e20 msgr2=0x7f4f980fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9d55a640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f98100e20 0x7f4f980fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9d55a640 1 -- 172.21.15.12:0/2433146763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f98102570 msgr2=0x7f4f980fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9d55a640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f98102570 0x7f4f980fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9d55a640 1 -- 172.21.15.12:0/2433146763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f981a6a40 con 0x7f4f98102ef0 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.444+0000 7f4f9d55a640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f98102ef0 0x7f4f980fd700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009dc0 tx=0x7f4f90003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.445+0000 7f4f95ffb640 1 -- 172.21.15.12:0/2433146763 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90034040 con 0x7f4f98102ef0 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.445+0000 7f4f95ffb640 1 -- 172.21.15.12:0/2433146763 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f9002fe10 con 0x7f4f98102ef0 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.445+0000 7f4f9efbd640 1 -- 172.21.15.12:0/2433146763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f981a6cd0 con 0x7f4f98102ef0 2024-09-19T06:38:14.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.445+0000 7f4f95ffb640 1 -- 172.21.15.12:0/2433146763 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f900047b0 con 0x7f4f98102ef0 2024-09-19T06:38:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.445+0000 7f4f9efbd640 1 -- 172.21.15.12:0/2433146763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f981a71b0 con 0x7f4f98102ef0 2024-09-19T06:38:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.446+0000 7f4f9efbd640 1 -- 172.21.15.12:0/2433146763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f98101200 con 0x7f4f98102ef0 2024-09-19T06:38:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.447+0000 7f4f95ffb640 1 -- 172.21.15.12:0/2433146763 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4f90037020 con 0x7f4f98102ef0 2024-09-19T06:38:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.448+0000 7f4f95ffb640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4f800a3240 0x7f4f800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.448+0000 7f4f9cd59640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4f800a3240 0x7f4f800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.448+0000 7f4f95ffb640 1 -- 172.21.15.12:0/2433146763 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f4f900f06d0 con 0x7f4f98102ef0 2024-09-19T06:38:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.448+0000 7f4f9cd59640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4f800a3240 0x7f4f800a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009890 tx=0x7f4f88008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:14.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.451+0000 7f4f95ffb640 1 -- 172.21.15.12:0/2433146763 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f900bd630 con 0x7f4f98102ef0 2024-09-19T06:38:14.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:14.664+0000 7f4f9efbd640 1 -- 172.21.15.12:0/2433146763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4f9810a0a0 con 0x7f4f98102ef0 2024-09-19T06:38:15.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.043+0000 7f4f95ffb640 1 -- 172.21.15.12:0/2433146763 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f4f900bcf30 con 0x7f4f98102ef0 2024-09-19T06:38:15.044 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T06:38:15.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 -- 172.21.15.12:0/2433146763 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4f800a3240 msgr2=0x7f4f800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:15.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4f800a3240 0x7f4f800a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009890 tx=0x7f4f88008040 comp rx=0 tx=0).stop 2024-09-19T06:38:15.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 -- 172.21.15.12:0/2433146763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f98102ef0 msgr2=0x7f4f980fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:15.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f98102ef0 0x7f4f980fd700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009dc0 tx=0x7f4f90003d00 comp rx=0 tx=0).stop 2024-09-19T06:38:15.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 -- 172.21.15.12:0/2433146763 shutdown_connections 2024-09-19T06:38:15.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4f800a3240 0x7f4f800a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:15.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f98102ef0 0x7f4f980fd700 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:15.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f98102570 0x7f4f980fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:15.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 --2- 172.21.15.12:0/2433146763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f98100e20 0x7f4f980fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 -- 172.21.15.12:0/2433146763 >> 172.21.15.12:0/2433146763 conn(0x7f4f980fc7d0 msgr2=0x7f4f9806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.045+0000 7f4f9efbd640 1 -- 172.21.15.12:0/2433146763 shutdown_connections 2024-09-19T06:38:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:15.046+0000 7f4f9efbd640 1 -- 172.21.15.12:0/2433146763 wait complete. 2024-09-19T06:38:15.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:15 smithi173 ceph-mon[35349]: pgmap v275: 97 pgs: 19 creating+peering, 66 unknown, 12 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:15.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:15 smithi173 ceph-mon[35349]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:38:15.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:15 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2433146763' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:38:15.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:15 smithi173 ceph-mon[35349]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:38:15.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:15 smithi012 ceph-mon[30937]: pgmap v275: 97 pgs: 19 creating+peering, 66 unknown, 12 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:15.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:15 smithi012 ceph-mon[30937]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:38:15.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:15 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2433146763' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:38:15.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:15 smithi012 ceph-mon[30937]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:38:15.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:15 smithi016 ceph-mon[34911]: pgmap v275: 97 pgs: 19 creating+peering, 66 unknown, 12 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:38:15.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:15 smithi016 ceph-mon[34911]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:38:15.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:15 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2433146763' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:38:15.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:15 smithi016 ceph-mon[34911]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:38:15.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:38:15.959 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:16.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:16 smithi012 ceph-mon[30937]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:38:16.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:16 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2433146763' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:38:16.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:16 smithi012 ceph-mon[30937]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:38:16.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:16 smithi012 ceph-mon[30937]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:38:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:16 smithi173 ceph-mon[35349]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:38:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:16 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2433146763' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:38:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:16 smithi173 ceph-mon[35349]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:38:16.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:16 smithi173 ceph-mon[35349]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:38:16.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.487+0000 7fba1b7a9640 1 -- 172.21.15.12:0/1432499094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba14102570 msgr2=0x7fba141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:16.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.487+0000 7fba1b7a9640 1 --2- 172.21.15.12:0/1432499094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba14102570 0x7fba141029b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fba04009900 tx=0x7fba0402a480 comp rx=0 tx=0).stop 2024-09-19T06:38:16.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.487+0000 7fba1b7a9640 1 -- 172.21.15.12:0/1432499094 shutdown_connections 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.487+0000 7fba1b7a9640 1 --2- 172.21.15.12:0/1432499094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba14102ef0 0x7fba1410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.487+0000 7fba1b7a9640 1 --2- 172.21.15.12:0/1432499094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba14102570 0x7fba141029b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.487+0000 7fba1b7a9640 1 --2- 172.21.15.12:0/1432499094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba14100e20 0x7fba14101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.487+0000 7fba1b7a9640 1 -- 172.21.15.12:0/1432499094 >> 172.21.15.12:0/1432499094 conn(0x7fba140fc7d0 msgr2=0x7fba140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.487+0000 7fba1b7a9640 1 -- 172.21.15.12:0/1432499094 shutdown_connections 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.487+0000 7fba1b7a9640 1 -- 172.21.15.12:0/1432499094 wait complete. 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba1b7a9640 1 Processor -- start 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba1b7a9640 1 -- start start 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba1b7a9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba14100e20 0x7fba141985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba1b7a9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba14102570 0x7fba14198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba1b7a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba14102ef0 0x7fba1419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba1b7a9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fba14110f80 con 0x7fba14102ef0 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba1b7a9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fba14110e00 con 0x7fba14100e20 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba1b7a9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fba14111100 con 0x7fba14102570 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba19d46640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba14102ef0 0x7fba1419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba19d46640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba14102ef0 0x7fba1419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56554/0 (socket says 172.21.15.12:56554) 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba19d46640 1 -- 172.21.15.12:0/2478850351 learned_addr learned my addr 172.21.15.12:0/2478850351 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba19545640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba14100e20 0x7fba141985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba18d44640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba14102570 0x7fba14198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba19d46640 1 -- 172.21.15.12:0/2478850351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba14102570 msgr2=0x7fba14198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba19d46640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba14102570 0x7fba14198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba19d46640 1 -- 172.21.15.12:0/2478850351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba14100e20 msgr2=0x7fba141985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba19d46640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba14100e20 0x7fba141985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.488+0000 7fba19d46640 1 -- 172.21.15.12:0/2478850351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1419d570 con 0x7fba14102ef0 2024-09-19T06:38:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.489+0000 7fba19d46640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba14102ef0 0x7fba1419ce90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00eaa0 tx=0x7fba0c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.489+0000 7fba0a7fc640 1 -- 172.21.15.12:0/2478850351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00cdb0 con 0x7fba14102ef0 2024-09-19T06:38:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.489+0000 7fba1b7a9640 1 -- 172.21.15.12:0/2478850351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1419d860 con 0x7fba14102ef0 2024-09-19T06:38:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.489+0000 7fba0a7fc640 1 -- 172.21.15.12:0/2478850351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba0c005020 con 0x7fba14102ef0 2024-09-19T06:38:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.489+0000 7fba0a7fc640 1 -- 172.21.15.12:0/2478850351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0116d0 con 0x7fba14102ef0 2024-09-19T06:38:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.489+0000 7fba1b7a9640 1 -- 172.21.15.12:0/2478850351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141a5140 con 0x7fba14102ef0 2024-09-19T06:38:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.490+0000 7fba1b7a9640 1 -- 172.21.15.12:0/2478850351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba14101200 con 0x7fba14102ef0 2024-09-19T06:38:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.491+0000 7fba0a7fc640 1 -- 172.21.15.12:0/2478850351 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fba0c0054d0 con 0x7fba14102ef0 2024-09-19T06:38:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.492+0000 7fba0a7fc640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fba000a3240 0x7fba000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.492+0000 7fba19545640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fba000a3240 0x7fba000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.492+0000 7fba0a7fc640 1 -- 172.21.15.12:0/2478850351 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fba0c0cfc90 con 0x7fba14102ef0 2024-09-19T06:38:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.492+0000 7fba19545640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fba000a3240 0x7fba000a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba1000bbe0 tx=0x7fba1000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:16.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.495+0000 7fba0a7fc640 1 -- 172.21.15.12:0/2478850351 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba0c016030 con 0x7fba14102ef0 2024-09-19T06:38:16.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:16 smithi016 ceph-mon[34911]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:38:16.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:16 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2433146763' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:38:16.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:16 smithi016 ceph-mon[34911]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:38:16.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:16 smithi016 ceph-mon[34911]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:38:16.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.673+0000 7fba1b7a9640 1 -- 172.21.15.12:0/2478850351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba1410a0a0 con 0x7fba14102ef0 2024-09-19T06:38:16.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.675+0000 7fba0a7fc640 1 -- 172.21.15.12:0/2478850351 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22207 (secure 0 0 0) 0x7fba0c09c4b0 con 0x7fba14102ef0 2024-09-19T06:38:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:16.677 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:38:14.665347+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:38:16.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 -- 172.21.15.12:0/2478850351 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fba000a3240 msgr2=0x7fba000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:16.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fba000a3240 0x7fba000a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba1000bbe0 tx=0x7fba1000b390 comp rx=0 tx=0).stop 2024-09-19T06:38:16.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 -- 172.21.15.12:0/2478850351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba14102ef0 msgr2=0x7fba1419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:16.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba14102ef0 0x7fba1419ce90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00eaa0 tx=0x7fba0c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:38:16.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 -- 172.21.15.12:0/2478850351 shutdown_connections 2024-09-19T06:38:16.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fba000a3240 0x7fba000a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba14102ef0 0x7fba1419ce90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba14102570 0x7fba14198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 --2- 172.21.15.12:0/2478850351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba14100e20 0x7fba141985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:16.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 -- 172.21.15.12:0/2478850351 >> 172.21.15.12:0/2478850351 conn(0x7fba140fc7d0 msgr2=0x7fba1406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:16.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 -- 172.21.15.12:0/2478850351 shutdown_connections 2024-09-19T06:38:16.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:16.678+0000 7fba1b7a9640 1 -- 172.21.15.12:0/2478850351 wait complete. 2024-09-19T06:38:17.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:17 smithi012 ceph-mon[30937]: pgmap v278: 97 pgs: 19 creating+peering, 6 unknown, 72 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-09-19T06:38:17.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:17 smithi012 ceph-mon[30937]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:38:17.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:17 smithi012 ceph-mon[30937]: Cluster is now healthy 2024-09-19T06:38:17.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:17 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] up:active 2024-09-19T06:38:17.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:17 smithi012 ceph-mon[30937]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:17.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:17 smithi012 ceph-mon[30937]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:17.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:17 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2478850351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:17.286 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:38:17.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:17 smithi173 ceph-mon[35349]: pgmap v278: 97 pgs: 19 creating+peering, 6 unknown, 72 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-09-19T06:38:17.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:17 smithi173 ceph-mon[35349]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:38:17.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:17 smithi173 ceph-mon[35349]: Cluster is now healthy 2024-09-19T06:38:17.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:17 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] up:active 2024-09-19T06:38:17.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:17 smithi173 ceph-mon[35349]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:17.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:17 smithi173 ceph-mon[35349]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:17.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:17 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2478850351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:17 smithi016 ceph-mon[34911]: pgmap v278: 97 pgs: 19 creating+peering, 6 unknown, 72 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-09-19T06:38:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:17 smithi016 ceph-mon[34911]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:38:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:17 smithi016 ceph-mon[34911]: Cluster is now healthy 2024-09-19T06:38:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:17 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] up:active 2024-09-19T06:38:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:17 smithi016 ceph-mon[34911]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:17 smithi016 ceph-mon[34911]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:17 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2478850351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:17.545 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:18.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 -- 172.21.15.12:0/3475600829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01601082a0 msgr2=0x7f016010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:18.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 --2- 172.21.15.12:0/3475600829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01601082a0 0x7f016010ec40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0150009cd0 tx=0x7f015002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 -- 172.21.15.12:0/3475600829 shutdown_connections 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 --2- 172.21.15.12:0/3475600829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01601082a0 0x7f016010ec40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 --2- 172.21.15.12:0/3475600829 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01601036e0 0x7f0160107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 --2- 172.21.15.12:0/3475600829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0160102d30 0x7f0160103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 -- 172.21.15.12:0/3475600829 >> 172.21.15.12:0/3475600829 conn(0x7f01600fc7d0 msgr2=0x7f01600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 -- 172.21.15.12:0/3475600829 shutdown_connections 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 -- 172.21.15.12:0/3475600829 wait complete. 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 Processor -- start 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.062+0000 7f016850a640 1 -- start start 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f016850a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0160102d30 0x7f01601984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f016850a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01601036e0 0x7f0160198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:18.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f016850a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01601082a0 0x7f016019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f016850a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f01601120a0 con 0x7f01601036e0 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f016850a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0160111f20 con 0x7f01601082a0 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f016850a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0160112220 con 0x7f0160102d30 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f0165aa5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01601036e0 0x7f0160198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f0165aa5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01601036e0 0x7f0160198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56562/0 (socket says 172.21.15.12:56562) 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f0165aa5640 1 -- 172.21.15.12:0/4141706391 learned_addr learned my addr 172.21.15.12:0/4141706391 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f01662a6640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0160102d30 0x7f01601984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f0166aa7640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01601082a0 0x7f016019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f0165aa5640 1 -- 172.21.15.12:0/4141706391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0160102d30 msgr2=0x7f01601984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f0165aa5640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0160102d30 0x7f01601984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f0165aa5640 1 -- 172.21.15.12:0/4141706391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01601082a0 msgr2=0x7f016019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:18.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f0165aa5640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01601082a0 0x7f016019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f0165aa5640 1 -- 172.21.15.12:0/4141706391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016019d470 con 0x7f01601036e0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f0165aa5640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01601036e0 0x7f0160198a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f015400c8c0 tx=0x7f015400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f015f7fe640 1 -- 172.21.15.12:0/4141706391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154007bb0 con 0x7f01601036e0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f016850a640 1 -- 172.21.15.12:0/4141706391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f016019d760 con 0x7f01601036e0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f015f7fe640 1 -- 172.21.15.12:0/4141706391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0154007d50 con 0x7f01601036e0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f015f7fe640 1 -- 172.21.15.12:0/4141706391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154018830 con 0x7f01601036e0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.063+0000 7f016850a640 1 -- 172.21.15.12:0/4141706391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01601a5040 con 0x7f01601036e0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.064+0000 7f016850a640 1 -- 172.21.15.12:0/4141706391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0160103110 con 0x7f01601036e0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.066+0000 7f015f7fe640 1 -- 172.21.15.12:0/4141706391 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f01540189f0 con 0x7f01601036e0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.066+0000 7f015f7fe640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f01480a3240 0x7f01480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.066+0000 7f01662a6640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f01480a3240 0x7f01480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.066+0000 7f015f7fe640 1 -- 172.21.15.12:0/4141706391 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f01540cfa30 con 0x7f01601036e0 2024-09-19T06:38:18.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.067+0000 7f01662a6640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f01480a3240 0x7f01480a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f01580058c0 tx=0x7f015800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:18.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.069+0000 7f015f7fe640 1 -- 172.21.15.12:0/4141706391 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0154014030 con 0x7f01601036e0 2024-09-19T06:38:18.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.248+0000 7f016850a640 1 -- 172.21.15.12:0/4141706391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01601a5240 con 0x7f01601036e0 2024-09-19T06:38:18.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.249+0000 7f015f7fe640 1 -- 172.21.15.12:0/4141706391 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22207 (secure 0 0 0) 0x7f015409c930 con 0x7f01601036e0 2024-09-19T06:38:18.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:18.251 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:38:14.665347+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:38:18.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.251+0000 7f016850a640 1 -- 172.21.15.12:0/4141706391 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f01480a3240 msgr2=0x7f01480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:18.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.251+0000 7f016850a640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f01480a3240 0x7f01480a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f01580058c0 tx=0x7f015800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.251+0000 7f016850a640 1 -- 172.21.15.12:0/4141706391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01601036e0 msgr2=0x7f0160198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.251+0000 7f016850a640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01601036e0 0x7f0160198a00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f015400c8c0 tx=0x7f015400cd80 comp rx=0 tx=0).stop 2024-09-19T06:38:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.252+0000 7f016850a640 1 -- 172.21.15.12:0/4141706391 shutdown_connections 2024-09-19T06:38:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.252+0000 7f016850a640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f01480a3240 0x7f01480a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.252+0000 7f016850a640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01601082a0 0x7f016019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.252+0000 7f016850a640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01601036e0 0x7f0160198a00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.252+0000 7f016850a640 1 --2- 172.21.15.12:0/4141706391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0160102d30 0x7f01601984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.252+0000 7f016850a640 1 -- 172.21.15.12:0/4141706391 >> 172.21.15.12:0/4141706391 conn(0x7f01600fc7d0 msgr2=0x7f01600fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:18.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.252+0000 7f016850a640 1 -- 172.21.15.12:0/4141706391 shutdown_connections 2024-09-19T06:38:18.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:18.252+0000 7f016850a640 1 -- 172.21.15.12:0/4141706391 wait complete. 2024-09-19T06:38:18.925 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T06:38:19.008 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:18 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: 2024-09-19T06:38:18.654+0000 7f466b756640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:38:19.185 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:19.302 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:19 smithi012 ceph-mon[30937]: pgmap v279: 97 pgs: 16 creating+peering, 81 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 721 B/s wr, 2 op/s 2024-09-19T06:38:19.302 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:19 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/4141706391' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:19.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:19 smithi173 ceph-mon[35349]: pgmap v279: 97 pgs: 16 creating+peering, 81 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 721 B/s wr, 2 op/s 2024-09-19T06:38:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:19 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/4141706391' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:19.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:19 smithi016 ceph-mon[34911]: pgmap v279: 97 pgs: 16 creating+peering, 81 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 721 B/s wr, 2 op/s 2024-09-19T06:38:19.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:19 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/4141706391' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:19.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.679+0000 7fe8a5b02640 1 -- 172.21.15.12:0/2940905058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8a0102d40 msgr2=0x7fe8a0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.679+0000 7fe8a5b02640 1 --2- 172.21.15.12:0/2940905058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8a0102d40 0x7fe8a0103120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe890009900 tx=0x7fe89002a480 comp rx=0 tx=0).stop 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.679+0000 7fe8a5b02640 1 -- 172.21.15.12:0/2940905058 shutdown_connections 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.679+0000 7fe8a5b02640 1 --2- 172.21.15.12:0/2940905058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a010c170 0x7fe8a010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.679+0000 7fe8a5b02640 1 --2- 172.21.15.12:0/2940905058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a0103660 0x7fe8a010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.679+0000 7fe8a5b02640 1 --2- 172.21.15.12:0/2940905058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8a0102d40 0x7fe8a0103120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.679+0000 7fe8a5b02640 1 -- 172.21.15.12:0/2940905058 >> 172.21.15.12:0/2940905058 conn(0x7fe8a00fc7a0 msgr2=0x7fe8a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.679+0000 7fe8a5b02640 1 -- 172.21.15.12:0/2940905058 shutdown_connections 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.679+0000 7fe8a5b02640 1 -- 172.21.15.12:0/2940905058 wait complete. 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe8a5b02640 1 Processor -- start 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe8a5b02640 1 -- start start 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe8a5b02640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a0102d40 0x7fe8a019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:19.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe8a5b02640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a0103660 0x7fe8a019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe8a5b02640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8a010c170 0x7fe8a019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe8a5b02640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a0111f70 con 0x7fe8a010c170 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe8a5b02640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a0111df0 con 0x7fe8a0103660 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe8a5b02640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a01120f0 con 0x7fe8a0102d40 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe89ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8a010c170 0x7fe8a019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe89ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8a010c170 0x7fe8a019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56584/0 (socket says 172.21.15.12:56584) 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe89ffff640 1 -- 172.21.15.12:0/1825898628 learned_addr learned my addr 172.21.15.12:0/1825898628 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.680+0000 7fe89f7fe640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a0102d40 0x7fe8a019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe89effd640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a0103660 0x7fe8a019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe89ffff640 1 -- 172.21.15.12:0/1825898628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a0102d40 msgr2=0x7fe8a019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:19.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe89ffff640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a0102d40 0x7fe8a019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe89ffff640 1 -- 172.21.15.12:0/1825898628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a0103660 msgr2=0x7fe8a019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe89ffff640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a0103660 0x7fe8a019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe89ffff640 1 -- 172.21.15.12:0/1825898628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a019f660 con 0x7fe8a010c170 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe89ffff640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8a010c170 0x7fe8a019ef80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe89800cad0 tx=0x7fe89800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe89cff9640 1 -- 172.21.15.12:0/1825898628 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89800ae20 con 0x7fe8a010c170 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe89cff9640 1 -- 172.21.15.12:0/1825898628 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe898005020 con 0x7fe8a010c170 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe8a5b02640 1 -- 172.21.15.12:0/1825898628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a019f950 con 0x7fe8a010c170 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe89cff9640 1 -- 172.21.15.12:0/1825898628 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89800f6f0 con 0x7fe8a010c170 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.681+0000 7fe8a5b02640 1 -- 172.21.15.12:0/1825898628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a01a7230 con 0x7fe8a010c170 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.682+0000 7fe8a5b02640 1 -- 172.21.15.12:0/1825898628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a0103120 con 0x7fe8a010c170 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.683+0000 7fe89cff9640 1 -- 172.21.15.12:0/1825898628 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe8980051d0 con 0x7fe8a010c170 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.684+0000 7fe89cff9640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8880a3240 0x7fe8880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:19.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.684+0000 7fe89f7fe640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8880a3240 0x7fe8880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:19.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.684+0000 7fe89cff9640 1 -- 172.21.15.12:0/1825898628 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fe8980cfb50 con 0x7fe8a010c170 2024-09-19T06:38:19.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.685+0000 7fe89f7fe640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8880a3240 0x7fe8880a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe890000c00 tx=0x7fe8900058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:19.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.687+0000 7fe89cff9640 1 -- 172.21.15.12:0/1825898628 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe898014030 con 0x7fe8a010c170 2024-09-19T06:38:19.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:19.900+0000 7fe8a5b02640 1 -- 172.21.15.12:0/1825898628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe8a01a7490 con 0x7fe8a010c170 2024-09-19T06:38:20.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.042+0000 7fe89cff9640 1 -- 172.21.15.12:0/1825898628 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fe89809c920 con 0x7fe8a010c170 2024-09-19T06:38:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 -- 172.21.15.12:0/1825898628 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8880a3240 msgr2=0x7fe8880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8880a3240 0x7fe8880a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe890000c00 tx=0x7fe8900058d0 comp rx=0 tx=0).stop 2024-09-19T06:38:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 -- 172.21.15.12:0/1825898628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8a010c170 msgr2=0x7fe8a019ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8a010c170 0x7fe8a019ef80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe89800cad0 tx=0x7fe89800cf90 comp rx=0 tx=0).stop 2024-09-19T06:38:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 -- 172.21.15.12:0/1825898628 shutdown_connections 2024-09-19T06:38:20.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8880a3240 0x7fe8880a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:20.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8a010c170 0x7fe8a019ef80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:20.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a0103660 0x7fe8a019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:20.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 --2- 172.21.15.12:0/1825898628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe8a0102d40 0x7fe8a019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:20.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 -- 172.21.15.12:0/1825898628 >> 172.21.15.12:0/1825898628 conn(0x7fe8a00fc7a0 msgr2=0x7fe8a010d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:20.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 -- 172.21.15.12:0/1825898628 shutdown_connections 2024-09-19T06:38:20.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:20.044+0000 7fe8a5b02640 1 -- 172.21.15.12:0/1825898628 wait complete. 2024-09-19T06:38:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:20 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1825898628' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:38:20.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:20 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1825898628' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:38:20.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:20 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1825898628' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:38:20.733 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T06:38:20.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-19T06:38:20.993 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:21.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:21 smithi012 ceph-mon[30937]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T06:38:21.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:21 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1825898628' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:38:21.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:21 smithi012 ceph-mon[30937]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:21.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:21 smithi173 ceph-mon[35349]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T06:38:21.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:21 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1825898628' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:38:21.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:21 smithi173 ceph-mon[35349]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:21.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.395+0000 7f3930623640 1 -- 172.21.15.12:0/2769011086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3928102570 msgr2=0x7f39281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.395+0000 7f3930623640 1 --2- 172.21.15.12:0/2769011086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3928102570 0x7f39281029b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3918009900 tx=0x7f391802a480 comp rx=0 tx=0).stop 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 -- 172.21.15.12:0/2769011086 shutdown_connections 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 --2- 172.21.15.12:0/2769011086 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3928102ef0 0x7f392810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 --2- 172.21.15.12:0/2769011086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3928102570 0x7f39281029b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 --2- 172.21.15.12:0/2769011086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3928100e20 0x7f3928101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 -- 172.21.15.12:0/2769011086 >> 172.21.15.12:0/2769011086 conn(0x7f39280fc7d0 msgr2=0x7f39280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 -- 172.21.15.12:0/2769011086 shutdown_connections 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 -- 172.21.15.12:0/2769011086 wait complete. 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 Processor -- start 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 -- start start 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3928100e20 0x7f39281984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:21.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3928102570 0x7f39281989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3928102ef0 0x7f392819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3928110f80 con 0x7f3928100e20 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3928110e00 con 0x7f3928102570 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.396+0000 7f3930623640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3928111100 con 0x7f3928102ef0 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392e3bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3928100e20 0x7f39281984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392e3bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3928100e20 0x7f39281984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54614/0 (socket says 172.21.15.12:54614) 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392e3bf640 1 -- 172.21.15.12:0/2716603178 learned_addr learned my addr 172.21.15.12:0/2716603178 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392ebc0640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3928102ef0 0x7f392819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392dbbe640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3928102570 0x7f39281989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392e3bf640 1 -- 172.21.15.12:0/2716603178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3928102ef0 msgr2=0x7f392819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392e3bf640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3928102ef0 0x7f392819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:21.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392e3bf640 1 -- 172.21.15.12:0/2716603178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3928102570 msgr2=0x7f39281989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392e3bf640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3928102570 0x7f39281989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392e3bf640 1 -- 172.21.15.12:0/2716603178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392819d460 con 0x7f3928100e20 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f392e3bf640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3928100e20 0x7f39281984b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f392400c920 tx=0x7f392400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f391f7fe640 1 -- 172.21.15.12:0/2716603178 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924007c70 con 0x7f3928100e20 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f391f7fe640 1 -- 172.21.15.12:0/2716603178 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3924007e10 con 0x7f3928100e20 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f3930623640 1 -- 172.21.15.12:0/2716603178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392819d750 con 0x7f3928100e20 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f391f7fe640 1 -- 172.21.15.12:0/2716603178 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924018890 con 0x7f3928100e20 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.397+0000 7f3930623640 1 -- 172.21.15.12:0/2716603178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39281a5030 con 0x7f3928100e20 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.398+0000 7f3930623640 1 -- 172.21.15.12:0/2716603178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3928101200 con 0x7f3928100e20 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.399+0000 7f391f7fe640 1 -- 172.21.15.12:0/2716603178 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3924018a70 con 0x7f3928100e20 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.400+0000 7f391f7fe640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f39140a3240 0x7f39140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.400+0000 7f392dbbe640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f39140a3240 0x7f39140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:21.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.400+0000 7f391f7fe640 1 -- 172.21.15.12:0/2716603178 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f39240cf910 con 0x7f3928100e20 2024-09-19T06:38:21.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.401+0000 7f392dbbe640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f39140a3240 0x7f39140a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f39280fee00 tx=0x7f3918005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:21.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.404+0000 7f391f7fe640 1 -- 172.21.15.12:0/2716603178 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3924014030 con 0x7f3928100e20 2024-09-19T06:38:21.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:21 smithi016 ceph-mon[34911]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T06:38:21.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:21 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1825898628' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:38:21.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:21 smithi016 ceph-mon[34911]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:21.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:21.620+0000 7f3930623640 1 -- 172.21.15.12:0/2716603178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f392810a0f0 con 0x7f3928100e20 2024-09-19T06:38:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.050+0000 7f391f7fe640 1 -- 172.21.15.12:0/2716603178 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f392810a0f0 con 0x7f3928100e20 2024-09-19T06:38:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.053+0000 7f3930623640 1 -- 172.21.15.12:0/2716603178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f39140a3240 msgr2=0x7f39140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.053+0000 7f3930623640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f39140a3240 0x7f39140a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f39280fee00 tx=0x7f3918005a20 comp rx=0 tx=0).stop 2024-09-19T06:38:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.053+0000 7f3930623640 1 -- 172.21.15.12:0/2716603178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3928100e20 msgr2=0x7f39281984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.053+0000 7f3930623640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3928100e20 0x7f39281984b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f392400c920 tx=0x7f392400cde0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.053+0000 7f3930623640 1 -- 172.21.15.12:0/2716603178 shutdown_connections 2024-09-19T06:38:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.053+0000 7f3930623640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f39140a3240 0x7f39140a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.053+0000 7f3930623640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3928102ef0 0x7f392819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.053+0000 7f3930623640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3928102570 0x7f39281989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.053+0000 7f3930623640 1 --2- 172.21.15.12:0/2716603178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3928100e20 0x7f39281984b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.053+0000 7f3930623640 1 -- 172.21.15.12:0/2716603178 >> 172.21.15.12:0/2716603178 conn(0x7f39280fc7d0 msgr2=0x7f392806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.054+0000 7f3930623640 1 -- 172.21.15.12:0/2716603178 shutdown_connections 2024-09-19T06:38:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:22.054+0000 7f3930623640 1 -- 172.21.15.12:0/2716603178 wait complete. 2024-09-19T06:38:22.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2716603178' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T06:38:22.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-19T06:38:22.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T06:38:22.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T06:38:22.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T06:38:22.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:38:22.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-09-19T06:38:22.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-19T06:38:22.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T06:38:22.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-19T06:38:22.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T06:38:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2716603178' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T06:38:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-19T06:38:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T06:38:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T06:38:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T06:38:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:38:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-09-19T06:38:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-19T06:38:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T06:38:22.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-19T06:38:22.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T06:38:22.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2716603178' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T06:38:22.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-19T06:38:22.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T06:38:22.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T06:38:22.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T06:38:22.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:38:22.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-09-19T06:38:22.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2024-09-19T06:38:22.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-19T06:38:22.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-19T06:38:22.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T06:38:22.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T06:38:23.017 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:23.056 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2716603178' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T06:38:23.057 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-19T06:38:23.058 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T06:38:23.058 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:38:23.058 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:38:23.058 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:23.058 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:23 smithi012 ceph-mon[30937]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2716603178' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-19T06:38:23.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T06:38:23.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-19T06:38:23.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T06:38:23.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:38:23.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:38:23.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:23.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:23 smithi173 ceph-mon[35349]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:38:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.487+0000 7fd35175e640 1 -- 172.21.15.12:0/2727950794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd34c102790 msgr2=0x7fd34c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.487+0000 7fd35175e640 1 --2- 172.21.15.12:0/2727950794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd34c102790 0x7fd34c1067e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd334009900 tx=0x7fd33402a410 comp rx=0 tx=0).stop 2024-09-19T06:38:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.487+0000 7fd35175e640 1 -- 172.21.15.12:0/2727950794 shutdown_connections 2024-09-19T06:38:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.487+0000 7fd35175e640 1 --2- 172.21.15.12:0/2727950794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd34c106f10 0x7fd34c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.487+0000 7fd35175e640 1 --2- 172.21.15.12:0/2727950794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd34c102790 0x7fd34c1067e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.487+0000 7fd35175e640 1 --2- 172.21.15.12:0/2727950794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd34c101de0 0x7fd34c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.487+0000 7fd35175e640 1 -- 172.21.15.12:0/2727950794 >> 172.21.15.12:0/2727950794 conn(0x7fd34c0fd8c0 msgr2=0x7fd34c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.487+0000 7fd35175e640 1 -- 172.21.15.12:0/2727950794 shutdown_connections 2024-09-19T06:38:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.487+0000 7fd35175e640 1 -- 172.21.15.12:0/2727950794 wait complete. 2024-09-19T06:38:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd35175e640 1 Processor -- start 2024-09-19T06:38:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd35175e640 1 -- start start 2024-09-19T06:38:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd35175e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd34c101de0 0x7fd34c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd35175e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd34c102790 0x7fd34c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd35175e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd34c106f10 0x7fd34c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd35175e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c111f90 con 0x7fd34c101de0 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd35175e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c111e10 con 0x7fd34c106f10 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd35175e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c112110 con 0x7fd34c102790 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd34affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd34c101de0 0x7fd34c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd34affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd34c101de0 0x7fd34c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54622/0 (socket says 172.21.15.12:54622) 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd34affd640 1 -- 172.21.15.12:0/1840333807 learned_addr learned my addr 172.21.15.12:0/1840333807 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.488+0000 7fd343fff640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd34c102790 0x7fd34c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd34b7fe640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd34c106f10 0x7fd34c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd34affd640 1 -- 172.21.15.12:0/1840333807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd34c102790 msgr2=0x7fd34c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd34affd640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd34c102790 0x7fd34c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd34affd640 1 -- 172.21.15.12:0/1840333807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd34c106f10 msgr2=0x7fd34c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd34affd640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd34c106f10 0x7fd34c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd34affd640 1 -- 172.21.15.12:0/1840333807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c19d3d0 con 0x7fd34c101de0 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd34b7fe640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd34c106f10 0x7fd34c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd34affd640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd34c101de0 0x7fd34c198420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00c920 tx=0x7fd33c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd348ff9640 1 -- 172.21.15.12:0/1840333807 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c007c70 con 0x7fd34c101de0 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd348ff9640 1 -- 172.21.15.12:0/1840333807 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd33c007e10 con 0x7fd34c101de0 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd35175e640 1 -- 172.21.15.12:0/1840333807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34c19d6c0 con 0x7fd34c101de0 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd348ff9640 1 -- 172.21.15.12:0/1840333807 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c018890 con 0x7fd34c101de0 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.489+0000 7fd35175e640 1 -- 172.21.15.12:0/1840333807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34c1a4fa0 con 0x7fd34c101de0 2024-09-19T06:38:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.490+0000 7fd35175e640 1 -- 172.21.15.12:0/1840333807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34c1021c0 con 0x7fd34c101de0 2024-09-19T06:38:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.491+0000 7fd348ff9640 1 -- 172.21.15.12:0/1840333807 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd33c018b30 con 0x7fd34c101de0 2024-09-19T06:38:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.492+0000 7fd348ff9640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd3380a32c0 0x7fd3380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.492+0000 7fd343fff640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd3380a32c0 0x7fd3380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.492+0000 7fd348ff9640 1 -- 172.21.15.12:0/1840333807 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fd33c0cfae0 con 0x7fd34c101de0 2024-09-19T06:38:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.493+0000 7fd343fff640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd3380a32c0 0x7fd3380a5780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0fe0d0 tx=0x7fd334031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.496+0000 7fd348ff9640 1 -- 172.21.15.12:0/1840333807 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd33c014030 con 0x7fd34c101de0 2024-09-19T06:38:23.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2716603178' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-19T06:38:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-19T06:38:23.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T06:38:23.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:38:23.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:38:23.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:38:23.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:23 smithi016 ceph-mon[34911]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:38:23.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:23.714+0000 7fd35175e640 1 -- 172.21.15.12:0/1840333807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fd34c10a150 con 0x7fd34c101de0 2024-09-19T06:38:24.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.062+0000 7fd348ff9640 1 -- 172.21.15.12:0/1840333807 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7fd33c00de20 con 0x7fd34c101de0 2024-09-19T06:38:24.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 -- 172.21.15.12:0/1840333807 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd3380a32c0 msgr2=0x7fd3380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:24.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd3380a32c0 0x7fd3380a5780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0fe0d0 tx=0x7fd334031490 comp rx=0 tx=0).stop 2024-09-19T06:38:24.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 -- 172.21.15.12:0/1840333807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd34c101de0 msgr2=0x7fd34c198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:24.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd34c101de0 0x7fd34c198420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00c920 tx=0x7fd33c00cde0 comp rx=0 tx=0).stop 2024-09-19T06:38:24.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 -- 172.21.15.12:0/1840333807 shutdown_connections 2024-09-19T06:38:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd3380a32c0 0x7fd3380a5780 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd34c106f10 0x7fd34c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd34c102790 0x7fd34c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 --2- 172.21.15.12:0/1840333807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd34c101de0 0x7fd34c198420 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 -- 172.21.15.12:0/1840333807 >> 172.21.15.12:0/1840333807 conn(0x7fd34c0fd8c0 msgr2=0x7fd34c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 -- 172.21.15.12:0/1840333807 shutdown_connections 2024-09-19T06:38:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:24.065+0000 7fd35175e640 1 -- 172.21.15.12:0/1840333807 wait complete. 2024-09-19T06:38:24.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:24 smithi173 ceph-mon[35349]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:38:24.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:24 smithi173 ceph-mon[35349]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:38:24.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:24 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1840333807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:38:24.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:24 smithi012 ceph-mon[30937]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:38:24.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:24 smithi012 ceph-mon[30937]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:38:24.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:24 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1840333807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:38:24.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:24 smithi016 ceph-mon[34911]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:38:24.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:24 smithi016 ceph-mon[34911]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:38:24.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:24 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1840333807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:38:24.798 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T06:38:25.061 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:25.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: pgmap v284: 97 pgs: 1 activating, 96 active+clean; 580 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T06:38:25.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1840333807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:38:25.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] up:active 2024-09-19T06:38:25.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:38:25.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:38:25.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T06:38:25.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T06:38:25.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] up:active 2024-09-19T06:38:25.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T06:38:25.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:38:25.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-09-19T06:38:25.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:25 smithi012 ceph-mon[30937]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-09-19T06:38:25.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: pgmap v284: 97 pgs: 1 activating, 96 active+clean; 580 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T06:38:25.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1840333807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:38:25.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] up:active 2024-09-19T06:38:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:38:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:38:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T06:38:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T06:38:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] up:active 2024-09-19T06:38:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T06:38:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:38:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-09-19T06:38:25.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:25 smithi173 ceph-mon[35349]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: pgmap v284: 97 pgs: 1 activating, 96 active+clean; 580 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1840333807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] up:active 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] up:active 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T06:38:25.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-09-19T06:38:25.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:25 smithi016 ceph-mon[34911]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-09-19T06:38:25.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.527+0000 7f3f6d10c640 1 -- 172.21.15.12:0/3136569586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f68106a80 msgr2=0x7f3f68106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:25.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.527+0000 7f3f6d10c640 1 --2- 172.21.15.12:0/3136569586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f68106a80 0x7f3f68106e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009930 tx=0x7f3f5802a420 comp rx=0 tx=0).stop 2024-09-19T06:38:25.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.527+0000 7f3f6d10c640 1 -- 172.21.15.12:0/3136569586 shutdown_connections 2024-09-19T06:38:25.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.527+0000 7f3f6d10c640 1 --2- 172.21.15.12:0/3136569586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68101420 0x7f3f6810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:25.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.527+0000 7f3f6d10c640 1 --2- 172.21.15.12:0/3136569586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f68100a80 0x7f3f68100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:25.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.527+0000 7f3f6d10c640 1 --2- 172.21.15.12:0/3136569586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f68106a80 0x7f3f68106e60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.527+0000 7f3f6d10c640 1 -- 172.21.15.12:0/3136569586 >> 172.21.15.12:0/3136569586 conn(0x7f3f680fc7a0 msgr2=0x7f3f680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.527+0000 7f3f6d10c640 1 -- 172.21.15.12:0/3136569586 shutdown_connections 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.527+0000 7f3f6d10c640 1 -- 172.21.15.12:0/3136569586 wait complete. 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.528+0000 7f3f6d10c640 1 Processor -- start 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.528+0000 7f3f6d10c640 1 -- start start 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6d10c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68100a80 0x7f3f681972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6d10c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f68101420 0x7f3f68197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6d10c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f68106a80 0x7f3f6819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6d10c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3f68110e80 con 0x7f3f68106a80 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6d10c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3f68110d00 con 0x7f3f68100a80 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6d10c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3f68111000 con 0x7f3f68101420 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f68106a80 0x7f3f6819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f68106a80 0x7f3f6819bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54644/0 (socket says 172.21.15.12:54644) 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6759e640 1 -- 172.21.15.12:0/1913503452 learned_addr learned my addr 172.21.15.12:0/1913503452 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6659c640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f68101420 0x7f3f68197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f66d9d640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68100a80 0x7f3f681972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6759e640 1 -- 172.21.15.12:0/1913503452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f68101420 msgr2=0x7f3f68197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6759e640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f68101420 0x7f3f68197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6759e640 1 -- 172.21.15.12:0/1913503452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68100a80 msgr2=0x7f3f681972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6759e640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68100a80 0x7f3f681972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6759e640 1 -- 172.21.15.12:0/1913503452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6819c290 con 0x7f3f68106a80 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f6759e640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f68106a80 0x7f3f6819bbb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009fd0 tx=0x7f3f6000def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.529+0000 7f3f4ffff640 1 -- 172.21.15.12:0/1913503452 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f60017070 con 0x7f3f68106a80 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.530+0000 7f3f4ffff640 1 -- 172.21.15.12:0/1913503452 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f60003e50 con 0x7f3f68106a80 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.530+0000 7f3f6d10c640 1 -- 172.21.15.12:0/1913503452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6819c580 con 0x7f3f68106a80 2024-09-19T06:38:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.530+0000 7f3f4ffff640 1 -- 172.21.15.12:0/1913503452 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f60010460 con 0x7f3f68106a80 2024-09-19T06:38:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.530+0000 7f3f6d10c640 1 -- 172.21.15.12:0/1913503452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f681a3e60 con 0x7f3f68106a80 2024-09-19T06:38:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.531+0000 7f3f6d10c640 1 -- 172.21.15.12:0/1913503452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f68100ee0 con 0x7f3f68106a80 2024-09-19T06:38:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.532+0000 7f3f4ffff640 1 -- 172.21.15.12:0/1913503452 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3f60003970 con 0x7f3f68106a80 2024-09-19T06:38:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.533+0000 7f3f4ffff640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3f500a3340 0x7f3f500a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.533+0000 7f3f66d9d640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3f500a3340 0x7f3f500a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.533+0000 7f3f4ffff640 1 -- 172.21.15.12:0/1913503452 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f3f600cf510 con 0x7f3f68106a80 2024-09-19T06:38:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.533+0000 7f3f66d9d640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3f500a3340 0x7f3f500a5800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009900 tx=0x7f3f580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.537+0000 7f3f4ffff640 1 -- 172.21.15.12:0/1913503452 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f6009c1b0 con 0x7f3f68106a80 2024-09-19T06:38:25.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:25.758+0000 7f3f6d10c640 1 -- 172.21.15.12:0/1913503452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f3f68108a60 con 0x7f3f68106a80 2024-09-19T06:38:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.670+0000 7f3f4ffff640 1 -- 172.21.15.12:0/1913503452 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f3f6009bab0 con 0x7f3f68106a80 2024-09-19T06:38:26.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 -- 172.21.15.12:0/1913503452 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3f500a3340 msgr2=0x7f3f500a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3f500a3340 0x7f3f500a5800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009900 tx=0x7f3f580058d0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 -- 172.21.15.12:0/1913503452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f68106a80 msgr2=0x7f3f6819bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f68106a80 0x7f3f6819bbb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009fd0 tx=0x7f3f6000def0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 -- 172.21.15.12:0/1913503452 shutdown_connections 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3f500a3340 0x7f3f500a5800 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f68106a80 0x7f3f6819bbb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f68101420 0x7f3f68197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 --2- 172.21.15.12:0/1913503452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f68100a80 0x7f3f681972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 -- 172.21.15.12:0/1913503452 >> 172.21.15.12:0/1913503452 conn(0x7f3f680fc7a0 msgr2=0x7f3f680fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 -- 172.21.15.12:0/1913503452 shutdown_connections 2024-09-19T06:38:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:26.673+0000 7f3f6d10c640 1 -- 172.21.15.12:0/1913503452 wait complete. 2024-09-19T06:38:27.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:26 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] up:active 2024-09-19T06:38:27.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:26 smithi016 ceph-mon[34911]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T06:38:27.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:26 smithi016 ceph-mon[34911]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:38:27.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:26 smithi016 ceph-mon[34911]: Cluster is now healthy 2024-09-19T06:38:27.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:26 smithi016 ceph-mon[34911]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-09-19T06:38:27.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:26 smithi016 ceph-mon[34911]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-09-19T06:38:27.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:26 smithi016 ceph-mon[34911]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-09-19T06:38:27.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:26 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1913503452' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:38:27.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:26 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] up:active 2024-09-19T06:38:27.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:26 smithi012 ceph-mon[30937]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T06:38:27.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:26 smithi012 ceph-mon[30937]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:38:27.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:26 smithi012 ceph-mon[30937]: Cluster is now healthy 2024-09-19T06:38:27.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:26 smithi012 ceph-mon[30937]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-09-19T06:38:27.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:26 smithi012 ceph-mon[30937]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-09-19T06:38:27.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:26 smithi012 ceph-mon[30937]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-09-19T06:38:27.023 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:26 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1913503452' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:38:27.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:26 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] up:active 2024-09-19T06:38:27.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:26 smithi173 ceph-mon[35349]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T06:38:27.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:26 smithi173 ceph-mon[35349]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:38:27.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:26 smithi173 ceph-mon[35349]: Cluster is now healthy 2024-09-19T06:38:27.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:26 smithi173 ceph-mon[35349]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-09-19T06:38:27.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:26 smithi173 ceph-mon[35349]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-09-19T06:38:27.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:26 smithi173 ceph-mon[35349]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-09-19T06:38:27.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:26 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1913503452' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:38:27.393 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T06:38:27.394 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T06:38:27.657 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:27.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:27 smithi012 ceph-mon[30937]: pgmap v285: 97 pgs: 1 activating, 96 active+clean; 582 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.4 KiB/s wr, 16 op/s; 274 B/s, 0 objects/s recovering 2024-09-19T06:38:27.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:27 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1913503452' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:38:27.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:27 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] up:active 2024-09-19T06:38:27.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:27 smithi012 ceph-mon[30937]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-09-19T06:38:27.932 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:27 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:38:28.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:27 smithi016 ceph-mon[34911]: pgmap v285: 97 pgs: 1 activating, 96 active+clean; 582 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.4 KiB/s wr, 16 op/s; 274 B/s, 0 objects/s recovering 2024-09-19T06:38:28.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:27 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1913503452' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:38:28.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:27 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] up:active 2024-09-19T06:38:28.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:27 smithi016 ceph-mon[34911]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-09-19T06:38:28.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:27 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:38:28.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:27 smithi173 ceph-mon[35349]: pgmap v285: 97 pgs: 1 activating, 96 active+clean; 582 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.4 KiB/s wr, 16 op/s; 274 B/s, 0 objects/s recovering 2024-09-19T06:38:28.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:27 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1913503452' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:38:28.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:27 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] up:active 2024-09-19T06:38:28.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:27 smithi173 ceph-mon[35349]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-09-19T06:38:28.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:27 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:38:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.103+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1601262975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb398106f10 msgr2=0x7fb39810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.103+0000 7fb39fb8b640 1 --2- 172.21.15.12:0/1601262975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb398106f10 0x7fb39810ea90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb390009ca0 tx=0x7fb39002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.103+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1601262975 shutdown_connections 2024-09-19T06:38:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.103+0000 7fb39fb8b640 1 --2- 172.21.15.12:0/1601262975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb398106f10 0x7fb39810ea90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.103+0000 7fb39fb8b640 1 --2- 172.21.15.12:0/1601262975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb398102790 0x7fb3981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.103+0000 7fb39fb8b640 1 --2- 172.21.15.12:0/1601262975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb398101de0 0x7fb3981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.103+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1601262975 >> 172.21.15.12:0/1601262975 conn(0x7fb3980fd8c0 msgr2=0x7fb3980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:28.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.103+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1601262975 shutdown_connections 2024-09-19T06:38:28.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.103+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1601262975 wait complete. 2024-09-19T06:38:28.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39fb8b640 1 Processor -- start 2024-09-19T06:38:28.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39fb8b640 1 -- start start 2024-09-19T06:38:28.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39fb8b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb398101de0 0x7fb3981983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:28.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39fb8b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb398102790 0x7fb3981988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:28.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39fb8b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb398106f10 0x7fb39819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:28.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39fb8b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb398111f70 con 0x7fb398101de0 2024-09-19T06:38:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39fb8b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb398111df0 con 0x7fb398102790 2024-09-19T06:38:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39fb8b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb3981120f0 con 0x7fb398106f10 2024-09-19T06:38:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d927640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb398101de0 0x7fb3981983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d927640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb398101de0 0x7fb3981983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54660/0 (socket says 172.21.15.12:54660) 2024-09-19T06:38:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d927640 1 -- 172.21.15.12:0/1835272131 learned_addr learned my addr 172.21.15.12:0/1835272131 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39e128640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb398106f10 0x7fb39819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d927640 1 -- 172.21.15.12:0/1835272131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb398106f10 msgr2=0x7fb39819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d927640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb398106f10 0x7fb39819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d927640 1 -- 172.21.15.12:0/1835272131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb398102790 msgr2=0x7fb3981988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d126640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb398102790 0x7fb3981988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d927640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb398102790 0x7fb3981988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d927640 1 -- 172.21.15.12:0/1835272131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39819d360 con 0x7fb398101de0 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39e128640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb398106f10 0x7fb39819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d126640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb398102790 0x7fb3981988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.104+0000 7fb39d927640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb398101de0 0x7fb3981983b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb39400d950 tx=0x7fb39400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.105+0000 7fb38effd640 1 -- 172.21.15.12:0/1835272131 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb394017070 con 0x7fb398101de0 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.105+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1835272131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb39819d650 con 0x7fb398101de0 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.105+0000 7fb38effd640 1 -- 172.21.15.12:0/1835272131 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb394009c30 con 0x7fb398101de0 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.105+0000 7fb38effd640 1 -- 172.21.15.12:0/1835272131 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39400f6b0 con 0x7fb398101de0 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.105+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1835272131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3981a4f30 con 0x7fb398101de0 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.106+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1835272131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3981021c0 con 0x7fb398101de0 2024-09-19T06:38:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.107+0000 7fb38effd640 1 -- 172.21.15.12:0/1835272131 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb3940109d0 con 0x7fb398101de0 2024-09-19T06:38:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.108+0000 7fb38effd640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb3840a3240 0x7fb3840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.108+0000 7fb39d126640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb3840a3240 0x7fb3840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.108+0000 7fb38effd640 1 -- 172.21.15.12:0/1835272131 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fb3940cf650 con 0x7fb398101de0 2024-09-19T06:38:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.108+0000 7fb39d126640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb3840a3240 0x7fb3840a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb388005fd0 tx=0x7fb3880094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.112+0000 7fb38effd640 1 -- 172.21.15.12:0/1835272131 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb394009de0 con 0x7fb398101de0 2024-09-19T06:38:28.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.312+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1835272131 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb398062630 con 0x7fb3840a3240 2024-09-19T06:38:28.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.342+0000 7fb38effd640 1 -- 172.21.15.12:0/1835272131 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb398062630 con 0x7fb3840a3240 2024-09-19T06:38:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1835272131 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb3840a3240 msgr2=0x7fb3840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb3840a3240 0x7fb3840a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb388005fd0 tx=0x7fb3880094d0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1835272131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb398101de0 msgr2=0x7fb3981983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb398101de0 0x7fb3981983b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb39400d950 tx=0x7fb39400de10 comp rx=0 tx=0).stop 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1835272131 shutdown_connections 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb3840a3240 0x7fb3840a5700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb398106f10 0x7fb39819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb398102790 0x7fb3981988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 --2- 172.21.15.12:0/1835272131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb398101de0 0x7fb3981983b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1835272131 >> 172.21.15.12:0/1835272131 conn(0x7fb3980fd8c0 msgr2=0x7fb3980fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.344+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1835272131 shutdown_connections 2024-09-19T06:38:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:28.345+0000 7fb39fb8b640 1 -- 172.21.15.12:0/1835272131 wait complete. 2024-09-19T06:38:28.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:38:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:38:28.317+0000 7f94c73be640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:38:28.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:38:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:38:28.317+0000 7f94c73be640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:38:28.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:38:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:38:28.317+0000 7f94c73be640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:38:28.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:38:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:38:28.317+0000 7f94c73be640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:38:28.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:38:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:38:28.317+0000 7f94c73be640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:38:29.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T06:38:29.008 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:38:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: 2024-09-19T06:38:28.655+0000 7f466b756640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-19T06:38:29.257 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.753+0000 7fb8c5303640 1 -- 172.21.15.12:0/3970826717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c0102d40 msgr2=0x7fb8c0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.753+0000 7fb8c5303640 1 --2- 172.21.15.12:0/3970826717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c0102d40 0x7fb8c0103120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009900 tx=0x7fb8b002a480 comp rx=0 tx=0).stop 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.753+0000 7fb8c5303640 1 -- 172.21.15.12:0/3970826717 shutdown_connections 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.753+0000 7fb8c5303640 1 --2- 172.21.15.12:0/3970826717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c010c170 0x7fb8c010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.753+0000 7fb8c5303640 1 --2- 172.21.15.12:0/3970826717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8c0103660 0x7fb8c010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.753+0000 7fb8c5303640 1 --2- 172.21.15.12:0/3970826717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c0102d40 0x7fb8c0103120 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.753+0000 7fb8c5303640 1 -- 172.21.15.12:0/3970826717 >> 172.21.15.12:0/3970826717 conn(0x7fb8c00fc7a0 msgr2=0x7fb8c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.753+0000 7fb8c5303640 1 -- 172.21.15.12:0/3970826717 shutdown_connections 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.753+0000 7fb8c5303640 1 -- 172.21.15.12:0/3970826717 wait complete. 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.754+0000 7fb8c5303640 1 Processor -- start 2024-09-19T06:38:29.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.754+0000 7fb8c5303640 1 -- start start 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.754+0000 7fb8c5303640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c0102d40 0x7fb8c01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.754+0000 7fb8c5303640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c0103660 0x7fb8c01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.754+0000 7fb8c5303640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8c010c170 0x7fb8c019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.754+0000 7fb8c5303640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0111fd0 con 0x7fb8c0102d40 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.754+0000 7fb8c5303640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0111e50 con 0x7fb8c0103660 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.754+0000 7fb8c5303640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0112150 con 0x7fb8c010c170 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8beffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c0102d40 0x7fb8c01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8beffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c0102d40 0x7fb8c01984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54690/0 (socket says 172.21.15.12:54690) 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8beffd640 1 -- 172.21.15.12:0/3724268548 learned_addr learned my addr 172.21.15.12:0/3724268548 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8bf7fe640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8c010c170 0x7fb8c019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8be7fc640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c0103660 0x7fb8c01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8beffd640 1 -- 172.21.15.12:0/3724268548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8c010c170 msgr2=0x7fb8c019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:29.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8beffd640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8c010c170 0x7fb8c019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8beffd640 1 -- 172.21.15.12:0/3724268548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c0103660 msgr2=0x7fb8c01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8beffd640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c0103660 0x7fb8c01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8beffd640 1 -- 172.21.15.12:0/3724268548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c019d460 con 0x7fb8c0102d40 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8be7fc640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c0103660 0x7fb8c01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8beffd640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c0102d40 0x7fb8c01984b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005ab0 tx=0x7fb8b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8a7fff640 1 -- 172.21.15.12:0/3724268548 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b003f030 con 0x7fb8c0102d40 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8c5303640 1 -- 172.21.15.12:0/3724268548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c019d6f0 con 0x7fb8c0102d40 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8a7fff640 1 -- 172.21.15.12:0/3724268548 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8b0003ce0 con 0x7fb8c0102d40 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8a7fff640 1 -- 172.21.15.12:0/3724268548 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0035070 con 0x7fb8c0102d40 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.755+0000 7fb8c5303640 1 -- 172.21.15.12:0/3724268548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c01a5030 con 0x7fb8c0102d40 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.757+0000 7fb8c5303640 1 -- 172.21.15.12:0/3724268548 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c0103120 con 0x7fb8c0102d40 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.758+0000 7fb8a7fff640 1 -- 172.21.15.12:0/3724268548 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb8b0042030 con 0x7fb8c0102d40 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.758+0000 7fb8a7fff640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb8a80a3240 0x7fb8a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:29.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.758+0000 7fb8be7fc640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb8a80a3240 0x7fb8a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:29.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.758+0000 7fb8a7fff640 1 -- 172.21.15.12:0/3724268548 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fb8b00f02b0 con 0x7fb8c0102d40 2024-09-19T06:38:29.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.759+0000 7fb8be7fc640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb8a80a3240 0x7fb8a80a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00fed30 tx=0x7fb8b4005dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:29.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.763+0000 7fb8a7fff640 1 -- 172.21.15.12:0/3724268548 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8b00bcfb0 con 0x7fb8c0102d40 2024-09-19T06:38:29.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.965+0000 7fb8c5303640 1 -- 172.21.15.12:0/3724268548 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb8c0062630 con 0x7fb8a80a3240 2024-09-19T06:38:29.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:29 smithi012 ceph-mon[30937]: pgmap v286: 97 pgs: 1 activating, 96 active+clean; 582 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.1 KiB/s wr, 14 op/s; 274 B/s, 0 objects/s recovering 2024-09-19T06:38:29.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:29 smithi012 ceph-mon[30937]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:29.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.993+0000 7fb8a7fff640 1 -- 172.21.15.12:0/3724268548 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb8c0062630 con 0x7fb8a80a3240 2024-09-19T06:38:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 -- 172.21.15.12:0/3724268548 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb8a80a3240 msgr2=0x7fb8a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb8a80a3240 0x7fb8a80a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00fed30 tx=0x7fb8b4005dd0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 -- 172.21.15.12:0/3724268548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c0102d40 msgr2=0x7fb8c01984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c0102d40 0x7fb8c01984b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005ab0 tx=0x7fb8b00042f0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 -- 172.21.15.12:0/3724268548 shutdown_connections 2024-09-19T06:38:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb8a80a3240 0x7fb8a80a5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8c010c170 0x7fb8c019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8c0103660 0x7fb8c01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 --2- 172.21.15.12:0/3724268548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c0102d40 0x7fb8c01984b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:29.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 -- 172.21.15.12:0/3724268548 >> 172.21.15.12:0/3724268548 conn(0x7fb8c00fc7a0 msgr2=0x7fb8c00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:29.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.995+0000 7fb8c5303640 1 -- 172.21.15.12:0/3724268548 shutdown_connections 2024-09-19T06:38:29.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:29.996+0000 7fb8c5303640 1 -- 172.21.15.12:0/3724268548 wait complete. 2024-09-19T06:38:30.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:29 smithi016 ceph-mon[34911]: pgmap v286: 97 pgs: 1 activating, 96 active+clean; 582 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.1 KiB/s wr, 14 op/s; 274 B/s, 0 objects/s recovering 2024-09-19T06:38:30.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:29 smithi016 ceph-mon[34911]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:30.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:29 smithi173 ceph-mon[35349]: pgmap v286: 97 pgs: 1 activating, 96 active+clean; 582 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.1 KiB/s wr, 14 op/s; 274 B/s, 0 objects/s recovering 2024-09-19T06:38:30.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:29 smithi173 ceph-mon[35349]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:30.719 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T06:38:30.974 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:31.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.435+0000 7f77e208d640 1 -- 172.21.15.12:0/3703954147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77dc102d30 msgr2=0x7f77dc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:31.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.435+0000 7f77e208d640 1 --2- 172.21.15.12:0/3703954147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77dc102d30 0x7f77dc103110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009cd0 tx=0x7f77cc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.435+0000 7f77e208d640 1 -- 172.21.15.12:0/3703954147 shutdown_connections 2024-09-19T06:38:31.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.435+0000 7f77e208d640 1 --2- 172.21.15.12:0/3703954147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77dc1082a0 0x7f77dc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.435+0000 7f77e208d640 1 --2- 172.21.15.12:0/3703954147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77dc1036e0 0x7f77dc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.435+0000 7f77e208d640 1 --2- 172.21.15.12:0/3703954147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77dc102d30 0x7f77dc103110 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.435+0000 7f77e208d640 1 -- 172.21.15.12:0/3703954147 >> 172.21.15.12:0/3703954147 conn(0x7f77dc0fc7d0 msgr2=0x7f77dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.435+0000 7f77e208d640 1 -- 172.21.15.12:0/3703954147 shutdown_connections 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.435+0000 7f77e208d640 1 -- 172.21.15.12:0/3703954147 wait complete. 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77e208d640 1 Processor -- start 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77e208d640 1 -- start start 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77e208d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77dc102d30 0x7f77dc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77e208d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77dc1036e0 0x7f77dc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77e208d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77dc1082a0 0x7f77dc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77e208d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1120a0 con 0x7f77dc1082a0 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77e208d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc111f20 con 0x7f77dc1036e0 2024-09-19T06:38:31.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77e208d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc112220 con 0x7f77dc102d30 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77dbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77dc1082a0 0x7f77dc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77dbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77dc1082a0 0x7f77dc101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56362/0 (socket says 172.21.15.12:56362) 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77dbfff640 1 -- 172.21.15.12:0/1877463221 learned_addr learned my addr 172.21.15.12:0/1877463221 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77db7fe640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77dc102d30 0x7f77dc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.436+0000 7f77daffd640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77dc1036e0 0x7f77dc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77dbfff640 1 -- 172.21.15.12:0/1877463221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77dc102d30 msgr2=0x7f77dc100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77dbfff640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77dc102d30 0x7f77dc100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77dbfff640 1 -- 172.21.15.12:0/1877463221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77dc1036e0 msgr2=0x7f77dc100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77dbfff640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77dc1036e0 0x7f77dc100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77dbfff640 1 -- 172.21.15.12:0/1877463221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc1a6a80 con 0x7f77dc1082a0 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77daffd640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77dc1036e0 0x7f77dc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77dbfff640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77dc1082a0 0x7f77dc101410 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f77d400d750 tx=0x7f77d400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:31.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77d8ff9640 1 -- 172.21.15.12:0/1877463221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4017070 con 0x7f77dc1082a0 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77e208d640 1 -- 172.21.15.12:0/1877463221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77dc1a6d70 con 0x7f77dc1082a0 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77d8ff9640 1 -- 172.21.15.12:0/1877463221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77d4005500 con 0x7f77dc1082a0 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77d8ff9640 1 -- 172.21.15.12:0/1877463221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4004d90 con 0x7f77dc1082a0 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.437+0000 7f77e208d640 1 -- 172.21.15.12:0/1877463221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77dc1a72b0 con 0x7f77dc1082a0 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.438+0000 7f77e208d640 1 -- 172.21.15.12:0/1877463221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77dc06a850 con 0x7f77dc1082a0 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.439+0000 7f77d8ff9640 1 -- 172.21.15.12:0/1877463221 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f77d4004f30 con 0x7f77dc1082a0 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.440+0000 7f77d8ff9640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f77c40a32d0 0x7f77c40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.440+0000 7f77db7fe640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f77c40a32d0 0x7f77c40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.440+0000 7f77d8ff9640 1 -- 172.21.15.12:0/1877463221 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f77d40cf470 con 0x7f77dc1082a0 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.440+0000 7f77db7fe640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f77c40a32d0 0x7f77c40a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77cc006010 tx=0x7f77cc0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:31.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.444+0000 7f77d8ff9640 1 -- 172.21.15.12:0/1877463221 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f77d409c010 con 0x7f77dc1082a0 2024-09-19T06:38:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.649+0000 7f77e208d640 1 -- 172.21.15.12:0/1877463221 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f77dc062630 con 0x7f77c40a32d0 2024-09-19T06:38:31.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.653+0000 7f77d8ff9640 1 -- 172.21.15.12:0/1877463221 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f77dc062630 con 0x7f77c40a32d0 2024-09-19T06:38:31.655 INFO:teuthology.orchestra.run.smithi012.stdout:/volumes/qa/sv_0/b1f6ccd3-1861-4696-8aaa-41b2e79e43e9 2024-09-19T06:38:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.655+0000 7f77e208d640 1 -- 172.21.15.12:0/1877463221 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f77c40a32d0 msgr2=0x7f77c40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:31.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.655+0000 7f77e208d640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f77c40a32d0 0x7f77c40a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77cc006010 tx=0x7f77cc0093f0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.655+0000 7f77e208d640 1 -- 172.21.15.12:0/1877463221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77dc1082a0 msgr2=0x7f77dc101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.655+0000 7f77e208d640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77dc1082a0 0x7f77dc101410 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f77d400d750 tx=0x7f77d400dc10 comp rx=0 tx=0).stop 2024-09-19T06:38:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.655+0000 7f77e208d640 1 -- 172.21.15.12:0/1877463221 shutdown_connections 2024-09-19T06:38:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.655+0000 7f77e208d640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f77c40a32d0 0x7f77c40a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.655+0000 7f77e208d640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77dc1082a0 0x7f77dc101410 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.655+0000 7f77e208d640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77dc1036e0 0x7f77dc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.655+0000 7f77e208d640 1 --2- 172.21.15.12:0/1877463221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77dc102d30 0x7f77dc100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.655+0000 7f77e208d640 1 -- 172.21.15.12:0/1877463221 >> 172.21.15.12:0/1877463221 conn(0x7f77dc0fc7d0 msgr2=0x7f77dc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:31.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.656+0000 7f77e208d640 1 -- 172.21.15.12:0/1877463221 shutdown_connections 2024-09-19T06:38:31.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:31.656+0000 7f77e208d640 1 -- 172.21.15.12:0/1877463221 wait complete. 2024-09-19T06:38:31.961 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:31 smithi012 ceph-mon[30937]: pgmap v287: 97 pgs: 97 active+clean; 585 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.1 KiB/s wr, 24 op/s; 274 B/s, 0 objects/s recovering 2024-09-19T06:38:31.961 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:31 smithi012 ceph-mon[30937]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:31.961 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:31 smithi012 ceph-mon[30937]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:38:32.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:31 smithi016 ceph-mon[34911]: pgmap v287: 97 pgs: 97 active+clean; 585 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.1 KiB/s wr, 24 op/s; 274 B/s, 0 objects/s recovering 2024-09-19T06:38:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:31 smithi016 ceph-mon[34911]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:32.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:31 smithi016 ceph-mon[34911]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:38:32.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:31 smithi173 ceph-mon[35349]: pgmap v287: 97 pgs: 97 active+clean; 585 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.1 KiB/s wr, 24 op/s; 274 B/s, 0 objects/s recovering 2024-09-19T06:38:32.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:31 smithi173 ceph-mon[35349]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:32.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:31 smithi173 ceph-mon[35349]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:38:32.333 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T06:38:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:32.982 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:32 smithi012 ceph-mon[30937]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:32.983 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:32 smithi012 ceph-mon[30937]: pgmap v288: 97 pgs: 97 active+clean; 606 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.9 KiB/s wr, 26 op/s; 227 B/s, 0 objects/s recovering 2024-09-19T06:38:33.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:32 smithi016 ceph-mon[34911]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:33.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:32 smithi016 ceph-mon[34911]: pgmap v288: 97 pgs: 97 active+clean; 606 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.9 KiB/s wr, 26 op/s; 227 B/s, 0 objects/s recovering 2024-09-19T06:38:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.068+0000 7f857d86f640 1 -- 172.21.15.12:0/3485360404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8578102790 msgr2=0x7f85781067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.068+0000 7f857d86f640 1 --2- 172.21.15.12:0/3485360404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8578102790 0x7f85781067e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f856c009900 tx=0x7f856c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.068+0000 7f857d86f640 1 -- 172.21.15.12:0/3485360404 shutdown_connections 2024-09-19T06:38:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.068+0000 7f857d86f640 1 --2- 172.21.15.12:0/3485360404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8578106f10 0x7f857810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.068+0000 7f857d86f640 1 --2- 172.21.15.12:0/3485360404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8578102790 0x7f85781067e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.068+0000 7f857d86f640 1 --2- 172.21.15.12:0/3485360404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8578101de0 0x7f85781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.068+0000 7f857d86f640 1 -- 172.21.15.12:0/3485360404 >> 172.21.15.12:0/3485360404 conn(0x7f85780fd8c0 msgr2=0x7f85780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.068+0000 7f857d86f640 1 -- 172.21.15.12:0/3485360404 shutdown_connections 2024-09-19T06:38:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.068+0000 7f857d86f640 1 -- 172.21.15.12:0/3485360404 wait complete. 2024-09-19T06:38:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f857d86f640 1 Processor -- start 2024-09-19T06:38:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f857d86f640 1 -- start start 2024-09-19T06:38:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f857d86f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8578101de0 0x7f8578198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f857d86f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8578102790 0x7f8578198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f857d86f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8578106f10 0x7f857819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f857d86f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8578111f90 con 0x7f8578102790 2024-09-19T06:38:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f857d86f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8578111e10 con 0x7f8578101de0 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f857d86f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8578112110 con 0x7f8578106f10 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f85767fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8578102790 0x7f8578198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f85767fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8578102790 0x7f8578198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56378/0 (socket says 172.21.15.12:56378) 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.069+0000 7f85767fc640 1 -- 172.21.15.12:0/3690606630 learned_addr learned my addr 172.21.15.12:0/3690606630 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f85777fe640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8578106f10 0x7f857819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f8576ffd640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8578101de0 0x7f8578198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f85767fc640 1 -- 172.21.15.12:0/3690606630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8578106f10 msgr2=0x7f857819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f85767fc640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8578106f10 0x7f857819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f85767fc640 1 -- 172.21.15.12:0/3690606630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8578101de0 msgr2=0x7f8578198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f85767fc640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8578101de0 0x7f8578198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f85767fc640 1 -- 172.21.15.12:0/3690606630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857819d3c0 con 0x7f8578102790 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f85767fc640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8578102790 0x7f8578198950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f856c005ab0 tx=0x7f856c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f857c86d640 1 -- 172.21.15.12:0/3690606630 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c03f030 con 0x7f8578102790 2024-09-19T06:38:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f857d86f640 1 -- 172.21.15.12:0/3690606630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857819d650 con 0x7f8578102790 2024-09-19T06:38:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f857c86d640 1 -- 172.21.15.12:0/3690606630 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f856c003ce0 con 0x7f8578102790 2024-09-19T06:38:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f857c86d640 1 -- 172.21.15.12:0/3690606630 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c035070 con 0x7f8578102790 2024-09-19T06:38:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.070+0000 7f857d86f640 1 -- 172.21.15.12:0/3690606630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85781a4f90 con 0x7f8578102790 2024-09-19T06:38:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.071+0000 7f857d86f640 1 -- 172.21.15.12:0/3690606630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85781032c0 con 0x7f8578102790 2024-09-19T06:38:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.072+0000 7f857c86d640 1 -- 172.21.15.12:0/3690606630 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f856c042030 con 0x7f8578102790 2024-09-19T06:38:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.073+0000 7f857c86d640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f85600a32d0 0x7f85600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.073+0000 7f8576ffd640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f85600a32d0 0x7f85600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.073+0000 7f857c86d640 1 -- 172.21.15.12:0/3690606630 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f856c0f00e0 con 0x7f8578102790 2024-09-19T06:38:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.074+0000 7f8576ffd640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f85600a32d0 0x7f85600a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f856800a810 tx=0x7f8568008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.078+0000 7f857c86d640 1 -- 172.21.15.12:0/3690606630 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f856c0bcc80 con 0x7f8578102790 2024-09-19T06:38:33.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:32 smithi173 ceph-mon[35349]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:33.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:32 smithi173 ceph-mon[35349]: pgmap v288: 97 pgs: 97 active+clean; 606 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.9 KiB/s wr, 26 op/s; 227 B/s, 0 objects/s recovering 2024-09-19T06:38:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.284+0000 7f857d86f640 1 -- 172.21.15.12:0/3690606630 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8578062630 con 0x7f85600a32d0 2024-09-19T06:38:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.309+0000 7f857c86d640 1 -- 172.21.15.12:0/3690606630 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8578062630 con 0x7f85600a32d0 2024-09-19T06:38:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 -- 172.21.15.12:0/3690606630 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f85600a32d0 msgr2=0x7f85600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f85600a32d0 0x7f85600a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f856800a810 tx=0x7f8568008040 comp rx=0 tx=0).stop 2024-09-19T06:38:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 -- 172.21.15.12:0/3690606630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8578102790 msgr2=0x7f8578198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8578102790 0x7f8578198950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f856c005ab0 tx=0x7f856c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 -- 172.21.15.12:0/3690606630 shutdown_connections 2024-09-19T06:38:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f85600a32d0 0x7f85600a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8578106f10 0x7f857819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8578102790 0x7f8578198950 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 --2- 172.21.15.12:0/3690606630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8578101de0 0x7f8578198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 -- 172.21.15.12:0/3690606630 >> 172.21.15.12:0/3690606630 conn(0x7f85780fd8c0 msgr2=0x7f85780fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 -- 172.21.15.12:0/3690606630 shutdown_connections 2024-09-19T06:38:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:33.312+0000 7f857d86f640 1 -- 172.21.15.12:0/3690606630 wait complete. 2024-09-19T06:38:33.984 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:33 smithi173 ceph-mon[35349]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:33.986 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:33 smithi012 ceph-mon[30937]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:34.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:33 smithi016 ceph-mon[34911]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:34.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T06:38:34.271 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:34.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.744+0000 7f2b4685e640 1 -- 172.21.15.12:0/2215875594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b401027a0 msgr2=0x7f2b401067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:34.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.744+0000 7f2b4685e640 1 --2- 172.21.15.12:0/2215875594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b401027a0 0x7f2b401067f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009900 tx=0x7f2b3402a410 comp rx=0 tx=0).stop 2024-09-19T06:38:34.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.744+0000 7f2b4685e640 1 -- 172.21.15.12:0/2215875594 shutdown_connections 2024-09-19T06:38:34.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.744+0000 7f2b4685e640 1 --2- 172.21.15.12:0/2215875594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b40106f20 0x7f2b4010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.744+0000 7f2b4685e640 1 --2- 172.21.15.12:0/2215875594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b401027a0 0x7f2b401067f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.744+0000 7f2b4685e640 1 --2- 172.21.15.12:0/2215875594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b40101df0 0x7f2b401021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.744+0000 7f2b4685e640 1 -- 172.21.15.12:0/2215875594 >> 172.21.15.12:0/2215875594 conn(0x7f2b400fd8b0 msgr2=0x7f2b400ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.744+0000 7f2b4685e640 1 -- 172.21.15.12:0/2215875594 shutdown_connections 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.744+0000 7f2b4685e640 1 -- 172.21.15.12:0/2215875594 wait complete. 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b4685e640 1 Processor -- start 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b4685e640 1 -- start start 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b4685e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b40101df0 0x7f2b40198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b4685e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b401027a0 0x7f2b40198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b4685e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40106f20 0x7f2b4019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b4685e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2b40111f80 con 0x7f2b40106f20 2024-09-19T06:38:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b4685e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2b40111e00 con 0x7f2b401027a0 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b4685e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2b40112100 con 0x7f2b40101df0 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b3ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b40101df0 0x7f2b40198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b44dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40106f20 0x7f2b4019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b3ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b40101df0 0x7f2b40198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:38250/0 (socket says 172.21.15.12:38250) 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b3ffff640 1 -- 172.21.15.12:0/1726555137 learned_addr learned my addr 172.21.15.12:0/1726555137 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.745+0000 7f2b3f7fe640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b401027a0 0x7f2b40198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b3ffff640 1 -- 172.21.15.12:0/1726555137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b401027a0 msgr2=0x7f2b40198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b3ffff640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b401027a0 0x7f2b40198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b3ffff640 1 -- 172.21.15.12:0/1726555137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40106f20 msgr2=0x7f2b4019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b3ffff640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40106f20 0x7f2b4019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b3ffff640 1 -- 172.21.15.12:0/1726555137 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4019d3d0 con 0x7f2b40101df0 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b44dfb640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40106f20 0x7f2b4019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:38:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b3ffff640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b40101df0 0x7f2b40198420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000e9f0 tx=0x7f2b3000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b3d7fa640 1 -- 172.21.15.12:0/1726555137 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3000cd80 con 0x7f2b40101df0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b3d7fa640 1 -- 172.21.15.12:0/1726555137 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b30005500 con 0x7f2b40101df0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b4685e640 1 -- 172.21.15.12:0/1726555137 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4019d6c0 con 0x7f2b40101df0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b3d7fa640 1 -- 172.21.15.12:0/1726555137 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b30010690 con 0x7f2b40101df0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.746+0000 7f2b4685e640 1 -- 172.21.15.12:0/1726555137 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b401a4fa0 con 0x7f2b40101df0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.747+0000 7f2b4685e640 1 -- 172.21.15.12:0/1726555137 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b401021d0 con 0x7f2b40101df0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.748+0000 7f2b3d7fa640 1 -- 172.21.15.12:0/1726555137 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2b300046c0 con 0x7f2b40101df0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.749+0000 7f2b3d7fa640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2b280a3350 0x7f2b280a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.749+0000 7f2b3d7fa640 1 -- 172.21.15.12:0/1726555137 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f2b300cfea0 con 0x7f2b40101df0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.749+0000 7f2b3f7fe640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2b280a3350 0x7f2b280a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.749+0000 7f2b3f7fe640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2b280a3350 0x7f2b280a5810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009230 tx=0x7f2b340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.753+0000 7f2b3d7fa640 1 -- 172.21.15.12:0/1726555137 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b3009c9e0 con 0x7f2b40101df0 2024-09-19T06:38:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.955+0000 7f2b4685e640 1 -- 172.21.15.12:0/1726555137 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f2b4010a130 con 0x7f2b280a3350 2024-09-19T06:38:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.960+0000 7f2b3d7fa640 1 -- 172.21.15.12:0/1726555137 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2b4010a130 con 0x7f2b280a3350 2024-09-19T06:38:34.961 INFO:teuthology.orchestra.run.smithi012.stdout:/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 2024-09-19T06:38:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 -- 172.21.15.12:0/1726555137 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2b280a3350 msgr2=0x7f2b280a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2b280a3350 0x7f2b280a5810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009230 tx=0x7f2b340058d0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 -- 172.21.15.12:0/1726555137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b40101df0 msgr2=0x7f2b40198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b40101df0 0x7f2b40198420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000e9f0 tx=0x7f2b3000edf0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 -- 172.21.15.12:0/1726555137 shutdown_connections 2024-09-19T06:38:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2b280a3350 0x7f2b280a5810 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b40106f20 0x7f2b4019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b401027a0 0x7f2b40198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 --2- 172.21.15.12:0/1726555137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b40101df0 0x7f2b40198420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 -- 172.21.15.12:0/1726555137 >> 172.21.15.12:0/1726555137 conn(0x7f2b400fd8b0 msgr2=0x7f2b400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 -- 172.21.15.12:0/1726555137 shutdown_connections 2024-09-19T06:38:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:34.962+0000 7f2b4685e640 1 -- 172.21.15.12:0/1726555137 wait complete. 2024-09-19T06:38:35.739 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:35 smithi012 ceph-mon[30937]: pgmap v289: 97 pgs: 97 active+clean; 606 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.1 KiB/s wr, 24 op/s; 206 B/s, 0 objects/s recovering 2024-09-19T06:38:35.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:38:36.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:35 smithi016 ceph-mon[34911]: pgmap v289: 97 pgs: 97 active+clean; 606 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.1 KiB/s wr, 24 op/s; 206 B/s, 0 objects/s recovering 2024-09-19T06:38:36.034 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:36.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:35 smithi173 ceph-mon[35349]: pgmap v289: 97 pgs: 97 active+clean; 606 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.1 KiB/s wr, 24 op/s; 206 B/s, 0 objects/s recovering 2024-09-19T06:38:36.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.495+0000 7fa8a727a640 1 -- 172.21.15.12:0/3780724559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8a0102790 msgr2=0x7fa8a01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.495+0000 7fa8a727a640 1 --2- 172.21.15.12:0/3780724559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8a0102790 0x7fa8a01067e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa894009900 tx=0x7fa89402a410 comp rx=0 tx=0).stop 2024-09-19T06:38:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.495+0000 7fa8a727a640 1 -- 172.21.15.12:0/3780724559 shutdown_connections 2024-09-19T06:38:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.495+0000 7fa8a727a640 1 --2- 172.21.15.12:0/3780724559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8a0106f10 0x7fa8a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.495+0000 7fa8a727a640 1 --2- 172.21.15.12:0/3780724559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8a0102790 0x7fa8a01067e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.495+0000 7fa8a727a640 1 --2- 172.21.15.12:0/3780724559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8a0101de0 0x7fa8a01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.495+0000 7fa8a727a640 1 -- 172.21.15.12:0/3780724559 >> 172.21.15.12:0/3780724559 conn(0x7fa8a00fd8c0 msgr2=0x7fa8a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.495+0000 7fa8a727a640 1 -- 172.21.15.12:0/3780724559 shutdown_connections 2024-09-19T06:38:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.495+0000 7fa8a727a640 1 -- 172.21.15.12:0/3780724559 wait complete. 2024-09-19T06:38:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a727a640 1 Processor -- start 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a727a640 1 -- start start 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a727a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8a0101de0 0x7fa8a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a727a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8a0102790 0x7fa8a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a727a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8a0106f10 0x7fa8a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a727a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a0112010 con 0x7fa8a0106f10 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a727a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a0111e90 con 0x7fa8a0101de0 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a727a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a0112190 con 0x7fa8a0102790 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a5817640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8a0106f10 0x7fa8a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a5817640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8a0106f10 0x7fa8a0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56424/0 (socket says 172.21.15.12:56424) 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a5817640 1 -- 172.21.15.12:0/3400975937 learned_addr learned my addr 172.21.15.12:0/3400975937 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a5016640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8a0101de0 0x7fa8a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a4815640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8a0102790 0x7fa8a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a5817640 1 -- 172.21.15.12:0/3400975937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8a0102790 msgr2=0x7fa8a0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a5817640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8a0102790 0x7fa8a0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a5817640 1 -- 172.21.15.12:0/3400975937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8a0101de0 msgr2=0x7fa8a00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a5817640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8a0101de0 0x7fa8a00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a5817640 1 -- 172.21.15.12:0/3400975937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a01a6a70 con 0x7fa8a0106f10 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.496+0000 7fa8a5016640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8a0101de0 0x7fa8a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.497+0000 7fa8a5817640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8a0106f10 0x7fa8a0074f70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa898009fd0 tx=0x7fa89800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.497+0000 7fa89e7fc640 1 -- 172.21.15.12:0/3400975937 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa898011830 con 0x7fa8a0106f10 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.497+0000 7fa8a727a640 1 -- 172.21.15.12:0/3400975937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a01a6d60 con 0x7fa8a0106f10 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.497+0000 7fa89e7fc640 1 -- 172.21.15.12:0/3400975937 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa898016070 con 0x7fa8a0106f10 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.497+0000 7fa89e7fc640 1 -- 172.21.15.12:0/3400975937 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89800f2e0 con 0x7fa8a0106f10 2024-09-19T06:38:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.497+0000 7fa8a727a640 1 -- 172.21.15.12:0/3400975937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a01a7250 con 0x7fa8a0106f10 2024-09-19T06:38:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.498+0000 7fa887fff640 1 -- 172.21.15.12:0/3400975937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a0102240 con 0x7fa8a0106f10 2024-09-19T06:38:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.499+0000 7fa89e7fc640 1 -- 172.21.15.12:0/3400975937 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa8980119d0 con 0x7fa8a0106f10 2024-09-19T06:38:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.500+0000 7fa89e7fc640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa8880a32d0 0x7fa8880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.500+0000 7fa8a5016640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa8880a32d0 0x7fa8880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.500+0000 7fa89e7fc640 1 -- 172.21.15.12:0/3400975937 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fa8980cf170 con 0x7fa8a0106f10 2024-09-19T06:38:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.500+0000 7fa8a5016640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa8880a32d0 0x7fa8880a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa890009fa0 tx=0x7fa890009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:36.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.504+0000 7fa89e7fc640 1 -- 172.21.15.12:0/3400975937 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa89809bdc0 con 0x7fa8a0106f10 2024-09-19T06:38:36.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.714+0000 7fa887fff640 1 -- 172.21.15.12:0/3400975937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8a0062df0 con 0x7fa8a0106f10 2024-09-19T06:38:36.716 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:36 smithi012 ceph-mon[30937]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:36.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.715+0000 7fa89e7fc640 1 -- 172.21.15.12:0/3400975937 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11971 (secure 0 0 0) 0x7fa89809b6c0 con 0x7fa8a0106f10 2024-09-19T06:38:36.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:36.717 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-19T06:38:26:674546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:38:26.674520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:38:36.717 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.717+0000 7fa887fff640 1 -- 172.21.15.12:0/3400975937 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa8880a32d0 msgr2=0x7fa8880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.717+0000 7fa887fff640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa8880a32d0 0x7fa8880a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa890009fa0 tx=0x7fa890009570 comp rx=0 tx=0).stop 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.717+0000 7fa887fff640 1 -- 172.21.15.12:0/3400975937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8a0106f10 msgr2=0x7fa8a0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.717+0000 7fa887fff640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8a0106f10 0x7fa8a0074f70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa898009fd0 tx=0x7fa89800b8e0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.717+0000 7fa887fff640 1 -- 172.21.15.12:0/3400975937 shutdown_connections 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.717+0000 7fa887fff640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa8880a32d0 0x7fa8880a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.717+0000 7fa887fff640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8a0106f10 0x7fa8a0074f70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.717+0000 7fa887fff640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa8a0102790 0x7fa8a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.718+0000 7fa887fff640 1 --2- 172.21.15.12:0/3400975937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8a0101de0 0x7fa8a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.718+0000 7fa887fff640 1 -- 172.21.15.12:0/3400975937 >> 172.21.15.12:0/3400975937 conn(0x7fa8a00fd8c0 msgr2=0x7fa8a00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:36.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.718+0000 7fa887fff640 1 -- 172.21.15.12:0/3400975937 shutdown_connections 2024-09-19T06:38:36.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:36.718+0000 7fa887fff640 1 -- 172.21.15.12:0/3400975937 wait complete. 2024-09-19T06:38:37.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:36 smithi016 ceph-mon[34911]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:37.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:36 smithi173 ceph-mon[35349]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:37.514 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:38:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:37.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:37 smithi012 ceph-mon[30937]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 25 op/s; 182 B/s, 0 objects/s recovering 2024-09-19T06:38:37.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:37 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3400975937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:38.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:37 smithi016 ceph-mon[34911]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 25 op/s; 182 B/s, 0 objects/s recovering 2024-09-19T06:38:38.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:37 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3400975937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:38.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:37 smithi173 ceph-mon[35349]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 25 op/s; 182 B/s, 0 objects/s recovering 2024-09-19T06:38:38.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:37 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3400975937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.245+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1541528512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6c4106a80 msgr2=0x7fd6c4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.245+0000 7fd6c89d4640 1 --2- 172.21.15.12:0/1541528512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6c4106a80 0x7fd6c4106e60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009930 tx=0x7fd6b402a420 comp rx=0 tx=0).stop 2024-09-19T06:38:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.245+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1541528512 shutdown_connections 2024-09-19T06:38:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.245+0000 7fd6c89d4640 1 --2- 172.21.15.12:0/1541528512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6c4101420 0x7fd6c410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.245+0000 7fd6c89d4640 1 --2- 172.21.15.12:0/1541528512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6c4100a80 0x7fd6c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.245+0000 7fd6c89d4640 1 --2- 172.21.15.12:0/1541528512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6c4106a80 0x7fd6c4106e60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.245+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1541528512 >> 172.21.15.12:0/1541528512 conn(0x7fd6c40fc7a0 msgr2=0x7fd6c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.245+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1541528512 shutdown_connections 2024-09-19T06:38:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.245+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1541528512 wait complete. 2024-09-19T06:38:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c89d4640 1 Processor -- start 2024-09-19T06:38:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c89d4640 1 -- start start 2024-09-19T06:38:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c89d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6c4100a80 0x7fd6c41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c89d4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6c4101420 0x7fd6c41989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c89d4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6c4106a80 0x7fd6c419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c89d4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c4111fa0 con 0x7fd6c4100a80 2024-09-19T06:38:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c89d4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c4111e20 con 0x7fd6c4106a80 2024-09-19T06:38:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c89d4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c4112120 con 0x7fd6c4101420 2024-09-19T06:38:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6c4100a80 0x7fd6c41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6c4100a80 0x7fd6c41984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56436/0 (socket says 172.21.15.12:56436) 2024-09-19T06:38:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.246+0000 7fd6c259c640 1 -- 172.21.15.12:0/1586611159 learned_addr learned my addr 172.21.15.12:0/1586611159 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c2d9d640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6c4106a80 0x7fd6c419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c1d9b640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6c4101420 0x7fd6c41989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c259c640 1 -- 172.21.15.12:0/1586611159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6c4101420 msgr2=0x7fd6c41989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c259c640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6c4101420 0x7fd6c41989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c259c640 1 -- 172.21.15.12:0/1586611159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6c4106a80 msgr2=0x7fd6c419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c259c640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6c4106a80 0x7fd6c419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c259c640 1 -- 172.21.15.12:0/1586611159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c419d450 con 0x7fd6c4100a80 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c1d9b640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6c4101420 0x7fd6c41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c259c640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6c4100a80 0x7fd6c41984a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009230 tx=0x7fd6b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6b37fe640 1 -- 172.21.15.12:0/1586611159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b403f030 con 0x7fd6c4100a80 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6b37fe640 1 -- 172.21.15.12:0/1586611159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6b4003ad0 con 0x7fd6c4100a80 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1586611159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c419d6e0 con 0x7fd6c4100a80 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6b37fe640 1 -- 172.21.15.12:0/1586611159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4035070 con 0x7fd6c4100a80 2024-09-19T06:38:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.247+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1586611159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c41a5020 con 0x7fd6c4100a80 2024-09-19T06:38:38.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.248+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1586611159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c4100ee0 con 0x7fd6c4100a80 2024-09-19T06:38:38.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.250+0000 7fd6b37fe640 1 -- 172.21.15.12:0/1586611159 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd6b4042030 con 0x7fd6c4100a80 2024-09-19T06:38:38.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.250+0000 7fd6b37fe640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd6ac0a32d0 0x7fd6ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:38.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.250+0000 7fd6c1d9b640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd6ac0a32d0 0x7fd6ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:38.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.250+0000 7fd6b37fe640 1 -- 172.21.15.12:0/1586611159 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fd6b40effd0 con 0x7fd6c4100a80 2024-09-19T06:38:38.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.251+0000 7fd6c1d9b640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd6ac0a32d0 0x7fd6ac0a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd6c41060d0 tx=0x7fd6b8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:38.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.255+0000 7fd6b37fe640 1 -- 172.21.15.12:0/1586611159 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6b40bcb70 con 0x7fd6c4100a80 2024-09-19T06:38:38.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.431+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1586611159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6c4108ff0 con 0x7fd6c4100a80 2024-09-19T06:38:38.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.433+0000 7fd6b37fe640 1 -- 172.21.15.12:0/1586611159 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22734 (secure 0 0 0) 0x7fd6b40bc470 con 0x7fd6c4100a80 2024-09-19T06:38:38.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:38.435 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:38:23.051378+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:38:38.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1586611159 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd6ac0a32d0 msgr2=0x7fd6ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:38.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd6ac0a32d0 0x7fd6ac0a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd6c41060d0 tx=0x7fd6b8005e50 comp rx=0 tx=0).stop 2024-09-19T06:38:38.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1586611159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6c4100a80 msgr2=0x7fd6c41984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:38.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6c4100a80 0x7fd6c41984a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009230 tx=0x7fd6b4004270 comp rx=0 tx=0).stop 2024-09-19T06:38:38.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1586611159 shutdown_connections 2024-09-19T06:38:38.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd6ac0a32d0 0x7fd6ac0a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6c4106a80 0x7fd6c419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd6c4101420 0x7fd6c41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 --2- 172.21.15.12:0/1586611159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6c4100a80 0x7fd6c41984a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:38.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1586611159 >> 172.21.15.12:0/1586611159 conn(0x7fd6c40fc7a0 msgr2=0x7fd6c40fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:38.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1586611159 shutdown_connections 2024-09-19T06:38:38.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:38.435+0000 7fd6c89d4640 1 -- 172.21.15.12:0/1586611159 wait complete. 2024-09-19T06:38:38.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:38 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1586611159' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:39.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:38 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1586611159' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:39.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:38 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1586611159' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:39.115 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:38:39.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:38:39.372 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:39.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:39 smithi012 ceph-mon[30937]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 18 op/s 2024-09-19T06:38:39.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.909+0000 7f8d45720640 1 -- 172.21.15.12:0/4045016665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d4010c170 msgr2=0x7f8d4010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:39.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.909+0000 7f8d45720640 1 --2- 172.21.15.12:0/4045016665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d4010c170 0x7f8d4010e610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009900 tx=0x7f8d3802a480 comp rx=0 tx=0).stop 2024-09-19T06:38:39.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.909+0000 7f8d45720640 1 -- 172.21.15.12:0/4045016665 shutdown_connections 2024-09-19T06:38:39.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.909+0000 7f8d45720640 1 --2- 172.21.15.12:0/4045016665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d4010c170 0x7f8d4010e610 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:39.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.909+0000 7f8d45720640 1 --2- 172.21.15.12:0/4045016665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d40103660 0x7f8d4010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:39.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.909+0000 7f8d45720640 1 --2- 172.21.15.12:0/4045016665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d40102d40 0x7f8d40103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.909+0000 7f8d45720640 1 -- 172.21.15.12:0/4045016665 >> 172.21.15.12:0/4045016665 conn(0x7f8d400fc7a0 msgr2=0x7f8d400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.909+0000 7f8d45720640 1 -- 172.21.15.12:0/4045016665 shutdown_connections 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.909+0000 7f8d45720640 1 -- 172.21.15.12:0/4045016665 wait complete. 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.909+0000 7f8d45720640 1 Processor -- start 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d45720640 1 -- start start 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d45720640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d40102d40 0x7f8d401983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d45720640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d40103660 0x7f8d40198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d45720640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d4010c170 0x7f8d4019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d45720640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40111f70 con 0x7f8d40102d40 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d45720640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40111df0 con 0x7f8d4010c170 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d45720640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401120f0 con 0x7f8d40103660 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d40102d40 0x7f8d401983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:39.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d40102d40 0x7f8d401983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56446/0 (socket says 172.21.15.12:56446) 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d3effd640 1 -- 172.21.15.12:0/1901705365 learned_addr learned my addr 172.21.15.12:0/1901705365 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d3f7fe640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d4010c170 0x7f8d4019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d3e7fc640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d40103660 0x7f8d40198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d3effd640 1 -- 172.21.15.12:0/1901705365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d40103660 msgr2=0x7f8d40198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d3effd640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d40103660 0x7f8d40198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d3effd640 1 -- 172.21.15.12:0/1901705365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d4010c170 msgr2=0x7f8d4019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d3effd640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d4010c170 0x7f8d4019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.910+0000 7f8d3effd640 1 -- 172.21.15.12:0/1901705365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4019d3a0 con 0x7f8d40102d40 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.911+0000 7f8d3effd640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d40102d40 0x7f8d401983f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000cce0 tx=0x7f8d3000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.911+0000 7f8d37fff640 1 -- 172.21.15.12:0/1901705365 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30004b20 con 0x7f8d40102d40 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.911+0000 7f8d37fff640 1 -- 172.21.15.12:0/1901705365 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d30004cc0 con 0x7f8d40102d40 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.911+0000 7f8d45720640 1 -- 172.21.15.12:0/1901705365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4019d690 con 0x7f8d40102d40 2024-09-19T06:38:39.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.911+0000 7f8d37fff640 1 -- 172.21.15.12:0/1901705365 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000f7d0 con 0x7f8d40102d40 2024-09-19T06:38:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.911+0000 7f8d45720640 1 -- 172.21.15.12:0/1901705365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d401a4f70 con 0x7f8d40102d40 2024-09-19T06:38:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.912+0000 7f8d45720640 1 -- 172.21.15.12:0/1901705365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d40103120 con 0x7f8d40102d40 2024-09-19T06:38:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.913+0000 7f8d37fff640 1 -- 172.21.15.12:0/1901705365 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8d3000f970 con 0x7f8d40102d40 2024-09-19T06:38:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.914+0000 7f8d37fff640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8d2c0a3350 0x7f8d2c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.914+0000 7f8d3e7fc640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8d2c0a3350 0x7f8d2c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.914+0000 7f8d37fff640 1 -- 172.21.15.12:0/1901705365 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f8d300cfb60 con 0x7f8d40102d40 2024-09-19T06:38:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.914+0000 7f8d3e7fc640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8d2c0a3350 0x7f8d2c0a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d280058c0 tx=0x7f8d28005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:39.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:39.918+0000 7f8d37fff640 1 -- 172.21.15.12:0/1901705365 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8d30014030 con 0x7f8d40102d40 2024-09-19T06:38:40.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:39 smithi016 ceph-mon[34911]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 18 op/s 2024-09-19T06:38:40.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:39 smithi173 ceph-mon[35349]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 18 op/s 2024-09-19T06:38:40.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.090+0000 7f8d45720640 1 -- 172.21.15.12:0/1901705365 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d40062630 con 0x7f8d2c0a3350 2024-09-19T06:38:40.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.099+0000 7f8d37fff640 1 -- 172.21.15.12:0/1901705365 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258766 (secure 0 0 0) 0x7f8d40062630 con 0x7f8d2c0a3350 2024-09-19T06:38:40.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:40.105 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-19T06:38:40.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.102+0000 7f8d45720640 1 -- 172.21.15.12:0/1901705365 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8d2c0a3350 msgr2=0x7f8d2c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:40.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.102+0000 7f8d45720640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8d2c0a3350 0x7f8d2c0a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d280058c0 tx=0x7f8d28005850 comp rx=0 tx=0).stop 2024-09-19T06:38:40.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.102+0000 7f8d45720640 1 -- 172.21.15.12:0/1901705365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d40102d40 msgr2=0x7f8d401983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:40.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.102+0000 7f8d45720640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d40102d40 0x7f8d401983f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000cce0 tx=0x7f8d3000a620 comp rx=0 tx=0).stop 2024-09-19T06:38:40.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.102+0000 7f8d45720640 1 -- 172.21.15.12:0/1901705365 shutdown_connections 2024-09-19T06:38:40.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.102+0000 7f8d45720640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8d2c0a3350 0x7f8d2c0a5810 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:40.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.102+0000 7f8d45720640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d4010c170 0x7f8d4019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:40.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.102+0000 7f8d45720640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d40103660 0x7f8d40198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:40.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.102+0000 7f8d45720640 1 --2- 172.21.15.12:0/1901705365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d40102d40 0x7f8d401983f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:40.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.102+0000 7f8d45720640 1 -- 172.21.15.12:0/1901705365 >> 172.21.15.12:0/1901705365 conn(0x7f8d400fc7a0 msgr2=0x7f8d400fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:40.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.103+0000 7f8d45720640 1 -- 172.21.15.12:0/1901705365 shutdown_connections 2024-09-19T06:38:40.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:40.103+0000 7f8d45720640 1 -- 172.21.15.12:0/1901705365 wait complete. 2024-09-19T06:38:40.808 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-19T06:38:39.706835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645005,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":288,"num_read_kb":251,"num_write":411,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1182930,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378728,"kb_used_data":12840,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563096,"statfs":{"total":1151940427776,"available":1151552610304,"internally_reserved":0,"allocated":13148160,"data_stored":7188339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49393,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":81,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003034"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062049+0000","last_change":"2024-09-19T06:38:14.052943+0000","last_active":"2024-09-19T06:38:23.062049+0000","last_peered":"2024-09-19T06:38:23.062049+0000","last_clean":"2024-09-19T06:38:23.062049+0000","last_became_active":"2024-09-19T06:38:14.052054+0000","last_became_peered":"2024-09-19T06:38:14.052054+0000","last_unstale":"2024-09-19T06:38:23.062049+0000","last_undegraded":"2024-09-19T06:38:23.062049+0000","last_fullsized":"2024-09-19T06:38:23.062049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:28.898131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061619+0000","last_change":"2024-09-19T06:38:14.044916+0000","last_active":"2024-09-19T06:38:23.061619+0000","last_peered":"2024-09-19T06:38:23.061619+0000","last_clean":"2024-09-19T06:38:23.061619+0000","last_became_active":"2024-09-19T06:38:14.044596+0000","last_became_peered":"2024-09-19T06:38:14.044596+0000","last_unstale":"2024-09-19T06:38:23.061619+0000","last_undegraded":"2024-09-19T06:38:23.061619+0000","last_fullsized":"2024-09-19T06:38:23.061619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:04.402332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061792+0000","last_change":"2024-09-19T06:38:14.052765+0000","last_active":"2024-09-19T06:38:23.061792+0000","last_peered":"2024-09-19T06:38:23.061792+0000","last_clean":"2024-09-19T06:38:23.061792+0000","last_became_active":"2024-09-19T06:38:14.052219+0000","last_became_peered":"2024-09-19T06:38:14.052219+0000","last_unstale":"2024-09-19T06:38:23.061792+0000","last_undegraded":"2024-09-19T06:38:23.061792+0000","last_fullsized":"2024-09-19T06:38:23.061792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:13.317252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176087+0000","last_change":"2024-09-19T06:38:14.052421+0000","last_active":"2024-09-19T06:38:23.176087+0000","last_peered":"2024-09-19T06:38:23.176087+0000","last_clean":"2024-09-19T06:38:23.176087+0000","last_became_active":"2024-09-19T06:38:14.052094+0000","last_became_peered":"2024-09-19T06:38:14.052094+0000","last_unstale":"2024-09-19T06:38:23.176087+0000","last_undegraded":"2024-09-19T06:38:23.176087+0000","last_fullsized":"2024-09-19T06:38:23.176087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062049+0000","last_change":"2024-09-19T06:38:14.047736+0000","last_active":"2024-09-19T06:38:23.062049+0000","last_peered":"2024-09-19T06:38:23.062049+0000","last_clean":"2024-09-19T06:38:23.062049+0000","last_became_active":"2024-09-19T06:38:14.047396+0000","last_became_peered":"2024-09-19T06:38:14.047396+0000","last_unstale":"2024-09-19T06:38:23.062049+0000","last_undegraded":"2024-09-19T06:38:23.062049+0000","last_fullsized":"2024-09-19T06:38:23.062049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.855638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062689+0000","last_change":"2024-09-19T06:38:14.047793+0000","last_active":"2024-09-19T06:38:23.062689+0000","last_peered":"2024-09-19T06:38:23.062689+0000","last_clean":"2024-09-19T06:38:23.062689+0000","last_became_active":"2024-09-19T06:38:14.047198+0000","last_became_peered":"2024-09-19T06:38:14.047198+0000","last_unstale":"2024-09-19T06:38:23.062689+0000","last_undegraded":"2024-09-19T06:38:23.062689+0000","last_fullsized":"2024-09-19T06:38:23.062689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:42.507270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059759+0000","last_change":"2024-09-19T06:38:14.050025+0000","last_active":"2024-09-19T06:38:23.059759+0000","last_peered":"2024-09-19T06:38:23.059759+0000","last_clean":"2024-09-19T06:38:23.059759+0000","last_became_active":"2024-09-19T06:38:14.049591+0000","last_became_peered":"2024-09-19T06:38:14.049591+0000","last_unstale":"2024-09-19T06:38:23.059759+0000","last_undegraded":"2024-09-19T06:38:23.059759+0000","last_fullsized":"2024-09-19T06:38:23.059759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:49.487521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066039+0000","last_change":"2024-09-19T06:38:23.065490+0000","last_active":"2024-09-19T06:38:23.066039+0000","last_peered":"2024-09-19T06:38:23.066039+0000","last_clean":"2024-09-19T06:38:23.066039+0000","last_became_active":"2024-09-19T06:38:23.065151+0000","last_became_peered":"2024-09-19T06:38:23.065151+0000","last_unstale":"2024-09-19T06:38:23.066039+0000","last_undegraded":"2024-09-19T06:38:23.066039+0000","last_fullsized":"2024-09-19T06:38:23.066039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:42.184698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066896+0000","last_change":"2024-09-19T06:38:14.047395+0000","last_active":"2024-09-19T06:38:23.066896+0000","last_peered":"2024-09-19T06:38:23.066896+0000","last_clean":"2024-09-19T06:38:23.066896+0000","last_became_active":"2024-09-19T06:38:14.046975+0000","last_became_peered":"2024-09-19T06:38:14.046975+0000","last_unstale":"2024-09-19T06:38:23.066896+0000","last_undegraded":"2024-09-19T06:38:23.066896+0000","last_fullsized":"2024-09-19T06:38:23.066896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:18.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063290+0000","last_change":"2024-09-19T06:38:14.055042+0000","last_active":"2024-09-19T06:38:23.063290+0000","last_peered":"2024-09-19T06:38:23.063290+0000","last_clean":"2024-09-19T06:38:23.063290+0000","last_became_active":"2024-09-19T06:38:14.054664+0000","last_became_peered":"2024-09-19T06:38:14.054664+0000","last_unstale":"2024-09-19T06:38:23.063290+0000","last_undegraded":"2024-09-19T06:38:23.063290+0000","last_fullsized":"2024-09-19T06:38:23.063290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.815277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060084+0000","last_change":"2024-09-19T06:38:14.055106+0000","last_active":"2024-09-19T06:38:23.060084+0000","last_peered":"2024-09-19T06:38:23.060084+0000","last_clean":"2024-09-19T06:38:23.060084+0000","last_became_active":"2024-09-19T06:38:14.054721+0000","last_became_peered":"2024-09-19T06:38:14.054721+0000","last_unstale":"2024-09-19T06:38:23.060084+0000","last_undegraded":"2024-09-19T06:38:23.060084+0000","last_fullsized":"2024-09-19T06:38:23.060084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:39.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176197+0000","last_change":"2024-09-19T06:38:14.051796+0000","last_active":"2024-09-19T06:38:23.176197+0000","last_peered":"2024-09-19T06:38:23.176197+0000","last_clean":"2024-09-19T06:38:23.176197+0000","last_became_active":"2024-09-19T06:38:14.048338+0000","last_became_peered":"2024-09-19T06:38:14.048338+0000","last_unstale":"2024-09-19T06:38:23.176197+0000","last_undegraded":"2024-09-19T06:38:23.176197+0000","last_fullsized":"2024-09-19T06:38:23.176197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:48.656819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174656+0000","last_change":"2024-09-19T06:38:14.048607+0000","last_active":"2024-09-19T06:38:23.174656+0000","last_peered":"2024-09-19T06:38:23.174656+0000","last_clean":"2024-09-19T06:38:23.174656+0000","last_became_active":"2024-09-19T06:38:14.047277+0000","last_became_peered":"2024-09-19T06:38:14.047277+0000","last_unstale":"2024-09-19T06:38:23.174656+0000","last_undegraded":"2024-09-19T06:38:23.174656+0000","last_fullsized":"2024-09-19T06:38:23.174656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:52.904376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061453+0000","last_change":"2024-09-19T06:38:14.050759+0000","last_active":"2024-09-19T06:38:23.061453+0000","last_peered":"2024-09-19T06:38:23.061453+0000","last_clean":"2024-09-19T06:38:23.061453+0000","last_became_active":"2024-09-19T06:38:14.049900+0000","last_became_peered":"2024-09-19T06:38:14.049900+0000","last_unstale":"2024-09-19T06:38:23.061453+0000","last_undegraded":"2024-09-19T06:38:23.061453+0000","last_fullsized":"2024-09-19T06:38:23.061453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:45.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061420+0000","last_change":"2024-09-19T06:38:14.058890+0000","last_active":"2024-09-19T06:38:23.061420+0000","last_peered":"2024-09-19T06:38:23.061420+0000","last_clean":"2024-09-19T06:38:23.061420+0000","last_became_active":"2024-09-19T06:38:14.058442+0000","last_became_peered":"2024-09-19T06:38:14.058442+0000","last_unstale":"2024-09-19T06:38:23.061420+0000","last_undegraded":"2024-09-19T06:38:23.061420+0000","last_fullsized":"2024-09-19T06:38:23.061420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:27.296578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066180+0000","last_change":"2024-09-19T06:38:14.050371+0000","last_active":"2024-09-19T06:38:23.066180+0000","last_peered":"2024-09-19T06:38:23.066180+0000","last_clean":"2024-09-19T06:38:23.066180+0000","last_became_active":"2024-09-19T06:38:14.049930+0000","last_became_peered":"2024-09-19T06:38:14.049930+0000","last_unstale":"2024-09-19T06:38:23.066180+0000","last_undegraded":"2024-09-19T06:38:23.066180+0000","last_fullsized":"2024-09-19T06:38:23.066180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:37.898624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062160+0000","last_change":"2024-09-19T06:38:14.052521+0000","last_active":"2024-09-19T06:38:23.062160+0000","last_peered":"2024-09-19T06:38:23.062160+0000","last_clean":"2024-09-19T06:38:23.062160+0000","last_became_active":"2024-09-19T06:38:14.052083+0000","last_became_peered":"2024-09-19T06:38:14.052083+0000","last_unstale":"2024-09-19T06:38:23.062160+0000","last_undegraded":"2024-09-19T06:38:23.062160+0000","last_fullsized":"2024-09-19T06:38:23.062160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:10.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059333+0000","last_change":"2024-09-19T06:38:14.044747+0000","last_active":"2024-09-19T06:38:23.059333+0000","last_peered":"2024-09-19T06:38:23.059333+0000","last_clean":"2024-09-19T06:38:23.059333+0000","last_became_active":"2024-09-19T06:38:14.044451+0000","last_became_peered":"2024-09-19T06:38:14.044451+0000","last_unstale":"2024-09-19T06:38:23.059333+0000","last_undegraded":"2024-09-19T06:38:23.059333+0000","last_fullsized":"2024-09-19T06:38:23.059333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:04.067156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067040+0000","last_change":"2024-09-19T06:38:14.056101+0000","last_active":"2024-09-19T06:38:23.067040+0000","last_peered":"2024-09-19T06:38:23.067040+0000","last_clean":"2024-09-19T06:38:23.067040+0000","last_became_active":"2024-09-19T06:38:14.055682+0000","last_became_peered":"2024-09-19T06:38:14.055682+0000","last_unstale":"2024-09-19T06:38:23.067040+0000","last_undegraded":"2024-09-19T06:38:23.067040+0000","last_fullsized":"2024-09-19T06:38:23.067040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:23.921766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061285+0000","last_change":"2024-09-19T06:38:14.059441+0000","last_active":"2024-09-19T06:38:23.061285+0000","last_peered":"2024-09-19T06:38:23.061285+0000","last_clean":"2024-09-19T06:38:23.061285+0000","last_became_active":"2024-09-19T06:38:14.059123+0000","last_became_peered":"2024-09-19T06:38:14.059123+0000","last_unstale":"2024-09-19T06:38:23.061285+0000","last_undegraded":"2024-09-19T06:38:23.061285+0000","last_fullsized":"2024-09-19T06:38:23.061285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:32.148741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174697+0000","last_change":"2024-09-19T06:38:14.050336+0000","last_active":"2024-09-19T06:38:23.174697+0000","last_peered":"2024-09-19T06:38:23.174697+0000","last_clean":"2024-09-19T06:38:23.174697+0000","last_became_active":"2024-09-19T06:38:14.050041+0000","last_became_peered":"2024-09-19T06:38:14.050041+0000","last_unstale":"2024-09-19T06:38:23.174697+0000","last_undegraded":"2024-09-19T06:38:23.174697+0000","last_fullsized":"2024-09-19T06:38:23.174697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:09.245804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066396+0000","last_change":"2024-09-19T06:38:14.050280+0000","last_active":"2024-09-19T06:38:23.066396+0000","last_peered":"2024-09-19T06:38:23.066396+0000","last_clean":"2024-09-19T06:38:23.066396+0000","last_became_active":"2024-09-19T06:38:14.049874+0000","last_became_peered":"2024-09-19T06:38:14.049874+0000","last_unstale":"2024-09-19T06:38:23.066396+0000","last_undegraded":"2024-09-19T06:38:23.066396+0000","last_fullsized":"2024-09-19T06:38:23.066396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:52.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.809784+0000","last_change":"2024-09-19T06:38:14.048294+0000","last_active":"2024-09-19T06:38:23.809784+0000","last_peered":"2024-09-19T06:38:23.809784+0000","last_clean":"2024-09-19T06:38:23.809784+0000","last_became_active":"2024-09-19T06:38:14.048002+0000","last_became_peered":"2024-09-19T06:38:14.048002+0000","last_unstale":"2024-09-19T06:38:23.809784+0000","last_undegraded":"2024-09-19T06:38:23.809784+0000","last_fullsized":"2024-09-19T06:38:23.809784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:55.920027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062988+0000","last_change":"2024-09-19T06:38:14.050244+0000","last_active":"2024-09-19T06:38:23.062988+0000","last_peered":"2024-09-19T06:38:23.062988+0000","last_clean":"2024-09-19T06:38:23.062988+0000","last_became_active":"2024-09-19T06:38:14.049499+0000","last_became_peered":"2024-09-19T06:38:14.049499+0000","last_unstale":"2024-09-19T06:38:23.062988+0000","last_undegraded":"2024-09-19T06:38:23.062988+0000","last_fullsized":"2024-09-19T06:38:23.062988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:35.506647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810013+0000","last_change":"2024-09-19T06:38:14.048779+0000","last_active":"2024-09-19T06:38:23.810013+0000","last_peered":"2024-09-19T06:38:23.810013+0000","last_clean":"2024-09-19T06:38:23.810013+0000","last_became_active":"2024-09-19T06:38:14.048492+0000","last_became_peered":"2024-09-19T06:38:14.048492+0000","last_unstale":"2024-09-19T06:38:23.810013+0000","last_undegraded":"2024-09-19T06:38:23.810013+0000","last_fullsized":"2024-09-19T06:38:23.810013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:01.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067146+0000","last_change":"2024-09-19T06:38:14.054442+0000","last_active":"2024-09-19T06:38:23.067146+0000","last_peered":"2024-09-19T06:38:23.067146+0000","last_clean":"2024-09-19T06:38:23.067146+0000","last_became_active":"2024-09-19T06:38:14.053903+0000","last_became_peered":"2024-09-19T06:38:14.053903+0000","last_unstale":"2024-09-19T06:38:23.067146+0000","last_undegraded":"2024-09-19T06:38:23.067146+0000","last_fullsized":"2024-09-19T06:38:23.067146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:42.002146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061889+0000","last_change":"2024-09-19T06:38:14.051139+0000","last_active":"2024-09-19T06:38:23.061889+0000","last_peered":"2024-09-19T06:38:23.061889+0000","last_clean":"2024-09-19T06:38:23.061889+0000","last_became_active":"2024-09-19T06:38:14.050764+0000","last_became_peered":"2024-09-19T06:38:14.050764+0000","last_unstale":"2024-09-19T06:38:23.061889+0000","last_undegraded":"2024-09-19T06:38:23.061889+0000","last_fullsized":"2024-09-19T06:38:23.061889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.379184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174574+0000","last_change":"2024-09-19T06:38:14.054614+0000","last_active":"2024-09-19T06:38:23.174574+0000","last_peered":"2024-09-19T06:38:23.174574+0000","last_clean":"2024-09-19T06:38:23.174574+0000","last_became_active":"2024-09-19T06:38:14.054280+0000","last_became_peered":"2024-09-19T06:38:14.054280+0000","last_unstale":"2024-09-19T06:38:23.174574+0000","last_undegraded":"2024-09-19T06:38:23.174574+0000","last_fullsized":"2024-09-19T06:38:23.174574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:21.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061680+0000","last_change":"2024-09-19T06:38:14.056215+0000","last_active":"2024-09-19T06:38:23.061680+0000","last_peered":"2024-09-19T06:38:23.061680+0000","last_clean":"2024-09-19T06:38:23.061680+0000","last_became_active":"2024-09-19T06:38:14.055875+0000","last_became_peered":"2024-09-19T06:38:14.055875+0000","last_unstale":"2024-09-19T06:38:23.061680+0000","last_undegraded":"2024-09-19T06:38:23.061680+0000","last_fullsized":"2024-09-19T06:38:23.061680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:45.347185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066728+0000","last_change":"2024-09-19T06:38:14.057963+0000","last_active":"2024-09-19T06:38:23.066728+0000","last_peered":"2024-09-19T06:38:23.066728+0000","last_clean":"2024-09-19T06:38:23.066728+0000","last_became_active":"2024-09-19T06:38:14.057578+0000","last_became_peered":"2024-09-19T06:38:14.057578+0000","last_unstale":"2024-09-19T06:38:23.066728+0000","last_undegraded":"2024-09-19T06:38:23.066728+0000","last_fullsized":"2024-09-19T06:38:23.066728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:26.173414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066558+0000","last_change":"2024-09-19T06:38:14.058840+0000","last_active":"2024-09-19T06:38:23.066558+0000","last_peered":"2024-09-19T06:38:23.066558+0000","last_clean":"2024-09-19T06:38:23.066558+0000","last_became_active":"2024-09-19T06:38:14.058418+0000","last_became_peered":"2024-09-19T06:38:14.058418+0000","last_unstale":"2024-09-19T06:38:23.066558+0000","last_undegraded":"2024-09-19T06:38:23.066558+0000","last_fullsized":"2024-09-19T06:38:23.066558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:13.624750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061748+0000","last_change":"2024-09-19T06:38:14.053363+0000","last_active":"2024-09-19T06:38:23.061748+0000","last_peered":"2024-09-19T06:38:23.061748+0000","last_clean":"2024-09-19T06:38:23.061748+0000","last_became_active":"2024-09-19T06:38:14.053039+0000","last_became_peered":"2024-09-19T06:38:14.053039+0000","last_unstale":"2024-09-19T06:38:23.061748+0000","last_undegraded":"2024-09-19T06:38:23.061748+0000","last_fullsized":"2024-09-19T06:38:23.061748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.274885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062028+0000","last_change":"2024-09-19T06:38:14.045719+0000","last_active":"2024-09-19T06:38:23.062028+0000","last_peered":"2024-09-19T06:38:23.062028+0000","last_clean":"2024-09-19T06:38:23.062028+0000","last_became_active":"2024-09-19T06:38:14.045285+0000","last_became_peered":"2024-09-19T06:38:14.045285+0000","last_unstale":"2024-09-19T06:38:23.062028+0000","last_undegraded":"2024-09-19T06:38:23.062028+0000","last_fullsized":"2024-09-19T06:38:23.062028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:16.877802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:36.675677+0000","last_change":"2024-09-19T06:38:23.177942+0000","last_active":"2024-09-19T06:38:36.675677+0000","last_peered":"2024-09-19T06:38:36.675677+0000","last_clean":"2024-09-19T06:38:36.675677+0000","last_became_active":"2024-09-19T06:38:23.176579+0000","last_became_peered":"2024-09-19T06:38:23.176579+0000","last_unstale":"2024-09-19T06:38:36.675677+0000","last_undegraded":"2024-09-19T06:38:36.675677+0000","last_fullsized":"2024-09-19T06:38:36.675677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:28.140245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.811603+0000","last_change":"2024-09-19T06:38:23.811603+0000","last_active":"2024-09-19T06:38:23.811603+0000","last_peered":"2024-09-19T06:38:23.811603+0000","last_clean":"2024-09-19T06:38:23.811603+0000","last_became_active":"2024-09-19T06:38:23.811139+0000","last_became_peered":"2024-09-19T06:38:23.811139+0000","last_unstale":"2024-09-19T06:38:23.811603+0000","last_undegraded":"2024-09-19T06:38:23.811603+0000","last_fullsized":"2024-09-19T06:38:23.811603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:42.082355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667648+0000","last_change":"2024-09-19T06:38:12.041330+0000","last_active":"2024-09-19T06:38:24.667648+0000","last_peered":"2024-09-19T06:38:24.667648+0000","last_clean":"2024-09-19T06:38:24.667648+0000","last_became_active":"2024-09-19T06:38:12.040992+0000","last_became_peered":"2024-09-19T06:38:12.040992+0000","last_unstale":"2024-09-19T06:38:24.667648+0000","last_undegraded":"2024-09-19T06:38:24.667648+0000","last_fullsized":"2024-09-19T06:38:24.667648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:51.721009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.079837+0000","last_change":"2024-09-19T06:38:12.034534+0000","last_active":"2024-09-19T06:38:24.079837+0000","last_peered":"2024-09-19T06:38:24.079837+0000","last_clean":"2024-09-19T06:38:24.079837+0000","last_became_active":"2024-09-19T06:38:12.034209+0000","last_became_peered":"2024-09-19T06:38:12.034209+0000","last_unstale":"2024-09-19T06:38:24.079837+0000","last_undegraded":"2024-09-19T06:38:24.079837+0000","last_fullsized":"2024-09-19T06:38:24.079837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:40.640464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.809975+0000","last_change":"2024-09-19T06:38:14.043287+0000","last_active":"2024-09-19T06:38:23.809975+0000","last_peered":"2024-09-19T06:38:23.809975+0000","last_clean":"2024-09-19T06:38:23.809975+0000","last_became_active":"2024-09-19T06:38:14.042565+0000","last_became_peered":"2024-09-19T06:38:14.042565+0000","last_unstale":"2024-09-19T06:38:23.809975+0000","last_undegraded":"2024-09-19T06:38:23.809975+0000","last_fullsized":"2024-09-19T06:38:23.809975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:32.689929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.671515+0000","last_change":"2024-09-19T06:38:12.039142+0000","last_active":"2024-09-19T06:38:25.671515+0000","last_peered":"2024-09-19T06:38:25.671515+0000","last_clean":"2024-09-19T06:38:25.671515+0000","last_became_active":"2024-09-19T06:38:12.038815+0000","last_became_peered":"2024-09-19T06:38:12.038815+0000","last_unstale":"2024-09-19T06:38:25.671515+0000","last_undegraded":"2024-09-19T06:38:25.671515+0000","last_fullsized":"2024-09-19T06:38:25.671515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:03.316742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059107+0000","last_change":"2024-09-19T06:38:14.044778+0000","last_active":"2024-09-19T06:38:23.059107+0000","last_peered":"2024-09-19T06:38:23.059107+0000","last_clean":"2024-09-19T06:38:23.059107+0000","last_became_active":"2024-09-19T06:38:14.044457+0000","last_became_peered":"2024-09-19T06:38:14.044457+0000","last_unstale":"2024-09-19T06:38:23.059107+0000","last_undegraded":"2024-09-19T06:38:23.059107+0000","last_fullsized":"2024-09-19T06:38:23.059107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:06.342070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:34.672084+0000","last_change":"2024-09-19T06:38:12.039031+0000","last_active":"2024-09-19T06:38:34.672084+0000","last_peered":"2024-09-19T06:38:34.672084+0000","last_clean":"2024-09-19T06:38:34.672084+0000","last_became_active":"2024-09-19T06:38:12.038346+0000","last_became_peered":"2024-09-19T06:38:12.038346+0000","last_unstale":"2024-09-19T06:38:34.672084+0000","last_undegraded":"2024-09-19T06:38:34.672084+0000","last_fullsized":"2024-09-19T06:38:34.672084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:33.752330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066715+0000","last_change":"2024-09-19T06:38:14.045159+0000","last_active":"2024-09-19T06:38:23.066715+0000","last_peered":"2024-09-19T06:38:23.066715+0000","last_clean":"2024-09-19T06:38:23.066715+0000","last_became_active":"2024-09-19T06:38:14.044822+0000","last_became_peered":"2024-09-19T06:38:14.044822+0000","last_unstale":"2024-09-19T06:38:23.066715+0000","last_undegraded":"2024-09-19T06:38:23.066715+0000","last_fullsized":"2024-09-19T06:38:23.066715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:05.143507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670553+0000","last_change":"2024-09-19T06:38:12.037820+0000","last_active":"2024-09-19T06:38:25.670553+0000","last_peered":"2024-09-19T06:38:25.670553+0000","last_clean":"2024-09-19T06:38:25.670553+0000","last_became_active":"2024-09-19T06:38:12.037417+0000","last_became_peered":"2024-09-19T06:38:12.037417+0000","last_unstale":"2024-09-19T06:38:25.670553+0000","last_undegraded":"2024-09-19T06:38:25.670553+0000","last_fullsized":"2024-09-19T06:38:25.670553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:22.516704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062170+0000","last_change":"2024-09-19T06:38:14.048633+0000","last_active":"2024-09-19T06:38:23.062170+0000","last_peered":"2024-09-19T06:38:23.062170+0000","last_clean":"2024-09-19T06:38:23.062170+0000","last_became_active":"2024-09-19T06:38:14.048257+0000","last_became_peered":"2024-09-19T06:38:14.048257+0000","last_unstale":"2024-09-19T06:38:23.062170+0000","last_undegraded":"2024-09-19T06:38:23.062170+0000","last_fullsized":"2024-09-19T06:38:23.062170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:16.509071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.657953+0000","last_change":"2024-09-19T06:38:12.047175+0000","last_active":"2024-09-19T06:38:24.657953+0000","last_peered":"2024-09-19T06:38:24.657953+0000","last_clean":"2024-09-19T06:38:24.657953+0000","last_became_active":"2024-09-19T06:38:12.046781+0000","last_became_peered":"2024-09-19T06:38:12.046781+0000","last_unstale":"2024-09-19T06:38:24.657953+0000","last_undegraded":"2024-09-19T06:38:24.657953+0000","last_fullsized":"2024-09-19T06:38:24.657953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:38.774803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067812+0000","last_change":"2024-09-19T06:38:23.067812+0000","last_active":"2024-09-19T06:38:23.067812+0000","last_peered":"2024-09-19T06:38:23.067812+0000","last_clean":"2024-09-19T06:38:23.067812+0000","last_became_active":"2024-09-19T06:38:23.067357+0000","last_became_peered":"2024-09-19T06:38:23.067357+0000","last_unstale":"2024-09-19T06:38:23.067812+0000","last_undegraded":"2024-09-19T06:38:23.067812+0000","last_fullsized":"2024-09-19T06:38:23.067812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:34.719243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'24","reported_seq":89,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:34.673367+0000","last_change":"2024-09-19T06:38:23.186703+0000","last_active":"2024-09-19T06:38:34.673367+0000","last_peered":"2024-09-19T06:38:34.673367+0000","last_clean":"2024-09-19T06:38:34.673367+0000","last_became_active":"2024-09-19T06:38:23.177212+0000","last_became_peered":"2024-09-19T06:38:23.177212+0000","last_unstale":"2024-09-19T06:38:34.673367+0000","last_undegraded":"2024-09-19T06:38:34.673367+0000","last_fullsized":"2024-09-19T06:38:34.673367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:46.884624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":58,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063284+0000","last_change":"2024-09-19T06:38:14.054619+0000","last_active":"2024-09-19T06:38:23.063284+0000","last_peered":"2024-09-19T06:38:23.063284+0000","last_clean":"2024-09-19T06:38:23.063284+0000","last_became_active":"2024-09-19T06:38:14.054118+0000","last_became_peered":"2024-09-19T06:38:14.054118+0000","last_unstale":"2024-09-19T06:38:23.063284+0000","last_undegraded":"2024-09-19T06:38:23.063284+0000","last_fullsized":"2024-09-19T06:38:23.063284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:41.041603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.673593+0000","last_change":"2024-09-19T06:38:12.040272+0000","last_active":"2024-09-19T06:38:25.673593+0000","last_peered":"2024-09-19T06:38:25.673593+0000","last_clean":"2024-09-19T06:38:25.673593+0000","last_became_active":"2024-09-19T06:38:12.039940+0000","last_became_peered":"2024-09-19T06:38:12.039940+0000","last_unstale":"2024-09-19T06:38:25.673593+0000","last_undegraded":"2024-09-19T06:38:25.673593+0000","last_fullsized":"2024-09-19T06:38:25.673593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:53.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174406+0000","last_change":"2024-09-19T06:38:14.049535+0000","last_active":"2024-09-19T06:38:23.174406+0000","last_peered":"2024-09-19T06:38:23.174406+0000","last_clean":"2024-09-19T06:38:23.174406+0000","last_became_active":"2024-09-19T06:38:14.049208+0000","last_became_peered":"2024-09-19T06:38:14.049208+0000","last_unstale":"2024-09-19T06:38:23.174406+0000","last_undegraded":"2024-09-19T06:38:23.174406+0000","last_fullsized":"2024-09-19T06:38:23.174406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:03.359786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670196+0000","last_change":"2024-09-19T06:38:12.037346+0000","last_active":"2024-09-19T06:38:25.670196+0000","last_peered":"2024-09-19T06:38:25.670196+0000","last_clean":"2024-09-19T06:38:25.670196+0000","last_became_active":"2024-09-19T06:38:12.036986+0000","last_became_peered":"2024-09-19T06:38:12.036986+0000","last_unstale":"2024-09-19T06:38:25.670196+0000","last_undegraded":"2024-09-19T06:38:25.670196+0000","last_fullsized":"2024-09-19T06:38:25.670196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:26.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059848+0000","last_change":"2024-09-19T06:38:14.059454+0000","last_active":"2024-09-19T06:38:23.059848+0000","last_peered":"2024-09-19T06:38:23.059848+0000","last_clean":"2024-09-19T06:38:23.059848+0000","last_became_active":"2024-09-19T06:38:14.058996+0000","last_became_peered":"2024-09-19T06:38:14.058996+0000","last_unstale":"2024-09-19T06:38:23.059848+0000","last_undegraded":"2024-09-19T06:38:23.059848+0000","last_fullsized":"2024-09-19T06:38:23.059848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:54.645395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:33.671858+0000","last_change":"2024-09-19T06:38:12.043687+0000","last_active":"2024-09-19T06:38:33.671858+0000","last_peered":"2024-09-19T06:38:33.671858+0000","last_clean":"2024-09-19T06:38:33.671858+0000","last_became_active":"2024-09-19T06:38:12.043268+0000","last_became_peered":"2024-09-19T06:38:12.043268+0000","last_unstale":"2024-09-19T06:38:33.671858+0000","last_undegraded":"2024-09-19T06:38:33.671858+0000","last_fullsized":"2024-09-19T06:38:33.671858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:18.753736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059613+0000","last_change":"2024-09-19T06:38:14.052184+0000","last_active":"2024-09-19T06:38:23.059613+0000","last_peered":"2024-09-19T06:38:23.059613+0000","last_clean":"2024-09-19T06:38:23.059613+0000","last_became_active":"2024-09-19T06:38:14.051736+0000","last_became_peered":"2024-09-19T06:38:14.051736+0000","last_unstale":"2024-09-19T06:38:23.059613+0000","last_undegraded":"2024-09-19T06:38:23.059613+0000","last_fullsized":"2024-09-19T06:38:23.059613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:12.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667007+0000","last_change":"2024-09-19T06:38:12.048418+0000","last_active":"2024-09-19T06:38:24.667007+0000","last_peered":"2024-09-19T06:38:24.667007+0000","last_clean":"2024-09-19T06:38:24.667007+0000","last_became_active":"2024-09-19T06:38:12.047948+0000","last_became_peered":"2024-09-19T06:38:12.047948+0000","last_unstale":"2024-09-19T06:38:24.667007+0000","last_undegraded":"2024-09-19T06:38:24.667007+0000","last_fullsized":"2024-09-19T06:38:24.667007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:06.059904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176378+0000","last_change":"2024-09-19T06:38:23.175961+0000","last_active":"2024-09-19T06:38:23.176378+0000","last_peered":"2024-09-19T06:38:23.176378+0000","last_clean":"2024-09-19T06:38:23.176378+0000","last_became_active":"2024-09-19T06:38:23.175629+0000","last_became_peered":"2024-09-19T06:38:23.175629+0000","last_unstale":"2024-09-19T06:38:23.176378+0000","last_undegraded":"2024-09-19T06:38:23.176378+0000","last_fullsized":"2024-09-19T06:38:23.176378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.655577+0000","last_change":"2024-09-19T06:38:12.038945+0000","last_active":"2024-09-19T06:38:24.655577+0000","last_peered":"2024-09-19T06:38:24.655577+0000","last_clean":"2024-09-19T06:38:24.655577+0000","last_became_active":"2024-09-19T06:38:12.038571+0000","last_became_peered":"2024-09-19T06:38:12.038571+0000","last_unstale":"2024-09-19T06:38:24.655577+0000","last_undegraded":"2024-09-19T06:38:24.655577+0000","last_fullsized":"2024-09-19T06:38:24.655577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:57.887070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061540+0000","last_change":"2024-09-19T06:38:14.056481+0000","last_active":"2024-09-19T06:38:23.061540+0000","last_peered":"2024-09-19T06:38:23.061540+0000","last_clean":"2024-09-19T06:38:23.061540+0000","last_became_active":"2024-09-19T06:38:14.056177+0000","last_became_peered":"2024-09-19T06:38:14.056177+0000","last_unstale":"2024-09-19T06:38:23.061540+0000","last_undegraded":"2024-09-19T06:38:23.061540+0000","last_fullsized":"2024-09-19T06:38:23.061540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.734802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.668174+0000","last_change":"2024-09-19T06:38:12.038826+0000","last_active":"2024-09-19T06:38:25.668174+0000","last_peered":"2024-09-19T06:38:25.668174+0000","last_clean":"2024-09-19T06:38:25.668174+0000","last_became_active":"2024-09-19T06:38:12.038516+0000","last_became_peered":"2024-09-19T06:38:12.038516+0000","last_unstale":"2024-09-19T06:38:25.668174+0000","last_undegraded":"2024-09-19T06:38:25.668174+0000","last_fullsized":"2024-09-19T06:38:25.668174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:16.709742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060031+0000","last_change":"2024-09-19T06:38:14.053888+0000","last_active":"2024-09-19T06:38:23.060031+0000","last_peered":"2024-09-19T06:38:23.060031+0000","last_clean":"2024-09-19T06:38:23.060031+0000","last_became_active":"2024-09-19T06:38:14.053524+0000","last_became_peered":"2024-09-19T06:38:14.053524+0000","last_unstale":"2024-09-19T06:38:23.060031+0000","last_undegraded":"2024-09-19T06:38:23.060031+0000","last_fullsized":"2024-09-19T06:38:23.060031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:54.853786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667849+0000","last_change":"2024-09-19T06:38:12.040842+0000","last_active":"2024-09-19T06:38:24.667849+0000","last_peered":"2024-09-19T06:38:24.667849+0000","last_clean":"2024-09-19T06:38:24.667849+0000","last_became_active":"2024-09-19T06:38:12.040463+0000","last_became_peered":"2024-09-19T06:38:12.040463+0000","last_unstale":"2024-09-19T06:38:24.667849+0000","last_undegraded":"2024-09-19T06:38:24.667849+0000","last_fullsized":"2024-09-19T06:38:24.667849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:29.726632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060279+0000","last_change":"2024-09-19T06:38:14.052210+0000","last_active":"2024-09-19T06:38:23.060279+0000","last_peered":"2024-09-19T06:38:23.060279+0000","last_clean":"2024-09-19T06:38:23.060279+0000","last_became_active":"2024-09-19T06:38:14.051803+0000","last_became_peered":"2024-09-19T06:38:14.051803+0000","last_unstale":"2024-09-19T06:38:23.060279+0000","last_undegraded":"2024-09-19T06:38:23.060279+0000","last_fullsized":"2024-09-19T06:38:23.060279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:40.751672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:37.701415+0000","last_change":"2024-09-19T06:38:12.118077+0000","last_active":"2024-09-19T06:38:37.701415+0000","last_peered":"2024-09-19T06:38:37.701415+0000","last_clean":"2024-09-19T06:38:37.701415+0000","last_became_active":"2024-09-19T06:38:12.117690+0000","last_became_peered":"2024-09-19T06:38:12.117690+0000","last_unstale":"2024-09-19T06:38:37.701415+0000","last_undegraded":"2024-09-19T06:38:37.701415+0000","last_fullsized":"2024-09-19T06:38:37.701415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.828335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060217+0000","last_change":"2024-09-19T06:38:14.054014+0000","last_active":"2024-09-19T06:38:23.060217+0000","last_peered":"2024-09-19T06:38:23.060217+0000","last_clean":"2024-09-19T06:38:23.060217+0000","last_became_active":"2024-09-19T06:38:14.053349+0000","last_became_peered":"2024-09-19T06:38:14.053349+0000","last_unstale":"2024-09-19T06:38:23.060217+0000","last_undegraded":"2024-09-19T06:38:23.060217+0000","last_fullsized":"2024-09-19T06:38:23.060217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:40.117720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059973+0000","last_change":"2024-09-19T06:37:02.166696+0000","last_active":"2024-09-19T06:38:23.059973+0000","last_peered":"2024-09-19T06:38:23.059973+0000","last_clean":"2024-09-19T06:38:23.059973+0000","last_became_active":"2024-09-19T06:37:02.166225+0000","last_became_peered":"2024-09-19T06:37:02.166225+0000","last_unstale":"2024-09-19T06:38:23.059973+0000","last_undegraded":"2024-09-19T06:38:23.059973+0000","last_fullsized":"2024-09-19T06:38:23.059973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_clean_scrub_stamp":"2024-09-19T06:33:40.535354+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:46.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672803+0000","last_change":"2024-09-19T06:38:12.044465+0000","last_active":"2024-09-19T06:38:25.672803+0000","last_peered":"2024-09-19T06:38:25.672803+0000","last_clean":"2024-09-19T06:38:25.672803+0000","last_became_active":"2024-09-19T06:38:12.044042+0000","last_became_peered":"2024-09-19T06:38:12.044042+0000","last_unstale":"2024-09-19T06:38:25.672803+0000","last_undegraded":"2024-09-19T06:38:25.672803+0000","last_fullsized":"2024-09-19T06:38:25.672803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:40.759264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810103+0000","last_change":"2024-09-19T06:38:14.045102+0000","last_active":"2024-09-19T06:38:23.810103+0000","last_peered":"2024-09-19T06:38:23.810103+0000","last_clean":"2024-09-19T06:38:23.810103+0000","last_became_active":"2024-09-19T06:38:14.044785+0000","last_became_peered":"2024-09-19T06:38:14.044785+0000","last_unstale":"2024-09-19T06:38:23.810103+0000","last_undegraded":"2024-09-19T06:38:23.810103+0000","last_fullsized":"2024-09-19T06:38:23.810103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:57.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.079355+0000","last_change":"2024-09-19T06:38:12.040656+0000","last_active":"2024-09-19T06:38:24.079355+0000","last_peered":"2024-09-19T06:38:24.079355+0000","last_clean":"2024-09-19T06:38:24.079355+0000","last_became_active":"2024-09-19T06:38:12.040068+0000","last_became_peered":"2024-09-19T06:38:12.040068+0000","last_unstale":"2024-09-19T06:38:24.079355+0000","last_undegraded":"2024-09-19T06:38:24.079355+0000","last_fullsized":"2024-09-19T06:38:24.079355+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:33.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174396+0000","last_change":"2024-09-19T06:38:14.054623+0000","last_active":"2024-09-19T06:38:23.174396+0000","last_peered":"2024-09-19T06:38:23.174396+0000","last_clean":"2024-09-19T06:38:23.174396+0000","last_became_active":"2024-09-19T06:38:14.054124+0000","last_became_peered":"2024-09-19T06:38:14.054124+0000","last_unstale":"2024-09-19T06:38:23.174396+0000","last_undegraded":"2024-09-19T06:38:23.174396+0000","last_fullsized":"2024-09-19T06:38:23.174396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:33.251059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:34.672537+0000","last_change":"2024-09-19T06:38:12.047284+0000","last_active":"2024-09-19T06:38:34.672537+0000","last_peered":"2024-09-19T06:38:34.672537+0000","last_clean":"2024-09-19T06:38:34.672537+0000","last_became_active":"2024-09-19T06:38:12.046886+0000","last_became_peered":"2024-09-19T06:38:12.046886+0000","last_unstale":"2024-09-19T06:38:34.672537+0000","last_undegraded":"2024-09-19T06:38:34.672537+0000","last_fullsized":"2024-09-19T06:38:34.672537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:15.030007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063722+0000","last_change":"2024-09-19T06:38:14.049351+0000","last_active":"2024-09-19T06:38:23.063722+0000","last_peered":"2024-09-19T06:38:23.063722+0000","last_clean":"2024-09-19T06:38:23.063722+0000","last_became_active":"2024-09-19T06:38:14.048792+0000","last_became_peered":"2024-09-19T06:38:14.048792+0000","last_unstale":"2024-09-19T06:38:23.063722+0000","last_undegraded":"2024-09-19T06:38:23.063722+0000","last_fullsized":"2024-09-19T06:38:23.063722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:30.431378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:37.700380+0000","last_change":"2024-09-19T06:38:12.037155+0000","last_active":"2024-09-19T06:38:37.700380+0000","last_peered":"2024-09-19T06:38:37.700380+0000","last_clean":"2024-09-19T06:38:37.700380+0000","last_became_active":"2024-09-19T06:38:12.036536+0000","last_became_peered":"2024-09-19T06:38:12.036536+0000","last_unstale":"2024-09-19T06:38:37.700380+0000","last_undegraded":"2024-09-19T06:38:37.700380+0000","last_fullsized":"2024-09-19T06:38:37.700380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:41.014783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062872+0000","last_change":"2024-09-19T06:38:14.055724+0000","last_active":"2024-09-19T06:38:23.062872+0000","last_peered":"2024-09-19T06:38:23.062872+0000","last_clean":"2024-09-19T06:38:23.062872+0000","last_became_active":"2024-09-19T06:38:14.054457+0000","last_became_peered":"2024-09-19T06:38:14.054457+0000","last_unstale":"2024-09-19T06:38:23.062872+0000","last_undegraded":"2024-09-19T06:38:23.062872+0000","last_fullsized":"2024-09-19T06:38:23.062872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:47.653709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059331+0000","last_change":"2024-09-19T06:38:12.049197+0000","last_active":"2024-09-19T06:38:23.059331+0000","last_peered":"2024-09-19T06:38:23.059331+0000","last_clean":"2024-09-19T06:38:23.059331+0000","last_became_active":"2024-09-19T06:38:12.048863+0000","last_became_peered":"2024-09-19T06:38:12.048863+0000","last_unstale":"2024-09-19T06:38:23.059331+0000","last_undegraded":"2024-09-19T06:38:23.059331+0000","last_fullsized":"2024-09-19T06:38:23.059331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:25.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063056+0000","last_change":"2024-09-19T06:38:14.042991+0000","last_active":"2024-09-19T06:38:23.063056+0000","last_peered":"2024-09-19T06:38:23.063056+0000","last_clean":"2024-09-19T06:38:23.063056+0000","last_became_active":"2024-09-19T06:38:14.042511+0000","last_became_peered":"2024-09-19T06:38:14.042511+0000","last_unstale":"2024-09-19T06:38:23.063056+0000","last_undegraded":"2024-09-19T06:38:23.063056+0000","last_fullsized":"2024-09-19T06:38:23.063056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:38.212838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.666253+0000","last_change":"2024-09-19T06:38:23.064456+0000","last_active":"2024-09-19T06:38:24.666253+0000","last_peered":"2024-09-19T06:38:24.666253+0000","last_clean":"2024-09-19T06:38:24.666253+0000","last_became_active":"2024-09-19T06:38:23.064051+0000","last_became_peered":"2024-09-19T06:38:23.064051+0000","last_unstale":"2024-09-19T06:38:24.666253+0000","last_undegraded":"2024-09-19T06:38:24.666253+0000","last_fullsized":"2024-09-19T06:38:24.666253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:58.548420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174635+0000","last_change":"2024-09-19T06:38:14.048612+0000","last_active":"2024-09-19T06:38:23.174635+0000","last_peered":"2024-09-19T06:38:23.174635+0000","last_clean":"2024-09-19T06:38:23.174635+0000","last_became_active":"2024-09-19T06:38:14.048294+0000","last_became_peered":"2024-09-19T06:38:14.048294+0000","last_unstale":"2024-09-19T06:38:23.174635+0000","last_undegraded":"2024-09-19T06:38:23.174635+0000","last_fullsized":"2024-09-19T06:38:23.174635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:55.892149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:30.052323+0000","last_change":"2024-09-19T06:38:12.035269+0000","last_active":"2024-09-19T06:38:30.052323+0000","last_peered":"2024-09-19T06:38:30.052323+0000","last_clean":"2024-09-19T06:38:30.052323+0000","last_became_active":"2024-09-19T06:38:12.034841+0000","last_became_peered":"2024-09-19T06:38:12.034841+0000","last_unstale":"2024-09-19T06:38:30.052323+0000","last_undegraded":"2024-09-19T06:38:30.052323+0000","last_fullsized":"2024-09-19T06:38:30.052323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:19.642572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810116+0000","last_change":"2024-09-19T06:38:14.052492+0000","last_active":"2024-09-19T06:38:23.810116+0000","last_peered":"2024-09-19T06:38:23.810116+0000","last_clean":"2024-09-19T06:38:23.810116+0000","last_became_active":"2024-09-19T06:38:14.052191+0000","last_became_peered":"2024-09-19T06:38:14.052191+0000","last_unstale":"2024-09-19T06:38:23.810116+0000","last_undegraded":"2024-09-19T06:38:23.810116+0000","last_fullsized":"2024-09-19T06:38:23.810116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:34.006480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670731+0000","last_change":"2024-09-19T06:38:12.118430+0000","last_active":"2024-09-19T06:38:25.670731+0000","last_peered":"2024-09-19T06:38:25.670731+0000","last_clean":"2024-09-19T06:38:25.670731+0000","last_became_active":"2024-09-19T06:38:12.118065+0000","last_became_peered":"2024-09-19T06:38:12.118065+0000","last_unstale":"2024-09-19T06:38:25.670731+0000","last_undegraded":"2024-09-19T06:38:25.670731+0000","last_fullsized":"2024-09-19T06:38:25.670731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:25.861922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.811305+0000","last_change":"2024-09-19T06:38:23.811305+0000","last_active":"2024-09-19T06:38:23.811305+0000","last_peered":"2024-09-19T06:38:23.811305+0000","last_clean":"2024-09-19T06:38:23.811305+0000","last_became_active":"2024-09-19T06:38:23.810840+0000","last_became_peered":"2024-09-19T06:38:23.810840+0000","last_unstale":"2024-09-19T06:38:23.811305+0000","last_undegraded":"2024-09-19T06:38:23.811305+0000","last_fullsized":"2024-09-19T06:38:23.811305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.019065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066057+0000","last_change":"2024-09-19T06:38:12.047670+0000","last_active":"2024-09-19T06:38:23.066057+0000","last_peered":"2024-09-19T06:38:23.066057+0000","last_clean":"2024-09-19T06:38:23.066057+0000","last_became_active":"2024-09-19T06:38:12.047312+0000","last_became_peered":"2024-09-19T06:38:12.047312+0000","last_unstale":"2024-09-19T06:38:23.066057+0000","last_undegraded":"2024-09-19T06:38:23.066057+0000","last_fullsized":"2024-09-19T06:38:23.066057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:47.477945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061871+0000","last_change":"2024-09-19T06:38:14.047210+0000","last_active":"2024-09-19T06:38:23.061871+0000","last_peered":"2024-09-19T06:38:23.061871+0000","last_clean":"2024-09-19T06:38:23.061871+0000","last_became_active":"2024-09-19T06:38:14.046836+0000","last_became_peered":"2024-09-19T06:38:14.046836+0000","last_unstale":"2024-09-19T06:38:23.061871+0000","last_undegraded":"2024-09-19T06:38:23.061871+0000","last_fullsized":"2024-09-19T06:38:23.061871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:14.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672539+0000","last_change":"2024-09-19T06:38:12.032692+0000","last_active":"2024-09-19T06:38:25.672539+0000","last_peered":"2024-09-19T06:38:25.672539+0000","last_clean":"2024-09-19T06:38:25.672539+0000","last_became_active":"2024-09-19T06:38:12.031874+0000","last_became_peered":"2024-09-19T06:38:12.031874+0000","last_unstale":"2024-09-19T06:38:25.672539+0000","last_undegraded":"2024-09-19T06:38:25.672539+0000","last_fullsized":"2024-09-19T06:38:25.672539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.787964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061862+0000","last_change":"2024-09-19T06:38:14.053504+0000","last_active":"2024-09-19T06:38:23.061862+0000","last_peered":"2024-09-19T06:38:23.061862+0000","last_clean":"2024-09-19T06:38:23.061862+0000","last_became_active":"2024-09-19T06:38:14.053148+0000","last_became_peered":"2024-09-19T06:38:14.053148+0000","last_unstale":"2024-09-19T06:38:23.061862+0000","last_undegraded":"2024-09-19T06:38:23.061862+0000","last_fullsized":"2024-09-19T06:38:23.061862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:29.809295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667656+0000","last_change":"2024-09-19T06:38:12.038884+0000","last_active":"2024-09-19T06:38:24.667656+0000","last_peered":"2024-09-19T06:38:24.667656+0000","last_clean":"2024-09-19T06:38:24.667656+0000","last_became_active":"2024-09-19T06:38:12.038532+0000","last_became_peered":"2024-09-19T06:38:12.038532+0000","last_unstale":"2024-09-19T06:38:24.667656+0000","last_undegraded":"2024-09-19T06:38:24.667656+0000","last_fullsized":"2024-09-19T06:38:24.667656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.348690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810045+0000","last_change":"2024-09-19T06:38:14.045761+0000","last_active":"2024-09-19T06:38:23.810045+0000","last_peered":"2024-09-19T06:38:23.810045+0000","last_clean":"2024-09-19T06:38:23.810045+0000","last_became_active":"2024-09-19T06:38:14.045467+0000","last_became_peered":"2024-09-19T06:38:14.045467+0000","last_unstale":"2024-09-19T06:38:23.810045+0000","last_undegraded":"2024-09-19T06:38:23.810045+0000","last_fullsized":"2024-09-19T06:38:23.810045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.917945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062222+0000","last_change":"2024-09-19T06:38:12.039546+0000","last_active":"2024-09-19T06:38:23.062222+0000","last_peered":"2024-09-19T06:38:23.062222+0000","last_clean":"2024-09-19T06:38:23.062222+0000","last_became_active":"2024-09-19T06:38:12.039130+0000","last_became_peered":"2024-09-19T06:38:12.039130+0000","last_unstale":"2024-09-19T06:38:23.062222+0000","last_undegraded":"2024-09-19T06:38:23.062222+0000","last_fullsized":"2024-09-19T06:38:23.062222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:43.200022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059825+0000","last_change":"2024-09-19T06:38:14.053935+0000","last_active":"2024-09-19T06:38:23.059825+0000","last_peered":"2024-09-19T06:38:23.059825+0000","last_clean":"2024-09-19T06:38:23.059825+0000","last_became_active":"2024-09-19T06:38:14.053542+0000","last_became_peered":"2024-09-19T06:38:14.053542+0000","last_unstale":"2024-09-19T06:38:23.059825+0000","last_undegraded":"2024-09-19T06:38:23.059825+0000","last_fullsized":"2024-09-19T06:38:23.059825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:25.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.177494+0000","last_change":"2024-09-19T06:38:23.177133+0000","last_active":"2024-09-19T06:38:23.177494+0000","last_peered":"2024-09-19T06:38:23.177494+0000","last_clean":"2024-09-19T06:38:23.177494+0000","last_became_active":"2024-09-19T06:38:23.176810+0000","last_became_peered":"2024-09-19T06:38:23.176810+0000","last_unstale":"2024-09-19T06:38:23.177494+0000","last_undegraded":"2024-09-19T06:38:23.177494+0000","last_fullsized":"2024-09-19T06:38:23.177494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:56.307720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672551+0000","last_change":"2024-09-19T06:38:12.042699+0000","last_active":"2024-09-19T06:38:25.672551+0000","last_peered":"2024-09-19T06:38:25.672551+0000","last_clean":"2024-09-19T06:38:25.672551+0000","last_became_active":"2024-09-19T06:38:12.042148+0000","last_became_peered":"2024-09-19T06:38:12.042148+0000","last_unstale":"2024-09-19T06:38:25.672551+0000","last_undegraded":"2024-09-19T06:38:25.672551+0000","last_fullsized":"2024-09-19T06:38:25.672551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.953596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066455+0000","last_change":"2024-09-19T06:38:14.043279+0000","last_active":"2024-09-19T06:38:23.066455+0000","last_peered":"2024-09-19T06:38:23.066455+0000","last_clean":"2024-09-19T06:38:23.066455+0000","last_became_active":"2024-09-19T06:38:14.042914+0000","last_became_peered":"2024-09-19T06:38:14.042914+0000","last_unstale":"2024-09-19T06:38:23.066455+0000","last_undegraded":"2024-09-19T06:38:23.066455+0000","last_fullsized":"2024-09-19T06:38:23.066455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:22.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:26.681663+0000","last_change":"2024-09-19T06:38:12.038683+0000","last_active":"2024-09-19T06:38:26.681663+0000","last_peered":"2024-09-19T06:38:26.681663+0000","last_clean":"2024-09-19T06:38:26.681663+0000","last_became_active":"2024-09-19T06:38:12.038342+0000","last_became_peered":"2024-09-19T06:38:12.038342+0000","last_unstale":"2024-09-19T06:38:26.681663+0000","last_undegraded":"2024-09-19T06:38:26.681663+0000","last_fullsized":"2024-09-19T06:38:26.681663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:07.091418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062167+0000","last_change":"2024-09-19T06:38:14.041552+0000","last_active":"2024-09-19T06:38:23.062167+0000","last_peered":"2024-09-19T06:38:23.062167+0000","last_clean":"2024-09-19T06:38:23.062167+0000","last_became_active":"2024-09-19T06:38:14.041187+0000","last_became_peered":"2024-09-19T06:38:14.041187+0000","last_unstale":"2024-09-19T06:38:23.062167+0000","last_undegraded":"2024-09-19T06:38:23.062167+0000","last_fullsized":"2024-09-19T06:38:23.062167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:17.390457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810276+0000","last_change":"2024-09-19T06:38:12.047436+0000","last_active":"2024-09-19T06:38:23.810276+0000","last_peered":"2024-09-19T06:38:23.810276+0000","last_clean":"2024-09-19T06:38:23.810276+0000","last_became_active":"2024-09-19T06:38:12.046961+0000","last_became_peered":"2024-09-19T06:38:12.046961+0000","last_unstale":"2024-09-19T06:38:23.810276+0000","last_undegraded":"2024-09-19T06:38:23.810276+0000","last_fullsized":"2024-09-19T06:38:23.810276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810051+0000","last_change":"2024-09-19T06:38:14.049660+0000","last_active":"2024-09-19T06:38:23.810051+0000","last_peered":"2024-09-19T06:38:23.810051+0000","last_clean":"2024-09-19T06:38:23.810051+0000","last_became_active":"2024-09-19T06:38:14.049375+0000","last_became_peered":"2024-09-19T06:38:14.049375+0000","last_unstale":"2024-09-19T06:38:23.810051+0000","last_undegraded":"2024-09-19T06:38:23.810051+0000","last_fullsized":"2024-09-19T06:38:23.810051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:08.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:33.695040+0000","last_change":"2024-09-19T06:38:23.071068+0000","last_active":"2024-09-19T06:38:33.695040+0000","last_peered":"2024-09-19T06:38:33.695040+0000","last_clean":"2024-09-19T06:38:33.695040+0000","last_became_active":"2024-09-19T06:38:23.067129+0000","last_became_peered":"2024-09-19T06:38:23.067129+0000","last_unstale":"2024-09-19T06:38:33.695040+0000","last_undegraded":"2024-09-19T06:38:33.695040+0000","last_fullsized":"2024-09-19T06:38:33.695040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:15.387758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54403,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":152,"num_read_kb":132,"num_write":228,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2194,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":163209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547218,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36908,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708244,"statfs":{"total":95995035648,"available":95957241856,"internally_reserved":0,"allocated":1601536,"data_stored":1076800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":438899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1032190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528362,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":439009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1544192,"data_stored":1031475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":486294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":438441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":439520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40460,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704692,"statfs":{"total":95995035648,"available":95953604608,"internally_reserved":0,"allocated":978944,"data_stored":487396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":49619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":48517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:38:40.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:38:41.072 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.560+0000 7fef89521640 1 -- 172.21.15.12:0/2101094503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef84101420 msgr2=0x7fef8410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.560+0000 7fef89521640 1 --2- 172.21.15.12:0/2101094503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef84101420 0x7fef8410d950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009cd0 tx=0x7fef7c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.560+0000 7fef89521640 1 -- 172.21.15.12:0/2101094503 shutdown_connections 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.560+0000 7fef89521640 1 --2- 172.21.15.12:0/2101094503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef84101420 0x7fef8410d950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.560+0000 7fef89521640 1 --2- 172.21.15.12:0/2101094503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef84100a80 0x7fef84100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.560+0000 7fef89521640 1 --2- 172.21.15.12:0/2101094503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef84106a80 0x7fef84106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.560+0000 7fef89521640 1 -- 172.21.15.12:0/2101094503 >> 172.21.15.12:0/2101094503 conn(0x7fef840fc7a0 msgr2=0x7fef840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.560+0000 7fef89521640 1 -- 172.21.15.12:0/2101094503 shutdown_connections 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.560+0000 7fef89521640 1 -- 172.21.15.12:0/2101094503 wait complete. 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef89521640 1 Processor -- start 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef89521640 1 -- start start 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef89521640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef84100a80 0x7fef84198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef89521640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef84101420 0x7fef84198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef89521640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef84106a80 0x7fef8419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef89521640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fef84110ed0 con 0x7fef84106a80 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef89521640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef84110d50 con 0x7fef84100a80 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef89521640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fef84111050 con 0x7fef84101420 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef84106a80 0x7fef8419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef84106a80 0x7fef8419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49458/0 (socket says 172.21.15.12:49458) 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef837fe640 1 -- 172.21.15.12:0/693752546 learned_addr learned my addr 172.21.15.12:0/693752546 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef82ffd640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef84100a80 0x7fef84198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.561+0000 7fef827fc640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef84101420 0x7fef84198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef837fe640 1 -- 172.21.15.12:0/693752546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef84101420 msgr2=0x7fef84198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef837fe640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef84101420 0x7fef84198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef837fe640 1 -- 172.21.15.12:0/693752546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef84100a80 msgr2=0x7fef84198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef837fe640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef84100a80 0x7fef84198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef837fe640 1 -- 172.21.15.12:0/693752546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8419d400 con 0x7fef84106a80 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef837fe640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef84106a80 0x7fef8419cd20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fef7c033040 tx=0x7fef7c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef6bfff640 1 -- 172.21.15.12:0/693752546 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c004040 con 0x7fef84106a80 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef89521640 1 -- 172.21.15.12:0/693752546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8419d690 con 0x7fef84106a80 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef6bfff640 1 -- 172.21.15.12:0/693752546 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef7c0046c0 con 0x7fef84106a80 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef6bfff640 1 -- 172.21.15.12:0/693752546 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c046480 con 0x7fef84106a80 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.562+0000 7fef89521640 1 -- 172.21.15.12:0/693752546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef841a4fd0 con 0x7fef84106a80 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.563+0000 7fef89521640 1 -- 172.21.15.12:0/693752546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef84100ee0 con 0x7fef84106a80 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.564+0000 7fef6bfff640 1 -- 172.21.15.12:0/693752546 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fef7c0305a0 con 0x7fef84106a80 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.565+0000 7fef6bfff640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fef6c0a32d0 0x7fef6c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.565+0000 7fef82ffd640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fef6c0a32d0 0x7fef6c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:41.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.565+0000 7fef6bfff640 1 -- 172.21.15.12:0/693752546 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fef7c02e030 con 0x7fef84106a80 2024-09-19T06:38:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.566+0000 7fef82ffd640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fef6c0a32d0 0x7fef6c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef74005d00 tx=0x7fef7400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.568+0000 7fef6bfff640 1 -- 172.21.15.12:0/693752546 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef7c04b060 con 0x7fef84106a80 2024-09-19T06:38:41.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.742+0000 7fef89521640 1 -- 172.21.15.12:0/693752546 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef8406af00 con 0x7fef6c0a32d0 2024-09-19T06:38:41.744 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:41 smithi012 ceph-mon[30937]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-09-19T06:38:41.744 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:41 smithi012 ceph-mon[30937]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:38:41.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.749+0000 7fef6bfff640 1 -- 172.21.15.12:0/693752546 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258764 (secure 0 0 0) 0x7fef8406af00 con 0x7fef6c0a32d0 2024-09-19T06:38:41.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:41.754 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-19T06:38:41.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 -- 172.21.15.12:0/693752546 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fef6c0a32d0 msgr2=0x7fef6c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:41.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fef6c0a32d0 0x7fef6c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef74005d00 tx=0x7fef7400b410 comp rx=0 tx=0).stop 2024-09-19T06:38:41.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 -- 172.21.15.12:0/693752546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef84106a80 msgr2=0x7fef8419cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:41.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef84106a80 0x7fef8419cd20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fef7c033040 tx=0x7fef7c003970 comp rx=0 tx=0).stop 2024-09-19T06:38:41.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 -- 172.21.15.12:0/693752546 shutdown_connections 2024-09-19T06:38:41.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fef6c0a32d0 0x7fef6c0a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef84106a80 0x7fef8419cd20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef84101420 0x7fef84198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 --2- 172.21.15.12:0/693752546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef84100a80 0x7fef84198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:41.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 -- 172.21.15.12:0/693752546 >> 172.21.15.12:0/693752546 conn(0x7fef840fc7a0 msgr2=0x7fef8406a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:41.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 -- 172.21.15.12:0/693752546 shutdown_connections 2024-09-19T06:38:41.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:41.752+0000 7fef89521640 1 -- 172.21.15.12:0/693752546 wait complete. 2024-09-19T06:38:42.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:41 smithi016 ceph-mon[34911]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-09-19T06:38:42.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:41 smithi016 ceph-mon[34911]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:38:42.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:41 smithi173 ceph-mon[35349]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-09-19T06:38:42.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:41 smithi173 ceph-mon[35349]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:38:42.512 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-19T06:38:41.707304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653157,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":324,"num_read_kb":284,"num_write":420,"num_write_kb":3067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1182930,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344,"ondisk_log_size":344,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378752,"kb_used_data":12864,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563072,"statfs":{"total":1151940427776,"available":1151552585728,"internally_reserved":0,"allocated":13172736,"data_stored":7212795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53700,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":141,"num_read_kb":130,"num_write":42,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003156"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062049+0000","last_change":"2024-09-19T06:38:14.052943+0000","last_active":"2024-09-19T06:38:23.062049+0000","last_peered":"2024-09-19T06:38:23.062049+0000","last_clean":"2024-09-19T06:38:23.062049+0000","last_became_active":"2024-09-19T06:38:14.052054+0000","last_became_peered":"2024-09-19T06:38:14.052054+0000","last_unstale":"2024-09-19T06:38:23.062049+0000","last_undegraded":"2024-09-19T06:38:23.062049+0000","last_fullsized":"2024-09-19T06:38:23.062049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:28.898131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061619+0000","last_change":"2024-09-19T06:38:14.044916+0000","last_active":"2024-09-19T06:38:23.061619+0000","last_peered":"2024-09-19T06:38:23.061619+0000","last_clean":"2024-09-19T06:38:23.061619+0000","last_became_active":"2024-09-19T06:38:14.044596+0000","last_became_peered":"2024-09-19T06:38:14.044596+0000","last_unstale":"2024-09-19T06:38:23.061619+0000","last_undegraded":"2024-09-19T06:38:23.061619+0000","last_fullsized":"2024-09-19T06:38:23.061619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:04.402332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061792+0000","last_change":"2024-09-19T06:38:14.052765+0000","last_active":"2024-09-19T06:38:23.061792+0000","last_peered":"2024-09-19T06:38:23.061792+0000","last_clean":"2024-09-19T06:38:23.061792+0000","last_became_active":"2024-09-19T06:38:14.052219+0000","last_became_peered":"2024-09-19T06:38:14.052219+0000","last_unstale":"2024-09-19T06:38:23.061792+0000","last_undegraded":"2024-09-19T06:38:23.061792+0000","last_fullsized":"2024-09-19T06:38:23.061792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:13.317252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176087+0000","last_change":"2024-09-19T06:38:14.052421+0000","last_active":"2024-09-19T06:38:23.176087+0000","last_peered":"2024-09-19T06:38:23.176087+0000","last_clean":"2024-09-19T06:38:23.176087+0000","last_became_active":"2024-09-19T06:38:14.052094+0000","last_became_peered":"2024-09-19T06:38:14.052094+0000","last_unstale":"2024-09-19T06:38:23.176087+0000","last_undegraded":"2024-09-19T06:38:23.176087+0000","last_fullsized":"2024-09-19T06:38:23.176087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062049+0000","last_change":"2024-09-19T06:38:14.047736+0000","last_active":"2024-09-19T06:38:23.062049+0000","last_peered":"2024-09-19T06:38:23.062049+0000","last_clean":"2024-09-19T06:38:23.062049+0000","last_became_active":"2024-09-19T06:38:14.047396+0000","last_became_peered":"2024-09-19T06:38:14.047396+0000","last_unstale":"2024-09-19T06:38:23.062049+0000","last_undegraded":"2024-09-19T06:38:23.062049+0000","last_fullsized":"2024-09-19T06:38:23.062049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.855638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062689+0000","last_change":"2024-09-19T06:38:14.047793+0000","last_active":"2024-09-19T06:38:23.062689+0000","last_peered":"2024-09-19T06:38:23.062689+0000","last_clean":"2024-09-19T06:38:23.062689+0000","last_became_active":"2024-09-19T06:38:14.047198+0000","last_became_peered":"2024-09-19T06:38:14.047198+0000","last_unstale":"2024-09-19T06:38:23.062689+0000","last_undegraded":"2024-09-19T06:38:23.062689+0000","last_fullsized":"2024-09-19T06:38:23.062689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:42.507270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059759+0000","last_change":"2024-09-19T06:38:14.050025+0000","last_active":"2024-09-19T06:38:23.059759+0000","last_peered":"2024-09-19T06:38:23.059759+0000","last_clean":"2024-09-19T06:38:23.059759+0000","last_became_active":"2024-09-19T06:38:14.049591+0000","last_became_peered":"2024-09-19T06:38:14.049591+0000","last_unstale":"2024-09-19T06:38:23.059759+0000","last_undegraded":"2024-09-19T06:38:23.059759+0000","last_fullsized":"2024-09-19T06:38:23.059759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:49.487521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066039+0000","last_change":"2024-09-19T06:38:23.065490+0000","last_active":"2024-09-19T06:38:23.066039+0000","last_peered":"2024-09-19T06:38:23.066039+0000","last_clean":"2024-09-19T06:38:23.066039+0000","last_became_active":"2024-09-19T06:38:23.065151+0000","last_became_peered":"2024-09-19T06:38:23.065151+0000","last_unstale":"2024-09-19T06:38:23.066039+0000","last_undegraded":"2024-09-19T06:38:23.066039+0000","last_fullsized":"2024-09-19T06:38:23.066039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:42.184698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066896+0000","last_change":"2024-09-19T06:38:14.047395+0000","last_active":"2024-09-19T06:38:23.066896+0000","last_peered":"2024-09-19T06:38:23.066896+0000","last_clean":"2024-09-19T06:38:23.066896+0000","last_became_active":"2024-09-19T06:38:14.046975+0000","last_became_peered":"2024-09-19T06:38:14.046975+0000","last_unstale":"2024-09-19T06:38:23.066896+0000","last_undegraded":"2024-09-19T06:38:23.066896+0000","last_fullsized":"2024-09-19T06:38:23.066896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:18.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063290+0000","last_change":"2024-09-19T06:38:14.055042+0000","last_active":"2024-09-19T06:38:23.063290+0000","last_peered":"2024-09-19T06:38:23.063290+0000","last_clean":"2024-09-19T06:38:23.063290+0000","last_became_active":"2024-09-19T06:38:14.054664+0000","last_became_peered":"2024-09-19T06:38:14.054664+0000","last_unstale":"2024-09-19T06:38:23.063290+0000","last_undegraded":"2024-09-19T06:38:23.063290+0000","last_fullsized":"2024-09-19T06:38:23.063290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.815277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060084+0000","last_change":"2024-09-19T06:38:14.055106+0000","last_active":"2024-09-19T06:38:23.060084+0000","last_peered":"2024-09-19T06:38:23.060084+0000","last_clean":"2024-09-19T06:38:23.060084+0000","last_became_active":"2024-09-19T06:38:14.054721+0000","last_became_peered":"2024-09-19T06:38:14.054721+0000","last_unstale":"2024-09-19T06:38:23.060084+0000","last_undegraded":"2024-09-19T06:38:23.060084+0000","last_fullsized":"2024-09-19T06:38:23.060084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:39.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176197+0000","last_change":"2024-09-19T06:38:14.051796+0000","last_active":"2024-09-19T06:38:23.176197+0000","last_peered":"2024-09-19T06:38:23.176197+0000","last_clean":"2024-09-19T06:38:23.176197+0000","last_became_active":"2024-09-19T06:38:14.048338+0000","last_became_peered":"2024-09-19T06:38:14.048338+0000","last_unstale":"2024-09-19T06:38:23.176197+0000","last_undegraded":"2024-09-19T06:38:23.176197+0000","last_fullsized":"2024-09-19T06:38:23.176197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:48.656819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174656+0000","last_change":"2024-09-19T06:38:14.048607+0000","last_active":"2024-09-19T06:38:23.174656+0000","last_peered":"2024-09-19T06:38:23.174656+0000","last_clean":"2024-09-19T06:38:23.174656+0000","last_became_active":"2024-09-19T06:38:14.047277+0000","last_became_peered":"2024-09-19T06:38:14.047277+0000","last_unstale":"2024-09-19T06:38:23.174656+0000","last_undegraded":"2024-09-19T06:38:23.174656+0000","last_fullsized":"2024-09-19T06:38:23.174656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:52.904376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061453+0000","last_change":"2024-09-19T06:38:14.050759+0000","last_active":"2024-09-19T06:38:23.061453+0000","last_peered":"2024-09-19T06:38:23.061453+0000","last_clean":"2024-09-19T06:38:23.061453+0000","last_became_active":"2024-09-19T06:38:14.049900+0000","last_became_peered":"2024-09-19T06:38:14.049900+0000","last_unstale":"2024-09-19T06:38:23.061453+0000","last_undegraded":"2024-09-19T06:38:23.061453+0000","last_fullsized":"2024-09-19T06:38:23.061453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:45.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061420+0000","last_change":"2024-09-19T06:38:14.058890+0000","last_active":"2024-09-19T06:38:23.061420+0000","last_peered":"2024-09-19T06:38:23.061420+0000","last_clean":"2024-09-19T06:38:23.061420+0000","last_became_active":"2024-09-19T06:38:14.058442+0000","last_became_peered":"2024-09-19T06:38:14.058442+0000","last_unstale":"2024-09-19T06:38:23.061420+0000","last_undegraded":"2024-09-19T06:38:23.061420+0000","last_fullsized":"2024-09-19T06:38:23.061420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:27.296578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066180+0000","last_change":"2024-09-19T06:38:14.050371+0000","last_active":"2024-09-19T06:38:23.066180+0000","last_peered":"2024-09-19T06:38:23.066180+0000","last_clean":"2024-09-19T06:38:23.066180+0000","last_became_active":"2024-09-19T06:38:14.049930+0000","last_became_peered":"2024-09-19T06:38:14.049930+0000","last_unstale":"2024-09-19T06:38:23.066180+0000","last_undegraded":"2024-09-19T06:38:23.066180+0000","last_fullsized":"2024-09-19T06:38:23.066180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:37.898624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062160+0000","last_change":"2024-09-19T06:38:14.052521+0000","last_active":"2024-09-19T06:38:23.062160+0000","last_peered":"2024-09-19T06:38:23.062160+0000","last_clean":"2024-09-19T06:38:23.062160+0000","last_became_active":"2024-09-19T06:38:14.052083+0000","last_became_peered":"2024-09-19T06:38:14.052083+0000","last_unstale":"2024-09-19T06:38:23.062160+0000","last_undegraded":"2024-09-19T06:38:23.062160+0000","last_fullsized":"2024-09-19T06:38:23.062160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:10.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059333+0000","last_change":"2024-09-19T06:38:14.044747+0000","last_active":"2024-09-19T06:38:23.059333+0000","last_peered":"2024-09-19T06:38:23.059333+0000","last_clean":"2024-09-19T06:38:23.059333+0000","last_became_active":"2024-09-19T06:38:14.044451+0000","last_became_peered":"2024-09-19T06:38:14.044451+0000","last_unstale":"2024-09-19T06:38:23.059333+0000","last_undegraded":"2024-09-19T06:38:23.059333+0000","last_fullsized":"2024-09-19T06:38:23.059333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:04.067156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067040+0000","last_change":"2024-09-19T06:38:14.056101+0000","last_active":"2024-09-19T06:38:23.067040+0000","last_peered":"2024-09-19T06:38:23.067040+0000","last_clean":"2024-09-19T06:38:23.067040+0000","last_became_active":"2024-09-19T06:38:14.055682+0000","last_became_peered":"2024-09-19T06:38:14.055682+0000","last_unstale":"2024-09-19T06:38:23.067040+0000","last_undegraded":"2024-09-19T06:38:23.067040+0000","last_fullsized":"2024-09-19T06:38:23.067040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:23.921766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061285+0000","last_change":"2024-09-19T06:38:14.059441+0000","last_active":"2024-09-19T06:38:23.061285+0000","last_peered":"2024-09-19T06:38:23.061285+0000","last_clean":"2024-09-19T06:38:23.061285+0000","last_became_active":"2024-09-19T06:38:14.059123+0000","last_became_peered":"2024-09-19T06:38:14.059123+0000","last_unstale":"2024-09-19T06:38:23.061285+0000","last_undegraded":"2024-09-19T06:38:23.061285+0000","last_fullsized":"2024-09-19T06:38:23.061285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:32.148741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174697+0000","last_change":"2024-09-19T06:38:14.050336+0000","last_active":"2024-09-19T06:38:23.174697+0000","last_peered":"2024-09-19T06:38:23.174697+0000","last_clean":"2024-09-19T06:38:23.174697+0000","last_became_active":"2024-09-19T06:38:14.050041+0000","last_became_peered":"2024-09-19T06:38:14.050041+0000","last_unstale":"2024-09-19T06:38:23.174697+0000","last_undegraded":"2024-09-19T06:38:23.174697+0000","last_fullsized":"2024-09-19T06:38:23.174697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:09.245804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066396+0000","last_change":"2024-09-19T06:38:14.050280+0000","last_active":"2024-09-19T06:38:23.066396+0000","last_peered":"2024-09-19T06:38:23.066396+0000","last_clean":"2024-09-19T06:38:23.066396+0000","last_became_active":"2024-09-19T06:38:14.049874+0000","last_became_peered":"2024-09-19T06:38:14.049874+0000","last_unstale":"2024-09-19T06:38:23.066396+0000","last_undegraded":"2024-09-19T06:38:23.066396+0000","last_fullsized":"2024-09-19T06:38:23.066396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:52.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.809784+0000","last_change":"2024-09-19T06:38:14.048294+0000","last_active":"2024-09-19T06:38:23.809784+0000","last_peered":"2024-09-19T06:38:23.809784+0000","last_clean":"2024-09-19T06:38:23.809784+0000","last_became_active":"2024-09-19T06:38:14.048002+0000","last_became_peered":"2024-09-19T06:38:14.048002+0000","last_unstale":"2024-09-19T06:38:23.809784+0000","last_undegraded":"2024-09-19T06:38:23.809784+0000","last_fullsized":"2024-09-19T06:38:23.809784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:55.920027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062988+0000","last_change":"2024-09-19T06:38:14.050244+0000","last_active":"2024-09-19T06:38:23.062988+0000","last_peered":"2024-09-19T06:38:23.062988+0000","last_clean":"2024-09-19T06:38:23.062988+0000","last_became_active":"2024-09-19T06:38:14.049499+0000","last_became_peered":"2024-09-19T06:38:14.049499+0000","last_unstale":"2024-09-19T06:38:23.062988+0000","last_undegraded":"2024-09-19T06:38:23.062988+0000","last_fullsized":"2024-09-19T06:38:23.062988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:35.506647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810013+0000","last_change":"2024-09-19T06:38:14.048779+0000","last_active":"2024-09-19T06:38:23.810013+0000","last_peered":"2024-09-19T06:38:23.810013+0000","last_clean":"2024-09-19T06:38:23.810013+0000","last_became_active":"2024-09-19T06:38:14.048492+0000","last_became_peered":"2024-09-19T06:38:14.048492+0000","last_unstale":"2024-09-19T06:38:23.810013+0000","last_undegraded":"2024-09-19T06:38:23.810013+0000","last_fullsized":"2024-09-19T06:38:23.810013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:01.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067146+0000","last_change":"2024-09-19T06:38:14.054442+0000","last_active":"2024-09-19T06:38:23.067146+0000","last_peered":"2024-09-19T06:38:23.067146+0000","last_clean":"2024-09-19T06:38:23.067146+0000","last_became_active":"2024-09-19T06:38:14.053903+0000","last_became_peered":"2024-09-19T06:38:14.053903+0000","last_unstale":"2024-09-19T06:38:23.067146+0000","last_undegraded":"2024-09-19T06:38:23.067146+0000","last_fullsized":"2024-09-19T06:38:23.067146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:42.002146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061889+0000","last_change":"2024-09-19T06:38:14.051139+0000","last_active":"2024-09-19T06:38:23.061889+0000","last_peered":"2024-09-19T06:38:23.061889+0000","last_clean":"2024-09-19T06:38:23.061889+0000","last_became_active":"2024-09-19T06:38:14.050764+0000","last_became_peered":"2024-09-19T06:38:14.050764+0000","last_unstale":"2024-09-19T06:38:23.061889+0000","last_undegraded":"2024-09-19T06:38:23.061889+0000","last_fullsized":"2024-09-19T06:38:23.061889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.379184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174574+0000","last_change":"2024-09-19T06:38:14.054614+0000","last_active":"2024-09-19T06:38:23.174574+0000","last_peered":"2024-09-19T06:38:23.174574+0000","last_clean":"2024-09-19T06:38:23.174574+0000","last_became_active":"2024-09-19T06:38:14.054280+0000","last_became_peered":"2024-09-19T06:38:14.054280+0000","last_unstale":"2024-09-19T06:38:23.174574+0000","last_undegraded":"2024-09-19T06:38:23.174574+0000","last_fullsized":"2024-09-19T06:38:23.174574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:21.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061680+0000","last_change":"2024-09-19T06:38:14.056215+0000","last_active":"2024-09-19T06:38:23.061680+0000","last_peered":"2024-09-19T06:38:23.061680+0000","last_clean":"2024-09-19T06:38:23.061680+0000","last_became_active":"2024-09-19T06:38:14.055875+0000","last_became_peered":"2024-09-19T06:38:14.055875+0000","last_unstale":"2024-09-19T06:38:23.061680+0000","last_undegraded":"2024-09-19T06:38:23.061680+0000","last_fullsized":"2024-09-19T06:38:23.061680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:45.347185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066728+0000","last_change":"2024-09-19T06:38:14.057963+0000","last_active":"2024-09-19T06:38:23.066728+0000","last_peered":"2024-09-19T06:38:23.066728+0000","last_clean":"2024-09-19T06:38:23.066728+0000","last_became_active":"2024-09-19T06:38:14.057578+0000","last_became_peered":"2024-09-19T06:38:14.057578+0000","last_unstale":"2024-09-19T06:38:23.066728+0000","last_undegraded":"2024-09-19T06:38:23.066728+0000","last_fullsized":"2024-09-19T06:38:23.066728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:26.173414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066558+0000","last_change":"2024-09-19T06:38:14.058840+0000","last_active":"2024-09-19T06:38:23.066558+0000","last_peered":"2024-09-19T06:38:23.066558+0000","last_clean":"2024-09-19T06:38:23.066558+0000","last_became_active":"2024-09-19T06:38:14.058418+0000","last_became_peered":"2024-09-19T06:38:14.058418+0000","last_unstale":"2024-09-19T06:38:23.066558+0000","last_undegraded":"2024-09-19T06:38:23.066558+0000","last_fullsized":"2024-09-19T06:38:23.066558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:13.624750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061748+0000","last_change":"2024-09-19T06:38:14.053363+0000","last_active":"2024-09-19T06:38:23.061748+0000","last_peered":"2024-09-19T06:38:23.061748+0000","last_clean":"2024-09-19T06:38:23.061748+0000","last_became_active":"2024-09-19T06:38:14.053039+0000","last_became_peered":"2024-09-19T06:38:14.053039+0000","last_unstale":"2024-09-19T06:38:23.061748+0000","last_undegraded":"2024-09-19T06:38:23.061748+0000","last_fullsized":"2024-09-19T06:38:23.061748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.274885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062028+0000","last_change":"2024-09-19T06:38:14.045719+0000","last_active":"2024-09-19T06:38:23.062028+0000","last_peered":"2024-09-19T06:38:23.062028+0000","last_clean":"2024-09-19T06:38:23.062028+0000","last_became_active":"2024-09-19T06:38:14.045285+0000","last_became_peered":"2024-09-19T06:38:14.045285+0000","last_unstale":"2024-09-19T06:38:23.062028+0000","last_undegraded":"2024-09-19T06:38:23.062028+0000","last_fullsized":"2024-09-19T06:38:23.062028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:16.877802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:36.675677+0000","last_change":"2024-09-19T06:38:23.177942+0000","last_active":"2024-09-19T06:38:36.675677+0000","last_peered":"2024-09-19T06:38:36.675677+0000","last_clean":"2024-09-19T06:38:36.675677+0000","last_became_active":"2024-09-19T06:38:23.176579+0000","last_became_peered":"2024-09-19T06:38:23.176579+0000","last_unstale":"2024-09-19T06:38:36.675677+0000","last_undegraded":"2024-09-19T06:38:36.675677+0000","last_fullsized":"2024-09-19T06:38:36.675677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:28.140245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.811603+0000","last_change":"2024-09-19T06:38:23.811603+0000","last_active":"2024-09-19T06:38:23.811603+0000","last_peered":"2024-09-19T06:38:23.811603+0000","last_clean":"2024-09-19T06:38:23.811603+0000","last_became_active":"2024-09-19T06:38:23.811139+0000","last_became_peered":"2024-09-19T06:38:23.811139+0000","last_unstale":"2024-09-19T06:38:23.811603+0000","last_undegraded":"2024-09-19T06:38:23.811603+0000","last_fullsized":"2024-09-19T06:38:23.811603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:42.082355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667648+0000","last_change":"2024-09-19T06:38:12.041330+0000","last_active":"2024-09-19T06:38:24.667648+0000","last_peered":"2024-09-19T06:38:24.667648+0000","last_clean":"2024-09-19T06:38:24.667648+0000","last_became_active":"2024-09-19T06:38:12.040992+0000","last_became_peered":"2024-09-19T06:38:12.040992+0000","last_unstale":"2024-09-19T06:38:24.667648+0000","last_undegraded":"2024-09-19T06:38:24.667648+0000","last_fullsized":"2024-09-19T06:38:24.667648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:51.721009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.079837+0000","last_change":"2024-09-19T06:38:12.034534+0000","last_active":"2024-09-19T06:38:24.079837+0000","last_peered":"2024-09-19T06:38:24.079837+0000","last_clean":"2024-09-19T06:38:24.079837+0000","last_became_active":"2024-09-19T06:38:12.034209+0000","last_became_peered":"2024-09-19T06:38:12.034209+0000","last_unstale":"2024-09-19T06:38:24.079837+0000","last_undegraded":"2024-09-19T06:38:24.079837+0000","last_fullsized":"2024-09-19T06:38:24.079837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:40.640464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.809975+0000","last_change":"2024-09-19T06:38:14.043287+0000","last_active":"2024-09-19T06:38:23.809975+0000","last_peered":"2024-09-19T06:38:23.809975+0000","last_clean":"2024-09-19T06:38:23.809975+0000","last_became_active":"2024-09-19T06:38:14.042565+0000","last_became_peered":"2024-09-19T06:38:14.042565+0000","last_unstale":"2024-09-19T06:38:23.809975+0000","last_undegraded":"2024-09-19T06:38:23.809975+0000","last_fullsized":"2024-09-19T06:38:23.809975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:32.689929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.671515+0000","last_change":"2024-09-19T06:38:12.039142+0000","last_active":"2024-09-19T06:38:25.671515+0000","last_peered":"2024-09-19T06:38:25.671515+0000","last_clean":"2024-09-19T06:38:25.671515+0000","last_became_active":"2024-09-19T06:38:12.038815+0000","last_became_peered":"2024-09-19T06:38:12.038815+0000","last_unstale":"2024-09-19T06:38:25.671515+0000","last_undegraded":"2024-09-19T06:38:25.671515+0000","last_fullsized":"2024-09-19T06:38:25.671515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:03.316742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059107+0000","last_change":"2024-09-19T06:38:14.044778+0000","last_active":"2024-09-19T06:38:23.059107+0000","last_peered":"2024-09-19T06:38:23.059107+0000","last_clean":"2024-09-19T06:38:23.059107+0000","last_became_active":"2024-09-19T06:38:14.044457+0000","last_became_peered":"2024-09-19T06:38:14.044457+0000","last_unstale":"2024-09-19T06:38:23.059107+0000","last_undegraded":"2024-09-19T06:38:23.059107+0000","last_fullsized":"2024-09-19T06:38:23.059107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:06.342070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:39.679321+0000","last_change":"2024-09-19T06:38:12.039031+0000","last_active":"2024-09-19T06:38:39.679321+0000","last_peered":"2024-09-19T06:38:39.679321+0000","last_clean":"2024-09-19T06:38:39.679321+0000","last_became_active":"2024-09-19T06:38:12.038346+0000","last_became_peered":"2024-09-19T06:38:12.038346+0000","last_unstale":"2024-09-19T06:38:39.679321+0000","last_undegraded":"2024-09-19T06:38:39.679321+0000","last_fullsized":"2024-09-19T06:38:39.679321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:33.752330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066715+0000","last_change":"2024-09-19T06:38:14.045159+0000","last_active":"2024-09-19T06:38:23.066715+0000","last_peered":"2024-09-19T06:38:23.066715+0000","last_clean":"2024-09-19T06:38:23.066715+0000","last_became_active":"2024-09-19T06:38:14.044822+0000","last_became_peered":"2024-09-19T06:38:14.044822+0000","last_unstale":"2024-09-19T06:38:23.066715+0000","last_undegraded":"2024-09-19T06:38:23.066715+0000","last_fullsized":"2024-09-19T06:38:23.066715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:05.143507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670553+0000","last_change":"2024-09-19T06:38:12.037820+0000","last_active":"2024-09-19T06:38:25.670553+0000","last_peered":"2024-09-19T06:38:25.670553+0000","last_clean":"2024-09-19T06:38:25.670553+0000","last_became_active":"2024-09-19T06:38:12.037417+0000","last_became_peered":"2024-09-19T06:38:12.037417+0000","last_unstale":"2024-09-19T06:38:25.670553+0000","last_undegraded":"2024-09-19T06:38:25.670553+0000","last_fullsized":"2024-09-19T06:38:25.670553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:22.516704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062170+0000","last_change":"2024-09-19T06:38:14.048633+0000","last_active":"2024-09-19T06:38:23.062170+0000","last_peered":"2024-09-19T06:38:23.062170+0000","last_clean":"2024-09-19T06:38:23.062170+0000","last_became_active":"2024-09-19T06:38:14.048257+0000","last_became_peered":"2024-09-19T06:38:14.048257+0000","last_unstale":"2024-09-19T06:38:23.062170+0000","last_undegraded":"2024-09-19T06:38:23.062170+0000","last_fullsized":"2024-09-19T06:38:23.062170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:16.509071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.657953+0000","last_change":"2024-09-19T06:38:12.047175+0000","last_active":"2024-09-19T06:38:24.657953+0000","last_peered":"2024-09-19T06:38:24.657953+0000","last_clean":"2024-09-19T06:38:24.657953+0000","last_became_active":"2024-09-19T06:38:12.046781+0000","last_became_peered":"2024-09-19T06:38:12.046781+0000","last_unstale":"2024-09-19T06:38:24.657953+0000","last_undegraded":"2024-09-19T06:38:24.657953+0000","last_fullsized":"2024-09-19T06:38:24.657953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:38.774803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067812+0000","last_change":"2024-09-19T06:38:23.067812+0000","last_active":"2024-09-19T06:38:23.067812+0000","last_peered":"2024-09-19T06:38:23.067812+0000","last_clean":"2024-09-19T06:38:23.067812+0000","last_became_active":"2024-09-19T06:38:23.067357+0000","last_became_peered":"2024-09-19T06:38:23.067357+0000","last_unstale":"2024-09-19T06:38:23.067812+0000","last_undegraded":"2024-09-19T06:38:23.067812+0000","last_fullsized":"2024-09-19T06:38:23.067812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:34.719243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'27","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:39.679721+0000","last_change":"2024-09-19T06:38:23.186703+0000","last_active":"2024-09-19T06:38:39.679721+0000","last_peered":"2024-09-19T06:38:39.679721+0000","last_clean":"2024-09-19T06:38:39.679721+0000","last_became_active":"2024-09-19T06:38:23.177212+0000","last_became_peered":"2024-09-19T06:38:23.177212+0000","last_unstale":"2024-09-19T06:38:39.679721+0000","last_undegraded":"2024-09-19T06:38:39.679721+0000","last_fullsized":"2024-09-19T06:38:39.679721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:46.884624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54954,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":71,"num_write":29,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063284+0000","last_change":"2024-09-19T06:38:14.054619+0000","last_active":"2024-09-19T06:38:23.063284+0000","last_peered":"2024-09-19T06:38:23.063284+0000","last_clean":"2024-09-19T06:38:23.063284+0000","last_became_active":"2024-09-19T06:38:14.054118+0000","last_became_peered":"2024-09-19T06:38:14.054118+0000","last_unstale":"2024-09-19T06:38:23.063284+0000","last_undegraded":"2024-09-19T06:38:23.063284+0000","last_fullsized":"2024-09-19T06:38:23.063284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:41.041603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.673593+0000","last_change":"2024-09-19T06:38:12.040272+0000","last_active":"2024-09-19T06:38:25.673593+0000","last_peered":"2024-09-19T06:38:25.673593+0000","last_clean":"2024-09-19T06:38:25.673593+0000","last_became_active":"2024-09-19T06:38:12.039940+0000","last_became_peered":"2024-09-19T06:38:12.039940+0000","last_unstale":"2024-09-19T06:38:25.673593+0000","last_undegraded":"2024-09-19T06:38:25.673593+0000","last_fullsized":"2024-09-19T06:38:25.673593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:53.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174406+0000","last_change":"2024-09-19T06:38:14.049535+0000","last_active":"2024-09-19T06:38:23.174406+0000","last_peered":"2024-09-19T06:38:23.174406+0000","last_clean":"2024-09-19T06:38:23.174406+0000","last_became_active":"2024-09-19T06:38:14.049208+0000","last_became_peered":"2024-09-19T06:38:14.049208+0000","last_unstale":"2024-09-19T06:38:23.174406+0000","last_undegraded":"2024-09-19T06:38:23.174406+0000","last_fullsized":"2024-09-19T06:38:23.174406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:03.359786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670196+0000","last_change":"2024-09-19T06:38:12.037346+0000","last_active":"2024-09-19T06:38:25.670196+0000","last_peered":"2024-09-19T06:38:25.670196+0000","last_clean":"2024-09-19T06:38:25.670196+0000","last_became_active":"2024-09-19T06:38:12.036986+0000","last_became_peered":"2024-09-19T06:38:12.036986+0000","last_unstale":"2024-09-19T06:38:25.670196+0000","last_undegraded":"2024-09-19T06:38:25.670196+0000","last_fullsized":"2024-09-19T06:38:25.670196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:26.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059848+0000","last_change":"2024-09-19T06:38:14.059454+0000","last_active":"2024-09-19T06:38:23.059848+0000","last_peered":"2024-09-19T06:38:23.059848+0000","last_clean":"2024-09-19T06:38:23.059848+0000","last_became_active":"2024-09-19T06:38:14.058996+0000","last_became_peered":"2024-09-19T06:38:14.058996+0000","last_unstale":"2024-09-19T06:38:23.059848+0000","last_undegraded":"2024-09-19T06:38:23.059848+0000","last_fullsized":"2024-09-19T06:38:23.059848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:54.645395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:38.677857+0000","last_change":"2024-09-19T06:38:12.043687+0000","last_active":"2024-09-19T06:38:38.677857+0000","last_peered":"2024-09-19T06:38:38.677857+0000","last_clean":"2024-09-19T06:38:38.677857+0000","last_became_active":"2024-09-19T06:38:12.043268+0000","last_became_peered":"2024-09-19T06:38:12.043268+0000","last_unstale":"2024-09-19T06:38:38.677857+0000","last_undegraded":"2024-09-19T06:38:38.677857+0000","last_fullsized":"2024-09-19T06:38:38.677857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:18.753736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059613+0000","last_change":"2024-09-19T06:38:14.052184+0000","last_active":"2024-09-19T06:38:23.059613+0000","last_peered":"2024-09-19T06:38:23.059613+0000","last_clean":"2024-09-19T06:38:23.059613+0000","last_became_active":"2024-09-19T06:38:14.051736+0000","last_became_peered":"2024-09-19T06:38:14.051736+0000","last_unstale":"2024-09-19T06:38:23.059613+0000","last_undegraded":"2024-09-19T06:38:23.059613+0000","last_fullsized":"2024-09-19T06:38:23.059613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:12.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667007+0000","last_change":"2024-09-19T06:38:12.048418+0000","last_active":"2024-09-19T06:38:24.667007+0000","last_peered":"2024-09-19T06:38:24.667007+0000","last_clean":"2024-09-19T06:38:24.667007+0000","last_became_active":"2024-09-19T06:38:12.047948+0000","last_became_peered":"2024-09-19T06:38:12.047948+0000","last_unstale":"2024-09-19T06:38:24.667007+0000","last_undegraded":"2024-09-19T06:38:24.667007+0000","last_fullsized":"2024-09-19T06:38:24.667007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:06.059904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176378+0000","last_change":"2024-09-19T06:38:23.175961+0000","last_active":"2024-09-19T06:38:23.176378+0000","last_peered":"2024-09-19T06:38:23.176378+0000","last_clean":"2024-09-19T06:38:23.176378+0000","last_became_active":"2024-09-19T06:38:23.175629+0000","last_became_peered":"2024-09-19T06:38:23.175629+0000","last_unstale":"2024-09-19T06:38:23.176378+0000","last_undegraded":"2024-09-19T06:38:23.176378+0000","last_fullsized":"2024-09-19T06:38:23.176378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.655577+0000","last_change":"2024-09-19T06:38:12.038945+0000","last_active":"2024-09-19T06:38:24.655577+0000","last_peered":"2024-09-19T06:38:24.655577+0000","last_clean":"2024-09-19T06:38:24.655577+0000","last_became_active":"2024-09-19T06:38:12.038571+0000","last_became_peered":"2024-09-19T06:38:12.038571+0000","last_unstale":"2024-09-19T06:38:24.655577+0000","last_undegraded":"2024-09-19T06:38:24.655577+0000","last_fullsized":"2024-09-19T06:38:24.655577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:57.887070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061540+0000","last_change":"2024-09-19T06:38:14.056481+0000","last_active":"2024-09-19T06:38:23.061540+0000","last_peered":"2024-09-19T06:38:23.061540+0000","last_clean":"2024-09-19T06:38:23.061540+0000","last_became_active":"2024-09-19T06:38:14.056177+0000","last_became_peered":"2024-09-19T06:38:14.056177+0000","last_unstale":"2024-09-19T06:38:23.061540+0000","last_undegraded":"2024-09-19T06:38:23.061540+0000","last_fullsized":"2024-09-19T06:38:23.061540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.734802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.668174+0000","last_change":"2024-09-19T06:38:12.038826+0000","last_active":"2024-09-19T06:38:25.668174+0000","last_peered":"2024-09-19T06:38:25.668174+0000","last_clean":"2024-09-19T06:38:25.668174+0000","last_became_active":"2024-09-19T06:38:12.038516+0000","last_became_peered":"2024-09-19T06:38:12.038516+0000","last_unstale":"2024-09-19T06:38:25.668174+0000","last_undegraded":"2024-09-19T06:38:25.668174+0000","last_fullsized":"2024-09-19T06:38:25.668174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:16.709742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060031+0000","last_change":"2024-09-19T06:38:14.053888+0000","last_active":"2024-09-19T06:38:23.060031+0000","last_peered":"2024-09-19T06:38:23.060031+0000","last_clean":"2024-09-19T06:38:23.060031+0000","last_became_active":"2024-09-19T06:38:14.053524+0000","last_became_peered":"2024-09-19T06:38:14.053524+0000","last_unstale":"2024-09-19T06:38:23.060031+0000","last_undegraded":"2024-09-19T06:38:23.060031+0000","last_fullsized":"2024-09-19T06:38:23.060031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:54.853786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667849+0000","last_change":"2024-09-19T06:38:12.040842+0000","last_active":"2024-09-19T06:38:24.667849+0000","last_peered":"2024-09-19T06:38:24.667849+0000","last_clean":"2024-09-19T06:38:24.667849+0000","last_became_active":"2024-09-19T06:38:12.040463+0000","last_became_peered":"2024-09-19T06:38:12.040463+0000","last_unstale":"2024-09-19T06:38:24.667849+0000","last_undegraded":"2024-09-19T06:38:24.667849+0000","last_fullsized":"2024-09-19T06:38:24.667849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:29.726632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060279+0000","last_change":"2024-09-19T06:38:14.052210+0000","last_active":"2024-09-19T06:38:23.060279+0000","last_peered":"2024-09-19T06:38:23.060279+0000","last_clean":"2024-09-19T06:38:23.060279+0000","last_became_active":"2024-09-19T06:38:14.051803+0000","last_became_peered":"2024-09-19T06:38:14.051803+0000","last_unstale":"2024-09-19T06:38:23.060279+0000","last_undegraded":"2024-09-19T06:38:23.060279+0000","last_fullsized":"2024-09-19T06:38:23.060279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:40.751672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:37.701415+0000","last_change":"2024-09-19T06:38:12.118077+0000","last_active":"2024-09-19T06:38:37.701415+0000","last_peered":"2024-09-19T06:38:37.701415+0000","last_clean":"2024-09-19T06:38:37.701415+0000","last_became_active":"2024-09-19T06:38:12.117690+0000","last_became_peered":"2024-09-19T06:38:12.117690+0000","last_unstale":"2024-09-19T06:38:37.701415+0000","last_undegraded":"2024-09-19T06:38:37.701415+0000","last_fullsized":"2024-09-19T06:38:37.701415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.828335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060217+0000","last_change":"2024-09-19T06:38:14.054014+0000","last_active":"2024-09-19T06:38:23.060217+0000","last_peered":"2024-09-19T06:38:23.060217+0000","last_clean":"2024-09-19T06:38:23.060217+0000","last_became_active":"2024-09-19T06:38:14.053349+0000","last_became_peered":"2024-09-19T06:38:14.053349+0000","last_unstale":"2024-09-19T06:38:23.060217+0000","last_undegraded":"2024-09-19T06:38:23.060217+0000","last_fullsized":"2024-09-19T06:38:23.060217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:40.117720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059973+0000","last_change":"2024-09-19T06:37:02.166696+0000","last_active":"2024-09-19T06:38:23.059973+0000","last_peered":"2024-09-19T06:38:23.059973+0000","last_clean":"2024-09-19T06:38:23.059973+0000","last_became_active":"2024-09-19T06:37:02.166225+0000","last_became_peered":"2024-09-19T06:37:02.166225+0000","last_unstale":"2024-09-19T06:38:23.059973+0000","last_undegraded":"2024-09-19T06:38:23.059973+0000","last_fullsized":"2024-09-19T06:38:23.059973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_clean_scrub_stamp":"2024-09-19T06:33:40.535354+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:46.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672803+0000","last_change":"2024-09-19T06:38:12.044465+0000","last_active":"2024-09-19T06:38:25.672803+0000","last_peered":"2024-09-19T06:38:25.672803+0000","last_clean":"2024-09-19T06:38:25.672803+0000","last_became_active":"2024-09-19T06:38:12.044042+0000","last_became_peered":"2024-09-19T06:38:12.044042+0000","last_unstale":"2024-09-19T06:38:25.672803+0000","last_undegraded":"2024-09-19T06:38:25.672803+0000","last_fullsized":"2024-09-19T06:38:25.672803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:40.759264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810103+0000","last_change":"2024-09-19T06:38:14.045102+0000","last_active":"2024-09-19T06:38:23.810103+0000","last_peered":"2024-09-19T06:38:23.810103+0000","last_clean":"2024-09-19T06:38:23.810103+0000","last_became_active":"2024-09-19T06:38:14.044785+0000","last_became_peered":"2024-09-19T06:38:14.044785+0000","last_unstale":"2024-09-19T06:38:23.810103+0000","last_undegraded":"2024-09-19T06:38:23.810103+0000","last_fullsized":"2024-09-19T06:38:23.810103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:57.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.079355+0000","last_change":"2024-09-19T06:38:12.040656+0000","last_active":"2024-09-19T06:38:24.079355+0000","last_peered":"2024-09-19T06:38:24.079355+0000","last_clean":"2024-09-19T06:38:24.079355+0000","last_became_active":"2024-09-19T06:38:12.040068+0000","last_became_peered":"2024-09-19T06:38:12.040068+0000","last_unstale":"2024-09-19T06:38:24.079355+0000","last_undegraded":"2024-09-19T06:38:24.079355+0000","last_fullsized":"2024-09-19T06:38:24.079355+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:33.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174396+0000","last_change":"2024-09-19T06:38:14.054623+0000","last_active":"2024-09-19T06:38:23.174396+0000","last_peered":"2024-09-19T06:38:23.174396+0000","last_clean":"2024-09-19T06:38:23.174396+0000","last_became_active":"2024-09-19T06:38:14.054124+0000","last_became_peered":"2024-09-19T06:38:14.054124+0000","last_unstale":"2024-09-19T06:38:23.174396+0000","last_undegraded":"2024-09-19T06:38:23.174396+0000","last_fullsized":"2024-09-19T06:38:23.174396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:33.251059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:39.678590+0000","last_change":"2024-09-19T06:38:12.047284+0000","last_active":"2024-09-19T06:38:39.678590+0000","last_peered":"2024-09-19T06:38:39.678590+0000","last_clean":"2024-09-19T06:38:39.678590+0000","last_became_active":"2024-09-19T06:38:12.046886+0000","last_became_peered":"2024-09-19T06:38:12.046886+0000","last_unstale":"2024-09-19T06:38:39.678590+0000","last_undegraded":"2024-09-19T06:38:39.678590+0000","last_fullsized":"2024-09-19T06:38:39.678590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:15.030007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063722+0000","last_change":"2024-09-19T06:38:14.049351+0000","last_active":"2024-09-19T06:38:23.063722+0000","last_peered":"2024-09-19T06:38:23.063722+0000","last_clean":"2024-09-19T06:38:23.063722+0000","last_became_active":"2024-09-19T06:38:14.048792+0000","last_became_peered":"2024-09-19T06:38:14.048792+0000","last_unstale":"2024-09-19T06:38:23.063722+0000","last_undegraded":"2024-09-19T06:38:23.063722+0000","last_fullsized":"2024-09-19T06:38:23.063722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:30.431378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:37.700380+0000","last_change":"2024-09-19T06:38:12.037155+0000","last_active":"2024-09-19T06:38:37.700380+0000","last_peered":"2024-09-19T06:38:37.700380+0000","last_clean":"2024-09-19T06:38:37.700380+0000","last_became_active":"2024-09-19T06:38:12.036536+0000","last_became_peered":"2024-09-19T06:38:12.036536+0000","last_unstale":"2024-09-19T06:38:37.700380+0000","last_undegraded":"2024-09-19T06:38:37.700380+0000","last_fullsized":"2024-09-19T06:38:37.700380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:41.014783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062872+0000","last_change":"2024-09-19T06:38:14.055724+0000","last_active":"2024-09-19T06:38:23.062872+0000","last_peered":"2024-09-19T06:38:23.062872+0000","last_clean":"2024-09-19T06:38:23.062872+0000","last_became_active":"2024-09-19T06:38:14.054457+0000","last_became_peered":"2024-09-19T06:38:14.054457+0000","last_unstale":"2024-09-19T06:38:23.062872+0000","last_undegraded":"2024-09-19T06:38:23.062872+0000","last_fullsized":"2024-09-19T06:38:23.062872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:47.653709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059331+0000","last_change":"2024-09-19T06:38:12.049197+0000","last_active":"2024-09-19T06:38:23.059331+0000","last_peered":"2024-09-19T06:38:23.059331+0000","last_clean":"2024-09-19T06:38:23.059331+0000","last_became_active":"2024-09-19T06:38:12.048863+0000","last_became_peered":"2024-09-19T06:38:12.048863+0000","last_unstale":"2024-09-19T06:38:23.059331+0000","last_undegraded":"2024-09-19T06:38:23.059331+0000","last_fullsized":"2024-09-19T06:38:23.059331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:25.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063056+0000","last_change":"2024-09-19T06:38:14.042991+0000","last_active":"2024-09-19T06:38:23.063056+0000","last_peered":"2024-09-19T06:38:23.063056+0000","last_clean":"2024-09-19T06:38:23.063056+0000","last_became_active":"2024-09-19T06:38:14.042511+0000","last_became_peered":"2024-09-19T06:38:14.042511+0000","last_unstale":"2024-09-19T06:38:23.063056+0000","last_undegraded":"2024-09-19T06:38:23.063056+0000","last_fullsized":"2024-09-19T06:38:23.063056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:38.212838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.666253+0000","last_change":"2024-09-19T06:38:23.064456+0000","last_active":"2024-09-19T06:38:24.666253+0000","last_peered":"2024-09-19T06:38:24.666253+0000","last_clean":"2024-09-19T06:38:24.666253+0000","last_became_active":"2024-09-19T06:38:23.064051+0000","last_became_peered":"2024-09-19T06:38:23.064051+0000","last_unstale":"2024-09-19T06:38:24.666253+0000","last_undegraded":"2024-09-19T06:38:24.666253+0000","last_fullsized":"2024-09-19T06:38:24.666253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:58.548420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174635+0000","last_change":"2024-09-19T06:38:14.048612+0000","last_active":"2024-09-19T06:38:23.174635+0000","last_peered":"2024-09-19T06:38:23.174635+0000","last_clean":"2024-09-19T06:38:23.174635+0000","last_became_active":"2024-09-19T06:38:14.048294+0000","last_became_peered":"2024-09-19T06:38:14.048294+0000","last_unstale":"2024-09-19T06:38:23.174635+0000","last_undegraded":"2024-09-19T06:38:23.174635+0000","last_fullsized":"2024-09-19T06:38:23.174635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:55.892149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'13","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:38.053761+0000","last_change":"2024-09-19T06:38:12.035269+0000","last_active":"2024-09-19T06:38:38.053761+0000","last_peered":"2024-09-19T06:38:38.053761+0000","last_clean":"2024-09-19T06:38:38.053761+0000","last_became_active":"2024-09-19T06:38:12.034841+0000","last_became_peered":"2024-09-19T06:38:12.034841+0000","last_unstale":"2024-09-19T06:38:38.053761+0000","last_undegraded":"2024-09-19T06:38:38.053761+0000","last_fullsized":"2024-09-19T06:38:38.053761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:19.642572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810116+0000","last_change":"2024-09-19T06:38:14.052492+0000","last_active":"2024-09-19T06:38:23.810116+0000","last_peered":"2024-09-19T06:38:23.810116+0000","last_clean":"2024-09-19T06:38:23.810116+0000","last_became_active":"2024-09-19T06:38:14.052191+0000","last_became_peered":"2024-09-19T06:38:14.052191+0000","last_unstale":"2024-09-19T06:38:23.810116+0000","last_undegraded":"2024-09-19T06:38:23.810116+0000","last_fullsized":"2024-09-19T06:38:23.810116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:34.006480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670731+0000","last_change":"2024-09-19T06:38:12.118430+0000","last_active":"2024-09-19T06:38:25.670731+0000","last_peered":"2024-09-19T06:38:25.670731+0000","last_clean":"2024-09-19T06:38:25.670731+0000","last_became_active":"2024-09-19T06:38:12.118065+0000","last_became_peered":"2024-09-19T06:38:12.118065+0000","last_unstale":"2024-09-19T06:38:25.670731+0000","last_undegraded":"2024-09-19T06:38:25.670731+0000","last_fullsized":"2024-09-19T06:38:25.670731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:25.861922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.811305+0000","last_change":"2024-09-19T06:38:23.811305+0000","last_active":"2024-09-19T06:38:23.811305+0000","last_peered":"2024-09-19T06:38:23.811305+0000","last_clean":"2024-09-19T06:38:23.811305+0000","last_became_active":"2024-09-19T06:38:23.810840+0000","last_became_peered":"2024-09-19T06:38:23.810840+0000","last_unstale":"2024-09-19T06:38:23.811305+0000","last_undegraded":"2024-09-19T06:38:23.811305+0000","last_fullsized":"2024-09-19T06:38:23.811305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.019065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066057+0000","last_change":"2024-09-19T06:38:12.047670+0000","last_active":"2024-09-19T06:38:23.066057+0000","last_peered":"2024-09-19T06:38:23.066057+0000","last_clean":"2024-09-19T06:38:23.066057+0000","last_became_active":"2024-09-19T06:38:12.047312+0000","last_became_peered":"2024-09-19T06:38:12.047312+0000","last_unstale":"2024-09-19T06:38:23.066057+0000","last_undegraded":"2024-09-19T06:38:23.066057+0000","last_fullsized":"2024-09-19T06:38:23.066057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:47.477945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061871+0000","last_change":"2024-09-19T06:38:14.047210+0000","last_active":"2024-09-19T06:38:23.061871+0000","last_peered":"2024-09-19T06:38:23.061871+0000","last_clean":"2024-09-19T06:38:23.061871+0000","last_became_active":"2024-09-19T06:38:14.046836+0000","last_became_peered":"2024-09-19T06:38:14.046836+0000","last_unstale":"2024-09-19T06:38:23.061871+0000","last_undegraded":"2024-09-19T06:38:23.061871+0000","last_fullsized":"2024-09-19T06:38:23.061871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:14.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672539+0000","last_change":"2024-09-19T06:38:12.032692+0000","last_active":"2024-09-19T06:38:25.672539+0000","last_peered":"2024-09-19T06:38:25.672539+0000","last_clean":"2024-09-19T06:38:25.672539+0000","last_became_active":"2024-09-19T06:38:12.031874+0000","last_became_peered":"2024-09-19T06:38:12.031874+0000","last_unstale":"2024-09-19T06:38:25.672539+0000","last_undegraded":"2024-09-19T06:38:25.672539+0000","last_fullsized":"2024-09-19T06:38:25.672539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.787964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061862+0000","last_change":"2024-09-19T06:38:14.053504+0000","last_active":"2024-09-19T06:38:23.061862+0000","last_peered":"2024-09-19T06:38:23.061862+0000","last_clean":"2024-09-19T06:38:23.061862+0000","last_became_active":"2024-09-19T06:38:14.053148+0000","last_became_peered":"2024-09-19T06:38:14.053148+0000","last_unstale":"2024-09-19T06:38:23.061862+0000","last_undegraded":"2024-09-19T06:38:23.061862+0000","last_fullsized":"2024-09-19T06:38:23.061862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:29.809295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667656+0000","last_change":"2024-09-19T06:38:12.038884+0000","last_active":"2024-09-19T06:38:24.667656+0000","last_peered":"2024-09-19T06:38:24.667656+0000","last_clean":"2024-09-19T06:38:24.667656+0000","last_became_active":"2024-09-19T06:38:12.038532+0000","last_became_peered":"2024-09-19T06:38:12.038532+0000","last_unstale":"2024-09-19T06:38:24.667656+0000","last_undegraded":"2024-09-19T06:38:24.667656+0000","last_fullsized":"2024-09-19T06:38:24.667656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.348690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810045+0000","last_change":"2024-09-19T06:38:14.045761+0000","last_active":"2024-09-19T06:38:23.810045+0000","last_peered":"2024-09-19T06:38:23.810045+0000","last_clean":"2024-09-19T06:38:23.810045+0000","last_became_active":"2024-09-19T06:38:14.045467+0000","last_became_peered":"2024-09-19T06:38:14.045467+0000","last_unstale":"2024-09-19T06:38:23.810045+0000","last_undegraded":"2024-09-19T06:38:23.810045+0000","last_fullsized":"2024-09-19T06:38:23.810045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.917945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062222+0000","last_change":"2024-09-19T06:38:12.039546+0000","last_active":"2024-09-19T06:38:23.062222+0000","last_peered":"2024-09-19T06:38:23.062222+0000","last_clean":"2024-09-19T06:38:23.062222+0000","last_became_active":"2024-09-19T06:38:12.039130+0000","last_became_peered":"2024-09-19T06:38:12.039130+0000","last_unstale":"2024-09-19T06:38:23.062222+0000","last_undegraded":"2024-09-19T06:38:23.062222+0000","last_fullsized":"2024-09-19T06:38:23.062222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:43.200022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059825+0000","last_change":"2024-09-19T06:38:14.053935+0000","last_active":"2024-09-19T06:38:23.059825+0000","last_peered":"2024-09-19T06:38:23.059825+0000","last_clean":"2024-09-19T06:38:23.059825+0000","last_became_active":"2024-09-19T06:38:14.053542+0000","last_became_peered":"2024-09-19T06:38:14.053542+0000","last_unstale":"2024-09-19T06:38:23.059825+0000","last_undegraded":"2024-09-19T06:38:23.059825+0000","last_fullsized":"2024-09-19T06:38:23.059825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:25.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.177494+0000","last_change":"2024-09-19T06:38:23.177133+0000","last_active":"2024-09-19T06:38:23.177494+0000","last_peered":"2024-09-19T06:38:23.177494+0000","last_clean":"2024-09-19T06:38:23.177494+0000","last_became_active":"2024-09-19T06:38:23.176810+0000","last_became_peered":"2024-09-19T06:38:23.176810+0000","last_unstale":"2024-09-19T06:38:23.177494+0000","last_undegraded":"2024-09-19T06:38:23.177494+0000","last_fullsized":"2024-09-19T06:38:23.177494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:56.307720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672551+0000","last_change":"2024-09-19T06:38:12.042699+0000","last_active":"2024-09-19T06:38:25.672551+0000","last_peered":"2024-09-19T06:38:25.672551+0000","last_clean":"2024-09-19T06:38:25.672551+0000","last_became_active":"2024-09-19T06:38:12.042148+0000","last_became_peered":"2024-09-19T06:38:12.042148+0000","last_unstale":"2024-09-19T06:38:25.672551+0000","last_undegraded":"2024-09-19T06:38:25.672551+0000","last_fullsized":"2024-09-19T06:38:25.672551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.953596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066455+0000","last_change":"2024-09-19T06:38:14.043279+0000","last_active":"2024-09-19T06:38:23.066455+0000","last_peered":"2024-09-19T06:38:23.066455+0000","last_clean":"2024-09-19T06:38:23.066455+0000","last_became_active":"2024-09-19T06:38:14.042914+0000","last_became_peered":"2024-09-19T06:38:14.042914+0000","last_unstale":"2024-09-19T06:38:23.066455+0000","last_undegraded":"2024-09-19T06:38:23.066455+0000","last_fullsized":"2024-09-19T06:38:23.066455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:22.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:26.681663+0000","last_change":"2024-09-19T06:38:12.038683+0000","last_active":"2024-09-19T06:38:26.681663+0000","last_peered":"2024-09-19T06:38:26.681663+0000","last_clean":"2024-09-19T06:38:26.681663+0000","last_became_active":"2024-09-19T06:38:12.038342+0000","last_became_peered":"2024-09-19T06:38:12.038342+0000","last_unstale":"2024-09-19T06:38:26.681663+0000","last_undegraded":"2024-09-19T06:38:26.681663+0000","last_fullsized":"2024-09-19T06:38:26.681663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:07.091418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062167+0000","last_change":"2024-09-19T06:38:14.041552+0000","last_active":"2024-09-19T06:38:23.062167+0000","last_peered":"2024-09-19T06:38:23.062167+0000","last_clean":"2024-09-19T06:38:23.062167+0000","last_became_active":"2024-09-19T06:38:14.041187+0000","last_became_peered":"2024-09-19T06:38:14.041187+0000","last_unstale":"2024-09-19T06:38:23.062167+0000","last_undegraded":"2024-09-19T06:38:23.062167+0000","last_fullsized":"2024-09-19T06:38:23.062167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:17.390457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810276+0000","last_change":"2024-09-19T06:38:12.047436+0000","last_active":"2024-09-19T06:38:23.810276+0000","last_peered":"2024-09-19T06:38:23.810276+0000","last_clean":"2024-09-19T06:38:23.810276+0000","last_became_active":"2024-09-19T06:38:12.046961+0000","last_became_peered":"2024-09-19T06:38:12.046961+0000","last_unstale":"2024-09-19T06:38:23.810276+0000","last_undegraded":"2024-09-19T06:38:23.810276+0000","last_fullsized":"2024-09-19T06:38:23.810276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810051+0000","last_change":"2024-09-19T06:38:14.049660+0000","last_active":"2024-09-19T06:38:23.810051+0000","last_peered":"2024-09-19T06:38:23.810051+0000","last_clean":"2024-09-19T06:38:23.810051+0000","last_became_active":"2024-09-19T06:38:14.049375+0000","last_became_peered":"2024-09-19T06:38:14.049375+0000","last_unstale":"2024-09-19T06:38:23.810051+0000","last_undegraded":"2024-09-19T06:38:23.810051+0000","last_fullsized":"2024-09-19T06:38:23.810051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:08.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:38.701071+0000","last_change":"2024-09-19T06:38:23.071068+0000","last_active":"2024-09-19T06:38:38.701071+0000","last_peered":"2024-09-19T06:38:38.701071+0000","last_clean":"2024-09-19T06:38:38.701071+0000","last_became_active":"2024-09-19T06:38:23.067129+0000","last_became_peered":"2024-09-19T06:38:23.067129+0000","last_unstale":"2024-09-19T06:38:38.701071+0000","last_undegraded":"2024-09-19T06:38:38.701071+0000","last_fullsized":"2024-09-19T06:38:38.701071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:15.387758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62555,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":188,"num_read_kb":165,"num_write":237,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2194,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":187665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547218,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36916,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708236,"statfs":{"total":95995035648,"available":95957233664,"internally_reserved":0,"allocated":1609728,"data_stored":1084952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":438899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1032190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528363,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":439009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1544192,"data_stored":1031475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":494446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":438441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":439520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40468,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704684,"statfs":{"total":95995035648,"available":95953596416,"internally_reserved":0,"allocated":987136,"data_stored":495548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":57771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":56669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:38:42.520 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:38:42.521 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T06:38:42.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T06:38:42.789 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:43.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.264+0000 7fe754f3b640 1 -- 172.21.15.12:0/3464655425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe750074b40 msgr2=0x7fe750074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.264+0000 7fe754f3b640 1 --2- 172.21.15.12:0/3464655425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe750074b40 0x7fe750074fa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe744009900 tx=0x7fe74402a410 comp rx=0 tx=0).stop 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.264+0000 7fe754f3b640 1 -- 172.21.15.12:0/3464655425 shutdown_connections 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.264+0000 7fe754f3b640 1 --2- 172.21.15.12:0/3464655425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe750109a70 0x7fe75010bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.264+0000 7fe754f3b640 1 --2- 172.21.15.12:0/3464655425 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe750074b40 0x7fe750074fa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.264+0000 7fe754f3b640 1 --2- 172.21.15.12:0/3464655425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500761a0 0x7fe750074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.264+0000 7fe754f3b640 1 -- 172.21.15.12:0/3464655425 >> 172.21.15.12:0/3464655425 conn(0x7fe7500fd390 msgr2=0x7fe7500ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.264+0000 7fe754f3b640 1 -- 172.21.15.12:0/3464655425 shutdown_connections 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.264+0000 7fe754f3b640 1 -- 172.21.15.12:0/3464655425 wait complete. 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.265+0000 7fe754f3b640 1 Processor -- start 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.265+0000 7fe754f3b640 1 -- start start 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.265+0000 7fe754f3b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe750074b40 0x7fe75019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:43.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.265+0000 7fe754f3b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500761a0 0x7fe75019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.265+0000 7fe754f3b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe750109a70 0x7fe7501a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.265+0000 7fe754f3b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe75010fa50 con 0x7fe750074b40 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.265+0000 7fe754f3b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe75010f8d0 con 0x7fe7500761a0 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.265+0000 7fe754f3b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe75010fbd0 con 0x7fe750109a70 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe750074b40 0x7fe75019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe750074b40 0x7fe75019a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49478/0 (socket says 172.21.15.12:49478) 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74e59c640 1 -- 172.21.15.12:0/1362859520 learned_addr learned my addr 172.21.15.12:0/1362859520 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74ed9d640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe750109a70 0x7fe7501a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74dd9b640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500761a0 0x7fe75019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74e59c640 1 -- 172.21.15.12:0/1362859520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe750109a70 msgr2=0x7fe7501a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74e59c640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe750109a70 0x7fe7501a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74e59c640 1 -- 172.21.15.12:0/1362859520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500761a0 msgr2=0x7fe75019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74e59c640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500761a0 0x7fe75019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74e59c640 1 -- 172.21.15.12:0/1362859520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7501a1ce0 con 0x7fe750074b40 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe74e59c640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe750074b40 0x7fe75019a0b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c920 tx=0x7fe74000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe73f7fe640 1 -- 172.21.15.12:0/1362859520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740007c70 con 0x7fe750074b40 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe73f7fe640 1 -- 172.21.15.12:0/1362859520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe740007e10 con 0x7fe750074b40 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe754f3b640 1 -- 172.21.15.12:0/1362859520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501a1fd0 con 0x7fe750074b40 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe73f7fe640 1 -- 172.21.15.12:0/1362859520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740018890 con 0x7fe750074b40 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.266+0000 7fe754f3b640 1 -- 172.21.15.12:0/1362859520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501a2420 con 0x7fe750074b40 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.268+0000 7fe754f3b640 1 -- 172.21.15.12:0/1362859520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe750108880 con 0x7fe750074b40 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.269+0000 7fe73f7fe640 1 -- 172.21.15.12:0/1362859520 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe740018a30 con 0x7fe750074b40 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.269+0000 7fe73f7fe640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7380a3300 0x7fe7380a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:43.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.270+0000 7fe74dd9b640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7380a3300 0x7fe7380a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.270+0000 7fe73f7fe640 1 -- 172.21.15.12:0/1362859520 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe7400cfed0 con 0x7fe750074b40 2024-09-19T06:38:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.270+0000 7fe74dd9b640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7380a3300 0x7fe7380a57c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe744000c00 tx=0x7fe744031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:43.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.273+0000 7fe73f7fe640 1 -- 172.21.15.12:0/1362859520 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe740014030 con 0x7fe750074b40 2024-09-19T06:38:43.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.517+0000 7fe754f3b640 1 -- 172.21.15.12:0/1362859520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fe75002d7c0 con 0x7fe750074b40 2024-09-19T06:38:43.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.520+0000 7fe73f7fe640 1 -- 172.21.15.12:0/1362859520 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fe74009caa0 con 0x7fe750074b40 2024-09-19T06:38:43.521 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-19T06:38:43.521 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDzxutmpiDyHhAAJqKsn0H4sdcZqLdWCxDXYA== 2024-09-19T06:38:43.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.522+0000 7fe754f3b640 1 -- 172.21.15.12:0/1362859520 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7380a3300 msgr2=0x7fe7380a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:43.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.522+0000 7fe754f3b640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7380a3300 0x7fe7380a57c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe744000c00 tx=0x7fe744031400 comp rx=0 tx=0).stop 2024-09-19T06:38:43.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.522+0000 7fe754f3b640 1 -- 172.21.15.12:0/1362859520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe750074b40 msgr2=0x7fe75019a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:43.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.522+0000 7fe754f3b640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe750074b40 0x7fe75019a0b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c920 tx=0x7fe74000cde0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.522+0000 7fe754f3b640 1 -- 172.21.15.12:0/1362859520 shutdown_connections 2024-09-19T06:38:43.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.522+0000 7fe754f3b640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe7380a3300 0x7fe7380a57c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.522+0000 7fe754f3b640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe750109a70 0x7fe7501a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.522+0000 7fe754f3b640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500761a0 0x7fe75019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.522+0000 7fe754f3b640 1 --2- 172.21.15.12:0/1362859520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe750074b40 0x7fe75019a0b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:43.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.522+0000 7fe754f3b640 1 -- 172.21.15.12:0/1362859520 >> 172.21.15.12:0/1362859520 conn(0x7fe7500fd390 msgr2=0x7fe750105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:43.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.523+0000 7fe754f3b640 1 -- 172.21.15.12:0/1362859520 shutdown_connections 2024-09-19T06:38:43.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:43.523+0000 7fe754f3b640 1 -- 172.21.15.12:0/1362859520 wait complete. 2024-09-19T06:38:43.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:43 smithi012 ceph-mon[30937]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 KiB/s wr, 15 op/s 2024-09-19T06:38:43.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:43 smithi012 ceph-mon[30937]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:38:43.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:43 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1362859520' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:38:43.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:43 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1362859520' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:38:44.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:43 smithi016 ceph-mon[34911]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 KiB/s wr, 15 op/s 2024-09-19T06:38:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:43 smithi016 ceph-mon[34911]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:38:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:43 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1362859520' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:38:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:43 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1362859520' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:38:44.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:43 smithi173 ceph-mon[35349]: pgmap v293: 97 pgs: 97 active+clean; 638 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 KiB/s wr, 15 op/s 2024-09-19T06:38:44.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:43 smithi173 ceph-mon[35349]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:38:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:43 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1362859520' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:38:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:43 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1362859520' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:38:44.253 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:38:44.254 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T06:38:44.254 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T06:38:44.293 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T06:38:44.293 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T06:38:44.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T06:38:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.052+0000 7fdb7bc26640 1 -- 172.21.15.12:0/204014133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb74101de0 msgr2=0x7fdb741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.052+0000 7fdb7bc26640 1 --2- 172.21.15.12:0/204014133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb74101de0 0x7fdb741021c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009900 tx=0x7fdb7002a410 comp rx=0 tx=0).stop 2024-09-19T06:38:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.052+0000 7fdb7bc26640 1 -- 172.21.15.12:0/204014133 shutdown_connections 2024-09-19T06:38:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.052+0000 7fdb7bc26640 1 --2- 172.21.15.12:0/204014133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb74106f10 0x7fdb7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.052+0000 7fdb7bc26640 1 --2- 172.21.15.12:0/204014133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb74102790 0x7fdb741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.052+0000 7fdb7bc26640 1 --2- 172.21.15.12:0/204014133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb74101de0 0x7fdb741021c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.052+0000 7fdb7bc26640 1 -- 172.21.15.12:0/204014133 >> 172.21.15.12:0/204014133 conn(0x7fdb740fd8c0 msgr2=0x7fdb740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.052+0000 7fdb7bc26640 1 -- 172.21.15.12:0/204014133 shutdown_connections 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.052+0000 7fdb7bc26640 1 -- 172.21.15.12:0/204014133 wait complete. 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7bc26640 1 Processor -- start 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7bc26640 1 -- start start 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7bc26640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb74101de0 0x7fdb74198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7bc26640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb74102790 0x7fdb741989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7bc26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb74106f10 0x7fdb7419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7bc26640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdb74111f90 con 0x7fdb74106f10 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7bc26640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdb74111e10 con 0x7fdb74101de0 2024-09-19T06:38:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7bc26640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdb74112110 con 0x7fdb74102790 2024-09-19T06:38:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7a1c3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb74106f10 0x7fdb7419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7a1c3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb74106f10 0x7fdb7419cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49500/0 (socket says 172.21.15.12:49500) 2024-09-19T06:38:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.053+0000 7fdb7a1c3640 1 -- 172.21.15.12:0/2023359178 learned_addr learned my addr 172.21.15.12:0/2023359178 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb799c2640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb74101de0 0x7fdb74198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb791c1640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb74102790 0x7fdb741989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb7a1c3640 1 -- 172.21.15.12:0/2023359178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb74102790 msgr2=0x7fdb741989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb7a1c3640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb74102790 0x7fdb741989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb7a1c3640 1 -- 172.21.15.12:0/2023359178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb74101de0 msgr2=0x7fdb74198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb7a1c3640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb74101de0 0x7fdb74198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb7a1c3640 1 -- 172.21.15.12:0/2023359178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7419d440 con 0x7fdb74106f10 2024-09-19T06:38:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb7a1c3640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb74106f10 0x7fdb7419cd60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00eaa0 tx=0x7fdb6c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb6affd640 1 -- 172.21.15.12:0/2023359178 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00cdb0 con 0x7fdb74106f10 2024-09-19T06:38:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb6affd640 1 -- 172.21.15.12:0/2023359178 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb6c005020 con 0x7fdb74106f10 2024-09-19T06:38:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb7bc26640 1 -- 172.21.15.12:0/2023359178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7419d730 con 0x7fdb74106f10 2024-09-19T06:38:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb6affd640 1 -- 172.21.15.12:0/2023359178 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0116b0 con 0x7fdb74106f10 2024-09-19T06:38:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.054+0000 7fdb7bc26640 1 -- 172.21.15.12:0/2023359178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb741a5010 con 0x7fdb74106f10 2024-09-19T06:38:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.055+0000 7fdb7bc26640 1 -- 172.21.15.12:0/2023359178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb741021c0 con 0x7fdb74106f10 2024-09-19T06:38:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.057+0000 7fdb6affd640 1 -- 172.21.15.12:0/2023359178 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdb6c005560 con 0x7fdb74106f10 2024-09-19T06:38:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.057+0000 7fdb6affd640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdb600a32d0 0x7fdb600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.057+0000 7fdb799c2640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdb600a32d0 0x7fdb600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.057+0000 7fdb6affd640 1 -- 172.21.15.12:0/2023359178 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fdb6c0cfa10 con 0x7fdb74106f10 2024-09-19T06:38:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.058+0000 7fdb799c2640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdb600a32d0 0x7fdb600a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009230 tx=0x7fdb700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.062+0000 7fdb6affd640 1 -- 172.21.15.12:0/2023359178 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb6c016030 con 0x7fdb74106f10 2024-09-19T06:38:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.290+0000 7fdb7bc26640 1 -- 172.21.15.12:0/2023359178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fdb74109b60 con 0x7fdb74106f10 2024-09-19T06:38:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.297+0000 7fdb6affd640 1 -- 172.21.15.12:0/2023359178 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264050 (secure 0 0 0) 0x7fdb6c09c550 con 0x7fdb74106f10 2024-09-19T06:38:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.299+0000 7fdb7bc26640 1 -- 172.21.15.12:0/2023359178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdb600a32d0 msgr2=0x7fdb600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.299+0000 7fdb7bc26640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdb600a32d0 0x7fdb600a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009230 tx=0x7fdb700058d0 comp rx=0 tx=0).stop 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.299+0000 7fdb7bc26640 1 -- 172.21.15.12:0/2023359178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb74106f10 msgr2=0x7fdb7419cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.299+0000 7fdb7bc26640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb74106f10 0x7fdb7419cd60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00eaa0 tx=0x7fdb6c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.299+0000 7fdb7bc26640 1 -- 172.21.15.12:0/2023359178 shutdown_connections 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.299+0000 7fdb7bc26640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdb600a32d0 0x7fdb600a5790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.299+0000 7fdb7bc26640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb74106f10 0x7fdb7419cd60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.299+0000 7fdb7bc26640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb74102790 0x7fdb741989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.299+0000 7fdb7bc26640 1 --2- 172.21.15.12:0/2023359178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb74101de0 0x7fdb74198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.299+0000 7fdb7bc26640 1 -- 172.21.15.12:0/2023359178 >> 172.21.15.12:0/2023359178 conn(0x7fdb740fd8c0 msgr2=0x7fdb740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.300+0000 7fdb7bc26640 1 -- 172.21.15.12:0/2023359178 shutdown_connections 2024-09-19T06:38:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:45.300+0000 7fdb7bc26640 1 -- 172.21.15.12:0/2023359178 wait complete. 2024-09-19T06:38:45.986 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:45 smithi012 ceph-mon[30937]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T06:38:45.986 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:45 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2023359178' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:38:46.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:45 smithi016 ceph-mon[34911]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T06:38:46.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:45 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2023359178' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:38:46.018 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4060248487},{"type":"v1","addr":"172.21.15.12:6801","nonce":4060248487}]},"active_addr":"172.21.15.12:6801/4060248487","active_change":"2024-09-19T06:31:21.623085+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24122,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.12:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2160320420}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2954657663}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3390758821}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1769692721}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3524375628}]}]} 2024-09-19T06:38:46.026 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T06:38:46.026 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T06:38:46.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:38:46.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:45 smithi173 ceph-mon[35349]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T06:38:46.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:45 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2023359178' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:38:46.287 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:46.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.746+0000 7f5f76fdb640 1 -- 172.21.15.12:0/2730955977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70100a80 msgr2=0x7f5f70100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:46.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 --2- 172.21.15.12:0/2730955977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70100a80 0x7f5f70100ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009930 tx=0x7f5f6402a420 comp rx=0 tx=0).stop 2024-09-19T06:38:46.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 -- 172.21.15.12:0/2730955977 shutdown_connections 2024-09-19T06:38:46.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 --2- 172.21.15.12:0/2730955977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f70101420 0x7f5f7010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 --2- 172.21.15.12:0/2730955977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70100a80 0x7f5f70100ee0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 --2- 172.21.15.12:0/2730955977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f70106a80 0x7f5f70106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 -- 172.21.15.12:0/2730955977 >> 172.21.15.12:0/2730955977 conn(0x7f5f700fc7a0 msgr2=0x7f5f700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 -- 172.21.15.12:0/2730955977 shutdown_connections 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 -- 172.21.15.12:0/2730955977 wait complete. 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 Processor -- start 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 -- start start 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f70100a80 0x7f5f70199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f70101420 0x7f5f70199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70106a80 0x7f5f701a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70110e80 con 0x7f5f70106a80 2024-09-19T06:38:46.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.747+0000 7f5f76fdb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70110d00 con 0x7f5f70100a80 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f76fdb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70111000 con 0x7f5f70101420 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f75578640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70106a80 0x7f5f701a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f75578640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70106a80 0x7f5f701a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49526/0 (socket says 172.21.15.12:49526) 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f75578640 1 -- 172.21.15.12:0/1363052508 learned_addr learned my addr 172.21.15.12:0/1363052508 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f6ffff640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f70101420 0x7f5f70199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f74d77640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f70100a80 0x7f5f70199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f75578640 1 -- 172.21.15.12:0/1363052508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f70101420 msgr2=0x7f5f70199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f75578640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f70101420 0x7f5f70199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f75578640 1 -- 172.21.15.12:0/1363052508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f70100a80 msgr2=0x7f5f70199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f75578640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f70100a80 0x7f5f70199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f75578640 1 -- 172.21.15.12:0/1363052508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f701a48d0 con 0x7f5f70106a80 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f74d77640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f70100a80 0x7f5f70199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:46.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f75578640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70106a80 0x7f5f701a4390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009fd0 tx=0x7f5f6800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f6dffb640 1 -- 172.21.15.12:0/1363052508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f68017070 con 0x7f5f70106a80 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f76fdb640 1 -- 172.21.15.12:0/1363052508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f701a4aa0 con 0x7f5f70106a80 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f6dffb640 1 -- 172.21.15.12:0/1363052508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f68003e50 con 0x7f5f70106a80 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f6dffb640 1 -- 172.21.15.12:0/1363052508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f680106c0 con 0x7f5f70106a80 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.748+0000 7f5f76fdb640 1 -- 172.21.15.12:0/1363052508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f701a4f60 con 0x7f5f70106a80 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.749+0000 7f5f76fdb640 1 -- 172.21.15.12:0/1363052508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f70100ee0 con 0x7f5f70106a80 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.751+0000 7f5f6dffb640 1 -- 172.21.15.12:0/1363052508 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5f68003970 con 0x7f5f70106a80 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.751+0000 7f5f6dffb640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5f580a32d0 0x7f5f580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.751+0000 7f5f74d77640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5f580a32d0 0x7f5f580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.751+0000 7f5f6dffb640 1 -- 172.21.15.12:0/1363052508 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f5f680cf910 con 0x7f5f70106a80 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.752+0000 7f5f74d77640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5f580a32d0 0x7f5f580a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f600058c0 tx=0x7f5f60005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:46.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.755+0000 7f5f6dffb640 1 -- 172.21.15.12:0/1363052508 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f6809c4b0 con 0x7f5f70106a80 2024-09-19T06:38:46.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.931+0000 7f5f76fdb640 1 -- 172.21.15.12:0/1363052508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f7002d7c0 con 0x7f5f70106a80 2024-09-19T06:38:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.933+0000 7f5f6dffb640 1 -- 172.21.15.12:0/1363052508 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22734 (secure 0 0 0) 0x7f5f6809bdb0 con 0x7f5f70106a80 2024-09-19T06:38:46.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:46.934 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:38:23.051378+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:38:46.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 -- 172.21.15.12:0/1363052508 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5f580a32d0 msgr2=0x7f5f580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5f580a32d0 0x7f5f580a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f600058c0 tx=0x7f5f60005cb0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 -- 172.21.15.12:0/1363052508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70106a80 msgr2=0x7f5f701a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70106a80 0x7f5f701a4390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009fd0 tx=0x7f5f6800b260 comp rx=0 tx=0).stop 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 -- 172.21.15.12:0/1363052508 shutdown_connections 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f5f580a32d0 0x7f5f580a5790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f70106a80 0x7f5f701a4390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f70101420 0x7f5f70199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 --2- 172.21.15.12:0/1363052508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f70100a80 0x7f5f70199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 -- 172.21.15.12:0/1363052508 >> 172.21.15.12:0/1363052508 conn(0x7f5f700fc7a0 msgr2=0x7f5f700fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 -- 172.21.15.12:0/1363052508 shutdown_connections 2024-09-19T06:38:46.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:46.935+0000 7f5f76fdb640 1 -- 172.21.15.12:0/1363052508 wait complete. 2024-09-19T06:38:47.856 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T06:38:47.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:38:48.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:47 smithi016 ceph-mon[34911]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-09-19T06:38:48.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:47 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1363052508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:48.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:47 smithi173 ceph-mon[35349]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-09-19T06:38:48.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:47 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1363052508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:48.119 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:48.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:47 smithi012 ceph-mon[30937]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-09-19T06:38:48.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:47 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1363052508' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.553+0000 7fe90732e640 1 -- 172.21.15.12:0/2462256075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe90010e480 msgr2=0x7fe900110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.553+0000 7fe90732e640 1 --2- 172.21.15.12:0/2462256075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe90010e480 0x7fe900110870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009900 tx=0x7fe8f802a410 comp rx=0 tx=0).stop 2024-09-19T06:38:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.554+0000 7fe90732e640 1 -- 172.21.15.12:0/2462256075 shutdown_connections 2024-09-19T06:38:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.554+0000 7fe90732e640 1 --2- 172.21.15.12:0/2462256075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe90010e480 0x7fe900110870 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.554+0000 7fe90732e640 1 --2- 172.21.15.12:0/2462256075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe900101280 0x7fe90010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.554+0000 7fe90732e640 1 --2- 172.21.15.12:0/2462256075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9001008d0 0x7fe900100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.554+0000 7fe90732e640 1 -- 172.21.15.12:0/2462256075 >> 172.21.15.12:0/2462256075 conn(0x7fe9000fc7a0 msgr2=0x7fe9000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.554+0000 7fe90732e640 1 -- 172.21.15.12:0/2462256075 shutdown_connections 2024-09-19T06:38:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.554+0000 7fe90732e640 1 -- 172.21.15.12:0/2462256075 wait complete. 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.554+0000 7fe90732e640 1 Processor -- start 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.554+0000 7fe90732e640 1 -- start start 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.554+0000 7fe90732e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9001008d0 0x7fe90019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe90732e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe900101280 0x7fe90019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe90732e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe90010e480 0x7fe90019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe90732e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe900114170 con 0x7fe9001008d0 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe90732e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe900113ff0 con 0x7fe90010e480 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe90732e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe9001142f0 con 0x7fe900101280 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9050ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9001008d0 0x7fe90019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9050ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9001008d0 0x7fe90019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49538/0 (socket says 172.21.15.12:49538) 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9050ca640 1 -- 172.21.15.12:0/2930225813 learned_addr learned my addr 172.21.15.12:0/2930225813 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9048c9640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe900101280 0x7fe90019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9058cb640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe90010e480 0x7fe90019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9050ca640 1 -- 172.21.15.12:0/2930225813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe900101280 msgr2=0x7fe90019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9050ca640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe900101280 0x7fe90019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9050ca640 1 -- 172.21.15.12:0/2930225813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe90010e480 msgr2=0x7fe90019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9050ca640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe90010e480 0x7fe90019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9050ca640 1 -- 172.21.15.12:0/2930225813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90019f600 con 0x7fe9001008d0 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe9050ca640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9001008d0 0x7fe90019a650 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00cce0 tx=0x7fe8fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.555+0000 7fe8f67fc640 1 -- 172.21.15.12:0/2930225813 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc004b20 con 0x7fe9001008d0 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.556+0000 7fe8f67fc640 1 -- 172.21.15.12:0/2930225813 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8fc004cc0 con 0x7fe9001008d0 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.556+0000 7fe90732e640 1 -- 172.21.15.12:0/2930225813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90019f8f0 con 0x7fe9001008d0 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.556+0000 7fe8f67fc640 1 -- 172.21.15.12:0/2930225813 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00f8c0 con 0x7fe9001008d0 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.556+0000 7fe90732e640 1 -- 172.21.15.12:0/2930225813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9001a71d0 con 0x7fe9001008d0 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.557+0000 7fe90732e640 1 -- 172.21.15.12:0/2930225813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe900100cb0 con 0x7fe9001008d0 2024-09-19T06:38:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.558+0000 7fe8f67fc640 1 -- 172.21.15.12:0/2930225813 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe8fc00fa60 con 0x7fe9001008d0 2024-09-19T06:38:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.558+0000 7fe8f67fc640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8ec0a32d0 0x7fe8ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.559+0000 7fe9048c9640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8ec0a32d0 0x7fe8ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.559+0000 7fe8f67fc640 1 -- 172.21.15.12:0/2930225813 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe8fc0cfaf0 con 0x7fe9001008d0 2024-09-19T06:38:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.559+0000 7fe9048c9640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8ec0a32d0 0x7fe8ec0a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe90010ed80 tx=0x7fe8f000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.563+0000 7fe8f67fc640 1 -- 172.21.15.12:0/2930225813 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8fc014030 con 0x7fe9001008d0 2024-09-19T06:38:48.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.741+0000 7fe90732e640 1 -- 172.21.15.12:0/2930225813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe90019b9b0 con 0x7fe9001008d0 2024-09-19T06:38:48.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.742+0000 7fe8f67fc640 1 -- 172.21.15.12:0/2930225813 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22734 (secure 0 0 0) 0x7fe8fc09c040 con 0x7fe9001008d0 2024-09-19T06:38:48.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:38:48.744 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:38:23.051378+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:38:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.744+0000 7fe90732e640 1 -- 172.21.15.12:0/2930225813 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8ec0a32d0 msgr2=0x7fe8ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.744+0000 7fe90732e640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8ec0a32d0 0x7fe8ec0a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe90010ed80 tx=0x7fe8f000b390 comp rx=0 tx=0).stop 2024-09-19T06:38:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.744+0000 7fe90732e640 1 -- 172.21.15.12:0/2930225813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9001008d0 msgr2=0x7fe90019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.744+0000 7fe90732e640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9001008d0 0x7fe90019a650 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00cce0 tx=0x7fe8fc00a620 comp rx=0 tx=0).stop 2024-09-19T06:38:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.744+0000 7fe90732e640 1 -- 172.21.15.12:0/2930225813 shutdown_connections 2024-09-19T06:38:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.744+0000 7fe90732e640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe8ec0a32d0 0x7fe8ec0a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.744+0000 7fe90732e640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe90010e480 0x7fe90019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.744+0000 7fe90732e640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe900101280 0x7fe90019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:48.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.744+0000 7fe90732e640 1 --2- 172.21.15.12:0/2930225813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9001008d0 0x7fe90019a650 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:48.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.744+0000 7fe90732e640 1 -- 172.21.15.12:0/2930225813 >> 172.21.15.12:0/2930225813 conn(0x7fe9000fc7a0 msgr2=0x7fe9000feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:48.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.745+0000 7fe90732e640 1 -- 172.21.15.12:0/2930225813 shutdown_connections 2024-09-19T06:38:48.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:48.745+0000 7fe90732e640 1 -- 172.21.15.12:0/2930225813 wait complete. 2024-09-19T06:38:49.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T06:38:49.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T06:38:49.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T06:38:49.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T06:38:49.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T06:38:49.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T06:38:49.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T06:38:49.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T06:38:49.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T06:38:49.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T06:38:49.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T06:38:49.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T06:38:49.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:49 smithi012 ceph-mon[30937]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T06:38:49.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:49 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2930225813' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:50.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:49 smithi016 ceph-mon[34911]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T06:38:50.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:49 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2930225813' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:50.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:49 smithi173 ceph-mon[35349]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T06:38:50.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:49 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2930225813' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:38:50.201 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:50.316 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:50.329 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:50.329 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:50.330 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.505+0000 7f5658031640 1 -- 172.21.15.12:0/4202805782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5650103720 msgr2=0x7f565010bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.505+0000 7f5658031640 1 --2- 172.21.15.12:0/4202805782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5650103720 0x7f565010bc10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5644009900 tx=0x7f564402a480 comp rx=0 tx=0).stop 2024-09-19T06:38:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 -- 172.21.15.12:0/4202805782 shutdown_connections 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 --2- 172.21.15.12:0/4202805782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f565010c1a0 0x7f565010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 --2- 172.21.15.12:0/4202805782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5650103720 0x7f565010bc10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 --2- 172.21.15.12:0/4202805782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5650102e00 0x7f56501031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 -- 172.21.15.12:0/4202805782 >> 172.21.15.12:0/4202805782 conn(0x7f56500fc7a0 msgr2=0x7f56500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 -- 172.21.15.12:0/4202805782 shutdown_connections 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 -- 172.21.15.12:0/4202805782 wait complete. 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 Processor -- start 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 -- start start 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5650102e00 0x7f565019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5650103720 0x7f565019ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565010c1a0 0x7f565019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5650111fb0 con 0x7f5650103720 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5650111e30 con 0x7f565010c1a0 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.506+0000 7f5658031640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5650112130 con 0x7f5650102e00 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f56555cc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5650103720 0x7f565019ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f56555cc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5650103720 0x7f565019ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42914/0 (socket says 172.21.15.12:42914) 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f56555cc640 1 -- 172.21.15.12:0/2070162892 learned_addr learned my addr 172.21.15.12:0/2070162892 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f5655dcd640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5650102e00 0x7f565019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f56565ce640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565010c1a0 0x7f565019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f56555cc640 1 -- 172.21.15.12:0/2070162892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5650102e00 msgr2=0x7f565019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f56555cc640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5650102e00 0x7f565019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f56555cc640 1 -- 172.21.15.12:0/2070162892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565010c1a0 msgr2=0x7f565019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f56555cc640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565010c1a0 0x7f565019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f56555cc640 1 -- 172.21.15.12:0/2070162892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565019f6e0 con 0x7f5650103720 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f56555cc640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5650103720 0x7f565019ad10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5644006010 tx=0x7f56440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f5642ffd640 1 -- 172.21.15.12:0/2070162892 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564403f030 con 0x7f5650103720 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565019f970 con 0x7f5650103720 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f5642ffd640 1 -- 172.21.15.12:0/2070162892 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5644003ce0 con 0x7f5650103720 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f5642ffd640 1 -- 172.21.15.12:0/2070162892 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644035070 con 0x7f5650103720 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.507+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56501a72b0 con 0x7f5650103720 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.508+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5650102490 con 0x7f5650103720 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.509+0000 7f5642ffd640 1 -- 172.21.15.12:0/2070162892 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5644042030 con 0x7f5650103720 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.510+0000 7f5642ffd640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f563c0a32d0 0x7f563c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.510+0000 7f5655dcd640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f563c0a32d0 0x7f563c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.510+0000 7f5642ffd640 1 -- 172.21.15.12:0/2070162892 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f56440f0670 con 0x7f5650103720 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.510+0000 7f5642ffd640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] conn(0x7f563c0acf80 0x7f563c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.510+0000 7f5642ffd640 1 -- 172.21.15.12:0/2070162892 --> [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5644040e70 con 0x7f563c0acf80 2024-09-19T06:38:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.510+0000 7f5642ffd640 1 -- 172.21.15.12:0/2070162892 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f56440f0ac0 con 0x7f5650103720 2024-09-19T06:38:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.510+0000 7f56565ce640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] conn(0x7f563c0acf80 0x7f563c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.511+0000 7f5655dcd640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f563c0a32d0 0x7f563c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f564c00bbe0 tx=0x7f564c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.511+0000 7f56565ce640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] conn(0x7f563c0acf80 0x7f563c0af420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.511+0000 7f5642ffd640 1 -- 172.21.15.12:0/2070162892 <== osd.6 v2:172.21.15.12:6818/2461755084 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5644040e70 con 0x7f563c0acf80 2024-09-19T06:38:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.525+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 --> [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f565006afb0 con 0x7f563c0acf80 2024-09-19T06:38:51.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5642ffd640 1 -- 172.21.15.12:0/2070162892 <== osd.6 v2:172.21.15.12:6818/2461755084 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f565006afb0 con 0x7f563c0acf80 2024-09-19T06:38:51.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] conn(0x7f563c0acf80 msgr2=0x7f563c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:51.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5658031640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] conn(0x7f563c0acf80 0x7f563c0af420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f563c0a32d0 msgr2=0x7f563c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5658031640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f563c0a32d0 0x7f563c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f564c00bbe0 tx=0x7f564c00b390 comp rx=0 tx=0).stop 2024-09-19T06:38:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5650103720 msgr2=0x7f565019ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5658031640 1 --2- 172.21.15.12:0/2070162892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5650103720 0x7f565019ad10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5644006010 tx=0x7f56440042f0 comp rx=0 tx=0).stop 2024-09-19T06:38:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f56565ce640 1 -- 172.21.15.12:0/2070162892 reap_dead start 2024-09-19T06:38:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 shutdown_connections 2024-09-19T06:38:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 >> 172.21.15.12:0/2070162892 conn(0x7f56500fc7a0 msgr2=0x7f5650101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 shutdown_connections 2024-09-19T06:38:51.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:51.526+0000 7f5658031640 1 -- 172.21.15.12:0/2070162892 wait complete. 2024-09-19T06:38:52.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:51 smithi016 ceph-mon[34911]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T06:38:52.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:51 smithi173 ceph-mon[35349]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T06:38:52.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:51 smithi012 ceph-mon[30937]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T06:38:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.596+0000 7f4660281640 1 -- 172.21.15.12:0/633471754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4658102790 msgr2=0x7f46581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.596+0000 7f4660281640 1 --2- 172.21.15.12:0/633471754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4658102790 0x7f46581067e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4648009900 tx=0x7f464802a410 comp rx=0 tx=0).stop 2024-09-19T06:38:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.596+0000 7f4660281640 1 -- 172.21.15.12:0/633471754 shutdown_connections 2024-09-19T06:38:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.596+0000 7f4660281640 1 --2- 172.21.15.12:0/633471754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4658106f10 0x7f465810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.596+0000 7f4660281640 1 --2- 172.21.15.12:0/633471754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4658102790 0x7f46581067e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.596+0000 7f4660281640 1 --2- 172.21.15.12:0/633471754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4658101de0 0x7f46581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.596+0000 7f4660281640 1 -- 172.21.15.12:0/633471754 >> 172.21.15.12:0/633471754 conn(0x7f46580fd8c0 msgr2=0x7f46580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.596+0000 7f4660281640 1 -- 172.21.15.12:0/633471754 shutdown_connections 2024-09-19T06:38:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.596+0000 7f4660281640 1 -- 172.21.15.12:0/633471754 wait complete. 2024-09-19T06:38:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f4660281640 1 Processor -- start 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f4660281640 1 -- start start 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f4660281640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4658101de0 0x7f46581984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f4660281640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4658102790 0x7f4658198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f4660281640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4658106f10 0x7f465819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f4660281640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4658112000 con 0x7f4658102790 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f4660281640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4658111e80 con 0x7f4658101de0 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f4660281640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4658112180 con 0x7f4658106f10 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465d81c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4658102790 0x7f4658198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465d81c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4658102790 0x7f4658198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42964/0 (socket says 172.21.15.12:42964) 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465d81c640 1 -- 172.21.15.12:0/63455744 learned_addr learned my addr 172.21.15.12:0/63455744 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465e81e640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4658106f10 0x7f465819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465e01d640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4658101de0 0x7f46581984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465d81c640 1 -- 172.21.15.12:0/63455744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4658106f10 msgr2=0x7f465819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465d81c640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4658106f10 0x7f465819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465d81c640 1 -- 172.21.15.12:0/63455744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4658101de0 msgr2=0x7f46581984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465d81c640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4658101de0 0x7f46581984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465d81c640 1 -- 172.21.15.12:0/63455744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465819d480 con 0x7f4658102790 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465e81e640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4658106f10 0x7f465819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.597+0000 7f465e01d640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4658101de0 0x7f46581984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.598+0000 7f465d81c640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4658102790 0x7f4658198a10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4648004770 tx=0x7f4648003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.598+0000 7f464f7fe640 1 -- 172.21.15.12:0/63455744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464803f070 con 0x7f4658102790 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.598+0000 7f464f7fe640 1 -- 172.21.15.12:0/63455744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4648031ca0 con 0x7f4658102790 2024-09-19T06:38:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.598+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465819d710 con 0x7f4658102790 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.598+0000 7f464f7fe640 1 -- 172.21.15.12:0/63455744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648035030 con 0x7f4658102790 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.598+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46581a5050 con 0x7f4658102790 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.599+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4658062980 con 0x7f4658102790 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.600+0000 7f464f7fe640 1 -- 172.21.15.12:0/63455744 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4648042070 con 0x7f4658102790 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.601+0000 7f464f7fe640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46440a32d0 0x7f46440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.601+0000 7f465e01d640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46440a32d0 0x7f46440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.601+0000 7f464f7fe640 1 -- 172.21.15.12:0/63455744 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f46480f0360 con 0x7f4658102790 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.601+0000 7f464f7fe640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] conn(0x7f46440acf80 0x7f46440af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.601+0000 7f464f7fe640 1 -- 172.21.15.12:0/63455744 --> [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f464800b0b0 con 0x7f46440acf80 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.601+0000 7f464f7fe640 1 -- 172.21.15.12:0/63455744 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f46480f07b0 con 0x7f4658102790 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.601+0000 7f465e01d640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46440a32d0 0x7f46440a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4654009b40 tx=0x7f4654005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:52.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.602+0000 7f465e81e640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] conn(0x7f46440acf80 0x7f46440af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.602+0000 7f465e81e640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] conn(0x7f46440acf80 0x7f46440af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.603+0000 7f464f7fe640 1 -- 172.21.15.12:0/63455744 <== osd.1 v2:172.21.15.16:6800/610562255 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f464800b0b0 con 0x7f46440acf80 2024-09-19T06:38:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.616+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 --> [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4658062e00 con 0x7f46440acf80 2024-09-19T06:38:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f464f7fe640 1 -- 172.21.15.12:0/63455744 <== osd.1 v2:172.21.15.16:6800/610562255 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4658062e00 con 0x7f46440acf80 2024-09-19T06:38:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 >> [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] conn(0x7f46440acf80 msgr2=0x7f46440af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f4660281640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] conn(0x7f46440acf80 0x7f46440af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46440a32d0 msgr2=0x7f46440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f4660281640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46440a32d0 0x7f46440a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4654009b40 tx=0x7f4654005e50 comp rx=0 tx=0).stop 2024-09-19T06:38:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4658102790 msgr2=0x7f4658198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f4660281640 1 --2- 172.21.15.12:0/63455744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4658102790 0x7f4658198a10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4648004770 tx=0x7f4648003c10 comp rx=0 tx=0).stop 2024-09-19T06:38:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f465e81e640 1 -- 172.21.15.12:0/63455744 reap_dead start 2024-09-19T06:38:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 shutdown_connections 2024-09-19T06:38:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 >> 172.21.15.12:0/63455744 conn(0x7f46580fd8c0 msgr2=0x7f46580fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 shutdown_connections 2024-09-19T06:38:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.617+0000 7f4660281640 1 -- 172.21.15.12:0/63455744 wait complete. 2024-09-19T06:38:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.276+0000 7f38c8e45640 1 -- 172.21.15.12:0/2119267722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c4102de0 msgr2=0x7f38c41031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.276+0000 7f38c8e45640 1 --2- 172.21.15.12:0/2119267722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c4102de0 0x7f38c41031c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009900 tx=0x7f38b402a480 comp rx=0 tx=0).stop 2024-09-19T06:38:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.276+0000 7f38c8e45640 1 -- 172.21.15.12:0/2119267722 shutdown_connections 2024-09-19T06:38:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.276+0000 7f38c8e45640 1 --2- 172.21.15.12:0/2119267722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c410c180 0x7f38c410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.276+0000 7f38c8e45640 1 --2- 172.21.15.12:0/2119267722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c4103700 0x7f38c410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.276+0000 7f38c8e45640 1 --2- 172.21.15.12:0/2119267722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c4102de0 0x7f38c41031c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.276+0000 7f38c8e45640 1 -- 172.21.15.12:0/2119267722 >> 172.21.15.12:0/2119267722 conn(0x7f38c40fc7a0 msgr2=0x7f38c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.276+0000 7f38c8e45640 1 -- 172.21.15.12:0/2119267722 shutdown_connections 2024-09-19T06:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.276+0000 7f38c8e45640 1 -- 172.21.15.12:0/2119267722 wait complete. 2024-09-19T06:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c8e45640 1 Processor -- start 2024-09-19T06:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c8e45640 1 -- start start 2024-09-19T06:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c8e45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c4102de0 0x7f38c41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c8e45640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c4103700 0x7f38c4198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c8e45640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c410c180 0x7f38c419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c8e45640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4111fb0 con 0x7f38c410c180 2024-09-19T06:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c8e45640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4111e30 con 0x7f38c4102de0 2024-09-19T06:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c8e45640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4112130 con 0x7f38c4103700 2024-09-19T06:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c410c180 0x7f38c419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c410c180 0x7f38c419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42938/0 (socket says 172.21.15.12:42938) 2024-09-19T06:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c2d9d640 1 -- 172.21.15.12:0/689062216 learned_addr learned my addr 172.21.15.12:0/689062216 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.277+0000 7f38c259c640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c4102de0 0x7f38c41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38c1d9b640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c4103700 0x7f38c4198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38c2d9d640 1 -- 172.21.15.12:0/689062216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c4103700 msgr2=0x7f38c4198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38c2d9d640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c4103700 0x7f38c4198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38c2d9d640 1 -- 172.21.15.12:0/689062216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c4102de0 msgr2=0x7f38c41985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38c2d9d640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c4102de0 0x7f38c41985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38c2d9d640 1 -- 172.21.15.12:0/689062216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c419d570 con 0x7f38c410c180 2024-09-19T06:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38c2d9d640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c410c180 0x7f38c419ce90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00eaa0 tx=0x7f38bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38b37fe640 1 -- 172.21.15.12:0/689062216 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00cdb0 con 0x7f38c410c180 2024-09-19T06:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38b37fe640 1 -- 172.21.15.12:0/689062216 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38bc005020 con 0x7f38c410c180 2024-09-19T06:38:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c419d860 con 0x7f38c410c180 2024-09-19T06:38:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38b37fe640 1 -- 172.21.15.12:0/689062216 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0116b0 con 0x7f38c410c180 2024-09-19T06:38:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.278+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c41a5140 con 0x7f38c410c180 2024-09-19T06:38:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.279+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38c4062900 con 0x7f38c410c180 2024-09-19T06:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.280+0000 7f38b37fe640 1 -- 172.21.15.12:0/689062216 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f38bc005560 con 0x7f38c410c180 2024-09-19T06:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.281+0000 7f38b37fe640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f38ac0a32d0 0x7f38ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.281+0000 7f38c259c640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f38ac0a32d0 0x7f38ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.281+0000 7f38b37fe640 1 -- 172.21.15.12:0/689062216 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f38bc0d0120 con 0x7f38c410c180 2024-09-19T06:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.281+0000 7f38b37fe640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] conn(0x7f38ac0acf80 0x7f38ac0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.281+0000 7f38b37fe640 1 -- 172.21.15.12:0/689062216 --> [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38bc014ec0 con 0x7f38ac0acf80 2024-09-19T06:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.281+0000 7f38b37fe640 1 -- 172.21.15.12:0/689062216 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f38bc0d0570 con 0x7f38c410c180 2024-09-19T06:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.282+0000 7f38c1d9b640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] conn(0x7f38ac0acf80 0x7f38ac0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.282+0000 7f38c259c640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f38ac0a32d0 0x7f38ac0a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009230 tx=0x7f38b40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.282+0000 7f38c1d9b640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] conn(0x7f38ac0acf80 0x7f38ac0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.283+0000 7f38b37fe640 1 -- 172.21.15.12:0/689062216 <== osd.0 v2:172.21.15.12:6802/3065119058 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38bc014ec0 con 0x7f38ac0acf80 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.296+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 --> [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f38c4062d00 con 0x7f38ac0acf80 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38b37fe640 1 -- 172.21.15.12:0/689062216 <== osd.0 v2:172.21.15.12:6802/3065119058 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f38c4062d00 con 0x7f38ac0acf80 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] conn(0x7f38ac0acf80 msgr2=0x7f38ac0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c8e45640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] conn(0x7f38ac0acf80 0x7f38ac0af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f38ac0a32d0 msgr2=0x7f38ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c8e45640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f38ac0a32d0 0x7f38ac0a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009230 tx=0x7f38b40058d0 comp rx=0 tx=0).stop 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c410c180 msgr2=0x7f38c419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c8e45640 1 --2- 172.21.15.12:0/689062216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c410c180 0x7f38c419ce90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00eaa0 tx=0x7f38bc00ef60 comp rx=0 tx=0).stop 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c2d9d640 1 -- 172.21.15.12:0/689062216 reap_dead start 2024-09-19T06:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 shutdown_connections 2024-09-19T06:38:52.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 >> 172.21.15.12:0/689062216 conn(0x7f38c40fc7a0 msgr2=0x7f38c40fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:52.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 shutdown_connections 2024-09-19T06:38:52.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:52.297+0000 7f38c8e45640 1 -- 172.21.15.12:0/689062216 wait complete. 2024-09-19T06:38:53.649 INFO:teuthology.orchestra.run.smithi012.stdout:193273528366 2024-09-19T06:38:53.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T06:38:53.866 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:53 smithi012 ceph-mon[30937]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T06:38:53.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.826+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/1393272904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb4106f40 msgr2=0x7f1eb410eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:53.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.826+0000 7f1eb9dd1640 1 --2- 172.21.15.12:0/1393272904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb4106f40 0x7f1eb410eac0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009ca0 tx=0x7f1eac02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:38:53.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.826+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/1393272904 shutdown_connections 2024-09-19T06:38:53.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.826+0000 7f1eb9dd1640 1 --2- 172.21.15.12:0/1393272904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb4106f40 0x7f1eb410eac0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:53.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.826+0000 7f1eb9dd1640 1 --2- 172.21.15.12:0/1393272904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eb41027c0 0x7f1eb4106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:53.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.826+0000 7f1eb9dd1640 1 --2- 172.21.15.12:0/1393272904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4101e10 0x7f1eb41021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.826+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/1393272904 >> 172.21.15.12:0/1393272904 conn(0x7f1eb40fd8d0 msgr2=0x7f1eb40ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.826+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/1393272904 shutdown_connections 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.827+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/1393272904 wait complete. 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.827+0000 7f1eb9dd1640 1 Processor -- start 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.827+0000 7f1eb9dd1640 1 -- start start 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb9dd1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4101e10 0x7f1eb4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb9dd1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb41027c0 0x7f1eb41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb9dd1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eb4106f40 0x7f1eb419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb9dd1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4111fa0 con 0x7f1eb41027c0 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb9dd1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4111e20 con 0x7f1eb4101e10 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb9dd1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4112120 con 0x7f1eb4106f40 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb41027c0 0x7f1eb41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb41027c0 0x7f1eb41988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42974/0 (socket says 172.21.15.12:42974) 2024-09-19T06:38:53.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb2ffd640 1 -- 172.21.15.12:0/2718099338 learned_addr learned my addr 172.21.15.12:0/2718099338 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:53.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb37fe640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4101e10 0x7f1eb4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:53.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb3fff640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eb4106f40 0x7f1eb419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:53.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb2ffd640 1 -- 172.21.15.12:0/2718099338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eb4106f40 msgr2=0x7f1eb419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:53.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb2ffd640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eb4106f40 0x7f1eb419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:53.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb2ffd640 1 -- 172.21.15.12:0/2718099338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4101e10 msgr2=0x7f1eb4198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:53.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb2ffd640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4101e10 0x7f1eb4198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb2ffd640 1 -- 172.21.15.12:0/2718099338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb419d310 con 0x7f1eb41027c0 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb37fe640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4101e10 0x7f1eb4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.828+0000 7f1eb2ffd640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb41027c0 0x7f1eb41988a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800e9f0 tx=0x7f1ea800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.829+0000 7f1eb0ff9640 1 -- 172.21.15.12:0/2718099338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800ccc0 con 0x7f1eb41027c0 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.829+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb419d600 con 0x7f1eb41027c0 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.829+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb4074420 con 0x7f1eb41027c0 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.829+0000 7f1eb0ff9640 1 -- 172.21.15.12:0/2718099338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea800ce60 con 0x7f1eb41027c0 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.830+0000 7f1eb0ff9640 1 -- 172.21.15.12:0/2718099338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8010430 con 0x7f1eb41027c0 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.830+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ea0001030 con 0x7f1eb41027c0 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.832+0000 7f1eb0ff9640 1 -- 172.21.15.12:0/2718099338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1ea80046c0 con 0x7f1eb41027c0 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.833+0000 7f1eb0ff9640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e9c0a3350 0x7f1e9c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:53.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.833+0000 7f1eb0ff9640 1 -- 172.21.15.12:0/2718099338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f1ea80d0370 con 0x7f1eb41027c0 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.833+0000 7f1eb37fe640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e9c0a3350 0x7f1e9c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.833+0000 7f1eb0ff9640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] conn(0x7f1e9c0ad000 0x7f1e9c0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.833+0000 7f1eb0ff9640 1 -- 172.21.15.12:0/2718099338 --> [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e9c0afb70 con 0x7f1e9c0ad000 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.833+0000 7f1eb0ff9640 1 -- 172.21.15.12:0/2718099338 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f1ea80d0720 con 0x7f1eb41027c0 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.834+0000 7f1eb37fe640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e9c0a3350 0x7f1e9c0a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400afb0 tx=0x7f1ea400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.834+0000 7f1eb3fff640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] conn(0x7f1e9c0ad000 0x7f1e9c0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.834+0000 7f1eb3fff640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] conn(0x7f1e9c0ad000 0x7f1e9c0af4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.835+0000 7f1eb0ff9640 1 -- 172.21.15.12:0/2718099338 <== osd.8 v2:172.21.15.173:6816/332186577 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e9c0afb70 con 0x7f1e9c0ad000 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.864+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 --> [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ea0002dd0 con 0x7f1e9c0ad000 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.865+0000 7f1eb0ff9640 1 -- 172.21.15.12:0/2718099338 <== osd.8 v2:172.21.15.173:6816/332186577 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1ea0002dd0 con 0x7f1e9c0ad000 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 >> [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] conn(0x7f1e9c0ad000 msgr2=0x7f1e9c0af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:53.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb9dd1640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] conn(0x7f1e9c0ad000 0x7f1e9c0af4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e9c0a3350 msgr2=0x7f1e9c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb9dd1640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f1e9c0a3350 0x7f1e9c0a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400afb0 tx=0x7f1ea400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:38:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb41027c0 msgr2=0x7f1eb41988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb9dd1640 1 --2- 172.21.15.12:0/2718099338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eb41027c0 0x7f1eb41988a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800e9f0 tx=0x7f1ea800edf0 comp rx=0 tx=0).stop 2024-09-19T06:38:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb3fff640 1 -- 172.21.15.12:0/2718099338 reap_dead start 2024-09-19T06:38:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 shutdown_connections 2024-09-19T06:38:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 >> 172.21.15.12:0/2718099338 conn(0x7f1eb40fd8d0 msgr2=0x7f1eb40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 shutdown_connections 2024-09-19T06:38:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.866+0000 7f1eb9dd1640 1 -- 172.21.15.12:0/2718099338 wait complete. 2024-09-19T06:38:54.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:53 smithi016 ceph-mon[34911]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T06:38:54.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:53 smithi173 ceph-mon[35349]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T06:38:54.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.356+0000 7fdea7296640 1 -- 172.21.15.12:0/1596532936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea01027a0 msgr2=0x7fdea01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:54.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.356+0000 7fdea7296640 1 --2- 172.21.15.12:0/1596532936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea01027a0 0x7fdea01067f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fde90009900 tx=0x7fde9002a410 comp rx=0 tx=0).stop 2024-09-19T06:38:54.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.356+0000 7fdea7296640 1 -- 172.21.15.12:0/1596532936 shutdown_connections 2024-09-19T06:38:54.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.356+0000 7fdea7296640 1 --2- 172.21.15.12:0/1596532936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdea0106f20 0x7fdea010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:54.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.356+0000 7fdea7296640 1 --2- 172.21.15.12:0/1596532936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea01027a0 0x7fdea01067f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:54.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.356+0000 7fdea7296640 1 --2- 172.21.15.12:0/1596532936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea0101df0 0x7fdea01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:54.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.356+0000 7fdea7296640 1 -- 172.21.15.12:0/1596532936 >> 172.21.15.12:0/1596532936 conn(0x7fdea00fd8f0 msgr2=0x7fdea00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:54.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.356+0000 7fdea7296640 1 -- 172.21.15.12:0/1596532936 shutdown_connections 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.356+0000 7fdea7296640 1 -- 172.21.15.12:0/1596532936 wait complete. 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.357+0000 7fdea7296640 1 Processor -- start 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.357+0000 7fdea7296640 1 -- start start 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.357+0000 7fdea7296640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea0101df0 0x7fdea0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.357+0000 7fdea7296640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea01027a0 0x7fdea01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.357+0000 7fdea7296640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdea0106f20 0x7fdea019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.357+0000 7fdea7296640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0111f80 con 0x7fdea01027a0 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.357+0000 7fdea7296640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0111e00 con 0x7fdea0106f20 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.357+0000 7fdea7296640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0112100 con 0x7fdea0101df0 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea5032640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea0101df0 0x7fdea0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea4831640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea01027a0 0x7fdea01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea5833640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdea0106f20 0x7fdea019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea5032640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea0101df0 0x7fdea0198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45638/0 (socket says 172.21.15.12:45638) 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea5032640 1 -- 172.21.15.12:0/2029821175 learned_addr learned my addr 172.21.15.12:0/2029821175 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea4831640 1 -- 172.21.15.12:0/2029821175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea0101df0 msgr2=0x7fdea0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea4831640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdea0101df0 0x7fdea0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea4831640 1 -- 172.21.15.12:0/2029821175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdea0106f20 msgr2=0x7fdea019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea4831640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdea0106f20 0x7fdea019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea4831640 1 -- 172.21.15.12:0/2029821175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea019d410 con 0x7fdea01027a0 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea4831640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea01027a0 0x7fdea01989a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde90005940 tx=0x7fde900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fde967fc640 1 -- 172.21.15.12:0/2029821175 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9003f030 con 0x7fdea01027a0 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea019d6a0 con 0x7fdea01027a0 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fde967fc640 1 -- 172.21.15.12:0/2029821175 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde90003ce0 con 0x7fdea01027a0 2024-09-19T06:38:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fde967fc640 1 -- 172.21.15.12:0/2029821175 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90035070 con 0x7fdea01027a0 2024-09-19T06:38:54.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.358+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea01a4fe0 con 0x7fdea01027a0 2024-09-19T06:38:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.359+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdea0062940 con 0x7fdea01027a0 2024-09-19T06:38:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.361+0000 7fde967fc640 1 -- 172.21.15.12:0/2029821175 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fde90042030 con 0x7fdea01027a0 2024-09-19T06:38:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.361+0000 7fde967fc640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fde8c0a32d0 0x7fde8c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.361+0000 7fdea5032640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fde8c0a32d0 0x7fde8c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.362+0000 7fde967fc640 1 -- 172.21.15.12:0/2029821175 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fde900f0250 con 0x7fdea01027a0 2024-09-19T06:38:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.362+0000 7fde967fc640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] conn(0x7fde8c0acf80 0x7fde8c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.362+0000 7fde967fc640 1 -- 172.21.15.12:0/2029821175 --> [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde8c0afaf0 con 0x7fde8c0acf80 2024-09-19T06:38:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.362+0000 7fde967fc640 1 -- 172.21.15.12:0/2029821175 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fde900f7050 con 0x7fdea01027a0 2024-09-19T06:38:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.362+0000 7fdea5833640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] conn(0x7fde8c0acf80 0x7fde8c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.362+0000 7fdea5032640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fde8c0a32d0 0x7fde8c0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00bca0 tx=0x7fde9c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.363+0000 7fdea5833640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] conn(0x7fde8c0acf80 0x7fde8c0af420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.363+0000 7fde967fc640 1 -- 172.21.15.12:0/2029821175 <== osd.5 v2:172.21.15.173:6808/2756003691 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde8c0afaf0 con 0x7fde8c0acf80 2024-09-19T06:38:54.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.377+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 --> [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdea0062d70 con 0x7fde8c0acf80 2024-09-19T06:38:54.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.378+0000 7fde967fc640 1 -- 172.21.15.12:0/2029821175 <== osd.5 v2:172.21.15.173:6808/2756003691 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdea0062d70 con 0x7fde8c0acf80 2024-09-19T06:38:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.378+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 >> [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] conn(0x7fde8c0acf80 msgr2=0x7fde8c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.378+0000 7fdea7296640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] conn(0x7fde8c0acf80 0x7fde8c0af420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.378+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fde8c0a32d0 msgr2=0x7fde8c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.378+0000 7fdea7296640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fde8c0a32d0 0x7fde8c0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00bca0 tx=0x7fde9c00b410 comp rx=0 tx=0).stop 2024-09-19T06:38:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.378+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea01027a0 msgr2=0x7fdea01989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.378+0000 7fdea7296640 1 --2- 172.21.15.12:0/2029821175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea01027a0 0x7fdea01989a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fde90005940 tx=0x7fde900042f0 comp rx=0 tx=0).stop 2024-09-19T06:38:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.378+0000 7fdea5833640 1 -- 172.21.15.12:0/2029821175 reap_dead start 2024-09-19T06:38:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.378+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 shutdown_connections 2024-09-19T06:38:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.378+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 >> 172.21.15.12:0/2029821175 conn(0x7fdea00fd8f0 msgr2=0x7fdea00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.379+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 shutdown_connections 2024-09-19T06:38:54.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:54.379+0000 7fdea7296640 1 -- 172.21.15.12:0/2029821175 wait complete. 2024-09-19T06:38:54.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:54 smithi012 ceph-mon[30937]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T06:38:55.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:54 smithi016 ceph-mon[34911]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T06:38:55.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:54 smithi173 ceph-mon[35349]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T06:38:55.092 INFO:teuthology.orchestra.run.smithi012.stdout:55834574919 2024-09-19T06:38:55.092 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T06:38:55.117 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:55.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 -- 172.21.15.12:0/3557995993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7640102dd0 msgr2=0x7f76401031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:55.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 --2- 172.21.15.12:0/3557995993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7640102dd0 0x7f76401031b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7630009930 tx=0x7f763002a420 comp rx=0 tx=0).stop 2024-09-19T06:38:55.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 -- 172.21.15.12:0/3557995993 shutdown_connections 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 --2- 172.21.15.12:0/3557995993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7640108300 0x7f764010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 --2- 172.21.15.12:0/3557995993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7640103780 0x7f7640107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 --2- 172.21.15.12:0/3557995993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7640102dd0 0x7f76401031b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 -- 172.21.15.12:0/3557995993 >> 172.21.15.12:0/3557995993 conn(0x7f76400fc7d0 msgr2=0x7f76400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 -- 172.21.15.12:0/3557995993 shutdown_connections 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 -- 172.21.15.12:0/3557995993 wait complete. 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 Processor -- start 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.632+0000 7f764667e640 1 -- start start 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f764667e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7640102dd0 0x7f7640100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f764667e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7640103780 0x7f7640100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f764667e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7640108300 0x7f76401014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:55.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f764667e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7640112090 con 0x7f7640103780 2024-09-19T06:38:55.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f764667e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7640111f10 con 0x7f7640108300 2024-09-19T06:38:55.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f764667e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7640112210 con 0x7f7640102dd0 2024-09-19T06:38:55.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f763f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7640103780 0x7f7640100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:55.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f763f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7640103780 0x7f7640100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43026/0 (socket says 172.21.15.12:43026) 2024-09-19T06:38:55.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f763f7fe640 1 -- 172.21.15.12:0/698624449 learned_addr learned my addr 172.21.15.12:0/698624449 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:55.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f763ffff640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7640102dd0 0x7f7640100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:55.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f7644c1b640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7640108300 0x7f76401014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:55.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f763f7fe640 1 -- 172.21.15.12:0/698624449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7640102dd0 msgr2=0x7f7640100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:55.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f763f7fe640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7640102dd0 0x7f7640100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:55.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f763f7fe640 1 -- 172.21.15.12:0/698624449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7640108300 msgr2=0x7f76401014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:55.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f763f7fe640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7640108300 0x7f76401014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:55.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f763f7fe640 1 -- 172.21.15.12:0/698624449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76401a6a10 con 0x7f7640103780 2024-09-19T06:38:55.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.633+0000 7f763f7fe640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7640103780 0x7f7640100f70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f763400d950 tx=0x7f763400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.634+0000 7f763d7fa640 1 -- 172.21.15.12:0/698624449 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634017070 con 0x7f7640103780 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.634+0000 7f763d7fa640 1 -- 172.21.15.12:0/698624449 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7634009c30 con 0x7f7640103780 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.634+0000 7f763d7fa640 1 -- 172.21.15.12:0/698624449 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76340047a0 con 0x7f7640103780 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.634+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76401a6d00 con 0x7f7640103780 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.634+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76401a7190 con 0x7f7640103780 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.635+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7640062880 con 0x7f7640103780 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.636+0000 7f763d7fa640 1 -- 172.21.15.12:0/698624449 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7634004020 con 0x7f7640103780 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.637+0000 7f763d7fa640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76280a32d0 0x7f76280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.637+0000 7f763ffff640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76280a32d0 0x7f76280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.637+0000 7f763d7fa640 1 -- 172.21.15.12:0/698624449 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f76340cfd20 con 0x7f7640103780 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.637+0000 7f763d7fa640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] conn(0x7f76280acf80 0x7f76280af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:55.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.637+0000 7f763d7fa640 1 -- 172.21.15.12:0/698624449 --> [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76280afaf0 con 0x7f76280acf80 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.637+0000 7f763d7fa640 1 -- 172.21.15.12:0/698624449 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f76340d0170 con 0x7f7640103780 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.637+0000 7f763ffff640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76280a32d0 0x7f76280a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7630000c00 tx=0x7f7630005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.637+0000 7f7644c1b640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] conn(0x7f76280acf80 0x7f76280af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.638+0000 7f7644c1b640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] conn(0x7f76280acf80 0x7f76280af420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.638+0000 7f763d7fa640 1 -- 172.21.15.12:0/698624449 <== osd.10 v2:172.21.15.16:6824/2551433772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f76280afaf0 con 0x7f76280acf80 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.652+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 --> [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7640062d00 con 0x7f76280acf80 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f763d7fa640 1 -- 172.21.15.12:0/698624449 <== osd.10 v2:172.21.15.16:6824/2551433772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7640062d00 con 0x7f76280acf80 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 >> [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] conn(0x7f76280acf80 msgr2=0x7f76280af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f764667e640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] conn(0x7f76280acf80 0x7f76280af420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76280a32d0 msgr2=0x7f76280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f764667e640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76280a32d0 0x7f76280a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7630000c00 tx=0x7f7630005a20 comp rx=0 tx=0).stop 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7640103780 msgr2=0x7f7640100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:55.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f764667e640 1 --2- 172.21.15.12:0/698624449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7640103780 0x7f7640100f70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f763400d950 tx=0x7f763400de10 comp rx=0 tx=0).stop 2024-09-19T06:38:55.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f7644c1b640 1 -- 172.21.15.12:0/698624449 reap_dead start 2024-09-19T06:38:55.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 shutdown_connections 2024-09-19T06:38:55.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 >> 172.21.15.12:0/698624449 conn(0x7f76400fc7d0 msgr2=0x7f7640105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:55.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 shutdown_connections 2024-09-19T06:38:55.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:55.653+0000 7f764667e640 1 -- 172.21.15.12:0/698624449 wait complete. 2024-09-19T06:38:56.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.924+0000 7fe963f18640 1 -- 172.21.15.12:0/999245272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe95c1027a0 msgr2=0x7fe95c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:56.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.924+0000 7fe963f18640 1 --2- 172.21.15.12:0/999245272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe95c1027a0 0x7fe95c1067f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe950009900 tx=0x7fe95002a410 comp rx=0 tx=0).stop 2024-09-19T06:38:56.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.924+0000 7fe963f18640 1 -- 172.21.15.12:0/999245272 shutdown_connections 2024-09-19T06:38:56.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.924+0000 7fe963f18640 1 --2- 172.21.15.12:0/999245272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe95c106f20 0x7fe95c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:56.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.924+0000 7fe963f18640 1 --2- 172.21.15.12:0/999245272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe95c1027a0 0x7fe95c1067f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:56.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.924+0000 7fe963f18640 1 --2- 172.21.15.12:0/999245272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe95c101df0 0x7fe95c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.924+0000 7fe963f18640 1 -- 172.21.15.12:0/999245272 >> 172.21.15.12:0/999245272 conn(0x7fe95c0fd8f0 msgr2=0x7fe95c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.924+0000 7fe963f18640 1 -- 172.21.15.12:0/999245272 shutdown_connections 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.924+0000 7fe963f18640 1 -- 172.21.15.12:0/999245272 wait complete. 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe963f18640 1 Processor -- start 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe963f18640 1 -- start start 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe963f18640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe95c101df0 0x7fe95c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe963f18640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe95c1027a0 0x7fe95c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe963f18640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe95c106f20 0x7fe95c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe963f18640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c111f40 con 0x7fe95c101df0 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe963f18640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c111dc0 con 0x7fe95c106f20 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe963f18640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c1120c0 con 0x7fe95c1027a0 2024-09-19T06:38:56.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe961cb4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe95c101df0 0x7fe95c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe961cb4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe95c101df0 0x7fe95c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42982/0 (socket says 172.21.15.12:42982) 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe961cb4640 1 -- 172.21.15.12:0/4178612974 learned_addr learned my addr 172.21.15.12:0/4178612974 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe9614b3640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe95c1027a0 0x7fe95c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe9624b5640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe95c106f20 0x7fe95c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe961cb4640 1 -- 172.21.15.12:0/4178612974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe95c1027a0 msgr2=0x7fe95c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe961cb4640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe95c1027a0 0x7fe95c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe961cb4640 1 -- 172.21.15.12:0/4178612974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe95c106f20 msgr2=0x7fe95c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe961cb4640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe95c106f20 0x7fe95c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe961cb4640 1 -- 172.21.15.12:0/4178612974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c19d430 con 0x7fe95c101df0 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe9614b3640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe95c1027a0 0x7fe95c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.925+0000 7fe9624b5640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe95c106f20 0x7fe95c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:38:56.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.926+0000 7fe961cb4640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe95c101df0 0x7fe95c198480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe95400d950 tx=0x7fe95400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.926+0000 7fe95affd640 1 -- 172.21.15.12:0/4178612974 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954017030 con 0x7fe95c101df0 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.926+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95c19d720 con 0x7fe95c101df0 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.926+0000 7fe95affd640 1 -- 172.21.15.12:0/4178612974 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe954004020 con 0x7fe95c101df0 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.926+0000 7fe95affd640 1 -- 172.21.15.12:0/4178612974 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9540047a0 con 0x7fe95c101df0 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.926+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95c1a5000 con 0x7fe95c101df0 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.927+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe95c062980 con 0x7fe95c101df0 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.928+0000 7fe95affd640 1 -- 172.21.15.12:0/4178612974 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe9540041d0 con 0x7fe95c101df0 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.928+0000 7fe95affd640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe9440a32d0 0x7fe9440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.929+0000 7fe9614b3640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe9440a32d0 0x7fe9440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.929+0000 7fe95affd640 1 -- 172.21.15.12:0/4178612974 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe9540cfc30 con 0x7fe95c101df0 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.929+0000 7fe95affd640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] conn(0x7fe9440acf80 0x7fe9440af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:56.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.929+0000 7fe95affd640 1 -- 172.21.15.12:0/4178612974 --> [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9440afaf0 con 0x7fe9440acf80 2024-09-19T06:38:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.929+0000 7fe95affd640 1 -- 172.21.15.12:0/4178612974 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe9540d0080 con 0x7fe95c101df0 2024-09-19T06:38:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.929+0000 7fe9624b5640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] conn(0x7fe9440acf80 0x7fe9440af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.929+0000 7fe9614b3640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe9440a32d0 0x7fe9440a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe95c108880 tx=0x7fe950005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.929+0000 7fe9624b5640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] conn(0x7fe9440acf80 0x7fe9440af420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.930+0000 7fe95affd640 1 -- 172.21.15.12:0/4178612974 <== osd.4 v2:172.21.15.16:6808/250959464 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe9440afaf0 con 0x7fe9440acf80 2024-09-19T06:38:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.944+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 --> [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe95c062e00 con 0x7fe9440acf80 2024-09-19T06:38:56.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.945+0000 7fe95affd640 1 -- 172.21.15.12:0/4178612974 <== osd.4 v2:172.21.15.16:6808/250959464 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe95c062e00 con 0x7fe9440acf80 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 >> [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] conn(0x7fe9440acf80 msgr2=0x7fe9440af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe963f18640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] conn(0x7fe9440acf80 0x7fe9440af420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe9440a32d0 msgr2=0x7fe9440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe963f18640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe9440a32d0 0x7fe9440a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe95c108880 tx=0x7fe950005a20 comp rx=0 tx=0).stop 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe95c101df0 msgr2=0x7fe95c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe963f18640 1 --2- 172.21.15.12:0/4178612974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe95c101df0 0x7fe95c198480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe95400d950 tx=0x7fe95400de10 comp rx=0 tx=0).stop 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe9624b5640 1 -- 172.21.15.12:0/4178612974 reap_dead start 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 shutdown_connections 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 >> 172.21.15.12:0/4178612974 conn(0x7fe95c0fd8f0 msgr2=0x7fe95c0fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 shutdown_connections 2024-09-19T06:38:56.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:53.946+0000 7fe963f18640 1 -- 172.21.15.12:0/4178612974 wait complete. 2024-09-19T06:38:56.899 INFO:teuthology.orchestra.run.smithi012.stdout:137438953527 2024-09-19T06:38:56.899 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T06:38:57.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:56 smithi173 ceph-mon[35349]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-19T06:38:57.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:56 smithi012 ceph-mon[30937]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-19T06:38:57.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:56 smithi016 ceph-mon[34911]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-19T06:38:57.316 INFO:teuthology.orchestra.run.smithi012.stdout:158913790003 2024-09-19T06:38:57.316 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T06:38:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.687+0000 7f1219706640 1 -- 172.21.15.12:0/552004818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1214102570 msgr2=0x7f12141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.687+0000 7f1219706640 1 --2- 172.21.15.12:0/552004818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1214102570 0x7f12141029b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009900 tx=0x7f11fc02a480 comp rx=0 tx=0).stop 2024-09-19T06:38:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.687+0000 7f1219706640 1 -- 172.21.15.12:0/552004818 shutdown_connections 2024-09-19T06:38:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.687+0000 7f1219706640 1 --2- 172.21.15.12:0/552004818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1214102ef0 0x7f121410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.687+0000 7f1219706640 1 --2- 172.21.15.12:0/552004818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1214102570 0x7f12141029b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.687+0000 7f1219706640 1 --2- 172.21.15.12:0/552004818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1214100e20 0x7f1214101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.687+0000 7f1219706640 1 -- 172.21.15.12:0/552004818 >> 172.21.15.12:0/552004818 conn(0x7f12140fc7d0 msgr2=0x7f12140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.688+0000 7f1219706640 1 -- 172.21.15.12:0/552004818 shutdown_connections 2024-09-19T06:38:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.688+0000 7f1219706640 1 -- 172.21.15.12:0/552004818 wait complete. 2024-09-19T06:38:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.688+0000 7f1219706640 1 Processor -- start 2024-09-19T06:38:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.688+0000 7f1219706640 1 -- start start 2024-09-19T06:38:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f1219706640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1214100e20 0x7f1214198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f1219706640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1214102570 0x7f1214198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f1219706640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1214102ef0 0x7f121419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f1219706640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12141120a0 con 0x7f1214102ef0 2024-09-19T06:38:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f1219706640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1214111f20 con 0x7f1214100e20 2024-09-19T06:38:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f1219706640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1214112220 con 0x7f1214102570 2024-09-19T06:38:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f1212ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1214100e20 0x7f1214198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f12137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1214102ef0 0x7f121419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f1212ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1214100e20 0x7f1214198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:48094/0 (socket says 172.21.15.12:48094) 2024-09-19T06:38:57.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f1212ffd640 1 -- 172.21.15.12:0/3345033881 learned_addr learned my addr 172.21.15.12:0/3345033881 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:38:57.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f12127fc640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1214102570 0x7f1214198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:57.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f12137fe640 1 -- 172.21.15.12:0/3345033881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1214102570 msgr2=0x7f1214198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:57.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f12137fe640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1214102570 0x7f1214198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f12137fe640 1 -- 172.21.15.12:0/3345033881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1214100e20 msgr2=0x7f1214198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f12137fe640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1214100e20 0x7f1214198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f12137fe640 1 -- 172.21.15.12:0/3345033881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121419d4d0 con 0x7f1214102ef0 2024-09-19T06:38:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f1212ffd640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1214100e20 0x7f1214198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:38:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f12137fe640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1214102ef0 0x7f121419cdf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f120400b410 tx=0x7f120400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.689+0000 7f120bfff640 1 -- 172.21.15.12:0/3345033881 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204015020 con 0x7f1214102ef0 2024-09-19T06:38:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.690+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121419d7c0 con 0x7f1214102ef0 2024-09-19T06:38:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.690+0000 7f120bfff640 1 -- 172.21.15.12:0/3345033881 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1204011d10 con 0x7f1214102ef0 2024-09-19T06:38:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.690+0000 7f120bfff640 1 -- 172.21.15.12:0/3345033881 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120400f2e0 con 0x7f1214102ef0 2024-09-19T06:38:57.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.690+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12141a50a0 con 0x7f1214102ef0 2024-09-19T06:38:57.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.691+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1214062940 con 0x7f1214102ef0 2024-09-19T06:38:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.692+0000 7f120bfff640 1 -- 172.21.15.12:0/3345033881 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1204018020 con 0x7f1214102ef0 2024-09-19T06:38:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.692+0000 7f120bfff640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f12000a32d0 0x7f12000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.693+0000 7f1212ffd640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f12000a32d0 0x7f12000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.693+0000 7f120bfff640 1 -- 172.21.15.12:0/3345033881 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f12040cf760 con 0x7f1214102ef0 2024-09-19T06:38:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.693+0000 7f120bfff640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] conn(0x7f12000acf80 0x7f12000af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.693+0000 7f120bfff640 1 -- 172.21.15.12:0/3345033881 --> [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1204012e80 con 0x7f12000acf80 2024-09-19T06:38:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.693+0000 7f120bfff640 1 -- 172.21.15.12:0/3345033881 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f12040cfbb0 con 0x7f1214102ef0 2024-09-19T06:38:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.693+0000 7f1212ffd640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f12000a32d0 0x7f12000a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f120c00e840 tx=0x7f120c009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.693+0000 7f12127fc640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] conn(0x7f12000acf80 0x7f12000af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.693+0000 7f12127fc640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] conn(0x7f12000acf80 0x7f12000af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.694+0000 7f120bfff640 1 -- 172.21.15.12:0/3345033881 <== osd.7 v2:172.21.15.16:6816/3670688861 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1204012e80 con 0x7f12000acf80 2024-09-19T06:38:57.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.708+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 --> [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1214062dc0 con 0x7f12000acf80 2024-09-19T06:38:57.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f120bfff640 1 -- 172.21.15.12:0/3345033881 <== osd.7 v2:172.21.15.16:6816/3670688861 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1214062dc0 con 0x7f12000acf80 2024-09-19T06:38:57.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 >> [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] conn(0x7f12000acf80 msgr2=0x7f12000af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:57.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f1219706640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] conn(0x7f12000acf80 0x7f12000af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:57.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f12000a32d0 msgr2=0x7f12000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:57.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f1219706640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f12000a32d0 0x7f12000a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f120c00e840 tx=0x7f120c009800 comp rx=0 tx=0).stop 2024-09-19T06:38:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1214102ef0 msgr2=0x7f121419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f1219706640 1 --2- 172.21.15.12:0/3345033881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1214102ef0 0x7f121419cdf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f120400b410 tx=0x7f120400b8d0 comp rx=0 tx=0).stop 2024-09-19T06:38:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f12137fe640 1 -- 172.21.15.12:0/3345033881 reap_dead start 2024-09-19T06:38:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 shutdown_connections 2024-09-19T06:38:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 >> 172.21.15.12:0/3345033881 conn(0x7f12140fc7d0 msgr2=0x7f12140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 shutdown_connections 2024-09-19T06:38:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:38:57.709+0000 7f1219706640 1 -- 172.21.15.12:0/3345033881 wait complete. 2024-09-19T06:38:58.401 INFO:teuthology.orchestra.run.smithi012.stdout:210453397545 2024-09-19T06:38:58.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T06:38:59.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:38:58 smithi173 ceph-mon[35349]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:38:59.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:38:58 smithi012 ceph-mon[30937]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:38:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:38:58 smithi016 ceph-mon[34911]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:38:59.390 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:38:59.419 INFO:teuthology.orchestra.run.smithi012.stdout:34359738444 2024-09-19T06:38:59.420 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T06:38:59.938 INFO:teuthology.orchestra.run.smithi012.stdout:240518168612 2024-09-19T06:38:59.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T06:39:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.131+0000 7fc81d75a640 1 -- 172.21.15.12:0/3090450027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8181036e0 msgr2=0x7fc818107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.131+0000 7fc81d75a640 1 --2- 172.21.15.12:0/3090450027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8181036e0 0x7fc818107b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009cd0 tx=0x7fc80c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.131+0000 7fc81d75a640 1 -- 172.21.15.12:0/3090450027 shutdown_connections 2024-09-19T06:39:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.131+0000 7fc81d75a640 1 --2- 172.21.15.12:0/3090450027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8181082a0 0x7fc81810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.131+0000 7fc81d75a640 1 --2- 172.21.15.12:0/3090450027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8181036e0 0x7fc818107b90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.131+0000 7fc81d75a640 1 --2- 172.21.15.12:0/3090450027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818102d30 0x7fc818103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.131+0000 7fc81d75a640 1 -- 172.21.15.12:0/3090450027 >> 172.21.15.12:0/3090450027 conn(0x7fc8180fc7d0 msgr2=0x7fc8180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.131+0000 7fc81d75a640 1 -- 172.21.15.12:0/3090450027 shutdown_connections 2024-09-19T06:39:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.131+0000 7fc81d75a640 1 -- 172.21.15.12:0/3090450027 wait complete. 2024-09-19T06:39:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.132+0000 7fc81d75a640 1 Processor -- start 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.132+0000 7fc81d75a640 1 -- start start 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.132+0000 7fc81d75a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818102d30 0x7fc8181a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.132+0000 7fc81d75a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8181036e0 0x7fc8181a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.132+0000 7fc81d75a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8181082a0 0x7fc81810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.132+0000 7fc81d75a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc8181120a0 con 0x7fc8181082a0 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.132+0000 7fc81d75a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc818111f20 con 0x7fc8181036e0 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.132+0000 7fc81d75a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc818112220 con 0x7fc818102d30 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.132+0000 7fc8177fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8181082a0 0x7fc81810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc8177fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8181082a0 0x7fc81810de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43068/0 (socket says 172.21.15.12:43068) 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc8177fe640 1 -- 172.21.15.12:0/4011013042 learned_addr learned my addr 172.21.15.12:0/4011013042 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc816ffd640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818102d30 0x7fc8181a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:00.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc8167fc640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8181036e0 0x7fc8181a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc8177fe640 1 -- 172.21.15.12:0/4011013042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818102d30 msgr2=0x7fc8181a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc8177fe640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc818102d30 0x7fc8181a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc8177fe640 1 -- 172.21.15.12:0/4011013042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8181036e0 msgr2=0x7fc8181a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc8177fe640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8181036e0 0x7fc8181a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc8177fe640 1 -- 172.21.15.12:0/4011013042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81810e6c0 con 0x7fc8181082a0 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc8177fe640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8181082a0 0x7fc81810de50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc81000c970 tx=0x7fc81000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc7fffff640 1 -- 172.21.15.12:0/4011013042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810007bb0 con 0x7fc8181082a0 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc7fffff640 1 -- 172.21.15.12:0/4011013042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc810007d50 con 0x7fc8181082a0 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81810e9b0 con 0x7fc8181082a0 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc7fffff640 1 -- 172.21.15.12:0/4011013042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81000f450 con 0x7fc8181082a0 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.133+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8181ab890 con 0x7fc8181082a0 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.134+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc818062980 con 0x7fc8181082a0 2024-09-19T06:39:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.135+0000 7fc7fffff640 1 -- 172.21.15.12:0/4011013042 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc810004f60 con 0x7fc8181082a0 2024-09-19T06:39:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.136+0000 7fc7fffff640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc8000a3350 0x7fc8000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.136+0000 7fc7fffff640 1 -- 172.21.15.12:0/4011013042 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fc8100cf640 con 0x7fc8181082a0 2024-09-19T06:39:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.136+0000 7fc816ffd640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc8000a3350 0x7fc8000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.136+0000 7fc7fffff640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] conn(0x7fc8000ad000 0x7fc8000af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.136+0000 7fc7fffff640 1 -- 172.21.15.12:0/4011013042 --> [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc810004490 con 0x7fc8000ad000 2024-09-19T06:39:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.136+0000 7fc7fffff640 1 -- 172.21.15.12:0/4011013042 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc8100d6050 con 0x7fc8181082a0 2024-09-19T06:39:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.137+0000 7fc8167fc640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] conn(0x7fc8000ad000 0x7fc8000af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.137+0000 7fc816ffd640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc8000a3350 0x7fc8000a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc8080058c0 tx=0x7fc80800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.137+0000 7fc8167fc640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] conn(0x7fc8000ad000 0x7fc8000af4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.138+0000 7fc7fffff640 1 -- 172.21.15.12:0/4011013042 <== osd.9 v2:172.21.15.12:6826/32889284 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc810004490 con 0x7fc8000ad000 2024-09-19T06:39:00.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.156+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 --> [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc818062e00 con 0x7fc8000ad000 2024-09-19T06:39:00.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.157+0000 7fc7fffff640 1 -- 172.21.15.12:0/4011013042 <== osd.9 v2:172.21.15.12:6826/32889284 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc818062e00 con 0x7fc8000ad000 2024-09-19T06:39:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.157+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] conn(0x7fc8000ad000 msgr2=0x7fc8000af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.157+0000 7fc81d75a640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] conn(0x7fc8000ad000 0x7fc8000af4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.157+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc8000a3350 msgr2=0x7fc8000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.157+0000 7fc81d75a640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc8000a3350 0x7fc8000a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc8080058c0 tx=0x7fc80800a250 comp rx=0 tx=0).stop 2024-09-19T06:39:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.157+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8181082a0 msgr2=0x7fc81810de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.157+0000 7fc81d75a640 1 --2- 172.21.15.12:0/4011013042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8181082a0 0x7fc81810de50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc81000c970 tx=0x7fc81000ce30 comp rx=0 tx=0).stop 2024-09-19T06:39:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.157+0000 7fc8177fe640 1 -- 172.21.15.12:0/4011013042 reap_dead start 2024-09-19T06:39:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.157+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 shutdown_connections 2024-09-19T06:39:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.157+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 >> 172.21.15.12:0/4011013042 conn(0x7fc8180fc7d0 msgr2=0x7fc818100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.158+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 shutdown_connections 2024-09-19T06:39:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:00.158+0000 7fc81d75a640 1 -- 172.21.15.12:0/4011013042 wait complete. 2024-09-19T06:39:00.636 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:00.673 INFO:teuthology.orchestra.run.smithi012.stdout:292057776154 2024-09-19T06:39:00.673 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T06:39:01.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:00 smithi012 ceph-mon[30937]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:01.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:00 smithi173 ceph-mon[35349]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:01.160 INFO:teuthology.orchestra.run.smithi012.stdout:270582939681 2024-09-19T06:39:01.160 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T06:39:01.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:00 smithi016 ceph-mon[34911]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:01.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.347+0000 7fe9d90d8640 1 -- 172.21.15.12:0/4266364071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d4103740 msgr2=0x7fe9d4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.347+0000 7fe9d90d8640 1 --2- 172.21.15.12:0/4266364071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d4103740 0x7fe9d4107b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009930 tx=0x7fe9c802a420 comp rx=0 tx=0).stop 2024-09-19T06:39:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.347+0000 7fe9d90d8640 1 -- 172.21.15.12:0/4266364071 shutdown_connections 2024-09-19T06:39:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.347+0000 7fe9d90d8640 1 --2- 172.21.15.12:0/4266364071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9d4108290 0x7fe9d410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.347+0000 7fe9d90d8640 1 --2- 172.21.15.12:0/4266364071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d4103740 0x7fe9d4107b80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.347+0000 7fe9d90d8640 1 --2- 172.21.15.12:0/4266364071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d4102d90 0x7fe9d4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.347+0000 7fe9d90d8640 1 -- 172.21.15.12:0/4266364071 >> 172.21.15.12:0/4266364071 conn(0x7fe9d40fc7d0 msgr2=0x7fe9d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.347+0000 7fe9d90d8640 1 -- 172.21.15.12:0/4266364071 shutdown_connections 2024-09-19T06:39:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.348+0000 7fe9d90d8640 1 -- 172.21.15.12:0/4266364071 wait complete. 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.349+0000 7fe9d90d8640 1 Processor -- start 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.349+0000 7fe9d90d8640 1 -- start start 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.349+0000 7fe9d90d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d4102d90 0x7fe9d410bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d90d8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9d4103740 0x7fe9d410c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d90d8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d4108290 0x7fe9d410c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d90d8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d41024c0 con 0x7fe9d4102d90 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d90d8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d4102340 con 0x7fe9d4108290 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d90d8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d4102640 con 0x7fe9d4103740 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d4108290 0x7fe9d410c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d4108290 0x7fe9d410c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49928/0 (socket says 172.21.15.12:49928) 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d359e640 1 -- 172.21.15.12:0/3433297609 learned_addr learned my addr 172.21.15.12:0/3433297609 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9d4103740 0x7fe9d410c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d2d9d640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d4102d90 0x7fe9d410bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d359e640 1 -- 172.21.15.12:0/3433297609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9d4103740 msgr2=0x7fe9d410c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d359e640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9d4103740 0x7fe9d410c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d359e640 1 -- 172.21.15.12:0/3433297609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d4102d90 msgr2=0x7fe9d410bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d359e640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9d4102d90 0x7fe9d410bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d359e640 1 -- 172.21.15.12:0/3433297609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d41aae80 con 0x7fe9d4108290 2024-09-19T06:39:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.350+0000 7fe9d359e640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d4108290 0x7fe9d410c770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00eb10 tx=0x7fe9cc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.351+0000 7fe9bbfff640 1 -- 172.21.15.12:0/3433297609 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc004b20 con 0x7fe9d4108290 2024-09-19T06:39:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.351+0000 7fe9bbfff640 1 -- 172.21.15.12:0/3433297609 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9cc004cc0 con 0x7fe9d4108290 2024-09-19T06:39:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.351+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d41ab110 con 0x7fe9d4108290 2024-09-19T06:39:01.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.351+0000 7fe9bbfff640 1 -- 172.21.15.12:0/3433297609 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc010760 con 0x7fe9d4108290 2024-09-19T06:39:01.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.351+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d41ab670 con 0x7fe9d4108290 2024-09-19T06:39:01.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.352+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9d4062940 con 0x7fe9d4108290 2024-09-19T06:39:01.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.353+0000 7fe9bbfff640 1 -- 172.21.15.12:0/3433297609 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe9cc005020 con 0x7fe9d4108290 2024-09-19T06:39:01.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.354+0000 7fe9bbfff640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe9bc0a3350 0x7fe9bc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.354+0000 7fe9bbfff640 1 -- 172.21.15.12:0/3433297609 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe9cc0d0740 con 0x7fe9d4108290 2024-09-19T06:39:01.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.354+0000 7fe9d2d9d640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe9bc0a3350 0x7fe9bc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.355+0000 7fe9bbfff640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] conn(0x7fe9bc0ad000 0x7fe9bc0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:01.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.355+0000 7fe9bbfff640 1 -- 172.21.15.12:0/3433297609 --> [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9bc0afb70 con 0x7fe9bc0ad000 2024-09-19T06:39:01.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.355+0000 7fe9bbfff640 1 -- 172.21.15.12:0/3433297609 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe9cc0d0af0 con 0x7fe9d4108290 2024-09-19T06:39:01.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.355+0000 7fe9d259c640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] conn(0x7fe9bc0ad000 0x7fe9bc0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:01.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.355+0000 7fe9d2d9d640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe9bc0a3350 0x7fe9bc0a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400bbe0 tx=0x7fe9c400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:01.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.356+0000 7fe9d259c640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] conn(0x7fe9bc0ad000 0x7fe9bc0af4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:01.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.357+0000 7fe9bbfff640 1 -- 172.21.15.12:0/3433297609 <== osd.2 v2:172.21.15.173:6800/3671051069 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe9bc0afb70 con 0x7fe9bc0ad000 2024-09-19T06:39:01.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.379+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 --> [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe9d4062dc0 con 0x7fe9bc0ad000 2024-09-19T06:39:01.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.379+0000 7fe9bbfff640 1 -- 172.21.15.12:0/3433297609 <== osd.2 v2:172.21.15.173:6800/3671051069 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe9d4062dc0 con 0x7fe9bc0ad000 2024-09-19T06:39:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.380+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 >> [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] conn(0x7fe9bc0ad000 msgr2=0x7fe9bc0af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.380+0000 7fe9d90d8640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] conn(0x7fe9bc0ad000 0x7fe9bc0af4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.380+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe9bc0a3350 msgr2=0x7fe9bc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.380+0000 7fe9d90d8640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe9bc0a3350 0x7fe9bc0a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400bbe0 tx=0x7fe9c400b390 comp rx=0 tx=0).stop 2024-09-19T06:39:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.380+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d4108290 msgr2=0x7fe9d410c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.380+0000 7fe9d90d8640 1 --2- 172.21.15.12:0/3433297609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9d4108290 0x7fe9d410c770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00eb10 tx=0x7fe9cc00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:39:01.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.380+0000 7fe9d359e640 1 -- 172.21.15.12:0/3433297609 reap_dead start 2024-09-19T06:39:01.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.381+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 shutdown_connections 2024-09-19T06:39:01.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.381+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 >> 172.21.15.12:0/3433297609 conn(0x7fe9d40fc7d0 msgr2=0x7fe9d4112ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:01.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.382+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 shutdown_connections 2024-09-19T06:39:01.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:01.382+0000 7fe9d90d8640 1 -- 172.21.15.12:0/3433297609 wait complete. 2024-09-19T06:39:02.469 INFO:teuthology.orchestra.run.smithi012.stdout:77309411396 2024-09-19T06:39:02.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T06:39:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1642682364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb14100e20 msgr2=0x7fdb14101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 --2- 172.21.15.12:0/1642682364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb14100e20 0x7fdb14101200 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009900 tx=0x7fdb0402a480 comp rx=0 tx=0).stop 2024-09-19T06:39:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1642682364 shutdown_connections 2024-09-19T06:39:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 --2- 172.21.15.12:0/1642682364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb14102ef0 0x7fdb1410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 --2- 172.21.15.12:0/1642682364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb14102570 0x7fdb141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 --2- 172.21.15.12:0/1642682364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb14100e20 0x7fdb14101200 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1642682364 >> 172.21.15.12:0/1642682364 conn(0x7fdb140fc7d0 msgr2=0x7fdb140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1642682364 shutdown_connections 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1642682364 wait complete. 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 Processor -- start 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.798+0000 7fdb1a44e640 1 -- start start 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb1a44e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb14100e20 0x7fdb14198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb1a44e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb14102570 0x7fdb14198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb1a44e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb14102ef0 0x7fdb1419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb1a44e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14110f80 con 0x7fdb14100e20 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb1a44e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14110e00 con 0x7fdb14102ef0 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb1a44e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14111100 con 0x7fdb14102570 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb13fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb14100e20 0x7fdb14198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb13fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb14100e20 0x7fdb14198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59562/0 (socket says 172.21.15.12:59562) 2024-09-19T06:39:02.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb13fff640 1 -- 172.21.15.12:0/1342352518 learned_addr learned my addr 172.21.15.12:0/1342352518 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb137fe640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb14102570 0x7fdb14198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb189eb640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb14102ef0 0x7fdb1419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb13fff640 1 -- 172.21.15.12:0/1342352518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb14102570 msgr2=0x7fdb14198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb13fff640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb14102570 0x7fdb14198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb13fff640 1 -- 172.21.15.12:0/1342352518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb14102ef0 msgr2=0x7fdb1419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb13fff640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb14102ef0 0x7fdb1419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb13fff640 1 -- 172.21.15.12:0/1342352518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1419d4f0 con 0x7fdb14100e20 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb137fe640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb14102570 0x7fdb14198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb13fff640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb14100e20 0x7fdb14198540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdb04006010 tx=0x7fdb04003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.799+0000 7fdb117fa640 1 -- 172.21.15.12:0/1342352518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0403f070 con 0x7fdb14100e20 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.800+0000 7fdb117fa640 1 -- 172.21.15.12:0/1342352518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb04031c30 con 0x7fdb14100e20 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.800+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1419d780 con 0x7fdb14100e20 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.800+0000 7fdb117fa640 1 -- 172.21.15.12:0/1342352518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04035030 con 0x7fdb14100e20 2024-09-19T06:39:02.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.800+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb141a50c0 con 0x7fdb14100e20 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.800+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb14106bb0 con 0x7fdb14100e20 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.802+0000 7fdb117fa640 1 -- 172.21.15.12:0/1342352518 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdb04042070 con 0x7fdb14100e20 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.802+0000 7fdb117fa640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdafc0a32d0 0x7fdafc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.803+0000 7fdb137fe640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdafc0a32d0 0x7fdafc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.803+0000 7fdb117fa640 1 -- 172.21.15.12:0/1342352518 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fdb040f0c80 con 0x7fdb14100e20 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.803+0000 7fdb117fa640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] conn(0x7fdafc0acf80 0x7fdafc0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.803+0000 7fdb117fa640 1 -- 172.21.15.12:0/1342352518 --> [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdafc0afaf0 con 0x7fdafc0acf80 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.803+0000 7fdb117fa640 1 -- 172.21.15.12:0/1342352518 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fdb040f1030 con 0x7fdb14100e20 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.803+0000 7fdb189eb640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] conn(0x7fdafc0acf80 0x7fdafc0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.803+0000 7fdb137fe640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdafc0a32d0 0x7fdafc0a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdb080058c0 tx=0x7fdb08005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.803+0000 7fdb189eb640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] conn(0x7fdafc0acf80 0x7fdafc0af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:02.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.804+0000 7fdb117fa640 1 -- 172.21.15.12:0/1342352518 <== osd.3 v2:172.21.15.12:6810/808998365 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdafc0afaf0 con 0x7fdafc0acf80 2024-09-19T06:39:02.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.817+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 --> [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdb141021b0 con 0x7fdafc0acf80 2024-09-19T06:39:02.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb117fa640 1 -- 172.21.15.12:0/1342352518 <== osd.3 v2:172.21.15.12:6810/808998365 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdb141021b0 con 0x7fdafc0acf80 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] conn(0x7fdafc0acf80 msgr2=0x7fdafc0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb1a44e640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] conn(0x7fdafc0acf80 0x7fdafc0af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdafc0a32d0 msgr2=0x7fdafc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb1a44e640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fdafc0a32d0 0x7fdafc0a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdb080058c0 tx=0x7fdb08005850 comp rx=0 tx=0).stop 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb14100e20 msgr2=0x7fdb14198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb1a44e640 1 --2- 172.21.15.12:0/1342352518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb14100e20 0x7fdb14198540 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdb04006010 tx=0x7fdb04003c10 comp rx=0 tx=0).stop 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb189eb640 1 -- 172.21.15.12:0/1342352518 reap_dead start 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 shutdown_connections 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 >> 172.21.15.12:0/1342352518 conn(0x7fdb140fc7d0 msgr2=0x7fdb1406a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 shutdown_connections 2024-09-19T06:39:02.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:02.818+0000 7fdb1a44e640 1 -- 172.21.15.12:0/1342352518 wait complete. 2024-09-19T06:39:03.006 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:02 smithi012 ceph-mon[30937]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:03.061 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:02 smithi016 ceph-mon[34911]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:03.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:02 smithi173 ceph-mon[35349]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:03.241 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:03.241 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.088+0000 7f8a450fe640 1 -- 172.21.15.12:0/3514968294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a401036e0 msgr2=0x7f8a40107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.088+0000 7f8a450fe640 1 --2- 172.21.15.12:0/3514968294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a401036e0 0x7f8a40107b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009930 tx=0x7f8a3402a420 comp rx=0 tx=0).stop 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.088+0000 7f8a450fe640 1 -- 172.21.15.12:0/3514968294 shutdown_connections 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.088+0000 7f8a450fe640 1 --2- 172.21.15.12:0/3514968294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a401082a0 0x7f8a4010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.088+0000 7f8a450fe640 1 --2- 172.21.15.12:0/3514968294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a401036e0 0x7f8a40107b90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.088+0000 7f8a450fe640 1 --2- 172.21.15.12:0/3514968294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a40102d30 0x7f8a40103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.088+0000 7f8a450fe640 1 -- 172.21.15.12:0/3514968294 >> 172.21.15.12:0/3514968294 conn(0x7f8a400fc7d0 msgr2=0x7f8a400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.088+0000 7f8a450fe640 1 -- 172.21.15.12:0/3514968294 shutdown_connections 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.089+0000 7f8a450fe640 1 -- 172.21.15.12:0/3514968294 wait complete. 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.089+0000 7f8a450fe640 1 Processor -- start 2024-09-19T06:39:03.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.089+0000 7f8a450fe640 1 -- start start 2024-09-19T06:39:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a450fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a40102d30 0x7f8a40198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a450fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a401036e0 0x7f8a40198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a450fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a401082a0 0x7f8a4019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a450fe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8a401120a0 con 0x7f8a401036e0 2024-09-19T06:39:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a450fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40111f20 con 0x7f8a40102d30 2024-09-19T06:39:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a450fe640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40112220 con 0x7f8a401082a0 2024-09-19T06:39:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a401036e0 0x7f8a40198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a401036e0 0x7f8a40198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59580/0 (socket says 172.21.15.12:59580) 2024-09-19T06:39:03.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3e59c640 1 -- 172.21.15.12:0/2420222870 learned_addr learned my addr 172.21.15.12:0/2420222870 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3ed9d640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a40102d30 0x7f8a40198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3f59e640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a401082a0 0x7f8a4019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3e59c640 1 -- 172.21.15.12:0/2420222870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a401082a0 msgr2=0x7f8a4019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3e59c640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a401082a0 0x7f8a4019cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3e59c640 1 -- 172.21.15.12:0/2420222870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a40102d30 msgr2=0x7f8a40198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3e59c640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a40102d30 0x7f8a40198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3e59c640 1 -- 172.21.15.12:0/2420222870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4019d5d0 con 0x7f8a401036e0 2024-09-19T06:39:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a3e59c640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a401036e0 0x7f8a40198b60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8a34005940 tx=0x7f8a340040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.090+0000 7f8a27fff640 1 -- 172.21.15.12:0/2420222870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3403f030 con 0x7f8a401036e0 2024-09-19T06:39:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.091+0000 7f8a27fff640 1 -- 172.21.15.12:0/2420222870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a340044c0 con 0x7f8a401036e0 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.091+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4019d860 con 0x7f8a401036e0 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.091+0000 7f8a27fff640 1 -- 172.21.15.12:0/2420222870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34035070 con 0x7f8a401036e0 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.091+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a401a51a0 con 0x7f8a401036e0 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.091+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a40062980 con 0x7f8a401036e0 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.093+0000 7f8a27fff640 1 -- 172.21.15.12:0/2420222870 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8a34042030 con 0x7f8a401036e0 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.093+0000 7f8a27fff640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8a280a32d0 0x7f8a280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.094+0000 7f8a3ed9d640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8a280a32d0 0x7f8a280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.094+0000 7f8a27fff640 1 -- 172.21.15.12:0/2420222870 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f8a340f0580 con 0x7f8a401036e0 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.094+0000 7f8a27fff640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] conn(0x7f8a280ace50 0x7f8a280af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.094+0000 7f8a27fff640 1 -- 172.21.15.12:0/2420222870 --> [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a280af9c0 con 0x7f8a280ace50 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.094+0000 7f8a27fff640 1 -- 172.21.15.12:0/2420222870 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f8a340f0930 con 0x7f8a401036e0 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.094+0000 7f8a3ed9d640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8a280a32d0 0x7f8a280a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8a30005fd0 tx=0x7f8a30009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.094+0000 7f8a3f59e640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] conn(0x7f8a280ace50 0x7f8a280af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.094+0000 7f8a3f59e640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] conn(0x7f8a280ace50 0x7f8a280af2f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.095+0000 7f8a27fff640 1 -- 172.21.15.12:0/2420222870 <== osd.11 v2:172.21.15.173:6824/3706383850 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a280af9c0 con 0x7f8a280ace50 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.109+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 --> [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a40062e00 con 0x7f8a280ace50 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a27fff640 1 -- 172.21.15.12:0/2420222870 <== osd.11 v2:172.21.15.173:6824/3706383850 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8a40062e00 con 0x7f8a280ace50 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 >> [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] conn(0x7f8a280ace50 msgr2=0x7f8a280af2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a450fe640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] conn(0x7f8a280ace50 0x7f8a280af2f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8a280a32d0 msgr2=0x7f8a280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a450fe640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f8a280a32d0 0x7f8a280a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8a30005fd0 tx=0x7f8a30009500 comp rx=0 tx=0).stop 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a401036e0 msgr2=0x7f8a40198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a450fe640 1 --2- 172.21.15.12:0/2420222870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a401036e0 0x7f8a40198b60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8a34005940 tx=0x7f8a340040c0 comp rx=0 tx=0).stop 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a3f59e640 1 -- 172.21.15.12:0/2420222870 reap_dead start 2024-09-19T06:39:03.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 shutdown_connections 2024-09-19T06:39:03.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 >> 172.21.15.12:0/2420222870 conn(0x7f8a400fc7d0 msgr2=0x7f8a40105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:03.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 shutdown_connections 2024-09-19T06:39:03.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:03.110+0000 7f8a450fe640 1 -- 172.21.15.12:0/2420222870 wait complete. 2024-09-19T06:39:04.061 INFO:teuthology.orchestra.run.smithi012.stdout:322122547223 2024-09-19T06:39:04.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T06:39:04.081 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:04.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 -- 172.21.15.12:0/550831032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9190102570 msgr2=0x7f91901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 --2- 172.21.15.12:0/550831032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9190102570 0x7f91901029b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9184009900 tx=0x7f918402a480 comp rx=0 tx=0).stop 2024-09-19T06:39:04.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 -- 172.21.15.12:0/550831032 shutdown_connections 2024-09-19T06:39:04.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 --2- 172.21.15.12:0/550831032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9190102ef0 0x7f919010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 --2- 172.21.15.12:0/550831032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9190102570 0x7f91901029b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 --2- 172.21.15.12:0/550831032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9190100e20 0x7f9190101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 -- 172.21.15.12:0/550831032 >> 172.21.15.12:0/550831032 conn(0x7f91900fc7d0 msgr2=0x7f91900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:04.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 -- 172.21.15.12:0/550831032 shutdown_connections 2024-09-19T06:39:04.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 -- 172.21.15.12:0/550831032 wait complete. 2024-09-19T06:39:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 Processor -- start 2024-09-19T06:39:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.582+0000 7f9196ebd640 1 -- start start 2024-09-19T06:39:04.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f9196ebd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9190100e20 0x7f91901984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f9196ebd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9190102570 0x7f9190198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f9196ebd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9190102ef0 0x7f919019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f9196ebd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9190110fd0 con 0x7f9190102ef0 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f9196ebd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9190110e50 con 0x7f9190100e20 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f9196ebd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9190111150 con 0x7f9190102570 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f919545a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9190102ef0 0x7f919019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f9194c59640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9190100e20 0x7f91901984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f919545a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9190102ef0 0x7f919019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59602/0 (socket says 172.21.15.12:59602) 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f919545a640 1 -- 172.21.15.12:0/4054211444 learned_addr learned my addr 172.21.15.12:0/4054211444 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f918ffff640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9190102570 0x7f9190198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:04.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f919545a640 1 -- 172.21.15.12:0/4054211444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9190102570 msgr2=0x7f9190198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f919545a640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9190102570 0x7f9190198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f919545a640 1 -- 172.21.15.12:0/4054211444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9190100e20 msgr2=0x7f91901984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f919545a640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9190100e20 0x7f91901984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f919545a640 1 -- 172.21.15.12:0/4054211444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919019d480 con 0x7f9190102ef0 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f9194c59640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9190100e20 0x7f91901984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.583+0000 7f919545a640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9190102ef0 0x7f919019cda0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f918800eaa0 tx=0x7f918800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.584+0000 7f918dffb640 1 -- 172.21.15.12:0/4054211444 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918800cdb0 con 0x7f9190102ef0 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.584+0000 7f918dffb640 1 -- 172.21.15.12:0/4054211444 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9188005020 con 0x7f9190102ef0 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.584+0000 7f9196ebd640 1 -- 172.21.15.12:0/4054211444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919019d770 con 0x7f9190102ef0 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.584+0000 7f918dffb640 1 -- 172.21.15.12:0/4054211444 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91880116b0 con 0x7f9190102ef0 2024-09-19T06:39:04.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.584+0000 7f9196ebd640 1 -- 172.21.15.12:0/4054211444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91901a5050 con 0x7f9190102ef0 2024-09-19T06:39:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.585+0000 7f9196ebd640 1 -- 172.21.15.12:0/4054211444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9190101200 con 0x7f9190102ef0 2024-09-19T06:39:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.586+0000 7f918dffb640 1 -- 172.21.15.12:0/4054211444 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9188005560 con 0x7f9190102ef0 2024-09-19T06:39:04.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.587+0000 7f918dffb640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91780a32d0 0x7f91780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.587+0000 7f9194c59640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91780a32d0 0x7f91780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.587+0000 7f918dffb640 1 -- 172.21.15.12:0/4054211444 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f91880cfda0 con 0x7f9190102ef0 2024-09-19T06:39:04.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.587+0000 7f9194c59640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91780a32d0 0x7f91780a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9180009fc0 tx=0x7f9180005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:04.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.591+0000 7f918dffb640 1 -- 172.21.15.12:0/4054211444 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9188016030 con 0x7f9190102ef0 2024-09-19T06:39:04.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.774+0000 7f9196ebd640 1 -- 172.21.15.12:0/4054211444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f91901a5220 con 0x7f9190102ef0 2024-09-19T06:39:04.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.777+0000 7f918dffb640 1 -- 172.21.15.12:0/4054211444 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91880bae20 con 0x7f9190102ef0 2024-09-19T06:39:04.778 INFO:teuthology.orchestra.run.smithi012.stdout:34359738446 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 -- 172.21.15.12:0/4054211444 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91780a32d0 msgr2=0x7f91780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91780a32d0 0x7f91780a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9180009fc0 tx=0x7f9180005f90 comp rx=0 tx=0).stop 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 -- 172.21.15.12:0/4054211444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9190102ef0 msgr2=0x7f919019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9190102ef0 0x7f919019cda0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f918800eaa0 tx=0x7f918800ef60 comp rx=0 tx=0).stop 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 -- 172.21.15.12:0/4054211444 shutdown_connections 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91780a32d0 0x7f91780a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9190102ef0 0x7f919019cda0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9190102570 0x7f9190198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 --2- 172.21.15.12:0/4054211444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9190100e20 0x7f91901984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 -- 172.21.15.12:0/4054211444 >> 172.21.15.12:0/4054211444 conn(0x7f91900fc7d0 msgr2=0x7f9190069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 -- 172.21.15.12:0/4054211444 shutdown_connections 2024-09-19T06:39:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:04.779+0000 7f9196ebd640 1 -- 172.21.15.12:0/4054211444 wait complete. 2024-09-19T06:39:05.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:04 smithi173 ceph-mon[35349]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:39:05.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:04 smithi012 ceph-mon[30937]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:39:05.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:04 smithi016 ceph-mon[34911]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:39:05.530 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738446 for osd.0 2024-09-19T06:39:05.531 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.744+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/1897589228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e881008d0 msgr2=0x7f2e88100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.744+0000 7f2e8e5a1640 1 --2- 172.21.15.12:0/1897589228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e881008d0 0x7f2e88100d30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009930 tx=0x7f2e7802a420 comp rx=0 tx=0).stop 2024-09-19T06:39:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.745+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/1897589228 shutdown_connections 2024-09-19T06:39:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.745+0000 7f2e8e5a1640 1 --2- 172.21.15.12:0/1897589228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e88101270 0x7f2e8810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.745+0000 7f2e8e5a1640 1 --2- 172.21.15.12:0/1897589228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e881008d0 0x7f2e88100d30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.745+0000 7f2e8e5a1640 1 --2- 172.21.15.12:0/1897589228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e881068d0 0x7f2e88106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.745+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/1897589228 >> 172.21.15.12:0/1897589228 conn(0x7f2e880fc630 msgr2=0x7f2e880fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.745+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/1897589228 shutdown_connections 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.745+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/1897589228 wait complete. 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.745+0000 7f2e8e5a1640 1 Processor -- start 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.745+0000 7f2e8e5a1640 1 -- start start 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.745+0000 7f2e8e5a1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e881008d0 0x7f2e88197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8e5a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88101270 0x7f2e881978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8e5a1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e881068d0 0x7f2e8819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8e5a1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2e88110d70 con 0x7f2e88101270 2024-09-19T06:39:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8e5a1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2e88110bf0 con 0x7f2e881008d0 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8e5a1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2e88110ef0 con 0x7f2e881068d0 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8cd9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88101270 0x7f2e881978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8cd9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88101270 0x7f2e881978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59618/0 (socket says 172.21.15.12:59618) 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8cd9e640 1 -- 172.21.15.12:0/3185002655 learned_addr learned my addr 172.21.15.12:0/3185002655 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8d59f640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e881008d0 0x7f2e88197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8dda0640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e881068d0 0x7f2e8819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8cd9e640 1 -- 172.21.15.12:0/3185002655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e881068d0 msgr2=0x7f2e8819bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8cd9e640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e881068d0 0x7f2e8819bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8cd9e640 1 -- 172.21.15.12:0/3185002655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e881008d0 msgr2=0x7f2e88197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8cd9e640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e881008d0 0x7f2e88197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8cd9e640 1 -- 172.21.15.12:0/3185002655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8819c340 con 0x7f2e88101270 2024-09-19T06:39:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8d59f640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e881008d0 0x7f2e88197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8dda0640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e881068d0 0x7f2e8819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8cd9e640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88101270 0x7f2e881978d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009a50 tx=0x7f2e78004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e7e7fc640 1 -- 172.21.15.12:0/3185002655 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7803f030 con 0x7f2e88101270 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e7e7fc640 1 -- 172.21.15.12:0/3185002655 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e78003ce0 con 0x7f2e88101270 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/3185002655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8819c5d0 con 0x7f2e88101270 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.746+0000 7f2e7e7fc640 1 -- 172.21.15.12:0/3185002655 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78035070 con 0x7f2e88101270 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.747+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/3185002655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e881a3f10 con 0x7f2e88101270 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.747+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/3185002655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e88100db0 con 0x7f2e88101270 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.750+0000 7f2e7e7fc640 1 -- 172.21.15.12:0/3185002655 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2e78042030 con 0x7f2e88101270 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.750+0000 7f2e7e7fc640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2e740a32d0 0x7f2e740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.750+0000 7f2e8d59f640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2e740a32d0 0x7f2e740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.750+0000 7f2e7e7fc640 1 -- 172.21.15.12:0/3185002655 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f2e780f0560 con 0x7f2e88101270 2024-09-19T06:39:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.751+0000 7f2e8d59f640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2e740a32d0 0x7f2e740a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009930 tx=0x7f2e84008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.754+0000 7f2e7e7fc640 1 -- 172.21.15.12:0/3185002655 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2e780bd100 con 0x7f2e88101270 2024-09-19T06:39:05.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.932+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/3185002655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2e88108e60 con 0x7f2e88101270 2024-09-19T06:39:05.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.932+0000 7f2e7e7fc640 1 -- 172.21.15.12:0/3185002655 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2e780bca00 con 0x7f2e88101270 2024-09-19T06:39:05.935 INFO:teuthology.orchestra.run.smithi012.stdout:193273528368 2024-09-19T06:39:05.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.934+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/3185002655 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2e740a32d0 msgr2=0x7f2e740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.934+0000 7f2e8e5a1640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2e740a32d0 0x7f2e740a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009930 tx=0x7f2e84008040 comp rx=0 tx=0).stop 2024-09-19T06:39:05.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.934+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/3185002655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88101270 msgr2=0x7f2e881978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.934+0000 7f2e8e5a1640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88101270 0x7f2e881978d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009a50 tx=0x7f2e78004270 comp rx=0 tx=0).stop 2024-09-19T06:39:05.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.935+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/3185002655 shutdown_connections 2024-09-19T06:39:05.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.935+0000 7f2e8e5a1640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f2e740a32d0 0x7f2e740a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.935+0000 7f2e8e5a1640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e881068d0 0x7f2e8819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.935+0000 7f2e8e5a1640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e88101270 0x7f2e881978d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.935+0000 7f2e8e5a1640 1 --2- 172.21.15.12:0/3185002655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e881008d0 0x7f2e88197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.935+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/3185002655 >> 172.21.15.12:0/3185002655 conn(0x7f2e880fc630 msgr2=0x7f2e880fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:05.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.935+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/3185002655 shutdown_connections 2024-09-19T06:39:05.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:05.935+0000 7f2e8e5a1640 1 -- 172.21.15.12:0/3185002655 wait complete. 2024-09-19T06:39:06.051 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:05 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/4054211444' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:39:06.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:05 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/4054211444' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:39:06.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:05 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/4054211444' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:39:06.696 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:06.698 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528366 got 193273528368 for osd.6 2024-09-19T06:39:06.699 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:07.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:06 smithi173 ceph-mon[35349]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:39:07.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:06 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3185002655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:39:07.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:06 smithi012 ceph-mon[30937]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:39:07.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:06 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3185002655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:39:07.168 INFO:teuthology.orchestra.run.smithi012.stdout:103079215167 2024-09-19T06:39:07.169 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T06:39:07.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:06 smithi016 ceph-mon[34911]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:39:07.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:06 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3185002655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:39:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.602+0000 7f74796ff640 1 -- 172.21.15.12:0/3254694371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74741036e0 msgr2=0x7f7474107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.602+0000 7f74796ff640 1 --2- 172.21.15.12:0/3254694371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74741036e0 0x7f7474107b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7468009930 tx=0x7f746802a420 comp rx=0 tx=0).stop 2024-09-19T06:39:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.602+0000 7f74796ff640 1 -- 172.21.15.12:0/3254694371 shutdown_connections 2024-09-19T06:39:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.602+0000 7f74796ff640 1 --2- 172.21.15.12:0/3254694371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74741082a0 0x7f747410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.602+0000 7f74796ff640 1 --2- 172.21.15.12:0/3254694371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74741036e0 0x7f7474107b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.602+0000 7f74796ff640 1 --2- 172.21.15.12:0/3254694371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7474102d30 0x7f7474103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.602+0000 7f74796ff640 1 -- 172.21.15.12:0/3254694371 >> 172.21.15.12:0/3254694371 conn(0x7f74740fc7d0 msgr2=0x7f74740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.602+0000 7f74796ff640 1 -- 172.21.15.12:0/3254694371 shutdown_connections 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.602+0000 7f74796ff640 1 -- 172.21.15.12:0/3254694371 wait complete. 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.603+0000 7f74796ff640 1 Processor -- start 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.603+0000 7f74796ff640 1 -- start start 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.603+0000 7f74796ff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7474102d30 0x7f7474198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.603+0000 7f74796ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74741036e0 0x7f7474198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.603+0000 7f74796ff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74741082a0 0x7f747419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.603+0000 7f74796ff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f74741120c0 con 0x7f74741036e0 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.603+0000 7f74796ff640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7474111f40 con 0x7f74741082a0 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.603+0000 7f74796ff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7474112240 con 0x7f7474102d30 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74727fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74741036e0 0x7f7474198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74727fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74741036e0 0x7f7474198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59638/0 (socket says 172.21.15.12:59638) 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74727fc640 1 -- 172.21.15.12:0/2866043198 learned_addr learned my addr 172.21.15.12:0/2866043198 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74737fe640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74741082a0 0x7f747419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74727fc640 1 -- 172.21.15.12:0/2866043198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7474102d30 msgr2=0x7f7474198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74727fc640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7474102d30 0x7f7474198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74727fc640 1 -- 172.21.15.12:0/2866043198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74741082a0 msgr2=0x7f747419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74727fc640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74741082a0 0x7f747419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74727fc640 1 -- 172.21.15.12:0/2866043198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747419d5f0 con 0x7f74741036e0 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74727fc640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74741036e0 0x7f7474198b80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7468005940 tx=0x7f74680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f745bfff640 1 -- 172.21.15.12:0/2866043198 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746803f030 con 0x7f74741036e0 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f745bfff640 1 -- 172.21.15.12:0/2866043198 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7468003ce0 con 0x7f74741036e0 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74796ff640 1 -- 172.21.15.12:0/2866043198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747419d880 con 0x7f74741036e0 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f745bfff640 1 -- 172.21.15.12:0/2866043198 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468035070 con 0x7f74741036e0 2024-09-19T06:39:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.604+0000 7f74796ff640 1 -- 172.21.15.12:0/2866043198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74741a51c0 con 0x7f74741036e0 2024-09-19T06:39:07.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.606+0000 7f74796ff640 1 -- 172.21.15.12:0/2866043198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7474103110 con 0x7f74741036e0 2024-09-19T06:39:07.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.607+0000 7f745bfff640 1 -- 172.21.15.12:0/2866043198 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7468042030 con 0x7f74741036e0 2024-09-19T06:39:07.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.607+0000 7f745bfff640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f745c0a32d0 0x7f745c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.607+0000 7f7472ffd640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f745c0a32d0 0x7f745c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.608+0000 7f745bfff640 1 -- 172.21.15.12:0/2866043198 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f74680f00c0 con 0x7f74741036e0 2024-09-19T06:39:07.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.608+0000 7f7472ffd640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f745c0a32d0 0x7f745c0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7464009710 tx=0x7f7464006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.611+0000 7f745bfff640 1 -- 172.21.15.12:0/2866043198 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f74680bcc60 con 0x7f74741036e0 2024-09-19T06:39:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:07.628 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:07.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.815+0000 7f74796ff640 1 -- 172.21.15.12:0/2866043198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f747410a2b0 con 0x7f74741036e0 2024-09-19T06:39:07.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.815+0000 7f745bfff640 1 -- 172.21.15.12:0/2866043198 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74680bc560 con 0x7f74741036e0 2024-09-19T06:39:07.818 INFO:teuthology.orchestra.run.smithi012.stdout:55834574922 2024-09-19T06:39:07.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.817+0000 7f74796ff640 1 -- 172.21.15.12:0/2866043198 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f745c0a32d0 msgr2=0x7f745c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.817+0000 7f74796ff640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f745c0a32d0 0x7f745c0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7464009710 tx=0x7f7464006c90 comp rx=0 tx=0).stop 2024-09-19T06:39:07.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.817+0000 7f74796ff640 1 -- 172.21.15.12:0/2866043198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74741036e0 msgr2=0x7f7474198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.817+0000 7f74796ff640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74741036e0 0x7f7474198b80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7468005940 tx=0x7f74680042f0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.817+0000 7f74796ff640 1 -- 172.21.15.12:0/2866043198 shutdown_connections 2024-09-19T06:39:07.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.817+0000 7f74796ff640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f745c0a32d0 0x7f745c0a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.817+0000 7f74796ff640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74741082a0 0x7f747419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.817+0000 7f74796ff640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74741036e0 0x7f7474198b80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.817+0000 7f74796ff640 1 --2- 172.21.15.12:0/2866043198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7474102d30 0x7f7474198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.817+0000 7f74796ff640 1 -- 172.21.15.12:0/2866043198 >> 172.21.15.12:0/2866043198 conn(0x7f74740fc7d0 msgr2=0x7f7474105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:07.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.818+0000 7f74796ff640 1 -- 172.21.15.12:0/2866043198 shutdown_connections 2024-09-19T06:39:07.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.818+0000 7f74796ff640 1 -- 172.21.15.12:0/2866043198 wait complete. 2024-09-19T06:39:07.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.826+0000 7ff16869f640 1 -- 172.21.15.12:0/2106896228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff160106f20 msgr2=0x7ff16010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.826+0000 7ff16869f640 1 --2- 172.21.15.12:0/2106896228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff160106f20 0x7ff16010eaa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff158009ca0 tx=0x7ff15802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.826+0000 7ff16869f640 1 -- 172.21.15.12:0/2106896228 shutdown_connections 2024-09-19T06:39:07.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.826+0000 7ff16869f640 1 --2- 172.21.15.12:0/2106896228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff160106f20 0x7ff16010eaa0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.826+0000 7ff16869f640 1 --2- 172.21.15.12:0/2106896228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1601027a0 0x7ff1601067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.826+0000 7ff16869f640 1 --2- 172.21.15.12:0/2106896228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff160101df0 0x7ff1601021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.826+0000 7ff16869f640 1 -- 172.21.15.12:0/2106896228 >> 172.21.15.12:0/2106896228 conn(0x7ff1600fd8f0 msgr2=0x7ff1600ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.826+0000 7ff16869f640 1 -- 172.21.15.12:0/2106896228 shutdown_connections 2024-09-19T06:39:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.826+0000 7ff16869f640 1 -- 172.21.15.12:0/2106896228 wait complete. 2024-09-19T06:39:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.827+0000 7ff16869f640 1 Processor -- start 2024-09-19T06:39:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.827+0000 7ff16869f640 1 -- start start 2024-09-19T06:39:07.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.827+0000 7ff16869f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff160101df0 0x7ff160198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.827+0000 7ff16869f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1601027a0 0x7ff160198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.827+0000 7ff16869f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff160106f20 0x7ff16019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.827+0000 7ff16869f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff160111f80 con 0x7ff160101df0 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.827+0000 7ff16869f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff160111e00 con 0x7ff160106f20 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.827+0000 7ff16869f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff160112100 con 0x7ff1601027a0 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff16643b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff160101df0 0x7ff160198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff16643b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff160101df0 0x7ff160198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59642/0 (socket says 172.21.15.12:59642) 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff16643b640 1 -- 172.21.15.12:0/3603970504 learned_addr learned my addr 172.21.15.12:0/3603970504 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff165c3a640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1601027a0 0x7ff160198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff166c3c640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff160106f20 0x7ff16019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff16643b640 1 -- 172.21.15.12:0/3603970504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1601027a0 msgr2=0x7ff160198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff16643b640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1601027a0 0x7ff160198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff16643b640 1 -- 172.21.15.12:0/3603970504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff160106f20 msgr2=0x7ff16019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff16643b640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff160106f20 0x7ff16019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff16643b640 1 -- 172.21.15.12:0/3603970504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16019d3b0 con 0x7ff160101df0 2024-09-19T06:39:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff16643b640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff160101df0 0x7ff160198400 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00d950 tx=0x7ff15c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:07.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff1577fe640 1 -- 172.21.15.12:0/3603970504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c017070 con 0x7ff160101df0 2024-09-19T06:39:07.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.828+0000 7ff1577fe640 1 -- 172.21.15.12:0/3603970504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff15c009c30 con 0x7ff160101df0 2024-09-19T06:39:07.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.829+0000 7ff16869f640 1 -- 172.21.15.12:0/3603970504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff16019d6a0 con 0x7ff160101df0 2024-09-19T06:39:07.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.829+0000 7ff16869f640 1 -- 172.21.15.12:0/3603970504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1601a4f80 con 0x7ff160101df0 2024-09-19T06:39:07.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.829+0000 7ff1577fe640 1 -- 172.21.15.12:0/3603970504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c00f6b0 con 0x7ff160101df0 2024-09-19T06:39:07.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.830+0000 7ff16869f640 1 -- 172.21.15.12:0/3603970504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff144005290 con 0x7ff160101df0 2024-09-19T06:39:07.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.831+0000 7ff1577fe640 1 -- 172.21.15.12:0/3603970504 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff15c00f850 con 0x7ff160101df0 2024-09-19T06:39:07.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.832+0000 7ff1577fe640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff14c0a3350 0x7ff14c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.832+0000 7ff1577fe640 1 -- 172.21.15.12:0/3603970504 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7ff15c0cf8a0 con 0x7ff160101df0 2024-09-19T06:39:07.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.832+0000 7ff165c3a640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff14c0a3350 0x7ff14c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.833+0000 7ff165c3a640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff14c0a3350 0x7ff14c0a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1600fe0f0 tx=0x7ff15000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:07.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:07.837+0000 7ff1577fe640 1 -- 172.21.15.12:0/3603970504 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff15c009de0 con 0x7ff160101df0 2024-09-19T06:39:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.016+0000 7ff16869f640 1 -- 172.21.15.12:0/3603970504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff144005850 con 0x7ff160101df0 2024-09-19T06:39:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.016+0000 7ff1577fe640 1 -- 172.21.15.12:0/3603970504 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff15c09bdf0 con 0x7ff160101df0 2024-09-19T06:39:08.019 INFO:teuthology.orchestra.run.smithi012.stdout:137438953530 2024-09-19T06:39:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 -- 172.21.15.12:0/3603970504 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff14c0a3350 msgr2=0x7ff14c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff14c0a3350 0x7ff14c0a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1600fe0f0 tx=0x7ff15000b390 comp rx=0 tx=0).stop 2024-09-19T06:39:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 -- 172.21.15.12:0/3603970504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff160101df0 msgr2=0x7ff160198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff160101df0 0x7ff160198400 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00d950 tx=0x7ff15c00de10 comp rx=0 tx=0).stop 2024-09-19T06:39:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 -- 172.21.15.12:0/3603970504 shutdown_connections 2024-09-19T06:39:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7ff14c0a3350 0x7ff14c0a5810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff160106f20 0x7ff16019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff1601027a0 0x7ff160198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 --2- 172.21.15.12:0/3603970504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff160101df0 0x7ff160198400 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 -- 172.21.15.12:0/3603970504 >> 172.21.15.12:0/3603970504 conn(0x7ff1600fd8f0 msgr2=0x7ff1600fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 -- 172.21.15.12:0/3603970504 shutdown_connections 2024-09-19T06:39:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:08.019+0000 7ff16869f640 1 -- 172.21.15.12:0/3603970504 wait complete. 2024-09-19T06:39:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:08.744 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953527 got 137438953530 for osd.4 2024-09-19T06:39:08.744 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:08.997 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:08 smithi012 ceph-mon[30937]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T06:39:08.997 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:08 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2866043198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:39:08.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:08 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3603970504' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:39:08.998 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:08 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:09.065 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:08 smithi016 ceph-mon[34911]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T06:39:09.065 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:08 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2866043198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:39:09.066 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:08 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3603970504' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:39:09.066 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:08 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:09.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:08 smithi173 ceph-mon[35349]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T06:39:09.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:08 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2866043198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:39:09.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:08 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3603970504' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:39:09.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:08 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:09.352 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574922 for osd.1 2024-09-19T06:39:09.353 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:09.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.757+0000 7f0fbf273640 1 -- 172.21.15.12:0/3045561126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fb8106f20 msgr2=0x7f0fb810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.757+0000 7f0fbf273640 1 --2- 172.21.15.12:0/3045561126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fb8106f20 0x7f0fb810eaa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009900 tx=0x7f0fb002a410 comp rx=0 tx=0).stop 2024-09-19T06:39:09.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.757+0000 7f0fbf273640 1 -- 172.21.15.12:0/3045561126 shutdown_connections 2024-09-19T06:39:09.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.757+0000 7f0fbf273640 1 --2- 172.21.15.12:0/3045561126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fb8106f20 0x7f0fb810eaa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.757+0000 7f0fbf273640 1 --2- 172.21.15.12:0/3045561126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb81027a0 0x7f0fb81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.757+0000 7f0fbf273640 1 --2- 172.21.15.12:0/3045561126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fb8101df0 0x7f0fb81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.757+0000 7f0fbf273640 1 -- 172.21.15.12:0/3045561126 >> 172.21.15.12:0/3045561126 conn(0x7f0fb80fd8f0 msgr2=0x7f0fb80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.757+0000 7f0fbf273640 1 -- 172.21.15.12:0/3045561126 shutdown_connections 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.757+0000 7f0fbf273640 1 -- 172.21.15.12:0/3045561126 wait complete. 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.757+0000 7f0fbf273640 1 Processor -- start 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbf273640 1 -- start start 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbf273640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fb8101df0 0x7f0fb80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbf273640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb81027a0 0x7f0fb8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbf273640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fb8106f20 0x7f0fb8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbf273640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8111f80 con 0x7f0fb8106f20 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbf273640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8111e00 con 0x7f0fb8101df0 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbf273640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8112100 con 0x7f0fb81027a0 2024-09-19T06:39:09.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbd810640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fb8106f20 0x7f0fb8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbc80e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb81027a0 0x7f0fb8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbd810640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fb8106f20 0x7f0fb8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59652/0 (socket says 172.21.15.12:59652) 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbd00f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fb8101df0 0x7f0fb80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbd810640 1 -- 172.21.15.12:0/2786196139 learned_addr learned my addr 172.21.15.12:0/2786196139 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbc80e640 1 -- 172.21.15.12:0/2786196139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fb8101df0 msgr2=0x7f0fb80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbc80e640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fb8101df0 0x7f0fb80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbc80e640 1 -- 172.21.15.12:0/2786196139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fb8106f20 msgr2=0x7f0fb8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbc80e640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fb8106f20 0x7f0fb8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbc80e640 1 -- 172.21.15.12:0/2786196139 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb81a6880 con 0x7f0fb81027a0 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbd00f640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fb8101df0 0x7f0fb80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.758+0000 7f0fbd810640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fb8106f20 0x7f0fb8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:09.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.759+0000 7f0fbc80e640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb81027a0 0x7f0fb8074a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00d6d0 tx=0x7f0fac00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.759+0000 7f0fb67fc640 1 -- 172.21.15.12:0/2786196139 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac017070 con 0x7f0fb81027a0 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.759+0000 7f0fbf273640 1 -- 172.21.15.12:0/2786196139 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb81a6b70 con 0x7f0fb81027a0 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.759+0000 7f0fb67fc640 1 -- 172.21.15.12:0/2786196139 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fac009820 con 0x7f0fb81027a0 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.759+0000 7f0fb67fc640 1 -- 172.21.15.12:0/2786196139 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac004cd0 con 0x7f0fb81027a0 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.759+0000 7f0fbf273640 1 -- 172.21.15.12:0/2786196139 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb81a7100 con 0x7f0fb81027a0 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.760+0000 7f0fbf273640 1 -- 172.21.15.12:0/2786196139 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb81021d0 con 0x7f0fb81027a0 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.761+0000 7f0fb67fc640 1 -- 172.21.15.12:0/2786196139 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0fac0099d0 con 0x7f0fb81027a0 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.762+0000 7f0fb67fc640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0fa00a32d0 0x7f0fa00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.762+0000 7f0fbd00f640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0fa00a32d0 0x7f0fa00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.762+0000 7f0fb67fc640 1 -- 172.21.15.12:0/2786196139 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f0fac0cf620 con 0x7f0fb81027a0 2024-09-19T06:39:09.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.762+0000 7f0fbd00f640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0fa00a32d0 0x7f0fa00a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8005fd0 tx=0x7f0fa8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:09.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.765+0000 7f0fb67fc640 1 -- 172.21.15.12:0/2786196139 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0fac09bb10 con 0x7f0fb81027a0 2024-09-19T06:39:09.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.945+0000 7f0fbf273640 1 -- 172.21.15.12:0/2786196139 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f0fb802d7c0 con 0x7f0fb81027a0 2024-09-19T06:39:09.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.946+0000 7f0fb67fc640 1 -- 172.21.15.12:0/2786196139 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0fac09fe10 con 0x7f0fb81027a0 2024-09-19T06:39:09.948 INFO:teuthology.orchestra.run.smithi012.stdout:240518168614 2024-09-19T06:39:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 -- 172.21.15.12:0/2786196139 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0fa00a32d0 msgr2=0x7f0fa00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0fa00a32d0 0x7f0fa00a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8005fd0 tx=0x7f0fa8009500 comp rx=0 tx=0).stop 2024-09-19T06:39:09.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 -- 172.21.15.12:0/2786196139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb81027a0 msgr2=0x7f0fb8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb81027a0 0x7f0fb8074a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00d6d0 tx=0x7f0fac00db90 comp rx=0 tx=0).stop 2024-09-19T06:39:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 -- 172.21.15.12:0/2786196139 shutdown_connections 2024-09-19T06:39:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0fa00a32d0 0x7f0fa00a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fb8106f20 0x7f0fb8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb81027a0 0x7f0fb8074a30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 --2- 172.21.15.12:0/2786196139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fb8101df0 0x7f0fb80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 -- 172.21.15.12:0/2786196139 >> 172.21.15.12:0/2786196139 conn(0x7f0fb80fd8f0 msgr2=0x7f0fb80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 -- 172.21.15.12:0/2786196139 shutdown_connections 2024-09-19T06:39:09.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.948+0000 7f0fbf273640 1 -- 172.21.15.12:0/2786196139 wait complete. 2024-09-19T06:39:09.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.956+0000 7f9e822be640 1 -- 172.21.15.12:0/4286701129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e7c106a80 msgr2=0x7f9e7c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.956+0000 7f9e822be640 1 --2- 172.21.15.12:0/4286701129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e7c106a80 0x7f9e7c106e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009930 tx=0x7f9e6c02a420 comp rx=0 tx=0).stop 2024-09-19T06:39:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.957+0000 7f9e822be640 1 -- 172.21.15.12:0/4286701129 shutdown_connections 2024-09-19T06:39:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.957+0000 7f9e822be640 1 --2- 172.21.15.12:0/4286701129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e7c101420 0x7f9e7c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.957+0000 7f9e822be640 1 --2- 172.21.15.12:0/4286701129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e7c100a80 0x7f9e7c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.957+0000 7f9e822be640 1 --2- 172.21.15.12:0/4286701129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e7c106a80 0x7f9e7c106e60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.957+0000 7f9e822be640 1 -- 172.21.15.12:0/4286701129 >> 172.21.15.12:0/4286701129 conn(0x7f9e7c0fc7a0 msgr2=0x7f9e7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.957+0000 7f9e822be640 1 -- 172.21.15.12:0/4286701129 shutdown_connections 2024-09-19T06:39:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.957+0000 7f9e822be640 1 -- 172.21.15.12:0/4286701129 wait complete. 2024-09-19T06:39:09.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.957+0000 7f9e822be640 1 Processor -- start 2024-09-19T06:39:09.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.957+0000 7f9e822be640 1 -- start start 2024-09-19T06:39:09.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e822be640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e7c100a80 0x7f9e7c1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e822be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e7c101420 0x7f9e7c197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e822be640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e7c106a80 0x7f9e7c19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e822be640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c110e80 con 0x7f9e7c101420 2024-09-19T06:39:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e822be640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c110d00 con 0x7f9e7c106a80 2024-09-19T06:39:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e822be640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c111000 con 0x7f9e7c100a80 2024-09-19T06:39:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e7c101420 0x7f9e7c197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e7b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e7c101420 0x7f9e7c197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59668/0 (socket says 172.21.15.12:59668) 2024-09-19T06:39:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e7b7fe640 1 -- 172.21.15.12:0/3098003814 learned_addr learned my addr 172.21.15.12:0/3098003814 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e8085b640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e7c106a80 0x7f9e7c19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e7b7fe640 1 -- 172.21.15.12:0/3098003814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e7c100a80 msgr2=0x7f9e7c1973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e7bfff640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e7c100a80 0x7f9e7c1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e7b7fe640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e7c100a80 0x7f9e7c1973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e7b7fe640 1 -- 172.21.15.12:0/3098003814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e7c106a80 msgr2=0x7f9e7c19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e7b7fe640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e7c106a80 0x7f9e7c19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e7b7fe640 1 -- 172.21.15.12:0/3098003814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c19c370 con 0x7f9e7c101420 2024-09-19T06:39:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.958+0000 7f9e8085b640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e7c106a80 0x7f9e7c19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.959+0000 7f9e7b7fe640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e7c101420 0x7f9e7c197900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000e9f0 tx=0x7f9e7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.959+0000 7f9e797fa640 1 -- 172.21.15.12:0/3098003814 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000cd80 con 0x7f9e7c101420 2024-09-19T06:39:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.959+0000 7f9e797fa640 1 -- 172.21.15.12:0/3098003814 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e70005500 con 0x7f9e7c101420 2024-09-19T06:39:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.959+0000 7f9e822be640 1 -- 172.21.15.12:0/3098003814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7c19c660 con 0x7f9e7c101420 2024-09-19T06:39:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.959+0000 7f9e797fa640 1 -- 172.21.15.12:0/3098003814 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70010690 con 0x7f9e7c101420 2024-09-19T06:39:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.959+0000 7f9e822be640 1 -- 172.21.15.12:0/3098003814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7c06a790 con 0x7f9e7c101420 2024-09-19T06:39:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.960+0000 7f9e822be640 1 -- 172.21.15.12:0/3098003814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e7c1021c0 con 0x7f9e7c101420 2024-09-19T06:39:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.961+0000 7f9e797fa640 1 -- 172.21.15.12:0/3098003814 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9e700046c0 con 0x7f9e7c101420 2024-09-19T06:39:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.962+0000 7f9e797fa640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9e640a32d0 0x7f9e640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.962+0000 7f9e7bfff640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9e640a32d0 0x7f9e640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.962+0000 7f9e797fa640 1 -- 172.21.15.12:0/3098003814 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f9e700cff50 con 0x7f9e7c101420 2024-09-19T06:39:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.962+0000 7f9e7bfff640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9e640a32d0 0x7f9e640a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0096c0 tx=0x7f9e6c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:09.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:09.966+0000 7f9e797fa640 1 -- 172.21.15.12:0/3098003814 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e7009caf0 con 0x7f9e7c101420 2024-09-19T06:39:10.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.148+0000 7f9e822be640 1 -- 172.21.15.12:0/3098003814 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9e7c06b260 con 0x7f9e7c101420 2024-09-19T06:39:10.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.148+0000 7f9e797fa640 1 -- 172.21.15.12:0/3098003814 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9e7009c3f0 con 0x7f9e7c101420 2024-09-19T06:39:10.151 INFO:teuthology.orchestra.run.smithi012.stdout:210453397547 2024-09-19T06:39:10.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 -- 172.21.15.12:0/3098003814 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9e640a32d0 msgr2=0x7f9e640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9e640a32d0 0x7f9e640a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0096c0 tx=0x7f9e6c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 -- 172.21.15.12:0/3098003814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e7c101420 msgr2=0x7f9e7c197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e7c101420 0x7f9e7c197900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000e9f0 tx=0x7f9e7000edf0 comp rx=0 tx=0).stop 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 -- 172.21.15.12:0/3098003814 shutdown_connections 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9e640a32d0 0x7f9e640a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e7c106a80 0x7f9e7c19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e7c101420 0x7f9e7c197900 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 --2- 172.21.15.12:0/3098003814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e7c100a80 0x7f9e7c1973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 -- 172.21.15.12:0/3098003814 >> 172.21.15.12:0/3098003814 conn(0x7f9e7c0fc7a0 msgr2=0x7f9e7c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.150+0000 7f9e822be640 1 -- 172.21.15.12:0/3098003814 shutdown_connections 2024-09-19T06:39:10.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:10.151+0000 7f9e822be640 1 -- 172.21.15.12:0/3098003814 wait complete. 2024-09-19T06:39:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:10.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:10 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:10.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:10 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:10.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:10 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:10.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:10 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:10.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:10 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2786196139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:39:10.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:10 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3098003814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:39:10.920 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397545 got 210453397547 for osd.7 2024-09-19T06:39:10.920 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:11.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:10 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:11.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:10 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:11.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:10 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:11.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:10 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:11.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:10 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2786196139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:39:11.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:10 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3098003814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:39:11.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:10 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:11.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:10 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:11.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:10 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:11.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:10 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:11.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:10 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2786196139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:39:11.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:10 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3098003814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:39:11.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.365+0000 7f0e48183640 1 -- 172.21.15.12:0/1229327678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e40102790 msgr2=0x7f0e401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.365+0000 7f0e48183640 1 --2- 172.21.15.12:0/1229327678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e40102790 0x7f0e401067e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0e30009900 tx=0x7f0e3002a410 comp rx=0 tx=0).stop 2024-09-19T06:39:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.366+0000 7f0e48183640 1 -- 172.21.15.12:0/1229327678 shutdown_connections 2024-09-19T06:39:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.366+0000 7f0e48183640 1 --2- 172.21.15.12:0/1229327678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40106f10 0x7f0e4010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.366+0000 7f0e48183640 1 --2- 172.21.15.12:0/1229327678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e40102790 0x7f0e401067e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.366+0000 7f0e48183640 1 --2- 172.21.15.12:0/1229327678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e40101de0 0x7f0e401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.366+0000 7f0e48183640 1 -- 172.21.15.12:0/1229327678 >> 172.21.15.12:0/1229327678 conn(0x7f0e400fd8c0 msgr2=0x7f0e400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.366+0000 7f0e48183640 1 -- 172.21.15.12:0/1229327678 shutdown_connections 2024-09-19T06:39:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.366+0000 7f0e48183640 1 -- 172.21.15.12:0/1229327678 wait complete. 2024-09-19T06:39:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.366+0000 7f0e48183640 1 Processor -- start 2024-09-19T06:39:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.366+0000 7f0e48183640 1 -- start start 2024-09-19T06:39:11.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e48183640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e40101de0 0x7f0e40198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:11.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e48183640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e40102790 0x7f0e40198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:11.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e48183640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40106f10 0x7f0e4019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:11.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e48183640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e40111f70 con 0x7f0e40101de0 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e48183640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e40111df0 con 0x7f0e40106f10 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e48183640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e401120f0 con 0x7f0e40102790 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e45f1f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e40101de0 0x7f0e40198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e45f1f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e40101de0 0x7f0e40198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43224/0 (socket says 172.21.15.12:43224) 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e45f1f640 1 -- 172.21.15.12:0/897678584 learned_addr learned my addr 172.21.15.12:0/897678584 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e4571e640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e40102790 0x7f0e40198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e46720640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40106f10 0x7f0e4019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e45f1f640 1 -- 172.21.15.12:0/897678584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e40102790 msgr2=0x7f0e40198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e45f1f640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e40102790 0x7f0e40198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e45f1f640 1 -- 172.21.15.12:0/897678584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40106f10 msgr2=0x7f0e4019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e45f1f640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40106f10 0x7f0e4019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e45f1f640 1 -- 172.21.15.12:0/897678584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4019d400 con 0x7f0e40101de0 2024-09-19T06:39:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e45f1f640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e40101de0 0x7f0e40198450 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00cce0 tx=0x7f0e3c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.367+0000 7f0e36ffd640 1 -- 172.21.15.12:0/897678584 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c004b20 con 0x7f0e40101de0 2024-09-19T06:39:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.368+0000 7f0e36ffd640 1 -- 172.21.15.12:0/897678584 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e3c004cc0 con 0x7f0e40101de0 2024-09-19T06:39:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.368+0000 7f0e36ffd640 1 -- 172.21.15.12:0/897678584 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00f7d0 con 0x7f0e40101de0 2024-09-19T06:39:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.368+0000 7f0e48183640 1 -- 172.21.15.12:0/897678584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4019d6f0 con 0x7f0e40101de0 2024-09-19T06:39:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.368+0000 7f0e48183640 1 -- 172.21.15.12:0/897678584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e40074420 con 0x7f0e40101de0 2024-09-19T06:39:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.369+0000 7f0e48183640 1 -- 172.21.15.12:0/897678584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e401032c0 con 0x7f0e40101de0 2024-09-19T06:39:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.370+0000 7f0e36ffd640 1 -- 172.21.15.12:0/897678584 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0e3c00f970 con 0x7f0e40101de0 2024-09-19T06:39:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.371+0000 7f0e36ffd640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0e2c0a31b0 0x7f0e2c0a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.371+0000 7f0e4571e640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0e2c0a31b0 0x7f0e2c0a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.371+0000 7f0e36ffd640 1 -- 172.21.15.12:0/897678584 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f0e3c0cfd90 con 0x7f0e40101de0 2024-09-19T06:39:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.371+0000 7f0e4571e640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0e2c0a31b0 0x7f0e2c0a5670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e30000c00 tx=0x7f0e300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:11.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.375+0000 7f0e36ffd640 1 -- 172.21.15.12:0/897678584 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0e3c01d020 con 0x7f0e40101de0 2024-09-19T06:39:11.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.558+0000 7f0e48183640 1 -- 172.21.15.12:0/897678584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f0e401997b0 con 0x7f0e40101de0 2024-09-19T06:39:11.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.559+0000 7f0e36ffd640 1 -- 172.21.15.12:0/897678584 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0e3c014030 con 0x7f0e40101de0 2024-09-19T06:39:11.561 INFO:teuthology.orchestra.run.smithi012.stdout:292057776156 2024-09-19T06:39:11.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 -- 172.21.15.12:0/897678584 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0e2c0a31b0 msgr2=0x7f0e2c0a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0e2c0a31b0 0x7f0e2c0a5670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e30000c00 tx=0x7f0e300058d0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 -- 172.21.15.12:0/897678584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e40101de0 msgr2=0x7f0e40198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e40101de0 0x7f0e40198450 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00cce0 tx=0x7f0e3c00a620 comp rx=0 tx=0).stop 2024-09-19T06:39:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 -- 172.21.15.12:0/897678584 shutdown_connections 2024-09-19T06:39:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f0e2c0a31b0 0x7f0e2c0a5670 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40106f10 0x7f0e4019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e40102790 0x7f0e40198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 --2- 172.21.15.12:0/897678584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e40101de0 0x7f0e40198450 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 -- 172.21.15.12:0/897678584 >> 172.21.15.12:0/897678584 conn(0x7f0e400fd8c0 msgr2=0x7f0e400feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 -- 172.21.15.12:0/897678584 shutdown_connections 2024-09-19T06:39:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:11.561+0000 7f0e48183640 1 -- 172.21.15.12:0/897678584 wait complete. 2024-09-19T06:39:11.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:11 smithi012 ceph-mon[30937]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:11.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:11 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/897678584' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:39:12.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:11 smithi016 ceph-mon[34911]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:12.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:11 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/897678584' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:39:12.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:11 smithi173 ceph-mon[35349]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:12.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:11 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/897678584' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:39:12.289 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776154 got 292057776156 for osd.10 2024-09-19T06:39:12.290 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:12.719 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168612 got 240518168614 for osd.8 2024-09-19T06:39:12.719 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:13.066 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.241+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/1359659474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4103780 msgr2=0x7fd0e4107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.241+0000 7fd0e8e5c640 1 --2- 172.21.15.12:0/1359659474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4103780 0x7fd0e4107bc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009930 tx=0x7fd0d802a420 comp rx=0 tx=0).stop 2024-09-19T06:39:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.241+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/1359659474 shutdown_connections 2024-09-19T06:39:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.241+0000 7fd0e8e5c640 1 --2- 172.21.15.12:0/1359659474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e4108300 0x7fd0e410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.241+0000 7fd0e8e5c640 1 --2- 172.21.15.12:0/1359659474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4103780 0x7fd0e4107bc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.241+0000 7fd0e8e5c640 1 --2- 172.21.15.12:0/1359659474 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e4102dd0 0x7fd0e41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.241+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/1359659474 >> 172.21.15.12:0/1359659474 conn(0x7fd0e40fc7d0 msgr2=0x7fd0e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.242+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/1359659474 shutdown_connections 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.242+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/1359659474 wait complete. 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e8e5c640 1 Processor -- start 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e8e5c640 1 -- start start 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e8e5c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e4102dd0 0x7fd0e4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e8e5c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e4103780 0x7fd0e4198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e8e5c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4108300 0x7fd0e419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e8e5c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e4112050 con 0x7fd0e4108300 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e8e5c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e4111ed0 con 0x7fd0e4102dd0 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e8e5c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e41121d0 con 0x7fd0e4103780 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4108300 0x7fd0e419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4108300 0x7fd0e419ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43254/0 (socket says 172.21.15.12:43254) 2024-09-19T06:39:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e2d9d640 1 -- 172.21.15.12:0/399349096 learned_addr learned my addr 172.21.15.12:0/399349096 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e1d9b640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e4103780 0x7fd0e4198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.243+0000 7fd0e259c640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e4102dd0 0x7fd0e4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0e2d9d640 1 -- 172.21.15.12:0/399349096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e4103780 msgr2=0x7fd0e4198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0e2d9d640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e4103780 0x7fd0e4198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0e2d9d640 1 -- 172.21.15.12:0/399349096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e4102dd0 msgr2=0x7fd0e4198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0e2d9d640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e4102dd0 0x7fd0e4198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0e2d9d640 1 -- 172.21.15.12:0/399349096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e419d540 con 0x7fd0e4108300 2024-09-19T06:39:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0e259c640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e4102dd0 0x7fd0e4198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0e1d9b640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e4103780 0x7fd0e4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0e2d9d640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4108300 0x7fd0e419ce60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00cce0 tx=0x7fd0dc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0d37fe640 1 -- 172.21.15.12:0/399349096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00f450 con 0x7fd0e4108300 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/399349096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e419d830 con 0x7fd0e4108300 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/399349096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e4100960 con 0x7fd0e4108300 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0d37fe640 1 -- 172.21.15.12:0/399349096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0dc00fad0 con 0x7fd0e4108300 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.244+0000 7fd0d37fe640 1 -- 172.21.15.12:0/399349096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc018c10 con 0x7fd0e4108300 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.245+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/399349096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c4005290 con 0x7fd0e4108300 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.246+0000 7fd0d37fe640 1 -- 172.21.15.12:0/399349096 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd0dc018400 con 0x7fd0e4108300 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.247+0000 7fd0d37fe640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd0cc0a3350 0x7fd0cc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.247+0000 7fd0d37fe640 1 -- 172.21.15.12:0/399349096 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fd0dc0cfe20 con 0x7fd0e4108300 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.247+0000 7fd0e259c640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd0cc0a3350 0x7fd0cc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.248+0000 7fd0e259c640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd0cc0a3350 0x7fd0cc0a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40096a0 tx=0x7fd0d4012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.255+0000 7fd0d37fe640 1 -- 172.21.15.12:0/399349096 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd0dc014030 con 0x7fd0e4108300 2024-09-19T06:39:13.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.145+0000 7f72af828640 1 -- 172.21.15.12:0/3283737170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a81036e0 msgr2=0x7f72a8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:13.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.145+0000 7f72af828640 1 --2- 172.21.15.12:0/3283737170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a81036e0 0x7f72a8107b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009930 tx=0x7f72a402a420 comp rx=0 tx=0).stop 2024-09-19T06:39:13.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.145+0000 7f72af828640 1 -- 172.21.15.12:0/3283737170 shutdown_connections 2024-09-19T06:39:13.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.145+0000 7f72af828640 1 --2- 172.21.15.12:0/3283737170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a81082a0 0x7f72a810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.145+0000 7f72af828640 1 --2- 172.21.15.12:0/3283737170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a81036e0 0x7f72a8107b90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.145+0000 7f72af828640 1 --2- 172.21.15.12:0/3283737170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72a8102d30 0x7f72a8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.145+0000 7f72af828640 1 -- 172.21.15.12:0/3283737170 >> 172.21.15.12:0/3283737170 conn(0x7f72a80fc7d0 msgr2=0x7f72a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.145+0000 7f72af828640 1 -- 172.21.15.12:0/3283737170 shutdown_connections 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.145+0000 7f72af828640 1 -- 172.21.15.12:0/3283737170 wait complete. 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.146+0000 7f72af828640 1 Processor -- start 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.146+0000 7f72af828640 1 -- start start 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.146+0000 7f72af828640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72a8102d30 0x7f72a81a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.146+0000 7f72af828640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a81036e0 0x7f72a81a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.146+0000 7f72af828640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a81082a0 0x7f72a819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.146+0000 7f72af828640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f72a81120a0 con 0x7f72a81082a0 2024-09-19T06:39:13.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.146+0000 7f72af828640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f72a8111f20 con 0x7f72a8102d30 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.146+0000 7f72af828640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f72a8112220 con 0x7f72a81036e0 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.146+0000 7f72addc5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a81082a0 0x7f72a819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72addc5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a81082a0 0x7f72a819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43234/0 (socket says 172.21.15.12:43234) 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72addc5640 1 -- 172.21.15.12:0/3128982729 learned_addr learned my addr 172.21.15.12:0/3128982729 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72ad5c4640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72a8102d30 0x7f72a81a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72acdc3640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a81036e0 0x7f72a81a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72addc5640 1 -- 172.21.15.12:0/3128982729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a81036e0 msgr2=0x7f72a81a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72addc5640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a81036e0 0x7f72a81a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72addc5640 1 -- 172.21.15.12:0/3128982729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72a8102d30 msgr2=0x7f72a81a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72addc5640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72a8102d30 0x7f72a81a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72addc5640 1 -- 172.21.15.12:0/3128982729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a819ad40 con 0x7f72a81082a0 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72addc5640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a81082a0 0x7f72a819a610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009fd0 tx=0x7f72a000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f729e7fc640 1 -- 172.21.15.12:0/3128982729 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0017070 con 0x7f72a81082a0 2024-09-19T06:39:13.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f729e7fc640 1 -- 172.21.15.12:0/3128982729 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a0003e50 con 0x7f72a81082a0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f72af828640 1 -- 172.21.15.12:0/3128982729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a819b030 con 0x7f72a81082a0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.147+0000 7f729e7fc640 1 -- 172.21.15.12:0/3128982729 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a00106c0 con 0x7f72a81082a0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.148+0000 7f72af828640 1 -- 172.21.15.12:0/3128982729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a81a7320 con 0x7f72a81082a0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.149+0000 7f72af828640 1 -- 172.21.15.12:0/3128982729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a8103110 con 0x7f72a81082a0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.151+0000 7f729e7fc640 1 -- 172.21.15.12:0/3128982729 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f72a0003970 con 0x7f72a81082a0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.151+0000 7f729e7fc640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f72940a32d0 0x7f72940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.151+0000 7f72ad5c4640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f72940a32d0 0x7f72940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.151+0000 7f729e7fc640 1 -- 172.21.15.12:0/3128982729 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f72a00cf780 con 0x7f72a81082a0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.152+0000 7f72ad5c4640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f72940a32d0 0x7f72940a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f729800bbe0 tx=0x7f729800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.156+0000 7f729e7fc640 1 -- 172.21.15.12:0/3128982729 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72a009bcd0 con 0x7f72a81082a0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.343+0000 7f72af828640 1 -- 172.21.15.12:0/3128982729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f72a810c2c0 con 0x7f72a81082a0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.344+0000 7f729e7fc640 1 -- 172.21.15.12:0/3128982729 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f72a009ffd0 con 0x7f72a81082a0 2024-09-19T06:39:13.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 -- 172.21.15.12:0/3128982729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f72940a32d0 msgr2=0x7f72940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:13.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f72940a32d0 0x7f72940a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f729800bbe0 tx=0x7f729800b390 comp rx=0 tx=0).stop 2024-09-19T06:39:13.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 -- 172.21.15.12:0/3128982729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a81082a0 msgr2=0x7f72a819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:13.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a81082a0 0x7f72a819a610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009fd0 tx=0x7f72a000b260 comp rx=0 tx=0).stop 2024-09-19T06:39:13.380 INFO:teuthology.orchestra.run.smithi012.stdout:270582939683 2024-09-19T06:39:13.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 -- 172.21.15.12:0/3128982729 shutdown_connections 2024-09-19T06:39:13.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f72940a32d0 0x7f72940a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72a81082a0 0x7f72a819a610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a81036e0 0x7f72a81a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 --2- 172.21.15.12:0/3128982729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72a8102d30 0x7f72a81a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 -- 172.21.15.12:0/3128982729 >> 172.21.15.12:0/3128982729 conn(0x7f72a80fc7d0 msgr2=0x7f72a8100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:13.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 -- 172.21.15.12:0/3128982729 shutdown_connections 2024-09-19T06:39:13.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.346+0000 7f72af828640 1 -- 172.21.15.12:0/3128982729 wait complete. 2024-09-19T06:39:13.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.447+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/399349096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd0c4005850 con 0x7fd0e4108300 2024-09-19T06:39:13.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.447+0000 7fd0d37fe640 1 -- 172.21.15.12:0/399349096 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd0dc09c9c0 con 0x7fd0e4108300 2024-09-19T06:39:13.449 INFO:teuthology.orchestra.run.smithi012.stdout:103079215169 2024-09-19T06:39:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/399349096 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd0cc0a3350 msgr2=0x7fd0cc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd0cc0a3350 0x7fd0cc0a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40096a0 tx=0x7fd0d4012040 comp rx=0 tx=0).stop 2024-09-19T06:39:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/399349096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4108300 msgr2=0x7fd0e419ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4108300 0x7fd0e419ce60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00cce0 tx=0x7fd0dc00a620 comp rx=0 tx=0).stop 2024-09-19T06:39:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/399349096 shutdown_connections 2024-09-19T06:39:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd0cc0a3350 0x7fd0cc0a5810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0e4108300 0x7fd0e419ce60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0e4103780 0x7fd0e4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 --2- 172.21.15.12:0/399349096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e4102dd0 0x7fd0e4198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/399349096 >> 172.21.15.12:0/399349096 conn(0x7fd0e40fc7d0 msgr2=0x7fd0e4105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/399349096 shutdown_connections 2024-09-19T06:39:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:13.449+0000 7fd0e8e5c640 1 -- 172.21.15.12:0/399349096 wait complete. 2024-09-19T06:39:13.882 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:13 smithi012 ceph-mon[30937]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:13.882 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:13 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3128982729' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:39:13.883 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:13 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/399349096' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:39:14.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:13 smithi016 ceph-mon[34911]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:14.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:13 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3128982729' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:39:14.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:13 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/399349096' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:39:14.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:13 smithi173 ceph-mon[35349]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:14.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:13 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3128982729' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:39:14.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:13 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/399349096' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:39:14.237 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215167 got 103079215169 for osd.3 2024-09-19T06:39:14.237 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:15.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.058+0000 7fe1e3966640 1 -- 172.21.15.12:0/2304362891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc102d20 msgr2=0x7fe1dc103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:15.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.058+0000 7fe1e3966640 1 --2- 172.21.15.12:0/2304362891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc102d20 0x7fe1dc103100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009900 tx=0x7fe1d802a480 comp rx=0 tx=0).stop 2024-09-19T06:39:15.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.058+0000 7fe1e3966640 1 -- 172.21.15.12:0/2304362891 shutdown_connections 2024-09-19T06:39:15.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.058+0000 7fe1e3966640 1 --2- 172.21.15.12:0/2304362891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1dc10c150 0x7fe1dc10e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.058+0000 7fe1e3966640 1 --2- 172.21.15.12:0/2304362891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1dc103640 0x7fe1dc10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.058+0000 7fe1e3966640 1 --2- 172.21.15.12:0/2304362891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc102d20 0x7fe1dc103100 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.058+0000 7fe1e3966640 1 -- 172.21.15.12:0/2304362891 >> 172.21.15.12:0/2304362891 conn(0x7fe1dc0fc780 msgr2=0x7fe1dc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.058+0000 7fe1e3966640 1 -- 172.21.15.12:0/2304362891 shutdown_connections 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.058+0000 7fe1e3966640 1 -- 172.21.15.12:0/2304362891 wait complete. 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.058+0000 7fe1e3966640 1 Processor -- start 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e3966640 1 -- start start 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e3966640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1dc102d20 0x7fe1dc1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e3966640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc103640 0x7fe1dc1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e3966640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1dc10c150 0x7fe1dc19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e3966640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc111f50 con 0x7fe1dc103640 2024-09-19T06:39:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e3966640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc111dd0 con 0x7fe1dc102d20 2024-09-19T06:39:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e3966640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc1120d0 con 0x7fe1dc10c150 2024-09-19T06:39:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e1702640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1dc102d20 0x7fe1dc1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e0f01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc103640 0x7fe1dc1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e1702640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1dc102d20 0x7fe1dc1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46578/0 (socket says 172.21.15.12:46578) 2024-09-19T06:39:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e1702640 1 -- 172.21.15.12:0/2426353144 learned_addr learned my addr 172.21.15.12:0/2426353144 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e1f03640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1dc10c150 0x7fe1dc19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e0f01640 1 -- 172.21.15.12:0/2426353144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1dc10c150 msgr2=0x7fe1dc19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e0f01640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1dc10c150 0x7fe1dc19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e0f01640 1 -- 172.21.15.12:0/2426353144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1dc102d20 msgr2=0x7fe1dc1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e0f01640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1dc102d20 0x7fe1dc1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e0f01640 1 -- 172.21.15.12:0/2426353144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc19d450 con 0x7fe1dc103640 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.059+0000 7fe1e1702640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1dc102d20 0x7fe1dc1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.060+0000 7fe1e0f01640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc103640 0x7fe1dc1989e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00d650 tx=0x7fe1cc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.060+0000 7fe1d27fc640 1 -- 172.21.15.12:0/2426353144 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc017070 con 0x7fe1dc103640 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.060+0000 7fe1d27fc640 1 -- 172.21.15.12:0/2426353144 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1cc005500 con 0x7fe1dc103640 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.060+0000 7fe1e3966640 1 -- 172.21.15.12:0/2426353144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc19d740 con 0x7fe1dc103640 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.060+0000 7fe1d27fc640 1 -- 172.21.15.12:0/2426353144 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0047a0 con 0x7fe1dc103640 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.061+0000 7fe1e3966640 1 -- 172.21.15.12:0/2426353144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1dc1a5020 con 0x7fe1dc103640 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.062+0000 7fe1e3966640 1 -- 172.21.15.12:0/2426353144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1dc103100 con 0x7fe1dc103640 2024-09-19T06:39:15.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.063+0000 7fe1d27fc640 1 -- 172.21.15.12:0/2426353144 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe1cc005020 con 0x7fe1dc103640 2024-09-19T06:39:15.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.064+0000 7fe1d27fc640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1c80a32d0 0x7fe1c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:15.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.064+0000 7fe1e1702640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1c80a32d0 0x7fe1c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:15.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.064+0000 7fe1d27fc640 1 -- 172.21.15.12:0/2426353144 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7fe1cc0cf380 con 0x7fe1dc103640 2024-09-19T06:39:15.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.064+0000 7fe1e1702640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1c80a32d0 0x7fe1c80a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80096c0 tx=0x7fe1d8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:15.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.068+0000 7fe1d27fc640 1 -- 172.21.15.12:0/2426353144 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe1cc020030 con 0x7fe1dc103640 2024-09-19T06:39:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.246+0000 7fe1e3966640 1 -- 172.21.15.12:0/2426353144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe1dc1071c0 con 0x7fe1dc103640 2024-09-19T06:39:15.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.246+0000 7fe1d27fc640 1 -- 172.21.15.12:0/2426353144 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe1cc09bf20 con 0x7fe1dc103640 2024-09-19T06:39:15.249 INFO:teuthology.orchestra.run.smithi012.stdout:158913790007 2024-09-19T06:39:15.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.249+0000 7fe1e3966640 1 -- 172.21.15.12:0/2426353144 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1c80a32d0 msgr2=0x7fe1c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:15.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1c80a32d0 0x7fe1c80a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80096c0 tx=0x7fe1d8005a20 comp rx=0 tx=0).stop 2024-09-19T06:39:15.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 -- 172.21.15.12:0/2426353144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc103640 msgr2=0x7fe1dc1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:15.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc103640 0x7fe1dc1989e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00d650 tx=0x7fe1cc00db10 comp rx=0 tx=0).stop 2024-09-19T06:39:15.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 -- 172.21.15.12:0/2426353144 shutdown_connections 2024-09-19T06:39:15.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe1c80a32d0 0x7fe1c80a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1dc10c150 0x7fe1dc19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1dc103640 0x7fe1dc1989e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 --2- 172.21.15.12:0/2426353144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1dc102d20 0x7fe1dc1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:15.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 -- 172.21.15.12:0/2426353144 >> 172.21.15.12:0/2426353144 conn(0x7fe1dc0fc780 msgr2=0x7fe1dc0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:15.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 -- 172.21.15.12:0/2426353144 shutdown_connections 2024-09-19T06:39:15.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.250+0000 7fe1e3966640 1 -- 172.21.15.12:0/2426353144 wait complete. 2024-09-19T06:39:15.635 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939681 got 270582939683 for osd.9 2024-09-19T06:39:15.636 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:15.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:15 smithi012 ceph-mon[30937]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:39:15.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:15 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2426353144' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:39:15.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:15 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1660625327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:39:16.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:15 smithi016 ceph-mon[34911]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:39:16.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:15 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2426353144' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:39:16.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:15 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1660625327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:39:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:15 smithi173 ceph-mon[35349]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:39:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:15 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2426353144' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:39:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:15 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1660625327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:39:16.600 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790003 got 158913790007 for osd.5 2024-09-19T06:39:16.601 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:16.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.282+0000 7f107686a640 1 -- 172.21.15.12:0/1090912778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1070102780 msgr2=0x7f10701067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.282+0000 7f107686a640 1 --2- 172.21.15.12:0/1090912778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1070102780 0x7f10701067d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1064009900 tx=0x7f106402a410 comp rx=0 tx=0).stop 2024-09-19T06:39:16.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.282+0000 7f107686a640 1 -- 172.21.15.12:0/1090912778 shutdown_connections 2024-09-19T06:39:16.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.282+0000 7f107686a640 1 --2- 172.21.15.12:0/1090912778 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1070106f00 0x7f107010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.282+0000 7f107686a640 1 --2- 172.21.15.12:0/1090912778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1070102780 0x7f10701067d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.282+0000 7f107686a640 1 --2- 172.21.15.12:0/1090912778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1070101dd0 0x7f10701021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.282+0000 7f107686a640 1 -- 172.21.15.12:0/1090912778 >> 172.21.15.12:0/1090912778 conn(0x7f10700fd8b0 msgr2=0x7f10700ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.282+0000 7f107686a640 1 -- 172.21.15.12:0/1090912778 shutdown_connections 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.283+0000 7f107686a640 1 -- 172.21.15.12:0/1090912778 wait complete. 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f107686a640 1 Processor -- start 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f107686a640 1 -- start start 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f107686a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1070101dd0 0x7f10701983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f107686a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1070102780 0x7f1070198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f107686a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1070106f00 0x7f107019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f107686a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1070111f60 con 0x7f1070102780 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f107686a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1070111de0 con 0x7f1070101dd0 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f107686a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10701120e0 con 0x7f1070106f00 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f106f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1070102780 0x7f1070198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f106f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1070102780 0x7f1070198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43288/0 (socket says 172.21.15.12:43288) 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f106f7fe640 1 -- 172.21.15.12:0/1660625327 learned_addr learned my addr 172.21.15.12:0/1660625327 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f106ffff640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1070101dd0 0x7f10701983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f1074e07640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1070106f00 0x7f107019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.284+0000 7f106f7fe640 1 -- 172.21.15.12:0/1660625327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1070106f00 msgr2=0x7f107019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.285+0000 7f106f7fe640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1070106f00 0x7f107019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.285+0000 7f106f7fe640 1 -- 172.21.15.12:0/1660625327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1070101dd0 msgr2=0x7f10701983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.285+0000 7f106f7fe640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1070101dd0 0x7f10701983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.285+0000 7f106f7fe640 1 -- 172.21.15.12:0/1660625327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107019d390 con 0x7f1070102780 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.285+0000 7f106f7fe640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1070102780 0x7f1070198920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1064005ab0 tx=0x7f10640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.285+0000 7f106d7fa640 1 -- 172.21.15.12:0/1660625327 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106403f030 con 0x7f1070102780 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.285+0000 7f107686a640 1 -- 172.21.15.12:0/1660625327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107019d620 con 0x7f1070102780 2024-09-19T06:39:16.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.285+0000 7f106d7fa640 1 -- 172.21.15.12:0/1660625327 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1064003ce0 con 0x7f1070102780 2024-09-19T06:39:16.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.285+0000 7f106d7fa640 1 -- 172.21.15.12:0/1660625327 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1064035070 con 0x7f1070102780 2024-09-19T06:39:16.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.285+0000 7f107686a640 1 -- 172.21.15.12:0/1660625327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10701a4f60 con 0x7f1070102780 2024-09-19T06:39:16.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.286+0000 7f107686a640 1 -- 172.21.15.12:0/1660625327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10701032b0 con 0x7f1070102780 2024-09-19T06:39:16.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.287+0000 7f106d7fa640 1 -- 172.21.15.12:0/1660625327 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1064042030 con 0x7f1070102780 2024-09-19T06:39:16.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.288+0000 7f106d7fa640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10580a32d0 0x7f10580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:16.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.288+0000 7f106d7fa640 1 -- 172.21.15.12:0/1660625327 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f10640f03b0 con 0x7f1070102780 2024-09-19T06:39:16.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.288+0000 7f106ffff640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10580a32d0 0x7f10580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:16.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.289+0000 7f106ffff640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10580a32d0 0x7f10580a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f10600058c0 tx=0x7f106000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:16.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.292+0000 7f106d7fa640 1 -- 172.21.15.12:0/1660625327 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10640bcf50 con 0x7f1070102780 2024-09-19T06:39:16.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.471+0000 7f107686a640 1 -- 172.21.15.12:0/1660625327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f107010a140 con 0x7f1070102780 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:322122547226 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.471+0000 7f106d7fa640 1 -- 172.21.15.12:0/1660625327 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f10640bc850 con 0x7f1070102780 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 -- 172.21.15.12:0/1660625327 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10580a32d0 msgr2=0x7f10580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10580a32d0 0x7f10580a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f10600058c0 tx=0x7f106000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 -- 172.21.15.12:0/1660625327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1070102780 msgr2=0x7f1070198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1070102780 0x7f1070198920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1064005ab0 tx=0x7f10640042f0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 -- 172.21.15.12:0/1660625327 shutdown_connections 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10580a32d0 0x7f10580a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1070106f00 0x7f107019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1070102780 0x7f1070198920 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 --2- 172.21.15.12:0/1660625327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1070101dd0 0x7f10701983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:16.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 -- 172.21.15.12:0/1660625327 >> 172.21.15.12:0/1660625327 conn(0x7f10700fd8b0 msgr2=0x7f10700fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:16.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 -- 172.21.15.12:0/1660625327 shutdown_connections 2024-09-19T06:39:16.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:15.473+0000 7f107686a640 1 -- 172.21.15.12:0/1660625327 wait complete. 2024-09-19T06:39:17.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.435+0000 7f148eb91640 1 -- 172.21.15.12:0/3936871326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14881036e0 msgr2=0x7f1488107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:17.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.435+0000 7f148eb91640 1 --2- 172.21.15.12:0/3936871326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14881036e0 0x7f1488107b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f147c009930 tx=0x7f147c02a420 comp rx=0 tx=0).stop 2024-09-19T06:39:17.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.435+0000 7f148eb91640 1 -- 172.21.15.12:0/3936871326 shutdown_connections 2024-09-19T06:39:17.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.435+0000 7f148eb91640 1 --2- 172.21.15.12:0/3936871326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14881082a0 0x7f148810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.435+0000 7f148eb91640 1 --2- 172.21.15.12:0/3936871326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14881036e0 0x7f1488107b90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.435+0000 7f148eb91640 1 --2- 172.21.15.12:0/3936871326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1488102d30 0x7f1488103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.435+0000 7f148eb91640 1 -- 172.21.15.12:0/3936871326 >> 172.21.15.12:0/3936871326 conn(0x7f14880fc7d0 msgr2=0x7f14880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:17.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.435+0000 7f148eb91640 1 -- 172.21.15.12:0/3936871326 shutdown_connections 2024-09-19T06:39:17.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.435+0000 7f148eb91640 1 -- 172.21.15.12:0/3936871326 wait complete. 2024-09-19T06:39:17.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148eb91640 1 Processor -- start 2024-09-19T06:39:17.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148eb91640 1 -- start start 2024-09-19T06:39:17.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148eb91640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1488102d30 0x7f14881a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:17.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148eb91640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14881036e0 0x7f14881a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:17.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148eb91640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14881082a0 0x7f148819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:17.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148eb91640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1488112060 con 0x7f14881082a0 2024-09-19T06:39:17.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148eb91640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1488111ee0 con 0x7f14881036e0 2024-09-19T06:39:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148eb91640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14881121e0 con 0x7f1488102d30 2024-09-19T06:39:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148d12e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14881082a0 0x7f148819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148d12e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14881082a0 0x7f148819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43292/0 (socket says 172.21.15.12:43292) 2024-09-19T06:39:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f1487fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14881036e0 0x7f14881a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148d12e640 1 -- 172.21.15.12:0/3506695930 learned_addr learned my addr 172.21.15.12:0/3506695930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.436+0000 7f148c92d640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1488102d30 0x7f14881a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f148d12e640 1 -- 172.21.15.12:0/3506695930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1488102d30 msgr2=0x7f14881a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f148d12e640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1488102d30 0x7f14881a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f148d12e640 1 -- 172.21.15.12:0/3506695930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14881036e0 msgr2=0x7f14881a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f148d12e640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14881036e0 0x7f14881a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f148d12e640 1 -- 172.21.15.12:0/3506695930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148819acc0 con 0x7f14881082a0 2024-09-19T06:39:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f1487fff640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14881036e0 0x7f14881a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f148d12e640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14881082a0 0x7f148819a590 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1480009fd0 tx=0x7f148000def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f1485ffb640 1 -- 172.21.15.12:0/3506695930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480017070 con 0x7f14881082a0 2024-09-19T06:39:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f1485ffb640 1 -- 172.21.15.12:0/3506695930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1480003e50 con 0x7f14881082a0 2024-09-19T06:39:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f148eb91640 1 -- 172.21.15.12:0/3506695930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148819afb0 con 0x7f14881082a0 2024-09-19T06:39:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f1485ffb640 1 -- 172.21.15.12:0/3506695930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480010460 con 0x7f14881082a0 2024-09-19T06:39:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.437+0000 7f148eb91640 1 -- 172.21.15.12:0/3506695930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14881a72a0 con 0x7f14881082a0 2024-09-19T06:39:17.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.439+0000 7f148eb91640 1 -- 172.21.15.12:0/3506695930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1488103110 con 0x7f14881082a0 2024-09-19T06:39:17.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.440+0000 7f1485ffb640 1 -- 172.21.15.12:0/3506695930 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1480003970 con 0x7f14881082a0 2024-09-19T06:39:17.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.440+0000 7f1485ffb640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f14700a3350 0x7f14700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:17.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.440+0000 7f1485ffb640 1 -- 172.21.15.12:0/3506695930 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f14800cf620 con 0x7f14881082a0 2024-09-19T06:39:17.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.440+0000 7f148c92d640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f14700a3350 0x7f14700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:17.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.441+0000 7f148c92d640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f14700a3350 0x7f14700a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f147800abe0 tx=0x7f147800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:17.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.445+0000 7f1485ffb640 1 -- 172.21.15.12:0/3506695930 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f148009c1c0 con 0x7f14881082a0 2024-09-19T06:39:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.630+0000 7f148eb91640 1 -- 172.21.15.12:0/3506695930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f148810c2c0 con 0x7f14881082a0 2024-09-19T06:39:17.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.630+0000 7f1485ffb640 1 -- 172.21.15.12:0/3506695930 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f148009bac0 con 0x7f14881082a0 2024-09-19T06:39:17.633 INFO:teuthology.orchestra.run.smithi012.stdout:77309411399 2024-09-19T06:39:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.632+0000 7f148eb91640 1 -- 172.21.15.12:0/3506695930 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f14700a3350 msgr2=0x7f14700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.632+0000 7f148eb91640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f14700a3350 0x7f14700a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f147800abe0 tx=0x7f147800a2d0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.632+0000 7f148eb91640 1 -- 172.21.15.12:0/3506695930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14881082a0 msgr2=0x7f148819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.632+0000 7f148eb91640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14881082a0 0x7f148819a590 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1480009fd0 tx=0x7f148000def0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.633+0000 7f148eb91640 1 -- 172.21.15.12:0/3506695930 shutdown_connections 2024-09-19T06:39:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.633+0000 7f148eb91640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f14700a3350 0x7f14700a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.633+0000 7f148eb91640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14881082a0 0x7f148819a590 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.633+0000 7f148eb91640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14881036e0 0x7f14881a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.633+0000 7f148eb91640 1 --2- 172.21.15.12:0/3506695930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1488102d30 0x7f14881a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.633+0000 7f148eb91640 1 -- 172.21.15.12:0/3506695930 >> 172.21.15.12:0/3506695930 conn(0x7f14880fc7d0 msgr2=0x7f1488100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.633+0000 7f148eb91640 1 -- 172.21.15.12:0/3506695930 shutdown_connections 2024-09-19T06:39:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:17.633+0000 7f148eb91640 1 -- 172.21.15.12:0/3506695930 wait complete. 2024-09-19T06:39:17.895 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:17 smithi012 ceph-mon[30937]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:39:17.895 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:17 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3506695930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:39:17.926 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547223 got 322122547226 for osd.11 2024-09-19T06:39:17.926 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:18.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:17 smithi016 ceph-mon[34911]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:39:18.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:17 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3506695930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:39:18.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:17 smithi173 ceph-mon[35349]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:39:18.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:17 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3506695930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:39:18.645 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411396 got 77309411399 for osd.2 2024-09-19T06:39:18.646 DEBUG:teuthology.parallel:result is None 2024-09-19T06:39:18.646 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:39:18.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:39:18.926 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.411+0000 7f55f7c15640 1 -- 172.21.15.12:0/1673759970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55f0102d30 msgr2=0x7f55f0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.411+0000 7f55f7c15640 1 --2- 172.21.15.12:0/1673759970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55f0102d30 0x7f55f0103110 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009930 tx=0x7f55ec02a420 comp rx=0 tx=0).stop 2024-09-19T06:39:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.411+0000 7f55f7c15640 1 -- 172.21.15.12:0/1673759970 shutdown_connections 2024-09-19T06:39:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.411+0000 7f55f7c15640 1 --2- 172.21.15.12:0/1673759970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f01082a0 0x7f55f010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.411+0000 7f55f7c15640 1 --2- 172.21.15.12:0/1673759970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f01036e0 0x7f55f0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.411+0000 7f55f7c15640 1 --2- 172.21.15.12:0/1673759970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55f0102d30 0x7f55f0103110 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.411+0000 7f55f7c15640 1 -- 172.21.15.12:0/1673759970 >> 172.21.15.12:0/1673759970 conn(0x7f55f00fc7d0 msgr2=0x7f55f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.411+0000 7f55f7c15640 1 -- 172.21.15.12:0/1673759970 shutdown_connections 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.411+0000 7f55f7c15640 1 -- 172.21.15.12:0/1673759970 wait complete. 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f7c15640 1 Processor -- start 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f7c15640 1 -- start start 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f7c15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55f0102d30 0x7f55f01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f7c15640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f01036e0 0x7f55f0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f7c15640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f01082a0 0x7f55f019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f7c15640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01120a0 con 0x7f55f0102d30 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f7c15640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0111f20 con 0x7f55f01082a0 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f7c15640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0112220 con 0x7f55f01036e0 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f59b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55f0102d30 0x7f55f01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f59b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55f0102d30 0x7f55f01985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43310/0 (socket says 172.21.15.12:43310) 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f59b1640 1 -- 172.21.15.12:0/4252668011 learned_addr learned my addr 172.21.15.12:0/4252668011 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f61b2640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f01082a0 0x7f55f019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f51b0640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f01036e0 0x7f55f0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f59b1640 1 -- 172.21.15.12:0/4252668011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f01036e0 msgr2=0x7f55f0198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f59b1640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f01036e0 0x7f55f0198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f59b1640 1 -- 172.21.15.12:0/4252668011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f01082a0 msgr2=0x7f55f019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f59b1640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f01082a0 0x7f55f019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f59b1640 1 -- 172.21.15.12:0/4252668011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f019d570 con 0x7f55f0102d30 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f61b2640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f01082a0 0x7f55f019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.412+0000 7f55f59b1640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55f0102d30 0x7f55f01985c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009230 tx=0x7f55ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.413+0000 7f55e6ffd640 1 -- 172.21.15.12:0/4252668011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec03f030 con 0x7f55f0102d30 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.413+0000 7f55e6ffd640 1 -- 172.21.15.12:0/4252668011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55ec003ad0 con 0x7f55f0102d30 2024-09-19T06:39:19.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.413+0000 7f55f7c15640 1 -- 172.21.15.12:0/4252668011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f019d800 con 0x7f55f0102d30 2024-09-19T06:39:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.413+0000 7f55e6ffd640 1 -- 172.21.15.12:0/4252668011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec035070 con 0x7f55f0102d30 2024-09-19T06:39:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.413+0000 7f55f7c15640 1 -- 172.21.15.12:0/4252668011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f01a5140 con 0x7f55f0102d30 2024-09-19T06:39:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.414+0000 7f55f7c15640 1 -- 172.21.15.12:0/4252668011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f006a850 con 0x7f55f0102d30 2024-09-19T06:39:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.416+0000 7f55e6ffd640 1 -- 172.21.15.12:0/4252668011 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f55ec042030 con 0x7f55f0102d30 2024-09-19T06:39:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.416+0000 7f55e6ffd640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f55dc0a32d0 0x7f55dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.416+0000 7f55f51b0640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f55dc0a32d0 0x7f55dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.416+0000 7f55e6ffd640 1 -- 172.21.15.12:0/4252668011 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f55ec0f0480 con 0x7f55f0102d30 2024-09-19T06:39:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.417+0000 7f55f51b0640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f55dc0a32d0 0x7f55dc0a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f55f00fee70 tx=0x7f55e000b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.420+0000 7f55e6ffd640 1 -- 172.21.15.12:0/4252668011 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55ec0bd020 con 0x7f55f0102d30 2024-09-19T06:39:19.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.591+0000 7f55f7c15640 1 -- 172.21.15.12:0/4252668011 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55f0062630 con 0x7f55dc0a32d0 2024-09-19T06:39:19.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.598+0000 7f55e6ffd640 1 -- 172.21.15.12:0/4252668011 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258761 (secure 0 0 0) 0x7f55f0062630 con 0x7f55dc0a32d0 2024-09-19T06:39:19.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:19.605 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-19T06:39:19.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 -- 172.21.15.12:0/4252668011 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f55dc0a32d0 msgr2=0x7f55dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f55dc0a32d0 0x7f55dc0a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f55f00fee70 tx=0x7f55e000b590 comp rx=0 tx=0).stop 2024-09-19T06:39:19.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 -- 172.21.15.12:0/4252668011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55f0102d30 msgr2=0x7f55f01985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:19.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55f0102d30 0x7f55f01985c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f55ec009230 tx=0x7f55ec004270 comp rx=0 tx=0).stop 2024-09-19T06:39:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 -- 172.21.15.12:0/4252668011 shutdown_connections 2024-09-19T06:39:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f55dc0a32d0 0x7f55dc0a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f01082a0 0x7f55f019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55f01036e0 0x7f55f0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 --2- 172.21.15.12:0/4252668011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55f0102d30 0x7f55f01985c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 -- 172.21.15.12:0/4252668011 >> 172.21.15.12:0/4252668011 conn(0x7f55f00fc7d0 msgr2=0x7f55f0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 -- 172.21.15.12:0/4252668011 shutdown_connections 2024-09-19T06:39:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:19.601+0000 7f55f7c15640 1 -- 172.21.15.12:0/4252668011 wait complete. 2024-09-19T06:39:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:19 smithi012 ceph-mon[30937]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T06:39:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:19 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:20.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:19 smithi016 ceph-mon[34911]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T06:39:20.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:20.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:20.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:20.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:20.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:19 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:20.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:19 smithi173 ceph-mon[35349]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T06:39:20.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:20.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:20.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:20.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:20.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:19 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' 2024-09-19T06:39:20.415 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-19T06:39:17.715853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657414,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":675,"num_read_kb":464,"num_write":423,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1182930,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378764,"kb_used_data":12876,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563060,"statfs":{"total":1151940427776,"available":1151552573440,"internally_reserved":0,"allocated":13185024,"data_stored":7225566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002578"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062049+0000","last_change":"2024-09-19T06:38:14.052943+0000","last_active":"2024-09-19T06:38:23.062049+0000","last_peered":"2024-09-19T06:38:23.062049+0000","last_clean":"2024-09-19T06:38:23.062049+0000","last_became_active":"2024-09-19T06:38:14.052054+0000","last_became_peered":"2024-09-19T06:38:14.052054+0000","last_unstale":"2024-09-19T06:38:23.062049+0000","last_undegraded":"2024-09-19T06:38:23.062049+0000","last_fullsized":"2024-09-19T06:38:23.062049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:28.898131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061619+0000","last_change":"2024-09-19T06:38:14.044916+0000","last_active":"2024-09-19T06:38:23.061619+0000","last_peered":"2024-09-19T06:38:23.061619+0000","last_clean":"2024-09-19T06:38:23.061619+0000","last_became_active":"2024-09-19T06:38:14.044596+0000","last_became_peered":"2024-09-19T06:38:14.044596+0000","last_unstale":"2024-09-19T06:38:23.061619+0000","last_undegraded":"2024-09-19T06:38:23.061619+0000","last_fullsized":"2024-09-19T06:38:23.061619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:04.402332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061792+0000","last_change":"2024-09-19T06:38:14.052765+0000","last_active":"2024-09-19T06:38:23.061792+0000","last_peered":"2024-09-19T06:38:23.061792+0000","last_clean":"2024-09-19T06:38:23.061792+0000","last_became_active":"2024-09-19T06:38:14.052219+0000","last_became_peered":"2024-09-19T06:38:14.052219+0000","last_unstale":"2024-09-19T06:38:23.061792+0000","last_undegraded":"2024-09-19T06:38:23.061792+0000","last_fullsized":"2024-09-19T06:38:23.061792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:13.317252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176087+0000","last_change":"2024-09-19T06:38:14.052421+0000","last_active":"2024-09-19T06:38:23.176087+0000","last_peered":"2024-09-19T06:38:23.176087+0000","last_clean":"2024-09-19T06:38:23.176087+0000","last_became_active":"2024-09-19T06:38:14.052094+0000","last_became_peered":"2024-09-19T06:38:14.052094+0000","last_unstale":"2024-09-19T06:38:23.176087+0000","last_undegraded":"2024-09-19T06:38:23.176087+0000","last_fullsized":"2024-09-19T06:38:23.176087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062049+0000","last_change":"2024-09-19T06:38:14.047736+0000","last_active":"2024-09-19T06:38:23.062049+0000","last_peered":"2024-09-19T06:38:23.062049+0000","last_clean":"2024-09-19T06:38:23.062049+0000","last_became_active":"2024-09-19T06:38:14.047396+0000","last_became_peered":"2024-09-19T06:38:14.047396+0000","last_unstale":"2024-09-19T06:38:23.062049+0000","last_undegraded":"2024-09-19T06:38:23.062049+0000","last_fullsized":"2024-09-19T06:38:23.062049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.855638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062689+0000","last_change":"2024-09-19T06:38:14.047793+0000","last_active":"2024-09-19T06:38:23.062689+0000","last_peered":"2024-09-19T06:38:23.062689+0000","last_clean":"2024-09-19T06:38:23.062689+0000","last_became_active":"2024-09-19T06:38:14.047198+0000","last_became_peered":"2024-09-19T06:38:14.047198+0000","last_unstale":"2024-09-19T06:38:23.062689+0000","last_undegraded":"2024-09-19T06:38:23.062689+0000","last_fullsized":"2024-09-19T06:38:23.062689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:42.507270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059759+0000","last_change":"2024-09-19T06:38:14.050025+0000","last_active":"2024-09-19T06:38:23.059759+0000","last_peered":"2024-09-19T06:38:23.059759+0000","last_clean":"2024-09-19T06:38:23.059759+0000","last_became_active":"2024-09-19T06:38:14.049591+0000","last_became_peered":"2024-09-19T06:38:14.049591+0000","last_unstale":"2024-09-19T06:38:23.059759+0000","last_undegraded":"2024-09-19T06:38:23.059759+0000","last_fullsized":"2024-09-19T06:38:23.059759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:49.487521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066039+0000","last_change":"2024-09-19T06:38:23.065490+0000","last_active":"2024-09-19T06:38:23.066039+0000","last_peered":"2024-09-19T06:38:23.066039+0000","last_clean":"2024-09-19T06:38:23.066039+0000","last_became_active":"2024-09-19T06:38:23.065151+0000","last_became_peered":"2024-09-19T06:38:23.065151+0000","last_unstale":"2024-09-19T06:38:23.066039+0000","last_undegraded":"2024-09-19T06:38:23.066039+0000","last_fullsized":"2024-09-19T06:38:23.066039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:42.184698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066896+0000","last_change":"2024-09-19T06:38:14.047395+0000","last_active":"2024-09-19T06:38:23.066896+0000","last_peered":"2024-09-19T06:38:23.066896+0000","last_clean":"2024-09-19T06:38:23.066896+0000","last_became_active":"2024-09-19T06:38:14.046975+0000","last_became_peered":"2024-09-19T06:38:14.046975+0000","last_unstale":"2024-09-19T06:38:23.066896+0000","last_undegraded":"2024-09-19T06:38:23.066896+0000","last_fullsized":"2024-09-19T06:38:23.066896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:18.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063290+0000","last_change":"2024-09-19T06:38:14.055042+0000","last_active":"2024-09-19T06:38:23.063290+0000","last_peered":"2024-09-19T06:38:23.063290+0000","last_clean":"2024-09-19T06:38:23.063290+0000","last_became_active":"2024-09-19T06:38:14.054664+0000","last_became_peered":"2024-09-19T06:38:14.054664+0000","last_unstale":"2024-09-19T06:38:23.063290+0000","last_undegraded":"2024-09-19T06:38:23.063290+0000","last_fullsized":"2024-09-19T06:38:23.063290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.815277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060084+0000","last_change":"2024-09-19T06:38:14.055106+0000","last_active":"2024-09-19T06:38:23.060084+0000","last_peered":"2024-09-19T06:38:23.060084+0000","last_clean":"2024-09-19T06:38:23.060084+0000","last_became_active":"2024-09-19T06:38:14.054721+0000","last_became_peered":"2024-09-19T06:38:14.054721+0000","last_unstale":"2024-09-19T06:38:23.060084+0000","last_undegraded":"2024-09-19T06:38:23.060084+0000","last_fullsized":"2024-09-19T06:38:23.060084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:39.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176197+0000","last_change":"2024-09-19T06:38:14.051796+0000","last_active":"2024-09-19T06:38:23.176197+0000","last_peered":"2024-09-19T06:38:23.176197+0000","last_clean":"2024-09-19T06:38:23.176197+0000","last_became_active":"2024-09-19T06:38:14.048338+0000","last_became_peered":"2024-09-19T06:38:14.048338+0000","last_unstale":"2024-09-19T06:38:23.176197+0000","last_undegraded":"2024-09-19T06:38:23.176197+0000","last_fullsized":"2024-09-19T06:38:23.176197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:48.656819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174656+0000","last_change":"2024-09-19T06:38:14.048607+0000","last_active":"2024-09-19T06:38:23.174656+0000","last_peered":"2024-09-19T06:38:23.174656+0000","last_clean":"2024-09-19T06:38:23.174656+0000","last_became_active":"2024-09-19T06:38:14.047277+0000","last_became_peered":"2024-09-19T06:38:14.047277+0000","last_unstale":"2024-09-19T06:38:23.174656+0000","last_undegraded":"2024-09-19T06:38:23.174656+0000","last_fullsized":"2024-09-19T06:38:23.174656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:52.904376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061453+0000","last_change":"2024-09-19T06:38:14.050759+0000","last_active":"2024-09-19T06:38:23.061453+0000","last_peered":"2024-09-19T06:38:23.061453+0000","last_clean":"2024-09-19T06:38:23.061453+0000","last_became_active":"2024-09-19T06:38:14.049900+0000","last_became_peered":"2024-09-19T06:38:14.049900+0000","last_unstale":"2024-09-19T06:38:23.061453+0000","last_undegraded":"2024-09-19T06:38:23.061453+0000","last_fullsized":"2024-09-19T06:38:23.061453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:45.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061420+0000","last_change":"2024-09-19T06:38:14.058890+0000","last_active":"2024-09-19T06:38:23.061420+0000","last_peered":"2024-09-19T06:38:23.061420+0000","last_clean":"2024-09-19T06:38:23.061420+0000","last_became_active":"2024-09-19T06:38:14.058442+0000","last_became_peered":"2024-09-19T06:38:14.058442+0000","last_unstale":"2024-09-19T06:38:23.061420+0000","last_undegraded":"2024-09-19T06:38:23.061420+0000","last_fullsized":"2024-09-19T06:38:23.061420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:27.296578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066180+0000","last_change":"2024-09-19T06:38:14.050371+0000","last_active":"2024-09-19T06:38:23.066180+0000","last_peered":"2024-09-19T06:38:23.066180+0000","last_clean":"2024-09-19T06:38:23.066180+0000","last_became_active":"2024-09-19T06:38:14.049930+0000","last_became_peered":"2024-09-19T06:38:14.049930+0000","last_unstale":"2024-09-19T06:38:23.066180+0000","last_undegraded":"2024-09-19T06:38:23.066180+0000","last_fullsized":"2024-09-19T06:38:23.066180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:37.898624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062160+0000","last_change":"2024-09-19T06:38:14.052521+0000","last_active":"2024-09-19T06:38:23.062160+0000","last_peered":"2024-09-19T06:38:23.062160+0000","last_clean":"2024-09-19T06:38:23.062160+0000","last_became_active":"2024-09-19T06:38:14.052083+0000","last_became_peered":"2024-09-19T06:38:14.052083+0000","last_unstale":"2024-09-19T06:38:23.062160+0000","last_undegraded":"2024-09-19T06:38:23.062160+0000","last_fullsized":"2024-09-19T06:38:23.062160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:10.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059333+0000","last_change":"2024-09-19T06:38:14.044747+0000","last_active":"2024-09-19T06:38:23.059333+0000","last_peered":"2024-09-19T06:38:23.059333+0000","last_clean":"2024-09-19T06:38:23.059333+0000","last_became_active":"2024-09-19T06:38:14.044451+0000","last_became_peered":"2024-09-19T06:38:14.044451+0000","last_unstale":"2024-09-19T06:38:23.059333+0000","last_undegraded":"2024-09-19T06:38:23.059333+0000","last_fullsized":"2024-09-19T06:38:23.059333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:04.067156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067040+0000","last_change":"2024-09-19T06:38:14.056101+0000","last_active":"2024-09-19T06:38:23.067040+0000","last_peered":"2024-09-19T06:38:23.067040+0000","last_clean":"2024-09-19T06:38:23.067040+0000","last_became_active":"2024-09-19T06:38:14.055682+0000","last_became_peered":"2024-09-19T06:38:14.055682+0000","last_unstale":"2024-09-19T06:38:23.067040+0000","last_undegraded":"2024-09-19T06:38:23.067040+0000","last_fullsized":"2024-09-19T06:38:23.067040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:23.921766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061285+0000","last_change":"2024-09-19T06:38:14.059441+0000","last_active":"2024-09-19T06:38:23.061285+0000","last_peered":"2024-09-19T06:38:23.061285+0000","last_clean":"2024-09-19T06:38:23.061285+0000","last_became_active":"2024-09-19T06:38:14.059123+0000","last_became_peered":"2024-09-19T06:38:14.059123+0000","last_unstale":"2024-09-19T06:38:23.061285+0000","last_undegraded":"2024-09-19T06:38:23.061285+0000","last_fullsized":"2024-09-19T06:38:23.061285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:32.148741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174697+0000","last_change":"2024-09-19T06:38:14.050336+0000","last_active":"2024-09-19T06:38:23.174697+0000","last_peered":"2024-09-19T06:38:23.174697+0000","last_clean":"2024-09-19T06:38:23.174697+0000","last_became_active":"2024-09-19T06:38:14.050041+0000","last_became_peered":"2024-09-19T06:38:14.050041+0000","last_unstale":"2024-09-19T06:38:23.174697+0000","last_undegraded":"2024-09-19T06:38:23.174697+0000","last_fullsized":"2024-09-19T06:38:23.174697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:09.245804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066396+0000","last_change":"2024-09-19T06:38:14.050280+0000","last_active":"2024-09-19T06:38:23.066396+0000","last_peered":"2024-09-19T06:38:23.066396+0000","last_clean":"2024-09-19T06:38:23.066396+0000","last_became_active":"2024-09-19T06:38:14.049874+0000","last_became_peered":"2024-09-19T06:38:14.049874+0000","last_unstale":"2024-09-19T06:38:23.066396+0000","last_undegraded":"2024-09-19T06:38:23.066396+0000","last_fullsized":"2024-09-19T06:38:23.066396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:52.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.809784+0000","last_change":"2024-09-19T06:38:14.048294+0000","last_active":"2024-09-19T06:38:23.809784+0000","last_peered":"2024-09-19T06:38:23.809784+0000","last_clean":"2024-09-19T06:38:23.809784+0000","last_became_active":"2024-09-19T06:38:14.048002+0000","last_became_peered":"2024-09-19T06:38:14.048002+0000","last_unstale":"2024-09-19T06:38:23.809784+0000","last_undegraded":"2024-09-19T06:38:23.809784+0000","last_fullsized":"2024-09-19T06:38:23.809784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:55.920027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062988+0000","last_change":"2024-09-19T06:38:14.050244+0000","last_active":"2024-09-19T06:38:23.062988+0000","last_peered":"2024-09-19T06:38:23.062988+0000","last_clean":"2024-09-19T06:38:23.062988+0000","last_became_active":"2024-09-19T06:38:14.049499+0000","last_became_peered":"2024-09-19T06:38:14.049499+0000","last_unstale":"2024-09-19T06:38:23.062988+0000","last_undegraded":"2024-09-19T06:38:23.062988+0000","last_fullsized":"2024-09-19T06:38:23.062988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:35.506647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810013+0000","last_change":"2024-09-19T06:38:14.048779+0000","last_active":"2024-09-19T06:38:23.810013+0000","last_peered":"2024-09-19T06:38:23.810013+0000","last_clean":"2024-09-19T06:38:23.810013+0000","last_became_active":"2024-09-19T06:38:14.048492+0000","last_became_peered":"2024-09-19T06:38:14.048492+0000","last_unstale":"2024-09-19T06:38:23.810013+0000","last_undegraded":"2024-09-19T06:38:23.810013+0000","last_fullsized":"2024-09-19T06:38:23.810013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:01.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067146+0000","last_change":"2024-09-19T06:38:14.054442+0000","last_active":"2024-09-19T06:38:23.067146+0000","last_peered":"2024-09-19T06:38:23.067146+0000","last_clean":"2024-09-19T06:38:23.067146+0000","last_became_active":"2024-09-19T06:38:14.053903+0000","last_became_peered":"2024-09-19T06:38:14.053903+0000","last_unstale":"2024-09-19T06:38:23.067146+0000","last_undegraded":"2024-09-19T06:38:23.067146+0000","last_fullsized":"2024-09-19T06:38:23.067146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:42.002146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061889+0000","last_change":"2024-09-19T06:38:14.051139+0000","last_active":"2024-09-19T06:38:23.061889+0000","last_peered":"2024-09-19T06:38:23.061889+0000","last_clean":"2024-09-19T06:38:23.061889+0000","last_became_active":"2024-09-19T06:38:14.050764+0000","last_became_peered":"2024-09-19T06:38:14.050764+0000","last_unstale":"2024-09-19T06:38:23.061889+0000","last_undegraded":"2024-09-19T06:38:23.061889+0000","last_fullsized":"2024-09-19T06:38:23.061889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.379184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174574+0000","last_change":"2024-09-19T06:38:14.054614+0000","last_active":"2024-09-19T06:38:23.174574+0000","last_peered":"2024-09-19T06:38:23.174574+0000","last_clean":"2024-09-19T06:38:23.174574+0000","last_became_active":"2024-09-19T06:38:14.054280+0000","last_became_peered":"2024-09-19T06:38:14.054280+0000","last_unstale":"2024-09-19T06:38:23.174574+0000","last_undegraded":"2024-09-19T06:38:23.174574+0000","last_fullsized":"2024-09-19T06:38:23.174574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:21.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061680+0000","last_change":"2024-09-19T06:38:14.056215+0000","last_active":"2024-09-19T06:38:23.061680+0000","last_peered":"2024-09-19T06:38:23.061680+0000","last_clean":"2024-09-19T06:38:23.061680+0000","last_became_active":"2024-09-19T06:38:14.055875+0000","last_became_peered":"2024-09-19T06:38:14.055875+0000","last_unstale":"2024-09-19T06:38:23.061680+0000","last_undegraded":"2024-09-19T06:38:23.061680+0000","last_fullsized":"2024-09-19T06:38:23.061680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:45.347185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066728+0000","last_change":"2024-09-19T06:38:14.057963+0000","last_active":"2024-09-19T06:38:23.066728+0000","last_peered":"2024-09-19T06:38:23.066728+0000","last_clean":"2024-09-19T06:38:23.066728+0000","last_became_active":"2024-09-19T06:38:14.057578+0000","last_became_peered":"2024-09-19T06:38:14.057578+0000","last_unstale":"2024-09-19T06:38:23.066728+0000","last_undegraded":"2024-09-19T06:38:23.066728+0000","last_fullsized":"2024-09-19T06:38:23.066728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:26.173414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066558+0000","last_change":"2024-09-19T06:38:14.058840+0000","last_active":"2024-09-19T06:38:23.066558+0000","last_peered":"2024-09-19T06:38:23.066558+0000","last_clean":"2024-09-19T06:38:23.066558+0000","last_became_active":"2024-09-19T06:38:14.058418+0000","last_became_peered":"2024-09-19T06:38:14.058418+0000","last_unstale":"2024-09-19T06:38:23.066558+0000","last_undegraded":"2024-09-19T06:38:23.066558+0000","last_fullsized":"2024-09-19T06:38:23.066558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:13.624750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061748+0000","last_change":"2024-09-19T06:38:14.053363+0000","last_active":"2024-09-19T06:38:23.061748+0000","last_peered":"2024-09-19T06:38:23.061748+0000","last_clean":"2024-09-19T06:38:23.061748+0000","last_became_active":"2024-09-19T06:38:14.053039+0000","last_became_peered":"2024-09-19T06:38:14.053039+0000","last_unstale":"2024-09-19T06:38:23.061748+0000","last_undegraded":"2024-09-19T06:38:23.061748+0000","last_fullsized":"2024-09-19T06:38:23.061748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.274885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062028+0000","last_change":"2024-09-19T06:38:14.045719+0000","last_active":"2024-09-19T06:38:23.062028+0000","last_peered":"2024-09-19T06:38:23.062028+0000","last_clean":"2024-09-19T06:38:23.062028+0000","last_became_active":"2024-09-19T06:38:14.045285+0000","last_became_peered":"2024-09-19T06:38:14.045285+0000","last_unstale":"2024-09-19T06:38:23.062028+0000","last_undegraded":"2024-09-19T06:38:23.062028+0000","last_fullsized":"2024-09-19T06:38:23.062028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:16.877802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:11.725485+0000","last_change":"2024-09-19T06:38:23.177942+0000","last_active":"2024-09-19T06:39:11.725485+0000","last_peered":"2024-09-19T06:39:11.725485+0000","last_clean":"2024-09-19T06:39:11.725485+0000","last_became_active":"2024-09-19T06:38:23.176579+0000","last_became_peered":"2024-09-19T06:38:23.176579+0000","last_unstale":"2024-09-19T06:39:11.725485+0000","last_undegraded":"2024-09-19T06:39:11.725485+0000","last_fullsized":"2024-09-19T06:39:11.725485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:28.140245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.811603+0000","last_change":"2024-09-19T06:38:23.811603+0000","last_active":"2024-09-19T06:38:23.811603+0000","last_peered":"2024-09-19T06:38:23.811603+0000","last_clean":"2024-09-19T06:38:23.811603+0000","last_became_active":"2024-09-19T06:38:23.811139+0000","last_became_peered":"2024-09-19T06:38:23.811139+0000","last_unstale":"2024-09-19T06:38:23.811603+0000","last_undegraded":"2024-09-19T06:38:23.811603+0000","last_fullsized":"2024-09-19T06:38:23.811603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:42.082355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667648+0000","last_change":"2024-09-19T06:38:12.041330+0000","last_active":"2024-09-19T06:38:24.667648+0000","last_peered":"2024-09-19T06:38:24.667648+0000","last_clean":"2024-09-19T06:38:24.667648+0000","last_became_active":"2024-09-19T06:38:12.040992+0000","last_became_peered":"2024-09-19T06:38:12.040992+0000","last_unstale":"2024-09-19T06:38:24.667648+0000","last_undegraded":"2024-09-19T06:38:24.667648+0000","last_fullsized":"2024-09-19T06:38:24.667648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:51.721009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.079837+0000","last_change":"2024-09-19T06:38:12.034534+0000","last_active":"2024-09-19T06:38:24.079837+0000","last_peered":"2024-09-19T06:38:24.079837+0000","last_clean":"2024-09-19T06:38:24.079837+0000","last_became_active":"2024-09-19T06:38:12.034209+0000","last_became_peered":"2024-09-19T06:38:12.034209+0000","last_unstale":"2024-09-19T06:38:24.079837+0000","last_undegraded":"2024-09-19T06:38:24.079837+0000","last_fullsized":"2024-09-19T06:38:24.079837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:40.640464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.809975+0000","last_change":"2024-09-19T06:38:14.043287+0000","last_active":"2024-09-19T06:38:23.809975+0000","last_peered":"2024-09-19T06:38:23.809975+0000","last_clean":"2024-09-19T06:38:23.809975+0000","last_became_active":"2024-09-19T06:38:14.042565+0000","last_became_peered":"2024-09-19T06:38:14.042565+0000","last_unstale":"2024-09-19T06:38:23.809975+0000","last_undegraded":"2024-09-19T06:38:23.809975+0000","last_fullsized":"2024-09-19T06:38:23.809975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:32.689929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.671515+0000","last_change":"2024-09-19T06:38:12.039142+0000","last_active":"2024-09-19T06:38:25.671515+0000","last_peered":"2024-09-19T06:38:25.671515+0000","last_clean":"2024-09-19T06:38:25.671515+0000","last_became_active":"2024-09-19T06:38:12.038815+0000","last_became_peered":"2024-09-19T06:38:12.038815+0000","last_unstale":"2024-09-19T06:38:25.671515+0000","last_undegraded":"2024-09-19T06:38:25.671515+0000","last_fullsized":"2024-09-19T06:38:25.671515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:03.316742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059107+0000","last_change":"2024-09-19T06:38:14.044778+0000","last_active":"2024-09-19T06:38:23.059107+0000","last_peered":"2024-09-19T06:38:23.059107+0000","last_clean":"2024-09-19T06:38:23.059107+0000","last_became_active":"2024-09-19T06:38:14.044457+0000","last_became_peered":"2024-09-19T06:38:14.044457+0000","last_unstale":"2024-09-19T06:38:23.059107+0000","last_undegraded":"2024-09-19T06:38:23.059107+0000","last_fullsized":"2024-09-19T06:38:23.059107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:06.342070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:14.729121+0000","last_change":"2024-09-19T06:38:12.039031+0000","last_active":"2024-09-19T06:39:14.729121+0000","last_peered":"2024-09-19T06:39:14.729121+0000","last_clean":"2024-09-19T06:39:14.729121+0000","last_became_active":"2024-09-19T06:38:12.038346+0000","last_became_peered":"2024-09-19T06:38:12.038346+0000","last_unstale":"2024-09-19T06:39:14.729121+0000","last_undegraded":"2024-09-19T06:39:14.729121+0000","last_fullsized":"2024-09-19T06:39:14.729121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:33.752330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066715+0000","last_change":"2024-09-19T06:38:14.045159+0000","last_active":"2024-09-19T06:38:23.066715+0000","last_peered":"2024-09-19T06:38:23.066715+0000","last_clean":"2024-09-19T06:38:23.066715+0000","last_became_active":"2024-09-19T06:38:14.044822+0000","last_became_peered":"2024-09-19T06:38:14.044822+0000","last_unstale":"2024-09-19T06:38:23.066715+0000","last_undegraded":"2024-09-19T06:38:23.066715+0000","last_fullsized":"2024-09-19T06:38:23.066715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:05.143507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670553+0000","last_change":"2024-09-19T06:38:12.037820+0000","last_active":"2024-09-19T06:38:25.670553+0000","last_peered":"2024-09-19T06:38:25.670553+0000","last_clean":"2024-09-19T06:38:25.670553+0000","last_became_active":"2024-09-19T06:38:12.037417+0000","last_became_peered":"2024-09-19T06:38:12.037417+0000","last_unstale":"2024-09-19T06:38:25.670553+0000","last_undegraded":"2024-09-19T06:38:25.670553+0000","last_fullsized":"2024-09-19T06:38:25.670553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:22.516704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062170+0000","last_change":"2024-09-19T06:38:14.048633+0000","last_active":"2024-09-19T06:38:23.062170+0000","last_peered":"2024-09-19T06:38:23.062170+0000","last_clean":"2024-09-19T06:38:23.062170+0000","last_became_active":"2024-09-19T06:38:14.048257+0000","last_became_peered":"2024-09-19T06:38:14.048257+0000","last_unstale":"2024-09-19T06:38:23.062170+0000","last_undegraded":"2024-09-19T06:38:23.062170+0000","last_fullsized":"2024-09-19T06:38:23.062170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:16.509071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.657953+0000","last_change":"2024-09-19T06:38:12.047175+0000","last_active":"2024-09-19T06:38:24.657953+0000","last_peered":"2024-09-19T06:38:24.657953+0000","last_clean":"2024-09-19T06:38:24.657953+0000","last_became_active":"2024-09-19T06:38:12.046781+0000","last_became_peered":"2024-09-19T06:38:12.046781+0000","last_unstale":"2024-09-19T06:38:24.657953+0000","last_undegraded":"2024-09-19T06:38:24.657953+0000","last_fullsized":"2024-09-19T06:38:24.657953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:38.774803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067812+0000","last_change":"2024-09-19T06:38:23.067812+0000","last_active":"2024-09-19T06:38:23.067812+0000","last_peered":"2024-09-19T06:38:23.067812+0000","last_clean":"2024-09-19T06:38:23.067812+0000","last_became_active":"2024-09-19T06:38:23.067357+0000","last_became_peered":"2024-09-19T06:38:23.067357+0000","last_unstale":"2024-09-19T06:38:23.067812+0000","last_undegraded":"2024-09-19T06:38:23.067812+0000","last_fullsized":"2024-09-19T06:38:23.067812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:34.719243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'28","reported_seq":175,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:14.728787+0000","last_change":"2024-09-19T06:38:23.186703+0000","last_active":"2024-09-19T06:39:14.728787+0000","last_peered":"2024-09-19T06:39:14.728787+0000","last_clean":"2024-09-19T06:39:14.728787+0000","last_became_active":"2024-09-19T06:38:23.177212+0000","last_became_peered":"2024-09-19T06:38:23.177212+0000","last_unstale":"2024-09-19T06:39:14.728787+0000","last_undegraded":"2024-09-19T06:39:14.728787+0000","last_fullsized":"2024-09-19T06:39:14.728787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:46.884624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59211,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":111,"num_write":30,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063284+0000","last_change":"2024-09-19T06:38:14.054619+0000","last_active":"2024-09-19T06:38:23.063284+0000","last_peered":"2024-09-19T06:38:23.063284+0000","last_clean":"2024-09-19T06:38:23.063284+0000","last_became_active":"2024-09-19T06:38:14.054118+0000","last_became_peered":"2024-09-19T06:38:14.054118+0000","last_unstale":"2024-09-19T06:38:23.063284+0000","last_undegraded":"2024-09-19T06:38:23.063284+0000","last_fullsized":"2024-09-19T06:38:23.063284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:41.041603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.673593+0000","last_change":"2024-09-19T06:38:12.040272+0000","last_active":"2024-09-19T06:38:25.673593+0000","last_peered":"2024-09-19T06:38:25.673593+0000","last_clean":"2024-09-19T06:38:25.673593+0000","last_became_active":"2024-09-19T06:38:12.039940+0000","last_became_peered":"2024-09-19T06:38:12.039940+0000","last_unstale":"2024-09-19T06:38:25.673593+0000","last_undegraded":"2024-09-19T06:38:25.673593+0000","last_fullsized":"2024-09-19T06:38:25.673593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:53.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174406+0000","last_change":"2024-09-19T06:38:14.049535+0000","last_active":"2024-09-19T06:38:23.174406+0000","last_peered":"2024-09-19T06:38:23.174406+0000","last_clean":"2024-09-19T06:38:23.174406+0000","last_became_active":"2024-09-19T06:38:14.049208+0000","last_became_peered":"2024-09-19T06:38:14.049208+0000","last_unstale":"2024-09-19T06:38:23.174406+0000","last_undegraded":"2024-09-19T06:38:23.174406+0000","last_fullsized":"2024-09-19T06:38:23.174406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:03.359786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670196+0000","last_change":"2024-09-19T06:38:12.037346+0000","last_active":"2024-09-19T06:38:25.670196+0000","last_peered":"2024-09-19T06:38:25.670196+0000","last_clean":"2024-09-19T06:38:25.670196+0000","last_became_active":"2024-09-19T06:38:12.036986+0000","last_became_peered":"2024-09-19T06:38:12.036986+0000","last_unstale":"2024-09-19T06:38:25.670196+0000","last_undegraded":"2024-09-19T06:38:25.670196+0000","last_fullsized":"2024-09-19T06:38:25.670196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:26.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059848+0000","last_change":"2024-09-19T06:38:14.059454+0000","last_active":"2024-09-19T06:38:23.059848+0000","last_peered":"2024-09-19T06:38:23.059848+0000","last_clean":"2024-09-19T06:38:23.059848+0000","last_became_active":"2024-09-19T06:38:14.058996+0000","last_became_peered":"2024-09-19T06:38:14.058996+0000","last_unstale":"2024-09-19T06:38:23.059848+0000","last_undegraded":"2024-09-19T06:38:23.059848+0000","last_fullsized":"2024-09-19T06:38:23.059848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:54.645395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:13.727890+0000","last_change":"2024-09-19T06:38:12.043687+0000","last_active":"2024-09-19T06:39:13.727890+0000","last_peered":"2024-09-19T06:39:13.727890+0000","last_clean":"2024-09-19T06:39:13.727890+0000","last_became_active":"2024-09-19T06:38:12.043268+0000","last_became_peered":"2024-09-19T06:38:12.043268+0000","last_unstale":"2024-09-19T06:39:13.727890+0000","last_undegraded":"2024-09-19T06:39:13.727890+0000","last_fullsized":"2024-09-19T06:39:13.727890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:18.753736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059613+0000","last_change":"2024-09-19T06:38:14.052184+0000","last_active":"2024-09-19T06:38:23.059613+0000","last_peered":"2024-09-19T06:38:23.059613+0000","last_clean":"2024-09-19T06:38:23.059613+0000","last_became_active":"2024-09-19T06:38:14.051736+0000","last_became_peered":"2024-09-19T06:38:14.051736+0000","last_unstale":"2024-09-19T06:38:23.059613+0000","last_undegraded":"2024-09-19T06:38:23.059613+0000","last_fullsized":"2024-09-19T06:38:23.059613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:12.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667007+0000","last_change":"2024-09-19T06:38:12.048418+0000","last_active":"2024-09-19T06:38:24.667007+0000","last_peered":"2024-09-19T06:38:24.667007+0000","last_clean":"2024-09-19T06:38:24.667007+0000","last_became_active":"2024-09-19T06:38:12.047948+0000","last_became_peered":"2024-09-19T06:38:12.047948+0000","last_unstale":"2024-09-19T06:38:24.667007+0000","last_undegraded":"2024-09-19T06:38:24.667007+0000","last_fullsized":"2024-09-19T06:38:24.667007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:06.059904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176378+0000","last_change":"2024-09-19T06:38:23.175961+0000","last_active":"2024-09-19T06:38:23.176378+0000","last_peered":"2024-09-19T06:38:23.176378+0000","last_clean":"2024-09-19T06:38:23.176378+0000","last_became_active":"2024-09-19T06:38:23.175629+0000","last_became_peered":"2024-09-19T06:38:23.175629+0000","last_unstale":"2024-09-19T06:38:23.176378+0000","last_undegraded":"2024-09-19T06:38:23.176378+0000","last_fullsized":"2024-09-19T06:38:23.176378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.655577+0000","last_change":"2024-09-19T06:38:12.038945+0000","last_active":"2024-09-19T06:38:24.655577+0000","last_peered":"2024-09-19T06:38:24.655577+0000","last_clean":"2024-09-19T06:38:24.655577+0000","last_became_active":"2024-09-19T06:38:12.038571+0000","last_became_peered":"2024-09-19T06:38:12.038571+0000","last_unstale":"2024-09-19T06:38:24.655577+0000","last_undegraded":"2024-09-19T06:38:24.655577+0000","last_fullsized":"2024-09-19T06:38:24.655577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:57.887070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061540+0000","last_change":"2024-09-19T06:38:14.056481+0000","last_active":"2024-09-19T06:38:23.061540+0000","last_peered":"2024-09-19T06:38:23.061540+0000","last_clean":"2024-09-19T06:38:23.061540+0000","last_became_active":"2024-09-19T06:38:14.056177+0000","last_became_peered":"2024-09-19T06:38:14.056177+0000","last_unstale":"2024-09-19T06:38:23.061540+0000","last_undegraded":"2024-09-19T06:38:23.061540+0000","last_fullsized":"2024-09-19T06:38:23.061540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.734802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.668174+0000","last_change":"2024-09-19T06:38:12.038826+0000","last_active":"2024-09-19T06:38:25.668174+0000","last_peered":"2024-09-19T06:38:25.668174+0000","last_clean":"2024-09-19T06:38:25.668174+0000","last_became_active":"2024-09-19T06:38:12.038516+0000","last_became_peered":"2024-09-19T06:38:12.038516+0000","last_unstale":"2024-09-19T06:38:25.668174+0000","last_undegraded":"2024-09-19T06:38:25.668174+0000","last_fullsized":"2024-09-19T06:38:25.668174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:16.709742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060031+0000","last_change":"2024-09-19T06:38:14.053888+0000","last_active":"2024-09-19T06:38:23.060031+0000","last_peered":"2024-09-19T06:38:23.060031+0000","last_clean":"2024-09-19T06:38:23.060031+0000","last_became_active":"2024-09-19T06:38:14.053524+0000","last_became_peered":"2024-09-19T06:38:14.053524+0000","last_unstale":"2024-09-19T06:38:23.060031+0000","last_undegraded":"2024-09-19T06:38:23.060031+0000","last_fullsized":"2024-09-19T06:38:23.060031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:54.853786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667849+0000","last_change":"2024-09-19T06:38:12.040842+0000","last_active":"2024-09-19T06:38:24.667849+0000","last_peered":"2024-09-19T06:38:24.667849+0000","last_clean":"2024-09-19T06:38:24.667849+0000","last_became_active":"2024-09-19T06:38:12.040463+0000","last_became_peered":"2024-09-19T06:38:12.040463+0000","last_unstale":"2024-09-19T06:38:24.667849+0000","last_undegraded":"2024-09-19T06:38:24.667849+0000","last_fullsized":"2024-09-19T06:38:24.667849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:29.726632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060279+0000","last_change":"2024-09-19T06:38:14.052210+0000","last_active":"2024-09-19T06:38:23.060279+0000","last_peered":"2024-09-19T06:38:23.060279+0000","last_clean":"2024-09-19T06:38:23.060279+0000","last_became_active":"2024-09-19T06:38:14.051803+0000","last_became_peered":"2024-09-19T06:38:14.051803+0000","last_unstale":"2024-09-19T06:38:23.060279+0000","last_undegraded":"2024-09-19T06:38:23.060279+0000","last_fullsized":"2024-09-19T06:38:23.060279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:40.751672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:12.749954+0000","last_change":"2024-09-19T06:38:12.118077+0000","last_active":"2024-09-19T06:39:12.749954+0000","last_peered":"2024-09-19T06:39:12.749954+0000","last_clean":"2024-09-19T06:39:12.749954+0000","last_became_active":"2024-09-19T06:38:12.117690+0000","last_became_peered":"2024-09-19T06:38:12.117690+0000","last_unstale":"2024-09-19T06:39:12.749954+0000","last_undegraded":"2024-09-19T06:39:12.749954+0000","last_fullsized":"2024-09-19T06:39:12.749954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.828335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060217+0000","last_change":"2024-09-19T06:38:14.054014+0000","last_active":"2024-09-19T06:38:23.060217+0000","last_peered":"2024-09-19T06:38:23.060217+0000","last_clean":"2024-09-19T06:38:23.060217+0000","last_became_active":"2024-09-19T06:38:14.053349+0000","last_became_peered":"2024-09-19T06:38:14.053349+0000","last_unstale":"2024-09-19T06:38:23.060217+0000","last_undegraded":"2024-09-19T06:38:23.060217+0000","last_fullsized":"2024-09-19T06:38:23.060217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:40.117720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059973+0000","last_change":"2024-09-19T06:37:02.166696+0000","last_active":"2024-09-19T06:38:23.059973+0000","last_peered":"2024-09-19T06:38:23.059973+0000","last_clean":"2024-09-19T06:38:23.059973+0000","last_became_active":"2024-09-19T06:37:02.166225+0000","last_became_peered":"2024-09-19T06:37:02.166225+0000","last_unstale":"2024-09-19T06:38:23.059973+0000","last_undegraded":"2024-09-19T06:38:23.059973+0000","last_fullsized":"2024-09-19T06:38:23.059973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_clean_scrub_stamp":"2024-09-19T06:33:40.535354+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:46.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672803+0000","last_change":"2024-09-19T06:38:12.044465+0000","last_active":"2024-09-19T06:38:25.672803+0000","last_peered":"2024-09-19T06:38:25.672803+0000","last_clean":"2024-09-19T06:38:25.672803+0000","last_became_active":"2024-09-19T06:38:12.044042+0000","last_became_peered":"2024-09-19T06:38:12.044042+0000","last_unstale":"2024-09-19T06:38:25.672803+0000","last_undegraded":"2024-09-19T06:38:25.672803+0000","last_fullsized":"2024-09-19T06:38:25.672803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:40.759264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810103+0000","last_change":"2024-09-19T06:38:14.045102+0000","last_active":"2024-09-19T06:38:23.810103+0000","last_peered":"2024-09-19T06:38:23.810103+0000","last_clean":"2024-09-19T06:38:23.810103+0000","last_became_active":"2024-09-19T06:38:14.044785+0000","last_became_peered":"2024-09-19T06:38:14.044785+0000","last_unstale":"2024-09-19T06:38:23.810103+0000","last_undegraded":"2024-09-19T06:38:23.810103+0000","last_fullsized":"2024-09-19T06:38:23.810103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:57.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.079355+0000","last_change":"2024-09-19T06:38:12.040656+0000","last_active":"2024-09-19T06:38:24.079355+0000","last_peered":"2024-09-19T06:38:24.079355+0000","last_clean":"2024-09-19T06:38:24.079355+0000","last_became_active":"2024-09-19T06:38:12.040068+0000","last_became_peered":"2024-09-19T06:38:12.040068+0000","last_unstale":"2024-09-19T06:38:24.079355+0000","last_undegraded":"2024-09-19T06:38:24.079355+0000","last_fullsized":"2024-09-19T06:38:24.079355+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:33.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174396+0000","last_change":"2024-09-19T06:38:14.054623+0000","last_active":"2024-09-19T06:38:23.174396+0000","last_peered":"2024-09-19T06:38:23.174396+0000","last_clean":"2024-09-19T06:38:23.174396+0000","last_became_active":"2024-09-19T06:38:14.054124+0000","last_became_peered":"2024-09-19T06:38:14.054124+0000","last_unstale":"2024-09-19T06:38:23.174396+0000","last_undegraded":"2024-09-19T06:38:23.174396+0000","last_fullsized":"2024-09-19T06:38:23.174396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:33.251059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:14.728695+0000","last_change":"2024-09-19T06:38:12.047284+0000","last_active":"2024-09-19T06:39:14.728695+0000","last_peered":"2024-09-19T06:39:14.728695+0000","last_clean":"2024-09-19T06:39:14.728695+0000","last_became_active":"2024-09-19T06:38:12.046886+0000","last_became_peered":"2024-09-19T06:38:12.046886+0000","last_unstale":"2024-09-19T06:39:14.728695+0000","last_undegraded":"2024-09-19T06:39:14.728695+0000","last_fullsized":"2024-09-19T06:39:14.728695+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:15.030007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063722+0000","last_change":"2024-09-19T06:38:14.049351+0000","last_active":"2024-09-19T06:38:23.063722+0000","last_peered":"2024-09-19T06:38:23.063722+0000","last_clean":"2024-09-19T06:38:23.063722+0000","last_became_active":"2024-09-19T06:38:14.048792+0000","last_became_peered":"2024-09-19T06:38:14.048792+0000","last_unstale":"2024-09-19T06:38:23.063722+0000","last_undegraded":"2024-09-19T06:38:23.063722+0000","last_fullsized":"2024-09-19T06:38:23.063722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:30.431378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:12.745876+0000","last_change":"2024-09-19T06:38:12.037155+0000","last_active":"2024-09-19T06:39:12.745876+0000","last_peered":"2024-09-19T06:39:12.745876+0000","last_clean":"2024-09-19T06:39:12.745876+0000","last_became_active":"2024-09-19T06:38:12.036536+0000","last_became_peered":"2024-09-19T06:38:12.036536+0000","last_unstale":"2024-09-19T06:39:12.745876+0000","last_undegraded":"2024-09-19T06:39:12.745876+0000","last_fullsized":"2024-09-19T06:39:12.745876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:41.014783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062872+0000","last_change":"2024-09-19T06:38:14.055724+0000","last_active":"2024-09-19T06:38:23.062872+0000","last_peered":"2024-09-19T06:38:23.062872+0000","last_clean":"2024-09-19T06:38:23.062872+0000","last_became_active":"2024-09-19T06:38:14.054457+0000","last_became_peered":"2024-09-19T06:38:14.054457+0000","last_unstale":"2024-09-19T06:38:23.062872+0000","last_undegraded":"2024-09-19T06:38:23.062872+0000","last_fullsized":"2024-09-19T06:38:23.062872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:47.653709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059331+0000","last_change":"2024-09-19T06:38:12.049197+0000","last_active":"2024-09-19T06:38:23.059331+0000","last_peered":"2024-09-19T06:38:23.059331+0000","last_clean":"2024-09-19T06:38:23.059331+0000","last_became_active":"2024-09-19T06:38:12.048863+0000","last_became_peered":"2024-09-19T06:38:12.048863+0000","last_unstale":"2024-09-19T06:38:23.059331+0000","last_undegraded":"2024-09-19T06:38:23.059331+0000","last_fullsized":"2024-09-19T06:38:23.059331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:25.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063056+0000","last_change":"2024-09-19T06:38:14.042991+0000","last_active":"2024-09-19T06:38:23.063056+0000","last_peered":"2024-09-19T06:38:23.063056+0000","last_clean":"2024-09-19T06:38:23.063056+0000","last_became_active":"2024-09-19T06:38:14.042511+0000","last_became_peered":"2024-09-19T06:38:14.042511+0000","last_unstale":"2024-09-19T06:38:23.063056+0000","last_undegraded":"2024-09-19T06:38:23.063056+0000","last_fullsized":"2024-09-19T06:38:23.063056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:38.212838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.666253+0000","last_change":"2024-09-19T06:38:23.064456+0000","last_active":"2024-09-19T06:38:24.666253+0000","last_peered":"2024-09-19T06:38:24.666253+0000","last_clean":"2024-09-19T06:38:24.666253+0000","last_became_active":"2024-09-19T06:38:23.064051+0000","last_became_peered":"2024-09-19T06:38:23.064051+0000","last_unstale":"2024-09-19T06:38:24.666253+0000","last_undegraded":"2024-09-19T06:38:24.666253+0000","last_fullsized":"2024-09-19T06:38:24.666253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:58.548420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174635+0000","last_change":"2024-09-19T06:38:14.048612+0000","last_active":"2024-09-19T06:38:23.174635+0000","last_peered":"2024-09-19T06:38:23.174635+0000","last_clean":"2024-09-19T06:38:23.174635+0000","last_became_active":"2024-09-19T06:38:14.048294+0000","last_became_peered":"2024-09-19T06:38:14.048294+0000","last_unstale":"2024-09-19T06:38:23.174635+0000","last_undegraded":"2024-09-19T06:38:23.174635+0000","last_fullsized":"2024-09-19T06:38:23.174635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:55.892149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:39.054531+0000","last_change":"2024-09-19T06:38:12.035269+0000","last_active":"2024-09-19T06:38:39.054531+0000","last_peered":"2024-09-19T06:38:39.054531+0000","last_clean":"2024-09-19T06:38:39.054531+0000","last_became_active":"2024-09-19T06:38:12.034841+0000","last_became_peered":"2024-09-19T06:38:12.034841+0000","last_unstale":"2024-09-19T06:38:39.054531+0000","last_undegraded":"2024-09-19T06:38:39.054531+0000","last_fullsized":"2024-09-19T06:38:39.054531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:19.642572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810116+0000","last_change":"2024-09-19T06:38:14.052492+0000","last_active":"2024-09-19T06:38:23.810116+0000","last_peered":"2024-09-19T06:38:23.810116+0000","last_clean":"2024-09-19T06:38:23.810116+0000","last_became_active":"2024-09-19T06:38:14.052191+0000","last_became_peered":"2024-09-19T06:38:14.052191+0000","last_unstale":"2024-09-19T06:38:23.810116+0000","last_undegraded":"2024-09-19T06:38:23.810116+0000","last_fullsized":"2024-09-19T06:38:23.810116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:34.006480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670731+0000","last_change":"2024-09-19T06:38:12.118430+0000","last_active":"2024-09-19T06:38:25.670731+0000","last_peered":"2024-09-19T06:38:25.670731+0000","last_clean":"2024-09-19T06:38:25.670731+0000","last_became_active":"2024-09-19T06:38:12.118065+0000","last_became_peered":"2024-09-19T06:38:12.118065+0000","last_unstale":"2024-09-19T06:38:25.670731+0000","last_undegraded":"2024-09-19T06:38:25.670731+0000","last_fullsized":"2024-09-19T06:38:25.670731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:25.861922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.811305+0000","last_change":"2024-09-19T06:38:23.811305+0000","last_active":"2024-09-19T06:38:23.811305+0000","last_peered":"2024-09-19T06:38:23.811305+0000","last_clean":"2024-09-19T06:38:23.811305+0000","last_became_active":"2024-09-19T06:38:23.810840+0000","last_became_peered":"2024-09-19T06:38:23.810840+0000","last_unstale":"2024-09-19T06:38:23.811305+0000","last_undegraded":"2024-09-19T06:38:23.811305+0000","last_fullsized":"2024-09-19T06:38:23.811305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.019065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066057+0000","last_change":"2024-09-19T06:38:12.047670+0000","last_active":"2024-09-19T06:38:23.066057+0000","last_peered":"2024-09-19T06:38:23.066057+0000","last_clean":"2024-09-19T06:38:23.066057+0000","last_became_active":"2024-09-19T06:38:12.047312+0000","last_became_peered":"2024-09-19T06:38:12.047312+0000","last_unstale":"2024-09-19T06:38:23.066057+0000","last_undegraded":"2024-09-19T06:38:23.066057+0000","last_fullsized":"2024-09-19T06:38:23.066057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:47.477945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061871+0000","last_change":"2024-09-19T06:38:14.047210+0000","last_active":"2024-09-19T06:38:23.061871+0000","last_peered":"2024-09-19T06:38:23.061871+0000","last_clean":"2024-09-19T06:38:23.061871+0000","last_became_active":"2024-09-19T06:38:14.046836+0000","last_became_peered":"2024-09-19T06:38:14.046836+0000","last_unstale":"2024-09-19T06:38:23.061871+0000","last_undegraded":"2024-09-19T06:38:23.061871+0000","last_fullsized":"2024-09-19T06:38:23.061871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:14.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672539+0000","last_change":"2024-09-19T06:38:12.032692+0000","last_active":"2024-09-19T06:38:25.672539+0000","last_peered":"2024-09-19T06:38:25.672539+0000","last_clean":"2024-09-19T06:38:25.672539+0000","last_became_active":"2024-09-19T06:38:12.031874+0000","last_became_peered":"2024-09-19T06:38:12.031874+0000","last_unstale":"2024-09-19T06:38:25.672539+0000","last_undegraded":"2024-09-19T06:38:25.672539+0000","last_fullsized":"2024-09-19T06:38:25.672539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.787964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061862+0000","last_change":"2024-09-19T06:38:14.053504+0000","last_active":"2024-09-19T06:38:23.061862+0000","last_peered":"2024-09-19T06:38:23.061862+0000","last_clean":"2024-09-19T06:38:23.061862+0000","last_became_active":"2024-09-19T06:38:14.053148+0000","last_became_peered":"2024-09-19T06:38:14.053148+0000","last_unstale":"2024-09-19T06:38:23.061862+0000","last_undegraded":"2024-09-19T06:38:23.061862+0000","last_fullsized":"2024-09-19T06:38:23.061862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:29.809295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667656+0000","last_change":"2024-09-19T06:38:12.038884+0000","last_active":"2024-09-19T06:38:24.667656+0000","last_peered":"2024-09-19T06:38:24.667656+0000","last_clean":"2024-09-19T06:38:24.667656+0000","last_became_active":"2024-09-19T06:38:12.038532+0000","last_became_peered":"2024-09-19T06:38:12.038532+0000","last_unstale":"2024-09-19T06:38:24.667656+0000","last_undegraded":"2024-09-19T06:38:24.667656+0000","last_fullsized":"2024-09-19T06:38:24.667656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.348690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810045+0000","last_change":"2024-09-19T06:38:14.045761+0000","last_active":"2024-09-19T06:38:23.810045+0000","last_peered":"2024-09-19T06:38:23.810045+0000","last_clean":"2024-09-19T06:38:23.810045+0000","last_became_active":"2024-09-19T06:38:14.045467+0000","last_became_peered":"2024-09-19T06:38:14.045467+0000","last_unstale":"2024-09-19T06:38:23.810045+0000","last_undegraded":"2024-09-19T06:38:23.810045+0000","last_fullsized":"2024-09-19T06:38:23.810045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.917945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062222+0000","last_change":"2024-09-19T06:38:12.039546+0000","last_active":"2024-09-19T06:38:23.062222+0000","last_peered":"2024-09-19T06:38:23.062222+0000","last_clean":"2024-09-19T06:38:23.062222+0000","last_became_active":"2024-09-19T06:38:12.039130+0000","last_became_peered":"2024-09-19T06:38:12.039130+0000","last_unstale":"2024-09-19T06:38:23.062222+0000","last_undegraded":"2024-09-19T06:38:23.062222+0000","last_fullsized":"2024-09-19T06:38:23.062222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:43.200022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059825+0000","last_change":"2024-09-19T06:38:14.053935+0000","last_active":"2024-09-19T06:38:23.059825+0000","last_peered":"2024-09-19T06:38:23.059825+0000","last_clean":"2024-09-19T06:38:23.059825+0000","last_became_active":"2024-09-19T06:38:14.053542+0000","last_became_peered":"2024-09-19T06:38:14.053542+0000","last_unstale":"2024-09-19T06:38:23.059825+0000","last_undegraded":"2024-09-19T06:38:23.059825+0000","last_fullsized":"2024-09-19T06:38:23.059825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:25.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.177494+0000","last_change":"2024-09-19T06:38:23.177133+0000","last_active":"2024-09-19T06:38:23.177494+0000","last_peered":"2024-09-19T06:38:23.177494+0000","last_clean":"2024-09-19T06:38:23.177494+0000","last_became_active":"2024-09-19T06:38:23.176810+0000","last_became_peered":"2024-09-19T06:38:23.176810+0000","last_unstale":"2024-09-19T06:38:23.177494+0000","last_undegraded":"2024-09-19T06:38:23.177494+0000","last_fullsized":"2024-09-19T06:38:23.177494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:56.307720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672551+0000","last_change":"2024-09-19T06:38:12.042699+0000","last_active":"2024-09-19T06:38:25.672551+0000","last_peered":"2024-09-19T06:38:25.672551+0000","last_clean":"2024-09-19T06:38:25.672551+0000","last_became_active":"2024-09-19T06:38:12.042148+0000","last_became_peered":"2024-09-19T06:38:12.042148+0000","last_unstale":"2024-09-19T06:38:25.672551+0000","last_undegraded":"2024-09-19T06:38:25.672551+0000","last_fullsized":"2024-09-19T06:38:25.672551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.953596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066455+0000","last_change":"2024-09-19T06:38:14.043279+0000","last_active":"2024-09-19T06:38:23.066455+0000","last_peered":"2024-09-19T06:38:23.066455+0000","last_clean":"2024-09-19T06:38:23.066455+0000","last_became_active":"2024-09-19T06:38:14.042914+0000","last_became_peered":"2024-09-19T06:38:14.042914+0000","last_unstale":"2024-09-19T06:38:23.066455+0000","last_undegraded":"2024-09-19T06:38:23.066455+0000","last_fullsized":"2024-09-19T06:38:23.066455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:22.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:26.681663+0000","last_change":"2024-09-19T06:38:12.038683+0000","last_active":"2024-09-19T06:38:26.681663+0000","last_peered":"2024-09-19T06:38:26.681663+0000","last_clean":"2024-09-19T06:38:26.681663+0000","last_became_active":"2024-09-19T06:38:12.038342+0000","last_became_peered":"2024-09-19T06:38:12.038342+0000","last_unstale":"2024-09-19T06:38:26.681663+0000","last_undegraded":"2024-09-19T06:38:26.681663+0000","last_fullsized":"2024-09-19T06:38:26.681663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:07.091418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062167+0000","last_change":"2024-09-19T06:38:14.041552+0000","last_active":"2024-09-19T06:38:23.062167+0000","last_peered":"2024-09-19T06:38:23.062167+0000","last_clean":"2024-09-19T06:38:23.062167+0000","last_became_active":"2024-09-19T06:38:14.041187+0000","last_became_peered":"2024-09-19T06:38:14.041187+0000","last_unstale":"2024-09-19T06:38:23.062167+0000","last_undegraded":"2024-09-19T06:38:23.062167+0000","last_fullsized":"2024-09-19T06:38:23.062167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:17.390457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810276+0000","last_change":"2024-09-19T06:38:12.047436+0000","last_active":"2024-09-19T06:38:23.810276+0000","last_peered":"2024-09-19T06:38:23.810276+0000","last_clean":"2024-09-19T06:38:23.810276+0000","last_became_active":"2024-09-19T06:38:12.046961+0000","last_became_peered":"2024-09-19T06:38:12.046961+0000","last_unstale":"2024-09-19T06:38:23.810276+0000","last_undegraded":"2024-09-19T06:38:23.810276+0000","last_fullsized":"2024-09-19T06:38:23.810276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810051+0000","last_change":"2024-09-19T06:38:14.049660+0000","last_active":"2024-09-19T06:38:23.810051+0000","last_peered":"2024-09-19T06:38:23.810051+0000","last_clean":"2024-09-19T06:38:23.810051+0000","last_became_active":"2024-09-19T06:38:14.049375+0000","last_became_peered":"2024-09-19T06:38:14.049375+0000","last_unstale":"2024-09-19T06:38:23.810051+0000","last_undegraded":"2024-09-19T06:38:23.810051+0000","last_fullsized":"2024-09-19T06:38:23.810051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:08.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:13.746618+0000","last_change":"2024-09-19T06:38:23.071068+0000","last_active":"2024-09-19T06:39:13.746618+0000","last_peered":"2024-09-19T06:39:13.746618+0000","last_clean":"2024-09-19T06:39:13.746618+0000","last_became_active":"2024-09-19T06:38:23.067129+0000","last_became_peered":"2024-09-19T06:38:23.067129+0000","last_unstale":"2024-09-19T06:39:13.746618+0000","last_undegraded":"2024-09-19T06:39:13.746618+0000","last_fullsized":"2024-09-19T06:39:13.746618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:15.387758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66812,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":539,"num_read_kb":345,"num_write":240,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2194,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547226,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776158,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1613824,"data_stored":1089209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939684,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":438899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168616,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397549,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1032190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528371,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":439009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1544192,"data_stored":1031475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":498703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":438441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":439520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40472,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704680,"statfs":{"total":95995035648,"available":95953592320,"internally_reserved":0,"allocated":991232,"data_stored":499805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:39:20.419 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:39:20.678 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:20.983 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:20 smithi012 ceph-mon[30937]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:39:21.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:20 smithi016 ceph-mon[34911]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:39:21.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:20 smithi173 ceph-mon[35349]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:39:21.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.217+0000 7f131ec35640 1 -- 172.21.15.12:0/3152770618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f131810c1a0 msgr2=0x7f131810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.217+0000 7f131ec35640 1 --2- 172.21.15.12:0/3152770618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f131810c1a0 0x7f131810e610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1310009ca0 tx=0x7f131002a950 comp rx=0 tx=0).stop 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 -- 172.21.15.12:0/3152770618 shutdown_connections 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 --2- 172.21.15.12:0/3152770618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f131810c1a0 0x7f131810e610 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 --2- 172.21.15.12:0/3152770618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1318103720 0x7f131810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 --2- 172.21.15.12:0/3152770618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1318102e00 0x7f13181031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 -- 172.21.15.12:0/3152770618 >> 172.21.15.12:0/3152770618 conn(0x7f13180fc7a0 msgr2=0x7f13180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 -- 172.21.15.12:0/3152770618 shutdown_connections 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 -- 172.21.15.12:0/3152770618 wait complete. 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 Processor -- start 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 -- start start 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1318102e00 0x7f13181983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:21.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1318103720 0x7f1318198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.218+0000 7f131ec35640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f131810c1a0 0x7f131819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131ec35640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1318111f50 con 0x7f131810c1a0 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131ec35640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1318111dd0 con 0x7f1318103720 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131ec35640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f13181120d0 con 0x7f1318102e00 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131d1d2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f131810c1a0 0x7f131819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131d1d2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f131810c1a0 0x7f131819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58152/0 (socket says 172.21.15.12:58152) 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131d1d2640 1 -- 172.21.15.12:0/712291925 learned_addr learned my addr 172.21.15.12:0/712291925 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131c9d1640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1318102e00 0x7f13181983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f1317fff640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1318103720 0x7f1318198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131d1d2640 1 -- 172.21.15.12:0/712291925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1318102e00 msgr2=0x7f13181983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131d1d2640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1318102e00 0x7f13181983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131d1d2640 1 -- 172.21.15.12:0/712291925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1318103720 msgr2=0x7f1318198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131d1d2640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1318103720 0x7f1318198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131d1d2640 1 -- 172.21.15.12:0/712291925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131819d3a0 con 0x7f131810c1a0 2024-09-19T06:39:21.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f131d1d2640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f131810c1a0 0x7f131819ccc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1310004af0 tx=0x7f131002f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:21.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.219+0000 7f1315ffb640 1 -- 172.21.15.12:0/712291925 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310034040 con 0x7f131810c1a0 2024-09-19T06:39:21.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.220+0000 7f1315ffb640 1 -- 172.21.15.12:0/712291925 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1310030920 con 0x7f131810c1a0 2024-09-19T06:39:21.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.220+0000 7f1315ffb640 1 -- 172.21.15.12:0/712291925 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310004670 con 0x7f131810c1a0 2024-09-19T06:39:21.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.220+0000 7f131ec35640 1 -- 172.21.15.12:0/712291925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131819d630 con 0x7f131810c1a0 2024-09-19T06:39:21.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.220+0000 7f131ec35640 1 -- 172.21.15.12:0/712291925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131819dac0 con 0x7f131810c1a0 2024-09-19T06:39:21.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.221+0000 7f131ec35640 1 -- 172.21.15.12:0/712291925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13181031e0 con 0x7f131810c1a0 2024-09-19T06:39:21.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.223+0000 7f1315ffb640 1 -- 172.21.15.12:0/712291925 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1310037020 con 0x7f131810c1a0 2024-09-19T06:39:21.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.223+0000 7f1315ffb640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f13080a3350 0x7f13080a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:21.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.223+0000 7f131c9d1640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f13080a3350 0x7f13080a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:21.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.223+0000 7f1315ffb640 1 -- 172.21.15.12:0/712291925 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8269+0+0 (secure 0 0 0) 0x7f13100f0690 con 0x7f131810c1a0 2024-09-19T06:39:21.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.224+0000 7f131c9d1640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f13080a3350 0x7f13080a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f130c009bd0 tx=0x7f130c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:21.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.227+0000 7f1315ffb640 1 -- 172.21.15.12:0/712291925 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13100bd2e0 con 0x7f131810c1a0 2024-09-19T06:39:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.411+0000 7f131ec35640 1 -- 172.21.15.12:0/712291925 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1318062630 con 0x7f13080a3350 2024-09-19T06:39:21.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.417+0000 7f1315ffb640 1 -- 172.21.15.12:0/712291925 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258761 (secure 0 0 0) 0x7f1318062630 con 0x7f13080a3350 2024-09-19T06:39:21.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:21.422 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-19T06:39:21.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 -- 172.21.15.12:0/712291925 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f13080a3350 msgr2=0x7f13080a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f13080a3350 0x7f13080a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f130c009bd0 tx=0x7f130c005f90 comp rx=0 tx=0).stop 2024-09-19T06:39:21.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 -- 172.21.15.12:0/712291925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f131810c1a0 msgr2=0x7f131819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:21.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f131810c1a0 0x7f131819ccc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1310004af0 tx=0x7f131002f3a0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 -- 172.21.15.12:0/712291925 shutdown_connections 2024-09-19T06:39:21.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f13080a3350 0x7f13080a5810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f131810c1a0 0x7f131819ccc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1318103720 0x7f1318198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 --2- 172.21.15.12:0/712291925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1318102e00 0x7f13181983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 -- 172.21.15.12:0/712291925 >> 172.21.15.12:0/712291925 conn(0x7f13180fc7a0 msgr2=0x7f13180fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 -- 172.21.15.12:0/712291925 shutdown_connections 2024-09-19T06:39:21.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:21.420+0000 7f131ec35640 1 -- 172.21.15.12:0/712291925 wait complete. 2024-09-19T06:39:22.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:21 smithi016 ceph-mon[34911]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:22.059 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:21 smithi012 ceph-mon[30937]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:22.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:21 smithi173 ceph-mon[35349]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:22.088 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-19T06:39:19.716333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657414,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":690,"num_read_kb":464,"num_write":423,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1182930,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378764,"kb_used_data":12876,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563060,"statfs":{"total":1151940427776,"available":1151552573440,"internally_reserved":0,"allocated":13185024,"data_stored":7225566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002582"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062049+0000","last_change":"2024-09-19T06:38:14.052943+0000","last_active":"2024-09-19T06:38:23.062049+0000","last_peered":"2024-09-19T06:38:23.062049+0000","last_clean":"2024-09-19T06:38:23.062049+0000","last_became_active":"2024-09-19T06:38:14.052054+0000","last_became_peered":"2024-09-19T06:38:14.052054+0000","last_unstale":"2024-09-19T06:38:23.062049+0000","last_undegraded":"2024-09-19T06:38:23.062049+0000","last_fullsized":"2024-09-19T06:38:23.062049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:28.898131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061619+0000","last_change":"2024-09-19T06:38:14.044916+0000","last_active":"2024-09-19T06:38:23.061619+0000","last_peered":"2024-09-19T06:38:23.061619+0000","last_clean":"2024-09-19T06:38:23.061619+0000","last_became_active":"2024-09-19T06:38:14.044596+0000","last_became_peered":"2024-09-19T06:38:14.044596+0000","last_unstale":"2024-09-19T06:38:23.061619+0000","last_undegraded":"2024-09-19T06:38:23.061619+0000","last_fullsized":"2024-09-19T06:38:23.061619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:04.402332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061792+0000","last_change":"2024-09-19T06:38:14.052765+0000","last_active":"2024-09-19T06:38:23.061792+0000","last_peered":"2024-09-19T06:38:23.061792+0000","last_clean":"2024-09-19T06:38:23.061792+0000","last_became_active":"2024-09-19T06:38:14.052219+0000","last_became_peered":"2024-09-19T06:38:14.052219+0000","last_unstale":"2024-09-19T06:38:23.061792+0000","last_undegraded":"2024-09-19T06:38:23.061792+0000","last_fullsized":"2024-09-19T06:38:23.061792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:13.317252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176087+0000","last_change":"2024-09-19T06:38:14.052421+0000","last_active":"2024-09-19T06:38:23.176087+0000","last_peered":"2024-09-19T06:38:23.176087+0000","last_clean":"2024-09-19T06:38:23.176087+0000","last_became_active":"2024-09-19T06:38:14.052094+0000","last_became_peered":"2024-09-19T06:38:14.052094+0000","last_unstale":"2024-09-19T06:38:23.176087+0000","last_undegraded":"2024-09-19T06:38:23.176087+0000","last_fullsized":"2024-09-19T06:38:23.176087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062049+0000","last_change":"2024-09-19T06:38:14.047736+0000","last_active":"2024-09-19T06:38:23.062049+0000","last_peered":"2024-09-19T06:38:23.062049+0000","last_clean":"2024-09-19T06:38:23.062049+0000","last_became_active":"2024-09-19T06:38:14.047396+0000","last_became_peered":"2024-09-19T06:38:14.047396+0000","last_unstale":"2024-09-19T06:38:23.062049+0000","last_undegraded":"2024-09-19T06:38:23.062049+0000","last_fullsized":"2024-09-19T06:38:23.062049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.855638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062689+0000","last_change":"2024-09-19T06:38:14.047793+0000","last_active":"2024-09-19T06:38:23.062689+0000","last_peered":"2024-09-19T06:38:23.062689+0000","last_clean":"2024-09-19T06:38:23.062689+0000","last_became_active":"2024-09-19T06:38:14.047198+0000","last_became_peered":"2024-09-19T06:38:14.047198+0000","last_unstale":"2024-09-19T06:38:23.062689+0000","last_undegraded":"2024-09-19T06:38:23.062689+0000","last_fullsized":"2024-09-19T06:38:23.062689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:42.507270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059759+0000","last_change":"2024-09-19T06:38:14.050025+0000","last_active":"2024-09-19T06:38:23.059759+0000","last_peered":"2024-09-19T06:38:23.059759+0000","last_clean":"2024-09-19T06:38:23.059759+0000","last_became_active":"2024-09-19T06:38:14.049591+0000","last_became_peered":"2024-09-19T06:38:14.049591+0000","last_unstale":"2024-09-19T06:38:23.059759+0000","last_undegraded":"2024-09-19T06:38:23.059759+0000","last_fullsized":"2024-09-19T06:38:23.059759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:49.487521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066039+0000","last_change":"2024-09-19T06:38:23.065490+0000","last_active":"2024-09-19T06:38:23.066039+0000","last_peered":"2024-09-19T06:38:23.066039+0000","last_clean":"2024-09-19T06:38:23.066039+0000","last_became_active":"2024-09-19T06:38:23.065151+0000","last_became_peered":"2024-09-19T06:38:23.065151+0000","last_unstale":"2024-09-19T06:38:23.066039+0000","last_undegraded":"2024-09-19T06:38:23.066039+0000","last_fullsized":"2024-09-19T06:38:23.066039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:42.184698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066896+0000","last_change":"2024-09-19T06:38:14.047395+0000","last_active":"2024-09-19T06:38:23.066896+0000","last_peered":"2024-09-19T06:38:23.066896+0000","last_clean":"2024-09-19T06:38:23.066896+0000","last_became_active":"2024-09-19T06:38:14.046975+0000","last_became_peered":"2024-09-19T06:38:14.046975+0000","last_unstale":"2024-09-19T06:38:23.066896+0000","last_undegraded":"2024-09-19T06:38:23.066896+0000","last_fullsized":"2024-09-19T06:38:23.066896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:18.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063290+0000","last_change":"2024-09-19T06:38:14.055042+0000","last_active":"2024-09-19T06:38:23.063290+0000","last_peered":"2024-09-19T06:38:23.063290+0000","last_clean":"2024-09-19T06:38:23.063290+0000","last_became_active":"2024-09-19T06:38:14.054664+0000","last_became_peered":"2024-09-19T06:38:14.054664+0000","last_unstale":"2024-09-19T06:38:23.063290+0000","last_undegraded":"2024-09-19T06:38:23.063290+0000","last_fullsized":"2024-09-19T06:38:23.063290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.815277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060084+0000","last_change":"2024-09-19T06:38:14.055106+0000","last_active":"2024-09-19T06:38:23.060084+0000","last_peered":"2024-09-19T06:38:23.060084+0000","last_clean":"2024-09-19T06:38:23.060084+0000","last_became_active":"2024-09-19T06:38:14.054721+0000","last_became_peered":"2024-09-19T06:38:14.054721+0000","last_unstale":"2024-09-19T06:38:23.060084+0000","last_undegraded":"2024-09-19T06:38:23.060084+0000","last_fullsized":"2024-09-19T06:38:23.060084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:39.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176197+0000","last_change":"2024-09-19T06:38:14.051796+0000","last_active":"2024-09-19T06:38:23.176197+0000","last_peered":"2024-09-19T06:38:23.176197+0000","last_clean":"2024-09-19T06:38:23.176197+0000","last_became_active":"2024-09-19T06:38:14.048338+0000","last_became_peered":"2024-09-19T06:38:14.048338+0000","last_unstale":"2024-09-19T06:38:23.176197+0000","last_undegraded":"2024-09-19T06:38:23.176197+0000","last_fullsized":"2024-09-19T06:38:23.176197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:48.656819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174656+0000","last_change":"2024-09-19T06:38:14.048607+0000","last_active":"2024-09-19T06:38:23.174656+0000","last_peered":"2024-09-19T06:38:23.174656+0000","last_clean":"2024-09-19T06:38:23.174656+0000","last_became_active":"2024-09-19T06:38:14.047277+0000","last_became_peered":"2024-09-19T06:38:14.047277+0000","last_unstale":"2024-09-19T06:38:23.174656+0000","last_undegraded":"2024-09-19T06:38:23.174656+0000","last_fullsized":"2024-09-19T06:38:23.174656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:52.904376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061453+0000","last_change":"2024-09-19T06:38:14.050759+0000","last_active":"2024-09-19T06:38:23.061453+0000","last_peered":"2024-09-19T06:38:23.061453+0000","last_clean":"2024-09-19T06:38:23.061453+0000","last_became_active":"2024-09-19T06:38:14.049900+0000","last_became_peered":"2024-09-19T06:38:14.049900+0000","last_unstale":"2024-09-19T06:38:23.061453+0000","last_undegraded":"2024-09-19T06:38:23.061453+0000","last_fullsized":"2024-09-19T06:38:23.061453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:45.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061420+0000","last_change":"2024-09-19T06:38:14.058890+0000","last_active":"2024-09-19T06:38:23.061420+0000","last_peered":"2024-09-19T06:38:23.061420+0000","last_clean":"2024-09-19T06:38:23.061420+0000","last_became_active":"2024-09-19T06:38:14.058442+0000","last_became_peered":"2024-09-19T06:38:14.058442+0000","last_unstale":"2024-09-19T06:38:23.061420+0000","last_undegraded":"2024-09-19T06:38:23.061420+0000","last_fullsized":"2024-09-19T06:38:23.061420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:27.296578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066180+0000","last_change":"2024-09-19T06:38:14.050371+0000","last_active":"2024-09-19T06:38:23.066180+0000","last_peered":"2024-09-19T06:38:23.066180+0000","last_clean":"2024-09-19T06:38:23.066180+0000","last_became_active":"2024-09-19T06:38:14.049930+0000","last_became_peered":"2024-09-19T06:38:14.049930+0000","last_unstale":"2024-09-19T06:38:23.066180+0000","last_undegraded":"2024-09-19T06:38:23.066180+0000","last_fullsized":"2024-09-19T06:38:23.066180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:37.898624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062160+0000","last_change":"2024-09-19T06:38:14.052521+0000","last_active":"2024-09-19T06:38:23.062160+0000","last_peered":"2024-09-19T06:38:23.062160+0000","last_clean":"2024-09-19T06:38:23.062160+0000","last_became_active":"2024-09-19T06:38:14.052083+0000","last_became_peered":"2024-09-19T06:38:14.052083+0000","last_unstale":"2024-09-19T06:38:23.062160+0000","last_undegraded":"2024-09-19T06:38:23.062160+0000","last_fullsized":"2024-09-19T06:38:23.062160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:10.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059333+0000","last_change":"2024-09-19T06:38:14.044747+0000","last_active":"2024-09-19T06:38:23.059333+0000","last_peered":"2024-09-19T06:38:23.059333+0000","last_clean":"2024-09-19T06:38:23.059333+0000","last_became_active":"2024-09-19T06:38:14.044451+0000","last_became_peered":"2024-09-19T06:38:14.044451+0000","last_unstale":"2024-09-19T06:38:23.059333+0000","last_undegraded":"2024-09-19T06:38:23.059333+0000","last_fullsized":"2024-09-19T06:38:23.059333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:04.067156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067040+0000","last_change":"2024-09-19T06:38:14.056101+0000","last_active":"2024-09-19T06:38:23.067040+0000","last_peered":"2024-09-19T06:38:23.067040+0000","last_clean":"2024-09-19T06:38:23.067040+0000","last_became_active":"2024-09-19T06:38:14.055682+0000","last_became_peered":"2024-09-19T06:38:14.055682+0000","last_unstale":"2024-09-19T06:38:23.067040+0000","last_undegraded":"2024-09-19T06:38:23.067040+0000","last_fullsized":"2024-09-19T06:38:23.067040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:23.921766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061285+0000","last_change":"2024-09-19T06:38:14.059441+0000","last_active":"2024-09-19T06:38:23.061285+0000","last_peered":"2024-09-19T06:38:23.061285+0000","last_clean":"2024-09-19T06:38:23.061285+0000","last_became_active":"2024-09-19T06:38:14.059123+0000","last_became_peered":"2024-09-19T06:38:14.059123+0000","last_unstale":"2024-09-19T06:38:23.061285+0000","last_undegraded":"2024-09-19T06:38:23.061285+0000","last_fullsized":"2024-09-19T06:38:23.061285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:32.148741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174697+0000","last_change":"2024-09-19T06:38:14.050336+0000","last_active":"2024-09-19T06:38:23.174697+0000","last_peered":"2024-09-19T06:38:23.174697+0000","last_clean":"2024-09-19T06:38:23.174697+0000","last_became_active":"2024-09-19T06:38:14.050041+0000","last_became_peered":"2024-09-19T06:38:14.050041+0000","last_unstale":"2024-09-19T06:38:23.174697+0000","last_undegraded":"2024-09-19T06:38:23.174697+0000","last_fullsized":"2024-09-19T06:38:23.174697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:09.245804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066396+0000","last_change":"2024-09-19T06:38:14.050280+0000","last_active":"2024-09-19T06:38:23.066396+0000","last_peered":"2024-09-19T06:38:23.066396+0000","last_clean":"2024-09-19T06:38:23.066396+0000","last_became_active":"2024-09-19T06:38:14.049874+0000","last_became_peered":"2024-09-19T06:38:14.049874+0000","last_unstale":"2024-09-19T06:38:23.066396+0000","last_undegraded":"2024-09-19T06:38:23.066396+0000","last_fullsized":"2024-09-19T06:38:23.066396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:52.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.809784+0000","last_change":"2024-09-19T06:38:14.048294+0000","last_active":"2024-09-19T06:38:23.809784+0000","last_peered":"2024-09-19T06:38:23.809784+0000","last_clean":"2024-09-19T06:38:23.809784+0000","last_became_active":"2024-09-19T06:38:14.048002+0000","last_became_peered":"2024-09-19T06:38:14.048002+0000","last_unstale":"2024-09-19T06:38:23.809784+0000","last_undegraded":"2024-09-19T06:38:23.809784+0000","last_fullsized":"2024-09-19T06:38:23.809784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:55.920027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062988+0000","last_change":"2024-09-19T06:38:14.050244+0000","last_active":"2024-09-19T06:38:23.062988+0000","last_peered":"2024-09-19T06:38:23.062988+0000","last_clean":"2024-09-19T06:38:23.062988+0000","last_became_active":"2024-09-19T06:38:14.049499+0000","last_became_peered":"2024-09-19T06:38:14.049499+0000","last_unstale":"2024-09-19T06:38:23.062988+0000","last_undegraded":"2024-09-19T06:38:23.062988+0000","last_fullsized":"2024-09-19T06:38:23.062988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:35.506647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810013+0000","last_change":"2024-09-19T06:38:14.048779+0000","last_active":"2024-09-19T06:38:23.810013+0000","last_peered":"2024-09-19T06:38:23.810013+0000","last_clean":"2024-09-19T06:38:23.810013+0000","last_became_active":"2024-09-19T06:38:14.048492+0000","last_became_peered":"2024-09-19T06:38:14.048492+0000","last_unstale":"2024-09-19T06:38:23.810013+0000","last_undegraded":"2024-09-19T06:38:23.810013+0000","last_fullsized":"2024-09-19T06:38:23.810013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:01.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067146+0000","last_change":"2024-09-19T06:38:14.054442+0000","last_active":"2024-09-19T06:38:23.067146+0000","last_peered":"2024-09-19T06:38:23.067146+0000","last_clean":"2024-09-19T06:38:23.067146+0000","last_became_active":"2024-09-19T06:38:14.053903+0000","last_became_peered":"2024-09-19T06:38:14.053903+0000","last_unstale":"2024-09-19T06:38:23.067146+0000","last_undegraded":"2024-09-19T06:38:23.067146+0000","last_fullsized":"2024-09-19T06:38:23.067146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:42.002146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061889+0000","last_change":"2024-09-19T06:38:14.051139+0000","last_active":"2024-09-19T06:38:23.061889+0000","last_peered":"2024-09-19T06:38:23.061889+0000","last_clean":"2024-09-19T06:38:23.061889+0000","last_became_active":"2024-09-19T06:38:14.050764+0000","last_became_peered":"2024-09-19T06:38:14.050764+0000","last_unstale":"2024-09-19T06:38:23.061889+0000","last_undegraded":"2024-09-19T06:38:23.061889+0000","last_fullsized":"2024-09-19T06:38:23.061889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.379184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174574+0000","last_change":"2024-09-19T06:38:14.054614+0000","last_active":"2024-09-19T06:38:23.174574+0000","last_peered":"2024-09-19T06:38:23.174574+0000","last_clean":"2024-09-19T06:38:23.174574+0000","last_became_active":"2024-09-19T06:38:14.054280+0000","last_became_peered":"2024-09-19T06:38:14.054280+0000","last_unstale":"2024-09-19T06:38:23.174574+0000","last_undegraded":"2024-09-19T06:38:23.174574+0000","last_fullsized":"2024-09-19T06:38:23.174574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:21.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061680+0000","last_change":"2024-09-19T06:38:14.056215+0000","last_active":"2024-09-19T06:38:23.061680+0000","last_peered":"2024-09-19T06:38:23.061680+0000","last_clean":"2024-09-19T06:38:23.061680+0000","last_became_active":"2024-09-19T06:38:14.055875+0000","last_became_peered":"2024-09-19T06:38:14.055875+0000","last_unstale":"2024-09-19T06:38:23.061680+0000","last_undegraded":"2024-09-19T06:38:23.061680+0000","last_fullsized":"2024-09-19T06:38:23.061680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:45.347185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066728+0000","last_change":"2024-09-19T06:38:14.057963+0000","last_active":"2024-09-19T06:38:23.066728+0000","last_peered":"2024-09-19T06:38:23.066728+0000","last_clean":"2024-09-19T06:38:23.066728+0000","last_became_active":"2024-09-19T06:38:14.057578+0000","last_became_peered":"2024-09-19T06:38:14.057578+0000","last_unstale":"2024-09-19T06:38:23.066728+0000","last_undegraded":"2024-09-19T06:38:23.066728+0000","last_fullsized":"2024-09-19T06:38:23.066728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:26.173414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066558+0000","last_change":"2024-09-19T06:38:14.058840+0000","last_active":"2024-09-19T06:38:23.066558+0000","last_peered":"2024-09-19T06:38:23.066558+0000","last_clean":"2024-09-19T06:38:23.066558+0000","last_became_active":"2024-09-19T06:38:14.058418+0000","last_became_peered":"2024-09-19T06:38:14.058418+0000","last_unstale":"2024-09-19T06:38:23.066558+0000","last_undegraded":"2024-09-19T06:38:23.066558+0000","last_fullsized":"2024-09-19T06:38:23.066558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:13.624750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061748+0000","last_change":"2024-09-19T06:38:14.053363+0000","last_active":"2024-09-19T06:38:23.061748+0000","last_peered":"2024-09-19T06:38:23.061748+0000","last_clean":"2024-09-19T06:38:23.061748+0000","last_became_active":"2024-09-19T06:38:14.053039+0000","last_became_peered":"2024-09-19T06:38:14.053039+0000","last_unstale":"2024-09-19T06:38:23.061748+0000","last_undegraded":"2024-09-19T06:38:23.061748+0000","last_fullsized":"2024-09-19T06:38:23.061748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.274885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062028+0000","last_change":"2024-09-19T06:38:14.045719+0000","last_active":"2024-09-19T06:38:23.062028+0000","last_peered":"2024-09-19T06:38:23.062028+0000","last_clean":"2024-09-19T06:38:23.062028+0000","last_became_active":"2024-09-19T06:38:14.045285+0000","last_became_peered":"2024-09-19T06:38:14.045285+0000","last_unstale":"2024-09-19T06:38:23.062028+0000","last_undegraded":"2024-09-19T06:38:23.062028+0000","last_fullsized":"2024-09-19T06:38:23.062028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:16.877802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":91,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:16.732394+0000","last_change":"2024-09-19T06:38:23.177942+0000","last_active":"2024-09-19T06:39:16.732394+0000","last_peered":"2024-09-19T06:39:16.732394+0000","last_clean":"2024-09-19T06:39:16.732394+0000","last_became_active":"2024-09-19T06:38:23.176579+0000","last_became_peered":"2024-09-19T06:38:23.176579+0000","last_unstale":"2024-09-19T06:39:16.732394+0000","last_undegraded":"2024-09-19T06:39:16.732394+0000","last_fullsized":"2024-09-19T06:39:16.732394+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:28.140245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.811603+0000","last_change":"2024-09-19T06:38:23.811603+0000","last_active":"2024-09-19T06:38:23.811603+0000","last_peered":"2024-09-19T06:38:23.811603+0000","last_clean":"2024-09-19T06:38:23.811603+0000","last_became_active":"2024-09-19T06:38:23.811139+0000","last_became_peered":"2024-09-19T06:38:23.811139+0000","last_unstale":"2024-09-19T06:38:23.811603+0000","last_undegraded":"2024-09-19T06:38:23.811603+0000","last_fullsized":"2024-09-19T06:38:23.811603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:42.082355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667648+0000","last_change":"2024-09-19T06:38:12.041330+0000","last_active":"2024-09-19T06:38:24.667648+0000","last_peered":"2024-09-19T06:38:24.667648+0000","last_clean":"2024-09-19T06:38:24.667648+0000","last_became_active":"2024-09-19T06:38:12.040992+0000","last_became_peered":"2024-09-19T06:38:12.040992+0000","last_unstale":"2024-09-19T06:38:24.667648+0000","last_undegraded":"2024-09-19T06:38:24.667648+0000","last_fullsized":"2024-09-19T06:38:24.667648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:51.721009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.079837+0000","last_change":"2024-09-19T06:38:12.034534+0000","last_active":"2024-09-19T06:38:24.079837+0000","last_peered":"2024-09-19T06:38:24.079837+0000","last_clean":"2024-09-19T06:38:24.079837+0000","last_became_active":"2024-09-19T06:38:12.034209+0000","last_became_peered":"2024-09-19T06:38:12.034209+0000","last_unstale":"2024-09-19T06:38:24.079837+0000","last_undegraded":"2024-09-19T06:38:24.079837+0000","last_fullsized":"2024-09-19T06:38:24.079837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:40.640464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.809975+0000","last_change":"2024-09-19T06:38:14.043287+0000","last_active":"2024-09-19T06:38:23.809975+0000","last_peered":"2024-09-19T06:38:23.809975+0000","last_clean":"2024-09-19T06:38:23.809975+0000","last_became_active":"2024-09-19T06:38:14.042565+0000","last_became_peered":"2024-09-19T06:38:14.042565+0000","last_unstale":"2024-09-19T06:38:23.809975+0000","last_undegraded":"2024-09-19T06:38:23.809975+0000","last_fullsized":"2024-09-19T06:38:23.809975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:32.689929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.671515+0000","last_change":"2024-09-19T06:38:12.039142+0000","last_active":"2024-09-19T06:38:25.671515+0000","last_peered":"2024-09-19T06:38:25.671515+0000","last_clean":"2024-09-19T06:38:25.671515+0000","last_became_active":"2024-09-19T06:38:12.038815+0000","last_became_peered":"2024-09-19T06:38:12.038815+0000","last_unstale":"2024-09-19T06:38:25.671515+0000","last_undegraded":"2024-09-19T06:38:25.671515+0000","last_fullsized":"2024-09-19T06:38:25.671515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:03.316742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059107+0000","last_change":"2024-09-19T06:38:14.044778+0000","last_active":"2024-09-19T06:38:23.059107+0000","last_peered":"2024-09-19T06:38:23.059107+0000","last_clean":"2024-09-19T06:38:23.059107+0000","last_became_active":"2024-09-19T06:38:14.044457+0000","last_became_peered":"2024-09-19T06:38:14.044457+0000","last_unstale":"2024-09-19T06:38:23.059107+0000","last_undegraded":"2024-09-19T06:38:23.059107+0000","last_fullsized":"2024-09-19T06:38:23.059107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:06.342070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:14.729121+0000","last_change":"2024-09-19T06:38:12.039031+0000","last_active":"2024-09-19T06:39:14.729121+0000","last_peered":"2024-09-19T06:39:14.729121+0000","last_clean":"2024-09-19T06:39:14.729121+0000","last_became_active":"2024-09-19T06:38:12.038346+0000","last_became_peered":"2024-09-19T06:38:12.038346+0000","last_unstale":"2024-09-19T06:39:14.729121+0000","last_undegraded":"2024-09-19T06:39:14.729121+0000","last_fullsized":"2024-09-19T06:39:14.729121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:33.752330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066715+0000","last_change":"2024-09-19T06:38:14.045159+0000","last_active":"2024-09-19T06:38:23.066715+0000","last_peered":"2024-09-19T06:38:23.066715+0000","last_clean":"2024-09-19T06:38:23.066715+0000","last_became_active":"2024-09-19T06:38:14.044822+0000","last_became_peered":"2024-09-19T06:38:14.044822+0000","last_unstale":"2024-09-19T06:38:23.066715+0000","last_undegraded":"2024-09-19T06:38:23.066715+0000","last_fullsized":"2024-09-19T06:38:23.066715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:05.143507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670553+0000","last_change":"2024-09-19T06:38:12.037820+0000","last_active":"2024-09-19T06:38:25.670553+0000","last_peered":"2024-09-19T06:38:25.670553+0000","last_clean":"2024-09-19T06:38:25.670553+0000","last_became_active":"2024-09-19T06:38:12.037417+0000","last_became_peered":"2024-09-19T06:38:12.037417+0000","last_unstale":"2024-09-19T06:38:25.670553+0000","last_undegraded":"2024-09-19T06:38:25.670553+0000","last_fullsized":"2024-09-19T06:38:25.670553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:22.516704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062170+0000","last_change":"2024-09-19T06:38:14.048633+0000","last_active":"2024-09-19T06:38:23.062170+0000","last_peered":"2024-09-19T06:38:23.062170+0000","last_clean":"2024-09-19T06:38:23.062170+0000","last_became_active":"2024-09-19T06:38:14.048257+0000","last_became_peered":"2024-09-19T06:38:14.048257+0000","last_unstale":"2024-09-19T06:38:23.062170+0000","last_undegraded":"2024-09-19T06:38:23.062170+0000","last_fullsized":"2024-09-19T06:38:23.062170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:16.509071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.657953+0000","last_change":"2024-09-19T06:38:12.047175+0000","last_active":"2024-09-19T06:38:24.657953+0000","last_peered":"2024-09-19T06:38:24.657953+0000","last_clean":"2024-09-19T06:38:24.657953+0000","last_became_active":"2024-09-19T06:38:12.046781+0000","last_became_peered":"2024-09-19T06:38:12.046781+0000","last_unstale":"2024-09-19T06:38:24.657953+0000","last_undegraded":"2024-09-19T06:38:24.657953+0000","last_fullsized":"2024-09-19T06:38:24.657953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:38.774803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.067812+0000","last_change":"2024-09-19T06:38:23.067812+0000","last_active":"2024-09-19T06:38:23.067812+0000","last_peered":"2024-09-19T06:38:23.067812+0000","last_clean":"2024-09-19T06:38:23.067812+0000","last_became_active":"2024-09-19T06:38:23.067357+0000","last_became_peered":"2024-09-19T06:38:23.067357+0000","last_unstale":"2024-09-19T06:38:23.067812+0000","last_undegraded":"2024-09-19T06:38:23.067812+0000","last_fullsized":"2024-09-19T06:38:23.067812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:34.719243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'28","reported_seq":175,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:14.728787+0000","last_change":"2024-09-19T06:38:23.186703+0000","last_active":"2024-09-19T06:39:14.728787+0000","last_peered":"2024-09-19T06:39:14.728787+0000","last_clean":"2024-09-19T06:39:14.728787+0000","last_became_active":"2024-09-19T06:38:23.177212+0000","last_became_peered":"2024-09-19T06:38:23.177212+0000","last_unstale":"2024-09-19T06:39:14.728787+0000","last_undegraded":"2024-09-19T06:39:14.728787+0000","last_fullsized":"2024-09-19T06:39:14.728787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:46.884624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59211,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":111,"num_write":30,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063284+0000","last_change":"2024-09-19T06:38:14.054619+0000","last_active":"2024-09-19T06:38:23.063284+0000","last_peered":"2024-09-19T06:38:23.063284+0000","last_clean":"2024-09-19T06:38:23.063284+0000","last_became_active":"2024-09-19T06:38:14.054118+0000","last_became_peered":"2024-09-19T06:38:14.054118+0000","last_unstale":"2024-09-19T06:38:23.063284+0000","last_undegraded":"2024-09-19T06:38:23.063284+0000","last_fullsized":"2024-09-19T06:38:23.063284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:41.041603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.673593+0000","last_change":"2024-09-19T06:38:12.040272+0000","last_active":"2024-09-19T06:38:25.673593+0000","last_peered":"2024-09-19T06:38:25.673593+0000","last_clean":"2024-09-19T06:38:25.673593+0000","last_became_active":"2024-09-19T06:38:12.039940+0000","last_became_peered":"2024-09-19T06:38:12.039940+0000","last_unstale":"2024-09-19T06:38:25.673593+0000","last_undegraded":"2024-09-19T06:38:25.673593+0000","last_fullsized":"2024-09-19T06:38:25.673593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:53.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174406+0000","last_change":"2024-09-19T06:38:14.049535+0000","last_active":"2024-09-19T06:38:23.174406+0000","last_peered":"2024-09-19T06:38:23.174406+0000","last_clean":"2024-09-19T06:38:23.174406+0000","last_became_active":"2024-09-19T06:38:14.049208+0000","last_became_peered":"2024-09-19T06:38:14.049208+0000","last_unstale":"2024-09-19T06:38:23.174406+0000","last_undegraded":"2024-09-19T06:38:23.174406+0000","last_fullsized":"2024-09-19T06:38:23.174406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:03.359786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670196+0000","last_change":"2024-09-19T06:38:12.037346+0000","last_active":"2024-09-19T06:38:25.670196+0000","last_peered":"2024-09-19T06:38:25.670196+0000","last_clean":"2024-09-19T06:38:25.670196+0000","last_became_active":"2024-09-19T06:38:12.036986+0000","last_became_peered":"2024-09-19T06:38:12.036986+0000","last_unstale":"2024-09-19T06:38:25.670196+0000","last_undegraded":"2024-09-19T06:38:25.670196+0000","last_fullsized":"2024-09-19T06:38:25.670196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:26.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059848+0000","last_change":"2024-09-19T06:38:14.059454+0000","last_active":"2024-09-19T06:38:23.059848+0000","last_peered":"2024-09-19T06:38:23.059848+0000","last_clean":"2024-09-19T06:38:23.059848+0000","last_became_active":"2024-09-19T06:38:14.058996+0000","last_became_peered":"2024-09-19T06:38:14.058996+0000","last_unstale":"2024-09-19T06:38:23.059848+0000","last_undegraded":"2024-09-19T06:38:23.059848+0000","last_fullsized":"2024-09-19T06:38:23.059848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:54.645395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:13.727890+0000","last_change":"2024-09-19T06:38:12.043687+0000","last_active":"2024-09-19T06:39:13.727890+0000","last_peered":"2024-09-19T06:39:13.727890+0000","last_clean":"2024-09-19T06:39:13.727890+0000","last_became_active":"2024-09-19T06:38:12.043268+0000","last_became_peered":"2024-09-19T06:38:12.043268+0000","last_unstale":"2024-09-19T06:39:13.727890+0000","last_undegraded":"2024-09-19T06:39:13.727890+0000","last_fullsized":"2024-09-19T06:39:13.727890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:18.753736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059613+0000","last_change":"2024-09-19T06:38:14.052184+0000","last_active":"2024-09-19T06:38:23.059613+0000","last_peered":"2024-09-19T06:38:23.059613+0000","last_clean":"2024-09-19T06:38:23.059613+0000","last_became_active":"2024-09-19T06:38:14.051736+0000","last_became_peered":"2024-09-19T06:38:14.051736+0000","last_unstale":"2024-09-19T06:38:23.059613+0000","last_undegraded":"2024-09-19T06:38:23.059613+0000","last_fullsized":"2024-09-19T06:38:23.059613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:12.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667007+0000","last_change":"2024-09-19T06:38:12.048418+0000","last_active":"2024-09-19T06:38:24.667007+0000","last_peered":"2024-09-19T06:38:24.667007+0000","last_clean":"2024-09-19T06:38:24.667007+0000","last_became_active":"2024-09-19T06:38:12.047948+0000","last_became_peered":"2024-09-19T06:38:12.047948+0000","last_unstale":"2024-09-19T06:38:24.667007+0000","last_undegraded":"2024-09-19T06:38:24.667007+0000","last_fullsized":"2024-09-19T06:38:24.667007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:06.059904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.176378+0000","last_change":"2024-09-19T06:38:23.175961+0000","last_active":"2024-09-19T06:38:23.176378+0000","last_peered":"2024-09-19T06:38:23.176378+0000","last_clean":"2024-09-19T06:38:23.176378+0000","last_became_active":"2024-09-19T06:38:23.175629+0000","last_became_peered":"2024-09-19T06:38:23.175629+0000","last_unstale":"2024-09-19T06:38:23.176378+0000","last_undegraded":"2024-09-19T06:38:23.176378+0000","last_fullsized":"2024-09-19T06:38:23.176378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.655577+0000","last_change":"2024-09-19T06:38:12.038945+0000","last_active":"2024-09-19T06:38:24.655577+0000","last_peered":"2024-09-19T06:38:24.655577+0000","last_clean":"2024-09-19T06:38:24.655577+0000","last_became_active":"2024-09-19T06:38:12.038571+0000","last_became_peered":"2024-09-19T06:38:12.038571+0000","last_unstale":"2024-09-19T06:38:24.655577+0000","last_undegraded":"2024-09-19T06:38:24.655577+0000","last_fullsized":"2024-09-19T06:38:24.655577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:57.887070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061540+0000","last_change":"2024-09-19T06:38:14.056481+0000","last_active":"2024-09-19T06:38:23.061540+0000","last_peered":"2024-09-19T06:38:23.061540+0000","last_clean":"2024-09-19T06:38:23.061540+0000","last_became_active":"2024-09-19T06:38:14.056177+0000","last_became_peered":"2024-09-19T06:38:14.056177+0000","last_unstale":"2024-09-19T06:38:23.061540+0000","last_undegraded":"2024-09-19T06:38:23.061540+0000","last_fullsized":"2024-09-19T06:38:23.061540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.734802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.668174+0000","last_change":"2024-09-19T06:38:12.038826+0000","last_active":"2024-09-19T06:38:25.668174+0000","last_peered":"2024-09-19T06:38:25.668174+0000","last_clean":"2024-09-19T06:38:25.668174+0000","last_became_active":"2024-09-19T06:38:12.038516+0000","last_became_peered":"2024-09-19T06:38:12.038516+0000","last_unstale":"2024-09-19T06:38:25.668174+0000","last_undegraded":"2024-09-19T06:38:25.668174+0000","last_fullsized":"2024-09-19T06:38:25.668174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:16.709742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060031+0000","last_change":"2024-09-19T06:38:14.053888+0000","last_active":"2024-09-19T06:38:23.060031+0000","last_peered":"2024-09-19T06:38:23.060031+0000","last_clean":"2024-09-19T06:38:23.060031+0000","last_became_active":"2024-09-19T06:38:14.053524+0000","last_became_peered":"2024-09-19T06:38:14.053524+0000","last_unstale":"2024-09-19T06:38:23.060031+0000","last_undegraded":"2024-09-19T06:38:23.060031+0000","last_fullsized":"2024-09-19T06:38:23.060031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:54.853786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667849+0000","last_change":"2024-09-19T06:38:12.040842+0000","last_active":"2024-09-19T06:38:24.667849+0000","last_peered":"2024-09-19T06:38:24.667849+0000","last_clean":"2024-09-19T06:38:24.667849+0000","last_became_active":"2024-09-19T06:38:12.040463+0000","last_became_peered":"2024-09-19T06:38:12.040463+0000","last_unstale":"2024-09-19T06:38:24.667849+0000","last_undegraded":"2024-09-19T06:38:24.667849+0000","last_fullsized":"2024-09-19T06:38:24.667849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:29.726632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060279+0000","last_change":"2024-09-19T06:38:14.052210+0000","last_active":"2024-09-19T06:38:23.060279+0000","last_peered":"2024-09-19T06:38:23.060279+0000","last_clean":"2024-09-19T06:38:23.060279+0000","last_became_active":"2024-09-19T06:38:14.051803+0000","last_became_peered":"2024-09-19T06:38:14.051803+0000","last_unstale":"2024-09-19T06:38:23.060279+0000","last_undegraded":"2024-09-19T06:38:23.060279+0000","last_fullsized":"2024-09-19T06:38:23.060279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:40.751672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:17.757511+0000","last_change":"2024-09-19T06:38:12.118077+0000","last_active":"2024-09-19T06:39:17.757511+0000","last_peered":"2024-09-19T06:39:17.757511+0000","last_clean":"2024-09-19T06:39:17.757511+0000","last_became_active":"2024-09-19T06:38:12.117690+0000","last_became_peered":"2024-09-19T06:38:12.117690+0000","last_unstale":"2024-09-19T06:39:17.757511+0000","last_undegraded":"2024-09-19T06:39:17.757511+0000","last_fullsized":"2024-09-19T06:39:17.757511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.828335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.060217+0000","last_change":"2024-09-19T06:38:14.054014+0000","last_active":"2024-09-19T06:38:23.060217+0000","last_peered":"2024-09-19T06:38:23.060217+0000","last_clean":"2024-09-19T06:38:23.060217+0000","last_became_active":"2024-09-19T06:38:14.053349+0000","last_became_peered":"2024-09-19T06:38:14.053349+0000","last_unstale":"2024-09-19T06:38:23.060217+0000","last_undegraded":"2024-09-19T06:38:23.060217+0000","last_fullsized":"2024-09-19T06:38:23.060217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:40.117720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059973+0000","last_change":"2024-09-19T06:37:02.166696+0000","last_active":"2024-09-19T06:38:23.059973+0000","last_peered":"2024-09-19T06:38:23.059973+0000","last_clean":"2024-09-19T06:38:23.059973+0000","last_became_active":"2024-09-19T06:37:02.166225+0000","last_became_peered":"2024-09-19T06:37:02.166225+0000","last_unstale":"2024-09-19T06:38:23.059973+0000","last_undegraded":"2024-09-19T06:38:23.059973+0000","last_fullsized":"2024-09-19T06:38:23.059973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_clean_scrub_stamp":"2024-09-19T06:33:40.535354+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:46.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672803+0000","last_change":"2024-09-19T06:38:12.044465+0000","last_active":"2024-09-19T06:38:25.672803+0000","last_peered":"2024-09-19T06:38:25.672803+0000","last_clean":"2024-09-19T06:38:25.672803+0000","last_became_active":"2024-09-19T06:38:12.044042+0000","last_became_peered":"2024-09-19T06:38:12.044042+0000","last_unstale":"2024-09-19T06:38:25.672803+0000","last_undegraded":"2024-09-19T06:38:25.672803+0000","last_fullsized":"2024-09-19T06:38:25.672803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:40.759264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810103+0000","last_change":"2024-09-19T06:38:14.045102+0000","last_active":"2024-09-19T06:38:23.810103+0000","last_peered":"2024-09-19T06:38:23.810103+0000","last_clean":"2024-09-19T06:38:23.810103+0000","last_became_active":"2024-09-19T06:38:14.044785+0000","last_became_peered":"2024-09-19T06:38:14.044785+0000","last_unstale":"2024-09-19T06:38:23.810103+0000","last_undegraded":"2024-09-19T06:38:23.810103+0000","last_fullsized":"2024-09-19T06:38:23.810103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:57.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.079355+0000","last_change":"2024-09-19T06:38:12.040656+0000","last_active":"2024-09-19T06:38:24.079355+0000","last_peered":"2024-09-19T06:38:24.079355+0000","last_clean":"2024-09-19T06:38:24.079355+0000","last_became_active":"2024-09-19T06:38:12.040068+0000","last_became_peered":"2024-09-19T06:38:12.040068+0000","last_unstale":"2024-09-19T06:38:24.079355+0000","last_undegraded":"2024-09-19T06:38:24.079355+0000","last_fullsized":"2024-09-19T06:38:24.079355+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:33.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174396+0000","last_change":"2024-09-19T06:38:14.054623+0000","last_active":"2024-09-19T06:38:23.174396+0000","last_peered":"2024-09-19T06:38:23.174396+0000","last_clean":"2024-09-19T06:38:23.174396+0000","last_became_active":"2024-09-19T06:38:14.054124+0000","last_became_peered":"2024-09-19T06:38:14.054124+0000","last_unstale":"2024-09-19T06:38:23.174396+0000","last_undegraded":"2024-09-19T06:38:23.174396+0000","last_fullsized":"2024-09-19T06:38:23.174396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:33.251059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:14.728695+0000","last_change":"2024-09-19T06:38:12.047284+0000","last_active":"2024-09-19T06:39:14.728695+0000","last_peered":"2024-09-19T06:39:14.728695+0000","last_clean":"2024-09-19T06:39:14.728695+0000","last_became_active":"2024-09-19T06:38:12.046886+0000","last_became_peered":"2024-09-19T06:38:12.046886+0000","last_unstale":"2024-09-19T06:39:14.728695+0000","last_undegraded":"2024-09-19T06:39:14.728695+0000","last_fullsized":"2024-09-19T06:39:14.728695+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:15.030007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063722+0000","last_change":"2024-09-19T06:38:14.049351+0000","last_active":"2024-09-19T06:38:23.063722+0000","last_peered":"2024-09-19T06:38:23.063722+0000","last_clean":"2024-09-19T06:38:23.063722+0000","last_became_active":"2024-09-19T06:38:14.048792+0000","last_became_peered":"2024-09-19T06:38:14.048792+0000","last_unstale":"2024-09-19T06:38:23.063722+0000","last_undegraded":"2024-09-19T06:38:23.063722+0000","last_fullsized":"2024-09-19T06:38:23.063722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:30.431378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":83,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:17.752229+0000","last_change":"2024-09-19T06:38:12.037155+0000","last_active":"2024-09-19T06:39:17.752229+0000","last_peered":"2024-09-19T06:39:17.752229+0000","last_clean":"2024-09-19T06:39:17.752229+0000","last_became_active":"2024-09-19T06:38:12.036536+0000","last_became_peered":"2024-09-19T06:38:12.036536+0000","last_unstale":"2024-09-19T06:39:17.752229+0000","last_undegraded":"2024-09-19T06:39:17.752229+0000","last_fullsized":"2024-09-19T06:39:17.752229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:41.014783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062872+0000","last_change":"2024-09-19T06:38:14.055724+0000","last_active":"2024-09-19T06:38:23.062872+0000","last_peered":"2024-09-19T06:38:23.062872+0000","last_clean":"2024-09-19T06:38:23.062872+0000","last_became_active":"2024-09-19T06:38:14.054457+0000","last_became_peered":"2024-09-19T06:38:14.054457+0000","last_unstale":"2024-09-19T06:38:23.062872+0000","last_undegraded":"2024-09-19T06:38:23.062872+0000","last_fullsized":"2024-09-19T06:38:23.062872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:47.653709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059331+0000","last_change":"2024-09-19T06:38:12.049197+0000","last_active":"2024-09-19T06:38:23.059331+0000","last_peered":"2024-09-19T06:38:23.059331+0000","last_clean":"2024-09-19T06:38:23.059331+0000","last_became_active":"2024-09-19T06:38:12.048863+0000","last_became_peered":"2024-09-19T06:38:12.048863+0000","last_unstale":"2024-09-19T06:38:23.059331+0000","last_undegraded":"2024-09-19T06:38:23.059331+0000","last_fullsized":"2024-09-19T06:38:23.059331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:25.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.063056+0000","last_change":"2024-09-19T06:38:14.042991+0000","last_active":"2024-09-19T06:38:23.063056+0000","last_peered":"2024-09-19T06:38:23.063056+0000","last_clean":"2024-09-19T06:38:23.063056+0000","last_became_active":"2024-09-19T06:38:14.042511+0000","last_became_peered":"2024-09-19T06:38:14.042511+0000","last_unstale":"2024-09-19T06:38:23.063056+0000","last_undegraded":"2024-09-19T06:38:23.063056+0000","last_fullsized":"2024-09-19T06:38:23.063056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:38.212838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.666253+0000","last_change":"2024-09-19T06:38:23.064456+0000","last_active":"2024-09-19T06:38:24.666253+0000","last_peered":"2024-09-19T06:38:24.666253+0000","last_clean":"2024-09-19T06:38:24.666253+0000","last_became_active":"2024-09-19T06:38:23.064051+0000","last_became_peered":"2024-09-19T06:38:23.064051+0000","last_unstale":"2024-09-19T06:38:24.666253+0000","last_undegraded":"2024-09-19T06:38:24.666253+0000","last_fullsized":"2024-09-19T06:38:24.666253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:58.548420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.174635+0000","last_change":"2024-09-19T06:38:14.048612+0000","last_active":"2024-09-19T06:38:23.174635+0000","last_peered":"2024-09-19T06:38:23.174635+0000","last_clean":"2024-09-19T06:38:23.174635+0000","last_became_active":"2024-09-19T06:38:14.048294+0000","last_became_peered":"2024-09-19T06:38:14.048294+0000","last_unstale":"2024-09-19T06:38:23.174635+0000","last_undegraded":"2024-09-19T06:38:23.174635+0000","last_fullsized":"2024-09-19T06:38:23.174635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:55.892149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:39.054531+0000","last_change":"2024-09-19T06:38:12.035269+0000","last_active":"2024-09-19T06:38:39.054531+0000","last_peered":"2024-09-19T06:38:39.054531+0000","last_clean":"2024-09-19T06:38:39.054531+0000","last_became_active":"2024-09-19T06:38:12.034841+0000","last_became_peered":"2024-09-19T06:38:12.034841+0000","last_unstale":"2024-09-19T06:38:39.054531+0000","last_undegraded":"2024-09-19T06:38:39.054531+0000","last_fullsized":"2024-09-19T06:38:39.054531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:19.642572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810116+0000","last_change":"2024-09-19T06:38:14.052492+0000","last_active":"2024-09-19T06:38:23.810116+0000","last_peered":"2024-09-19T06:38:23.810116+0000","last_clean":"2024-09-19T06:38:23.810116+0000","last_became_active":"2024-09-19T06:38:14.052191+0000","last_became_peered":"2024-09-19T06:38:14.052191+0000","last_unstale":"2024-09-19T06:38:23.810116+0000","last_undegraded":"2024-09-19T06:38:23.810116+0000","last_fullsized":"2024-09-19T06:38:23.810116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:34.006480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.670731+0000","last_change":"2024-09-19T06:38:12.118430+0000","last_active":"2024-09-19T06:38:25.670731+0000","last_peered":"2024-09-19T06:38:25.670731+0000","last_clean":"2024-09-19T06:38:25.670731+0000","last_became_active":"2024-09-19T06:38:12.118065+0000","last_became_peered":"2024-09-19T06:38:12.118065+0000","last_unstale":"2024-09-19T06:38:25.670731+0000","last_undegraded":"2024-09-19T06:38:25.670731+0000","last_fullsized":"2024-09-19T06:38:25.670731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:25.861922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.811305+0000","last_change":"2024-09-19T06:38:23.811305+0000","last_active":"2024-09-19T06:38:23.811305+0000","last_peered":"2024-09-19T06:38:23.811305+0000","last_clean":"2024-09-19T06:38:23.811305+0000","last_became_active":"2024-09-19T06:38:23.810840+0000","last_became_peered":"2024-09-19T06:38:23.810840+0000","last_unstale":"2024-09-19T06:38:23.811305+0000","last_undegraded":"2024-09-19T06:38:23.811305+0000","last_fullsized":"2024-09-19T06:38:23.811305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.019065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066057+0000","last_change":"2024-09-19T06:38:12.047670+0000","last_active":"2024-09-19T06:38:23.066057+0000","last_peered":"2024-09-19T06:38:23.066057+0000","last_clean":"2024-09-19T06:38:23.066057+0000","last_became_active":"2024-09-19T06:38:12.047312+0000","last_became_peered":"2024-09-19T06:38:12.047312+0000","last_unstale":"2024-09-19T06:38:23.066057+0000","last_undegraded":"2024-09-19T06:38:23.066057+0000","last_fullsized":"2024-09-19T06:38:23.066057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:47.477945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061871+0000","last_change":"2024-09-19T06:38:14.047210+0000","last_active":"2024-09-19T06:38:23.061871+0000","last_peered":"2024-09-19T06:38:23.061871+0000","last_clean":"2024-09-19T06:38:23.061871+0000","last_became_active":"2024-09-19T06:38:14.046836+0000","last_became_peered":"2024-09-19T06:38:14.046836+0000","last_unstale":"2024-09-19T06:38:23.061871+0000","last_undegraded":"2024-09-19T06:38:23.061871+0000","last_fullsized":"2024-09-19T06:38:23.061871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:14.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672539+0000","last_change":"2024-09-19T06:38:12.032692+0000","last_active":"2024-09-19T06:38:25.672539+0000","last_peered":"2024-09-19T06:38:25.672539+0000","last_clean":"2024-09-19T06:38:25.672539+0000","last_became_active":"2024-09-19T06:38:12.031874+0000","last_became_peered":"2024-09-19T06:38:12.031874+0000","last_unstale":"2024-09-19T06:38:25.672539+0000","last_undegraded":"2024-09-19T06:38:25.672539+0000","last_fullsized":"2024-09-19T06:38:25.672539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.787964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.061862+0000","last_change":"2024-09-19T06:38:14.053504+0000","last_active":"2024-09-19T06:38:23.061862+0000","last_peered":"2024-09-19T06:38:23.061862+0000","last_clean":"2024-09-19T06:38:23.061862+0000","last_became_active":"2024-09-19T06:38:14.053148+0000","last_became_peered":"2024-09-19T06:38:14.053148+0000","last_unstale":"2024-09-19T06:38:23.061862+0000","last_undegraded":"2024-09-19T06:38:23.061862+0000","last_fullsized":"2024-09-19T06:38:23.061862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:29.809295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:24.667656+0000","last_change":"2024-09-19T06:38:12.038884+0000","last_active":"2024-09-19T06:38:24.667656+0000","last_peered":"2024-09-19T06:38:24.667656+0000","last_clean":"2024-09-19T06:38:24.667656+0000","last_became_active":"2024-09-19T06:38:12.038532+0000","last_became_peered":"2024-09-19T06:38:12.038532+0000","last_unstale":"2024-09-19T06:38:24.667656+0000","last_undegraded":"2024-09-19T06:38:24.667656+0000","last_fullsized":"2024-09-19T06:38:24.667656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.348690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810045+0000","last_change":"2024-09-19T06:38:14.045761+0000","last_active":"2024-09-19T06:38:23.810045+0000","last_peered":"2024-09-19T06:38:23.810045+0000","last_clean":"2024-09-19T06:38:23.810045+0000","last_became_active":"2024-09-19T06:38:14.045467+0000","last_became_peered":"2024-09-19T06:38:14.045467+0000","last_unstale":"2024-09-19T06:38:23.810045+0000","last_undegraded":"2024-09-19T06:38:23.810045+0000","last_fullsized":"2024-09-19T06:38:23.810045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.917945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062222+0000","last_change":"2024-09-19T06:38:12.039546+0000","last_active":"2024-09-19T06:38:23.062222+0000","last_peered":"2024-09-19T06:38:23.062222+0000","last_clean":"2024-09-19T06:38:23.062222+0000","last_became_active":"2024-09-19T06:38:12.039130+0000","last_became_peered":"2024-09-19T06:38:12.039130+0000","last_unstale":"2024-09-19T06:38:23.062222+0000","last_undegraded":"2024-09-19T06:38:23.062222+0000","last_fullsized":"2024-09-19T06:38:23.062222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:43.200022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.059825+0000","last_change":"2024-09-19T06:38:14.053935+0000","last_active":"2024-09-19T06:38:23.059825+0000","last_peered":"2024-09-19T06:38:23.059825+0000","last_clean":"2024-09-19T06:38:23.059825+0000","last_became_active":"2024-09-19T06:38:14.053542+0000","last_became_peered":"2024-09-19T06:38:14.053542+0000","last_unstale":"2024-09-19T06:38:23.059825+0000","last_undegraded":"2024-09-19T06:38:23.059825+0000","last_fullsized":"2024-09-19T06:38:23.059825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:25.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.177494+0000","last_change":"2024-09-19T06:38:23.177133+0000","last_active":"2024-09-19T06:38:23.177494+0000","last_peered":"2024-09-19T06:38:23.177494+0000","last_clean":"2024-09-19T06:38:23.177494+0000","last_became_active":"2024-09-19T06:38:23.176810+0000","last_became_peered":"2024-09-19T06:38:23.176810+0000","last_unstale":"2024-09-19T06:38:23.177494+0000","last_undegraded":"2024-09-19T06:38:23.177494+0000","last_fullsized":"2024-09-19T06:38:23.177494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:56.307720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:25.672551+0000","last_change":"2024-09-19T06:38:12.042699+0000","last_active":"2024-09-19T06:38:25.672551+0000","last_peered":"2024-09-19T06:38:25.672551+0000","last_clean":"2024-09-19T06:38:25.672551+0000","last_became_active":"2024-09-19T06:38:12.042148+0000","last_became_peered":"2024-09-19T06:38:12.042148+0000","last_unstale":"2024-09-19T06:38:25.672551+0000","last_undegraded":"2024-09-19T06:38:25.672551+0000","last_fullsized":"2024-09-19T06:38:25.672551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.953596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.066455+0000","last_change":"2024-09-19T06:38:14.043279+0000","last_active":"2024-09-19T06:38:23.066455+0000","last_peered":"2024-09-19T06:38:23.066455+0000","last_clean":"2024-09-19T06:38:23.066455+0000","last_became_active":"2024-09-19T06:38:14.042914+0000","last_became_peered":"2024-09-19T06:38:14.042914+0000","last_unstale":"2024-09-19T06:38:23.066455+0000","last_undegraded":"2024-09-19T06:38:23.066455+0000","last_fullsized":"2024-09-19T06:38:23.066455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:22.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:26.681663+0000","last_change":"2024-09-19T06:38:12.038683+0000","last_active":"2024-09-19T06:38:26.681663+0000","last_peered":"2024-09-19T06:38:26.681663+0000","last_clean":"2024-09-19T06:38:26.681663+0000","last_became_active":"2024-09-19T06:38:12.038342+0000","last_became_peered":"2024-09-19T06:38:12.038342+0000","last_unstale":"2024-09-19T06:38:26.681663+0000","last_undegraded":"2024-09-19T06:38:26.681663+0000","last_fullsized":"2024-09-19T06:38:26.681663+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:07.091418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.062167+0000","last_change":"2024-09-19T06:38:14.041552+0000","last_active":"2024-09-19T06:38:23.062167+0000","last_peered":"2024-09-19T06:38:23.062167+0000","last_clean":"2024-09-19T06:38:23.062167+0000","last_became_active":"2024-09-19T06:38:14.041187+0000","last_became_peered":"2024-09-19T06:38:14.041187+0000","last_unstale":"2024-09-19T06:38:23.062167+0000","last_undegraded":"2024-09-19T06:38:23.062167+0000","last_fullsized":"2024-09-19T06:38:23.062167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:17.390457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810276+0000","last_change":"2024-09-19T06:38:12.047436+0000","last_active":"2024-09-19T06:38:23.810276+0000","last_peered":"2024-09-19T06:38:23.810276+0000","last_clean":"2024-09-19T06:38:23.810276+0000","last_became_active":"2024-09-19T06:38:12.046961+0000","last_became_peered":"2024-09-19T06:38:12.046961+0000","last_unstale":"2024-09-19T06:38:23.810276+0000","last_undegraded":"2024-09-19T06:38:23.810276+0000","last_fullsized":"2024-09-19T06:38:23.810276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:38:23.810051+0000","last_change":"2024-09-19T06:38:14.049660+0000","last_active":"2024-09-19T06:38:23.810051+0000","last_peered":"2024-09-19T06:38:23.810051+0000","last_clean":"2024-09-19T06:38:23.810051+0000","last_became_active":"2024-09-19T06:38:14.049375+0000","last_became_peered":"2024-09-19T06:38:14.049375+0000","last_unstale":"2024-09-19T06:38:23.810051+0000","last_undegraded":"2024-09-19T06:38:23.810051+0000","last_fullsized":"2024-09-19T06:38:23.810051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:08.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T06:39:13.746618+0000","last_change":"2024-09-19T06:38:23.071068+0000","last_active":"2024-09-19T06:39:13.746618+0000","last_peered":"2024-09-19T06:39:13.746618+0000","last_clean":"2024-09-19T06:39:13.746618+0000","last_became_active":"2024-09-19T06:38:23.067129+0000","last_became_peered":"2024-09-19T06:38:23.067129+0000","last_unstale":"2024-09-19T06:39:13.746618+0000","last_undegraded":"2024-09-19T06:39:13.746618+0000","last_fullsized":"2024-09-19T06:39:13.746618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:15.387758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66812,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":554,"num_read_kb":345,"num_write":240,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2194,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776158,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1613824,"data_stored":1089209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939684,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":438899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":438493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1032190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528371,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":439009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1544192,"data_stored":1031475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":498703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":438441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":439520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40472,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704680,"statfs":{"total":95995035648,"available":95953592320,"internally_reserved":0,"allocated":991232,"data_stored":499805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:39:22.092 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:39:22.093 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T06:39:22.093 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T06:39:22.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T06:39:22.348 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:22.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:22 smithi012 ceph-mon[30937]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:39:22.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 1]}]: dispatch 2024-09-19T06:39:22.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]}]: dispatch 2024-09-19T06:39:22.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]}]: dispatch 2024-09-19T06:39:22.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:22 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]: dispatch 2024-09-19T06:39:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 -- 172.21.15.12:0/1594674546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd438106a60 msgr2=0x7fd438106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 --2- 172.21.15.12:0/1594674546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd438106a60 0x7fd438106e40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd434009930 tx=0x7fd43402a420 comp rx=0 tx=0).stop 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 -- 172.21.15.12:0/1594674546 shutdown_connections 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 --2- 172.21.15.12:0/1594674546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd438101400 0x7fd43810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 --2- 172.21.15.12:0/1594674546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd438100a60 0x7fd438100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 --2- 172.21.15.12:0/1594674546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd438106a60 0x7fd438106e40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 -- 172.21.15.12:0/1594674546 >> 172.21.15.12:0/1594674546 conn(0x7fd4380fc780 msgr2=0x7fd4380feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 -- 172.21.15.12:0/1594674546 shutdown_connections 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 -- 172.21.15.12:0/1594674546 wait complete. 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 Processor -- start 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.801+0000 7fd43f2d5640 1 -- start start 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43f2d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd438100a60 0x7fd438199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43f2d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd438101400 0x7fd438199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43f2d5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd438106a60 0x7fd4381a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43f2d5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd438110e60 con 0x7fd438101400 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43f2d5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd438110ce0 con 0x7fd438100a60 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43f2d5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd438110fe0 con 0x7fd438106a60 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43c870640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd438101400 0x7fd438199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43c870640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd438101400 0x7fd438199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58162/0 (socket says 172.21.15.12:58162) 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43c870640 1 -- 172.21.15.12:0/3324463226 learned_addr learned my addr 172.21.15.12:0/3324463226 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43d872640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd438106a60 0x7fd4381a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43d071640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd438100a60 0x7fd438199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43c870640 1 -- 172.21.15.12:0/3324463226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd438106a60 msgr2=0x7fd4381a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43c870640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd438106a60 0x7fd4381a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43c870640 1 -- 172.21.15.12:0/3324463226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd438100a60 msgr2=0x7fd438199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43c870640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd438100a60 0x7fd438199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43c870640 1 -- 172.21.15.12:0/3324463226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4381a4910 con 0x7fd438101400 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43d071640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd438100a60 0x7fd438199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43c870640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd438101400 0x7fd438199890 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd42800c970 tx=0x7fd42800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd42e7fc640 1 -- 172.21.15.12:0/3324463226 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428007bb0 con 0x7fd438101400 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd42e7fc640 1 -- 172.21.15.12:0/3324463226 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd428007d50 con 0x7fd438101400 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.802+0000 7fd43f2d5640 1 -- 172.21.15.12:0/3324463226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4381a4ae0 con 0x7fd438101400 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.803+0000 7fd42e7fc640 1 -- 172.21.15.12:0/3324463226 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42800f450 con 0x7fd438101400 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.803+0000 7fd43f2d5640 1 -- 172.21.15.12:0/3324463226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4381a4fa0 con 0x7fd438101400 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.804+0000 7fd43f2d5640 1 -- 172.21.15.12:0/3324463226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd438100ec0 con 0x7fd438101400 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.805+0000 7fd42e7fc640 1 -- 172.21.15.12:0/3324463226 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd428005020 con 0x7fd438101400 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.805+0000 7fd42e7fc640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd4240a32d0 0x7fd4240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.805+0000 7fd43d071640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd4240a32d0 0x7fd4240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.805+0000 7fd42e7fc640 1 -- 172.21.15.12:0/3324463226 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8385+0+0 (secure 0 0 0) 0x7fd4280cf920 con 0x7fd438101400 2024-09-19T06:39:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.806+0000 7fd43d071640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd4240a32d0 0x7fd4240a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd434000c00 tx=0x7fd434005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:22.810+0000 7fd42e7fc640 1 -- 172.21.15.12:0/3324463226 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd428014030 con 0x7fd438101400 2024-09-19T06:39:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:22 smithi016 ceph-mon[34911]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:39:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 1]}]: dispatch 2024-09-19T06:39:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]}]: dispatch 2024-09-19T06:39:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]}]: dispatch 2024-09-19T06:39:23.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:22 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]: dispatch 2024-09-19T06:39:23.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.021+0000 7fd43f2d5640 1 -- 172.21.15.12:0/3324463226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd438108fd0 con 0x7fd438101400 2024-09-19T06:39:23.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.021+0000 7fd42e7fc640 1 -- 172.21.15.12:0/3324463226 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd42809c440 con 0x7fd438101400 2024-09-19T06:39:23.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:23.024 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T06:39:23.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.023+0000 7fd43f2d5640 1 -- 172.21.15.12:0/3324463226 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd4240a32d0 msgr2=0x7fd4240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:23.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.023+0000 7fd43f2d5640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd4240a32d0 0x7fd4240a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd434000c00 tx=0x7fd434005a20 comp rx=0 tx=0).stop 2024-09-19T06:39:23.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.023+0000 7fd43f2d5640 1 -- 172.21.15.12:0/3324463226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd438101400 msgr2=0x7fd438199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:23.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.023+0000 7fd43f2d5640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd438101400 0x7fd438199890 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd42800c970 tx=0x7fd42800ce30 comp rx=0 tx=0).stop 2024-09-19T06:39:23.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.023+0000 7fd43f2d5640 1 -- 172.21.15.12:0/3324463226 shutdown_connections 2024-09-19T06:39:23.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.023+0000 7fd43f2d5640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd4240a32d0 0x7fd4240a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.024+0000 7fd43f2d5640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd438106a60 0x7fd4381a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.024+0000 7fd43f2d5640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd438101400 0x7fd438199890 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.024+0000 7fd43f2d5640 1 --2- 172.21.15.12:0/3324463226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd438100a60 0x7fd438199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.024+0000 7fd43f2d5640 1 -- 172.21.15.12:0/3324463226 >> 172.21.15.12:0/3324463226 conn(0x7fd4380fc780 msgr2=0x7fd4380fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.024+0000 7fd43f2d5640 1 -- 172.21.15.12:0/3324463226 shutdown_connections 2024-09-19T06:39:23.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:23.024+0000 7fd43f2d5640 1 -- 172.21.15.12:0/3324463226 wait complete. 2024-09-19T06:39:23.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:22 smithi173 ceph-mon[35349]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:39:23.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 1]}]: dispatch 2024-09-19T06:39:23.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]}]: dispatch 2024-09-19T06:39:23.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]}]: dispatch 2024-09-19T06:39:23.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:22 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]: dispatch 2024-09-19T06:39:23.647 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T06:39:23.648 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:39:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:23 smithi012 ceph-mon[30937]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 1]}]': finished 2024-09-19T06:39:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]}]': finished 2024-09-19T06:39:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]}]': finished 2024-09-19T06:39:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:23 smithi012 ceph-mon[30937]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]': finished 2024-09-19T06:39:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:23 smithi012 ceph-mon[30937]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:39:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:23 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3324463226' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:39:23.916 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:24.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:23 smithi016 ceph-mon[34911]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:24.012 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 1]}]': finished 2024-09-19T06:39:24.013 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]}]': finished 2024-09-19T06:39:24.013 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]}]': finished 2024-09-19T06:39:24.014 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:23 smithi016 ceph-mon[34911]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]': finished 2024-09-19T06:39:24.017 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:23 smithi016 ceph-mon[34911]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:39:24.017 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:23 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3324463226' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:39:24.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:23 smithi173 ceph-mon[35349]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:24.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [5, 1]}]': finished 2024-09-19T06:39:24.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]}]': finished 2024-09-19T06:39:24.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]}]': finished 2024-09-19T06:39:24.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:23 smithi173 ceph-mon[35349]: from='mgr.14150 172.21.15.12:0/2471045319' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]': finished 2024-09-19T06:39:24.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:23 smithi173 ceph-mon[35349]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:39:24.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:23 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3324463226' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:39:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.394+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1753292738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c98101ba0 msgr2=0x7f4c9810d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.394+0000 7f4ca05e6640 1 --2- 172.21.15.12:0/1753292738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c98101ba0 0x7f4c9810d970 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009900 tx=0x7f4c9002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.394+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1753292738 shutdown_connections 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.394+0000 7f4ca05e6640 1 --2- 172.21.15.12:0/1753292738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c98101ba0 0x7f4c9810d970 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.394+0000 7f4ca05e6640 1 --2- 172.21.15.12:0/1753292738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c98101200 0x7f4c98101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.394+0000 7f4ca05e6640 1 --2- 172.21.15.12:0/1753292738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c98105ad0 0x7f4c98105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.394+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1753292738 >> 172.21.15.12:0/1753292738 conn(0x7f4c98077210 msgr2=0x7f4c980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.394+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1753292738 shutdown_connections 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.394+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1753292738 wait complete. 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4ca05e6640 1 Processor -- start 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4ca05e6640 1 -- start start 2024-09-19T06:39:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4ca05e6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c98101200 0x7f4c980fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4ca05e6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c98101ba0 0x7f4c980fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4ca05e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c98105ad0 0x7f4c980fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4ca05e6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98110f40 con 0x7f4c98105ad0 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4ca05e6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98110dc0 con 0x7f4c98101200 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4ca05e6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4c981110c0 con 0x7f4c98101ba0 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4c9eb83640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c98105ad0 0x7f4c980fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4c9eb83640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c98105ad0 0x7f4c980fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58174/0 (socket says 172.21.15.12:58174) 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4c9eb83640 1 -- 172.21.15.12:0/1476376409 learned_addr learned my addr 172.21.15.12:0/1476376409 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4c9db81640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c98101ba0 0x7f4c980fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4c9e382640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c98101200 0x7f4c980fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4c9eb83640 1 -- 172.21.15.12:0/1476376409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c98101ba0 msgr2=0x7f4c980fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4c9eb83640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c98101ba0 0x7f4c980fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4c9eb83640 1 -- 172.21.15.12:0/1476376409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c98101200 msgr2=0x7f4c980fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4c9eb83640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c98101200 0x7f4c980fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.395+0000 7f4c9eb83640 1 -- 172.21.15.12:0/1476376409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c981a6870 con 0x7f4c98105ad0 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.396+0000 7f4c9eb83640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c98105ad0 0x7f4c980fd110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009230 tx=0x7f4c90003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.396+0000 7f4c8f7fe640 1 -- 172.21.15.12:0/1476376409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9003f070 con 0x7f4c98105ad0 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.396+0000 7f4c8f7fe640 1 -- 172.21.15.12:0/1476376409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c90031e30 con 0x7f4c98105ad0 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.396+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1476376409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c981a6b00 con 0x7f4c98105ad0 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.396+0000 7f4c8f7fe640 1 -- 172.21.15.12:0/1476376409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90035030 con 0x7f4c98105ad0 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.396+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1476376409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c981a6fe0 con 0x7f4c98105ad0 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.397+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1476376409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c98101660 con 0x7f4c98105ad0 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.398+0000 7f4c8f7fe640 1 -- 172.21.15.12:0/1476376409 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4c90042070 con 0x7f4c98105ad0 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.399+0000 7f4c8f7fe640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4c840a32d0 0x7f4c840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.399+0000 7f4c9e382640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4c840a32d0 0x7f4c840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.399+0000 7f4c8f7fe640 1 -- 172.21.15.12:0/1476376409 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f4c900f0a60 con 0x7f4c98105ad0 2024-09-19T06:39:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.399+0000 7f4c9e382640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4c840a32d0 0x7f4c840a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4c94007350 tx=0x7f4c940072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:24.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.402+0000 7f4c8f7fe640 1 -- 172.21.15.12:0/1476376409 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4c900bd520 con 0x7f4c98105ad0 2024-09-19T06:39:24.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.616+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1476376409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c981a7310 con 0x7f4c98105ad0 2024-09-19T06:39:24.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.617+0000 7f4c8f7fe640 1 -- 172.21.15.12:0/1476376409 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11971 (secure 0 0 0) 0x7f4c900bce20 con 0x7f4c98105ad0 2024-09-19T06:39:24.618 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-19T06:39:24.619 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:24.619 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-19T06:38:26:674546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:38:26.674520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:39:24.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.619+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1476376409 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4c840a32d0 msgr2=0x7f4c840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:24.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.619+0000 7f4ca05e6640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4c840a32d0 0x7f4c840a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4c94007350 tx=0x7f4c940072e0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.619+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1476376409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c98105ad0 msgr2=0x7f4c980fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:24.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.619+0000 7f4ca05e6640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c98105ad0 0x7f4c980fd110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009230 tx=0x7f4c90003c00 comp rx=0 tx=0).stop 2024-09-19T06:39:24.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.620+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1476376409 shutdown_connections 2024-09-19T06:39:24.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.620+0000 7f4ca05e6640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f4c840a32d0 0x7f4c840a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.620+0000 7f4ca05e6640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c98105ad0 0x7f4c980fd110 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.620+0000 7f4ca05e6640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c98101ba0 0x7f4c980fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.620+0000 7f4ca05e6640 1 --2- 172.21.15.12:0/1476376409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c98101200 0x7f4c980fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.620+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1476376409 >> 172.21.15.12:0/1476376409 conn(0x7f4c98077210 msgr2=0x7f4c98100240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.620+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1476376409 shutdown_connections 2024-09-19T06:39:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:24.620+0000 7f4ca05e6640 1 -- 172.21.15.12:0/1476376409 wait complete. 2024-09-19T06:39:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:24 smithi012 ceph-mon[30937]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:39:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:24 smithi012 ceph-mon[30937]: pgmap v316: 97 pgs: 3 peering, 94 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-19T06:39:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:24 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1476376409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:25.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:24 smithi016 ceph-mon[34911]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:39:25.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:24 smithi016 ceph-mon[34911]: pgmap v316: 97 pgs: 3 peering, 94 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-19T06:39:25.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:24 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1476376409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:25.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:24 smithi173 ceph-mon[35349]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:39:25.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:24 smithi173 ceph-mon[35349]: pgmap v316: 97 pgs: 3 peering, 94 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-19T06:39:25.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:24 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1476376409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:25.357 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:39:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:25.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:25 smithi012 ceph-mon[30937]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T06:39:26.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:25 smithi016 ceph-mon[34911]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T06:39:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.051+0000 7fe3bcda4640 1 -- 172.21.15.12:0/3691766834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3b8101360 msgr2=0x7fe3b810df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.051+0000 7fe3bcda4640 1 --2- 172.21.15.12:0/3691766834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3b8101360 0x7fe3b810df90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009900 tx=0x7fe3ac02a410 comp rx=0 tx=0).stop 2024-09-19T06:39:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.051+0000 7fe3bcda4640 1 -- 172.21.15.12:0/3691766834 shutdown_connections 2024-09-19T06:39:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.051+0000 7fe3bcda4640 1 --2- 172.21.15.12:0/3691766834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b810e4d0 0x7fe3b81108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.051+0000 7fe3bcda4640 1 --2- 172.21.15.12:0/3691766834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3b8101360 0x7fe3b810df90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.051+0000 7fe3bcda4640 1 --2- 172.21.15.12:0/3691766834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b81009b0 0x7fe3b8100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.051+0000 7fe3bcda4640 1 -- 172.21.15.12:0/3691766834 >> 172.21.15.12:0/3691766834 conn(0x7fe3b80fc7d0 msgr2=0x7fe3b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.051+0000 7fe3bcda4640 1 -- 172.21.15.12:0/3691766834 shutdown_connections 2024-09-19T06:39:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.051+0000 7fe3bcda4640 1 -- 172.21.15.12:0/3691766834 wait complete. 2024-09-19T06:39:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.052+0000 7fe3bcda4640 1 Processor -- start 2024-09-19T06:39:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.052+0000 7fe3bcda4640 1 -- start start 2024-09-19T06:39:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.052+0000 7fe3bcda4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b81009b0 0x7fe3b81a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.052+0000 7fe3bcda4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b8101360 0x7fe3b81a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.052+0000 7fe3bcda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3b810e4d0 0x7fe3b819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3bcda4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b8114270 con 0x7fe3b810e4d0 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3bcda4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b81140f0 con 0x7fe3b81009b0 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3bcda4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b81143f0 con 0x7fe3b8101360 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3b810e4d0 0x7fe3b819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b81009b0 0x7fe3b81a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b81009b0 0x7fe3b81a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43608/0 (socket says 172.21.15.12:43608) 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3b810e4d0 0x7fe3b819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58188/0 (socket says 172.21.15.12:58188) 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b659c640 1 -- 172.21.15.12:0/1063075794 learned_addr learned my addr 172.21.15.12:0/1063075794 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b5d9b640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b8101360 0x7fe3b81a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b6d9d640 1 -- 172.21.15.12:0/1063075794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b8101360 msgr2=0x7fe3b81a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b6d9d640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b8101360 0x7fe3b81a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b6d9d640 1 -- 172.21.15.12:0/1063075794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b81009b0 msgr2=0x7fe3b81a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b6d9d640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b81009b0 0x7fe3b81a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b6d9d640 1 -- 172.21.15.12:0/1063075794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b819acc0 con 0x7fe3b810e4d0 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b659c640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b81009b0 0x7fe3b81a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3b6d9d640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3b810e4d0 0x7fe3b819a590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009fd0 tx=0x7fe3b000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3a77fe640 1 -- 172.21.15.12:0/1063075794 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b000ce20 con 0x7fe3b810e4d0 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.053+0000 7fe3a77fe640 1 -- 172.21.15.12:0/1063075794 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b0005020 con 0x7fe3b810e4d0 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.054+0000 7fe3bcda4640 1 -- 172.21.15.12:0/1063075794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b819afb0 con 0x7fe3b810e4d0 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.054+0000 7fe3a77fe640 1 -- 172.21.15.12:0/1063075794 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0010720 con 0x7fe3b810e4d0 2024-09-19T06:39:26.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.054+0000 7fe3bcda4640 1 -- 172.21.15.12:0/1063075794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b8102b30 con 0x7fe3b810e4d0 2024-09-19T06:39:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.055+0000 7fe3bcda4640 1 -- 172.21.15.12:0/1063075794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b8100d90 con 0x7fe3b810e4d0 2024-09-19T06:39:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.056+0000 7fe3a77fe640 1 -- 172.21.15.12:0/1063075794 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe3b0005540 con 0x7fe3b810e4d0 2024-09-19T06:39:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.057+0000 7fe3a77fe640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe3a00a3350 0x7fe3a00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.057+0000 7fe3b659c640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe3a00a3350 0x7fe3a00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:26.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.057+0000 7fe3a77fe640 1 -- 172.21.15.12:0/1063075794 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fe3b00d0310 con 0x7fe3b810e4d0 2024-09-19T06:39:26.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.057+0000 7fe3b659c640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe3a00a3350 0x7fe3a00a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8011550 tx=0x7fe3a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:26.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.060+0000 7fe3a77fe640 1 -- 172.21.15.12:0/1063075794 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3b009cec0 con 0x7fe3b810e4d0 2024-09-19T06:39:26.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:25 smithi173 ceph-mon[35349]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T06:39:26.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.271+0000 7fe3bcda4640 1 -- 172.21.15.12:0/1063075794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3b819bac0 con 0x7fe3b810e4d0 2024-09-19T06:39:26.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.272+0000 7fe3a77fe640 1 -- 172.21.15.12:0/1063075794 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11971 (secure 0 0 0) 0x7fe3b819bac0 con 0x7fe3b810e4d0 2024-09-19T06:39:26.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:26.274 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-19T06:38:26:674546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:38:26.674520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:39:26.274 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-19T06:39:26.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 -- 172.21.15.12:0/1063075794 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe3a00a3350 msgr2=0x7fe3a00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe3a00a3350 0x7fe3a00a5810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8011550 tx=0x7fe3a8005f90 comp rx=0 tx=0).stop 2024-09-19T06:39:26.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 -- 172.21.15.12:0/1063075794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3b810e4d0 msgr2=0x7fe3b819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:26.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3b810e4d0 0x7fe3b819a590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009fd0 tx=0x7fe3b000ef10 comp rx=0 tx=0).stop 2024-09-19T06:39:26.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 -- 172.21.15.12:0/1063075794 shutdown_connections 2024-09-19T06:39:26.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe3a00a3350 0x7fe3a00a5810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3b810e4d0 0x7fe3b819a590 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b8101360 0x7fe3b81a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 --2- 172.21.15.12:0/1063075794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b81009b0 0x7fe3b81a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 -- 172.21.15.12:0/1063075794 >> 172.21.15.12:0/1063075794 conn(0x7fe3b80fc7d0 msgr2=0x7fe3b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 -- 172.21.15.12:0/1063075794 shutdown_connections 2024-09-19T06:39:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:26.275+0000 7fe3bcda4640 1 -- 172.21.15.12:0/1063075794 wait complete. 2024-09-19T06:39:26.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:26 smithi012 ceph-mon[30937]: pgmap v317: 97 pgs: 3 peering, 94 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:39:26.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:26 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1063075794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:26.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:39:27.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:26 smithi016 ceph-mon[34911]: pgmap v317: 97 pgs: 3 peering, 94 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:39:27.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:26 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1063075794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:27.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:26 smithi173 ceph-mon[35349]: pgmap v317: 97 pgs: 3 peering, 94 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:39:27.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:26 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1063075794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:27.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.658+0000 7fc2f89d0640 1 -- 172.21.15.12:0/2492225837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f410c170 msgr2=0x7fc2f410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:27.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.658+0000 7fc2f89d0640 1 --2- 172.21.15.12:0/2492225837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f410c170 0x7fc2f410e610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009ca0 tx=0x7fc2ec02a950 comp rx=0 tx=0).stop 2024-09-19T06:39:27.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.658+0000 7fc2f89d0640 1 -- 172.21.15.12:0/2492225837 shutdown_connections 2024-09-19T06:39:27.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.658+0000 7fc2f89d0640 1 --2- 172.21.15.12:0/2492225837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f410c170 0x7fc2f410e610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:27.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.658+0000 7fc2f89d0640 1 --2- 172.21.15.12:0/2492225837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4103660 0x7fc2f410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:27.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.658+0000 7fc2f89d0640 1 --2- 172.21.15.12:0/2492225837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2f4102d40 0x7fc2f4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:27.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.658+0000 7fc2f89d0640 1 -- 172.21.15.12:0/2492225837 >> 172.21.15.12:0/2492225837 conn(0x7fc2f40fc7a0 msgr2=0x7fc2f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:27.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.658+0000 7fc2f89d0640 1 -- 172.21.15.12:0/2492225837 shutdown_connections 2024-09-19T06:39:27.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.658+0000 7fc2f89d0640 1 -- 172.21.15.12:0/2492225837 wait complete. 2024-09-19T06:39:27.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f89d0640 1 Processor -- start 2024-09-19T06:39:27.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f89d0640 1 -- start start 2024-09-19T06:39:27.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f89d0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2f4102d40 0x7fc2f4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:27.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f89d0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4103660 0x7fc2f41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:27.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f89d0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f410c170 0x7fc2f419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:27.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f89d0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4111fa0 con 0x7fc2f410c170 2024-09-19T06:39:27.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f89d0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4111e20 con 0x7fc2f4102d40 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f89d0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4112120 con 0x7fc2f4103660 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f410c170 0x7fc2f419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f410c170 0x7fc2f419cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58210/0 (socket says 172.21.15.12:58210) 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f2d9d640 1 -- 172.21.15.12:0/606353604 learned_addr learned my addr 172.21.15.12:0/606353604 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2e9d9b640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4103660 0x7fc2f41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.659+0000 7fc2f259c640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2f4102d40 0x7fc2f4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2f2d9d640 1 -- 172.21.15.12:0/606353604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4103660 msgr2=0x7fc2f41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2f2d9d640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4103660 0x7fc2f41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2f2d9d640 1 -- 172.21.15.12:0/606353604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2f4102d40 msgr2=0x7fc2f4198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2f2d9d640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2f4102d40 0x7fc2f4198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2f2d9d640 1 -- 172.21.15.12:0/606353604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f419d330 con 0x7fc2f410c170 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2f259c640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2f4102d40 0x7fc2f4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:27.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2f2d9d640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f410c170 0x7fc2f419cc50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0098d0 tx=0x7fc2ec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:27.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2ebfff640 1 -- 172.21.15.12:0/606353604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec034040 con 0x7fc2f410c170 2024-09-19T06:39:27.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2f89d0640 1 -- 172.21.15.12:0/606353604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f419d5c0 con 0x7fc2f410c170 2024-09-19T06:39:27.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2ebfff640 1 -- 172.21.15.12:0/606353604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2ec02fe20 con 0x7fc2f410c170 2024-09-19T06:39:27.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2ebfff640 1 -- 172.21.15.12:0/606353604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec039450 con 0x7fc2f410c170 2024-09-19T06:39:27.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.660+0000 7fc2f89d0640 1 -- 172.21.15.12:0/606353604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f41a4f00 con 0x7fc2f410c170 2024-09-19T06:39:27.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.661+0000 7fc2f89d0640 1 -- 172.21.15.12:0/606353604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f4103120 con 0x7fc2f410c170 2024-09-19T06:39:27.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.662+0000 7fc2ebfff640 1 -- 172.21.15.12:0/606353604 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc2ec037020 con 0x7fc2f410c170 2024-09-19T06:39:27.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.663+0000 7fc2ebfff640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e00a32d0 0x7fc2e00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:27.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.663+0000 7fc2f259c640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e00a32d0 0x7fc2e00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:27.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.663+0000 7fc2ebfff640 1 -- 172.21.15.12:0/606353604 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fc2ec0f0d70 con 0x7fc2f410c170 2024-09-19T06:39:27.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.663+0000 7fc2f259c640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e00a32d0 0x7fc2e00a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400abe0 tx=0x7fc2e400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:27.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.666+0000 7fc2ebfff640 1 -- 172.21.15.12:0/606353604 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc2ec07f210 con 0x7fc2f410c170 2024-09-19T06:39:27.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.846+0000 7fc2f89d0640 1 -- 172.21.15.12:0/606353604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2f41996e0 con 0x7fc2f410c170 2024-09-19T06:39:27.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.847+0000 7fc2ebfff640 1 -- 172.21.15.12:0/606353604 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22920 (secure 0 0 0) 0x7fc2f41996e0 con 0x7fc2f410c170 2024-09-19T06:39:27.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:27.849 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:39:23.693200+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":1}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:39:27.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 -- 172.21.15.12:0/606353604 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e00a32d0 msgr2=0x7fc2e00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:27.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e00a32d0 0x7fc2e00a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400abe0 tx=0x7fc2e400a5c0 comp rx=0 tx=0).stop 2024-09-19T06:39:27.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 -- 172.21.15.12:0/606353604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f410c170 msgr2=0x7fc2f419cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:27.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f410c170 0x7fc2f419cc50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0098d0 tx=0x7fc2ec003f10 comp rx=0 tx=0).stop 2024-09-19T06:39:27.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 -- 172.21.15.12:0/606353604 shutdown_connections 2024-09-19T06:39:27.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fc2e00a32d0 0x7fc2e00a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:27.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2f410c170 0x7fc2f419cc50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:27.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f4103660 0x7fc2f41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:27.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 --2- 172.21.15.12:0/606353604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2f4102d40 0x7fc2f4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:27.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 -- 172.21.15.12:0/606353604 >> 172.21.15.12:0/606353604 conn(0x7fc2f40fc7a0 msgr2=0x7fc2f40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:27.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 -- 172.21.15.12:0/606353604 shutdown_connections 2024-09-19T06:39:27.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:27.850+0000 7fc2f89d0640 1 -- 172.21.15.12:0/606353604 wait complete. 2024-09-19T06:39:28.513 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:39:28.770 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:29.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:28 smithi012 ceph-mon[30937]: pgmap v318: 97 pgs: 3 peering, 94 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:39:29.031 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:28 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/606353604' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:39:29.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:28 smithi173 ceph-mon[35349]: pgmap v318: 97 pgs: 3 peering, 94 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:39:29.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:28 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/606353604' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:39:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:28 smithi016 ceph-mon[34911]: pgmap v318: 97 pgs: 3 peering, 94 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T06:39:29.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:28 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/606353604' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:39:29.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.240+0000 7f7666f25640 1 -- 172.21.15.12:0/1235352745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660101420 msgr2=0x7f766010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:29.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.240+0000 7f7666f25640 1 --2- 172.21.15.12:0/1235352745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660101420 0x7f766010d950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7658009cd0 tx=0x7f765802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:39:29.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.240+0000 7f7666f25640 1 -- 172.21.15.12:0/1235352745 shutdown_connections 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.240+0000 7f7666f25640 1 --2- 172.21.15.12:0/1235352745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660101420 0x7f766010d950 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.240+0000 7f7666f25640 1 --2- 172.21.15.12:0/1235352745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100a80 0x7f7660100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.240+0000 7f7666f25640 1 --2- 172.21.15.12:0/1235352745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660106a80 0x7f7660106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.240+0000 7f7666f25640 1 -- 172.21.15.12:0/1235352745 >> 172.21.15.12:0/1235352745 conn(0x7f76600fc7a0 msgr2=0x7f76600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.240+0000 7f7666f25640 1 -- 172.21.15.12:0/1235352745 shutdown_connections 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.240+0000 7f7666f25640 1 -- 172.21.15.12:0/1235352745 wait complete. 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f7666f25640 1 Processor -- start 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f7666f25640 1 -- start start 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f7666f25640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100a80 0x7f76600fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f7666f25640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660101420 0x7f76600fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f7666f25640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660106a80 0x7f76600fd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f7666f25640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7660110ef0 con 0x7f7660101420 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f7666f25640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7660110d70 con 0x7f7660106a80 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f7666f25640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7660111070 con 0x7f7660100a80 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f765ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660101420 0x7f76600fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f765ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660101420 0x7f76600fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58222/0 (socket says 172.21.15.12:58222) 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f765ffff640 1 -- 172.21.15.12:0/2956251308 learned_addr learned my addr 172.21.15.12:0/2956251308 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f7664cc1640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100a80 0x7f76600fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f765ffff640 1 -- 172.21.15.12:0/2956251308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100a80 msgr2=0x7f76600fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f765ffff640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100a80 0x7f76600fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f765ffff640 1 -- 172.21.15.12:0/2956251308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660106a80 msgr2=0x7f76600fd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f76654c2640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660106a80 0x7f76600fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f765ffff640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660106a80 0x7f76600fd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f765ffff640 1 -- 172.21.15.12:0/2956251308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76601a6910 con 0x7f7660101420 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.241+0000 7f7664cc1640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100a80 0x7f76600fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.242+0000 7f765ffff640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660101420 0x7f76600fd260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f764c00b4a0 tx=0x7f764c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.242+0000 7f765dffb640 1 -- 172.21.15.12:0/2956251308 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c014070 con 0x7f7660101420 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.242+0000 7f765dffb640 1 -- 172.21.15.12:0/2956251308 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f764c010af0 con 0x7f7660101420 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.242+0000 7f7666f25640 1 -- 172.21.15.12:0/2956251308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76601a6c00 con 0x7f7660101420 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.242+0000 7f765dffb640 1 -- 172.21.15.12:0/2956251308 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c017d10 con 0x7f7660101420 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.242+0000 7f7666f25640 1 -- 172.21.15.12:0/2956251308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76601a7140 con 0x7f7660101420 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.243+0000 7f7666f25640 1 -- 172.21.15.12:0/2956251308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7660100ee0 con 0x7f7660101420 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.244+0000 7f765dffb640 1 -- 172.21.15.12:0/2956251308 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f764c017070 con 0x7f7660101420 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.245+0000 7f765dffb640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76500a3350 0x7f76500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.245+0000 7f7664cc1640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76500a3350 0x7f76500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:29.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.245+0000 7f765dffb640 1 -- 172.21.15.12:0/2956251308 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f764c0ceea0 con 0x7f7660101420 2024-09-19T06:39:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.245+0000 7f7664cc1640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76500a3350 0x7f76500a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f76540058c0 tx=0x7f7654005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.249+0000 7f765dffb640 1 -- 172.21.15.12:0/2956251308 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f764c09ba70 con 0x7f7660101420 2024-09-19T06:39:29.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.460+0000 7f7666f25640 1 -- 172.21.15.12:0/2956251308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7660109a90 con 0x7f7660101420 2024-09-19T06:39:29.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.461+0000 7f765dffb640 1 -- 172.21.15.12:0/2956251308 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11971 (secure 0 0 0) 0x7f764c09b370 con 0x7f7660101420 2024-09-19T06:39:29.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:29.463 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-19T06:38:26:674546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:38:26.674520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:39:29.463 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-19T06:39:29.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 -- 172.21.15.12:0/2956251308 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76500a3350 msgr2=0x7f76500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76500a3350 0x7f76500a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f76540058c0 tx=0x7f7654005d30 comp rx=0 tx=0).stop 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 -- 172.21.15.12:0/2956251308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660101420 msgr2=0x7f76600fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660101420 0x7f76600fd260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f764c00b4a0 tx=0x7f764c00b960 comp rx=0 tx=0).stop 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 -- 172.21.15.12:0/2956251308 shutdown_connections 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f76500a3350 0x7f76500a5810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660106a80 0x7f76600fd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660101420 0x7f76600fd260 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 --2- 172.21.15.12:0/2956251308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100a80 0x7f76600fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 -- 172.21.15.12:0/2956251308 >> 172.21.15.12:0/2956251308 conn(0x7f76600fc7a0 msgr2=0x7f766006a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 -- 172.21.15.12:0/2956251308 shutdown_connections 2024-09-19T06:39:29.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:29.463+0000 7f7666f25640 1 -- 172.21.15.12:0/2956251308 wait complete. 2024-09-19T06:39:30.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:29 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2956251308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:30.097 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:29 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2956251308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:30.130 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:38:14.665545+0000', 'modified': '2024-09-19T06:38:26.674520+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24509, 'mds_1': 24502, 'mds_2': 24481, 'mds_3': 24439, 'mds_4': 24431}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14622': {'gid': 14622, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6839/523853421', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6838', 'nonce': 523853421}, {'type': 'v1', 'addr': '172.21.15.12:6839', 'nonce': 523853421}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14634': {'gid': 14634, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6841/1524660797', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6840', 'nonce': 1524660797}, {'type': 'v1', 'addr': '172.21.15.12:6841', 'nonce': 1524660797}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.16:6833/2120245692', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 2120245692}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 2120245692}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.173:6833/1987793831', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 1987793831}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 1987793831}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.16:6835/549418858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6834', 'nonce': 549418858}, {'type': 'v1', 'addr': '172.21.15.16:6835', 'nonce': 549418858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6835/2501878004', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 2501878004}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 2501878004}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.16:6837/2891393100', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6836', 'nonce': 2891393100}, {'type': 'v1', 'addr': '172.21.15.16:6837', 'nonce': 2891393100}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/3674805378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 3674805378}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 3674805378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.173:6839/2051533953', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 2051533953}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 2051533953}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.16:6839/2939093038', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6838', 'nonce': 2939093038}, {'type': 'v1', 'addr': '172.21.15.16:6839', 'nonce': 2939093038}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24509, 'qdb_cluster': [24502, 24481, 24439, 24509, 24431]} 2024-09-19T06:39:30.130 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T06:39:30.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.k status 2024-09-19T06:39:30.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:29 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2956251308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:30.390 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:30.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.824+0000 7f2403a74640 1 -- 172.21.15.12:0/1262602822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc102dd0 msgr2=0x7f23fc1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.824+0000 7f2403a74640 1 --2- 172.21.15.12:0/1262602822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc102dd0 0x7f23fc1031b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009930 tx=0x7f23f402a420 comp rx=0 tx=0).stop 2024-09-19T06:39:30.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.824+0000 7f2403a74640 1 -- 172.21.15.12:0/1262602822 shutdown_connections 2024-09-19T06:39:30.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.824+0000 7f2403a74640 1 --2- 172.21.15.12:0/1262602822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc108300 0x7f23fc10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.824+0000 7f2403a74640 1 --2- 172.21.15.12:0/1262602822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc103780 0x7f23fc107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.824+0000 7f2403a74640 1 --2- 172.21.15.12:0/1262602822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc102dd0 0x7f23fc1031b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.824+0000 7f2403a74640 1 -- 172.21.15.12:0/1262602822 >> 172.21.15.12:0/1262602822 conn(0x7f23fc0fc7d0 msgr2=0x7f23fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.824+0000 7f2403a74640 1 -- 172.21.15.12:0/1262602822 shutdown_connections 2024-09-19T06:39:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.824+0000 7f2403a74640 1 -- 172.21.15.12:0/1262602822 wait complete. 2024-09-19T06:39:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2403a74640 1 Processor -- start 2024-09-19T06:39:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2403a74640 1 -- start start 2024-09-19T06:39:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2403a74640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc102dd0 0x7f23fc198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2403a74640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc103780 0x7f23fc198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2403a74640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc108300 0x7f23fc19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2403a74640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1120b0 con 0x7f23fc108300 2024-09-19T06:39:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2403a74640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc111f30 con 0x7f23fc103780 2024-09-19T06:39:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2403a74640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc112230 con 0x7f23fc102dd0 2024-09-19T06:39:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2402011640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc108300 0x7f23fc19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2401810640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc102dd0 0x7f23fc198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2401810640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc102dd0 0x7f23fc198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43742/0 (socket says 172.21.15.12:43742) 2024-09-19T06:39:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2401810640 1 -- 172.21.15.12:0/2885448319 learned_addr learned my addr 172.21.15.12:0/2885448319 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:30.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2402011640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc108300 0x7f23fc19cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57612/0 (socket says 172.21.15.12:57612) 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f240100f640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc103780 0x7f23fc198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2402011640 1 -- 172.21.15.12:0/2885448319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc102dd0 msgr2=0x7f23fc198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2402011640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc102dd0 0x7f23fc198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2402011640 1 -- 172.21.15.12:0/2885448319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc103780 msgr2=0x7f23fc198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2402011640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc103780 0x7f23fc198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f2402011640 1 -- 172.21.15.12:0/2885448319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc19d620 con 0x7f23fc108300 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.825+0000 7f240100f640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc103780 0x7f23fc198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.826+0000 7f2402011640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc108300 0x7f23fc19cf40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00e940 tx=0x7f23ec00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.826+0000 7f23faffd640 1 -- 172.21.15.12:0/2885448319 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec004d20 con 0x7f23fc108300 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.826+0000 7f23faffd640 1 -- 172.21.15.12:0/2885448319 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23ec005020 con 0x7f23fc108300 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.826+0000 7f2403a74640 1 -- 172.21.15.12:0/2885448319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc19d910 con 0x7f23fc108300 2024-09-19T06:39:30.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.826+0000 7f23faffd640 1 -- 172.21.15.12:0/2885448319 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec0116b0 con 0x7f23fc108300 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.826+0000 7f2403a74640 1 -- 172.21.15.12:0/2885448319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc1a51f0 con 0x7f23fc108300 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.828+0000 7f23faffd640 1 -- 172.21.15.12:0/2885448319 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f23ec0054d0 con 0x7f23fc108300 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.828+0000 7f2405e4d740 1 Processor -- start 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.828+0000 7f2405e4d740 1 -- start start 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf59d0 0x558bc9cf5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf62f0 0x558bc9d00670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d02fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2405e4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558bc9c5c090 con 0x558bc9d00bb0 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2405e4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558bc9c03a70 con 0x558bc9cf59d0 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2405e4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558bc9c58050 con 0x558bc9cf62f0 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f23faffd640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f23e40a3350 0x7f23e40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f240100f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d02fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f240100f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d02fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57620/0 (socket says 172.21.15.12:57620) 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f240100f640 1 -- 172.21.15.12:0/3882102004 learned_addr learned my addr 172.21.15.12:0/3882102004 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2401810640 1 --2- 172.21.15.12:0/3882102004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf62f0 0x558bc9d00670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f240100f640 1 --2- 172.21.15.12:0/3882102004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf59d0 0x558bc9cf5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2402011640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f23e40a3350 0x7f23e40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f23faffd640 1 -- 172.21.15.12:0/2885448319 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f23ec0cfec0 con 0x7f23fc108300 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2401810640 1 -- 172.21.15.12:0/3882102004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf59d0 msgr2=0x558bc9cf5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2401810640 1 --2- 172.21.15.12:0/3882102004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf59d0 0x558bc9cf5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2401810640 1 -- 172.21.15.12:0/3882102004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 msgr2=0x558bc9d02fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2401810640 1 --2- 172.21.15.12:0/3882102004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d02fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f2401810640 1 -- 172.21.15.12:0/3882102004 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc9c10130 con 0x558bc9cf62f0 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.829+0000 7f240100f640 1 --2- 172.21.15.12:0/3882102004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d02fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:30.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.830+0000 7f2402011640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f23e40a3350 0x7f23e40a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f23ec09bfe0 tx=0x7f23ec0671c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.830+0000 7f2401810640 1 --2- 172.21.15.12:0/3882102004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf62f0 0x558bc9d00670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009900 tx=0x7f23f40315b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=885b182707b347af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.830+0000 7f23e3fff640 1 -- 172.21.15.12:0/3882102004 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4040070 con 0x558bc9cf62f0 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.830+0000 7f23e3fff640 1 -- 172.21.15.12:0/3882102004 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f4005020 con 0x558bc9cf62f0 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.830+0000 7f23e3fff640 1 -- 172.21.15.12:0/3882102004 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4035040 con 0x558bc9cf62f0 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.830+0000 7f2405e4d740 1 -- 172.21.15.12:0/3882102004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf62f0 msgr2=0x558bc9d00670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.830+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3882102004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf62f0 0x558bc9d00670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009900 tx=0x7f23f40315b0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 -- 172.21.15.12:0/3882102004 shutdown_connections 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3882102004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d02fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3882102004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf62f0 0x558bc9d00670 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3882102004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf59d0 0x558bc9cf5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 -- 172.21.15.12:0/3882102004 >> 172.21.15.12:0/3882102004 conn(0x558bc9cf1f60 msgr2=0x558bc9cf2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 -- 172.21.15.12:0/3882102004 shutdown_connections 2024-09-19T06:39:30.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 -- 172.21.15.12:0/3882102004 wait complete. 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 -- start start 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 Processor -- start 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 0x558bc9d00390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf62f0 0x558bc9cfd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.831+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9d00bb0 0x558bc9cfdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2405e4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558bc9d03780 con 0x558bc9cf62f0 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2405e4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558bc9c16f20 con 0x558bc9d00bb0 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2405e4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558bc9d03900 con 0x558bc9cf59d0 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2405e4d740 10 client.0 _ll_register_callbacks cb 0x558bc9be0030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2401810640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf62f0 0x558bc9cfd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f240100f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 0x558bc9d00390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2401810640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf62f0 0x558bc9cfd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57624/0 (socket says 172.21.15.12:57624) 2024-09-19T06:39:30.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2401810640 1 -- 172.21.15.12:0/3085330597 learned_addr learned my addr 172.21.15.12:0/3085330597 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f240100f640 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9d00bb0 0x558bc9cfdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2401810640 1 -- 172.21.15.12:0/3085330597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 msgr2=0x558bc9d00390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2401810640 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 0x558bc9d00390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2401810640 1 -- 172.21.15.12:0/3085330597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9d00bb0 msgr2=0x558bc9cfdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2401810640 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9d00bb0 0x558bc9cfdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2401810640 1 -- 172.21.15.12:0/3085330597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc99cd2b0 con 0x558bc9cf62f0 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f240100f640 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 0x558bc9d00390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2401810640 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf62f0 0x558bc9cfd6e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23f402a460 tx=0x7f23f4031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e994ccf6aa01c2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f23e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f23e17fa640 1 -- 172.21.15.12:0/3085330597 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4040070 con 0x558bc9cf62f0 2024-09-19T06:39:30.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f23e17fa640 1 -- 172.21.15.12:0/3085330597 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f23f40053e0 con 0x558bc9cf62f0 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.832+0000 7f2405e4d740 1 -- 172.21.15.12:0/3085330597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f4005020 con 0x558bc9cf62f0 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f23e17fa640 1 -- 172.21.15.12:0/3085330597 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f23f4035050 con 0x558bc9cf62f0 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f2405e4d740 10 client.14991 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f2405e4d740 1 -- 172.21.15.12:0/3085330597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558bc9d0efe0 con 0x558bc9cf62f0 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f23e17fa640 1 -- 172.21.15.12:0/3085330597 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f4005020 con 0x558bc9cf62f0 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f23e17fa640 1 -- 172.21.15.12:0/3085330597 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f23f403c7f0 con 0x558bc9cf62f0 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f2405e4d740 10 client.14991 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f2405e4d740 10 client.14991 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f2405e4d740 20 client.14991 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x558bc9d11110 0x558bc9d12580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f2405e4d740 4 client.14991 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f2405e4d740 1 -- 172.21.15.12:0/3085330597 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bc9c69600 con 0x558bc9d11110 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.833+0000 7f240100f640 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x558bc9d11110 0x558bc9d12580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.834+0000 7f23e17fa640 10 client.14991 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.834+0000 7f240100f640 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x558bc9d11110 0x558bc9d12580 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b77fda7b77c5655 server_cookie=8b68297c99590e07 in_seq=0 out_seq=0 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f23e17fa640 1 -- 172.21.15.12:0/3085330597 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bc9c69600 con 0x558bc9d11110 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f23e17fa640 10 client.14991 handle_command_reply: tid=0 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 client.14991 shutdown 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 -- 172.21.15.12:0/3085330597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf62f0 msgr2=0x558bc9cfd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf62f0 0x558bc9cfd6e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23f402a460 tx=0x7f23f4031a90 comp rx=0 tx=0).stop 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 -- 172.21.15.12:0/3085330597 shutdown_connections 2024-09-19T06:39:30.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x558bc9d11110 0x558bc9d12580 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9d00bb0 0x558bc9cfdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf62f0 0x558bc9cfd6e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3085330597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 0x558bc9d00390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f23e17fa640 0 client.14991 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:39:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 -- 172.21.15.12:0/3085330597 >> 172.21.15.12:0/3085330597 conn(0x558bc9cf1f60 msgr2=0x558bc9cf7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 -- 172.21.15.12:0/3085330597 shutdown_connections 2024-09-19T06:39:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 1 -- 172.21.15.12:0/3085330597 wait complete. 2024-09-19T06:39:30.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.835+0000 7f2405e4d740 20 client.14991 trim_cache size 0 max 16384 2024-09-19T06:39:30.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f2405e4d740 1 Processor -- start 2024-09-19T06:39:30.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f2405e4d740 1 -- start start 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf59d0 0x558bc9d10a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf62f0 0x558bc9d11eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9d00bb0 0x558bc9cf6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f2405e4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558bc9d108c0 con 0x558bc9cf59d0 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f2405e4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558bc9d10f90 con 0x558bc9cf62f0 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f2405e4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558bc9d11660 con 0x558bc9d00bb0 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f240100f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf59d0 0x558bc9d10a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f240100f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf59d0 0x558bc9d10a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57634/0 (socket says 172.21.15.12:57634) 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f240100f640 1 -- 172.21.15.12:0/1149208622 learned_addr learned my addr 172.21.15.12:0/1149208622 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f2401810640 1 --2- 172.21.15.12:0/1149208622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf62f0 0x558bc9d11eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f240100f640 1 --2- 172.21.15.12:0/1149208622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9d00bb0 0x558bc9cf6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f240100f640 1 -- 172.21.15.12:0/1149208622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9d00bb0 msgr2=0x558bc9cf6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f240100f640 1 --2- 172.21.15.12:0/1149208622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9d00bb0 0x558bc9cf6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f240100f640 1 -- 172.21.15.12:0/1149208622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf62f0 msgr2=0x558bc9d11eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f240100f640 1 --2- 172.21.15.12:0/1149208622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf62f0 0x558bc9d11eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.853+0000 7f240100f640 1 -- 172.21.15.12:0/1149208622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc9cf6120 con 0x558bc9cf59d0 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.854+0000 7f240100f640 1 --2- 172.21.15.12:0/1149208622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf59d0 0x558bc9d10a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005780 tx=0x7f23f000c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383217f560be4a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.854+0000 7f23e37fe640 1 -- 172.21.15.12:0/1149208622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0026040 con 0x558bc9cf59d0 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.854+0000 7f23e37fe640 1 -- 172.21.15.12:0/1149208622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f0022af0 con 0x558bc9cf59d0 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.854+0000 7f23e37fe640 1 -- 172.21.15.12:0/1149208622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0003d00 con 0x558bc9cf59d0 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.854+0000 7f2405e4d740 1 -- 172.21.15.12:0/1149208622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf59d0 msgr2=0x558bc9d10a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.854+0000 7f2405e4d740 1 --2- 172.21.15.12:0/1149208622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf59d0 0x558bc9d10a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005780 tx=0x7f23f000c510 comp rx=0 tx=0).stop 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.855+0000 7f2405e4d740 1 -- 172.21.15.12:0/1149208622 shutdown_connections 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.855+0000 7f2405e4d740 1 --2- 172.21.15.12:0/1149208622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9d00bb0 0x558bc9cf6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.855+0000 7f2405e4d740 1 --2- 172.21.15.12:0/1149208622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf62f0 0x558bc9d11eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.855+0000 7f2405e4d740 1 --2- 172.21.15.12:0/1149208622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9cf59d0 0x558bc9d10a40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.855+0000 7f2405e4d740 1 -- 172.21.15.12:0/1149208622 >> 172.21.15.12:0/1149208622 conn(0x558bc9cf1f60 msgr2=0x558bc9cfee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.855+0000 7f2405e4d740 1 -- 172.21.15.12:0/1149208622 shutdown_connections 2024-09-19T06:39:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.855+0000 7f2405e4d740 1 -- 172.21.15.12:0/1149208622 wait complete. 2024-09-19T06:39:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.855+0000 7f2405e4d740 1 -- start start 2024-09-19T06:39:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.855+0000 7f2405e4d740 1 Processor -- start 2024-09-19T06:39:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 0x558bc9d19cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf62f0 0x558bc9d1a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f2405e4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d7d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f2405e4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558bc9d12400 con 0x558bc9d00bb0 2024-09-19T06:39:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f2405e4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558bc9d11d30 con 0x558bc9cf62f0 2024-09-19T06:39:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f2405e4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558bc9d12ad0 con 0x558bc9cf59d0 2024-09-19T06:39:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f2405e4d740 10 client.0 _ll_register_callbacks cb 0x7f23f000c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f240100f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d7d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f240100f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d7d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57642/0 (socket says 172.21.15.12:57642) 2024-09-19T06:39:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f240100f640 1 -- 172.21.15.12:0/3306194806 learned_addr learned my addr 172.21.15.12:0/3306194806 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f2401810640 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf62f0 0x558bc9d1a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f240100f640 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 0x558bc9d19cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f240100f640 1 -- 172.21.15.12:0/3306194806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 msgr2=0x558bc9d19cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f240100f640 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 0x558bc9d19cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f240100f640 1 -- 172.21.15.12:0/3306194806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf62f0 msgr2=0x558bc9d1a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f240100f640 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf62f0 0x558bc9d1a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f240100f640 1 -- 172.21.15.12:0/3306194806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc9d7dd90 con 0x558bc9d00bb0 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f240100f640 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d7d850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005fd0 tx=0x7f23f00056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55348290803a4a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f23e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f23e17fa640 1 -- 172.21.15.12:0/3306194806 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0003a80 con 0x558bc9d00bb0 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f23e17fa640 1 -- 172.21.15.12:0/3306194806 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f23f0003c20 con 0x558bc9d00bb0 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.856+0000 7f2405e4d740 1 -- 172.21.15.12:0/3306194806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f0022af0 con 0x558bc9d00bb0 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f23e17fa640 1 -- 172.21.15.12:0/3306194806 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f23f0041050 con 0x558bc9d00bb0 2024-09-19T06:39:30.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f2405e4d740 10 client.14997 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f2405e4d740 1 -- 172.21.15.12:0/3306194806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558bc9d7f090 con 0x558bc9d00bb0 2024-09-19T06:39:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f23e17fa640 1 -- 172.21.15.12:0/3306194806 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f0022af0 con 0x558bc9d00bb0 2024-09-19T06:39:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f23e17fa640 1 -- 172.21.15.12:0/3306194806 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f23f0022040 con 0x558bc9d00bb0 2024-09-19T06:39:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f2405e4d740 10 client.14997 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f2405e4d740 10 client.14997 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-19T06:39:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f2405e4d740 20 client.14997 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x558bc9d83980 0x558bc9d82690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f2405e4d740 4 client.14997 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:39:30.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f2405e4d740 1 -- 172.21.15.12:0/3306194806 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "status"}) -- 0x558bc9c63b10 con 0x558bc9d83980 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.857+0000 7f2401810640 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x558bc9d83980 0x558bc9d82690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2401810640 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x558bc9d83980 0x558bc9d82690 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a718824657c232d2 server_cookie=bb0357c6c4e5018b in_seq=0 out_seq=0 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f23e17fa640 10 client.14997 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f23e17fa640 1 -- 172.21.15.12:0/3306194806 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x558bc9c63b10 con 0x558bc9d83980 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f23e17fa640 10 client.14997 handle_command_reply: tid=0 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 client.14997 shutdown 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 -- 172.21.15.12:0/3306194806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 msgr2=0x558bc9d7d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d7d850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005fd0 tx=0x7f23f00056d0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 -- 172.21.15.12:0/3306194806 shutdown_connections 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x558bc9d83980 0x558bc9d82690 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558bc9d00bb0 0x558bc9d7d850 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558bc9cf62f0 0x558bc9d1a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 --2- 172.21.15.12:0/3306194806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558bc9cf59d0 0x558bc9d19cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f23e17fa640 0 client.14997 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:39:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 -- 172.21.15.12:0/3306194806 >> 172.21.15.12:0/3306194806 conn(0x558bc9cf1f60 msgr2=0x558bc9cff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 -- 172.21.15.12:0/3306194806 shutdown_connections 2024-09-19T06:39:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 1 -- 172.21.15.12:0/3306194806 wait complete. 2024-09-19T06:39:30.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.858+0000 7f2405e4d740 20 client.14997 trim_cache size 0 max 16384 2024-09-19T06:39:30.867 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 4, 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24431, 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 65.197409649999997, 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 115.97038784 2024-09-19T06:39:30.868 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:39:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 -- 172.21.15.12:0/2885448319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f23e40a3350 msgr2=0x7f23e40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f23e40a3350 0x7f23e40a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f23ec09bfe0 tx=0x7f23ec0671c0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 -- 172.21.15.12:0/2885448319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc108300 msgr2=0x7f23fc19cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc108300 0x7f23fc19cf40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00e940 tx=0x7f23ec00ee00 comp rx=0 tx=0).stop 2024-09-19T06:39:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 -- 172.21.15.12:0/2885448319 shutdown_connections 2024-09-19T06:39:30.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f23e40a3350 0x7f23e40a5810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23fc108300 0x7f23fc19cf40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23fc103780 0x7f23fc198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 --2- 172.21.15.12:0/2885448319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc102dd0 0x7f23fc198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:30.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 -- 172.21.15.12:0/2885448319 >> 172.21.15.12:0/2885448319 conn(0x7f23fc0fc7d0 msgr2=0x7f23fc105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:30.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 -- 172.21.15.12:0/2885448319 shutdown_connections 2024-09-19T06:39:30.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:30.859+0000 7f2403a74640 1 -- 172.21.15.12:0/2885448319 wait complete. 2024-09-19T06:39:31.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:30 smithi173 ceph-mon[35349]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T06:39:31.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:30 smithi173 ceph-mon[35349]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-19T06:39:31.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:30 smithi173 ceph-mon[35349]: Cluster is now healthy 2024-09-19T06:39:31.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:30 smithi012 ceph-mon[30937]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T06:39:31.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:30 smithi012 ceph-mon[30937]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-19T06:39:31.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:30 smithi012 ceph-mon[30937]: Cluster is now healthy 2024-09-19T06:39:31.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:30 smithi016 ceph-mon[34911]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s; 8 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T06:39:31.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:30 smithi016 ceph-mon[34911]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-19T06:39:31.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:30 smithi016 ceph-mon[34911]: Cluster is now healthy 2024-09-19T06:39:31.617 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.l status 2024-09-19T06:39:31.871 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.291+0000 7f8417f01640 1 -- 172.21.15.12:0/4114414529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8410100e20 msgr2=0x7f8410101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.291+0000 7f8417f01640 1 --2- 172.21.15.12:0/4114414529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8410100e20 0x7f8410101200 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f840c009900 tx=0x7f840c02a480 comp rx=0 tx=0).stop 2024-09-19T06:39:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.291+0000 7f8417f01640 1 -- 172.21.15.12:0/4114414529 shutdown_connections 2024-09-19T06:39:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.291+0000 7f8417f01640 1 --2- 172.21.15.12:0/4114414529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8410102ef0 0x7f841010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.291+0000 7f8417f01640 1 --2- 172.21.15.12:0/4114414529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8410102570 0x7f84101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.291+0000 7f8417f01640 1 --2- 172.21.15.12:0/4114414529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8410100e20 0x7f8410101200 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.291+0000 7f8417f01640 1 -- 172.21.15.12:0/4114414529 >> 172.21.15.12:0/4114414529 conn(0x7f84100fc7d0 msgr2=0x7f84100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.291+0000 7f8417f01640 1 -- 172.21.15.12:0/4114414529 shutdown_connections 2024-09-19T06:39:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.291+0000 7f8417f01640 1 -- 172.21.15.12:0/4114414529 wait complete. 2024-09-19T06:39:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.291+0000 7f8417f01640 1 Processor -- start 2024-09-19T06:39:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8417f01640 1 -- start start 2024-09-19T06:39:32.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8417f01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8410100e20 0x7f84101994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8417f01640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8410102570 0x7f8410199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8417f01640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8410102ef0 0x7f84101a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8417f01640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8410111020 con 0x7f8410100e20 2024-09-19T06:39:32.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8415c9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8410100e20 0x7f84101994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8417f01640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8410110ea0 con 0x7f8410102570 2024-09-19T06:39:32.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8417f01640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84101111a0 con 0x7f8410102ef0 2024-09-19T06:39:32.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8415c9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8410100e20 0x7f84101994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57656/0 (socket says 172.21.15.12:57656) 2024-09-19T06:39:32.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8415c9d640 1 -- 172.21.15.12:0/1732052071 learned_addr learned my addr 172.21.15.12:0/1732052071 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f841549c640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8410102570 0x7f8410199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f841649e640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8410102ef0 0x7f84101a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8415c9d640 1 -- 172.21.15.12:0/1732052071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8410102ef0 msgr2=0x7f84101a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.292+0000 7f8415c9d640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8410102ef0 0x7f84101a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.293+0000 7f8415c9d640 1 -- 172.21.15.12:0/1732052071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8410102570 msgr2=0x7f8410199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.293+0000 7f8415c9d640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8410102570 0x7f8410199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.293+0000 7f8415c9d640 1 -- 172.21.15.12:0/1732052071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84101a4ab0 con 0x7f8410100e20 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.293+0000 7f8415c9d640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8410100e20 0x7f84101994f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f840c006010 tx=0x7f840c03ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.293+0000 7f8406ffd640 1 -- 172.21.15.12:0/1732052071 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c035070 con 0x7f8410100e20 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.293+0000 7f8406ffd640 1 -- 172.21.15.12:0/1732052071 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f840c003ce0 con 0x7f8410100e20 2024-09-19T06:39:32.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.293+0000 7f8417f01640 1 -- 172.21.15.12:0/1732052071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84101972e0 con 0x7f8410100e20 2024-09-19T06:39:32.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.293+0000 7f8406ffd640 1 -- 172.21.15.12:0/1732052071 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0433c0 con 0x7f8410100e20 2024-09-19T06:39:32.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.293+0000 7f8417f01640 1 -- 172.21.15.12:0/1732052071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8410197810 con 0x7f8410100e20 2024-09-19T06:39:32.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.295+0000 7f8406ffd640 1 -- 172.21.15.12:0/1732052071 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f840c003800 con 0x7f8410100e20 2024-09-19T06:39:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f841a2da740 1 Processor -- start 2024-09-19T06:39:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f841a2da740 1 -- start start 2024-09-19T06:39:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f841a2da740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 0x5644c871cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f841a2da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c8727670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f841a2da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c8727bb0 0x5644c8729fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f841a2da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5644c8683090 con 0x5644c871d2f0 2024-09-19T06:39:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f841a2da740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5644c862aa70 con 0x5644c871c9d0 2024-09-19T06:39:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f841a2da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5644c867f050 con 0x5644c8727bb0 2024-09-19T06:39:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f8415c9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c8727670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f8415c9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c8727670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57660/0 (socket says 172.21.15.12:57660) 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f8415c9d640 1 -- 172.21.15.12:0/848074794 learned_addr learned my addr 172.21.15.12:0/848074794 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f841649e640 1 --2- 172.21.15.12:0/848074794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 0x5644c871cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.296+0000 7f8406ffd640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83fc0a3350 0x7f83fc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f841549c640 1 --2- 172.21.15.12:0/848074794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c8727bb0 0x5644c8729fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f841649e640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83fc0a3350 0x7f83fc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f841649e640 1 -- 172.21.15.12:0/848074794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c8727bb0 msgr2=0x5644c8729fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f841649e640 1 --2- 172.21.15.12:0/848074794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c8727bb0 0x5644c8729fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f841649e640 1 -- 172.21.15.12:0/848074794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 msgr2=0x5644c8727670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f841649e640 1 --2- 172.21.15.12:0/848074794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c8727670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f841649e640 1 -- 172.21.15.12:0/848074794 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c8637130 con 0x5644c871c9d0 2024-09-19T06:39:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f8406ffd640 1 -- 172.21.15.12:0/1732052071 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f840c0f3f20 con 0x7f8410100e20 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f8415c9d640 1 --2- 172.21.15.12:0/848074794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c8727670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f841649e640 1 --2- 172.21.15.12:0/848074794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 0x5644c871cdb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f840800a8b0 tx=0x7f840800ad70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9a74225a1361125 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f841649e640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83fc0a3350 0x7f83fc0a5810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f84080155c0 tx=0x7f840801c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.297+0000 7f83fbfff640 1 -- 172.21.15.12:0/848074794 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840801d040 con 0x5644c871c9d0 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.298+0000 7f83fbfff640 1 -- 172.21.15.12:0/848074794 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8408019cf0 con 0x5644c871c9d0 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.298+0000 7f83fbfff640 1 -- 172.21.15.12:0/848074794 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408022c90 con 0x5644c871c9d0 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.298+0000 7f841a2da740 1 -- 172.21.15.12:0/848074794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 msgr2=0x5644c871cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.298+0000 7f841a2da740 1 --2- 172.21.15.12:0/848074794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 0x5644c871cdb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f840800a8b0 tx=0x7f840800ad70 comp rx=0 tx=0).stop 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.298+0000 7f841a2da740 1 -- 172.21.15.12:0/848074794 shutdown_connections 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.298+0000 7f841a2da740 1 --2- 172.21.15.12:0/848074794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c8727bb0 0x5644c8729fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.298+0000 7f841a2da740 1 --2- 172.21.15.12:0/848074794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c8727670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.298+0000 7f841a2da740 1 --2- 172.21.15.12:0/848074794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 0x5644c871cdb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.298+0000 7f841a2da740 1 -- 172.21.15.12:0/848074794 >> 172.21.15.12:0/848074794 conn(0x5644c8718f60 msgr2=0x5644c8719340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.298+0000 7f841a2da740 1 -- 172.21.15.12:0/848074794 shutdown_connections 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.299+0000 7f841a2da740 1 -- 172.21.15.12:0/848074794 wait complete. 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.299+0000 7f841a2da740 1 -- start start 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.299+0000 7f841a2da740 1 Processor -- start 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.299+0000 7f841a2da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871c9d0 0x5644c8727460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.299+0000 7f841a2da740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871d2f0 0x5644c87247b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.299+0000 7f841a2da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c8727bb0 0x5644c8724cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.299+0000 7f841a2da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5644c872a7d0 con 0x5644c8727bb0 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.299+0000 7f841a2da740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5644c863df20 con 0x5644c871d2f0 2024-09-19T06:39:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.299+0000 7f841a2da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5644c872a950 con 0x5644c871c9d0 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841a2da740 10 client.0 _ll_register_callbacks cb 0x5644c8607030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841649e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c8727bb0 0x5644c8724cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f8415c9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871c9d0 0x5644c8727460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841649e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c8727bb0 0x5644c8724cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57672/0 (socket says 172.21.15.12:57672) 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841649e640 1 -- 172.21.15.12:0/1257367288 learned_addr learned my addr 172.21.15.12:0/1257367288 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841549c640 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871d2f0 0x5644c87247b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841649e640 1 -- 172.21.15.12:0/1257367288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871c9d0 msgr2=0x5644c8727460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841649e640 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871c9d0 0x5644c8727460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841649e640 1 -- 172.21.15.12:0/1257367288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871d2f0 msgr2=0x5644c87247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841649e640 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871d2f0 0x5644c87247b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841649e640 1 -- 172.21.15.12:0/1257367288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c83f42b0 con 0x5644c8727bb0 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841649e640 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c8727bb0 0x5644c8724cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8408022810 tx=0x7f8408019ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365ca1989d787aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f83f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f83f97fa640 1 -- 172.21.15.12:0/1257367288 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408030070 con 0x5644c8727bb0 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f83f97fa640 1 -- 172.21.15.12:0/1257367288 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f84080197e0 con 0x5644c8727bb0 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.300+0000 7f841a2da740 1 -- 172.21.15.12:0/1257367288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8408019cf0 con 0x5644c8727bb0 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f83f97fa640 1 -- 172.21.15.12:0/1257367288 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f840803c050 con 0x5644c8727bb0 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f841a2da740 10 client.15009 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f841a2da740 1 -- 172.21.15.12:0/1257367288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5644c87360f0 con 0x5644c8727bb0 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f83f97fa640 1 -- 172.21.15.12:0/1257367288 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8408019cf0 con 0x5644c8727bb0 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f83f97fa640 1 -- 172.21.15.12:0/1257367288 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f840802c400 con 0x5644c8727bb0 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f841a2da740 10 client.15009 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f841a2da740 10 client.15009 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-19T06:39:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f841a2da740 20 client.15009 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f841a2da740 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5644c8738570 0x5644c87399e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f841a2da740 4 client.15009 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:39:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.301+0000 7f841a2da740 1 -- 172.21.15.12:0/1257367288 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644c8690600 con 0x5644c8738570 2024-09-19T06:39:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.302+0000 7f8415c9d640 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5644c8738570 0x5644c87399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.302+0000 7f8415c9d640 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5644c8738570 0x5644c87399e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=99bb83f164bb218b server_cookie=2b0da1606b85b6db in_seq=0 out_seq=0 2024-09-19T06:39:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.302+0000 7f83f97fa640 10 client.15009 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:39:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f83f97fa640 1 -- 172.21.15.12:0/1257367288 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644c8690600 con 0x5644c8738570 2024-09-19T06:39:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f83f97fa640 10 client.15009 handle_command_reply: tid=0 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 client.15009 shutdown 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 -- 172.21.15.12:0/1257367288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c8727bb0 msgr2=0x5644c8724cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c8727bb0 0x5644c8724cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8408022810 tx=0x7f8408019ea0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 -- 172.21.15.12:0/1257367288 shutdown_connections 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5644c8738570 0x5644c87399e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c8727bb0 0x5644c8724cf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871d2f0 0x5644c87247b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f83f97fa640 0 client.15009 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 --2- 172.21.15.12:0/1257367288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871c9d0 0x5644c8727460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 -- 172.21.15.12:0/1257367288 >> 172.21.15.12:0/1257367288 conn(0x5644c8718f60 msgr2=0x5644c871ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 -- 172.21.15.12:0/1257367288 shutdown_connections 2024-09-19T06:39:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 1 -- 172.21.15.12:0/1257367288 wait complete. 2024-09-19T06:39:32.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.303+0000 7f841a2da740 20 client.15009 trim_cache size 0 max 16384 2024-09-19T06:39:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.321+0000 7f841a2da740 1 Processor -- start 2024-09-19T06:39:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.321+0000 7f841a2da740 1 -- start start 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.321+0000 7f841a2da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871c9d0 0x5644c87399e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.321+0000 7f841a2da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871d2f0 0x5644c871e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.321+0000 7f841a2da740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c8727bb0 0x5644c871e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.321+0000 7f841a2da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5644c8737d20 con 0x5644c871c9d0 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.321+0000 7f841a2da740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5644c87383f0 con 0x5644c8727bb0 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.321+0000 7f841a2da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5644c8738ac0 con 0x5644c871d2f0 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f8415c9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871c9d0 0x5644c87399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f8415c9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871c9d0 0x5644c87399e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57678/0 (socket says 172.21.15.12:57678) 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f8415c9d640 1 -- 172.21.15.12:0/500585330 learned_addr learned my addr 172.21.15.12:0/500585330 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f841649e640 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c8727bb0 0x5644c871e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f841549c640 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871d2f0 0x5644c871e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f8415c9d640 1 -- 172.21.15.12:0/500585330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871d2f0 msgr2=0x5644c871e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f8415c9d640 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871d2f0 0x5644c871e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f8415c9d640 1 -- 172.21.15.12:0/500585330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c8727bb0 msgr2=0x5644c871e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f8415c9d640 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c8727bb0 0x5644c871e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f8415c9d640 1 -- 172.21.15.12:0/500585330 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c87277d0 con 0x5644c871c9d0 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f841649e640 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c8727bb0 0x5644c871e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f841549c640 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871d2f0 0x5644c871e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f8415c9d640 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871c9d0 0x5644c87399e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f840c000c00 tx=0x7f840c0f6410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44f9d2ebc78048 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f83fb7fe640 1 -- 172.21.15.12:0/500585330 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0c0110 con 0x5644c871c9d0 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f83fb7fe640 1 -- 172.21.15.12:0/500585330 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f840c0c0a40 con 0x5644c871c9d0 2024-09-19T06:39:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.322+0000 7f83fb7fe640 1 -- 172.21.15.12:0/500585330 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0bfca0 con 0x5644c871c9d0 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 -- 172.21.15.12:0/500585330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871c9d0 msgr2=0x5644c87399e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871c9d0 0x5644c87399e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f840c000c00 tx=0x7f840c0f6410 comp rx=0 tx=0).stop 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 -- 172.21.15.12:0/500585330 shutdown_connections 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c8727bb0 0x5644c871e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c871d2f0 0x5644c871e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 --2- 172.21.15.12:0/500585330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871c9d0 0x5644c87399e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 -- 172.21.15.12:0/500585330 >> 172.21.15.12:0/500585330 conn(0x5644c8718f60 msgr2=0x5644c87230c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 -- 172.21.15.12:0/500585330 shutdown_connections 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 -- 172.21.15.12:0/500585330 wait complete. 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 -- start start 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.323+0000 7f841a2da740 1 Processor -- start 2024-09-19T06:39:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841a2da740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 0x5644c873e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841a2da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c873eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841a2da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c8727bb0 0x5644c873b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841a2da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5644c8739860 con 0x5644c871d2f0 2024-09-19T06:39:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841a2da740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5644c8739190 con 0x5644c871c9d0 2024-09-19T06:39:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841a2da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5644c8739f30 con 0x5644c8727bb0 2024-09-19T06:39:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841a2da740 10 client.0 _ll_register_callbacks cb 0x7f840c0bc5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841549c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c873eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841549c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c873eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57680/0 (socket says 172.21.15.12:57680) 2024-09-19T06:39:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841549c640 1 -- 172.21.15.12:0/4256919315 learned_addr learned my addr 172.21.15.12:0/4256919315 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841649e640 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c8727bb0 0x5644c873b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f8415c9d640 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 0x5644c873e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841549c640 1 -- 172.21.15.12:0/4256919315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c8727bb0 msgr2=0x5644c873b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841549c640 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c8727bb0 0x5644c873b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841549c640 1 -- 172.21.15.12:0/4256919315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 msgr2=0x5644c873e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841549c640 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 0x5644c873e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841549c640 1 -- 172.21.15.12:0/4256919315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c873b6d0 con 0x5644c871d2f0 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f8415c9d640 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 0x5644c873e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f841549c640 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c873eef0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x5644c871a2e0 tx=0x7f8400016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbf85da9add2911 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f83f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.324+0000 7f83f97fa640 1 -- 172.21.15.12:0/4256919315 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400024060 con 0x5644c871d2f0 2024-09-19T06:39:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f83f97fa640 1 -- 172.21.15.12:0/4256919315 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f84000147e0 con 0x5644c871d2f0 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f841a2da740 1 -- 172.21.15.12:0/4256919315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f840c0c0a40 con 0x5644c871d2f0 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f83f97fa640 1 -- 172.21.15.12:0/4256919315 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f84000149e0 con 0x5644c871d2f0 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f841a2da740 10 client.15015 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f841a2da740 1 -- 172.21.15.12:0/4256919315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5644c8740170 con 0x5644c871d2f0 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f83f97fa640 1 -- 172.21.15.12:0/4256919315 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f840c0c0a40 con 0x5644c871d2f0 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f83f97fa640 1 -- 172.21.15.12:0/4256919315 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f840001d340 con 0x5644c871d2f0 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f841a2da740 10 client.15015 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f841a2da740 10 client.15015 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f841a2da740 20 client.15015 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f841a2da740 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5644c87a71f0 0x5644c87a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f841a2da740 4 client.15015 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:39:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f841a2da740 1 -- 172.21.15.12:0/4256919315 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "status"}) -- 0x5644c868ab10 con 0x5644c87a71f0 2024-09-19T06:39:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.325+0000 7f8415c9d640 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5644c87a71f0 0x5644c87a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f8415c9d640 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5644c87a71f0 0x5644c87a5f00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a14a9383490d5f80 server_cookie=b435ce49a02003c9 in_seq=0 out_seq=0 2024-09-19T06:39:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f83f97fa640 10 client.15015 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:39:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f83f97fa640 1 -- 172.21.15.12:0/4256919315 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5644c868ab10 con 0x5644c87a71f0 2024-09-19T06:39:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f83f97fa640 10 client.15015 handle_command_reply: tid=0 2024-09-19T06:39:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 client.15015 shutdown 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 -- 172.21.15.12:0/4256919315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 msgr2=0x5644c873eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c873eef0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x5644c871a2e0 tx=0x7f8400016b00 comp rx=0 tx=0).stop 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 -- 172.21.15.12:0/4256919315 shutdown_connections 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5644c87a71f0 0x5644c87a5f00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5644c8727bb0 0x5644c873b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f83f97fa640 0 client.15015 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5644c871d2f0 0x5644c873eef0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 --2- 172.21.15.12:0/4256919315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5644c871c9d0 0x5644c873e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 -- 172.21.15.12:0/4256919315 >> 172.21.15.12:0/4256919315 conn(0x5644c8718f60 msgr2=0x5644c87177e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 -- 172.21.15.12:0/4256919315 shutdown_connections 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.326+0000 7f841a2da740 1 -- 172.21.15.12:0/4256919315 wait complete. 2024-09-19T06:39:32.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f841a2da740 20 client.15015 trim_cache size 0 max 16384 2024-09-19T06:39:32.337 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:39:32.337 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:39:32.337 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 3, 2024-09-19T06:39:32.337 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24439, 2024-09-19T06:39:32.337 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:39:32.337 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:39:32.337 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:39:32.337 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 67.672010976999999, 2024-09-19T06:39:32.338 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-19T06:39:32.338 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-19T06:39:32.338 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T06:39:32.338 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 120.18716363599999 2024-09-19T06:39:32.338 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:39:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 -- 172.21.15.12:0/1732052071 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83fc0a3350 msgr2=0x7f83fc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83fc0a3350 0x7f83fc0a5810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f84080155c0 tx=0x7f840801c000 comp rx=0 tx=0).stop 2024-09-19T06:39:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 -- 172.21.15.12:0/1732052071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8410100e20 msgr2=0x7f84101994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8410100e20 0x7f84101994f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f840c006010 tx=0x7f840c03ac80 comp rx=0 tx=0).stop 2024-09-19T06:39:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 -- 172.21.15.12:0/1732052071 shutdown_connections 2024-09-19T06:39:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83fc0a3350 0x7f83fc0a5810 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8410102ef0 0x7f84101a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8410102570 0x7f8410199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 --2- 172.21.15.12:0/1732052071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8410100e20 0x7f84101994f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 -- 172.21.15.12:0/1732052071 >> 172.21.15.12:0/1732052071 conn(0x7f84100fc7d0 msgr2=0x7f84100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 -- 172.21.15.12:0/1732052071 shutdown_connections 2024-09-19T06:39:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:32.327+0000 7f8417f01640 1 -- 172.21.15.12:0/1732052071 wait complete. 2024-09-19T06:39:33.034 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:32 smithi012 ceph-mon[30937]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 7 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T06:39:33.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T06:39:33.060 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:32 smithi016 ceph-mon[34911]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 7 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T06:39:33.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:32 smithi173 ceph-mon[35349]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 7 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T06:39:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:33.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.725+0000 7f47936e1640 1 -- 172.21.15.12:0/3212949518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f478c074590 msgr2=0x7f478c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.725+0000 7f47936e1640 1 --2- 172.21.15.12:0/3212949518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f478c074590 0x7f478c074970 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4788009900 tx=0x7f478802a480 comp rx=0 tx=0).stop 2024-09-19T06:39:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.725+0000 7f47936e1640 1 -- 172.21.15.12:0/3212949518 shutdown_connections 2024-09-19T06:39:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.725+0000 7f47936e1640 1 --2- 172.21.15.12:0/3212949518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f478c112b90 0x7f478c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.725+0000 7f47936e1640 1 --2- 172.21.15.12:0/3212949518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f478c074eb0 0x7f478c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.725+0000 7f47936e1640 1 --2- 172.21.15.12:0/3212949518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f478c074590 0x7f478c074970 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.725+0000 7f47936e1640 1 -- 172.21.15.12:0/3212949518 >> 172.21.15.12:0/3212949518 conn(0x7f478c0fd8c0 msgr2=0x7f478c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.726+0000 7f47936e1640 1 -- 172.21.15.12:0/3212949518 shutdown_connections 2024-09-19T06:39:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.726+0000 7f47936e1640 1 -- 172.21.15.12:0/3212949518 wait complete. 2024-09-19T06:39:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.726+0000 7f47936e1640 1 Processor -- start 2024-09-19T06:39:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.726+0000 7f47936e1640 1 -- start start 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.726+0000 7f47936e1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f478c074590 0x7f478c1a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.726+0000 7f47936e1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f478c074eb0 0x7f478c1a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.726+0000 7f47936e1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f478c112b90 0x7f478c19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.726+0000 7f47936e1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f478c118650 con 0x7f478c074590 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.726+0000 7f47936e1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f478c1184d0 con 0x7f478c074eb0 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.726+0000 7f47936e1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f478c1187d0 con 0x7f478c112b90 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f479147d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f478c074590 0x7f478c1a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f479147d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f478c074590 0x7f478c1a4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57708/0 (socket says 172.21.15.12:57708) 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f479147d640 1 -- 172.21.15.12:0/978242060 learned_addr learned my addr 172.21.15.12:0/978242060 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f4791c7e640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f478c112b90 0x7f478c19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f4790c7c640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f478c074eb0 0x7f478c1a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f479147d640 1 -- 172.21.15.12:0/978242060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f478c112b90 msgr2=0x7f478c19eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f479147d640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f478c112b90 0x7f478c19eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f479147d640 1 -- 172.21.15.12:0/978242060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f478c074eb0 msgr2=0x7f478c1a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f479147d640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f478c074eb0 0x7f478c1a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f479147d640 1 -- 172.21.15.12:0/978242060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c19f1f0 con 0x7f478c074590 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f479147d640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f478c074590 0x7f478c1a4900 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4788005ab0 tx=0x7f47880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f47827fc640 1 -- 172.21.15.12:0/978242060 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478803f030 con 0x7f478c074590 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f47827fc640 1 -- 172.21.15.12:0/978242060 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4788003ce0 con 0x7f478c074590 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f47936e1640 1 -- 172.21.15.12:0/978242060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478c19f480 con 0x7f478c074590 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.727+0000 7f47827fc640 1 -- 172.21.15.12:0/978242060 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788035070 con 0x7f478c074590 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.728+0000 7f47936e1640 1 -- 172.21.15.12:0/978242060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478c1ab7d0 con 0x7f478c074590 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.730+0000 7f47827fc640 1 -- 172.21.15.12:0/978242060 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4788042030 con 0x7f478c074590 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.730+0000 7f4795aba740 1 Processor -- start 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.730+0000 7f4795aba740 1 -- start start 2024-09-19T06:39:33.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4795aba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b81db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4795aba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b822f0 0x55f7c6b8c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4795aba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b8efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4795aba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6ae8090 con 0x55f7c6b819d0 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4795aba740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6a8fa70 con 0x55f7c6b8cbb0 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4795aba740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6ae4050 con 0x55f7c6b822f0 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4791c7e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b81db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f47827fc640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f47780a3350 0x7f47780a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4791c7e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b81db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57724/0 (socket says 172.21.15.12:57724) 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4791c7e640 1 -- 172.21.15.12:0/1720563412 learned_addr learned my addr 172.21.15.12:0/1720563412 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4790c7c640 1 --2- 172.21.15.12:0/1720563412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b8efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f479147d640 1 --2- 172.21.15.12:0/1720563412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b822f0 0x55f7c6b8c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4791c7e640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f47780a3350 0x7f47780a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f47827fc640 1 -- 172.21.15.12:0/978242060 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f47880f03f0 con 0x7f478c074590 2024-09-19T06:39:33.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4791c7e640 1 -- 172.21.15.12:0/1720563412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b822f0 msgr2=0x55f7c6b8c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:33.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4791c7e640 1 --2- 172.21.15.12:0/1720563412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b822f0 0x55f7c6b8c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4791c7e640 1 -- 172.21.15.12:0/1720563412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 msgr2=0x55f7c6b8efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:33.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4791c7e640 1 --2- 172.21.15.12:0/1720563412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b8efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4791c7e640 1 -- 172.21.15.12:0/1720563412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c6a9c130 con 0x55f7c6b819d0 2024-09-19T06:39:33.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4790c7c640 1 --2- 172.21.15.12:0/1720563412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b8efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:33.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.731+0000 7f4791c7e640 1 --2- 172.21.15.12:0/1720563412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b81db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f478400a960 tx=0x7f478400ae20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239915bba05fe283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:33.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f47777fe640 1 -- 172.21.15.12:0/1720563412 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478401d030 con 0x55f7c6b819d0 2024-09-19T06:39:33.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f47777fe640 1 -- 172.21.15.12:0/1720563412 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4784015c40 con 0x55f7c6b819d0 2024-09-19T06:39:33.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f47777fe640 1 -- 172.21.15.12:0/1720563412 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47840213c0 con 0x55f7c6b819d0 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f4795aba740 1 -- 172.21.15.12:0/1720563412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 msgr2=0x55f7c6b81db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f4791c7e640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f47780a3350 0x7f47780a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4784020000 tx=0x7f478401e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f4795aba740 1 --2- 172.21.15.12:0/1720563412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b81db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f478400a960 tx=0x7f478400ae20 comp rx=0 tx=0).stop 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f4795aba740 1 -- 172.21.15.12:0/1720563412 shutdown_connections 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f4795aba740 1 --2- 172.21.15.12:0/1720563412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b8efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f4795aba740 1 --2- 172.21.15.12:0/1720563412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b822f0 0x55f7c6b8c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f4795aba740 1 --2- 172.21.15.12:0/1720563412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b81db0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f4795aba740 1 -- 172.21.15.12:0/1720563412 >> 172.21.15.12:0/1720563412 conn(0x55f7c6b7df60 msgr2=0x55f7c6b7e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.732+0000 7f4795aba740 1 -- 172.21.15.12:0/1720563412 shutdown_connections 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.733+0000 7f4795aba740 1 -- 172.21.15.12:0/1720563412 wait complete. 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.733+0000 7f4795aba740 1 -- start start 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.733+0000 7f4795aba740 1 Processor -- start 2024-09-19T06:39:33.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.733+0000 7f4795aba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b8c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.733+0000 7f4795aba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b822f0 0x55f7c6b89790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.733+0000 7f4795aba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b89cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.733+0000 7f479147d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b8c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.733+0000 7f479147d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b8c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57730/0 (socket says 172.21.15.12:57730) 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.733+0000 7f479147d640 1 -- 172.21.15.12:0/2307095947 learned_addr learned my addr 172.21.15.12:0/2307095947 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.733+0000 7f4795aba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6b8f780 con 0x55f7c6b819d0 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f4795aba740 1 -- 172.21.15.12:0/2307095947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6aa2f20 con 0x55f7c6b8cbb0 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f4795aba740 1 -- 172.21.15.12:0/2307095947 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6b8f900 con 0x55f7c6b822f0 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f4795aba740 10 client.0 _ll_register_callbacks cb 0x55f7c6a6c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f4790c7c640 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b822f0 0x55f7c6b89790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f4791c7e640 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b89cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f479147d640 1 -- 172.21.15.12:0/2307095947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b822f0 msgr2=0x55f7c6b89790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:33.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f479147d640 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b822f0 0x55f7c6b89790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f479147d640 1 -- 172.21.15.12:0/2307095947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 msgr2=0x55f7c6b89cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f479147d640 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b89cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f479147d640 1 -- 172.21.15.12:0/2307095947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7c68592b0 con 0x55f7c6b819d0 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f4791c7e640 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b89cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f479147d640 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b8c440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47880c4ef0 tx=0x7f478803b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1e66095902b78b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f4774ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f4774ff9640 1 -- 172.21.15.12:0/2307095947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788049040 con 0x55f7c6b819d0 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f4774ff9640 1 -- 172.21.15.12:0/2307095947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f47880b8e20 con 0x55f7c6b819d0 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.734+0000 7f4795aba740 1 -- 172.21.15.12:0/2307095947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4784015c40 con 0x55f7c6b819d0 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4774ff9640 1 -- 172.21.15.12:0/2307095947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f47880bc2f0 con 0x55f7c6b819d0 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4795aba740 10 client.15027 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4795aba740 1 -- 172.21.15.12:0/2307095947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f7c6b9b090 con 0x55f7c6b819d0 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4774ff9640 1 -- 172.21.15.12:0/2307095947 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4784015c40 con 0x55f7c6b819d0 2024-09-19T06:39:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4774ff9640 1 -- 172.21.15.12:0/2307095947 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f47880edef0 con 0x55f7c6b819d0 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4795aba740 10 client.15027 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4795aba740 10 client.15027 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4795aba740 20 client.15027 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4795aba740 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f7c6b9d720 0x55f7c6b9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4795aba740 4 client.15027 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4795aba740 1 -- 172.21.15.12:0/2307095947 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7c6af5600 con 0x55f7c6b9d720 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.735+0000 7f4790c7c640 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f7c6b9d720 0x55f7c6b9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.736+0000 7f4790c7c640 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f7c6b9d720 0x55f7c6b9eb90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=572518382c1f49d2 server_cookie=1afcc9cda8571ce2 in_seq=0 out_seq=0 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.736+0000 7f4774ff9640 10 client.15027 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4774ff9640 1 -- 172.21.15.12:0/2307095947 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f7c6af5600 con 0x55f7c6b9d720 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4774ff9640 10 client.15027 handle_command_reply: tid=0 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 client.15027 shutdown 2024-09-19T06:39:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 -- 172.21.15.12:0/2307095947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 msgr2=0x55f7c6b8c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b8c440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47880c4ef0 tx=0x7f478803b790 comp rx=0 tx=0).stop 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 -- 172.21.15.12:0/2307095947 shutdown_connections 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f7c6b9d720 0x55f7c6b9eb90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b89cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b822f0 0x55f7c6b89790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4774ff9640 0 client.15027 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 --2- 172.21.15.12:0/2307095947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b8c440 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 -- 172.21.15.12:0/2307095947 >> 172.21.15.12:0/2307095947 conn(0x55f7c6b7df60 msgr2=0x55f7c6b83c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 -- 172.21.15.12:0/2307095947 shutdown_connections 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 1 -- 172.21.15.12:0/2307095947 wait complete. 2024-09-19T06:39:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.737+0000 7f4795aba740 20 client.15027 trim_cache size 0 max 16384 2024-09-19T06:39:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.755+0000 7f4795aba740 1 Processor -- start 2024-09-19T06:39:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.755+0000 7f4795aba740 1 -- start start 2024-09-19T06:39:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.755+0000 7f4795aba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.755+0000 7f4795aba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 0x55f7c6b78ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.755+0000 7f4795aba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b88060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.755+0000 7f4795aba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6b9ced0 con 0x55f7c6b819d0 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.755+0000 7f4795aba740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6b9d5a0 con 0x55f7c6b822f0 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.755+0000 7f4795aba740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6b9dc70 con 0x55f7c6b8cbb0 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.755+0000 7f479147d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f479147d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b9eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57738/0 (socket says 172.21.15.12:57738) 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f479147d640 1 -- 172.21.15.12:0/3842526404 learned_addr learned my addr 172.21.15.12:0/3842526404 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f4790c7c640 1 --2- 172.21.15.12:0/3842526404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 0x55f7c6b78ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f4791c7e640 1 --2- 172.21.15.12:0/3842526404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b88060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f479147d640 1 -- 172.21.15.12:0/3842526404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b8cbb0 msgr2=0x55f7c6b88060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f479147d640 1 --2- 172.21.15.12:0/3842526404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b88060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f479147d640 1 -- 172.21.15.12:0/3842526404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 msgr2=0x55f7c6b78ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f479147d640 1 --2- 172.21.15.12:0/3842526404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 0x55f7c6b78ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f479147d640 1 -- 172.21.15.12:0/3842526404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c6b8f890 con 0x55f7c6b819d0 2024-09-19T06:39:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f4790c7c640 1 --2- 172.21.15.12:0/3842526404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 0x55f7c6b78ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f479147d640 1 --2- 172.21.15.12:0/3842526404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b9eb90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47880b8c10 tx=0x7f4788005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1db01153adfb877 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f4776ffd640 1 -- 172.21.15.12:0/3842526404 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788049070 con 0x55f7c6b819d0 2024-09-19T06:39:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f4776ffd640 1 -- 172.21.15.12:0/3842526404 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47880bceb0 con 0x55f7c6b819d0 2024-09-19T06:39:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.756+0000 7f4776ffd640 1 -- 172.21.15.12:0/3842526404 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47880bc110 con 0x55f7c6b819d0 2024-09-19T06:39:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 -- 172.21.15.12:0/3842526404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 msgr2=0x55f7c6b9eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 --2- 172.21.15.12:0/3842526404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b9eb90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47880b8c10 tx=0x7f4788005d50 comp rx=0 tx=0).stop 2024-09-19T06:39:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 -- 172.21.15.12:0/3842526404 shutdown_connections 2024-09-19T06:39:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 --2- 172.21.15.12:0/3842526404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6b88060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 --2- 172.21.15.12:0/3842526404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 0x55f7c6b78ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 --2- 172.21.15.12:0/3842526404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b9eb90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 -- 172.21.15.12:0/3842526404 >> 172.21.15.12:0/3842526404 conn(0x55f7c6b7df60 msgr2=0x55f7c6b9c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 -- 172.21.15.12:0/3842526404 shutdown_connections 2024-09-19T06:39:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 -- 172.21.15.12:0/3842526404 wait complete. 2024-09-19T06:39:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 -- start start 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.757+0000 7f4795aba740 1 Processor -- start 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f4795aba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b86180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f4795aba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 0x55f7c6b866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f4795aba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6ba5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f4795aba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6b9ea10 con 0x55f7c6b819d0 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f4795aba740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6b9e340 con 0x55f7c6b822f0 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f4795aba740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f7c6b9f0e0 con 0x55f7c6b8cbb0 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f4795aba740 10 client.0 _ll_register_callbacks cb 0x7f4788005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f479147d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b86180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f479147d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b86180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57750/0 (socket says 172.21.15.12:57750) 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f479147d640 1 -- 172.21.15.12:0/2728434774 learned_addr learned my addr 172.21.15.12:0/2728434774 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f4791c7e640 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6ba5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f4790c7c640 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 0x55f7c6b866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f479147d640 1 -- 172.21.15.12:0/2728434774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b8cbb0 msgr2=0x55f7c6ba5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f479147d640 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6ba5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f479147d640 1 -- 172.21.15.12:0/2728434774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 msgr2=0x55f7c6b866c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f479147d640 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 0x55f7c6b866c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.758+0000 7f479147d640 1 -- 172.21.15.12:0/2728434774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7c6ba6320 con 0x55f7c6b819d0 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f479147d640 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b86180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4788005de0 tx=0x7f478802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9b92e4c124b8ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4774ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4774ff9640 1 -- 172.21.15.12:0/2728434774 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788049070 con 0x55f7c6b819d0 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4774ff9640 1 -- 172.21.15.12:0/2728434774 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f4788031dd0 con 0x55f7c6b819d0 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4795aba740 1 -- 172.21.15.12:0/2728434774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47880bceb0 con 0x55f7c6b819d0 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4774ff9640 1 -- 172.21.15.12:0/2728434774 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f47880bc110 con 0x55f7c6b819d0 2024-09-19T06:39:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4795aba740 10 client.15033 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4795aba740 1 -- 172.21.15.12:0/2728434774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f7c6ba6320 con 0x55f7c6b819d0 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4774ff9640 1 -- 172.21.15.12:0/2728434774 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47880bceb0 con 0x55f7c6b819d0 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4774ff9640 1 -- 172.21.15.12:0/2728434774 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f47880c4f90 con 0x55f7c6b819d0 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4795aba740 10 client.15033 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4795aba740 10 client.15033 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4795aba740 20 client.15033 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4795aba740 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f7c6c0ba70 0x55f7c6c0a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4795aba740 4 client.15033 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.759+0000 7f4795aba740 1 -- 172.21.15.12:0/2728434774 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "status"}) -- 0x55f7c6aefb10 con 0x55f7c6c0ba70 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4790c7c640 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f7c6c0ba70 0x55f7c6c0a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4790c7c640 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f7c6c0ba70 0x55f7c6c0a780 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b61086ac15b3b9a9 server_cookie=3edf9f3d9b2185b7 in_seq=0 out_seq=0 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4774ff9640 10 client.15033 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:39:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4774ff9640 1 -- 172.21.15.12:0/2728434774 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f7c6aefb10 con 0x55f7c6c0ba70 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4774ff9640 10 client.15033 handle_command_reply: tid=0 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4795aba740 1 client.15033 shutdown 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4795aba740 1 -- 172.21.15.12:0/2728434774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 msgr2=0x55f7c6b86180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4795aba740 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b86180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4788005de0 tx=0x7f478802a480 comp rx=0 tx=0).stop 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4795aba740 1 -- 172.21.15.12:0/2728434774 shutdown_connections 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4795aba740 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f7c6c0ba70 0x55f7c6c0a780 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4795aba740 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7c6b8cbb0 0x55f7c6ba5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4795aba740 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f7c6b822f0 0x55f7c6b866c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4795aba740 1 --2- 172.21.15.12:0/2728434774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7c6b819d0 0x55f7c6b86180 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.760+0000 7f4774ff9640 0 client.15033 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f4795aba740 1 -- 172.21.15.12:0/2728434774 >> 172.21.15.12:0/2728434774 conn(0x55f7c6b7df60 msgr2=0x55f7c6b83420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f4795aba740 1 -- 172.21.15.12:0/2728434774 shutdown_connections 2024-09-19T06:39:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f4795aba740 1 -- 172.21.15.12:0/2728434774 wait complete. 2024-09-19T06:39:33.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f4795aba740 20 client.15033 trim_cache size 0 max 16384 2024-09-19T06:39:33.768 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:39:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:39:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 2, 2024-09-19T06:39:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24481, 2024-09-19T06:39:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:39:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:39:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:39:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 69.690480328000007, 2024-09-19T06:39:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-19T06:39:33.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-19T06:39:33.769 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T06:39:33.769 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 104.36332544699999 2024-09-19T06:39:33.769 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:39:33.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 -- 172.21.15.12:0/978242060 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f47780a3350 msgr2=0x7f47780a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f47780a3350 0x7f47780a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4784020000 tx=0x7f478401e000 comp rx=0 tx=0).stop 2024-09-19T06:39:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 -- 172.21.15.12:0/978242060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f478c074590 msgr2=0x7f478c1a4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f478c074590 0x7f478c1a4900 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4788005ab0 tx=0x7f47880042f0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 -- 172.21.15.12:0/978242060 shutdown_connections 2024-09-19T06:39:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f47780a3350 0x7f47780a5810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f478c112b90 0x7f478c19eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f478c074eb0 0x7f478c1a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 --2- 172.21.15.12:0/978242060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f478c074590 0x7f478c1a4900 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 -- 172.21.15.12:0/978242060 >> 172.21.15.12:0/978242060 conn(0x7f478c0fd8c0 msgr2=0x7f478c0ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 -- 172.21.15.12:0/978242060 shutdown_connections 2024-09-19T06:39:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:33.761+0000 7f47936e1640 1 -- 172.21.15.12:0/978242060 wait complete. 2024-09-19T06:39:34.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:39:34.758 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:35.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:34 smithi173 ceph-mon[35349]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 6 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T06:39:35.126 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:34 smithi012 ceph-mon[30937]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 6 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.208+0000 7fa577d20640 1 -- 172.21.15.12:0/1145839137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57010e480 msgr2=0x7fa570110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.208+0000 7fa577d20640 1 --2- 172.21.15.12:0/1145839137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57010e480 0x7fa570110870 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa568009ca0 tx=0x7fa56802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.208+0000 7fa577d20640 1 -- 172.21.15.12:0/1145839137 shutdown_connections 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.208+0000 7fa577d20640 1 --2- 172.21.15.12:0/1145839137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa57010e480 0x7fa570110870 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.208+0000 7fa577d20640 1 --2- 172.21.15.12:0/1145839137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa570101280 0x7fa57010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.208+0000 7fa577d20640 1 --2- 172.21.15.12:0/1145839137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5701008d0 0x7fa570100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.208+0000 7fa577d20640 1 -- 172.21.15.12:0/1145839137 >> 172.21.15.12:0/1145839137 conn(0x7fa5700fc7a0 msgr2=0x7fa5700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.208+0000 7fa577d20640 1 -- 172.21.15.12:0/1145839137 shutdown_connections 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.208+0000 7fa577d20640 1 -- 172.21.15.12:0/1145839137 wait complete. 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa577d20640 1 Processor -- start 2024-09-19T06:39:35.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa577d20640 1 -- start start 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa577d20640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5701008d0 0x7fa57019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa577d20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa570101280 0x7fa57019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa577d20640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57010e480 0x7fa57019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa577d20640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa5701141c0 con 0x7fa570101280 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa577d20640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa570114040 con 0x7fa5701008d0 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa577d20640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa570114340 con 0x7fa57010e480 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa5752bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa570101280 0x7fa57019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa5752bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa570101280 0x7fa57019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57764/0 (socket says 172.21.15.12:57764) 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.209+0000 7fa5752bb640 1 -- 172.21.15.12:0/1590234407 learned_addr learned my addr 172.21.15.12:0/1590234407 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa5762bd640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57010e480 0x7fa57019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa575abc640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5701008d0 0x7fa57019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa5752bb640 1 -- 172.21.15.12:0/1590234407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57010e480 msgr2=0x7fa57019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:35.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa5752bb640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57010e480 0x7fa57019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa5752bb640 1 -- 172.21.15.12:0/1590234407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5701008d0 msgr2=0x7fa57019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa5752bb640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5701008d0 0x7fa57019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa5752bb640 1 -- 172.21.15.12:0/1590234407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57019f5d0 con 0x7fa570101280 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa5762bd640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57010e480 0x7fa57019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa5752bb640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa570101280 0x7fa57019ab60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa56000b4a0 tx=0x7fa56000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa566ffd640 1 -- 172.21.15.12:0/1590234407 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560014070 con 0x7fa570101280 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa577d20640 1 -- 172.21.15.12:0/1590234407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa57019f8c0 con 0x7fa570101280 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa566ffd640 1 -- 172.21.15.12:0/1590234407 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa560010af0 con 0x7fa570101280 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa566ffd640 1 -- 172.21.15.12:0/1590234407 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560017d10 con 0x7fa570101280 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.210+0000 7fa577d20640 1 -- 172.21.15.12:0/1590234407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5701a71a0 con 0x7fa570101280 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.212+0000 7fa566ffd640 1 -- 172.21.15.12:0/1590234407 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa560017070 con 0x7fa570101280 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa57a0f9740 1 Processor -- start 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa57a0f9740 1 -- start start 2024-09-19T06:39:35.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e23db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e30fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558d09d8a090 con 0x558d09e239d0 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558d09d31a70 con 0x558d09e242f0 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558d09d86050 con 0x558d09e2ebb0 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa5762bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e23db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa5762bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e23db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57766/0 (socket says 172.21.15.12:57766) 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.213+0000 7fa5762bd640 1 -- 172.21.15.12:0/3295543930 learned_addr learned my addr 172.21.15.12:0/3295543930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa5752bb640 1 --2- 172.21.15.12:0/3295543930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e30fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa575abc640 1 --2- 172.21.15.12:0/3295543930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa566ffd640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa55c0a32d0 0x7fa55c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa5762bd640 1 -- 172.21.15.12:0/3295543930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 msgr2=0x558d09e30fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa5762bd640 1 --2- 172.21.15.12:0/3295543930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e30fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa5762bd640 1 -- 172.21.15.12:0/3295543930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 msgr2=0x558d09e2e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa5762bd640 1 --2- 172.21.15.12:0/3295543930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa5762bd640 1 -- 172.21.15.12:0/3295543930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d09d3e130 con 0x558d09e239d0 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa5752bb640 1 --2- 172.21.15.12:0/3295543930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e30fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa566ffd640 1 -- 172.21.15.12:0/1590234407 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fa5600cef10 con 0x7fa570101280 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa5762bd640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa55c0a32d0 0x7fa55c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa5762bd640 1 --2- 172.21.15.12:0/3295543930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e23db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa568031bb0 tx=0x7fa568031be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758d43cac4883a81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa55bfff640 1 -- 172.21.15.12:0/3295543930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5680319a0 con 0x558d09e239d0 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa55bfff640 1 -- 172.21.15.12:0/3295543930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa568036070 con 0x558d09e239d0 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.214+0000 7fa55bfff640 1 -- 172.21.15.12:0/3295543930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56802fc80 con 0x558d09e239d0 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.215+0000 7fa57a0f9740 1 -- 172.21.15.12:0/3295543930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 msgr2=0x558d09e23db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.215+0000 7fa5762bd640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa55c0a32d0 0x7fa55c0a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa56804b000 tx=0x7fa568048000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.215+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/3295543930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e23db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa568031bb0 tx=0x7fa568031be0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.215+0000 7fa57a0f9740 1 -- 172.21.15.12:0/3295543930 shutdown_connections 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.215+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/3295543930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e30fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.215+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/3295543930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.215+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/3295543930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e23db0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.215+0000 7fa57a0f9740 1 -- 172.21.15.12:0/3295543930 >> 172.21.15.12:0/3295543930 conn(0x558d09e1ff60 msgr2=0x558d09e20340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.215+0000 7fa57a0f9740 1 -- 172.21.15.12:0/3295543930 shutdown_connections 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.215+0000 7fa57a0f9740 1 -- 172.21.15.12:0/3295543930 wait complete. 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa57a0f9740 1 -- start start 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa57a0f9740 1 Processor -- start 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e2bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558d09e31600 con 0x558d09e239d0 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558d09d44f20 con 0x558d09e242f0 2024-09-19T06:39:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558d09e31780 con 0x558d09e2ebb0 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa575abc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa57a0f9740 10 client.0 _ll_register_callbacks cb 0x558d09d0e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa575abc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57770/0 (socket says 172.21.15.12:57770) 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa575abc640 1 -- 172.21.15.12:0/1125980201 learned_addr learned my addr 172.21.15.12:0/1125980201 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa5762bd640 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e2bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.216+0000 7fa5752bb640 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa575abc640 1 -- 172.21.15.12:0/1125980201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 msgr2=0x558d09e2bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa575abc640 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e2bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa575abc640 1 -- 172.21.15.12:0/1125980201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 msgr2=0x558d09e2b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa575abc640 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa575abc640 1 -- 172.21.15.12:0/1125980201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d09afb2b0 con 0x558d09e239d0 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa575abc640 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2e420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa56c010770 tx=0x7fa56c010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50900966feafc7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa5597fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa5597fa640 1 -- 172.21.15.12:0/1125980201 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c01d060 con 0x558d09e239d0 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa5597fa640 1 -- 172.21.15.12:0/1125980201 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fa56c00eda0 con 0x558d09e239d0 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1125980201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa568036070 con 0x558d09e239d0 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa5597fa640 1 -- 172.21.15.12:0/1125980201 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa56c022430 con 0x558d09e239d0 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa57a0f9740 10 client.15045 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1125980201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d09e3cef0 con 0x558d09e239d0 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.217+0000 7fa5597fa640 1 -- 172.21.15.12:0/1125980201 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa568036070 con 0x558d09e239d0 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.218+0000 7fa5597fa640 1 -- 172.21.15.12:0/1125980201 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa56c016590 con 0x558d09e239d0 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.218+0000 7fa57a0f9740 10 client.15045 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.218+0000 7fa57a0f9740 10 client.15045 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:39:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.218+0000 7fa57a0f9740 20 client.15045 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.218+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x558d09e3f530 0x558d09e409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.218+0000 7fa57a0f9740 4 client.15045 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:39:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.218+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1125980201 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d09d97600 con 0x558d09e3f530 2024-09-19T06:39:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.218+0000 7fa5752bb640 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x558d09e3f530 0x558d09e409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.218+0000 7fa5752bb640 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x558d09e3f530 0x558d09e409a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f45c85087ad59abf server_cookie=6851d95c09e49bd8 in_seq=0 out_seq=0 2024-09-19T06:39:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.218+0000 7fa5597fa640 10 client.15045 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:39:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa5597fa640 1 -- 172.21.15.12:0/1125980201 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d09d97600 con 0x558d09e3f530 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa5597fa640 10 client.15045 handle_command_reply: tid=0 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa57a0f9740 1 client.15045 shutdown 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1125980201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 msgr2=0x558d09e2e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2e420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa56c010770 tx=0x7fa56c010c30 comp rx=0 tx=0).stop 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1125980201 shutdown_connections 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x558d09e3f530 0x558d09e409a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e2bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa5597fa640 0 client.15045 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1125980201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2e420 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.219+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1125980201 >> 172.21.15.12:0/1125980201 conn(0x558d09e1ff60 msgr2=0x558d09e25c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.220+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1125980201 shutdown_connections 2024-09-19T06:39:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.220+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1125980201 wait complete. 2024-09-19T06:39:35.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.220+0000 7fa57a0f9740 20 client.15045 trim_cache size 0 max 16384 2024-09-19T06:39:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa57a0f9740 1 Processor -- start 2024-09-19T06:39:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa57a0f9740 1 -- start start 2024-09-19T06:39:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e48c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558d09e3ece0 con 0x558d09e239d0 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558d09e3f3b0 con 0x558d09e242f0 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558d09e3fa80 con 0x558d09e2ebb0 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa575abc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa575abc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57784/0 (socket says 172.21.15.12:57784) 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa575abc640 1 -- 172.21.15.12:0/4259230522 learned_addr learned my addr 172.21.15.12:0/4259230522 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa5762bd640 1 --2- 172.21.15.12:0/4259230522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e48c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa575abc640 1 -- 172.21.15.12:0/4259230522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 msgr2=0x558d09e48c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa575abc640 1 --2- 172.21.15.12:0/4259230522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e48c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa575abc640 1 -- 172.21.15.12:0/4259230522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 msgr2=0x558d09e2a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:35.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa575abc640 1 --2- 172.21.15.12:0/4259230522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa575abc640 1 -- 172.21.15.12:0/4259230522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d09e2e750 con 0x558d09e239d0 2024-09-19T06:39:35.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.238+0000 7fa575abc640 1 --2- 172.21.15.12:0/4259230522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2a040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00b610 tx=0x7fa56c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2dc6939dd9291f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:35.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa55b7fe640 1 -- 172.21.15.12:0/4259230522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c016da0 con 0x558d09e239d0 2024-09-19T06:39:35.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa55b7fe640 1 -- 172.21.15.12:0/4259230522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa56c00eba0 con 0x558d09e239d0 2024-09-19T06:39:35.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa55b7fe640 1 -- 172.21.15.12:0/4259230522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c004640 con 0x558d09e239d0 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa57a0f9740 1 -- 172.21.15.12:0/4259230522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 msgr2=0x558d09e2a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/4259230522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2a040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00b610 tx=0x7fa56c011f10 comp rx=0 tx=0).stop 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa57a0f9740 1 -- 172.21.15.12:0/4259230522 shutdown_connections 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/4259230522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e2ebb0 0x558d09e48c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/4259230522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e242f0 0x558d09e2a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/4259230522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e2a040 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa57a0f9740 1 -- 172.21.15.12:0/4259230522 >> 172.21.15.12:0/4259230522 conn(0x558d09e1ff60 msgr2=0x558d09e20340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa57a0f9740 1 -- 172.21.15.12:0/4259230522 shutdown_connections 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.239+0000 7fa57a0f9740 1 -- 172.21.15.12:0/4259230522 wait complete. 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa57a0f9740 1 -- start start 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa57a0f9740 1 Processor -- start 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e43be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e242f0 0x558d09e44120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa57a0f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e2ebb0 0x558d09e44660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558d09e40820 con 0x558d09e239d0 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558d09e40150 con 0x558d09e2ebb0 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa57a0f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558d09e40ef0 con 0x558d09e242f0 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa57a0f9740 10 client.0 _ll_register_callbacks cb 0x7fa56c00b640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa575abc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e43be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa575abc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e43be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57796/0 (socket says 172.21.15.12:57796) 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa575abc640 1 -- 172.21.15.12:0/1217775739 learned_addr learned my addr 172.21.15.12:0/1217775739 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.240+0000 7fa5752bb640 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e242f0 0x558d09e44120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa5762bd640 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e2ebb0 0x558d09e44660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa575abc640 1 -- 172.21.15.12:0/1217775739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e242f0 msgr2=0x558d09e44120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa575abc640 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e242f0 0x558d09e44120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa575abc640 1 -- 172.21.15.12:0/1217775739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e2ebb0 msgr2=0x558d09e44660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa575abc640 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e2ebb0 0x558d09e44660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa575abc640 1 -- 172.21.15.12:0/1217775739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d09ea7e50 con 0x558d09e239d0 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa575abc640 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e43be0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00bce0 tx=0x7fa56c00e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf83c4f92a0ea74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa5597fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa5597fa640 1 -- 172.21.15.12:0/1217775739 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c039060 con 0x558d09e239d0 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa5597fa640 1 -- 172.21.15.12:0/1217775739 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fa56c010240 con 0x558d09e239d0 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1217775739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa56c00eba0 con 0x558d09e239d0 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa5597fa640 1 -- 172.21.15.12:0/1217775739 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa56c016b20 con 0x558d09e239d0 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa57a0f9740 10 client.15051 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1217775739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558d09ea9130 con 0x558d09e239d0 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.241+0000 7fa5597fa640 1 -- 172.21.15.12:0/1217775739 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa56c00eba0 con 0x558d09e239d0 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.242+0000 7fa5597fa640 1 -- 172.21.15.12:0/1217775739 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa56c022a90 con 0x558d09e239d0 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.242+0000 7fa57a0f9740 10 client.15051 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:35.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.242+0000 7fa57a0f9740 10 client.15051 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.242+0000 7fa57a0f9740 20 client.15051 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.242+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x558d09e3f530 0x558d09eac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.242+0000 7fa57a0f9740 4 client.15051 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.242+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1217775739 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "status"}) -- 0x558d09d91b10 con 0x558d09e3f530 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.242+0000 7fa5752bb640 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x558d09e3f530 0x558d09eac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa5597fa640 10 client.15051 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa5752bb640 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x558d09e3f530 0x558d09eac630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55475fa82c963e48 server_cookie=cccd53ff45592746 in_seq=0 out_seq=0 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa5597fa640 1 -- 172.21.15.12:0/1217775739 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558d09d91b10 con 0x558d09e3f530 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa5597fa640 10 client.15051 handle_command_reply: tid=0 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 client.15051 shutdown 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1217775739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 msgr2=0x558d09e43be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e43be0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00bce0 tx=0x7fa56c00e7f0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1217775739 shutdown_connections 2024-09-19T06:39:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x558d09e3f530 0x558d09eac630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558d09e2ebb0 0x558d09e44660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558d09e242f0 0x558d09e44120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa5597fa640 0 client.15051 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:39:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 --2- 172.21.15.12:0/1217775739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558d09e239d0 0x558d09e43be0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1217775739 >> 172.21.15.12:0/1217775739 conn(0x558d09e1ff60 msgr2=0x558d09e29ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1217775739 shutdown_connections 2024-09-19T06:39:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 1 -- 172.21.15.12:0/1217775739 wait complete. 2024-09-19T06:39:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.243+0000 7fa57a0f9740 20 client.15051 trim_cache size 0 max 16384 2024-09-19T06:39:35.249 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 1, 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24502, 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 73.178358579999994, 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 100.688107124 2024-09-19T06:39:35.250 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:39:35.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 -- 172.21.15.12:0/1590234407 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa55c0a32d0 msgr2=0x7fa55c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:35.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa55c0a32d0 0x7fa55c0a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa56804b000 tx=0x7fa568048000 comp rx=0 tx=0).stop 2024-09-19T06:39:35.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 -- 172.21.15.12:0/1590234407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa570101280 msgr2=0x7fa57019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:35.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa570101280 0x7fa57019ab60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa56000b4a0 tx=0x7fa56000b960 comp rx=0 tx=0).stop 2024-09-19T06:39:35.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 -- 172.21.15.12:0/1590234407 shutdown_connections 2024-09-19T06:39:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fa55c0a32d0 0x7fa55c0a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa57010e480 0x7fa57019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa570101280 0x7fa57019ab60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 --2- 172.21.15.12:0/1590234407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5701008d0 0x7fa57019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 -- 172.21.15.12:0/1590234407 >> 172.21.15.12:0/1590234407 conn(0x7fa5700fc7a0 msgr2=0x7fa5700feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 -- 172.21.15.12:0/1590234407 shutdown_connections 2024-09-19T06:39:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:35.244+0000 7fa577d20640 1 -- 172.21.15.12:0/1590234407 wait complete. 2024-09-19T06:39:35.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:34 smithi016 ceph-mon[34911]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 6 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T06:39:36.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:39:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:36.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 -- 172.21.15.12:0/3346615536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fe4102d30 msgr2=0x7f9fe4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:36.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 --2- 172.21.15.12:0/3346615536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fe4102d30 0x7f9fe4103110 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009930 tx=0x7f9fdc02a420 comp rx=0 tx=0).stop 2024-09-19T06:39:36.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 -- 172.21.15.12:0/3346615536 shutdown_connections 2024-09-19T06:39:36.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 --2- 172.21.15.12:0/3346615536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fe41082a0 0x7f9fe410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 --2- 172.21.15.12:0/3346615536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fe41036e0 0x7f9fe4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 --2- 172.21.15.12:0/3346615536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fe4102d30 0x7f9fe4103110 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 -- 172.21.15.12:0/3346615536 >> 172.21.15.12:0/3346615536 conn(0x7f9fe40fc7d0 msgr2=0x7f9fe40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:36.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 -- 172.21.15.12:0/3346615536 shutdown_connections 2024-09-19T06:39:36.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 -- 172.21.15.12:0/3346615536 wait complete. 2024-09-19T06:39:36.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 Processor -- start 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.725+0000 7f9febf5e640 1 -- start start 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9febf5e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fe4102d30 0x7f9fe41985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9febf5e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fe41036e0 0x7f9fe4198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9febf5e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fe41082a0 0x7f9fe419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9febf5e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe41120a0 con 0x7f9fe41036e0 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9febf5e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe4111f20 con 0x7f9fe4102d30 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9febf5e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe4112220 con 0x7f9fe41082a0 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe94f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fe41036e0 0x7f9fe4198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe94f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fe41036e0 0x7f9fe4198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57802/0 (socket says 172.21.15.12:57802) 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe94f9640 1 -- 172.21.15.12:0/2213036189 learned_addr learned my addr 172.21.15.12:0/2213036189 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fe41082a0 0x7f9fe419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fe4102d30 0x7f9fe41985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe94f9640 1 -- 172.21.15.12:0/2213036189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fe41082a0 msgr2=0x7f9fe419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fe41082a0 0x7f9fe419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe94f9640 1 -- 172.21.15.12:0/2213036189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fe4102d30 msgr2=0x7f9fe41985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fe4102d30 0x7f9fe41985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe94f9640 1 -- 172.21.15.12:0/2213036189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe419d580 con 0x7f9fe41036e0 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fe41036e0 0x7f9fe4198b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800c970 tx=0x7f9fd800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.726+0000 7f9fe2ffd640 1 -- 172.21.15.12:0/2213036189 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8007bb0 con 0x7f9fe41036e0 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.727+0000 7f9fe2ffd640 1 -- 172.21.15.12:0/2213036189 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd8007d50 con 0x7f9fe41036e0 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.727+0000 7f9febf5e640 1 -- 172.21.15.12:0/2213036189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe419d870 con 0x7f9fe41036e0 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.727+0000 7f9fe2ffd640 1 -- 172.21.15.12:0/2213036189 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800f450 con 0x7f9fe41036e0 2024-09-19T06:39:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.727+0000 7f9febf5e640 1 -- 172.21.15.12:0/2213036189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe41a5150 con 0x7f9fe41036e0 2024-09-19T06:39:36.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fe2ffd640 1 -- 172.21.15.12:0/2213036189 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9fd8004f60 con 0x7f9fe41036e0 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fee337740 1 Processor -- start 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fee337740 1 -- start start 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fee337740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bd6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fee337740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd72f0 0x55ecf2be1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fee337740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 0x55ecf2be3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fee337740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2b3d090 con 0x55ecf2bd69d0 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fee337740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2ae4a70 con 0x55ecf2bd72f0 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fee337740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2b39050 con 0x55ecf2be1bb0 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fea4fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bd6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fea4fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bd6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57806/0 (socket says 172.21.15.12:57806) 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fea4fb640 1 -- 172.21.15.12:0/3543395632 learned_addr learned my addr 172.21.15.12:0/3543395632 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/3543395632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 0x55ecf2be3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.730+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/3543395632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd72f0 0x55ecf2be1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fea4fb640 1 -- 172.21.15.12:0/3543395632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 msgr2=0x55ecf2be3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/3543395632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 0x55ecf2be3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fea4fb640 1 -- 172.21.15.12:0/3543395632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd72f0 msgr2=0x55ecf2be1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/3543395632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd72f0 0x55ecf2be1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fea4fb640 1 -- 172.21.15.12:0/3543395632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf2af1130 con 0x55ecf2bd69d0 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/3543395632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 0x55ecf2be3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fe2ffd640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9fcc0a3350 0x7f9fcc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9fcc0a3350 0x7f9fcc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fe2ffd640 1 -- 172.21.15.12:0/2213036189 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f9fd80cf760 con 0x7f9fe41036e0 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/3543395632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bd6db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009f50 tx=0x7f9fd40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239cc06281c2abcd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fcbfff640 1 -- 172.21.15.12:0/3543395632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4004d20 con 0x55ecf2bd69d0 2024-09-19T06:39:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fcbfff640 1 -- 172.21.15.12:0/3543395632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd4004050 con 0x55ecf2bd69d0 2024-09-19T06:39:36.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.731+0000 7f9fcbfff640 1 -- 172.21.15.12:0/3543395632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4005280 con 0x55ecf2bd69d0 2024-09-19T06:39:36.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.732+0000 7f9fee337740 1 -- 172.21.15.12:0/3543395632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 msgr2=0x55ecf2bd6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:36.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.732+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9fcc0a3350 0x7f9fcc0a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009900 tx=0x7f9fdc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:36.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.732+0000 7f9fee337740 1 --2- 172.21.15.12:0/3543395632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bd6db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009f50 tx=0x7f9fd40118d0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.732+0000 7f9fee337740 1 -- 172.21.15.12:0/3543395632 shutdown_connections 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.732+0000 7f9fee337740 1 --2- 172.21.15.12:0/3543395632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 0x55ecf2be3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.732+0000 7f9fee337740 1 --2- 172.21.15.12:0/3543395632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd72f0 0x55ecf2be1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.732+0000 7f9fee337740 1 --2- 172.21.15.12:0/3543395632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bd6db0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.732+0000 7f9fee337740 1 -- 172.21.15.12:0/3543395632 >> 172.21.15.12:0/3543395632 conn(0x55ecf2bd2f60 msgr2=0x55ecf2bd3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.732+0000 7f9fee337740 1 -- 172.21.15.12:0/3543395632 shutdown_connections 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.732+0000 7f9fee337740 1 -- 172.21.15.12:0/3543395632 wait complete. 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fee337740 1 -- start start 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fee337740 1 Processor -- start 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fee337740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2be1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fee337740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bde790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fee337740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2be1bb0 0x55ecf2bdecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fee337740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2be4780 con 0x55ecf2bd69d0 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fee337740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2af7f20 con 0x55ecf2be1bb0 2024-09-19T06:39:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fee337740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2be4900 con 0x55ecf2bd72f0 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fee337740 10 client.0 _ll_register_callbacks cb 0x55ecf2ac1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fe9cfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2be1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fe9cfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2be1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57808/0 (socket says 172.21.15.12:57808) 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fe9cfa640 1 -- 172.21.15.12:0/2836150928 learned_addr learned my addr 172.21.15.12:0/2836150928 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bde790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.733+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2be1bb0 0x55ecf2bdecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fe9cfa640 1 -- 172.21.15.12:0/2836150928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 msgr2=0x55ecf2bde790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bde790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fe9cfa640 1 -- 172.21.15.12:0/2836150928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2be1bb0 msgr2=0x55ecf2bdecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2be1bb0 0x55ecf2bdecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fe9cfa640 1 -- 172.21.15.12:0/2836150928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecf28ae2b0 con 0x55ecf2bd69d0 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2be1bb0 0x55ecf2bdecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bde790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2be1440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0096c0 tx=0x7f9fdc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101e3f3ea31b95c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fc97fa640 1 -- 172.21.15.12:0/2836150928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc04e070 con 0x55ecf2bd69d0 2024-09-19T06:39:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fc97fa640 1 -- 172.21.15.12:0/2836150928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f9fdc003cc0 con 0x55ecf2bd69d0 2024-09-19T06:39:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fee337740 1 -- 172.21.15.12:0/2836150928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fd4004050 con 0x55ecf2bd69d0 2024-09-19T06:39:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fc97fa640 1 -- 172.21.15.12:0/2836150928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9fdc035040 con 0x55ecf2bd69d0 2024-09-19T06:39:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fee337740 10 client.15063 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.734+0000 7f9fee337740 1 -- 172.21.15.12:0/2836150928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ecf2bf0090 con 0x55ecf2bd69d0 2024-09-19T06:39:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fc97fa640 1 -- 172.21.15.12:0/2836150928 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fdc05a070 con 0x55ecf2bd69d0 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fc97fa640 1 -- 172.21.15.12:0/2836150928 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9fdc03d4e0 con 0x55ecf2bd69d0 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fee337740 10 client.15063 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fee337740 10 client.15063 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fee337740 20 client.15063 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fee337740 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ecf2bf26f0 0x55ecf2bf3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fee337740 4 client.15063 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fee337740 1 -- 172.21.15.12:0/2836150928 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecf2b4a600 con 0x55ecf2bf26f0 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ecf2bf26f0 0x55ecf2bf3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ecf2bf26f0 0x55ecf2bf3b60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3813412e0fec1e1d server_cookie=bf52cbc52c37c908 in_seq=0 out_seq=0 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.735+0000 7f9fc97fa640 10 client.15063 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fc97fa640 1 -- 172.21.15.12:0/2836150928 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ecf2b4a600 con 0x55ecf2bf26f0 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fc97fa640 10 client.15063 handle_command_reply: tid=0 2024-09-19T06:39:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fee337740 1 client.15063 shutdown 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fee337740 1 -- 172.21.15.12:0/2836150928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 msgr2=0x55ecf2be1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fee337740 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2be1440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0096c0 tx=0x7f9fdc009260 comp rx=0 tx=0).stop 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fee337740 1 -- 172.21.15.12:0/2836150928 shutdown_connections 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fee337740 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ecf2bf26f0 0x55ecf2bf3b60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fee337740 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2be1bb0 0x55ecf2bdecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fee337740 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bde790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fc97fa640 0 client.15063 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.736+0000 7f9fee337740 1 --2- 172.21.15.12:0/2836150928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2be1440 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.737+0000 7f9fee337740 1 -- 172.21.15.12:0/2836150928 >> 172.21.15.12:0/2836150928 conn(0x55ecf2bd2f60 msgr2=0x55ecf2bd8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.737+0000 7f9fee337740 1 -- 172.21.15.12:0/2836150928 shutdown_connections 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.737+0000 7f9fee337740 1 -- 172.21.15.12:0/2836150928 wait complete. 2024-09-19T06:39:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.737+0000 7f9fee337740 20 client.15063 trim_cache size 0 max 16384 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.754+0000 7f9fee337740 1 Processor -- start 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fee337740 1 -- start start 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fee337740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fee337740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bdece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fee337740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 0x55ecf2bcdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fee337740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2bf1ea0 con 0x55ecf2bd69d0 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fee337740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2bf2570 con 0x55ecf2bd72f0 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fee337740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2bf2c40 con 0x55ecf2be1bb0 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fe9cfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fe9cfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57812/0 (socket says 172.21.15.12:57812) 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fe9cfa640 1 -- 172.21.15.12:0/2005922476 learned_addr learned my addr 172.21.15.12:0/2005922476 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/2005922476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 0x55ecf2bcdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/2005922476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bdece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fe9cfa640 1 -- 172.21.15.12:0/2005922476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 msgr2=0x55ecf2bcdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/2005922476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 0x55ecf2bcdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fe9cfa640 1 -- 172.21.15.12:0/2005922476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd72f0 msgr2=0x55ecf2bdece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/2005922476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bdece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fe9cfa640 1 -- 172.21.15.12:0/2005922476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf2bdd740 con 0x55ecf2bd69d0 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/2005922476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 0x55ecf2bcdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.755+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/2005922476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf3b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009230 tx=0x7f9fdc005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7e89fdbd34b28e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fcb7fe640 1 -- 172.21.15.12:0/2005922476 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc063070 con 0x55ecf2bd69d0 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fcb7fe640 1 -- 172.21.15.12:0/2005922476 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fdc05a040 con 0x55ecf2bd69d0 2024-09-19T06:39:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fcb7fe640 1 -- 172.21.15.12:0/2005922476 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc04e070 con 0x55ecf2bd69d0 2024-09-19T06:39:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fee337740 1 -- 172.21.15.12:0/2005922476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 msgr2=0x55ecf2bf3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fee337740 1 --2- 172.21.15.12:0/2005922476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf3b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009230 tx=0x7f9fdc005a20 comp rx=0 tx=0).stop 2024-09-19T06:39:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fee337740 1 -- 172.21.15.12:0/2005922476 shutdown_connections 2024-09-19T06:39:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fee337740 1 --2- 172.21.15.12:0/2005922476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2be1bb0 0x55ecf2bcdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fee337740 1 --2- 172.21.15.12:0/2005922476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bdece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fee337740 1 --2- 172.21.15.12:0/2005922476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf3b60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fee337740 1 -- 172.21.15.12:0/2005922476 >> 172.21.15.12:0/2005922476 conn(0x55ecf2bd2f60 msgr2=0x55ecf2bd1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fee337740 1 -- 172.21.15.12:0/2005922476 shutdown_connections 2024-09-19T06:39:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.756+0000 7f9fee337740 1 -- 172.21.15.12:0/2005922476 wait complete. 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fee337740 1 -- start start 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fee337740 1 Processor -- start 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fee337740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fee337740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bf7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fee337740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2be1bb0 0x55ecf2c54dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fee337740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2bf39e0 con 0x55ecf2be1bb0 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fee337740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2bf3310 con 0x55ecf2bd69d0 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fee337740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ecf2bf40b0 con 0x55ecf2bd72f0 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fea4fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2be1bb0 0x55ecf2c54dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fee337740 10 client.0 _ll_register_callbacks cb 0x7f9fdc005df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fea4fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2be1bb0 0x55ecf2c54dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57824/0 (socket says 172.21.15.12:57824) 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fea4fb640 1 -- 172.21.15.12:0/569143650 learned_addr learned my addr 172.21.15.12:0/569143650 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bf7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.757+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fea4fb640 1 -- 172.21.15.12:0/569143650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 msgr2=0x55ecf2bf7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bf7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fea4fb640 1 -- 172.21.15.12:0/569143650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd69d0 msgr2=0x55ecf2bf7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fea4fb640 1 -- 172.21.15.12:0/569143650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecf2c55460 con 0x55ecf2be1bb0 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fe94f9640 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bf7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fea4fb640 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2be1bb0 0x55ecf2c54dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009f20 tx=0x7f9fd40054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19029a1f0f9ec544 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fc97fa640 1 -- 172.21.15.12:0/569143650 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd40059a0 con 0x55ecf2be1bb0 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fee337740 1 -- 172.21.15.12:0/569143650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fdc05a040 con 0x55ecf2be1bb0 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fc97fa640 1 -- 172.21.15.12:0/569143650 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f9fd400f480 con 0x55ecf2be1bb0 2024-09-19T06:39:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fc97fa640 1 -- 172.21.15.12:0/569143650 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9fd400f6a0 con 0x55ecf2be1bb0 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fee337740 10 client.15069 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fee337740 1 -- 172.21.15.12:0/569143650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ecf2c5c7d0 con 0x55ecf2be1bb0 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.758+0000 7f9fc97fa640 1 -- 172.21.15.12:0/569143650 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fdc05a040 con 0x55ecf2be1bb0 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fc97fa640 1 -- 172.21.15.12:0/569143650 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9fd40378a0 con 0x55ecf2be1bb0 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fee337740 10 client.15069 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fee337740 10 client.15069 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fee337740 20 client.15069 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fee337740 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ecf2bf26f0 0x55ecf2c5fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fee337740 4 client.15069 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fee337740 1 -- 172.21.15.12:0/569143650 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "status"}) -- 0x55ecf2b44b10 con 0x55ecf2bf26f0 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ecf2bf26f0 0x55ecf2c5fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fc97fa640 10 client.15069 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:39:36.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fe9cfa640 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ecf2bf26f0 0x55ecf2c5fee0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43471058cfe94eb0 server_cookie=dbb54359c3dff7df in_seq=0 out_seq=0 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fc97fa640 1 -- 172.21.15.12:0/569143650 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ecf2b44b10 con 0x55ecf2bf26f0 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fc97fa640 10 client.15069 handle_command_reply: tid=0 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.759+0000 7f9fee337740 1 client.15069 shutdown 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 1 -- 172.21.15.12:0/569143650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2be1bb0 msgr2=0x55ecf2c54dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2be1bb0 0x55ecf2c54dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009f20 tx=0x7f9fd40054a0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 1 -- 172.21.15.12:0/569143650 shutdown_connections 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ecf2bf26f0 0x55ecf2c5fee0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ecf2be1bb0 0x55ecf2c54dc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ecf2bd72f0 0x55ecf2bf7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 1 --2- 172.21.15.12:0/569143650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ecf2bd69d0 0x55ecf2bf7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fc97fa640 0 client.15069 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 1 -- 172.21.15.12:0/569143650 >> 172.21.15.12:0/569143650 conn(0x55ecf2bd2f60 msgr2=0x55ecf2bd2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:36.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 1 -- 172.21.15.12:0/569143650 shutdown_connections 2024-09-19T06:39:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 1 -- 172.21.15.12:0/569143650 wait complete. 2024-09-19T06:39:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9fee337740 20 client.15069 trim_cache size 0 max 16384 2024-09-19T06:39:36.767 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:39:36.767 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:39:36.767 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-19T06:39:36.767 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24509, 2024-09-19T06:39:36.767 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:39:36.767 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:39:36.767 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:39:36.768 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 81.714951971999994, 2024-09-19T06:39:36.768 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-19T06:39:36.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-19T06:39:36.768 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T06:39:36.768 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 93.352144361000001 2024-09-19T06:39:36.768 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:39:36.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9febf5e640 1 -- 172.21.15.12:0/2213036189 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9fcc0a3350 msgr2=0x7f9fcc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9febf5e640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9fcc0a3350 0x7f9fcc0a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009900 tx=0x7f9fdc0058d0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9febf5e640 1 -- 172.21.15.12:0/2213036189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fe41036e0 msgr2=0x7f9fe4198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9febf5e640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fe41036e0 0x7f9fe4198b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800c970 tx=0x7f9fd800ce30 comp rx=0 tx=0).stop 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.760+0000 7f9febf5e640 1 -- 172.21.15.12:0/2213036189 shutdown_connections 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.761+0000 7f9febf5e640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9fcc0a3350 0x7f9fcc0a5810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.761+0000 7f9febf5e640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fe41082a0 0x7f9fe419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.761+0000 7f9febf5e640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fe41036e0 0x7f9fe4198b10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.761+0000 7f9febf5e640 1 --2- 172.21.15.12:0/2213036189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fe4102d30 0x7f9fe41985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.761+0000 7f9febf5e640 1 -- 172.21.15.12:0/2213036189 >> 172.21.15.12:0/2213036189 conn(0x7f9fe40fc7d0 msgr2=0x7f9fe4105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.761+0000 7f9febf5e640 1 -- 172.21.15.12:0/2213036189 shutdown_connections 2024-09-19T06:39:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:36.761+0000 7f9febf5e640 1 -- 172.21.15.12:0/2213036189 wait complete. 2024-09-19T06:39:37.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:36 smithi173 ceph-mon[35349]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:39:37.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:36 smithi012 ceph-mon[30937]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:39:37.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:36 smithi016 ceph-mon[34911]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:39:37.584 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T06:39:37.585 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:39:37.598 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:39:37.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T06:39:37.865 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.277+0000 7f985dcf5640 1 -- 172.21.15.12:0/1844177285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9858103870 msgr2=0x7f985810a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.277+0000 7f985dcf5640 1 --2- 172.21.15.12:0/1844177285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9858103870 0x7f985810a100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9850009cd0 tx=0x7f985002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.277+0000 7f985dcf5640 1 -- 172.21.15.12:0/1844177285 shutdown_connections 2024-09-19T06:39:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.277+0000 7f985dcf5640 1 --2- 172.21.15.12:0/1844177285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9858103870 0x7f985810a100 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.277+0000 7f985dcf5640 1 --2- 172.21.15.12:0/1844177285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9858102eb0 0x7f9858103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.277+0000 7f985dcf5640 1 --2- 172.21.15.12:0/1844177285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98580ffed0 0x7f98581002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.277+0000 7f985dcf5640 1 -- 172.21.15.12:0/1844177285 >> 172.21.15.12:0/1844177285 conn(0x7f98580fba40 msgr2=0x7f98580fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.278+0000 7f985dcf5640 1 -- 172.21.15.12:0/1844177285 shutdown_connections 2024-09-19T06:39:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.278+0000 7f985dcf5640 1 -- 172.21.15.12:0/1844177285 wait complete. 2024-09-19T06:39:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.278+0000 7f985dcf5640 1 Processor -- start 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.278+0000 7f985dcf5640 1 -- start start 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f985dcf5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98580ffed0 0x7f9858197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f985dcf5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9858102eb0 0x7f9858198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f985dcf5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9858103870 0x7f985819f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f985dcf5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f985810d8e0 con 0x7f98580ffed0 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f985dcf5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f985810d760 con 0x7f9858103870 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f985dcf5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f985810da60 con 0x7f9858102eb0 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f98577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98580ffed0 0x7f9858197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f98577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98580ffed0 0x7f9858197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57852/0 (socket says 172.21.15.12:57852) 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f98577fe640 1 -- 172.21.15.12:0/2755450847 learned_addr learned my addr 172.21.15.12:0/2755450847 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f9856ffd640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9858102eb0 0x7f9858198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f9857fff640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9858103870 0x7f985819f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f98577fe640 1 -- 172.21.15.12:0/2755450847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9858102eb0 msgr2=0x7f9858198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f98577fe640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9858102eb0 0x7f9858198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f98577fe640 1 -- 172.21.15.12:0/2755450847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9858103870 msgr2=0x7f985819f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f98577fe640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9858103870 0x7f985819f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f98577fe640 1 -- 172.21.15.12:0/2755450847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985819fa80 con 0x7f98580ffed0 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f9857fff640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9858103870 0x7f985819f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f9856ffd640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9858102eb0 0x7f9858198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f98577fe640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98580ffed0 0x7f9858197e50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f984800d950 tx=0x7f984800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f9854ff9640 1 -- 172.21.15.12:0/2755450847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848017020 con 0x7f98580ffed0 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f9854ff9640 1 -- 172.21.15.12:0/2755450847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9848009c30 con 0x7f98580ffed0 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.279+0000 7f985dcf5640 1 -- 172.21.15.12:0/2755450847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985819fd70 con 0x7f98580ffed0 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.280+0000 7f9854ff9640 1 -- 172.21.15.12:0/2755450847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984800f720 con 0x7f98580ffed0 2024-09-19T06:39:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.280+0000 7f985dcf5640 1 -- 172.21.15.12:0/2755450847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98581a0220 con 0x7f98580ffed0 2024-09-19T06:39:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.281+0000 7f985dcf5640 1 -- 172.21.15.12:0/2755450847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9858108fe0 con 0x7f98580ffed0 2024-09-19T06:39:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.282+0000 7f9854ff9640 1 -- 172.21.15.12:0/2755450847 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f984801a020 con 0x7f98580ffed0 2024-09-19T06:39:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.283+0000 7f9854ff9640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f98400a3380 0x7f98400a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.283+0000 7f9856ffd640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f98400a3380 0x7f98400a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.283+0000 7f9854ff9640 1 -- 172.21.15.12:0/2755450847 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f98480cfed0 con 0x7f98580ffed0 2024-09-19T06:39:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.283+0000 7f9856ffd640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f98400a3380 0x7f98400a5840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9858199370 tx=0x7f984c005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.286+0000 7f9854ff9640 1 -- 172.21.15.12:0/2755450847 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9848021020 con 0x7f98580ffed0 2024-09-19T06:39:38.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.478+0000 7f985dcf5640 1 -- 172.21.15.12:0/2755450847 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9858063020 con 0x7f98400a3380 2024-09-19T06:39:38.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.479+0000 7f9854ff9640 1 -- 172.21.15.12:0/2755450847 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9858063020 con 0x7f98400a3380 2024-09-19T06:39:38.481 INFO:teuthology.orchestra.run.smithi012.stdout:Backend: cephadm 2024-09-19T06:39:38.481 INFO:teuthology.orchestra.run.smithi012.stdout:Available: Yes 2024-09-19T06:39:38.481 INFO:teuthology.orchestra.run.smithi012.stdout:Paused: No 2024-09-19T06:39:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 -- 172.21.15.12:0/2755450847 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f98400a3380 msgr2=0x7f98400a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f98400a3380 0x7f98400a5840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9858199370 tx=0x7f984c005d20 comp rx=0 tx=0).stop 2024-09-19T06:39:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 -- 172.21.15.12:0/2755450847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98580ffed0 msgr2=0x7f9858197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98580ffed0 0x7f9858197e50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f984800d950 tx=0x7f984800de10 comp rx=0 tx=0).stop 2024-09-19T06:39:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 -- 172.21.15.12:0/2755450847 shutdown_connections 2024-09-19T06:39:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f98400a3380 0x7f98400a5840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9858103870 0x7f985819f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9858102eb0 0x7f9858198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 --2- 172.21.15.12:0/2755450847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98580ffed0 0x7f9858197e50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 -- 172.21.15.12:0/2755450847 >> 172.21.15.12:0/2755450847 conn(0x7f98580fba40 msgr2=0x7f98581061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:38.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.481+0000 7f985dcf5640 1 -- 172.21.15.12:0/2755450847 shutdown_connections 2024-09-19T06:39:38.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:38.482+0000 7f985dcf5640 1 -- 172.21.15.12:0/2755450847 wait complete. 2024-09-19T06:39:39.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:38 smithi173 ceph-mon[35349]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:39:39.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:38 smithi173 ceph-mon[35349]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:38 smithi012 ceph-mon[30937]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:39:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:38 smithi012 ceph-mon[30937]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:39.162 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T06:39:39.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:38 smithi016 ceph-mon[34911]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:39:39.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:38 smithi016 ceph-mon[34911]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:39.423 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:39.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.883+0000 7fd310b82640 1 -- 172.21.15.12:0/459367130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd30c101c00 msgr2=0x7fd30c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.883+0000 7fd310b82640 1 --2- 172.21.15.12:0/459367130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd30c101c00 0x7fd30c102000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009900 tx=0x7fd2f402a410 comp rx=0 tx=0).stop 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.883+0000 7fd310b82640 1 -- 172.21.15.12:0/459367130 shutdown_connections 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.883+0000 7fd310b82640 1 --2- 172.21.15.12:0/459367130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30c1037c0 0x7fd30c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.883+0000 7fd310b82640 1 --2- 172.21.15.12:0/459367130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c102e00 0x7fd30c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.883+0000 7fd310b82640 1 --2- 172.21.15.12:0/459367130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd30c101c00 0x7fd30c102000 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.883+0000 7fd310b82640 1 -- 172.21.15.12:0/459367130 >> 172.21.15.12:0/459367130 conn(0x7fd30c0fd390 msgr2=0x7fd30c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.883+0000 7fd310b82640 1 -- 172.21.15.12:0/459367130 shutdown_connections 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.883+0000 7fd310b82640 1 -- 172.21.15.12:0/459367130 wait complete. 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd310b82640 1 Processor -- start 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd310b82640 1 -- start start 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd310b82640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c101c00 0x7fd30c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd310b82640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30c102e00 0x7fd30c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:39.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd310b82640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd30c1037c0 0x7fd30c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd310b82640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c10d860 con 0x7fd30c1037c0 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd310b82640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c10d6e0 con 0x7fd30c101c00 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd310b82640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c10d9e0 con 0x7fd30c102e00 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd30ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd30c1037c0 0x7fd30c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd30ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd30c1037c0 0x7fd30c074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57880/0 (socket says 172.21.15.12:57880) 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd30ad9d640 1 -- 172.21.15.12:0/1055340259 learned_addr learned my addr 172.21.15.12:0/1055340259 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd30a59c640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c101c00 0x7fd30c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.884+0000 7fd309d9b640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30c102e00 0x7fd30c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd30ad9d640 1 -- 172.21.15.12:0/1055340259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30c102e00 msgr2=0x7fd30c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd30ad9d640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30c102e00 0x7fd30c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd30ad9d640 1 -- 172.21.15.12:0/1055340259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c101c00 msgr2=0x7fd30c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd30ad9d640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c101c00 0x7fd30c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd30ad9d640 1 -- 172.21.15.12:0/1055340259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c0753e0 con 0x7fd30c1037c0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd30ad9d640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd30c1037c0 0x7fd30c074b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd30400cce0 tx=0x7fd30400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd3037fe640 1 -- 172.21.15.12:0/1055340259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30400f450 con 0x7fd30c1037c0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd310b82640 1 -- 172.21.15.12:0/1055340259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30c1a1fe0 con 0x7fd30c1037c0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd3037fe640 1 -- 172.21.15.12:0/1055340259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd30400fad0 con 0x7fd30c1037c0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd3037fe640 1 -- 172.21.15.12:0/1055340259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd304018c10 con 0x7fd30c1037c0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.885+0000 7fd310b82640 1 -- 172.21.15.12:0/1055340259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30c1a24a0 con 0x7fd30c1037c0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.886+0000 7fd310b82640 1 -- 172.21.15.12:0/1055340259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd30c108fa0 con 0x7fd30c1037c0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.887+0000 7fd3037fe640 1 -- 172.21.15.12:0/1055340259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd30400f5f0 con 0x7fd30c1037c0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.888+0000 7fd3037fe640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd2f80a32d0 0x7fd2f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.888+0000 7fd30a59c640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd2f80a32d0 0x7fd2f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.888+0000 7fd3037fe640 1 -- 172.21.15.12:0/1055340259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fd3040d0230 con 0x7fd30c1037c0 2024-09-19T06:39:39.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.889+0000 7fd30a59c640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd2f80a32d0 0x7fd2f80a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4005ab0 tx=0x7fd2f4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:39.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:39.892+0000 7fd3037fe640 1 -- 172.21.15.12:0/1055340259 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd304014030 con 0x7fd30c1037c0 2024-09-19T06:39:40.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.077+0000 7fd310b82640 1 -- 172.21.15.12:0/1055340259 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd30c062630 con 0x7fd2f80a32d0 2024-09-19T06:39:40.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.090+0000 7fd3037fe640 1 -- 172.21.15.12:0/1055340259 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fd30c062630 con 0x7fd2f80a32d0 2024-09-19T06:39:40.091 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (99s) 21s ago 99s 19.3M - 19.1.1-361-g2f599a46 d2baa855c067 d6be61aaa3fc 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi016 running (97s) 30s ago 96s 25.6M - 19.1.1-361-g2f599a46 d2baa855c067 b5e9449ec325 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.c smithi173 running (111s) 30s ago 110s 20.4M - 19.1.1-361-g2f599a46 d2baa855c067 ac9838b1d70a 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.d smithi012 running (118s) 21s ago 118s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 16d7996e63df 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.e smithi016 running (115s) 30s ago 115s 18.3M - 19.1.1-361-g2f599a46 d2baa855c067 f0d1477f8ec7 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.f smithi173 running (113s) 30s ago 113s 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 df73eaf33d65 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.g smithi012 running (103s) 21s ago 102s 19.2M - 19.1.1-361-g2f599a46 d2baa855c067 b8ed9b1e4cfd 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.h smithi016 running (108s) 30s ago 107s 20.0M - 19.1.1-361-g2f599a46 d2baa855c067 8dc3901a3abd 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.i smithi173 running (105s) 30s ago 105s 18.3M - 19.1.1-361-g2f599a46 d2baa855c067 bdfdc3d17e55 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.j smithi012 running (2m) 21s ago 2m 13.4M - 19.1.1-361-g2f599a46 d2baa855c067 b79df0ecf29c 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.k smithi016 running (2m) 30s ago 2m 18.0M - 19.1.1-361-g2f599a46 d2baa855c067 2b0605a75a93 2024-09-19T06:39:40.092 INFO:teuthology.orchestra.run.smithi012.stdout:mds.l smithi173 running (2m) 30s ago 2m 17.1M - 19.1.1-361-g2f599a46 d2baa855c067 65c61c6c3f8c 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi012 *:9283,8765 running (8m) 21s ago 8m 509M - 19.1.1-361-g2f599a46 d2baa855c067 0b352ea0c27c 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi016 *:8443,8765 running (7m) 30s ago 7m 443M - 19.1.1-361-g2f599a46 d2baa855c067 3a4caf458dc7 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.z smithi173 *:8443,8765 running (7m) 30s ago 7m 441M - 19.1.1-361-g2f599a46 d2baa855c067 b767e544145e 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (9m) 21s ago 9m 48.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 56166a7b626f 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi016 running (7m) 30s ago 7m 41.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 8ddc26cc182f 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi173 running (7m) 30s ago 7m 41.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 fadca08d8e98 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (6m) 21s ago 6m 58.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 d0b27272be7a 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi016 running (6m) 30s ago 6m 54.8M 4273M 19.1.1-361-g2f599a46 d2baa855c067 5d1ab319e244 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi173 running (6m) 30s ago 6m 56.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 53b60990d479 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (5m) 21s ago 5m 45.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 e63b96eac20d 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi016 running (5m) 30s ago 5m 46.3M 4273M 19.1.1-361-g2f599a46 d2baa855c067 20346f2c89eb 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi173 running (4m) 30s ago 4m 55.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 c1caeb405960 2024-09-19T06:39:40.093 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi012 running (4m) 21s ago 4m 51.5M 4273M 19.1.1-361-g2f599a46 d2baa855c067 8a2c938ed5b1 2024-09-19T06:39:40.094 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi016 running (4m) 30s ago 4m 46.5M 4273M 19.1.1-361-g2f599a46 d2baa855c067 c4d3e7e84046 2024-09-19T06:39:40.094 INFO:teuthology.orchestra.run.smithi012.stdout:osd.8 smithi173 running (3m) 30s ago 3m 51.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 38469e1dc779 2024-09-19T06:39:40.094 INFO:teuthology.orchestra.run.smithi012.stdout:osd.9 smithi012 running (3m) 21s ago 3m 44.3M 4273M 19.1.1-361-g2f599a46 d2baa855c067 0eef60692fe7 2024-09-19T06:39:40.094 INFO:teuthology.orchestra.run.smithi012.stdout:osd.10 smithi016 running (2m) 30s ago 2m 52.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 fe150c5f8eb1 2024-09-19T06:39:40.094 INFO:teuthology.orchestra.run.smithi012.stdout:osd.11 smithi173 running (2m) 30s ago 2m 46.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 1c38c3442a21 2024-09-19T06:39:40.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 -- 172.21.15.12:0/1055340259 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd2f80a32d0 msgr2=0x7fd2f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd2f80a32d0 0x7fd2f80a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4005ab0 tx=0x7fd2f4000bc0 comp rx=0 tx=0).stop 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 -- 172.21.15.12:0/1055340259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd30c1037c0 msgr2=0x7fd30c074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd30c1037c0 0x7fd30c074b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd30400cce0 tx=0x7fd30400a620 comp rx=0 tx=0).stop 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 -- 172.21.15.12:0/1055340259 shutdown_connections 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd2f80a32d0 0x7fd2f80a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd30c1037c0 0x7fd30c074b20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd30c102e00 0x7fd30c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 --2- 172.21.15.12:0/1055340259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd30c101c00 0x7fd30c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 -- 172.21.15.12:0/1055340259 >> 172.21.15.12:0/1055340259 conn(0x7fd30c0fd390 msgr2=0x7fd30c106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 -- 172.21.15.12:0/1055340259 shutdown_connections 2024-09-19T06:39:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:40.092+0000 7fd310b82640 1 -- 172.21.15.12:0/1055340259 wait complete. 2024-09-19T06:39:40.816 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:40 smithi012 ceph-mon[30937]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:39:40.817 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:40 smithi012 ceph-mon[30937]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:40.851 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T06:39:41.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:40 smithi173 ceph-mon[35349]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:39:41.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:40 smithi173 ceph-mon[35349]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:41.110 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:41.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:40 smithi016 ceph-mon[34911]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 5 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:39:41.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:40 smithi016 ceph-mon[34911]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:41.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.704+0000 7fe5908dc640 1 -- 172.21.15.12:0/3325678331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe58c107900 msgr2=0x7fe58c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:41.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.704+0000 7fe5908dc640 1 --2- 172.21.15.12:0/3325678331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe58c107900 0x7fe58c109d50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe584009ca0 tx=0x7fe58402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.704+0000 7fe5908dc640 1 -- 172.21.15.12:0/3325678331 shutdown_connections 2024-09-19T06:39:41.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.704+0000 7fe5908dc640 1 --2- 172.21.15.12:0/3325678331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe58c107900 0x7fe58c109d50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.704+0000 7fe5908dc640 1 --2- 172.21.15.12:0/3325678331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c104fd0 0x7fe58c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.704+0000 7fe5908dc640 1 --2- 172.21.15.12:0/3325678331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe58c1026a0 0x7fe58c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.704+0000 7fe5908dc640 1 -- 172.21.15.12:0/3325678331 >> 172.21.15.12:0/3325678331 conn(0x7fe58c0fc2a0 msgr2=0x7fe58c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:41.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.705+0000 7fe5908dc640 1 -- 172.21.15.12:0/3325678331 shutdown_connections 2024-09-19T06:39:41.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.705+0000 7fe5908dc640 1 -- 172.21.15.12:0/3325678331 wait complete. 2024-09-19T06:39:41.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.705+0000 7fe5908dc640 1 Processor -- start 2024-09-19T06:39:41.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.705+0000 7fe5908dc640 1 -- start start 2024-09-19T06:39:41.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.705+0000 7fe5908dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe58c1026a0 0x7fe58c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:41.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.705+0000 7fe5908dc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe58c104fd0 0x7fe58c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:41.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe5908dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c107900 0x7fe58c1a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:41.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe5908dc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c10d8c0 con 0x7fe58c1026a0 2024-09-19T06:39:41.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe5908dc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c10d740 con 0x7fe58c107900 2024-09-19T06:39:41.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe5908dc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c10da40 con 0x7fe58c104fd0 2024-09-19T06:39:41.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe58a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe58c1026a0 0x7fe58c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:41.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe58a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe58c1026a0 0x7fe58c19a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36242/0 (socket says 172.21.15.12:36242) 2024-09-19T06:39:41.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe58a59c640 1 -- 172.21.15.12:0/1648092305 learned_addr learned my addr 172.21.15.12:0/1648092305 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:41.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe58ad9d640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c107900 0x7fe58c1a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:41.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe589d9b640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe58c104fd0 0x7fe58c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:41.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe58a59c640 1 -- 172.21.15.12:0/1648092305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe58c104fd0 msgr2=0x7fe58c19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:41.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe58a59c640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe58c104fd0 0x7fe58c19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe58a59c640 1 -- 172.21.15.12:0/1648092305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c107900 msgr2=0x7fe58c1a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:41.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe58a59c640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c107900 0x7fe58c1a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe58a59c640 1 -- 172.21.15.12:0/1648092305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58c1a1cc0 con 0x7fe58c1026a0 2024-09-19T06:39:41.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe58a59c640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe58c1026a0 0x7fe58c19a090 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c970 tx=0x7fe57c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:41.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe57b7fe640 1 -- 172.21.15.12:0/1648092305 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c007bb0 con 0x7fe58c1026a0 2024-09-19T06:39:41.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe57b7fe640 1 -- 172.21.15.12:0/1648092305 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe57c007d50 con 0x7fe58c1026a0 2024-09-19T06:39:41.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe5908dc640 1 -- 172.21.15.12:0/1648092305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58c1a1fb0 con 0x7fe58c1026a0 2024-09-19T06:39:41.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe57b7fe640 1 -- 172.21.15.12:0/1648092305 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00f450 con 0x7fe58c1026a0 2024-09-19T06:39:41.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.706+0000 7fe5908dc640 1 -- 172.21.15.12:0/1648092305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe58c1a2400 con 0x7fe58c1026a0 2024-09-19T06:39:41.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.708+0000 7fe5908dc640 1 -- 172.21.15.12:0/1648092305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe58c1093f0 con 0x7fe58c1026a0 2024-09-19T06:39:41.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.709+0000 7fe57b7fe640 1 -- 172.21.15.12:0/1648092305 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe57c004f00 con 0x7fe58c1026a0 2024-09-19T06:39:41.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.709+0000 7fe57b7fe640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe5740a3300 0x7fe5740a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:41.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.709+0000 7fe589d9b640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe5740a3300 0x7fe5740a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:41.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.709+0000 7fe57b7fe640 1 -- 172.21.15.12:0/1648092305 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fe57c0cf7e0 con 0x7fe58c1026a0 2024-09-19T06:39:41.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.710+0000 7fe589d9b640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe5740a3300 0x7fe5740a57c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe58c19b5b0 tx=0x7fe58000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:41.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.713+0000 7fe57b7fe640 1 -- 172.21.15.12:0/1648092305 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe57c014030 con 0x7fe58c1026a0 2024-09-19T06:39:41.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.902+0000 7fe5908dc640 1 -- 172.21.15.12:0/1648092305 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fe58c062630 con 0x7fe5740a3300 2024-09-19T06:39:41.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.907+0000 7fe57b7fe640 1 -- 172.21.15.12:0/1648092305 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fe58c062630 con 0x7fe5740a3300 2024-09-19T06:39:41.909 INFO:teuthology.orchestra.run.smithi012.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T06:39:41.909 INFO:teuthology.orchestra.run.smithi012.stdout:mds.all 12/12 32s ago 2m smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi016=b;smithi016=e;smithi016=h;smithi016=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-19T06:39:41.909 INFO:teuthology.orchestra.run.smithi012.stdout:mgr 3/3 32s ago 7m smithi012=x;smithi016=y;smithi173=z;count:3 2024-09-19T06:39:41.910 INFO:teuthology.orchestra.run.smithi012.stdout:mon 3/3 32s ago 7m smithi012:172.21.15.12=a;smithi016:172.21.15.16=b;smithi173:172.21.15.173=c;count:3 2024-09-19T06:39:41.910 INFO:teuthology.orchestra.run.smithi012.stdout:osd 12 32s ago - 2024-09-19T06:39:41.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 -- 172.21.15.12:0/1648092305 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe5740a3300 msgr2=0x7fe5740a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe5740a3300 0x7fe5740a57c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe58c19b5b0 tx=0x7fe58000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 -- 172.21.15.12:0/1648092305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe58c1026a0 msgr2=0x7fe58c19a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe58c1026a0 0x7fe58c19a090 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c970 tx=0x7fe57c00cd70 comp rx=0 tx=0).stop 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 -- 172.21.15.12:0/1648092305 shutdown_connections 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fe5740a3300 0x7fe5740a57c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe58c107900 0x7fe58c1a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe58c104fd0 0x7fe58c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 --2- 172.21.15.12:0/1648092305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe58c1026a0 0x7fe58c19a090 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 -- 172.21.15.12:0/1648092305 >> 172.21.15.12:0/1648092305 conn(0x7fe58c0fc2a0 msgr2=0x7fe58c101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 -- 172.21.15.12:0/1648092305 shutdown_connections 2024-09-19T06:39:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:41.910+0000 7fe5908dc640 1 -- 172.21.15.12:0/1648092305 wait complete. 2024-09-19T06:39:42.589 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T06:39:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:42.869 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:42 smithi012 ceph-mon[30937]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:42.869 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:42 smithi012 ceph-mon[30937]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:43.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:42 smithi173 ceph-mon[35349]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:43.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:42 smithi173 ceph-mon[35349]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:43.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:42 smithi016 ceph-mon[34911]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:43.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:42 smithi016 ceph-mon[34911]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:43.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.304+0000 7fbb44e01640 1 -- 172.21.15.12:0/1430651299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb40101cd0 msgr2=0x7fbb40102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.304+0000 7fbb44e01640 1 --2- 172.21.15.12:0/1430651299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb40101cd0 0x7fbb40102150 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009900 tx=0x7fbb3402a410 comp rx=0 tx=0).stop 2024-09-19T06:39:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.304+0000 7fbb44e01640 1 -- 172.21.15.12:0/1430651299 shutdown_connections 2024-09-19T06:39:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.304+0000 7fbb44e01640 1 --2- 172.21.15.12:0/1430651299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb40102690 0x7fbb40108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.304+0000 7fbb44e01640 1 --2- 172.21.15.12:0/1430651299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb40101cd0 0x7fbb40102150 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.304+0000 7fbb44e01640 1 --2- 172.21.15.12:0/1430651299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb40100ad0 0x7fbb40100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.304+0000 7fbb44e01640 1 -- 172.21.15.12:0/1430651299 >> 172.21.15.12:0/1430651299 conn(0x7fbb400fc280 msgr2=0x7fbb400fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:43.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.304+0000 7fbb44e01640 1 -- 172.21.15.12:0/1430651299 shutdown_connections 2024-09-19T06:39:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.304+0000 7fbb44e01640 1 -- 172.21.15.12:0/1430651299 wait complete. 2024-09-19T06:39:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb44e01640 1 Processor -- start 2024-09-19T06:39:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb44e01640 1 -- start start 2024-09-19T06:39:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb44e01640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb40100ad0 0x7fbb40197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb44e01640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb40101cd0 0x7fbb40198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb44e01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb40102690 0x7fbb4019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb44e01640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4010d920 con 0x7fbb40102690 2024-09-19T06:39:43.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb44e01640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4010d7a0 con 0x7fbb40101cd0 2024-09-19T06:39:43.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb44e01640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4010daa0 con 0x7fbb40100ad0 2024-09-19T06:39:43.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb3ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb40102690 0x7fbb4019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:43.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb3ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb40102690 0x7fbb4019f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36252/0 (socket says 172.21.15.12:36252) 2024-09-19T06:39:43.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.305+0000 7fbb3ed9d640 1 -- 172.21.15.12:0/2616552432 learned_addr learned my addr 172.21.15.12:0/2616552432 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:43.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb3e59c640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb40100ad0 0x7fbb40197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:43.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb3dd9b640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb40101cd0 0x7fbb40198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:43.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb3ed9d640 1 -- 172.21.15.12:0/2616552432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb40100ad0 msgr2=0x7fbb40197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:43.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb3ed9d640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb40100ad0 0x7fbb40197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb3ed9d640 1 -- 172.21.15.12:0/2616552432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb40101cd0 msgr2=0x7fbb40198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:43.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb3ed9d640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb40101cd0 0x7fbb40198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb3ed9d640 1 -- 172.21.15.12:0/2616552432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4019fb40 con 0x7fbb40102690 2024-09-19T06:39:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb3e59c640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb40100ad0 0x7fbb40197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb3ed9d640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb40102690 0x7fbb4019f4d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800cce0 tx=0x7fbb3800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb2f7fe640 1 -- 172.21.15.12:0/2616552432 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800f450 con 0x7fbb40102690 2024-09-19T06:39:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb44e01640 1 -- 172.21.15.12:0/2616552432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4019fe30 con 0x7fbb40102690 2024-09-19T06:39:43.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb2f7fe640 1 -- 172.21.15.12:0/2616552432 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb3800fad0 con 0x7fbb40102690 2024-09-19T06:39:43.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb2f7fe640 1 -- 172.21.15.12:0/2616552432 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38018c10 con 0x7fbb40102690 2024-09-19T06:39:43.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.306+0000 7fbb44e01640 1 -- 172.21.15.12:0/2616552432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb401a0310 con 0x7fbb40102690 2024-09-19T06:39:43.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.307+0000 7fbb44e01640 1 -- 172.21.15.12:0/2616552432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb40107e80 con 0x7fbb40102690 2024-09-19T06:39:43.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.309+0000 7fbb2f7fe640 1 -- 172.21.15.12:0/2616552432 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbb3800f5f0 con 0x7fbb40102690 2024-09-19T06:39:43.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.309+0000 7fbb2f7fe640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb280a3300 0x7fbb280a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:43.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.310+0000 7fbb3e59c640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb280a3300 0x7fbb280a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.310+0000 7fbb2f7fe640 1 -- 172.21.15.12:0/2616552432 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fbb380d02f0 con 0x7fbb40102690 2024-09-19T06:39:43.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.310+0000 7fbb3e59c640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb280a3300 0x7fbb280a57c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbb40101b30 tx=0x7fbb30008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:43.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.317+0000 7fbb2f7fe640 1 -- 172.21.15.12:0/2616552432 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb38014030 con 0x7fbb40102690 2024-09-19T06:39:43.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.500+0000 7fbb44e01640 1 -- 172.21.15.12:0/2616552432 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fbb40062630 con 0x7fbb280a3300 2024-09-19T06:39:43.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.502+0000 7fbb2f7fe640 1 -- 172.21.15.12:0/2616552432 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fbb40062630 con 0x7fbb280a3300 2024-09-19T06:39:43.503 INFO:teuthology.orchestra.run.smithi012.stdout:HOST ADDR LABELS STATUS 2024-09-19T06:39:43.503 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012 172.21.15.12 2024-09-19T06:39:43.504 INFO:teuthology.orchestra.run.smithi012.stdout:smithi016 172.21.15.16 2024-09-19T06:39:43.504 INFO:teuthology.orchestra.run.smithi012.stdout:smithi173 172.21.15.173 2024-09-19T06:39:43.504 INFO:teuthology.orchestra.run.smithi012.stdout:3 hosts in cluster 2024-09-19T06:39:43.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 -- 172.21.15.12:0/2616552432 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb280a3300 msgr2=0x7fbb280a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:43.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb280a3300 0x7fbb280a57c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbb40101b30 tx=0x7fbb30008040 comp rx=0 tx=0).stop 2024-09-19T06:39:43.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 -- 172.21.15.12:0/2616552432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb40102690 msgr2=0x7fbb4019f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:43.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb40102690 0x7fbb4019f4d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800cce0 tx=0x7fbb3800a620 comp rx=0 tx=0).stop 2024-09-19T06:39:43.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 -- 172.21.15.12:0/2616552432 shutdown_connections 2024-09-19T06:39:43.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbb280a3300 0x7fbb280a57c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb40102690 0x7fbb4019f4d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb40101cd0 0x7fbb40198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 --2- 172.21.15.12:0/2616552432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb40100ad0 0x7fbb40197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:43.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 -- 172.21.15.12:0/2616552432 >> 172.21.15.12:0/2616552432 conn(0x7fbb400fc280 msgr2=0x7fbb40105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:43.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 -- 172.21.15.12:0/2616552432 shutdown_connections 2024-09-19T06:39:43.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:43.504+0000 7fbb44e01640 1 -- 172.21.15.12:0/2616552432 wait complete. 2024-09-19T06:39:44.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:43 smithi173 ceph-mon[35349]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:43 smithi012 ceph-mon[30937]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:44.220 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T06:39:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:43 smithi016 ceph-mon[34911]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:44.478 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:44.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:44 smithi012 ceph-mon[30937]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:39:44.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.928+0000 7f9133810640 1 -- 172.21.15.12:0/1414501614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c100450 msgr2=0x7f912c100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.928+0000 7f9133810640 1 --2- 172.21.15.12:0/1414501614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c100450 0x7f912c100850 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9128009900 tx=0x7f912802a410 comp rx=0 tx=0).stop 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.928+0000 7f9133810640 1 -- 172.21.15.12:0/1414501614 shutdown_connections 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.928+0000 7f9133810640 1 --2- 172.21.15.12:0/1414501614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f912c101730 0x7f912c101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.928+0000 7f9133810640 1 --2- 172.21.15.12:0/1414501614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f912c100d90 0x7f912c1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.928+0000 7f9133810640 1 --2- 172.21.15.12:0/1414501614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c100450 0x7f912c100850 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.928+0000 7f9133810640 1 -- 172.21.15.12:0/1414501614 >> 172.21.15.12:0/1414501614 conn(0x7f912c0fc280 msgr2=0x7f912c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.928+0000 7f9133810640 1 -- 172.21.15.12:0/1414501614 shutdown_connections 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.928+0000 7f9133810640 1 -- 172.21.15.12:0/1414501614 wait complete. 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f9133810640 1 Processor -- start 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f9133810640 1 -- start start 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f9133810640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c100450 0x7f912c19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:44.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f9133810640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f912c100d90 0x7f912c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f9133810640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f912c101730 0x7f912c1a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f9133810640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f912c10fa40 con 0x7f912c100450 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f9133810640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f912c10f8c0 con 0x7f912c101730 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f9133810640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f912c10fbc0 con 0x7f912c100d90 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f91315ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c100450 0x7f912c19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f91315ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c100450 0x7f912c19a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36256/0 (socket says 172.21.15.12:36256) 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f91315ac640 1 -- 172.21.15.12:0/554550264 learned_addr learned my addr 172.21.15.12:0/554550264 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f9130dab640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f912c100d90 0x7f912c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f9131dad640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f912c101730 0x7f912c1a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f91315ac640 1 -- 172.21.15.12:0/554550264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f912c100d90 msgr2=0x7f912c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f91315ac640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f912c100d90 0x7f912c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:44.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f91315ac640 1 -- 172.21.15.12:0/554550264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f912c101730 msgr2=0x7f912c1a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f91315ac640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f912c101730 0x7f912c1a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f91315ac640 1 -- 172.21.15.12:0/554550264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c1a1d20 con 0x7f912c100450 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.929+0000 7f91315ac640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c100450 0x7f912c19a0f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9128009230 tx=0x7f9128004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.930+0000 7f91227fc640 1 -- 172.21.15.12:0/554550264 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912803f030 con 0x7f912c100450 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.930+0000 7f91227fc640 1 -- 172.21.15.12:0/554550264 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9128003ce0 con 0x7f912c100450 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.930+0000 7f9133810640 1 -- 172.21.15.12:0/554550264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912c1a1fb0 con 0x7f912c100450 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.930+0000 7f91227fc640 1 -- 172.21.15.12:0/554550264 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9128035070 con 0x7f912c100450 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.930+0000 7f9133810640 1 -- 172.21.15.12:0/554550264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f912c1a23a0 con 0x7f912c100450 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.931+0000 7f9133810640 1 -- 172.21.15.12:0/554550264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f912c10b2e0 con 0x7f912c100450 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.932+0000 7f91227fc640 1 -- 172.21.15.12:0/554550264 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9128042030 con 0x7f912c100450 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.932+0000 7f91227fc640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91180a3300 0x7f91180a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.933+0000 7f9130dab640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91180a3300 0x7f91180a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:44.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.933+0000 7f91227fc640 1 -- 172.21.15.12:0/554550264 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f91280f0260 con 0x7f912c100450 2024-09-19T06:39:44.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.933+0000 7f9130dab640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91180a3300 0x7f91180a57c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f912c19b610 tx=0x7f911c005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:44.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:44.937+0000 7f91227fc640 1 -- 172.21.15.12:0/554550264 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91280bcd20 con 0x7f912c100450 2024-09-19T06:39:45.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:44 smithi173 ceph-mon[35349]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:39:45.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.121+0000 7f9133810640 1 -- 172.21.15.12:0/554550264 --> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f912c062630 con 0x7f91180a3300 2024-09-19T06:39:45.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.123+0000 7f91227fc640 1 -- 172.21.15.12:0/554550264 <== mgr.14150 v2:172.21.15.12:6800/4060248487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f912c062630 con 0x7f91180a3300 2024-09-19T06:39:45.124 INFO:teuthology.orchestra.run.smithi012.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T06:39:45.124 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005J400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T06:39:45.124 INFO:teuthology.orchestra.run.smithi012.stdout:smithi016 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002C480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:39:45.124 INFO:teuthology.orchestra.run.smithi012.stdout:smithi173 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204019S400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:39:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 -- 172.21.15.12:0/554550264 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91180a3300 msgr2=0x7f91180a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91180a3300 0x7f91180a57c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f912c19b610 tx=0x7f911c005c60 comp rx=0 tx=0).stop 2024-09-19T06:39:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 -- 172.21.15.12:0/554550264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c100450 msgr2=0x7f912c19a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c100450 0x7f912c19a0f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9128009230 tx=0x7f9128004360 comp rx=0 tx=0).stop 2024-09-19T06:39:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 -- 172.21.15.12:0/554550264 shutdown_connections 2024-09-19T06:39:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f91180a3300 0x7f91180a57c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f912c101730 0x7f912c1a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f912c100d90 0x7f912c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 --2- 172.21.15.12:0/554550264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c100450 0x7f912c19a0f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 -- 172.21.15.12:0/554550264 >> 172.21.15.12:0/554550264 conn(0x7f912c0fc280 msgr2=0x7f912c0fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 -- 172.21.15.12:0/554550264 shutdown_connections 2024-09-19T06:39:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:45.125+0000 7f9133810640 1 -- 172.21.15.12:0/554550264 wait complete. 2024-09-19T06:39:45.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:44 smithi016 ceph-mon[34911]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:39:45.770 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:39:45.780 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:39:45.780 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T06:39:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:46.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:45 smithi173 ceph-mon[35349]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:45 smithi012 ceph-mon[30937]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:46.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:45 smithi016 ceph-mon[34911]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:46.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.535+0000 7fecf9ac5640 1 -- 172.21.15.12:0/593256741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf4102e00 msgr2=0x7fecf4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:46.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.535+0000 7fecf9ac5640 1 --2- 172.21.15.12:0/593256741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf4102e00 0x7fecf4103280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009900 tx=0x7fecdc02a410 comp rx=0 tx=0).stop 2024-09-19T06:39:46.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.535+0000 7fecf9ac5640 1 -- 172.21.15.12:0/593256741 shutdown_connections 2024-09-19T06:39:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.535+0000 7fecf9ac5640 1 --2- 172.21.15.12:0/593256741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf41037c0 0x7fecf410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.535+0000 7fecf9ac5640 1 --2- 172.21.15.12:0/593256741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf4102e00 0x7fecf4103280 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.535+0000 7fecf9ac5640 1 --2- 172.21.15.12:0/593256741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf4101c00 0x7fecf4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.535+0000 7fecf9ac5640 1 -- 172.21.15.12:0/593256741 >> 172.21.15.12:0/593256741 conn(0x7fecf40fd390 msgr2=0x7fecf40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.535+0000 7fecf9ac5640 1 -- 172.21.15.12:0/593256741 shutdown_connections 2024-09-19T06:39:46.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.535+0000 7fecf9ac5640 1 -- 172.21.15.12:0/593256741 wait complete. 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf9ac5640 1 Processor -- start 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf9ac5640 1 -- start start 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf9ac5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf4101c00 0x7fecf4075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf9ac5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf4102e00 0x7fecf40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf9ac5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf41037c0 0x7fecf4074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf9ac5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fecf410d8b0 con 0x7fecf4101c00 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf9ac5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fecf410d730 con 0x7fecf41037c0 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf9ac5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fecf410da30 con 0x7fecf4102e00 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf4101c00 0x7fecf4075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf4101c00 0x7fecf4075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36286/0 (socket says 172.21.15.12:36286) 2024-09-19T06:39:46.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf37fe640 1 -- 172.21.15.12:0/894361946 learned_addr learned my addr 172.21.15.12:0/894361946 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7feceaffd640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf4102e00 0x7fecf40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.536+0000 7fecf3fff640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf41037c0 0x7fecf4074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf37fe640 1 -- 172.21.15.12:0/894361946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf4102e00 msgr2=0x7fecf40745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf37fe640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf4102e00 0x7fecf40745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf37fe640 1 -- 172.21.15.12:0/894361946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf41037c0 msgr2=0x7fecf4074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf37fe640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf41037c0 0x7fecf4074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf37fe640 1 -- 172.21.15.12:0/894361946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf40753e0 con 0x7fecf4101c00 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf37fe640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf4101c00 0x7fecf4075f90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fece400d770 tx=0x7fece400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf17fa640 1 -- 172.21.15.12:0/894361946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4017070 con 0x7fecf4101c00 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf9ac5640 1 -- 172.21.15.12:0/894361946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf41a20c0 con 0x7fecf4101c00 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf17fa640 1 -- 172.21.15.12:0/894361946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fece4009c30 con 0x7fecf4101c00 2024-09-19T06:39:46.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf17fa640 1 -- 172.21.15.12:0/894361946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4003dd0 con 0x7fecf4101c00 2024-09-19T06:39:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.537+0000 7fecf9ac5640 1 -- 172.21.15.12:0/894361946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf41a25d0 con 0x7fecf4101c00 2024-09-19T06:39:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.538+0000 7fecf9ac5640 1 -- 172.21.15.12:0/894361946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf4108fd0 con 0x7fecf4101c00 2024-09-19T06:39:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.539+0000 7fecf17fa640 1 -- 172.21.15.12:0/894361946 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fece4003fb0 con 0x7fecf4101c00 2024-09-19T06:39:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.540+0000 7fecf17fa640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fece00a32d0 0x7fece00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:46.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.540+0000 7feceaffd640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fece00a32d0 0x7fece00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:46.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.540+0000 7fecf17fa640 1 -- 172.21.15.12:0/894361946 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fece40cf550 con 0x7fecf4101c00 2024-09-19T06:39:46.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.541+0000 7feceaffd640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fece00a32d0 0x7fece00a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fecdc031440 tx=0x7fecdc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:46.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.544+0000 7fecf17fa640 1 -- 172.21.15.12:0/894361946 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fece409c010 con 0x7fecf4101c00 2024-09-19T06:39:46.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.755+0000 7fecf9ac5640 1 -- 172.21.15.12:0/894361946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fecf4062df0 con 0x7fecf4101c00 2024-09-19T06:39:46.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.756+0000 7fecf17fa640 1 -- 172.21.15.12:0/894361946 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3127 (secure 0 0 0) 0x7fece4009de0 con 0x7fecf4101c00 2024-09-19T06:39:46.758 INFO:teuthology.orchestra.run.smithi012.stdout:e27 2024-09-19T06:39:46.758 INFO:teuthology.orchestra.run.smithi012.stdout:btime 2024-09-19T06:38:26:674546+0000 2024-09-19T06:39:46.758 INFO:teuthology.orchestra.run.smithi012.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:39:46.758 INFO:teuthology.orchestra.run.smithi012.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:39:46.758 INFO:teuthology.orchestra.run.smithi012.stdout:legacy client fscid: 1 2024-09-19T06:39:46.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:46.758 INFO:teuthology.orchestra.run.smithi012.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:39:46.758 INFO:teuthology.orchestra.run.smithi012.stdout:fs_name cephfs 2024-09-19T06:39:46.758 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 27 2024-09-19T06:39:46.758 INFO:teuthology.orchestra.run.smithi012.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-19T06:38:14.665545+0000 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2024-09-19T06:38:26.674520+0000 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:tableserver 0 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:root 0 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:session_timeout 300 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:session_autoclose 300 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:max_file_size 1099511627776 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:max_xattr_size 65536 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:required_client_features {} 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:last_failure 0 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:last_failure_osd_epoch 0 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:max_mds 5 2024-09-19T06:39:46.759 INFO:teuthology.orchestra.run.smithi012.stdout:in 0,1,2,3,4 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:up {0=24509,1=24502,2=24481,3=24439,4=24431} 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:failed 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:damaged 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:stopped 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:data_pools [3] 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:metadata_pool 2 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:inline_data disabled 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:balancer 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:bal_rank_mask -1 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:standby_count_wanted 0 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:qdb_cluster leader: 24509 members: 24502,24481,24439,24509,24431 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b{0:24509} state up:active seq 4 addr [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.760 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.h{0:24476} state up:standby-replay seq 1 addr [v2:172.21.15.16:6836/2891393100,v1:172.21.15.16:6837/2891393100] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.i{1:24502} state up:active seq 9 addr [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.f{1:24475} state up:standby-replay seq 1 addr [v2:172.21.15.173:6834/2501878004,v1:172.21.15.173:6835/2501878004] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c{2:24481} state up:active seq 10 addr [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.e{2:24461} state up:standby-replay seq 1 addr [v2:172.21.15.16:6834/549418858,v1:172.21.15.16:6835/549418858] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.l{3:24439} state up:active seq 15 addr [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a{3:14634} state up:standby-replay seq 1 addr [v2:172.21.15.12:6840/1524660797,v1:172.21.15.12:6841/1524660797] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.k{4:24431} state up:active seq 14 addr [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.g{4:14622} state up:standby-replay seq 1 addr [v2:172.21.15.12:6838/523853421,v1:172.21.15.12:6839/523853421] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout:Standby daemons: 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:46.761 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.j{-1:14568} state up:standby seq 1 addr [v2:172.21.15.12:6834/1831354583,v1:172.21.15.12:6835/1831354583] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.762 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d{-1:14580} state up:standby seq 1 addr [v2:172.21.15.12:6836/2426691660,v1:172.21.15.12:6837/2426691660] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:39:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-19T06:39:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 -- 172.21.15.12:0/894361946 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fece00a32d0 msgr2=0x7fece00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fece00a32d0 0x7fece00a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fecdc031440 tx=0x7fecdc0315b0 comp rx=0 tx=0).stop 2024-09-19T06:39:46.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 -- 172.21.15.12:0/894361946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf4101c00 msgr2=0x7fecf4075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf4101c00 0x7fecf4075f90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fece400d770 tx=0x7fece400dc30 comp rx=0 tx=0).stop 2024-09-19T06:39:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 -- 172.21.15.12:0/894361946 shutdown_connections 2024-09-19T06:39:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fece00a32d0 0x7fece00a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf41037c0 0x7fecf4074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf4102e00 0x7fecf40745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 --2- 172.21.15.12:0/894361946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf4101c00 0x7fecf4075f90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 -- 172.21.15.12:0/894361946 >> 172.21.15.12:0/894361946 conn(0x7fecf40fd390 msgr2=0x7fecf41061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 -- 172.21.15.12:0/894361946 shutdown_connections 2024-09-19T06:39:46.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:46.758+0000 7fecf9ac5640 1 -- 172.21.15.12:0/894361946 wait complete. 2024-09-19T06:39:47.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:46 smithi173 ceph-mon[35349]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:39:47.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:46 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/894361946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:39:47.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:46 smithi012 ceph-mon[30937]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:39:47.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:46 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/894361946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:39:47.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:46 smithi016 ceph-mon[34911]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:39:47.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:46 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/894361946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:39:47.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T06:39:47.666 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:48.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.201+0000 7f79d1db9640 1 -- 172.21.15.12:0/2708581469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79cc101c00 msgr2=0x7f79cc102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:48.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.201+0000 7f79d1db9640 1 --2- 172.21.15.12:0/2708581469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79cc101c00 0x7f79cc102000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009900 tx=0x7f79bc02a410 comp rx=0 tx=0).stop 2024-09-19T06:39:48.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.202+0000 7f79d1db9640 1 -- 172.21.15.12:0/2708581469 shutdown_connections 2024-09-19T06:39:48.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.202+0000 7f79d1db9640 1 --2- 172.21.15.12:0/2708581469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79cc1037c0 0x7f79cc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:48.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.202+0000 7f79d1db9640 1 --2- 172.21.15.12:0/2708581469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79cc102e00 0x7f79cc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.202+0000 7f79d1db9640 1 --2- 172.21.15.12:0/2708581469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79cc101c00 0x7f79cc102000 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.202+0000 7f79d1db9640 1 -- 172.21.15.12:0/2708581469 >> 172.21.15.12:0/2708581469 conn(0x7f79cc0fd390 msgr2=0x7f79cc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.202+0000 7f79d1db9640 1 -- 172.21.15.12:0/2708581469 shutdown_connections 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.202+0000 7f79d1db9640 1 -- 172.21.15.12:0/2708581469 wait complete. 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.202+0000 7f79d1db9640 1 Processor -- start 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.202+0000 7f79d1db9640 1 -- start start 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79d1db9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79cc101c00 0x7f79cc197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79d1db9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79cc102e00 0x7f79cc1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79d1db9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79cc1037c0 0x7f79cc19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79d1db9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc10d8e0 con 0x7f79cc101c00 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79d1db9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc10d760 con 0x7f79cc1037c0 2024-09-19T06:39:48.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79d1db9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc10da60 con 0x7f79cc102e00 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79cb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79cc101c00 0x7f79cc197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79cb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79cc101c00 0x7f79cc197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36308/0 (socket says 172.21.15.12:36308) 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1042724117 learned_addr learned my addr 172.21.15.12:0/1042724117 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79c2ffd640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79cc102e00 0x7f79cc1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79cbfff640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79cc1037c0 0x7f79cc19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1042724117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79cc102e00 msgr2=0x7f79cc1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79cb7fe640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79cc102e00 0x7f79cc1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1042724117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79cc1037c0 msgr2=0x7f79cc19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79cb7fe640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79cc1037c0 0x7f79cc19f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1042724117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc19fb90 con 0x7f79cc101c00 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.203+0000 7f79cb7fe640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79cc101c00 0x7f79cc197f60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f79bc031610 tx=0x7f79bc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.204+0000 7f79c97fa640 1 -- 172.21.15.12:0/1042724117 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc03f030 con 0x7f79cc101c00 2024-09-19T06:39:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.204+0000 7f79d1db9640 1 -- 172.21.15.12:0/1042724117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79cc19fe20 con 0x7f79cc101c00 2024-09-19T06:39:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.204+0000 7f79c97fa640 1 -- 172.21.15.12:0/1042724117 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79bc003ce0 con 0x7f79cc101c00 2024-09-19T06:39:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.204+0000 7f79c97fa640 1 -- 172.21.15.12:0/1042724117 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc035070 con 0x7f79cc101c00 2024-09-19T06:39:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.204+0000 7f79d1db9640 1 -- 172.21.15.12:0/1042724117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79cc1a0290 con 0x7f79cc101c00 2024-09-19T06:39:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.205+0000 7f79d1db9640 1 -- 172.21.15.12:0/1042724117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79cc109020 con 0x7f79cc101c00 2024-09-19T06:39:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.207+0000 7f79c97fa640 1 -- 172.21.15.12:0/1042724117 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f79bc042030 con 0x7f79cc101c00 2024-09-19T06:39:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.207+0000 7f79c97fa640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f79b80a3300 0x7f79b80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.208+0000 7f79c2ffd640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f79b80a3300 0x7f79b80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.208+0000 7f79c97fa640 1 -- 172.21.15.12:0/1042724117 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f79bc0f01d0 con 0x7f79cc101c00 2024-09-19T06:39:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.208+0000 7f79c2ffd640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f79b80a3300 0x7f79b80a57c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f79cc199480 tx=0x7f79b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.210+0000 7f79c97fa640 1 -- 172.21.15.12:0/1042724117 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79bc0bc6a0 con 0x7f79cc101c00 2024-09-19T06:39:48.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.389+0000 7f79d1db9640 1 -- 172.21.15.12:0/1042724117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f79cc02d7c0 con 0x7f79cc101c00 2024-09-19T06:39:48.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.390+0000 7f79c97fa640 1 -- 172.21.15.12:0/1042724117 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) ==== 56+0+5409 (secure 0 0 0) 0x7f79bc0c09a0 con 0x7f79cc101c00 2024-09-19T06:39:48.391 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 85 2024-09-19T06:39:48.391 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:39:48.391 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-19T06:30:34.142933+0000 2024-09-19T06:39:48.391 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2024-09-19T06:39:23.693200+0000 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:crush_version 26 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:full_ratio 0.95 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:backfillfull_ratio 0.9 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:nearfull_ratio 0.85 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:require_min_compat_client luminous 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:min_compat_client luminous 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:require_osd_release squid 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:stretch_mode_enabled false 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T06:39:48.392 INFO:teuthology.orchestra.run.smithi012.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:max_osd 12 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6802/3065119058,v1:172.21.15.12:6803/3065119058] [v2:172.21.15.12:6804/3065119058,v1:172.21.15.12:6805/3065119058] exists,up b91bda9f-2b6e-4186-b0fe-7e0b5a50121a 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 up in weight 1 up_from 13 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6800/610562255,v1:172.21.15.16:6801/610562255] [v2:172.21.15.16:6802/610562255,v1:172.21.15.16:6803/610562255] exists,up 07e58c8d-382e-4acb-b271-116ef907125d 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 up in weight 1 up_from 18 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6800/3671051069,v1:172.21.15.173:6801/3671051069] [v2:172.21.15.173:6802/3671051069,v1:172.21.15.173:6803/3671051069] exists,up 7438fe31-c81a-4f07-a580-8cccad16f0ec 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 up in weight 1 up_from 24 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6810/808998365,v1:172.21.15.12:6811/808998365] [v2:172.21.15.12:6812/808998365,v1:172.21.15.12:6813/808998365] exists,up ba9ac3c0-f7da-4ee8-9102-3909f8b8504b 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 up in weight 1 up_from 32 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6808/250959464,v1:172.21.15.16:6809/250959464] [v2:172.21.15.16:6810/250959464,v1:172.21.15.16:6811/250959464] exists,up 20aad675-3694-46a0-a7f3-d3ebd60aee5e 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 up in weight 1 up_from 37 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6808/2756003691,v1:172.21.15.173:6809/2756003691] [v2:172.21.15.173:6810/2756003691,v1:172.21.15.173:6811/2756003691] exists,up 583dbaf5-4f1f-45a1-b839-67a5d21c483d 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 up in weight 1 up_from 45 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6818/2461755084,v1:172.21.15.12:6819/2461755084] [v2:172.21.15.12:6820/2461755084,v1:172.21.15.12:6821/2461755084] exists,up f0b6ef77-21e2-4950-a37f-57ccbf9101d7 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 up in weight 1 up_from 49 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6816/3670688861,v1:172.21.15.16:6817/3670688861] [v2:172.21.15.16:6818/3670688861,v1:172.21.15.16:6819/3670688861] exists,up 657d94ae-3aee-432c-84c1-1535d2806aa0 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.8 up in weight 1 up_from 56 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6816/332186577,v1:172.21.15.173:6817/332186577] [v2:172.21.15.173:6818/332186577,v1:172.21.15.173:6819/332186577] exists,up 0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.9 up in weight 1 up_from 63 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6826/32889284,v1:172.21.15.12:6827/32889284] [v2:172.21.15.12:6828/32889284,v1:172.21.15.12:6829/32889284] exists,up 74fa5ae1-a2ed-45df-9456-d1b8b9cdd961 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.10 up in weight 1 up_from 68 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6824/2551433772,v1:172.21.15.16:6825/2551433772] [v2:172.21.15.16:6826/2551433772,v1:172.21.15.16:6827/2551433772] exists,up d2491092-90ed-40f4-ac16-0b21acb8da6b 2024-09-19T06:39:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:osd.11 up in weight 1 up_from 75 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6824/3706383850,v1:172.21.15.173:6825/3706383850] [v2:172.21.15.173:6826/3706383850,v1:172.21.15.173:6827/3706383850] exists,up 8e5cfd54-d273-4af7-b672-7c3ffef495c9 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.0 [5,1] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.5 [8,11] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.b [7,4] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.d [5,11] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.14 [2,4] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.1b [2,4] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.1d [2,6] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.1f [8,1] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.6 [4,6] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.11 [5,9] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.14 [4,7] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.1b [4,8] 2024-09-19T06:39:48.394 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.1d [5,9] 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.38 [3,9] 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6800/1073027972 expires 2024-09-20T06:31:21.622973+0000 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/321072458 expires 2024-09-20T06:31:21.622973+0000 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/2279004208 expires 2024-09-20T06:31:21.622973+0000 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6801/4034653914 expires 2024-09-20T06:30:56.926561+0000 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6801/1073027972 expires 2024-09-20T06:31:21.622973+0000 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6800/4034653914 expires 2024-09-20T06:30:56.926561+0000 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/1625397880 expires 2024-09-20T06:30:56.926561+0000 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/3149948455 expires 2024-09-20T06:31:21.622973+0000 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/1745599596 expires 2024-09-20T06:30:56.926561+0000 2024-09-19T06:39:48.395 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/509408594 expires 2024-09-20T06:30:56.926561+0000 2024-09-19T06:39:48.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 -- 172.21.15.12:0/1042724117 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f79b80a3300 msgr2=0x7f79b80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:48.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f79b80a3300 0x7f79b80a57c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f79cc199480 tx=0x7f79b400b390 comp rx=0 tx=0).stop 2024-09-19T06:39:48.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 -- 172.21.15.12:0/1042724117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79cc101c00 msgr2=0x7f79cc197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:48.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79cc101c00 0x7f79cc197f60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f79bc031610 tx=0x7f79bc0043b0 comp rx=0 tx=0).stop 2024-09-19T06:39:48.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 -- 172.21.15.12:0/1042724117 shutdown_connections 2024-09-19T06:39:48.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f79b80a3300 0x7f79b80a57c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:48.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79cc1037c0 0x7f79cc19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:48.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79cc102e00 0x7f79cc1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:48.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 --2- 172.21.15.12:0/1042724117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79cc101c00 0x7f79cc197f60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:48.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 -- 172.21.15.12:0/1042724117 >> 172.21.15.12:0/1042724117 conn(0x7f79cc0fd390 msgr2=0x7f79cc1061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:48.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 -- 172.21.15.12:0/1042724117 shutdown_connections 2024-09-19T06:39:48.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:48.393+0000 7f79d1db9640 1 -- 172.21.15.12:0/1042724117 wait complete. 2024-09-19T06:39:49.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:48 smithi173 ceph-mon[35349]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T06:39:49.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:48 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1042724117' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:39:49.088 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:48 smithi012 ceph-mon[30937]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T06:39:49.088 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:48 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1042724117' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:39:49.116 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T06:39:49.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:39:49.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:48 smithi016 ceph-mon[34911]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-19T06:39:49.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:48 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1042724117' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:39:49.382 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.842+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2102532526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100a80 msgr2=0x7f6e28100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.842+0000 7f6e2e00e640 1 --2- 172.21.15.12:0/2102532526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100a80 0x7f6e28100ee0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009930 tx=0x7f6e1002a420 comp rx=0 tx=0).stop 2024-09-19T06:39:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.842+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2102532526 shutdown_connections 2024-09-19T06:39:49.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.842+0000 7f6e2e00e640 1 --2- 172.21.15.12:0/2102532526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e28101420 0x7f6e2810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.842+0000 7f6e2e00e640 1 --2- 172.21.15.12:0/2102532526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100a80 0x7f6e28100ee0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.842+0000 7f6e2e00e640 1 --2- 172.21.15.12:0/2102532526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e28106a80 0x7f6e28106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.842+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2102532526 >> 172.21.15.12:0/2102532526 conn(0x7f6e280fc7a0 msgr2=0x7f6e280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.842+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2102532526 shutdown_connections 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.843+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2102532526 wait complete. 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.843+0000 7f6e2e00e640 1 Processor -- start 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.843+0000 7f6e2e00e640 1 -- start start 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.843+0000 7f6e2e00e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e28100a80 0x7f6e28198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e2e00e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e28101420 0x7f6e28198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e2e00e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28106a80 0x7f6e2819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e2e00e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28110e80 con 0x7f6e28106a80 2024-09-19T06:39:49.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e2e00e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28110d00 con 0x7f6e28100a80 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e2e00e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28111000 con 0x7f6e28101420 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e27fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28106a80 0x7f6e2819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e27fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28106a80 0x7f6e2819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36332/0 (socket says 172.21.15.12:36332) 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e27fff640 1 -- 172.21.15.12:0/2577270600 learned_addr learned my addr 172.21.15.12:0/2577270600 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e277fe640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e28100a80 0x7f6e28198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e26ffd640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e28101420 0x7f6e28198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e27fff640 1 -- 172.21.15.12:0/2577270600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e28101420 msgr2=0x7f6e28198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e27fff640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e28101420 0x7f6e28198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e27fff640 1 -- 172.21.15.12:0/2577270600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e28100a80 msgr2=0x7f6e28198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e27fff640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e28100a80 0x7f6e28198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:49.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e27fff640 1 -- 172.21.15.12:0/2577270600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2819d3e0 con 0x7f6e28106a80 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e27fff640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28106a80 0x7f6e2819cd00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000eaa0 tx=0x7f6e2000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e24ff9640 1 -- 172.21.15.12:0/2577270600 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2000cdb0 con 0x7f6e28106a80 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e24ff9640 1 -- 172.21.15.12:0/2577270600 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e20005020 con 0x7f6e28106a80 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e24ff9640 1 -- 172.21.15.12:0/2577270600 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e200116b0 con 0x7f6e28106a80 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2577270600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2819d6d0 con 0x7f6e28106a80 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.844+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2577270600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e281a4fb0 con 0x7f6e28106a80 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.846+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2577270600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e28100ee0 con 0x7f6e28106a80 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.848+0000 7f6e24ff9640 1 -- 172.21.15.12:0/2577270600 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6e20005560 con 0x7f6e28106a80 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.848+0000 7f6e24ff9640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f6e140a3350 0x7f6e140a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.848+0000 7f6e277fe640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f6e140a3350 0x7f6e140a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.849+0000 7f6e24ff9640 1 -- 172.21.15.12:0/2577270600 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f6e200d0130 con 0x7f6e28106a80 2024-09-19T06:39:49.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.849+0000 7f6e277fe640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f6e140a3350 0x7f6e140a5810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800bb60 tx=0x7f6e1800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:49.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:49.851+0000 7f6e24ff9640 1 -- 172.21.15.12:0/2577270600 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e20016030 con 0x7f6e28106a80 2024-09-19T06:39:50.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.068+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2577270600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e28199790 con 0x7f6e28106a80 2024-09-19T06:39:50.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.069+0000 7f6e24ff9640 1 -- 172.21.15.12:0/2577270600 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11971 (secure 0 0 0) 0x7f6e28199790 con 0x7f6e28106a80 2024-09-19T06:39:50.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:50.071 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-19T06:38:26:674546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:38:26.674520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:39:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-19T06:39:50.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2577270600 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f6e140a3350 msgr2=0x7f6e140a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f6e140a3350 0x7f6e140a5810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800bb60 tx=0x7f6e1800b390 comp rx=0 tx=0).stop 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2577270600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28106a80 msgr2=0x7f6e2819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28106a80 0x7f6e2819cd00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000eaa0 tx=0x7f6e2000ef60 comp rx=0 tx=0).stop 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2577270600 shutdown_connections 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f6e140a3350 0x7f6e140a5810 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28106a80 0x7f6e2819cd00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e28101420 0x7f6e28198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 --2- 172.21.15.12:0/2577270600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e28100a80 0x7f6e28198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2577270600 >> 172.21.15.12:0/2577270600 conn(0x7f6e280fc7a0 msgr2=0x7f6e2806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2577270600 shutdown_connections 2024-09-19T06:39:50.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:50.071+0000 7f6e2e00e640 1 -- 172.21.15.12:0/2577270600 wait complete. 2024-09-19T06:39:50.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:39:51.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:50 smithi173 ceph-mon[35349]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:51.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:50 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2577270600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:51.085 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:51.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:50 smithi012 ceph-mon[30937]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:51.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:50 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2577270600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:51.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:50 smithi016 ceph-mon[34911]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T06:39:51.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:50 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2577270600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.551+0000 7f156f634640 1 -- 172.21.15.12:0/3453253036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1568106f10 msgr2=0x7f156810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.551+0000 7f156f634640 1 --2- 172.21.15.12:0/3453253036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1568106f10 0x7f156810ea90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1560009ca0 tx=0x7f156002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.551+0000 7f156f634640 1 -- 172.21.15.12:0/3453253036 shutdown_connections 2024-09-19T06:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.551+0000 7f156f634640 1 --2- 172.21.15.12:0/3453253036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1568106f10 0x7f156810ea90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.551+0000 7f156f634640 1 --2- 172.21.15.12:0/3453253036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1568102790 0x7f15681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.551+0000 7f156f634640 1 --2- 172.21.15.12:0/3453253036 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1568101de0 0x7f15681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.551+0000 7f156f634640 1 -- 172.21.15.12:0/3453253036 >> 172.21.15.12:0/3453253036 conn(0x7f15680fd8c0 msgr2=0x7f15680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.551+0000 7f156f634640 1 -- 172.21.15.12:0/3453253036 shutdown_connections 2024-09-19T06:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.551+0000 7f156f634640 1 -- 172.21.15.12:0/3453253036 wait complete. 2024-09-19T06:39:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156f634640 1 Processor -- start 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156f634640 1 -- start start 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156f634640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1568101de0 0x7f15681983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156f634640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1568102790 0x7f1568198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156f634640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1568106f10 0x7f156819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156f634640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1568111f70 con 0x7f1568106f10 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156f634640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1568111df0 con 0x7f1568101de0 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156f634640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f15681120f0 con 0x7f1568102790 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156dbd1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1568106f10 0x7f156819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156dbd1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1568106f10 0x7f156819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47946/0 (socket says 172.21.15.12:47946) 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156dbd1640 1 -- 172.21.15.12:0/179094959 learned_addr learned my addr 172.21.15.12:0/179094959 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156d3d0640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1568101de0 0x7f15681983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156dbd1640 1 -- 172.21.15.12:0/179094959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1568102790 msgr2=0x7f1568198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156dbd1640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1568102790 0x7f1568198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156dbd1640 1 -- 172.21.15.12:0/179094959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1568101de0 msgr2=0x7f15681983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156dbd1640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1568101de0 0x7f15681983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156dbd1640 1 -- 172.21.15.12:0/179094959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156819d380 con 0x7f1568106f10 2024-09-19T06:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.552+0000 7f156d3d0640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1568101de0 0x7f15681983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.553+0000 7f156dbd1640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1568106f10 0x7f156819cca0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1560031a20 tx=0x7f1560031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.553+0000 7f155e7fc640 1 -- 172.21.15.12:0/179094959 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560003c30 con 0x7f1568106f10 2024-09-19T06:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.553+0000 7f155e7fc640 1 -- 172.21.15.12:0/179094959 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1560003dd0 con 0x7f1568106f10 2024-09-19T06:39:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.553+0000 7f156f634640 1 -- 172.21.15.12:0/179094959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f156819d610 con 0x7f1568106f10 2024-09-19T06:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.553+0000 7f155e7fc640 1 -- 172.21.15.12:0/179094959 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156002fcf0 con 0x7f1568106f10 2024-09-19T06:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.553+0000 7f156f634640 1 -- 172.21.15.12:0/179094959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15681a4f50 con 0x7f1568106f10 2024-09-19T06:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.554+0000 7f156f634640 1 -- 172.21.15.12:0/179094959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15681021c0 con 0x7f1568106f10 2024-09-19T06:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.555+0000 7f155e7fc640 1 -- 172.21.15.12:0/179094959 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1560004050 con 0x7f1568106f10 2024-09-19T06:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.556+0000 7f155e7fc640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f15540a3350 0x7f15540a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.556+0000 7f156d3d0640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f15540a3350 0x7f15540a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.556+0000 7f155e7fc640 1 -- 172.21.15.12:0/179094959 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f15600f0e00 con 0x7f1568106f10 2024-09-19T06:39:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.557+0000 7f156d3d0640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f15540a3350 0x7f15540a5810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15640058c0 tx=0x7f1564005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.560+0000 7f155e7fc640 1 -- 172.21.15.12:0/179094959 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15600bdac0 con 0x7f1568106f10 2024-09-19T06:39:51.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.803+0000 7f156f634640 1 -- 172.21.15.12:0/179094959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1568109bc0 con 0x7f1568106f10 2024-09-19T06:39:51.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.804+0000 7f155e7fc640 1 -- 172.21.15.12:0/179094959 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11971 (secure 0 0 0) 0x7f156002fe90 con 0x7f1568106f10 2024-09-19T06:39:51.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:51.807 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-19T06:38:26:674546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:38:26.674520+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:39:51.808 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-19T06:39:51.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 -- 172.21.15.12:0/179094959 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f15540a3350 msgr2=0x7f15540a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f15540a3350 0x7f15540a5810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15640058c0 tx=0x7f1564005850 comp rx=0 tx=0).stop 2024-09-19T06:39:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 -- 172.21.15.12:0/179094959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1568106f10 msgr2=0x7f156819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1568106f10 0x7f156819cca0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1560031a20 tx=0x7f1560031a50 comp rx=0 tx=0).stop 2024-09-19T06:39:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 -- 172.21.15.12:0/179094959 shutdown_connections 2024-09-19T06:39:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f15540a3350 0x7f15540a5810 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1568106f10 0x7f156819cca0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1568102790 0x7f1568198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:51.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 --2- 172.21.15.12:0/179094959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1568101de0 0x7f15681983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:51.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 -- 172.21.15.12:0/179094959 >> 172.21.15.12:0/179094959 conn(0x7f15680fd8c0 msgr2=0x7f15680feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:51.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 -- 172.21.15.12:0/179094959 shutdown_connections 2024-09-19T06:39:51.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:51.806+0000 7f156f634640 1 -- 172.21.15.12:0/179094959 wait complete. 2024-09-19T06:39:52.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:51 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/179094959' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:52.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:51 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/179094959' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:52.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:51 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/179094959' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:39:52.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:39:52.846 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:53.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:52 smithi173 ceph-mon[35349]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:53.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:52 smithi173 ceph-mon[35349]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:39:53.097 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:52 smithi012 ceph-mon[30937]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:53.097 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:52 smithi012 ceph-mon[30937]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:39:53.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:52 smithi016 ceph-mon[34911]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T06:39:53.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:52 smithi016 ceph-mon[34911]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T06:39:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.304+0000 7f52795e8640 1 -- 172.21.15.12:0/1366029698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5274102d30 msgr2=0x7f5274103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.304+0000 7f52795e8640 1 --2- 172.21.15.12:0/1366029698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5274102d30 0x7f5274103110 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5264009930 tx=0x7f526402a420 comp rx=0 tx=0).stop 2024-09-19T06:39:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.304+0000 7f52795e8640 1 -- 172.21.15.12:0/1366029698 shutdown_connections 2024-09-19T06:39:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.304+0000 7f52795e8640 1 --2- 172.21.15.12:0/1366029698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52741082a0 0x7f527410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.304+0000 7f52795e8640 1 --2- 172.21.15.12:0/1366029698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52741036e0 0x7f5274107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.304+0000 7f52795e8640 1 --2- 172.21.15.12:0/1366029698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5274102d30 0x7f5274103110 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.304+0000 7f52795e8640 1 -- 172.21.15.12:0/1366029698 >> 172.21.15.12:0/1366029698 conn(0x7f52740fc7d0 msgr2=0x7f52740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.304+0000 7f52795e8640 1 -- 172.21.15.12:0/1366029698 shutdown_connections 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.304+0000 7f52795e8640 1 -- 172.21.15.12:0/1366029698 wait complete. 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.304+0000 7f52795e8640 1 Processor -- start 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f52795e8640 1 -- start start 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f52795e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5274102d30 0x7f5274198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f52795e8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52741036e0 0x7f5274198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f52795e8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52741082a0 0x7f527419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f52795e8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5274112100 con 0x7f5274102d30 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f52795e8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5274111f80 con 0x7f52741036e0 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f52795e8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5274112280 con 0x7f52741082a0 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f5272ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5274102d30 0x7f5274198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f5272ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5274102d30 0x7f5274198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47964/0 (socket says 172.21.15.12:47964) 2024-09-19T06:39:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f5272ffd640 1 -- 172.21.15.12:0/1184642186 learned_addr learned my addr 172.21.15.12:0/1184642186 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f52737fe640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52741082a0 0x7f527419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f52727fc640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52741036e0 0x7f5274198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f5272ffd640 1 -- 172.21.15.12:0/1184642186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52741082a0 msgr2=0x7f527419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f5272ffd640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52741082a0 0x7f527419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f5272ffd640 1 -- 172.21.15.12:0/1184642186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52741036e0 msgr2=0x7f5274198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f5272ffd640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52741036e0 0x7f5274198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f5272ffd640 1 -- 172.21.15.12:0/1184642186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527419d5b0 con 0x7f5274102d30 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.305+0000 7f52727fc640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52741036e0 0x7f5274198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.306+0000 7f5272ffd640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5274102d30 0x7f5274198600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5264009230 tx=0x7f5264004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.306+0000 7f525bfff640 1 -- 172.21.15.12:0/1184642186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526403f030 con 0x7f5274102d30 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.306+0000 7f525bfff640 1 -- 172.21.15.12:0/1184642186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5264003ad0 con 0x7f5274102d30 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.306+0000 7f52795e8640 1 -- 172.21.15.12:0/1184642186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527419d840 con 0x7f5274102d30 2024-09-19T06:39:53.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.306+0000 7f525bfff640 1 -- 172.21.15.12:0/1184642186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264035070 con 0x7f5274102d30 2024-09-19T06:39:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.306+0000 7f52795e8640 1 -- 172.21.15.12:0/1184642186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52741a5180 con 0x7f5274102d30 2024-09-19T06:39:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.307+0000 7f52795e8640 1 -- 172.21.15.12:0/1184642186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f527406a850 con 0x7f5274102d30 2024-09-19T06:39:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.308+0000 7f525bfff640 1 -- 172.21.15.12:0/1184642186 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5264042030 con 0x7f5274102d30 2024-09-19T06:39:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.309+0000 7f525bfff640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f525c0a3240 0x7f525c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.309+0000 7f52727fc640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f525c0a3240 0x7f525c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.309+0000 7f525bfff640 1 -- 172.21.15.12:0/1184642186 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f52640efe80 con 0x7f5274102d30 2024-09-19T06:39:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.309+0000 7f52727fc640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f525c0a3240 0x7f525c0a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f52680058c0 tx=0x7f5268005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.313+0000 7f525bfff640 1 -- 172.21.15.12:0/1184642186 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f52640bcb00 con 0x7f5274102d30 2024-09-19T06:39:53.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.488+0000 7f52795e8640 1 -- 172.21.15.12:0/1184642186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5274199960 con 0x7f5274102d30 2024-09-19T06:39:53.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.490+0000 7f525bfff640 1 -- 172.21.15.12:0/1184642186 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22920 (secure 0 0 0) 0x7f52640bc400 con 0x7f5274102d30 2024-09-19T06:39:53.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:39:53.491 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:39:23.693200+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":1}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:39:53.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 -- 172.21.15.12:0/1184642186 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f525c0a3240 msgr2=0x7f525c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:53.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f525c0a3240 0x7f525c0a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f52680058c0 tx=0x7f5268005850 comp rx=0 tx=0).stop 2024-09-19T06:39:53.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 -- 172.21.15.12:0/1184642186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5274102d30 msgr2=0x7f5274198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:53.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5274102d30 0x7f5274198600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5264009230 tx=0x7f5264004270 comp rx=0 tx=0).stop 2024-09-19T06:39:53.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 -- 172.21.15.12:0/1184642186 shutdown_connections 2024-09-19T06:39:53.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f525c0a3240 0x7f525c0a5700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:53.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52741082a0 0x7f527419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:53.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52741036e0 0x7f5274198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:53.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 --2- 172.21.15.12:0/1184642186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5274102d30 0x7f5274198600 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:53.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 -- 172.21.15.12:0/1184642186 >> 172.21.15.12:0/1184642186 conn(0x7f52740fc7d0 msgr2=0x7f5274105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:53.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 -- 172.21.15.12:0/1184642186 shutdown_connections 2024-09-19T06:39:53.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:53.492+0000 7f52795e8640 1 -- 172.21.15.12:0/1184642186 wait complete. 2024-09-19T06:39:54.118 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:53 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1184642186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:39:54.152 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:38:14.665545+0000', 'modified': '2024-09-19T06:38:26.674520+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24509, 'mds_1': 24502, 'mds_2': 24481, 'mds_3': 24439, 'mds_4': 24431}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14622': {'gid': 14622, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6839/523853421', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6838', 'nonce': 523853421}, {'type': 'v1', 'addr': '172.21.15.12:6839', 'nonce': 523853421}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14634': {'gid': 14634, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6841/1524660797', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6840', 'nonce': 1524660797}, {'type': 'v1', 'addr': '172.21.15.12:6841', 'nonce': 1524660797}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.16:6833/2120245692', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 2120245692}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 2120245692}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.173:6833/1987793831', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 1987793831}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 1987793831}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.16:6835/549418858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6834', 'nonce': 549418858}, {'type': 'v1', 'addr': '172.21.15.16:6835', 'nonce': 549418858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6835/2501878004', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 2501878004}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 2501878004}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.16:6837/2891393100', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6836', 'nonce': 2891393100}, {'type': 'v1', 'addr': '172.21.15.16:6837', 'nonce': 2891393100}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/3674805378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 3674805378}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 3674805378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.173:6839/2051533953', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 2051533953}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 2051533953}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.16:6839/2939093038', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6838', 'nonce': 2939093038}, {'type': 'v1', 'addr': '172.21.15.16:6839', 'nonce': 2939093038}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24509, 'qdb_cluster': [24502, 24481, 24439, 24509, 24431]} 2024-09-19T06:39:54.152 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T06:39:54.152 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.k status 2024-09-19T06:39:54.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:53 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1184642186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:39:54.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:53 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1184642186' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:39:54.415 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:54.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.888+0000 7f613485a640 1 -- 172.21.15.12:0/4038139970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130106a80 msgr2=0x7f6130106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.888+0000 7f613485a640 1 --2- 172.21.15.12:0/4038139970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130106a80 0x7f6130106e60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6120009930 tx=0x7f612002a420 comp rx=0 tx=0).stop 2024-09-19T06:39:54.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.888+0000 7f613485a640 1 -- 172.21.15.12:0/4038139970 shutdown_connections 2024-09-19T06:39:54.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.888+0000 7f613485a640 1 --2- 172.21.15.12:0/4038139970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6130101420 0x7f613010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.888+0000 7f613485a640 1 --2- 172.21.15.12:0/4038139970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6130100a80 0x7f6130100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.888+0000 7f613485a640 1 --2- 172.21.15.12:0/4038139970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130106a80 0x7f6130106e60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.888+0000 7f613485a640 1 -- 172.21.15.12:0/4038139970 >> 172.21.15.12:0/4038139970 conn(0x7f61300fc7a0 msgr2=0x7f61300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:54.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.888+0000 7f613485a640 1 -- 172.21.15.12:0/4038139970 shutdown_connections 2024-09-19T06:39:54.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.888+0000 7f613485a640 1 -- 172.21.15.12:0/4038139970 wait complete. 2024-09-19T06:39:54.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.888+0000 7f613485a640 1 Processor -- start 2024-09-19T06:39:54.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f613485a640 1 -- start start 2024-09-19T06:39:54.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f613485a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130100a80 0x7f6130197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f613485a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6130101420 0x7f61301978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f613485a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6130106a80 0x7f613019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f613485a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6130110ea0 con 0x7f6130100a80 2024-09-19T06:39:54.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f613485a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6130110d20 con 0x7f6130101420 2024-09-19T06:39:54.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f613485a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6130111020 con 0x7f6130106a80 2024-09-19T06:39:54.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130100a80 0x7f6130197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130100a80 0x7f6130197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47994/0 (socket says 172.21.15.12:47994) 2024-09-19T06:39:54.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612e59c640 1 -- 172.21.15.12:0/1694006545 learned_addr learned my addr 172.21.15.12:0/1694006545 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:54.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612ed9d640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6130106a80 0x7f613019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612dd9b640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6130101420 0x7f61301978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612e59c640 1 -- 172.21.15.12:0/1694006545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6130106a80 msgr2=0x7f613019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612e59c640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6130106a80 0x7f613019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612e59c640 1 -- 172.21.15.12:0/1694006545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6130101420 msgr2=0x7f61301978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612e59c640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6130101420 0x7f61301978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612e59c640 1 -- 172.21.15.12:0/1694006545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613019c310 con 0x7f6130100a80 2024-09-19T06:39:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.889+0000 7f612e59c640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130100a80 0x7f6130197360 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6120009a50 tx=0x7f6120004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.890+0000 7f611f7fe640 1 -- 172.21.15.12:0/1694006545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612003f030 con 0x7f6130100a80 2024-09-19T06:39:54.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.890+0000 7f613485a640 1 -- 172.21.15.12:0/1694006545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613019c5a0 con 0x7f6130100a80 2024-09-19T06:39:54.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.890+0000 7f611f7fe640 1 -- 172.21.15.12:0/1694006545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6120003ad0 con 0x7f6130100a80 2024-09-19T06:39:54.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.890+0000 7f611f7fe640 1 -- 172.21.15.12:0/1694006545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120035070 con 0x7f6130100a80 2024-09-19T06:39:54.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.890+0000 7f613485a640 1 -- 172.21.15.12:0/1694006545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61301a3ee0 con 0x7f6130100a80 2024-09-19T06:39:54.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.892+0000 7f611f7fe640 1 -- 172.21.15.12:0/1694006545 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6120042030 con 0x7f6130100a80 2024-09-19T06:39:54.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.892+0000 7f6136c33740 1 Processor -- start 2024-09-19T06:39:54.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.892+0000 7f6136c33740 1 -- start start 2024-09-19T06:39:54.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f611f7fe640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f61180a3240 0x7f61180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f6136c33740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 0x556fb75d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f6136c33740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75e0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f6136c33740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f6136c33740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556fb753a090 con 0x556fb75d4130 2024-09-19T06:39:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f6136c33740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556fb74e1a70 con 0x556fb75e0dc0 2024-09-19T06:39:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f6136c33740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556fb7536050 con 0x556fb75d3810 2024-09-19T06:39:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612ed9d640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f61180a3240 0x7f61180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f611f7fe640 1 -- 172.21.15.12:0/1694006545 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f61200eff30 con 0x7f6130100a80 2024-09-19T06:39:54.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75e0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75e0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48008/0 (socket says 172.21.15.12:48008) 2024-09-19T06:39:54.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612dd9b640 1 -- 172.21.15.12:0/3932337295 learned_addr learned my addr 172.21.15.12:0/3932337295 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:54.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612e59c640 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 0x556fb75d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612ed9d640 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612dd9b640 1 -- 172.21.15.12:0/3932337295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 msgr2=0x556fb75d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:54.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612dd9b640 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 0x556fb75d3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612dd9b640 1 -- 172.21.15.12:0/3932337295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 msgr2=0x556fb75e31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:54.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612dd9b640 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75e31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612dd9b640 1 -- 172.21.15.12:0/3932337295 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fb74ee130 con 0x556fb75d4130 2024-09-19T06:39:54.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612e59c640 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 0x556fb75d3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:54.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612ed9d640 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75e31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:54.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.893+0000 7f612ed9d640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f61180a3240 0x7f61180a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6128013460 tx=0x7f6128013860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.894+0000 7f612dd9b640 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75e0880 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6124009a40 tx=0x7f6124009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a80cbc391804dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.894+0000 7f611cff9640 1 -- 172.21.15.12:0/3932337295 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124017070 con 0x556fb75d4130 2024-09-19T06:39:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.894+0000 7f611cff9640 1 -- 172.21.15.12:0/3932337295 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6124013470 con 0x556fb75d4130 2024-09-19T06:39:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.894+0000 7f611cff9640 1 -- 172.21.15.12:0/3932337295 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124012610 con 0x556fb75d4130 2024-09-19T06:39:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 -- 172.21.15.12:0/3932337295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 msgr2=0x556fb75e0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75e0880 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6124009a40 tx=0x7f6124009f00 comp rx=0 tx=0).stop 2024-09-19T06:39:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 -- 172.21.15.12:0/3932337295 shutdown_connections 2024-09-19T06:39:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75e31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75e0880 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 --2- 172.21.15.12:0/3932337295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 0x556fb75d3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 -- 172.21.15.12:0/3932337295 >> 172.21.15.12:0/3932337295 conn(0x556fb75cff60 msgr2=0x556fb75d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:54.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 -- 172.21.15.12:0/3932337295 shutdown_connections 2024-09-19T06:39:54.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 -- 172.21.15.12:0/3932337295 wait complete. 2024-09-19T06:39:54.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 -- start start 2024-09-19T06:39:54.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 Processor -- start 2024-09-19T06:39:54.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d3810 0x556fb75e0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d4130 0x556fb75dd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75ddea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556fb75e3990 con 0x556fb75d3810 2024-09-19T06:39:54.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556fb74f4f20 con 0x556fb75e0dc0 2024-09-19T06:39:54.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556fb75e3b10 con 0x556fb75d4130 2024-09-19T06:39:54.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f6136c33740 10 client.0 _ll_register_callbacks cb 0x556fb74be030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:54.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.895+0000 7f612e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d3810 0x556fb75e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f612e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d3810 0x556fb75e0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48022/0 (socket says 172.21.15.12:48022) 2024-09-19T06:39:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f612e59c640 1 -- 172.21.15.12:0/2658158860 learned_addr learned my addr 172.21.15.12:0/2658158860 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f612dd9b640 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d4130 0x556fb75dd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f612ed9d640 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75ddea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f612e59c640 1 -- 172.21.15.12:0/2658158860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d4130 msgr2=0x556fb75dd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f612e59c640 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d4130 0x556fb75dd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f612e59c640 1 -- 172.21.15.12:0/2658158860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 msgr2=0x556fb75ddea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f612e59c640 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75ddea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f612e59c640 1 -- 172.21.15.12:0/2658158860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fb72ab2b0 con 0x556fb75d3810 2024-09-19T06:39:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f612e59c640 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d3810 0x556fb75e0610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6120031550 tx=0x7f61200bc220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ba74049946e426 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f6115ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f6115ffb640 1 -- 172.21.15.12:0/2658158860 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120049040 con 0x556fb75d3810 2024-09-19T06:39:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f6115ffb640 1 -- 172.21.15.12:0/2658158860 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f612003b460 con 0x556fb75d3810 2024-09-19T06:39:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f6136c33740 1 -- 172.21.15.12:0/2658158860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6124013470 con 0x556fb75d3810 2024-09-19T06:39:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f6115ffb640 1 -- 172.21.15.12:0/2658158860 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f61200d5830 con 0x556fb75d3810 2024-09-19T06:39:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f6136c33740 10 client.15141 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f6136c33740 1 -- 172.21.15.12:0/2658158860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556fb75ef210 con 0x556fb75d3810 2024-09-19T06:39:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.896+0000 7f6115ffb640 1 -- 172.21.15.12:0/2658158860 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6124013470 con 0x556fb75d3810 2024-09-19T06:39:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.897+0000 7f6115ffb640 1 -- 172.21.15.12:0/2658158860 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f61200d5a10 con 0x556fb75d3810 2024-09-19T06:39:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.897+0000 7f6136c33740 10 client.15141 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.897+0000 7f6136c33740 10 client.15141 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-19T06:39:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.897+0000 7f6136c33740 20 client.15141 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.897+0000 7f6136c33740 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556fb75f1810 0x556fb75f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.897+0000 7f6136c33740 4 client.15141 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:39:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.897+0000 7f6136c33740 1 -- 172.21.15.12:0/2658158860 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fb7547600 con 0x556fb75f1810 2024-09-19T06:39:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.897+0000 7f612dd9b640 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556fb75f1810 0x556fb75f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.897+0000 7f612dd9b640 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556fb75f1810 0x556fb75f2c80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=834605d9c73e4f91 server_cookie=8302166a70150a90 in_seq=0 out_seq=0 2024-09-19T06:39:54.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.897+0000 7f6115ffb640 10 client.15141 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:39:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.898+0000 7f6115ffb640 1 -- 172.21.15.12:0/2658158860 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556fb7547600 con 0x556fb75f1810 2024-09-19T06:39:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.898+0000 7f6115ffb640 10 client.15141 handle_command_reply: tid=0 2024-09-19T06:39:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.898+0000 7f6136c33740 1 client.15141 shutdown 2024-09-19T06:39:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 1 -- 172.21.15.12:0/2658158860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d3810 msgr2=0x556fb75e0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d3810 0x556fb75e0610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6120031550 tx=0x7f61200bc220 comp rx=0 tx=0).stop 2024-09-19T06:39:54.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 1 -- 172.21.15.12:0/2658158860 shutdown_connections 2024-09-19T06:39:54.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556fb75f1810 0x556fb75f2c80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75ddea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d4130 0x556fb75dd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 1 --2- 172.21.15.12:0/2658158860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d3810 0x556fb75e0610 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6115ffb640 0 client.15141 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:39:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 1 -- 172.21.15.12:0/2658158860 >> 172.21.15.12:0/2658158860 conn(0x556fb75cff60 msgr2=0x556fb75cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 1 -- 172.21.15.12:0/2658158860 shutdown_connections 2024-09-19T06:39:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 1 -- 172.21.15.12:0/2658158860 wait complete. 2024-09-19T06:39:54.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.899+0000 7f6136c33740 20 client.15141 trim_cache size 0 max 16384 2024-09-19T06:39:54.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f6136c33740 1 Processor -- start 2024-09-19T06:39:54.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f6136c33740 1 -- start start 2024-09-19T06:39:54.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f6136c33740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75d3810 0x556fb75f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f6136c33740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75fb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f6136c33740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75e0dc0 0x556fb75dabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f6136c33740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556fb75f0fc0 con 0x556fb75d4130 2024-09-19T06:39:54.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f6136c33740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556fb75f1690 con 0x556fb75d3810 2024-09-19T06:39:54.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f6136c33740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556fb75f1d60 con 0x556fb75e0dc0 2024-09-19T06:39:54.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75fb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75fb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48024/0 (socket says 172.21.15.12:48024) 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612dd9b640 1 -- 172.21.15.12:0/2839510872 learned_addr learned my addr 172.21.15.12:0/2839510872 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612e59c640 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75d3810 0x556fb75f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612ed9d640 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75e0dc0 0x556fb75dabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612dd9b640 1 -- 172.21.15.12:0/2839510872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75e0dc0 msgr2=0x556fb75dabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612dd9b640 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75e0dc0 0x556fb75dabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612dd9b640 1 -- 172.21.15.12:0/2839510872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75d3810 msgr2=0x556fb75f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612dd9b640 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75d3810 0x556fb75f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612dd9b640 1 -- 172.21.15.12:0/2839510872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fb75e0980 con 0x556fb75d4130 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612e59c640 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75d3810 0x556fb75f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:54.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612ed9d640 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75e0dc0 0x556fb75dabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:54.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.917+0000 7f612dd9b640 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75fb350 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6124009a40 tx=0x7f6124009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7d87b68ebeff79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:54.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6117fff640 1 -- 172.21.15.12:0/2839510872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124017040 con 0x556fb75d4130 2024-09-19T06:39:54.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6117fff640 1 -- 172.21.15.12:0/2839510872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f612402c070 con 0x556fb75d4130 2024-09-19T06:39:54.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6117fff640 1 -- 172.21.15.12:0/2839510872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124026680 con 0x556fb75d4130 2024-09-19T06:39:54.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6136c33740 1 -- 172.21.15.12:0/2839510872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 msgr2=0x556fb75fb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6136c33740 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75fb350 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6124009a40 tx=0x7f6124009110 comp rx=0 tx=0).stop 2024-09-19T06:39:54.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6136c33740 1 -- 172.21.15.12:0/2839510872 shutdown_connections 2024-09-19T06:39:54.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6136c33740 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75e0dc0 0x556fb75dabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6136c33740 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75fb350 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6136c33740 1 --2- 172.21.15.12:0/2839510872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75d3810 0x556fb75f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6136c33740 1 -- 172.21.15.12:0/2839510872 >> 172.21.15.12:0/2839510872 conn(0x556fb75cff60 msgr2=0x556fb75dc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:54.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6136c33740 1 -- 172.21.15.12:0/2839510872 shutdown_connections 2024-09-19T06:39:54.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.918+0000 7f6136c33740 1 -- 172.21.15.12:0/2839510872 wait complete. 2024-09-19T06:39:54.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f6136c33740 1 -- start start 2024-09-19T06:39:54.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f6136c33740 1 Processor -- start 2024-09-19T06:39:54.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f6136c33740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 0x556fb75d83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f6136c33740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75d88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f6136c33740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75d8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f6136c33740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556fb75f2b00 con 0x556fb75d4130 2024-09-19T06:39:54.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f6136c33740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556fb75f2430 con 0x556fb75e0dc0 2024-09-19T06:39:54.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f6136c33740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556fb75f31d0 con 0x556fb75d3810 2024-09-19T06:39:54.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f6136c33740 10 client.0 _ll_register_callbacks cb 0x7f61200b8cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:54.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f612dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75d88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f612dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75d88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48038/0 (socket says 172.21.15.12:48038) 2024-09-19T06:39:54.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f612dd9b640 1 -- 172.21.15.12:0/249133040 learned_addr learned my addr 172.21.15.12:0/249133040 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:54.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f612e59c640 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 0x556fb75d83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f612ed9d640 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75d8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f612dd9b640 1 -- 172.21.15.12:0/249133040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 msgr2=0x556fb75d83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:54.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f612dd9b640 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 0x556fb75d83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f612dd9b640 1 -- 172.21.15.12:0/249133040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 msgr2=0x556fb75d8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:54.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f612dd9b640 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75d8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.919+0000 7f612dd9b640 1 -- 172.21.15.12:0/249133040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fb765d220 con 0x556fb75d4130 2024-09-19T06:39:54.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f612dd9b640 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75d88e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6124009f40 tx=0x7f612400e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9b10ddde753ba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:54.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6115ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:54.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6115ffb640 1 -- 172.21.15.12:0/249133040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124035060 con 0x556fb75d4130 2024-09-19T06:39:54.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6115ffb640 1 -- 172.21.15.12:0/249133040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f6124013670 con 0x556fb75d4130 2024-09-19T06:39:54.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6136c33740 1 -- 172.21.15.12:0/249133040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f612402c070 con 0x556fb75d4130 2024-09-19T06:39:54.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6115ffb640 1 -- 172.21.15.12:0/249133040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6124020070 con 0x556fb75d4130 2024-09-19T06:39:54.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6136c33740 10 client.15147 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:54.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6136c33740 1 -- 172.21.15.12:0/249133040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556fb765e490 con 0x556fb75d4130 2024-09-19T06:39:54.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6115ffb640 1 -- 172.21.15.12:0/249133040 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f612402c070 con 0x556fb75d4130 2024-09-19T06:39:54.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6115ffb640 1 -- 172.21.15.12:0/249133040 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6124006690 con 0x556fb75d4130 2024-09-19T06:39:54.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6136c33740 10 client.15147 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:54.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6136c33740 10 client.15147 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-19T06:39:54.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6136c33740 20 client.15147 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:54.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.920+0000 7f6136c33740 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556fb7662820 0x556fb7661530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:54.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.921+0000 7f6136c33740 4 client.15147 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:39:54.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.921+0000 7f6136c33740 1 -- 172.21.15.12:0/249133040 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "status"}) -- 0x556fb7541b10 con 0x556fb7662820 2024-09-19T06:39:54.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.921+0000 7f612e59c640 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556fb7662820 0x556fb7661530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:54.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.921+0000 7f6115ffb640 10 client.15147 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:39:54.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.921+0000 7f612e59c640 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556fb7662820 0x556fb7661530 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a5360df36ac617e5 server_cookie=1798c68fffc56f7b in_seq=0 out_seq=0 2024-09-19T06:39:54.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.921+0000 7f6115ffb640 1 -- 172.21.15.12:0/249133040 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556fb7541b10 con 0x556fb7662820 2024-09-19T06:39:54.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.921+0000 7f6115ffb640 10 client.15147 handle_command_reply: tid=0 2024-09-19T06:39:54.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.921+0000 7f6136c33740 1 client.15147 shutdown 2024-09-19T06:39:54.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.921+0000 7f6136c33740 1 -- 172.21.15.12:0/249133040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 msgr2=0x556fb75d88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.921+0000 7f6136c33740 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75d88e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6124009f40 tx=0x7f612400e6e0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f6136c33740 1 -- 172.21.15.12:0/249133040 shutdown_connections 2024-09-19T06:39:54.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f6136c33740 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556fb7662820 0x556fb7661530 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f6136c33740 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556fb75e0dc0 0x556fb75d8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f6136c33740 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556fb75d4130 0x556fb75d88e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f6136c33740 1 --2- 172.21.15.12:0/249133040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556fb75d3810 0x556fb75d83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f6115ffb640 0 client.15147 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:39:54.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f6136c33740 1 -- 172.21.15.12:0/249133040 >> 172.21.15.12:0/249133040 conn(0x556fb75cff60 msgr2=0x556fb75ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:54.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f6136c33740 1 -- 172.21.15.12:0/249133040 shutdown_connections 2024-09-19T06:39:54.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f6136c33740 1 -- 172.21.15.12:0/249133040 wait complete. 2024-09-19T06:39:54.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f6136c33740 20 client.15147 trim_cache size 0 max 16384 2024-09-19T06:39:54.943 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:39:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:39:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 4, 2024-09-19T06:39:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24431, 2024-09-19T06:39:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:39:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:39:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:39:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 89.260782856999995, 2024-09-19T06:39:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-19T06:39:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-19T06:39:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T06:39:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 140.033760274 2024-09-19T06:39:54.945 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:39:54.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 -- 172.21.15.12:0/1694006545 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f61180a3240 msgr2=0x7f61180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f61180a3240 0x7f61180a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6128013460 tx=0x7f6128013860 comp rx=0 tx=0).stop 2024-09-19T06:39:54.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 -- 172.21.15.12:0/1694006545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130100a80 msgr2=0x7f6130197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:54.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130100a80 0x7f6130197360 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6120009a50 tx=0x7f6120004270 comp rx=0 tx=0).stop 2024-09-19T06:39:54.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 -- 172.21.15.12:0/1694006545 shutdown_connections 2024-09-19T06:39:54.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f61180a3240 0x7f61180a5700 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6130106a80 0x7f613019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6130101420 0x7f61301978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 --2- 172.21.15.12:0/1694006545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6130100a80 0x7f6130197360 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:54.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 -- 172.21.15.12:0/1694006545 >> 172.21.15.12:0/1694006545 conn(0x7f61300fc7a0 msgr2=0x7f61300fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:54.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.922+0000 7f613485a640 1 -- 172.21.15.12:0/1694006545 shutdown_connections 2024-09-19T06:39:54.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:54.923+0000 7f613485a640 1 -- 172.21.15.12:0/1694006545 wait complete. 2024-09-19T06:39:55.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:54 smithi012 ceph-mon[30937]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T06:39:55.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:54 smithi016 ceph-mon[34911]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T06:39:55.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:54 smithi173 ceph-mon[35349]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-19T06:39:55.722 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.l status 2024-09-19T06:39:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.406+0000 7f3c4882c640 1 -- 172.21.15.12:0/4132815447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c4410c170 msgr2=0x7f3c4410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.406+0000 7f3c4882c640 1 --2- 172.21.15.12:0/4132815447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c4410c170 0x7f3c4410e610 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009ca0 tx=0x7f3c3c02a950 comp rx=0 tx=0).stop 2024-09-19T06:39:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.406+0000 7f3c4882c640 1 -- 172.21.15.12:0/4132815447 shutdown_connections 2024-09-19T06:39:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.406+0000 7f3c4882c640 1 --2- 172.21.15.12:0/4132815447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c4410c170 0x7f3c4410e610 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.406+0000 7f3c4882c640 1 --2- 172.21.15.12:0/4132815447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44103660 0x7f3c4410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.406+0000 7f3c4882c640 1 --2- 172.21.15.12:0/4132815447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c44102d40 0x7f3c44103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.406+0000 7f3c4882c640 1 -- 172.21.15.12:0/4132815447 >> 172.21.15.12:0/4132815447 conn(0x7f3c440fc7a0 msgr2=0x7f3c440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:56.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.406+0000 7f3c4882c640 1 -- 172.21.15.12:0/4132815447 shutdown_connections 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.406+0000 7f3c4882c640 1 -- 172.21.15.12:0/4132815447 wait complete. 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.407+0000 7f3c4882c640 1 Processor -- start 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.407+0000 7f3c4882c640 1 -- start start 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.407+0000 7f3c4882c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102d40 0x7f3c441982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.407+0000 7f3c4882c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c44103660 0x7f3c441987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.407+0000 7f3c4882c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c4410c170 0x7f3c4419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c4882c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44111f30 con 0x7f3c44103660 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c4882c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44111db0 con 0x7f3c4410c170 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c4882c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441120b0 con 0x7f3c44102d40 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c39d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c44103660 0x7f3c441987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c4259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102d40 0x7f3c441982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c39d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c44103660 0x7f3c441987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48058/0 (socket says 172.21.15.12:48058) 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c39d9b640 1 -- 172.21.15.12:0/196251496 learned_addr learned my addr 172.21.15.12:0/196251496 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c42d9d640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c4410c170 0x7f3c4419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c39d9b640 1 -- 172.21.15.12:0/196251496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102d40 msgr2=0x7f3c441982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c39d9b640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102d40 0x7f3c441982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c39d9b640 1 -- 172.21.15.12:0/196251496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c4410c170 msgr2=0x7f3c4419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c39d9b640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c4410c170 0x7f3c4419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c39d9b640 1 -- 172.21.15.12:0/196251496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4419d260 con 0x7f3c44103660 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c39d9b640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c44103660 0x7f3c441987f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00c970 tx=0x7f3c2c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c3bfff640 1 -- 172.21.15.12:0/196251496 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c007bb0 con 0x7f3c44103660 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c4882c640 1 -- 172.21.15.12:0/196251496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4419d550 con 0x7f3c44103660 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c3bfff640 1 -- 172.21.15.12:0/196251496 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c2c007d50 con 0x7f3c44103660 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.408+0000 7f3c3bfff640 1 -- 172.21.15.12:0/196251496 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c018730 con 0x7f3c44103660 2024-09-19T06:39:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.409+0000 7f3c4882c640 1 -- 172.21.15.12:0/196251496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c441a4e30 con 0x7f3c44103660 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.411+0000 7f3c3bfff640 1 -- 172.21.15.12:0/196251496 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3c2c00f450 con 0x7f3c44103660 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.411+0000 7f3c4ac05740 1 Processor -- start 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.411+0000 7f3c4ac05740 1 -- start start 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25ce11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 0x55ce25ceba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25cee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c3bfff640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3c300a3240 0x7f3c300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce25c43090 con 0x55ce25cebfc0 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ce25beaa70 con 0x55ce25ce1700 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ce25c3f050 con 0x55ce25ce0de0 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c39d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25cee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c42d9d640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3c300a3240 0x7f3c300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c39d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25cee3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48070/0 (socket says 172.21.15.12:48070) 2024-09-19T06:39:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c39d9b640 1 -- 172.21.15.12:0/338926413 learned_addr learned my addr 172.21.15.12:0/338926413 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4259c640 1 --2- 172.21.15.12:0/338926413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 0x55ce25ceba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c42d9d640 1 --2- 172.21.15.12:0/338926413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25ce11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c3bfff640 1 -- 172.21.15.12:0/196251496 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f3c2c0cf910 con 0x7f3c44103660 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4259c640 1 -- 172.21.15.12:0/338926413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 msgr2=0x55ce25ce11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4259c640 1 --2- 172.21.15.12:0/338926413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25ce11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4259c640 1 -- 172.21.15.12:0/338926413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 msgr2=0x55ce25cee3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4259c640 1 --2- 172.21.15.12:0/338926413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25cee3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4259c640 1 -- 172.21.15.12:0/338926413 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce25bf7130 con 0x55ce25ce1700 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c42d9d640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3c300a3240 0x7f3c300a5700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0098d0 tx=0x7f3c3c02fee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.412+0000 7f3c4259c640 1 --2- 172.21.15.12:0/338926413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 0x55ce25ceba80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400abf0 tx=0x7f3c3400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f08d9a697ef667e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.413+0000 7f3c38d99640 1 -- 172.21.15.12:0/338926413 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34005220 con 0x55ce25ce1700 2024-09-19T06:39:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.413+0000 7f3c38d99640 1 -- 172.21.15.12:0/338926413 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c34004c80 con 0x55ce25ce1700 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.413+0000 7f3c38d99640 1 -- 172.21.15.12:0/338926413 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34018820 con 0x55ce25ce1700 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.413+0000 7f3c4ac05740 1 -- 172.21.15.12:0/338926413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 msgr2=0x55ce25ceba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.413+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/338926413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 0x55ce25ceba80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400abf0 tx=0x7f3c3400f790 comp rx=0 tx=0).stop 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.413+0000 7f3c4ac05740 1 -- 172.21.15.12:0/338926413 shutdown_connections 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.413+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/338926413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25cee3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.413+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/338926413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 0x55ce25ceba80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.413+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/338926413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25ce11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.413+0000 7f3c4ac05740 1 -- 172.21.15.12:0/338926413 >> 172.21.15.12:0/338926413 conn(0x55ce25cdd370 msgr2=0x55ce25cdd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 1 -- 172.21.15.12:0/338926413 shutdown_connections 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 1 -- 172.21.15.12:0/338926413 wait complete. 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 1 -- start start 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 1 Processor -- start 2024-09-19T06:39:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25ceb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 0x55ce25ce8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25ce90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce25ceeb90 con 0x55ce25cebfc0 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ce25bfdf20 con 0x55ce25ce1700 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ce25ceed10 con 0x55ce25ce0de0 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c4ac05740 10 client.0 _ll_register_callbacks cb 0x55ce25bc7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c42d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25ce90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c42d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25ce90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48078/0 (socket says 172.21.15.12:48078) 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.414+0000 7f3c42d9d640 1 -- 172.21.15.12:0/3687756184 learned_addr learned my addr 172.21.15.12:0/3687756184 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c39d9b640 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 0x55ce25ce8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c4259c640 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25ceb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c42d9d640 1 -- 172.21.15.12:0/3687756184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 msgr2=0x55ce25ceb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:56.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c42d9d640 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25ceb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c42d9d640 1 -- 172.21.15.12:0/3687756184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 msgr2=0x55ce25ce8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c42d9d640 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 0x55ce25ce8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c42d9d640 1 -- 172.21.15.12:0/3687756184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce259b42b0 con 0x55ce25cebfc0 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c4259c640 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25ceb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c42d9d640 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25ce90a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c003e40 tx=0x7f3c3c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd299dfc39f2f87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3687756184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c04e070 con 0x55ce25cebfc0 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3687756184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f3c3c0045c0 con 0x55ce25cebfc0 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3687756184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c34004c80 con 0x55ce25cebfc0 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3687756184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3c3c034040 con 0x55ce25cebfc0 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c4ac05740 10 client.15159 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.415+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3687756184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ce25cfa460 con 0x55ce25cebfc0 2024-09-19T06:39:56.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.416+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3687756184 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c34004c80 con 0x55ce25cebfc0 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.416+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3687756184 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3c3c005530 con 0x55ce25cebfc0 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.416+0000 7f3c4ac05740 10 client.15159 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.416+0000 7f3c4ac05740 10 client.15159 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.416+0000 7f3c4ac05740 20 client.15159 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.416+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ce25cfca90 0x55ce25cfdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.416+0000 7f3c4ac05740 4 client.15159 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.416+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3687756184 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce25c50600 con 0x55ce25cfca90 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.416+0000 7f3c4259c640 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ce25cfca90 0x55ce25cfdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.417+0000 7f3c29ffb640 10 client.15159 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.417+0000 7f3c4259c640 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ce25cfca90 0x55ce25cfdf00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c6e6df2e22f469cf server_cookie=268be00fb8175dd1 in_seq=0 out_seq=0 2024-09-19T06:39:56.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.417+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3687756184 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce25c50600 con 0x55ce25cfca90 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.417+0000 7f3c29ffb640 10 client.15159 handle_command_reply: tid=0 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.417+0000 7f3c4ac05740 1 client.15159 shutdown 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.417+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3687756184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 msgr2=0x55ce25ce90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.417+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25ce90a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c003e40 tx=0x7f3c3c005c50 comp rx=0 tx=0).stop 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.418+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3687756184 shutdown_connections 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.418+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ce25cfca90 0x55ce25cfdf00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.418+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25cebfc0 0x55ce25ce90a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.418+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce1700 0x55ce25ce8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.418+0000 7f3c29ffb640 0 client.15159 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.418+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3687756184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25ceb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.418+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3687756184 >> 172.21.15.12:0/3687756184 conn(0x55ce25cdd370 msgr2=0x55ce25ce3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:56.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.418+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3687756184 shutdown_connections 2024-09-19T06:39:56.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.418+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3687756184 wait complete. 2024-09-19T06:39:56.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.418+0000 7f3c4ac05740 20 client.15159 trim_cache size 0 max 16384 2024-09-19T06:39:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.435+0000 7f3c4ac05740 1 Processor -- start 2024-09-19T06:39:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.435+0000 7f3c4ac05740 1 -- start start 2024-09-19T06:39:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce0de0 0x55ce25cfd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25ce80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25cebfc0 0x55ce25ce5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce25cfc240 con 0x55ce25ce1700 2024-09-19T06:39:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ce25cfc910 con 0x55ce25ce0de0 2024-09-19T06:39:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ce25cfcfe0 con 0x55ce25cebfc0 2024-09-19T06:39:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c39d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25ce80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c39d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25ce80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48094/0 (socket says 172.21.15.12:48094) 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c39d9b640 1 -- 172.21.15.12:0/3265855288 learned_addr learned my addr 172.21.15.12:0/3265855288 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c42d9d640 1 --2- 172.21.15.12:0/3265855288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25cebfc0 0x55ce25ce5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c4259c640 1 --2- 172.21.15.12:0/3265855288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce0de0 0x55ce25cfd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c39d9b640 1 -- 172.21.15.12:0/3265855288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25cebfc0 msgr2=0x55ce25ce5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c39d9b640 1 --2- 172.21.15.12:0/3265855288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25cebfc0 0x55ce25ce5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c39d9b640 1 -- 172.21.15.12:0/3265855288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce0de0 msgr2=0x55ce25cfd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c39d9b640 1 --2- 172.21.15.12:0/3265855288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce0de0 0x55ce25cfd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c39d9b640 1 -- 172.21.15.12:0/3265855288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce25cddff0 con 0x55ce25ce1700 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c4259c640 1 --2- 172.21.15.12:0/3265855288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce0de0 0x55ce25cfd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c39d9b640 1 --2- 172.21.15.12:0/3265855288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25ce80a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0cd3c0 tx=0x7f3c2c06ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9050afea0159f737 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.436+0000 7f3c2bfff640 1 -- 172.21.15.12:0/3265855288 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c066d30 con 0x55ce25ce1700 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c2bfff640 1 -- 172.21.15.12:0/3265855288 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c2c09be90 con 0x55ce25ce1700 2024-09-19T06:39:56.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c2bfff640 1 -- 172.21.15.12:0/3265855288 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c00f9c0 con 0x55ce25ce1700 2024-09-19T06:39:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3265855288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 msgr2=0x55ce25ce80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3265855288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25ce80a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0cd3c0 tx=0x7f3c2c06ed10 comp rx=0 tx=0).stop 2024-09-19T06:39:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3265855288 shutdown_connections 2024-09-19T06:39:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3265855288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25cebfc0 0x55ce25ce5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3265855288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25ce80a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3265855288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25ce0de0 0x55ce25cfd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3265855288 >> 172.21.15.12:0/3265855288 conn(0x55ce25cdd370 msgr2=0x55ce25ce7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:56.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3265855288 shutdown_connections 2024-09-19T06:39:56.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.437+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3265855288 wait complete. 2024-09-19T06:39:56.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4ac05740 1 -- start start 2024-09-19T06:39:56.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4ac05740 1 Processor -- start 2024-09-19T06:39:56.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25d023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25d028e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4ac05740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25cebfc0 0x55ce25d661a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce25cfdd80 con 0x55ce25ce1700 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ce25cfd6b0 con 0x55ce25cebfc0 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4ac05740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ce25cfe450 con 0x55ce25ce0de0 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4ac05740 10 client.0 _ll_register_callbacks cb 0x7f3c3c02f740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c39d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25d028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c39d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25d028e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48106/0 (socket says 172.21.15.12:48106) 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c39d9b640 1 -- 172.21.15.12:0/3860130216 learned_addr learned my addr 172.21.15.12:0/3860130216 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c42d9d640 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25cebfc0 0x55ce25d661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4259c640 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25d023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c39d9b640 1 -- 172.21.15.12:0/3860130216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 msgr2=0x55ce25d023a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c39d9b640 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25d023a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c39d9b640 1 -- 172.21.15.12:0/3860130216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25cebfc0 msgr2=0x55ce25d661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c39d9b640 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25cebfc0 0x55ce25d661a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c39d9b640 1 -- 172.21.15.12:0/3860130216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce25d666e0 con 0x55ce25ce1700 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.438+0000 7f3c4259c640 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25d023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c42d9d640 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25cebfc0 0x55ce25d661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c39d9b640 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25d028e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0a45d0 tx=0x7f3c2c0a4b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e041179e21f2dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3860130216 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c00f9c0 con 0x55ce25ce1700 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3860130216 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f3c2c0a4670 con 0x55ce25ce1700 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3860130216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c2c09be90 con 0x55ce25ce1700 2024-09-19T06:39:56.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3860130216 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3c2c0a4870 con 0x55ce25ce1700 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c4ac05740 10 client.15165 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3860130216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ce25d677e0 con 0x55ce25ce1700 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3860130216 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c2c09be90 con 0x55ce25ce1700 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3860130216 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3c2c0cb070 con 0x55ce25ce1700 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c4ac05740 10 client.15165 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c4ac05740 10 client.15165 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c4ac05740 20 client.15165 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ce25d6bf50 0x55ce25d6ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c4ac05740 4 client.15165 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.439+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3860130216 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "status"}) -- 0x55ce25c4ab10 con 0x55ce25d6bf50 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.440+0000 7f3c4259c640 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ce25d6bf50 0x55ce25d6ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.440+0000 7f3c4259c640 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ce25d6bf50 0x55ce25d6ac60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fb6908456b9bc89c server_cookie=6007bc0db778ef26 in_seq=0 out_seq=0 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.440+0000 7f3c29ffb640 10 client.15165 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.440+0000 7f3c29ffb640 1 -- 172.21.15.12:0/3860130216 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ce25c4ab10 con 0x55ce25d6bf50 2024-09-19T06:39:56.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.440+0000 7f3c29ffb640 10 client.15165 handle_command_reply: tid=0 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.440+0000 7f3c4ac05740 1 client.15165 shutdown 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.440+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3860130216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 msgr2=0x55ce25d028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.440+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25d028e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0a45d0 tx=0x7f3c2c0a4b00 comp rx=0 tx=0).stop 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.440+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3860130216 shutdown_connections 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ce25d6bf50 0x55ce25d6ac60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce25cebfc0 0x55ce25d661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce25ce1700 0x55ce25d028e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4ac05740 1 --2- 172.21.15.12:0/3860130216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce25ce0de0 0x55ce25d023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3860130216 >> 172.21.15.12:0/3860130216 conn(0x55ce25cdd370 msgr2=0x55ce25cea240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c29ffb640 0 client.15165 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3860130216 shutdown_connections 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4ac05740 1 -- 172.21.15.12:0/3860130216 wait complete. 2024-09-19T06:39:56.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4ac05740 20 client.15165 trim_cache size 0 max 16384 2024-09-19T06:39:56.449 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:39:56.449 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:39:56.449 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 3, 2024-09-19T06:39:56.449 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24439, 2024-09-19T06:39:56.449 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:39:56.449 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:39:56.449 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:39:56.449 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 91.786274302999999, 2024-09-19T06:39:56.449 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-19T06:39:56.449 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-19T06:39:56.450 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T06:39:56.450 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 144.30142553100001 2024-09-19T06:39:56.450 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:39:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4882c640 1 -- 172.21.15.12:0/196251496 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3c300a3240 msgr2=0x7f3c300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4882c640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3c300a3240 0x7f3c300a5700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0098d0 tx=0x7f3c3c02fee0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4882c640 1 -- 172.21.15.12:0/196251496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c44103660 msgr2=0x7f3c441987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4882c640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c44103660 0x7f3c441987f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00c970 tx=0x7f3c2c00cd70 comp rx=0 tx=0).stop 2024-09-19T06:39:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4882c640 1 -- 172.21.15.12:0/196251496 shutdown_connections 2024-09-19T06:39:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4882c640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f3c300a3240 0x7f3c300a5700 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4882c640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c4410c170 0x7f3c4419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4882c640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c44103660 0x7f3c441987f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4882c640 1 --2- 172.21.15.12:0/196251496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c44102d40 0x7f3c441982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.441+0000 7f3c4882c640 1 -- 172.21.15.12:0/196251496 >> 172.21.15.12:0/196251496 conn(0x7f3c440fc7a0 msgr2=0x7f3c440fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.442+0000 7f3c4882c640 1 -- 172.21.15.12:0/196251496 shutdown_connections 2024-09-19T06:39:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:56.442+0000 7f3c4882c640 1 -- 172.21.15.12:0/196251496 wait complete. 2024-09-19T06:39:57.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:56 smithi012 ceph-mon[30937]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T06:39:57.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:56 smithi016 ceph-mon[34911]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T06:39:57.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:56 smithi173 ceph-mon[35349]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T06:39:57.353 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T06:39:57.612 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:58.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.111+0000 7fb9d5bda640 1 -- 172.21.15.12:0/251403863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9d010c180 msgr2=0x7fb9d010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:58.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.111+0000 7fb9d5bda640 1 --2- 172.21.15.12:0/251403863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9d010c180 0x7fb9d010e600 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009ca0 tx=0x7fb9c802a950 comp rx=0 tx=0).stop 2024-09-19T06:39:58.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.111+0000 7fb9d5bda640 1 -- 172.21.15.12:0/251403863 shutdown_connections 2024-09-19T06:39:58.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.111+0000 7fb9d5bda640 1 --2- 172.21.15.12:0/251403863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9d010c180 0x7fb9d010e600 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.111+0000 7fb9d5bda640 1 --2- 172.21.15.12:0/251403863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9d01036c0 0x7fb9d010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.111+0000 7fb9d5bda640 1 --2- 172.21.15.12:0/251403863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9d0102da0 0x7fb9d0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.111+0000 7fb9d5bda640 1 -- 172.21.15.12:0/251403863 >> 172.21.15.12:0/251403863 conn(0x7fb9d00fc7a0 msgr2=0x7fb9d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.111+0000 7fb9d5bda640 1 -- 172.21.15.12:0/251403863 shutdown_connections 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9d5bda640 1 -- 172.21.15.12:0/251403863 wait complete. 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9d5bda640 1 Processor -- start 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9d5bda640 1 -- start start 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9d5bda640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9d0102da0 0x7fb9d0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9d5bda640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9d01036c0 0x7fb9d0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9d5bda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9d010c180 0x7fb9d019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9d5bda640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d0111f60 con 0x7fb9d01036c0 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9d5bda640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d0111de0 con 0x7fb9d010c180 2024-09-19T06:39:58.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9d5bda640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d01120e0 con 0x7fb9d0102da0 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9d01036c0 0x7fb9d0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9d01036c0 0x7fb9d0198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48132/0 (socket says 172.21.15.12:48132) 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.112+0000 7fb9c7fff640 1 -- 172.21.15.12:0/697323349 learned_addr learned my addr 172.21.15.12:0/697323349 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9d0102da0 0x7fb9d0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9cffff640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9d010c180 0x7fb9d019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9c7fff640 1 -- 172.21.15.12:0/697323349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9d0102da0 msgr2=0x7fb9d0198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9d0102da0 0x7fb9d0198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9c7fff640 1 -- 172.21.15.12:0/697323349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9d010c180 msgr2=0x7fb9d019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9d010c180 0x7fb9d019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9c7fff640 1 -- 172.21.15.12:0/697323349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d019d2d0 con 0x7fb9d01036c0 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9cffff640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9d010c180 0x7fb9d019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9d01036c0 0x7fb9d0198860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c920 tx=0x7fb9b800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:58.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9cd7fa640 1 -- 172.21.15.12:0/697323349 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8007c70 con 0x7fb9d01036c0 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9d5bda640 1 -- 172.21.15.12:0/697323349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d019d5c0 con 0x7fb9d01036c0 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9cd7fa640 1 -- 172.21.15.12:0/697323349 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9b8007e10 con 0x7fb9d01036c0 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9cd7fa640 1 -- 172.21.15.12:0/697323349 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8018890 con 0x7fb9d01036c0 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.113+0000 7fb9d5bda640 1 -- 172.21.15.12:0/697323349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d01a4ea0 con 0x7fb9d01036c0 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.115+0000 7fb9cd7fa640 1 -- 172.21.15.12:0/697323349 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb9b8018a70 con 0x7fb9d01036c0 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9d7fb3740 1 Processor -- start 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9d7fb3740 1 -- start start 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8149d0 0x55bc1a814db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8152f0 0x55bc1a81f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a81fbb0 0x55bc1a821fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a77b090 con 0x55bc1a81fbb0 2024-09-19T06:39:58.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a722a70 con 0x55bc1a8149d0 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a777050 con 0x55bc1a8152f0 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a81fbb0 0x55bc1a821fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a81fbb0 0x55bc1a821fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48142/0 (socket says 172.21.15.12:48142) 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9c7fff640 1 -- 172.21.15.12:0/3395122716 learned_addr learned my addr 172.21.15.12:0/3395122716 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cffff640 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8149d0 0x55bc1a814db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cd7fa640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb9bc0a3240 0x7fb9bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8152f0 0x55bc1a81f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cffff640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb9bc0a3240 0x7fb9bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cd7fa640 1 -- 172.21.15.12:0/697323349 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fb9b80cfab0 con 0x7fb9d01036c0 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cffff640 1 -- 172.21.15.12:0/3395122716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8152f0 msgr2=0x55bc1a81f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cffff640 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8152f0 0x55bc1a81f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cffff640 1 -- 172.21.15.12:0/3395122716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a81fbb0 msgr2=0x55bc1a821fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:58.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cffff640 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a81fbb0 0x55bc1a821fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cffff640 1 -- 172.21.15.12:0/3395122716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc1a72f130 con 0x55bc1a8149d0 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a81fbb0 0x55bc1a821fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.116+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8152f0 0x55bc1a81f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.117+0000 7fb9cffff640 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8149d0 0x55bc1a814db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009ca0 tx=0x7fb9c802fc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59f0877a14dbfa1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.117+0000 7fb9c5ffb640 1 -- 172.21.15.12:0/3395122716 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8034070 con 0x55bc1a8149d0 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.117+0000 7fb9cffff640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb9bc0a3240 0x7fb9bc0a5700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9c804c000 tx=0x7fb9c804a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.117+0000 7fb9c5ffb640 1 -- 172.21.15.12:0/3395122716 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c804d070 con 0x55bc1a8149d0 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.117+0000 7fb9c5ffb640 1 -- 172.21.15.12:0/3395122716 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8048690 con 0x55bc1a8149d0 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3395122716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8149d0 msgr2=0x55bc1a814db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8149d0 0x55bc1a814db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009ca0 tx=0x7fb9c802fc80 comp rx=0 tx=0).stop 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3395122716 shutdown_connections 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a81fbb0 0x55bc1a821fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8152f0 0x55bc1a81f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/3395122716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8149d0 0x55bc1a814db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3395122716 >> 172.21.15.12:0/3395122716 conn(0x55bc1a810f60 msgr2=0x55bc1a811340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3395122716 shutdown_connections 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3395122716 wait complete. 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 -- start start 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.118+0000 7fb9d7fb3740 1 Processor -- start 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8149d0 0x55bc1a81f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8152f0 0x55bc1a81c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a81fbb0 0x55bc1a81cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a822780 con 0x55bc1a8149d0 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a735f20 con 0x55bc1a8152f0 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a822900 con 0x55bc1a81fbb0 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9d7fb3740 10 client.0 _ll_register_callbacks cb 0x55bc1a6ff030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8149d0 0x55bc1a81f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8149d0 0x55bc1a81f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48156/0 (socket says 172.21.15.12:48156) 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9cf7fe640 1 -- 172.21.15.12:0/3964236490 learned_addr learned my addr 172.21.15.12:0/3964236490 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8152f0 0x55bc1a81c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9cffff640 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a81fbb0 0x55bc1a81cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9cf7fe640 1 -- 172.21.15.12:0/3964236490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a81fbb0 msgr2=0x55bc1a81cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a81fbb0 0x55bc1a81cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9cf7fe640 1 -- 172.21.15.12:0/3964236490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8152f0 msgr2=0x55bc1a81c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8152f0 0x55bc1a81c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9cf7fe640 1 -- 172.21.15.12:0/3964236490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc1a4ec2b0 con 0x55bc1a8149d0 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8152f0 0x55bc1a81c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8149d0 0x55bc1a81f4d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000b9a0 tx=0x7fb9c000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e460469cc7fa3b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.119+0000 7fb9aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9aeffd640 1 -- 172.21.15.12:0/3964236490 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0003ea0 con 0x55bc1a8149d0 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9aeffd640 1 -- 172.21.15.12:0/3964236490 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fb9c0005220 con 0x55bc1a8149d0 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3964236490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9c804d070 con 0x55bc1a8149d0 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9aeffd640 1 -- 172.21.15.12:0/3964236490 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb9c0005420 con 0x55bc1a8149d0 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9d7fb3740 10 client.15177 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3964236490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bc1a82e160 con 0x55bc1a8149d0 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9aeffd640 1 -- 172.21.15.12:0/3964236490 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c804d070 con 0x55bc1a8149d0 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9aeffd640 1 -- 172.21.15.12:0/3964236490 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb9c0019030 con 0x55bc1a8149d0 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9d7fb3740 10 client.15177 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9d7fb3740 10 client.15177 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9d7fb3740 20 client.15177 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55bc1a830730 0x55bc1a831ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9d7fb3740 4 client.15177 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.120+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3964236490 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc1a788600 con 0x55bc1a830730 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.121+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55bc1a830730 0x55bc1a831ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.121+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55bc1a830730 0x55bc1a831ba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7383f7836bcf953f server_cookie=f017406bccb3aba1 in_seq=0 out_seq=0 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.121+0000 7fb9aeffd640 10 client.15177 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9aeffd640 1 -- 172.21.15.12:0/3964236490 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc1a788600 con 0x55bc1a830730 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9aeffd640 10 client.15177 handle_command_reply: tid=0 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 client.15177 shutdown 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3964236490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8149d0 msgr2=0x55bc1a81f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8149d0 0x55bc1a81f4d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000b9a0 tx=0x7fb9c000bda0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3964236490 shutdown_connections 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55bc1a830730 0x55bc1a831ba0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a81fbb0 0x55bc1a81cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a8152f0 0x55bc1a81c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/3964236490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8149d0 0x55bc1a81f4d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3964236490 >> 172.21.15.12:0/3964236490 conn(0x55bc1a810f60 msgr2=0x55bc1a816c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9aeffd640 0 client.15177 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:39:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3964236490 shutdown_connections 2024-09-19T06:39:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/3964236490 wait complete. 2024-09-19T06:39:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.122+0000 7fb9d7fb3740 20 client.15177 trim_cache size 0 max 16384 2024-09-19T06:39:58.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.140+0000 7fb9d7fb3740 1 Processor -- start 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.140+0000 7fb9d7fb3740 1 -- start start 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.140+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 0x55bc1a8314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a839e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 0x55bc1a83a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a82fee0 con 0x55bc1a8152f0 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a8305b0 con 0x55bc1a81fbb0 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a830c80 con 0x55bc1a8149d0 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a839e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a839e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48164/0 (socket says 172.21.15.12:48164) 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c7fff640 1 -- 172.21.15.12:0/4186901163 learned_addr learned my addr 172.21.15.12:0/4186901163 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 0x55bc1a8314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9cffff640 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 0x55bc1a83a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c7fff640 1 -- 172.21.15.12:0/4186901163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 msgr2=0x55bc1a8314d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 0x55bc1a8314d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c7fff640 1 -- 172.21.15.12:0/4186901163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 msgr2=0x55bc1a83a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 0x55bc1a83a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c7fff640 1 -- 172.21.15.12:0/4186901163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc1a815b70 con 0x55bc1a8152f0 2024-09-19T06:39:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 0x55bc1a8314d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:39:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9cffff640 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 0x55bc1a83a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a839e50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80cd560 tx=0x7fb9b80cd3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bcc1689f891c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c57fa640 1 -- 172.21.15.12:0/4186901163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80b4070 con 0x55bc1a8152f0 2024-09-19T06:39:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c57fa640 1 -- 172.21.15.12:0/4186901163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9b80a03e0 con 0x55bc1a8152f0 2024-09-19T06:39:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.141+0000 7fb9c57fa640 1 -- 172.21.15.12:0/4186901163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80d6070 con 0x55bc1a8152f0 2024-09-19T06:39:58.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/4186901163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 msgr2=0x55bc1a839e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:58.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a839e50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80cd560 tx=0x7fb9b80cd3e0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/4186901163 shutdown_connections 2024-09-19T06:39:58.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 0x55bc1a83a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a839e50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/4186901163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 0x55bc1a8314d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/4186901163 >> 172.21.15.12:0/4186901163 conn(0x55bc1a810f60 msgr2=0x55bc1a81b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:58.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/4186901163 shutdown_connections 2024-09-19T06:39:58.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/4186901163 wait complete. 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 -- start start 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.142+0000 7fb9d7fb3740 1 Processor -- start 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 0x55bc1a834cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a8351f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9d7fb3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 0x55bc1a835730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a831a20 con 0x55bc1a8152f0 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a831350 con 0x55bc1a81fbb0 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9d7fb3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a8320f0 con 0x55bc1a8149d0 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9d7fb3740 10 client.0 _ll_register_callbacks cb 0x7fb9c0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a8351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a8351f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48168/0 (socket says 172.21.15.12:48168) 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9c7fff640 1 -- 172.21.15.12:0/2100533386 learned_addr learned my addr 172.21.15.12:0/2100533386 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:58.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9cffff640 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 0x55bc1a835730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 0x55bc1a834cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9c7fff640 1 -- 172.21.15.12:0/2100533386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 msgr2=0x55bc1a834cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 0x55bc1a834cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9c7fff640 1 -- 172.21.15.12:0/2100533386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 msgr2=0x55bc1a835730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 0x55bc1a835730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9c7fff640 1 -- 172.21.15.12:0/2100533386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc1a898f30 con 0x55bc1a8152f0 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9c7fff640 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a8351f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80a4770 tx=0x7fb9b80a4ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96681c68c0a4572d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.143+0000 7fb9aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9aeffd640 1 -- 172.21.15.12:0/2100533386 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80b4070 con 0x55bc1a8152f0 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9aeffd640 1 -- 172.21.15.12:0/2100533386 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fb9b8018d60 con 0x55bc1a8152f0 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/2100533386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9b80a03e0 con 0x55bc1a8152f0 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9aeffd640 1 -- 172.21.15.12:0/2100533386 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb9b80d6070 con 0x55bc1a8152f0 2024-09-19T06:39:58.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9d7fb3740 10 client.15183 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/2100533386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bc1a89a1a0 con 0x55bc1a8152f0 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9aeffd640 1 -- 172.21.15.12:0/2100533386 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9b80a03e0 con 0x55bc1a8152f0 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9aeffd640 1 -- 172.21.15.12:0/2100533386 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fb9b809b480 con 0x55bc1a8152f0 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9d7fb3740 10 client.15183 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9d7fb3740 10 client.15183 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9d7fb3740 20 client.15183 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55bc1a89e7d0 0x55bc1a89d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9d7fb3740 4 client.15183 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/2100533386 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "status"}) -- 0x55bc1a782b10 con 0x55bc1a89e7d0 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.144+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55bc1a89e7d0 0x55bc1a89d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9aeffd640 10 client.15183 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9cf7fe640 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55bc1a89e7d0 0x55bc1a89d4e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=792a6cdc3bfa11c5 server_cookie=b98e57fafa2dab14 in_seq=0 out_seq=0 2024-09-19T06:39:58.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9aeffd640 1 -- 172.21.15.12:0/2100533386 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bc1a782b10 con 0x55bc1a89e7d0 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9aeffd640 10 client.15183 handle_command_reply: tid=0 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 client.15183 shutdown 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/2100533386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 msgr2=0x55bc1a8351f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a8351f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80a4770 tx=0x7fb9b80a4ca0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/2100533386 shutdown_connections 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55bc1a89e7d0 0x55bc1a89d4e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bc1a81fbb0 0x55bc1a835730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc1a8152f0 0x55bc1a8351f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9aeffd640 0 client.15183 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 --2- 172.21.15.12:0/2100533386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc1a8149d0 0x55bc1a834cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/2100533386 >> 172.21.15.12:0/2100533386 conn(0x55bc1a810f60 msgr2=0x55bc1a81b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/2100533386 shutdown_connections 2024-09-19T06:39:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.145+0000 7fb9d7fb3740 1 -- 172.21.15.12:0/2100533386 wait complete. 2024-09-19T06:39:58.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d7fb3740 20 client.15183 trim_cache size 0 max 16384 2024-09-19T06:39:58.153 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:39:58.153 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:39:58.153 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 2, 2024-09-19T06:39:58.153 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24481, 2024-09-19T06:39:58.153 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:39:58.153 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:39:58.153 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:39:58.153 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 94.075259088999999, 2024-09-19T06:39:58.153 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-19T06:39:58.154 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-19T06:39:58.154 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T06:39:58.154 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 128.74810380700001 2024-09-19T06:39:58.154 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:39:58.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 -- 172.21.15.12:0/697323349 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb9bc0a3240 msgr2=0x7fb9bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:58.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb9bc0a3240 0x7fb9bc0a5700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9c804c000 tx=0x7fb9c804a000 comp rx=0 tx=0).stop 2024-09-19T06:39:58.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 -- 172.21.15.12:0/697323349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9d01036c0 msgr2=0x7fb9d0198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:58.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9d01036c0 0x7fb9d0198860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c920 tx=0x7fb9b800cde0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 -- 172.21.15.12:0/697323349 shutdown_connections 2024-09-19T06:39:58.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fb9bc0a3240 0x7fb9bc0a5700 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9d010c180 0x7fb9d019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9d01036c0 0x7fb9d0198860 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 --2- 172.21.15.12:0/697323349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9d0102da0 0x7fb9d0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:58.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 -- 172.21.15.12:0/697323349 >> 172.21.15.12:0/697323349 conn(0x7fb9d00fc7a0 msgr2=0x7fb9d00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:58.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 -- 172.21.15.12:0/697323349 shutdown_connections 2024-09-19T06:39:58.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:58.146+0000 7fb9d5bda640 1 -- 172.21.15.12:0/697323349 wait complete. 2024-09-19T06:39:58.851 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:39:59.110 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:39:59.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:39:58 smithi012 ceph-mon[30937]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T06:39:59.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:39:58 smithi016 ceph-mon[34911]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T06:39:59.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:39:58 smithi173 ceph-mon[35349]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T06:39:59.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.575+0000 7f9a3c343640 1 -- 172.21.15.12:0/707561193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a34106a80 msgr2=0x7f9a34106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.575+0000 7f9a3c343640 1 --2- 172.21.15.12:0/707561193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a34106a80 0x7f9a34106e60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9a30009930 tx=0x7f9a3002a420 comp rx=0 tx=0).stop 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.575+0000 7f9a3c343640 1 -- 172.21.15.12:0/707561193 shutdown_connections 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.575+0000 7f9a3c343640 1 --2- 172.21.15.12:0/707561193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a34101420 0x7f9a3410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.575+0000 7f9a3c343640 1 --2- 172.21.15.12:0/707561193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a34100a80 0x7f9a34100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.575+0000 7f9a3c343640 1 --2- 172.21.15.12:0/707561193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a34106a80 0x7f9a34106e60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.575+0000 7f9a3c343640 1 -- 172.21.15.12:0/707561193 >> 172.21.15.12:0/707561193 conn(0x7f9a340fc7a0 msgr2=0x7f9a340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.575+0000 7f9a3c343640 1 -- 172.21.15.12:0/707561193 shutdown_connections 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.575+0000 7f9a3c343640 1 -- 172.21.15.12:0/707561193 wait complete. 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.576+0000 7f9a3c343640 1 Processor -- start 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.576+0000 7f9a3c343640 1 -- start start 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.576+0000 7f9a3c343640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a34100a80 0x7f9a34198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.576+0000 7f9a3c343640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a34101420 0x7f9a341989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.576+0000 7f9a3c343640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a34106a80 0x7f9a3419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.576+0000 7f9a3c343640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9a34110ea0 con 0x7f9a34106a80 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.576+0000 7f9a3c343640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9a34110d20 con 0x7f9a34100a80 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.576+0000 7f9a3c343640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9a34111020 con 0x7f9a34101420 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.576+0000 7f9a3a8e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a34106a80 0x7f9a3419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3a8e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a34106a80 0x7f9a3419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48174/0 (socket says 172.21.15.12:48174) 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3a8e0640 1 -- 172.21.15.12:0/878362021 learned_addr learned my addr 172.21.15.12:0/878362021 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a398de640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a34101420 0x7f9a341989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a34100a80 0x7f9a34198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3a8e0640 1 -- 172.21.15.12:0/878362021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a34101420 msgr2=0x7f9a341989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3a8e0640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a34101420 0x7f9a341989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3a8e0640 1 -- 172.21.15.12:0/878362021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a34100a80 msgr2=0x7f9a34198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3a8e0640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a34100a80 0x7f9a34198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3a8e0640 1 -- 172.21.15.12:0/878362021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3419d430 con 0x7f9a34106a80 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3a8e0640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a34106a80 0x7f9a3419cd50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00cce0 tx=0x7f9a2c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a2b7fe640 1 -- 172.21.15.12:0/878362021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00f450 con 0x7f9a34106a80 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a2b7fe640 1 -- 172.21.15.12:0/878362021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a2c00fad0 con 0x7f9a34106a80 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3c343640 1 -- 172.21.15.12:0/878362021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3419d720 con 0x7f9a34106a80 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a2b7fe640 1 -- 172.21.15.12:0/878362021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c018b60 con 0x7f9a34106a80 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.577+0000 7f9a3c343640 1 -- 172.21.15.12:0/878362021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a341a5000 con 0x7f9a34106a80 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a2b7fe640 1 -- 172.21.15.12:0/878362021 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9a2c00fc80 con 0x7f9a34106a80 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a3e71c740 1 Processor -- start 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a3e71c740 1 -- start start 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b79d0 0x55c8c54b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b82f0 0x55c8c54c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54c2bb0 0x55c8c54c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c8c541e090 con 0x55c8c54b79d0 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c8c53c5a70 con 0x55c8c54b82f0 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c8c541a050 con 0x55c8c54c2bb0 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a398de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b79d0 0x55c8c54b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a398de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b79d0 0x55c8c54b7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48182/0 (socket says 172.21.15.12:48182) 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a398de640 1 -- 172.21.15.12:0/634797293 learned_addr learned my addr 172.21.15.12:0/634797293 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.580+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/634797293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b82f0 0x55c8c54c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a2b7fe640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9a200a3240 0x7f9a200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a398de640 1 -- 172.21.15.12:0/634797293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54c2bb0 msgr2=0x55c8c54c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a398de640 1 --2- 172.21.15.12:0/634797293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54c2bb0 0x55c8c54c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a398de640 1 -- 172.21.15.12:0/634797293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b82f0 msgr2=0x55c8c54c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a398de640 1 --2- 172.21.15.12:0/634797293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b82f0 0x55c8c54c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a398de640 1 -- 172.21.15.12:0/634797293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8c53d2130 con 0x55c8c54b79d0 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a3a8e0640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9a200a3240 0x7f9a200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a398de640 1 --2- 172.21.15.12:0/634797293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b79d0 0x55c8c54b7db0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9a24006aa0 tx=0x7f9a24009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fe63093036d990 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a2b7fe640 1 -- 172.21.15.12:0/878362021 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f9a2c0cfe60 con 0x7f9a34106a80 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a28dea640 1 -- 172.21.15.12:0/634797293 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a24018020 con 0x55c8c54b79d0 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a28dea640 1 -- 172.21.15.12:0/634797293 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a24010dc0 con 0x55c8c54b79d0 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.581+0000 7f9a28dea640 1 -- 172.21.15.12:0/634797293 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a24013790 con 0x55c8c54b79d0 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 -- 172.21.15.12:0/634797293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b79d0 msgr2=0x55c8c54b7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/634797293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b79d0 0x55c8c54b7db0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9a24006aa0 tx=0x7f9a24009f70 comp rx=0 tx=0).stop 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3a8e0640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9a200a3240 0x7f9a200a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c09c0e0 tx=0x7f9a2c0918c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 -- 172.21.15.12:0/634797293 shutdown_connections 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/634797293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54c2bb0 0x55c8c54c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/634797293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b82f0 0x55c8c54c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/634797293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b79d0 0x55c8c54b7db0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 -- 172.21.15.12:0/634797293 >> 172.21.15.12:0/634797293 conn(0x55c8c54b3f60 msgr2=0x55c8c54b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 -- 172.21.15.12:0/634797293 shutdown_connections 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 -- 172.21.15.12:0/634797293 wait complete. 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 -- start start 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.582+0000 7f9a3e71c740 1 Processor -- start 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 0x55c8c54c2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54bf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54c2bb0 0x55c8c54bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c8c54c5780 con 0x55c8c54b82f0 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c8c53d8f20 con 0x55c8c54b79d0 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c8c54c5900 con 0x55c8c54c2bb0 2024-09-19T06:39:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3e71c740 10 client.0 _ll_register_callbacks cb 0x55c8c53a2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3a0df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3a0df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54bf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48192/0 (socket says 172.21.15.12:48192) 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3a0df640 1 -- 172.21.15.12:0/2851371451 learned_addr learned my addr 172.21.15.12:0/2851371451 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a398de640 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 0x55c8c54c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a398de640 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54c2bb0 0x55c8c54bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3a0df640 1 -- 172.21.15.12:0/2851371451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54c2bb0 msgr2=0x55c8c54bfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54c2bb0 0x55c8c54bfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3a0df640 1 -- 172.21.15.12:0/2851371451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 msgr2=0x55c8c54c2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 0x55c8c54c2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3a0df640 1 -- 172.21.15.12:0/2851371451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c518f2b0 con 0x55c8c54b82f0 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a398de640 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 0x55c8c54c2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54bf760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9a30006010 tx=0x7f9a30031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c92be00b9e17df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.583+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2851371451 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30035040 con 0x55c8c54b82f0 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2851371451 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f9a30004380 con 0x55c8c54b82f0 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2851371451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a24010dc0 con 0x55c8c54b82f0 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2851371451 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9a300035f0 con 0x55c8c54b82f0 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a3e71c740 10 client.15195 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2851371451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c8c54d1070 con 0x55c8c54b82f0 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2851371451 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a24010dc0 con 0x55c8c54b82f0 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2851371451 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9a3003c960 con 0x55c8c54b82f0 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a3e71c740 10 client.15195 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a3e71c740 10 client.15195 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a3e71c740 20 client.15195 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c8c54d36e0 0x55c8c54d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a3e71c740 4 client.15195 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.584+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2851371451 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8c542b600 con 0x55c8c54d36e0 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.585+0000 7f9a398de640 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c8c54d36e0 0x55c8c54d4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.585+0000 7f9a1dffb640 10 client.15195 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.585+0000 7f9a398de640 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c8c54d36e0 0x55c8c54d4b50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fbc3c0dc724a699f server_cookie=6d3d7414862bc3b9 in_seq=0 out_seq=0 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2851371451 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8c542b600 con 0x55c8c54d36e0 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a1dffb640 10 client.15195 handle_command_reply: tid=0 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 client.15195 shutdown 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2851371451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 msgr2=0x55c8c54bf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54bf760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9a30006010 tx=0x7f9a30031a60 comp rx=0 tx=0).stop 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2851371451 shutdown_connections 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c8c54d36e0 0x55c8c54d4b50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54c2bb0 0x55c8c54bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54bf760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2851371451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 0x55c8c54c2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2851371451 >> 172.21.15.12:0/2851371451 conn(0x55c8c54b3f60 msgr2=0x55c8c54b9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a1dffb640 0 client.15195 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:39:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2851371451 shutdown_connections 2024-09-19T06:39:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2851371451 wait complete. 2024-09-19T06:39:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.586+0000 7f9a3e71c740 20 client.15195 trim_cache size 0 max 16384 2024-09-19T06:39:59.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3e71c740 1 Processor -- start 2024-09-19T06:39:59.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3e71c740 1 -- start start 2024-09-19T06:39:59.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54b79d0 0x55c8c54d4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54dce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54c2bb0 0x55c8c54dd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c8c54d2e90 con 0x55c8c54b82f0 2024-09-19T06:39:59.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c8c54d3560 con 0x55c8c54c2bb0 2024-09-19T06:39:59.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c8c54d3c30 con 0x55c8c54b79d0 2024-09-19T06:39:59.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3a0df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54dce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3a0df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54dce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48196/0 (socket says 172.21.15.12:48196) 2024-09-19T06:39:59.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a3a0df640 1 -- 172.21.15.12:0/1425410390 learned_addr learned my addr 172.21.15.12:0/1425410390 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:59.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.604+0000 7f9a398de640 1 --2- 172.21.15.12:0/1425410390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54b79d0 0x55c8c54d4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a398de640 1 --2- 172.21.15.12:0/1425410390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54c2bb0 0x55c8c54dd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a3a0df640 1 -- 172.21.15.12:0/1425410390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54b79d0 msgr2=0x55c8c54d4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:59.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/1425410390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54b79d0 0x55c8c54d4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a3a0df640 1 -- 172.21.15.12:0/1425410390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54c2bb0 msgr2=0x55c8c54dd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:59.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/1425410390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54c2bb0 0x55c8c54dd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a3a0df640 1 -- 172.21.15.12:0/1425410390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8c54c0280 con 0x55c8c54b82f0 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a398de640 1 --2- 172.21.15.12:0/1425410390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54c2bb0 0x55c8c54dd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/1425410390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54dce00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9a3003cd80 tx=0x7f9a3002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a5a0dd0534ef08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a1ffff640 1 -- 172.21.15.12:0/1425410390 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30035030 con 0x55c8c54b82f0 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a1ffff640 1 -- 172.21.15.12:0/1425410390 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a30045d30 con 0x55c8c54b82f0 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.605+0000 7f9a1ffff640 1 -- 172.21.15.12:0/1425410390 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30052070 con 0x55c8c54b82f0 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 -- 172.21.15.12:0/1425410390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 msgr2=0x55c8c54dce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/1425410390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54dce00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9a3003cd80 tx=0x7f9a3002a420 comp rx=0 tx=0).stop 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 -- 172.21.15.12:0/1425410390 shutdown_connections 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/1425410390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54c2bb0 0x55c8c54dd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/1425410390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54b82f0 0x55c8c54dce00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/1425410390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54b79d0 0x55c8c54d4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 -- 172.21.15.12:0/1425410390 >> 172.21.15.12:0/1425410390 conn(0x55c8c54b3f60 msgr2=0x55c8c54be030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:59.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 -- 172.21.15.12:0/1425410390 shutdown_connections 2024-09-19T06:39:59.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 -- 172.21.15.12:0/1425410390 wait complete. 2024-09-19T06:39:59.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 -- start start 2024-09-19T06:39:59.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 Processor -- start 2024-09-19T06:39:59.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 0x55c8c54d7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54b82f0 0x55c8c54d82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54c2bb0 0x55c8c54d87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c8c54d49d0 con 0x55c8c54c2bb0 2024-09-19T06:39:59.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c8c54d4300 con 0x55c8c54b79d0 2024-09-19T06:39:59.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c8c54d50a0 con 0x55c8c54b82f0 2024-09-19T06:39:59.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.606+0000 7f9a3e71c740 10 client.0 _ll_register_callbacks cb 0x7f9a30009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a398de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54c2bb0 0x55c8c54d87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a398de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54c2bb0 0x55c8c54d87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48198/0 (socket says 172.21.15.12:48198) 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a398de640 1 -- 172.21.15.12:0/2519489626 learned_addr learned my addr 172.21.15.12:0/2519489626 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a398de640 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 0x55c8c54d7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54b82f0 0x55c8c54d82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a398de640 1 -- 172.21.15.12:0/2519489626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54b82f0 msgr2=0x55c8c54d82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a398de640 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54b82f0 0x55c8c54d82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a398de640 1 -- 172.21.15.12:0/2519489626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 msgr2=0x55c8c54d7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a398de640 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 0x55c8c54d7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a398de640 1 -- 172.21.15.12:0/2519489626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c553beb0 con 0x55c8c54c2bb0 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a398de640 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54c2bb0 0x55c8c54d87e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9a240134e0 tx=0x7f9a24016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4230d1529d3b03d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:39:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2519489626 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a24018030 con 0x55c8c54c2bb0 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2519489626 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f9a24027040 con 0x55c8c54c2bb0 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.607+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2519489626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a30045d30 con 0x55c8c54c2bb0 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2519489626 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9a2403d050 con 0x55c8c54c2bb0 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a3e71c740 10 client.15201 fetch_fsmap learned FSMap version 27 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2519489626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c8c553d120 con 0x55c8c54c2bb0 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2519489626 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a30045d30 con 0x55c8c54c2bb0 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2519489626 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9a24014a40 con 0x55c8c54c2bb0 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a3e71c740 10 client.15201 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a3e71c740 10 client.15201 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a3e71c740 20 client.15201 populate_metadata read hostname 'smithi012' 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c8c5541a20 0x55c8c5540730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a3e71c740 4 client.15201 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:39:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2519489626 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "status"}) -- 0x55c8c5425b10 con 0x55c8c5541a20 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.608+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c8c5541a20 0x55c8c5540730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a1dffb640 10 client.15201 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3a0df640 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c8c5541a20 0x55c8c5540730 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=370c524c37adab61 server_cookie=1212b3efcb7c2791 in_seq=0 out_seq=0 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a1dffb640 1 -- 172.21.15.12:0/2519489626 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c8c5425b10 con 0x55c8c5541a20 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a1dffb640 10 client.15201 handle_command_reply: tid=0 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 client.15201 shutdown 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2519489626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54c2bb0 msgr2=0x55c8c54d87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54c2bb0 0x55c8c54d87e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9a240134e0 tx=0x7f9a24016040 comp rx=0 tx=0).stop 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2519489626 shutdown_connections 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c8c5541a20 0x55c8c5540730 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8c54c2bb0 0x55c8c54d87e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8c54b82f0 0x55c8c54d82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 --2- 172.21.15.12:0/2519489626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8c54b79d0 0x55c8c54d7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a1dffb640 0 client.15201 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2519489626 >> 172.21.15.12:0/2519489626 conn(0x55c8c54b3f60 msgr2=0x55c8c54be450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2519489626 shutdown_connections 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 1 -- 172.21.15.12:0/2519489626 wait complete. 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.609+0000 7f9a3e71c740 20 client.15201 trim_cache size 0 max 16384 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 1, 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24502, 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:39:59.617 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:39:59.618 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:39:59.618 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 97.544587684999996, 2024-09-19T06:39:59.618 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-19T06:39:59.618 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-19T06:39:59.618 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T06:39:59.618 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 125.054335417 2024-09-19T06:39:59.618 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:39:59.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 -- 172.21.15.12:0/878362021 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9a200a3240 msgr2=0x7f9a200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9a200a3240 0x7f9a200a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c09c0e0 tx=0x7f9a2c0918c0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 -- 172.21.15.12:0/878362021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a34106a80 msgr2=0x7f9a3419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a34106a80 0x7f9a3419cd50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00cce0 tx=0x7f9a2c00a620 comp rx=0 tx=0).stop 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 -- 172.21.15.12:0/878362021 shutdown_connections 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f9a200a3240 0x7f9a200a5700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a34106a80 0x7f9a3419cd50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a34101420 0x7f9a341989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 --2- 172.21.15.12:0/878362021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a34100a80 0x7f9a34198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 -- 172.21.15.12:0/878362021 >> 172.21.15.12:0/878362021 conn(0x7f9a340fc7a0 msgr2=0x7f9a34104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 -- 172.21.15.12:0/878362021 shutdown_connections 2024-09-19T06:39:59.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:39:59.610+0000 7f9a3c343640 1 -- 172.21.15.12:0/878362021 wait complete. 2024-09-19T06:40:00.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:40:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:01.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:00 smithi012 ceph-mon[30937]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T06:40:01.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:00 smithi012 ceph-mon[30937]: overall HEALTH_OK 2024-09-19T06:40:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.237+0000 7f46471ed640 1 -- 172.21.15.12:0/169229289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4640100a80 msgr2=0x7f4640100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.237+0000 7f46471ed640 1 --2- 172.21.15.12:0/169229289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4640100a80 0x7f4640100ee0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4630009930 tx=0x7f463002a420 comp rx=0 tx=0).stop 2024-09-19T06:40:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.237+0000 7f46471ed640 1 -- 172.21.15.12:0/169229289 shutdown_connections 2024-09-19T06:40:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.237+0000 7f46471ed640 1 --2- 172.21.15.12:0/169229289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4640101420 0x7f464010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.237+0000 7f46471ed640 1 --2- 172.21.15.12:0/169229289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4640100a80 0x7f4640100ee0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.237+0000 7f46471ed640 1 --2- 172.21.15.12:0/169229289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640106a80 0x7f4640106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.237+0000 7f46471ed640 1 -- 172.21.15.12:0/169229289 >> 172.21.15.12:0/169229289 conn(0x7f46400fc7a0 msgr2=0x7f46400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.237+0000 7f46471ed640 1 -- 172.21.15.12:0/169229289 shutdown_connections 2024-09-19T06:40:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.237+0000 7f46471ed640 1 -- 172.21.15.12:0/169229289 wait complete. 2024-09-19T06:40:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.237+0000 7f46471ed640 1 Processor -- start 2024-09-19T06:40:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f46471ed640 1 -- start start 2024-09-19T06:40:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f46471ed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100a80 0x7f46400fce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f46471ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4640101420 0x7f46400fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f46471ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4640106a80 0x7f46400fd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f46471ed640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4640110e80 con 0x7f4640101420 2024-09-19T06:40:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f46471ed640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4640110d00 con 0x7f4640106a80 2024-09-19T06:40:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f46471ed640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4640111000 con 0x7f4640100a80 2024-09-19T06:40:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4637fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4640101420 0x7f46400fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4637fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4640101420 0x7f46400fd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32850/0 (socket says 172.21.15.12:32850) 2024-09-19T06:40:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4637fff640 1 -- 172.21.15.12:0/2858331396 learned_addr learned my addr 172.21.15.12:0/2858331396 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4644f89640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100a80 0x7f46400fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f464578a640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4640106a80 0x7f46400fd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4637fff640 1 -- 172.21.15.12:0/2858331396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100a80 msgr2=0x7f46400fce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4637fff640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100a80 0x7f46400fce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4637fff640 1 -- 172.21.15.12:0/2858331396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4640106a80 msgr2=0x7f46400fd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4637fff640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4640106a80 0x7f46400fd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4637fff640 1 -- 172.21.15.12:0/2858331396 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46401a6910 con 0x7f4640101420 2024-09-19T06:40:01.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4644f89640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100a80 0x7f46400fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:01.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f464578a640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4640106a80 0x7f46400fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:01.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.238+0000 7f4637fff640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4640101420 0x7f46400fd3d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4630009230 tx=0x7f4630004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:01.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.239+0000 7f4635ffb640 1 -- 172.21.15.12:0/2858331396 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463003f030 con 0x7f4640101420 2024-09-19T06:40:01.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.239+0000 7f4635ffb640 1 -- 172.21.15.12:0/2858331396 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4630003ad0 con 0x7f4640101420 2024-09-19T06:40:01.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.239+0000 7f46471ed640 1 -- 172.21.15.12:0/2858331396 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46401a6ba0 con 0x7f4640101420 2024-09-19T06:40:01.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.239+0000 7f4635ffb640 1 -- 172.21.15.12:0/2858331396 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630035070 con 0x7f4640101420 2024-09-19T06:40:01.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.239+0000 7f46471ed640 1 -- 172.21.15.12:0/2858331396 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46401a7080 con 0x7f4640101420 2024-09-19T06:40:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.241+0000 7f4635ffb640 1 -- 172.21.15.12:0/2858331396 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4630042030 con 0x7f4640101420 2024-09-19T06:40:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.241+0000 7f46495c6740 1 Processor -- start 2024-09-19T06:40:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.241+0000 7f46495c6740 1 -- start start 2024-09-19T06:40:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f46495c6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f46495c6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2f5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f46495c6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2f5bb0 0x563dac2f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f46495c6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563dac251090 con 0x563dac2eb2f0 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f46495c6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563dac1f8a70 con 0x563dac2f5bb0 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f46495c6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563dac24d050 con 0x563dac2ea9d0 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4635ffb640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46280a3240 0x7f46280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4644f89640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4644f89640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32862/0 (socket says 172.21.15.12:32862) 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4644f89640 1 -- 172.21.15.12:0/1354265927 learned_addr learned my addr 172.21.15.12:0/1354265927 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4635ffb640 1 -- 172.21.15.12:0/2858331396 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f46300f0100 con 0x7f4640101420 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4637fff640 1 --2- 172.21.15.12:0/1354265927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2f5bb0 0x563dac2f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f464578a640 1 --2- 172.21.15.12:0/1354265927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f464578a640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46280a3240 0x7f46280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4644f89640 1 -- 172.21.15.12:0/1354265927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 msgr2=0x563dac2eadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4644f89640 1 --2- 172.21.15.12:0/1354265927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2eadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4644f89640 1 -- 172.21.15.12:0/1354265927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2f5bb0 msgr2=0x563dac2f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4644f89640 1 --2- 172.21.15.12:0/1354265927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2f5bb0 0x563dac2f7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4644f89640 1 -- 172.21.15.12:0/1354265927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dac205130 con 0x563dac2eb2f0 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f464578a640 1 --2- 172.21.15.12:0/1354265927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.242+0000 7f4644f89640 1 --2- 172.21.15.12:0/1354265927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2f5670 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f463c009c80 tx=0x7f463c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c00960f24f60fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f464578a640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46280a3240 0x7f46280a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4638009270 tx=0x7f4638005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f4626ffd640 1 -- 172.21.15.12:0/1354265927 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c004030 con 0x563dac2eb2f0 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f4626ffd640 1 -- 172.21.15.12:0/1354265927 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f463c0041d0 con 0x563dac2eb2f0 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f4626ffd640 1 -- 172.21.15.12:0/1354265927 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c012780 con 0x563dac2eb2f0 2024-09-19T06:40:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f46495c6740 1 -- 172.21.15.12:0/1354265927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 msgr2=0x563dac2f5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f46495c6740 1 --2- 172.21.15.12:0/1354265927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2f5670 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f463c009c80 tx=0x7f463c010740 comp rx=0 tx=0).stop 2024-09-19T06:40:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f46495c6740 1 -- 172.21.15.12:0/1354265927 shutdown_connections 2024-09-19T06:40:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f46495c6740 1 --2- 172.21.15.12:0/1354265927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2f5bb0 0x563dac2f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f46495c6740 1 --2- 172.21.15.12:0/1354265927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2f5670 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f46495c6740 1 --2- 172.21.15.12:0/1354265927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2eadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.243+0000 7f46495c6740 1 -- 172.21.15.12:0/1354265927 >> 172.21.15.12:0/1354265927 conn(0x563dac2e6f60 msgr2=0x563dac2e7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 1 -- 172.21.15.12:0/1354265927 shutdown_connections 2024-09-19T06:40:01.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 1 -- 172.21.15.12:0/1354265927 wait complete. 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 1 -- start start 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 1 Processor -- start 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2f5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 0x563dac2f2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac2f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563dac2f8780 con 0x563dac2f5bb0 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563dac20bf20 con 0x563dac2eb2f0 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563dac2f8900 con 0x563dac2ea9d0 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.244+0000 7f46495c6740 10 client.0 _ll_register_callbacks cb 0x563dac1d5030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f464578a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac2f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f464578a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac2f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32874/0 (socket says 172.21.15.12:32874) 2024-09-19T06:40:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f464578a640 1 -- 172.21.15.12:0/2857363879 learned_addr learned my addr 172.21.15.12:0/2857363879 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f4644f89640 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f4637fff640 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 0x563dac2f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f464578a640 1 -- 172.21.15.12:0/2857363879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 msgr2=0x563dac2f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f464578a640 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2f5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f464578a640 1 -- 172.21.15.12:0/2857363879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 msgr2=0x563dac2f2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f464578a640 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 0x563dac2f2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f464578a640 1 -- 172.21.15.12:0/2857363879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dabfc22b0 con 0x563dac2f5bb0 2024-09-19T06:40:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f4637fff640 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 0x563dac2f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f464578a640 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac2f2ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4638011a10 tx=0x7f4638004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28c5bfc6fa790d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f461ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f461ffff640 1 -- 172.21.15.12:0/2857363879 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638024070 con 0x563dac2f5bb0 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f461ffff640 1 -- 172.21.15.12:0/2857363879 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f463800fd80 con 0x563dac2f5bb0 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.245+0000 7f46495c6740 1 -- 172.21.15.12:0/2857363879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f463c0041d0 con 0x563dac2f5bb0 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f461ffff640 1 -- 172.21.15.12:0/2857363879 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f463802f050 con 0x563dac2f5bb0 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f46495c6740 10 client.15213 fetch_fsmap learned FSMap version 27 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f46495c6740 1 -- 172.21.15.12:0/2857363879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563dac304150 con 0x563dac2f5bb0 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f461ffff640 1 -- 172.21.15.12:0/2857363879 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f463c0041d0 con 0x563dac2f5bb0 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f461ffff640 1 -- 172.21.15.12:0/2857363879 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f463801f070 con 0x563dac2f5bb0 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f46495c6740 10 client.15213 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:40:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f46495c6740 10 client.15213 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f46495c6740 20 client.15213 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f46495c6740 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563dac3067e0 0x563dac307c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f46495c6740 4 client.15213 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f46495c6740 1 -- 172.21.15.12:0/2857363879 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dac25e600 con 0x563dac3067e0 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.246+0000 7f4644f89640 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563dac3067e0 0x563dac307c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.247+0000 7f461ffff640 10 client.15213 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.247+0000 7f4644f89640 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563dac3067e0 0x563dac307c50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfc5a14790ab48b7 server_cookie=e459e62182c3668d in_seq=0 out_seq=0 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f461ffff640 1 -- 172.21.15.12:0/2857363879 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563dac25e600 con 0x563dac3067e0 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f461ffff640 10 client.15213 handle_command_reply: tid=0 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 client.15213 shutdown 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 -- 172.21.15.12:0/2857363879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 msgr2=0x563dac2f2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac2f2ca0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4638011a10 tx=0x7f4638004a40 comp rx=0 tx=0).stop 2024-09-19T06:40:01.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 -- 172.21.15.12:0/2857363879 shutdown_connections 2024-09-19T06:40:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563dac3067e0 0x563dac307c50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac2f2ca0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 0x563dac2f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 --2- 172.21.15.12:0/2857363879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f461ffff640 0 client.15213 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 -- 172.21.15.12:0/2857363879 >> 172.21.15.12:0/2857363879 conn(0x563dac2e6f60 msgr2=0x563dac2ecc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 -- 172.21.15.12:0/2857363879 shutdown_connections 2024-09-19T06:40:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 1 -- 172.21.15.12:0/2857363879 wait complete. 2024-09-19T06:40:01.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.248+0000 7f46495c6740 20 client.15213 trim_cache size 0 max 16384 2024-09-19T06:40:01.264 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:00 smithi016 ceph-mon[34911]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T06:40:01.264 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:00 smithi016 ceph-mon[34911]: overall HEALTH_OK 2024-09-19T06:40:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f46495c6740 1 Processor -- start 2024-09-19T06:40:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f46495c6740 1 -- start start 2024-09-19T06:40:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f46495c6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac307c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f46495c6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2e1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f46495c6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2f5bb0 0x563dac2f1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f46495c6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563dac305f90 con 0x563dac2eb2f0 2024-09-19T06:40:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f46495c6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563dac306660 con 0x563dac2f5bb0 2024-09-19T06:40:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f46495c6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563dac306d30 con 0x563dac2ea9d0 2024-09-19T06:40:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f4637fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2e1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f4637fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2e1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32886/0 (socket says 172.21.15.12:32886) 2024-09-19T06:40:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f4637fff640 1 -- 172.21.15.12:0/3657042073 learned_addr learned my addr 172.21.15.12:0/3657042073 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f4644f89640 1 --2- 172.21.15.12:0/3657042073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac307c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f4637fff640 1 -- 172.21.15.12:0/3657042073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 msgr2=0x563dac307c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f4637fff640 1 --2- 172.21.15.12:0/3657042073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac307c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f4637fff640 1 -- 172.21.15.12:0/3657042073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2f5bb0 msgr2=0x563dac2f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f464578a640 1 --2- 172.21.15.12:0/3657042073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2f5bb0 0x563dac2f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f4637fff640 1 --2- 172.21.15.12:0/3657042073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2f5bb0 0x563dac2f1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f4637fff640 1 -- 172.21.15.12:0/3657042073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dac2f0cb0 con 0x563dac2eb2f0 2024-09-19T06:40:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.266+0000 7f4644f89640 1 --2- 172.21.15.12:0/3657042073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac307c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f4637fff640 1 --2- 172.21.15.12:0/3657042073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2e1ce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f46300b8ff0 tx=0x7f4630009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d80ac1f1f8535 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46267fc640 1 -- 172.21.15.12:0/3657042073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630049040 con 0x563dac2eb2f0 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46267fc640 1 -- 172.21.15.12:0/3657042073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46300d5070 con 0x563dac2eb2f0 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46267fc640 1 -- 172.21.15.12:0/3657042073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630003c80 con 0x563dac2eb2f0 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46495c6740 1 -- 172.21.15.12:0/3657042073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 msgr2=0x563dac2e1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46495c6740 1 --2- 172.21.15.12:0/3657042073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2e1ce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f46300b8ff0 tx=0x7f4630009260 comp rx=0 tx=0).stop 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46495c6740 1 -- 172.21.15.12:0/3657042073 shutdown_connections 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46495c6740 1 --2- 172.21.15.12:0/3657042073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2f5bb0 0x563dac2f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46495c6740 1 --2- 172.21.15.12:0/3657042073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2eb2f0 0x563dac2e1ce0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46495c6740 1 --2- 172.21.15.12:0/3657042073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac307c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46495c6740 1 -- 172.21.15.12:0/3657042073 >> 172.21.15.12:0/3657042073 conn(0x563dac2e6f60 msgr2=0x563dac2e7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.267+0000 7f46495c6740 1 -- 172.21.15.12:0/3657042073 shutdown_connections 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.268+0000 7f46495c6740 1 -- 172.21.15.12:0/3657042073 wait complete. 2024-09-19T06:40:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.268+0000 7f46495c6740 1 -- start start 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.268+0000 7f46495c6740 1 Processor -- start 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.268+0000 7f46495c6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2eef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.268+0000 7f46495c6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 0x563dac2ef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.268+0000 7f46495c6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac30ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.268+0000 7f46495c6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563dac307ad0 con 0x563dac2f5bb0 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.268+0000 7f46495c6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563dac307400 con 0x563dac2eb2f0 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.268+0000 7f46495c6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563dac3081a0 con 0x563dac2ea9d0 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.268+0000 7f46495c6740 10 client.0 _ll_register_callbacks cb 0x7f4638009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f464578a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac30ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f4644f89640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f464578a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac30ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32888/0 (socket says 172.21.15.12:32888) 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f464578a640 1 -- 172.21.15.12:0/3351620620 learned_addr learned my addr 172.21.15.12:0/3351620620 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:01.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f4637fff640 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 0x563dac2ef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f464578a640 1 -- 172.21.15.12:0/3351620620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 msgr2=0x563dac2eef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f464578a640 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2eef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f464578a640 1 -- 172.21.15.12:0/3351620620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 msgr2=0x563dac2ef4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f464578a640 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 0x563dac2ef4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f464578a640 1 -- 172.21.15.12:0/3351620620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dac30f450 con 0x563dac2f5bb0 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f4644f89640 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2eef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f464578a640 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac30ef10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4638000f80 tx=0x7f46380203f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11b9141ad4f33e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f461ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f461ffff640 1 -- 172.21.15.12:0/3351620620 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638038060 con 0x563dac2f5bb0 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f46495c6740 1 -- 172.21.15.12:0/3351620620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46300d5070 con 0x563dac2f5bb0 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f461ffff640 1 -- 172.21.15.12:0/3351620620 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f463800fb80 con 0x563dac2f5bb0 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f461ffff640 1 -- 172.21.15.12:0/3351620620 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4638024040 con 0x563dac2f5bb0 2024-09-19T06:40:01.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f46495c6740 10 client.15219 fetch_fsmap learned FSMap version 27 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.269+0000 7f46495c6740 1 -- 172.21.15.12:0/3351620620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563dac3106c0 con 0x563dac2f5bb0 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f461ffff640 1 -- 172.21.15.12:0/3351620620 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46300d5070 con 0x563dac2f5bb0 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f461ffff640 1 -- 172.21.15.12:0/3351620620 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f463801f070 con 0x563dac2f5bb0 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f46495c6740 10 client.15219 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f46495c6740 10 client.15219 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f46495c6740 20 client.15219 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f46495c6740 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563dac375240 0x563dac373f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f46495c6740 4 client.15219 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f46495c6740 1 -- 172.21.15.12:0/3351620620 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "status"}) -- 0x563dac258b10 con 0x563dac375240 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f4644f89640 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563dac375240 0x563dac373f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f4644f89640 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563dac375240 0x563dac373f50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8beda44e8dc80544 server_cookie=942649026a70cc6 in_seq=0 out_seq=0 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.270+0000 7f461ffff640 10 client.15219 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:01.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f461ffff640 1 -- 172.21.15.12:0/3351620620 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x563dac258b10 con 0x563dac375240 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f461ffff640 10 client.15219 handle_command_reply: tid=0 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 client.15219 shutdown 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 -- 172.21.15.12:0/3351620620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 msgr2=0x563dac30ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac30ef10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4638000f80 tx=0x7f46380203f0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 -- 172.21.15.12:0/3351620620 shutdown_connections 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563dac375240 0x563dac373f50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dac2f5bb0 0x563dac30ef10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563dac2eb2f0 0x563dac2ef4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 --2- 172.21.15.12:0/3351620620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563dac2ea9d0 0x563dac2eef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 -- 172.21.15.12:0/3351620620 >> 172.21.15.12:0/3351620620 conn(0x563dac2e6f60 msgr2=0x563dac2e1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f461ffff640 0 client.15219 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 -- 172.21.15.12:0/3351620620 shutdown_connections 2024-09-19T06:40:01.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 1 -- 172.21.15.12:0/3351620620 wait complete. 2024-09-19T06:40:01.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.271+0000 7f46495c6740 20 client.15219 trim_cache size 0 max 16384 2024-09-19T06:40:01.283 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:40:01.283 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:40:01.283 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-19T06:40:01.283 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24509, 2024-09-19T06:40:01.283 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:40:01.283 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:40:01.283 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:40:01.283 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 106.226197951, 2024-09-19T06:40:01.284 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-19T06:40:01.284 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-19T06:40:01.284 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 83, 2024-09-19T06:40:01.284 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 117.863390076 2024-09-19T06:40:01.284 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:40:01.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 -- 172.21.15.12:0/2858331396 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46280a3240 msgr2=0x7f46280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46280a3240 0x7f46280a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4638009270 tx=0x7f4638005bd0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 -- 172.21.15.12:0/2858331396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4640101420 msgr2=0x7f46400fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4640101420 0x7f46400fd3d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4630009230 tx=0x7f4630004270 comp rx=0 tx=0).stop 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 -- 172.21.15.12:0/2858331396 shutdown_connections 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f46280a3240 0x7f46280a5700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4640106a80 0x7f46400fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4640101420 0x7f46400fd3d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 --2- 172.21.15.12:0/2858331396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4640100a80 0x7f46400fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 -- 172.21.15.12:0/2858331396 >> 172.21.15.12:0/2858331396 conn(0x7f46400fc7a0 msgr2=0x7f464006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 -- 172.21.15.12:0/2858331396 shutdown_connections 2024-09-19T06:40:01.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:01.272+0000 7f46471ed640 1 -- 172.21.15.12:0/2858331396 wait complete. 2024-09-19T06:40:01.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:00 smithi173 ceph-mon[35349]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T06:40:01.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:00 smithi173 ceph-mon[35349]: overall HEALTH_OK 2024-09-19T06:40:02.107 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T06:40:02.118 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T06:40:02.118 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T06:40:02.119 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T06:40:02.119 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T06:40:02.120 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:40:02.120 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:40:02.120 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T06:40:02.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.227+0000 7f831f85e640 1 -- 172.21.15.12:0/3094316401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318102d50 msgr2=0x7f83181031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:02.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.227+0000 7f831f85e640 1 --2- 172.21.15.12:0/3094316401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318102d50 0x7f83181031d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8308009900 tx=0x7f830802a410 comp rx=0 tx=0).stop 2024-09-19T06:40:02.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.227+0000 7f831f85e640 1 -- 172.21.15.12:0/3094316401 shutdown_connections 2024-09-19T06:40:02.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.227+0000 7f831f85e640 1 --2- 172.21.15.12:0/3094316401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8318103710 0x7f8318109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:02.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.227+0000 7f831f85e640 1 --2- 172.21.15.12:0/3094316401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318102d50 0x7f83181031d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:02.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.227+0000 7f831f85e640 1 --2- 172.21.15.12:0/3094316401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8318101b60 0x7f8318101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:02.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.227+0000 7f831f85e640 1 -- 172.21.15.12:0/3094316401 >> 172.21.15.12:0/3094316401 conn(0x7f83180fd2e0 msgr2=0x7f83180ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:02.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.227+0000 7f831f85e640 1 -- 172.21.15.12:0/3094316401 shutdown_connections 2024-09-19T06:40:02.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.228+0000 7f831f85e640 1 -- 172.21.15.12:0/3094316401 wait complete. 2024-09-19T06:40:02.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.228+0000 7f831f85e640 1 Processor -- start 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.228+0000 7f831f85e640 1 -- start start 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.228+0000 7f831f85e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318101b60 0x7f8318197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.228+0000 7f831f85e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8318102d50 0x7f8318198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.228+0000 7f831f85e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8318103710 0x7f831819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831f85e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f831810d7e0 con 0x7f8318101b60 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831f85e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f831810d660 con 0x7f8318102d50 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831f85e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f831810d960 con 0x7f8318103710 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831d5fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318101b60 0x7f8318197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831d5fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318101b60 0x7f8318197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32910/0 (socket says 172.21.15.12:32910) 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831d5fa640 1 -- 172.21.15.12:0/1802430469 learned_addr learned my addr 172.21.15.12:0/1802430469 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831cdf9640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8318102d50 0x7f8318198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:02.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831ddfb640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8318103710 0x7f831819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831d5fa640 1 -- 172.21.15.12:0/1802430469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8318103710 msgr2=0x7f831819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831d5fa640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8318103710 0x7f831819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831d5fa640 1 -- 172.21.15.12:0/1802430469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8318102d50 msgr2=0x7f8318198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831d5fa640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8318102d50 0x7f8318198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831d5fa640 1 -- 172.21.15.12:0/1802430469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831819f9f0 con 0x7f8318101b60 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831ddfb640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8318103710 0x7f831819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831cdf9640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8318102d50 0x7f8318198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831d5fa640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318101b60 0x7f8318197dd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f831400d950 tx=0x7f831400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f830e7fc640 1 -- 172.21.15.12:0/1802430469 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314017020 con 0x7f8318101b60 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f830e7fc640 1 -- 172.21.15.12:0/1802430469 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8314009c30 con 0x7f8318101b60 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831f85e640 1 -- 172.21.15.12:0/1802430469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831819fce0 con 0x7f8318101b60 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f830e7fc640 1 -- 172.21.15.12:0/1802430469 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831400f720 con 0x7f8318101b60 2024-09-19T06:40:02.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.229+0000 7f831f85e640 1 -- 172.21.15.12:0/1802430469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83181a01b0 con 0x7f8318101b60 2024-09-19T06:40:02.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.230+0000 7f831f85e640 1 -- 172.21.15.12:0/1802430469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8318108ed0 con 0x7f8318101b60 2024-09-19T06:40:02.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.231+0000 7f830e7fc640 1 -- 172.21.15.12:0/1802430469 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f831401a020 con 0x7f8318101b60 2024-09-19T06:40:02.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.232+0000 7f830e7fc640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83040a32f0 0x7f83040a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:02.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.232+0000 7f831cdf9640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83040a32f0 0x7f83040a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:02.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.232+0000 7f830e7fc640 1 -- 172.21.15.12:0/1802430469 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f83140cf9c0 con 0x7f8318101b60 2024-09-19T06:40:02.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.232+0000 7f831cdf9640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83040a32f0 0x7f83040a57b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8308000c00 tx=0x7f83080095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:02.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.236+0000 7f830e7fc640 1 -- 172.21.15.12:0/1802430469 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83140d1e20 con 0x7f8318101b60 2024-09-19T06:40:02.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.461+0000 7f831f85e640 1 -- 172.21.15.12:0/1802430469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f8318062e90 con 0x7f8318101b60 2024-09-19T06:40:02.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.849+0000 7f830e7fc640 1 -- 172.21.15.12:0/1802430469 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f8314021020 con 0x7f8318101b60 2024-09-19T06:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 -- 172.21.15.12:0/1802430469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83040a32f0 msgr2=0x7f83040a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83040a32f0 0x7f83040a57b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8308000c00 tx=0x7f83080095f0 comp rx=0 tx=0).stop 2024-09-19T06:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 -- 172.21.15.12:0/1802430469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318101b60 msgr2=0x7f8318197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318101b60 0x7f8318197dd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f831400d950 tx=0x7f831400de10 comp rx=0 tx=0).stop 2024-09-19T06:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 -- 172.21.15.12:0/1802430469 shutdown_connections 2024-09-19T06:40:02.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f83040a32f0 0x7f83040a57b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8318103710 0x7f831819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8318102d50 0x7f8318198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 --2- 172.21.15.12:0/1802430469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8318101b60 0x7f8318197dd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 -- 172.21.15.12:0/1802430469 >> 172.21.15.12:0/1802430469 conn(0x7f83180fd2e0 msgr2=0x7f83181060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 -- 172.21.15.12:0/1802430469 shutdown_connections 2024-09-19T06:40:02.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:02.852+0000 7f831f85e640 1 -- 172.21.15.12:0/1802430469 wait complete. 2024-09-19T06:40:02.871 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T06:40:02.900 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T06:40:02.900 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T06:40:02.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:40:02.901 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-19T06:40:02.902 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:02 smithi012 ceph-mon[30937]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T06:40:02.902 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:02 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1802430469' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:40:02.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:40:02.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-19T06:40:02.988 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2024-09-19T06:40:02.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:40:02.989 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-09-19T06:40:02.990 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:40:02.990 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-19T06:40:02.990 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-19T06:40:02.990 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T06:40:03.208 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:02 smithi173 ceph-mon[35349]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T06:40:03.208 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:02 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1802430469' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:40:03.208 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: ignoring --setuser ceph since I am not root 2024-09-19T06:40:03.209 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: ignoring --setgroup ceph since I am not root 2024-09-19T06:40:03.209 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:02 smithi173 ceph-mgr[37166]: -- 172.21.15.173:0/1348522992 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55647af850e0 con 0x55647af63400 2024-09-19T06:40:03.209 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:03.000+0000 7f7eac308040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:40:03.209 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:03.057+0000 7f7eac308040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:40:03.209 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:03.207+0000 7f7eac308040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:40:03.219 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:02 smithi016 ceph-mon[34911]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T06:40:03.220 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:02 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1802430469' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:40:03.220 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:02 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: ignoring --setuser ceph since I am not root 2024-09-19T06:40:03.220 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:02 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: ignoring --setgroup ceph since I am not root 2024-09-19T06:40:03.220 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:02 smithi016 ceph-mgr[36280]: -- 172.21.15.16:0/2550543302 <== mon.2 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f5b1a110e0 con 0x55f5b19ef400 2024-09-19T06:40:03.220 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:03 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:03.007+0000 7f201d660040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:40:03.220 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:03 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:03.066+0000 7f201d660040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:40:03.220 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:03 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:03.218+0000 7f201d660040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:40:03.231 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: ignoring --setuser ceph since I am not root 2024-09-19T06:40:03.231 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: ignoring --setgroup ceph since I am not root 2024-09-19T06:40:03.231 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:03.009+0000 7f4d36368040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:40:03.232 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:03.070+0000 7f4d36368040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:40:03.232 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:03.230+0000 7f4d36368040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:40:03.292 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:03.508 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:03 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:03.286+0000 7f201d660040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:40:03.509 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:03 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:03.438+0000 7f201d660040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:40:03.552 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:03.306+0000 7f4d36368040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:40:03.552 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:03.468+0000 7f4d36368040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:40:03.560 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:03.272+0000 7f7eac308040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:40:03.560 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:03.417+0000 7f7eac308040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:40:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.772+0000 7fd9a5050640 1 -- 172.21.15.12:0/2727378910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a0100e20 msgr2=0x7fd9a0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.772+0000 7fd9a5050640 1 --2- 172.21.15.12:0/2727378910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a0100e20 0x7fd9a0101200 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd988009900 tx=0x7fd98802a480 comp rx=0 tx=0).stop 2024-09-19T06:40:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.773+0000 7fd9a5050640 1 -- 172.21.15.12:0/2727378910 shutdown_connections 2024-09-19T06:40:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.773+0000 7fd9a5050640 1 --2- 172.21.15.12:0/2727378910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9a0102ef0 0x7fd9a010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.773+0000 7fd9a5050640 1 --2- 172.21.15.12:0/2727378910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a0102570 0x7fd9a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.773+0000 7fd9a5050640 1 --2- 172.21.15.12:0/2727378910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a0100e20 0x7fd9a0101200 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.773+0000 7fd9a5050640 1 -- 172.21.15.12:0/2727378910 >> 172.21.15.12:0/2727378910 conn(0x7fd9a00fc7d0 msgr2=0x7fd9a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.773+0000 7fd9a5050640 1 -- 172.21.15.12:0/2727378910 shutdown_connections 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.773+0000 7fd9a5050640 1 -- 172.21.15.12:0/2727378910 wait complete. 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd9a5050640 1 Processor -- start 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd9a5050640 1 -- start start 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd9a5050640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a0100e20 0x7fd9a0197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd9a5050640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9a0102570 0x7fd9a01976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd9a5050640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a0102ef0 0x7fd9a0197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd9a5050640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0110f80 con 0x7fd9a0102ef0 2024-09-19T06:40:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd9a5050640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0110e00 con 0x7fd9a0102570 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd9a5050640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0111100 con 0x7fd9a0100e20 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd99f59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a0102ef0 0x7fd9a0197c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd99e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9a0102570 0x7fd9a01976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd99ed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a0100e20 0x7fd9a0197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd99f59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a0102ef0 0x7fd9a0197c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32938/0 (socket says 172.21.15.12:32938) 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.774+0000 7fd99f59e640 1 -- 172.21.15.12:0/851420796 learned_addr learned my addr 172.21.15.12:0/851420796 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd99ed9d640 1 -- 172.21.15.12:0/851420796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9a0102570 msgr2=0x7fd9a01976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd99ed9d640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9a0102570 0x7fd9a01976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd99ed9d640 1 -- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a0102ef0 msgr2=0x7fd9a0197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd99ed9d640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a0102ef0 0x7fd9a0197c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd99ed9d640 1 -- 172.21.15.12:0/851420796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a01a69f0 con 0x7fd9a0100e20 2024-09-19T06:40:03.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd99e59c640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9a0102570 0x7fd9a01976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd99f59e640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a0102ef0 0x7fd9a0197c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd99ed9d640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a0100e20 0x7fd9a0197180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd988005940 tx=0x7fd988003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd997fff640 1 -- 172.21.15.12:0/851420796 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98803f070 con 0x7fd9a0100e20 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd997fff640 1 -- 172.21.15.12:0/851420796 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd988031c30 con 0x7fd9a0100e20 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd9a5050640 1 -- 172.21.15.12:0/851420796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a01a6c80 con 0x7fd9a0100e20 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd997fff640 1 -- 172.21.15.12:0/851420796 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd988035030 con 0x7fd9a0100e20 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.775+0000 7fd9a5050640 1 -- 172.21.15.12:0/851420796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a01a71b0 con 0x7fd9a0100e20 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.777+0000 7fd9a5050640 1 -- 172.21.15.12:0/851420796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a0101200 con 0x7fd9a0100e20 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.778+0000 7fd997fff640 1 -- 172.21.15.12:0/851420796 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7fd988042070 con 0x7fd9a0100e20 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.779+0000 7fd997fff640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd98c0a3310 0x7fd98c0a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.779+0000 7fd99e59c640 1 -- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd98c0a3310 msgr2=0x7fd98c0a57d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4060248487 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.779+0000 7fd997fff640 1 -- 172.21.15.12:0/851420796 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fd9880f0600 con 0x7fd9a0100e20 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.779+0000 7fd99e59c640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd98c0a3310 0x7fd98c0a57d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:40:03.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.782+0000 7fd997fff640 1 -- 172.21.15.12:0/851420796 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd9880bcbd0 con 0x7fd9a0100e20 2024-09-19T06:40:03.810 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:03.621+0000 7f4d36368040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:40:03.832 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:03.558+0000 7f7eac308040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:40:03.852 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:03 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:03.584+0000 7f201d660040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:40:03.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.980+0000 7fd99e59c640 1 -- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd98c0a3310 msgr2=0x7fd98c0a57d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4060248487 2024-09-19T06:40:03.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.980+0000 7fd99e59c640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd98c0a3310 0x7fd98c0a57d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:40:03.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.996+0000 7fd9a5050640 1 -- 172.21.15.12:0/851420796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd9a01090c0 con 0x7fd9a0100e20 2024-09-19T06:40:03.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.997+0000 7fd997fff640 1 -- 172.21.15.12:0/851420796 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fd9880c0ed0 con 0x7fd9a0100e20 2024-09-19T06:40:03.998 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T06:40:04.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 -- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd98c0a3310 msgr2=0x7fd98c0a57d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:40:04.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd98c0a3310 0x7fd98c0a57d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:04.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 -- 172.21.15.12:0/851420796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a0100e20 msgr2=0x7fd9a0197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:04.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a0100e20 0x7fd9a0197180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd988005940 tx=0x7fd988003c10 comp rx=0 tx=0).stop 2024-09-19T06:40:04.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 -- 172.21.15.12:0/851420796 shutdown_connections 2024-09-19T06:40:04.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fd98c0a3310 0x7fd98c0a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:04.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a0102ef0 0x7fd9a0197c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:04.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9a0102570 0x7fd9a01976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:04.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 --2- 172.21.15.12:0/851420796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9a0100e20 0x7fd9a0197180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:04.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 -- 172.21.15.12:0/851420796 >> 172.21.15.12:0/851420796 conn(0x7fd9a00fc7d0 msgr2=0x7fd9a00fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:04.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 -- 172.21.15.12:0/851420796 shutdown_connections 2024-09-19T06:40:04.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:03.999+0000 7fd9a5050640 1 -- 172.21.15.12:0/851420796 wait complete. 2024-09-19T06:40:04.122 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:03 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1802430469' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:40:04.122 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:03 smithi173 ceph-mon[35349]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T06:40:04.122 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:03.872+0000 7f7eac308040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:40:04.123 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:03.933+0000 7f7eac308040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:40:04.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:03 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1802430469' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:40:04.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:03 smithi012 ceph-mon[30937]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T06:40:04.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:03.957+0000 7f4d36368040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:40:04.129 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:04 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:04.024+0000 7f4d36368040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:40:04.167 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:03 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1802430469' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:40:04.167 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:03 smithi016 ceph-mon[34911]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T06:40:04.167 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:03 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:03.909+0000 7f201d660040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:40:04.167 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:03 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:03.971+0000 7f201d660040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:40:04.508 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:04 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:04.165+0000 7f201d660040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:40:04.582 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:04 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:04.121+0000 7f7eac308040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:40:04.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:04 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:04.223+0000 7f4d36368040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:40:04.800 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T06:40:04.800 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:40:04.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-19T06:40:04.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T06:40:04.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-19T06:40:04.800 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T06:40:04.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:40:04.801 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:40:04.801 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-19T06:40:04.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:40:04.801 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-19T06:40:04.818 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:40:04.818 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:40:04.818 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:40:04.818 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:40:04.818 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T06:40:04.819 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42192sec preferred_lft 42192sec 2024-09-19T06:40:04.820 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-19T06:40:04.820 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:40:04.820 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:40:04.820 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-19T06:40:04.820 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-19T06:40:04.821 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:40:04.821 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:40:04.821 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-19T06:40:04.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:40:04.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2024-09-19T06:40:04.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2024-09-19T06:40:04.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:40:04.821 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-19T06:40:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:40:05.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:04 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/851420796' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:40:05.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:40:05.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:40:05.032 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:40:05.061 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-19T06:40:05.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:40:05.063 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-19T06:40:05.135 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-19T06:40:05.136 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:40:05.136 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T06:40:05.136 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T06:40:05.136 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:40:05.137 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:40:05.137 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-19T06:40:05.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T06:40:05.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T06:40:05.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T06:40:05.137 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-19T06:40:05.150 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:04 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/851420796' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:40:05.151 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:05 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:05.079+0000 7f201d660040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:40:05.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:40:05.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:04 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/851420796' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:40:05.333 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:05 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:05.004+0000 7f7eac308040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:40:05.333 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:05 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:05.071+0000 7f7eac308040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:40:05.346 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:05 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:05.176+0000 7f4d36368040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:40:05.346 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:05 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:05.249+0000 7f4d36368040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:40:05.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:40:05.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:40:05.447 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-19T06:40:05.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:40:05.463 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-09-19T06:40:05.509 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:05 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:05.149+0000 7f201d660040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:40:05.525 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:40:05.525 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-19T06:40:05.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-19T06:40:05.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-19T06:40:05.525 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-19T06:40:05.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:40:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:40:05.648 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-19T06:40:05.649 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:40:05.649 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-19T06:40:05.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-19T06:40:05.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:40:05.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-19T06:40:05.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-19T06:40:05.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-19T06:40:05.649 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-19T06:40:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:40:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:40:05.782 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:40:05.782 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-19T06:40:05.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-19T06:40:05.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:40:05.782 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-19T06:40:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:40:05.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:40:05.864 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:40:05.864 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /tmp/cephfs 2024-09-19T06:40:05.884 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-19T06:40:05.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:40:05.885 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /tmp/cephfs 2024-09-19T06:40:05.947 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T06:40:05.947 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T06:40:05.947 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 2024-09-19T06:40:05.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:40:05.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2024-09-19T06:40:06.041 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:05 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:05.780+0000 7f7eac308040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:40:06.041 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:05 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:05.896+0000 7f7eac308040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:40:06.063 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-09-19T06:40:06.063 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-19T06:40:06.156 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:05 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:05.885+0000 7f201d660040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:40:06.157 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.004+0000 7f201d660040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:40:06.200 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-09-19T06:40:06.200 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-19T06:40:06.200 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.16:3300,172.21.15.173:3300" 2024-09-19T06:40:06.200 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@8bf314c8-7650-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 2024-09-19T06:40:06.201 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.12:3300/172.21.15.16:3300/172.21.15.173:3300" will pass to kernel 2024-09-19T06:40:06.203 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T06:40:06.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:40:06.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /tmp/cephfs 2024-09-19T06:40:06.231 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:40:06.319 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:06.032+0000 7f4d36368040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:40:06.319 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:06.160+0000 7f4d36368040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:40:06.323 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.039+0000 7f7eac308040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:40:06.323 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.104+0000 7f7eac308040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:40:06.324 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.254+0000 7f7eac308040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:40:06.324 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.321+0000 7f7eac308040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:40:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:40:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:40:06.331 INFO:teuthology.orchestra.run.smithi012.stdout:client15252 2024-09-19T06:40:06.331 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:40:06.331 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:40:06.349 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:40:06.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:40:06.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:40:06.449 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.155+0000 7f201d660040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:40:06.450 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.220+0000 7f201d660040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:40:06.450 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.375+0000 7f201d660040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:40:06.450 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.446+0000 7f201d660040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:40:06.450 INFO:teuthology.orchestra.run.smithi012.stdout:client15252 2024-09-19T06:40:06.451 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:40:06.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:40:06.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:40:06.509 INFO:teuthology.orchestra.run.smithi012.stdout:client15252 2024-09-19T06:40:06.509 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/8bf314c8-7650-11ef-bceb-c7b262605968.client15252/status') 2024-09-19T06:40:06.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:40:06.568 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:06.316+0000 7f4d36368040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:40:06.568 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:06.382+0000 7f4d36368040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:40:06.568 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:06.545+0000 7f4d36368040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:40:06.570 INFO:teuthology.orchestra.run.smithi012.stdout:instance: client.15252 (3)192.168.0.1:0/765715525 2024-09-19T06:40:06.570 INFO:teuthology.orchestra.run.smithi012.stdout:blocklisted: false 2024-09-19T06:40:06.571 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records in 2024-09-19T06:40:06.571 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records out 2024-09-19T06:40:06.571 INFO:teuthology.orchestra.run.smithi012.stderr:69 bytes copied, 2.5343e-05 s, 2.7 MB/s 2024-09-19T06:40:06.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:40:06.578 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T06:40:06.708 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:40:06.708 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:40:06.709 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T06:40:06.710 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.382+0000 7f7eac308040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:40:06.710 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.540+0000 7f7eac308040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:40:06.741 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.508+0000 7f201d660040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:40:06.741 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.672+0000 7f201d660040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:40:06.741 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.739+0000 7f201d660040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.813+0000 7f493d284640 1 -- 172.21.15.12:0/579188171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4938103710 msgr2=0x7f4938109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.813+0000 7f493d284640 1 --2- 172.21.15.12:0/579188171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4938103710 0x7f4938109fa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4930009ca0 tx=0x7f493002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.813+0000 7f493d284640 1 -- 172.21.15.12:0/579188171 shutdown_connections 2024-09-19T06:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.813+0000 7f493d284640 1 --2- 172.21.15.12:0/579188171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4938103710 0x7f4938109fa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.813+0000 7f493d284640 1 --2- 172.21.15.12:0/579188171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4938102d50 0x7f49381031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.813+0000 7f493d284640 1 --2- 172.21.15.12:0/579188171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4938101b60 0x7f4938101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.813+0000 7f493d284640 1 -- 172.21.15.12:0/579188171 >> 172.21.15.12:0/579188171 conn(0x7f49380fd2e0 msgr2=0x7f49380ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.813+0000 7f493d284640 1 -- 172.21.15.12:0/579188171 shutdown_connections 2024-09-19T06:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.814+0000 7f493d284640 1 -- 172.21.15.12:0/579188171 wait complete. 2024-09-19T06:40:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.814+0000 7f493d284640 1 Processor -- start 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.814+0000 7f493d284640 1 -- start start 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.814+0000 7f493d284640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4938101b60 0x7f4938197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.814+0000 7f493d284640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4938102d50 0x7f4938198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.814+0000 7f493d284640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4938103710 0x7f493819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.814+0000 7f493d284640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f493810d7e0 con 0x7f4938102d50 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.814+0000 7f493d284640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f493810d660 con 0x7f4938103710 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.814+0000 7f493d284640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f493810d960 con 0x7f4938101b60 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f49367fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4938102d50 0x7f4938198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f49377fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4938103710 0x7f493819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f49367fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4938102d50 0x7f4938198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32946/0 (socket says 172.21.15.12:32946) 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f4936ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4938101b60 0x7f4938197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f49367fc640 1 -- 172.21.15.12:0/3730475046 learned_addr learned my addr 172.21.15.12:0/3730475046 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f49367fc640 1 -- 172.21.15.12:0/3730475046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4938101b60 msgr2=0x7f4938197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f49367fc640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4938101b60 0x7f4938197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f49367fc640 1 -- 172.21.15.12:0/3730475046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4938103710 msgr2=0x7f493819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f49367fc640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4938103710 0x7f493819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f49367fc640 1 -- 172.21.15.12:0/3730475046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493819f970 con 0x7f4938102d50 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f49367fc640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4938102d50 0x7f4938198290 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f492c00e9f0 tx=0x7f492c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f491ffff640 1 -- 172.21.15.12:0/3730475046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c00cd80 con 0x7f4938102d50 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f491ffff640 1 -- 172.21.15.12:0/3730475046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f492c010910 con 0x7f4938102d50 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f493d284640 1 -- 172.21.15.12:0/3730475046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493819fc60 con 0x7f4938102d50 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f491ffff640 1 -- 172.21.15.12:0/3730475046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c018990 con 0x7f4938102d50 2024-09-19T06:40:06.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.815+0000 7f493d284640 1 -- 172.21.15.12:0/3730475046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49381a01b0 con 0x7f4938102d50 2024-09-19T06:40:06.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.816+0000 7f493d284640 1 -- 172.21.15.12:0/3730475046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4938108e80 con 0x7f4938102d50 2024-09-19T06:40:06.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.818+0000 7f491ffff640 1 -- 172.21.15.12:0/3730475046 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f492c010ac0 con 0x7f4938102d50 2024-09-19T06:40:06.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.818+0000 7f491ffff640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49200a3340 0x7f49200a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:06.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.818+0000 7f4936ffd640 1 -- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49200a3340 msgr2=0x7f49200a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4060248487 2024-09-19T06:40:06.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.818+0000 7f491ffff640 1 -- 172.21.15.12:0/3730475046 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f492c0cfd60 con 0x7f4938102d50 2024-09-19T06:40:06.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.818+0000 7f4936ffd640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49200a3340 0x7f49200a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:40:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:06.823+0000 7f491ffff640 1 -- 172.21.15.12:0/3730475046 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f492c09c330 con 0x7f4938102d50 2024-09-19T06:40:06.854 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:06.618+0000 7f4d36368040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:40:06.855 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:06.681+0000 7f4d36368040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:40:06.855 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:06.853+0000 7f4d36368040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:40:06.872 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.605+0000 7f7eac308040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:40:06.872 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.671+0000 7f7eac308040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:40:06.872 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.753+0000 7f7eac308040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:40:06.872 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.812+0000 7f7eac308040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:40:06.872 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:06.871+0000 7f7eac308040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:40:07.008 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.809+0000 7f201d660040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:40:07.009 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.894+0000 7f201d660040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:40:07.009 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:06.956+0000 7f201d660040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:40:07.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.019+0000 7f4936ffd640 1 -- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49200a3340 msgr2=0x7f49200a5800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4060248487 2024-09-19T06:40:07.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.019+0000 7f4936ffd640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49200a3340 0x7f49200a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:40:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.038+0000 7f493d284640 1 -- 172.21.15.12:0/3730475046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f4938062e90 con 0x7f4938102d50 2024-09-19T06:40:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.090+0000 7f491ffff640 1 -- 172.21.15.12:0/3730475046 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f492c0a0630 con 0x7f4938102d50 2024-09-19T06:40:07.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 -- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49200a3340 msgr2=0x7f49200a5800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:40:07.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49200a3340 0x7f49200a5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 -- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4938102d50 msgr2=0x7f4938198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4938102d50 0x7f4938198290 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f492c00e9f0 tx=0x7f492c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 -- 172.21.15.12:0/3730475046 shutdown_connections 2024-09-19T06:40:07.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f49200a3340 0x7f49200a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4938103710 0x7f493819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4938102d50 0x7f4938198290 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 --2- 172.21.15.12:0/3730475046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4938101b60 0x7f4938197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 -- 172.21.15.12:0/3730475046 >> 172.21.15.12:0/3730475046 conn(0x7f49380fd2e0 msgr2=0x7f4938106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:07.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 -- 172.21.15.12:0/3730475046 shutdown_connections 2024-09-19T06:40:07.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.093+0000 7f493d284640 1 -- 172.21.15.12:0/3730475046 wait complete. 2024-09-19T06:40:07.104 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:07 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3730475046' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:40:07.105 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:06.923+0000 7f4d36368040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:40:07.105 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:06.993+0000 7f4d36368040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:40:07.105 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:07 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:07.082+0000 7f4d36368040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:40:07.106 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T06:40:07.116 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T06:40:07.126 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:40:07.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.230+0000 7f9621518640 1 -- 172.21.15.12:0/1202247947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c101c00 msgr2=0x7f961c102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.230+0000 7f9621518640 1 --2- 172.21.15.12:0/1202247947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c101c00 0x7f961c102080 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9604009900 tx=0x7f960402a410 comp rx=0 tx=0).stop 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.230+0000 7f9621518640 1 -- 172.21.15.12:0/1202247947 shutdown_connections 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.230+0000 7f9621518640 1 --2- 172.21.15.12:0/1202247947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f961c1025c0 0x7f961c108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.230+0000 7f9621518640 1 --2- 172.21.15.12:0/1202247947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c101c00 0x7f961c102080 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.230+0000 7f9621518640 1 --2- 172.21.15.12:0/1202247947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f961c100a10 0x7f961c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.230+0000 7f9621518640 1 -- 172.21.15.12:0/1202247947 >> 172.21.15.12:0/1202247947 conn(0x7f961c0fc170 msgr2=0x7f961c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.230+0000 7f9621518640 1 -- 172.21.15.12:0/1202247947 shutdown_connections 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.230+0000 7f9621518640 1 -- 172.21.15.12:0/1202247947 wait complete. 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f9621518640 1 Processor -- start 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f9621518640 1 -- start start 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f9621518640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c100a10 0x7f961c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f9621518640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f961c101c00 0x7f961c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f9621518640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f961c1025c0 0x7f961c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f9621518640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f961c10c690 con 0x7f961c100a10 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f9621518640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f961c10c510 con 0x7f961c1025c0 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f9621518640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f961c10c810 con 0x7f961c101c00 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f961affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c100a10 0x7f961c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f961affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c100a10 0x7f961c197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32970/0 (socket says 172.21.15.12:32970) 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f9613fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f961c101c00 0x7f961c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f961affd640 1 -- 172.21.15.12:0/133176151 learned_addr learned my addr 172.21.15.12:0/133176151 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.231+0000 7f961b7fe640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f961c1025c0 0x7f961c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f961b7fe640 1 -- 172.21.15.12:0/133176151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f961c101c00 msgr2=0x7f961c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f961b7fe640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f961c101c00 0x7f961c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f961b7fe640 1 -- 172.21.15.12:0/133176151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c100a10 msgr2=0x7f961c197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f961b7fe640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c100a10 0x7f961c197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f961b7fe640 1 -- 172.21.15.12:0/133176151 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c19fa80 con 0x7f961c1025c0 2024-09-19T06:40:07.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f9613fff640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f961c101c00 0x7f961c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:07.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f961affd640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c100a10 0x7f961c197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:07.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f961b7fe640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f961c1025c0 0x7f961c19f410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9614009fd0 tx=0x7f961400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:07.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f9618ff9640 1 -- 172.21.15.12:0/133176151 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961400ce20 con 0x7f961c1025c0 2024-09-19T06:40:07.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f9621518640 1 -- 172.21.15.12:0/133176151 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961c19fd70 con 0x7f961c1025c0 2024-09-19T06:40:07.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f9618ff9640 1 -- 172.21.15.12:0/133176151 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9614005020 con 0x7f961c1025c0 2024-09-19T06:40:07.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f9618ff9640 1 -- 172.21.15.12:0/133176151 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614010720 con 0x7f961c1025c0 2024-09-19T06:40:07.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.232+0000 7f9621518640 1 -- 172.21.15.12:0/133176151 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961c1a0230 con 0x7f961c1025c0 2024-09-19T06:40:07.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.233+0000 7f9621518640 1 -- 172.21.15.12:0/133176151 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961c1a04c0 con 0x7f961c1025c0 2024-09-19T06:40:07.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.235+0000 7f9618ff9640 1 -- 172.21.15.12:0/133176151 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f9614005540 con 0x7f961c1025c0 2024-09-19T06:40:07.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.235+0000 7f9618ff9640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f96080a32a0 0x7f96080a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.235+0000 7f961affd640 1 -- 172.21.15.12:0/133176151 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f96080a32a0 msgr2=0x7f96080a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4060248487 2024-09-19T06:40:07.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.235+0000 7f9618ff9640 1 -- 172.21.15.12:0/133176151 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f96140d0340 con 0x7f961c1025c0 2024-09-19T06:40:07.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.235+0000 7f961affd640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f96080a32a0 0x7f96080a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:40:07.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.239+0000 7f9618ff9640 1 -- 172.21.15.12:0/133176151 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f961409cfc0 con 0x7f961c1025c0 2024-09-19T06:40:07.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:07 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3730475046' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:40:07.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:07 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:07.148+0000 7f4d36368040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:40:07.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:07 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:07.213+0000 7f4d36368040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:40:07.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.417+0000 7f9621518640 1 -- 172.21.15.12:0/133176151 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f961c1a0730 con 0x7f961c1025c0 2024-09-19T06:40:07.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.419+0000 7f9618ff9640 1 -- 172.21.15.12:0/133176151 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22920 (secure 0 0 0) 0x7f961409c8c0 con 0x7f961c1025c0 2024-09-19T06:40:07.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:07.421 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:39:23.693200+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":1}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:40:07.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 -- 172.21.15.12:0/133176151 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f96080a32a0 msgr2=0x7f96080a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:40:07.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f96080a32a0 0x7f96080a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 -- 172.21.15.12:0/133176151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f961c1025c0 msgr2=0x7f961c19f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f961c1025c0 0x7f961c19f410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9614009fd0 tx=0x7f961400ef10 comp rx=0 tx=0).stop 2024-09-19T06:40:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 -- 172.21.15.12:0/133176151 shutdown_connections 2024-09-19T06:40:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f96080a32a0 0x7f96080a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f961c1025c0 0x7f961c19f410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f961c101c00 0x7f961c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 --2- 172.21.15.12:0/133176151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f961c100a10 0x7f961c197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 -- 172.21.15.12:0/133176151 >> 172.21.15.12:0/133176151 conn(0x7f961c0fc170 msgr2=0x7f961c0693b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 -- 172.21.15.12:0/133176151 shutdown_connections 2024-09-19T06:40:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.421+0000 7f9621518640 1 -- 172.21.15.12:0/133176151 wait complete. 2024-09-19T06:40:07.434 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:33:40.130755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:38:10.971934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:38:13.015596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:40:07.434 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:40:07.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:07 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3730475046' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:40:07.509 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:07 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:07.017+0000 7f201d660040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:40:07.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.540+0000 7fbe159bd640 1 -- 172.21.15.12:0/2682795881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe10101b20 msgr2=0x7fbe10101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.540+0000 7fbe159bd640 1 --2- 172.21.15.12:0/2682795881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe10101b20 0x7fbe10101f20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009900 tx=0x7fbe0002a410 comp rx=0 tx=0).stop 2024-09-19T06:40:07.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.540+0000 7fbe159bd640 1 -- 172.21.15.12:0/2682795881 shutdown_connections 2024-09-19T06:40:07.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.540+0000 7fbe159bd640 1 --2- 172.21.15.12:0/2682795881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe101036d0 0x7fbe10109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.540+0000 7fbe159bd640 1 --2- 172.21.15.12:0/2682795881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe10102d10 0x7fbe10103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.540+0000 7fbe159bd640 1 --2- 172.21.15.12:0/2682795881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe10101b20 0x7fbe10101f20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.540+0000 7fbe159bd640 1 -- 172.21.15.12:0/2682795881 >> 172.21.15.12:0/2682795881 conn(0x7fbe100fd2a0 msgr2=0x7fbe100ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.540+0000 7fbe159bd640 1 -- 172.21.15.12:0/2682795881 shutdown_connections 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.540+0000 7fbe159bd640 1 -- 172.21.15.12:0/2682795881 wait complete. 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe159bd640 1 Processor -- start 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe159bd640 1 -- start start 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe159bd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe10101b20 0x7fbe10197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe159bd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe10102d10 0x7fbe101983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe159bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe101036d0 0x7fbe1019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe159bd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1010d7d0 con 0x7fbe101036d0 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe159bd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1010d650 con 0x7fbe10102d10 2024-09-19T06:40:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe159bd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1010d950 con 0x7fbe10101b20 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe101036d0 0x7fbe1019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe0effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe10101b20 0x7fbe10197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe101036d0 0x7fbe1019f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32980/0 (socket says 172.21.15.12:32980) 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe07fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe10102d10 0x7fbe101983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.541+0000 7fbe0f7fe640 1 -- 172.21.15.12:0/2151070911 learned_addr learned my addr 172.21.15.12:0/2151070911 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe0f7fe640 1 -- 172.21.15.12:0/2151070911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe10101b20 msgr2=0x7fbe10197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe0f7fe640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe10101b20 0x7fbe10197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe0f7fe640 1 -- 172.21.15.12:0/2151070911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe10102d10 msgr2=0x7fbe101983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe0f7fe640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe10102d10 0x7fbe101983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe0f7fe640 1 -- 172.21.15.12:0/2151070911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1019faa0 con 0x7fbe101036d0 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe0effd640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe10101b20 0x7fbe10197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe0f7fe640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe101036d0 0x7fbe1019f430 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009fd0 tx=0x7fbe0800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe149bb640 1 -- 172.21.15.12:0/2151070911 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08017070 con 0x7fbe101036d0 2024-09-19T06:40:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe149bb640 1 -- 172.21.15.12:0/2151070911 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe08003e50 con 0x7fbe101036d0 2024-09-19T06:40:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe159bd640 1 -- 172.21.15.12:0/2151070911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1019fd90 con 0x7fbe101036d0 2024-09-19T06:40:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe149bb640 1 -- 172.21.15.12:0/2151070911 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe080106c0 con 0x7fbe101036d0 2024-09-19T06:40:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.542+0000 7fbe159bd640 1 -- 172.21.15.12:0/2151070911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe101a0280 con 0x7fbe101036d0 2024-09-19T06:40:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.543+0000 7fbe159bd640 1 -- 172.21.15.12:0/2151070911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe10108f60 con 0x7fbe101036d0 2024-09-19T06:40:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.545+0000 7fbe149bb640 1 -- 172.21.15.12:0/2151070911 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7fbe08003970 con 0x7fbe101036d0 2024-09-19T06:40:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.546+0000 7fbe149bb640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbdfc0a3320 0x7fbdfc0a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.546+0000 7fbe0effd640 1 -- 172.21.15.12:0/2151070911 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbdfc0a3320 msgr2=0x7fbdfc0a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4060248487 2024-09-19T06:40:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.547+0000 7fbe149bb640 1 -- 172.21.15.12:0/2151070911 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7fbe080cf6d0 con 0x7fbe101036d0 2024-09-19T06:40:07.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.547+0000 7fbe0effd640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbdfc0a3320 0x7fbdfc0a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:40:07.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.551+0000 7fbe149bb640 1 -- 172.21.15.12:0/2151070911 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe0809bca0 con 0x7fbe101036d0 2024-09-19T06:40:07.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.725+0000 7fbe159bd640 1 -- 172.21.15.12:0/2151070911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbe10062e90 con 0x7fbe101036d0 2024-09-19T06:40:07.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.725+0000 7fbe149bb640 1 -- 172.21.15.12:0/2151070911 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7fbe0809ffa0 con 0x7fbe101036d0 2024-09-19T06:40:07.727 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-19T06:40:07.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.727+0000 7fbe159bd640 1 -- 172.21.15.12:0/2151070911 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbdfc0a3320 msgr2=0x7fbdfc0a57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:40:07.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.727+0000 7fbe159bd640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbdfc0a3320 0x7fbdfc0a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.727+0000 7fbe159bd640 1 -- 172.21.15.12:0/2151070911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe101036d0 msgr2=0x7fbe1019f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.727+0000 7fbe159bd640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe101036d0 0x7fbe1019f430 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009fd0 tx=0x7fbe0800b260 comp rx=0 tx=0).stop 2024-09-19T06:40:07.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.727+0000 7fbe159bd640 1 -- 172.21.15.12:0/2151070911 shutdown_connections 2024-09-19T06:40:07.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.727+0000 7fbe159bd640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7fbdfc0a3320 0x7fbdfc0a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.727+0000 7fbe159bd640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe101036d0 0x7fbe1019f430 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.727+0000 7fbe159bd640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe10102d10 0x7fbe101983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.727+0000 7fbe159bd640 1 --2- 172.21.15.12:0/2151070911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe10101b20 0x7fbe10197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.728+0000 7fbe159bd640 1 -- 172.21.15.12:0/2151070911 >> 172.21.15.12:0/2151070911 conn(0x7fbe100fd2a0 msgr2=0x7fbe10106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:07.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.728+0000 7fbe159bd640 1 -- 172.21.15.12:0/2151070911 shutdown_connections 2024-09-19T06:40:07.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.728+0000 7fbe159bd640 1 -- 172.21.15.12:0/2151070911 wait complete. 2024-09-19T06:40:07.740 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:40:07.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.849+0000 7f10acaae640 1 -- 172.21.15.12:0/130928242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a8102d20 msgr2=0x7f10a81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.849+0000 7f10acaae640 1 --2- 172.21.15.12:0/130928242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a8102d20 0x7f10a81031a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f109c009900 tx=0x7f109c02a410 comp rx=0 tx=0).stop 2024-09-19T06:40:07.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.849+0000 7f10acaae640 1 -- 172.21.15.12:0/130928242 shutdown_connections 2024-09-19T06:40:07.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.849+0000 7f10acaae640 1 --2- 172.21.15.12:0/130928242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a81036e0 0x7f10a8109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.849+0000 7f10acaae640 1 --2- 172.21.15.12:0/130928242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a8102d20 0x7f10a81031a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.849+0000 7f10acaae640 1 --2- 172.21.15.12:0/130928242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a8101b30 0x7f10a8101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.849+0000 7f10acaae640 1 -- 172.21.15.12:0/130928242 >> 172.21.15.12:0/130928242 conn(0x7f10a80fd2b0 msgr2=0x7f10a80ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:07.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.849+0000 7f10acaae640 1 -- 172.21.15.12:0/130928242 shutdown_connections 2024-09-19T06:40:07.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.849+0000 7f10acaae640 1 -- 172.21.15.12:0/130928242 wait complete. 2024-09-19T06:40:07.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10acaae640 1 Processor -- start 2024-09-19T06:40:07.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10acaae640 1 -- start start 2024-09-19T06:40:07.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10acaae640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a8101b30 0x7f10a8075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10acaae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a8102d20 0x7f10a80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10acaae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a81036e0 0x7f10a8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10acaae640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f10a810d790 con 0x7f10a8102d20 2024-09-19T06:40:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10acaae640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10a810d610 con 0x7f10a8101b30 2024-09-19T06:40:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10acaae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10a810d910 con 0x7f10a81036e0 2024-09-19T06:40:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10a5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a8102d20 0x7f10a80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10a659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a8101b30 0x7f10a8075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10a5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a8102d20 0x7f10a80745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32996/0 (socket says 172.21.15.12:32996) 2024-09-19T06:40:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10a5d9b640 1 -- 172.21.15.12:0/4181595942 learned_addr learned my addr 172.21.15.12:0/4181595942 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.850+0000 7f10a6d9d640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a81036e0 0x7f10a8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10a659c640 1 -- 172.21.15.12:0/4181595942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a81036e0 msgr2=0x7f10a8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10a659c640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a81036e0 0x7f10a8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10a659c640 1 -- 172.21.15.12:0/4181595942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a8102d20 msgr2=0x7f10a80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:07.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10a659c640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a8102d20 0x7f10a80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:07.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10a659c640 1 -- 172.21.15.12:0/4181595942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a80753b0 con 0x7f10a8101b30 2024-09-19T06:40:07.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10a5d9b640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a8102d20 0x7f10a80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:07.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10a659c640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a8101b30 0x7f10a8075fa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f109800d6a0 tx=0x7f109800db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10977fe640 1 -- 172.21.15.12:0/4181595942 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098017070 con 0x7f10a8101b30 2024-09-19T06:40:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10977fe640 1 -- 172.21.15.12:0/4181595942 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1098009d00 con 0x7f10a8101b30 2024-09-19T06:40:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10acaae640 1 -- 172.21.15.12:0/4181595942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a81a1f90 con 0x7f10a8101b30 2024-09-19T06:40:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10977fe640 1 -- 172.21.15.12:0/4181595942 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098003c60 con 0x7f10a8101b30 2024-09-19T06:40:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.851+0000 7f10acaae640 1 -- 172.21.15.12:0/4181595942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a81a2390 con 0x7f10a8101b30 2024-09-19T06:40:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.852+0000 7f10acaae640 1 -- 172.21.15.12:0/4181595942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a8109010 con 0x7f10a8101b30 2024-09-19T06:40:07.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.853+0000 7f10977fe640 1 -- 172.21.15.12:0/4181595942 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 19) ==== 138372+0+0 (secure 0 0 0) 0x7f1098009820 con 0x7f10a8101b30 2024-09-19T06:40:07.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.854+0000 7f10977fe640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10900a32a0 0x7f10900a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:07.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.854+0000 7f10a5d9b640 1 -- 172.21.15.12:0/4181595942 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10900a32a0 msgr2=0x7f10900a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4060248487 2024-09-19T06:40:07.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.854+0000 7f10977fe640 1 -- 172.21.15.12:0/4181595942 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8385+0+0 (secure 0 0 0) 0x7f10980cf350 con 0x7f10a8101b30 2024-09-19T06:40:07.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.854+0000 7f10a5d9b640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10900a32a0 0x7f10900a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:40:07.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:07.857+0000 7f10977fe640 1 -- 172.21.15.12:0/4181595942 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f109809b920 con 0x7f10a8101b30 2024-09-19T06:40:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.035+0000 7f10acaae640 1 -- 172.21.15.12:0/4181595942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f10a8062e90 con 0x7f10a8101b30 2024-09-19T06:40:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.035+0000 7f10977fe640 1 -- 172.21.15.12:0/4181595942 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7f109809fc20 con 0x7f10a8101b30 2024-09-19T06:40:08.037 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-09-19T06:40:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.037+0000 7f10acaae640 1 -- 172.21.15.12:0/4181595942 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10900a32a0 msgr2=0x7f10900a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:40:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.037+0000 7f10acaae640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10900a32a0 0x7f10900a5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.038+0000 7f10acaae640 1 -- 172.21.15.12:0/4181595942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a8101b30 msgr2=0x7f10a8075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.038+0000 7f10acaae640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a8101b30 0x7f10a8075fa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f109800d6a0 tx=0x7f109800db60 comp rx=0 tx=0).stop 2024-09-19T06:40:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.038+0000 7f10acaae640 1 -- 172.21.15.12:0/4181595942 shutdown_connections 2024-09-19T06:40:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.038+0000 7f10acaae640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.12:6800/4060248487,v1:172.21.15.12:6801/4060248487] conn(0x7f10900a32a0 0x7f10900a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.038+0000 7f10acaae640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a81036e0 0x7f10a8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.038+0000 7f10acaae640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a8102d20 0x7f10a80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.038+0000 7f10acaae640 1 --2- 172.21.15.12:0/4181595942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a8101b30 0x7f10a8075fa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.038+0000 7f10acaae640 1 -- 172.21.15.12:0/4181595942 >> 172.21.15.12:0/4181595942 conn(0x7f10a80fd2b0 msgr2=0x7f10a81061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:08.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.038+0000 7f10acaae640 1 -- 172.21.15.12:0/4181595942 shutdown_connections 2024-09-19T06:40:08.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.038+0000 7f10acaae640 1 -- 172.21.15.12:0/4181595942 wait complete. 2024-09-19T06:40:08.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:40:08.082 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:40:07 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z[37162]: 2024-09-19T06:40:07.667+0000 7f7eac308040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:40:08.099 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:40:07 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y[36276]: 2024-09-19T06:40:07.844+0000 7f201d660040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:40:08.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.173+0000 7f307b6f1640 1 -- 172.21.15.12:0/1419832941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3074101bf0 msgr2=0x7f3074102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:08.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.173+0000 7f307b6f1640 1 --2- 172.21.15.12:0/1419832941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3074101bf0 0x7f3074102070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3064009900 tx=0x7f306402a410 comp rx=0 tx=0).stop 2024-09-19T06:40:08.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.173+0000 7f307b6f1640 1 -- 172.21.15.12:0/1419832941 shutdown_connections 2024-09-19T06:40:08.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.173+0000 7f307b6f1640 1 --2- 172.21.15.12:0/1419832941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30741025b0 0x7f3074108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.173+0000 7f307b6f1640 1 --2- 172.21.15.12:0/1419832941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3074101bf0 0x7f3074102070 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.174+0000 7f307b6f1640 1 --2- 172.21.15.12:0/1419832941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3074100a00 0x7f3074100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.174+0000 7f307b6f1640 1 -- 172.21.15.12:0/1419832941 >> 172.21.15.12:0/1419832941 conn(0x7f30740fc140 msgr2=0x7f30740fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:08.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.174+0000 7f307b6f1640 1 -- 172.21.15.12:0/1419832941 shutdown_connections 2024-09-19T06:40:08.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.174+0000 7f307b6f1640 1 -- 172.21.15.12:0/1419832941 wait complete. 2024-09-19T06:40:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307b6f1640 1 Processor -- start 2024-09-19T06:40:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307b6f1640 1 -- start start 2024-09-19T06:40:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307b6f1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3074100a00 0x7f3074069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307b6f1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3074101bf0 0x7f307419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307948d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3074100a00 0x7f3074069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307948d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3074100a00 0x7f3074069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:35350/0 (socket says 172.21.15.12:35350) 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307b6f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30741025b0 0x7f30741a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307948d640 1 -- 172.21.15.12:0/3249887454 learned_addr learned my addr 172.21.15.12:0/3249887454 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f307410c6d0 con 0x7f30741025b0 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f307410c550 con 0x7f3074101bf0 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f307410c850 con 0x7f3074100a00 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f3078c8c640 1 --2- 172.21.15.12:0/3249887454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3074101bf0 0x7f307419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.175+0000 7f3079c8e640 1 --2- 172.21.15.12:0/3249887454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30741025b0 0x7f30741a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.176+0000 7f307948d640 1 -- 172.21.15.12:0/3249887454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3074101bf0 msgr2=0x7f307419edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.176+0000 7f307948d640 1 --2- 172.21.15.12:0/3249887454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3074101bf0 0x7f307419edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.176+0000 7f307948d640 1 -- 172.21.15.12:0/3249887454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30741025b0 msgr2=0x7f30741a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.176+0000 7f307948d640 1 --2- 172.21.15.12:0/3249887454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30741025b0 0x7f30741a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.176+0000 7f307948d640 1 -- 172.21.15.12:0/3249887454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30741a1af0 con 0x7f3074100a00 2024-09-19T06:40:08.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.176+0000 7f3079c8e640 1 --2- 172.21.15.12:0/3249887454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30741025b0 0x7f30741a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:08.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.176+0000 7f307948d640 1 --2- 172.21.15.12:0/3249887454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3074100a00 0x7f3074069f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f307000d950 tx=0x7f307000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:08.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.176+0000 7f306a7fc640 1 -- 172.21.15.12:0/3249887454 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070017070 con 0x7f3074100a00 2024-09-19T06:40:08.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.176+0000 7f306a7fc640 1 -- 172.21.15.12:0/3249887454 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3070009c30 con 0x7f3074100a00 2024-09-19T06:40:08.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.176+0000 7f306a7fc640 1 -- 172.21.15.12:0/3249887454 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307000f600 con 0x7f3074100a00 2024-09-19T06:40:08.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.177+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30741a1de0 con 0x7f3074100a00 2024-09-19T06:40:08.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.177+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30741a2190 con 0x7f3074100a00 2024-09-19T06:40:08.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.179+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3074107d20 con 0x7f3074100a00 2024-09-19T06:40:08.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.180+0000 7f306a7fc640 1 -- 172.21.15.12:0/3249887454 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 20) ==== 138040+0+0 (secure 0 0 0) 0x7f307001a070 con 0x7f3074100a00 2024-09-19T06:40:08.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.181+0000 7f306a7fc640 1 -- 172.21.15.12:0/3249887454 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f30700cef10 con 0x7f3074100a00 2024-09-19T06:40:08.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.185+0000 7f306a7fc640 1 -- 172.21.15.12:0/3249887454 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3070009de0 con 0x7f3074100a00 2024-09-19T06:40:08.347 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3730475046' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T06:40:08.347 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:40:08.347 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/133176151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:40:08.347 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: Standby manager daemon z restarted 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: Standby manager daemon z started 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2151070911' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: Standby manager daemon y restarted 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: Standby manager daemon y started 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:40:08.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/4181595942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: Active manager daemon x restarted 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: Activating manager daemon x 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: mgrmap e20: x(active, starting, since 0.0138739s), standbys: y, z 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:40:08.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:40:08.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:40:08.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:40:08.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:40:08.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:40:08.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:40:08.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:40:08.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:40:08.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:40:08.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:40:08.351 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:40:08.352 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.067+0000 7f4d36368040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:40:08.434 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3730475046' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T06:40:08.434 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:40:08.434 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/133176151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:40:08.434 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: Standby manager daemon z restarted 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: Standby manager daemon z started 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2151070911' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: Standby manager daemon y restarted 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: Standby manager daemon y started 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:40:08.435 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/4181595942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: Active manager daemon x restarted 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: Activating manager daemon x 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: mgrmap e20: x(active, starting, since 0.0138739s), standbys: y, z 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:40:08.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:40:08.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:40:08.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:40:08.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:40:08.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:40:08.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:40:08.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:40:08.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:40:08.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:40:08.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:40:08.438 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:08 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:40:08.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.507+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3074063040 con 0x7f3074100a00 2024-09-19T06:40:08.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.508+0000 7f306a7fc640 1 -- 172.21.15.12:0/3249887454 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7f307009be90 con 0x7f3074100a00 2024-09-19T06:40:08.509 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3730475046' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/133176151' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: Standby manager daemon z restarted 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: Standby manager daemon z started 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.173:0/647502814' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2151070911' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:40:08.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: Standby manager daemon y restarted 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: Standby manager daemon y started 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.? 172.21.15.16:0/4131845984' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/4181595942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: Active manager daemon x restarted 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: Activating manager daemon x 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: mgrmap e20: x(active, starting, since 0.0138739s), standbys: y, z 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:40:08.511 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:40:08.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:40:08.513 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:40:08.514 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:08 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:40:08.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.510+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3074100a00 msgr2=0x7f3074069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:08.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.510+0000 7f307b6f1640 1 --2- 172.21.15.12:0/3249887454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3074100a00 0x7f3074069f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f307000d950 tx=0x7f307000de10 comp rx=0 tx=0).stop 2024-09-19T06:40:08.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.510+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 shutdown_connections 2024-09-19T06:40:08.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.510+0000 7f307b6f1640 1 --2- 172.21.15.12:0/3249887454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30741025b0 0x7f30741a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.510+0000 7f307b6f1640 1 --2- 172.21.15.12:0/3249887454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3074101bf0 0x7f307419edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.510+0000 7f307b6f1640 1 --2- 172.21.15.12:0/3249887454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3074100a00 0x7f3074069f30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:08.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.510+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 >> 172.21.15.12:0/3249887454 conn(0x7f30740fc140 msgr2=0x7f3074104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:08.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.510+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 shutdown_connections 2024-09-19T06:40:08.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:08.510+0000 7f307b6f1640 1 -- 172.21.15.12:0/3249887454 wait complete. 2024-09-19T06:40:08.522 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T06:40:08.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:40:08.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.345+0000 7f4ca04bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:40:08.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.345+0000 7f4ca04bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:40:08.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.345+0000 7f4ca04bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:40:08.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.345+0000 7f4ca04bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:40:08.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.345+0000 7f4ca04bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:40:08.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.347+0000 7f4c9dc7a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:40:08.629 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.347+0000 7f4c9dc7a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:40:08.630 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.347+0000 7f4c9dc7a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:40:08.630 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.347+0000 7f4c9dc7a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:40:08.630 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:08.347+0000 7f4c9dc7a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:40:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:09.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:09 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:40:09.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:09 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:40:09.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:09 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:40:09.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:09 smithi012 ceph-mon[30937]: Manager daemon x is now available 2024-09-19T06:40:09.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:09 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:09.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:09 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:40:09.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:09 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:40:09.210 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:09 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3249887454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:40:09.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.293+0000 7f1048d6f640 1 -- 172.21.15.12:0/3141659945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044101df0 msgr2=0x7f10441021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:09.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.293+0000 7f1048d6f640 1 --2- 172.21.15.12:0/3141659945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044101df0 0x7f10441021d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1034009900 tx=0x7f103402a410 comp rx=0 tx=0).stop 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.293+0000 7f1048d6f640 1 -- 172.21.15.12:0/3141659945 shutdown_connections 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.293+0000 7f1048d6f640 1 --2- 172.21.15.12:0/3141659945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1044106f20 0x7f104410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.293+0000 7f1048d6f640 1 --2- 172.21.15.12:0/3141659945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10441027a0 0x7f10441067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.293+0000 7f1048d6f640 1 --2- 172.21.15.12:0/3141659945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1044101df0 0x7f10441021d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.293+0000 7f1048d6f640 1 -- 172.21.15.12:0/3141659945 >> 172.21.15.12:0/3141659945 conn(0x7f10440fd8f0 msgr2=0x7f10440ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.293+0000 7f1048d6f640 1 -- 172.21.15.12:0/3141659945 shutdown_connections 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.293+0000 7f1048d6f640 1 -- 172.21.15.12:0/3141659945 wait complete. 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.293+0000 7f1048d6f640 1 Processor -- start 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1048d6f640 1 -- start start 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1048d6f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1044101df0 0x7f10441984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1048d6f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10441027a0 0x7f1044198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1048d6f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1044106f20 0x7f104419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1048d6f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1044111f80 con 0x7f10441027a0 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1048d6f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1044111e00 con 0x7f1044101df0 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1048d6f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1044112100 con 0x7f1044106f20 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1039d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10441027a0 0x7f1044198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1039d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10441027a0 0x7f1044198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33116/0 (socket says 172.21.15.12:33116) 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1039d9b640 1 -- 172.21.15.12:0/3559017841 learned_addr learned my addr 172.21.15.12:0/3559017841 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1042d9d640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1044106f20 0x7f104419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f104259c640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1044101df0 0x7f10441984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1042d9d640 1 -- 172.21.15.12:0/3559017841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1044101df0 msgr2=0x7f10441984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1042d9d640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1044101df0 0x7f10441984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1042d9d640 1 -- 172.21.15.12:0/3559017841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10441027a0 msgr2=0x7f1044198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1042d9d640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10441027a0 0x7f1044198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.294+0000 7f1042d9d640 1 -- 172.21.15.12:0/3559017841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104419d470 con 0x7f1044106f20 2024-09-19T06:40:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.295+0000 7f1042d9d640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1044106f20 0x7f104419cd90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f103c009fd0 tx=0x7f103c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.295+0000 7f103bfff640 1 -- 172.21.15.12:0/3559017841 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c00ce20 con 0x7f1044106f20 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.295+0000 7f1048d6f640 1 -- 172.21.15.12:0/3559017841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104419d760 con 0x7f1044106f20 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.295+0000 7f103bfff640 1 -- 172.21.15.12:0/3559017841 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f103c005020 con 0x7f1044106f20 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.295+0000 7f103bfff640 1 -- 172.21.15.12:0/3559017841 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c010720 con 0x7f1044106f20 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.295+0000 7f1048d6f640 1 -- 172.21.15.12:0/3559017841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10441a5040 con 0x7f1044106f20 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.296+0000 7f1048d6f640 1 -- 172.21.15.12:0/3559017841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10441021d0 con 0x7f1044106f20 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.297+0000 7f103bfff640 1 -- 172.21.15.12:0/3559017841 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f103c005540 con 0x7f1044106f20 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.298+0000 7f103bfff640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10300a3030 0x7f10300a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.298+0000 7f104259c640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10300a3030 0x7f10300a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.298+0000 7f103bfff640 1 -- 172.21.15.12:0/3559017841 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f103c0cfcf0 con 0x7f1044106f20 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.299+0000 7f104259c640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10300a3030 0x7f10300a54f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1034009230 tx=0x7f10340058d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.305+0000 7f103bfff640 1 -- 172.21.15.12:0/3559017841 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f103c09cb20 con 0x7f1044106f20 2024-09-19T06:40:09.422 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:09 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:40:09.422 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:09 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:40:09.422 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:09 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:40:09.422 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:09 smithi173 ceph-mon[35349]: Manager daemon x is now available 2024-09-19T06:40:09.422 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:09 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:09.422 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:09 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:40:09.422 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:09 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:40:09.422 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:09 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3249887454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:40:09.482 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:09 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:40:09.482 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:09 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:40:09.482 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:09 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:40:09.482 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:09 smithi016 ceph-mon[34911]: Manager daemon x is now available 2024-09-19T06:40:09.482 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:09 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:09.482 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:09 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:40:09.482 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:09 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:40:09.482 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:09 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3249887454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:40:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.540+0000 7f1048d6f640 1 -- 172.21.15.12:0/3559017841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f104410a160 con 0x7f1044106f20 2024-09-19T06:40:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.541+0000 7f103bfff640 1 -- 172.21.15.12:0/3559017841 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7f103c09c420 con 0x7f1044106f20 2024-09-19T06:40:09.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:09.542 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-19T06:40:07:090225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:40:07.040062+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:40:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-19T06:40:09.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 -- 172.21.15.12:0/3559017841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10300a3030 msgr2=0x7f10300a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:09.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10300a3030 0x7f10300a54f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1034009230 tx=0x7f10340058d0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 -- 172.21.15.12:0/3559017841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1044106f20 msgr2=0x7f104419cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:09.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1044106f20 0x7f104419cd90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f103c009fd0 tx=0x7f103c00ef10 comp rx=0 tx=0).stop 2024-09-19T06:40:09.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 -- 172.21.15.12:0/3559017841 shutdown_connections 2024-09-19T06:40:09.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10300a3030 0x7f10300a54f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1044106f20 0x7f104419cd90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10441027a0 0x7f1044198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 --2- 172.21.15.12:0/3559017841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1044101df0 0x7f10441984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 -- 172.21.15.12:0/3559017841 >> 172.21.15.12:0/3559017841 conn(0x7f10440fd8f0 msgr2=0x7f10440feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 -- 172.21.15.12:0/3559017841 shutdown_connections 2024-09-19T06:40:09.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:09.543+0000 7f1048d6f640 1 -- 172.21.15.12:0/3559017841 wait complete. 2024-09-19T06:40:10.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-mon[30937]: mgrmap e21: x(active, since 1.08835s), standbys: y, z 2024-09-19T06:40:10.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3559017841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:10.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-mon[30937]: [19/Sep/2024:06:40:09] ENGINE Bus STARTING 2024-09-19T06:40:10.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:10.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:10.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:10.025+0000 7f4c89b93640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:40:10] ENGINE Error in HTTPServer.serve 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: Traceback (most recent call last): 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self._connections.run(self.expiration_interval) 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self._run(expiration_interval) 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: s = self.context.wrap_socket( 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:40:10.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: return self.sslsocket_class._create( 2024-09-19T06:40:10.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:40:10.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self.do_handshake() 2024-09-19T06:40:10.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:40:10.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: self._sslobj.do_handshake() 2024-09-19T06:40:10.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:40:10.381 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:40:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:40:10.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:10 smithi016 ceph-mon[34911]: mgrmap e21: x(active, since 1.08835s), standbys: y, z 2024-09-19T06:40:10.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:10 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3559017841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:10.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:10 smithi016 ceph-mon[34911]: [19/Sep/2024:06:40:09] ENGINE Bus STARTING 2024-09-19T06:40:10.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:10 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:10.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:10 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:10.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:10 smithi173 ceph-mon[35349]: mgrmap e21: x(active, since 1.08835s), standbys: y, z 2024-09-19T06:40:10.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:10 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3559017841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:10.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:10 smithi173 ceph-mon[35349]: [19/Sep/2024:06:40:09] ENGINE Bus STARTING 2024-09-19T06:40:10.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:10 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:10.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:10 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:10.846 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T06:40:10.847 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T06:40:10.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:40:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.961+0000 7f79e0e17640 1 -- 172.21.15.12:0/442658674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79dc1025e0 msgr2=0x7f79dc108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.961+0000 7f79e0e17640 1 --2- 172.21.15.12:0/442658674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79dc1025e0 0x7f79dc108e70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009ca0 tx=0x7f79d402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.961+0000 7f79e0e17640 1 -- 172.21.15.12:0/442658674 shutdown_connections 2024-09-19T06:40:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.961+0000 7f79e0e17640 1 --2- 172.21.15.12:0/442658674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79dc1025e0 0x7f79dc108e70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.961+0000 7f79e0e17640 1 --2- 172.21.15.12:0/442658674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79dc101c20 0x7f79dc1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.961+0000 7f79e0e17640 1 --2- 172.21.15.12:0/442658674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc100a30 0x7f79dc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.961+0000 7f79e0e17640 1 -- 172.21.15.12:0/442658674 >> 172.21.15.12:0/442658674 conn(0x7f79dc0fc1b0 msgr2=0x7f79dc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.961+0000 7f79e0e17640 1 -- 172.21.15.12:0/442658674 shutdown_connections 2024-09-19T06:40:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.961+0000 7f79e0e17640 1 -- 172.21.15.12:0/442658674 wait complete. 2024-09-19T06:40:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79e0e17640 1 Processor -- start 2024-09-19T06:40:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79e0e17640 1 -- start start 2024-09-19T06:40:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79e0e17640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79dc100a30 0x7f79dc197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79e0e17640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79dc101c20 0x7f79dc198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79e0e17640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc1025e0 0x7f79dc19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79e0e17640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc10c690 con 0x7f79dc100a30 2024-09-19T06:40:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79e0e17640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc10c510 con 0x7f79dc1025e0 2024-09-19T06:40:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79e0e17640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc10c810 con 0x7f79dc101c20 2024-09-19T06:40:10.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79da59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79dc100a30 0x7f79dc197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79da59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79dc100a30 0x7f79dc197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36784/0 (socket says 172.21.15.12:36784) 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.962+0000 7f79da59c640 1 -- 172.21.15.12:0/1432179597 learned_addr learned my addr 172.21.15.12:0/1432179597 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79d9d9b640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79dc101c20 0x7f79dc198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79dad9d640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc1025e0 0x7f79dc19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79da59c640 1 -- 172.21.15.12:0/1432179597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79dc101c20 msgr2=0x7f79dc198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79da59c640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79dc101c20 0x7f79dc198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79da59c640 1 -- 172.21.15.12:0/1432179597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc1025e0 msgr2=0x7f79dc19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79da59c640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc1025e0 0x7f79dc19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79da59c640 1 -- 172.21.15.12:0/1432179597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79dc19fa00 con 0x7f79dc100a30 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79dad9d640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc1025e0 0x7f79dc19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79da59c640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79dc100a30 0x7f79dc197de0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e9c0 tx=0x7f79cc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:10.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1432179597 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00cd80 con 0x7f79dc100a30 2024-09-19T06:40:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79e0e17640 1 -- 172.21.15.12:0/1432179597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79dc19fcf0 con 0x7f79dc100a30 2024-09-19T06:40:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1432179597 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79cc0035f0 con 0x7f79dc100a30 2024-09-19T06:40:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79e0e17640 1 -- 172.21.15.12:0/1432179597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79dc1a01d0 con 0x7f79dc100a30 2024-09-19T06:40:10.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.963+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1432179597 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc010690 con 0x7f79dc100a30 2024-09-19T06:40:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.965+0000 7f79e0e17640 1 -- 172.21.15.12:0/1432179597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79bc0052c0 con 0x7f79dc100a30 2024-09-19T06:40:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.966+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1432179597 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f79cc0037a0 con 0x7f79dc100a30 2024-09-19T06:40:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.967+0000 7f79cb7fe640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79c40a3050 0x7f79c40a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.967+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1432179597 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f79cc0cfb90 con 0x7f79dc100a30 2024-09-19T06:40:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.967+0000 7f79d9d9b640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79c40a3050 0x7f79c40a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.967+0000 7f79d9d9b640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79c40a3050 0x7f79c40a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79dc1992f0 tx=0x7f79d0005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:10.970+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1432179597 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79cc09ca90 con 0x7f79dc100a30 2024-09-19T06:40:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.084+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1432179597 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7f79cc098a00 con 0x7f79dc100a30 2024-09-19T06:40:11.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.202+0000 7f79e0e17640 1 -- 172.21.15.12:0/1432179597 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79bc000bf0 con 0x7f79c40a3050 2024-09-19T06:40:11.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.209+0000 7f79cb7fe640 1 -- 172.21.15.12:0/1432179597 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257795 (secure 0 0 0) 0x7f79bc000bf0 con 0x7f79c40a3050 2024-09-19T06:40:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:11.214 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-19T06:40:11.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.211+0000 7f79e0e17640 1 -- 172.21.15.12:0/1432179597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79c40a3050 msgr2=0x7f79c40a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.211+0000 7f79e0e17640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79c40a3050 0x7f79c40a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79dc1992f0 tx=0x7f79d0005f90 comp rx=0 tx=0).stop 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.212+0000 7f79e0e17640 1 -- 172.21.15.12:0/1432179597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79dc100a30 msgr2=0x7f79dc197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.212+0000 7f79e0e17640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79dc100a30 0x7f79dc197de0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e9c0 tx=0x7f79cc00ee80 comp rx=0 tx=0).stop 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.212+0000 7f79e0e17640 1 -- 172.21.15.12:0/1432179597 shutdown_connections 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.212+0000 7f79e0e17640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc1025e0 0x7f79dc19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.212+0000 7f79e0e17640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79c40a3050 0x7f79c40a5510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.212+0000 7f79e0e17640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79dc101c20 0x7f79dc198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.212+0000 7f79e0e17640 1 --2- 172.21.15.12:0/1432179597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79dc100a30 0x7f79dc197de0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.212+0000 7f79e0e17640 1 -- 172.21.15.12:0/1432179597 >> 172.21.15.12:0/1432179597 conn(0x7f79dc0fc1b0 msgr2=0x7f79dc0fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.212+0000 7f79e0e17640 1 -- 172.21.15.12:0/1432179597 shutdown_connections 2024-09-19T06:40:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.212+0000 7f79e0e17640 1 -- 172.21.15.12:0/1432179597 wait complete. 2024-09-19T06:40:11.227 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T06:40:10.089803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190856,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1319,"num_read_kb":827,"num_write":559,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183000,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":942,"ondisk_log_size":942,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385072,"kb_used_data":14928,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124556752,"statfs":{"total":1151940427776,"available":1151546114048,"internally_reserved":0,"allocated":15286272,"data_stored":9061234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.927734"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193904+0000","last_change":"2024-09-19T06:38:14.052943+0000","last_active":"2024-09-19T06:40:08.193904+0000","last_peered":"2024-09-19T06:40:08.193904+0000","last_clean":"2024-09-19T06:40:08.193904+0000","last_became_active":"2024-09-19T06:38:14.052054+0000","last_became_peered":"2024-09-19T06:38:14.052054+0000","last_unstale":"2024-09-19T06:40:08.193904+0000","last_undegraded":"2024-09-19T06:40:08.193904+0000","last_fullsized":"2024-09-19T06:40:08.193904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:28.898131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274838+0000","last_change":"2024-09-19T06:38:14.044916+0000","last_active":"2024-09-19T06:40:08.274838+0000","last_peered":"2024-09-19T06:40:08.274838+0000","last_clean":"2024-09-19T06:40:08.274838+0000","last_became_active":"2024-09-19T06:38:14.044596+0000","last_became_peered":"2024-09-19T06:38:14.044596+0000","last_unstale":"2024-09-19T06:40:08.274838+0000","last_undegraded":"2024-09-19T06:40:08.274838+0000","last_fullsized":"2024-09-19T06:40:08.274838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:04.402332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274196+0000","last_change":"2024-09-19T06:38:14.052765+0000","last_active":"2024-09-19T06:40:08.274196+0000","last_peered":"2024-09-19T06:40:08.274196+0000","last_clean":"2024-09-19T06:40:08.274196+0000","last_became_active":"2024-09-19T06:38:14.052219+0000","last_became_peered":"2024-09-19T06:38:14.052219+0000","last_unstale":"2024-09-19T06:40:08.274196+0000","last_undegraded":"2024-09-19T06:40:08.274196+0000","last_fullsized":"2024-09-19T06:40:08.274196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:13.317252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274176+0000","last_change":"2024-09-19T06:38:14.052421+0000","last_active":"2024-09-19T06:40:08.274176+0000","last_peered":"2024-09-19T06:40:08.274176+0000","last_clean":"2024-09-19T06:40:08.274176+0000","last_became_active":"2024-09-19T06:38:14.052094+0000","last_became_peered":"2024-09-19T06:38:14.052094+0000","last_unstale":"2024-09-19T06:40:08.274176+0000","last_undegraded":"2024-09-19T06:40:08.274176+0000","last_fullsized":"2024-09-19T06:40:08.274176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185134+0000","last_change":"2024-09-19T06:38:14.047736+0000","last_active":"2024-09-19T06:40:08.185134+0000","last_peered":"2024-09-19T06:40:08.185134+0000","last_clean":"2024-09-19T06:40:08.185134+0000","last_became_active":"2024-09-19T06:38:14.047396+0000","last_became_peered":"2024-09-19T06:38:14.047396+0000","last_unstale":"2024-09-19T06:40:08.185134+0000","last_undegraded":"2024-09-19T06:40:08.185134+0000","last_fullsized":"2024-09-19T06:40:08.185134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.855638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196543+0000","last_change":"2024-09-19T06:38:14.047793+0000","last_active":"2024-09-19T06:40:08.196543+0000","last_peered":"2024-09-19T06:40:08.196543+0000","last_clean":"2024-09-19T06:40:08.196543+0000","last_became_active":"2024-09-19T06:38:14.047198+0000","last_became_peered":"2024-09-19T06:38:14.047198+0000","last_unstale":"2024-09-19T06:40:08.196543+0000","last_undegraded":"2024-09-19T06:40:08.196543+0000","last_fullsized":"2024-09-19T06:40:08.196543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:42.507270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076273+0000","last_change":"2024-09-19T06:38:14.050025+0000","last_active":"2024-09-19T06:40:08.076273+0000","last_peered":"2024-09-19T06:40:08.076273+0000","last_clean":"2024-09-19T06:40:08.076273+0000","last_became_active":"2024-09-19T06:38:14.049591+0000","last_became_peered":"2024-09-19T06:38:14.049591+0000","last_unstale":"2024-09-19T06:40:08.076273+0000","last_undegraded":"2024-09-19T06:40:08.076273+0000","last_fullsized":"2024-09-19T06:40:08.076273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:49.487521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181942+0000","last_change":"2024-09-19T06:38:23.065490+0000","last_active":"2024-09-19T06:40:08.181942+0000","last_peered":"2024-09-19T06:40:08.181942+0000","last_clean":"2024-09-19T06:40:08.181942+0000","last_became_active":"2024-09-19T06:38:23.065151+0000","last_became_peered":"2024-09-19T06:38:23.065151+0000","last_unstale":"2024-09-19T06:40:08.181942+0000","last_undegraded":"2024-09-19T06:40:08.181942+0000","last_fullsized":"2024-09-19T06:40:08.181942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:42.184698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273928+0000","last_change":"2024-09-19T06:38:14.047395+0000","last_active":"2024-09-19T06:40:08.273928+0000","last_peered":"2024-09-19T06:40:08.273928+0000","last_clean":"2024-09-19T06:40:08.273928+0000","last_became_active":"2024-09-19T06:38:14.046975+0000","last_became_peered":"2024-09-19T06:38:14.046975+0000","last_unstale":"2024-09-19T06:40:08.273928+0000","last_undegraded":"2024-09-19T06:40:08.273928+0000","last_fullsized":"2024-09-19T06:40:08.273928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:18.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196936+0000","last_change":"2024-09-19T06:38:14.055042+0000","last_active":"2024-09-19T06:40:08.196936+0000","last_peered":"2024-09-19T06:40:08.196936+0000","last_clean":"2024-09-19T06:40:08.196936+0000","last_became_active":"2024-09-19T06:38:14.054664+0000","last_became_peered":"2024-09-19T06:38:14.054664+0000","last_unstale":"2024-09-19T06:40:08.196936+0000","last_undegraded":"2024-09-19T06:40:08.196936+0000","last_fullsized":"2024-09-19T06:40:08.196936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.815277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076591+0000","last_change":"2024-09-19T06:38:14.055106+0000","last_active":"2024-09-19T06:40:08.076591+0000","last_peered":"2024-09-19T06:40:08.076591+0000","last_clean":"2024-09-19T06:40:08.076591+0000","last_became_active":"2024-09-19T06:38:14.054721+0000","last_became_peered":"2024-09-19T06:38:14.054721+0000","last_unstale":"2024-09-19T06:40:08.076591+0000","last_undegraded":"2024-09-19T06:40:08.076591+0000","last_fullsized":"2024-09-19T06:40:08.076591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:39.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274235+0000","last_change":"2024-09-19T06:38:14.051796+0000","last_active":"2024-09-19T06:40:08.274235+0000","last_peered":"2024-09-19T06:40:08.274235+0000","last_clean":"2024-09-19T06:40:08.274235+0000","last_became_active":"2024-09-19T06:38:14.048338+0000","last_became_peered":"2024-09-19T06:38:14.048338+0000","last_unstale":"2024-09-19T06:40:08.274235+0000","last_undegraded":"2024-09-19T06:40:08.274235+0000","last_fullsized":"2024-09-19T06:40:08.274235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:48.656819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276087+0000","last_change":"2024-09-19T06:38:14.048607+0000","last_active":"2024-09-19T06:40:08.276087+0000","last_peered":"2024-09-19T06:40:08.276087+0000","last_clean":"2024-09-19T06:40:08.276087+0000","last_became_active":"2024-09-19T06:38:14.047277+0000","last_became_peered":"2024-09-19T06:38:14.047277+0000","last_unstale":"2024-09-19T06:40:08.276087+0000","last_undegraded":"2024-09-19T06:40:08.276087+0000","last_fullsized":"2024-09-19T06:40:08.276087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:52.904376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273963+0000","last_change":"2024-09-19T06:38:14.050759+0000","last_active":"2024-09-19T06:40:08.273963+0000","last_peered":"2024-09-19T06:40:08.273963+0000","last_clean":"2024-09-19T06:40:08.273963+0000","last_became_active":"2024-09-19T06:38:14.049900+0000","last_became_peered":"2024-09-19T06:38:14.049900+0000","last_unstale":"2024-09-19T06:40:08.273963+0000","last_undegraded":"2024-09-19T06:40:08.273963+0000","last_fullsized":"2024-09-19T06:40:08.273963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:45.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273772+0000","last_change":"2024-09-19T06:38:14.058890+0000","last_active":"2024-09-19T06:40:08.273772+0000","last_peered":"2024-09-19T06:40:08.273772+0000","last_clean":"2024-09-19T06:40:08.273772+0000","last_became_active":"2024-09-19T06:38:14.058442+0000","last_became_peered":"2024-09-19T06:38:14.058442+0000","last_unstale":"2024-09-19T06:40:08.273772+0000","last_undegraded":"2024-09-19T06:40:08.273772+0000","last_fullsized":"2024-09-19T06:40:08.273772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:27.296578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273218+0000","last_change":"2024-09-19T06:38:14.050371+0000","last_active":"2024-09-19T06:40:08.273218+0000","last_peered":"2024-09-19T06:40:08.273218+0000","last_clean":"2024-09-19T06:40:08.273218+0000","last_became_active":"2024-09-19T06:38:14.049930+0000","last_became_peered":"2024-09-19T06:38:14.049930+0000","last_unstale":"2024-09-19T06:40:08.273218+0000","last_undegraded":"2024-09-19T06:40:08.273218+0000","last_fullsized":"2024-09-19T06:40:08.273218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:37.898624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193944+0000","last_change":"2024-09-19T06:38:14.052521+0000","last_active":"2024-09-19T06:40:08.193944+0000","last_peered":"2024-09-19T06:40:08.193944+0000","last_clean":"2024-09-19T06:40:08.193944+0000","last_became_active":"2024-09-19T06:38:14.052083+0000","last_became_peered":"2024-09-19T06:38:14.052083+0000","last_unstale":"2024-09-19T06:40:08.193944+0000","last_undegraded":"2024-09-19T06:40:08.193944+0000","last_fullsized":"2024-09-19T06:40:08.193944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:10.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182686+0000","last_change":"2024-09-19T06:38:14.044747+0000","last_active":"2024-09-19T06:40:08.182686+0000","last_peered":"2024-09-19T06:40:08.182686+0000","last_clean":"2024-09-19T06:40:08.182686+0000","last_became_active":"2024-09-19T06:38:14.044451+0000","last_became_peered":"2024-09-19T06:38:14.044451+0000","last_unstale":"2024-09-19T06:40:08.182686+0000","last_undegraded":"2024-09-19T06:40:08.182686+0000","last_fullsized":"2024-09-19T06:40:08.182686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:04.067156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076928+0000","last_change":"2024-09-19T06:38:14.056101+0000","last_active":"2024-09-19T06:40:08.076928+0000","last_peered":"2024-09-19T06:40:08.076928+0000","last_clean":"2024-09-19T06:40:08.076928+0000","last_became_active":"2024-09-19T06:38:14.055682+0000","last_became_peered":"2024-09-19T06:38:14.055682+0000","last_unstale":"2024-09-19T06:40:08.076928+0000","last_undegraded":"2024-09-19T06:40:08.076928+0000","last_fullsized":"2024-09-19T06:40:08.076928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:23.921766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193625+0000","last_change":"2024-09-19T06:38:14.059441+0000","last_active":"2024-09-19T06:40:08.193625+0000","last_peered":"2024-09-19T06:40:08.193625+0000","last_clean":"2024-09-19T06:40:08.193625+0000","last_became_active":"2024-09-19T06:38:14.059123+0000","last_became_peered":"2024-09-19T06:38:14.059123+0000","last_unstale":"2024-09-19T06:40:08.193625+0000","last_undegraded":"2024-09-19T06:40:08.193625+0000","last_fullsized":"2024-09-19T06:40:08.193625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:32.148741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276233+0000","last_change":"2024-09-19T06:38:14.050336+0000","last_active":"2024-09-19T06:40:08.276233+0000","last_peered":"2024-09-19T06:40:08.276233+0000","last_clean":"2024-09-19T06:40:08.276233+0000","last_became_active":"2024-09-19T06:38:14.050041+0000","last_became_peered":"2024-09-19T06:38:14.050041+0000","last_unstale":"2024-09-19T06:40:08.276233+0000","last_undegraded":"2024-09-19T06:40:08.276233+0000","last_fullsized":"2024-09-19T06:40:08.276233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:09.245804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273366+0000","last_change":"2024-09-19T06:38:14.050280+0000","last_active":"2024-09-19T06:40:08.273366+0000","last_peered":"2024-09-19T06:40:08.273366+0000","last_clean":"2024-09-19T06:40:08.273366+0000","last_became_active":"2024-09-19T06:38:14.049874+0000","last_became_peered":"2024-09-19T06:38:14.049874+0000","last_unstale":"2024-09-19T06:40:08.273366+0000","last_undegraded":"2024-09-19T06:40:08.273366+0000","last_fullsized":"2024-09-19T06:40:08.273366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:52.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075355+0000","last_change":"2024-09-19T06:38:14.048294+0000","last_active":"2024-09-19T06:40:08.075355+0000","last_peered":"2024-09-19T06:40:08.075355+0000","last_clean":"2024-09-19T06:40:08.075355+0000","last_became_active":"2024-09-19T06:38:14.048002+0000","last_became_peered":"2024-09-19T06:38:14.048002+0000","last_unstale":"2024-09-19T06:40:08.075355+0000","last_undegraded":"2024-09-19T06:40:08.075355+0000","last_fullsized":"2024-09-19T06:40:08.075355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:55.920027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257610+0000","last_change":"2024-09-19T06:38:14.050244+0000","last_active":"2024-09-19T06:40:08.257610+0000","last_peered":"2024-09-19T06:40:08.257610+0000","last_clean":"2024-09-19T06:40:08.257610+0000","last_became_active":"2024-09-19T06:38:14.049499+0000","last_became_peered":"2024-09-19T06:38:14.049499+0000","last_unstale":"2024-09-19T06:40:08.257610+0000","last_undegraded":"2024-09-19T06:40:08.257610+0000","last_fullsized":"2024-09-19T06:40:08.257610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:35.506647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076492+0000","last_change":"2024-09-19T06:38:14.048779+0000","last_active":"2024-09-19T06:40:08.076492+0000","last_peered":"2024-09-19T06:40:08.076492+0000","last_clean":"2024-09-19T06:40:08.076492+0000","last_became_active":"2024-09-19T06:38:14.048492+0000","last_became_peered":"2024-09-19T06:38:14.048492+0000","last_unstale":"2024-09-19T06:40:08.076492+0000","last_undegraded":"2024-09-19T06:40:08.076492+0000","last_fullsized":"2024-09-19T06:40:08.076492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:01.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076981+0000","last_change":"2024-09-19T06:38:14.054442+0000","last_active":"2024-09-19T06:40:08.076981+0000","last_peered":"2024-09-19T06:40:08.076981+0000","last_clean":"2024-09-19T06:40:08.076981+0000","last_became_active":"2024-09-19T06:38:14.053903+0000","last_became_peered":"2024-09-19T06:38:14.053903+0000","last_unstale":"2024-09-19T06:40:08.076981+0000","last_undegraded":"2024-09-19T06:40:08.076981+0000","last_fullsized":"2024-09-19T06:40:08.076981+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:42.002146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193936+0000","last_change":"2024-09-19T06:38:14.051139+0000","last_active":"2024-09-19T06:40:08.193936+0000","last_peered":"2024-09-19T06:40:08.193936+0000","last_clean":"2024-09-19T06:40:08.193936+0000","last_became_active":"2024-09-19T06:38:14.050764+0000","last_became_peered":"2024-09-19T06:38:14.050764+0000","last_unstale":"2024-09-19T06:40:08.193936+0000","last_undegraded":"2024-09-19T06:40:08.193936+0000","last_fullsized":"2024-09-19T06:40:08.193936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.379184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275728+0000","last_change":"2024-09-19T06:38:14.054614+0000","last_active":"2024-09-19T06:40:08.275728+0000","last_peered":"2024-09-19T06:40:08.275728+0000","last_clean":"2024-09-19T06:40:08.275728+0000","last_became_active":"2024-09-19T06:38:14.054280+0000","last_became_peered":"2024-09-19T06:38:14.054280+0000","last_unstale":"2024-09-19T06:40:08.275728+0000","last_undegraded":"2024-09-19T06:40:08.275728+0000","last_fullsized":"2024-09-19T06:40:08.275728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:21.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274136+0000","last_change":"2024-09-19T06:38:14.056215+0000","last_active":"2024-09-19T06:40:08.274136+0000","last_peered":"2024-09-19T06:40:08.274136+0000","last_clean":"2024-09-19T06:40:08.274136+0000","last_became_active":"2024-09-19T06:38:14.055875+0000","last_became_peered":"2024-09-19T06:38:14.055875+0000","last_unstale":"2024-09-19T06:40:08.274136+0000","last_undegraded":"2024-09-19T06:40:08.274136+0000","last_fullsized":"2024-09-19T06:40:08.274136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:45.347185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076524+0000","last_change":"2024-09-19T06:38:14.057963+0000","last_active":"2024-09-19T06:40:08.076524+0000","last_peered":"2024-09-19T06:40:08.076524+0000","last_clean":"2024-09-19T06:40:08.076524+0000","last_became_active":"2024-09-19T06:38:14.057578+0000","last_became_peered":"2024-09-19T06:38:14.057578+0000","last_unstale":"2024-09-19T06:40:08.076524+0000","last_undegraded":"2024-09-19T06:40:08.076524+0000","last_fullsized":"2024-09-19T06:40:08.076524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:26.173414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076544+0000","last_change":"2024-09-19T06:38:14.058840+0000","last_active":"2024-09-19T06:40:08.076544+0000","last_peered":"2024-09-19T06:40:08.076544+0000","last_clean":"2024-09-19T06:40:08.076544+0000","last_became_active":"2024-09-19T06:38:14.058418+0000","last_became_peered":"2024-09-19T06:38:14.058418+0000","last_unstale":"2024-09-19T06:40:08.076544+0000","last_undegraded":"2024-09-19T06:40:08.076544+0000","last_fullsized":"2024-09-19T06:40:08.076544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:13.624750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193600+0000","last_change":"2024-09-19T06:38:14.053363+0000","last_active":"2024-09-19T06:40:08.193600+0000","last_peered":"2024-09-19T06:40:08.193600+0000","last_clean":"2024-09-19T06:40:08.193600+0000","last_became_active":"2024-09-19T06:38:14.053039+0000","last_became_peered":"2024-09-19T06:38:14.053039+0000","last_unstale":"2024-09-19T06:40:08.193600+0000","last_undegraded":"2024-09-19T06:40:08.193600+0000","last_fullsized":"2024-09-19T06:40:08.193600+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.274885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185012+0000","last_change":"2024-09-19T06:38:14.045719+0000","last_active":"2024-09-19T06:40:08.185012+0000","last_peered":"2024-09-19T06:40:08.185012+0000","last_clean":"2024-09-19T06:40:08.185012+0000","last_became_active":"2024-09-19T06:38:14.045285+0000","last_became_peered":"2024-09-19T06:38:14.045285+0000","last_unstale":"2024-09-19T06:40:08.185012+0000","last_undegraded":"2024-09-19T06:40:08.185012+0000","last_fullsized":"2024-09-19T06:40:08.185012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:16.877802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":150,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257864+0000","last_change":"2024-09-19T06:38:23.177942+0000","last_active":"2024-09-19T06:40:08.257864+0000","last_peered":"2024-09-19T06:40:08.257864+0000","last_clean":"2024-09-19T06:40:08.257864+0000","last_became_active":"2024-09-19T06:38:23.176579+0000","last_became_peered":"2024-09-19T06:38:23.176579+0000","last_unstale":"2024-09-19T06:40:08.257864+0000","last_undegraded":"2024-09-19T06:40:08.257864+0000","last_fullsized":"2024-09-19T06:40:08.257864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:28.140245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257665+0000","last_change":"2024-09-19T06:38:23.811603+0000","last_active":"2024-09-19T06:40:08.257665+0000","last_peered":"2024-09-19T06:40:08.257665+0000","last_clean":"2024-09-19T06:40:08.257665+0000","last_became_active":"2024-09-19T06:38:23.811139+0000","last_became_peered":"2024-09-19T06:38:23.811139+0000","last_unstale":"2024-09-19T06:40:08.257665+0000","last_undegraded":"2024-09-19T06:40:08.257665+0000","last_fullsized":"2024-09-19T06:40:08.257665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:42.082355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196626+0000","last_change":"2024-09-19T06:38:12.041330+0000","last_active":"2024-09-19T06:40:08.196626+0000","last_peered":"2024-09-19T06:40:08.196626+0000","last_clean":"2024-09-19T06:40:08.196626+0000","last_became_active":"2024-09-19T06:38:12.040992+0000","last_became_peered":"2024-09-19T06:38:12.040992+0000","last_unstale":"2024-09-19T06:40:08.196626+0000","last_undegraded":"2024-09-19T06:40:08.196626+0000","last_fullsized":"2024-09-19T06:40:08.196626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:51.721009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275224+0000","last_change":"2024-09-19T06:38:12.034534+0000","last_active":"2024-09-19T06:40:08.275224+0000","last_peered":"2024-09-19T06:40:08.275224+0000","last_clean":"2024-09-19T06:40:08.275224+0000","last_became_active":"2024-09-19T06:38:12.034209+0000","last_became_peered":"2024-09-19T06:38:12.034209+0000","last_unstale":"2024-09-19T06:40:08.275224+0000","last_undegraded":"2024-09-19T06:40:08.275224+0000","last_fullsized":"2024-09-19T06:40:08.275224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:40.640464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075337+0000","last_change":"2024-09-19T06:38:14.043287+0000","last_active":"2024-09-19T06:40:08.075337+0000","last_peered":"2024-09-19T06:40:08.075337+0000","last_clean":"2024-09-19T06:40:08.075337+0000","last_became_active":"2024-09-19T06:38:14.042565+0000","last_became_peered":"2024-09-19T06:38:14.042565+0000","last_unstale":"2024-09-19T06:40:08.075337+0000","last_undegraded":"2024-09-19T06:40:08.075337+0000","last_fullsized":"2024-09-19T06:40:08.075337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:32.689929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257848+0000","last_change":"2024-09-19T06:38:12.039142+0000","last_active":"2024-09-19T06:40:08.257848+0000","last_peered":"2024-09-19T06:40:08.257848+0000","last_clean":"2024-09-19T06:40:08.257848+0000","last_became_active":"2024-09-19T06:38:12.038815+0000","last_became_peered":"2024-09-19T06:38:12.038815+0000","last_unstale":"2024-09-19T06:40:08.257848+0000","last_undegraded":"2024-09-19T06:40:08.257848+0000","last_fullsized":"2024-09-19T06:40:08.257848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:03.316742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182141+0000","last_change":"2024-09-19T06:38:14.044778+0000","last_active":"2024-09-19T06:40:08.182141+0000","last_peered":"2024-09-19T06:40:08.182141+0000","last_clean":"2024-09-19T06:40:08.182141+0000","last_became_active":"2024-09-19T06:38:14.044457+0000","last_became_peered":"2024-09-19T06:38:14.044457+0000","last_unstale":"2024-09-19T06:40:08.182141+0000","last_undegraded":"2024-09-19T06:40:08.182141+0000","last_fullsized":"2024-09-19T06:40:08.182141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:06.342070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":243,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.802495+0000","last_change":"2024-09-19T06:38:12.039031+0000","last_active":"2024-09-19T06:40:08.802495+0000","last_peered":"2024-09-19T06:40:08.802495+0000","last_clean":"2024-09-19T06:40:08.802495+0000","last_became_active":"2024-09-19T06:38:12.038346+0000","last_became_peered":"2024-09-19T06:38:12.038346+0000","last_unstale":"2024-09-19T06:40:08.802495+0000","last_undegraded":"2024-09-19T06:40:08.802495+0000","last_fullsized":"2024-09-19T06:40:08.802495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:33.752330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273694+0000","last_change":"2024-09-19T06:38:14.045159+0000","last_active":"2024-09-19T06:40:08.273694+0000","last_peered":"2024-09-19T06:40:08.273694+0000","last_clean":"2024-09-19T06:40:08.273694+0000","last_became_active":"2024-09-19T06:38:14.044822+0000","last_became_peered":"2024-09-19T06:38:14.044822+0000","last_unstale":"2024-09-19T06:40:08.273694+0000","last_undegraded":"2024-09-19T06:40:08.273694+0000","last_fullsized":"2024-09-19T06:40:08.273694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:05.143507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076765+0000","last_change":"2024-09-19T06:38:12.037820+0000","last_active":"2024-09-19T06:40:08.076765+0000","last_peered":"2024-09-19T06:40:08.076765+0000","last_clean":"2024-09-19T06:40:08.076765+0000","last_became_active":"2024-09-19T06:38:12.037417+0000","last_became_peered":"2024-09-19T06:38:12.037417+0000","last_unstale":"2024-09-19T06:40:08.076765+0000","last_undegraded":"2024-09-19T06:40:08.076765+0000","last_fullsized":"2024-09-19T06:40:08.076765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:22.516704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274674+0000","last_change":"2024-09-19T06:38:14.048633+0000","last_active":"2024-09-19T06:40:08.274674+0000","last_peered":"2024-09-19T06:40:08.274674+0000","last_clean":"2024-09-19T06:40:08.274674+0000","last_became_active":"2024-09-19T06:38:14.048257+0000","last_became_peered":"2024-09-19T06:38:14.048257+0000","last_unstale":"2024-09-19T06:40:08.274674+0000","last_undegraded":"2024-09-19T06:40:08.274674+0000","last_fullsized":"2024-09-19T06:40:08.274674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:16.509071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257784+0000","last_change":"2024-09-19T06:38:12.047175+0000","last_active":"2024-09-19T06:40:08.257784+0000","last_peered":"2024-09-19T06:40:08.257784+0000","last_clean":"2024-09-19T06:40:08.257784+0000","last_became_active":"2024-09-19T06:38:12.046781+0000","last_became_peered":"2024-09-19T06:38:12.046781+0000","last_unstale":"2024-09-19T06:40:08.257784+0000","last_undegraded":"2024-09-19T06:40:08.257784+0000","last_fullsized":"2024-09-19T06:40:08.257784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:38.774803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273461+0000","last_change":"2024-09-19T06:38:23.067812+0000","last_active":"2024-09-19T06:40:08.273461+0000","last_peered":"2024-09-19T06:40:08.273461+0000","last_clean":"2024-09-19T06:40:08.273461+0000","last_became_active":"2024-09-19T06:38:23.067357+0000","last_became_peered":"2024-09-19T06:38:23.067357+0000","last_unstale":"2024-09-19T06:40:08.273461+0000","last_undegraded":"2024-09-19T06:40:08.273461+0000","last_fullsized":"2024-09-19T06:40:08.273461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:34.719243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'35","reported_seq":299,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.802563+0000","last_change":"2024-09-19T06:38:23.186703+0000","last_active":"2024-09-19T06:40:08.802563+0000","last_peered":"2024-09-19T06:40:08.802563+0000","last_clean":"2024-09-19T06:40:08.802563+0000","last_became_active":"2024-09-19T06:38:23.177212+0000","last_became_peered":"2024-09-19T06:38:23.177212+0000","last_unstale":"2024-09-19T06:40:08.802563+0000","last_undegraded":"2024-09-19T06:40:08.802563+0000","last_fullsized":"2024-09-19T06:40:08.802563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:46.884624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65927,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":174,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185343+0000","last_change":"2024-09-19T06:38:14.054619+0000","last_active":"2024-09-19T06:40:08.185343+0000","last_peered":"2024-09-19T06:40:08.185343+0000","last_clean":"2024-09-19T06:40:08.185343+0000","last_became_active":"2024-09-19T06:38:14.054118+0000","last_became_peered":"2024-09-19T06:38:14.054118+0000","last_unstale":"2024-09-19T06:40:08.185343+0000","last_undegraded":"2024-09-19T06:40:08.185343+0000","last_fullsized":"2024-09-19T06:40:08.185343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:41.041603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076764+0000","last_change":"2024-09-19T06:38:12.040272+0000","last_active":"2024-09-19T06:40:08.076764+0000","last_peered":"2024-09-19T06:40:08.076764+0000","last_clean":"2024-09-19T06:40:08.076764+0000","last_became_active":"2024-09-19T06:38:12.039940+0000","last_became_peered":"2024-09-19T06:38:12.039940+0000","last_unstale":"2024-09-19T06:40:08.076764+0000","last_undegraded":"2024-09-19T06:40:08.076764+0000","last_fullsized":"2024-09-19T06:40:08.076764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:53.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275371+0000","last_change":"2024-09-19T06:38:14.049535+0000","last_active":"2024-09-19T06:40:08.275371+0000","last_peered":"2024-09-19T06:40:08.275371+0000","last_clean":"2024-09-19T06:40:08.275371+0000","last_became_active":"2024-09-19T06:38:14.049208+0000","last_became_peered":"2024-09-19T06:38:14.049208+0000","last_unstale":"2024-09-19T06:40:08.275371+0000","last_undegraded":"2024-09-19T06:40:08.275371+0000","last_fullsized":"2024-09-19T06:40:08.275371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:03.359786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257731+0000","last_change":"2024-09-19T06:38:12.037346+0000","last_active":"2024-09-19T06:40:08.257731+0000","last_peered":"2024-09-19T06:40:08.257731+0000","last_clean":"2024-09-19T06:40:08.257731+0000","last_became_active":"2024-09-19T06:38:12.036986+0000","last_became_peered":"2024-09-19T06:38:12.036986+0000","last_unstale":"2024-09-19T06:40:08.257731+0000","last_undegraded":"2024-09-19T06:40:08.257731+0000","last_fullsized":"2024-09-19T06:40:08.257731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:26.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076694+0000","last_change":"2024-09-19T06:38:14.059454+0000","last_active":"2024-09-19T06:40:08.076694+0000","last_peered":"2024-09-19T06:40:08.076694+0000","last_clean":"2024-09-19T06:40:08.076694+0000","last_became_active":"2024-09-19T06:38:14.058996+0000","last_became_peered":"2024-09-19T06:38:14.058996+0000","last_unstale":"2024-09-19T06:40:08.076694+0000","last_undegraded":"2024-09-19T06:40:08.076694+0000","last_fullsized":"2024-09-19T06:40:08.076694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:54.645395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":142,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.802915+0000","last_change":"2024-09-19T06:38:12.043687+0000","last_active":"2024-09-19T06:40:08.802915+0000","last_peered":"2024-09-19T06:40:08.802915+0000","last_clean":"2024-09-19T06:40:08.802915+0000","last_became_active":"2024-09-19T06:38:12.043268+0000","last_became_peered":"2024-09-19T06:38:12.043268+0000","last_unstale":"2024-09-19T06:40:08.802915+0000","last_undegraded":"2024-09-19T06:40:08.802915+0000","last_fullsized":"2024-09-19T06:40:08.802915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:18.753736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076233+0000","last_change":"2024-09-19T06:38:14.052184+0000","last_active":"2024-09-19T06:40:08.076233+0000","last_peered":"2024-09-19T06:40:08.076233+0000","last_clean":"2024-09-19T06:40:08.076233+0000","last_became_active":"2024-09-19T06:38:14.051736+0000","last_became_peered":"2024-09-19T06:38:14.051736+0000","last_unstale":"2024-09-19T06:40:08.076233+0000","last_undegraded":"2024-09-19T06:40:08.076233+0000","last_fullsized":"2024-09-19T06:40:08.076233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:12.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:12.048418+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:12.047948+0000","last_became_peered":"2024-09-19T06:38:12.047948+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:06.059904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181946+0000","last_change":"2024-09-19T06:38:23.175961+0000","last_active":"2024-09-19T06:40:08.181946+0000","last_peered":"2024-09-19T06:40:08.181946+0000","last_clean":"2024-09-19T06:40:08.181946+0000","last_became_active":"2024-09-19T06:38:23.175629+0000","last_became_peered":"2024-09-19T06:38:23.175629+0000","last_unstale":"2024-09-19T06:40:08.181946+0000","last_undegraded":"2024-09-19T06:40:08.181946+0000","last_fullsized":"2024-09-19T06:40:08.181946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185296+0000","last_change":"2024-09-19T06:38:12.038945+0000","last_active":"2024-09-19T06:40:08.185296+0000","last_peered":"2024-09-19T06:40:08.185296+0000","last_clean":"2024-09-19T06:40:08.185296+0000","last_became_active":"2024-09-19T06:38:12.038571+0000","last_became_peered":"2024-09-19T06:38:12.038571+0000","last_unstale":"2024-09-19T06:40:08.185296+0000","last_undegraded":"2024-09-19T06:40:08.185296+0000","last_fullsized":"2024-09-19T06:40:08.185296+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:57.887070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193798+0000","last_change":"2024-09-19T06:38:14.056481+0000","last_active":"2024-09-19T06:40:08.193798+0000","last_peered":"2024-09-19T06:40:08.193798+0000","last_clean":"2024-09-19T06:40:08.193798+0000","last_became_active":"2024-09-19T06:38:14.056177+0000","last_became_peered":"2024-09-19T06:38:14.056177+0000","last_unstale":"2024-09-19T06:40:08.193798+0000","last_undegraded":"2024-09-19T06:40:08.193798+0000","last_fullsized":"2024-09-19T06:40:08.193798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.734802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276561+0000","last_change":"2024-09-19T06:38:12.038826+0000","last_active":"2024-09-19T06:40:08.276561+0000","last_peered":"2024-09-19T06:40:08.276561+0000","last_clean":"2024-09-19T06:40:08.276561+0000","last_became_active":"2024-09-19T06:38:12.038516+0000","last_became_peered":"2024-09-19T06:38:12.038516+0000","last_unstale":"2024-09-19T06:40:08.276561+0000","last_undegraded":"2024-09-19T06:40:08.276561+0000","last_fullsized":"2024-09-19T06:40:08.276561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:16.709742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076941+0000","last_change":"2024-09-19T06:38:14.053888+0000","last_active":"2024-09-19T06:40:08.076941+0000","last_peered":"2024-09-19T06:40:08.076941+0000","last_clean":"2024-09-19T06:40:08.076941+0000","last_became_active":"2024-09-19T06:38:14.053524+0000","last_became_peered":"2024-09-19T06:38:14.053524+0000","last_unstale":"2024-09-19T06:40:08.076941+0000","last_undegraded":"2024-09-19T06:40:08.076941+0000","last_fullsized":"2024-09-19T06:40:08.076941+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:54.853786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'41","reported_seq":62,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.310545+0000","last_change":"2024-09-19T06:39:23.715975+0000","last_active":"2024-09-19T06:40:08.310545+0000","last_peered":"2024-09-19T06:40:08.310545+0000","last_clean":"2024-09-19T06:40:08.310545+0000","last_became_active":"2024-09-19T06:39:23.713052+0000","last_became_peered":"2024-09-19T06:39:23.713052+0000","last_unstale":"2024-09-19T06:40:08.310545+0000","last_undegraded":"2024-09-19T06:40:08.310545+0000","last_fullsized":"2024-09-19T06:40:08.310545+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:42.887751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076532+0000","last_change":"2024-09-19T06:38:14.052210+0000","last_active":"2024-09-19T06:40:08.076532+0000","last_peered":"2024-09-19T06:40:08.076532+0000","last_clean":"2024-09-19T06:40:08.076532+0000","last_became_active":"2024-09-19T06:38:14.051803+0000","last_became_peered":"2024-09-19T06:38:14.051803+0000","last_unstale":"2024-09-19T06:40:08.076532+0000","last_undegraded":"2024-09-19T06:40:08.076532+0000","last_fullsized":"2024-09-19T06:40:08.076532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:40.751672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'8","reported_seq":144,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.825713+0000","last_change":"2024-09-19T06:38:12.118077+0000","last_active":"2024-09-19T06:40:08.825713+0000","last_peered":"2024-09-19T06:40:08.825713+0000","last_clean":"2024-09-19T06:40:08.825713+0000","last_became_active":"2024-09-19T06:38:12.117690+0000","last_became_peered":"2024-09-19T06:38:12.117690+0000","last_unstale":"2024-09-19T06:40:08.825713+0000","last_undegraded":"2024-09-19T06:40:08.825713+0000","last_fullsized":"2024-09-19T06:40:08.825713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.828335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076689+0000","last_change":"2024-09-19T06:38:14.054014+0000","last_active":"2024-09-19T06:40:08.076689+0000","last_peered":"2024-09-19T06:40:08.076689+0000","last_clean":"2024-09-19T06:40:08.076689+0000","last_became_active":"2024-09-19T06:38:14.053349+0000","last_became_peered":"2024-09-19T06:38:14.053349+0000","last_unstale":"2024-09-19T06:40:08.076689+0000","last_undegraded":"2024-09-19T06:40:08.076689+0000","last_fullsized":"2024-09-19T06:40:08.076689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:40.117720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076455+0000","last_change":"2024-09-19T06:37:02.166696+0000","last_active":"2024-09-19T06:40:08.076455+0000","last_peered":"2024-09-19T06:40:08.076455+0000","last_clean":"2024-09-19T06:40:08.076455+0000","last_became_active":"2024-09-19T06:37:02.166225+0000","last_became_peered":"2024-09-19T06:37:02.166225+0000","last_unstale":"2024-09-19T06:40:08.076455+0000","last_undegraded":"2024-09-19T06:40:08.076455+0000","last_fullsized":"2024-09-19T06:40:08.076455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_clean_scrub_stamp":"2024-09-19T06:33:40.535354+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:46.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274179+0000","last_change":"2024-09-19T06:38:12.044465+0000","last_active":"2024-09-19T06:40:08.274179+0000","last_peered":"2024-09-19T06:40:08.274179+0000","last_clean":"2024-09-19T06:40:08.274179+0000","last_became_active":"2024-09-19T06:38:12.044042+0000","last_became_peered":"2024-09-19T06:38:12.044042+0000","last_unstale":"2024-09-19T06:40:08.274179+0000","last_undegraded":"2024-09-19T06:40:08.274179+0000","last_fullsized":"2024-09-19T06:40:08.274179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:40.759264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075774+0000","last_change":"2024-09-19T06:38:14.045102+0000","last_active":"2024-09-19T06:40:08.075774+0000","last_peered":"2024-09-19T06:40:08.075774+0000","last_clean":"2024-09-19T06:40:08.075774+0000","last_became_active":"2024-09-19T06:38:14.044785+0000","last_became_peered":"2024-09-19T06:38:14.044785+0000","last_unstale":"2024-09-19T06:40:08.075774+0000","last_undegraded":"2024-09-19T06:40:08.075774+0000","last_fullsized":"2024-09-19T06:40:08.075774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:57.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076395+0000","last_change":"2024-09-19T06:39:24.353205+0000","last_active":"2024-09-19T06:40:08.076395+0000","last_peered":"2024-09-19T06:40:08.076395+0000","last_clean":"2024-09-19T06:40:08.076395+0000","last_became_active":"2024-09-19T06:39:24.350315+0000","last_became_peered":"2024-09-19T06:39:24.350315+0000","last_unstale":"2024-09-19T06:40:08.076395+0000","last_undegraded":"2024-09-19T06:40:08.076395+0000","last_fullsized":"2024-09-19T06:40:08.076395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:32.467330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,8],"acting":[7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275223+0000","last_change":"2024-09-19T06:38:14.054623+0000","last_active":"2024-09-19T06:40:08.275223+0000","last_peered":"2024-09-19T06:40:08.275223+0000","last_clean":"2024-09-19T06:40:08.275223+0000","last_became_active":"2024-09-19T06:38:14.054124+0000","last_became_peered":"2024-09-19T06:38:14.054124+0000","last_unstale":"2024-09-19T06:40:08.275223+0000","last_undegraded":"2024-09-19T06:40:08.275223+0000","last_fullsized":"2024-09-19T06:40:08.275223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:33.251059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":140,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.356255+0000","last_change":"2024-09-19T06:38:12.047284+0000","last_active":"2024-09-19T06:40:08.356255+0000","last_peered":"2024-09-19T06:40:08.356255+0000","last_clean":"2024-09-19T06:40:08.356255+0000","last_became_active":"2024-09-19T06:38:12.046886+0000","last_became_peered":"2024-09-19T06:38:12.046886+0000","last_unstale":"2024-09-19T06:40:08.356255+0000","last_undegraded":"2024-09-19T06:40:08.356255+0000","last_fullsized":"2024-09-19T06:40:08.356255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:15.030007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257667+0000","last_change":"2024-09-19T06:38:14.049351+0000","last_active":"2024-09-19T06:40:08.257667+0000","last_peered":"2024-09-19T06:40:08.257667+0000","last_clean":"2024-09-19T06:40:08.257667+0000","last_became_active":"2024-09-19T06:38:14.048792+0000","last_became_peered":"2024-09-19T06:38:14.048792+0000","last_unstale":"2024-09-19T06:40:08.257667+0000","last_undegraded":"2024-09-19T06:40:08.257667+0000","last_fullsized":"2024-09-19T06:40:08.257667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:30.431378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'9","reported_seq":145,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.824197+0000","last_change":"2024-09-19T06:38:12.037155+0000","last_active":"2024-09-19T06:40:08.824197+0000","last_peered":"2024-09-19T06:40:08.824197+0000","last_clean":"2024-09-19T06:40:08.824197+0000","last_became_active":"2024-09-19T06:38:12.036536+0000","last_became_peered":"2024-09-19T06:38:12.036536+0000","last_unstale":"2024-09-19T06:40:08.824197+0000","last_undegraded":"2024-09-19T06:40:08.824197+0000","last_fullsized":"2024-09-19T06:40:08.824197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:41.014783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196631+0000","last_change":"2024-09-19T06:38:14.055724+0000","last_active":"2024-09-19T06:40:08.196631+0000","last_peered":"2024-09-19T06:40:08.196631+0000","last_clean":"2024-09-19T06:40:08.196631+0000","last_became_active":"2024-09-19T06:38:14.054457+0000","last_became_peered":"2024-09-19T06:38:14.054457+0000","last_unstale":"2024-09-19T06:40:08.196631+0000","last_undegraded":"2024-09-19T06:40:08.196631+0000","last_fullsized":"2024-09-19T06:40:08.196631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:47.653709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182579+0000","last_change":"2024-09-19T06:38:12.049197+0000","last_active":"2024-09-19T06:40:08.182579+0000","last_peered":"2024-09-19T06:40:08.182579+0000","last_clean":"2024-09-19T06:40:08.182579+0000","last_became_active":"2024-09-19T06:38:12.048863+0000","last_became_peered":"2024-09-19T06:38:12.048863+0000","last_unstale":"2024-09-19T06:40:08.182579+0000","last_undegraded":"2024-09-19T06:40:08.182579+0000","last_fullsized":"2024-09-19T06:40:08.182579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:25.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196635+0000","last_change":"2024-09-19T06:38:14.042991+0000","last_active":"2024-09-19T06:40:08.196635+0000","last_peered":"2024-09-19T06:40:08.196635+0000","last_clean":"2024-09-19T06:40:08.196635+0000","last_became_active":"2024-09-19T06:38:14.042511+0000","last_became_peered":"2024-09-19T06:38:14.042511+0000","last_unstale":"2024-09-19T06:40:08.196635+0000","last_undegraded":"2024-09-19T06:40:08.196635+0000","last_fullsized":"2024-09-19T06:40:08.196635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:38.212838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193790+0000","last_change":"2024-09-19T06:38:23.064456+0000","last_active":"2024-09-19T06:40:08.193790+0000","last_peered":"2024-09-19T06:40:08.193790+0000","last_clean":"2024-09-19T06:40:08.193790+0000","last_became_active":"2024-09-19T06:38:23.064051+0000","last_became_peered":"2024-09-19T06:38:23.064051+0000","last_unstale":"2024-09-19T06:40:08.193790+0000","last_undegraded":"2024-09-19T06:40:08.193790+0000","last_fullsized":"2024-09-19T06:40:08.193790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:58.548420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275853+0000","last_change":"2024-09-19T06:38:14.048612+0000","last_active":"2024-09-19T06:40:08.275853+0000","last_peered":"2024-09-19T06:40:08.275853+0000","last_clean":"2024-09-19T06:40:08.275853+0000","last_became_active":"2024-09-19T06:38:14.048294+0000","last_became_peered":"2024-09-19T06:38:14.048294+0000","last_unstale":"2024-09-19T06:40:08.275853+0000","last_undegraded":"2024-09-19T06:40:08.275853+0000","last_fullsized":"2024-09-19T06:40:08.275853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:55.892149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'50","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.313781+0000","last_change":"2024-09-19T06:38:12.035269+0000","last_active":"2024-09-19T06:40:08.313781+0000","last_peered":"2024-09-19T06:40:08.313781+0000","last_clean":"2024-09-19T06:40:08.313781+0000","last_became_active":"2024-09-19T06:38:12.034841+0000","last_became_peered":"2024-09-19T06:38:12.034841+0000","last_unstale":"2024-09-19T06:40:08.313781+0000","last_undegraded":"2024-09-19T06:40:08.313781+0000","last_fullsized":"2024-09-19T06:40:08.313781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:19.642572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076503+0000","last_change":"2024-09-19T06:38:14.052492+0000","last_active":"2024-09-19T06:40:08.076503+0000","last_peered":"2024-09-19T06:40:08.076503+0000","last_clean":"2024-09-19T06:40:08.076503+0000","last_became_active":"2024-09-19T06:38:14.052191+0000","last_became_peered":"2024-09-19T06:38:14.052191+0000","last_unstale":"2024-09-19T06:40:08.076503+0000","last_undegraded":"2024-09-19T06:40:08.076503+0000","last_fullsized":"2024-09-19T06:40:08.076503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:34.006480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274336+0000","last_change":"2024-09-19T06:38:12.118430+0000","last_active":"2024-09-19T06:40:08.274336+0000","last_peered":"2024-09-19T06:40:08.274336+0000","last_clean":"2024-09-19T06:40:08.274336+0000","last_became_active":"2024-09-19T06:38:12.118065+0000","last_became_peered":"2024-09-19T06:38:12.118065+0000","last_unstale":"2024-09-19T06:40:08.274336+0000","last_undegraded":"2024-09-19T06:40:08.274336+0000","last_fullsized":"2024-09-19T06:40:08.274336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:25.861922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274974+0000","last_change":"2024-09-19T06:38:23.811305+0000","last_active":"2024-09-19T06:40:08.274974+0000","last_peered":"2024-09-19T06:40:08.274974+0000","last_clean":"2024-09-19T06:40:08.274974+0000","last_became_active":"2024-09-19T06:38:23.810840+0000","last_became_peered":"2024-09-19T06:38:23.810840+0000","last_unstale":"2024-09-19T06:40:08.274974+0000","last_undegraded":"2024-09-19T06:40:08.274974+0000","last_fullsized":"2024-09-19T06:40:08.274974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.019065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273364+0000","last_change":"2024-09-19T06:38:12.047670+0000","last_active":"2024-09-19T06:40:08.273364+0000","last_peered":"2024-09-19T06:40:08.273364+0000","last_clean":"2024-09-19T06:40:08.273364+0000","last_became_active":"2024-09-19T06:38:12.047312+0000","last_became_peered":"2024-09-19T06:38:12.047312+0000","last_unstale":"2024-09-19T06:40:08.273364+0000","last_undegraded":"2024-09-19T06:40:08.273364+0000","last_fullsized":"2024-09-19T06:40:08.273364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:47.477945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:14.047210+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:14.046836+0000","last_became_peered":"2024-09-19T06:38:14.046836+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:14.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075584+0000","last_change":"2024-09-19T06:38:12.032692+0000","last_active":"2024-09-19T06:40:08.075584+0000","last_peered":"2024-09-19T06:40:08.075584+0000","last_clean":"2024-09-19T06:40:08.075584+0000","last_became_active":"2024-09-19T06:38:12.031874+0000","last_became_peered":"2024-09-19T06:38:12.031874+0000","last_unstale":"2024-09-19T06:40:08.075584+0000","last_undegraded":"2024-09-19T06:40:08.075584+0000","last_fullsized":"2024-09-19T06:40:08.075584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.787964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193683+0000","last_change":"2024-09-19T06:38:14.053504+0000","last_active":"2024-09-19T06:40:08.193683+0000","last_peered":"2024-09-19T06:40:08.193683+0000","last_clean":"2024-09-19T06:40:08.193683+0000","last_became_active":"2024-09-19T06:38:14.053148+0000","last_became_peered":"2024-09-19T06:38:14.053148+0000","last_unstale":"2024-09-19T06:40:08.193683+0000","last_undegraded":"2024-09-19T06:40:08.193683+0000","last_fullsized":"2024-09-19T06:40:08.193683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:29.809295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076736+0000","last_change":"2024-09-19T06:38:12.038884+0000","last_active":"2024-09-19T06:40:08.076736+0000","last_peered":"2024-09-19T06:40:08.076736+0000","last_clean":"2024-09-19T06:40:08.076736+0000","last_became_active":"2024-09-19T06:38:12.038532+0000","last_became_peered":"2024-09-19T06:38:12.038532+0000","last_unstale":"2024-09-19T06:40:08.076736+0000","last_undegraded":"2024-09-19T06:40:08.076736+0000","last_fullsized":"2024-09-19T06:40:08.076736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.348690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075777+0000","last_change":"2024-09-19T06:38:14.045761+0000","last_active":"2024-09-19T06:40:08.075777+0000","last_peered":"2024-09-19T06:40:08.075777+0000","last_clean":"2024-09-19T06:40:08.075777+0000","last_became_active":"2024-09-19T06:38:14.045467+0000","last_became_peered":"2024-09-19T06:38:14.045467+0000","last_unstale":"2024-09-19T06:40:08.075777+0000","last_undegraded":"2024-09-19T06:40:08.075777+0000","last_fullsized":"2024-09-19T06:40:08.075777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.917945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185144+0000","last_change":"2024-09-19T06:39:23.748032+0000","last_active":"2024-09-19T06:40:08.185144+0000","last_peered":"2024-09-19T06:40:08.185144+0000","last_clean":"2024-09-19T06:40:08.185144+0000","last_became_active":"2024-09-19T06:39:23.744288+0000","last_became_peered":"2024-09-19T06:39:23.744288+0000","last_unstale":"2024-09-19T06:40:08.185144+0000","last_undegraded":"2024-09-19T06:40:08.185144+0000","last_fullsized":"2024-09-19T06:40:08.185144+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:50.668043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4],"acting":[8,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076545+0000","last_change":"2024-09-19T06:38:14.053935+0000","last_active":"2024-09-19T06:40:08.076545+0000","last_peered":"2024-09-19T06:40:08.076545+0000","last_clean":"2024-09-19T06:40:08.076545+0000","last_became_active":"2024-09-19T06:38:14.053542+0000","last_became_peered":"2024-09-19T06:38:14.053542+0000","last_unstale":"2024-09-19T06:40:08.076545+0000","last_undegraded":"2024-09-19T06:40:08.076545+0000","last_fullsized":"2024-09-19T06:40:08.076545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:25.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182280+0000","last_change":"2024-09-19T06:38:23.177133+0000","last_active":"2024-09-19T06:40:08.182280+0000","last_peered":"2024-09-19T06:40:08.182280+0000","last_clean":"2024-09-19T06:40:08.182280+0000","last_became_active":"2024-09-19T06:38:23.176810+0000","last_became_peered":"2024-09-19T06:38:23.176810+0000","last_unstale":"2024-09-19T06:40:08.182280+0000","last_undegraded":"2024-09-19T06:40:08.182280+0000","last_fullsized":"2024-09-19T06:40:08.182280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:56.307720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185240+0000","last_change":"2024-09-19T06:38:12.042699+0000","last_active":"2024-09-19T06:40:08.185240+0000","last_peered":"2024-09-19T06:40:08.185240+0000","last_clean":"2024-09-19T06:40:08.185240+0000","last_became_active":"2024-09-19T06:38:12.042148+0000","last_became_peered":"2024-09-19T06:38:12.042148+0000","last_unstale":"2024-09-19T06:40:08.185240+0000","last_undegraded":"2024-09-19T06:40:08.185240+0000","last_fullsized":"2024-09-19T06:40:08.185240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.953596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273371+0000","last_change":"2024-09-19T06:38:14.043279+0000","last_active":"2024-09-19T06:40:08.273371+0000","last_peered":"2024-09-19T06:40:08.273371+0000","last_clean":"2024-09-19T06:40:08.273371+0000","last_became_active":"2024-09-19T06:38:14.042914+0000","last_became_peered":"2024-09-19T06:38:14.042914+0000","last_unstale":"2024-09-19T06:40:08.273371+0000","last_undegraded":"2024-09-19T06:40:08.273371+0000","last_fullsized":"2024-09-19T06:40:08.273371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:22.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'13","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185441+0000","last_change":"2024-09-19T06:39:23.719397+0000","last_active":"2024-09-19T06:40:08.185441+0000","last_peered":"2024-09-19T06:40:08.185441+0000","last_clean":"2024-09-19T06:40:08.185441+0000","last_became_active":"2024-09-19T06:39:23.709128+0000","last_became_peered":"2024-09-19T06:39:23.709128+0000","last_unstale":"2024-09-19T06:40:08.185441+0000","last_undegraded":"2024-09-19T06:40:08.185441+0000","last_fullsized":"2024-09-19T06:40:08.185441+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:46.092401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274542+0000","last_change":"2024-09-19T06:38:14.041552+0000","last_active":"2024-09-19T06:40:08.274542+0000","last_peered":"2024-09-19T06:40:08.274542+0000","last_clean":"2024-09-19T06:40:08.274542+0000","last_became_active":"2024-09-19T06:38:14.041187+0000","last_became_peered":"2024-09-19T06:38:14.041187+0000","last_unstale":"2024-09-19T06:40:08.274542+0000","last_undegraded":"2024-09-19T06:40:08.274542+0000","last_fullsized":"2024-09-19T06:40:08.274542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:17.390457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076363+0000","last_change":"2024-09-19T06:38:12.047436+0000","last_active":"2024-09-19T06:40:08.076363+0000","last_peered":"2024-09-19T06:40:08.076363+0000","last_clean":"2024-09-19T06:40:08.076363+0000","last_became_active":"2024-09-19T06:38:12.046961+0000","last_became_peered":"2024-09-19T06:38:12.046961+0000","last_unstale":"2024-09-19T06:40:08.076363+0000","last_undegraded":"2024-09-19T06:40:08.076363+0000","last_fullsized":"2024-09-19T06:40:08.076363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076212+0000","last_change":"2024-09-19T06:38:14.049660+0000","last_active":"2024-09-19T06:40:08.076212+0000","last_peered":"2024-09-19T06:40:08.076212+0000","last_clean":"2024-09-19T06:40:08.076212+0000","last_became_active":"2024-09-19T06:38:14.049375+0000","last_became_peered":"2024-09-19T06:38:14.049375+0000","last_unstale":"2024-09-19T06:40:08.076212+0000","last_undegraded":"2024-09-19T06:40:08.076212+0000","last_fullsized":"2024-09-19T06:40:08.076212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:08.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'15","reported_seq":159,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.357314+0000","last_change":"2024-09-19T06:38:23.071068+0000","last_active":"2024-09-19T06:40:08.357314+0000","last_peered":"2024-09-19T06:40:08.357314+0000","last_clean":"2024-09-19T06:40:08.357314+0000","last_became_active":"2024-09-19T06:38:23.067129+0000","last_became_peered":"2024-09-19T06:38:23.067129+0000","last_unstale":"2024-09-19T06:40:08.357314+0000","last_undegraded":"2024-09-19T06:40:08.357314+0000","last_fullsized":"2024-09-19T06:40:08.357314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:15.387758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600254,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1183,"num_read_kb":708,"num_write":376,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2264,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2162688,"data_stored":1800762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":598089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776168,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41260,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703892,"statfs":{"total":95995035648,"available":95952785408,"internally_reserved":0,"allocated":1732608,"data_stored":1182233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28376,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716776,"statfs":{"total":95995035648,"available":95965978624,"internally_reserved":0,"allocated":1380352,"data_stored":858526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168626,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28356,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716796,"statfs":{"total":95995035648,"available":95965999104,"internally_reserved":0,"allocated":1359872,"data_stored":858120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1581056,"data_stored":1059977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528381,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":456768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32740,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712412,"statfs":{"total":95995035648,"available":95961509888,"internally_reserved":0,"allocated":1589248,"data_stored":1057957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1052672,"data_stored":532364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":989668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":466465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40528,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704624,"statfs":{"total":95995035648,"available":95953534976,"internally_reserved":0,"allocated":1044480,"data_stored":533774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":467293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":199656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":133901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:40:11.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:40:11.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.381+0000 7f018e9e8640 1 -- 172.21.15.12:0/952252046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01881077f0 msgr2=0x7f0188109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.381+0000 7f018e9e8640 1 --2- 172.21.15.12:0/952252046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01881077f0 0x7f0188109c60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0180009ca0 tx=0x7f018002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.381+0000 7f018e9e8640 1 -- 172.21.15.12:0/952252046 shutdown_connections 2024-09-19T06:40:11.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.381+0000 7f018e9e8640 1 --2- 172.21.15.12:0/952252046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01881077f0 0x7f0188109c60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.381+0000 7f018e9e8640 1 --2- 172.21.15.12:0/952252046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0188104ec0 0x7f01881072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.381+0000 7f018e9e8640 1 --2- 172.21.15.12:0/952252046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0188102590 0x7f0188104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.381+0000 7f018e9e8640 1 -- 172.21.15.12:0/952252046 >> 172.21.15.12:0/952252046 conn(0x7f01880fc170 msgr2=0x7f01880fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:11.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.381+0000 7f018e9e8640 1 -- 172.21.15.12:0/952252046 shutdown_connections 2024-09-19T06:40:11.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.381+0000 7f018e9e8640 1 -- 172.21.15.12:0/952252046 wait complete. 2024-09-19T06:40:11.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f018e9e8640 1 Processor -- start 2024-09-19T06:40:11.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f018e9e8640 1 -- start start 2024-09-19T06:40:11.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f018e9e8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0188102590 0x7f0188197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f018e9e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0188104ec0 0x7f01881983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f018e9e8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01881077f0 0x7f018819f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f018e9e8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f018810d7d0 con 0x7f0188104ec0 2024-09-19T06:40:11.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f018e9e8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f018810d650 con 0x7f01881077f0 2024-09-19T06:40:11.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f018e9e8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f018810d950 con 0x7f0188102590 2024-09-19T06:40:11.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f01877fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0188104ec0 0x7f01881983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f01877fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0188104ec0 0x7f01881983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36798/0 (socket says 172.21.15.12:36798) 2024-09-19T06:40:11.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f01877fe640 1 -- 172.21.15.12:0/1111320558 learned_addr learned my addr 172.21.15.12:0/1111320558 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:11.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f0187fff640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0188102590 0x7f0188197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f018cf85640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01881077f0 0x7f018819f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f01877fe640 1 -- 172.21.15.12:0/1111320558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0188102590 msgr2=0x7f0188197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f01877fe640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0188102590 0x7f0188197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f01877fe640 1 -- 172.21.15.12:0/1111320558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01881077f0 msgr2=0x7f018819f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f01877fe640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01881077f0 0x7f018819f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f01877fe640 1 -- 172.21.15.12:0/1111320558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018819fab0 con 0x7f0188104ec0 2024-09-19T06:40:11.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.382+0000 7f018cf85640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01881077f0 0x7f018819f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:11.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.383+0000 7f01877fe640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0188104ec0 0x7f01881983d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f017c00e9f0 tx=0x7f017c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:11.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.383+0000 7f01857fa640 1 -- 172.21.15.12:0/1111320558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c00ccc0 con 0x7f0188104ec0 2024-09-19T06:40:11.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.383+0000 7f018e9e8640 1 -- 172.21.15.12:0/1111320558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018819fda0 con 0x7f0188104ec0 2024-09-19T06:40:11.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.383+0000 7f01857fa640 1 -- 172.21.15.12:0/1111320558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f017c005500 con 0x7f0188104ec0 2024-09-19T06:40:11.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.383+0000 7f01857fa640 1 -- 172.21.15.12:0/1111320558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c010690 con 0x7f0188104ec0 2024-09-19T06:40:11.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.383+0000 7f018e9e8640 1 -- 172.21.15.12:0/1111320558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01881a0210 con 0x7f0188104ec0 2024-09-19T06:40:11.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.384+0000 7f018e9e8640 1 -- 172.21.15.12:0/1111320558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01880fdc60 con 0x7f0188104ec0 2024-09-19T06:40:11.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.385+0000 7f01857fa640 1 -- 172.21.15.12:0/1111320558 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7f017c0046c0 con 0x7f0188104ec0 2024-09-19T06:40:11.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.386+0000 7f01857fa640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01700a33c0 0x7f01700a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.386+0000 7f01857fa640 1 -- 172.21.15.12:0/1111320558 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f017c0d0380 con 0x7f0188104ec0 2024-09-19T06:40:11.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.386+0000 7f0187fff640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01700a33c0 0x7f01700a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.387+0000 7f0187fff640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01700a33c0 0x7f01700a5880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0178009b60 tx=0x7f0178005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:11.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.389+0000 7f01857fa640 1 -- 172.21.15.12:0/1111320558 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f017c054210 con 0x7f0188104ec0 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: [19/Sep/2024:06:40:10] ENGINE Serving on https://172.21.15.12:7150 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: [19/Sep/2024:06:40:10] ENGINE Error in HTTPServer.serve 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:40:11.512 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: [19/Sep/2024:06:40:10] ENGINE Serving on http://172.21.15.12:8765 2024-09-19T06:40:11.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: [19/Sep/2024:06:40:10] ENGINE Bus STARTED 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: mgrmap e22: x(active, since 3s), standbys: y, z 2024-09-19T06:40:11.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:11 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.568+0000 7f018e9e8640 1 -- 172.21.15.12:0/1111320558 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0188062630 con 0x7f01700a33c0 2024-09-19T06:40:11.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.574+0000 7f01857fa640 1 -- 172.21.15.12:0/1111320558 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257795 (secure 0 0 0) 0x7f0188062630 con 0x7f01700a33c0 2024-09-19T06:40:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:11.581 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-19T06:40:11.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 -- 172.21.15.12:0/1111320558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01700a33c0 msgr2=0x7f01700a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01700a33c0 0x7f01700a5880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0178009b60 tx=0x7f0178005f90 comp rx=0 tx=0).stop 2024-09-19T06:40:11.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 -- 172.21.15.12:0/1111320558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0188104ec0 msgr2=0x7f01881983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0188104ec0 0x7f01881983d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f017c00e9f0 tx=0x7f017c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 -- 172.21.15.12:0/1111320558 shutdown_connections 2024-09-19T06:40:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01881077f0 0x7f018819f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0188104ec0 0x7f01881983d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01700a33c0 0x7f01700a5880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 --2- 172.21.15.12:0/1111320558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0188102590 0x7f0188197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 -- 172.21.15.12:0/1111320558 >> 172.21.15.12:0/1111320558 conn(0x7f01880fc170 msgr2=0x7f0188102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 -- 172.21.15.12:0/1111320558 shutdown_connections 2024-09-19T06:40:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.578+0000 7f018e9e8640 1 -- 172.21.15.12:0/1111320558 wait complete. 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: [19/Sep/2024:06:40:10] ENGINE Serving on https://172.21.15.12:7150 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: [19/Sep/2024:06:40:10] ENGINE Error in HTTPServer.serve 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout: Traceback (most recent call last): 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout: self._run(expiration_interval) 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:40:11.584 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout: s = self.context.wrap_socket( 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout: return self.sslsocket_class._create( 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout: self.do_handshake() 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout: self._sslobj.do_handshake() 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: [19/Sep/2024:06:40:10] ENGINE Serving on http://172.21.15.12:8765 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: [19/Sep/2024:06:40:10] ENGINE Bus STARTED 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: mgrmap e22: x(active, since 3s), standbys: y, z 2024-09-19T06:40:11.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.587 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:11 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.596 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T06:40:10.089803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190856,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1319,"num_read_kb":827,"num_write":559,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183000,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":942,"ondisk_log_size":942,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385072,"kb_used_data":14928,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124556752,"statfs":{"total":1151940427776,"available":1151546114048,"internally_reserved":0,"allocated":15286272,"data_stored":9061234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.927734"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193904+0000","last_change":"2024-09-19T06:38:14.052943+0000","last_active":"2024-09-19T06:40:08.193904+0000","last_peered":"2024-09-19T06:40:08.193904+0000","last_clean":"2024-09-19T06:40:08.193904+0000","last_became_active":"2024-09-19T06:38:14.052054+0000","last_became_peered":"2024-09-19T06:38:14.052054+0000","last_unstale":"2024-09-19T06:40:08.193904+0000","last_undegraded":"2024-09-19T06:40:08.193904+0000","last_fullsized":"2024-09-19T06:40:08.193904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:28.898131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274838+0000","last_change":"2024-09-19T06:38:14.044916+0000","last_active":"2024-09-19T06:40:08.274838+0000","last_peered":"2024-09-19T06:40:08.274838+0000","last_clean":"2024-09-19T06:40:08.274838+0000","last_became_active":"2024-09-19T06:38:14.044596+0000","last_became_peered":"2024-09-19T06:38:14.044596+0000","last_unstale":"2024-09-19T06:40:08.274838+0000","last_undegraded":"2024-09-19T06:40:08.274838+0000","last_fullsized":"2024-09-19T06:40:08.274838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:04.402332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274196+0000","last_change":"2024-09-19T06:38:14.052765+0000","last_active":"2024-09-19T06:40:08.274196+0000","last_peered":"2024-09-19T06:40:08.274196+0000","last_clean":"2024-09-19T06:40:08.274196+0000","last_became_active":"2024-09-19T06:38:14.052219+0000","last_became_peered":"2024-09-19T06:38:14.052219+0000","last_unstale":"2024-09-19T06:40:08.274196+0000","last_undegraded":"2024-09-19T06:40:08.274196+0000","last_fullsized":"2024-09-19T06:40:08.274196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:13.317252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274176+0000","last_change":"2024-09-19T06:38:14.052421+0000","last_active":"2024-09-19T06:40:08.274176+0000","last_peered":"2024-09-19T06:40:08.274176+0000","last_clean":"2024-09-19T06:40:08.274176+0000","last_became_active":"2024-09-19T06:38:14.052094+0000","last_became_peered":"2024-09-19T06:38:14.052094+0000","last_unstale":"2024-09-19T06:40:08.274176+0000","last_undegraded":"2024-09-19T06:40:08.274176+0000","last_fullsized":"2024-09-19T06:40:08.274176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185134+0000","last_change":"2024-09-19T06:38:14.047736+0000","last_active":"2024-09-19T06:40:08.185134+0000","last_peered":"2024-09-19T06:40:08.185134+0000","last_clean":"2024-09-19T06:40:08.185134+0000","last_became_active":"2024-09-19T06:38:14.047396+0000","last_became_peered":"2024-09-19T06:38:14.047396+0000","last_unstale":"2024-09-19T06:40:08.185134+0000","last_undegraded":"2024-09-19T06:40:08.185134+0000","last_fullsized":"2024-09-19T06:40:08.185134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.855638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196543+0000","last_change":"2024-09-19T06:38:14.047793+0000","last_active":"2024-09-19T06:40:08.196543+0000","last_peered":"2024-09-19T06:40:08.196543+0000","last_clean":"2024-09-19T06:40:08.196543+0000","last_became_active":"2024-09-19T06:38:14.047198+0000","last_became_peered":"2024-09-19T06:38:14.047198+0000","last_unstale":"2024-09-19T06:40:08.196543+0000","last_undegraded":"2024-09-19T06:40:08.196543+0000","last_fullsized":"2024-09-19T06:40:08.196543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:42.507270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076273+0000","last_change":"2024-09-19T06:38:14.050025+0000","last_active":"2024-09-19T06:40:08.076273+0000","last_peered":"2024-09-19T06:40:08.076273+0000","last_clean":"2024-09-19T06:40:08.076273+0000","last_became_active":"2024-09-19T06:38:14.049591+0000","last_became_peered":"2024-09-19T06:38:14.049591+0000","last_unstale":"2024-09-19T06:40:08.076273+0000","last_undegraded":"2024-09-19T06:40:08.076273+0000","last_fullsized":"2024-09-19T06:40:08.076273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:49.487521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181942+0000","last_change":"2024-09-19T06:38:23.065490+0000","last_active":"2024-09-19T06:40:08.181942+0000","last_peered":"2024-09-19T06:40:08.181942+0000","last_clean":"2024-09-19T06:40:08.181942+0000","last_became_active":"2024-09-19T06:38:23.065151+0000","last_became_peered":"2024-09-19T06:38:23.065151+0000","last_unstale":"2024-09-19T06:40:08.181942+0000","last_undegraded":"2024-09-19T06:40:08.181942+0000","last_fullsized":"2024-09-19T06:40:08.181942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:42.184698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273928+0000","last_change":"2024-09-19T06:38:14.047395+0000","last_active":"2024-09-19T06:40:08.273928+0000","last_peered":"2024-09-19T06:40:08.273928+0000","last_clean":"2024-09-19T06:40:08.273928+0000","last_became_active":"2024-09-19T06:38:14.046975+0000","last_became_peered":"2024-09-19T06:38:14.046975+0000","last_unstale":"2024-09-19T06:40:08.273928+0000","last_undegraded":"2024-09-19T06:40:08.273928+0000","last_fullsized":"2024-09-19T06:40:08.273928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:18.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196936+0000","last_change":"2024-09-19T06:38:14.055042+0000","last_active":"2024-09-19T06:40:08.196936+0000","last_peered":"2024-09-19T06:40:08.196936+0000","last_clean":"2024-09-19T06:40:08.196936+0000","last_became_active":"2024-09-19T06:38:14.054664+0000","last_became_peered":"2024-09-19T06:38:14.054664+0000","last_unstale":"2024-09-19T06:40:08.196936+0000","last_undegraded":"2024-09-19T06:40:08.196936+0000","last_fullsized":"2024-09-19T06:40:08.196936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.815277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076591+0000","last_change":"2024-09-19T06:38:14.055106+0000","last_active":"2024-09-19T06:40:08.076591+0000","last_peered":"2024-09-19T06:40:08.076591+0000","last_clean":"2024-09-19T06:40:08.076591+0000","last_became_active":"2024-09-19T06:38:14.054721+0000","last_became_peered":"2024-09-19T06:38:14.054721+0000","last_unstale":"2024-09-19T06:40:08.076591+0000","last_undegraded":"2024-09-19T06:40:08.076591+0000","last_fullsized":"2024-09-19T06:40:08.076591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:39.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274235+0000","last_change":"2024-09-19T06:38:14.051796+0000","last_active":"2024-09-19T06:40:08.274235+0000","last_peered":"2024-09-19T06:40:08.274235+0000","last_clean":"2024-09-19T06:40:08.274235+0000","last_became_active":"2024-09-19T06:38:14.048338+0000","last_became_peered":"2024-09-19T06:38:14.048338+0000","last_unstale":"2024-09-19T06:40:08.274235+0000","last_undegraded":"2024-09-19T06:40:08.274235+0000","last_fullsized":"2024-09-19T06:40:08.274235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:48.656819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276087+0000","last_change":"2024-09-19T06:38:14.048607+0000","last_active":"2024-09-19T06:40:08.276087+0000","last_peered":"2024-09-19T06:40:08.276087+0000","last_clean":"2024-09-19T06:40:08.276087+0000","last_became_active":"2024-09-19T06:38:14.047277+0000","last_became_peered":"2024-09-19T06:38:14.047277+0000","last_unstale":"2024-09-19T06:40:08.276087+0000","last_undegraded":"2024-09-19T06:40:08.276087+0000","last_fullsized":"2024-09-19T06:40:08.276087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:52.904376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273963+0000","last_change":"2024-09-19T06:38:14.050759+0000","last_active":"2024-09-19T06:40:08.273963+0000","last_peered":"2024-09-19T06:40:08.273963+0000","last_clean":"2024-09-19T06:40:08.273963+0000","last_became_active":"2024-09-19T06:38:14.049900+0000","last_became_peered":"2024-09-19T06:38:14.049900+0000","last_unstale":"2024-09-19T06:40:08.273963+0000","last_undegraded":"2024-09-19T06:40:08.273963+0000","last_fullsized":"2024-09-19T06:40:08.273963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:45.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273772+0000","last_change":"2024-09-19T06:38:14.058890+0000","last_active":"2024-09-19T06:40:08.273772+0000","last_peered":"2024-09-19T06:40:08.273772+0000","last_clean":"2024-09-19T06:40:08.273772+0000","last_became_active":"2024-09-19T06:38:14.058442+0000","last_became_peered":"2024-09-19T06:38:14.058442+0000","last_unstale":"2024-09-19T06:40:08.273772+0000","last_undegraded":"2024-09-19T06:40:08.273772+0000","last_fullsized":"2024-09-19T06:40:08.273772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:27.296578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273218+0000","last_change":"2024-09-19T06:38:14.050371+0000","last_active":"2024-09-19T06:40:08.273218+0000","last_peered":"2024-09-19T06:40:08.273218+0000","last_clean":"2024-09-19T06:40:08.273218+0000","last_became_active":"2024-09-19T06:38:14.049930+0000","last_became_peered":"2024-09-19T06:38:14.049930+0000","last_unstale":"2024-09-19T06:40:08.273218+0000","last_undegraded":"2024-09-19T06:40:08.273218+0000","last_fullsized":"2024-09-19T06:40:08.273218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:37.898624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193944+0000","last_change":"2024-09-19T06:38:14.052521+0000","last_active":"2024-09-19T06:40:08.193944+0000","last_peered":"2024-09-19T06:40:08.193944+0000","last_clean":"2024-09-19T06:40:08.193944+0000","last_became_active":"2024-09-19T06:38:14.052083+0000","last_became_peered":"2024-09-19T06:38:14.052083+0000","last_unstale":"2024-09-19T06:40:08.193944+0000","last_undegraded":"2024-09-19T06:40:08.193944+0000","last_fullsized":"2024-09-19T06:40:08.193944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:10.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182686+0000","last_change":"2024-09-19T06:38:14.044747+0000","last_active":"2024-09-19T06:40:08.182686+0000","last_peered":"2024-09-19T06:40:08.182686+0000","last_clean":"2024-09-19T06:40:08.182686+0000","last_became_active":"2024-09-19T06:38:14.044451+0000","last_became_peered":"2024-09-19T06:38:14.044451+0000","last_unstale":"2024-09-19T06:40:08.182686+0000","last_undegraded":"2024-09-19T06:40:08.182686+0000","last_fullsized":"2024-09-19T06:40:08.182686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:04.067156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076928+0000","last_change":"2024-09-19T06:38:14.056101+0000","last_active":"2024-09-19T06:40:08.076928+0000","last_peered":"2024-09-19T06:40:08.076928+0000","last_clean":"2024-09-19T06:40:08.076928+0000","last_became_active":"2024-09-19T06:38:14.055682+0000","last_became_peered":"2024-09-19T06:38:14.055682+0000","last_unstale":"2024-09-19T06:40:08.076928+0000","last_undegraded":"2024-09-19T06:40:08.076928+0000","last_fullsized":"2024-09-19T06:40:08.076928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:23.921766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193625+0000","last_change":"2024-09-19T06:38:14.059441+0000","last_active":"2024-09-19T06:40:08.193625+0000","last_peered":"2024-09-19T06:40:08.193625+0000","last_clean":"2024-09-19T06:40:08.193625+0000","last_became_active":"2024-09-19T06:38:14.059123+0000","last_became_peered":"2024-09-19T06:38:14.059123+0000","last_unstale":"2024-09-19T06:40:08.193625+0000","last_undegraded":"2024-09-19T06:40:08.193625+0000","last_fullsized":"2024-09-19T06:40:08.193625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:32.148741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276233+0000","last_change":"2024-09-19T06:38:14.050336+0000","last_active":"2024-09-19T06:40:08.276233+0000","last_peered":"2024-09-19T06:40:08.276233+0000","last_clean":"2024-09-19T06:40:08.276233+0000","last_became_active":"2024-09-19T06:38:14.050041+0000","last_became_peered":"2024-09-19T06:38:14.050041+0000","last_unstale":"2024-09-19T06:40:08.276233+0000","last_undegraded":"2024-09-19T06:40:08.276233+0000","last_fullsized":"2024-09-19T06:40:08.276233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:09.245804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273366+0000","last_change":"2024-09-19T06:38:14.050280+0000","last_active":"2024-09-19T06:40:08.273366+0000","last_peered":"2024-09-19T06:40:08.273366+0000","last_clean":"2024-09-19T06:40:08.273366+0000","last_became_active":"2024-09-19T06:38:14.049874+0000","last_became_peered":"2024-09-19T06:38:14.049874+0000","last_unstale":"2024-09-19T06:40:08.273366+0000","last_undegraded":"2024-09-19T06:40:08.273366+0000","last_fullsized":"2024-09-19T06:40:08.273366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:52.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075355+0000","last_change":"2024-09-19T06:38:14.048294+0000","last_active":"2024-09-19T06:40:08.075355+0000","last_peered":"2024-09-19T06:40:08.075355+0000","last_clean":"2024-09-19T06:40:08.075355+0000","last_became_active":"2024-09-19T06:38:14.048002+0000","last_became_peered":"2024-09-19T06:38:14.048002+0000","last_unstale":"2024-09-19T06:40:08.075355+0000","last_undegraded":"2024-09-19T06:40:08.075355+0000","last_fullsized":"2024-09-19T06:40:08.075355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:55.920027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257610+0000","last_change":"2024-09-19T06:38:14.050244+0000","last_active":"2024-09-19T06:40:08.257610+0000","last_peered":"2024-09-19T06:40:08.257610+0000","last_clean":"2024-09-19T06:40:08.257610+0000","last_became_active":"2024-09-19T06:38:14.049499+0000","last_became_peered":"2024-09-19T06:38:14.049499+0000","last_unstale":"2024-09-19T06:40:08.257610+0000","last_undegraded":"2024-09-19T06:40:08.257610+0000","last_fullsized":"2024-09-19T06:40:08.257610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:35.506647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076492+0000","last_change":"2024-09-19T06:38:14.048779+0000","last_active":"2024-09-19T06:40:08.076492+0000","last_peered":"2024-09-19T06:40:08.076492+0000","last_clean":"2024-09-19T06:40:08.076492+0000","last_became_active":"2024-09-19T06:38:14.048492+0000","last_became_peered":"2024-09-19T06:38:14.048492+0000","last_unstale":"2024-09-19T06:40:08.076492+0000","last_undegraded":"2024-09-19T06:40:08.076492+0000","last_fullsized":"2024-09-19T06:40:08.076492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:01.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076981+0000","last_change":"2024-09-19T06:38:14.054442+0000","last_active":"2024-09-19T06:40:08.076981+0000","last_peered":"2024-09-19T06:40:08.076981+0000","last_clean":"2024-09-19T06:40:08.076981+0000","last_became_active":"2024-09-19T06:38:14.053903+0000","last_became_peered":"2024-09-19T06:38:14.053903+0000","last_unstale":"2024-09-19T06:40:08.076981+0000","last_undegraded":"2024-09-19T06:40:08.076981+0000","last_fullsized":"2024-09-19T06:40:08.076981+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:42.002146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193936+0000","last_change":"2024-09-19T06:38:14.051139+0000","last_active":"2024-09-19T06:40:08.193936+0000","last_peered":"2024-09-19T06:40:08.193936+0000","last_clean":"2024-09-19T06:40:08.193936+0000","last_became_active":"2024-09-19T06:38:14.050764+0000","last_became_peered":"2024-09-19T06:38:14.050764+0000","last_unstale":"2024-09-19T06:40:08.193936+0000","last_undegraded":"2024-09-19T06:40:08.193936+0000","last_fullsized":"2024-09-19T06:40:08.193936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.379184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275728+0000","last_change":"2024-09-19T06:38:14.054614+0000","last_active":"2024-09-19T06:40:08.275728+0000","last_peered":"2024-09-19T06:40:08.275728+0000","last_clean":"2024-09-19T06:40:08.275728+0000","last_became_active":"2024-09-19T06:38:14.054280+0000","last_became_peered":"2024-09-19T06:38:14.054280+0000","last_unstale":"2024-09-19T06:40:08.275728+0000","last_undegraded":"2024-09-19T06:40:08.275728+0000","last_fullsized":"2024-09-19T06:40:08.275728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:21.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274136+0000","last_change":"2024-09-19T06:38:14.056215+0000","last_active":"2024-09-19T06:40:08.274136+0000","last_peered":"2024-09-19T06:40:08.274136+0000","last_clean":"2024-09-19T06:40:08.274136+0000","last_became_active":"2024-09-19T06:38:14.055875+0000","last_became_peered":"2024-09-19T06:38:14.055875+0000","last_unstale":"2024-09-19T06:40:08.274136+0000","last_undegraded":"2024-09-19T06:40:08.274136+0000","last_fullsized":"2024-09-19T06:40:08.274136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:45.347185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076524+0000","last_change":"2024-09-19T06:38:14.057963+0000","last_active":"2024-09-19T06:40:08.076524+0000","last_peered":"2024-09-19T06:40:08.076524+0000","last_clean":"2024-09-19T06:40:08.076524+0000","last_became_active":"2024-09-19T06:38:14.057578+0000","last_became_peered":"2024-09-19T06:38:14.057578+0000","last_unstale":"2024-09-19T06:40:08.076524+0000","last_undegraded":"2024-09-19T06:40:08.076524+0000","last_fullsized":"2024-09-19T06:40:08.076524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:26.173414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076544+0000","last_change":"2024-09-19T06:38:14.058840+0000","last_active":"2024-09-19T06:40:08.076544+0000","last_peered":"2024-09-19T06:40:08.076544+0000","last_clean":"2024-09-19T06:40:08.076544+0000","last_became_active":"2024-09-19T06:38:14.058418+0000","last_became_peered":"2024-09-19T06:38:14.058418+0000","last_unstale":"2024-09-19T06:40:08.076544+0000","last_undegraded":"2024-09-19T06:40:08.076544+0000","last_fullsized":"2024-09-19T06:40:08.076544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:13.624750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193600+0000","last_change":"2024-09-19T06:38:14.053363+0000","last_active":"2024-09-19T06:40:08.193600+0000","last_peered":"2024-09-19T06:40:08.193600+0000","last_clean":"2024-09-19T06:40:08.193600+0000","last_became_active":"2024-09-19T06:38:14.053039+0000","last_became_peered":"2024-09-19T06:38:14.053039+0000","last_unstale":"2024-09-19T06:40:08.193600+0000","last_undegraded":"2024-09-19T06:40:08.193600+0000","last_fullsized":"2024-09-19T06:40:08.193600+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.274885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185012+0000","last_change":"2024-09-19T06:38:14.045719+0000","last_active":"2024-09-19T06:40:08.185012+0000","last_peered":"2024-09-19T06:40:08.185012+0000","last_clean":"2024-09-19T06:40:08.185012+0000","last_became_active":"2024-09-19T06:38:14.045285+0000","last_became_peered":"2024-09-19T06:38:14.045285+0000","last_unstale":"2024-09-19T06:40:08.185012+0000","last_undegraded":"2024-09-19T06:40:08.185012+0000","last_fullsized":"2024-09-19T06:40:08.185012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:16.877802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":150,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257864+0000","last_change":"2024-09-19T06:38:23.177942+0000","last_active":"2024-09-19T06:40:08.257864+0000","last_peered":"2024-09-19T06:40:08.257864+0000","last_clean":"2024-09-19T06:40:08.257864+0000","last_became_active":"2024-09-19T06:38:23.176579+0000","last_became_peered":"2024-09-19T06:38:23.176579+0000","last_unstale":"2024-09-19T06:40:08.257864+0000","last_undegraded":"2024-09-19T06:40:08.257864+0000","last_fullsized":"2024-09-19T06:40:08.257864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:28.140245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257665+0000","last_change":"2024-09-19T06:38:23.811603+0000","last_active":"2024-09-19T06:40:08.257665+0000","last_peered":"2024-09-19T06:40:08.257665+0000","last_clean":"2024-09-19T06:40:08.257665+0000","last_became_active":"2024-09-19T06:38:23.811139+0000","last_became_peered":"2024-09-19T06:38:23.811139+0000","last_unstale":"2024-09-19T06:40:08.257665+0000","last_undegraded":"2024-09-19T06:40:08.257665+0000","last_fullsized":"2024-09-19T06:40:08.257665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:42.082355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196626+0000","last_change":"2024-09-19T06:38:12.041330+0000","last_active":"2024-09-19T06:40:08.196626+0000","last_peered":"2024-09-19T06:40:08.196626+0000","last_clean":"2024-09-19T06:40:08.196626+0000","last_became_active":"2024-09-19T06:38:12.040992+0000","last_became_peered":"2024-09-19T06:38:12.040992+0000","last_unstale":"2024-09-19T06:40:08.196626+0000","last_undegraded":"2024-09-19T06:40:08.196626+0000","last_fullsized":"2024-09-19T06:40:08.196626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:51.721009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275224+0000","last_change":"2024-09-19T06:38:12.034534+0000","last_active":"2024-09-19T06:40:08.275224+0000","last_peered":"2024-09-19T06:40:08.275224+0000","last_clean":"2024-09-19T06:40:08.275224+0000","last_became_active":"2024-09-19T06:38:12.034209+0000","last_became_peered":"2024-09-19T06:38:12.034209+0000","last_unstale":"2024-09-19T06:40:08.275224+0000","last_undegraded":"2024-09-19T06:40:08.275224+0000","last_fullsized":"2024-09-19T06:40:08.275224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:40.640464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075337+0000","last_change":"2024-09-19T06:38:14.043287+0000","last_active":"2024-09-19T06:40:08.075337+0000","last_peered":"2024-09-19T06:40:08.075337+0000","last_clean":"2024-09-19T06:40:08.075337+0000","last_became_active":"2024-09-19T06:38:14.042565+0000","last_became_peered":"2024-09-19T06:38:14.042565+0000","last_unstale":"2024-09-19T06:40:08.075337+0000","last_undegraded":"2024-09-19T06:40:08.075337+0000","last_fullsized":"2024-09-19T06:40:08.075337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:32.689929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257848+0000","last_change":"2024-09-19T06:38:12.039142+0000","last_active":"2024-09-19T06:40:08.257848+0000","last_peered":"2024-09-19T06:40:08.257848+0000","last_clean":"2024-09-19T06:40:08.257848+0000","last_became_active":"2024-09-19T06:38:12.038815+0000","last_became_peered":"2024-09-19T06:38:12.038815+0000","last_unstale":"2024-09-19T06:40:08.257848+0000","last_undegraded":"2024-09-19T06:40:08.257848+0000","last_fullsized":"2024-09-19T06:40:08.257848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:03.316742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182141+0000","last_change":"2024-09-19T06:38:14.044778+0000","last_active":"2024-09-19T06:40:08.182141+0000","last_peered":"2024-09-19T06:40:08.182141+0000","last_clean":"2024-09-19T06:40:08.182141+0000","last_became_active":"2024-09-19T06:38:14.044457+0000","last_became_peered":"2024-09-19T06:38:14.044457+0000","last_unstale":"2024-09-19T06:40:08.182141+0000","last_undegraded":"2024-09-19T06:40:08.182141+0000","last_fullsized":"2024-09-19T06:40:08.182141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:06.342070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":243,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.802495+0000","last_change":"2024-09-19T06:38:12.039031+0000","last_active":"2024-09-19T06:40:08.802495+0000","last_peered":"2024-09-19T06:40:08.802495+0000","last_clean":"2024-09-19T06:40:08.802495+0000","last_became_active":"2024-09-19T06:38:12.038346+0000","last_became_peered":"2024-09-19T06:38:12.038346+0000","last_unstale":"2024-09-19T06:40:08.802495+0000","last_undegraded":"2024-09-19T06:40:08.802495+0000","last_fullsized":"2024-09-19T06:40:08.802495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:33.752330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273694+0000","last_change":"2024-09-19T06:38:14.045159+0000","last_active":"2024-09-19T06:40:08.273694+0000","last_peered":"2024-09-19T06:40:08.273694+0000","last_clean":"2024-09-19T06:40:08.273694+0000","last_became_active":"2024-09-19T06:38:14.044822+0000","last_became_peered":"2024-09-19T06:38:14.044822+0000","last_unstale":"2024-09-19T06:40:08.273694+0000","last_undegraded":"2024-09-19T06:40:08.273694+0000","last_fullsized":"2024-09-19T06:40:08.273694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:05.143507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076765+0000","last_change":"2024-09-19T06:38:12.037820+0000","last_active":"2024-09-19T06:40:08.076765+0000","last_peered":"2024-09-19T06:40:08.076765+0000","last_clean":"2024-09-19T06:40:08.076765+0000","last_became_active":"2024-09-19T06:38:12.037417+0000","last_became_peered":"2024-09-19T06:38:12.037417+0000","last_unstale":"2024-09-19T06:40:08.076765+0000","last_undegraded":"2024-09-19T06:40:08.076765+0000","last_fullsized":"2024-09-19T06:40:08.076765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:22.516704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274674+0000","last_change":"2024-09-19T06:38:14.048633+0000","last_active":"2024-09-19T06:40:08.274674+0000","last_peered":"2024-09-19T06:40:08.274674+0000","last_clean":"2024-09-19T06:40:08.274674+0000","last_became_active":"2024-09-19T06:38:14.048257+0000","last_became_peered":"2024-09-19T06:38:14.048257+0000","last_unstale":"2024-09-19T06:40:08.274674+0000","last_undegraded":"2024-09-19T06:40:08.274674+0000","last_fullsized":"2024-09-19T06:40:08.274674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:16.509071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257784+0000","last_change":"2024-09-19T06:38:12.047175+0000","last_active":"2024-09-19T06:40:08.257784+0000","last_peered":"2024-09-19T06:40:08.257784+0000","last_clean":"2024-09-19T06:40:08.257784+0000","last_became_active":"2024-09-19T06:38:12.046781+0000","last_became_peered":"2024-09-19T06:38:12.046781+0000","last_unstale":"2024-09-19T06:40:08.257784+0000","last_undegraded":"2024-09-19T06:40:08.257784+0000","last_fullsized":"2024-09-19T06:40:08.257784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:38.774803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273461+0000","last_change":"2024-09-19T06:38:23.067812+0000","last_active":"2024-09-19T06:40:08.273461+0000","last_peered":"2024-09-19T06:40:08.273461+0000","last_clean":"2024-09-19T06:40:08.273461+0000","last_became_active":"2024-09-19T06:38:23.067357+0000","last_became_peered":"2024-09-19T06:38:23.067357+0000","last_unstale":"2024-09-19T06:40:08.273461+0000","last_undegraded":"2024-09-19T06:40:08.273461+0000","last_fullsized":"2024-09-19T06:40:08.273461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:34.719243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'35","reported_seq":299,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.802563+0000","last_change":"2024-09-19T06:38:23.186703+0000","last_active":"2024-09-19T06:40:08.802563+0000","last_peered":"2024-09-19T06:40:08.802563+0000","last_clean":"2024-09-19T06:40:08.802563+0000","last_became_active":"2024-09-19T06:38:23.177212+0000","last_became_peered":"2024-09-19T06:38:23.177212+0000","last_unstale":"2024-09-19T06:40:08.802563+0000","last_undegraded":"2024-09-19T06:40:08.802563+0000","last_fullsized":"2024-09-19T06:40:08.802563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:46.884624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65927,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":174,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185343+0000","last_change":"2024-09-19T06:38:14.054619+0000","last_active":"2024-09-19T06:40:08.185343+0000","last_peered":"2024-09-19T06:40:08.185343+0000","last_clean":"2024-09-19T06:40:08.185343+0000","last_became_active":"2024-09-19T06:38:14.054118+0000","last_became_peered":"2024-09-19T06:38:14.054118+0000","last_unstale":"2024-09-19T06:40:08.185343+0000","last_undegraded":"2024-09-19T06:40:08.185343+0000","last_fullsized":"2024-09-19T06:40:08.185343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:41.041603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076764+0000","last_change":"2024-09-19T06:38:12.040272+0000","last_active":"2024-09-19T06:40:08.076764+0000","last_peered":"2024-09-19T06:40:08.076764+0000","last_clean":"2024-09-19T06:40:08.076764+0000","last_became_active":"2024-09-19T06:38:12.039940+0000","last_became_peered":"2024-09-19T06:38:12.039940+0000","last_unstale":"2024-09-19T06:40:08.076764+0000","last_undegraded":"2024-09-19T06:40:08.076764+0000","last_fullsized":"2024-09-19T06:40:08.076764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:53.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275371+0000","last_change":"2024-09-19T06:38:14.049535+0000","last_active":"2024-09-19T06:40:08.275371+0000","last_peered":"2024-09-19T06:40:08.275371+0000","last_clean":"2024-09-19T06:40:08.275371+0000","last_became_active":"2024-09-19T06:38:14.049208+0000","last_became_peered":"2024-09-19T06:38:14.049208+0000","last_unstale":"2024-09-19T06:40:08.275371+0000","last_undegraded":"2024-09-19T06:40:08.275371+0000","last_fullsized":"2024-09-19T06:40:08.275371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:03.359786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257731+0000","last_change":"2024-09-19T06:38:12.037346+0000","last_active":"2024-09-19T06:40:08.257731+0000","last_peered":"2024-09-19T06:40:08.257731+0000","last_clean":"2024-09-19T06:40:08.257731+0000","last_became_active":"2024-09-19T06:38:12.036986+0000","last_became_peered":"2024-09-19T06:38:12.036986+0000","last_unstale":"2024-09-19T06:40:08.257731+0000","last_undegraded":"2024-09-19T06:40:08.257731+0000","last_fullsized":"2024-09-19T06:40:08.257731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:26.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076694+0000","last_change":"2024-09-19T06:38:14.059454+0000","last_active":"2024-09-19T06:40:08.076694+0000","last_peered":"2024-09-19T06:40:08.076694+0000","last_clean":"2024-09-19T06:40:08.076694+0000","last_became_active":"2024-09-19T06:38:14.058996+0000","last_became_peered":"2024-09-19T06:38:14.058996+0000","last_unstale":"2024-09-19T06:40:08.076694+0000","last_undegraded":"2024-09-19T06:40:08.076694+0000","last_fullsized":"2024-09-19T06:40:08.076694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:54.645395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":142,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.802915+0000","last_change":"2024-09-19T06:38:12.043687+0000","last_active":"2024-09-19T06:40:08.802915+0000","last_peered":"2024-09-19T06:40:08.802915+0000","last_clean":"2024-09-19T06:40:08.802915+0000","last_became_active":"2024-09-19T06:38:12.043268+0000","last_became_peered":"2024-09-19T06:38:12.043268+0000","last_unstale":"2024-09-19T06:40:08.802915+0000","last_undegraded":"2024-09-19T06:40:08.802915+0000","last_fullsized":"2024-09-19T06:40:08.802915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:18.753736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076233+0000","last_change":"2024-09-19T06:38:14.052184+0000","last_active":"2024-09-19T06:40:08.076233+0000","last_peered":"2024-09-19T06:40:08.076233+0000","last_clean":"2024-09-19T06:40:08.076233+0000","last_became_active":"2024-09-19T06:38:14.051736+0000","last_became_peered":"2024-09-19T06:38:14.051736+0000","last_unstale":"2024-09-19T06:40:08.076233+0000","last_undegraded":"2024-09-19T06:40:08.076233+0000","last_fullsized":"2024-09-19T06:40:08.076233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:12.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:12.048418+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:12.047948+0000","last_became_peered":"2024-09-19T06:38:12.047948+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:06.059904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181946+0000","last_change":"2024-09-19T06:38:23.175961+0000","last_active":"2024-09-19T06:40:08.181946+0000","last_peered":"2024-09-19T06:40:08.181946+0000","last_clean":"2024-09-19T06:40:08.181946+0000","last_became_active":"2024-09-19T06:38:23.175629+0000","last_became_peered":"2024-09-19T06:38:23.175629+0000","last_unstale":"2024-09-19T06:40:08.181946+0000","last_undegraded":"2024-09-19T06:40:08.181946+0000","last_fullsized":"2024-09-19T06:40:08.181946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185296+0000","last_change":"2024-09-19T06:38:12.038945+0000","last_active":"2024-09-19T06:40:08.185296+0000","last_peered":"2024-09-19T06:40:08.185296+0000","last_clean":"2024-09-19T06:40:08.185296+0000","last_became_active":"2024-09-19T06:38:12.038571+0000","last_became_peered":"2024-09-19T06:38:12.038571+0000","last_unstale":"2024-09-19T06:40:08.185296+0000","last_undegraded":"2024-09-19T06:40:08.185296+0000","last_fullsized":"2024-09-19T06:40:08.185296+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:57.887070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193798+0000","last_change":"2024-09-19T06:38:14.056481+0000","last_active":"2024-09-19T06:40:08.193798+0000","last_peered":"2024-09-19T06:40:08.193798+0000","last_clean":"2024-09-19T06:40:08.193798+0000","last_became_active":"2024-09-19T06:38:14.056177+0000","last_became_peered":"2024-09-19T06:38:14.056177+0000","last_unstale":"2024-09-19T06:40:08.193798+0000","last_undegraded":"2024-09-19T06:40:08.193798+0000","last_fullsized":"2024-09-19T06:40:08.193798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.734802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276561+0000","last_change":"2024-09-19T06:38:12.038826+0000","last_active":"2024-09-19T06:40:08.276561+0000","last_peered":"2024-09-19T06:40:08.276561+0000","last_clean":"2024-09-19T06:40:08.276561+0000","last_became_active":"2024-09-19T06:38:12.038516+0000","last_became_peered":"2024-09-19T06:38:12.038516+0000","last_unstale":"2024-09-19T06:40:08.276561+0000","last_undegraded":"2024-09-19T06:40:08.276561+0000","last_fullsized":"2024-09-19T06:40:08.276561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:16.709742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076941+0000","last_change":"2024-09-19T06:38:14.053888+0000","last_active":"2024-09-19T06:40:08.076941+0000","last_peered":"2024-09-19T06:40:08.076941+0000","last_clean":"2024-09-19T06:40:08.076941+0000","last_became_active":"2024-09-19T06:38:14.053524+0000","last_became_peered":"2024-09-19T06:38:14.053524+0000","last_unstale":"2024-09-19T06:40:08.076941+0000","last_undegraded":"2024-09-19T06:40:08.076941+0000","last_fullsized":"2024-09-19T06:40:08.076941+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:54.853786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'41","reported_seq":62,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.310545+0000","last_change":"2024-09-19T06:39:23.715975+0000","last_active":"2024-09-19T06:40:08.310545+0000","last_peered":"2024-09-19T06:40:08.310545+0000","last_clean":"2024-09-19T06:40:08.310545+0000","last_became_active":"2024-09-19T06:39:23.713052+0000","last_became_peered":"2024-09-19T06:39:23.713052+0000","last_unstale":"2024-09-19T06:40:08.310545+0000","last_undegraded":"2024-09-19T06:40:08.310545+0000","last_fullsized":"2024-09-19T06:40:08.310545+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:42.887751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076532+0000","last_change":"2024-09-19T06:38:14.052210+0000","last_active":"2024-09-19T06:40:08.076532+0000","last_peered":"2024-09-19T06:40:08.076532+0000","last_clean":"2024-09-19T06:40:08.076532+0000","last_became_active":"2024-09-19T06:38:14.051803+0000","last_became_peered":"2024-09-19T06:38:14.051803+0000","last_unstale":"2024-09-19T06:40:08.076532+0000","last_undegraded":"2024-09-19T06:40:08.076532+0000","last_fullsized":"2024-09-19T06:40:08.076532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:40.751672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'8","reported_seq":144,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.825713+0000","last_change":"2024-09-19T06:38:12.118077+0000","last_active":"2024-09-19T06:40:08.825713+0000","last_peered":"2024-09-19T06:40:08.825713+0000","last_clean":"2024-09-19T06:40:08.825713+0000","last_became_active":"2024-09-19T06:38:12.117690+0000","last_became_peered":"2024-09-19T06:38:12.117690+0000","last_unstale":"2024-09-19T06:40:08.825713+0000","last_undegraded":"2024-09-19T06:40:08.825713+0000","last_fullsized":"2024-09-19T06:40:08.825713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.828335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076689+0000","last_change":"2024-09-19T06:38:14.054014+0000","last_active":"2024-09-19T06:40:08.076689+0000","last_peered":"2024-09-19T06:40:08.076689+0000","last_clean":"2024-09-19T06:40:08.076689+0000","last_became_active":"2024-09-19T06:38:14.053349+0000","last_became_peered":"2024-09-19T06:38:14.053349+0000","last_unstale":"2024-09-19T06:40:08.076689+0000","last_undegraded":"2024-09-19T06:40:08.076689+0000","last_fullsized":"2024-09-19T06:40:08.076689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:40.117720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076455+0000","last_change":"2024-09-19T06:37:02.166696+0000","last_active":"2024-09-19T06:40:08.076455+0000","last_peered":"2024-09-19T06:40:08.076455+0000","last_clean":"2024-09-19T06:40:08.076455+0000","last_became_active":"2024-09-19T06:37:02.166225+0000","last_became_peered":"2024-09-19T06:37:02.166225+0000","last_unstale":"2024-09-19T06:40:08.076455+0000","last_undegraded":"2024-09-19T06:40:08.076455+0000","last_fullsized":"2024-09-19T06:40:08.076455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_clean_scrub_stamp":"2024-09-19T06:33:40.535354+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:46.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274179+0000","last_change":"2024-09-19T06:38:12.044465+0000","last_active":"2024-09-19T06:40:08.274179+0000","last_peered":"2024-09-19T06:40:08.274179+0000","last_clean":"2024-09-19T06:40:08.274179+0000","last_became_active":"2024-09-19T06:38:12.044042+0000","last_became_peered":"2024-09-19T06:38:12.044042+0000","last_unstale":"2024-09-19T06:40:08.274179+0000","last_undegraded":"2024-09-19T06:40:08.274179+0000","last_fullsized":"2024-09-19T06:40:08.274179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:40.759264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075774+0000","last_change":"2024-09-19T06:38:14.045102+0000","last_active":"2024-09-19T06:40:08.075774+0000","last_peered":"2024-09-19T06:40:08.075774+0000","last_clean":"2024-09-19T06:40:08.075774+0000","last_became_active":"2024-09-19T06:38:14.044785+0000","last_became_peered":"2024-09-19T06:38:14.044785+0000","last_unstale":"2024-09-19T06:40:08.075774+0000","last_undegraded":"2024-09-19T06:40:08.075774+0000","last_fullsized":"2024-09-19T06:40:08.075774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:57.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076395+0000","last_change":"2024-09-19T06:39:24.353205+0000","last_active":"2024-09-19T06:40:08.076395+0000","last_peered":"2024-09-19T06:40:08.076395+0000","last_clean":"2024-09-19T06:40:08.076395+0000","last_became_active":"2024-09-19T06:39:24.350315+0000","last_became_peered":"2024-09-19T06:39:24.350315+0000","last_unstale":"2024-09-19T06:40:08.076395+0000","last_undegraded":"2024-09-19T06:40:08.076395+0000","last_fullsized":"2024-09-19T06:40:08.076395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:32.467330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,8],"acting":[7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275223+0000","last_change":"2024-09-19T06:38:14.054623+0000","last_active":"2024-09-19T06:40:08.275223+0000","last_peered":"2024-09-19T06:40:08.275223+0000","last_clean":"2024-09-19T06:40:08.275223+0000","last_became_active":"2024-09-19T06:38:14.054124+0000","last_became_peered":"2024-09-19T06:38:14.054124+0000","last_unstale":"2024-09-19T06:40:08.275223+0000","last_undegraded":"2024-09-19T06:40:08.275223+0000","last_fullsized":"2024-09-19T06:40:08.275223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:33.251059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":140,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.356255+0000","last_change":"2024-09-19T06:38:12.047284+0000","last_active":"2024-09-19T06:40:08.356255+0000","last_peered":"2024-09-19T06:40:08.356255+0000","last_clean":"2024-09-19T06:40:08.356255+0000","last_became_active":"2024-09-19T06:38:12.046886+0000","last_became_peered":"2024-09-19T06:38:12.046886+0000","last_unstale":"2024-09-19T06:40:08.356255+0000","last_undegraded":"2024-09-19T06:40:08.356255+0000","last_fullsized":"2024-09-19T06:40:08.356255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:15.030007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257667+0000","last_change":"2024-09-19T06:38:14.049351+0000","last_active":"2024-09-19T06:40:08.257667+0000","last_peered":"2024-09-19T06:40:08.257667+0000","last_clean":"2024-09-19T06:40:08.257667+0000","last_became_active":"2024-09-19T06:38:14.048792+0000","last_became_peered":"2024-09-19T06:38:14.048792+0000","last_unstale":"2024-09-19T06:40:08.257667+0000","last_undegraded":"2024-09-19T06:40:08.257667+0000","last_fullsized":"2024-09-19T06:40:08.257667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:30.431378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'9","reported_seq":145,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.824197+0000","last_change":"2024-09-19T06:38:12.037155+0000","last_active":"2024-09-19T06:40:08.824197+0000","last_peered":"2024-09-19T06:40:08.824197+0000","last_clean":"2024-09-19T06:40:08.824197+0000","last_became_active":"2024-09-19T06:38:12.036536+0000","last_became_peered":"2024-09-19T06:38:12.036536+0000","last_unstale":"2024-09-19T06:40:08.824197+0000","last_undegraded":"2024-09-19T06:40:08.824197+0000","last_fullsized":"2024-09-19T06:40:08.824197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:41.014783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196631+0000","last_change":"2024-09-19T06:38:14.055724+0000","last_active":"2024-09-19T06:40:08.196631+0000","last_peered":"2024-09-19T06:40:08.196631+0000","last_clean":"2024-09-19T06:40:08.196631+0000","last_became_active":"2024-09-19T06:38:14.054457+0000","last_became_peered":"2024-09-19T06:38:14.054457+0000","last_unstale":"2024-09-19T06:40:08.196631+0000","last_undegraded":"2024-09-19T06:40:08.196631+0000","last_fullsized":"2024-09-19T06:40:08.196631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:47.653709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182579+0000","last_change":"2024-09-19T06:38:12.049197+0000","last_active":"2024-09-19T06:40:08.182579+0000","last_peered":"2024-09-19T06:40:08.182579+0000","last_clean":"2024-09-19T06:40:08.182579+0000","last_became_active":"2024-09-19T06:38:12.048863+0000","last_became_peered":"2024-09-19T06:38:12.048863+0000","last_unstale":"2024-09-19T06:40:08.182579+0000","last_undegraded":"2024-09-19T06:40:08.182579+0000","last_fullsized":"2024-09-19T06:40:08.182579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:25.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196635+0000","last_change":"2024-09-19T06:38:14.042991+0000","last_active":"2024-09-19T06:40:08.196635+0000","last_peered":"2024-09-19T06:40:08.196635+0000","last_clean":"2024-09-19T06:40:08.196635+0000","last_became_active":"2024-09-19T06:38:14.042511+0000","last_became_peered":"2024-09-19T06:38:14.042511+0000","last_unstale":"2024-09-19T06:40:08.196635+0000","last_undegraded":"2024-09-19T06:40:08.196635+0000","last_fullsized":"2024-09-19T06:40:08.196635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:38.212838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193790+0000","last_change":"2024-09-19T06:38:23.064456+0000","last_active":"2024-09-19T06:40:08.193790+0000","last_peered":"2024-09-19T06:40:08.193790+0000","last_clean":"2024-09-19T06:40:08.193790+0000","last_became_active":"2024-09-19T06:38:23.064051+0000","last_became_peered":"2024-09-19T06:38:23.064051+0000","last_unstale":"2024-09-19T06:40:08.193790+0000","last_undegraded":"2024-09-19T06:40:08.193790+0000","last_fullsized":"2024-09-19T06:40:08.193790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:58.548420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275853+0000","last_change":"2024-09-19T06:38:14.048612+0000","last_active":"2024-09-19T06:40:08.275853+0000","last_peered":"2024-09-19T06:40:08.275853+0000","last_clean":"2024-09-19T06:40:08.275853+0000","last_became_active":"2024-09-19T06:38:14.048294+0000","last_became_peered":"2024-09-19T06:38:14.048294+0000","last_unstale":"2024-09-19T06:40:08.275853+0000","last_undegraded":"2024-09-19T06:40:08.275853+0000","last_fullsized":"2024-09-19T06:40:08.275853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:55.892149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'50","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.313781+0000","last_change":"2024-09-19T06:38:12.035269+0000","last_active":"2024-09-19T06:40:08.313781+0000","last_peered":"2024-09-19T06:40:08.313781+0000","last_clean":"2024-09-19T06:40:08.313781+0000","last_became_active":"2024-09-19T06:38:12.034841+0000","last_became_peered":"2024-09-19T06:38:12.034841+0000","last_unstale":"2024-09-19T06:40:08.313781+0000","last_undegraded":"2024-09-19T06:40:08.313781+0000","last_fullsized":"2024-09-19T06:40:08.313781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:19.642572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076503+0000","last_change":"2024-09-19T06:38:14.052492+0000","last_active":"2024-09-19T06:40:08.076503+0000","last_peered":"2024-09-19T06:40:08.076503+0000","last_clean":"2024-09-19T06:40:08.076503+0000","last_became_active":"2024-09-19T06:38:14.052191+0000","last_became_peered":"2024-09-19T06:38:14.052191+0000","last_unstale":"2024-09-19T06:40:08.076503+0000","last_undegraded":"2024-09-19T06:40:08.076503+0000","last_fullsized":"2024-09-19T06:40:08.076503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:34.006480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274336+0000","last_change":"2024-09-19T06:38:12.118430+0000","last_active":"2024-09-19T06:40:08.274336+0000","last_peered":"2024-09-19T06:40:08.274336+0000","last_clean":"2024-09-19T06:40:08.274336+0000","last_became_active":"2024-09-19T06:38:12.118065+0000","last_became_peered":"2024-09-19T06:38:12.118065+0000","last_unstale":"2024-09-19T06:40:08.274336+0000","last_undegraded":"2024-09-19T06:40:08.274336+0000","last_fullsized":"2024-09-19T06:40:08.274336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:25.861922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274974+0000","last_change":"2024-09-19T06:38:23.811305+0000","last_active":"2024-09-19T06:40:08.274974+0000","last_peered":"2024-09-19T06:40:08.274974+0000","last_clean":"2024-09-19T06:40:08.274974+0000","last_became_active":"2024-09-19T06:38:23.810840+0000","last_became_peered":"2024-09-19T06:38:23.810840+0000","last_unstale":"2024-09-19T06:40:08.274974+0000","last_undegraded":"2024-09-19T06:40:08.274974+0000","last_fullsized":"2024-09-19T06:40:08.274974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.019065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273364+0000","last_change":"2024-09-19T06:38:12.047670+0000","last_active":"2024-09-19T06:40:08.273364+0000","last_peered":"2024-09-19T06:40:08.273364+0000","last_clean":"2024-09-19T06:40:08.273364+0000","last_became_active":"2024-09-19T06:38:12.047312+0000","last_became_peered":"2024-09-19T06:38:12.047312+0000","last_unstale":"2024-09-19T06:40:08.273364+0000","last_undegraded":"2024-09-19T06:40:08.273364+0000","last_fullsized":"2024-09-19T06:40:08.273364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:47.477945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:14.047210+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:14.046836+0000","last_became_peered":"2024-09-19T06:38:14.046836+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:14.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075584+0000","last_change":"2024-09-19T06:38:12.032692+0000","last_active":"2024-09-19T06:40:08.075584+0000","last_peered":"2024-09-19T06:40:08.075584+0000","last_clean":"2024-09-19T06:40:08.075584+0000","last_became_active":"2024-09-19T06:38:12.031874+0000","last_became_peered":"2024-09-19T06:38:12.031874+0000","last_unstale":"2024-09-19T06:40:08.075584+0000","last_undegraded":"2024-09-19T06:40:08.075584+0000","last_fullsized":"2024-09-19T06:40:08.075584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.787964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193683+0000","last_change":"2024-09-19T06:38:14.053504+0000","last_active":"2024-09-19T06:40:08.193683+0000","last_peered":"2024-09-19T06:40:08.193683+0000","last_clean":"2024-09-19T06:40:08.193683+0000","last_became_active":"2024-09-19T06:38:14.053148+0000","last_became_peered":"2024-09-19T06:38:14.053148+0000","last_unstale":"2024-09-19T06:40:08.193683+0000","last_undegraded":"2024-09-19T06:40:08.193683+0000","last_fullsized":"2024-09-19T06:40:08.193683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:29.809295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076736+0000","last_change":"2024-09-19T06:38:12.038884+0000","last_active":"2024-09-19T06:40:08.076736+0000","last_peered":"2024-09-19T06:40:08.076736+0000","last_clean":"2024-09-19T06:40:08.076736+0000","last_became_active":"2024-09-19T06:38:12.038532+0000","last_became_peered":"2024-09-19T06:38:12.038532+0000","last_unstale":"2024-09-19T06:40:08.076736+0000","last_undegraded":"2024-09-19T06:40:08.076736+0000","last_fullsized":"2024-09-19T06:40:08.076736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.348690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075777+0000","last_change":"2024-09-19T06:38:14.045761+0000","last_active":"2024-09-19T06:40:08.075777+0000","last_peered":"2024-09-19T06:40:08.075777+0000","last_clean":"2024-09-19T06:40:08.075777+0000","last_became_active":"2024-09-19T06:38:14.045467+0000","last_became_peered":"2024-09-19T06:38:14.045467+0000","last_unstale":"2024-09-19T06:40:08.075777+0000","last_undegraded":"2024-09-19T06:40:08.075777+0000","last_fullsized":"2024-09-19T06:40:08.075777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.917945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185144+0000","last_change":"2024-09-19T06:39:23.748032+0000","last_active":"2024-09-19T06:40:08.185144+0000","last_peered":"2024-09-19T06:40:08.185144+0000","last_clean":"2024-09-19T06:40:08.185144+0000","last_became_active":"2024-09-19T06:39:23.744288+0000","last_became_peered":"2024-09-19T06:39:23.744288+0000","last_unstale":"2024-09-19T06:40:08.185144+0000","last_undegraded":"2024-09-19T06:40:08.185144+0000","last_fullsized":"2024-09-19T06:40:08.185144+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:50.668043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4],"acting":[8,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076545+0000","last_change":"2024-09-19T06:38:14.053935+0000","last_active":"2024-09-19T06:40:08.076545+0000","last_peered":"2024-09-19T06:40:08.076545+0000","last_clean":"2024-09-19T06:40:08.076545+0000","last_became_active":"2024-09-19T06:38:14.053542+0000","last_became_peered":"2024-09-19T06:38:14.053542+0000","last_unstale":"2024-09-19T06:40:08.076545+0000","last_undegraded":"2024-09-19T06:40:08.076545+0000","last_fullsized":"2024-09-19T06:40:08.076545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:25.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182280+0000","last_change":"2024-09-19T06:38:23.177133+0000","last_active":"2024-09-19T06:40:08.182280+0000","last_peered":"2024-09-19T06:40:08.182280+0000","last_clean":"2024-09-19T06:40:08.182280+0000","last_became_active":"2024-09-19T06:38:23.176810+0000","last_became_peered":"2024-09-19T06:38:23.176810+0000","last_unstale":"2024-09-19T06:40:08.182280+0000","last_undegraded":"2024-09-19T06:40:08.182280+0000","last_fullsized":"2024-09-19T06:40:08.182280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:56.307720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185240+0000","last_change":"2024-09-19T06:38:12.042699+0000","last_active":"2024-09-19T06:40:08.185240+0000","last_peered":"2024-09-19T06:40:08.185240+0000","last_clean":"2024-09-19T06:40:08.185240+0000","last_became_active":"2024-09-19T06:38:12.042148+0000","last_became_peered":"2024-09-19T06:38:12.042148+0000","last_unstale":"2024-09-19T06:40:08.185240+0000","last_undegraded":"2024-09-19T06:40:08.185240+0000","last_fullsized":"2024-09-19T06:40:08.185240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.953596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273371+0000","last_change":"2024-09-19T06:38:14.043279+0000","last_active":"2024-09-19T06:40:08.273371+0000","last_peered":"2024-09-19T06:40:08.273371+0000","last_clean":"2024-09-19T06:40:08.273371+0000","last_became_active":"2024-09-19T06:38:14.042914+0000","last_became_peered":"2024-09-19T06:38:14.042914+0000","last_unstale":"2024-09-19T06:40:08.273371+0000","last_undegraded":"2024-09-19T06:40:08.273371+0000","last_fullsized":"2024-09-19T06:40:08.273371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:22.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'13","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185441+0000","last_change":"2024-09-19T06:39:23.719397+0000","last_active":"2024-09-19T06:40:08.185441+0000","last_peered":"2024-09-19T06:40:08.185441+0000","last_clean":"2024-09-19T06:40:08.185441+0000","last_became_active":"2024-09-19T06:39:23.709128+0000","last_became_peered":"2024-09-19T06:39:23.709128+0000","last_unstale":"2024-09-19T06:40:08.185441+0000","last_undegraded":"2024-09-19T06:40:08.185441+0000","last_fullsized":"2024-09-19T06:40:08.185441+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:46.092401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274542+0000","last_change":"2024-09-19T06:38:14.041552+0000","last_active":"2024-09-19T06:40:08.274542+0000","last_peered":"2024-09-19T06:40:08.274542+0000","last_clean":"2024-09-19T06:40:08.274542+0000","last_became_active":"2024-09-19T06:38:14.041187+0000","last_became_peered":"2024-09-19T06:38:14.041187+0000","last_unstale":"2024-09-19T06:40:08.274542+0000","last_undegraded":"2024-09-19T06:40:08.274542+0000","last_fullsized":"2024-09-19T06:40:08.274542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:17.390457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076363+0000","last_change":"2024-09-19T06:38:12.047436+0000","last_active":"2024-09-19T06:40:08.076363+0000","last_peered":"2024-09-19T06:40:08.076363+0000","last_clean":"2024-09-19T06:40:08.076363+0000","last_became_active":"2024-09-19T06:38:12.046961+0000","last_became_peered":"2024-09-19T06:38:12.046961+0000","last_unstale":"2024-09-19T06:40:08.076363+0000","last_undegraded":"2024-09-19T06:40:08.076363+0000","last_fullsized":"2024-09-19T06:40:08.076363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076212+0000","last_change":"2024-09-19T06:38:14.049660+0000","last_active":"2024-09-19T06:40:08.076212+0000","last_peered":"2024-09-19T06:40:08.076212+0000","last_clean":"2024-09-19T06:40:08.076212+0000","last_became_active":"2024-09-19T06:38:14.049375+0000","last_became_peered":"2024-09-19T06:38:14.049375+0000","last_unstale":"2024-09-19T06:40:08.076212+0000","last_undegraded":"2024-09-19T06:40:08.076212+0000","last_fullsized":"2024-09-19T06:40:08.076212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:08.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'15","reported_seq":159,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.357314+0000","last_change":"2024-09-19T06:38:23.071068+0000","last_active":"2024-09-19T06:40:08.357314+0000","last_peered":"2024-09-19T06:40:08.357314+0000","last_clean":"2024-09-19T06:40:08.357314+0000","last_became_active":"2024-09-19T06:38:23.067129+0000","last_became_peered":"2024-09-19T06:38:23.067129+0000","last_unstale":"2024-09-19T06:40:08.357314+0000","last_undegraded":"2024-09-19T06:40:08.357314+0000","last_fullsized":"2024-09-19T06:40:08.357314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:15.387758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600254,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1183,"num_read_kb":708,"num_write":376,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2264,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2162688,"data_stored":1800762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":598089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776168,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41260,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703892,"statfs":{"total":95995035648,"available":95952785408,"internally_reserved":0,"allocated":1732608,"data_stored":1182233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28376,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716776,"statfs":{"total":95995035648,"available":95965978624,"internally_reserved":0,"allocated":1380352,"data_stored":858526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168626,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28356,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716796,"statfs":{"total":95995035648,"available":95965999104,"internally_reserved":0,"allocated":1359872,"data_stored":858120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1581056,"data_stored":1059977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528381,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":456768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32740,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712412,"statfs":{"total":95995035648,"available":95961509888,"internally_reserved":0,"allocated":1589248,"data_stored":1057957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1052672,"data_stored":532364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":989668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":466465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40528,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704624,"statfs":{"total":95995035648,"available":95953534976,"internally_reserved":0,"allocated":1044480,"data_stored":533774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":467293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":199656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":133901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:40:11.600 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T06:40:11.600 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:40:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.749+0000 7f314ffff640 1 -- 172.21.15.12:0/515289211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3150100b90 msgr2=0x7f3150100ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.749+0000 7f314ffff640 1 --2- 172.21.15.12:0/515289211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3150100b90 0x7f3150100ff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3144009900 tx=0x7f314402a480 comp rx=0 tx=0).stop 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.749+0000 7f314ffff640 1 -- 172.21.15.12:0/515289211 shutdown_connections 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.749+0000 7f314ffff640 1 --2- 172.21.15.12:0/515289211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3150101530 0x7f31501019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.749+0000 7f314ffff640 1 --2- 172.21.15.12:0/515289211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3150100b90 0x7f3150100ff0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.749+0000 7f314ffff640 1 --2- 172.21.15.12:0/515289211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3150100250 0x7f3150100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.749+0000 7f314ffff640 1 -- 172.21.15.12:0/515289211 >> 172.21.15.12:0/515289211 conn(0x7f31500fc000 msgr2=0x7f31500fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.749+0000 7f314ffff640 1 -- 172.21.15.12:0/515289211 shutdown_connections 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.749+0000 7f314ffff640 1 -- 172.21.15.12:0/515289211 wait complete. 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314ffff640 1 Processor -- start 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314ffff640 1 -- start start 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3150100250 0x7f3150199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3150100b90 0x7f315019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3150101530 0x7f31501a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314ffff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f315010f7e0 con 0x7f3150100250 2024-09-19T06:40:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314ffff640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f315010f660 con 0x7f3150101530 2024-09-19T06:40:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314ffff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f315010f960 con 0x7f3150100b90 2024-09-19T06:40:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3150100250 0x7f3150199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3150100250 0x7f3150199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36818/0 (socket says 172.21.15.12:36818) 2024-09-19T06:40:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314effd640 1 -- 172.21.15.12:0/3747844813 learned_addr learned my addr 172.21.15.12:0/3747844813 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314f7fe640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3150101530 0x7f31501a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.750+0000 7f314e7fc640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3150100b90 0x7f315019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f314effd640 1 -- 172.21.15.12:0/3747844813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3150100b90 msgr2=0x7f315019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f314effd640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3150100b90 0x7f315019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f314effd640 1 -- 172.21.15.12:0/3747844813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3150101530 msgr2=0x7f31501a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f314effd640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3150101530 0x7f31501a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f314effd640 1 -- 172.21.15.12:0/3747844813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31501a1ac0 con 0x7f3150100250 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f314f7fe640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3150101530 0x7f31501a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f314effd640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3150100250 0x7f3150199ea0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f314000e9f0 tx=0x7f314000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f3137fff640 1 -- 172.21.15.12:0/3747844813 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314000cd80 con 0x7f3150100250 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f314ffff640 1 -- 172.21.15.12:0/3747844813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31501a1db0 con 0x7f3150100250 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f3137fff640 1 -- 172.21.15.12:0/3747844813 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3140005500 con 0x7f3150100250 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f314ffff640 1 -- 172.21.15.12:0/3747844813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31501a2210 con 0x7f3150100250 2024-09-19T06:40:11.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.751+0000 7f3137fff640 1 -- 172.21.15.12:0/3747844813 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140010690 con 0x7f3150100250 2024-09-19T06:40:11.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.752+0000 7f314ffff640 1 -- 172.21.15.12:0/3747844813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315010afa0 con 0x7f3150100250 2024-09-19T06:40:11.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.754+0000 7f3137fff640 1 -- 172.21.15.12:0/3747844813 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7f31400046c0 con 0x7f3150100250 2024-09-19T06:40:11.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.755+0000 7f3137fff640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f31380a33c0 0x7f31380a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.756+0000 7f3137fff640 1 -- 172.21.15.12:0/3747844813 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f31400d0400 con 0x7f3150100250 2024-09-19T06:40:11.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.756+0000 7f314e7fc640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f31380a33c0 0x7f31380a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.756+0000 7f314e7fc640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f31380a33c0 0x7f31380a5880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f31440314e0 tx=0x7f3144000bc0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:11.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.758+0000 7f3137fff640 1 -- 172.21.15.12:0/3747844813 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3140054210 con 0x7f3150100250 2024-09-19T06:40:11.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: [19/Sep/2024:06:40:10] ENGINE Serving on https://172.21.15.12:7150 2024-09-19T06:40:11.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: [19/Sep/2024:06:40:10] ENGINE Error in HTTPServer.serve 2024-09-19T06:40:11.759 INFO:journalctl@ceph.mon.b.smithi016.stdout: Traceback (most recent call last): 2024-09-19T06:40:11.759 INFO:journalctl@ceph.mon.b.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:40:11.759 INFO:journalctl@ceph.mon.b.smithi016.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:40:11.760 INFO:journalctl@ceph.mon.b.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:40:11.760 INFO:journalctl@ceph.mon.b.smithi016.stdout: self._run(expiration_interval) 2024-09-19T06:40:11.760 INFO:journalctl@ceph.mon.b.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:40:11.760 INFO:journalctl@ceph.mon.b.smithi016.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:40:11.760 INFO:journalctl@ceph.mon.b.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:40:11.760 INFO:journalctl@ceph.mon.b.smithi016.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:40:11.760 INFO:journalctl@ceph.mon.b.smithi016.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:40:11.760 INFO:journalctl@ceph.mon.b.smithi016.stdout: s = self.context.wrap_socket( 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout: return self.sslsocket_class._create( 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout: self.do_handshake() 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout: self._sslobj.do_handshake() 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: [19/Sep/2024:06:40:10] ENGINE Serving on http://172.21.15.12:8765 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: [19/Sep/2024:06:40:10] ENGINE Bus STARTED 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.763 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:11.763 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: mgrmap e22: x(active, since 3s), standbys: y, z 2024-09-19T06:40:11.763 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.763 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:11 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:11.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.936+0000 7f314ffff640 1 -- 172.21.15.12:0/3747844813 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3150062630 con 0x7f31380a33c0 2024-09-19T06:40:11.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.943+0000 7f3137fff640 1 -- 172.21.15.12:0/3747844813 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257795 (secure 0 0 0) 0x7f3150062630 con 0x7f31380a33c0 2024-09-19T06:40:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:11.948 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-19T06:40:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 -- 172.21.15.12:0/3747844813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f31380a33c0 msgr2=0x7f31380a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f31380a33c0 0x7f31380a5880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f31440314e0 tx=0x7f3144000bc0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 -- 172.21.15.12:0/3747844813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3150100250 msgr2=0x7f3150199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3150100250 0x7f3150199ea0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f314000e9f0 tx=0x7f314000edf0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 -- 172.21.15.12:0/3747844813 shutdown_connections 2024-09-19T06:40:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3150101530 0x7f31501a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f31380a33c0 0x7f31380a5880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3150100b90 0x7f315019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 --2- 172.21.15.12:0/3747844813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3150100250 0x7f3150199ea0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 -- 172.21.15.12:0/3747844813 >> 172.21.15.12:0/3747844813 conn(0x7f31500fc000 msgr2=0x7f31500fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:11.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 -- 172.21.15.12:0/3747844813 shutdown_connections 2024-09-19T06:40:11.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:11.946+0000 7f314ffff640 1 -- 172.21.15.12:0/3747844813 wait complete. 2024-09-19T06:40:11.959 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-19T06:40:10.089803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190856,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1319,"num_read_kb":827,"num_write":559,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183000,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":942,"ondisk_log_size":942,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385072,"kb_used_data":14928,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124556752,"statfs":{"total":1151940427776,"available":1151546114048,"internally_reserved":0,"allocated":15286272,"data_stored":9061234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.927734"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193904+0000","last_change":"2024-09-19T06:38:14.052943+0000","last_active":"2024-09-19T06:40:08.193904+0000","last_peered":"2024-09-19T06:40:08.193904+0000","last_clean":"2024-09-19T06:40:08.193904+0000","last_became_active":"2024-09-19T06:38:14.052054+0000","last_became_peered":"2024-09-19T06:38:14.052054+0000","last_unstale":"2024-09-19T06:40:08.193904+0000","last_undegraded":"2024-09-19T06:40:08.193904+0000","last_fullsized":"2024-09-19T06:40:08.193904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:28.898131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274838+0000","last_change":"2024-09-19T06:38:14.044916+0000","last_active":"2024-09-19T06:40:08.274838+0000","last_peered":"2024-09-19T06:40:08.274838+0000","last_clean":"2024-09-19T06:40:08.274838+0000","last_became_active":"2024-09-19T06:38:14.044596+0000","last_became_peered":"2024-09-19T06:38:14.044596+0000","last_unstale":"2024-09-19T06:40:08.274838+0000","last_undegraded":"2024-09-19T06:40:08.274838+0000","last_fullsized":"2024-09-19T06:40:08.274838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:04.402332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274196+0000","last_change":"2024-09-19T06:38:14.052765+0000","last_active":"2024-09-19T06:40:08.274196+0000","last_peered":"2024-09-19T06:40:08.274196+0000","last_clean":"2024-09-19T06:40:08.274196+0000","last_became_active":"2024-09-19T06:38:14.052219+0000","last_became_peered":"2024-09-19T06:38:14.052219+0000","last_unstale":"2024-09-19T06:40:08.274196+0000","last_undegraded":"2024-09-19T06:40:08.274196+0000","last_fullsized":"2024-09-19T06:40:08.274196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:13.317252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274176+0000","last_change":"2024-09-19T06:38:14.052421+0000","last_active":"2024-09-19T06:40:08.274176+0000","last_peered":"2024-09-19T06:40:08.274176+0000","last_clean":"2024-09-19T06:40:08.274176+0000","last_became_active":"2024-09-19T06:38:14.052094+0000","last_became_peered":"2024-09-19T06:38:14.052094+0000","last_unstale":"2024-09-19T06:40:08.274176+0000","last_undegraded":"2024-09-19T06:40:08.274176+0000","last_fullsized":"2024-09-19T06:40:08.274176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185134+0000","last_change":"2024-09-19T06:38:14.047736+0000","last_active":"2024-09-19T06:40:08.185134+0000","last_peered":"2024-09-19T06:40:08.185134+0000","last_clean":"2024-09-19T06:40:08.185134+0000","last_became_active":"2024-09-19T06:38:14.047396+0000","last_became_peered":"2024-09-19T06:38:14.047396+0000","last_unstale":"2024-09-19T06:40:08.185134+0000","last_undegraded":"2024-09-19T06:40:08.185134+0000","last_fullsized":"2024-09-19T06:40:08.185134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.855638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196543+0000","last_change":"2024-09-19T06:38:14.047793+0000","last_active":"2024-09-19T06:40:08.196543+0000","last_peered":"2024-09-19T06:40:08.196543+0000","last_clean":"2024-09-19T06:40:08.196543+0000","last_became_active":"2024-09-19T06:38:14.047198+0000","last_became_peered":"2024-09-19T06:38:14.047198+0000","last_unstale":"2024-09-19T06:40:08.196543+0000","last_undegraded":"2024-09-19T06:40:08.196543+0000","last_fullsized":"2024-09-19T06:40:08.196543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:42.507270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076273+0000","last_change":"2024-09-19T06:38:14.050025+0000","last_active":"2024-09-19T06:40:08.076273+0000","last_peered":"2024-09-19T06:40:08.076273+0000","last_clean":"2024-09-19T06:40:08.076273+0000","last_became_active":"2024-09-19T06:38:14.049591+0000","last_became_peered":"2024-09-19T06:38:14.049591+0000","last_unstale":"2024-09-19T06:40:08.076273+0000","last_undegraded":"2024-09-19T06:40:08.076273+0000","last_fullsized":"2024-09-19T06:40:08.076273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:49.487521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181942+0000","last_change":"2024-09-19T06:38:23.065490+0000","last_active":"2024-09-19T06:40:08.181942+0000","last_peered":"2024-09-19T06:40:08.181942+0000","last_clean":"2024-09-19T06:40:08.181942+0000","last_became_active":"2024-09-19T06:38:23.065151+0000","last_became_peered":"2024-09-19T06:38:23.065151+0000","last_unstale":"2024-09-19T06:40:08.181942+0000","last_undegraded":"2024-09-19T06:40:08.181942+0000","last_fullsized":"2024-09-19T06:40:08.181942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:42.184698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273928+0000","last_change":"2024-09-19T06:38:14.047395+0000","last_active":"2024-09-19T06:40:08.273928+0000","last_peered":"2024-09-19T06:40:08.273928+0000","last_clean":"2024-09-19T06:40:08.273928+0000","last_became_active":"2024-09-19T06:38:14.046975+0000","last_became_peered":"2024-09-19T06:38:14.046975+0000","last_unstale":"2024-09-19T06:40:08.273928+0000","last_undegraded":"2024-09-19T06:40:08.273928+0000","last_fullsized":"2024-09-19T06:40:08.273928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:18.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196936+0000","last_change":"2024-09-19T06:38:14.055042+0000","last_active":"2024-09-19T06:40:08.196936+0000","last_peered":"2024-09-19T06:40:08.196936+0000","last_clean":"2024-09-19T06:40:08.196936+0000","last_became_active":"2024-09-19T06:38:14.054664+0000","last_became_peered":"2024-09-19T06:38:14.054664+0000","last_unstale":"2024-09-19T06:40:08.196936+0000","last_undegraded":"2024-09-19T06:40:08.196936+0000","last_fullsized":"2024-09-19T06:40:08.196936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.815277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076591+0000","last_change":"2024-09-19T06:38:14.055106+0000","last_active":"2024-09-19T06:40:08.076591+0000","last_peered":"2024-09-19T06:40:08.076591+0000","last_clean":"2024-09-19T06:40:08.076591+0000","last_became_active":"2024-09-19T06:38:14.054721+0000","last_became_peered":"2024-09-19T06:38:14.054721+0000","last_unstale":"2024-09-19T06:40:08.076591+0000","last_undegraded":"2024-09-19T06:40:08.076591+0000","last_fullsized":"2024-09-19T06:40:08.076591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:39.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274235+0000","last_change":"2024-09-19T06:38:14.051796+0000","last_active":"2024-09-19T06:40:08.274235+0000","last_peered":"2024-09-19T06:40:08.274235+0000","last_clean":"2024-09-19T06:40:08.274235+0000","last_became_active":"2024-09-19T06:38:14.048338+0000","last_became_peered":"2024-09-19T06:38:14.048338+0000","last_unstale":"2024-09-19T06:40:08.274235+0000","last_undegraded":"2024-09-19T06:40:08.274235+0000","last_fullsized":"2024-09-19T06:40:08.274235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:48.656819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276087+0000","last_change":"2024-09-19T06:38:14.048607+0000","last_active":"2024-09-19T06:40:08.276087+0000","last_peered":"2024-09-19T06:40:08.276087+0000","last_clean":"2024-09-19T06:40:08.276087+0000","last_became_active":"2024-09-19T06:38:14.047277+0000","last_became_peered":"2024-09-19T06:38:14.047277+0000","last_unstale":"2024-09-19T06:40:08.276087+0000","last_undegraded":"2024-09-19T06:40:08.276087+0000","last_fullsized":"2024-09-19T06:40:08.276087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:52.904376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273963+0000","last_change":"2024-09-19T06:38:14.050759+0000","last_active":"2024-09-19T06:40:08.273963+0000","last_peered":"2024-09-19T06:40:08.273963+0000","last_clean":"2024-09-19T06:40:08.273963+0000","last_became_active":"2024-09-19T06:38:14.049900+0000","last_became_peered":"2024-09-19T06:38:14.049900+0000","last_unstale":"2024-09-19T06:40:08.273963+0000","last_undegraded":"2024-09-19T06:40:08.273963+0000","last_fullsized":"2024-09-19T06:40:08.273963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:45.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273772+0000","last_change":"2024-09-19T06:38:14.058890+0000","last_active":"2024-09-19T06:40:08.273772+0000","last_peered":"2024-09-19T06:40:08.273772+0000","last_clean":"2024-09-19T06:40:08.273772+0000","last_became_active":"2024-09-19T06:38:14.058442+0000","last_became_peered":"2024-09-19T06:38:14.058442+0000","last_unstale":"2024-09-19T06:40:08.273772+0000","last_undegraded":"2024-09-19T06:40:08.273772+0000","last_fullsized":"2024-09-19T06:40:08.273772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:27.296578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273218+0000","last_change":"2024-09-19T06:38:14.050371+0000","last_active":"2024-09-19T06:40:08.273218+0000","last_peered":"2024-09-19T06:40:08.273218+0000","last_clean":"2024-09-19T06:40:08.273218+0000","last_became_active":"2024-09-19T06:38:14.049930+0000","last_became_peered":"2024-09-19T06:38:14.049930+0000","last_unstale":"2024-09-19T06:40:08.273218+0000","last_undegraded":"2024-09-19T06:40:08.273218+0000","last_fullsized":"2024-09-19T06:40:08.273218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:37.898624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193944+0000","last_change":"2024-09-19T06:38:14.052521+0000","last_active":"2024-09-19T06:40:08.193944+0000","last_peered":"2024-09-19T06:40:08.193944+0000","last_clean":"2024-09-19T06:40:08.193944+0000","last_became_active":"2024-09-19T06:38:14.052083+0000","last_became_peered":"2024-09-19T06:38:14.052083+0000","last_unstale":"2024-09-19T06:40:08.193944+0000","last_undegraded":"2024-09-19T06:40:08.193944+0000","last_fullsized":"2024-09-19T06:40:08.193944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:10.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182686+0000","last_change":"2024-09-19T06:38:14.044747+0000","last_active":"2024-09-19T06:40:08.182686+0000","last_peered":"2024-09-19T06:40:08.182686+0000","last_clean":"2024-09-19T06:40:08.182686+0000","last_became_active":"2024-09-19T06:38:14.044451+0000","last_became_peered":"2024-09-19T06:38:14.044451+0000","last_unstale":"2024-09-19T06:40:08.182686+0000","last_undegraded":"2024-09-19T06:40:08.182686+0000","last_fullsized":"2024-09-19T06:40:08.182686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:04.067156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076928+0000","last_change":"2024-09-19T06:38:14.056101+0000","last_active":"2024-09-19T06:40:08.076928+0000","last_peered":"2024-09-19T06:40:08.076928+0000","last_clean":"2024-09-19T06:40:08.076928+0000","last_became_active":"2024-09-19T06:38:14.055682+0000","last_became_peered":"2024-09-19T06:38:14.055682+0000","last_unstale":"2024-09-19T06:40:08.076928+0000","last_undegraded":"2024-09-19T06:40:08.076928+0000","last_fullsized":"2024-09-19T06:40:08.076928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:23.921766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193625+0000","last_change":"2024-09-19T06:38:14.059441+0000","last_active":"2024-09-19T06:40:08.193625+0000","last_peered":"2024-09-19T06:40:08.193625+0000","last_clean":"2024-09-19T06:40:08.193625+0000","last_became_active":"2024-09-19T06:38:14.059123+0000","last_became_peered":"2024-09-19T06:38:14.059123+0000","last_unstale":"2024-09-19T06:40:08.193625+0000","last_undegraded":"2024-09-19T06:40:08.193625+0000","last_fullsized":"2024-09-19T06:40:08.193625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:32.148741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276233+0000","last_change":"2024-09-19T06:38:14.050336+0000","last_active":"2024-09-19T06:40:08.276233+0000","last_peered":"2024-09-19T06:40:08.276233+0000","last_clean":"2024-09-19T06:40:08.276233+0000","last_became_active":"2024-09-19T06:38:14.050041+0000","last_became_peered":"2024-09-19T06:38:14.050041+0000","last_unstale":"2024-09-19T06:40:08.276233+0000","last_undegraded":"2024-09-19T06:40:08.276233+0000","last_fullsized":"2024-09-19T06:40:08.276233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:09.245804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273366+0000","last_change":"2024-09-19T06:38:14.050280+0000","last_active":"2024-09-19T06:40:08.273366+0000","last_peered":"2024-09-19T06:40:08.273366+0000","last_clean":"2024-09-19T06:40:08.273366+0000","last_became_active":"2024-09-19T06:38:14.049874+0000","last_became_peered":"2024-09-19T06:38:14.049874+0000","last_unstale":"2024-09-19T06:40:08.273366+0000","last_undegraded":"2024-09-19T06:40:08.273366+0000","last_fullsized":"2024-09-19T06:40:08.273366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:52.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075355+0000","last_change":"2024-09-19T06:38:14.048294+0000","last_active":"2024-09-19T06:40:08.075355+0000","last_peered":"2024-09-19T06:40:08.075355+0000","last_clean":"2024-09-19T06:40:08.075355+0000","last_became_active":"2024-09-19T06:38:14.048002+0000","last_became_peered":"2024-09-19T06:38:14.048002+0000","last_unstale":"2024-09-19T06:40:08.075355+0000","last_undegraded":"2024-09-19T06:40:08.075355+0000","last_fullsized":"2024-09-19T06:40:08.075355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:55.920027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257610+0000","last_change":"2024-09-19T06:38:14.050244+0000","last_active":"2024-09-19T06:40:08.257610+0000","last_peered":"2024-09-19T06:40:08.257610+0000","last_clean":"2024-09-19T06:40:08.257610+0000","last_became_active":"2024-09-19T06:38:14.049499+0000","last_became_peered":"2024-09-19T06:38:14.049499+0000","last_unstale":"2024-09-19T06:40:08.257610+0000","last_undegraded":"2024-09-19T06:40:08.257610+0000","last_fullsized":"2024-09-19T06:40:08.257610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:35.506647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076492+0000","last_change":"2024-09-19T06:38:14.048779+0000","last_active":"2024-09-19T06:40:08.076492+0000","last_peered":"2024-09-19T06:40:08.076492+0000","last_clean":"2024-09-19T06:40:08.076492+0000","last_became_active":"2024-09-19T06:38:14.048492+0000","last_became_peered":"2024-09-19T06:38:14.048492+0000","last_unstale":"2024-09-19T06:40:08.076492+0000","last_undegraded":"2024-09-19T06:40:08.076492+0000","last_fullsized":"2024-09-19T06:40:08.076492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:01.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076981+0000","last_change":"2024-09-19T06:38:14.054442+0000","last_active":"2024-09-19T06:40:08.076981+0000","last_peered":"2024-09-19T06:40:08.076981+0000","last_clean":"2024-09-19T06:40:08.076981+0000","last_became_active":"2024-09-19T06:38:14.053903+0000","last_became_peered":"2024-09-19T06:38:14.053903+0000","last_unstale":"2024-09-19T06:40:08.076981+0000","last_undegraded":"2024-09-19T06:40:08.076981+0000","last_fullsized":"2024-09-19T06:40:08.076981+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:42.002146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193936+0000","last_change":"2024-09-19T06:38:14.051139+0000","last_active":"2024-09-19T06:40:08.193936+0000","last_peered":"2024-09-19T06:40:08.193936+0000","last_clean":"2024-09-19T06:40:08.193936+0000","last_became_active":"2024-09-19T06:38:14.050764+0000","last_became_peered":"2024-09-19T06:38:14.050764+0000","last_unstale":"2024-09-19T06:40:08.193936+0000","last_undegraded":"2024-09-19T06:40:08.193936+0000","last_fullsized":"2024-09-19T06:40:08.193936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.379184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275728+0000","last_change":"2024-09-19T06:38:14.054614+0000","last_active":"2024-09-19T06:40:08.275728+0000","last_peered":"2024-09-19T06:40:08.275728+0000","last_clean":"2024-09-19T06:40:08.275728+0000","last_became_active":"2024-09-19T06:38:14.054280+0000","last_became_peered":"2024-09-19T06:38:14.054280+0000","last_unstale":"2024-09-19T06:40:08.275728+0000","last_undegraded":"2024-09-19T06:40:08.275728+0000","last_fullsized":"2024-09-19T06:40:08.275728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:21.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274136+0000","last_change":"2024-09-19T06:38:14.056215+0000","last_active":"2024-09-19T06:40:08.274136+0000","last_peered":"2024-09-19T06:40:08.274136+0000","last_clean":"2024-09-19T06:40:08.274136+0000","last_became_active":"2024-09-19T06:38:14.055875+0000","last_became_peered":"2024-09-19T06:38:14.055875+0000","last_unstale":"2024-09-19T06:40:08.274136+0000","last_undegraded":"2024-09-19T06:40:08.274136+0000","last_fullsized":"2024-09-19T06:40:08.274136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:45.347185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076524+0000","last_change":"2024-09-19T06:38:14.057963+0000","last_active":"2024-09-19T06:40:08.076524+0000","last_peered":"2024-09-19T06:40:08.076524+0000","last_clean":"2024-09-19T06:40:08.076524+0000","last_became_active":"2024-09-19T06:38:14.057578+0000","last_became_peered":"2024-09-19T06:38:14.057578+0000","last_unstale":"2024-09-19T06:40:08.076524+0000","last_undegraded":"2024-09-19T06:40:08.076524+0000","last_fullsized":"2024-09-19T06:40:08.076524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:26.173414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076544+0000","last_change":"2024-09-19T06:38:14.058840+0000","last_active":"2024-09-19T06:40:08.076544+0000","last_peered":"2024-09-19T06:40:08.076544+0000","last_clean":"2024-09-19T06:40:08.076544+0000","last_became_active":"2024-09-19T06:38:14.058418+0000","last_became_peered":"2024-09-19T06:38:14.058418+0000","last_unstale":"2024-09-19T06:40:08.076544+0000","last_undegraded":"2024-09-19T06:40:08.076544+0000","last_fullsized":"2024-09-19T06:40:08.076544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:13.624750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193600+0000","last_change":"2024-09-19T06:38:14.053363+0000","last_active":"2024-09-19T06:40:08.193600+0000","last_peered":"2024-09-19T06:40:08.193600+0000","last_clean":"2024-09-19T06:40:08.193600+0000","last_became_active":"2024-09-19T06:38:14.053039+0000","last_became_peered":"2024-09-19T06:38:14.053039+0000","last_unstale":"2024-09-19T06:40:08.193600+0000","last_undegraded":"2024-09-19T06:40:08.193600+0000","last_fullsized":"2024-09-19T06:40:08.193600+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.274885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185012+0000","last_change":"2024-09-19T06:38:14.045719+0000","last_active":"2024-09-19T06:40:08.185012+0000","last_peered":"2024-09-19T06:40:08.185012+0000","last_clean":"2024-09-19T06:40:08.185012+0000","last_became_active":"2024-09-19T06:38:14.045285+0000","last_became_peered":"2024-09-19T06:38:14.045285+0000","last_unstale":"2024-09-19T06:40:08.185012+0000","last_undegraded":"2024-09-19T06:40:08.185012+0000","last_fullsized":"2024-09-19T06:40:08.185012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:16.877802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":150,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257864+0000","last_change":"2024-09-19T06:38:23.177942+0000","last_active":"2024-09-19T06:40:08.257864+0000","last_peered":"2024-09-19T06:40:08.257864+0000","last_clean":"2024-09-19T06:40:08.257864+0000","last_became_active":"2024-09-19T06:38:23.176579+0000","last_became_peered":"2024-09-19T06:38:23.176579+0000","last_unstale":"2024-09-19T06:40:08.257864+0000","last_undegraded":"2024-09-19T06:40:08.257864+0000","last_fullsized":"2024-09-19T06:40:08.257864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:28.140245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257665+0000","last_change":"2024-09-19T06:38:23.811603+0000","last_active":"2024-09-19T06:40:08.257665+0000","last_peered":"2024-09-19T06:40:08.257665+0000","last_clean":"2024-09-19T06:40:08.257665+0000","last_became_active":"2024-09-19T06:38:23.811139+0000","last_became_peered":"2024-09-19T06:38:23.811139+0000","last_unstale":"2024-09-19T06:40:08.257665+0000","last_undegraded":"2024-09-19T06:40:08.257665+0000","last_fullsized":"2024-09-19T06:40:08.257665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:42.082355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196626+0000","last_change":"2024-09-19T06:38:12.041330+0000","last_active":"2024-09-19T06:40:08.196626+0000","last_peered":"2024-09-19T06:40:08.196626+0000","last_clean":"2024-09-19T06:40:08.196626+0000","last_became_active":"2024-09-19T06:38:12.040992+0000","last_became_peered":"2024-09-19T06:38:12.040992+0000","last_unstale":"2024-09-19T06:40:08.196626+0000","last_undegraded":"2024-09-19T06:40:08.196626+0000","last_fullsized":"2024-09-19T06:40:08.196626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:51.721009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275224+0000","last_change":"2024-09-19T06:38:12.034534+0000","last_active":"2024-09-19T06:40:08.275224+0000","last_peered":"2024-09-19T06:40:08.275224+0000","last_clean":"2024-09-19T06:40:08.275224+0000","last_became_active":"2024-09-19T06:38:12.034209+0000","last_became_peered":"2024-09-19T06:38:12.034209+0000","last_unstale":"2024-09-19T06:40:08.275224+0000","last_undegraded":"2024-09-19T06:40:08.275224+0000","last_fullsized":"2024-09-19T06:40:08.275224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:40.640464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075337+0000","last_change":"2024-09-19T06:38:14.043287+0000","last_active":"2024-09-19T06:40:08.075337+0000","last_peered":"2024-09-19T06:40:08.075337+0000","last_clean":"2024-09-19T06:40:08.075337+0000","last_became_active":"2024-09-19T06:38:14.042565+0000","last_became_peered":"2024-09-19T06:38:14.042565+0000","last_unstale":"2024-09-19T06:40:08.075337+0000","last_undegraded":"2024-09-19T06:40:08.075337+0000","last_fullsized":"2024-09-19T06:40:08.075337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:32.689929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257848+0000","last_change":"2024-09-19T06:38:12.039142+0000","last_active":"2024-09-19T06:40:08.257848+0000","last_peered":"2024-09-19T06:40:08.257848+0000","last_clean":"2024-09-19T06:40:08.257848+0000","last_became_active":"2024-09-19T06:38:12.038815+0000","last_became_peered":"2024-09-19T06:38:12.038815+0000","last_unstale":"2024-09-19T06:40:08.257848+0000","last_undegraded":"2024-09-19T06:40:08.257848+0000","last_fullsized":"2024-09-19T06:40:08.257848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:03.316742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182141+0000","last_change":"2024-09-19T06:38:14.044778+0000","last_active":"2024-09-19T06:40:08.182141+0000","last_peered":"2024-09-19T06:40:08.182141+0000","last_clean":"2024-09-19T06:40:08.182141+0000","last_became_active":"2024-09-19T06:38:14.044457+0000","last_became_peered":"2024-09-19T06:38:14.044457+0000","last_unstale":"2024-09-19T06:40:08.182141+0000","last_undegraded":"2024-09-19T06:40:08.182141+0000","last_fullsized":"2024-09-19T06:40:08.182141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:06.342070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":243,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.802495+0000","last_change":"2024-09-19T06:38:12.039031+0000","last_active":"2024-09-19T06:40:08.802495+0000","last_peered":"2024-09-19T06:40:08.802495+0000","last_clean":"2024-09-19T06:40:08.802495+0000","last_became_active":"2024-09-19T06:38:12.038346+0000","last_became_peered":"2024-09-19T06:38:12.038346+0000","last_unstale":"2024-09-19T06:40:08.802495+0000","last_undegraded":"2024-09-19T06:40:08.802495+0000","last_fullsized":"2024-09-19T06:40:08.802495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:33.752330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":208,"num_read_kb":208,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273694+0000","last_change":"2024-09-19T06:38:14.045159+0000","last_active":"2024-09-19T06:40:08.273694+0000","last_peered":"2024-09-19T06:40:08.273694+0000","last_clean":"2024-09-19T06:40:08.273694+0000","last_became_active":"2024-09-19T06:38:14.044822+0000","last_became_peered":"2024-09-19T06:38:14.044822+0000","last_unstale":"2024-09-19T06:40:08.273694+0000","last_undegraded":"2024-09-19T06:40:08.273694+0000","last_fullsized":"2024-09-19T06:40:08.273694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:05.143507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076765+0000","last_change":"2024-09-19T06:38:12.037820+0000","last_active":"2024-09-19T06:40:08.076765+0000","last_peered":"2024-09-19T06:40:08.076765+0000","last_clean":"2024-09-19T06:40:08.076765+0000","last_became_active":"2024-09-19T06:38:12.037417+0000","last_became_peered":"2024-09-19T06:38:12.037417+0000","last_unstale":"2024-09-19T06:40:08.076765+0000","last_undegraded":"2024-09-19T06:40:08.076765+0000","last_fullsized":"2024-09-19T06:40:08.076765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:22.516704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274674+0000","last_change":"2024-09-19T06:38:14.048633+0000","last_active":"2024-09-19T06:40:08.274674+0000","last_peered":"2024-09-19T06:40:08.274674+0000","last_clean":"2024-09-19T06:40:08.274674+0000","last_became_active":"2024-09-19T06:38:14.048257+0000","last_became_peered":"2024-09-19T06:38:14.048257+0000","last_unstale":"2024-09-19T06:40:08.274674+0000","last_undegraded":"2024-09-19T06:40:08.274674+0000","last_fullsized":"2024-09-19T06:40:08.274674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:16.509071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257784+0000","last_change":"2024-09-19T06:38:12.047175+0000","last_active":"2024-09-19T06:40:08.257784+0000","last_peered":"2024-09-19T06:40:08.257784+0000","last_clean":"2024-09-19T06:40:08.257784+0000","last_became_active":"2024-09-19T06:38:12.046781+0000","last_became_peered":"2024-09-19T06:38:12.046781+0000","last_unstale":"2024-09-19T06:40:08.257784+0000","last_undegraded":"2024-09-19T06:40:08.257784+0000","last_fullsized":"2024-09-19T06:40:08.257784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:38.774803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273461+0000","last_change":"2024-09-19T06:38:23.067812+0000","last_active":"2024-09-19T06:40:08.273461+0000","last_peered":"2024-09-19T06:40:08.273461+0000","last_clean":"2024-09-19T06:40:08.273461+0000","last_became_active":"2024-09-19T06:38:23.067357+0000","last_became_peered":"2024-09-19T06:38:23.067357+0000","last_unstale":"2024-09-19T06:40:08.273461+0000","last_undegraded":"2024-09-19T06:40:08.273461+0000","last_fullsized":"2024-09-19T06:40:08.273461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:34.719243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'35","reported_seq":299,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.802563+0000","last_change":"2024-09-19T06:38:23.186703+0000","last_active":"2024-09-19T06:40:08.802563+0000","last_peered":"2024-09-19T06:40:08.802563+0000","last_clean":"2024-09-19T06:40:08.802563+0000","last_became_active":"2024-09-19T06:38:23.177212+0000","last_became_peered":"2024-09-19T06:38:23.177212+0000","last_unstale":"2024-09-19T06:40:08.802563+0000","last_undegraded":"2024-09-19T06:40:08.802563+0000","last_fullsized":"2024-09-19T06:40:08.802563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:46.884624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65927,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":174,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185343+0000","last_change":"2024-09-19T06:38:14.054619+0000","last_active":"2024-09-19T06:40:08.185343+0000","last_peered":"2024-09-19T06:40:08.185343+0000","last_clean":"2024-09-19T06:40:08.185343+0000","last_became_active":"2024-09-19T06:38:14.054118+0000","last_became_peered":"2024-09-19T06:38:14.054118+0000","last_unstale":"2024-09-19T06:40:08.185343+0000","last_undegraded":"2024-09-19T06:40:08.185343+0000","last_fullsized":"2024-09-19T06:40:08.185343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:41.041603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076764+0000","last_change":"2024-09-19T06:38:12.040272+0000","last_active":"2024-09-19T06:40:08.076764+0000","last_peered":"2024-09-19T06:40:08.076764+0000","last_clean":"2024-09-19T06:40:08.076764+0000","last_became_active":"2024-09-19T06:38:12.039940+0000","last_became_peered":"2024-09-19T06:38:12.039940+0000","last_unstale":"2024-09-19T06:40:08.076764+0000","last_undegraded":"2024-09-19T06:40:08.076764+0000","last_fullsized":"2024-09-19T06:40:08.076764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:53.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275371+0000","last_change":"2024-09-19T06:38:14.049535+0000","last_active":"2024-09-19T06:40:08.275371+0000","last_peered":"2024-09-19T06:40:08.275371+0000","last_clean":"2024-09-19T06:40:08.275371+0000","last_became_active":"2024-09-19T06:38:14.049208+0000","last_became_peered":"2024-09-19T06:38:14.049208+0000","last_unstale":"2024-09-19T06:40:08.275371+0000","last_undegraded":"2024-09-19T06:40:08.275371+0000","last_fullsized":"2024-09-19T06:40:08.275371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:03.359786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257731+0000","last_change":"2024-09-19T06:38:12.037346+0000","last_active":"2024-09-19T06:40:08.257731+0000","last_peered":"2024-09-19T06:40:08.257731+0000","last_clean":"2024-09-19T06:40:08.257731+0000","last_became_active":"2024-09-19T06:38:12.036986+0000","last_became_peered":"2024-09-19T06:38:12.036986+0000","last_unstale":"2024-09-19T06:40:08.257731+0000","last_undegraded":"2024-09-19T06:40:08.257731+0000","last_fullsized":"2024-09-19T06:40:08.257731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:26.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076694+0000","last_change":"2024-09-19T06:38:14.059454+0000","last_active":"2024-09-19T06:40:08.076694+0000","last_peered":"2024-09-19T06:40:08.076694+0000","last_clean":"2024-09-19T06:40:08.076694+0000","last_became_active":"2024-09-19T06:38:14.058996+0000","last_became_peered":"2024-09-19T06:38:14.058996+0000","last_unstale":"2024-09-19T06:40:08.076694+0000","last_undegraded":"2024-09-19T06:40:08.076694+0000","last_fullsized":"2024-09-19T06:40:08.076694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:54.645395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":142,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.802915+0000","last_change":"2024-09-19T06:38:12.043687+0000","last_active":"2024-09-19T06:40:08.802915+0000","last_peered":"2024-09-19T06:40:08.802915+0000","last_clean":"2024-09-19T06:40:08.802915+0000","last_became_active":"2024-09-19T06:38:12.043268+0000","last_became_peered":"2024-09-19T06:38:12.043268+0000","last_unstale":"2024-09-19T06:40:08.802915+0000","last_undegraded":"2024-09-19T06:40:08.802915+0000","last_fullsized":"2024-09-19T06:40:08.802915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:18.753736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076233+0000","last_change":"2024-09-19T06:38:14.052184+0000","last_active":"2024-09-19T06:40:08.076233+0000","last_peered":"2024-09-19T06:40:08.076233+0000","last_clean":"2024-09-19T06:40:08.076233+0000","last_became_active":"2024-09-19T06:38:14.051736+0000","last_became_peered":"2024-09-19T06:38:14.051736+0000","last_unstale":"2024-09-19T06:40:08.076233+0000","last_undegraded":"2024-09-19T06:40:08.076233+0000","last_fullsized":"2024-09-19T06:40:08.076233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:12.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:12.048418+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:12.047948+0000","last_became_peered":"2024-09-19T06:38:12.047948+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:06.059904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181946+0000","last_change":"2024-09-19T06:38:23.175961+0000","last_active":"2024-09-19T06:40:08.181946+0000","last_peered":"2024-09-19T06:40:08.181946+0000","last_clean":"2024-09-19T06:40:08.181946+0000","last_became_active":"2024-09-19T06:38:23.175629+0000","last_became_peered":"2024-09-19T06:38:23.175629+0000","last_unstale":"2024-09-19T06:40:08.181946+0000","last_undegraded":"2024-09-19T06:40:08.181946+0000","last_fullsized":"2024-09-19T06:40:08.181946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185296+0000","last_change":"2024-09-19T06:38:12.038945+0000","last_active":"2024-09-19T06:40:08.185296+0000","last_peered":"2024-09-19T06:40:08.185296+0000","last_clean":"2024-09-19T06:40:08.185296+0000","last_became_active":"2024-09-19T06:38:12.038571+0000","last_became_peered":"2024-09-19T06:38:12.038571+0000","last_unstale":"2024-09-19T06:40:08.185296+0000","last_undegraded":"2024-09-19T06:40:08.185296+0000","last_fullsized":"2024-09-19T06:40:08.185296+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:57.887070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193798+0000","last_change":"2024-09-19T06:38:14.056481+0000","last_active":"2024-09-19T06:40:08.193798+0000","last_peered":"2024-09-19T06:40:08.193798+0000","last_clean":"2024-09-19T06:40:08.193798+0000","last_became_active":"2024-09-19T06:38:14.056177+0000","last_became_peered":"2024-09-19T06:38:14.056177+0000","last_unstale":"2024-09-19T06:40:08.193798+0000","last_undegraded":"2024-09-19T06:40:08.193798+0000","last_fullsized":"2024-09-19T06:40:08.193798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.734802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276561+0000","last_change":"2024-09-19T06:38:12.038826+0000","last_active":"2024-09-19T06:40:08.276561+0000","last_peered":"2024-09-19T06:40:08.276561+0000","last_clean":"2024-09-19T06:40:08.276561+0000","last_became_active":"2024-09-19T06:38:12.038516+0000","last_became_peered":"2024-09-19T06:38:12.038516+0000","last_unstale":"2024-09-19T06:40:08.276561+0000","last_undegraded":"2024-09-19T06:40:08.276561+0000","last_fullsized":"2024-09-19T06:40:08.276561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:16.709742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076941+0000","last_change":"2024-09-19T06:38:14.053888+0000","last_active":"2024-09-19T06:40:08.076941+0000","last_peered":"2024-09-19T06:40:08.076941+0000","last_clean":"2024-09-19T06:40:08.076941+0000","last_became_active":"2024-09-19T06:38:14.053524+0000","last_became_peered":"2024-09-19T06:38:14.053524+0000","last_unstale":"2024-09-19T06:40:08.076941+0000","last_undegraded":"2024-09-19T06:40:08.076941+0000","last_fullsized":"2024-09-19T06:40:08.076941+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:54.853786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'41","reported_seq":62,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.310545+0000","last_change":"2024-09-19T06:39:23.715975+0000","last_active":"2024-09-19T06:40:08.310545+0000","last_peered":"2024-09-19T06:40:08.310545+0000","last_clean":"2024-09-19T06:40:08.310545+0000","last_became_active":"2024-09-19T06:39:23.713052+0000","last_became_peered":"2024-09-19T06:39:23.713052+0000","last_unstale":"2024-09-19T06:40:08.310545+0000","last_undegraded":"2024-09-19T06:40:08.310545+0000","last_fullsized":"2024-09-19T06:40:08.310545+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:42.887751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076532+0000","last_change":"2024-09-19T06:38:14.052210+0000","last_active":"2024-09-19T06:40:08.076532+0000","last_peered":"2024-09-19T06:40:08.076532+0000","last_clean":"2024-09-19T06:40:08.076532+0000","last_became_active":"2024-09-19T06:38:14.051803+0000","last_became_peered":"2024-09-19T06:38:14.051803+0000","last_unstale":"2024-09-19T06:40:08.076532+0000","last_undegraded":"2024-09-19T06:40:08.076532+0000","last_fullsized":"2024-09-19T06:40:08.076532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:40.751672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'8","reported_seq":144,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.825713+0000","last_change":"2024-09-19T06:38:12.118077+0000","last_active":"2024-09-19T06:40:08.825713+0000","last_peered":"2024-09-19T06:40:08.825713+0000","last_clean":"2024-09-19T06:40:08.825713+0000","last_became_active":"2024-09-19T06:38:12.117690+0000","last_became_peered":"2024-09-19T06:38:12.117690+0000","last_unstale":"2024-09-19T06:40:08.825713+0000","last_undegraded":"2024-09-19T06:40:08.825713+0000","last_fullsized":"2024-09-19T06:40:08.825713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.828335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076689+0000","last_change":"2024-09-19T06:38:14.054014+0000","last_active":"2024-09-19T06:40:08.076689+0000","last_peered":"2024-09-19T06:40:08.076689+0000","last_clean":"2024-09-19T06:40:08.076689+0000","last_became_active":"2024-09-19T06:38:14.053349+0000","last_became_peered":"2024-09-19T06:38:14.053349+0000","last_unstale":"2024-09-19T06:40:08.076689+0000","last_undegraded":"2024-09-19T06:40:08.076689+0000","last_fullsized":"2024-09-19T06:40:08.076689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:40.117720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076455+0000","last_change":"2024-09-19T06:37:02.166696+0000","last_active":"2024-09-19T06:40:08.076455+0000","last_peered":"2024-09-19T06:40:08.076455+0000","last_clean":"2024-09-19T06:40:08.076455+0000","last_became_active":"2024-09-19T06:37:02.166225+0000","last_became_peered":"2024-09-19T06:37:02.166225+0000","last_unstale":"2024-09-19T06:40:08.076455+0000","last_undegraded":"2024-09-19T06:40:08.076455+0000","last_fullsized":"2024-09-19T06:40:08.076455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_clean_scrub_stamp":"2024-09-19T06:33:40.535354+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:46.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274179+0000","last_change":"2024-09-19T06:38:12.044465+0000","last_active":"2024-09-19T06:40:08.274179+0000","last_peered":"2024-09-19T06:40:08.274179+0000","last_clean":"2024-09-19T06:40:08.274179+0000","last_became_active":"2024-09-19T06:38:12.044042+0000","last_became_peered":"2024-09-19T06:38:12.044042+0000","last_unstale":"2024-09-19T06:40:08.274179+0000","last_undegraded":"2024-09-19T06:40:08.274179+0000","last_fullsized":"2024-09-19T06:40:08.274179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:40.759264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075774+0000","last_change":"2024-09-19T06:38:14.045102+0000","last_active":"2024-09-19T06:40:08.075774+0000","last_peered":"2024-09-19T06:40:08.075774+0000","last_clean":"2024-09-19T06:40:08.075774+0000","last_became_active":"2024-09-19T06:38:14.044785+0000","last_became_peered":"2024-09-19T06:38:14.044785+0000","last_unstale":"2024-09-19T06:40:08.075774+0000","last_undegraded":"2024-09-19T06:40:08.075774+0000","last_fullsized":"2024-09-19T06:40:08.075774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:57.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076395+0000","last_change":"2024-09-19T06:39:24.353205+0000","last_active":"2024-09-19T06:40:08.076395+0000","last_peered":"2024-09-19T06:40:08.076395+0000","last_clean":"2024-09-19T06:40:08.076395+0000","last_became_active":"2024-09-19T06:39:24.350315+0000","last_became_peered":"2024-09-19T06:39:24.350315+0000","last_unstale":"2024-09-19T06:40:08.076395+0000","last_undegraded":"2024-09-19T06:40:08.076395+0000","last_fullsized":"2024-09-19T06:40:08.076395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:32.467330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,8],"acting":[7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275223+0000","last_change":"2024-09-19T06:38:14.054623+0000","last_active":"2024-09-19T06:40:08.275223+0000","last_peered":"2024-09-19T06:40:08.275223+0000","last_clean":"2024-09-19T06:40:08.275223+0000","last_became_active":"2024-09-19T06:38:14.054124+0000","last_became_peered":"2024-09-19T06:38:14.054124+0000","last_unstale":"2024-09-19T06:40:08.275223+0000","last_undegraded":"2024-09-19T06:40:08.275223+0000","last_fullsized":"2024-09-19T06:40:08.275223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:33.251059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":140,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.356255+0000","last_change":"2024-09-19T06:38:12.047284+0000","last_active":"2024-09-19T06:40:08.356255+0000","last_peered":"2024-09-19T06:40:08.356255+0000","last_clean":"2024-09-19T06:40:08.356255+0000","last_became_active":"2024-09-19T06:38:12.046886+0000","last_became_peered":"2024-09-19T06:38:12.046886+0000","last_unstale":"2024-09-19T06:40:08.356255+0000","last_undegraded":"2024-09-19T06:40:08.356255+0000","last_fullsized":"2024-09-19T06:40:08.356255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:15.030007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257667+0000","last_change":"2024-09-19T06:38:14.049351+0000","last_active":"2024-09-19T06:40:08.257667+0000","last_peered":"2024-09-19T06:40:08.257667+0000","last_clean":"2024-09-19T06:40:08.257667+0000","last_became_active":"2024-09-19T06:38:14.048792+0000","last_became_peered":"2024-09-19T06:38:14.048792+0000","last_unstale":"2024-09-19T06:40:08.257667+0000","last_undegraded":"2024-09-19T06:40:08.257667+0000","last_fullsized":"2024-09-19T06:40:08.257667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:30.431378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'9","reported_seq":145,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.824197+0000","last_change":"2024-09-19T06:38:12.037155+0000","last_active":"2024-09-19T06:40:08.824197+0000","last_peered":"2024-09-19T06:40:08.824197+0000","last_clean":"2024-09-19T06:40:08.824197+0000","last_became_active":"2024-09-19T06:38:12.036536+0000","last_became_peered":"2024-09-19T06:38:12.036536+0000","last_unstale":"2024-09-19T06:40:08.824197+0000","last_undegraded":"2024-09-19T06:40:08.824197+0000","last_fullsized":"2024-09-19T06:40:08.824197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:41.014783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196631+0000","last_change":"2024-09-19T06:38:14.055724+0000","last_active":"2024-09-19T06:40:08.196631+0000","last_peered":"2024-09-19T06:40:08.196631+0000","last_clean":"2024-09-19T06:40:08.196631+0000","last_became_active":"2024-09-19T06:38:14.054457+0000","last_became_peered":"2024-09-19T06:38:14.054457+0000","last_unstale":"2024-09-19T06:40:08.196631+0000","last_undegraded":"2024-09-19T06:40:08.196631+0000","last_fullsized":"2024-09-19T06:40:08.196631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:47.653709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182579+0000","last_change":"2024-09-19T06:38:12.049197+0000","last_active":"2024-09-19T06:40:08.182579+0000","last_peered":"2024-09-19T06:40:08.182579+0000","last_clean":"2024-09-19T06:40:08.182579+0000","last_became_active":"2024-09-19T06:38:12.048863+0000","last_became_peered":"2024-09-19T06:38:12.048863+0000","last_unstale":"2024-09-19T06:40:08.182579+0000","last_undegraded":"2024-09-19T06:40:08.182579+0000","last_fullsized":"2024-09-19T06:40:08.182579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:25.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196635+0000","last_change":"2024-09-19T06:38:14.042991+0000","last_active":"2024-09-19T06:40:08.196635+0000","last_peered":"2024-09-19T06:40:08.196635+0000","last_clean":"2024-09-19T06:40:08.196635+0000","last_became_active":"2024-09-19T06:38:14.042511+0000","last_became_peered":"2024-09-19T06:38:14.042511+0000","last_unstale":"2024-09-19T06:40:08.196635+0000","last_undegraded":"2024-09-19T06:40:08.196635+0000","last_fullsized":"2024-09-19T06:40:08.196635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:38.212838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193790+0000","last_change":"2024-09-19T06:38:23.064456+0000","last_active":"2024-09-19T06:40:08.193790+0000","last_peered":"2024-09-19T06:40:08.193790+0000","last_clean":"2024-09-19T06:40:08.193790+0000","last_became_active":"2024-09-19T06:38:23.064051+0000","last_became_peered":"2024-09-19T06:38:23.064051+0000","last_unstale":"2024-09-19T06:40:08.193790+0000","last_undegraded":"2024-09-19T06:40:08.193790+0000","last_fullsized":"2024-09-19T06:40:08.193790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:58.548420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275853+0000","last_change":"2024-09-19T06:38:14.048612+0000","last_active":"2024-09-19T06:40:08.275853+0000","last_peered":"2024-09-19T06:40:08.275853+0000","last_clean":"2024-09-19T06:40:08.275853+0000","last_became_active":"2024-09-19T06:38:14.048294+0000","last_became_peered":"2024-09-19T06:38:14.048294+0000","last_unstale":"2024-09-19T06:40:08.275853+0000","last_undegraded":"2024-09-19T06:40:08.275853+0000","last_fullsized":"2024-09-19T06:40:08.275853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:55.892149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'50","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.313781+0000","last_change":"2024-09-19T06:38:12.035269+0000","last_active":"2024-09-19T06:40:08.313781+0000","last_peered":"2024-09-19T06:40:08.313781+0000","last_clean":"2024-09-19T06:40:08.313781+0000","last_became_active":"2024-09-19T06:38:12.034841+0000","last_became_peered":"2024-09-19T06:38:12.034841+0000","last_unstale":"2024-09-19T06:40:08.313781+0000","last_undegraded":"2024-09-19T06:40:08.313781+0000","last_fullsized":"2024-09-19T06:40:08.313781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:19.642572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076503+0000","last_change":"2024-09-19T06:38:14.052492+0000","last_active":"2024-09-19T06:40:08.076503+0000","last_peered":"2024-09-19T06:40:08.076503+0000","last_clean":"2024-09-19T06:40:08.076503+0000","last_became_active":"2024-09-19T06:38:14.052191+0000","last_became_peered":"2024-09-19T06:38:14.052191+0000","last_unstale":"2024-09-19T06:40:08.076503+0000","last_undegraded":"2024-09-19T06:40:08.076503+0000","last_fullsized":"2024-09-19T06:40:08.076503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:34.006480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274336+0000","last_change":"2024-09-19T06:38:12.118430+0000","last_active":"2024-09-19T06:40:08.274336+0000","last_peered":"2024-09-19T06:40:08.274336+0000","last_clean":"2024-09-19T06:40:08.274336+0000","last_became_active":"2024-09-19T06:38:12.118065+0000","last_became_peered":"2024-09-19T06:38:12.118065+0000","last_unstale":"2024-09-19T06:40:08.274336+0000","last_undegraded":"2024-09-19T06:40:08.274336+0000","last_fullsized":"2024-09-19T06:40:08.274336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:25.861922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274974+0000","last_change":"2024-09-19T06:38:23.811305+0000","last_active":"2024-09-19T06:40:08.274974+0000","last_peered":"2024-09-19T06:40:08.274974+0000","last_clean":"2024-09-19T06:40:08.274974+0000","last_became_active":"2024-09-19T06:38:23.810840+0000","last_became_peered":"2024-09-19T06:38:23.810840+0000","last_unstale":"2024-09-19T06:40:08.274974+0000","last_undegraded":"2024-09-19T06:40:08.274974+0000","last_fullsized":"2024-09-19T06:40:08.274974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.019065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273364+0000","last_change":"2024-09-19T06:38:12.047670+0000","last_active":"2024-09-19T06:40:08.273364+0000","last_peered":"2024-09-19T06:40:08.273364+0000","last_clean":"2024-09-19T06:40:08.273364+0000","last_became_active":"2024-09-19T06:38:12.047312+0000","last_became_peered":"2024-09-19T06:38:12.047312+0000","last_unstale":"2024-09-19T06:40:08.273364+0000","last_undegraded":"2024-09-19T06:40:08.273364+0000","last_fullsized":"2024-09-19T06:40:08.273364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:47.477945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:14.047210+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:14.046836+0000","last_became_peered":"2024-09-19T06:38:14.046836+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:14.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075584+0000","last_change":"2024-09-19T06:38:12.032692+0000","last_active":"2024-09-19T06:40:08.075584+0000","last_peered":"2024-09-19T06:40:08.075584+0000","last_clean":"2024-09-19T06:40:08.075584+0000","last_became_active":"2024-09-19T06:38:12.031874+0000","last_became_peered":"2024-09-19T06:38:12.031874+0000","last_unstale":"2024-09-19T06:40:08.075584+0000","last_undegraded":"2024-09-19T06:40:08.075584+0000","last_fullsized":"2024-09-19T06:40:08.075584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.787964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193683+0000","last_change":"2024-09-19T06:38:14.053504+0000","last_active":"2024-09-19T06:40:08.193683+0000","last_peered":"2024-09-19T06:40:08.193683+0000","last_clean":"2024-09-19T06:40:08.193683+0000","last_became_active":"2024-09-19T06:38:14.053148+0000","last_became_peered":"2024-09-19T06:38:14.053148+0000","last_unstale":"2024-09-19T06:40:08.193683+0000","last_undegraded":"2024-09-19T06:40:08.193683+0000","last_fullsized":"2024-09-19T06:40:08.193683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:29.809295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076736+0000","last_change":"2024-09-19T06:38:12.038884+0000","last_active":"2024-09-19T06:40:08.076736+0000","last_peered":"2024-09-19T06:40:08.076736+0000","last_clean":"2024-09-19T06:40:08.076736+0000","last_became_active":"2024-09-19T06:38:12.038532+0000","last_became_peered":"2024-09-19T06:38:12.038532+0000","last_unstale":"2024-09-19T06:40:08.076736+0000","last_undegraded":"2024-09-19T06:40:08.076736+0000","last_fullsized":"2024-09-19T06:40:08.076736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.348690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075777+0000","last_change":"2024-09-19T06:38:14.045761+0000","last_active":"2024-09-19T06:40:08.075777+0000","last_peered":"2024-09-19T06:40:08.075777+0000","last_clean":"2024-09-19T06:40:08.075777+0000","last_became_active":"2024-09-19T06:38:14.045467+0000","last_became_peered":"2024-09-19T06:38:14.045467+0000","last_unstale":"2024-09-19T06:40:08.075777+0000","last_undegraded":"2024-09-19T06:40:08.075777+0000","last_fullsized":"2024-09-19T06:40:08.075777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.917945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185144+0000","last_change":"2024-09-19T06:39:23.748032+0000","last_active":"2024-09-19T06:40:08.185144+0000","last_peered":"2024-09-19T06:40:08.185144+0000","last_clean":"2024-09-19T06:40:08.185144+0000","last_became_active":"2024-09-19T06:39:23.744288+0000","last_became_peered":"2024-09-19T06:39:23.744288+0000","last_unstale":"2024-09-19T06:40:08.185144+0000","last_undegraded":"2024-09-19T06:40:08.185144+0000","last_fullsized":"2024-09-19T06:40:08.185144+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:50.668043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4],"acting":[8,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076545+0000","last_change":"2024-09-19T06:38:14.053935+0000","last_active":"2024-09-19T06:40:08.076545+0000","last_peered":"2024-09-19T06:40:08.076545+0000","last_clean":"2024-09-19T06:40:08.076545+0000","last_became_active":"2024-09-19T06:38:14.053542+0000","last_became_peered":"2024-09-19T06:38:14.053542+0000","last_unstale":"2024-09-19T06:40:08.076545+0000","last_undegraded":"2024-09-19T06:40:08.076545+0000","last_fullsized":"2024-09-19T06:40:08.076545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:25.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182280+0000","last_change":"2024-09-19T06:38:23.177133+0000","last_active":"2024-09-19T06:40:08.182280+0000","last_peered":"2024-09-19T06:40:08.182280+0000","last_clean":"2024-09-19T06:40:08.182280+0000","last_became_active":"2024-09-19T06:38:23.176810+0000","last_became_peered":"2024-09-19T06:38:23.176810+0000","last_unstale":"2024-09-19T06:40:08.182280+0000","last_undegraded":"2024-09-19T06:40:08.182280+0000","last_fullsized":"2024-09-19T06:40:08.182280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:56.307720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185240+0000","last_change":"2024-09-19T06:38:12.042699+0000","last_active":"2024-09-19T06:40:08.185240+0000","last_peered":"2024-09-19T06:40:08.185240+0000","last_clean":"2024-09-19T06:40:08.185240+0000","last_became_active":"2024-09-19T06:38:12.042148+0000","last_became_peered":"2024-09-19T06:38:12.042148+0000","last_unstale":"2024-09-19T06:40:08.185240+0000","last_undegraded":"2024-09-19T06:40:08.185240+0000","last_fullsized":"2024-09-19T06:40:08.185240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.953596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273371+0000","last_change":"2024-09-19T06:38:14.043279+0000","last_active":"2024-09-19T06:40:08.273371+0000","last_peered":"2024-09-19T06:40:08.273371+0000","last_clean":"2024-09-19T06:40:08.273371+0000","last_became_active":"2024-09-19T06:38:14.042914+0000","last_became_peered":"2024-09-19T06:38:14.042914+0000","last_unstale":"2024-09-19T06:40:08.273371+0000","last_undegraded":"2024-09-19T06:40:08.273371+0000","last_fullsized":"2024-09-19T06:40:08.273371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:22.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'13","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185441+0000","last_change":"2024-09-19T06:39:23.719397+0000","last_active":"2024-09-19T06:40:08.185441+0000","last_peered":"2024-09-19T06:40:08.185441+0000","last_clean":"2024-09-19T06:40:08.185441+0000","last_became_active":"2024-09-19T06:39:23.709128+0000","last_became_peered":"2024-09-19T06:39:23.709128+0000","last_unstale":"2024-09-19T06:40:08.185441+0000","last_undegraded":"2024-09-19T06:40:08.185441+0000","last_fullsized":"2024-09-19T06:40:08.185441+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:46.092401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274542+0000","last_change":"2024-09-19T06:38:14.041552+0000","last_active":"2024-09-19T06:40:08.274542+0000","last_peered":"2024-09-19T06:40:08.274542+0000","last_clean":"2024-09-19T06:40:08.274542+0000","last_became_active":"2024-09-19T06:38:14.041187+0000","last_became_peered":"2024-09-19T06:38:14.041187+0000","last_unstale":"2024-09-19T06:40:08.274542+0000","last_undegraded":"2024-09-19T06:40:08.274542+0000","last_fullsized":"2024-09-19T06:40:08.274542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:17.390457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076363+0000","last_change":"2024-09-19T06:38:12.047436+0000","last_active":"2024-09-19T06:40:08.076363+0000","last_peered":"2024-09-19T06:40:08.076363+0000","last_clean":"2024-09-19T06:40:08.076363+0000","last_became_active":"2024-09-19T06:38:12.046961+0000","last_became_peered":"2024-09-19T06:38:12.046961+0000","last_unstale":"2024-09-19T06:40:08.076363+0000","last_undegraded":"2024-09-19T06:40:08.076363+0000","last_fullsized":"2024-09-19T06:40:08.076363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076212+0000","last_change":"2024-09-19T06:38:14.049660+0000","last_active":"2024-09-19T06:40:08.076212+0000","last_peered":"2024-09-19T06:40:08.076212+0000","last_clean":"2024-09-19T06:40:08.076212+0000","last_became_active":"2024-09-19T06:38:14.049375+0000","last_became_peered":"2024-09-19T06:38:14.049375+0000","last_unstale":"2024-09-19T06:40:08.076212+0000","last_undegraded":"2024-09-19T06:40:08.076212+0000","last_fullsized":"2024-09-19T06:40:08.076212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:08.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'15","reported_seq":159,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.357314+0000","last_change":"2024-09-19T06:38:23.071068+0000","last_active":"2024-09-19T06:40:08.357314+0000","last_peered":"2024-09-19T06:40:08.357314+0000","last_clean":"2024-09-19T06:40:08.357314+0000","last_became_active":"2024-09-19T06:38:23.067129+0000","last_became_peered":"2024-09-19T06:38:23.067129+0000","last_unstale":"2024-09-19T06:40:08.357314+0000","last_undegraded":"2024-09-19T06:40:08.357314+0000","last_fullsized":"2024-09-19T06:40:08.357314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:15.387758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600254,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1183,"num_read_kb":708,"num_write":376,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2264,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2162688,"data_stored":1800762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":598089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776168,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41260,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703892,"statfs":{"total":95995035648,"available":95952785408,"internally_reserved":0,"allocated":1732608,"data_stored":1182233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28376,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716776,"statfs":{"total":95995035648,"available":95965978624,"internally_reserved":0,"allocated":1380352,"data_stored":858526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168626,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28356,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716796,"statfs":{"total":95995035648,"available":95965999104,"internally_reserved":0,"allocated":1359872,"data_stored":858120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1581056,"data_stored":1059977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528381,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":456768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32740,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712412,"statfs":{"total":95995035648,"available":95961509888,"internally_reserved":0,"allocated":1589248,"data_stored":1057957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1052672,"data_stored":532364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":989668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":466465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40528,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704624,"statfs":{"total":95995035648,"available":95953534976,"internally_reserved":0,"allocated":1044480,"data_stored":533774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":467293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":199656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":133901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:40:11.963 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:40:12.292 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi016 to 177.0M 2024-09-19T06:40:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: Unable to set osd_memory_target on smithi016 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T06:40:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:12.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:12 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:12.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi016 to 177.0M 2024-09-19T06:40:12.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: Unable to set osd_memory_target on smithi016 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T06:40:12.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:12.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:12.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:12.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:12.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:12.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:12 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:12.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi016 to 177.0M 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: Unable to set osd_memory_target on smithi016 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:12.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:12 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:12.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.846+0000 7f140938a640 1 -- 172.21.15.12:0/2689372247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1404106b80 msgr2=0x7f1404106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.846+0000 7f140938a640 1 --2- 172.21.15.12:0/2689372247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1404106b80 0x7f1404106f60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009ca0 tx=0x7f13f402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.846+0000 7f140938a640 1 -- 172.21.15.12:0/2689372247 shutdown_connections 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.846+0000 7f140938a640 1 --2- 172.21.15.12:0/2689372247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1404100aa0 0x7f140410ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.846+0000 7f140938a640 1 --2- 172.21.15.12:0/2689372247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1404100100 0x7f1404100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.846+0000 7f140938a640 1 --2- 172.21.15.12:0/2689372247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1404106b80 0x7f1404106f60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.846+0000 7f140938a640 1 -- 172.21.15.12:0/2689372247 >> 172.21.15.12:0/2689372247 conn(0x7f1404077230 msgr2=0x7f14040fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.846+0000 7f140938a640 1 -- 172.21.15.12:0/2689372247 shutdown_connections 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.846+0000 7f140938a640 1 -- 172.21.15.12:0/2689372247 wait complete. 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.847+0000 7f140938a640 1 Processor -- start 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f140938a640 1 -- start start 2024-09-19T06:40:12.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f140938a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1404100100 0x7f1404198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f140938a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1404100aa0 0x7f1404198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f140938a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1404106b80 0x7f140419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f140938a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1404112010 con 0x7f1404106b80 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f140938a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1404111e90 con 0x7f1404100100 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f140938a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1404112190 con 0x7f1404100aa0 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f1402ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1404100100 0x7f1404198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f14037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1404106b80 0x7f140419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f14027fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1404100aa0 0x7f1404198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f14037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1404106b80 0x7f140419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36836/0 (socket says 172.21.15.12:36836) 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f14037fe640 1 -- 172.21.15.12:0/1852710713 learned_addr learned my addr 172.21.15.12:0/1852710713 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f14037fe640 1 -- 172.21.15.12:0/1852710713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1404100aa0 msgr2=0x7f1404198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f14037fe640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1404100aa0 0x7f1404198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:12.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f14037fe640 1 -- 172.21.15.12:0/1852710713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1404100100 msgr2=0x7f1404198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.848+0000 7f14037fe640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1404100100 0x7f1404198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.849+0000 7f14037fe640 1 -- 172.21.15.12:0/1852710713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140419d520 con 0x7f1404106b80 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.849+0000 7f14027fc640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1404100aa0 0x7f1404198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.849+0000 7f14037fe640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1404106b80 0x7f140419ce40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00e970 tx=0x7f13fc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.849+0000 7f13fbfff640 1 -- 172.21.15.12:0/1852710713 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00ccc0 con 0x7f1404106b80 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.849+0000 7f13fbfff640 1 -- 172.21.15.12:0/1852710713 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13fc005500 con 0x7f1404106b80 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.849+0000 7f140938a640 1 -- 172.21.15.12:0/1852710713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140419d810 con 0x7f1404106b80 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.849+0000 7f13fbfff640 1 -- 172.21.15.12:0/1852710713 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc010690 con 0x7f1404106b80 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.849+0000 7f140938a640 1 -- 172.21.15.12:0/1852710713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1404101210 con 0x7f1404106b80 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.850+0000 7f140938a640 1 -- 172.21.15.12:0/1852710713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14041998d0 con 0x7f1404106b80 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.852+0000 7f13fbfff640 1 -- 172.21.15.12:0/1852710713 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7f13fc0046c0 con 0x7f1404106b80 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.852+0000 7f13fbfff640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13f00a3430 0x7f13f00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:12.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.852+0000 7f1402ffd640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13f00a3430 0x7f13f00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:12.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.852+0000 7f13fbfff640 1 -- 172.21.15.12:0/1852710713 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f13fc0d0060 con 0x7f1404106b80 2024-09-19T06:40:12.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.853+0000 7f1402ffd640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13f00a3430 0x7f13f00a58f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f13f4006010 tx=0x7f13f4009360 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:12.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:12.857+0000 7f13fbfff640 1 -- 172.21.15.12:0/1852710713 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13fc09c9c0 con 0x7f1404106b80 2024-09-19T06:40:13.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.014+0000 7f13fbfff640 1 -- 172.21.15.12:0/1852710713 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f13fc0cd9b0 con 0x7f1404106b80 2024-09-19T06:40:13.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.085+0000 7f140938a640 1 -- 172.21.15.12:0/1852710713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f140402d7c0 con 0x7f1404106b80 2024-09-19T06:40:13.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.085+0000 7f13fbfff640 1 -- 172.21.15.12:0/1852710713 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7f13fc0c7880 con 0x7f1404106b80 2024-09-19T06:40:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:13.087 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-19T06:40:07:090225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:40:07.040062+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:40:13.087 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-19T06:40:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 -- 172.21.15.12:0/1852710713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13f00a3430 msgr2=0x7f13f00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13f00a3430 0x7f13f00a58f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f13f4006010 tx=0x7f13f4009360 comp rx=0 tx=0).stop 2024-09-19T06:40:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 -- 172.21.15.12:0/1852710713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1404106b80 msgr2=0x7f140419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1404106b80 0x7f140419ce40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00e970 tx=0x7f13fc00ee30 comp rx=0 tx=0).stop 2024-09-19T06:40:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 -- 172.21.15.12:0/1852710713 shutdown_connections 2024-09-19T06:40:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1404106b80 0x7f140419ce40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13f00a3430 0x7f13f00a58f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:13.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1404100aa0 0x7f1404198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:13.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 --2- 172.21.15.12:0/1852710713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1404100100 0x7f1404198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:13.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 -- 172.21.15.12:0/1852710713 >> 172.21.15.12:0/1852710713 conn(0x7f1404077230 msgr2=0x7f1404104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:13.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 -- 172.21.15.12:0/1852710713 shutdown_connections 2024-09-19T06:40:13.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:13.088+0000 7f140938a640 1 -- 172.21.15.12:0/1852710713 wait complete. 2024-09-19T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi012 to 177.0M 2024-09-19T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Unable to set osd_memory_target on smithi012 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-19T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi016:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi012:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi016:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: Updating smithi012:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:13.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1852710713' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:13.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:13 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi012 to 177.0M 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Unable to set osd_memory_target on smithi012 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi016:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi012:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:13.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:13.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:13.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi016:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:13.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: Updating smithi012:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:13.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T06:40:13.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1852710713' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:13.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:13.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:13.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:13.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:13 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi012 to 177.0M 2024-09-19T06:40:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Unable to set osd_memory_target on smithi012 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:40:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-19T06:40:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi016:/etc/ceph/ceph.conf 2024-09-19T06:40:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-19T06:40:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:40:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi016:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi012:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:13.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi016:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi016:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: Updating smithi012:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T06:40:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1852710713' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:13.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:13.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:13.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:13.762 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:13 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:13.846 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:40:14.109 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.566+0000 7fab6c41d640 1 -- 172.21.15.12:0/1098640635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab64100a80 msgr2=0x7fab64100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.566+0000 7fab6c41d640 1 --2- 172.21.15.12:0/1098640635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab64100a80 0x7fab64100ee0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fab60009930 tx=0x7fab6002a420 comp rx=0 tx=0).stop 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.566+0000 7fab6c41d640 1 -- 172.21.15.12:0/1098640635 shutdown_connections 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.566+0000 7fab6c41d640 1 --2- 172.21.15.12:0/1098640635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64101420 0x7fab6410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.566+0000 7fab6c41d640 1 --2- 172.21.15.12:0/1098640635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab64100a80 0x7fab64100ee0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.566+0000 7fab6c41d640 1 --2- 172.21.15.12:0/1098640635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab64106a80 0x7fab64106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.566+0000 7fab6c41d640 1 -- 172.21.15.12:0/1098640635 >> 172.21.15.12:0/1098640635 conn(0x7fab640fc7a0 msgr2=0x7fab640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.566+0000 7fab6c41d640 1 -- 172.21.15.12:0/1098640635 shutdown_connections 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.566+0000 7fab6c41d640 1 -- 172.21.15.12:0/1098640635 wait complete. 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6c41d640 1 Processor -- start 2024-09-19T06:40:14.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6c41d640 1 -- start start 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6c41d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab64100a80 0x7fab64197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6c41d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64101420 0x7fab64197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6c41d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab64106a80 0x7fab6419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6c41d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fab64110e40 con 0x7fab64100a80 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6c41d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fab64110cc0 con 0x7fab64101420 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6c41d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fab64110fc0 con 0x7fab64106a80 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6a1b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab64100a80 0x7fab64197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6a1b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab64100a80 0x7fab64197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36850/0 (socket says 172.21.15.12:36850) 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.567+0000 7fab6a1b9640 1 -- 172.21.15.12:0/1495708711 learned_addr learned my addr 172.21.15.12:0/1495708711 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab699b8640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64101420 0x7fab64197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:14.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab6a9ba640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab64106a80 0x7fab6419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab6a1b9640 1 -- 172.21.15.12:0/1495708711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab64106a80 msgr2=0x7fab6419bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab6a1b9640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab64106a80 0x7fab6419bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab6a1b9640 1 -- 172.21.15.12:0/1495708711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64101420 msgr2=0x7fab64197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab6a1b9640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64101420 0x7fab64197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab6a1b9640 1 -- 172.21.15.12:0/1495708711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6419c2d0 con 0x7fab64100a80 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab699b8640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64101420 0x7fab64197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab6a9ba640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab64106a80 0x7fab6419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab6a1b9640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab64100a80 0x7fab64197320 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fab54007b50 tx=0x7fab5400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab5b7fe640 1 -- 172.21.15.12:0/1495708711 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54007c40 con 0x7fab64100a80 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab6c41d640 1 -- 172.21.15.12:0/1495708711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6419c5c0 con 0x7fab64100a80 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab5b7fe640 1 -- 172.21.15.12:0/1495708711 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab54007de0 con 0x7fab64100a80 2024-09-19T06:40:14.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab5b7fe640 1 -- 172.21.15.12:0/1495708711 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5400ae60 con 0x7fab64100a80 2024-09-19T06:40:14.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.568+0000 7fab6c41d640 1 -- 172.21.15.12:0/1495708711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6406a790 con 0x7fab64100a80 2024-09-19T06:40:14.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.569+0000 7fab6c41d640 1 -- 172.21.15.12:0/1495708711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab64100ee0 con 0x7fab64100a80 2024-09-19T06:40:14.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.570+0000 7fab5b7fe640 1 -- 172.21.15.12:0/1495708711 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fab5400a440 con 0x7fab64100a80 2024-09-19T06:40:14.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.571+0000 7fab5b7fe640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab500a3440 0x7fab500a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:14.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.571+0000 7fab699b8640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab500a3440 0x7fab500a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:14.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.571+0000 7fab5b7fe640 1 -- 172.21.15.12:0/1495708711 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fab540d1510 con 0x7fab64100a80 2024-09-19T06:40:14.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.571+0000 7fab699b8640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab500a3440 0x7fab500a5900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fab60000c00 tx=0x7fab60032d50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:14.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.575+0000 7fab5b7fe640 1 -- 172.21.15.12:0/1495708711 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab54023060 con 0x7fab64100a80 2024-09-19T06:40:14.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.755+0000 7fab6c41d640 1 -- 172.21.15.12:0/1495708711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab6406b1b0 con 0x7fab64100a80 2024-09-19T06:40:14.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.757+0000 7fab5b7fe640 1 -- 172.21.15.12:0/1495708711 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+23298 (secure 0 0 0) 0x7fab5409dd30 con 0x7fab64100a80 2024-09-19T06:40:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:14.758 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":86,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:40:08.069349+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":1}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6801/4060248487":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/3390758821":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1769692721":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/2160320420":"2024-09-20T06:40:08.069301+0000","172.21.15.12:6800/4060248487":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2954657663":"2024-09-20T06:40:08.069301+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:40:14.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 -- 172.21.15.12:0/1495708711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab500a3440 msgr2=0x7fab500a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab500a3440 0x7fab500a5900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fab60000c00 tx=0x7fab60032d50 comp rx=0 tx=0).stop 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 -- 172.21.15.12:0/1495708711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab64100a80 msgr2=0x7fab64197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab64100a80 0x7fab64197320 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fab54007b50 tx=0x7fab5400e420 comp rx=0 tx=0).stop 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 -- 172.21.15.12:0/1495708711 shutdown_connections 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab500a3440 0x7fab500a5900 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab64106a80 0x7fab6419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab64101420 0x7fab64197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 --2- 172.21.15.12:0/1495708711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab64100a80 0x7fab64197320 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 -- 172.21.15.12:0/1495708711 >> 172.21.15.12:0/1495708711 conn(0x7fab640fc7a0 msgr2=0x7fab640fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 -- 172.21.15.12:0/1495708711 shutdown_connections 2024-09-19T06:40:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:14.759+0000 7fab6c41d640 1 -- 172.21.15.12:0/1495708711 wait complete. 2024-09-19T06:40:15.482 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T06:40:15.482 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T06:40:15.492 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:40:15.492 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:40:15.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T06:40:15.493 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T06:40:15.493 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:40:15.493 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:40:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:15 smithi173 ceph-mon[35349]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:40:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:15 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1495708711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:40:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.605+0000 7f3a990e4640 1 -- 172.21.15.12:0/4037352551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a94107b70 msgr2=0x7f3a94107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.605+0000 7f3a990e4640 1 --2- 172.21.15.12:0/4037352551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a94107b70 0x7f3a94107f50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009cd0 tx=0x7f3a8402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.605+0000 7f3a990e4640 1 -- 172.21.15.12:0/4037352551 shutdown_connections 2024-09-19T06:40:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.605+0000 7f3a990e4640 1 --2- 172.21.15.12:0/4037352551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a94102470 0x7f3a9410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.605+0000 7f3a990e4640 1 --2- 172.21.15.12:0/4037352551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a94101ad0 0x7f3a94101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.605+0000 7f3a990e4640 1 --2- 172.21.15.12:0/4037352551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a94107b70 0x7f3a94107f50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.605+0000 7f3a990e4640 1 -- 172.21.15.12:0/4037352551 >> 172.21.15.12:0/4037352551 conn(0x7f3a940fd7d0 msgr2=0x7f3a940ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.605+0000 7f3a990e4640 1 -- 172.21.15.12:0/4037352551 shutdown_connections 2024-09-19T06:40:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.605+0000 7f3a990e4640 1 -- 172.21.15.12:0/4037352551 wait complete. 2024-09-19T06:40:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a990e4640 1 Processor -- start 2024-09-19T06:40:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a990e4640 1 -- start start 2024-09-19T06:40:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a990e4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a94101ad0 0x7f3a941983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a990e4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a94102470 0x7f3a941988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a990e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a94107b70 0x7f3a9419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a990e4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3a94111f20 con 0x7f3a94107b70 2024-09-19T06:40:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a990e4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3a94111da0 con 0x7f3a94102470 2024-09-19T06:40:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a990e4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3a941120a0 con 0x7f3a94101ad0 2024-09-19T06:40:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a9359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a94107b70 0x7f3a9419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a9359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a94107b70 0x7f3a9419cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36872/0 (socket says 172.21.15.12:36872) 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a9359e640 1 -- 172.21.15.12:0/2198183944 learned_addr learned my addr 172.21.15.12:0/2198183944 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a92d9d640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a94101ad0 0x7f3a941983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a9259c640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a94102470 0x7f3a941988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a9359e640 1 -- 172.21.15.12:0/2198183944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a94101ad0 msgr2=0x7f3a941983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a9359e640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a94101ad0 0x7f3a941983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a9359e640 1 -- 172.21.15.12:0/2198183944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a94102470 msgr2=0x7f3a941988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a9359e640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a94102470 0x7f3a941988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.606+0000 7f3a9359e640 1 -- 172.21.15.12:0/2198183944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9419d3a0 con 0x7f3a94107b70 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.607+0000 7f3a9359e640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a94107b70 0x7f3a9419cc70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00e970 tx=0x7f3a8c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.607+0000 7f3a7bfff640 1 -- 172.21.15.12:0/2198183944 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c00ccc0 con 0x7f3a94107b70 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.607+0000 7f3a990e4640 1 -- 172.21.15.12:0/2198183944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9419d690 con 0x7f3a94107b70 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.607+0000 7f3a7bfff640 1 -- 172.21.15.12:0/2198183944 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a8c00ce60 con 0x7f3a94107b70 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.607+0000 7f3a990e4640 1 -- 172.21.15.12:0/2198183944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a941a4f20 con 0x7f3a94107b70 2024-09-19T06:40:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.607+0000 7f3a7bfff640 1 -- 172.21.15.12:0/2198183944 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c018630 con 0x7f3a94107b70 2024-09-19T06:40:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.608+0000 7f3a990e4640 1 -- 172.21.15.12:0/2198183944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a94101f30 con 0x7f3a94107b70 2024-09-19T06:40:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.609+0000 7f3a7bfff640 1 -- 172.21.15.12:0/2198183944 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f3a8c0187d0 con 0x7f3a94107b70 2024-09-19T06:40:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.610+0000 7f3a7bfff640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a7c0a3500 0x7f3a7c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.610+0000 7f3a7bfff640 1 -- 172.21.15.12:0/2198183944 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f3a8c0d0570 con 0x7f3a94107b70 2024-09-19T06:40:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.610+0000 7f3a92d9d640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a7c0a3500 0x7f3a7c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:15.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.610+0000 7f3a92d9d640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a7c0a3500 0x7f3a7c0a59c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3a84006010 tx=0x7f3a840093f0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.614+0000 7f3a7bfff640 1 -- 172.21.15.12:0/2198183944 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a8c09cd60 con 0x7f3a94107b70 2024-09-19T06:40:15.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:15 smithi012 ceph-mon[30937]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:40:15.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:15 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1495708711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:40:15.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:15 smithi016 ceph-mon[34911]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:40:15.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:15 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1495708711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:40:15.769 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:15.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.814+0000 7f3a990e4640 1 -- 172.21.15.12:0/2198183944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f3a941a51b0 con 0x7f3a94107b70 2024-09-19T06:40:15.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.818+0000 7f3a7bfff640 1 -- 172.21.15.12:0/2198183944 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7f3a8c09c660 con 0x7f3a94107b70 2024-09-19T06:40:15.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.820+0000 7f3a990e4640 1 -- 172.21.15.12:0/2198183944 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a7c0a3500 msgr2=0x7f3a7c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:15.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.820+0000 7f3a990e4640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a7c0a3500 0x7f3a7c0a59c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3a84006010 tx=0x7f3a840093f0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.820+0000 7f3a990e4640 1 -- 172.21.15.12:0/2198183944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a94107b70 msgr2=0x7f3a9419cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:15.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.820+0000 7f3a990e4640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a94107b70 0x7f3a9419cc70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00e970 tx=0x7f3a8c00ed70 comp rx=0 tx=0).stop 2024-09-19T06:40:15.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.820+0000 7f3a990e4640 1 -- 172.21.15.12:0/2198183944 shutdown_connections 2024-09-19T06:40:15.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.820+0000 7f3a990e4640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a94107b70 0x7f3a9419cc70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.820+0000 7f3a990e4640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a94102470 0x7f3a941988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.820+0000 7f3a990e4640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a7c0a3500 0x7f3a7c0a59c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.820+0000 7f3a990e4640 1 --2- 172.21.15.12:0/2198183944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a94101ad0 0x7f3a941983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.821+0000 7f3a990e4640 1 -- 172.21.15.12:0/2198183944 >> 172.21.15.12:0/2198183944 conn(0x7f3a940fd7d0 msgr2=0x7f3a940fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:15.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.821+0000 7f3a990e4640 1 -- 172.21.15.12:0/2198183944 shutdown_connections 2024-09-19T06:40:15.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.821+0000 7f3a990e4640 1 -- 172.21.15.12:0/2198183944 wait complete. 2024-09-19T06:40:15.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T06:40:15.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.942+0000 7f942fbe4640 1 -- 172.21.15.12:0/1791924787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f942810e440 msgr2=0x7f9428110830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:15.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.942+0000 7f942fbe4640 1 --2- 172.21.15.12:0/1791924787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f942810e440 0x7f9428110830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9420009ca0 tx=0x7f942002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.942+0000 7f942fbe4640 1 -- 172.21.15.12:0/1791924787 shutdown_connections 2024-09-19T06:40:15.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.942+0000 7f942fbe4640 1 --2- 172.21.15.12:0/1791924787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f942810e440 0x7f9428110830 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.942+0000 7f942fbe4640 1 --2- 172.21.15.12:0/1791924787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9428101240 0x7f942810de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.942+0000 7f942fbe4640 1 --2- 172.21.15.12:0/1791924787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9428100890 0x7f9428100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.942+0000 7f942fbe4640 1 -- 172.21.15.12:0/1791924787 >> 172.21.15.12:0/1791924787 conn(0x7f9428077990 msgr2=0x7f94280fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:15.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942fbe4640 1 -- 172.21.15.12:0/1791924787 shutdown_connections 2024-09-19T06:40:15.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942fbe4640 1 -- 172.21.15.12:0/1791924787 wait complete. 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942fbe4640 1 Processor -- start 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942fbe4640 1 -- start start 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942fbe4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9428100890 0x7f942819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942fbe4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9428101240 0x7f942819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942fbe4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f942810e440 0x7f942819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942fbe4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9428114100 con 0x7f9428100890 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942fbe4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9428113f80 con 0x7f942810e440 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942fbe4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9428114280 con 0x7f9428101240 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942d980640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9428100890 0x7f942819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942d980640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9428100890 0x7f942819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36898/0 (socket says 172.21.15.12:36898) 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.943+0000 7f942d980640 1 -- 172.21.15.12:0/2065102823 learned_addr learned my addr 172.21.15.12:0/2065102823 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f942e181640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f942810e440 0x7f942819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f942d17f640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9428101240 0x7f942819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f942d980640 1 -- 172.21.15.12:0/2065102823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9428101240 msgr2=0x7f942819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f942d980640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9428101240 0x7f942819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f942d980640 1 -- 172.21.15.12:0/2065102823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f942810e440 msgr2=0x7f942819ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f942d980640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f942810e440 0x7f942819ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f942d980640 1 -- 172.21.15.12:0/2065102823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942819f540 con 0x7f9428100890 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f942d980640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9428100890 0x7f942819a550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f942400e9f0 tx=0x7f942400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f941effd640 1 -- 172.21.15.12:0/2065102823 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942400cd80 con 0x7f9428100890 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f941effd640 1 -- 172.21.15.12:0/2065102823 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9424005500 con 0x7f9428100890 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f942fbe4640 1 -- 172.21.15.12:0/2065102823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942819f830 con 0x7f9428100890 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f941effd640 1 -- 172.21.15.12:0/2065102823 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424010690 con 0x7f9428100890 2024-09-19T06:40:15.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.944+0000 7f942fbe4640 1 -- 172.21.15.12:0/2065102823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94281a70c0 con 0x7f9428100890 2024-09-19T06:40:15.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.945+0000 7f942fbe4640 1 -- 172.21.15.12:0/2065102823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9428100c70 con 0x7f9428100890 2024-09-19T06:40:15.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.946+0000 7f941effd640 1 -- 172.21.15.12:0/2065102823 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f94240046c0 con 0x7f9428100890 2024-09-19T06:40:15.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.947+0000 7f941effd640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94140a3500 0x7f94140a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:15.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.947+0000 7f942d17f640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94140a3500 0x7f94140a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:15.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.947+0000 7f941effd640 1 -- 172.21.15.12:0/2065102823 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f94240d04f0 con 0x7f9428100890 2024-09-19T06:40:15.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.948+0000 7f942d17f640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94140a3500 0x7f94140a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9428102700 tx=0x7f941800b390 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:15.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:15.950+0000 7f941effd640 1 -- 172.21.15.12:0/2065102823 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9424054210 con 0x7f9428100890 2024-09-19T06:40:16.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.130+0000 7f942fbe4640 1 -- 172.21.15.12:0/2065102823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f942819b8a0 con 0x7f9428100890 2024-09-19T06:40:16.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.134+0000 7f941effd640 1 -- 172.21.15.12:0/2065102823 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7f942409cce0 con 0x7f9428100890 2024-09-19T06:40:16.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 -- 172.21.15.12:0/2065102823 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94140a3500 msgr2=0x7f94140a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94140a3500 0x7f94140a59c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9428102700 tx=0x7f941800b390 comp rx=0 tx=0).stop 2024-09-19T06:40:16.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 -- 172.21.15.12:0/2065102823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9428100890 msgr2=0x7f942819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9428100890 0x7f942819a550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f942400e9f0 tx=0x7f942400edf0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 -- 172.21.15.12:0/2065102823 shutdown_connections 2024-09-19T06:40:16.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f942810e440 0x7f942819ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94140a3500 0x7f94140a59c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9428101240 0x7f942819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 --2- 172.21.15.12:0/2065102823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9428100890 0x7f942819a550 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 -- 172.21.15.12:0/2065102823 >> 172.21.15.12:0/2065102823 conn(0x7f9428077990 msgr2=0x7f94280ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 -- 172.21.15.12:0/2065102823 shutdown_connections 2024-09-19T06:40:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.136+0000 7f942fbe4640 1 -- 172.21.15.12:0/2065102823 wait complete. 2024-09-19T06:40:16.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T06:40:16.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.257+0000 7fbfd1247640 1 -- 172.21.15.12:0/348006847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfcc1069e0 msgr2=0x7fbfcc106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.257+0000 7fbfd1247640 1 --2- 172.21.15.12:0/348006847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfcc1069e0 0x7fbfcc106dc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009930 tx=0x7fbfbc02a420 comp rx=0 tx=0).stop 2024-09-19T06:40:16.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.257+0000 7fbfd1247640 1 -- 172.21.15.12:0/348006847 shutdown_connections 2024-09-19T06:40:16.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.257+0000 7fbfd1247640 1 --2- 172.21.15.12:0/348006847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfcc101370 0x7fbfcc10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.257+0000 7fbfd1247640 1 --2- 172.21.15.12:0/348006847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc1009d0 0x7fbfcc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.257+0000 7fbfd1247640 1 --2- 172.21.15.12:0/348006847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfcc1069e0 0x7fbfcc106dc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.257+0000 7fbfd1247640 1 -- 172.21.15.12:0/348006847 >> 172.21.15.12:0/348006847 conn(0x7fbfcc0fc6b0 msgr2=0x7fbfcc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.257+0000 7fbfd1247640 1 -- 172.21.15.12:0/348006847 shutdown_connections 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.257+0000 7fbfd1247640 1 -- 172.21.15.12:0/348006847 wait complete. 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.258+0000 7fbfd1247640 1 Processor -- start 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.258+0000 7fbfd1247640 1 -- start start 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfd1247640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfcc1009d0 0x7fbfcc1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfd1247640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfcc101370 0x7fbfcc199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfd1247640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc1069e0 0x7fbfcc1a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfd1247640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc110e70 con 0x7fbfcc1009d0 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfd1247640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc110cf0 con 0x7fbfcc101370 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfd1247640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc110ff0 con 0x7fbfcc1069e0 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfcad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfcc1009d0 0x7fbfcc1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfcad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfcc1009d0 0x7fbfcc1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36912/0 (socket says 172.21.15.12:36912) 2024-09-19T06:40:16.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfca59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfcc101370 0x7fbfcc199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfcad9d640 1 -- 172.21.15.12:0/2571524513 learned_addr learned my addr 172.21.15.12:0/2571524513 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:16.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfcb59e640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc1069e0 0x7fbfcc1a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfcad9d640 1 -- 172.21.15.12:0/2571524513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc1069e0 msgr2=0x7fbfcc1a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfcad9d640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc1069e0 0x7fbfcc1a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfcad9d640 1 -- 172.21.15.12:0/2571524513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfcc101370 msgr2=0x7fbfcc199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfcad9d640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfcc101370 0x7fbfcc199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfcad9d640 1 -- 172.21.15.12:0/2571524513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfcc1a47b0 con 0x7fbfcc1009d0 2024-09-19T06:40:16.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfcad9d640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfcc1009d0 0x7fbfcc1991f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc02a940 tx=0x7fbfbc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:16.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.259+0000 7fbfb3fff640 1 -- 172.21.15.12:0/2571524513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc03f070 con 0x7fbfcc1009d0 2024-09-19T06:40:16.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.260+0000 7fbfb3fff640 1 -- 172.21.15.12:0/2571524513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfbc031c90 con 0x7fbfcc1009d0 2024-09-19T06:40:16.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.260+0000 7fbfd1247640 1 -- 172.21.15.12:0/2571524513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfcc1a4980 con 0x7fbfcc1009d0 2024-09-19T06:40:16.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.260+0000 7fbfb3fff640 1 -- 172.21.15.12:0/2571524513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc035030 con 0x7fbfcc1009d0 2024-09-19T06:40:16.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.260+0000 7fbfd1247640 1 -- 172.21.15.12:0/2571524513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfcc1a4e40 con 0x7fbfcc1009d0 2024-09-19T06:40:16.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.261+0000 7fbfd1247640 1 -- 172.21.15.12:0/2571524513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfcc100e30 con 0x7fbfcc1009d0 2024-09-19T06:40:16.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.262+0000 7fbfb3fff640 1 -- 172.21.15.12:0/2571524513 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fbfbc042070 con 0x7fbfcc1009d0 2024-09-19T06:40:16.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.263+0000 7fbfb3fff640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfb40a3580 0x7fbfb40a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.263+0000 7fbfb3fff640 1 -- 172.21.15.12:0/2571524513 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbfbc0f0610 con 0x7fbfcc1009d0 2024-09-19T06:40:16.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.263+0000 7fbfca59c640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfb40a3580 0x7fbfb40a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.263+0000 7fbfca59c640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfb40a3580 0x7fbfb40a5a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc06ac10 tx=0x7fbfc000b390 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:16.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.267+0000 7fbfb3fff640 1 -- 172.21.15.12:0/2571524513 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbfbc0bc750 con 0x7fbfcc1009d0 2024-09-19T06:40:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.289+0000 7f5073db7640 1 -- 172.21.15.12:0/3535915759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f506c102570 msgr2=0x7f506c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.289+0000 7f5073db7640 1 --2- 172.21.15.12:0/3535915759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f506c102570 0x7f506c1029b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5060009900 tx=0x7f506002a480 comp rx=0 tx=0).stop 2024-09-19T06:40:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.289+0000 7f5073db7640 1 -- 172.21.15.12:0/3535915759 shutdown_connections 2024-09-19T06:40:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.289+0000 7f5073db7640 1 --2- 172.21.15.12:0/3535915759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f506c102ef0 0x7f506c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.289+0000 7f5073db7640 1 --2- 172.21.15.12:0/3535915759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f506c102570 0x7f506c1029b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.289+0000 7f5073db7640 1 --2- 172.21.15.12:0/3535915759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c100e20 0x7f506c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.289+0000 7f5073db7640 1 -- 172.21.15.12:0/3535915759 >> 172.21.15.12:0/3535915759 conn(0x7f506c0fc7d0 msgr2=0x7f506c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.289+0000 7f5073db7640 1 -- 172.21.15.12:0/3535915759 shutdown_connections 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.289+0000 7f5073db7640 1 -- 172.21.15.12:0/3535915759 wait complete. 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.290+0000 7f5073db7640 1 Processor -- start 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.290+0000 7f5073db7640 1 -- start start 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.290+0000 7f5073db7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f506c100e20 0x7f506c1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.290+0000 7f5073db7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f506c102570 0x7f506c197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.290+0000 7f5073db7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c102ef0 0x7f506c19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.290+0000 7f5073db7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f506c110f50 con 0x7f506c102570 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.290+0000 7f5073db7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f506c110dd0 con 0x7f506c102ef0 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.290+0000 7f5073db7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1110d0 con 0x7f506c100e20 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071352640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f506c102570 0x7f506c197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071352640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f506c102570 0x7f506c197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36934/0 (socket says 172.21.15.12:36934) 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071352640 1 -- 172.21.15.12:0/3817446913 learned_addr learned my addr 172.21.15.12:0/3817446913 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5072354640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c102ef0 0x7f506c19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071b53640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f506c100e20 0x7f506c1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071352640 1 -- 172.21.15.12:0/3817446913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f506c100e20 msgr2=0x7f506c1973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071352640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f506c100e20 0x7f506c1973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071352640 1 -- 172.21.15.12:0/3817446913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c102ef0 msgr2=0x7f506c19bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071352640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c102ef0 0x7f506c19bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071352640 1 -- 172.21.15.12:0/3817446913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506c19c3a0 con 0x7f506c102570 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071b53640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f506c100e20 0x7f506c1973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5071352640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f506c102570 0x7f506c197930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5060006010 tx=0x7f5060003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f506affd640 1 -- 172.21.15.12:0/3817446913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506003f070 con 0x7f506c102570 2024-09-19T06:40:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f5073db7640 1 -- 172.21.15.12:0/3817446913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506c19c630 con 0x7f506c102570 2024-09-19T06:40:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f506affd640 1 -- 172.21.15.12:0/3817446913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5060031c30 con 0x7f506c102570 2024-09-19T06:40:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.291+0000 7f506affd640 1 -- 172.21.15.12:0/3817446913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060035030 con 0x7f506c102570 2024-09-19T06:40:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.292+0000 7f5073db7640 1 -- 172.21.15.12:0/3817446913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506c069f70 con 0x7f506c102570 2024-09-19T06:40:16.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.294+0000 7f5076190740 1 Processor -- start 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.294+0000 7f5076190740 1 -- start start 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.294+0000 7f5076190740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f825f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.294+0000 7f5076190740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f826480 0x55fd7f830800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.294+0000 7f5076190740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f830d40 0x55fd7f833130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.294+0000 7f5076190740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fd7f78b280 con 0x55fd7f825b60 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.294+0000 7f5076190740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fd7f732b10 con 0x55fd7f826480 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.294+0000 7f5076190740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fd7f787240 con 0x55fd7f830d40 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f5072354640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f825f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f5072354640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f825f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36938/0 (socket says 172.21.15.12:36938) 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f5072354640 1 -- 172.21.15.12:0/1907205219 learned_addr learned my addr 172.21.15.12:0/1907205219 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f5071b53640 1 --2- 172.21.15.12:0/1907205219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f826480 0x55fd7f830800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f5072354640 1 -- 172.21.15.12:0/1907205219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f830d40 msgr2=0x55fd7f833130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f5072354640 1 --2- 172.21.15.12:0/1907205219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f830d40 0x55fd7f833130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f5072354640 1 -- 172.21.15.12:0/1907205219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f826480 msgr2=0x55fd7f830800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f5072354640 1 --2- 172.21.15.12:0/1907205219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f826480 0x55fd7f830800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f5072354640 1 -- 172.21.15.12:0/1907205219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd7f73f1f0 con 0x55fd7f825b60 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f506affd640 1 -- 172.21.15.12:0/3817446913 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f5060042070 con 0x7f506c102570 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.295+0000 7f5072354640 1 --2- 172.21.15.12:0/1907205219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f825f40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5064009c20 tx=0x7f5064011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3400130e91c6a654 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.296+0000 7f5053fff640 1 -- 172.21.15.12:0/1907205219 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506401e070 con 0x55fd7f825b60 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.296+0000 7f5053fff640 1 -- 172.21.15.12:0/1907205219 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5064019b10 con 0x55fd7f825b60 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.296+0000 7f5053fff640 1 -- 172.21.15.12:0/1907205219 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506400e9e0 con 0x55fd7f825b60 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.296+0000 7f506affd640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50540a5650 0x7f50540a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.296+0000 7f5071b53640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50540a5650 0x7f50540a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.296+0000 7f506affd640 1 -- 172.21.15.12:0/3817446913 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f50600f0640 con 0x7f506c102570 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.296+0000 7f5076190740 1 -- 172.21.15.12:0/1907205219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 msgr2=0x55fd7f825f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.296+0000 7f5071b53640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50540a5650 0x7f50540a7b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x55fd7f822f50 tx=0x7f505c009940 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.296+0000 7f5076190740 1 --2- 172.21.15.12:0/1907205219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f825f40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5064009c20 tx=0x7f5064011810 comp rx=0 tx=0).stop 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.297+0000 7f5076190740 1 -- 172.21.15.12:0/1907205219 shutdown_connections 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.297+0000 7f5076190740 1 --2- 172.21.15.12:0/1907205219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f830d40 0x55fd7f833130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.297+0000 7f5076190740 1 --2- 172.21.15.12:0/1907205219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f826480 0x55fd7f830800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.297+0000 7f5076190740 1 --2- 172.21.15.12:0/1907205219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f825f40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.297+0000 7f5076190740 1 -- 172.21.15.12:0/1907205219 >> 172.21.15.12:0/1907205219 conn(0x55fd7f8220f0 msgr2=0x55fd7f8224d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.297+0000 7f5076190740 1 -- 172.21.15.12:0/1907205219 shutdown_connections 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.297+0000 7f5076190740 1 -- 172.21.15.12:0/1907205219 wait complete. 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.297+0000 7f5076190740 1 -- start start 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.297+0000 7f5076190740 1 Processor -- start 2024-09-19T06:40:16.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5076190740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f82dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5076190740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 0x55fd7f82e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5076190740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 0x55fd7f82e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5076190740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fd7f833910 con 0x55fd7f825b60 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5076190740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fd7f745f10 con 0x55fd7f830d40 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5076190740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fd7f833a90 con 0x55fd7f826480 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5076190740 10 client.0 _ll_register_callbacks cb 0x55fd7f70ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5071b53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f82dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5071b53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f82dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36952/0 (socket says 172.21.15.12:36952) 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5071b53640 1 -- 172.21.15.12:0/3565819457 learned_addr learned my addr 172.21.15.12:0/3565819457 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5071352640 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 0x55fd7f82e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5072354640 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 0x55fd7f82e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5071352640 1 -- 172.21.15.12:0/3565819457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 msgr2=0x55fd7f82e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5071352640 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 0x55fd7f82e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5071352640 1 -- 172.21.15.12:0/3565819457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 msgr2=0x55fd7f82dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5071352640 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f82dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5071352640 1 -- 172.21.15.12:0/3565819457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd7f4fc6a0 con 0x55fd7f826480 2024-09-19T06:40:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5071b53640 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f82dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.298+0000 7f5072354640 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 0x55fd7f82e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.299+0000 7f5071352640 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 0x55fd7f82e200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50600edc50 tx=0x7f50600b8a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be346283499094ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.299+0000 7f50517fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:40:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.299+0000 7f50517fa640 1 -- 172.21.15.12:0/3565819457 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060049070 con 0x55fd7f826480 2024-09-19T06:40:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.299+0000 7f5076190740 1 -- 172.21.15.12:0/3565819457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5064019b10 con 0x55fd7f826480 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.299+0000 7f50517fa640 1 -- 172.21.15.12:0/3565819457 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f50600b8da0 con 0x55fd7f826480 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.299+0000 7f50517fa640 1 -- 172.21.15.12:0/3565819457 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f50600bce30 con 0x55fd7f826480 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.299+0000 7f5076190740 10 client.25063 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.299+0000 7f5076190740 1 -- 172.21.15.12:0/3565819457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd7f833960 con 0x55fd7f826480 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.299+0000 7f50517fa640 1 -- 172.21.15.12:0/3565819457 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5064019b10 con 0x55fd7f826480 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.300+0000 7f50517fa640 1 -- 172.21.15.12:0/3565819457 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f50600edf00 con 0x55fd7f826480 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.300+0000 7f5076190740 10 client.25063 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.300+0000 7f5076190740 10 client.25063 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.300+0000 7f5076190740 20 client.25063 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.300+0000 7f5076190740 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fd7f840970 0x55fd7f842d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.300+0000 7f5076190740 4 client.25063 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.300+0000 7f5076190740 1 -- 172.21.15.12:0/3565819457 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd7f7987f0 con 0x55fd7f840970 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.300+0000 7f5071b53640 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fd7f840970 0x55fd7f842d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.300+0000 7f5071b53640 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fd7f840970 0x55fd7f842d90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9d94f6c8c78158 server_cookie=20591bf773121ee0 in_seq=0 out_seq=0 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.300+0000 7f50517fa640 10 client.25063 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.301+0000 7f50517fa640 1 -- 172.21.15.12:0/3565819457 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd7f7987f0 con 0x55fd7f840970 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.301+0000 7f50517fa640 10 client.25063 handle_command_reply: tid=0 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.301+0000 7f5076190740 1 client.25063 shutdown 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.301+0000 7f5076190740 1 -- 172.21.15.12:0/3565819457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 msgr2=0x55fd7f82e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.301+0000 7f5076190740 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 0x55fd7f82e200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50600edc50 tx=0x7f50600b8a50 comp rx=0 tx=0).stop 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.302+0000 7f5076190740 1 -- 172.21.15.12:0/3565819457 shutdown_connections 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.302+0000 7f5076190740 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fd7f840970 0x55fd7f842d90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.302+0000 7f5076190740 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 0x55fd7f82e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.302+0000 7f5076190740 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 0x55fd7f82e200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.302+0000 7f5076190740 1 --2- 172.21.15.12:0/3565819457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f82dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.302+0000 7f50517fa640 0 client.25063 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.302+0000 7f5076190740 1 -- 172.21.15.12:0/3565819457 >> 172.21.15.12:0/3565819457 conn(0x55fd7f8220f0 msgr2=0x55fd7f827e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.302+0000 7f5076190740 1 -- 172.21.15.12:0/3565819457 shutdown_connections 2024-09-19T06:40:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.302+0000 7f5076190740 1 -- 172.21.15.12:0/3565819457 wait complete. 2024-09-19T06:40:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.302+0000 7f5076190740 20 client.25063 trim_cache size 0 max 16384 2024-09-19T06:40:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.319+0000 7f5076190740 1 Processor -- start 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.319+0000 7f5076190740 1 -- start start 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.319+0000 7f5076190740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f848680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.319+0000 7f5076190740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 0x55fd7f848bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.319+0000 7f5076190740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 0x55fd7f82af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.319+0000 7f5076190740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1ab8d0 con 0x55fd7f825b60 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5076190740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1ad410 con 0x55fd7f830d40 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5076190740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1abfa0 con 0x55fd7f826480 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5071b53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f848680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5071b53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f848680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36966/0 (socket says 172.21.15.12:36966) 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5071b53640 1 -- 172.21.15.12:0/1349778441 learned_addr learned my addr 172.21.15.12:0/1349778441 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5071352640 1 --2- 172.21.15.12:0/1349778441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 0x55fd7f848bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5072354640 1 --2- 172.21.15.12:0/1349778441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 0x55fd7f82af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5071b53640 1 -- 172.21.15.12:0/1349778441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 msgr2=0x55fd7f848bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5071b53640 1 --2- 172.21.15.12:0/1349778441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 0x55fd7f848bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5071b53640 1 -- 172.21.15.12:0/1349778441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 msgr2=0x55fd7f82af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5071b53640 1 --2- 172.21.15.12:0/1349778441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 0x55fd7f82af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5071b53640 1 -- 172.21.15.12:0/1349778441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd7f8433f0 con 0x55fd7f825b60 2024-09-19T06:40:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f5071b53640 1 --2- 172.21.15.12:0/1349778441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f848680 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55fd7f8435f0 tx=0x7f505c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1219ef1000d49ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.320+0000 7f50537fe640 1 -- 172.21.15.12:0/1349778441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c032420 con 0x55fd7f825b60 2024-09-19T06:40:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f50537fe640 1 -- 172.21.15.12:0/1349778441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f505c0298f0 con 0x55fd7f825b60 2024-09-19T06:40:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f50537fe640 1 -- 172.21.15.12:0/1349778441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c01e940 con 0x55fd7f825b60 2024-09-19T06:40:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f5076190740 1 -- 172.21.15.12:0/1349778441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 msgr2=0x55fd7f848680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f5076190740 1 --2- 172.21.15.12:0/1349778441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f848680 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x55fd7f8435f0 tx=0x7f505c015000 comp rx=0 tx=0).stop 2024-09-19T06:40:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f5076190740 1 -- 172.21.15.12:0/1349778441 shutdown_connections 2024-09-19T06:40:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f5076190740 1 --2- 172.21.15.12:0/1349778441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f830d40 0x55fd7f82af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f5076190740 1 --2- 172.21.15.12:0/1349778441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f826480 0x55fd7f848bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f5076190740 1 --2- 172.21.15.12:0/1349778441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f825b60 0x55fd7f848680 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f5076190740 1 -- 172.21.15.12:0/1349778441 >> 172.21.15.12:0/1349778441 conn(0x55fd7f8220f0 msgr2=0x55fd7f82fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f5076190740 1 -- 172.21.15.12:0/1349778441 shutdown_connections 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.321+0000 7f5076190740 1 -- 172.21.15.12:0/1349778441 wait complete. 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.322+0000 7f5076190740 1 -- start start 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.322+0000 7f5076190740 1 Processor -- start 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.322+0000 7f5076190740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f825b60 0x55fd7f834f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.322+0000 7f5076190740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f826480 0x55fd7f835450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.322+0000 7f5076190740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f830d40 0x55fd7f8aa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.322+0000 7f5076190740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1acd40 con 0x55fd7f826480 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.322+0000 7f5076190740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1ac670 con 0x55fd7f825b60 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.322+0000 7f5076190740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f506c1a98b0 con 0x55fd7f830d40 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.322+0000 7f5076190740 10 client.0 _ll_register_callbacks cb 0x7f50600edae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5071352640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f826480 0x55fd7f835450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5071352640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f826480 0x55fd7f835450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36980/0 (socket says 172.21.15.12:36980) 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5071352640 1 -- 172.21.15.12:0/2727481873 learned_addr learned my addr 172.21.15.12:0/2727481873 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5071b53640 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f825b60 0x55fd7f834f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5072354640 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f830d40 0x55fd7f8aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5071352640 1 -- 172.21.15.12:0/2727481873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f830d40 msgr2=0x55fd7f8aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5071352640 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f830d40 0x55fd7f8aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5071352640 1 -- 172.21.15.12:0/2727481873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f825b60 msgr2=0x55fd7f834f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5071352640 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f825b60 0x55fd7f834f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5071352640 1 -- 172.21.15.12:0/2727481873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd7f8231a0 con 0x55fd7f826480 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5072354640 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f830d40 0x55fd7f8aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5071352640 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f826480 0x55fd7f835450 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f50600b9100 tx=0x7f5060005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b195ea0d0dd8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f50517fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f50517fa640 1 -- 172.21.15.12:0/2727481873 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060049040 con 0x55fd7f826480 2024-09-19T06:40:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f50517fa640 1 -- 172.21.15.12:0/2727481873 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5060031750 con 0x55fd7f826480 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f5076190740 1 -- 172.21.15.12:0/2727481873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f505c0298f0 con 0x55fd7f826480 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.323+0000 7f50517fa640 1 -- 172.21.15.12:0/2727481873 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f50600c53a0 con 0x55fd7f826480 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f5076190740 10 client.15387 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f5076190740 1 -- 172.21.15.12:0/2727481873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd7f8abbe0 con 0x55fd7f826480 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f50517fa640 1 -- 172.21.15.12:0/2727481873 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f505c0298f0 con 0x55fd7f826480 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f50517fa640 1 -- 172.21.15.12:0/2727481873 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f50600bb5f0 con 0x55fd7f826480 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f5076190740 10 client.15387 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f5076190740 10 client.15387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f5076190740 20 client.15387 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f5076190740 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fd7f8ac200 0x55fd7f8ae620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f5076190740 4 client.15387 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f5076190740 1 -- 172.21.15.12:0/2727481873 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fd7f792d00 con 0x55fd7f8ac200 2024-09-19T06:40:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.324+0000 7f5071b53640 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fd7f8ac200 0x55fd7f8ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.325+0000 7f5071b53640 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fd7f8ac200 0x55fd7f8ae620 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e63076505690e160 server_cookie=210c95457e065bca in_seq=0 out_seq=0 2024-09-19T06:40:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.325+0000 7f50517fa640 10 client.15387 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f50517fa640 1 -- 172.21.15.12:0/2727481873 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fd7f792d00 con 0x55fd7f8ac200 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f50517fa640 10 client.15387 handle_command_reply: tid=0 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 client.15387 shutdown 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 -- 172.21.15.12:0/2727481873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f826480 msgr2=0x55fd7f835450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f826480 0x55fd7f835450 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f50600b9100 tx=0x7f5060005900 comp rx=0 tx=0).stop 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 -- 172.21.15.12:0/2727481873 shutdown_connections 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fd7f8ac200 0x55fd7f8ae620 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fd7f830d40 0x55fd7f8aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd7f826480 0x55fd7f835450 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f50517fa640 0 client.15387 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 --2- 172.21.15.12:0/2727481873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fd7f825b60 0x55fd7f834f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 -- 172.21.15.12:0/2727481873 >> 172.21.15.12:0/2727481873 conn(0x55fd7f8220f0 msgr2=0x55fd7f82dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 -- 172.21.15.12:0/2727481873 shutdown_connections 2024-09-19T06:40:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 1 -- 172.21.15.12:0/2727481873 wait complete. 2024-09-19T06:40:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.326+0000 7f5076190740 20 client.15387 trim_cache size 0 max 16384 2024-09-19T06:40:16.332 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:40:16.332 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:40:16.332 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "6a799a2a-d5f1-46e5-82d1-894601600bb4", 2024-09-19T06:40:16.332 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:40:16.332 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:40:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 -- 172.21.15.12:0/3817446913 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50540a5650 msgr2=0x7f50540a7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50540a5650 0x7f50540a7b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x55fd7f822f50 tx=0x7f505c009940 comp rx=0 tx=0).stop 2024-09-19T06:40:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 -- 172.21.15.12:0/3817446913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f506c102570 msgr2=0x7f506c197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f506c102570 0x7f506c197930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5060006010 tx=0x7f5060003c10 comp rx=0 tx=0).stop 2024-09-19T06:40:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 -- 172.21.15.12:0/3817446913 shutdown_connections 2024-09-19T06:40:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f506c102ef0 0x7f506c19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f506c102570 0x7f506c197930 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50540a5650 0x7f50540a7b10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 --2- 172.21.15.12:0/3817446913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f506c100e20 0x7f506c1973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 -- 172.21.15.12:0/3817446913 >> 172.21.15.12:0/3817446913 conn(0x7f506c0fc7d0 msgr2=0x7f506c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 -- 172.21.15.12:0/3817446913 shutdown_connections 2024-09-19T06:40:16.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.327+0000 7f5073db7640 1 -- 172.21.15.12:0/3817446913 wait complete. 2024-09-19T06:40:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.457+0000 7fbfd1247640 1 -- 172.21.15.12:0/2571524513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fbfcc1a50f0 con 0x7fbfcc1009d0 2024-09-19T06:40:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.461+0000 7fbfb3fff640 1 -- 172.21.15.12:0/2571524513 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7fbfbc0c0a50 con 0x7fbfcc1009d0 2024-09-19T06:40:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 -- 172.21.15.12:0/2571524513 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfb40a3580 msgr2=0x7fbfb40a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfb40a3580 0x7fbfb40a5a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc06ac10 tx=0x7fbfc000b390 comp rx=0 tx=0).stop 2024-09-19T06:40:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 -- 172.21.15.12:0/2571524513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfcc1009d0 msgr2=0x7fbfcc1991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfcc1009d0 0x7fbfcc1991f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc02a940 tx=0x7fbfbc003b90 comp rx=0 tx=0).stop 2024-09-19T06:40:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 -- 172.21.15.12:0/2571524513 shutdown_connections 2024-09-19T06:40:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfb40a3580 0x7fbfb40a5a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfcc1069e0 0x7fbfcc1a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfcc101370 0x7fbfcc199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 --2- 172.21.15.12:0/2571524513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfcc1009d0 0x7fbfcc1991f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 -- 172.21.15.12:0/2571524513 >> 172.21.15.12:0/2571524513 conn(0x7fbfcc0fc6b0 msgr2=0x7fbfcc0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 -- 172.21.15.12:0/2571524513 shutdown_connections 2024-09-19T06:40:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.463+0000 7fbfd1247640 1 -- 172.21.15.12:0/2571524513 wait complete. 2024-09-19T06:40:16.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T06:40:16.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 -- 172.21.15.12:0/1427428255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6778101ae0 msgr2=0x7f6778101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 --2- 172.21.15.12:0/1427428255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6778101ae0 0x7f6778101f40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f676c009930 tx=0x7f676c02a420 comp rx=0 tx=0).stop 2024-09-19T06:40:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 -- 172.21.15.12:0/1427428255 shutdown_connections 2024-09-19T06:40:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 --2- 172.21.15.12:0/1427428255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6778102480 0x7f677810e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 --2- 172.21.15.12:0/1427428255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6778101ae0 0x7f6778101f40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 --2- 172.21.15.12:0/1427428255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6778107b80 0x7f6778107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 -- 172.21.15.12:0/1427428255 >> 172.21.15.12:0/1427428255 conn(0x7f67780fd7e0 msgr2=0x7f67780ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 -- 172.21.15.12:0/1427428255 shutdown_connections 2024-09-19T06:40:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 -- 172.21.15.12:0/1427428255 wait complete. 2024-09-19T06:40:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 Processor -- start 2024-09-19T06:40:16.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.584+0000 7f677e65c640 1 -- start start 2024-09-19T06:40:16.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f677e65c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6778101ae0 0x7f67781983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f677e65c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6778102480 0x7f67781988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f677e65c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6778107b80 0x7f677819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f677e65c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6778111ef0 con 0x7f6778101ae0 2024-09-19T06:40:16.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f677e65c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6778111d70 con 0x7f6778102480 2024-09-19T06:40:16.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f677e65c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6778112070 con 0x7f6778107b80 2024-09-19T06:40:16.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f6777fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6778101ae0 0x7f67781983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f6777fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6778101ae0 0x7f67781983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37002/0 (socket says 172.21.15.12:37002) 2024-09-19T06:40:16.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f6777fff640 1 -- 172.21.15.12:0/2090609326 learned_addr learned my addr 172.21.15.12:0/2090609326 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f67777fe640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6778102480 0x7f67781988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f677cbf9640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6778107b80 0x7f677819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f6777fff640 1 -- 172.21.15.12:0/2090609326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6778107b80 msgr2=0x7f677819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f6777fff640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6778107b80 0x7f677819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f6777fff640 1 -- 172.21.15.12:0/2090609326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6778102480 msgr2=0x7f67781988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f6777fff640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6778102480 0x7f67781988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f6777fff640 1 -- 172.21.15.12:0/2090609326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677819d390 con 0x7f6778101ae0 2024-09-19T06:40:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.585+0000 7f6777fff640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6778101ae0 0x7f67781983a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f676800e9f0 tx=0x7f676800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.586+0000 7f67757fa640 1 -- 172.21.15.12:0/2090609326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676800cd80 con 0x7f6778101ae0 2024-09-19T06:40:16.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.586+0000 7f67757fa640 1 -- 172.21.15.12:0/2090609326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6768010910 con 0x7f6778101ae0 2024-09-19T06:40:16.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.586+0000 7f677e65c640 1 -- 172.21.15.12:0/2090609326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677819d680 con 0x7f6778101ae0 2024-09-19T06:40:16.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.586+0000 7f67757fa640 1 -- 172.21.15.12:0/2090609326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768018990 con 0x7f6778101ae0 2024-09-19T06:40:16.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.586+0000 7f677e65c640 1 -- 172.21.15.12:0/2090609326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67781a4f10 con 0x7f6778101ae0 2024-09-19T06:40:16.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.587+0000 7f677e65c640 1 -- 172.21.15.12:0/2090609326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6778101f40 con 0x7f6778101ae0 2024-09-19T06:40:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.588+0000 7f67757fa640 1 -- 172.21.15.12:0/2090609326 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f6768010ac0 con 0x7f6778101ae0 2024-09-19T06:40:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.589+0000 7f67757fa640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f67600a3580 0x7f67600a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.589+0000 7f67777fe640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f67600a3580 0x7f67600a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.589+0000 7f67757fa640 1 -- 172.21.15.12:0/2090609326 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f67680d0110 con 0x7f6778101ae0 2024-09-19T06:40:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.590+0000 7f67777fe640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f67600a3580 0x7f67600a5a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f676c009900 tx=0x7f676c0058d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.593+0000 7f67757fa640 1 -- 172.21.15.12:0/2090609326 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f676809c2b0 con 0x7f6778101ae0 2024-09-19T06:40:16.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.797+0000 7f677e65c640 1 -- 172.21.15.12:0/2090609326 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f67780fe600 con 0x7f67600a3580 2024-09-19T06:40:16.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.867+0000 7f67757fa640 1 -- 172.21.15.12:0/2090609326 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f67780fe600 con 0x7f67600a3580 2024-09-19T06:40:16.869 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path / 2024-09-19T06:40:16.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 -- 172.21.15.12:0/2090609326 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f67600a3580 msgr2=0x7f67600a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f67600a3580 0x7f67600a5a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f676c009900 tx=0x7f676c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 -- 172.21.15.12:0/2090609326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6778101ae0 msgr2=0x7f67781983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6778101ae0 0x7f67781983a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f676800e9f0 tx=0x7f676800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 -- 172.21.15.12:0/2090609326 shutdown_connections 2024-09-19T06:40:16.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f67600a3580 0x7f67600a5a40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6778107b80 0x7f677819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6778102480 0x7f67781988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 --2- 172.21.15.12:0/2090609326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6778101ae0 0x7f67781983a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 -- 172.21.15.12:0/2090609326 >> 172.21.15.12:0/2090609326 conn(0x7f67780fd7e0 msgr2=0x7f67780fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 -- 172.21.15.12:0/2090609326 shutdown_connections 2024-09-19T06:40:16.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.869+0000 7f677e65c640 1 -- 172.21.15.12:0/2090609326 wait complete. 2024-09-19T06:40:16.882 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T06:40:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.988+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/4113679959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b18102470 msgr2=0x7f4b1810e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.988+0000 7f4b1e5c4640 1 --2- 172.21.15.12:0/4113679959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b18102470 0x7f4b1810e9a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009cd0 tx=0x7f4b1002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.988+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/4113679959 shutdown_connections 2024-09-19T06:40:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.988+0000 7f4b1e5c4640 1 --2- 172.21.15.12:0/4113679959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b18102470 0x7f4b1810e9a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.988+0000 7f4b1e5c4640 1 --2- 172.21.15.12:0/4113679959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b18101ad0 0x7f4b18101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.988+0000 7f4b1e5c4640 1 --2- 172.21.15.12:0/4113679959 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b18107b70 0x7f4b18107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.988+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/4113679959 >> 172.21.15.12:0/4113679959 conn(0x7f4b180fd7d0 msgr2=0x7f4b180ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:16.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.988+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/4113679959 shutdown_connections 2024-09-19T06:40:16.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.988+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/4113679959 wait complete. 2024-09-19T06:40:16.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.989+0000 7f4b1e5c4640 1 Processor -- start 2024-09-19T06:40:16.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.989+0000 7f4b1e5c4640 1 -- start start 2024-09-19T06:40:16.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.989+0000 7f4b1e5c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b18101ad0 0x7f4b181982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.989+0000 7f4b1e5c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b18102470 0x7f4b18198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.989+0000 7f4b1e5c4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b18107b70 0x7f4b1819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:16.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.989+0000 7f4b1e5c4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18111f20 con 0x7f4b18102470 2024-09-19T06:40:16.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.989+0000 7f4b1e5c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18111da0 con 0x7f4b18101ad0 2024-09-19T06:40:16.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.989+0000 7f4b1e5c4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181120a0 con 0x7f4b18107b70 2024-09-19T06:40:16.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b177fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b18102470 0x7f4b18198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b177fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b18102470 0x7f4b18198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37018/0 (socket says 172.21.15.12:37018) 2024-09-19T06:40:16.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b177fe640 1 -- 172.21.15.12:0/1060418707 learned_addr learned my addr 172.21.15.12:0/1060418707 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:16.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b17fff640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b18101ad0 0x7f4b181982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b1cb61640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b18107b70 0x7f4b1819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:16.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b177fe640 1 -- 172.21.15.12:0/1060418707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b18107b70 msgr2=0x7f4b1819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:16.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b177fe640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b18107b70 0x7f4b1819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:16.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b177fe640 1 -- 172.21.15.12:0/1060418707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b18101ad0 msgr2=0x7f4b181982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b177fe640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b18101ad0 0x7f4b181982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b177fe640 1 -- 172.21.15.12:0/1060418707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1819d2e0 con 0x7f4b18102470 2024-09-19T06:40:17.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b177fe640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b18102470 0x7f4b18198830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00e9f0 tx=0x7f4b0c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b157fa640 1 -- 172.21.15.12:0/1060418707 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00cd80 con 0x7f4b18102470 2024-09-19T06:40:17.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b157fa640 1 -- 172.21.15.12:0/1060418707 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b0c010910 con 0x7f4b18102470 2024-09-19T06:40:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/1060418707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1819d5d0 con 0x7f4b18102470 2024-09-19T06:40:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b157fa640 1 -- 172.21.15.12:0/1060418707 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c018990 con 0x7f4b18102470 2024-09-19T06:40:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.990+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/1060418707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b181a4e60 con 0x7f4b18102470 2024-09-19T06:40:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.991+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/1060418707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b18101f30 con 0x7f4b18102470 2024-09-19T06:40:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.993+0000 7f4b157fa640 1 -- 172.21.15.12:0/1060418707 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f4b0c010ac0 con 0x7f4b18102470 2024-09-19T06:40:17.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.993+0000 7f4b157fa640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b000a3580 0x7f4b000a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.993+0000 7f4b157fa640 1 -- 172.21.15.12:0/1060418707 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4b0c0d0260 con 0x7f4b18102470 2024-09-19T06:40:17.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.993+0000 7f4b17fff640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b000a3580 0x7f4b000a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.994+0000 7f4b17fff640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b000a3580 0x7f4b000a5a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800bb60 tx=0x7f4b0800b390 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:16.997+0000 7f4b157fa640 1 -- 172.21.15.12:0/1060418707 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b0c09ca50 con 0x7f4b18102470 2024-09-19T06:40:17.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2198183944' entity='client.admin' 2024-09-19T06:40:17.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:17.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:17.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:17.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:17.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2065102823' entity='client.admin' 2024-09-19T06:40:17.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:17.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:17.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:17.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:17.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:40:17.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:40:17.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:40:17.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:40:17.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2571524513' entity='client.admin' 2024-09-19T06:40:17.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:17.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:17.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:17.085 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:17.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2198183944' entity='client.admin' 2024-09-19T06:40:17.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:17.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2065102823' entity='client.admin' 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2571524513' entity='client.admin' 2024-09-19T06:40:17.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:17.110 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:17.110 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:17.110 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:17.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:40:17.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.196+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/1060418707 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f4b180ff4f0 con 0x7f4b000a3580 2024-09-19T06:40:17.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2198183944' entity='client.admin' 2024-09-19T06:40:17.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:17.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:17.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:17.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:17.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2065102823' entity='client.admin' 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2571524513' entity='client.admin' 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:17.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:17.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:40:17.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.262+0000 7f4b157fa640 1 -- 172.21.15.12:0/1060418707 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f4b180ff4f0 con 0x7f4b000a3580 2024-09-19T06:40:17.264 INFO:teuthology.orchestra.run.smithi012.stdout:Retention added to path / 2024-09-19T06:40:17.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.264+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/1060418707 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b000a3580 msgr2=0x7f4b000a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.264+0000 7f4b1e5c4640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b000a3580 0x7f4b000a5a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800bb60 tx=0x7f4b0800b390 comp rx=0 tx=0).stop 2024-09-19T06:40:17.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.264+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/1060418707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b18102470 msgr2=0x7f4b18198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.264+0000 7f4b1e5c4640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b18102470 0x7f4b18198830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00e9f0 tx=0x7f4b0c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.265+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/1060418707 shutdown_connections 2024-09-19T06:40:17.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.265+0000 7f4b1e5c4640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b000a3580 0x7f4b000a5a40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.265+0000 7f4b1e5c4640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b18107b70 0x7f4b1819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.265+0000 7f4b1e5c4640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b18102470 0x7f4b18198830 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.265+0000 7f4b1e5c4640 1 --2- 172.21.15.12:0/1060418707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b18101ad0 0x7f4b181982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.265+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/1060418707 >> 172.21.15.12:0/1060418707 conn(0x7f4b180fd7d0 msgr2=0x7f4b180fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.265+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/1060418707 shutdown_connections 2024-09-19T06:40:17.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.265+0000 7f4b1e5c4640 1 -- 172.21.15.12:0/1060418707 wait complete. 2024-09-19T06:40:17.277 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T06:40:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.384+0000 7f8377a77640 1 -- 172.21.15.12:0/4183504554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8370107b80 msgr2=0x7f8370107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.384+0000 7f8377a77640 1 --2- 172.21.15.12:0/4183504554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8370107b80 0x7f8370107f60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f836c009930 tx=0x7f836c02a420 comp rx=0 tx=0).stop 2024-09-19T06:40:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.384+0000 7f8377a77640 1 -- 172.21.15.12:0/4183504554 shutdown_connections 2024-09-19T06:40:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.384+0000 7f8377a77640 1 --2- 172.21.15.12:0/4183504554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8370102480 0x7f837010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.384+0000 7f8377a77640 1 --2- 172.21.15.12:0/4183504554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370101ae0 0x7f8370101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.384+0000 7f8377a77640 1 --2- 172.21.15.12:0/4183504554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8370107b80 0x7f8370107f60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.384+0000 7f8377a77640 1 -- 172.21.15.12:0/4183504554 >> 172.21.15.12:0/4183504554 conn(0x7f83700fd7e0 msgr2=0x7f83700ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.384+0000 7f8377a77640 1 -- 172.21.15.12:0/4183504554 shutdown_connections 2024-09-19T06:40:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.384+0000 7f8377a77640 1 -- 172.21.15.12:0/4183504554 wait complete. 2024-09-19T06:40:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8377a77640 1 Processor -- start 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8377a77640 1 -- start start 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8377a77640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8370101ae0 0x7f83701983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8377a77640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8370102480 0x7f8370198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8377a77640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370107b80 0x7f837019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8377a77640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8370111f80 con 0x7f8370101ae0 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8377a77640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8370111e00 con 0x7f8370102480 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8377a77640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8370112100 con 0x7f8370107b80 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8375813640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8370101ae0 0x7f83701983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8375813640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8370101ae0 0x7f83701983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37026/0 (socket says 172.21.15.12:37026) 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8375813640 1 -- 172.21.15.12:0/778022413 learned_addr learned my addr 172.21.15.12:0/778022413 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8376014640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370107b80 0x7f837019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.385+0000 7f8375012640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8370102480 0x7f8370198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8375813640 1 -- 172.21.15.12:0/778022413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370107b80 msgr2=0x7f837019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8375813640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370107b80 0x7f837019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8375813640 1 -- 172.21.15.12:0/778022413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8370102480 msgr2=0x7f8370198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8375813640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8370102480 0x7f8370198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8375813640 1 -- 172.21.15.12:0/778022413 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837019d3b0 con 0x7f8370101ae0 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8375012640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8370102480 0x7f8370198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8375813640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8370101ae0 0x7f83701983c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f836c02a940 tx=0x7f836c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8366ffd640 1 -- 172.21.15.12:0/778022413 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c03f070 con 0x7f8370101ae0 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8366ffd640 1 -- 172.21.15.12:0/778022413 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f836c031c90 con 0x7f8370101ae0 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8377a77640 1 -- 172.21.15.12:0/778022413 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837019d640 con 0x7f8370101ae0 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8366ffd640 1 -- 172.21.15.12:0/778022413 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c035030 con 0x7f8370101ae0 2024-09-19T06:40:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.386+0000 7f8377a77640 1 -- 172.21.15.12:0/778022413 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83701a4f30 con 0x7f8370101ae0 2024-09-19T06:40:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.387+0000 7f8377a77640 1 -- 172.21.15.12:0/778022413 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83701031e0 con 0x7f8370101ae0 2024-09-19T06:40:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.388+0000 7f8366ffd640 1 -- 172.21.15.12:0/778022413 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f836c042070 con 0x7f8370101ae0 2024-09-19T06:40:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.389+0000 7f8366ffd640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f835c0a3580 0x7f835c0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.389+0000 7f8375012640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f835c0a3580 0x7f835c0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.389+0000 7f8366ffd640 1 -- 172.21.15.12:0/778022413 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f836c0f0730 con 0x7f8370101ae0 2024-09-19T06:40:17.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.390+0000 7f8375012640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f835c0a3580 0x7f835c0a5a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83600058c0 tx=0x7f8360005850 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.394+0000 7f8366ffd640 1 -- 172.21.15.12:0/778022413 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f836c0bcec0 con 0x7f8370101ae0 2024-09-19T06:40:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:17.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.596+0000 7f8377a77640 1 -- 172.21.15.12:0/778022413 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f83700fe5a0 con 0x7f835c0a3580 2024-09-19T06:40:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.603+0000 7f8366ffd640 1 -- 172.21.15.12:0/778022413 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f83700fe5a0 con 0x7f835c0a3580 2024-09-19T06:40:17.605 INFO:teuthology.orchestra.run.smithi012.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T06:40:16", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T06:40:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.605+0000 7f8377a77640 1 -- 172.21.15.12:0/778022413 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f835c0a3580 msgr2=0x7f835c0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.605+0000 7f8377a77640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f835c0a3580 0x7f835c0a5a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83600058c0 tx=0x7f8360005850 comp rx=0 tx=0).stop 2024-09-19T06:40:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.605+0000 7f8377a77640 1 -- 172.21.15.12:0/778022413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8370101ae0 msgr2=0x7f83701983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.605+0000 7f8377a77640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8370101ae0 0x7f83701983c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f836c02a940 tx=0x7f836c003b90 comp rx=0 tx=0).stop 2024-09-19T06:40:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.606+0000 7f8377a77640 1 -- 172.21.15.12:0/778022413 shutdown_connections 2024-09-19T06:40:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.606+0000 7f8377a77640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f835c0a3580 0x7f835c0a5a40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.606+0000 7f8377a77640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370107b80 0x7f837019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.606+0000 7f8377a77640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8370102480 0x7f8370198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.606+0000 7f8377a77640 1 --2- 172.21.15.12:0/778022413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8370101ae0 0x7f83701983c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.606+0000 7f8377a77640 1 -- 172.21.15.12:0/778022413 >> 172.21.15.12:0/778022413 conn(0x7f83700fd7e0 msgr2=0x7f83700fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.606+0000 7f8377a77640 1 -- 172.21.15.12:0/778022413 shutdown_connections 2024-09-19T06:40:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.606+0000 7f8377a77640 1 -- 172.21.15.12:0/778022413 wait complete. 2024-09-19T06:40:17.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T06:40:17.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.726+0000 7faa9b25e640 1 -- 172.21.15.12:0/1455989464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa94101ad0 msgr2=0x7faa94101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.726+0000 7faa9b25e640 1 --2- 172.21.15.12:0/1455989464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa94101ad0 0x7faa94101f30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faa88009930 tx=0x7faa8802a420 comp rx=0 tx=0).stop 2024-09-19T06:40:17.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.726+0000 7faa9b25e640 1 -- 172.21.15.12:0/1455989464 shutdown_connections 2024-09-19T06:40:17.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.726+0000 7faa9b25e640 1 --2- 172.21.15.12:0/1455989464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa94102470 0x7faa9410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.726+0000 7faa9b25e640 1 --2- 172.21.15.12:0/1455989464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa94101ad0 0x7faa94101f30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.726+0000 7faa9b25e640 1 --2- 172.21.15.12:0/1455989464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa94107b70 0x7faa94107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.726+0000 7faa9b25e640 1 -- 172.21.15.12:0/1455989464 >> 172.21.15.12:0/1455989464 conn(0x7faa940fd7d0 msgr2=0x7faa940ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.726+0000 7faa9b25e640 1 -- 172.21.15.12:0/1455989464 shutdown_connections 2024-09-19T06:40:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.726+0000 7faa9b25e640 1 -- 172.21.15.12:0/1455989464 wait complete. 2024-09-19T06:40:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa9b25e640 1 Processor -- start 2024-09-19T06:40:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa9b25e640 1 -- start start 2024-09-19T06:40:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa9b25e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa94101ad0 0x7faa94198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa9b25e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa94102470 0x7faa94198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa9b25e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa94107b70 0x7faa9419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa9b25e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faa94111f70 con 0x7faa94102470 2024-09-19T06:40:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa9b25e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faa94111df0 con 0x7faa94101ad0 2024-09-19T06:40:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa9b25e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faa941120f0 con 0x7faa94107b70 2024-09-19T06:40:17.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa93fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa94102470 0x7faa94198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa93fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa94102470 0x7faa94198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37042/0 (socket says 172.21.15.12:37042) 2024-09-19T06:40:17.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa93fff640 1 -- 172.21.15.12:0/515184744 learned_addr learned my addr 172.21.15.12:0/515184744 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:17.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa997fb640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa94107b70 0x7faa9419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.727+0000 7faa98ffa640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa94101ad0 0x7faa94198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa93fff640 1 -- 172.21.15.12:0/515184744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa94107b70 msgr2=0x7faa9419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa93fff640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa94107b70 0x7faa9419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa93fff640 1 -- 172.21.15.12:0/515184744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa94101ad0 msgr2=0x7faa94198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa93fff640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa94101ad0 0x7faa94198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa93fff640 1 -- 172.21.15.12:0/515184744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9419d320 con 0x7faa94102470 2024-09-19T06:40:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa98ffa640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa94101ad0 0x7faa94198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa93fff640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa94102470 0x7faa94198870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faa8802a940 tx=0x7faa88003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa91ffb640 1 -- 172.21.15.12:0/515184744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8803f070 con 0x7faa94102470 2024-09-19T06:40:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa91ffb640 1 -- 172.21.15.12:0/515184744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa88031c90 con 0x7faa94102470 2024-09-19T06:40:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa91ffb640 1 -- 172.21.15.12:0/515184744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88035030 con 0x7faa94102470 2024-09-19T06:40:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa9b25e640 1 -- 172.21.15.12:0/515184744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9419d5b0 con 0x7faa94102470 2024-09-19T06:40:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.728+0000 7faa9b25e640 1 -- 172.21.15.12:0/515184744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa941a4ea0 con 0x7faa94102470 2024-09-19T06:40:17.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.729+0000 7faa9b25e640 1 -- 172.21.15.12:0/515184744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa94101f30 con 0x7faa94102470 2024-09-19T06:40:17.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.731+0000 7faa91ffb640 1 -- 172.21.15.12:0/515184744 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7faa88042070 con 0x7faa94102470 2024-09-19T06:40:17.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.731+0000 7faa91ffb640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa7c0a3580 0x7faa7c0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.731+0000 7faa98ffa640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa7c0a3580 0x7faa7c0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.731+0000 7faa91ffb640 1 -- 172.21.15.12:0/515184744 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7faa880f0a70 con 0x7faa94102470 2024-09-19T06:40:17.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.732+0000 7faa98ffa640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa7c0a3580 0x7faa7c0a5a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa84005e10 tx=0x7faa84005da0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.734+0000 7faa91ffb640 1 -- 172.21.15.12:0/515184744 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa880bd370 con 0x7faa94102470 2024-09-19T06:40:17.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.853+0000 7f1a880cf640 1 -- 172.21.15.12:0/2587389595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a801082a0 msgr2=0x7f1a8010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.853+0000 7f1a880cf640 1 --2- 172.21.15.12:0/2587389595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a801082a0 0x7f1a8010ec40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009cd0 tx=0x7f1a7802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.853+0000 7f1a880cf640 1 -- 172.21.15.12:0/2587389595 shutdown_connections 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.853+0000 7f1a880cf640 1 --2- 172.21.15.12:0/2587389595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a801082a0 0x7f1a8010ec40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.853+0000 7f1a880cf640 1 --2- 172.21.15.12:0/2587389595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a801036e0 0x7f1a80107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.853+0000 7f1a880cf640 1 --2- 172.21.15.12:0/2587389595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a80102d30 0x7f1a80103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.853+0000 7f1a880cf640 1 -- 172.21.15.12:0/2587389595 >> 172.21.15.12:0/2587389595 conn(0x7f1a800fc7d0 msgr2=0x7f1a800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.853+0000 7f1a880cf640 1 -- 172.21.15.12:0/2587389595 shutdown_connections 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.853+0000 7f1a880cf640 1 -- 172.21.15.12:0/2587389595 wait complete. 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a880cf640 1 Processor -- start 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a880cf640 1 -- start start 2024-09-19T06:40:17.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a880cf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a80102d30 0x7f1a801984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a880cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a801036e0 0x7f1a80198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a880cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a801082a0 0x7f1a8019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a880cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1a801120a0 con 0x7f1a801082a0 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a880cf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80111f20 con 0x7f1a801036e0 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a880cf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80112220 con 0x7f1a80102d30 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a8666c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a801082a0 0x7f1a8019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a8666c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a801082a0 0x7f1a8019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37072/0 (socket says 172.21.15.12:37072) 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a8666c640 1 -- 172.21.15.12:0/2759117656 learned_addr learned my addr 172.21.15.12:0/2759117656 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a8566a640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a801036e0 0x7f1a80198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a85e6b640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a80102d30 0x7f1a801984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a8666c640 1 -- 172.21.15.12:0/2759117656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a80102d30 msgr2=0x7f1a801984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a8666c640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a80102d30 0x7f1a801984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a8666c640 1 -- 172.21.15.12:0/2759117656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a801036e0 msgr2=0x7f1a80198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a8666c640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a801036e0 0x7f1a80198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a8666c640 1 -- 172.21.15.12:0/2759117656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8019d480 con 0x7f1a801082a0 2024-09-19T06:40:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.854+0000 7f1a8566a640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a801036e0 0x7f1a80198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.855+0000 7f1a8666c640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a801082a0 0x7f1a8019cda0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1a78005cc0 tx=0x7f1a78003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.855+0000 7f1a76ffd640 1 -- 172.21.15.12:0/2759117656 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78004040 con 0x7f1a801082a0 2024-09-19T06:40:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.855+0000 7f1a880cf640 1 -- 172.21.15.12:0/2759117656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8019d710 con 0x7f1a801082a0 2024-09-19T06:40:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.855+0000 7f1a76ffd640 1 -- 172.21.15.12:0/2759117656 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a780046c0 con 0x7f1a801082a0 2024-09-19T06:40:17.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.855+0000 7f1a76ffd640 1 -- 172.21.15.12:0/2759117656 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78046480 con 0x7f1a801082a0 2024-09-19T06:40:17.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.855+0000 7f1a880cf640 1 -- 172.21.15.12:0/2759117656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a801a5050 con 0x7f1a801082a0 2024-09-19T06:40:17.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.857+0000 7f1a76ffd640 1 -- 172.21.15.12:0/2759117656 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f1a780305a0 con 0x7f1a801082a0 2024-09-19T06:40:17.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8a4a8740 1 Processor -- start 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8a4a8740 1 -- start start 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d12880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d12dc0 0x5572d5d1d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d1d680 0x5572d5d1fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5572d5c782e0 con 0x5572d5d124a0 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5572d5c1fce0 con 0x5572d5d1d680 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5572d5c742a0 con 0x5572d5d12dc0 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8566a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d12880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8566a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d12880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37074/0 (socket says 172.21.15.12:37074) 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8566a640 1 -- 172.21.15.12:0/1756910657 learned_addr learned my addr 172.21.15.12:0/1756910657 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:17.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a85e6b640 1 --2- 172.21.15.12:0/1756910657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d12dc0 0x5572d5d1d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a8566a640 1 --2- 172.21.15.12:0/1756910657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d1d680 0x5572d5d1fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.858+0000 7f1a76ffd640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1a6c0a7850 0x7f1a6c0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a8566a640 1 -- 172.21.15.12:0/1756910657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d12dc0 msgr2=0x5572d5d1d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a8566a640 1 --2- 172.21.15.12:0/1756910657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d12dc0 0x5572d5d1d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a8566a640 1 -- 172.21.15.12:0/1756910657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d1d680 msgr2=0x5572d5d1fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a8566a640 1 --2- 172.21.15.12:0/1756910657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d1d680 0x5572d5d1fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a8666c640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1a6c0a7850 0x7f1a6c0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a8566a640 1 -- 172.21.15.12:0/1756910657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d5c04440 con 0x5572d5d124a0 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a85e6b640 1 --2- 172.21.15.12:0/1756910657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d12dc0 0x5572d5d1d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a8566a640 1 --2- 172.21.15.12:0/1756910657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d12880 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009fd0 tx=0x7f1a70009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3bce4e77dd8782 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a76ffd640 1 -- 172.21.15.12:0/2759117656 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f1a7802e030 con 0x7f1a801082a0 2024-09-19T06:40:17.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a6bfff640 1 -- 172.21.15.12:0/1756910657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a700150d0 con 0x5572d5d124a0 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a6bfff640 1 -- 172.21.15.12:0/1756910657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a70015270 con 0x5572d5d124a0 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.859+0000 7f1a6bfff640 1 -- 172.21.15.12:0/1756910657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a700106e0 con 0x5572d5d124a0 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8666c640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1a6c0a7850 0x7f1a6c0a9d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a780eee80 tx=0x7f1a780b9480 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/1756910657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 msgr2=0x5572d5d12880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/1756910657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d12880 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009fd0 tx=0x7f1a70009550 comp rx=0 tx=0).stop 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/1756910657 shutdown_connections 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/1756910657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d1d680 0x5572d5d1fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/1756910657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d12dc0 0x5572d5d1d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/1756910657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d12880 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/1756910657 >> 172.21.15.12:0/1756910657 conn(0x5572d5d0ea30 msgr2=0x5572d5d0ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/1756910657 shutdown_connections 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/1756910657 wait complete. 2024-09-19T06:40:17.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.860+0000 7f1a8a4a8740 1 -- start start 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a8a4a8740 1 Processor -- start 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d124a0 0x5572d5d1cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d12dc0 0x5572d5d1a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d1d680 0x5572d5d1a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5572d5d20250 con 0x5572d5d12dc0 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5572d5c33050 con 0x5572d5d1d680 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5572d5d203d0 con 0x5572d5d124a0 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a8a4a8740 10 client.0 _ll_register_callbacks cb 0x5572d5c73160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a85e6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d12dc0 0x5572d5d1a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a85e6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d12dc0 0x5572d5d1a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37090/0 (socket says 172.21.15.12:37090) 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a85e6b640 1 -- 172.21.15.12:0/2964641002 learned_addr learned my addr 172.21.15.12:0/2964641002 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:17.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.861+0000 7f1a8566a640 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d124a0 0x5572d5d1cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a8566a640 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d1d680 0x5572d5d1a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a85e6b640 1 -- 172.21.15.12:0/2964641002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d124a0 msgr2=0x5572d5d1cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a85e6b640 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d124a0 0x5572d5d1cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a85e6b640 1 -- 172.21.15.12:0/2964641002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d1d680 msgr2=0x5572d5d1a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a85e6b640 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d1d680 0x5572d5d1a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a85e6b640 1 -- 172.21.15.12:0/2964641002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572d59e93c0 con 0x5572d5d12dc0 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a8566a640 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d124a0 0x5572d5d1cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a85e6b640 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d12dc0 0x5572d5d1a250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00cea0 tx=0x7f1a7c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9978dca93615dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a697fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a697fa640 1 -- 172.21.15.12:0/2964641002 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0119d0 con 0x5572d5d12dc0 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a697fa640 1 -- 172.21.15.12:0/2964641002 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f1a7c011b70 con 0x5572d5d12dc0 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/2964641002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a70015270 con 0x5572d5d12dc0 2024-09-19T06:40:17.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a697fa640 1 -- 172.21.15.12:0/2964641002 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a7c011d70 con 0x5572d5d12dc0 2024-09-19T06:40:17.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a8a4a8740 10 client.15423 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:17.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/2964641002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5572d5d2bc30 con 0x5572d5d12dc0 2024-09-19T06:40:17.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.862+0000 7f1a697fa640 1 -- 172.21.15.12:0/2964641002 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a70015270 con 0x5572d5d12dc0 2024-09-19T06:40:17.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.863+0000 7f1a697fa640 1 -- 172.21.15.12:0/2964641002 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1a7c018070 con 0x5572d5d12dc0 2024-09-19T06:40:17.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.863+0000 7f1a8a4a8740 10 client.15423 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:17.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.863+0000 7f1a8a4a8740 10 client.15423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:17.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.863+0000 7f1a8a4a8740 20 client.15423 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.863+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5572d5d2d190 0x5572d5d2f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.863+0000 7f1a8a4a8740 4 client.15423 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.863+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/2964641002 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572d5c85850 con 0x5572d5d2d190 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.863+0000 7f1a8566a640 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5572d5d2d190 0x5572d5d2f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.863+0000 7f1a697fa640 10 client.15423 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.863+0000 7f1a8566a640 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5572d5d2d190 0x5572d5d2f5b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce8257bbe495f4a9 server_cookie=f654434e52d06f00 in_seq=0 out_seq=0 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.864+0000 7f1a697fa640 1 -- 172.21.15.12:0/2964641002 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572d5c85850 con 0x5572d5d2d190 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.864+0000 7f1a697fa640 10 client.15423 handle_command_reply: tid=0 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.864+0000 7f1a8a4a8740 1 client.15423 shutdown 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.864+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/2964641002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d12dc0 msgr2=0x5572d5d1a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.864+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d12dc0 0x5572d5d1a250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00cea0 tx=0x7f1a7c00cf90 comp rx=0 tx=0).stop 2024-09-19T06:40:17.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.864+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/2964641002 shutdown_connections 2024-09-19T06:40:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.864+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5572d5d2d190 0x5572d5d2f5b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.864+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d1d680 0x5572d5d1a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.864+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d12dc0 0x5572d5d1a250 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.865+0000 7f1a697fa640 0 client.15423 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.864+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/2964641002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d124a0 0x5572d5d1cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.865+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/2964641002 >> 172.21.15.12:0/2964641002 conn(0x5572d5d0ea30 msgr2=0x5572d5d0db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.865+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/2964641002 shutdown_connections 2024-09-19T06:40:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.865+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/2964641002 wait complete. 2024-09-19T06:40:17.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.865+0000 7f1a8a4a8740 20 client.15423 trim_cache size 0 max 16384 2024-09-19T06:40:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8a4a8740 1 Processor -- start 2024-09-19T06:40:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8a4a8740 1 -- start start 2024-09-19T06:40:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d294b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d12dc0 0x5572d5d34e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d1d680 0x5572d5d353a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1a801ab8a0 con 0x5572d5d124a0 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a801ad3e0 con 0x5572d5d12dc0 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1a801abf70 con 0x5572d5d1d680 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8566a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d294b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8566a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d294b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37094/0 (socket says 172.21.15.12:37094) 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a8566a640 1 -- 172.21.15.12:0/4241675813 learned_addr learned my addr 172.21.15.12:0/4241675813 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.882+0000 7f1a85e6b640 1 --2- 172.21.15.12:0/4241675813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d12dc0 0x5572d5d34e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.883+0000 7f1a8566a640 1 -- 172.21.15.12:0/4241675813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d1d680 msgr2=0x5572d5d353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.883+0000 7f1a8566a640 1 --2- 172.21.15.12:0/4241675813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d1d680 0x5572d5d353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.883+0000 7f1a8566a640 1 -- 172.21.15.12:0/4241675813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d12dc0 msgr2=0x5572d5d34e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.883+0000 7f1a8566a640 1 --2- 172.21.15.12:0/4241675813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d12dc0 0x5572d5d34e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.883+0000 7f1a8566a640 1 -- 172.21.15.12:0/4241675813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572d5d15e50 con 0x5572d5d124a0 2024-09-19T06:40:17.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.883+0000 7f1a8566a640 1 --2- 172.21.15.12:0/4241675813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d294b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1a70005fa0 tx=0x7f1a70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3ef2c1e06cd74c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.883+0000 7f1a6b7fe640 1 -- 172.21.15.12:0/4241675813 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70015270 con 0x5572d5d124a0 2024-09-19T06:40:17.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.883+0000 7f1a6b7fe640 1 -- 172.21.15.12:0/4241675813 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a700106e0 con 0x5572d5d124a0 2024-09-19T06:40:17.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.883+0000 7f1a6b7fe640 1 -- 172.21.15.12:0/4241675813 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70003830 con 0x5572d5d124a0 2024-09-19T06:40:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/4241675813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 msgr2=0x5572d5d294b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/4241675813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d294b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1a70005fa0 tx=0x7f1a70009e30 comp rx=0 tx=0).stop 2024-09-19T06:40:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/4241675813 shutdown_connections 2024-09-19T06:40:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/4241675813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d1d680 0x5572d5d353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/4241675813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d12dc0 0x5572d5d34e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/4241675813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d294b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/4241675813 >> 172.21.15.12:0/4241675813 conn(0x5572d5d0ea30 msgr2=0x5572d5d19340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/4241675813 shutdown_connections 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/4241675813 wait complete. 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 -- start start 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.884+0000 7f1a8a4a8740 1 Processor -- start 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d258f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d12dc0 0x5572d5d25e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8a4a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d1d680 0x5572d5d20d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1a801acd10 con 0x5572d5d124a0 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a801ac640 con 0x5572d5d12dc0 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8a4a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1a801a9880 con 0x5572d5d1d680 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8a4a8740 10 client.0 _ll_register_callbacks cb 0x7f1a7c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:17.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8566a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d258f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8566a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d258f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37102/0 (socket says 172.21.15.12:37102) 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8566a640 1 -- 172.21.15.12:0/785444504 learned_addr learned my addr 172.21.15.12:0/785444504 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8566a640 1 -- 172.21.15.12:0/785444504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d1d680 msgr2=0x5572d5d20d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8566a640 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d1d680 0x5572d5d20d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8566a640 1 -- 172.21.15.12:0/785444504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d12dc0 msgr2=0x5572d5d25e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8566a640 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d12dc0 0x5572d5d25e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8566a640 1 -- 172.21.15.12:0/785444504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572d5d21550 con 0x5572d5d124a0 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a8566a640 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d258f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1a70005740 tx=0x7f1a700155b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b346d6b113e8f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.885+0000 7f1a697fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a697fa640 1 -- 172.21.15.12:0/785444504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70032040 con 0x5572d5d124a0 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/785444504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a700106e0 con 0x5572d5d124a0 2024-09-19T06:40:17.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a697fa640 1 -- 172.21.15.12:0/785444504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f1a70005020 con 0x5572d5d124a0 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a697fa640 1 -- 172.21.15.12:0/785444504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a700044a0 con 0x5572d5d124a0 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a8a4a8740 10 client.15429 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/785444504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5572d5d979c0 con 0x5572d5d124a0 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a697fa640 1 -- 172.21.15.12:0/785444504 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a700106e0 con 0x5572d5d124a0 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a697fa640 1 -- 172.21.15.12:0/785444504 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1a7003d070 con 0x5572d5d124a0 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a8a4a8740 10 client.15429 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a8a4a8740 10 client.15429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a8a4a8740 20 client.15429 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5572d5d2d190 0x5572d5d99df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a8a4a8740 4 client.15429 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:40:17.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.886+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/785444504 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5572d5c7fd60 con 0x5572d5d2d190 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a85e6b640 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5572d5d2d190 0x5572d5d99df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a697fa640 10 client.15429 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a85e6b640 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5572d5d2d190 0x5572d5d99df0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=532f93e0e46e3df7 server_cookie=85d62dcb495a7281 in_seq=0 out_seq=0 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a697fa640 1 -- 172.21.15.12:0/785444504 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5572d5c7fd60 con 0x5572d5d2d190 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a697fa640 10 client.15429 handle_command_reply: tid=0 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a8a4a8740 1 client.15429 shutdown 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/785444504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 msgr2=0x5572d5d258f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d258f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1a70005740 tx=0x7f1a700155b0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/785444504 shutdown_connections 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5572d5d2d190 0x5572d5d99df0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5572d5d1d680 0x5572d5d20d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5572d5d12dc0 0x5572d5d25e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a8a4a8740 1 --2- 172.21.15.12:0/785444504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572d5d124a0 0x5572d5d258f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/785444504 >> 172.21.15.12:0/785444504 conn(0x5572d5d0ea30 msgr2=0x5572d5d0d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.887+0000 7f1a697fa640 0 client.15429 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/785444504 shutdown_connections 2024-09-19T06:40:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a8a4a8740 1 -- 172.21.15.12:0/785444504 wait complete. 2024-09-19T06:40:17.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a8a4a8740 20 client.15429 trim_cache size 0 max 16384 2024-09-19T06:40:17.895 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:40:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:40:17.895 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:40:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "6a799a2a-d5f1-46e5-82d1-894601600bb4": { 2024-09-19T06:40:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:40:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "6a799a2a-d5f1-46e5-82d1-894601600bb4", 2024-09-19T06:40:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:40:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:40:17.896 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:40:17.896 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 -- 172.21.15.12:0/2759117656 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1a6c0a7850 msgr2=0x7f1a6c0a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1a6c0a7850 0x7f1a6c0a9d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a780eee80 tx=0x7f1a780b9480 comp rx=0 tx=0).stop 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 -- 172.21.15.12:0/2759117656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a801082a0 msgr2=0x7f1a8019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a801082a0 0x7f1a8019cda0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1a78005cc0 tx=0x7f1a78003970 comp rx=0 tx=0).stop 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 -- 172.21.15.12:0/2759117656 shutdown_connections 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a801082a0 0x7f1a8019cda0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a801036e0 0x7f1a80198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1a6c0a7850 0x7f1a6c0a9d10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 --2- 172.21.15.12:0/2759117656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a80102d30 0x7f1a801984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 -- 172.21.15.12:0/2759117656 >> 172.21.15.12:0/2759117656 conn(0x7f1a800fc7d0 msgr2=0x7f1a80106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.888+0000 7f1a880cf640 1 -- 172.21.15.12:0/2759117656 shutdown_connections 2024-09-19T06:40:17.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.889+0000 7f1a880cf640 1 -- 172.21.15.12:0/2759117656 wait complete. 2024-09-19T06:40:17.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.944+0000 7faa9b25e640 1 -- 172.21.15.12:0/515184744 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7faa940fe450 con 0x7faa7c0a3580 2024-09-19T06:40:17.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.951+0000 7faa91ffb640 1 -- 172.21.15.12:0/515184744 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7faa940fe450 con 0x7faa7c0a3580 2024-09-19T06:40:17.953 INFO:teuthology.orchestra.run.smithi012.stdout:/ 1m 6m3h 2024-09-19T06:40:17.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.953+0000 7faa9b25e640 1 -- 172.21.15.12:0/515184744 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa7c0a3580 msgr2=0x7faa7c0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.953+0000 7faa9b25e640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa7c0a3580 0x7faa7c0a5a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa84005e10 tx=0x7faa84005da0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.953+0000 7faa9b25e640 1 -- 172.21.15.12:0/515184744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa94102470 msgr2=0x7faa94198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:17.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.953+0000 7faa9b25e640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa94102470 0x7faa94198870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faa8802a940 tx=0x7faa88003b90 comp rx=0 tx=0).stop 2024-09-19T06:40:17.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.954+0000 7faa9b25e640 1 -- 172.21.15.12:0/515184744 shutdown_connections 2024-09-19T06:40:17.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.954+0000 7faa9b25e640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa7c0a3580 0x7faa7c0a5a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.954+0000 7faa9b25e640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa94107b70 0x7faa9419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.954+0000 7faa9b25e640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faa94102470 0x7faa94198870 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.954+0000 7faa9b25e640 1 --2- 172.21.15.12:0/515184744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa94101ad0 0x7faa94198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:17.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.954+0000 7faa9b25e640 1 -- 172.21.15.12:0/515184744 >> 172.21.15.12:0/515184744 conn(0x7faa940fd7d0 msgr2=0x7faa940fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:17.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.954+0000 7faa9b25e640 1 -- 172.21.15.12:0/515184744 shutdown_connections 2024-09-19T06:40:17.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:17.954+0000 7faa9b25e640 1 -- 172.21.15.12:0/515184744 wait complete. 2024-09-19T06:40:17.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T06:40:17.994 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T06:40:18.004 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T06:40:18.016 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:40:18.016 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T06:40:18.036 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T06:40:18.053 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:40:18.053 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:40:18.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:17 smithi012 ceph-mon[30937]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-19T06:40:18.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:17 smithi012 ceph-mon[30937]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:18.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:17 smithi016 ceph-mon[34911]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-19T06:40:18.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:17 smithi016 ceph-mon[34911]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:17 smithi173 ceph-mon[35349]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-19T06:40:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:17 smithi173 ceph-mon[35349]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:18.635 INFO:tasks.cephfs.filesystem:scrub status for tag:6a799a2a-d5f1-46e5-82d1-894601600bb4 - {'path': '/', 'tag': '6a799a2a-d5f1-46e5-82d1-894601600bb4', 'options': 'recursive,force'} 2024-09-19T06:40:18.742 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:19.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:18 smithi012 ceph-mon[30937]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:19.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:18 smithi012 ceph-mon[30937]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:19.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:18 smithi016 ceph-mon[34911]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:18 smithi016 ceph-mon[34911]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:19.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.274+0000 7f27aed74640 1 -- 172.21.15.12:0/1190526275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27a8106f10 msgr2=0x7f27a810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:19.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.274+0000 7f27aed74640 1 --2- 172.21.15.12:0/1190526275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27a8106f10 0x7f27a810ea90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009ca0 tx=0x7f27a002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.274+0000 7f27aed74640 1 -- 172.21.15.12:0/1190526275 shutdown_connections 2024-09-19T06:40:19.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.274+0000 7f27aed74640 1 --2- 172.21.15.12:0/1190526275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27a8106f10 0x7f27a810ea90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.274+0000 7f27aed74640 1 --2- 172.21.15.12:0/1190526275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a8102790 0x7f27a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.274+0000 7f27aed74640 1 --2- 172.21.15.12:0/1190526275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27a8101de0 0x7f27a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.274+0000 7f27aed74640 1 -- 172.21.15.12:0/1190526275 >> 172.21.15.12:0/1190526275 conn(0x7f27a80fd8c0 msgr2=0x7f27a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.274+0000 7f27aed74640 1 -- 172.21.15.12:0/1190526275 shutdown_connections 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.274+0000 7f27aed74640 1 -- 172.21.15.12:0/1190526275 wait complete. 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f27aed74640 1 Processor -- start 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f27aed74640 1 -- start start 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f27aed74640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27a8101de0 0x7f27a8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f27aed74640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27a8102790 0x7f27a8198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f27aed74640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a8106f10 0x7f27a819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f27aed74640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8111f70 con 0x7f27a8102790 2024-09-19T06:40:19.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f27aed74640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8111df0 con 0x7f27a8101de0 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f27aed74640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81120f0 con 0x7f27a8106f10 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f279ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27a8102790 0x7f27a8198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f279ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27a8102790 0x7f27a8198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37118/0 (socket says 172.21.15.12:37118) 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f279ffff640 1 -- 172.21.15.12:0/149026356 learned_addr learned my addr 172.21.15.12:0/149026356 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f27acb10640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27a8101de0 0x7f27a8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f27ad311640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a8106f10 0x7f27a819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f279ffff640 1 -- 172.21.15.12:0/149026356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a8106f10 msgr2=0x7f27a819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f279ffff640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a8106f10 0x7f27a819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.275+0000 7f279ffff640 1 -- 172.21.15.12:0/149026356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27a8101de0 msgr2=0x7f27a8198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.276+0000 7f279ffff640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27a8101de0 0x7f27a8198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.276+0000 7f279ffff640 1 -- 172.21.15.12:0/149026356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a819d2e0 con 0x7f27a8102790 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.276+0000 7f27acb10640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27a8101de0 0x7f27a8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:19.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.276+0000 7f279ffff640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27a8102790 0x7f27a8198870 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f279800d770 tx=0x7f279800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.276+0000 7f279dffb640 1 -- 172.21.15.12:0/149026356 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798017070 con 0x7f27a8102790 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.276+0000 7f279dffb640 1 -- 172.21.15.12:0/149026356 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2798005500 con 0x7f27a8102790 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.276+0000 7f27aed74640 1 -- 172.21.15.12:0/149026356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a819d5d0 con 0x7f27a8102790 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.276+0000 7f279dffb640 1 -- 172.21.15.12:0/149026356 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798004e00 con 0x7f27a8102790 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.276+0000 7f27aed74640 1 -- 172.21.15.12:0/149026356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a81a4eb0 con 0x7f27a8102790 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.277+0000 7f27aed74640 1 -- 172.21.15.12:0/149026356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a81021c0 con 0x7f27a8102790 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.278+0000 7f279dffb640 1 -- 172.21.15.12:0/149026356 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f2798004fa0 con 0x7f27a8102790 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.279+0000 7f279dffb640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f27900a34c0 0x7f27900a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.279+0000 7f279dffb640 1 -- 172.21.15.12:0/149026356 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f27980cf990 con 0x7f27a8102790 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.279+0000 7f27acb10640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f27900a34c0 0x7f27900a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.280+0000 7f27acb10640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f27900a34c0 0x7f27900a5980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27a400abe0 tx=0x7f27a400a5c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:19.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.283+0000 7f279dffb640 1 -- 172.21.15.12:0/149026356 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f279809c180 con 0x7f27a8102790 2024-09-19T06:40:19.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:18 smithi173 ceph-mon[35349]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:19.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:18 smithi173 ceph-mon[35349]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:19.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.456+0000 7f27aed74640 1 -- 172.21.15.12:0/149026356 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27a8062630 con 0x7f27900a34c0 2024-09-19T06:40:19.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.464+0000 7f279dffb640 1 -- 172.21.15.12:0/149026356 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257801 (secure 0 0 0) 0x7f27a8062630 con 0x7f27900a34c0 2024-09-19T06:40:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:19.472 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-19T06:40:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 -- 172.21.15.12:0/149026356 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f27900a34c0 msgr2=0x7f27900a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f27900a34c0 0x7f27900a5980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27a400abe0 tx=0x7f27a400a5c0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 -- 172.21.15.12:0/149026356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27a8102790 msgr2=0x7f27a8198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27a8102790 0x7f27a8198870 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f279800d770 tx=0x7f279800dc30 comp rx=0 tx=0).stop 2024-09-19T06:40:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 -- 172.21.15.12:0/149026356 shutdown_connections 2024-09-19T06:40:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f27900a34c0 0x7f27900a5980 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27a8106f10 0x7f27a819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27a8102790 0x7f27a8198870 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 --2- 172.21.15.12:0/149026356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27a8101de0 0x7f27a8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 -- 172.21.15.12:0/149026356 >> 172.21.15.12:0/149026356 conn(0x7f27a80fd8c0 msgr2=0x7f27a80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 -- 172.21.15.12:0/149026356 shutdown_connections 2024-09-19T06:40:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:19.467+0000 7f27aed74640 1 -- 172.21.15.12:0/149026356 wait complete. 2024-09-19T06:40:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:19 smithi012 ceph-mon[30937]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:19 smithi012 ceph-mon[30937]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-19T06:40:20.168 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-09-19T06:40:18.091626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190856,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1470,"num_read_kb":1063,"num_write":579,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183000,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385088,"kb_used_data":15012,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124556736,"statfs":{"total":1151940427776,"available":1151546097664,"internally_reserved":0,"allocated":15372288,"data_stored":9142824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":236,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.929556"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193904+0000","last_change":"2024-09-19T06:38:14.052943+0000","last_active":"2024-09-19T06:40:08.193904+0000","last_peered":"2024-09-19T06:40:08.193904+0000","last_clean":"2024-09-19T06:40:08.193904+0000","last_became_active":"2024-09-19T06:38:14.052054+0000","last_became_peered":"2024-09-19T06:38:14.052054+0000","last_unstale":"2024-09-19T06:40:08.193904+0000","last_undegraded":"2024-09-19T06:40:08.193904+0000","last_fullsized":"2024-09-19T06:40:08.193904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:28.898131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274838+0000","last_change":"2024-09-19T06:38:14.044916+0000","last_active":"2024-09-19T06:40:08.274838+0000","last_peered":"2024-09-19T06:40:08.274838+0000","last_clean":"2024-09-19T06:40:08.274838+0000","last_became_active":"2024-09-19T06:38:14.044596+0000","last_became_peered":"2024-09-19T06:38:14.044596+0000","last_unstale":"2024-09-19T06:40:08.274838+0000","last_undegraded":"2024-09-19T06:40:08.274838+0000","last_fullsized":"2024-09-19T06:40:08.274838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:04.402332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274196+0000","last_change":"2024-09-19T06:38:14.052765+0000","last_active":"2024-09-19T06:40:08.274196+0000","last_peered":"2024-09-19T06:40:08.274196+0000","last_clean":"2024-09-19T06:40:08.274196+0000","last_became_active":"2024-09-19T06:38:14.052219+0000","last_became_peered":"2024-09-19T06:38:14.052219+0000","last_unstale":"2024-09-19T06:40:08.274196+0000","last_undegraded":"2024-09-19T06:40:08.274196+0000","last_fullsized":"2024-09-19T06:40:08.274196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:13.317252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274176+0000","last_change":"2024-09-19T06:38:14.052421+0000","last_active":"2024-09-19T06:40:08.274176+0000","last_peered":"2024-09-19T06:40:08.274176+0000","last_clean":"2024-09-19T06:40:08.274176+0000","last_became_active":"2024-09-19T06:38:14.052094+0000","last_became_peered":"2024-09-19T06:38:14.052094+0000","last_unstale":"2024-09-19T06:40:08.274176+0000","last_undegraded":"2024-09-19T06:40:08.274176+0000","last_fullsized":"2024-09-19T06:40:08.274176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185134+0000","last_change":"2024-09-19T06:38:14.047736+0000","last_active":"2024-09-19T06:40:08.185134+0000","last_peered":"2024-09-19T06:40:08.185134+0000","last_clean":"2024-09-19T06:40:08.185134+0000","last_became_active":"2024-09-19T06:38:14.047396+0000","last_became_peered":"2024-09-19T06:38:14.047396+0000","last_unstale":"2024-09-19T06:40:08.185134+0000","last_undegraded":"2024-09-19T06:40:08.185134+0000","last_fullsized":"2024-09-19T06:40:08.185134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.855638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196543+0000","last_change":"2024-09-19T06:38:14.047793+0000","last_active":"2024-09-19T06:40:08.196543+0000","last_peered":"2024-09-19T06:40:08.196543+0000","last_clean":"2024-09-19T06:40:08.196543+0000","last_became_active":"2024-09-19T06:38:14.047198+0000","last_became_peered":"2024-09-19T06:38:14.047198+0000","last_unstale":"2024-09-19T06:40:08.196543+0000","last_undegraded":"2024-09-19T06:40:08.196543+0000","last_fullsized":"2024-09-19T06:40:08.196543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:42.507270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076273+0000","last_change":"2024-09-19T06:38:14.050025+0000","last_active":"2024-09-19T06:40:08.076273+0000","last_peered":"2024-09-19T06:40:08.076273+0000","last_clean":"2024-09-19T06:40:08.076273+0000","last_became_active":"2024-09-19T06:38:14.049591+0000","last_became_peered":"2024-09-19T06:38:14.049591+0000","last_unstale":"2024-09-19T06:40:08.076273+0000","last_undegraded":"2024-09-19T06:40:08.076273+0000","last_fullsized":"2024-09-19T06:40:08.076273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:49.487521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181942+0000","last_change":"2024-09-19T06:38:23.065490+0000","last_active":"2024-09-19T06:40:08.181942+0000","last_peered":"2024-09-19T06:40:08.181942+0000","last_clean":"2024-09-19T06:40:08.181942+0000","last_became_active":"2024-09-19T06:38:23.065151+0000","last_became_peered":"2024-09-19T06:38:23.065151+0000","last_unstale":"2024-09-19T06:40:08.181942+0000","last_undegraded":"2024-09-19T06:40:08.181942+0000","last_fullsized":"2024-09-19T06:40:08.181942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:42.184698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273928+0000","last_change":"2024-09-19T06:38:14.047395+0000","last_active":"2024-09-19T06:40:08.273928+0000","last_peered":"2024-09-19T06:40:08.273928+0000","last_clean":"2024-09-19T06:40:08.273928+0000","last_became_active":"2024-09-19T06:38:14.046975+0000","last_became_peered":"2024-09-19T06:38:14.046975+0000","last_unstale":"2024-09-19T06:40:08.273928+0000","last_undegraded":"2024-09-19T06:40:08.273928+0000","last_fullsized":"2024-09-19T06:40:08.273928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:18.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196936+0000","last_change":"2024-09-19T06:38:14.055042+0000","last_active":"2024-09-19T06:40:08.196936+0000","last_peered":"2024-09-19T06:40:08.196936+0000","last_clean":"2024-09-19T06:40:08.196936+0000","last_became_active":"2024-09-19T06:38:14.054664+0000","last_became_peered":"2024-09-19T06:38:14.054664+0000","last_unstale":"2024-09-19T06:40:08.196936+0000","last_undegraded":"2024-09-19T06:40:08.196936+0000","last_fullsized":"2024-09-19T06:40:08.196936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.815277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076591+0000","last_change":"2024-09-19T06:38:14.055106+0000","last_active":"2024-09-19T06:40:08.076591+0000","last_peered":"2024-09-19T06:40:08.076591+0000","last_clean":"2024-09-19T06:40:08.076591+0000","last_became_active":"2024-09-19T06:38:14.054721+0000","last_became_peered":"2024-09-19T06:38:14.054721+0000","last_unstale":"2024-09-19T06:40:08.076591+0000","last_undegraded":"2024-09-19T06:40:08.076591+0000","last_fullsized":"2024-09-19T06:40:08.076591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:39.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274235+0000","last_change":"2024-09-19T06:38:14.051796+0000","last_active":"2024-09-19T06:40:08.274235+0000","last_peered":"2024-09-19T06:40:08.274235+0000","last_clean":"2024-09-19T06:40:08.274235+0000","last_became_active":"2024-09-19T06:38:14.048338+0000","last_became_peered":"2024-09-19T06:38:14.048338+0000","last_unstale":"2024-09-19T06:40:08.274235+0000","last_undegraded":"2024-09-19T06:40:08.274235+0000","last_fullsized":"2024-09-19T06:40:08.274235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:48.656819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276087+0000","last_change":"2024-09-19T06:38:14.048607+0000","last_active":"2024-09-19T06:40:08.276087+0000","last_peered":"2024-09-19T06:40:08.276087+0000","last_clean":"2024-09-19T06:40:08.276087+0000","last_became_active":"2024-09-19T06:38:14.047277+0000","last_became_peered":"2024-09-19T06:38:14.047277+0000","last_unstale":"2024-09-19T06:40:08.276087+0000","last_undegraded":"2024-09-19T06:40:08.276087+0000","last_fullsized":"2024-09-19T06:40:08.276087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:52.904376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273963+0000","last_change":"2024-09-19T06:38:14.050759+0000","last_active":"2024-09-19T06:40:08.273963+0000","last_peered":"2024-09-19T06:40:08.273963+0000","last_clean":"2024-09-19T06:40:08.273963+0000","last_became_active":"2024-09-19T06:38:14.049900+0000","last_became_peered":"2024-09-19T06:38:14.049900+0000","last_unstale":"2024-09-19T06:40:08.273963+0000","last_undegraded":"2024-09-19T06:40:08.273963+0000","last_fullsized":"2024-09-19T06:40:08.273963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:45.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273772+0000","last_change":"2024-09-19T06:38:14.058890+0000","last_active":"2024-09-19T06:40:08.273772+0000","last_peered":"2024-09-19T06:40:08.273772+0000","last_clean":"2024-09-19T06:40:08.273772+0000","last_became_active":"2024-09-19T06:38:14.058442+0000","last_became_peered":"2024-09-19T06:38:14.058442+0000","last_unstale":"2024-09-19T06:40:08.273772+0000","last_undegraded":"2024-09-19T06:40:08.273772+0000","last_fullsized":"2024-09-19T06:40:08.273772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:27.296578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273218+0000","last_change":"2024-09-19T06:38:14.050371+0000","last_active":"2024-09-19T06:40:08.273218+0000","last_peered":"2024-09-19T06:40:08.273218+0000","last_clean":"2024-09-19T06:40:08.273218+0000","last_became_active":"2024-09-19T06:38:14.049930+0000","last_became_peered":"2024-09-19T06:38:14.049930+0000","last_unstale":"2024-09-19T06:40:08.273218+0000","last_undegraded":"2024-09-19T06:40:08.273218+0000","last_fullsized":"2024-09-19T06:40:08.273218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:37.898624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193944+0000","last_change":"2024-09-19T06:38:14.052521+0000","last_active":"2024-09-19T06:40:08.193944+0000","last_peered":"2024-09-19T06:40:08.193944+0000","last_clean":"2024-09-19T06:40:08.193944+0000","last_became_active":"2024-09-19T06:38:14.052083+0000","last_became_peered":"2024-09-19T06:38:14.052083+0000","last_unstale":"2024-09-19T06:40:08.193944+0000","last_undegraded":"2024-09-19T06:40:08.193944+0000","last_fullsized":"2024-09-19T06:40:08.193944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:10.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182686+0000","last_change":"2024-09-19T06:38:14.044747+0000","last_active":"2024-09-19T06:40:08.182686+0000","last_peered":"2024-09-19T06:40:08.182686+0000","last_clean":"2024-09-19T06:40:08.182686+0000","last_became_active":"2024-09-19T06:38:14.044451+0000","last_became_peered":"2024-09-19T06:38:14.044451+0000","last_unstale":"2024-09-19T06:40:08.182686+0000","last_undegraded":"2024-09-19T06:40:08.182686+0000","last_fullsized":"2024-09-19T06:40:08.182686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:04.067156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076928+0000","last_change":"2024-09-19T06:38:14.056101+0000","last_active":"2024-09-19T06:40:08.076928+0000","last_peered":"2024-09-19T06:40:08.076928+0000","last_clean":"2024-09-19T06:40:08.076928+0000","last_became_active":"2024-09-19T06:38:14.055682+0000","last_became_peered":"2024-09-19T06:38:14.055682+0000","last_unstale":"2024-09-19T06:40:08.076928+0000","last_undegraded":"2024-09-19T06:40:08.076928+0000","last_fullsized":"2024-09-19T06:40:08.076928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:23.921766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193625+0000","last_change":"2024-09-19T06:38:14.059441+0000","last_active":"2024-09-19T06:40:08.193625+0000","last_peered":"2024-09-19T06:40:08.193625+0000","last_clean":"2024-09-19T06:40:08.193625+0000","last_became_active":"2024-09-19T06:38:14.059123+0000","last_became_peered":"2024-09-19T06:38:14.059123+0000","last_unstale":"2024-09-19T06:40:08.193625+0000","last_undegraded":"2024-09-19T06:40:08.193625+0000","last_fullsized":"2024-09-19T06:40:08.193625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:32.148741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276233+0000","last_change":"2024-09-19T06:38:14.050336+0000","last_active":"2024-09-19T06:40:08.276233+0000","last_peered":"2024-09-19T06:40:08.276233+0000","last_clean":"2024-09-19T06:40:08.276233+0000","last_became_active":"2024-09-19T06:38:14.050041+0000","last_became_peered":"2024-09-19T06:38:14.050041+0000","last_unstale":"2024-09-19T06:40:08.276233+0000","last_undegraded":"2024-09-19T06:40:08.276233+0000","last_fullsized":"2024-09-19T06:40:08.276233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:09.245804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273366+0000","last_change":"2024-09-19T06:38:14.050280+0000","last_active":"2024-09-19T06:40:08.273366+0000","last_peered":"2024-09-19T06:40:08.273366+0000","last_clean":"2024-09-19T06:40:08.273366+0000","last_became_active":"2024-09-19T06:38:14.049874+0000","last_became_peered":"2024-09-19T06:38:14.049874+0000","last_unstale":"2024-09-19T06:40:08.273366+0000","last_undegraded":"2024-09-19T06:40:08.273366+0000","last_fullsized":"2024-09-19T06:40:08.273366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:52.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075355+0000","last_change":"2024-09-19T06:38:14.048294+0000","last_active":"2024-09-19T06:40:08.075355+0000","last_peered":"2024-09-19T06:40:08.075355+0000","last_clean":"2024-09-19T06:40:08.075355+0000","last_became_active":"2024-09-19T06:38:14.048002+0000","last_became_peered":"2024-09-19T06:38:14.048002+0000","last_unstale":"2024-09-19T06:40:08.075355+0000","last_undegraded":"2024-09-19T06:40:08.075355+0000","last_fullsized":"2024-09-19T06:40:08.075355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:55.920027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257610+0000","last_change":"2024-09-19T06:38:14.050244+0000","last_active":"2024-09-19T06:40:08.257610+0000","last_peered":"2024-09-19T06:40:08.257610+0000","last_clean":"2024-09-19T06:40:08.257610+0000","last_became_active":"2024-09-19T06:38:14.049499+0000","last_became_peered":"2024-09-19T06:38:14.049499+0000","last_unstale":"2024-09-19T06:40:08.257610+0000","last_undegraded":"2024-09-19T06:40:08.257610+0000","last_fullsized":"2024-09-19T06:40:08.257610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:35.506647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076492+0000","last_change":"2024-09-19T06:38:14.048779+0000","last_active":"2024-09-19T06:40:08.076492+0000","last_peered":"2024-09-19T06:40:08.076492+0000","last_clean":"2024-09-19T06:40:08.076492+0000","last_became_active":"2024-09-19T06:38:14.048492+0000","last_became_peered":"2024-09-19T06:38:14.048492+0000","last_unstale":"2024-09-19T06:40:08.076492+0000","last_undegraded":"2024-09-19T06:40:08.076492+0000","last_fullsized":"2024-09-19T06:40:08.076492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:01.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076981+0000","last_change":"2024-09-19T06:38:14.054442+0000","last_active":"2024-09-19T06:40:08.076981+0000","last_peered":"2024-09-19T06:40:08.076981+0000","last_clean":"2024-09-19T06:40:08.076981+0000","last_became_active":"2024-09-19T06:38:14.053903+0000","last_became_peered":"2024-09-19T06:38:14.053903+0000","last_unstale":"2024-09-19T06:40:08.076981+0000","last_undegraded":"2024-09-19T06:40:08.076981+0000","last_fullsized":"2024-09-19T06:40:08.076981+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:42.002146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193936+0000","last_change":"2024-09-19T06:38:14.051139+0000","last_active":"2024-09-19T06:40:08.193936+0000","last_peered":"2024-09-19T06:40:08.193936+0000","last_clean":"2024-09-19T06:40:08.193936+0000","last_became_active":"2024-09-19T06:38:14.050764+0000","last_became_peered":"2024-09-19T06:38:14.050764+0000","last_unstale":"2024-09-19T06:40:08.193936+0000","last_undegraded":"2024-09-19T06:40:08.193936+0000","last_fullsized":"2024-09-19T06:40:08.193936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.379184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275728+0000","last_change":"2024-09-19T06:38:14.054614+0000","last_active":"2024-09-19T06:40:08.275728+0000","last_peered":"2024-09-19T06:40:08.275728+0000","last_clean":"2024-09-19T06:40:08.275728+0000","last_became_active":"2024-09-19T06:38:14.054280+0000","last_became_peered":"2024-09-19T06:38:14.054280+0000","last_unstale":"2024-09-19T06:40:08.275728+0000","last_undegraded":"2024-09-19T06:40:08.275728+0000","last_fullsized":"2024-09-19T06:40:08.275728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:21.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274136+0000","last_change":"2024-09-19T06:38:14.056215+0000","last_active":"2024-09-19T06:40:08.274136+0000","last_peered":"2024-09-19T06:40:08.274136+0000","last_clean":"2024-09-19T06:40:08.274136+0000","last_became_active":"2024-09-19T06:38:14.055875+0000","last_became_peered":"2024-09-19T06:38:14.055875+0000","last_unstale":"2024-09-19T06:40:08.274136+0000","last_undegraded":"2024-09-19T06:40:08.274136+0000","last_fullsized":"2024-09-19T06:40:08.274136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:45.347185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076524+0000","last_change":"2024-09-19T06:38:14.057963+0000","last_active":"2024-09-19T06:40:08.076524+0000","last_peered":"2024-09-19T06:40:08.076524+0000","last_clean":"2024-09-19T06:40:08.076524+0000","last_became_active":"2024-09-19T06:38:14.057578+0000","last_became_peered":"2024-09-19T06:38:14.057578+0000","last_unstale":"2024-09-19T06:40:08.076524+0000","last_undegraded":"2024-09-19T06:40:08.076524+0000","last_fullsized":"2024-09-19T06:40:08.076524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:26.173414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076544+0000","last_change":"2024-09-19T06:38:14.058840+0000","last_active":"2024-09-19T06:40:08.076544+0000","last_peered":"2024-09-19T06:40:08.076544+0000","last_clean":"2024-09-19T06:40:08.076544+0000","last_became_active":"2024-09-19T06:38:14.058418+0000","last_became_peered":"2024-09-19T06:38:14.058418+0000","last_unstale":"2024-09-19T06:40:08.076544+0000","last_undegraded":"2024-09-19T06:40:08.076544+0000","last_fullsized":"2024-09-19T06:40:08.076544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:13.624750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193600+0000","last_change":"2024-09-19T06:38:14.053363+0000","last_active":"2024-09-19T06:40:08.193600+0000","last_peered":"2024-09-19T06:40:08.193600+0000","last_clean":"2024-09-19T06:40:08.193600+0000","last_became_active":"2024-09-19T06:38:14.053039+0000","last_became_peered":"2024-09-19T06:38:14.053039+0000","last_unstale":"2024-09-19T06:40:08.193600+0000","last_undegraded":"2024-09-19T06:40:08.193600+0000","last_fullsized":"2024-09-19T06:40:08.193600+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.274885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185012+0000","last_change":"2024-09-19T06:38:14.045719+0000","last_active":"2024-09-19T06:40:08.185012+0000","last_peered":"2024-09-19T06:40:08.185012+0000","last_clean":"2024-09-19T06:40:08.185012+0000","last_became_active":"2024-09-19T06:38:14.045285+0000","last_became_peered":"2024-09-19T06:38:14.045285+0000","last_unstale":"2024-09-19T06:40:08.185012+0000","last_undegraded":"2024-09-19T06:40:08.185012+0000","last_fullsized":"2024-09-19T06:40:08.185012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:16.877802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":155,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:12.808215+0000","last_change":"2024-09-19T06:38:23.177942+0000","last_active":"2024-09-19T06:40:12.808215+0000","last_peered":"2024-09-19T06:40:12.808215+0000","last_clean":"2024-09-19T06:40:12.808215+0000","last_became_active":"2024-09-19T06:38:23.176579+0000","last_became_peered":"2024-09-19T06:38:23.176579+0000","last_unstale":"2024-09-19T06:40:12.808215+0000","last_undegraded":"2024-09-19T06:40:12.808215+0000","last_fullsized":"2024-09-19T06:40:12.808215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:28.140245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257665+0000","last_change":"2024-09-19T06:38:23.811603+0000","last_active":"2024-09-19T06:40:08.257665+0000","last_peered":"2024-09-19T06:40:08.257665+0000","last_clean":"2024-09-19T06:40:08.257665+0000","last_became_active":"2024-09-19T06:38:23.811139+0000","last_became_peered":"2024-09-19T06:38:23.811139+0000","last_unstale":"2024-09-19T06:40:08.257665+0000","last_undegraded":"2024-09-19T06:40:08.257665+0000","last_fullsized":"2024-09-19T06:40:08.257665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:42.082355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196626+0000","last_change":"2024-09-19T06:38:12.041330+0000","last_active":"2024-09-19T06:40:08.196626+0000","last_peered":"2024-09-19T06:40:08.196626+0000","last_clean":"2024-09-19T06:40:08.196626+0000","last_became_active":"2024-09-19T06:38:12.040992+0000","last_became_peered":"2024-09-19T06:38:12.040992+0000","last_unstale":"2024-09-19T06:40:08.196626+0000","last_undegraded":"2024-09-19T06:40:08.196626+0000","last_fullsized":"2024-09-19T06:40:08.196626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:51.721009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275224+0000","last_change":"2024-09-19T06:38:12.034534+0000","last_active":"2024-09-19T06:40:08.275224+0000","last_peered":"2024-09-19T06:40:08.275224+0000","last_clean":"2024-09-19T06:40:08.275224+0000","last_became_active":"2024-09-19T06:38:12.034209+0000","last_became_peered":"2024-09-19T06:38:12.034209+0000","last_unstale":"2024-09-19T06:40:08.275224+0000","last_undegraded":"2024-09-19T06:40:08.275224+0000","last_fullsized":"2024-09-19T06:40:08.275224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:40.640464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075337+0000","last_change":"2024-09-19T06:38:14.043287+0000","last_active":"2024-09-19T06:40:08.075337+0000","last_peered":"2024-09-19T06:40:08.075337+0000","last_clean":"2024-09-19T06:40:08.075337+0000","last_became_active":"2024-09-19T06:38:14.042565+0000","last_became_peered":"2024-09-19T06:38:14.042565+0000","last_unstale":"2024-09-19T06:40:08.075337+0000","last_undegraded":"2024-09-19T06:40:08.075337+0000","last_fullsized":"2024-09-19T06:40:08.075337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:32.689929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257848+0000","last_change":"2024-09-19T06:38:12.039142+0000","last_active":"2024-09-19T06:40:08.257848+0000","last_peered":"2024-09-19T06:40:08.257848+0000","last_clean":"2024-09-19T06:40:08.257848+0000","last_became_active":"2024-09-19T06:38:12.038815+0000","last_became_peered":"2024-09-19T06:38:12.038815+0000","last_unstale":"2024-09-19T06:40:08.257848+0000","last_undegraded":"2024-09-19T06:40:08.257848+0000","last_fullsized":"2024-09-19T06:40:08.257848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:03.316742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182141+0000","last_change":"2024-09-19T06:38:14.044778+0000","last_active":"2024-09-19T06:40:08.182141+0000","last_peered":"2024-09-19T06:40:08.182141+0000","last_clean":"2024-09-19T06:40:08.182141+0000","last_became_active":"2024-09-19T06:38:14.044457+0000","last_became_peered":"2024-09-19T06:38:14.044457+0000","last_unstale":"2024-09-19T06:40:08.182141+0000","last_undegraded":"2024-09-19T06:40:08.182141+0000","last_fullsized":"2024-09-19T06:40:08.182141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:06.342070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":253,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:13.808823+0000","last_change":"2024-09-19T06:38:12.039031+0000","last_active":"2024-09-19T06:40:13.808823+0000","last_peered":"2024-09-19T06:40:13.808823+0000","last_clean":"2024-09-19T06:40:13.808823+0000","last_became_active":"2024-09-19T06:38:12.038346+0000","last_became_peered":"2024-09-19T06:38:12.038346+0000","last_unstale":"2024-09-19T06:40:13.808823+0000","last_undegraded":"2024-09-19T06:40:13.808823+0000","last_fullsized":"2024-09-19T06:40:13.808823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:33.752330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":218,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273694+0000","last_change":"2024-09-19T06:38:14.045159+0000","last_active":"2024-09-19T06:40:08.273694+0000","last_peered":"2024-09-19T06:40:08.273694+0000","last_clean":"2024-09-19T06:40:08.273694+0000","last_became_active":"2024-09-19T06:38:14.044822+0000","last_became_peered":"2024-09-19T06:38:14.044822+0000","last_unstale":"2024-09-19T06:40:08.273694+0000","last_undegraded":"2024-09-19T06:40:08.273694+0000","last_fullsized":"2024-09-19T06:40:08.273694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:05.143507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076765+0000","last_change":"2024-09-19T06:38:12.037820+0000","last_active":"2024-09-19T06:40:08.076765+0000","last_peered":"2024-09-19T06:40:08.076765+0000","last_clean":"2024-09-19T06:40:08.076765+0000","last_became_active":"2024-09-19T06:38:12.037417+0000","last_became_peered":"2024-09-19T06:38:12.037417+0000","last_unstale":"2024-09-19T06:40:08.076765+0000","last_undegraded":"2024-09-19T06:40:08.076765+0000","last_fullsized":"2024-09-19T06:40:08.076765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:22.516704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274674+0000","last_change":"2024-09-19T06:38:14.048633+0000","last_active":"2024-09-19T06:40:08.274674+0000","last_peered":"2024-09-19T06:40:08.274674+0000","last_clean":"2024-09-19T06:40:08.274674+0000","last_became_active":"2024-09-19T06:38:14.048257+0000","last_became_peered":"2024-09-19T06:38:14.048257+0000","last_unstale":"2024-09-19T06:40:08.274674+0000","last_undegraded":"2024-09-19T06:40:08.274674+0000","last_fullsized":"2024-09-19T06:40:08.274674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:16.509071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257784+0000","last_change":"2024-09-19T06:38:12.047175+0000","last_active":"2024-09-19T06:40:08.257784+0000","last_peered":"2024-09-19T06:40:08.257784+0000","last_clean":"2024-09-19T06:40:08.257784+0000","last_became_active":"2024-09-19T06:38:12.046781+0000","last_became_peered":"2024-09-19T06:38:12.046781+0000","last_unstale":"2024-09-19T06:40:08.257784+0000","last_undegraded":"2024-09-19T06:40:08.257784+0000","last_fullsized":"2024-09-19T06:40:08.257784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:38.774803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273461+0000","last_change":"2024-09-19T06:38:23.067812+0000","last_active":"2024-09-19T06:40:08.273461+0000","last_peered":"2024-09-19T06:40:08.273461+0000","last_clean":"2024-09-19T06:40:08.273461+0000","last_became_active":"2024-09-19T06:38:23.067357+0000","last_became_peered":"2024-09-19T06:38:23.067357+0000","last_unstale":"2024-09-19T06:40:08.273461+0000","last_undegraded":"2024-09-19T06:40:08.273461+0000","last_fullsized":"2024-09-19T06:40:08.273461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:34.719243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'35","reported_seq":309,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:13.808833+0000","last_change":"2024-09-19T06:38:23.186703+0000","last_active":"2024-09-19T06:40:13.808833+0000","last_peered":"2024-09-19T06:40:13.808833+0000","last_clean":"2024-09-19T06:40:13.808833+0000","last_became_active":"2024-09-19T06:38:23.177212+0000","last_became_peered":"2024-09-19T06:38:23.177212+0000","last_unstale":"2024-09-19T06:40:13.808833+0000","last_undegraded":"2024-09-19T06:40:13.808833+0000","last_fullsized":"2024-09-19T06:40:13.808833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:46.884624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65927,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":230,"num_read_kb":179,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185343+0000","last_change":"2024-09-19T06:38:14.054619+0000","last_active":"2024-09-19T06:40:08.185343+0000","last_peered":"2024-09-19T06:40:08.185343+0000","last_clean":"2024-09-19T06:40:08.185343+0000","last_became_active":"2024-09-19T06:38:14.054118+0000","last_became_peered":"2024-09-19T06:38:14.054118+0000","last_unstale":"2024-09-19T06:40:08.185343+0000","last_undegraded":"2024-09-19T06:40:08.185343+0000","last_fullsized":"2024-09-19T06:40:08.185343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:41.041603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076764+0000","last_change":"2024-09-19T06:38:12.040272+0000","last_active":"2024-09-19T06:40:08.076764+0000","last_peered":"2024-09-19T06:40:08.076764+0000","last_clean":"2024-09-19T06:40:08.076764+0000","last_became_active":"2024-09-19T06:38:12.039940+0000","last_became_peered":"2024-09-19T06:38:12.039940+0000","last_unstale":"2024-09-19T06:40:08.076764+0000","last_undegraded":"2024-09-19T06:40:08.076764+0000","last_fullsized":"2024-09-19T06:40:08.076764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:53.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275371+0000","last_change":"2024-09-19T06:38:14.049535+0000","last_active":"2024-09-19T06:40:08.275371+0000","last_peered":"2024-09-19T06:40:08.275371+0000","last_clean":"2024-09-19T06:40:08.275371+0000","last_became_active":"2024-09-19T06:38:14.049208+0000","last_became_peered":"2024-09-19T06:38:14.049208+0000","last_unstale":"2024-09-19T06:40:08.275371+0000","last_undegraded":"2024-09-19T06:40:08.275371+0000","last_fullsized":"2024-09-19T06:40:08.275371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:03.359786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257731+0000","last_change":"2024-09-19T06:38:12.037346+0000","last_active":"2024-09-19T06:40:08.257731+0000","last_peered":"2024-09-19T06:40:08.257731+0000","last_clean":"2024-09-19T06:40:08.257731+0000","last_became_active":"2024-09-19T06:38:12.036986+0000","last_became_peered":"2024-09-19T06:38:12.036986+0000","last_unstale":"2024-09-19T06:40:08.257731+0000","last_undegraded":"2024-09-19T06:40:08.257731+0000","last_fullsized":"2024-09-19T06:40:08.257731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:26.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076694+0000","last_change":"2024-09-19T06:38:14.059454+0000","last_active":"2024-09-19T06:40:08.076694+0000","last_peered":"2024-09-19T06:40:08.076694+0000","last_clean":"2024-09-19T06:40:08.076694+0000","last_became_active":"2024-09-19T06:38:14.058996+0000","last_became_peered":"2024-09-19T06:38:14.058996+0000","last_unstale":"2024-09-19T06:40:08.076694+0000","last_undegraded":"2024-09-19T06:40:08.076694+0000","last_fullsized":"2024-09-19T06:40:08.076694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:54.645395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":147,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:12.808267+0000","last_change":"2024-09-19T06:38:12.043687+0000","last_active":"2024-09-19T06:40:12.808267+0000","last_peered":"2024-09-19T06:40:12.808267+0000","last_clean":"2024-09-19T06:40:12.808267+0000","last_became_active":"2024-09-19T06:38:12.043268+0000","last_became_peered":"2024-09-19T06:38:12.043268+0000","last_unstale":"2024-09-19T06:40:12.808267+0000","last_undegraded":"2024-09-19T06:40:12.808267+0000","last_fullsized":"2024-09-19T06:40:12.808267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:18.753736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076233+0000","last_change":"2024-09-19T06:38:14.052184+0000","last_active":"2024-09-19T06:40:08.076233+0000","last_peered":"2024-09-19T06:40:08.076233+0000","last_clean":"2024-09-19T06:40:08.076233+0000","last_became_active":"2024-09-19T06:38:14.051736+0000","last_became_peered":"2024-09-19T06:38:14.051736+0000","last_unstale":"2024-09-19T06:40:08.076233+0000","last_undegraded":"2024-09-19T06:40:08.076233+0000","last_fullsized":"2024-09-19T06:40:08.076233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:12.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:12.048418+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:12.047948+0000","last_became_peered":"2024-09-19T06:38:12.047948+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:06.059904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181946+0000","last_change":"2024-09-19T06:38:23.175961+0000","last_active":"2024-09-19T06:40:08.181946+0000","last_peered":"2024-09-19T06:40:08.181946+0000","last_clean":"2024-09-19T06:40:08.181946+0000","last_became_active":"2024-09-19T06:38:23.175629+0000","last_became_peered":"2024-09-19T06:38:23.175629+0000","last_unstale":"2024-09-19T06:40:08.181946+0000","last_undegraded":"2024-09-19T06:40:08.181946+0000","last_fullsized":"2024-09-19T06:40:08.181946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185296+0000","last_change":"2024-09-19T06:38:12.038945+0000","last_active":"2024-09-19T06:40:08.185296+0000","last_peered":"2024-09-19T06:40:08.185296+0000","last_clean":"2024-09-19T06:40:08.185296+0000","last_became_active":"2024-09-19T06:38:12.038571+0000","last_became_peered":"2024-09-19T06:38:12.038571+0000","last_unstale":"2024-09-19T06:40:08.185296+0000","last_undegraded":"2024-09-19T06:40:08.185296+0000","last_fullsized":"2024-09-19T06:40:08.185296+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:57.887070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193798+0000","last_change":"2024-09-19T06:38:14.056481+0000","last_active":"2024-09-19T06:40:08.193798+0000","last_peered":"2024-09-19T06:40:08.193798+0000","last_clean":"2024-09-19T06:40:08.193798+0000","last_became_active":"2024-09-19T06:38:14.056177+0000","last_became_peered":"2024-09-19T06:38:14.056177+0000","last_unstale":"2024-09-19T06:40:08.193798+0000","last_undegraded":"2024-09-19T06:40:08.193798+0000","last_fullsized":"2024-09-19T06:40:08.193798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.734802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276561+0000","last_change":"2024-09-19T06:38:12.038826+0000","last_active":"2024-09-19T06:40:08.276561+0000","last_peered":"2024-09-19T06:40:08.276561+0000","last_clean":"2024-09-19T06:40:08.276561+0000","last_became_active":"2024-09-19T06:38:12.038516+0000","last_became_peered":"2024-09-19T06:38:12.038516+0000","last_unstale":"2024-09-19T06:40:08.276561+0000","last_undegraded":"2024-09-19T06:40:08.276561+0000","last_fullsized":"2024-09-19T06:40:08.276561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:16.709742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076941+0000","last_change":"2024-09-19T06:38:14.053888+0000","last_active":"2024-09-19T06:40:08.076941+0000","last_peered":"2024-09-19T06:40:08.076941+0000","last_clean":"2024-09-19T06:40:08.076941+0000","last_became_active":"2024-09-19T06:38:14.053524+0000","last_became_peered":"2024-09-19T06:38:14.053524+0000","last_unstale":"2024-09-19T06:40:08.076941+0000","last_undegraded":"2024-09-19T06:40:08.076941+0000","last_fullsized":"2024-09-19T06:40:08.076941+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:54.853786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'41","reported_seq":62,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.310545+0000","last_change":"2024-09-19T06:39:23.715975+0000","last_active":"2024-09-19T06:40:08.310545+0000","last_peered":"2024-09-19T06:40:08.310545+0000","last_clean":"2024-09-19T06:40:08.310545+0000","last_became_active":"2024-09-19T06:39:23.713052+0000","last_became_peered":"2024-09-19T06:39:23.713052+0000","last_unstale":"2024-09-19T06:40:08.310545+0000","last_undegraded":"2024-09-19T06:40:08.310545+0000","last_fullsized":"2024-09-19T06:40:08.310545+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:42.887751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076532+0000","last_change":"2024-09-19T06:38:14.052210+0000","last_active":"2024-09-19T06:40:08.076532+0000","last_peered":"2024-09-19T06:40:08.076532+0000","last_clean":"2024-09-19T06:40:08.076532+0000","last_became_active":"2024-09-19T06:38:14.051803+0000","last_became_peered":"2024-09-19T06:38:14.051803+0000","last_unstale":"2024-09-19T06:40:08.076532+0000","last_undegraded":"2024-09-19T06:40:08.076532+0000","last_fullsized":"2024-09-19T06:40:08.076532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:40.751672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'8","reported_seq":149,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:12.830848+0000","last_change":"2024-09-19T06:38:12.118077+0000","last_active":"2024-09-19T06:40:12.830848+0000","last_peered":"2024-09-19T06:40:12.830848+0000","last_clean":"2024-09-19T06:40:12.830848+0000","last_became_active":"2024-09-19T06:38:12.117690+0000","last_became_peered":"2024-09-19T06:38:12.117690+0000","last_unstale":"2024-09-19T06:40:12.830848+0000","last_undegraded":"2024-09-19T06:40:12.830848+0000","last_fullsized":"2024-09-19T06:40:12.830848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.828335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076689+0000","last_change":"2024-09-19T06:38:14.054014+0000","last_active":"2024-09-19T06:40:08.076689+0000","last_peered":"2024-09-19T06:40:08.076689+0000","last_clean":"2024-09-19T06:40:08.076689+0000","last_became_active":"2024-09-19T06:38:14.053349+0000","last_became_peered":"2024-09-19T06:38:14.053349+0000","last_unstale":"2024-09-19T06:40:08.076689+0000","last_undegraded":"2024-09-19T06:40:08.076689+0000","last_fullsized":"2024-09-19T06:40:08.076689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:40.117720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"86'148","reported_seq":395,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:10.190486+0000","last_change":"2024-09-19T06:37:02.166696+0000","last_active":"2024-09-19T06:40:10.190486+0000","last_peered":"2024-09-19T06:40:10.190486+0000","last_clean":"2024-09-19T06:40:10.190486+0000","last_became_active":"2024-09-19T06:37:02.166225+0000","last_became_peered":"2024-09-19T06:37:02.166225+0000","last_unstale":"2024-09-19T06:40:10.190486+0000","last_undegraded":"2024-09-19T06:40:10.190486+0000","last_fullsized":"2024-09-19T06:40:10.190486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_clean_scrub_stamp":"2024-09-19T06:33:40.535354+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:46.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274179+0000","last_change":"2024-09-19T06:38:12.044465+0000","last_active":"2024-09-19T06:40:08.274179+0000","last_peered":"2024-09-19T06:40:08.274179+0000","last_clean":"2024-09-19T06:40:08.274179+0000","last_became_active":"2024-09-19T06:38:12.044042+0000","last_became_peered":"2024-09-19T06:38:12.044042+0000","last_unstale":"2024-09-19T06:40:08.274179+0000","last_undegraded":"2024-09-19T06:40:08.274179+0000","last_fullsized":"2024-09-19T06:40:08.274179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:40.759264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075774+0000","last_change":"2024-09-19T06:38:14.045102+0000","last_active":"2024-09-19T06:40:08.075774+0000","last_peered":"2024-09-19T06:40:08.075774+0000","last_clean":"2024-09-19T06:40:08.075774+0000","last_became_active":"2024-09-19T06:38:14.044785+0000","last_became_peered":"2024-09-19T06:38:14.044785+0000","last_unstale":"2024-09-19T06:40:08.075774+0000","last_undegraded":"2024-09-19T06:40:08.075774+0000","last_fullsized":"2024-09-19T06:40:08.075774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:57.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076395+0000","last_change":"2024-09-19T06:39:24.353205+0000","last_active":"2024-09-19T06:40:08.076395+0000","last_peered":"2024-09-19T06:40:08.076395+0000","last_clean":"2024-09-19T06:40:08.076395+0000","last_became_active":"2024-09-19T06:39:24.350315+0000","last_became_peered":"2024-09-19T06:39:24.350315+0000","last_unstale":"2024-09-19T06:40:08.076395+0000","last_undegraded":"2024-09-19T06:40:08.076395+0000","last_fullsized":"2024-09-19T06:40:08.076395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:32.467330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,8],"acting":[7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275223+0000","last_change":"2024-09-19T06:38:14.054623+0000","last_active":"2024-09-19T06:40:08.275223+0000","last_peered":"2024-09-19T06:40:08.275223+0000","last_clean":"2024-09-19T06:40:08.275223+0000","last_became_active":"2024-09-19T06:38:14.054124+0000","last_became_peered":"2024-09-19T06:38:14.054124+0000","last_unstale":"2024-09-19T06:40:08.275223+0000","last_undegraded":"2024-09-19T06:40:08.275223+0000","last_fullsized":"2024-09-19T06:40:08.275223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:33.251059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":146,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:13.809087+0000","last_change":"2024-09-19T06:38:12.047284+0000","last_active":"2024-09-19T06:40:13.809087+0000","last_peered":"2024-09-19T06:40:13.809087+0000","last_clean":"2024-09-19T06:40:13.809087+0000","last_became_active":"2024-09-19T06:38:12.046886+0000","last_became_peered":"2024-09-19T06:38:12.046886+0000","last_unstale":"2024-09-19T06:40:13.809087+0000","last_undegraded":"2024-09-19T06:40:13.809087+0000","last_fullsized":"2024-09-19T06:40:13.809087+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:15.030007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257725+0000","last_change":"2024-09-19T06:38:14.049351+0000","last_active":"2024-09-19T06:40:08.257725+0000","last_peered":"2024-09-19T06:40:08.257725+0000","last_clean":"2024-09-19T06:40:08.257725+0000","last_became_active":"2024-09-19T06:38:14.048792+0000","last_became_peered":"2024-09-19T06:38:14.048792+0000","last_unstale":"2024-09-19T06:40:08.257725+0000","last_undegraded":"2024-09-19T06:40:08.257725+0000","last_fullsized":"2024-09-19T06:40:08.257725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:30.431378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'9","reported_seq":150,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:12.829419+0000","last_change":"2024-09-19T06:38:12.037155+0000","last_active":"2024-09-19T06:40:12.829419+0000","last_peered":"2024-09-19T06:40:12.829419+0000","last_clean":"2024-09-19T06:40:12.829419+0000","last_became_active":"2024-09-19T06:38:12.036536+0000","last_became_peered":"2024-09-19T06:38:12.036536+0000","last_unstale":"2024-09-19T06:40:12.829419+0000","last_undegraded":"2024-09-19T06:40:12.829419+0000","last_fullsized":"2024-09-19T06:40:12.829419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:41.014783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196631+0000","last_change":"2024-09-19T06:38:14.055724+0000","last_active":"2024-09-19T06:40:08.196631+0000","last_peered":"2024-09-19T06:40:08.196631+0000","last_clean":"2024-09-19T06:40:08.196631+0000","last_became_active":"2024-09-19T06:38:14.054457+0000","last_became_peered":"2024-09-19T06:38:14.054457+0000","last_unstale":"2024-09-19T06:40:08.196631+0000","last_undegraded":"2024-09-19T06:40:08.196631+0000","last_fullsized":"2024-09-19T06:40:08.196631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:47.653709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182579+0000","last_change":"2024-09-19T06:38:12.049197+0000","last_active":"2024-09-19T06:40:08.182579+0000","last_peered":"2024-09-19T06:40:08.182579+0000","last_clean":"2024-09-19T06:40:08.182579+0000","last_became_active":"2024-09-19T06:38:12.048863+0000","last_became_peered":"2024-09-19T06:38:12.048863+0000","last_unstale":"2024-09-19T06:40:08.182579+0000","last_undegraded":"2024-09-19T06:40:08.182579+0000","last_fullsized":"2024-09-19T06:40:08.182579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:25.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196635+0000","last_change":"2024-09-19T06:38:14.042991+0000","last_active":"2024-09-19T06:40:08.196635+0000","last_peered":"2024-09-19T06:40:08.196635+0000","last_clean":"2024-09-19T06:40:08.196635+0000","last_became_active":"2024-09-19T06:38:14.042511+0000","last_became_peered":"2024-09-19T06:38:14.042511+0000","last_unstale":"2024-09-19T06:40:08.196635+0000","last_undegraded":"2024-09-19T06:40:08.196635+0000","last_fullsized":"2024-09-19T06:40:08.196635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:38.212838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193790+0000","last_change":"2024-09-19T06:38:23.064456+0000","last_active":"2024-09-19T06:40:08.193790+0000","last_peered":"2024-09-19T06:40:08.193790+0000","last_clean":"2024-09-19T06:40:08.193790+0000","last_became_active":"2024-09-19T06:38:23.064051+0000","last_became_peered":"2024-09-19T06:38:23.064051+0000","last_unstale":"2024-09-19T06:40:08.193790+0000","last_undegraded":"2024-09-19T06:40:08.193790+0000","last_fullsized":"2024-09-19T06:40:08.193790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:58.548420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275853+0000","last_change":"2024-09-19T06:38:14.048612+0000","last_active":"2024-09-19T06:40:08.275853+0000","last_peered":"2024-09-19T06:40:08.275853+0000","last_clean":"2024-09-19T06:40:08.275853+0000","last_became_active":"2024-09-19T06:38:14.048294+0000","last_became_peered":"2024-09-19T06:38:14.048294+0000","last_unstale":"2024-09-19T06:40:08.275853+0000","last_undegraded":"2024-09-19T06:40:08.275853+0000","last_fullsized":"2024-09-19T06:40:08.275853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:55.892149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'50","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.313781+0000","last_change":"2024-09-19T06:38:12.035269+0000","last_active":"2024-09-19T06:40:08.313781+0000","last_peered":"2024-09-19T06:40:08.313781+0000","last_clean":"2024-09-19T06:40:08.313781+0000","last_became_active":"2024-09-19T06:38:12.034841+0000","last_became_peered":"2024-09-19T06:38:12.034841+0000","last_unstale":"2024-09-19T06:40:08.313781+0000","last_undegraded":"2024-09-19T06:40:08.313781+0000","last_fullsized":"2024-09-19T06:40:08.313781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:19.642572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076503+0000","last_change":"2024-09-19T06:38:14.052492+0000","last_active":"2024-09-19T06:40:08.076503+0000","last_peered":"2024-09-19T06:40:08.076503+0000","last_clean":"2024-09-19T06:40:08.076503+0000","last_became_active":"2024-09-19T06:38:14.052191+0000","last_became_peered":"2024-09-19T06:38:14.052191+0000","last_unstale":"2024-09-19T06:40:08.076503+0000","last_undegraded":"2024-09-19T06:40:08.076503+0000","last_fullsized":"2024-09-19T06:40:08.076503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:34.006480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274336+0000","last_change":"2024-09-19T06:38:12.118430+0000","last_active":"2024-09-19T06:40:08.274336+0000","last_peered":"2024-09-19T06:40:08.274336+0000","last_clean":"2024-09-19T06:40:08.274336+0000","last_became_active":"2024-09-19T06:38:12.118065+0000","last_became_peered":"2024-09-19T06:38:12.118065+0000","last_unstale":"2024-09-19T06:40:08.274336+0000","last_undegraded":"2024-09-19T06:40:08.274336+0000","last_fullsized":"2024-09-19T06:40:08.274336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:25.861922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274974+0000","last_change":"2024-09-19T06:38:23.811305+0000","last_active":"2024-09-19T06:40:08.274974+0000","last_peered":"2024-09-19T06:40:08.274974+0000","last_clean":"2024-09-19T06:40:08.274974+0000","last_became_active":"2024-09-19T06:38:23.810840+0000","last_became_peered":"2024-09-19T06:38:23.810840+0000","last_unstale":"2024-09-19T06:40:08.274974+0000","last_undegraded":"2024-09-19T06:40:08.274974+0000","last_fullsized":"2024-09-19T06:40:08.274974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.019065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273364+0000","last_change":"2024-09-19T06:38:12.047670+0000","last_active":"2024-09-19T06:40:08.273364+0000","last_peered":"2024-09-19T06:40:08.273364+0000","last_clean":"2024-09-19T06:40:08.273364+0000","last_became_active":"2024-09-19T06:38:12.047312+0000","last_became_peered":"2024-09-19T06:38:12.047312+0000","last_unstale":"2024-09-19T06:40:08.273364+0000","last_undegraded":"2024-09-19T06:40:08.273364+0000","last_fullsized":"2024-09-19T06:40:08.273364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:47.477945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:14.047210+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:14.046836+0000","last_became_peered":"2024-09-19T06:38:14.046836+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:14.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075584+0000","last_change":"2024-09-19T06:38:12.032692+0000","last_active":"2024-09-19T06:40:08.075584+0000","last_peered":"2024-09-19T06:40:08.075584+0000","last_clean":"2024-09-19T06:40:08.075584+0000","last_became_active":"2024-09-19T06:38:12.031874+0000","last_became_peered":"2024-09-19T06:38:12.031874+0000","last_unstale":"2024-09-19T06:40:08.075584+0000","last_undegraded":"2024-09-19T06:40:08.075584+0000","last_fullsized":"2024-09-19T06:40:08.075584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.787964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193683+0000","last_change":"2024-09-19T06:38:14.053504+0000","last_active":"2024-09-19T06:40:08.193683+0000","last_peered":"2024-09-19T06:40:08.193683+0000","last_clean":"2024-09-19T06:40:08.193683+0000","last_became_active":"2024-09-19T06:38:14.053148+0000","last_became_peered":"2024-09-19T06:38:14.053148+0000","last_unstale":"2024-09-19T06:40:08.193683+0000","last_undegraded":"2024-09-19T06:40:08.193683+0000","last_fullsized":"2024-09-19T06:40:08.193683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:29.809295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076736+0000","last_change":"2024-09-19T06:38:12.038884+0000","last_active":"2024-09-19T06:40:08.076736+0000","last_peered":"2024-09-19T06:40:08.076736+0000","last_clean":"2024-09-19T06:40:08.076736+0000","last_became_active":"2024-09-19T06:38:12.038532+0000","last_became_peered":"2024-09-19T06:38:12.038532+0000","last_unstale":"2024-09-19T06:40:08.076736+0000","last_undegraded":"2024-09-19T06:40:08.076736+0000","last_fullsized":"2024-09-19T06:40:08.076736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.348690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075777+0000","last_change":"2024-09-19T06:38:14.045761+0000","last_active":"2024-09-19T06:40:08.075777+0000","last_peered":"2024-09-19T06:40:08.075777+0000","last_clean":"2024-09-19T06:40:08.075777+0000","last_became_active":"2024-09-19T06:38:14.045467+0000","last_became_peered":"2024-09-19T06:38:14.045467+0000","last_unstale":"2024-09-19T06:40:08.075777+0000","last_undegraded":"2024-09-19T06:40:08.075777+0000","last_fullsized":"2024-09-19T06:40:08.075777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.917945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185144+0000","last_change":"2024-09-19T06:39:23.748032+0000","last_active":"2024-09-19T06:40:08.185144+0000","last_peered":"2024-09-19T06:40:08.185144+0000","last_clean":"2024-09-19T06:40:08.185144+0000","last_became_active":"2024-09-19T06:39:23.744288+0000","last_became_peered":"2024-09-19T06:39:23.744288+0000","last_unstale":"2024-09-19T06:40:08.185144+0000","last_undegraded":"2024-09-19T06:40:08.185144+0000","last_fullsized":"2024-09-19T06:40:08.185144+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:50.668043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4],"acting":[8,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076545+0000","last_change":"2024-09-19T06:38:14.053935+0000","last_active":"2024-09-19T06:40:08.076545+0000","last_peered":"2024-09-19T06:40:08.076545+0000","last_clean":"2024-09-19T06:40:08.076545+0000","last_became_active":"2024-09-19T06:38:14.053542+0000","last_became_peered":"2024-09-19T06:38:14.053542+0000","last_unstale":"2024-09-19T06:40:08.076545+0000","last_undegraded":"2024-09-19T06:40:08.076545+0000","last_fullsized":"2024-09-19T06:40:08.076545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:25.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182280+0000","last_change":"2024-09-19T06:38:23.177133+0000","last_active":"2024-09-19T06:40:08.182280+0000","last_peered":"2024-09-19T06:40:08.182280+0000","last_clean":"2024-09-19T06:40:08.182280+0000","last_became_active":"2024-09-19T06:38:23.176810+0000","last_became_peered":"2024-09-19T06:38:23.176810+0000","last_unstale":"2024-09-19T06:40:08.182280+0000","last_undegraded":"2024-09-19T06:40:08.182280+0000","last_fullsized":"2024-09-19T06:40:08.182280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:56.307720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185240+0000","last_change":"2024-09-19T06:38:12.042699+0000","last_active":"2024-09-19T06:40:08.185240+0000","last_peered":"2024-09-19T06:40:08.185240+0000","last_clean":"2024-09-19T06:40:08.185240+0000","last_became_active":"2024-09-19T06:38:12.042148+0000","last_became_peered":"2024-09-19T06:38:12.042148+0000","last_unstale":"2024-09-19T06:40:08.185240+0000","last_undegraded":"2024-09-19T06:40:08.185240+0000","last_fullsized":"2024-09-19T06:40:08.185240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.953596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273371+0000","last_change":"2024-09-19T06:38:14.043279+0000","last_active":"2024-09-19T06:40:08.273371+0000","last_peered":"2024-09-19T06:40:08.273371+0000","last_clean":"2024-09-19T06:40:08.273371+0000","last_became_active":"2024-09-19T06:38:14.042914+0000","last_became_peered":"2024-09-19T06:38:14.042914+0000","last_unstale":"2024-09-19T06:40:08.273371+0000","last_undegraded":"2024-09-19T06:40:08.273371+0000","last_fullsized":"2024-09-19T06:40:08.273371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:22.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'13","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185441+0000","last_change":"2024-09-19T06:39:23.719397+0000","last_active":"2024-09-19T06:40:08.185441+0000","last_peered":"2024-09-19T06:40:08.185441+0000","last_clean":"2024-09-19T06:40:08.185441+0000","last_became_active":"2024-09-19T06:39:23.709128+0000","last_became_peered":"2024-09-19T06:39:23.709128+0000","last_unstale":"2024-09-19T06:40:08.185441+0000","last_undegraded":"2024-09-19T06:40:08.185441+0000","last_fullsized":"2024-09-19T06:40:08.185441+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:46.092401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274542+0000","last_change":"2024-09-19T06:38:14.041552+0000","last_active":"2024-09-19T06:40:08.274542+0000","last_peered":"2024-09-19T06:40:08.274542+0000","last_clean":"2024-09-19T06:40:08.274542+0000","last_became_active":"2024-09-19T06:38:14.041187+0000","last_became_peered":"2024-09-19T06:38:14.041187+0000","last_unstale":"2024-09-19T06:40:08.274542+0000","last_undegraded":"2024-09-19T06:40:08.274542+0000","last_fullsized":"2024-09-19T06:40:08.274542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:17.390457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076363+0000","last_change":"2024-09-19T06:38:12.047436+0000","last_active":"2024-09-19T06:40:08.076363+0000","last_peered":"2024-09-19T06:40:08.076363+0000","last_clean":"2024-09-19T06:40:08.076363+0000","last_became_active":"2024-09-19T06:38:12.046961+0000","last_became_peered":"2024-09-19T06:38:12.046961+0000","last_unstale":"2024-09-19T06:40:08.076363+0000","last_undegraded":"2024-09-19T06:40:08.076363+0000","last_fullsized":"2024-09-19T06:40:08.076363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076212+0000","last_change":"2024-09-19T06:38:14.049660+0000","last_active":"2024-09-19T06:40:08.076212+0000","last_peered":"2024-09-19T06:40:08.076212+0000","last_clean":"2024-09-19T06:40:08.076212+0000","last_became_active":"2024-09-19T06:38:14.049375+0000","last_became_peered":"2024-09-19T06:38:14.049375+0000","last_unstale":"2024-09-19T06:40:08.076212+0000","last_undegraded":"2024-09-19T06:40:08.076212+0000","last_fullsized":"2024-09-19T06:40:08.076212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:08.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'15","reported_seq":164,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:12.828992+0000","last_change":"2024-09-19T06:38:23.071068+0000","last_active":"2024-09-19T06:40:12.828992+0000","last_peered":"2024-09-19T06:40:12.828992+0000","last_clean":"2024-09-19T06:40:12.828992+0000","last_became_active":"2024-09-19T06:38:23.067129+0000","last_became_peered":"2024-09-19T06:38:23.067129+0000","last_unstale":"2024-09-19T06:40:12.828992+0000","last_undegraded":"2024-09-19T06:40:12.828992+0000","last_fullsized":"2024-09-19T06:40:12.828992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:15.387758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600254,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1233,"num_read_kb":733,"num_write":376,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2264,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2162688,"data_stored":1800762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547237,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1110016,"data_stored":598089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776169,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41264,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703888,"statfs":{"total":95995035648,"available":95952781312,"internally_reserved":0,"allocated":1802240,"data_stored":1254329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939695,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28376,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716776,"statfs":{"total":95995035648,"available":95965978624,"internally_reserved":0,"allocated":1380352,"data_stored":858526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28356,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716796,"statfs":{"total":95995035648,"available":95965999104,"internally_reserved":0,"allocated":1359872,"data_stored":858120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397560,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1059977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528382,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":970752,"data_stored":466262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1589248,"data_stored":1057957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1052672,"data_stored":532364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215181,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":989668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":466465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40528,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704624,"statfs":{"total":95995035648,"available":95953534976,"internally_reserved":0,"allocated":1044480,"data_stored":533774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":467293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":199656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":133901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:40:20.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:40:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:19 smithi016 ceph-mon[34911]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:19 smithi016 ceph-mon[34911]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-19T06:40:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:19 smithi173 ceph-mon[35349]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:19 smithi173 ceph-mon[35349]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-19T06:40:20.428 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.975+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/3717457266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d4103660 msgr2=0x7fa4d410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.975+0000 7fa4d9bfb640 1 --2- 172.21.15.12:0/3717457266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d4103660 0x7fa4d410bb50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009900 tx=0x7fa4c802a480 comp rx=0 tx=0).stop 2024-09-19T06:40:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.975+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/3717457266 shutdown_connections 2024-09-19T06:40:20.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.975+0000 7fa4d9bfb640 1 --2- 172.21.15.12:0/3717457266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d410c170 0x7fa4d410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.975+0000 7fa4d9bfb640 1 --2- 172.21.15.12:0/3717457266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d4103660 0x7fa4d410bb50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.975+0000 7fa4d9bfb640 1 --2- 172.21.15.12:0/3717457266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d4102d40 0x7fa4d4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.975+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/3717457266 >> 172.21.15.12:0/3717457266 conn(0x7fa4d40fc7a0 msgr2=0x7fa4d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.975+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/3717457266 shutdown_connections 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.975+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/3717457266 wait complete. 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d9bfb640 1 Processor -- start 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d9bfb640 1 -- start start 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d9bfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d4102d40 0x7fa4d4198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d9bfb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4103660 0x7fa4d4198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d9bfb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d410c170 0x7fa4d419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d9bfb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4112080 con 0x7fa4d4102d40 2024-09-19T06:40:20.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d9bfb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4111f00 con 0x7fa4d410c170 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d9bfb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4112200 con 0x7fa4d4103660 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d4102d40 0x7fa4d4198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d4102d40 0x7fa4d4198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44734/0 (socket says 172.21.15.12:44734) 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d37fe640 1 -- 172.21.15.12:0/1955367179 learned_addr learned my addr 172.21.15.12:0/1955367179 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d3fff640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d410c170 0x7fa4d419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d2ffd640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4103660 0x7fa4d4198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d37fe640 1 -- 172.21.15.12:0/1955367179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4103660 msgr2=0x7fa4d4198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d37fe640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4103660 0x7fa4d4198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d37fe640 1 -- 172.21.15.12:0/1955367179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d410c170 msgr2=0x7fa4d419ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d37fe640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d410c170 0x7fa4d419ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.976+0000 7fa4d37fe640 1 -- 172.21.15.12:0/1955367179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d419d530 con 0x7fa4d4102d40 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.977+0000 7fa4d37fe640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d4102d40 0x7fa4d4198580 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400b4a0 tx=0x7fa4c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:20.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.977+0000 7fa4d0ff9640 1 -- 172.21.15.12:0/1955367179 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4014070 con 0x7fa4d4102d40 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.977+0000 7fa4d0ff9640 1 -- 172.21.15.12:0/1955367179 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c4010af0 con 0x7fa4d4102d40 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.977+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/1955367179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d419d820 con 0x7fa4d4102d40 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.977+0000 7fa4d0ff9640 1 -- 172.21.15.12:0/1955367179 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4017d10 con 0x7fa4d4102d40 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.977+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/1955367179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d41a5100 con 0x7fa4d4102d40 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.978+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/1955367179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d41031a0 con 0x7fa4d4102d40 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.979+0000 7fa4d0ff9640 1 -- 172.21.15.12:0/1955367179 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fa4c4017070 con 0x7fa4d4102d40 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.980+0000 7fa4d0ff9640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4bc0a3440 0x7fa4bc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.980+0000 7fa4d2ffd640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4bc0a3440 0x7fa4bc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.980+0000 7fa4d0ff9640 1 -- 172.21.15.12:0/1955367179 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa4c40cf5f0 con 0x7fa4d4102d40 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.981+0000 7fa4d2ffd640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4bc0a3440 0x7fa4bc0a5900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8000c00 tx=0x7fa4c8005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:20.983+0000 7fa4d0ff9640 1 -- 172.21.15.12:0/1955367179 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa4c409be90 con 0x7fa4d4102d40 2024-09-19T06:40:21.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:20 smithi012 ceph-mon[30937]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:21.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.158+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/1955367179 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4d4062630 con 0x7fa4bc0a3440 2024-09-19T06:40:21.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.164+0000 7fa4d0ff9640 1 -- 172.21.15.12:0/1955367179 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257822 (secure 0 0 0) 0x7fa4d4062630 con 0x7fa4bc0a3440 2024-09-19T06:40:21.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:21.187 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-19T06:40:21.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/1955367179 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4bc0a3440 msgr2=0x7fa4bc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:21.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4bc0a3440 0x7fa4bc0a5900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8000c00 tx=0x7fa4c8005a20 comp rx=0 tx=0).stop 2024-09-19T06:40:21.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/1955367179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d4102d40 msgr2=0x7fa4d4198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:21.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d4102d40 0x7fa4d4198580 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400b4a0 tx=0x7fa4c400b960 comp rx=0 tx=0).stop 2024-09-19T06:40:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/1955367179 shutdown_connections 2024-09-19T06:40:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d410c170 0x7fa4d419ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4bc0a3440 0x7fa4bc0a5900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4d4103660 0x7fa4d4198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 --2- 172.21.15.12:0/1955367179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d4102d40 0x7fa4d4198580 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/1955367179 >> 172.21.15.12:0/1955367179 conn(0x7fa4d40fc7a0 msgr2=0x7fa4d40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/1955367179 shutdown_connections 2024-09-19T06:40:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:21.168+0000 7fa4d9bfb640 1 -- 172.21.15.12:0/1955367179 wait complete. 2024-09-19T06:40:21.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:20 smithi016 ceph-mon[34911]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:21.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:20 smithi173 ceph-mon[35349]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:21.905 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-19T06:40:20.092055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1388626,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1776,"num_read_kb":1322,"num_write":706,"num_write_kb":5322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183000,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1033,"ondisk_log_size":1033,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386020,"kb_used_data":15600,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124555804,"statfs":{"total":1151940427776,"available":1151545143296,"internally_reserved":0,"allocated":15974400,"data_stored":9736134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":197770,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":457,"num_read_kb":495,"num_write":147,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.929986"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193955+0000","last_change":"2024-09-19T06:38:14.052943+0000","last_active":"2024-09-19T06:40:08.193955+0000","last_peered":"2024-09-19T06:40:08.193955+0000","last_clean":"2024-09-19T06:40:08.193955+0000","last_became_active":"2024-09-19T06:38:14.052054+0000","last_became_peered":"2024-09-19T06:38:14.052054+0000","last_unstale":"2024-09-19T06:40:08.193955+0000","last_undegraded":"2024-09-19T06:40:08.193955+0000","last_fullsized":"2024-09-19T06:40:08.193955+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:28.898131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274890+0000","last_change":"2024-09-19T06:38:14.044916+0000","last_active":"2024-09-19T06:40:08.274890+0000","last_peered":"2024-09-19T06:40:08.274890+0000","last_clean":"2024-09-19T06:40:08.274890+0000","last_became_active":"2024-09-19T06:38:14.044596+0000","last_became_peered":"2024-09-19T06:38:14.044596+0000","last_unstale":"2024-09-19T06:40:08.274890+0000","last_undegraded":"2024-09-19T06:40:08.274890+0000","last_fullsized":"2024-09-19T06:40:08.274890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:04.402332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274248+0000","last_change":"2024-09-19T06:38:14.052765+0000","last_active":"2024-09-19T06:40:08.274248+0000","last_peered":"2024-09-19T06:40:08.274248+0000","last_clean":"2024-09-19T06:40:08.274248+0000","last_became_active":"2024-09-19T06:38:14.052219+0000","last_became_peered":"2024-09-19T06:38:14.052219+0000","last_unstale":"2024-09-19T06:40:08.274248+0000","last_undegraded":"2024-09-19T06:40:08.274248+0000","last_fullsized":"2024-09-19T06:40:08.274248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:13.317252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274226+0000","last_change":"2024-09-19T06:38:14.052421+0000","last_active":"2024-09-19T06:40:08.274226+0000","last_peered":"2024-09-19T06:40:08.274226+0000","last_clean":"2024-09-19T06:40:08.274226+0000","last_became_active":"2024-09-19T06:38:14.052094+0000","last_became_peered":"2024-09-19T06:38:14.052094+0000","last_unstale":"2024-09-19T06:40:08.274226+0000","last_undegraded":"2024-09-19T06:40:08.274226+0000","last_fullsized":"2024-09-19T06:40:08.274226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185134+0000","last_change":"2024-09-19T06:38:14.047736+0000","last_active":"2024-09-19T06:40:08.185134+0000","last_peered":"2024-09-19T06:40:08.185134+0000","last_clean":"2024-09-19T06:40:08.185134+0000","last_became_active":"2024-09-19T06:38:14.047396+0000","last_became_peered":"2024-09-19T06:38:14.047396+0000","last_unstale":"2024-09-19T06:40:08.185134+0000","last_undegraded":"2024-09-19T06:40:08.185134+0000","last_fullsized":"2024-09-19T06:40:08.185134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.855638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196543+0000","last_change":"2024-09-19T06:38:14.047793+0000","last_active":"2024-09-19T06:40:08.196543+0000","last_peered":"2024-09-19T06:40:08.196543+0000","last_clean":"2024-09-19T06:40:08.196543+0000","last_became_active":"2024-09-19T06:38:14.047198+0000","last_became_peered":"2024-09-19T06:38:14.047198+0000","last_unstale":"2024-09-19T06:40:08.196543+0000","last_undegraded":"2024-09-19T06:40:08.196543+0000","last_fullsized":"2024-09-19T06:40:08.196543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:42.507270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076273+0000","last_change":"2024-09-19T06:38:14.050025+0000","last_active":"2024-09-19T06:40:08.076273+0000","last_peered":"2024-09-19T06:40:08.076273+0000","last_clean":"2024-09-19T06:40:08.076273+0000","last_became_active":"2024-09-19T06:38:14.049591+0000","last_became_peered":"2024-09-19T06:38:14.049591+0000","last_unstale":"2024-09-19T06:40:08.076273+0000","last_undegraded":"2024-09-19T06:40:08.076273+0000","last_fullsized":"2024-09-19T06:40:08.076273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:49.487521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181942+0000","last_change":"2024-09-19T06:38:23.065490+0000","last_active":"2024-09-19T06:40:08.181942+0000","last_peered":"2024-09-19T06:40:08.181942+0000","last_clean":"2024-09-19T06:40:08.181942+0000","last_became_active":"2024-09-19T06:38:23.065151+0000","last_became_peered":"2024-09-19T06:38:23.065151+0000","last_unstale":"2024-09-19T06:40:08.181942+0000","last_undegraded":"2024-09-19T06:40:08.181942+0000","last_fullsized":"2024-09-19T06:40:08.181942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:42.184698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273928+0000","last_change":"2024-09-19T06:38:14.047395+0000","last_active":"2024-09-19T06:40:08.273928+0000","last_peered":"2024-09-19T06:40:08.273928+0000","last_clean":"2024-09-19T06:40:08.273928+0000","last_became_active":"2024-09-19T06:38:14.046975+0000","last_became_peered":"2024-09-19T06:38:14.046975+0000","last_unstale":"2024-09-19T06:40:08.273928+0000","last_undegraded":"2024-09-19T06:40:08.273928+0000","last_fullsized":"2024-09-19T06:40:08.273928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:18.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196936+0000","last_change":"2024-09-19T06:38:14.055042+0000","last_active":"2024-09-19T06:40:08.196936+0000","last_peered":"2024-09-19T06:40:08.196936+0000","last_clean":"2024-09-19T06:40:08.196936+0000","last_became_active":"2024-09-19T06:38:14.054664+0000","last_became_peered":"2024-09-19T06:38:14.054664+0000","last_unstale":"2024-09-19T06:40:08.196936+0000","last_undegraded":"2024-09-19T06:40:08.196936+0000","last_fullsized":"2024-09-19T06:40:08.196936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.815277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076591+0000","last_change":"2024-09-19T06:38:14.055106+0000","last_active":"2024-09-19T06:40:08.076591+0000","last_peered":"2024-09-19T06:40:08.076591+0000","last_clean":"2024-09-19T06:40:08.076591+0000","last_became_active":"2024-09-19T06:38:14.054721+0000","last_became_peered":"2024-09-19T06:38:14.054721+0000","last_unstale":"2024-09-19T06:40:08.076591+0000","last_undegraded":"2024-09-19T06:40:08.076591+0000","last_fullsized":"2024-09-19T06:40:08.076591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:39.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274235+0000","last_change":"2024-09-19T06:38:14.051796+0000","last_active":"2024-09-19T06:40:08.274235+0000","last_peered":"2024-09-19T06:40:08.274235+0000","last_clean":"2024-09-19T06:40:08.274235+0000","last_became_active":"2024-09-19T06:38:14.048338+0000","last_became_peered":"2024-09-19T06:38:14.048338+0000","last_unstale":"2024-09-19T06:40:08.274235+0000","last_undegraded":"2024-09-19T06:40:08.274235+0000","last_fullsized":"2024-09-19T06:40:08.274235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:48.656819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276087+0000","last_change":"2024-09-19T06:38:14.048607+0000","last_active":"2024-09-19T06:40:08.276087+0000","last_peered":"2024-09-19T06:40:08.276087+0000","last_clean":"2024-09-19T06:40:08.276087+0000","last_became_active":"2024-09-19T06:38:14.047277+0000","last_became_peered":"2024-09-19T06:38:14.047277+0000","last_unstale":"2024-09-19T06:40:08.276087+0000","last_undegraded":"2024-09-19T06:40:08.276087+0000","last_fullsized":"2024-09-19T06:40:08.276087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:52.904376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273963+0000","last_change":"2024-09-19T06:38:14.050759+0000","last_active":"2024-09-19T06:40:08.273963+0000","last_peered":"2024-09-19T06:40:08.273963+0000","last_clean":"2024-09-19T06:40:08.273963+0000","last_became_active":"2024-09-19T06:38:14.049900+0000","last_became_peered":"2024-09-19T06:38:14.049900+0000","last_unstale":"2024-09-19T06:40:08.273963+0000","last_undegraded":"2024-09-19T06:40:08.273963+0000","last_fullsized":"2024-09-19T06:40:08.273963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:45.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273772+0000","last_change":"2024-09-19T06:38:14.058890+0000","last_active":"2024-09-19T06:40:08.273772+0000","last_peered":"2024-09-19T06:40:08.273772+0000","last_clean":"2024-09-19T06:40:08.273772+0000","last_became_active":"2024-09-19T06:38:14.058442+0000","last_became_peered":"2024-09-19T06:38:14.058442+0000","last_unstale":"2024-09-19T06:40:08.273772+0000","last_undegraded":"2024-09-19T06:40:08.273772+0000","last_fullsized":"2024-09-19T06:40:08.273772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:27.296578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273218+0000","last_change":"2024-09-19T06:38:14.050371+0000","last_active":"2024-09-19T06:40:08.273218+0000","last_peered":"2024-09-19T06:40:08.273218+0000","last_clean":"2024-09-19T06:40:08.273218+0000","last_became_active":"2024-09-19T06:38:14.049930+0000","last_became_peered":"2024-09-19T06:38:14.049930+0000","last_unstale":"2024-09-19T06:40:08.273218+0000","last_undegraded":"2024-09-19T06:40:08.273218+0000","last_fullsized":"2024-09-19T06:40:08.273218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:37.898624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193944+0000","last_change":"2024-09-19T06:38:14.052521+0000","last_active":"2024-09-19T06:40:08.193944+0000","last_peered":"2024-09-19T06:40:08.193944+0000","last_clean":"2024-09-19T06:40:08.193944+0000","last_became_active":"2024-09-19T06:38:14.052083+0000","last_became_peered":"2024-09-19T06:38:14.052083+0000","last_unstale":"2024-09-19T06:40:08.193944+0000","last_undegraded":"2024-09-19T06:40:08.193944+0000","last_fullsized":"2024-09-19T06:40:08.193944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:10.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182686+0000","last_change":"2024-09-19T06:38:14.044747+0000","last_active":"2024-09-19T06:40:08.182686+0000","last_peered":"2024-09-19T06:40:08.182686+0000","last_clean":"2024-09-19T06:40:08.182686+0000","last_became_active":"2024-09-19T06:38:14.044451+0000","last_became_peered":"2024-09-19T06:38:14.044451+0000","last_unstale":"2024-09-19T06:40:08.182686+0000","last_undegraded":"2024-09-19T06:40:08.182686+0000","last_fullsized":"2024-09-19T06:40:08.182686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:04.067156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076928+0000","last_change":"2024-09-19T06:38:14.056101+0000","last_active":"2024-09-19T06:40:08.076928+0000","last_peered":"2024-09-19T06:40:08.076928+0000","last_clean":"2024-09-19T06:40:08.076928+0000","last_became_active":"2024-09-19T06:38:14.055682+0000","last_became_peered":"2024-09-19T06:38:14.055682+0000","last_unstale":"2024-09-19T06:40:08.076928+0000","last_undegraded":"2024-09-19T06:40:08.076928+0000","last_fullsized":"2024-09-19T06:40:08.076928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:23.921766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193625+0000","last_change":"2024-09-19T06:38:14.059441+0000","last_active":"2024-09-19T06:40:08.193625+0000","last_peered":"2024-09-19T06:40:08.193625+0000","last_clean":"2024-09-19T06:40:08.193625+0000","last_became_active":"2024-09-19T06:38:14.059123+0000","last_became_peered":"2024-09-19T06:38:14.059123+0000","last_unstale":"2024-09-19T06:40:08.193625+0000","last_undegraded":"2024-09-19T06:40:08.193625+0000","last_fullsized":"2024-09-19T06:40:08.193625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:32.148741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276233+0000","last_change":"2024-09-19T06:38:14.050336+0000","last_active":"2024-09-19T06:40:08.276233+0000","last_peered":"2024-09-19T06:40:08.276233+0000","last_clean":"2024-09-19T06:40:08.276233+0000","last_became_active":"2024-09-19T06:38:14.050041+0000","last_became_peered":"2024-09-19T06:38:14.050041+0000","last_unstale":"2024-09-19T06:40:08.276233+0000","last_undegraded":"2024-09-19T06:40:08.276233+0000","last_fullsized":"2024-09-19T06:40:08.276233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:09.245804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273366+0000","last_change":"2024-09-19T06:38:14.050280+0000","last_active":"2024-09-19T06:40:08.273366+0000","last_peered":"2024-09-19T06:40:08.273366+0000","last_clean":"2024-09-19T06:40:08.273366+0000","last_became_active":"2024-09-19T06:38:14.049874+0000","last_became_peered":"2024-09-19T06:38:14.049874+0000","last_unstale":"2024-09-19T06:40:08.273366+0000","last_undegraded":"2024-09-19T06:40:08.273366+0000","last_fullsized":"2024-09-19T06:40:08.273366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:52.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075355+0000","last_change":"2024-09-19T06:38:14.048294+0000","last_active":"2024-09-19T06:40:08.075355+0000","last_peered":"2024-09-19T06:40:08.075355+0000","last_clean":"2024-09-19T06:40:08.075355+0000","last_became_active":"2024-09-19T06:38:14.048002+0000","last_became_peered":"2024-09-19T06:38:14.048002+0000","last_unstale":"2024-09-19T06:40:08.075355+0000","last_undegraded":"2024-09-19T06:40:08.075355+0000","last_fullsized":"2024-09-19T06:40:08.075355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:55.920027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257610+0000","last_change":"2024-09-19T06:38:14.050244+0000","last_active":"2024-09-19T06:40:08.257610+0000","last_peered":"2024-09-19T06:40:08.257610+0000","last_clean":"2024-09-19T06:40:08.257610+0000","last_became_active":"2024-09-19T06:38:14.049499+0000","last_became_peered":"2024-09-19T06:38:14.049499+0000","last_unstale":"2024-09-19T06:40:08.257610+0000","last_undegraded":"2024-09-19T06:40:08.257610+0000","last_fullsized":"2024-09-19T06:40:08.257610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:35.506647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076492+0000","last_change":"2024-09-19T06:38:14.048779+0000","last_active":"2024-09-19T06:40:08.076492+0000","last_peered":"2024-09-19T06:40:08.076492+0000","last_clean":"2024-09-19T06:40:08.076492+0000","last_became_active":"2024-09-19T06:38:14.048492+0000","last_became_peered":"2024-09-19T06:38:14.048492+0000","last_unstale":"2024-09-19T06:40:08.076492+0000","last_undegraded":"2024-09-19T06:40:08.076492+0000","last_fullsized":"2024-09-19T06:40:08.076492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:01.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076981+0000","last_change":"2024-09-19T06:38:14.054442+0000","last_active":"2024-09-19T06:40:08.076981+0000","last_peered":"2024-09-19T06:40:08.076981+0000","last_clean":"2024-09-19T06:40:08.076981+0000","last_became_active":"2024-09-19T06:38:14.053903+0000","last_became_peered":"2024-09-19T06:38:14.053903+0000","last_unstale":"2024-09-19T06:40:08.076981+0000","last_undegraded":"2024-09-19T06:40:08.076981+0000","last_fullsized":"2024-09-19T06:40:08.076981+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:42.002146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193936+0000","last_change":"2024-09-19T06:38:14.051139+0000","last_active":"2024-09-19T06:40:08.193936+0000","last_peered":"2024-09-19T06:40:08.193936+0000","last_clean":"2024-09-19T06:40:08.193936+0000","last_became_active":"2024-09-19T06:38:14.050764+0000","last_became_peered":"2024-09-19T06:38:14.050764+0000","last_unstale":"2024-09-19T06:40:08.193936+0000","last_undegraded":"2024-09-19T06:40:08.193936+0000","last_fullsized":"2024-09-19T06:40:08.193936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.379184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275728+0000","last_change":"2024-09-19T06:38:14.054614+0000","last_active":"2024-09-19T06:40:08.275728+0000","last_peered":"2024-09-19T06:40:08.275728+0000","last_clean":"2024-09-19T06:40:08.275728+0000","last_became_active":"2024-09-19T06:38:14.054280+0000","last_became_peered":"2024-09-19T06:38:14.054280+0000","last_unstale":"2024-09-19T06:40:08.275728+0000","last_undegraded":"2024-09-19T06:40:08.275728+0000","last_fullsized":"2024-09-19T06:40:08.275728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:21.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274136+0000","last_change":"2024-09-19T06:38:14.056215+0000","last_active":"2024-09-19T06:40:08.274136+0000","last_peered":"2024-09-19T06:40:08.274136+0000","last_clean":"2024-09-19T06:40:08.274136+0000","last_became_active":"2024-09-19T06:38:14.055875+0000","last_became_peered":"2024-09-19T06:38:14.055875+0000","last_unstale":"2024-09-19T06:40:08.274136+0000","last_undegraded":"2024-09-19T06:40:08.274136+0000","last_fullsized":"2024-09-19T06:40:08.274136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:45.347185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076586+0000","last_change":"2024-09-19T06:38:14.057963+0000","last_active":"2024-09-19T06:40:08.076586+0000","last_peered":"2024-09-19T06:40:08.076586+0000","last_clean":"2024-09-19T06:40:08.076586+0000","last_became_active":"2024-09-19T06:38:14.057578+0000","last_became_peered":"2024-09-19T06:38:14.057578+0000","last_unstale":"2024-09-19T06:40:08.076586+0000","last_undegraded":"2024-09-19T06:40:08.076586+0000","last_fullsized":"2024-09-19T06:40:08.076586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:26.173414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076589+0000","last_change":"2024-09-19T06:38:14.058840+0000","last_active":"2024-09-19T06:40:08.076589+0000","last_peered":"2024-09-19T06:40:08.076589+0000","last_clean":"2024-09-19T06:40:08.076589+0000","last_became_active":"2024-09-19T06:38:14.058418+0000","last_became_peered":"2024-09-19T06:38:14.058418+0000","last_unstale":"2024-09-19T06:40:08.076589+0000","last_undegraded":"2024-09-19T06:40:08.076589+0000","last_fullsized":"2024-09-19T06:40:08.076589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:13.624750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193666+0000","last_change":"2024-09-19T06:38:14.053363+0000","last_active":"2024-09-19T06:40:08.193666+0000","last_peered":"2024-09-19T06:40:08.193666+0000","last_clean":"2024-09-19T06:40:08.193666+0000","last_became_active":"2024-09-19T06:38:14.053039+0000","last_became_peered":"2024-09-19T06:38:14.053039+0000","last_unstale":"2024-09-19T06:40:08.193666+0000","last_undegraded":"2024-09-19T06:40:08.193666+0000","last_fullsized":"2024-09-19T06:40:08.193666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.274885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185012+0000","last_change":"2024-09-19T06:38:14.045719+0000","last_active":"2024-09-19T06:40:08.185012+0000","last_peered":"2024-09-19T06:40:08.185012+0000","last_clean":"2024-09-19T06:40:08.185012+0000","last_became_active":"2024-09-19T06:38:14.045285+0000","last_became_peered":"2024-09-19T06:38:14.045285+0000","last_unstale":"2024-09-19T06:40:08.185012+0000","last_undegraded":"2024-09-19T06:40:08.185012+0000","last_fullsized":"2024-09-19T06:40:08.185012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:16.877802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.815736+0000","last_change":"2024-09-19T06:38:23.177942+0000","last_active":"2024-09-19T06:40:17.815736+0000","last_peered":"2024-09-19T06:40:17.815736+0000","last_clean":"2024-09-19T06:40:17.815736+0000","last_became_active":"2024-09-19T06:38:23.176579+0000","last_became_peered":"2024-09-19T06:38:23.176579+0000","last_unstale":"2024-09-19T06:40:17.815736+0000","last_undegraded":"2024-09-19T06:40:17.815736+0000","last_fullsized":"2024-09-19T06:40:17.815736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:28.140245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257665+0000","last_change":"2024-09-19T06:38:23.811603+0000","last_active":"2024-09-19T06:40:08.257665+0000","last_peered":"2024-09-19T06:40:08.257665+0000","last_clean":"2024-09-19T06:40:08.257665+0000","last_became_active":"2024-09-19T06:38:23.811139+0000","last_became_peered":"2024-09-19T06:38:23.811139+0000","last_unstale":"2024-09-19T06:40:08.257665+0000","last_undegraded":"2024-09-19T06:40:08.257665+0000","last_fullsized":"2024-09-19T06:40:08.257665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:42.082355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196626+0000","last_change":"2024-09-19T06:38:12.041330+0000","last_active":"2024-09-19T06:40:08.196626+0000","last_peered":"2024-09-19T06:40:08.196626+0000","last_clean":"2024-09-19T06:40:08.196626+0000","last_became_active":"2024-09-19T06:38:12.040992+0000","last_became_peered":"2024-09-19T06:38:12.040992+0000","last_unstale":"2024-09-19T06:40:08.196626+0000","last_undegraded":"2024-09-19T06:40:08.196626+0000","last_fullsized":"2024-09-19T06:40:08.196626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:51.721009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275224+0000","last_change":"2024-09-19T06:38:12.034534+0000","last_active":"2024-09-19T06:40:08.275224+0000","last_peered":"2024-09-19T06:40:08.275224+0000","last_clean":"2024-09-19T06:40:08.275224+0000","last_became_active":"2024-09-19T06:38:12.034209+0000","last_became_peered":"2024-09-19T06:38:12.034209+0000","last_unstale":"2024-09-19T06:40:08.275224+0000","last_undegraded":"2024-09-19T06:40:08.275224+0000","last_fullsized":"2024-09-19T06:40:08.275224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:40.640464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075337+0000","last_change":"2024-09-19T06:38:14.043287+0000","last_active":"2024-09-19T06:40:08.075337+0000","last_peered":"2024-09-19T06:40:08.075337+0000","last_clean":"2024-09-19T06:40:08.075337+0000","last_became_active":"2024-09-19T06:38:14.042565+0000","last_became_peered":"2024-09-19T06:38:14.042565+0000","last_unstale":"2024-09-19T06:40:08.075337+0000","last_undegraded":"2024-09-19T06:40:08.075337+0000","last_fullsized":"2024-09-19T06:40:08.075337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:32.689929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257848+0000","last_change":"2024-09-19T06:38:12.039142+0000","last_active":"2024-09-19T06:40:08.257848+0000","last_peered":"2024-09-19T06:40:08.257848+0000","last_clean":"2024-09-19T06:40:08.257848+0000","last_became_active":"2024-09-19T06:38:12.038815+0000","last_became_peered":"2024-09-19T06:38:12.038815+0000","last_unstale":"2024-09-19T06:40:08.257848+0000","last_undegraded":"2024-09-19T06:40:08.257848+0000","last_fullsized":"2024-09-19T06:40:08.257848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:03.316742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182141+0000","last_change":"2024-09-19T06:38:14.044778+0000","last_active":"2024-09-19T06:40:08.182141+0000","last_peered":"2024-09-19T06:40:08.182141+0000","last_clean":"2024-09-19T06:40:08.182141+0000","last_became_active":"2024-09-19T06:38:14.044457+0000","last_became_peered":"2024-09-19T06:38:14.044457+0000","last_unstale":"2024-09-19T06:40:08.182141+0000","last_undegraded":"2024-09-19T06:40:08.182141+0000","last_fullsized":"2024-09-19T06:40:08.182141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:06.342070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":263,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:18.816485+0000","last_change":"2024-09-19T06:38:12.039031+0000","last_active":"2024-09-19T06:40:18.816485+0000","last_peered":"2024-09-19T06:40:18.816485+0000","last_clean":"2024-09-19T06:40:18.816485+0000","last_became_active":"2024-09-19T06:38:12.038346+0000","last_became_peered":"2024-09-19T06:38:12.038346+0000","last_unstale":"2024-09-19T06:40:18.816485+0000","last_undegraded":"2024-09-19T06:40:18.816485+0000","last_fullsized":"2024-09-19T06:40:18.816485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:33.752330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273694+0000","last_change":"2024-09-19T06:38:14.045159+0000","last_active":"2024-09-19T06:40:08.273694+0000","last_peered":"2024-09-19T06:40:08.273694+0000","last_clean":"2024-09-19T06:40:08.273694+0000","last_became_active":"2024-09-19T06:38:14.044822+0000","last_became_peered":"2024-09-19T06:38:14.044822+0000","last_unstale":"2024-09-19T06:40:08.273694+0000","last_undegraded":"2024-09-19T06:40:08.273694+0000","last_fullsized":"2024-09-19T06:40:08.273694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:05.143507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076765+0000","last_change":"2024-09-19T06:38:12.037820+0000","last_active":"2024-09-19T06:40:08.076765+0000","last_peered":"2024-09-19T06:40:08.076765+0000","last_clean":"2024-09-19T06:40:08.076765+0000","last_became_active":"2024-09-19T06:38:12.037417+0000","last_became_peered":"2024-09-19T06:38:12.037417+0000","last_unstale":"2024-09-19T06:40:08.076765+0000","last_undegraded":"2024-09-19T06:40:08.076765+0000","last_fullsized":"2024-09-19T06:40:08.076765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:22.516704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274674+0000","last_change":"2024-09-19T06:38:14.048633+0000","last_active":"2024-09-19T06:40:08.274674+0000","last_peered":"2024-09-19T06:40:08.274674+0000","last_clean":"2024-09-19T06:40:08.274674+0000","last_became_active":"2024-09-19T06:38:14.048257+0000","last_became_peered":"2024-09-19T06:38:14.048257+0000","last_unstale":"2024-09-19T06:40:08.274674+0000","last_undegraded":"2024-09-19T06:40:08.274674+0000","last_fullsized":"2024-09-19T06:40:08.274674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:16.509071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257784+0000","last_change":"2024-09-19T06:38:12.047175+0000","last_active":"2024-09-19T06:40:08.257784+0000","last_peered":"2024-09-19T06:40:08.257784+0000","last_clean":"2024-09-19T06:40:08.257784+0000","last_became_active":"2024-09-19T06:38:12.046781+0000","last_became_peered":"2024-09-19T06:38:12.046781+0000","last_unstale":"2024-09-19T06:40:08.257784+0000","last_undegraded":"2024-09-19T06:40:08.257784+0000","last_fullsized":"2024-09-19T06:40:08.257784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:38.774803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273461+0000","last_change":"2024-09-19T06:38:23.067812+0000","last_active":"2024-09-19T06:40:08.273461+0000","last_peered":"2024-09-19T06:40:08.273461+0000","last_clean":"2024-09-19T06:40:08.273461+0000","last_became_active":"2024-09-19T06:38:23.067357+0000","last_became_peered":"2024-09-19T06:38:23.067357+0000","last_unstale":"2024-09-19T06:40:08.273461+0000","last_undegraded":"2024-09-19T06:40:08.273461+0000","last_fullsized":"2024-09-19T06:40:08.273461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:34.719243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'36","reported_seq":322,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:18.816508+0000","last_change":"2024-09-19T06:38:23.186703+0000","last_active":"2024-09-19T06:40:18.816508+0000","last_peered":"2024-09-19T06:40:18.816508+0000","last_clean":"2024-09-19T06:40:18.816508+0000","last_became_active":"2024-09-19T06:38:23.177212+0000","last_became_peered":"2024-09-19T06:38:23.177212+0000","last_unstale":"2024-09-19T06:40:18.816508+0000","last_undegraded":"2024-09-19T06:40:18.816508+0000","last_fullsized":"2024-09-19T06:40:18.816508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:46.884624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67065,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":187,"num_write":38,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185343+0000","last_change":"2024-09-19T06:38:14.054619+0000","last_active":"2024-09-19T06:40:08.185343+0000","last_peered":"2024-09-19T06:40:08.185343+0000","last_clean":"2024-09-19T06:40:08.185343+0000","last_became_active":"2024-09-19T06:38:14.054118+0000","last_became_peered":"2024-09-19T06:38:14.054118+0000","last_unstale":"2024-09-19T06:40:08.185343+0000","last_undegraded":"2024-09-19T06:40:08.185343+0000","last_fullsized":"2024-09-19T06:40:08.185343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:41.041603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076764+0000","last_change":"2024-09-19T06:38:12.040272+0000","last_active":"2024-09-19T06:40:08.076764+0000","last_peered":"2024-09-19T06:40:08.076764+0000","last_clean":"2024-09-19T06:40:08.076764+0000","last_became_active":"2024-09-19T06:38:12.039940+0000","last_became_peered":"2024-09-19T06:38:12.039940+0000","last_unstale":"2024-09-19T06:40:08.076764+0000","last_undegraded":"2024-09-19T06:40:08.076764+0000","last_fullsized":"2024-09-19T06:40:08.076764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:53.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275371+0000","last_change":"2024-09-19T06:38:14.049535+0000","last_active":"2024-09-19T06:40:08.275371+0000","last_peered":"2024-09-19T06:40:08.275371+0000","last_clean":"2024-09-19T06:40:08.275371+0000","last_became_active":"2024-09-19T06:38:14.049208+0000","last_became_peered":"2024-09-19T06:38:14.049208+0000","last_unstale":"2024-09-19T06:40:08.275371+0000","last_undegraded":"2024-09-19T06:40:08.275371+0000","last_fullsized":"2024-09-19T06:40:08.275371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:03.359786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257731+0000","last_change":"2024-09-19T06:38:12.037346+0000","last_active":"2024-09-19T06:40:08.257731+0000","last_peered":"2024-09-19T06:40:08.257731+0000","last_clean":"2024-09-19T06:40:08.257731+0000","last_became_active":"2024-09-19T06:38:12.036986+0000","last_became_peered":"2024-09-19T06:38:12.036986+0000","last_unstale":"2024-09-19T06:40:08.257731+0000","last_undegraded":"2024-09-19T06:40:08.257731+0000","last_fullsized":"2024-09-19T06:40:08.257731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:26.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076694+0000","last_change":"2024-09-19T06:38:14.059454+0000","last_active":"2024-09-19T06:40:08.076694+0000","last_peered":"2024-09-19T06:40:08.076694+0000","last_clean":"2024-09-19T06:40:08.076694+0000","last_became_active":"2024-09-19T06:38:14.058996+0000","last_became_peered":"2024-09-19T06:38:14.058996+0000","last_unstale":"2024-09-19T06:40:08.076694+0000","last_undegraded":"2024-09-19T06:40:08.076694+0000","last_fullsized":"2024-09-19T06:40:08.076694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:54.645395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":152,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.814912+0000","last_change":"2024-09-19T06:38:12.043687+0000","last_active":"2024-09-19T06:40:17.814912+0000","last_peered":"2024-09-19T06:40:17.814912+0000","last_clean":"2024-09-19T06:40:17.814912+0000","last_became_active":"2024-09-19T06:38:12.043268+0000","last_became_peered":"2024-09-19T06:38:12.043268+0000","last_unstale":"2024-09-19T06:40:17.814912+0000","last_undegraded":"2024-09-19T06:40:17.814912+0000","last_fullsized":"2024-09-19T06:40:17.814912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:18.753736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076233+0000","last_change":"2024-09-19T06:38:14.052184+0000","last_active":"2024-09-19T06:40:08.076233+0000","last_peered":"2024-09-19T06:40:08.076233+0000","last_clean":"2024-09-19T06:40:08.076233+0000","last_became_active":"2024-09-19T06:38:14.051736+0000","last_became_peered":"2024-09-19T06:38:14.051736+0000","last_unstale":"2024-09-19T06:40:08.076233+0000","last_undegraded":"2024-09-19T06:40:08.076233+0000","last_fullsized":"2024-09-19T06:40:08.076233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:12.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:12.048418+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:12.047948+0000","last_became_peered":"2024-09-19T06:38:12.047948+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:06.059904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181946+0000","last_change":"2024-09-19T06:38:23.175961+0000","last_active":"2024-09-19T06:40:08.181946+0000","last_peered":"2024-09-19T06:40:08.181946+0000","last_clean":"2024-09-19T06:40:08.181946+0000","last_became_active":"2024-09-19T06:38:23.175629+0000","last_became_peered":"2024-09-19T06:38:23.175629+0000","last_unstale":"2024-09-19T06:40:08.181946+0000","last_undegraded":"2024-09-19T06:40:08.181946+0000","last_fullsized":"2024-09-19T06:40:08.181946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185296+0000","last_change":"2024-09-19T06:38:12.038945+0000","last_active":"2024-09-19T06:40:08.185296+0000","last_peered":"2024-09-19T06:40:08.185296+0000","last_clean":"2024-09-19T06:40:08.185296+0000","last_became_active":"2024-09-19T06:38:12.038571+0000","last_became_peered":"2024-09-19T06:38:12.038571+0000","last_unstale":"2024-09-19T06:40:08.185296+0000","last_undegraded":"2024-09-19T06:40:08.185296+0000","last_fullsized":"2024-09-19T06:40:08.185296+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:57.887070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193798+0000","last_change":"2024-09-19T06:38:14.056481+0000","last_active":"2024-09-19T06:40:08.193798+0000","last_peered":"2024-09-19T06:40:08.193798+0000","last_clean":"2024-09-19T06:40:08.193798+0000","last_became_active":"2024-09-19T06:38:14.056177+0000","last_became_peered":"2024-09-19T06:38:14.056177+0000","last_unstale":"2024-09-19T06:40:08.193798+0000","last_undegraded":"2024-09-19T06:40:08.193798+0000","last_fullsized":"2024-09-19T06:40:08.193798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.734802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276561+0000","last_change":"2024-09-19T06:38:12.038826+0000","last_active":"2024-09-19T06:40:08.276561+0000","last_peered":"2024-09-19T06:40:08.276561+0000","last_clean":"2024-09-19T06:40:08.276561+0000","last_became_active":"2024-09-19T06:38:12.038516+0000","last_became_peered":"2024-09-19T06:38:12.038516+0000","last_unstale":"2024-09-19T06:40:08.276561+0000","last_undegraded":"2024-09-19T06:40:08.276561+0000","last_fullsized":"2024-09-19T06:40:08.276561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:16.709742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076941+0000","last_change":"2024-09-19T06:38:14.053888+0000","last_active":"2024-09-19T06:40:08.076941+0000","last_peered":"2024-09-19T06:40:08.076941+0000","last_clean":"2024-09-19T06:40:08.076941+0000","last_became_active":"2024-09-19T06:38:14.053524+0000","last_became_peered":"2024-09-19T06:38:14.053524+0000","last_unstale":"2024-09-19T06:40:08.076941+0000","last_undegraded":"2024-09-19T06:40:08.076941+0000","last_fullsized":"2024-09-19T06:40:08.076941+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:54.853786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'67","reported_seq":111,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.601711+0000","last_change":"2024-09-19T06:39:23.715975+0000","last_active":"2024-09-19T06:40:17.601711+0000","last_peered":"2024-09-19T06:40:17.601711+0000","last_clean":"2024-09-19T06:40:17.601711+0000","last_became_active":"2024-09-19T06:39:23.713052+0000","last_became_peered":"2024-09-19T06:39:23.713052+0000","last_unstale":"2024-09-19T06:40:17.601711+0000","last_undegraded":"2024-09-19T06:40:17.601711+0000","last_fullsized":"2024-09-19T06:40:17.601711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:42.887751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076532+0000","last_change":"2024-09-19T06:38:14.052210+0000","last_active":"2024-09-19T06:40:08.076532+0000","last_peered":"2024-09-19T06:40:08.076532+0000","last_clean":"2024-09-19T06:40:08.076532+0000","last_became_active":"2024-09-19T06:38:14.051803+0000","last_became_peered":"2024-09-19T06:38:14.051803+0000","last_unstale":"2024-09-19T06:40:08.076532+0000","last_undegraded":"2024-09-19T06:40:08.076532+0000","last_fullsized":"2024-09-19T06:40:08.076532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:40.751672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'8","reported_seq":154,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.836884+0000","last_change":"2024-09-19T06:38:12.118077+0000","last_active":"2024-09-19T06:40:17.836884+0000","last_peered":"2024-09-19T06:40:17.836884+0000","last_clean":"2024-09-19T06:40:17.836884+0000","last_became_active":"2024-09-19T06:38:12.117690+0000","last_became_peered":"2024-09-19T06:38:12.117690+0000","last_unstale":"2024-09-19T06:40:17.836884+0000","last_undegraded":"2024-09-19T06:40:17.836884+0000","last_fullsized":"2024-09-19T06:40:17.836884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.828335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076689+0000","last_change":"2024-09-19T06:38:14.054014+0000","last_active":"2024-09-19T06:40:08.076689+0000","last_peered":"2024-09-19T06:40:08.076689+0000","last_clean":"2024-09-19T06:40:08.076689+0000","last_became_active":"2024-09-19T06:38:14.053349+0000","last_became_peered":"2024-09-19T06:38:14.053349+0000","last_unstale":"2024-09-19T06:40:08.076689+0000","last_undegraded":"2024-09-19T06:40:08.076689+0000","last_fullsized":"2024-09-19T06:40:08.076689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:40.117720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"86'148","reported_seq":395,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:10.190486+0000","last_change":"2024-09-19T06:37:02.166696+0000","last_active":"2024-09-19T06:40:10.190486+0000","last_peered":"2024-09-19T06:40:10.190486+0000","last_clean":"2024-09-19T06:40:10.190486+0000","last_became_active":"2024-09-19T06:37:02.166225+0000","last_became_peered":"2024-09-19T06:37:02.166225+0000","last_unstale":"2024-09-19T06:40:10.190486+0000","last_undegraded":"2024-09-19T06:40:10.190486+0000","last_fullsized":"2024-09-19T06:40:10.190486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_clean_scrub_stamp":"2024-09-19T06:33:40.535354+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:46.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274223+0000","last_change":"2024-09-19T06:38:12.044465+0000","last_active":"2024-09-19T06:40:08.274223+0000","last_peered":"2024-09-19T06:40:08.274223+0000","last_clean":"2024-09-19T06:40:08.274223+0000","last_became_active":"2024-09-19T06:38:12.044042+0000","last_became_peered":"2024-09-19T06:38:12.044042+0000","last_unstale":"2024-09-19T06:40:08.274223+0000","last_undegraded":"2024-09-19T06:40:08.274223+0000","last_fullsized":"2024-09-19T06:40:08.274223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:40.759264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075820+0000","last_change":"2024-09-19T06:38:14.045102+0000","last_active":"2024-09-19T06:40:08.075820+0000","last_peered":"2024-09-19T06:40:08.075820+0000","last_clean":"2024-09-19T06:40:08.075820+0000","last_became_active":"2024-09-19T06:38:14.044785+0000","last_became_peered":"2024-09-19T06:38:14.044785+0000","last_unstale":"2024-09-19T06:40:08.075820+0000","last_undegraded":"2024-09-19T06:40:08.075820+0000","last_fullsized":"2024-09-19T06:40:08.075820+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:57.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076444+0000","last_change":"2024-09-19T06:39:24.353205+0000","last_active":"2024-09-19T06:40:08.076444+0000","last_peered":"2024-09-19T06:40:08.076444+0000","last_clean":"2024-09-19T06:40:08.076444+0000","last_became_active":"2024-09-19T06:39:24.350315+0000","last_became_peered":"2024-09-19T06:39:24.350315+0000","last_unstale":"2024-09-19T06:40:08.076444+0000","last_undegraded":"2024-09-19T06:40:08.076444+0000","last_fullsized":"2024-09-19T06:40:08.076444+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:32.467330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,8],"acting":[7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275292+0000","last_change":"2024-09-19T06:38:14.054623+0000","last_active":"2024-09-19T06:40:08.275292+0000","last_peered":"2024-09-19T06:40:08.275292+0000","last_clean":"2024-09-19T06:40:08.275292+0000","last_became_active":"2024-09-19T06:38:14.054124+0000","last_became_peered":"2024-09-19T06:38:14.054124+0000","last_unstale":"2024-09-19T06:40:08.275292+0000","last_undegraded":"2024-09-19T06:40:08.275292+0000","last_fullsized":"2024-09-19T06:40:08.275292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:33.251059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":151,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.814069+0000","last_change":"2024-09-19T06:38:12.047284+0000","last_active":"2024-09-19T06:40:17.814069+0000","last_peered":"2024-09-19T06:40:17.814069+0000","last_clean":"2024-09-19T06:40:17.814069+0000","last_became_active":"2024-09-19T06:38:12.046886+0000","last_became_peered":"2024-09-19T06:38:12.046886+0000","last_unstale":"2024-09-19T06:40:17.814069+0000","last_undegraded":"2024-09-19T06:40:17.814069+0000","last_fullsized":"2024-09-19T06:40:17.814069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:15.030007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257725+0000","last_change":"2024-09-19T06:38:14.049351+0000","last_active":"2024-09-19T06:40:08.257725+0000","last_peered":"2024-09-19T06:40:08.257725+0000","last_clean":"2024-09-19T06:40:08.257725+0000","last_became_active":"2024-09-19T06:38:14.048792+0000","last_became_peered":"2024-09-19T06:38:14.048792+0000","last_unstale":"2024-09-19T06:40:08.257725+0000","last_undegraded":"2024-09-19T06:40:08.257725+0000","last_fullsized":"2024-09-19T06:40:08.257725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:30.431378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'9","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:18.837974+0000","last_change":"2024-09-19T06:38:12.037155+0000","last_active":"2024-09-19T06:40:18.837974+0000","last_peered":"2024-09-19T06:40:18.837974+0000","last_clean":"2024-09-19T06:40:18.837974+0000","last_became_active":"2024-09-19T06:38:12.036536+0000","last_became_peered":"2024-09-19T06:38:12.036536+0000","last_unstale":"2024-09-19T06:40:18.837974+0000","last_undegraded":"2024-09-19T06:40:18.837974+0000","last_fullsized":"2024-09-19T06:40:18.837974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:41.014783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196682+0000","last_change":"2024-09-19T06:38:14.055724+0000","last_active":"2024-09-19T06:40:08.196682+0000","last_peered":"2024-09-19T06:40:08.196682+0000","last_clean":"2024-09-19T06:40:08.196682+0000","last_became_active":"2024-09-19T06:38:14.054457+0000","last_became_peered":"2024-09-19T06:38:14.054457+0000","last_unstale":"2024-09-19T06:40:08.196682+0000","last_undegraded":"2024-09-19T06:40:08.196682+0000","last_fullsized":"2024-09-19T06:40:08.196682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:47.653709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182631+0000","last_change":"2024-09-19T06:38:12.049197+0000","last_active":"2024-09-19T06:40:08.182631+0000","last_peered":"2024-09-19T06:40:08.182631+0000","last_clean":"2024-09-19T06:40:08.182631+0000","last_became_active":"2024-09-19T06:38:12.048863+0000","last_became_peered":"2024-09-19T06:38:12.048863+0000","last_unstale":"2024-09-19T06:40:08.182631+0000","last_undegraded":"2024-09-19T06:40:08.182631+0000","last_fullsized":"2024-09-19T06:40:08.182631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:25.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196635+0000","last_change":"2024-09-19T06:38:14.042991+0000","last_active":"2024-09-19T06:40:08.196635+0000","last_peered":"2024-09-19T06:40:08.196635+0000","last_clean":"2024-09-19T06:40:08.196635+0000","last_became_active":"2024-09-19T06:38:14.042511+0000","last_became_peered":"2024-09-19T06:38:14.042511+0000","last_unstale":"2024-09-19T06:40:08.196635+0000","last_undegraded":"2024-09-19T06:40:08.196635+0000","last_fullsized":"2024-09-19T06:40:08.196635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:38.212838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193790+0000","last_change":"2024-09-19T06:38:23.064456+0000","last_active":"2024-09-19T06:40:08.193790+0000","last_peered":"2024-09-19T06:40:08.193790+0000","last_clean":"2024-09-19T06:40:08.193790+0000","last_became_active":"2024-09-19T06:38:23.064051+0000","last_became_peered":"2024-09-19T06:38:23.064051+0000","last_unstale":"2024-09-19T06:40:08.193790+0000","last_undegraded":"2024-09-19T06:40:08.193790+0000","last_fullsized":"2024-09-19T06:40:08.193790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:58.548420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275853+0000","last_change":"2024-09-19T06:38:14.048612+0000","last_active":"2024-09-19T06:40:08.275853+0000","last_peered":"2024-09-19T06:40:08.275853+0000","last_clean":"2024-09-19T06:40:08.275853+0000","last_became_active":"2024-09-19T06:38:14.048294+0000","last_became_peered":"2024-09-19T06:38:14.048294+0000","last_unstale":"2024-09-19T06:40:08.275853+0000","last_undegraded":"2024-09-19T06:40:08.275853+0000","last_fullsized":"2024-09-19T06:40:08.275853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:55.892149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'103","reported_seq":223,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.949927+0000","last_change":"2024-09-19T06:38:12.035269+0000","last_active":"2024-09-19T06:40:17.949927+0000","last_peered":"2024-09-19T06:40:17.949927+0000","last_clean":"2024-09-19T06:40:17.949927+0000","last_became_active":"2024-09-19T06:38:12.034841+0000","last_became_peered":"2024-09-19T06:38:12.034841+0000","last_unstale":"2024-09-19T06:40:17.949927+0000","last_undegraded":"2024-09-19T06:40:17.949927+0000","last_fullsized":"2024-09-19T06:40:17.949927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:19.642572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":187,"num_write_kb":1284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076503+0000","last_change":"2024-09-19T06:38:14.052492+0000","last_active":"2024-09-19T06:40:08.076503+0000","last_peered":"2024-09-19T06:40:08.076503+0000","last_clean":"2024-09-19T06:40:08.076503+0000","last_became_active":"2024-09-19T06:38:14.052191+0000","last_became_peered":"2024-09-19T06:38:14.052191+0000","last_unstale":"2024-09-19T06:40:08.076503+0000","last_undegraded":"2024-09-19T06:40:08.076503+0000","last_fullsized":"2024-09-19T06:40:08.076503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:34.006480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274336+0000","last_change":"2024-09-19T06:38:12.118430+0000","last_active":"2024-09-19T06:40:08.274336+0000","last_peered":"2024-09-19T06:40:08.274336+0000","last_clean":"2024-09-19T06:40:08.274336+0000","last_became_active":"2024-09-19T06:38:12.118065+0000","last_became_peered":"2024-09-19T06:38:12.118065+0000","last_unstale":"2024-09-19T06:40:08.274336+0000","last_undegraded":"2024-09-19T06:40:08.274336+0000","last_fullsized":"2024-09-19T06:40:08.274336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:25.861922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274974+0000","last_change":"2024-09-19T06:38:23.811305+0000","last_active":"2024-09-19T06:40:08.274974+0000","last_peered":"2024-09-19T06:40:08.274974+0000","last_clean":"2024-09-19T06:40:08.274974+0000","last_became_active":"2024-09-19T06:38:23.810840+0000","last_became_peered":"2024-09-19T06:38:23.810840+0000","last_unstale":"2024-09-19T06:40:08.274974+0000","last_undegraded":"2024-09-19T06:40:08.274974+0000","last_fullsized":"2024-09-19T06:40:08.274974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.019065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273364+0000","last_change":"2024-09-19T06:38:12.047670+0000","last_active":"2024-09-19T06:40:08.273364+0000","last_peered":"2024-09-19T06:40:08.273364+0000","last_clean":"2024-09-19T06:40:08.273364+0000","last_became_active":"2024-09-19T06:38:12.047312+0000","last_became_peered":"2024-09-19T06:38:12.047312+0000","last_unstale":"2024-09-19T06:40:08.273364+0000","last_undegraded":"2024-09-19T06:40:08.273364+0000","last_fullsized":"2024-09-19T06:40:08.273364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:47.477945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:14.047210+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:14.046836+0000","last_became_peered":"2024-09-19T06:38:14.046836+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:14.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075584+0000","last_change":"2024-09-19T06:38:12.032692+0000","last_active":"2024-09-19T06:40:08.075584+0000","last_peered":"2024-09-19T06:40:08.075584+0000","last_clean":"2024-09-19T06:40:08.075584+0000","last_became_active":"2024-09-19T06:38:12.031874+0000","last_became_peered":"2024-09-19T06:38:12.031874+0000","last_unstale":"2024-09-19T06:40:08.075584+0000","last_undegraded":"2024-09-19T06:40:08.075584+0000","last_fullsized":"2024-09-19T06:40:08.075584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.787964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193683+0000","last_change":"2024-09-19T06:38:14.053504+0000","last_active":"2024-09-19T06:40:08.193683+0000","last_peered":"2024-09-19T06:40:08.193683+0000","last_clean":"2024-09-19T06:40:08.193683+0000","last_became_active":"2024-09-19T06:38:14.053148+0000","last_became_peered":"2024-09-19T06:38:14.053148+0000","last_unstale":"2024-09-19T06:40:08.193683+0000","last_undegraded":"2024-09-19T06:40:08.193683+0000","last_fullsized":"2024-09-19T06:40:08.193683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:29.809295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076736+0000","last_change":"2024-09-19T06:38:12.038884+0000","last_active":"2024-09-19T06:40:08.076736+0000","last_peered":"2024-09-19T06:40:08.076736+0000","last_clean":"2024-09-19T06:40:08.076736+0000","last_became_active":"2024-09-19T06:38:12.038532+0000","last_became_peered":"2024-09-19T06:38:12.038532+0000","last_unstale":"2024-09-19T06:40:08.076736+0000","last_undegraded":"2024-09-19T06:40:08.076736+0000","last_fullsized":"2024-09-19T06:40:08.076736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.348690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075777+0000","last_change":"2024-09-19T06:38:14.045761+0000","last_active":"2024-09-19T06:40:08.075777+0000","last_peered":"2024-09-19T06:40:08.075777+0000","last_clean":"2024-09-19T06:40:08.075777+0000","last_became_active":"2024-09-19T06:38:14.045467+0000","last_became_peered":"2024-09-19T06:38:14.045467+0000","last_unstale":"2024-09-19T06:40:08.075777+0000","last_undegraded":"2024-09-19T06:40:08.075777+0000","last_fullsized":"2024-09-19T06:40:08.075777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.917945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185144+0000","last_change":"2024-09-19T06:39:23.748032+0000","last_active":"2024-09-19T06:40:08.185144+0000","last_peered":"2024-09-19T06:40:08.185144+0000","last_clean":"2024-09-19T06:40:08.185144+0000","last_became_active":"2024-09-19T06:39:23.744288+0000","last_became_peered":"2024-09-19T06:39:23.744288+0000","last_unstale":"2024-09-19T06:40:08.185144+0000","last_undegraded":"2024-09-19T06:40:08.185144+0000","last_fullsized":"2024-09-19T06:40:08.185144+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:50.668043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4],"acting":[8,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076545+0000","last_change":"2024-09-19T06:38:14.053935+0000","last_active":"2024-09-19T06:40:08.076545+0000","last_peered":"2024-09-19T06:40:08.076545+0000","last_clean":"2024-09-19T06:40:08.076545+0000","last_became_active":"2024-09-19T06:38:14.053542+0000","last_became_peered":"2024-09-19T06:38:14.053542+0000","last_unstale":"2024-09-19T06:40:08.076545+0000","last_undegraded":"2024-09-19T06:40:08.076545+0000","last_fullsized":"2024-09-19T06:40:08.076545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:25.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182280+0000","last_change":"2024-09-19T06:38:23.177133+0000","last_active":"2024-09-19T06:40:08.182280+0000","last_peered":"2024-09-19T06:40:08.182280+0000","last_clean":"2024-09-19T06:40:08.182280+0000","last_became_active":"2024-09-19T06:38:23.176810+0000","last_became_peered":"2024-09-19T06:38:23.176810+0000","last_unstale":"2024-09-19T06:40:08.182280+0000","last_undegraded":"2024-09-19T06:40:08.182280+0000","last_fullsized":"2024-09-19T06:40:08.182280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:56.307720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185240+0000","last_change":"2024-09-19T06:38:12.042699+0000","last_active":"2024-09-19T06:40:08.185240+0000","last_peered":"2024-09-19T06:40:08.185240+0000","last_clean":"2024-09-19T06:40:08.185240+0000","last_became_active":"2024-09-19T06:38:12.042148+0000","last_became_peered":"2024-09-19T06:38:12.042148+0000","last_unstale":"2024-09-19T06:40:08.185240+0000","last_undegraded":"2024-09-19T06:40:08.185240+0000","last_fullsized":"2024-09-19T06:40:08.185240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.953596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273371+0000","last_change":"2024-09-19T06:38:14.043279+0000","last_active":"2024-09-19T06:40:08.273371+0000","last_peered":"2024-09-19T06:40:08.273371+0000","last_clean":"2024-09-19T06:40:08.273371+0000","last_became_active":"2024-09-19T06:38:14.042914+0000","last_became_peered":"2024-09-19T06:38:14.042914+0000","last_unstale":"2024-09-19T06:40:08.273371+0000","last_undegraded":"2024-09-19T06:40:08.273371+0000","last_fullsized":"2024-09-19T06:40:08.273371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:22.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'13","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185441+0000","last_change":"2024-09-19T06:39:23.719397+0000","last_active":"2024-09-19T06:40:08.185441+0000","last_peered":"2024-09-19T06:40:08.185441+0000","last_clean":"2024-09-19T06:40:08.185441+0000","last_became_active":"2024-09-19T06:39:23.709128+0000","last_became_peered":"2024-09-19T06:39:23.709128+0000","last_unstale":"2024-09-19T06:40:08.185441+0000","last_undegraded":"2024-09-19T06:40:08.185441+0000","last_fullsized":"2024-09-19T06:40:08.185441+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:46.092401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274590+0000","last_change":"2024-09-19T06:38:14.041552+0000","last_active":"2024-09-19T06:40:08.274590+0000","last_peered":"2024-09-19T06:40:08.274590+0000","last_clean":"2024-09-19T06:40:08.274590+0000","last_became_active":"2024-09-19T06:38:14.041187+0000","last_became_peered":"2024-09-19T06:38:14.041187+0000","last_unstale":"2024-09-19T06:40:08.274590+0000","last_undegraded":"2024-09-19T06:40:08.274590+0000","last_fullsized":"2024-09-19T06:40:08.274590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:17.390457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076417+0000","last_change":"2024-09-19T06:38:12.047436+0000","last_active":"2024-09-19T06:40:08.076417+0000","last_peered":"2024-09-19T06:40:08.076417+0000","last_clean":"2024-09-19T06:40:08.076417+0000","last_became_active":"2024-09-19T06:38:12.046961+0000","last_became_peered":"2024-09-19T06:38:12.046961+0000","last_unstale":"2024-09-19T06:40:08.076417+0000","last_undegraded":"2024-09-19T06:40:08.076417+0000","last_fullsized":"2024-09-19T06:40:08.076417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076262+0000","last_change":"2024-09-19T06:38:14.049660+0000","last_active":"2024-09-19T06:40:08.076262+0000","last_peered":"2024-09-19T06:40:08.076262+0000","last_clean":"2024-09-19T06:40:08.076262+0000","last_became_active":"2024-09-19T06:38:14.049375+0000","last_became_peered":"2024-09-19T06:38:14.049375+0000","last_unstale":"2024-09-19T06:40:08.076262+0000","last_undegraded":"2024-09-19T06:40:08.076262+0000","last_fullsized":"2024-09-19T06:40:08.076262+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:08.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'15","reported_seq":171,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:18.837439+0000","last_change":"2024-09-19T06:38:23.071068+0000","last_active":"2024-09-19T06:40:18.837439+0000","last_peered":"2024-09-19T06:40:18.837439+0000","last_clean":"2024-09-19T06:40:18.837439+0000","last_became_active":"2024-09-19T06:38:23.067129+0000","last_became_peered":"2024-09-19T06:38:23.067129+0000","last_unstale":"2024-09-19T06:40:18.837439+0000","last_undegraded":"2024-09-19T06:40:18.837439+0000","last_fullsized":"2024-09-19T06:40:18.837439+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:15.387758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":798024,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1539,"num_read_kb":992,"num_write":503,"num_write_kb":2382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2264,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":2394072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":383,"ondisk_log_size":383,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547238,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1306624,"data_stored":794721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41580,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703572,"statfs":{"total":95995035648,"available":95952457728,"internally_reserved":0,"allocated":2002944,"data_stored":1452099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939696,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28372,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716780,"statfs":{"total":95995035648,"available":95965982720,"internally_reserved":0,"allocated":1380352,"data_stored":858526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168628,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28352,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716800,"statfs":{"total":95995035648,"available":95966003200,"internally_reserved":0,"allocated":1359872,"data_stored":858120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1059977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528383,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":970752,"data_stored":466262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1589248,"data_stored":1057957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":533502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28816,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716336,"statfs":{"total":95995035648,"available":95965528064,"internally_reserved":0,"allocated":1712128,"data_stored":1186300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":466465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40528,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704624,"statfs":{"total":95995035648,"available":95953534976,"internally_reserved":0,"allocated":1048576,"data_stored":534912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":467293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":69314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":397426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":330533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:40:21.909 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:40:21.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:40:22.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:21 smithi012 ceph-mon[30937]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-19T06:40:22.175 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:21 smithi016 ceph-mon[34911]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-19T06:40:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:21 smithi173 ceph-mon[35349]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-19T06:40:22.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.624+0000 7fa24ef42640 1 -- 172.21.15.12:0/1326566331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2481036e0 msgr2=0x7fa248107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:22.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.624+0000 7fa24ef42640 1 --2- 172.21.15.12:0/1326566331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2481036e0 0x7fa248107b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa238009cd0 tx=0x7fa23802a8f0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.624+0000 7fa24ef42640 1 -- 172.21.15.12:0/1326566331 shutdown_connections 2024-09-19T06:40:22.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.624+0000 7fa24ef42640 1 --2- 172.21.15.12:0/1326566331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2481082a0 0x7fa24810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.624+0000 7fa24ef42640 1 --2- 172.21.15.12:0/1326566331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2481036e0 0x7fa248107b90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.624+0000 7fa24ef42640 1 --2- 172.21.15.12:0/1326566331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa248102d30 0x7fa248103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.624+0000 7fa24ef42640 1 -- 172.21.15.12:0/1326566331 >> 172.21.15.12:0/1326566331 conn(0x7fa2480fc7d0 msgr2=0x7fa2480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:22.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.624+0000 7fa24ef42640 1 -- 172.21.15.12:0/1326566331 shutdown_connections 2024-09-19T06:40:22.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.624+0000 7fa24ef42640 1 -- 172.21.15.12:0/1326566331 wait complete. 2024-09-19T06:40:22.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ef42640 1 Processor -- start 2024-09-19T06:40:22.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ef42640 1 -- start start 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ef42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa248102d30 0x7fa248100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ef42640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2481036e0 0x7fa248100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ef42640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2481082a0 0x7fa248101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ef42640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa248112060 con 0x7fa248102d30 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ef42640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa248111ee0 con 0x7fa2481036e0 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ef42640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481121e0 con 0x7fa2481082a0 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ccde640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa248102d30 0x7fa248100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ccde640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa248102d30 0x7fa248100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44746/0 (socket says 172.21.15.12:44746) 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ccde640 1 -- 172.21.15.12:0/3562891936 learned_addr learned my addr 172.21.15.12:0/3562891936 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24d4df640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2481082a0 0x7fa248101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa247fff640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2481036e0 0x7fa248100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ccde640 1 -- 172.21.15.12:0/3562891936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2481082a0 msgr2=0x7fa248101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:22.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ccde640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2481082a0 0x7fa248101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ccde640 1 -- 172.21.15.12:0/3562891936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2481036e0 msgr2=0x7fa248100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ccde640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2481036e0 0x7fa248100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24ccde640 1 -- 172.21.15.12:0/3562891936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2481a6980 con 0x7fa248102d30 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.625+0000 7fa24d4df640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2481082a0 0x7fa248101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.626+0000 7fa24ccde640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa248102d30 0x7fa248100990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa23000c920 tx=0x7fa23000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.626+0000 7fa245ffb640 1 -- 172.21.15.12:0/3562891936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230007c70 con 0x7fa248102d30 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.626+0000 7fa245ffb640 1 -- 172.21.15.12:0/3562891936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa230007e10 con 0x7fa248102d30 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.626+0000 7fa24ef42640 1 -- 172.21.15.12:0/3562891936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2481a6c70 con 0x7fa248102d30 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.626+0000 7fa245ffb640 1 -- 172.21.15.12:0/3562891936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230018890 con 0x7fa248102d30 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.626+0000 7fa24ef42640 1 -- 172.21.15.12:0/3562891936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2481a7180 con 0x7fa248102d30 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.627+0000 7fa24ef42640 1 -- 172.21.15.12:0/3562891936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa248103110 con 0x7fa248102d30 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.629+0000 7fa245ffb640 1 -- 172.21.15.12:0/3562891936 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fa230018a70 con 0x7fa248102d30 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.630+0000 7fa245ffb640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa2340a3440 0x7fa2340a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:22.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.630+0000 7fa247fff640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa2340a3440 0x7fa2340a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:22.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.630+0000 7fa245ffb640 1 -- 172.21.15.12:0/3562891936 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa2300d01a0 con 0x7fa248102d30 2024-09-19T06:40:22.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.630+0000 7fa247fff640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa2340a3440 0x7fa2340a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa238006010 tx=0x7fa2380093f0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:22.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.634+0000 7fa245ffb640 1 -- 172.21.15.12:0/3562891936 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa230014030 con 0x7fa248102d30 2024-09-19T06:40:22.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.806+0000 7fa24ef42640 1 -- 172.21.15.12:0/3562891936 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2481073e0 con 0x7fa2340a3440 2024-09-19T06:40:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.813+0000 7fa245ffb640 1 -- 172.21.15.12:0/3562891936 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257823 (secure 0 0 0) 0x7fa2481073e0 con 0x7fa2340a3440 2024-09-19T06:40:22.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:22.817 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-19T06:40:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 -- 172.21.15.12:0/3562891936 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa2340a3440 msgr2=0x7fa2340a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa2340a3440 0x7fa2340a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa238006010 tx=0x7fa2380093f0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 -- 172.21.15.12:0/3562891936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa248102d30 msgr2=0x7fa248100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa248102d30 0x7fa248100990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa23000c920 tx=0x7fa23000cde0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 -- 172.21.15.12:0/3562891936 shutdown_connections 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa2340a3440 0x7fa2340a5900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2481082a0 0x7fa248101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2481036e0 0x7fa248100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 --2- 172.21.15.12:0/3562891936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa248102d30 0x7fa248100990 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 -- 172.21.15.12:0/3562891936 >> 172.21.15.12:0/3562891936 conn(0x7fa2480fc7d0 msgr2=0x7fa248105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 -- 172.21.15.12:0/3562891936 shutdown_connections 2024-09-19T06:40:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:22.817+0000 7fa24ef42640 1 -- 172.21.15.12:0/3562891936 wait complete. 2024-09-19T06:40:23.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:22 smithi012 ceph-mon[30937]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:23.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:22 smithi016 ceph-mon[34911]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:23.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:22 smithi173 ceph-mon[35349]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:23.513 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-19T06:40:22.092602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1388626,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1776,"num_read_kb":1322,"num_write":706,"num_write_kb":5322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183000,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1033,"ondisk_log_size":1033,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386020,"kb_used_data":15600,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124555804,"statfs":{"total":1151940427776,"available":1151545143296,"internally_reserved":0,"allocated":15974400,"data_stored":9736134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":197770,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":457,"num_read_kb":495,"num_write":147,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002799"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193955+0000","last_change":"2024-09-19T06:38:14.052943+0000","last_active":"2024-09-19T06:40:08.193955+0000","last_peered":"2024-09-19T06:40:08.193955+0000","last_clean":"2024-09-19T06:40:08.193955+0000","last_became_active":"2024-09-19T06:38:14.052054+0000","last_became_peered":"2024-09-19T06:38:14.052054+0000","last_unstale":"2024-09-19T06:40:08.193955+0000","last_undegraded":"2024-09-19T06:40:08.193955+0000","last_fullsized":"2024-09-19T06:40:08.193955+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:05:28.898131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274890+0000","last_change":"2024-09-19T06:38:14.044916+0000","last_active":"2024-09-19T06:40:08.274890+0000","last_peered":"2024-09-19T06:40:08.274890+0000","last_clean":"2024-09-19T06:40:08.274890+0000","last_became_active":"2024-09-19T06:38:14.044596+0000","last_became_peered":"2024-09-19T06:38:14.044596+0000","last_unstale":"2024-09-19T06:40:08.274890+0000","last_undegraded":"2024-09-19T06:40:08.274890+0000","last_fullsized":"2024-09-19T06:40:08.274890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:04.402332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274248+0000","last_change":"2024-09-19T06:38:14.052765+0000","last_active":"2024-09-19T06:40:08.274248+0000","last_peered":"2024-09-19T06:40:08.274248+0000","last_clean":"2024-09-19T06:40:08.274248+0000","last_became_active":"2024-09-19T06:38:14.052219+0000","last_became_peered":"2024-09-19T06:38:14.052219+0000","last_unstale":"2024-09-19T06:40:08.274248+0000","last_undegraded":"2024-09-19T06:40:08.274248+0000","last_fullsized":"2024-09-19T06:40:08.274248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:13.317252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274226+0000","last_change":"2024-09-19T06:38:14.052421+0000","last_active":"2024-09-19T06:40:08.274226+0000","last_peered":"2024-09-19T06:40:08.274226+0000","last_clean":"2024-09-19T06:40:08.274226+0000","last_became_active":"2024-09-19T06:38:14.052094+0000","last_became_peered":"2024-09-19T06:38:14.052094+0000","last_unstale":"2024-09-19T06:40:08.274226+0000","last_undegraded":"2024-09-19T06:40:08.274226+0000","last_fullsized":"2024-09-19T06:40:08.274226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185134+0000","last_change":"2024-09-19T06:38:14.047736+0000","last_active":"2024-09-19T06:40:08.185134+0000","last_peered":"2024-09-19T06:40:08.185134+0000","last_clean":"2024-09-19T06:40:08.185134+0000","last_became_active":"2024-09-19T06:38:14.047396+0000","last_became_peered":"2024-09-19T06:38:14.047396+0000","last_unstale":"2024-09-19T06:40:08.185134+0000","last_undegraded":"2024-09-19T06:40:08.185134+0000","last_fullsized":"2024-09-19T06:40:08.185134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:47.855638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196543+0000","last_change":"2024-09-19T06:38:14.047793+0000","last_active":"2024-09-19T06:40:08.196543+0000","last_peered":"2024-09-19T06:40:08.196543+0000","last_clean":"2024-09-19T06:40:08.196543+0000","last_became_active":"2024-09-19T06:38:14.047198+0000","last_became_peered":"2024-09-19T06:38:14.047198+0000","last_unstale":"2024-09-19T06:40:08.196543+0000","last_undegraded":"2024-09-19T06:40:08.196543+0000","last_fullsized":"2024-09-19T06:40:08.196543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:42.507270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076273+0000","last_change":"2024-09-19T06:38:14.050025+0000","last_active":"2024-09-19T06:40:08.076273+0000","last_peered":"2024-09-19T06:40:08.076273+0000","last_clean":"2024-09-19T06:40:08.076273+0000","last_became_active":"2024-09-19T06:38:14.049591+0000","last_became_peered":"2024-09-19T06:38:14.049591+0000","last_unstale":"2024-09-19T06:40:08.076273+0000","last_undegraded":"2024-09-19T06:40:08.076273+0000","last_fullsized":"2024-09-19T06:40:08.076273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:49.487521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181942+0000","last_change":"2024-09-19T06:38:23.065490+0000","last_active":"2024-09-19T06:40:08.181942+0000","last_peered":"2024-09-19T06:40:08.181942+0000","last_clean":"2024-09-19T06:40:08.181942+0000","last_became_active":"2024-09-19T06:38:23.065151+0000","last_became_peered":"2024-09-19T06:38:23.065151+0000","last_unstale":"2024-09-19T06:40:08.181942+0000","last_undegraded":"2024-09-19T06:40:08.181942+0000","last_fullsized":"2024-09-19T06:40:08.181942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:42.184698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273928+0000","last_change":"2024-09-19T06:38:14.047395+0000","last_active":"2024-09-19T06:40:08.273928+0000","last_peered":"2024-09-19T06:40:08.273928+0000","last_clean":"2024-09-19T06:40:08.273928+0000","last_became_active":"2024-09-19T06:38:14.046975+0000","last_became_peered":"2024-09-19T06:38:14.046975+0000","last_unstale":"2024-09-19T06:40:08.273928+0000","last_undegraded":"2024-09-19T06:40:08.273928+0000","last_fullsized":"2024-09-19T06:40:08.273928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:18.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196936+0000","last_change":"2024-09-19T06:38:14.055042+0000","last_active":"2024-09-19T06:40:08.196936+0000","last_peered":"2024-09-19T06:40:08.196936+0000","last_clean":"2024-09-19T06:40:08.196936+0000","last_became_active":"2024-09-19T06:38:14.054664+0000","last_became_peered":"2024-09-19T06:38:14.054664+0000","last_unstale":"2024-09-19T06:40:08.196936+0000","last_undegraded":"2024-09-19T06:40:08.196936+0000","last_fullsized":"2024-09-19T06:40:08.196936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:29.815277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076591+0000","last_change":"2024-09-19T06:38:14.055106+0000","last_active":"2024-09-19T06:40:08.076591+0000","last_peered":"2024-09-19T06:40:08.076591+0000","last_clean":"2024-09-19T06:40:08.076591+0000","last_became_active":"2024-09-19T06:38:14.054721+0000","last_became_peered":"2024-09-19T06:38:14.054721+0000","last_unstale":"2024-09-19T06:40:08.076591+0000","last_undegraded":"2024-09-19T06:40:08.076591+0000","last_fullsized":"2024-09-19T06:40:08.076591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:39.952491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274235+0000","last_change":"2024-09-19T06:38:14.051796+0000","last_active":"2024-09-19T06:40:08.274235+0000","last_peered":"2024-09-19T06:40:08.274235+0000","last_clean":"2024-09-19T06:40:08.274235+0000","last_became_active":"2024-09-19T06:38:14.048338+0000","last_became_peered":"2024-09-19T06:38:14.048338+0000","last_unstale":"2024-09-19T06:40:08.274235+0000","last_undegraded":"2024-09-19T06:40:08.274235+0000","last_fullsized":"2024-09-19T06:40:08.274235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:48.656819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276087+0000","last_change":"2024-09-19T06:38:14.048607+0000","last_active":"2024-09-19T06:40:08.276087+0000","last_peered":"2024-09-19T06:40:08.276087+0000","last_clean":"2024-09-19T06:40:08.276087+0000","last_became_active":"2024-09-19T06:38:14.047277+0000","last_became_peered":"2024-09-19T06:38:14.047277+0000","last_unstale":"2024-09-19T06:40:08.276087+0000","last_undegraded":"2024-09-19T06:40:08.276087+0000","last_fullsized":"2024-09-19T06:40:08.276087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:52.904376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273963+0000","last_change":"2024-09-19T06:38:14.050759+0000","last_active":"2024-09-19T06:40:08.273963+0000","last_peered":"2024-09-19T06:40:08.273963+0000","last_clean":"2024-09-19T06:40:08.273963+0000","last_became_active":"2024-09-19T06:38:14.049900+0000","last_became_peered":"2024-09-19T06:38:14.049900+0000","last_unstale":"2024-09-19T06:40:08.273963+0000","last_undegraded":"2024-09-19T06:40:08.273963+0000","last_fullsized":"2024-09-19T06:40:08.273963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:10:45.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273772+0000","last_change":"2024-09-19T06:38:14.058890+0000","last_active":"2024-09-19T06:40:08.273772+0000","last_peered":"2024-09-19T06:40:08.273772+0000","last_clean":"2024-09-19T06:40:08.273772+0000","last_became_active":"2024-09-19T06:38:14.058442+0000","last_became_peered":"2024-09-19T06:38:14.058442+0000","last_unstale":"2024-09-19T06:40:08.273772+0000","last_undegraded":"2024-09-19T06:40:08.273772+0000","last_fullsized":"2024-09-19T06:40:08.273772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:27.296578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273218+0000","last_change":"2024-09-19T06:38:14.050371+0000","last_active":"2024-09-19T06:40:08.273218+0000","last_peered":"2024-09-19T06:40:08.273218+0000","last_clean":"2024-09-19T06:40:08.273218+0000","last_became_active":"2024-09-19T06:38:14.049930+0000","last_became_peered":"2024-09-19T06:38:14.049930+0000","last_unstale":"2024-09-19T06:40:08.273218+0000","last_undegraded":"2024-09-19T06:40:08.273218+0000","last_fullsized":"2024-09-19T06:40:08.273218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:37.898624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193944+0000","last_change":"2024-09-19T06:38:14.052521+0000","last_active":"2024-09-19T06:40:08.193944+0000","last_peered":"2024-09-19T06:40:08.193944+0000","last_clean":"2024-09-19T06:40:08.193944+0000","last_became_active":"2024-09-19T06:38:14.052083+0000","last_became_peered":"2024-09-19T06:38:14.052083+0000","last_unstale":"2024-09-19T06:40:08.193944+0000","last_undegraded":"2024-09-19T06:40:08.193944+0000","last_fullsized":"2024-09-19T06:40:08.193944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:10.752606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182686+0000","last_change":"2024-09-19T06:38:14.044747+0000","last_active":"2024-09-19T06:40:08.182686+0000","last_peered":"2024-09-19T06:40:08.182686+0000","last_clean":"2024-09-19T06:40:08.182686+0000","last_became_active":"2024-09-19T06:38:14.044451+0000","last_became_peered":"2024-09-19T06:38:14.044451+0000","last_unstale":"2024-09-19T06:40:08.182686+0000","last_undegraded":"2024-09-19T06:40:08.182686+0000","last_fullsized":"2024-09-19T06:40:08.182686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:04.067156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076928+0000","last_change":"2024-09-19T06:38:14.056101+0000","last_active":"2024-09-19T06:40:08.076928+0000","last_peered":"2024-09-19T06:40:08.076928+0000","last_clean":"2024-09-19T06:40:08.076928+0000","last_became_active":"2024-09-19T06:38:14.055682+0000","last_became_peered":"2024-09-19T06:38:14.055682+0000","last_unstale":"2024-09-19T06:40:08.076928+0000","last_undegraded":"2024-09-19T06:40:08.076928+0000","last_fullsized":"2024-09-19T06:40:08.076928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:23.921766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193625+0000","last_change":"2024-09-19T06:38:14.059441+0000","last_active":"2024-09-19T06:40:08.193625+0000","last_peered":"2024-09-19T06:40:08.193625+0000","last_clean":"2024-09-19T06:40:08.193625+0000","last_became_active":"2024-09-19T06:38:14.059123+0000","last_became_peered":"2024-09-19T06:38:14.059123+0000","last_unstale":"2024-09-19T06:40:08.193625+0000","last_undegraded":"2024-09-19T06:40:08.193625+0000","last_fullsized":"2024-09-19T06:40:08.193625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:32.148741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276233+0000","last_change":"2024-09-19T06:38:14.050336+0000","last_active":"2024-09-19T06:40:08.276233+0000","last_peered":"2024-09-19T06:40:08.276233+0000","last_clean":"2024-09-19T06:40:08.276233+0000","last_became_active":"2024-09-19T06:38:14.050041+0000","last_became_peered":"2024-09-19T06:38:14.050041+0000","last_unstale":"2024-09-19T06:40:08.276233+0000","last_undegraded":"2024-09-19T06:40:08.276233+0000","last_fullsized":"2024-09-19T06:40:08.276233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:09.245804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273366+0000","last_change":"2024-09-19T06:38:14.050280+0000","last_active":"2024-09-19T06:40:08.273366+0000","last_peered":"2024-09-19T06:40:08.273366+0000","last_clean":"2024-09-19T06:40:08.273366+0000","last_became_active":"2024-09-19T06:38:14.049874+0000","last_became_peered":"2024-09-19T06:38:14.049874+0000","last_unstale":"2024-09-19T06:40:08.273366+0000","last_undegraded":"2024-09-19T06:40:08.273366+0000","last_fullsized":"2024-09-19T06:40:08.273366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:52.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075355+0000","last_change":"2024-09-19T06:38:14.048294+0000","last_active":"2024-09-19T06:40:08.075355+0000","last_peered":"2024-09-19T06:40:08.075355+0000","last_clean":"2024-09-19T06:40:08.075355+0000","last_became_active":"2024-09-19T06:38:14.048002+0000","last_became_peered":"2024-09-19T06:38:14.048002+0000","last_unstale":"2024-09-19T06:40:08.075355+0000","last_undegraded":"2024-09-19T06:40:08.075355+0000","last_fullsized":"2024-09-19T06:40:08.075355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:55.920027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257610+0000","last_change":"2024-09-19T06:38:14.050244+0000","last_active":"2024-09-19T06:40:08.257610+0000","last_peered":"2024-09-19T06:40:08.257610+0000","last_clean":"2024-09-19T06:40:08.257610+0000","last_became_active":"2024-09-19T06:38:14.049499+0000","last_became_peered":"2024-09-19T06:38:14.049499+0000","last_unstale":"2024-09-19T06:40:08.257610+0000","last_undegraded":"2024-09-19T06:40:08.257610+0000","last_fullsized":"2024-09-19T06:40:08.257610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:35.506647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076492+0000","last_change":"2024-09-19T06:38:14.048779+0000","last_active":"2024-09-19T06:40:08.076492+0000","last_peered":"2024-09-19T06:40:08.076492+0000","last_clean":"2024-09-19T06:40:08.076492+0000","last_became_active":"2024-09-19T06:38:14.048492+0000","last_became_peered":"2024-09-19T06:38:14.048492+0000","last_unstale":"2024-09-19T06:40:08.076492+0000","last_undegraded":"2024-09-19T06:40:08.076492+0000","last_fullsized":"2024-09-19T06:40:08.076492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:01.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076981+0000","last_change":"2024-09-19T06:38:14.054442+0000","last_active":"2024-09-19T06:40:08.076981+0000","last_peered":"2024-09-19T06:40:08.076981+0000","last_clean":"2024-09-19T06:40:08.076981+0000","last_became_active":"2024-09-19T06:38:14.053903+0000","last_became_peered":"2024-09-19T06:38:14.053903+0000","last_unstale":"2024-09-19T06:40:08.076981+0000","last_undegraded":"2024-09-19T06:40:08.076981+0000","last_fullsized":"2024-09-19T06:40:08.076981+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:42.002146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193936+0000","last_change":"2024-09-19T06:38:14.051139+0000","last_active":"2024-09-19T06:40:08.193936+0000","last_peered":"2024-09-19T06:40:08.193936+0000","last_clean":"2024-09-19T06:40:08.193936+0000","last_became_active":"2024-09-19T06:38:14.050764+0000","last_became_peered":"2024-09-19T06:38:14.050764+0000","last_unstale":"2024-09-19T06:40:08.193936+0000","last_undegraded":"2024-09-19T06:40:08.193936+0000","last_fullsized":"2024-09-19T06:40:08.193936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:49.379184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275728+0000","last_change":"2024-09-19T06:38:14.054614+0000","last_active":"2024-09-19T06:40:08.275728+0000","last_peered":"2024-09-19T06:40:08.275728+0000","last_clean":"2024-09-19T06:40:08.275728+0000","last_became_active":"2024-09-19T06:38:14.054280+0000","last_became_peered":"2024-09-19T06:38:14.054280+0000","last_unstale":"2024-09-19T06:40:08.275728+0000","last_undegraded":"2024-09-19T06:40:08.275728+0000","last_fullsized":"2024-09-19T06:40:08.275728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:21.264389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274136+0000","last_change":"2024-09-19T06:38:14.056215+0000","last_active":"2024-09-19T06:40:08.274136+0000","last_peered":"2024-09-19T06:40:08.274136+0000","last_clean":"2024-09-19T06:40:08.274136+0000","last_became_active":"2024-09-19T06:38:14.055875+0000","last_became_peered":"2024-09-19T06:38:14.055875+0000","last_unstale":"2024-09-19T06:40:08.274136+0000","last_undegraded":"2024-09-19T06:40:08.274136+0000","last_fullsized":"2024-09-19T06:40:08.274136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:42:45.347185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076586+0000","last_change":"2024-09-19T06:38:14.057963+0000","last_active":"2024-09-19T06:40:08.076586+0000","last_peered":"2024-09-19T06:40:08.076586+0000","last_clean":"2024-09-19T06:40:08.076586+0000","last_became_active":"2024-09-19T06:38:14.057578+0000","last_became_peered":"2024-09-19T06:38:14.057578+0000","last_unstale":"2024-09-19T06:40:08.076586+0000","last_undegraded":"2024-09-19T06:40:08.076586+0000","last_fullsized":"2024-09-19T06:40:08.076586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:26.173414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076589+0000","last_change":"2024-09-19T06:38:14.058840+0000","last_active":"2024-09-19T06:40:08.076589+0000","last_peered":"2024-09-19T06:40:08.076589+0000","last_clean":"2024-09-19T06:40:08.076589+0000","last_became_active":"2024-09-19T06:38:14.058418+0000","last_became_peered":"2024-09-19T06:38:14.058418+0000","last_unstale":"2024-09-19T06:40:08.076589+0000","last_undegraded":"2024-09-19T06:40:08.076589+0000","last_fullsized":"2024-09-19T06:40:08.076589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:13.624750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193666+0000","last_change":"2024-09-19T06:38:14.053363+0000","last_active":"2024-09-19T06:40:08.193666+0000","last_peered":"2024-09-19T06:40:08.193666+0000","last_clean":"2024-09-19T06:40:08.193666+0000","last_became_active":"2024-09-19T06:38:14.053039+0000","last_became_peered":"2024-09-19T06:38:14.053039+0000","last_unstale":"2024-09-19T06:40:08.193666+0000","last_undegraded":"2024-09-19T06:40:08.193666+0000","last_fullsized":"2024-09-19T06:40:08.193666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:38.274885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185012+0000","last_change":"2024-09-19T06:38:14.045719+0000","last_active":"2024-09-19T06:40:08.185012+0000","last_peered":"2024-09-19T06:40:08.185012+0000","last_clean":"2024-09-19T06:40:08.185012+0000","last_became_active":"2024-09-19T06:38:14.045285+0000","last_became_peered":"2024-09-19T06:38:14.045285+0000","last_unstale":"2024-09-19T06:40:08.185012+0000","last_undegraded":"2024-09-19T06:40:08.185012+0000","last_fullsized":"2024-09-19T06:40:08.185012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:16.877802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'7","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.815736+0000","last_change":"2024-09-19T06:38:23.177942+0000","last_active":"2024-09-19T06:40:17.815736+0000","last_peered":"2024-09-19T06:40:17.815736+0000","last_clean":"2024-09-19T06:40:17.815736+0000","last_became_active":"2024-09-19T06:38:23.176579+0000","last_became_peered":"2024-09-19T06:38:23.176579+0000","last_unstale":"2024-09-19T06:40:17.815736+0000","last_undegraded":"2024-09-19T06:40:17.815736+0000","last_fullsized":"2024-09-19T06:40:17.815736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:28.140245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257665+0000","last_change":"2024-09-19T06:38:23.811603+0000","last_active":"2024-09-19T06:40:08.257665+0000","last_peered":"2024-09-19T06:40:08.257665+0000","last_clean":"2024-09-19T06:40:08.257665+0000","last_became_active":"2024-09-19T06:38:23.811139+0000","last_became_peered":"2024-09-19T06:38:23.811139+0000","last_unstale":"2024-09-19T06:40:08.257665+0000","last_undegraded":"2024-09-19T06:40:08.257665+0000","last_fullsized":"2024-09-19T06:40:08.257665+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:42.082355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196626+0000","last_change":"2024-09-19T06:38:12.041330+0000","last_active":"2024-09-19T06:40:08.196626+0000","last_peered":"2024-09-19T06:40:08.196626+0000","last_clean":"2024-09-19T06:40:08.196626+0000","last_became_active":"2024-09-19T06:38:12.040992+0000","last_became_peered":"2024-09-19T06:38:12.040992+0000","last_unstale":"2024-09-19T06:40:08.196626+0000","last_undegraded":"2024-09-19T06:40:08.196626+0000","last_fullsized":"2024-09-19T06:40:08.196626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:51.721009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275224+0000","last_change":"2024-09-19T06:38:12.034534+0000","last_active":"2024-09-19T06:40:08.275224+0000","last_peered":"2024-09-19T06:40:08.275224+0000","last_clean":"2024-09-19T06:40:08.275224+0000","last_became_active":"2024-09-19T06:38:12.034209+0000","last_became_peered":"2024-09-19T06:38:12.034209+0000","last_unstale":"2024-09-19T06:40:08.275224+0000","last_undegraded":"2024-09-19T06:40:08.275224+0000","last_fullsized":"2024-09-19T06:40:08.275224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:40.640464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075337+0000","last_change":"2024-09-19T06:38:14.043287+0000","last_active":"2024-09-19T06:40:08.075337+0000","last_peered":"2024-09-19T06:40:08.075337+0000","last_clean":"2024-09-19T06:40:08.075337+0000","last_became_active":"2024-09-19T06:38:14.042565+0000","last_became_peered":"2024-09-19T06:38:14.042565+0000","last_unstale":"2024-09-19T06:40:08.075337+0000","last_undegraded":"2024-09-19T06:40:08.075337+0000","last_fullsized":"2024-09-19T06:40:08.075337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:32.689929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257848+0000","last_change":"2024-09-19T06:38:12.039142+0000","last_active":"2024-09-19T06:40:08.257848+0000","last_peered":"2024-09-19T06:40:08.257848+0000","last_clean":"2024-09-19T06:40:08.257848+0000","last_became_active":"2024-09-19T06:38:12.038815+0000","last_became_peered":"2024-09-19T06:38:12.038815+0000","last_unstale":"2024-09-19T06:40:08.257848+0000","last_undegraded":"2024-09-19T06:40:08.257848+0000","last_fullsized":"2024-09-19T06:40:08.257848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:03.316742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182141+0000","last_change":"2024-09-19T06:38:14.044778+0000","last_active":"2024-09-19T06:40:08.182141+0000","last_peered":"2024-09-19T06:40:08.182141+0000","last_clean":"2024-09-19T06:40:08.182141+0000","last_became_active":"2024-09-19T06:38:14.044457+0000","last_became_peered":"2024-09-19T06:38:14.044457+0000","last_unstale":"2024-09-19T06:40:08.182141+0000","last_undegraded":"2024-09-19T06:40:08.182141+0000","last_fullsized":"2024-09-19T06:40:08.182141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:06.342070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'7","reported_seq":263,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:18.816485+0000","last_change":"2024-09-19T06:38:12.039031+0000","last_active":"2024-09-19T06:40:18.816485+0000","last_peered":"2024-09-19T06:40:18.816485+0000","last_clean":"2024-09-19T06:40:18.816485+0000","last_became_active":"2024-09-19T06:38:12.038346+0000","last_became_peered":"2024-09-19T06:38:12.038346+0000","last_unstale":"2024-09-19T06:40:18.816485+0000","last_undegraded":"2024-09-19T06:40:18.816485+0000","last_fullsized":"2024-09-19T06:40:18.816485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:33.752330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273694+0000","last_change":"2024-09-19T06:38:14.045159+0000","last_active":"2024-09-19T06:40:08.273694+0000","last_peered":"2024-09-19T06:40:08.273694+0000","last_clean":"2024-09-19T06:40:08.273694+0000","last_became_active":"2024-09-19T06:38:14.044822+0000","last_became_peered":"2024-09-19T06:38:14.044822+0000","last_unstale":"2024-09-19T06:40:08.273694+0000","last_undegraded":"2024-09-19T06:40:08.273694+0000","last_fullsized":"2024-09-19T06:40:08.273694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:05.143507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076765+0000","last_change":"2024-09-19T06:38:12.037820+0000","last_active":"2024-09-19T06:40:08.076765+0000","last_peered":"2024-09-19T06:40:08.076765+0000","last_clean":"2024-09-19T06:40:08.076765+0000","last_became_active":"2024-09-19T06:38:12.037417+0000","last_became_peered":"2024-09-19T06:38:12.037417+0000","last_unstale":"2024-09-19T06:40:08.076765+0000","last_undegraded":"2024-09-19T06:40:08.076765+0000","last_fullsized":"2024-09-19T06:40:08.076765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:22.516704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274674+0000","last_change":"2024-09-19T06:38:14.048633+0000","last_active":"2024-09-19T06:40:08.274674+0000","last_peered":"2024-09-19T06:40:08.274674+0000","last_clean":"2024-09-19T06:40:08.274674+0000","last_became_active":"2024-09-19T06:38:14.048257+0000","last_became_peered":"2024-09-19T06:38:14.048257+0000","last_unstale":"2024-09-19T06:40:08.274674+0000","last_undegraded":"2024-09-19T06:40:08.274674+0000","last_fullsized":"2024-09-19T06:40:08.274674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:16.509071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257784+0000","last_change":"2024-09-19T06:38:12.047175+0000","last_active":"2024-09-19T06:40:08.257784+0000","last_peered":"2024-09-19T06:40:08.257784+0000","last_clean":"2024-09-19T06:40:08.257784+0000","last_became_active":"2024-09-19T06:38:12.046781+0000","last_became_peered":"2024-09-19T06:38:12.046781+0000","last_unstale":"2024-09-19T06:40:08.257784+0000","last_undegraded":"2024-09-19T06:40:08.257784+0000","last_fullsized":"2024-09-19T06:40:08.257784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:38.774803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273461+0000","last_change":"2024-09-19T06:38:23.067812+0000","last_active":"2024-09-19T06:40:08.273461+0000","last_peered":"2024-09-19T06:40:08.273461+0000","last_clean":"2024-09-19T06:40:08.273461+0000","last_became_active":"2024-09-19T06:38:23.067357+0000","last_became_peered":"2024-09-19T06:38:23.067357+0000","last_unstale":"2024-09-19T06:40:08.273461+0000","last_undegraded":"2024-09-19T06:40:08.273461+0000","last_fullsized":"2024-09-19T06:40:08.273461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:34.719243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'36","reported_seq":322,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:18.816508+0000","last_change":"2024-09-19T06:38:23.186703+0000","last_active":"2024-09-19T06:40:18.816508+0000","last_peered":"2024-09-19T06:40:18.816508+0000","last_clean":"2024-09-19T06:40:18.816508+0000","last_became_active":"2024-09-19T06:38:23.177212+0000","last_became_peered":"2024-09-19T06:38:23.177212+0000","last_unstale":"2024-09-19T06:40:18.816508+0000","last_undegraded":"2024-09-19T06:40:18.816508+0000","last_fullsized":"2024-09-19T06:40:18.816508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:46.884624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67065,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":242,"num_read_kb":187,"num_write":38,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185343+0000","last_change":"2024-09-19T06:38:14.054619+0000","last_active":"2024-09-19T06:40:08.185343+0000","last_peered":"2024-09-19T06:40:08.185343+0000","last_clean":"2024-09-19T06:40:08.185343+0000","last_became_active":"2024-09-19T06:38:14.054118+0000","last_became_peered":"2024-09-19T06:38:14.054118+0000","last_unstale":"2024-09-19T06:40:08.185343+0000","last_undegraded":"2024-09-19T06:40:08.185343+0000","last_fullsized":"2024-09-19T06:40:08.185343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:41.041603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076764+0000","last_change":"2024-09-19T06:38:12.040272+0000","last_active":"2024-09-19T06:40:08.076764+0000","last_peered":"2024-09-19T06:40:08.076764+0000","last_clean":"2024-09-19T06:40:08.076764+0000","last_became_active":"2024-09-19T06:38:12.039940+0000","last_became_peered":"2024-09-19T06:38:12.039940+0000","last_unstale":"2024-09-19T06:40:08.076764+0000","last_undegraded":"2024-09-19T06:40:08.076764+0000","last_fullsized":"2024-09-19T06:40:08.076764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:53.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275371+0000","last_change":"2024-09-19T06:38:14.049535+0000","last_active":"2024-09-19T06:40:08.275371+0000","last_peered":"2024-09-19T06:40:08.275371+0000","last_clean":"2024-09-19T06:40:08.275371+0000","last_became_active":"2024-09-19T06:38:14.049208+0000","last_became_peered":"2024-09-19T06:38:14.049208+0000","last_unstale":"2024-09-19T06:40:08.275371+0000","last_undegraded":"2024-09-19T06:40:08.275371+0000","last_fullsized":"2024-09-19T06:40:08.275371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:03.359786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257731+0000","last_change":"2024-09-19T06:38:12.037346+0000","last_active":"2024-09-19T06:40:08.257731+0000","last_peered":"2024-09-19T06:40:08.257731+0000","last_clean":"2024-09-19T06:40:08.257731+0000","last_became_active":"2024-09-19T06:38:12.036986+0000","last_became_peered":"2024-09-19T06:38:12.036986+0000","last_unstale":"2024-09-19T06:40:08.257731+0000","last_undegraded":"2024-09-19T06:40:08.257731+0000","last_fullsized":"2024-09-19T06:40:08.257731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:26.009299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076694+0000","last_change":"2024-09-19T06:38:14.059454+0000","last_active":"2024-09-19T06:40:08.076694+0000","last_peered":"2024-09-19T06:40:08.076694+0000","last_clean":"2024-09-19T06:40:08.076694+0000","last_became_active":"2024-09-19T06:38:14.058996+0000","last_became_peered":"2024-09-19T06:38:14.058996+0000","last_unstale":"2024-09-19T06:40:08.076694+0000","last_undegraded":"2024-09-19T06:40:08.076694+0000","last_fullsized":"2024-09-19T06:40:08.076694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:54.645395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":152,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.814912+0000","last_change":"2024-09-19T06:38:12.043687+0000","last_active":"2024-09-19T06:40:17.814912+0000","last_peered":"2024-09-19T06:40:17.814912+0000","last_clean":"2024-09-19T06:40:17.814912+0000","last_became_active":"2024-09-19T06:38:12.043268+0000","last_became_peered":"2024-09-19T06:38:12.043268+0000","last_unstale":"2024-09-19T06:40:17.814912+0000","last_undegraded":"2024-09-19T06:40:17.814912+0000","last_fullsized":"2024-09-19T06:40:17.814912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:18.753736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076233+0000","last_change":"2024-09-19T06:38:14.052184+0000","last_active":"2024-09-19T06:40:08.076233+0000","last_peered":"2024-09-19T06:40:08.076233+0000","last_clean":"2024-09-19T06:40:08.076233+0000","last_became_active":"2024-09-19T06:38:14.051736+0000","last_became_peered":"2024-09-19T06:38:14.051736+0000","last_unstale":"2024-09-19T06:40:08.076233+0000","last_undegraded":"2024-09-19T06:40:08.076233+0000","last_fullsized":"2024-09-19T06:40:08.076233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:12.166272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:12.048418+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:12.047948+0000","last_became_peered":"2024-09-19T06:38:12.047948+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:06.059904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.181946+0000","last_change":"2024-09-19T06:38:23.175961+0000","last_active":"2024-09-19T06:40:08.181946+0000","last_peered":"2024-09-19T06:40:08.181946+0000","last_clean":"2024-09-19T06:40:08.181946+0000","last_became_active":"2024-09-19T06:38:23.175629+0000","last_became_peered":"2024-09-19T06:38:23.175629+0000","last_unstale":"2024-09-19T06:40:08.181946+0000","last_undegraded":"2024-09-19T06:40:08.181946+0000","last_fullsized":"2024-09-19T06:40:08.181946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185296+0000","last_change":"2024-09-19T06:38:12.038945+0000","last_active":"2024-09-19T06:40:08.185296+0000","last_peered":"2024-09-19T06:40:08.185296+0000","last_clean":"2024-09-19T06:40:08.185296+0000","last_became_active":"2024-09-19T06:38:12.038571+0000","last_became_peered":"2024-09-19T06:38:12.038571+0000","last_unstale":"2024-09-19T06:40:08.185296+0000","last_undegraded":"2024-09-19T06:40:08.185296+0000","last_fullsized":"2024-09-19T06:40:08.185296+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:57.887070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193798+0000","last_change":"2024-09-19T06:38:14.056481+0000","last_active":"2024-09-19T06:40:08.193798+0000","last_peered":"2024-09-19T06:40:08.193798+0000","last_clean":"2024-09-19T06:40:08.193798+0000","last_became_active":"2024-09-19T06:38:14.056177+0000","last_became_peered":"2024-09-19T06:38:14.056177+0000","last_unstale":"2024-09-19T06:40:08.193798+0000","last_undegraded":"2024-09-19T06:40:08.193798+0000","last_fullsized":"2024-09-19T06:40:08.193798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:06.734802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.276561+0000","last_change":"2024-09-19T06:38:12.038826+0000","last_active":"2024-09-19T06:40:08.276561+0000","last_peered":"2024-09-19T06:40:08.276561+0000","last_clean":"2024-09-19T06:40:08.276561+0000","last_became_active":"2024-09-19T06:38:12.038516+0000","last_became_peered":"2024-09-19T06:38:12.038516+0000","last_unstale":"2024-09-19T06:40:08.276561+0000","last_undegraded":"2024-09-19T06:40:08.276561+0000","last_fullsized":"2024-09-19T06:40:08.276561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:16.709742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076941+0000","last_change":"2024-09-19T06:38:14.053888+0000","last_active":"2024-09-19T06:40:08.076941+0000","last_peered":"2024-09-19T06:40:08.076941+0000","last_clean":"2024-09-19T06:40:08.076941+0000","last_became_active":"2024-09-19T06:38:14.053524+0000","last_became_peered":"2024-09-19T06:38:14.053524+0000","last_unstale":"2024-09-19T06:40:08.076941+0000","last_undegraded":"2024-09-19T06:40:08.076941+0000","last_fullsized":"2024-09-19T06:40:08.076941+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:54.853786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'67","reported_seq":111,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.601711+0000","last_change":"2024-09-19T06:39:23.715975+0000","last_active":"2024-09-19T06:40:17.601711+0000","last_peered":"2024-09-19T06:40:17.601711+0000","last_clean":"2024-09-19T06:40:17.601711+0000","last_became_active":"2024-09-19T06:39:23.713052+0000","last_became_peered":"2024-09-19T06:39:23.713052+0000","last_unstale":"2024-09-19T06:40:17.601711+0000","last_undegraded":"2024-09-19T06:40:17.601711+0000","last_fullsized":"2024-09-19T06:40:17.601711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:42.887751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076532+0000","last_change":"2024-09-19T06:38:14.052210+0000","last_active":"2024-09-19T06:40:08.076532+0000","last_peered":"2024-09-19T06:40:08.076532+0000","last_clean":"2024-09-19T06:40:08.076532+0000","last_became_active":"2024-09-19T06:38:14.051803+0000","last_became_peered":"2024-09-19T06:38:14.051803+0000","last_unstale":"2024-09-19T06:40:08.076532+0000","last_undegraded":"2024-09-19T06:40:08.076532+0000","last_fullsized":"2024-09-19T06:40:08.076532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:40.751672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'8","reported_seq":154,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.836884+0000","last_change":"2024-09-19T06:38:12.118077+0000","last_active":"2024-09-19T06:40:17.836884+0000","last_peered":"2024-09-19T06:40:17.836884+0000","last_clean":"2024-09-19T06:40:17.836884+0000","last_became_active":"2024-09-19T06:38:12.117690+0000","last_became_peered":"2024-09-19T06:38:12.117690+0000","last_unstale":"2024-09-19T06:40:17.836884+0000","last_undegraded":"2024-09-19T06:40:17.836884+0000","last_fullsized":"2024-09-19T06:40:17.836884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:00.828335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076689+0000","last_change":"2024-09-19T06:38:14.054014+0000","last_active":"2024-09-19T06:40:08.076689+0000","last_peered":"2024-09-19T06:40:08.076689+0000","last_clean":"2024-09-19T06:40:08.076689+0000","last_became_active":"2024-09-19T06:38:14.053349+0000","last_became_peered":"2024-09-19T06:38:14.053349+0000","last_unstale":"2024-09-19T06:40:08.076689+0000","last_undegraded":"2024-09-19T06:40:08.076689+0000","last_fullsized":"2024-09-19T06:40:08.076689+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:40.117720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"86'148","reported_seq":395,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:10.190486+0000","last_change":"2024-09-19T06:37:02.166696+0000","last_active":"2024-09-19T06:40:10.190486+0000","last_peered":"2024-09-19T06:40:10.190486+0000","last_clean":"2024-09-19T06:40:10.190486+0000","last_became_active":"2024-09-19T06:37:02.166225+0000","last_became_peered":"2024-09-19T06:37:02.166225+0000","last_unstale":"2024-09-19T06:40:10.190486+0000","last_undegraded":"2024-09-19T06:40:10.190486+0000","last_fullsized":"2024-09-19T06:40:10.190486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:33:40.535354+0000","last_clean_scrub_stamp":"2024-09-19T06:33:40.535354+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:46.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274223+0000","last_change":"2024-09-19T06:38:12.044465+0000","last_active":"2024-09-19T06:40:08.274223+0000","last_peered":"2024-09-19T06:40:08.274223+0000","last_clean":"2024-09-19T06:40:08.274223+0000","last_became_active":"2024-09-19T06:38:12.044042+0000","last_became_peered":"2024-09-19T06:38:12.044042+0000","last_unstale":"2024-09-19T06:40:08.274223+0000","last_undegraded":"2024-09-19T06:40:08.274223+0000","last_fullsized":"2024-09-19T06:40:08.274223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:40.759264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075820+0000","last_change":"2024-09-19T06:38:14.045102+0000","last_active":"2024-09-19T06:40:08.075820+0000","last_peered":"2024-09-19T06:40:08.075820+0000","last_clean":"2024-09-19T06:40:08.075820+0000","last_became_active":"2024-09-19T06:38:14.044785+0000","last_became_peered":"2024-09-19T06:38:14.044785+0000","last_unstale":"2024-09-19T06:40:08.075820+0000","last_undegraded":"2024-09-19T06:40:08.075820+0000","last_fullsized":"2024-09-19T06:40:08.075820+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:57.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076444+0000","last_change":"2024-09-19T06:39:24.353205+0000","last_active":"2024-09-19T06:40:08.076444+0000","last_peered":"2024-09-19T06:40:08.076444+0000","last_clean":"2024-09-19T06:40:08.076444+0000","last_became_active":"2024-09-19T06:39:24.350315+0000","last_became_peered":"2024-09-19T06:39:24.350315+0000","last_unstale":"2024-09-19T06:40:08.076444+0000","last_undegraded":"2024-09-19T06:40:08.076444+0000","last_fullsized":"2024-09-19T06:40:08.076444+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:32.467330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,8],"acting":[7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275292+0000","last_change":"2024-09-19T06:38:14.054623+0000","last_active":"2024-09-19T06:40:08.275292+0000","last_peered":"2024-09-19T06:40:08.275292+0000","last_clean":"2024-09-19T06:40:08.275292+0000","last_became_active":"2024-09-19T06:38:14.054124+0000","last_became_peered":"2024-09-19T06:38:14.054124+0000","last_unstale":"2024-09-19T06:40:08.275292+0000","last_undegraded":"2024-09-19T06:40:08.275292+0000","last_fullsized":"2024-09-19T06:40:08.275292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:06:33.251059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":151,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.814069+0000","last_change":"2024-09-19T06:38:12.047284+0000","last_active":"2024-09-19T06:40:17.814069+0000","last_peered":"2024-09-19T06:40:17.814069+0000","last_clean":"2024-09-19T06:40:17.814069+0000","last_became_active":"2024-09-19T06:38:12.046886+0000","last_became_peered":"2024-09-19T06:38:12.046886+0000","last_unstale":"2024-09-19T06:40:17.814069+0000","last_undegraded":"2024-09-19T06:40:17.814069+0000","last_fullsized":"2024-09-19T06:40:17.814069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:15.030007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.257725+0000","last_change":"2024-09-19T06:38:14.049351+0000","last_active":"2024-09-19T06:40:08.257725+0000","last_peered":"2024-09-19T06:40:08.257725+0000","last_clean":"2024-09-19T06:40:08.257725+0000","last_became_active":"2024-09-19T06:38:14.048792+0000","last_became_peered":"2024-09-19T06:38:14.048792+0000","last_unstale":"2024-09-19T06:40:08.257725+0000","last_undegraded":"2024-09-19T06:40:08.257725+0000","last_fullsized":"2024-09-19T06:40:08.257725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:30.431378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'9","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:18.837974+0000","last_change":"2024-09-19T06:38:12.037155+0000","last_active":"2024-09-19T06:40:18.837974+0000","last_peered":"2024-09-19T06:40:18.837974+0000","last_clean":"2024-09-19T06:40:18.837974+0000","last_became_active":"2024-09-19T06:38:12.036536+0000","last_became_peered":"2024-09-19T06:38:12.036536+0000","last_unstale":"2024-09-19T06:40:18.837974+0000","last_undegraded":"2024-09-19T06:40:18.837974+0000","last_fullsized":"2024-09-19T06:40:18.837974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:41.014783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196682+0000","last_change":"2024-09-19T06:38:14.055724+0000","last_active":"2024-09-19T06:40:08.196682+0000","last_peered":"2024-09-19T06:40:08.196682+0000","last_clean":"2024-09-19T06:40:08.196682+0000","last_became_active":"2024-09-19T06:38:14.054457+0000","last_became_peered":"2024-09-19T06:38:14.054457+0000","last_unstale":"2024-09-19T06:40:08.196682+0000","last_undegraded":"2024-09-19T06:40:08.196682+0000","last_fullsized":"2024-09-19T06:40:08.196682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:47.653709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182631+0000","last_change":"2024-09-19T06:38:12.049197+0000","last_active":"2024-09-19T06:40:08.182631+0000","last_peered":"2024-09-19T06:40:08.182631+0000","last_clean":"2024-09-19T06:40:08.182631+0000","last_became_active":"2024-09-19T06:38:12.048863+0000","last_became_peered":"2024-09-19T06:38:12.048863+0000","last_unstale":"2024-09-19T06:40:08.182631+0000","last_undegraded":"2024-09-19T06:40:08.182631+0000","last_fullsized":"2024-09-19T06:40:08.182631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:25.198355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.196635+0000","last_change":"2024-09-19T06:38:14.042991+0000","last_active":"2024-09-19T06:40:08.196635+0000","last_peered":"2024-09-19T06:40:08.196635+0000","last_clean":"2024-09-19T06:40:08.196635+0000","last_became_active":"2024-09-19T06:38:14.042511+0000","last_became_peered":"2024-09-19T06:38:14.042511+0000","last_unstale":"2024-09-19T06:40:08.196635+0000","last_undegraded":"2024-09-19T06:40:08.196635+0000","last_fullsized":"2024-09-19T06:40:08.196635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:38.212838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193790+0000","last_change":"2024-09-19T06:38:23.064456+0000","last_active":"2024-09-19T06:40:08.193790+0000","last_peered":"2024-09-19T06:40:08.193790+0000","last_clean":"2024-09-19T06:40:08.193790+0000","last_became_active":"2024-09-19T06:38:23.064051+0000","last_became_peered":"2024-09-19T06:38:23.064051+0000","last_unstale":"2024-09-19T06:40:08.193790+0000","last_undegraded":"2024-09-19T06:40:08.193790+0000","last_fullsized":"2024-09-19T06:40:08.193790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:58.548420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.275853+0000","last_change":"2024-09-19T06:38:14.048612+0000","last_active":"2024-09-19T06:40:08.275853+0000","last_peered":"2024-09-19T06:40:08.275853+0000","last_clean":"2024-09-19T06:40:08.275853+0000","last_became_active":"2024-09-19T06:38:14.048294+0000","last_became_peered":"2024-09-19T06:38:14.048294+0000","last_unstale":"2024-09-19T06:40:08.275853+0000","last_undegraded":"2024-09-19T06:40:08.275853+0000","last_fullsized":"2024-09-19T06:40:08.275853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:55.892149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'103","reported_seq":223,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:17.949927+0000","last_change":"2024-09-19T06:38:12.035269+0000","last_active":"2024-09-19T06:40:17.949927+0000","last_peered":"2024-09-19T06:40:17.949927+0000","last_clean":"2024-09-19T06:40:17.949927+0000","last_became_active":"2024-09-19T06:38:12.034841+0000","last_became_peered":"2024-09-19T06:38:12.034841+0000","last_unstale":"2024-09-19T06:40:17.949927+0000","last_undegraded":"2024-09-19T06:40:17.949927+0000","last_fullsized":"2024-09-19T06:40:17.949927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:19.642572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":187,"num_write_kb":1284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076503+0000","last_change":"2024-09-19T06:38:14.052492+0000","last_active":"2024-09-19T06:40:08.076503+0000","last_peered":"2024-09-19T06:40:08.076503+0000","last_clean":"2024-09-19T06:40:08.076503+0000","last_became_active":"2024-09-19T06:38:14.052191+0000","last_became_peered":"2024-09-19T06:38:14.052191+0000","last_unstale":"2024-09-19T06:40:08.076503+0000","last_undegraded":"2024-09-19T06:40:08.076503+0000","last_fullsized":"2024-09-19T06:40:08.076503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:34.006480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274336+0000","last_change":"2024-09-19T06:38:12.118430+0000","last_active":"2024-09-19T06:40:08.274336+0000","last_peered":"2024-09-19T06:40:08.274336+0000","last_clean":"2024-09-19T06:40:08.274336+0000","last_became_active":"2024-09-19T06:38:12.118065+0000","last_became_peered":"2024-09-19T06:38:12.118065+0000","last_unstale":"2024-09-19T06:40:08.274336+0000","last_undegraded":"2024-09-19T06:40:08.274336+0000","last_fullsized":"2024-09-19T06:40:08.274336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:25.861922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274974+0000","last_change":"2024-09-19T06:38:23.811305+0000","last_active":"2024-09-19T06:40:08.274974+0000","last_peered":"2024-09-19T06:40:08.274974+0000","last_clean":"2024-09-19T06:40:08.274974+0000","last_became_active":"2024-09-19T06:38:23.810840+0000","last_became_peered":"2024-09-19T06:38:23.810840+0000","last_unstale":"2024-09-19T06:40:08.274974+0000","last_undegraded":"2024-09-19T06:40:08.274974+0000","last_fullsized":"2024-09-19T06:40:08.274974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.019065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273364+0000","last_change":"2024-09-19T06:38:12.047670+0000","last_active":"2024-09-19T06:40:08.273364+0000","last_peered":"2024-09-19T06:40:08.273364+0000","last_clean":"2024-09-19T06:40:08.273364+0000","last_became_active":"2024-09-19T06:38:12.047312+0000","last_became_peered":"2024-09-19T06:38:12.047312+0000","last_unstale":"2024-09-19T06:40:08.273364+0000","last_undegraded":"2024-09-19T06:40:08.273364+0000","last_fullsized":"2024-09-19T06:40:08.273364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:47.477945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.184951+0000","last_change":"2024-09-19T06:38:14.047210+0000","last_active":"2024-09-19T06:40:08.184951+0000","last_peered":"2024-09-19T06:40:08.184951+0000","last_clean":"2024-09-19T06:40:08.184951+0000","last_became_active":"2024-09-19T06:38:14.046836+0000","last_became_peered":"2024-09-19T06:38:14.046836+0000","last_unstale":"2024-09-19T06:40:08.184951+0000","last_undegraded":"2024-09-19T06:40:08.184951+0000","last_fullsized":"2024-09-19T06:40:08.184951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:14.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075584+0000","last_change":"2024-09-19T06:38:12.032692+0000","last_active":"2024-09-19T06:40:08.075584+0000","last_peered":"2024-09-19T06:40:08.075584+0000","last_clean":"2024-09-19T06:40:08.075584+0000","last_became_active":"2024-09-19T06:38:12.031874+0000","last_became_peered":"2024-09-19T06:38:12.031874+0000","last_unstale":"2024-09-19T06:40:08.075584+0000","last_undegraded":"2024-09-19T06:40:08.075584+0000","last_fullsized":"2024-09-19T06:40:08.075584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:12.787964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.193683+0000","last_change":"2024-09-19T06:38:14.053504+0000","last_active":"2024-09-19T06:40:08.193683+0000","last_peered":"2024-09-19T06:40:08.193683+0000","last_clean":"2024-09-19T06:40:08.193683+0000","last_became_active":"2024-09-19T06:38:14.053148+0000","last_became_peered":"2024-09-19T06:38:14.053148+0000","last_unstale":"2024-09-19T06:40:08.193683+0000","last_undegraded":"2024-09-19T06:40:08.193683+0000","last_fullsized":"2024-09-19T06:40:08.193683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:03:29.809295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076736+0000","last_change":"2024-09-19T06:38:12.038884+0000","last_active":"2024-09-19T06:40:08.076736+0000","last_peered":"2024-09-19T06:40:08.076736+0000","last_clean":"2024-09-19T06:40:08.076736+0000","last_became_active":"2024-09-19T06:38:12.038532+0000","last_became_peered":"2024-09-19T06:38:12.038532+0000","last_unstale":"2024-09-19T06:40:08.076736+0000","last_undegraded":"2024-09-19T06:40:08.076736+0000","last_fullsized":"2024-09-19T06:40:08.076736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:21.348690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.075777+0000","last_change":"2024-09-19T06:38:14.045761+0000","last_active":"2024-09-19T06:40:08.075777+0000","last_peered":"2024-09-19T06:40:08.075777+0000","last_clean":"2024-09-19T06:40:08.075777+0000","last_became_active":"2024-09-19T06:38:14.045467+0000","last_became_peered":"2024-09-19T06:38:14.045467+0000","last_unstale":"2024-09-19T06:40:08.075777+0000","last_undegraded":"2024-09-19T06:40:08.075777+0000","last_fullsized":"2024-09-19T06:40:08.075777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.917945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185144+0000","last_change":"2024-09-19T06:39:23.748032+0000","last_active":"2024-09-19T06:40:08.185144+0000","last_peered":"2024-09-19T06:40:08.185144+0000","last_clean":"2024-09-19T06:40:08.185144+0000","last_became_active":"2024-09-19T06:39:23.744288+0000","last_became_peered":"2024-09-19T06:39:23.744288+0000","last_unstale":"2024-09-19T06:40:08.185144+0000","last_undegraded":"2024-09-19T06:40:08.185144+0000","last_fullsized":"2024-09-19T06:40:08.185144+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:50.668043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4],"acting":[8,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076545+0000","last_change":"2024-09-19T06:38:14.053935+0000","last_active":"2024-09-19T06:40:08.076545+0000","last_peered":"2024-09-19T06:40:08.076545+0000","last_clean":"2024-09-19T06:40:08.076545+0000","last_became_active":"2024-09-19T06:38:14.053542+0000","last_became_peered":"2024-09-19T06:38:14.053542+0000","last_unstale":"2024-09-19T06:40:08.076545+0000","last_undegraded":"2024-09-19T06:40:08.076545+0000","last_fullsized":"2024-09-19T06:40:08.076545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:25.375786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.182280+0000","last_change":"2024-09-19T06:38:23.177133+0000","last_active":"2024-09-19T06:40:08.182280+0000","last_peered":"2024-09-19T06:40:08.182280+0000","last_clean":"2024-09-19T06:40:08.182280+0000","last_became_active":"2024-09-19T06:38:23.176810+0000","last_became_peered":"2024-09-19T06:38:23.176810+0000","last_unstale":"2024-09-19T06:40:08.182280+0000","last_undegraded":"2024-09-19T06:40:08.182280+0000","last_fullsized":"2024-09-19T06:40:08.182280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:56.307720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185240+0000","last_change":"2024-09-19T06:38:12.042699+0000","last_active":"2024-09-19T06:40:08.185240+0000","last_peered":"2024-09-19T06:40:08.185240+0000","last_clean":"2024-09-19T06:40:08.185240+0000","last_became_active":"2024-09-19T06:38:12.042148+0000","last_became_peered":"2024-09-19T06:38:12.042148+0000","last_unstale":"2024-09-19T06:40:08.185240+0000","last_undegraded":"2024-09-19T06:40:08.185240+0000","last_fullsized":"2024-09-19T06:40:08.185240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:32.953596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.273371+0000","last_change":"2024-09-19T06:38:14.043279+0000","last_active":"2024-09-19T06:40:08.273371+0000","last_peered":"2024-09-19T06:40:08.273371+0000","last_clean":"2024-09-19T06:40:08.273371+0000","last_became_active":"2024-09-19T06:38:14.042914+0000","last_became_peered":"2024-09-19T06:38:14.042914+0000","last_unstale":"2024-09-19T06:40:08.273371+0000","last_undegraded":"2024-09-19T06:40:08.273371+0000","last_fullsized":"2024-09-19T06:40:08.273371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:22.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'13","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.185441+0000","last_change":"2024-09-19T06:39:23.719397+0000","last_active":"2024-09-19T06:40:08.185441+0000","last_peered":"2024-09-19T06:40:08.185441+0000","last_clean":"2024-09-19T06:40:08.185441+0000","last_became_active":"2024-09-19T06:39:23.709128+0000","last_became_peered":"2024-09-19T06:39:23.709128+0000","last_unstale":"2024-09-19T06:40:08.185441+0000","last_undegraded":"2024-09-19T06:40:08.185441+0000","last_fullsized":"2024-09-19T06:40:08.185441+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:46.092401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.274590+0000","last_change":"2024-09-19T06:38:14.041552+0000","last_active":"2024-09-19T06:40:08.274590+0000","last_peered":"2024-09-19T06:40:08.274590+0000","last_clean":"2024-09-19T06:40:08.274590+0000","last_became_active":"2024-09-19T06:38:14.041187+0000","last_became_peered":"2024-09-19T06:38:14.041187+0000","last_unstale":"2024-09-19T06:40:08.274590+0000","last_undegraded":"2024-09-19T06:40:08.274590+0000","last_fullsized":"2024-09-19T06:40:08.274590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:17.390457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076417+0000","last_change":"2024-09-19T06:38:12.047436+0000","last_active":"2024-09-19T06:40:08.076417+0000","last_peered":"2024-09-19T06:40:08.076417+0000","last_clean":"2024-09-19T06:40:08.076417+0000","last_became_active":"2024-09-19T06:38:12.046961+0000","last_became_peered":"2024-09-19T06:38:12.046961+0000","last_unstale":"2024-09-19T06:40:08.076417+0000","last_undegraded":"2024-09-19T06:40:08.076417+0000","last_fullsized":"2024-09-19T06:40:08.076417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.503702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:08.076262+0000","last_change":"2024-09-19T06:38:14.049660+0000","last_active":"2024-09-19T06:40:08.076262+0000","last_peered":"2024-09-19T06:40:08.076262+0000","last_clean":"2024-09-19T06:40:08.076262+0000","last_became_active":"2024-09-19T06:38:14.049375+0000","last_became_peered":"2024-09-19T06:38:14.049375+0000","last_unstale":"2024-09-19T06:40:08.076262+0000","last_undegraded":"2024-09-19T06:40:08.076262+0000","last_fullsized":"2024-09-19T06:40:08.076262+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:13.025350+0000","last_clean_scrub_stamp":"2024-09-19T06:38:13.025350+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:08.783892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'15","reported_seq":171,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T06:40:18.837439+0000","last_change":"2024-09-19T06:38:23.071068+0000","last_active":"2024-09-19T06:40:18.837439+0000","last_peered":"2024-09-19T06:40:18.837439+0000","last_clean":"2024-09-19T06:40:18.837439+0000","last_became_active":"2024-09-19T06:38:23.067129+0000","last_became_peered":"2024-09-19T06:38:23.067129+0000","last_unstale":"2024-09-19T06:40:18.837439+0000","last_undegraded":"2024-09-19T06:40:18.837439+0000","last_fullsized":"2024-09-19T06:40:18.837439+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:38:11.022075+0000","last_clean_scrub_stamp":"2024-09-19T06:38:11.022075+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:15.387758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":798024,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1539,"num_read_kb":992,"num_write":503,"num_write_kb":2382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2264,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2764800,"data_stored":2394072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":383,"ondisk_log_size":383,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547238,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1306624,"data_stored":794721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41580,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93703572,"statfs":{"total":95995035648,"available":95952457728,"internally_reserved":0,"allocated":2002944,"data_stored":1452099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939696,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28372,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716780,"statfs":{"total":95995035648,"available":95965982720,"internally_reserved":0,"allocated":1380352,"data_stored":858526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168628,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28352,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716800,"statfs":{"total":95995035648,"available":95966003200,"internally_reserved":0,"allocated":1359872,"data_stored":858120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1059977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528383,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":970752,"data_stored":466262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1589248,"data_stored":1057957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":533502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28816,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716336,"statfs":{"total":95995035648,"available":95965528064,"internally_reserved":0,"allocated":1712128,"data_stored":1186300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":466465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40528,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704624,"statfs":{"total":95995035648,"available":95953534976,"internally_reserved":0,"allocated":1048576,"data_stored":534912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":467293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":69314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":397426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":330533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:40:23.518 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:40:23.785 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:24.066 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:23 smithi012 ceph-mon[30937]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-19T06:40:24.066 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:23 smithi012 ceph-mon[30937]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:23 smithi016 ceph-mon[34911]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-19T06:40:24.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:23 smithi016 ceph-mon[34911]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.286+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2221255451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc948100e20 msgr2=0x7fc948101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.286+0000 7fc94f9f3640 1 --2- 172.21.15.12:0/2221255451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc948100e20 0x7fc948101200 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc944009900 tx=0x7fc94402a480 comp rx=0 tx=0).stop 2024-09-19T06:40:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.286+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2221255451 shutdown_connections 2024-09-19T06:40:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.286+0000 7fc94f9f3640 1 --2- 172.21.15.12:0/2221255451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc948102ef0 0x7fc94810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.286+0000 7fc94f9f3640 1 --2- 172.21.15.12:0/2221255451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc948102570 0x7fc9481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.286+0000 7fc94f9f3640 1 --2- 172.21.15.12:0/2221255451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc948100e20 0x7fc948101200 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.286+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2221255451 >> 172.21.15.12:0/2221255451 conn(0x7fc9480fc7d0 msgr2=0x7fc9480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.286+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2221255451 shutdown_connections 2024-09-19T06:40:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.286+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2221255451 wait complete. 2024-09-19T06:40:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94f9f3640 1 Processor -- start 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94f9f3640 1 -- start start 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94f9f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc948100e20 0x7fc9481971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94f9f3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc948102570 0x7fc948197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94f9f3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc948102ef0 0x7fc948197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94f9f3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc948110f80 con 0x7fc948100e20 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94f9f3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc948110e00 con 0x7fc948102570 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94f9f3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc948111100 con 0x7fc948102ef0 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94d78f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc948100e20 0x7fc9481971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94d78f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc948100e20 0x7fc9481971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44770/0 (socket says 172.21.15.12:44770) 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94d78f640 1 -- 172.21.15.12:0/2473588353 learned_addr learned my addr 172.21.15.12:0/2473588353 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94df90640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc948102ef0 0x7fc948197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.287+0000 7fc94cf8e640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc948102570 0x7fc948197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc94d78f640 1 -- 172.21.15.12:0/2473588353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc948102ef0 msgr2=0x7fc948197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:24.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc94d78f640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc948102ef0 0x7fc948197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:24.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc94d78f640 1 -- 172.21.15.12:0/2473588353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc948102570 msgr2=0x7fc948197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:24.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc94d78f640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc948102570 0x7fc948197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:24.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc94d78f640 1 -- 172.21.15.12:0/2473588353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9481a6a30 con 0x7fc948100e20 2024-09-19T06:40:24.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc94cf8e640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc948102570 0x7fc948197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:24.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc94d78f640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc948100e20 0x7fc9481971c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc944006010 tx=0x7fc944003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc93e7fc640 1 -- 172.21.15.12:0/2473588353 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94403f070 con 0x7fc948100e20 2024-09-19T06:40:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc93e7fc640 1 -- 172.21.15.12:0/2473588353 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc944031c30 con 0x7fc948100e20 2024-09-19T06:40:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2473588353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9481a6cc0 con 0x7fc948100e20 2024-09-19T06:40:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc93e7fc640 1 -- 172.21.15.12:0/2473588353 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944035030 con 0x7fc948100e20 2024-09-19T06:40:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.288+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2473588353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9481a71a0 con 0x7fc948100e20 2024-09-19T06:40:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.289+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2473588353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc948101200 con 0x7fc948100e20 2024-09-19T06:40:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.291+0000 7fc93e7fc640 1 -- 172.21.15.12:0/2473588353 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fc944042070 con 0x7fc948100e20 2024-09-19T06:40:24.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.291+0000 7fc93e7fc640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9340a34c0 0x7fc9340a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:24.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.291+0000 7fc94cf8e640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9340a34c0 0x7fc9340a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:24.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.291+0000 7fc93e7fc640 1 -- 172.21.15.12:0/2473588353 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc9440f0b80 con 0x7fc948100e20 2024-09-19T06:40:24.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.292+0000 7fc94cf8e640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9340a34c0 0x7fc9340a5980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc948199320 tx=0x7fc938005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:24.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.294+0000 7fc93e7fc640 1 -- 172.21.15.12:0/2473588353 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9440bd370 con 0x7fc948100e20 2024-09-19T06:40:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:23 smithi173 ceph-mon[35349]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-19T06:40:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:23 smithi173 ceph-mon[35349]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:40:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.505+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2473588353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc94806a560 con 0x7fc948100e20 2024-09-19T06:40:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.506+0000 7fc93e7fc640 1 -- 172.21.15.12:0/2473588353 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7fc94806a560 con 0x7fc948100e20 2024-09-19T06:40:24.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:24.508 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-19T06:40:07:090225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:40:07.040062+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:40:24.508 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-19T06:40:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.509+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2473588353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9340a34c0 msgr2=0x7fc9340a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.509+0000 7fc94f9f3640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9340a34c0 0x7fc9340a5980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc948199320 tx=0x7fc938005f90 comp rx=0 tx=0).stop 2024-09-19T06:40:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.509+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2473588353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc948100e20 msgr2=0x7fc9481971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.509+0000 7fc94f9f3640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc948100e20 0x7fc9481971c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc944006010 tx=0x7fc944003c10 comp rx=0 tx=0).stop 2024-09-19T06:40:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.509+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2473588353 shutdown_connections 2024-09-19T06:40:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.509+0000 7fc94f9f3640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9340a34c0 0x7fc9340a5980 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.509+0000 7fc94f9f3640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc948102ef0 0x7fc948197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.509+0000 7fc94f9f3640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc948102570 0x7fc948197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.509+0000 7fc94f9f3640 1 --2- 172.21.15.12:0/2473588353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc948100e20 0x7fc9481971c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.509+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2473588353 >> 172.21.15.12:0/2473588353 conn(0x7fc9480fc7d0 msgr2=0x7fc9480fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.510+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2473588353 shutdown_connections 2024-09-19T06:40:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:24.510+0000 7fc94f9f3640 1 -- 172.21.15.12:0/2473588353 wait complete. 2024-09-19T06:40:25.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:24 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2473588353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:25.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:40:25.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:24 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2473588353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:25.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:24 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2473588353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:25.454 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:25.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.926+0000 7f6f2a501640 1 -- 172.21.15.12:0/1496576567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24102790 msgr2=0x7f6f241067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.926+0000 7f6f2a501640 1 --2- 172.21.15.12:0/1496576567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24102790 0x7f6f241067e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009900 tx=0x7f6f0c02a410 comp rx=0 tx=0).stop 2024-09-19T06:40:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.926+0000 7f6f2a501640 1 -- 172.21.15.12:0/1496576567 shutdown_connections 2024-09-19T06:40:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.926+0000 7f6f2a501640 1 --2- 172.21.15.12:0/1496576567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24106f10 0x7f6f2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.926+0000 7f6f2a501640 1 --2- 172.21.15.12:0/1496576567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24102790 0x7f6f241067e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.926+0000 7f6f2a501640 1 --2- 172.21.15.12:0/1496576567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24101de0 0x7f6f241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.926+0000 7f6f2a501640 1 -- 172.21.15.12:0/1496576567 >> 172.21.15.12:0/1496576567 conn(0x7f6f240fd8c0 msgr2=0x7f6f240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.926+0000 7f6f2a501640 1 -- 172.21.15.12:0/1496576567 shutdown_connections 2024-09-19T06:40:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.926+0000 7f6f2a501640 1 -- 172.21.15.12:0/1496576567 wait complete. 2024-09-19T06:40:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.926+0000 7f6f2a501640 1 Processor -- start 2024-09-19T06:40:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f2a501640 1 -- start start 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f2a501640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24101de0 0x7f6f241983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f2a501640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24102790 0x7f6f241988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f2a501640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24106f10 0x7f6f2419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f2a501640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24111f70 con 0x7f6f24106f10 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f2a501640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24111df0 con 0x7f6f24102790 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f2a501640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241120f0 con 0x7f6f24101de0 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f28a9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24106f10 0x7f6f2419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f28a9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24106f10 0x7f6f2419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44792/0 (socket says 172.21.15.12:44792) 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f28a9e640 1 -- 172.21.15.12:0/1784034434 learned_addr learned my addr 172.21.15.12:0/1784034434 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f1bfff640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24102790 0x7f6f241988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f23fff640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24101de0 0x7f6f241983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f28a9e640 1 -- 172.21.15.12:0/1784034434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24101de0 msgr2=0x7f6f241983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f28a9e640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24101de0 0x7f6f241983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f28a9e640 1 -- 172.21.15.12:0/1784034434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24102790 msgr2=0x7f6f241988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f28a9e640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24102790 0x7f6f241988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f28a9e640 1 -- 172.21.15.12:0/1784034434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2419d360 con 0x7f6f24106f10 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.927+0000 7f6f28a9e640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24106f10 0x7f6f2419cc80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00cce0 tx=0x7f6f1c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.928+0000 7f6f21ffb640 1 -- 172.21.15.12:0/1784034434 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00f450 con 0x7f6f24106f10 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.928+0000 7f6f21ffb640 1 -- 172.21.15.12:0/1784034434 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f1c00fad0 con 0x7f6f24106f10 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.928+0000 7f6f2a501640 1 -- 172.21.15.12:0/1784034434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2419d650 con 0x7f6f24106f10 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.928+0000 7f6f21ffb640 1 -- 172.21.15.12:0/1784034434 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c018c10 con 0x7f6f24106f10 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.928+0000 7f6f2a501640 1 -- 172.21.15.12:0/1784034434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f241a4f30 con 0x7f6f24106f10 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.929+0000 7f6f2a501640 1 -- 172.21.15.12:0/1784034434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f241021c0 con 0x7f6f24106f10 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.930+0000 7f6f21ffb640 1 -- 172.21.15.12:0/1784034434 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f6f1c00f5f0 con 0x7f6f24106f10 2024-09-19T06:40:25.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.931+0000 7f6f21ffb640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f100a34c0 0x7f6f100a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.931+0000 7f6f23fff640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f100a34c0 0x7f6f100a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.931+0000 7f6f21ffb640 1 -- 172.21.15.12:0/1784034434 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f6f1c0d05f0 con 0x7f6f24106f10 2024-09-19T06:40:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.931+0000 7f6f23fff640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f100a34c0 0x7f6f100a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f14005fd0 tx=0x7f6f14005850 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:25.934+0000 7f6f21ffb640 1 -- 172.21.15.12:0/1784034434 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6f1c014030 con 0x7f6f24106f10 2024-09-19T06:40:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:25 smithi012 ceph-mon[30937]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-19T06:40:26.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.149+0000 7f6f2a501640 1 -- 172.21.15.12:0/1784034434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f24199710 con 0x7f6f24106f10 2024-09-19T06:40:26.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.150+0000 7f6f21ffb640 1 -- 172.21.15.12:0/1784034434 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7f6f24199710 con 0x7f6f24106f10 2024-09-19T06:40:26.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:26.151 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-19T06:40:07:090225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:40:07.040062+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:40:26.152 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-19T06:40:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 -- 172.21.15.12:0/1784034434 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f100a34c0 msgr2=0x7f6f100a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f100a34c0 0x7f6f100a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f14005fd0 tx=0x7f6f14005850 comp rx=0 tx=0).stop 2024-09-19T06:40:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 -- 172.21.15.12:0/1784034434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24106f10 msgr2=0x7f6f2419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24106f10 0x7f6f2419cc80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00cce0 tx=0x7f6f1c00a620 comp rx=0 tx=0).stop 2024-09-19T06:40:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 -- 172.21.15.12:0/1784034434 shutdown_connections 2024-09-19T06:40:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24106f10 0x7f6f2419cc80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24102790 0x7f6f241988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f100a34c0 0x7f6f100a5980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 --2- 172.21.15.12:0/1784034434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24101de0 0x7f6f241983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 -- 172.21.15.12:0/1784034434 >> 172.21.15.12:0/1784034434 conn(0x7f6f240fd8c0 msgr2=0x7f6f240fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 -- 172.21.15.12:0/1784034434 shutdown_connections 2024-09-19T06:40:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:26.152+0000 7f6f2a501640 1 -- 172.21.15.12:0/1784034434 wait complete. 2024-09-19T06:40:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:25 smithi016 ceph-mon[34911]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-19T06:40:26.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:25 smithi173 ceph-mon[35349]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-19T06:40:26.870 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:40:27.127 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:27.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:26 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1784034434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:27.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:26 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1784034434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:27.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:26 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1784034434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:27.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.597+0000 7f26445d2640 1 -- 172.21.15.12:0/129929476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c102da0 msgr2=0x7f263c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:27.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.597+0000 7f26445d2640 1 --2- 172.21.15.12:0/129929476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c102da0 0x7f263c103180 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2638009900 tx=0x7f263802a480 comp rx=0 tx=0).stop 2024-09-19T06:40:27.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.597+0000 7f26445d2640 1 -- 172.21.15.12:0/129929476 shutdown_connections 2024-09-19T06:40:27.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.597+0000 7f26445d2640 1 --2- 172.21.15.12:0/129929476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f263c10c180 0x7f263c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.597+0000 7f26445d2640 1 --2- 172.21.15.12:0/129929476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f263c1036c0 0x7f263c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.597+0000 7f26445d2640 1 --2- 172.21.15.12:0/129929476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c102da0 0x7f263c103180 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 -- 172.21.15.12:0/129929476 >> 172.21.15.12:0/129929476 conn(0x7f263c0fc7a0 msgr2=0x7f263c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 -- 172.21.15.12:0/129929476 shutdown_connections 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 -- 172.21.15.12:0/129929476 wait complete. 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 Processor -- start 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 -- start start 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c102da0 0x7f263c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f263c1036c0 0x7f263c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f263c10c180 0x7f263c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f263c111f60 con 0x7f263c102da0 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f263c111de0 con 0x7f263c1036c0 2024-09-19T06:40:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.598+0000 7f26445d2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f263c1120e0 con 0x7f263c10c180 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f264236e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c102da0 0x7f263c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f264236e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c102da0 0x7f263c100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44798/0 (socket says 172.21.15.12:44798) 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f264236e640 1 -- 172.21.15.12:0/1616502538 learned_addr learned my addr 172.21.15.12:0/1616502538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f2641b6d640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f263c1036c0 0x7f263c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f2642b6f640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f263c10c180 0x7f263c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f264236e640 1 -- 172.21.15.12:0/1616502538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f263c10c180 msgr2=0x7f263c101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f264236e640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f263c10c180 0x7f263c101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f264236e640 1 -- 172.21.15.12:0/1616502538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f263c1036c0 msgr2=0x7f263c100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f264236e640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f263c1036c0 0x7f263c100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f264236e640 1 -- 172.21.15.12:0/1616502538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c1a6860 con 0x7f263c102da0 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f264236e640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c102da0 0x7f263c100a00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2638006010 tx=0x7f26380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f26337fe640 1 -- 172.21.15.12:0/1616502538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263803f030 con 0x7f263c102da0 2024-09-19T06:40:27.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f26337fe640 1 -- 172.21.15.12:0/1616502538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2638003ce0 con 0x7f263c102da0 2024-09-19T06:40:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f26337fe640 1 -- 172.21.15.12:0/1616502538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638035070 con 0x7f263c102da0 2024-09-19T06:40:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.599+0000 7f26445d2640 1 -- 172.21.15.12:0/1616502538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263c1a6af0 con 0x7f263c102da0 2024-09-19T06:40:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.600+0000 7f26445d2640 1 -- 172.21.15.12:0/1616502538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263c1a6f80 con 0x7f263c102da0 2024-09-19T06:40:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.601+0000 7f26445d2640 1 -- 172.21.15.12:0/1616502538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263c103180 con 0x7f263c102da0 2024-09-19T06:40:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.602+0000 7f26337fe640 1 -- 172.21.15.12:0/1616502538 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f2638042030 con 0x7f263c102da0 2024-09-19T06:40:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.602+0000 7f26337fe640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f26280a3440 0x7f26280a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.602+0000 7f2641b6d640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f26280a3440 0x7f26280a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.603+0000 7f26337fe640 1 -- 172.21.15.12:0/1616502538 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f26380f0360 con 0x7f263c102da0 2024-09-19T06:40:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.603+0000 7f2641b6d640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f26280a3440 0x7f26280a5900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f263c102490 tx=0x7f262c00a2d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:27.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.606+0000 7f26337fe640 1 -- 172.21.15.12:0/1616502538 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26380bcb50 con 0x7f263c102da0 2024-09-19T06:40:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.782+0000 7f26445d2640 1 -- 172.21.15.12:0/1616502538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f263c106c90 con 0x7f263c102da0 2024-09-19T06:40:27.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.784+0000 7f26337fe640 1 -- 172.21.15.12:0/1616502538 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+23298 (secure 0 0 0) 0x7f26380bc450 con 0x7f263c102da0 2024-09-19T06:40:27.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:27.786 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":86,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:40:08.069349+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":1}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6801/4060248487":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/3390758821":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1769692721":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/2160320420":"2024-09-20T06:40:08.069301+0000","172.21.15.12:6800/4060248487":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2954657663":"2024-09-20T06:40:08.069301+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:40:27.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 -- 172.21.15.12:0/1616502538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f26280a3440 msgr2=0x7f26280a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:27.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f26280a3440 0x7f26280a5900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f263c102490 tx=0x7f262c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 -- 172.21.15.12:0/1616502538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c102da0 msgr2=0x7f263c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:27.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c102da0 0x7f263c100a00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2638006010 tx=0x7f26380042f0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 -- 172.21.15.12:0/1616502538 shutdown_connections 2024-09-19T06:40:27.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f26280a3440 0x7f26280a5900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f263c10c180 0x7f263c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f263c1036c0 0x7f263c100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 --2- 172.21.15.12:0/1616502538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f263c102da0 0x7f263c100a00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:27.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 -- 172.21.15.12:0/1616502538 >> 172.21.15.12:0/1616502538 conn(0x7f263c0fc7a0 msgr2=0x7f263c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:27.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 -- 172.21.15.12:0/1616502538 shutdown_connections 2024-09-19T06:40:27.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:27.786+0000 7f26445d2640 1 -- 172.21.15.12:0/1616502538 wait complete. 2024-09-19T06:40:28.070 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:27 smithi012 ceph-mon[30937]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 76 KiB/s wr, 54 op/s 2024-09-19T06:40:28.070 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:27 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1616502538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:40:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:27 smithi016 ceph-mon[34911]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 76 KiB/s wr, 54 op/s 2024-09-19T06:40:28.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:27 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1616502538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:40:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:27 smithi173 ceph-mon[35349]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 76 KiB/s wr, 54 op/s 2024-09-19T06:40:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:27 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1616502538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:40:28.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T06:40:28.703 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:29.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:28 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:40:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:28 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:40:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:28 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:40:29.918 INFO:teuthology.orchestra.run.smithi012.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T06:40:29.919 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T06:40:29.919 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T06:40:29.919 DEBUG:tasks.quiescer:Yielding 2024-09-19T06:40:29.919 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T06:40:29.930 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:40:29.930 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:40:29.930 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-19T06:40:29.931 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:40:29.970 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:29.988 INFO:teuthology.orchestra.run.smithi012.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-19T06:40:29.988 INFO:teuthology.orchestra.run.smithi012.stdout:0@8bf314c8-7650-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 340G 0 340G 0% /tmp/cephfs 2024-09-19T06:40:29.991 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-19T06:40:30.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-19T06:40:30.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:29 smithi012 ceph-mon[30937]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-19T06:40:30.127 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-19T06:40:30.201 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:29 smithi016 ceph-mon[34911]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-19T06:40:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:29 smithi173 ceph-mon[35349]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-19T06:40:30.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.757+0000 7fa517620640 1 -- 172.21.15.12:0/3201345622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa510102d90 msgr2=0x7fa510103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.757+0000 7fa517620640 1 --2- 172.21.15.12:0/3201345622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa510102d90 0x7fa510103170 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009930 tx=0x7fa50c02a420 comp rx=0 tx=0).stop 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.757+0000 7fa517620640 1 -- 172.21.15.12:0/3201345622 shutdown_connections 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.757+0000 7fa517620640 1 --2- 172.21.15.12:0/3201345622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa510108290 0x7fa51010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.757+0000 7fa517620640 1 --2- 172.21.15.12:0/3201345622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa510103740 0x7fa510107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.757+0000 7fa517620640 1 --2- 172.21.15.12:0/3201345622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa510102d90 0x7fa510103170 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.757+0000 7fa517620640 1 -- 172.21.15.12:0/3201345622 >> 172.21.15.12:0/3201345622 conn(0x7fa5100fc7d0 msgr2=0x7fa5100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.757+0000 7fa517620640 1 -- 172.21.15.12:0/3201345622 shutdown_connections 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.757+0000 7fa517620640 1 -- 172.21.15.12:0/3201345622 wait complete. 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa517620640 1 Processor -- start 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa517620640 1 -- start start 2024-09-19T06:40:30.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa517620640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa510102d90 0x7fa510198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa517620640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa510103740 0x7fa510198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa517620640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa510108290 0x7fa51019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa517620640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa510112090 con 0x7fa510103740 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa517620640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa510111f10 con 0x7fa510108290 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa517620640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa510112210 con 0x7fa510102d90 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa514bbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa510103740 0x7fa510198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa514bbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa510103740 0x7fa510198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41462/0 (socket says 172.21.15.12:41462) 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa514bbb640 1 -- 172.21.15.12:0/2239769579 learned_addr learned my addr 172.21.15.12:0/2239769579 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa5153bc640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa510102d90 0x7fa510198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa515bbd640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa510108290 0x7fa51019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa514bbb640 1 -- 172.21.15.12:0/2239769579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa510102d90 msgr2=0x7fa510198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa514bbb640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa510102d90 0x7fa510198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa514bbb640 1 -- 172.21.15.12:0/2239769579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa510108290 msgr2=0x7fa51019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa514bbb640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa510108290 0x7fa51019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa514bbb640 1 -- 172.21.15.12:0/2239769579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51019d4d0 con 0x7fa510103740 2024-09-19T06:40:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.758+0000 7fa5153bc640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa510102d90 0x7fa510198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.759+0000 7fa514bbb640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa510103740 0x7fa510198a60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa50000c970 tx=0x7fa50000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.759+0000 7fa5067fc640 1 -- 172.21.15.12:0/2239769579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500014070 con 0x7fa510103740 2024-09-19T06:40:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.759+0000 7fa5067fc640 1 -- 172.21.15.12:0/2239769579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa500004440 con 0x7fa510103740 2024-09-19T06:40:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.759+0000 7fa517620640 1 -- 172.21.15.12:0/2239769579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51019d7c0 con 0x7fa510103740 2024-09-19T06:40:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.759+0000 7fa5067fc640 1 -- 172.21.15.12:0/2239769579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50000f450 con 0x7fa510103740 2024-09-19T06:40:30.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.759+0000 7fa517620640 1 -- 172.21.15.12:0/2239769579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5101a50a0 con 0x7fa510103740 2024-09-19T06:40:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.760+0000 7fa517620640 1 -- 172.21.15.12:0/2239769579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa51006a7f0 con 0x7fa510103740 2024-09-19T06:40:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.761+0000 7fa5067fc640 1 -- 172.21.15.12:0/2239769579 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fa500017070 con 0x7fa510103740 2024-09-19T06:40:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.762+0000 7fa5067fc640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4fc0a34c0 0x7fa4fc0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.762+0000 7fa5153bc640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4fc0a34c0 0x7fa4fc0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.762+0000 7fa5067fc640 1 -- 172.21.15.12:0/2239769579 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa5000cfdf0 con 0x7fa510103740 2024-09-19T06:40:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.763+0000 7fa5153bc640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4fc0a34c0 0x7fa4fc0a5980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa50c000c00 tx=0x7fa50c005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:30.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.766+0000 7fa5067fc640 1 -- 172.21.15.12:0/2239769579 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa50001e020 con 0x7fa510103740 2024-09-19T06:40:30.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.981+0000 7fa517620640 1 -- 172.21.15.12:0/2239769579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa51010a2a0 con 0x7fa510103740 2024-09-19T06:40:30.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.982+0000 7fa5067fc640 1 -- 172.21.15.12:0/2239769579 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7fa50009c5e0 con 0x7fa510103740 2024-09-19T06:40:30.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:30.984 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-19T06:40:07:090225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:40:07.040062+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:40:30.984 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-19T06:40:30.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 -- 172.21.15.12:0/2239769579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4fc0a34c0 msgr2=0x7fa4fc0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:30.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4fc0a34c0 0x7fa4fc0a5980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa50c000c00 tx=0x7fa50c005a20 comp rx=0 tx=0).stop 2024-09-19T06:40:30.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 -- 172.21.15.12:0/2239769579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa510103740 msgr2=0x7fa510198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:30.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa510103740 0x7fa510198a60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa50000c970 tx=0x7fa50000ce30 comp rx=0 tx=0).stop 2024-09-19T06:40:30.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 -- 172.21.15.12:0/2239769579 shutdown_connections 2024-09-19T06:40:30.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa510108290 0x7fa51019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:30.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa510103740 0x7fa510198a60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:30.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4fc0a34c0 0x7fa4fc0a5980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:30.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 --2- 172.21.15.12:0/2239769579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa510102d90 0x7fa510198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:30.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 -- 172.21.15.12:0/2239769579 >> 172.21.15.12:0/2239769579 conn(0x7fa5100fc7d0 msgr2=0x7fa510106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:30.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 -- 172.21.15.12:0/2239769579 shutdown_connections 2024-09-19T06:40:30.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:30.985+0000 7fa517620640 1 -- 172.21.15.12:0/2239769579 wait complete. 2024-09-19T06:40:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 -- 172.21.15.12:0/975861566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c100850 msgr2=0x7f0f8c100c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 --2- 172.21.15.12:0/975861566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c100850 0x7f0f8c100c30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009930 tx=0x7f0f7c02a420 comp rx=0 tx=0).stop 2024-09-19T06:40:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 -- 172.21.15.12:0/975861566 shutdown_connections 2024-09-19T06:40:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 --2- 172.21.15.12:0/975861566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f8c108110 0x7f0f8c10ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 --2- 172.21.15.12:0/975861566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f8c101200 0x7f0f8c1079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 --2- 172.21.15.12:0/975861566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c100850 0x7f0f8c100c30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 -- 172.21.15.12:0/975861566 >> 172.21.15.12:0/975861566 conn(0x7f0f8c075db0 msgr2=0x7f0f8c0761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 -- 172.21.15.12:0/975861566 shutdown_connections 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 -- 172.21.15.12:0/975861566 wait complete. 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 Processor -- start 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.168+0000 7f0f9290a640 1 -- start start 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f9290a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f8c100850 0x7f0f8c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f9290a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f8c108110 0x7f0f8c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f9290a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c19cc00 0x7f0f8c19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f9290a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c111f10 con 0x7f0f8c19cc00 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f9290a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c111d90 con 0x7f0f8c108110 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f9290a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c112090 con 0x7f0f8c100850 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f90ea7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c19cc00 0x7f0f8c19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f90ea7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c19cc00 0x7f0f8c19d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41488/0 (socket says 172.21.15.12:41488) 2024-09-19T06:40:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f90ea7640 1 -- 172.21.15.12:0/2517517625 learned_addr learned my addr 172.21.15.12:0/2517517625 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f8bfff640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f8c100850 0x7f0f8c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f8c108110 0x7f0f8c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f90ea7640 1 -- 172.21.15.12:0/2517517625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f8c100850 msgr2=0x7f0f8c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f90ea7640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f8c100850 0x7f0f8c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f90ea7640 1 -- 172.21.15.12:0/2517517625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f8c108110 msgr2=0x7f0f8c198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f90ea7640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f8c108110 0x7f0f8c198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f90ea7640 1 -- 172.21.15.12:0/2517517625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8c19d6f0 con 0x7f0f8c19cc00 2024-09-19T06:40:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.169+0000 7f0f90ea7640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c19cc00 0x7f0f8c19d0b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400cce0 tx=0x7f0f8400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.170+0000 7f0f897fa640 1 -- 172.21.15.12:0/2517517625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8400f450 con 0x7f0f8c19cc00 2024-09-19T06:40:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.170+0000 7f0f897fa640 1 -- 172.21.15.12:0/2517517625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f8400fad0 con 0x7f0f8c19cc00 2024-09-19T06:40:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.170+0000 7f0f9290a640 1 -- 172.21.15.12:0/2517517625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8c19d9e0 con 0x7f0f8c19cc00 2024-09-19T06:40:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.170+0000 7f0f897fa640 1 -- 172.21.15.12:0/2517517625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84018c10 con 0x7f0f8c19cc00 2024-09-19T06:40:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.170+0000 7f0f9290a640 1 -- 172.21.15.12:0/2517517625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8c1a5180 con 0x7f0f8c19cc00 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.172+0000 7f0f897fa640 1 -- 172.21.15.12:0/2517517625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f0f8400f5f0 con 0x7f0f8c19cc00 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.172+0000 7f0f9569e740 1 Processor -- start 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.172+0000 7f0f9569e740 1 -- start start 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea334ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea335410 0x55bfea33f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea33fcb0 0x55bfea3420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f9569e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bfea2992f0 con 0x55bfea334af0 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f9569e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bfea241270 con 0x55bfea33fcb0 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f9569e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bfea2952b0 con 0x55bfea335410 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea334ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea334ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41496/0 (socket says 172.21.15.12:41496) 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/181890956 learned_addr learned my addr 172.21.15.12:0/181890956 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f897fa640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f740a3500 0x7f0f740a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8bfff640 1 --2- 172.21.15.12:0/181890956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea335410 0x55bfea33f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/181890956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea33fcb0 0x55bfea3420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/181890956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea335410 msgr2=0x55bfea33f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/181890956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea335410 0x55bfea33f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/181890956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea33fcb0 msgr2=0x55bfea3420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/181890956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea33fcb0 0x55bfea3420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f90ea7640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f740a3500 0x7f0f740a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/181890956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfea240340 con 0x55bfea334af0 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8bfff640 1 --2- 172.21.15.12:0/181890956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea335410 0x55bfea33f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f897fa640 1 -- 172.21.15.12:0/2517517625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0f840d0510 con 0x7f0f8c19cc00 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.173+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/181890956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea334ed0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0f800125b0 tx=0x7f0f8000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102ed40524082ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f727fc640 1 -- 172.21.15.12:0/181890956 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80005020 con 0x55bfea334af0 2024-09-19T06:40:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f90ea7640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f740a3500 0x7f0f740a59c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f840cdb80 tx=0x7f0f8400af30 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f727fc640 1 -- 172.21.15.12:0/181890956 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f800047a0 con 0x55bfea334af0 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f727fc640 1 -- 172.21.15.12:0/181890956 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800106c0 con 0x55bfea334af0 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f9569e740 1 -- 172.21.15.12:0/181890956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 msgr2=0x55bfea334ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f9569e740 1 --2- 172.21.15.12:0/181890956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea334ed0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0f800125b0 tx=0x7f0f8000b650 comp rx=0 tx=0).stop 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f9569e740 1 -- 172.21.15.12:0/181890956 shutdown_connections 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f9569e740 1 --2- 172.21.15.12:0/181890956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea33fcb0 0x55bfea3420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f9569e740 1 --2- 172.21.15.12:0/181890956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea335410 0x55bfea33f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f9569e740 1 --2- 172.21.15.12:0/181890956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea334ed0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f9569e740 1 -- 172.21.15.12:0/181890956 >> 172.21.15.12:0/181890956 conn(0x55bfea331060 msgr2=0x55bfea331440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f9569e740 1 -- 172.21.15.12:0/181890956 shutdown_connections 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.174+0000 7f0f9569e740 1 -- 172.21.15.12:0/181890956 wait complete. 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.175+0000 7f0f9569e740 1 -- start start 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.175+0000 7f0f9569e740 1 Processor -- start 2024-09-19T06:40:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.175+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea334af0 0x55bfea33cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.175+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea335410 0x55bfea33d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.175+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea33fcb0 0x55bfea33d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.175+0000 7f0f9569e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bfea342880 con 0x55bfea33fcb0 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.175+0000 7f0f9569e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bfea222290 con 0x55bfea335410 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.175+0000 7f0f9569e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bfea342a00 con 0x55bfea334af0 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.175+0000 7f0f9569e740 10 client.0 _ll_register_callbacks cb 0x55bfea253140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea33fcb0 0x55bfea33d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea33fcb0 0x55bfea33d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41498/0 (socket says 172.21.15.12:41498) 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/1936025164 learned_addr learned my addr 172.21.15.12:0/1936025164 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea334af0 0x55bfea33cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8bfff640 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea335410 0x55bfea33d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/1936025164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea334af0 msgr2=0x55bfea33cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea334af0 0x55bfea33cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/1936025164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea335410 msgr2=0x55bfea33d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea335410 0x55bfea33d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/1936025164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe9fac210 con 0x55bfea33fcb0 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea33fcb0 0x55bfea33d600 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0f80004770 tx=0x7f0f8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a653542ab836d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/1936025164 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80022060 con 0x55bfea33fcb0 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/1936025164 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0f80010a90 con 0x55bfea33fcb0 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f9569e740 1 -- 172.21.15.12:0/1936025164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f800047a0 con 0x55bfea33fcb0 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/1936025164 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f80010c90 con 0x55bfea33fcb0 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f9569e740 10 client.15483 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.176+0000 7f0f9569e740 1 -- 172.21.15.12:0/1936025164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bfea078620 con 0x55bfea33fcb0 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/1936025164 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f800047a0 con 0x55bfea33fcb0 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/1936025164 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0f8001d3f0 con 0x55bfea33fcb0 2024-09-19T06:40:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f9569e740 10 client.15483 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f9569e740 10 client.15483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f9569e740 20 client.15483 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f9569e740 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfea34fa80 0x55bfea351e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f9569e740 4 client.15483 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f9569e740 1 -- 172.21.15.12:0/1936025164 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfea2a6a20 con 0x55bfea34fa80 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f8bfff640 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfea34fa80 0x55bfea351e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f6b7fe640 10 client.15483 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.177+0000 7f0f8bfff640 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfea34fa80 0x55bfea351e70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=136ab1d8b5d9c94c server_cookie=2d11c1551d111319 in_seq=0 out_seq=0 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.178+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/1936025164 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bfea2a6a20 con 0x55bfea34fa80 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.178+0000 7f0f6b7fe640 10 client.15483 handle_command_reply: tid=0 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.178+0000 7f0f9569e740 1 client.15483 shutdown 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 1 -- 172.21.15.12:0/1936025164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea33fcb0 msgr2=0x55bfea33d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea33fcb0 0x55bfea33d600 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0f80004770 tx=0x7f0f8000b8e0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 1 -- 172.21.15.12:0/1936025164 shutdown_connections 2024-09-19T06:40:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfea34fa80 0x55bfea351e70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea33fcb0 0x55bfea33d600 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea335410 0x55bfea33d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 1 --2- 172.21.15.12:0/1936025164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea334af0 0x55bfea33cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 1 -- 172.21.15.12:0/1936025164 >> 172.21.15.12:0/1936025164 conn(0x55bfea331060 msgr2=0x55bfea336d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f6b7fe640 0 client.15483 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 1 -- 172.21.15.12:0/1936025164 shutdown_connections 2024-09-19T06:40:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 1 -- 172.21.15.12:0/1936025164 wait complete. 2024-09-19T06:40:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.179+0000 7f0f9569e740 20 client.15483 trim_cache size 0 max 16384 2024-09-19T06:40:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.193+0000 7f0f9569e740 1 Processor -- start 2024-09-19T06:40:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.193+0000 7f0f9569e740 1 -- start start 2024-09-19T06:40:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.193+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea33d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.193+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea335410 0x55bfea33d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.193+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea33fcb0 0x55bfea357580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.193+0000 7f0f9569e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c1ad9e0 con 0x55bfea334af0 2024-09-19T06:40:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.193+0000 7f0f9569e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c1af520 con 0x55bfea335410 2024-09-19T06:40:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.193+0000 7f0f9569e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c1ae0b0 con 0x55bfea33fcb0 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.193+0000 7f0f8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea33d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea33d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41504/0 (socket says 172.21.15.12:41504) 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/2766560480 learned_addr learned my addr 172.21.15.12:0/2766560480 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/2766560480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea33fcb0 msgr2=0x55bfea357580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/2766560480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea33fcb0 0x55bfea357580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/2766560480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea335410 msgr2=0x55bfea33d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/2766560480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea335410 0x55bfea33d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f8b7fe640 1 -- 172.21.15.12:0/2766560480 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfea330e90 con 0x55bfea334af0 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/2766560480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea33d0b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000bed0 tx=0x7f0f8000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76b0095863e192b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f71ffb640 1 -- 172.21.15.12:0/2766560480 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80022030 con 0x55bfea334af0 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f71ffb640 1 -- 172.21.15.12:0/2766560480 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f80024070 con 0x55bfea334af0 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.194+0000 7f0f71ffb640 1 -- 172.21.15.12:0/2766560480 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8001da30 con 0x55bfea334af0 2024-09-19T06:40:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 -- 172.21.15.12:0/2766560480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 msgr2=0x55bfea33d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 --2- 172.21.15.12:0/2766560480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea33d0b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000bed0 tx=0x7f0f8000b870 comp rx=0 tx=0).stop 2024-09-19T06:40:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 -- 172.21.15.12:0/2766560480 shutdown_connections 2024-09-19T06:40:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 --2- 172.21.15.12:0/2766560480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea33fcb0 0x55bfea357580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 --2- 172.21.15.12:0/2766560480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea335410 0x55bfea33d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 --2- 172.21.15.12:0/2766560480 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea334af0 0x55bfea33d0b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 -- 172.21.15.12:0/2766560480 >> 172.21.15.12:0/2766560480 conn(0x55bfea331060 msgr2=0x55bfea33ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 -- 172.21.15.12:0/2766560480 shutdown_connections 2024-09-19T06:40:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 -- 172.21.15.12:0/2766560480 wait complete. 2024-09-19T06:40:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 -- start start 2024-09-19T06:40:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 Processor -- start 2024-09-19T06:40:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea334af0 0x55bfea343b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea335410 0x55bfea344040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea33fcb0 0x55bfea344580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c1aee50 con 0x55bfea335410 2024-09-19T06:40:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c1ae780 con 0x55bfea334af0 2024-09-19T06:40:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.195+0000 7f0f9569e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c1ab9c0 con 0x55bfea33fcb0 2024-09-19T06:40:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f9569e740 10 client.0 _ll_register_callbacks cb 0x7f0f80012410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea335410 0x55bfea344040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea335410 0x55bfea344040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41514/0 (socket says 172.21.15.12:41514) 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8bfff640 1 -- 172.21.15.12:0/657973016 learned_addr learned my addr 172.21.15.12:0/657973016 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea334af0 0x55bfea343b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea33fcb0 0x55bfea344580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8bfff640 1 -- 172.21.15.12:0/657973016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea33fcb0 msgr2=0x55bfea344580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8bfff640 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea33fcb0 0x55bfea344580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8bfff640 1 -- 172.21.15.12:0/657973016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea334af0 msgr2=0x55bfea343b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8bfff640 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea334af0 0x55bfea343b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8bfff640 1 -- 172.21.15.12:0/657973016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfea337940 con 0x55bfea335410 2024-09-19T06:40:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f8bfff640 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea335410 0x55bfea344040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009900 tx=0x7f0f7c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddaf719adc028fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/657973016 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c049070 con 0x55bfea335410 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/657973016 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0f7c004240 con 0x55bfea335410 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f9569e740 1 -- 172.21.15.12:0/657973016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f80024070 con 0x55bfea335410 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/657973016 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f7c055050 con 0x55bfea335410 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f9569e740 10 client.15489 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.196+0000 7f0f9569e740 1 -- 172.21.15.12:0/657973016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bfea3ba820 con 0x55bfea335410 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/657973016 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f80024070 con 0x55bfea335410 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/657973016 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0f7c0454f0 con 0x55bfea335410 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f9569e740 10 client.15489 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f9569e740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f9569e740 20 client.15489 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f9569e740 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfea3baf80 0x55bfea3bd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f9569e740 4 client.15489 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:40:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f9569e740 1 -- 172.21.15.12:0/657973016 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bfea2a0d70 con 0x55bfea3baf80 2024-09-19T06:40:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfea3baf80 0x55bfea3bd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f6b7fe640 10 client.15489 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.197+0000 7f0f8b7fe640 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfea3baf80 0x55bfea3bd3a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1e27399acd43d server_cookie=6d059e99e3ca5e97 in_seq=0 out_seq=0 2024-09-19T06:40:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.212+0000 7f0f6b7fe640 1 -- 172.21.15.12:0/657973016 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bfea2a0d70 con 0x55bfea3baf80 2024-09-19T06:40:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.212+0000 7f0f6b7fe640 10 client.15489 handle_command_reply: tid=0 2024-09-19T06:40:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.212+0000 7f0f9569e740 1 client.15489 shutdown 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 1 -- 172.21.15.12:0/657973016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea335410 msgr2=0x55bfea344040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea335410 0x55bfea344040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009900 tx=0x7f0f7c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 1 -- 172.21.15.12:0/657973016 shutdown_connections 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfea3baf80 0x55bfea3bd3a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfea33fcb0 0x55bfea344580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfea335410 0x55bfea344040 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 1 --2- 172.21.15.12:0/657973016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfea334af0 0x55bfea343b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 1 -- 172.21.15.12:0/657973016 >> 172.21.15.12:0/657973016 conn(0x55bfea331060 msgr2=0x55bfea336550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f6b7fe640 0 client.15489 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 1 -- 172.21.15.12:0/657973016 shutdown_connections 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 1 -- 172.21.15.12:0/657973016 wait complete. 2024-09-19T06:40:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9569e740 20 client.15489 trim_cache size 0 max 16384 2024-09-19T06:40:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:40:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:40:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:40:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9290a640 1 -- 172.21.15.12:0/2517517625 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f740a3500 msgr2=0x7f0f740a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9290a640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f740a3500 0x7f0f740a59c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f840cdb80 tx=0x7f0f8400af30 comp rx=0 tx=0).stop 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9290a640 1 -- 172.21.15.12:0/2517517625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c19cc00 msgr2=0x7f0f8c19d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.213+0000 7f0f9290a640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c19cc00 0x7f0f8c19d0b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400cce0 tx=0x7f0f8400a620 comp rx=0 tx=0).stop 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.214+0000 7f0f9290a640 1 -- 172.21.15.12:0/2517517625 shutdown_connections 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.214+0000 7f0f9290a640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f8c19cc00 0x7f0f8c19d0b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.214+0000 7f0f9290a640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f8c108110 0x7f0f8c198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.214+0000 7f0f9290a640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f740a3500 0x7f0f740a59c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.214+0000 7f0f9290a640 1 --2- 172.21.15.12:0/2517517625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f8c100850 0x7f0f8c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.214+0000 7f0f9290a640 1 -- 172.21.15.12:0/2517517625 >> 172.21.15.12:0/2517517625 conn(0x7f0f8c075db0 msgr2=0x7f0f8c0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.214+0000 7f0f9290a640 1 -- 172.21.15.12:0/2517517625 shutdown_connections 2024-09-19T06:40:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:31.214+0000 7f0f9290a640 1 -- 172.21.15.12:0/2517517625 wait complete. 2024-09-19T06:40:32.139 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:31 smithi012 ceph-mon[30937]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-19T06:40:32.139 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:31 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2239769579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:32.252 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-19T06:40:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:31 smithi016 ceph-mon[34911]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-19T06:40:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:31 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2239769579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:32.329 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-19T06:40:32.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-19T06:40:32.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:31 smithi173 ceph-mon[35349]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-19T06:40:32.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:31 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2239769579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:32.411 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-19T06:40:32.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:38:14.665545+0000', 'modified': '2024-09-19T06:40:07.040062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24509, 'mds_1': 24502, 'mds_2': 24481, 'mds_3': 24439, 'mds_4': 24431}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14622': {'gid': 14622, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6839/523853421', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6838', 'nonce': 523853421}, {'type': 'v1', 'addr': '172.21.15.12:6839', 'nonce': 523853421}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14634': {'gid': 14634, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6841/1524660797', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6840', 'nonce': 1524660797}, {'type': 'v1', 'addr': '172.21.15.12:6841', 'nonce': 1524660797}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.16:6833/2120245692', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 2120245692}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 2120245692}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.173:6833/1987793831', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 1987793831}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 1987793831}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.16:6835/549418858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6834', 'nonce': 549418858}, {'type': 'v1', 'addr': '172.21.15.16:6835', 'nonce': 549418858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6835/2501878004', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 2501878004}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 2501878004}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.16:6837/2891393100', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6836', 'nonce': 2891393100}, {'type': 'v1', 'addr': '172.21.15.16:6837', 'nonce': 2891393100}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/3674805378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 3674805378}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 3674805378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.173:6839/2051533953', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 2051533953}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 2051533953}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.16:6839/2939093038', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6838', 'nonce': 2939093038}, {'type': 'v1', 'addr': '172.21.15.16:6839', 'nonce': 2939093038}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24509, 'qdb_cluster': [24431, 24509, 24439, 24481, 24502]} 2024-09-19T06:40:32.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T06:40:32.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.k status 2024-09-19T06:40:32.488 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/: 2024-09-19T06:40:32.488 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:32.488 INFO:teuthology.orchestra.run.smithi012.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 . 2024-09-19T06:40:32.488 INFO:teuthology.orchestra.run.smithi012.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 .. 2024-09-19T06:40:32.488 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 data 2024-09-19T06:40:32.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:32.488 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data: 2024-09-19T06:40:32.488 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:32.488 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:32.488 INFO:teuthology.orchestra.run.smithi012.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 .. 2024-09-19T06:40:32.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-19T06:40:32.576 INFO:teuthology.orchestra.run.smithi012.stdout:[Service] 2024-09-19T06:40:32.576 INFO:teuthology.orchestra.run.smithi012.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-19T06:40:32.576 INFO:teuthology.orchestra.run.smithi012.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-19T06:40:32.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-19T06:40:32.669 INFO:teuthology.orchestra.run.smithi012.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-19T06:40:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:33.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 -- 172.21.15.12:0/3612344168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc548106f10 msgr2=0x7fc54810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 --2- 172.21.15.12:0/3612344168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc548106f10 0x7fc54810ea90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc540009ca0 tx=0x7fc54002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 -- 172.21.15.12:0/3612344168 shutdown_connections 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 --2- 172.21.15.12:0/3612344168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc548106f10 0x7fc54810ea90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 --2- 172.21.15.12:0/3612344168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc548102790 0x7fc5481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 --2- 172.21.15.12:0/3612344168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc548101de0 0x7fc5481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 -- 172.21.15.12:0/3612344168 >> 172.21.15.12:0/3612344168 conn(0x7fc5480fd8e0 msgr2=0x7fc5480ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 -- 172.21.15.12:0/3612344168 shutdown_connections 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 -- 172.21.15.12:0/3612344168 wait complete. 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 Processor -- start 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.279+0000 7fc550316640 1 -- start start 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc550316640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc548101de0 0x7fc54819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc550316640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc548102790 0x7fc54819ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc550316640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc548106f10 0x7fc54819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc550316640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc548111f70 con 0x7fc548102790 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc550316640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc548111df0 con 0x7fc548106f10 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc550316640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc5481120f0 con 0x7fc548101de0 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54d8b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc548102790 0x7fc54819ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54d8b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc548102790 0x7fc54819ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41538/0 (socket says 172.21.15.12:41538) 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54d8b1640 1 -- 172.21.15.12:0/4023794600 learned_addr learned my addr 172.21.15.12:0/4023794600 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54e8b3640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc548106f10 0x7fc54819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54e0b2640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc548101de0 0x7fc54819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54d8b1640 1 -- 172.21.15.12:0/4023794600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc548101de0 msgr2=0x7fc54819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc548101de0 0x7fc54819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54d8b1640 1 -- 172.21.15.12:0/4023794600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc548106f10 msgr2=0x7fc54819efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc548106f10 0x7fc54819efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54d8b1640 1 -- 172.21.15.12:0/4023794600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54819f6c0 con 0x7fc548102790 2024-09-19T06:40:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54e0b2640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc548101de0 0x7fc54819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.280+0000 7fc54e8b3640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc548106f10 0x7fc54819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.281+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc548102790 0x7fc54819ac50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc53800d770 tx=0x7fc53800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.281+0000 7fc53f7fe640 1 -- 172.21.15.12:0/4023794600 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538017070 con 0x7fc548102790 2024-09-19T06:40:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.281+0000 7fc53f7fe640 1 -- 172.21.15.12:0/4023794600 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc538005500 con 0x7fc548102790 2024-09-19T06:40:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.281+0000 7fc53f7fe640 1 -- 172.21.15.12:0/4023794600 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538004e00 con 0x7fc548102790 2024-09-19T06:40:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.281+0000 7fc550316640 1 -- 172.21.15.12:0/4023794600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54819f9b0 con 0x7fc548102790 2024-09-19T06:40:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.281+0000 7fc550316640 1 -- 172.21.15.12:0/4023794600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5481a7290 con 0x7fc548102790 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.283+0000 7fc53f7fe640 1 -- 172.21.15.12:0/4023794600 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fc538004fa0 con 0x7fc548102790 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc5526ef740 1 Processor -- start 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc5526ef740 1 -- start start 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc53f7fe640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc5340a3440 0x7fc5340a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec09c9d0 0x55caec09cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09d2f0 0x55caec0a7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec0a7bb0 0x55caec0a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc5526ef740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55caec003090 con 0x55caec0a7bb0 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc5526ef740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55caebfaaa70 con 0x55caec09d2f0 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc5526ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55caebfff050 con 0x55caec09c9d0 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc53f7fe640 1 -- 172.21.15.12:0/4023794600 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc5380cf960 con 0x7fc548102790 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc54e8b3640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc5340a3440 0x7fc5340a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc54e8b3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec0a7bb0 0x55caec0a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc54e0b2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec09c9d0 0x55caec09cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc54e8b3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec0a7bb0 0x55caec0a9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41542/0 (socket says 172.21.15.12:41542) 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc54d8b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09d2f0 0x55caec0a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.284+0000 7fc54e8b3640 1 -- 172.21.15.12:0/1913576376 learned_addr learned my addr 172.21.15.12:0/1913576376 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.285+0000 7fc54d8b1640 1 -- 172.21.15.12:0/1913576376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec09c9d0 msgr2=0x55caec09cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.285+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/1913576376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec09c9d0 0x55caec09cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.285+0000 7fc54d8b1640 1 -- 172.21.15.12:0/1913576376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec0a7bb0 msgr2=0x55caec0a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.285+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/1913576376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec0a7bb0 0x55caec0a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.285+0000 7fc54d8b1640 1 -- 172.21.15.12:0/1913576376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caebfb7130 con 0x55caec09d2f0 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.285+0000 7fc54e8b3640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc5340a3440 0x7fc5340a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc54002f540 tx=0x7fc54002f4d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.285+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/1913576376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09d2f0 0x55caec0a7670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5380ccf70 tx=0x7fc53800de80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35c4506c7fe77f50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.285+0000 7fc53cdea640 1 -- 172.21.15.12:0/1913576376 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538020070 con 0x55caec09d2f0 2024-09-19T06:40:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.285+0000 7fc53cdea640 1 -- 172.21.15.12:0/1913576376 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5380046c0 con 0x55caec09d2f0 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.285+0000 7fc53cdea640 1 -- 172.21.15.12:0/1913576376 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538099de0 con 0x55caec09d2f0 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 -- 172.21.15.12:0/1913576376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09d2f0 msgr2=0x55caec0a7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 --2- 172.21.15.12:0/1913576376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09d2f0 0x55caec0a7670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5380ccf70 tx=0x7fc53800de80 comp rx=0 tx=0).stop 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 -- 172.21.15.12:0/1913576376 shutdown_connections 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 --2- 172.21.15.12:0/1913576376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec0a7bb0 0x55caec0a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 --2- 172.21.15.12:0/1913576376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09d2f0 0x55caec0a7670 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 --2- 172.21.15.12:0/1913576376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec09c9d0 0x55caec09cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 -- 172.21.15.12:0/1913576376 >> 172.21.15.12:0/1913576376 conn(0x55caec098f60 msgr2=0x55caec099340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 -- 172.21.15.12:0/1913576376 shutdown_connections 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 -- 172.21.15.12:0/1913576376 wait complete. 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 -- start start 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.286+0000 7fc5526ef740 1 Processor -- start 2024-09-19T06:40:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0a7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec0a7bb0 0x55caec0a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc5526ef740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55caec0aa720 con 0x55caec09d2f0 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc5526ef740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55caebfbdf20 con 0x55caec09c9d0 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc5526ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55caec0aa8a0 con 0x55caec0a7bb0 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc5526ef740 10 client.0 _ll_register_callbacks cb 0x55caebf87030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54d8b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54e0b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54d8b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0a47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41558/0 (socket says 172.21.15.12:41558) 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54d8b1640 1 -- 172.21.15.12:0/1762279853 learned_addr learned my addr 172.21.15.12:0/1762279853 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54e0b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:39542/0 (socket says 172.21.15.12:39542) 2024-09-19T06:40:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54e8b3640 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec0a7bb0 0x55caec0a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54d8b1640 1 -- 172.21.15.12:0/1762279853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec0a7bb0 msgr2=0x55caec0a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec0a7bb0 0x55caec0a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54d8b1640 1 -- 172.21.15.12:0/1762279853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 msgr2=0x55caec0a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0a7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54d8b1640 1 -- 172.21.15.12:0/1762279853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caebd742b0 con 0x55caec09d2f0 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54e0b2640 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0a47a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc53809b9e0 tx=0x7fc538009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0f419248fa6124 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.287+0000 7fc531ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc531ffb640 1 -- 172.21.15.12:0/1762279853 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538020070 con 0x55caec09d2f0 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc5526ef740 1 -- 172.21.15.12:0/1762279853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55caec010600 con 0x55caec09d2f0 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc531ffb640 1 -- 172.21.15.12:0/1762279853 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc538009cc0 con 0x55caec09d2f0 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc531ffb640 1 -- 172.21.15.12:0/1762279853 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc53809ba50 con 0x55caec09d2f0 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc5526ef740 10 client.15501 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc5526ef740 1 -- 172.21.15.12:0/1762279853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55caec0b6040 con 0x55caec09d2f0 2024-09-19T06:40:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc531ffb640 1 -- 172.21.15.12:0/1762279853 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55caec010600 con 0x55caec09d2f0 2024-09-19T06:40:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc531ffb640 1 -- 172.21.15.12:0/1762279853 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc538055330 con 0x55caec09d2f0 2024-09-19T06:40:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc5526ef740 10 client.15501 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc5526ef740 10 client.15501 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-19T06:40:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc5526ef740 20 client.15501 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc5526ef740 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55caec0b8140 0x55caec0b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc5526ef740 4 client.15501 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.288+0000 7fc5526ef740 1 -- 172.21.15.12:0/1762279853 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55caec00ab10 con 0x55caec0b8140 2024-09-19T06:40:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.289+0000 7fc54e0b2640 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55caec0b8140 0x55caec0b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.289+0000 7fc54e0b2640 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55caec0b8140 0x55caec0b95b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aa00795a623f1f3b server_cookie=ce83c0af9db2e58d in_seq=0 out_seq=0 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.289+0000 7fc531ffb640 10 client.15501 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc531ffb640 1 -- 172.21.15.12:0/1762279853 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55caec00ab10 con 0x55caec0b8140 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc531ffb640 10 client.15501 handle_command_reply: tid=0 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 client.15501 shutdown 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 -- 172.21.15.12:0/1762279853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 msgr2=0x55caec0a47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0a47a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc53809b9e0 tx=0x7fc538009c30 comp rx=0 tx=0).stop 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 -- 172.21.15.12:0/1762279853 shutdown_connections 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55caec0b8140 0x55caec0b95b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec0a7bb0 0x55caec0a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0a47a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 --2- 172.21.15.12:0/1762279853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc531ffb640 0 client.15501 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:40:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 -- 172.21.15.12:0/1762279853 >> 172.21.15.12:0/1762279853 conn(0x55caec098f60 msgr2=0x55caec09ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 -- 172.21.15.12:0/1762279853 shutdown_connections 2024-09-19T06:40:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 1 -- 172.21.15.12:0/1762279853 wait complete. 2024-09-19T06:40:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.290+0000 7fc5526ef740 20 client.15501 trim_cache size 0 max 16384 2024-09-19T06:40:33.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.311+0000 7fc5526ef740 1 Processor -- start 2024-09-19T06:40:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.311+0000 7fc5526ef740 1 -- start start 2024-09-19T06:40:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec09c9d0 0x55caec0b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0b8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec0a7bb0 0x55caec09db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc5526ef740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55caec0b78f0 con 0x55caec09d2f0 2024-09-19T06:40:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc5526ef740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55caec0b7fc0 con 0x55caec0a7bb0 2024-09-19T06:40:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc5526ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55caec0b8690 con 0x55caec09c9d0 2024-09-19T06:40:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54d8b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54e8b3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec0a7bb0 0x55caec09db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54d8b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0b8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41574/0 (socket says 172.21.15.12:41574) 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54d8b1640 1 -- 172.21.15.12:0/3988016362 learned_addr learned my addr 172.21.15.12:0/3988016362 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54e0b2640 1 --2- 172.21.15.12:0/3988016362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec09c9d0 0x55caec0b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54e8b3640 1 -- 172.21.15.12:0/3988016362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec09c9d0 msgr2=0x55caec0b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54e8b3640 1 --2- 172.21.15.12:0/3988016362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec09c9d0 0x55caec0b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54e8b3640 1 -- 172.21.15.12:0/3988016362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 msgr2=0x55caec0b8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54e8b3640 1 --2- 172.21.15.12:0/3988016362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0b8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54e8b3640 1 -- 172.21.15.12:0/3988016362 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caec0a7070 con 0x55caec0a7bb0 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.312+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/3988016362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.313+0000 7fc54e8b3640 1 --2- 172.21.15.12:0/3988016362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec0a7bb0 0x55caec09db70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55caec09a2e0 tx=0x7fc54004b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc1ac2fd1187ea83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.313+0000 7fc533fff640 1 -- 172.21.15.12:0/3988016362 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc540003d40 con 0x55caec0a7bb0 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.313+0000 7fc533fff640 1 -- 172.21.15.12:0/3988016362 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc540004590 con 0x55caec0a7bb0 2024-09-19T06:40:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.313+0000 7fc533fff640 1 -- 172.21.15.12:0/3988016362 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5400305c0 con 0x55caec0a7bb0 2024-09-19T06:40:33.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 -- 172.21.15.12:0/3988016362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec0a7bb0 msgr2=0x55caec09db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:33.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 --2- 172.21.15.12:0/3988016362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec0a7bb0 0x55caec09db70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55caec09a2e0 tx=0x7fc54004b000 comp rx=0 tx=0).stop 2024-09-19T06:40:33.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 -- 172.21.15.12:0/3988016362 shutdown_connections 2024-09-19T06:40:33.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 --2- 172.21.15.12:0/3988016362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec0a7bb0 0x55caec09db70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 --2- 172.21.15.12:0/3988016362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 --2- 172.21.15.12:0/3988016362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec09c9d0 0x55caec0b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 -- 172.21.15.12:0/3988016362 >> 172.21.15.12:0/3988016362 conn(0x55caec098f60 msgr2=0x55caec0a5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 -- 172.21.15.12:0/3988016362 shutdown_connections 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 -- 172.21.15.12:0/3988016362 wait complete. 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 -- start start 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 Processor -- start 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0bce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0bd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec0a7bb0 0x55caec11a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55caec0b9430 con 0x55caec09d2f0 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55caec0b8d60 con 0x55caec09c9d0 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55caec0b9b00 con 0x55caec0a7bb0 2024-09-19T06:40:33.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.314+0000 7fc5526ef740 10 client.0 _ll_register_callbacks cb 0x7fc540009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54d8b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0bd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54e0b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0bce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54d8b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0bd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41582/0 (socket says 172.21.15.12:41582) 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54d8b1640 1 -- 172.21.15.12:0/2229923643 learned_addr learned my addr 172.21.15.12:0/2229923643 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54e8b3640 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec0a7bb0 0x55caec11a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54d8b1640 1 -- 172.21.15.12:0/2229923643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec0a7bb0 msgr2=0x55caec11a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec0a7bb0 0x55caec11a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54d8b1640 1 -- 172.21.15.12:0/2229923643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 msgr2=0x55caec0bce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0bce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54d8b1640 1 -- 172.21.15.12:0/2229923643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caec11ae50 con 0x55caec09d2f0 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54e0b2640 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc54d8b1640 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0bd340 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc53809b9e0 tx=0x7fc538009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5d848af7dc2303 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc531ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc531ffb640 1 -- 172.21.15.12:0/2229923643 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5380b4020 con 0x55caec09d2f0 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc531ffb640 1 -- 172.21.15.12:0/2229923643 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc5380860b0 con 0x55caec09d2f0 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc5526ef740 1 -- 172.21.15.12:0/2229923643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc540004590 con 0x55caec09d2f0 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.315+0000 7fc531ffb640 1 -- 172.21.15.12:0/2229923643 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc538020070 con 0x55caec09d2f0 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc5526ef740 10 client.15507 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc5526ef740 1 -- 172.21.15.12:0/2229923643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55caec122200 con 0x55caec09d2f0 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc531ffb640 1 -- 172.21.15.12:0/2229923643 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc540004590 con 0x55caec09d2f0 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc531ffb640 1 -- 172.21.15.12:0/2229923643 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc538055330 con 0x55caec09d2f0 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc5526ef740 10 client.15507 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc5526ef740 10 client.15507 resolve_mds: resolved name 'k' to daemon mds.k 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc5526ef740 20 client.15507 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc5526ef740 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55caec126b20 0x55caec125830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc5526ef740 4 client.15507 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:40:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc5526ef740 1 -- 172.21.15.12:0/2229923643 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "status"}) -- 0x55caebf870e0 con 0x55caec126b20 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.316+0000 7fc54e0b2640 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55caec126b20 0x55caec125830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc54e0b2640 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55caec126b20 0x55caec125830 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fe295d4a22b5ede1 server_cookie=503b98093007e67f in_seq=0 out_seq=0 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc531ffb640 10 client.15507 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc531ffb640 1 -- 172.21.15.12:0/2229923643 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55caebf870e0 con 0x55caec126b20 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc531ffb640 10 client.15507 handle_command_reply: tid=0 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 client.15507 shutdown 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 -- 172.21.15.12:0/2229923643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 msgr2=0x55caec0bd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0bd340 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc53809b9e0 tx=0x7fc538009740 comp rx=0 tx=0).stop 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 -- 172.21.15.12:0/2229923643 shutdown_connections 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55caec126b20 0x55caec125830 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55caec0a7bb0 0x55caec11a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55caec09d2f0 0x55caec0bd340 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 --2- 172.21.15.12:0/2229923643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55caec09c9d0 0x55caec0bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 -- 172.21.15.12:0/2229923643 >> 172.21.15.12:0/2229923643 conn(0x55caec098f60 msgr2=0x55caec0a6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc531ffb640 0 client.15507 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:40:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 -- 172.21.15.12:0/2229923643 shutdown_connections 2024-09-19T06:40:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 1 -- 172.21.15.12:0/2229923643 wait complete. 2024-09-19T06:40:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.317+0000 7fc5526ef740 20 client.15507 trim_cache size 0 max 16384 2024-09-19T06:40:33.324 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:40:33.324 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:40:33.324 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 4, 2024-09-19T06:40:33.324 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24431, 2024-09-19T06:40:33.325 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:40:33.325 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:40:33.325 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:40:33.325 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 127.65626849500001, 2024-09-19T06:40:33.325 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-19T06:40:33.325 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 86, 2024-09-19T06:40:33.325 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-19T06:40:33.325 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 178.42924608499999 2024-09-19T06:40:33.325 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:40:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 -- 172.21.15.12:0/4023794600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc5340a3440 msgr2=0x7fc5340a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc5340a3440 0x7fc5340a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc54002f540 tx=0x7fc54002f4d0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 -- 172.21.15.12:0/4023794600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc548102790 msgr2=0x7fc54819ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc548102790 0x7fc54819ac50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc53800d770 tx=0x7fc53800dc30 comp rx=0 tx=0).stop 2024-09-19T06:40:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 -- 172.21.15.12:0/4023794600 shutdown_connections 2024-09-19T06:40:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc548106f10 0x7fc54819efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc548102790 0x7fc54819ac50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc5340a3440 0x7fc5340a5900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 --2- 172.21.15.12:0/4023794600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc548101de0 0x7fc54819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:33.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 -- 172.21.15.12:0/4023794600 >> 172.21.15.12:0/4023794600 conn(0x7fc5480fd8e0 msgr2=0x7fc5480ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:33.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 -- 172.21.15.12:0/4023794600 shutdown_connections 2024-09-19T06:40:33.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:33.318+0000 7fc550316640 1 -- 172.21.15.12:0/4023794600 wait complete. 2024-09-19T06:40:34.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:33 smithi012 ceph-mon[30937]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:40:34.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:33 smithi173 ceph-mon[35349]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:40:34.162 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.l status 2024-09-19T06:40:34.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:33 smithi016 ceph-mon[34911]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:40:34.428 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.898+0000 7f739fe4b640 1 -- 172.21.15.12:0/4130659123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7398106a70 msgr2=0x7f7398106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.898+0000 7f739fe4b640 1 --2- 172.21.15.12:0/4130659123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7398106a70 0x7f7398106e50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7394009930 tx=0x7f739402a420 comp rx=0 tx=0).stop 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.898+0000 7f739fe4b640 1 -- 172.21.15.12:0/4130659123 shutdown_connections 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.898+0000 7f739fe4b640 1 --2- 172.21.15.12:0/4130659123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7398101410 0x7f739810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.898+0000 7f739fe4b640 1 --2- 172.21.15.12:0/4130659123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7398100a70 0x7f7398100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.898+0000 7f739fe4b640 1 --2- 172.21.15.12:0/4130659123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7398106a70 0x7f7398106e50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.898+0000 7f739fe4b640 1 -- 172.21.15.12:0/4130659123 >> 172.21.15.12:0/4130659123 conn(0x7f73980fc790 msgr2=0x7f73980febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.898+0000 7f739fe4b640 1 -- 172.21.15.12:0/4130659123 shutdown_connections 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.898+0000 7f739fe4b640 1 -- 172.21.15.12:0/4130659123 wait complete. 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739fe4b640 1 Processor -- start 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739fe4b640 1 -- start start 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739fe4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7398100a70 0x7f7398199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739fe4b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7398101410 0x7f7398199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739fe4b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7398106a70 0x7f73981a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739fe4b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7398110e70 con 0x7f7398100a70 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739fe4b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7398110cf0 con 0x7f7398101410 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739fe4b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7398110ff0 con 0x7f7398106a70 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739dbe7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7398100a70 0x7f7398199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739dbe7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7398100a70 0x7f7398199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41614/0 (socket says 172.21.15.12:41614) 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739dbe7640 1 -- 172.21.15.12:0/430806367 learned_addr learned my addr 172.21.15.12:0/430806367 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739e3e8640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7398106a70 0x7f73981a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739d3e6640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7398101410 0x7f7398199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739dbe7640 1 -- 172.21.15.12:0/430806367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7398106a70 msgr2=0x7f73981a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739dbe7640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7398106a70 0x7f73981a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739dbe7640 1 -- 172.21.15.12:0/430806367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7398101410 msgr2=0x7f7398199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739dbe7640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7398101410 0x7f7398199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.899+0000 7f739dbe7640 1 -- 172.21.15.12:0/430806367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73981a48e0 con 0x7f7398100a70 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.900+0000 7f739dbe7640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7398100a70 0x7f7398199320 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7394009230 tx=0x7f7394004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.900+0000 7f738effd640 1 -- 172.21.15.12:0/430806367 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739403f030 con 0x7f7398100a70 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.900+0000 7f738effd640 1 -- 172.21.15.12:0/430806367 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7394003ad0 con 0x7f7398100a70 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.900+0000 7f739fe4b640 1 -- 172.21.15.12:0/430806367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73981a4ab0 con 0x7f7398100a70 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.900+0000 7f738effd640 1 -- 172.21.15.12:0/430806367 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394035070 con 0x7f7398100a70 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.900+0000 7f739fe4b640 1 -- 172.21.15.12:0/430806367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73981a4f00 con 0x7f7398100a70 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.902+0000 7f738effd640 1 -- 172.21.15.12:0/430806367 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f7394042030 con 0x7f7398100a70 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.902+0000 7f73a2224740 1 Processor -- start 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f73a2224740 1 -- start start 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f73a2224740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf006db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f73a2224740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf0072f0 0x561adf011670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f73a2224740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf011bb0 0x561adf013fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f73a2224740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561adef6d090 con 0x561adf0069d0 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f73a2224740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561adef14a70 con 0x561adf0072f0 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f73a2224740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561adef69050 con 0x561adf011bb0 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f738effd640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f73840a3440 0x7f73840a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739e3e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf006db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739e3e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf006db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41620/0 (socket says 172.21.15.12:41620) 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739e3e8640 1 -- 172.21.15.12:0/1243296796 learned_addr learned my addr 172.21.15.12:0/1243296796 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739d3e6640 1 --2- 172.21.15.12:0/1243296796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf011bb0 0x561adf013fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f738effd640 1 -- 172.21.15.12:0/430806367 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f73940f0620 con 0x7f7398100a70 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739dbe7640 1 --2- 172.21.15.12:0/1243296796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf0072f0 0x561adf011670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739e3e8640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f73840a3440 0x7f73840a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739e3e8640 1 -- 172.21.15.12:0/1243296796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf011bb0 msgr2=0x561adf013fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739e3e8640 1 --2- 172.21.15.12:0/1243296796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf011bb0 0x561adf013fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739e3e8640 1 -- 172.21.15.12:0/1243296796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf0072f0 msgr2=0x561adf011670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739e3e8640 1 --2- 172.21.15.12:0/1243296796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf0072f0 0x561adf011670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.903+0000 7f739e3e8640 1 -- 172.21.15.12:0/1243296796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561adef21130 con 0x561adf0069d0 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.904+0000 7f739e3e8640 1 --2- 172.21.15.12:0/1243296796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf006db0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7390011da0 tx=0x7f739000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1a684ad900e422 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.904+0000 7f739e3e8640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f73840a3440 0x7f73840a5900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f739000fc90 tx=0x7f739001e000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.904+0000 7f7383fff640 1 -- 172.21.15.12:0/1243296796 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390022070 con 0x561adf0069d0 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.904+0000 7f7383fff640 1 -- 172.21.15.12:0/1243296796 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7390009dc0 con 0x561adf0069d0 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.904+0000 7f7383fff640 1 -- 172.21.15.12:0/1243296796 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73900042b0 con 0x561adf0069d0 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 -- 172.21.15.12:0/1243296796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 msgr2=0x561adf006db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 --2- 172.21.15.12:0/1243296796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf006db0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7390011da0 tx=0x7f739000f790 comp rx=0 tx=0).stop 2024-09-19T06:40:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 -- 172.21.15.12:0/1243296796 shutdown_connections 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 --2- 172.21.15.12:0/1243296796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf011bb0 0x561adf013fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 --2- 172.21.15.12:0/1243296796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf0072f0 0x561adf011670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 --2- 172.21.15.12:0/1243296796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf006db0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 -- 172.21.15.12:0/1243296796 >> 172.21.15.12:0/1243296796 conn(0x561adf002f60 msgr2=0x561adf003340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 -- 172.21.15.12:0/1243296796 shutdown_connections 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 -- 172.21.15.12:0/1243296796 wait complete. 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 -- start start 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.905+0000 7f73a2224740 1 Processor -- start 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f73a2224740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 0x561adf0114f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f73a2224740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf00e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f73a2224740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 0x561adf00ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f73a2224740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561adf014780 con 0x561adf0072f0 2024-09-19T06:40:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f73a2224740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561adef27f20 con 0x561adf011bb0 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f73a2224740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561adf014900 con 0x561adf0069d0 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f73a2224740 10 client.0 _ll_register_callbacks cb 0x561adeef1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739d3e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf00e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739d3e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf00e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41636/0 (socket says 172.21.15.12:41636) 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739d3e6640 1 -- 172.21.15.12:0/3928993137 learned_addr learned my addr 172.21.15.12:0/3928993137 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739dbe7640 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 0x561adf0114f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739e3e8640 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 0x561adf00ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739d3e6640 1 -- 172.21.15.12:0/3928993137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 msgr2=0x561adf0114f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739d3e6640 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 0x561adf0114f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739d3e6640 1 -- 172.21.15.12:0/3928993137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 msgr2=0x561adf00ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739d3e6640 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 0x561adf00ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739d3e6640 1 -- 172.21.15.12:0/3928993137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561adecde2b0 con 0x561adf0072f0 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739e3e8640 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 0x561adf00ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f739d3e6640 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf00e840 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f738800da10 tx=0x7f738800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd44ac2dd9f81ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.906+0000 7f73817fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73817fa640 1 -- 172.21.15.12:0/3928993137 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738801b440 con 0x561adf0072f0 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73817fa640 1 -- 172.21.15.12:0/3928993137 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f7388011440 con 0x561adf0072f0 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73a2224740 1 -- 172.21.15.12:0/3928993137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7390009dc0 con 0x561adf0072f0 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73817fa640 1 -- 172.21.15.12:0/3928993137 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7388011640 con 0x561adf0072f0 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73a2224740 10 client.15519 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73a2224740 1 -- 172.21.15.12:0/3928993137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561adf0201e0 con 0x561adf0072f0 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73817fa640 1 -- 172.21.15.12:0/3928993137 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7390009dc0 con 0x561adf0072f0 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73817fa640 1 -- 172.21.15.12:0/3928993137 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7388021070 con 0x561adf0072f0 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73a2224740 10 client.15519 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73a2224740 10 client.15519 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73a2224740 20 client.15519 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73a2224740 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561adf022870 0x561adf023ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73a2224740 4 client.15519 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.907+0000 7f73a2224740 1 -- 172.21.15.12:0/3928993137 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561adef7a600 con 0x561adf022870 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.908+0000 7f739dbe7640 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561adf022870 0x561adf023ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.908+0000 7f73817fa640 10 client.15519 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.908+0000 7f739dbe7640 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561adf022870 0x561adf023ce0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a71a2adc3181b030 server_cookie=78769d5684ce8250 in_seq=0 out_seq=0 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73817fa640 1 -- 172.21.15.12:0/3928993137 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561adef7a600 con 0x561adf022870 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73817fa640 10 client.15519 handle_command_reply: tid=0 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 client.15519 shutdown 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 -- 172.21.15.12:0/3928993137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 msgr2=0x561adf00e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf00e840 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f738800da10 tx=0x7f738800de10 comp rx=0 tx=0).stop 2024-09-19T06:40:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 -- 172.21.15.12:0/3928993137 shutdown_connections 2024-09-19T06:40:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561adf022870 0x561adf023ce0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 0x561adf00ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf00e840 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 --2- 172.21.15.12:0/3928993137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 0x561adf0114f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73817fa640 0 client.15519 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:40:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 -- 172.21.15.12:0/3928993137 >> 172.21.15.12:0/3928993137 conn(0x561adf002f60 msgr2=0x561adf008c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 -- 172.21.15.12:0/3928993137 shutdown_connections 2024-09-19T06:40:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 1 -- 172.21.15.12:0/3928993137 wait complete. 2024-09-19T06:40:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.909+0000 7f73a2224740 20 client.15519 trim_cache size 0 max 16384 2024-09-19T06:40:34.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f73a2224740 1 Processor -- start 2024-09-19T06:40:34.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f73a2224740 1 -- start start 2024-09-19T06:40:34.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f73a2224740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf022f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f73a2224740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf0072f0 0x561adf02bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f73a2224740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf011bb0 0x561adf02c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f73a2224740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561adf022020 con 0x561adf0069d0 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f73a2224740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561adf0226f0 con 0x561adf0072f0 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f73a2224740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561adf022dc0 con 0x561adf011bb0 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739dbe7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf022f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739dbe7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf022f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41638/0 (socket says 172.21.15.12:41638) 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739dbe7640 1 -- 172.21.15.12:0/4071032156 learned_addr learned my addr 172.21.15.12:0/4071032156 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739e3e8640 1 --2- 172.21.15.12:0/4071032156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf011bb0 0x561adf02c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739d3e6640 1 --2- 172.21.15.12:0/4071032156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf0072f0 0x561adf02bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739dbe7640 1 -- 172.21.15.12:0/4071032156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf011bb0 msgr2=0x561adf02c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739dbe7640 1 --2- 172.21.15.12:0/4071032156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf011bb0 0x561adf02c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739dbe7640 1 -- 172.21.15.12:0/4071032156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf0072f0 msgr2=0x561adf02bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739dbe7640 1 --2- 172.21.15.12:0/4071032156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf0072f0 0x561adf02bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739dbe7640 1 -- 172.21.15.12:0/4071032156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561adf011860 con 0x561adf0069d0 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.928+0000 7f739dbe7640 1 --2- 172.21.15.12:0/4071032156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf022f40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7394009a50 tx=0x7f7394046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacaeb335506242e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.929+0000 7f73837fe640 1 -- 172.21.15.12:0/4071032156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394049040 con 0x561adf0069d0 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.929+0000 7f73837fe640 1 -- 172.21.15.12:0/4071032156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73940c0a60 con 0x561adf0069d0 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.929+0000 7f73837fe640 1 -- 172.21.15.12:0/4071032156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73940035f0 con 0x561adf0069d0 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.929+0000 7f73a2224740 1 -- 172.21.15.12:0/4071032156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 msgr2=0x561adf022f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.929+0000 7f73a2224740 1 --2- 172.21.15.12:0/4071032156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf022f40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7394009a50 tx=0x7f7394046040 comp rx=0 tx=0).stop 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.929+0000 7f73a2224740 1 -- 172.21.15.12:0/4071032156 shutdown_connections 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.929+0000 7f73a2224740 1 --2- 172.21.15.12:0/4071032156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf011bb0 0x561adf02c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.929+0000 7f73a2224740 1 --2- 172.21.15.12:0/4071032156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf0072f0 0x561adf02bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.929+0000 7f73a2224740 1 --2- 172.21.15.12:0/4071032156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0069d0 0x561adf022f40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.929+0000 7f73a2224740 1 -- 172.21.15.12:0/4071032156 >> 172.21.15.12:0/4071032156 conn(0x561adf002f60 msgr2=0x561adf00d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 1 -- 172.21.15.12:0/4071032156 shutdown_connections 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 1 -- 172.21.15.12:0/4071032156 wait complete. 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 1 -- start start 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 1 Processor -- start 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 0x561adf027490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf0279d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 0x561adf08af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561adf023b60 con 0x561adf0072f0 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561adf023490 con 0x561adf011bb0 2024-09-19T06:40:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561adf024230 con 0x561adf0069d0 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.930+0000 7f73a2224740 10 client.0 _ll_register_callbacks cb 0x7f7388004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739dbe7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 0x561adf027490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739d3e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf0279d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739dbe7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 0x561adf027490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58478/0 (socket says 172.21.15.12:58478) 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739dbe7640 1 -- 172.21.15.12:0/1789835080 learned_addr learned my addr 172.21.15.12:0/1789835080 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739e3e8640 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 0x561adf08af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739dbe7640 1 -- 172.21.15.12:0/1789835080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 msgr2=0x561adf08af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739dbe7640 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 0x561adf08af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739dbe7640 1 -- 172.21.15.12:0/1789835080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 msgr2=0x561adf0279d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739dbe7640 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf0279d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739dbe7640 1 -- 172.21.15.12:0/1789835080 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561adf08b4b0 con 0x561adf0069d0 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739d3e6640 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf0279d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739e3e8640 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 0x561adf08af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f739dbe7640 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 0x561adf027490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7394032c00 tx=0x7f7394005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79086a954afb141c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f73817fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f73817fa640 1 -- 172.21.15.12:0/1789835080 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73940ca020 con 0x561adf0069d0 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f73817fa640 1 -- 172.21.15.12:0/1789835080 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f7394003c80 con 0x561adf0069d0 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f73a2224740 1 -- 172.21.15.12:0/1789835080 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73940c0a60 con 0x561adf0069d0 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.931+0000 7f73817fa640 1 -- 172.21.15.12:0/1789835080 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f73940ba750 con 0x561adf0069d0 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f73a2224740 10 client.25189 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f73a2224740 1 -- 172.21.15.12:0/1789835080 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561adf08c790 con 0x561adf0069d0 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f73817fa640 1 -- 172.21.15.12:0/1789835080 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73940c0a60 con 0x561adf0069d0 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f73817fa640 1 -- 172.21.15.12:0/1789835080 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f73940dc040 con 0x561adf0069d0 2024-09-19T06:40:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f73a2224740 10 client.25189 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f73a2224740 10 client.25189 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f73a2224740 20 client.25189 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f73a2224740 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561adf0912b0 0x561adf08ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f73a2224740 4 client.25189 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f73a2224740 1 -- 172.21.15.12:0/1789835080 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "status"}) -- 0x561adef74b10 con 0x561adf0912b0 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.932+0000 7f739d3e6640 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561adf0912b0 0x561adf08ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73817fa640 10 client.25189 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f739d3e6640 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561adf0912b0 0x561adf08ffc0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=249df908ec19fed0 server_cookie=c3e7feaed8664361 in_seq=0 out_seq=0 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73817fa640 1 -- 172.21.15.12:0/1789835080 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561adef74b10 con 0x561adf0912b0 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73817fa640 10 client.25189 handle_command_reply: tid=0 2024-09-19T06:40:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 client.25189 shutdown 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 -- 172.21.15.12:0/1789835080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 msgr2=0x561adf027490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 0x561adf027490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7394032c00 tx=0x7f7394005c90 comp rx=0 tx=0).stop 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 -- 172.21.15.12:0/1789835080 shutdown_connections 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561adf0912b0 0x561adf08ffc0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561adf011bb0 0x561adf08af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73817fa640 0 client.25189 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561adf0072f0 0x561adf0279d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 --2- 172.21.15.12:0/1789835080 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561adf0069d0 0x561adf027490 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 -- 172.21.15.12:0/1789835080 >> 172.21.15.12:0/1789835080 conn(0x561adf002f60 msgr2=0x561adf00d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 -- 172.21.15.12:0/1789835080 shutdown_connections 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 1 -- 172.21.15.12:0/1789835080 wait complete. 2024-09-19T06:40:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.933+0000 7f73a2224740 20 client.25189 trim_cache size 0 max 16384 2024-09-19T06:40:34.945 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:40:34.945 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:40:34.945 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 3, 2024-09-19T06:40:34.945 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24439, 2024-09-19T06:40:34.945 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:40:34.946 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:40:34.946 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:40:34.946 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 130.27887296200001, 2024-09-19T06:40:34.946 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-19T06:40:34.946 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 86, 2024-09-19T06:40:34.946 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-19T06:40:34.946 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 182.79402251299999 2024-09-19T06:40:34.947 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:40:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 -- 172.21.15.12:0/430806367 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f73840a3440 msgr2=0x7f73840a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f73840a3440 0x7f73840a5900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f739000fc90 tx=0x7f739001e000 comp rx=0 tx=0).stop 2024-09-19T06:40:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 -- 172.21.15.12:0/430806367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7398100a70 msgr2=0x7f7398199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7398100a70 0x7f7398199320 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7394009230 tx=0x7f7394004270 comp rx=0 tx=0).stop 2024-09-19T06:40:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 -- 172.21.15.12:0/430806367 shutdown_connections 2024-09-19T06:40:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f73840a3440 0x7f73840a5900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7398106a70 0x7f73981a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7398101410 0x7f7398199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 --2- 172.21.15.12:0/430806367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7398100a70 0x7f7398199320 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:34.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 -- 172.21.15.12:0/430806367 >> 172.21.15.12:0/430806367 conn(0x7f73980fc790 msgr2=0x7f73980fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:34.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 -- 172.21.15.12:0/430806367 shutdown_connections 2024-09-19T06:40:34.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:34.934+0000 7f739fe4b640 1 -- 172.21.15.12:0/430806367 wait complete. 2024-09-19T06:40:35.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T06:40:35.904 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:36.168 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:35 smithi012 ceph-mon[30937]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:40:36.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:35 smithi016 ceph-mon[34911]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:40:36.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:35 smithi173 ceph-mon[35349]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:40:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.408+0000 7f20ec9de640 1 -- 172.21.15.12:0/1180291793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20e8101420 msgr2=0x7f20e810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.408+0000 7f20ec9de640 1 --2- 172.21.15.12:0/1180291793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20e8101420 0x7f20e810d950 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009cd0 tx=0x7f20e002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.408+0000 7f20ec9de640 1 -- 172.21.15.12:0/1180291793 shutdown_connections 2024-09-19T06:40:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.408+0000 7f20ec9de640 1 --2- 172.21.15.12:0/1180291793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20e8101420 0x7f20e810d950 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.408+0000 7f20ec9de640 1 --2- 172.21.15.12:0/1180291793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20e8100a80 0x7f20e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.408+0000 7f20ec9de640 1 --2- 172.21.15.12:0/1180291793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e8106a80 0x7f20e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.408+0000 7f20ec9de640 1 -- 172.21.15.12:0/1180291793 >> 172.21.15.12:0/1180291793 conn(0x7f20e80fc7a0 msgr2=0x7f20e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.409+0000 7f20ec9de640 1 -- 172.21.15.12:0/1180291793 shutdown_connections 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.409+0000 7f20ec9de640 1 -- 172.21.15.12:0/1180291793 wait complete. 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.409+0000 7f20ec9de640 1 Processor -- start 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.409+0000 7f20ec9de640 1 -- start start 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20ec9de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20e8100a80 0x7f20e8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20ec9de640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20e8101420 0x7f20e8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20ec9de640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e8106a80 0x7f20e81a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20ec9de640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20e8110e80 con 0x7f20e8100a80 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20ec9de640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20e8110d00 con 0x7f20e8101420 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20ec9de640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20e8111000 con 0x7f20e8106a80 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20e659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20e8100a80 0x7f20e8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20e8101420 0x7f20e8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20e659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20e8100a80 0x7f20e8199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41668/0 (socket says 172.21.15.12:41668) 2024-09-19T06:40:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20e659c640 1 -- 172.21.15.12:0/3770749042 learned_addr learned my addr 172.21.15.12:0/3770749042 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20e6d9d640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e8106a80 0x7f20e81a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20dffff640 1 -- 172.21.15.12:0/3770749042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e8106a80 msgr2=0x7f20e81a42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20dffff640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e8106a80 0x7f20e81a42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20dffff640 1 -- 172.21.15.12:0/3770749042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20e8100a80 msgr2=0x7f20e8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20dffff640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20e8100a80 0x7f20e8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20dffff640 1 -- 172.21.15.12:0/3770749042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e81a47f0 con 0x7f20e8101420 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20e659c640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20e8100a80 0x7f20e8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20dffff640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20e8101420 0x7f20e8199770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20d000e9f0 tx=0x7f20d000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.410+0000 7f20df7fe640 1 -- 172.21.15.12:0/3770749042 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d000cd80 con 0x7f20e8101420 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.411+0000 7f20df7fe640 1 -- 172.21.15.12:0/3770749042 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d00035f0 con 0x7f20e8101420 2024-09-19T06:40:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.411+0000 7f20ec9de640 1 -- 172.21.15.12:0/3770749042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e81a49c0 con 0x7f20e8101420 2024-09-19T06:40:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.411+0000 7f20df7fe640 1 -- 172.21.15.12:0/3770749042 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0010690 con 0x7f20e8101420 2024-09-19T06:40:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.411+0000 7f20ec9de640 1 -- 172.21.15.12:0/3770749042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e81a4f50 con 0x7f20e8101420 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.413+0000 7f20df7fe640 1 -- 172.21.15.12:0/3770749042 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f20d0003b30 con 0x7f20e8101420 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.413+0000 7f20eedb7740 1 Processor -- start 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.413+0000 7f20eedb7740 1 -- start start 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20df7fe640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d40a34c0 0x7f20d40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96517db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 0x55be96522670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be96522bb0 0x55be96524fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20eedb7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55be9647e090 con 0x55be965182f0 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20eedb7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55be96425a70 con 0x55be965179d0 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20eedb7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55be9647a050 con 0x55be96522bb0 2024-09-19T06:40:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20e659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96517db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 0x55be96522670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20e6d9d640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d40a34c0 0x7f20d40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20e659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96517db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:39632/0 (socket says 172.21.15.12:39632) 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20e659c640 1 -- 172.21.15.12:0/188078986 learned_addr learned my addr 172.21.15.12:0/188078986 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20df7fe640 1 -- 172.21.15.12:0/3770749042 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f20d00d01d0 con 0x7f20e8101420 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20e659c640 1 -- 172.21.15.12:0/188078986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be96522bb0 msgr2=0x55be96524fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20e659c640 1 --2- 172.21.15.12:0/188078986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be96522bb0 0x55be96524fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20e659c640 1 -- 172.21.15.12:0/188078986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 msgr2=0x55be96522670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20e659c640 1 --2- 172.21.15.12:0/188078986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 0x55be96522670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.414+0000 7f20e659c640 1 -- 172.21.15.12:0/188078986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be96432130 con 0x55be965179d0 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20e659c640 1 --2- 172.21.15.12:0/188078986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96517db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20d80115f0 tx=0x7f20d8011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1630de7cebfa9f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20e6d9d640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d40a34c0 0x7f20d40a5980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f20e0004ab0 tx=0x7f20e0031430 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20dcff9640 1 -- 172.21.15.12:0/188078986 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d800f8f0 con 0x55be965179d0 2024-09-19T06:40:36.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20dcff9640 1 -- 172.21.15.12:0/188078986 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d8019420 con 0x55be965179d0 2024-09-19T06:40:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20dcff9640 1 -- 172.21.15.12:0/188078986 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8018630 con 0x55be965179d0 2024-09-19T06:40:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20eedb7740 1 -- 172.21.15.12:0/188078986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 msgr2=0x55be96517db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20eedb7740 1 --2- 172.21.15.12:0/188078986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96517db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20d80115f0 tx=0x7f20d8011ab0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20eedb7740 1 -- 172.21.15.12:0/188078986 shutdown_connections 2024-09-19T06:40:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20eedb7740 1 --2- 172.21.15.12:0/188078986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be96522bb0 0x55be96524fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20eedb7740 1 --2- 172.21.15.12:0/188078986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 0x55be96522670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20eedb7740 1 --2- 172.21.15.12:0/188078986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96517db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.415+0000 7f20eedb7740 1 -- 172.21.15.12:0/188078986 >> 172.21.15.12:0/188078986 conn(0x55be96513f60 msgr2=0x55be96514340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 1 -- 172.21.15.12:0/188078986 shutdown_connections 2024-09-19T06:40:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 1 -- 172.21.15.12:0/188078986 wait complete. 2024-09-19T06:40:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 1 -- start start 2024-09-19T06:40:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 1 Processor -- start 2024-09-19T06:40:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be965224c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be965182f0 0x55be9651f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be9651fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55be96525780 con 0x55be96522bb0 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55be96438f20 con 0x55be965179d0 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55be96525900 con 0x55be965182f0 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20eedb7740 10 client.0 _ll_register_callbacks cb 0x55be96402030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.416+0000 7f20e6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be9651fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20e659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be965224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20e659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be965224c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:39644/0 (socket says 172.21.15.12:39644) 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20e6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be9651fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41678/0 (socket says 172.21.15.12:41678) 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20e659c640 1 -- 172.21.15.12:0/78637706 learned_addr learned my addr 172.21.15.12:0/78637706 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20dffff640 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be965182f0 0x55be9651f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20e659c640 1 -- 172.21.15.12:0/78637706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be965182f0 msgr2=0x55be9651f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20e659c640 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be965182f0 0x55be9651f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20e659c640 1 -- 172.21.15.12:0/78637706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 msgr2=0x55be9651fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20e659c640 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be9651fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20e659c640 1 -- 172.21.15.12:0/78637706 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be961ef2b0 con 0x55be965179d0 2024-09-19T06:40:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20e659c640 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be965224c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20d80115c0 tx=0x7f20d8019f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e97191e89881e84c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:40:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20cdffb640 1 -- 172.21.15.12:0/78637706 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d800f6c0 con 0x55be965179d0 2024-09-19T06:40:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20cdffb640 1 -- 172.21.15.12:0/78637706 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f20d800f860 con 0x55be965179d0 2024-09-19T06:40:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.417+0000 7f20eedb7740 1 -- 172.21.15.12:0/78637706 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20d8019420 con 0x55be965179d0 2024-09-19T06:40:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20cdffb640 1 -- 172.21.15.12:0/78637706 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f20d800fa60 con 0x55be965179d0 2024-09-19T06:40:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20eedb7740 10 client.25163 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:36.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20eedb7740 1 -- 172.21.15.12:0/78637706 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55be96531100 con 0x55be965179d0 2024-09-19T06:40:36.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20cdffb640 1 -- 172.21.15.12:0/78637706 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d8019420 con 0x55be965179d0 2024-09-19T06:40:36.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20cdffb640 1 -- 172.21.15.12:0/78637706 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f20d8030070 con 0x55be965179d0 2024-09-19T06:40:36.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20eedb7740 10 client.25163 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:36.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20eedb7740 10 client.25163 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:40:36.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20eedb7740 20 client.25163 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:36.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20eedb7740 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55be965334b0 0x55be96534920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20eedb7740 4 client.25163 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:36.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.418+0000 7f20eedb7740 1 -- 172.21.15.12:0/78637706 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be9648b600 con 0x55be965334b0 2024-09-19T06:40:36.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.419+0000 7f20dffff640 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55be965334b0 0x55be96534920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.419+0000 7f20cdffb640 10 client.25163 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.419+0000 7f20dffff640 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55be965334b0 0x55be96534920 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bbc61ed2290d6e26 server_cookie=96d6e6c0123559c4 in_seq=0 out_seq=0 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20cdffb640 1 -- 172.21.15.12:0/78637706 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be9648b600 con 0x55be965334b0 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20cdffb640 10 client.25163 handle_command_reply: tid=0 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 client.25163 shutdown 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 -- 172.21.15.12:0/78637706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 msgr2=0x55be965224c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be965224c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20d80115c0 tx=0x7f20d8019f90 comp rx=0 tx=0).stop 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 -- 172.21.15.12:0/78637706 shutdown_connections 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55be965334b0 0x55be96534920 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be9651fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be965182f0 0x55be9651f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 --2- 172.21.15.12:0/78637706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be965224c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20cdffb640 0 client.25163 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:40:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 -- 172.21.15.12:0/78637706 >> 172.21.15.12:0/78637706 conn(0x55be96513f60 msgr2=0x55be96519c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 -- 172.21.15.12:0/78637706 shutdown_connections 2024-09-19T06:40:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 1 -- 172.21.15.12:0/78637706 wait complete. 2024-09-19T06:40:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.420+0000 7f20eedb7740 20 client.25163 trim_cache size 0 max 16384 2024-09-19T06:40:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20eedb7740 1 Processor -- start 2024-09-19T06:40:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20eedb7740 1 -- start start 2024-09-19T06:40:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96512ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 0x55be9651ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be96522bb0 0x55be9651cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20eedb7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55be96532c60 con 0x55be965182f0 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20eedb7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55be96533330 con 0x55be965179d0 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20eedb7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55be96533a00 con 0x55be96522bb0 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 0x55be9651ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 0x55be9651ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41686/0 (socket says 172.21.15.12:41686) 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20dffff640 1 -- 172.21.15.12:0/3532989342 learned_addr learned my addr 172.21.15.12:0/3532989342 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20e659c640 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96512ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.438+0000 7f20dffff640 1 -- 172.21.15.12:0/3532989342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be96522bb0 msgr2=0x55be9651cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20e6d9d640 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be96522bb0 0x55be9651cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20dffff640 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be96522bb0 0x55be9651cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20dffff640 1 -- 172.21.15.12:0/3532989342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 msgr2=0x55be96512ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20dffff640 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96512ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20dffff640 1 -- 172.21.15.12:0/3532989342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be965150f0 con 0x55be965182f0 2024-09-19T06:40:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20e659c640 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96512ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20e6d9d640 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be96522bb0 0x55be9651cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20dffff640 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 0x55be9651ca70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f20d0004610 tx=0x7f20d00bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797f6d5453c99ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20cffff640 1 -- 172.21.15.12:0/3532989342 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d009c2c0 con 0x55be965182f0 2024-09-19T06:40:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20cffff640 1 -- 172.21.15.12:0/3532989342 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d00a0670 con 0x55be965182f0 2024-09-19T06:40:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.439+0000 7f20cffff640 1 -- 172.21.15.12:0/3532989342 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0098930 con 0x55be965182f0 2024-09-19T06:40:36.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 -- 172.21.15.12:0/3532989342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 msgr2=0x55be9651ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:36.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 0x55be9651ca70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f20d0004610 tx=0x7f20d00bc040 comp rx=0 tx=0).stop 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 -- 172.21.15.12:0/3532989342 shutdown_connections 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be96522bb0 0x55be9651cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be965182f0 0x55be9651ca70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 --2- 172.21.15.12:0/3532989342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965179d0 0x55be96512ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 -- 172.21.15.12:0/3532989342 >> 172.21.15.12:0/3532989342 conn(0x55be96513f60 msgr2=0x55be965127e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 -- 172.21.15.12:0/3532989342 shutdown_connections 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 -- 172.21.15.12:0/3532989342 wait complete. 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 -- start start 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 Processor -- start 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be965179d0 0x55be9653a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965182f0 0x55be9653af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be96535fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55be965347a0 con 0x55be96522bb0 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55be965340d0 con 0x55be965182f0 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55be96534e70 con 0x55be965179d0 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20eedb7740 10 client.0 _ll_register_callbacks cb 0x7f20d00cd670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20e6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be96535fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965182f0 0x55be9653af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20e6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be96535fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41688/0 (socket says 172.21.15.12:41688) 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.440+0000 7f20e6d9d640 1 -- 172.21.15.12:0/1732401844 learned_addr learned my addr 172.21.15.12:0/1732401844 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20e659c640 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be965179d0 0x55be9653a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20dffff640 1 -- 172.21.15.12:0/1732401844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be965179d0 msgr2=0x55be9653a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20dffff640 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be965179d0 0x55be9653a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20dffff640 1 -- 172.21.15.12:0/1732401844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 msgr2=0x55be96535fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20dffff640 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be96535fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20dffff640 1 -- 172.21.15.12:0/1732401844 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be96536610 con 0x55be965182f0 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20e6d9d640 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be96535fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20dffff640 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965182f0 0x55be9653af00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20d0004610 tx=0x7f20d00a4fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d4de38453f1f81b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20cdffb640 1 -- 172.21.15.12:0/1732401844 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d00b9020 con 0x55be965182f0 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20cdffb640 1 -- 172.21.15.12:0/1732401844 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f20d0098930 con 0x55be965182f0 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20eedb7740 1 -- 172.21.15.12:0/1732401844 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20d00a0670 con 0x55be965182f0 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20cdffb640 1 -- 172.21.15.12:0/1732401844 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f20d0009430 con 0x55be965182f0 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20eedb7740 10 client.25166 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.441+0000 7f20eedb7740 1 -- 172.21.15.12:0/1732401844 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55be96539ff0 con 0x55be965182f0 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.442+0000 7f20cdffb640 1 -- 172.21.15.12:0/1732401844 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d00a0670 con 0x55be965182f0 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.442+0000 7f20cdffb640 1 -- 172.21.15.12:0/1732401844 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f20d00bc0b0 con 0x55be965182f0 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.442+0000 7f20eedb7740 10 client.25166 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.442+0000 7f20eedb7740 10 client.25166 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:40:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.442+0000 7f20eedb7740 20 client.25166 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.442+0000 7f20eedb7740 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55be965a1a20 0x55be965a0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.442+0000 7f20eedb7740 4 client.25166 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.442+0000 7f20eedb7740 1 -- 172.21.15.12:0/1732401844 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "status"}) -- 0x55be96485b10 con 0x55be965a1a20 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.442+0000 7f20e659c640 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55be965a1a20 0x55be965a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20e659c640 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55be965a1a20 0x55be965a0730 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9302d91af42b3f2 server_cookie=b6ef15b3b93a2ade in_seq=0 out_seq=0 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20cdffb640 10 client.25166 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20cdffb640 1 -- 172.21.15.12:0/1732401844 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55be96485b10 con 0x55be965a1a20 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20cdffb640 10 client.25166 handle_command_reply: tid=0 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 client.25166 shutdown 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 -- 172.21.15.12:0/1732401844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965182f0 msgr2=0x55be9653af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965182f0 0x55be9653af00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20d0004610 tx=0x7f20d00a4fa0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 -- 172.21.15.12:0/1732401844 shutdown_connections 2024-09-19T06:40:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55be965a1a20 0x55be965a0730 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55be96522bb0 0x55be96535fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55be965182f0 0x55be9653af00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20cdffb640 0 client.25166 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 --2- 172.21.15.12:0/1732401844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55be965179d0 0x55be9653a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 -- 172.21.15.12:0/1732401844 >> 172.21.15.12:0/1732401844 conn(0x55be96513f60 msgr2=0x55be96519bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 -- 172.21.15.12:0/1732401844 shutdown_connections 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 1 -- 172.21.15.12:0/1732401844 wait complete. 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.443+0000 7f20eedb7740 20 client.25166 trim_cache size 0 max 16384 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:40:36.450 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 2, 2024-09-19T06:40:36.451 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24481, 2024-09-19T06:40:36.451 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:40:36.451 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:40:36.451 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:40:36.451 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 132.37304701599999, 2024-09-19T06:40:36.451 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-19T06:40:36.451 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 86, 2024-09-19T06:40:36.451 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-19T06:40:36.451 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 167.045890654 2024-09-19T06:40:36.451 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 -- 172.21.15.12:0/3770749042 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d40a34c0 msgr2=0x7f20d40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d40a34c0 0x7f20d40a5980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f20e0004ab0 tx=0x7f20e0031430 comp rx=0 tx=0).stop 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 -- 172.21.15.12:0/3770749042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20e8101420 msgr2=0x7f20e8199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20e8101420 0x7f20e8199770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20d000e9f0 tx=0x7f20d000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 -- 172.21.15.12:0/3770749042 shutdown_connections 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d40a34c0 0x7f20d40a5980 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e8106a80 0x7f20e81a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20e8101420 0x7f20e8199770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 --2- 172.21.15.12:0/3770749042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20e8100a80 0x7f20e8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 -- 172.21.15.12:0/3770749042 >> 172.21.15.12:0/3770749042 conn(0x7f20e80fc7a0 msgr2=0x7f20e80fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 -- 172.21.15.12:0/3770749042 shutdown_connections 2024-09-19T06:40:36.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:36.444+0000 7f20ec9de640 1 -- 172.21.15.12:0/3770749042 wait complete. 2024-09-19T06:40:37.200 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:40:37.462 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:37.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.934+0000 7f6468629640 1 -- 172.21.15.12:0/1169745155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460100ca0 msgr2=0x7f6460106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.934+0000 7f6468629640 1 --2- 172.21.15.12:0/1169745155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460100ca0 0x7f6460106840 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6450009930 tx=0x7f645002a420 comp rx=0 tx=0).stop 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 -- 172.21.15.12:0/1169745155 shutdown_connections 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 --2- 172.21.15.12:0/1169745155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460106f50 0x7f646010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 --2- 172.21.15.12:0/1169745155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460100ca0 0x7f6460106840 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 --2- 172.21.15.12:0/1169745155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64601002f0 0x7f64601006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 -- 172.21.15.12:0/1169745155 >> 172.21.15.12:0/1169745155 conn(0x7f6460077210 msgr2=0x7f64600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 -- 172.21.15.12:0/1169745155 shutdown_connections 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 -- 172.21.15.12:0/1169745155 wait complete. 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 Processor -- start 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 -- start start 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64601002f0 0x7f6460101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460100ca0 0x7f64601017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.935+0000 7f6468629640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460106f50 0x7f6460101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6468629640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6460111f60 con 0x7f6460106f50 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6468629640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6460111de0 con 0x7f6460100ca0 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6468629640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f64601120e0 con 0x7f64601002f0 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6466bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460106f50 0x7f6460101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6466bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460106f50 0x7f6460101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41708/0 (socket says 172.21.15.12:41708) 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6466bc6640 1 -- 172.21.15.12:0/2092183296 learned_addr learned my addr 172.21.15.12:0/2092183296 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f64663c5640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64601002f0 0x7f6460101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6465bc4640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460100ca0 0x7f64601017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6466bc6640 1 -- 172.21.15.12:0/2092183296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64601002f0 msgr2=0x7f6460101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6466bc6640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64601002f0 0x7f6460101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6466bc6640 1 -- 172.21.15.12:0/2092183296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460100ca0 msgr2=0x7f64601017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6466bc6640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460100ca0 0x7f64601017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6466bc6640 1 -- 172.21.15.12:0/2092183296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64601a6920 con 0x7f6460106f50 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f6466bc6640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460106f50 0x7f6460101cf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f645800cad0 tx=0x7f645800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f64577fe640 1 -- 172.21.15.12:0/2092183296 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645800ad60 con 0x7f6460106f50 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.936+0000 7f64577fe640 1 -- 172.21.15.12:0/2092183296 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6458005020 con 0x7f6460106f50 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.937+0000 7f6468629640 1 -- 172.21.15.12:0/2092183296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64601a6c10 con 0x7f6460106f50 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.937+0000 7f64577fe640 1 -- 172.21.15.12:0/2092183296 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645800f6b0 con 0x7f6460106f50 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.937+0000 7f6468629640 1 -- 172.21.15.12:0/2092183296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64601a7120 con 0x7f6460106f50 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.939+0000 7f64577fe640 1 -- 172.21.15.12:0/2092183296 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f6458005560 con 0x7f6460106f50 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.939+0000 7f646aa02740 1 Processor -- start 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.939+0000 7f646aa02740 1 -- start start 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f646aa02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 0x5597cb7e2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f646aa02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 0x5597cb7ed670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f646aa02740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7effa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f646aa02740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5597cb749090 con 0x5597cb7edbb0 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f646aa02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5597cb6f0a70 con 0x5597cb7e32f0 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f646aa02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5597cb745050 con 0x5597cb7e29d0 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f64577fe640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f644c0a34c0 0x7f644c0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f6465bc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7effa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f6465bc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7effa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41712/0 (socket says 172.21.15.12:41712) 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f64663c5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 0x5597cb7ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f6465bc4640 1 -- 172.21.15.12:0/2104890784 learned_addr learned my addr 172.21.15.12:0/2104890784 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f6466bc6640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f644c0a34c0 0x7f644c0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f6465bc4640 1 --2- 172.21.15.12:0/2104890784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 0x5597cb7e2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f64577fe640 1 -- 172.21.15.12:0/2092183296 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f64580cfe20 con 0x7f6460106f50 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f64663c5640 1 -- 172.21.15.12:0/2104890784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 msgr2=0x5597cb7e2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:37.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f64663c5640 1 --2- 172.21.15.12:0/2104890784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 0x5597cb7e2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f64663c5640 1 -- 172.21.15.12:0/2104890784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 msgr2=0x5597cb7effa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f64663c5640 1 --2- 172.21.15.12:0/2104890784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7effa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f64663c5640 1 -- 172.21.15.12:0/2104890784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597cb6fd130 con 0x5597cb7e32f0 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f6465bc4640 1 --2- 172.21.15.12:0/2104890784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 0x5597cb7e2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f6466bc6640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f644c0a34c0 0x7f644c0a5980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64580cd490 tx=0x7f645806d040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.940+0000 7f64663c5640 1 --2- 172.21.15.12:0/2104890784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 0x5597cb7ed670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f645c00abf0 tx=0x7f645c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=950dfe19bf1525f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.941+0000 7f6454ff9640 1 -- 172.21.15.12:0/2104890784 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c005220 con 0x5597cb7e32f0 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.941+0000 7f6454ff9640 1 -- 172.21.15.12:0/2104890784 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f645c004c80 con 0x5597cb7e32f0 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.941+0000 7f6454ff9640 1 -- 172.21.15.12:0/2104890784 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c018830 con 0x5597cb7e32f0 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.941+0000 7f646aa02740 1 -- 172.21.15.12:0/2104890784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 msgr2=0x5597cb7ed670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.941+0000 7f646aa02740 1 --2- 172.21.15.12:0/2104890784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 0x5597cb7ed670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f645c00abf0 tx=0x7f645c00f790 comp rx=0 tx=0).stop 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.941+0000 7f646aa02740 1 -- 172.21.15.12:0/2104890784 shutdown_connections 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.941+0000 7f646aa02740 1 --2- 172.21.15.12:0/2104890784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7effa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.941+0000 7f646aa02740 1 --2- 172.21.15.12:0/2104890784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 0x5597cb7ed670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.941+0000 7f646aa02740 1 --2- 172.21.15.12:0/2104890784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 0x5597cb7e2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.941+0000 7f646aa02740 1 -- 172.21.15.12:0/2104890784 >> 172.21.15.12:0/2104890784 conn(0x5597cb7def60 msgr2=0x5597cb7df340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 1 -- 172.21.15.12:0/2104890784 shutdown_connections 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 1 -- 172.21.15.12:0/2104890784 wait complete. 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 1 -- start start 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 1 Processor -- start 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 0x5597cb7ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e32f0 0x5597cb7ea700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7edbb0 0x5597cb7eac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5597cb7f0780 con 0x5597cb7e32f0 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5597cb703f20 con 0x5597cb7edbb0 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5597cb7f0900 con 0x5597cb7e29d0 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f646aa02740 10 client.0 _ll_register_callbacks cb 0x5597cb6cd030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f64663c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e32f0 0x5597cb7ea700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f64663c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e32f0 0x5597cb7ea700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41722/0 (socket says 172.21.15.12:41722) 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.942+0000 7f64663c5640 1 -- 172.21.15.12:0/3260879716 learned_addr learned my addr 172.21.15.12:0/3260879716 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7edbb0 0x5597cb7eac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f64663c5640 1 -- 172.21.15.12:0/3260879716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 msgr2=0x5597cb7ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 0x5597cb7ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f64663c5640 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 0x5597cb7ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f64663c5640 1 -- 172.21.15.12:0/3260879716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7edbb0 msgr2=0x5597cb7eac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f64663c5640 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7edbb0 0x5597cb7eac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f64663c5640 1 -- 172.21.15.12:0/3260879716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597cb4ba2b0 con 0x5597cb7e32f0 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 0x5597cb7ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f64663c5640 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e32f0 0x5597cb7ea700 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f645c00abc0 tx=0x7f645c0052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e5e60ca12e8992 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:37.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f6449ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f6449ffb640 1 -- 172.21.15.12:0/3260879716 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c027070 con 0x5597cb7e32f0 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f646aa02740 1 -- 172.21.15.12:0/3260879716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f645c004c80 con 0x5597cb7e32f0 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f6449ffb640 1 -- 172.21.15.12:0/3260879716 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f645c0185b0 con 0x5597cb7e32f0 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f6449ffb640 1 -- 172.21.15.12:0/3260879716 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f645c033050 con 0x5597cb7e32f0 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f646aa02740 10 client.15555 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f646aa02740 1 -- 172.21.15.12:0/3260879716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5597cb7fc040 con 0x5597cb7e32f0 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.943+0000 7f6449ffb640 1 -- 172.21.15.12:0/3260879716 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f645c004c80 con 0x5597cb7e32f0 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.944+0000 7f6449ffb640 1 -- 172.21.15.12:0/3260879716 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f645c0234c0 con 0x5597cb7e32f0 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.944+0000 7f646aa02740 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.944+0000 7f646aa02740 10 client.15555 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.944+0000 7f646aa02740 20 client.15555 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.944+0000 7f646aa02740 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5597cb7fe2e0 0x5597cb7ff750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.944+0000 7f646aa02740 4 client.15555 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.944+0000 7f646aa02740 1 -- 172.21.15.12:0/3260879716 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597cb756600 con 0x5597cb7fe2e0 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.944+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5597cb7fe2e0 0x5597cb7ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f6449ffb640 10 client.15555 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5597cb7fe2e0 0x5597cb7ff750 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d53be0ef476cfef2 server_cookie=6ee4ed2bb38b8b11 in_seq=0 out_seq=0 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f6449ffb640 1 -- 172.21.15.12:0/3260879716 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597cb756600 con 0x5597cb7fe2e0 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f6449ffb640 10 client.15555 handle_command_reply: tid=0 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f646aa02740 1 client.15555 shutdown 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f646aa02740 1 -- 172.21.15.12:0/3260879716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e32f0 msgr2=0x5597cb7ea700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f646aa02740 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e32f0 0x5597cb7ea700 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f645c00abc0 tx=0x7f645c0052b0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f646aa02740 1 -- 172.21.15.12:0/3260879716 shutdown_connections 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f646aa02740 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5597cb7fe2e0 0x5597cb7ff750 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f646aa02740 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7edbb0 0x5597cb7eac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f646aa02740 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e32f0 0x5597cb7ea700 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f6449ffb640 0 client.15555 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:40:37.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f646aa02740 1 --2- 172.21.15.12:0/3260879716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e29d0 0x5597cb7ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.945+0000 7f646aa02740 1 -- 172.21.15.12:0/3260879716 >> 172.21.15.12:0/3260879716 conn(0x5597cb7def60 msgr2=0x5597cb7e4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:37.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.946+0000 7f646aa02740 1 -- 172.21.15.12:0/3260879716 shutdown_connections 2024-09-19T06:40:37.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.946+0000 7f646aa02740 1 -- 172.21.15.12:0/3260879716 wait complete. 2024-09-19T06:40:37.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.946+0000 7f646aa02740 20 client.15555 trim_cache size 0 max 16384 2024-09-19T06:40:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.963+0000 7f646aa02740 1 Processor -- start 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.963+0000 7f646aa02740 1 -- start start 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f646aa02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e29d0 0x5597cb7fdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f646aa02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e32f0 0x5597cb7ff750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f646aa02740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f646aa02740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5597cb7fda90 con 0x5597cb7edbb0 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f646aa02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5597cb7fe160 con 0x5597cb7e29d0 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f646aa02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5597cb7fe830 con 0x5597cb7e32f0 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f6465bc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f6465bc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7e5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41730/0 (socket says 172.21.15.12:41730) 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f6465bc4640 1 -- 172.21.15.12:0/3782071905 learned_addr learned my addr 172.21.15.12:0/3782071905 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f64663c5640 1 --2- 172.21.15.12:0/3782071905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e32f0 0x5597cb7ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f6465bc4640 1 -- 172.21.15.12:0/3782071905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e32f0 msgr2=0x5597cb7ff750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3782071905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e32f0 0x5597cb7ff750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f6465bc4640 1 -- 172.21.15.12:0/3782071905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e29d0 msgr2=0x5597cb7fdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3782071905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e29d0 0x5597cb7fdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f6465bc4640 1 -- 172.21.15.12:0/3782071905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597cb7ed720 con 0x5597cb7edbb0 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3782071905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7e5d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6450005940 tx=0x7f6450032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aca140126a6ea11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f644bfff640 1 -- 172.21.15.12:0/3782071905 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450035040 con 0x5597cb7edbb0 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f644bfff640 1 -- 172.21.15.12:0/3782071905 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6450005500 con 0x5597cb7edbb0 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.964+0000 7f644bfff640 1 -- 172.21.15.12:0/3782071905 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64500035f0 con 0x5597cb7edbb0 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.965+0000 7f646aa02740 1 -- 172.21.15.12:0/3782071905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 msgr2=0x5597cb7e5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.965+0000 7f646aa02740 1 --2- 172.21.15.12:0/3782071905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7e5d80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6450005940 tx=0x7f6450032c30 comp rx=0 tx=0).stop 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.965+0000 7f646aa02740 1 -- 172.21.15.12:0/3782071905 shutdown_connections 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.965+0000 7f646aa02740 1 --2- 172.21.15.12:0/3782071905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7edbb0 0x5597cb7e5d80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.965+0000 7f646aa02740 1 --2- 172.21.15.12:0/3782071905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7e32f0 0x5597cb7ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.965+0000 7f646aa02740 1 --2- 172.21.15.12:0/3782071905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e29d0 0x5597cb7fdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.965+0000 7f646aa02740 1 -- 172.21.15.12:0/3782071905 >> 172.21.15.12:0/3782071905 conn(0x5597cb7def60 msgr2=0x5597cb7df340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.965+0000 7f646aa02740 1 -- 172.21.15.12:0/3782071905 shutdown_connections 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.965+0000 7f646aa02740 1 -- 172.21.15.12:0/3782071905 wait complete. 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.965+0000 7f646aa02740 1 -- start start 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f646aa02740 1 Processor -- start 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f646aa02740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e29d0 0x5597cb807e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f646aa02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 0x5597cb7e7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f646aa02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7edbb0 0x5597cb7e7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f646aa02740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5597cb7ff5d0 con 0x5597cb7e29d0 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f646aa02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5597cb7fef00 con 0x5597cb7e32f0 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f646aa02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5597cb7ffca0 con 0x5597cb7edbb0 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f646aa02740 10 client.0 _ll_register_callbacks cb 0x7f64500095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6465bc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e29d0 0x5597cb807e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6465bc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e29d0 0x5597cb807e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41746/0 (socket says 172.21.15.12:41746) 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6465bc4640 1 -- 172.21.15.12:0/3835953149 learned_addr learned my addr 172.21.15.12:0/3835953149 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f64663c5640 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 0x5597cb7e7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7edbb0 0x5597cb7e7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6465bc4640 1 -- 172.21.15.12:0/3835953149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7edbb0 msgr2=0x5597cb7e7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7edbb0 0x5597cb7e7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6465bc4640 1 -- 172.21.15.12:0/3835953149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 msgr2=0x5597cb7e7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 0x5597cb7e7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6465bc4640 1 -- 172.21.15.12:0/3835953149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597cb7e7ee0 con 0x5597cb7e29d0 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f64663c5640 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 0x5597cb7e7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6465bc4640 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e29d0 0x5597cb807e70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6450000c00 tx=0x7f6450009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932da107e49a06d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.966+0000 7f6449ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:37.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f6449ffb640 1 -- 172.21.15.12:0/3835953149 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645005b030 con 0x5597cb7e29d0 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f6449ffb640 1 -- 172.21.15.12:0/3835953149 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f6450004960 con 0x5597cb7e29d0 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f646aa02740 1 -- 172.21.15.12:0/3835953149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6450005500 con 0x5597cb7e29d0 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f6449ffb640 1 -- 172.21.15.12:0/3835953149 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6450035040 con 0x5597cb7e29d0 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f646aa02740 10 client.15561 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f646aa02740 1 -- 172.21.15.12:0/3835953149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5597cb8067f0 con 0x5597cb7e29d0 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f6449ffb640 1 -- 172.21.15.12:0/3835953149 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6450005500 con 0x5597cb7e29d0 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f6449ffb640 1 -- 172.21.15.12:0/3835953149 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f645004a050 con 0x5597cb7e29d0 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f646aa02740 10 client.15561 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f646aa02740 10 client.15561 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f646aa02740 20 client.15561 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f646aa02740 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5597cb86cf00 0x5597cb86bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f646aa02740 4 client.15561 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:40:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.967+0000 7f646aa02740 1 -- 172.21.15.12:0/3835953149 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "status"}) -- 0x5597cb750b10 con 0x5597cb86cf00 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f64663c5640 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5597cb86cf00 0x5597cb86bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f64663c5640 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5597cb86cf00 0x5597cb86bc10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd8d9c738201c7a2 server_cookie=7d52ea05a7ba3ef in_seq=0 out_seq=0 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f6449ffb640 10 client.15561 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f6449ffb640 1 -- 172.21.15.12:0/3835953149 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5597cb750b10 con 0x5597cb86cf00 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f6449ffb640 10 client.15561 handle_command_reply: tid=0 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 client.15561 shutdown 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 -- 172.21.15.12:0/3835953149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e29d0 msgr2=0x5597cb807e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e29d0 0x5597cb807e70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6450000c00 tx=0x7f6450009650 comp rx=0 tx=0).stop 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 -- 172.21.15.12:0/3835953149 shutdown_connections 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5597cb86cf00 0x5597cb86bc10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597cb7edbb0 0x5597cb7e7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597cb7e32f0 0x5597cb7e7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 --2- 172.21.15.12:0/3835953149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597cb7e29d0 0x5597cb807e70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 -- 172.21.15.12:0/3835953149 >> 172.21.15.12:0/3835953149 conn(0x5597cb7def60 msgr2=0x5597cb7e4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:37.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f6449ffb640 0 client.15561 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:40:37.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 -- 172.21.15.12:0/3835953149 shutdown_connections 2024-09-19T06:40:37.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.968+0000 7f646aa02740 1 -- 172.21.15.12:0/3835953149 wait complete. 2024-09-19T06:40:37.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f646aa02740 20 client.15561 trim_cache size 0 max 16384 2024-09-19T06:40:37.981 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:40:37.981 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:40:37.981 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 1, 2024-09-19T06:40:37.982 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24502, 2024-09-19T06:40:37.982 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:40:37.982 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:40:37.982 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:40:37.982 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 135.90380189999999, 2024-09-19T06:40:37.982 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-19T06:40:37.982 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 86, 2024-09-19T06:40:37.982 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-19T06:40:37.982 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 163.41355140499999 2024-09-19T06:40:37.982 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:40:37.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 -- 172.21.15.12:0/2092183296 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f644c0a34c0 msgr2=0x7f644c0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:37.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f644c0a34c0 0x7f644c0a5980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64580cd490 tx=0x7f645806d040 comp rx=0 tx=0).stop 2024-09-19T06:40:37.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 -- 172.21.15.12:0/2092183296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460106f50 msgr2=0x7f6460101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:37.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460106f50 0x7f6460101cf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f645800cad0 tx=0x7f645800ced0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 -- 172.21.15.12:0/2092183296 shutdown_connections 2024-09-19T06:40:37.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6460106f50 0x7f6460101cf0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6460100ca0 0x7f64601017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f644c0a34c0 0x7f644c0a5980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 --2- 172.21.15.12:0/2092183296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f64601002f0 0x7f6460101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:37.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 -- 172.21.15.12:0/2092183296 >> 172.21.15.12:0/2092183296 conn(0x7f6460077210 msgr2=0x7f6460105830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:37.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 -- 172.21.15.12:0/2092183296 shutdown_connections 2024-09-19T06:40:37.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:37.969+0000 7f6468629640 1 -- 172.21.15.12:0/2092183296 wait complete. 2024-09-19T06:40:38.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:37 smithi012 ceph-mon[30937]: pgmap v17: 97 pgs: 97 active+clean; 2.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 72 KiB/s wr, 21 op/s 2024-09-19T06:40:38.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:37 smithi016 ceph-mon[34911]: pgmap v17: 97 pgs: 97 active+clean; 2.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 72 KiB/s wr, 21 op/s 2024-09-19T06:40:38.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:37 smithi173 ceph-mon[35349]: pgmap v17: 97 pgs: 97 active+clean; 2.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 72 KiB/s wr, 21 op/s 2024-09-19T06:40:38.660 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:40:38.948 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:39.064 INFO:teuthology.orchestra.run.smithi012.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-19T06:40:39.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-19T06:40:39.110 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/: 2024-09-19T06:40:39.110 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.110 INFO:teuthology.orchestra.run.smithi012.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 . 2024-09-19T06:40:39.110 INFO:teuthology.orchestra.run.smithi012.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 .. 2024-09-19T06:40:39.110 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 data 2024-09-19T06:40:39.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.110 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data: 2024-09-19T06:40:39.110 INFO:teuthology.orchestra.run.smithi012.stdout:total 35 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 . 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 .. 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 base 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 19 06:40 global 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 log 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_commit_ts 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_dynshmem 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 19 06:40 pg_hba.conf 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 19 06:40 pg_ident.conf 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 pg_logical 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 pg_multixact 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_notify 2024-09-19T06:40:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_replslot 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_serial 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_snapshots 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_stat 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_stat_tmp 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 pg_subtrans 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_tblspc 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_twophase 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 PG_VERSION 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 pg_wal 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 pg_xact 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 19 06:40 postgresql.auto.conf 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 19 06:40 postgresql.conf 2024-09-19T06:40:39.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/base: 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 . 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 06:40 1 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 06:40 13493 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 06:40 13494 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:total 7777 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 06:40 . 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 .. 2024-09-19T06:40:39.113 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 112 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 113 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 1247 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1247_fsm 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1247_vm 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 06:40 1249 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1249_fsm 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1249_vm 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 06:40 1255 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1255_fsm 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1255_vm 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 06:40 1259 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1259_fsm 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1259_vm 2024-09-19T06:40:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 06:40 13344 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13344_fsm 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13344_vm 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13346 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13348 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13349_fsm 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349_vm 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13351 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13353 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13354_fsm 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354_vm 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13356 2024-09-19T06:40:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13358 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13359_fsm 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359_vm 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13361 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13363 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1417 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1418 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 174 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 175 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2187 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2224 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2328 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2336 2024-09-19T06:40:39.116 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2337 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2579 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2600 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2600_fsm 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2600_vm 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2601_fsm 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601_vm 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2602 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2602_fsm 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2602_vm 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2603 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2603_fsm 2024-09-19T06:40:39.117 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2603_vm 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2604 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2605 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2605_fsm 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2605_vm 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2606_fsm 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606_vm 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2607 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2607_fsm 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2607_vm 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 06:40 2608 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2608_fsm 2024-09-19T06:40:39.118 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2608_vm 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 06:40 2609 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2609_fsm 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2609_vm 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2610 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2610_fsm 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2610_vm 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2611 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2612_fsm 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612_vm 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2613 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2615_fsm 2024-09-19T06:40:39.119 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615_vm 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2616 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2616_fsm 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2616_vm 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 06:40 2617 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2617_fsm 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2617_vm 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 06:40 2618 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2618_fsm 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2618_vm 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 06:40 2619 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2619_fsm 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2619_vm 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2620 2024-09-19T06:40:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2650 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2651 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2652 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2653 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2654 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2655 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2656 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2657 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 06:40 2658 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 2659 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2660 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2661 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2662 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2663 2024-09-19T06:40:39.121 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2664 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2665 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2666 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2667 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2668 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2669 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2670 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 06:40 2673 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 06:40 2674 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 06:40 2675 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2678 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2679 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2680 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2681 2024-09-19T06:40:39.122 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2682 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2683 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2684 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2685 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2686 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2687 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2688 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2689 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 06:40 2690 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 06:40 2691 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2692 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2693 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2696 2024-09-19T06:40:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2699 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2701 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2702 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2703 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2704 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2753 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2753_fsm 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2753_vm 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2754 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2755 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2756 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2757 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2830 2024-09-19T06:40:39.124 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2831 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2832 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2833 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2834 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2835 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2836 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2837 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 06:40 2838 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2838_fsm 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2838_vm 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2839 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840_fsm 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2840_vm 2024-09-19T06:40:39.125 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2841 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2995 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2996 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3079_fsm 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079_vm 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3080 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3081 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3085 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3118 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3119 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 06:40 3164 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3256 2024-09-19T06:40:39.126 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3257 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3258 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3350 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3351 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3379 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3380 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3381 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3394 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3394_fsm 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3394_vm 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3395 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3429 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3430 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3431 2024-09-19T06:40:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3433 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3439 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3440 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3455 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 06:40 3456 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3456_fsm 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3456_vm 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3466 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3467 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3468 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3501 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3502 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3503 2024-09-19T06:40:39.128 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3534 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3541_fsm 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541_vm 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3542 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3574 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3575 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3576 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3596 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3597 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3598 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3599 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3600_fsm 2024-09-19T06:40:39.129 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600_vm 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3601_fsm 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601_vm 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3602_fsm 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602_vm 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603_fsm 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3603_vm 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3604 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3605 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3606 2024-09-19T06:40:39.130 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3607 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3608 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 3609 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3712 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3764_fsm 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764_vm 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3766 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3767 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3997 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4143 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4144 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4145 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4146 2024-09-19T06:40:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4147 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4148 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4149 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4150 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4151 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4152 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4153 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4154 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4155 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4156 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4157 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4158 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4159 2024-09-19T06:40:39.132 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4160 2024-09-19T06:40:39.133 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4161 2024-09-19T06:40:39.133 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4162 2024-09-19T06:40:39.133 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4163 2024-09-19T06:40:39.133 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4164 2024-09-19T06:40:39.133 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4165 2024-09-19T06:40:39.136 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4166 2024-09-19T06:40:39.136 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4167 2024-09-19T06:40:39.136 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4168 2024-09-19T06:40:39.136 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4169 2024-09-19T06:40:39.136 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4170 2024-09-19T06:40:39.136 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4171 2024-09-19T06:40:39.136 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4172 2024-09-19T06:40:39.136 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4173 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4174 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 5002 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 548 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 549 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6102 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6104 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6106 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6110 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6111 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6112 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6113 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6117 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 826 2024-09-19T06:40:39.137 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 827 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 828 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 06:40 pg_filenode.map 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 PG_VERSION 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:total 7777 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 06:40 . 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 .. 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 112 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 113 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 1247 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1247_fsm 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1247_vm 2024-09-19T06:40:39.138 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 06:40 1249 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1249_fsm 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1249_vm 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 06:40 1255 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1255_fsm 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1255_vm 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 06:40 1259 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1259_fsm 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1259_vm 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 06:40 13344 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13344_fsm 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13344_vm 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13346 2024-09-19T06:40:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13348 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13349_fsm 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349_vm 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13351 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13353 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13354_fsm 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354_vm 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13356 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13358 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13359_fsm 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359_vm 2024-09-19T06:40:39.140 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13361 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13363 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1417 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1418 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 174 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 175 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2187 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2224 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2328 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2336 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2337 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2579 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2600 2024-09-19T06:40:39.141 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2600_fsm 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2600_vm 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2601_fsm 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601_vm 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2602 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2602_fsm 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2602_vm 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2603 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2603_fsm 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2603_vm 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2604 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2605 2024-09-19T06:40:39.142 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2605_fsm 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2605_vm 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2606_fsm 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606_vm 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2607 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2607_fsm 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2607_vm 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 06:40 2608 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2608_fsm 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2608_vm 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 06:40 2609 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2609_fsm 2024-09-19T06:40:39.143 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2609_vm 2024-09-19T06:40:39.144 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2610 2024-09-19T06:40:39.144 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2610_fsm 2024-09-19T06:40:39.144 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2610_vm 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2611 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2612_fsm 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612_vm 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2613 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2615_fsm 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615_vm 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2616 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2616_fsm 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2616_vm 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 06:40 2617 2024-09-19T06:40:39.145 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2617_fsm 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2617_vm 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 06:40 2618 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2618_fsm 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2618_vm 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 06:40 2619 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2619_fsm 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2619_vm 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2620 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2650 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2651 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2652 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2653 2024-09-19T06:40:39.146 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2654 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2655 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2656 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2657 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 06:40 2658 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 2659 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2660 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2661 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2662 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2663 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2664 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2665 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2666 2024-09-19T06:40:39.147 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2667 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2668 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2669 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2670 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 06:40 2673 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 06:40 2674 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 06:40 2675 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2678 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2679 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2680 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2681 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2682 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2683 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2684 2024-09-19T06:40:39.148 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2685 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2686 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2687 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2688 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2689 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 06:40 2690 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 06:40 2691 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2692 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2693 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2696 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2699 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2701 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2702 2024-09-19T06:40:39.149 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2703 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2704 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2753 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2753_fsm 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2753_vm 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2754 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2755 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2756 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2757 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2830 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2831 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2832 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2833 2024-09-19T06:40:39.150 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2834 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2835 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2836 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2837 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 06:40 2838 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2838_fsm 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2838_vm 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2839 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840_fsm 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2840_vm 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2841 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2995 2024-09-19T06:40:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2996 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3079_fsm 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079_vm 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3080 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3081 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3085 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3118 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3119 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 06:40 3164 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3256 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3257 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3258 2024-09-19T06:40:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3350 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3351 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3379 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3380 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3381 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3394 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3394_fsm 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3394_vm 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3395 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3429 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3430 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3431 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3433 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3439 2024-09-19T06:40:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3440 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3455 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 06:40 3456 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3456_fsm 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3456_vm 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3466 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3467 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3468 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3501 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3502 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3503 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3534 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3541_fsm 2024-09-19T06:40:39.154 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541_vm 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3542 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3574 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3575 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3576 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3596 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3597 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3598 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3599 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3600_fsm 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600_vm 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601 2024-09-19T06:40:39.155 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3601_fsm 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601_vm 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3602_fsm 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602_vm 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603_fsm 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3603_vm 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3604 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3605 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3606 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3607 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3608 2024-09-19T06:40:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 3609 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3712 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3764_fsm 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764_vm 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3766 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3767 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3997 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4143 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4144 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4145 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4146 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4147 2024-09-19T06:40:39.157 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4148 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4149 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4150 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4151 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4152 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4153 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4154 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4155 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4156 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4157 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4158 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4159 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4160 2024-09-19T06:40:39.158 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4161 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4162 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4163 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4164 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4165 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4166 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4167 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4168 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4169 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4170 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4171 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4172 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4173 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4174 2024-09-19T06:40:39.159 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 5002 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 548 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 549 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6102 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6104 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6106 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6110 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6111 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6112 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6113 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6117 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 826 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 827 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 828 2024-09-19T06:40:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 06:40 pg_filenode.map 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 PG_VERSION 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:total 7777 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 06:40 . 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 .. 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 112 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 113 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 1247 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1247_fsm 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1247_vm 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 06:40 1249 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1249_fsm 2024-09-19T06:40:39.161 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1249_vm 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 06:40 1255 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1255_fsm 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1255_vm 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 06:40 1259 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1259_fsm 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1259_vm 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 06:40 13344 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13344_fsm 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13344_vm 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13346 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13348 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13349_fsm 2024-09-19T06:40:39.162 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349_vm 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13351 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13353 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13354_fsm 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354_vm 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13356 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13358 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13359_fsm 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359_vm 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13361 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13363 2024-09-19T06:40:39.163 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1417 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1418 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 174 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 175 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2187 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2224 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2328 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2336 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2337 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2579 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2600 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2600_fsm 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2600_vm 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601 2024-09-19T06:40:39.164 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2601_fsm 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601_vm 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2602 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2602_fsm 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2602_vm 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2603 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2603_fsm 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2603_vm 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2604 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2605 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2605_fsm 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2605_vm 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606 2024-09-19T06:40:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2606_fsm 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606_vm 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2607 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2607_fsm 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2607_vm 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 06:40 2608 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2608_fsm 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2608_vm 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 06:40 2609 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2609_fsm 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2609_vm 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2610 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2610_fsm 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2610_vm 2024-09-19T06:40:39.166 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2611 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2612_fsm 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612_vm 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2613 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2615_fsm 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615_vm 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2616 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2616_fsm 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2616_vm 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 06:40 2617 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2617_fsm 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2617_vm 2024-09-19T06:40:39.167 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 06:40 2618 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2618_fsm 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2618_vm 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 06:40 2619 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2619_fsm 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2619_vm 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2620 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2650 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2651 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2652 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2653 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2654 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2655 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2656 2024-09-19T06:40:39.168 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2657 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 06:40 2658 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 2659 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2660 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2661 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2662 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2663 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2664 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2665 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2666 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2667 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2668 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2669 2024-09-19T06:40:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2670 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 06:40 2673 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 06:40 2674 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 06:40 2675 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2678 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2679 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2680 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2681 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2682 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2683 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2684 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2685 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2686 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2687 2024-09-19T06:40:39.170 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2688 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2689 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 06:40 2690 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 06:40 2691 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2692 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2693 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2696 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2699 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2701 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2702 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2703 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2704 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2753 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2753_fsm 2024-09-19T06:40:39.171 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2753_vm 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2754 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2755 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2756 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2757 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2830 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2831 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2832 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2833 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2834 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2835 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2836 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2837 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 06:40 2838 2024-09-19T06:40:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2838_fsm 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2838_vm 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2839 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840_fsm 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2840_vm 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2841 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2995 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2996 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3079_fsm 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079_vm 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3080 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3081 2024-09-19T06:40:39.173 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3085 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3118 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3119 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 06:40 3164 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3256 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3257 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3258 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3350 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3351 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3379 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3380 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3381 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3394 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3394_fsm 2024-09-19T06:40:39.174 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3394_vm 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3395 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3429 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3430 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3431 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3433 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3439 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3440 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3455 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 06:40 3456 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3456_fsm 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3456_vm 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3466 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3467 2024-09-19T06:40:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3468 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3501 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3502 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3503 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3534 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3541_fsm 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541_vm 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3542 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3574 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3575 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3576 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3596 2024-09-19T06:40:39.176 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3597 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3598 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3599 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3600_fsm 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600_vm 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3601_fsm 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601_vm 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3602_fsm 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602_vm 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603 2024-09-19T06:40:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603_fsm 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3603_vm 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3604 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3605 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3606 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3607 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3608 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 3609 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3712 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3764_fsm 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764_vm 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3766 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3767 2024-09-19T06:40:39.178 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3997 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4143 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4144 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4145 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4146 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4147 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4148 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4149 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4150 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4151 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4152 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4153 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4154 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4155 2024-09-19T06:40:39.179 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4156 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4157 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4158 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4159 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4160 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4161 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4162 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4163 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4164 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4165 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4166 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4167 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4168 2024-09-19T06:40:39.180 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4169 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4170 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4171 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4172 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4173 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4174 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 5002 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 548 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 549 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6102 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6104 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6106 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6110 2024-09-19T06:40:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6111 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6112 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6113 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6117 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 826 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 827 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 828 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 06:40 pg_filenode.map 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 PG_VERSION 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/global: 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:total 537 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 19 06:40 . 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.182 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1213 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1213_fsm 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1213_vm 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1214 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1214_fsm 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1214_vm 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 1232 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 1233 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1260 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1260_fsm 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1260_vm 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1261 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1261_fsm 2024-09-19T06:40:39.183 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1261_vm 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1262 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1262_fsm 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1262_vm 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2396 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2396_fsm 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2396_vm 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2397 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2671 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2672 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2676 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2677 2024-09-19T06:40:39.184 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2694 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2695 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2697 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2698 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2846 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2847 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2964 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2965 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2966 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2967 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3592 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3593 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4060 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4061 2024-09-19T06:40:39.185 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4175 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4176 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4177 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4178 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4181 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4182 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4183 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4184 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4185 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4186 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6000 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6001 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6002 2024-09-19T06:40:39.186 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6100 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6114 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6115 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 pg_control 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 06:40 pg_filenode.map 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/log: 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.187 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:total 1 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 . 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 mappings 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 06:40 replorigin_checkpoint 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 snapshots 2024-09-19T06:40:39.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 .. 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 .. 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 . 2024-09-19T06:40:39.189 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 members 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 offsets 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:total 8 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 . 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 .. 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 0000 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:total 8 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 . 2024-09-19T06:40:39.190 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 .. 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 0000 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-19T06:40:39.191 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:total 8 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 . 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 0000 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.193 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:total 16384 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 . 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:40 000000010000000000000001 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 archive_status 2024-09-19T06:40:39.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.195 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-19T06:40:39.195 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:40:39.195 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:40:39.195 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 .. 2024-09-19T06:40:39.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:39.195 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-19T06:40:39.195 INFO:teuthology.orchestra.run.smithi012.stdout:total 8 2024-09-19T06:40:39.195 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 . 2024-09-19T06:40:39.195 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 19 06:40 .. 2024-09-19T06:40:39.195 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 0000 2024-09-19T06:40:39.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-19T06:40:39.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-19T06:40:39.428 INFO:teuthology.orchestra.run.smithi012.stderr:dropping old tables... 2024-09-19T06:40:39.429 INFO:teuthology.orchestra.run.smithi012.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-19T06:40:39.429 INFO:teuthology.orchestra.run.smithi012.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-19T06:40:39.429 INFO:teuthology.orchestra.run.smithi012.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-19T06:40:39.429 INFO:teuthology.orchestra.run.smithi012.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-19T06:40:39.429 INFO:teuthology.orchestra.run.smithi012.stderr:creating tables... 2024-09-19T06:40:39.440 INFO:teuthology.orchestra.run.smithi012.stderr:generating data (client-side)... 2024-09-19T06:40:39.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.472+0000 7f459d682640 1 -- 172.21.15.12:0/683148407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4598100e20 msgr2=0x7f4598101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:39.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.472+0000 7f459d682640 1 --2- 172.21.15.12:0/683148407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4598100e20 0x7f4598101200 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4588009900 tx=0x7f458802a480 comp rx=0 tx=0).stop 2024-09-19T06:40:39.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.472+0000 7f459d682640 1 -- 172.21.15.12:0/683148407 shutdown_connections 2024-09-19T06:40:39.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.472+0000 7f459d682640 1 --2- 172.21.15.12:0/683148407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4598102ef0 0x7f459810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.472+0000 7f459d682640 1 --2- 172.21.15.12:0/683148407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4598102570 0x7f45981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.472+0000 7f459d682640 1 --2- 172.21.15.12:0/683148407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4598100e20 0x7f4598101200 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.472+0000 7f459d682640 1 -- 172.21.15.12:0/683148407 >> 172.21.15.12:0/683148407 conn(0x7f45980fc7d0 msgr2=0x7f45980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.472+0000 7f459d682640 1 -- 172.21.15.12:0/683148407 shutdown_connections 2024-09-19T06:40:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.472+0000 7f459d682640 1 -- 172.21.15.12:0/683148407 wait complete. 2024-09-19T06:40:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.473+0000 7f459d682640 1 Processor -- start 2024-09-19T06:40:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.473+0000 7f459d682640 1 -- start start 2024-09-19T06:40:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.473+0000 7f459d682640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4598100e20 0x7f4598198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.473+0000 7f459d682640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4598102570 0x7f4598198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.473+0000 7f459d682640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4598102ef0 0x7f459819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.473+0000 7f459d682640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4598110f50 con 0x7f4598102ef0 2024-09-19T06:40:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.473+0000 7f459d682640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4598110dd0 con 0x7f4598100e20 2024-09-19T06:40:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.473+0000 7f459d682640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f45981110d0 con 0x7f4598102570 2024-09-19T06:40:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f45977fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4598102ef0 0x7f459819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f4596ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4598100e20 0x7f4598198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f45977fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4598102ef0 0x7f459819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41768/0 (socket says 172.21.15.12:41768) 2024-09-19T06:40:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f45977fe640 1 -- 172.21.15.12:0/1336176082 learned_addr learned my addr 172.21.15.12:0/1336176082 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f45967fc640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4598102570 0x7f4598198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f4596ffd640 1 -- 172.21.15.12:0/1336176082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4598102570 msgr2=0x7f4598198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f4596ffd640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4598102570 0x7f4598198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f4596ffd640 1 -- 172.21.15.12:0/1336176082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4598102ef0 msgr2=0x7f459819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f4596ffd640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4598102ef0 0x7f459819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f4596ffd640 1 -- 172.21.15.12:0/1336176082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459819d530 con 0x7f4598100e20 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f4596ffd640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4598100e20 0x7f4598198580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4588005940 tx=0x7f4588003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f458ffff640 1 -- 172.21.15.12:0/1336176082 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458803f070 con 0x7f4598100e20 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f458ffff640 1 -- 172.21.15.12:0/1336176082 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4588031c30 con 0x7f4598100e20 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f459d682640 1 -- 172.21.15.12:0/1336176082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459819d7c0 con 0x7f4598100e20 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f458ffff640 1 -- 172.21.15.12:0/1336176082 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588035030 con 0x7f4598100e20 2024-09-19T06:40:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.474+0000 7f459d682640 1 -- 172.21.15.12:0/1336176082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45980fcbb0 con 0x7f4598100e20 2024-09-19T06:40:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.477+0000 7f458ffff640 1 -- 172.21.15.12:0/1336176082 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f4588042070 con 0x7f4598100e20 2024-09-19T06:40:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f458ffff640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45840a3440 0x7f45840a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f458ffff640 1 -- 172.21.15.12:0/1336176082 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f45880f05a0 con 0x7f4598100e20 2024-09-19T06:40:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f45967fc640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45840a3440 0x7f45840a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f459fa5b740 1 Processor -- start 2024-09-19T06:40:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f459fa5b740 1 -- start start 2024-09-19T06:40:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f45967fc640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45840a3440 0x7f45840a5900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4598100050 tx=0x7f4580005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cab4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cabf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748cac1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f459fa5b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55748ca1b090 con 0x55748cab49d0 2024-09-19T06:40:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f459fa5b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55748c9c2a70 con 0x55748cab52f0 2024-09-19T06:40:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.478+0000 7f459fa5b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55748ca17050 con 0x55748cabfbb0 2024-09-19T06:40:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f4596ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cab4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f4596ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cab4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41770/0 (socket says 172.21.15.12:41770) 2024-09-19T06:40:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f4596ffd640 1 -- 172.21.15.12:0/2067873813 learned_addr learned my addr 172.21.15.12:0/2067873813 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f45967fc640 1 --2- 172.21.15.12:0/2067873813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cabf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f45977fe640 1 --2- 172.21.15.12:0/2067873813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748cac1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f4596ffd640 1 -- 172.21.15.12:0/2067873813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 msgr2=0x55748cac1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f4596ffd640 1 --2- 172.21.15.12:0/2067873813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748cac1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f4596ffd640 1 -- 172.21.15.12:0/2067873813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 msgr2=0x55748cabf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f4596ffd640 1 --2- 172.21.15.12:0/2067873813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cabf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f4596ffd640 1 -- 172.21.15.12:0/2067873813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55748c9cf130 con 0x55748cab49d0 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f45967fc640 1 --2- 172.21.15.12:0/2067873813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cabf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f4596ffd640 1 --2- 172.21.15.12:0/2067873813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cab4db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f45880c4d70 tx=0x7f45880bc2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5134fb9f9614b480 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f458d7fa640 1 -- 172.21.15.12:0/2067873813 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588049070 con 0x55748cab49d0 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f458d7fa640 1 -- 172.21.15.12:0/2067873813 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45880c09e0 con 0x55748cab49d0 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.479+0000 7f458d7fa640 1 -- 172.21.15.12:0/2067873813 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880c4e10 con 0x55748cab49d0 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.480+0000 7f459fa5b740 1 -- 172.21.15.12:0/2067873813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 msgr2=0x55748cab4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.480+0000 7f459fa5b740 1 --2- 172.21.15.12:0/2067873813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cab4db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f45880c4d70 tx=0x7f45880bc2e0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.480+0000 7f459fa5b740 1 -- 172.21.15.12:0/2067873813 shutdown_connections 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.480+0000 7f459fa5b740 1 --2- 172.21.15.12:0/2067873813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748cac1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.480+0000 7f459fa5b740 1 --2- 172.21.15.12:0/2067873813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cabf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.480+0000 7f459fa5b740 1 --2- 172.21.15.12:0/2067873813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cab4db0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.480+0000 7f459fa5b740 1 -- 172.21.15.12:0/2067873813 >> 172.21.15.12:0/2067873813 conn(0x55748cab0f60 msgr2=0x55748cab1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.480+0000 7f459fa5b740 1 -- 172.21.15.12:0/2067873813 shutdown_connections 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.480+0000 7f459fa5b740 1 -- 172.21.15.12:0/2067873813 wait complete. 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f459fa5b740 1 -- start start 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f459fa5b740 1 Processor -- start 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab49d0 0x55748cabf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab52f0 0x55748cabc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748cabccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f459fa5b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55748cac2540 con 0x55748cab52f0 2024-09-19T06:40:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f459fa5b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55748c9d5f20 con 0x55748cab49d0 2024-09-19T06:40:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f459fa5b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55748cac26c0 con 0x55748cabfbb0 2024-09-19T06:40:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f45967fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab52f0 0x55748cabc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f45967fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab52f0 0x55748cabc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41778/0 (socket says 172.21.15.12:41778) 2024-09-19T06:40:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f4596ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab49d0 0x55748cabf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f45967fc640 1 -- 172.21.15.12:0/470999526 learned_addr learned my addr 172.21.15.12:0/470999526 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.481+0000 7f459fa5b740 10 client.0 _ll_register_callbacks cb 0x55748c99f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f45977fe640 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748cabccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f45967fc640 1 -- 172.21.15.12:0/470999526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 msgr2=0x55748cabccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f45967fc640 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748cabccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f45967fc640 1 -- 172.21.15.12:0/470999526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab49d0 msgr2=0x55748cabf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f45967fc640 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab49d0 0x55748cabf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f45967fc640 1 -- 172.21.15.12:0/470999526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55748c78c2b0 con 0x55748cab52f0 2024-09-19T06:40:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f4596ffd640 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab49d0 0x55748cabf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f45967fc640 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab52f0 0x55748cabc7b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f45800038a0 tx=0x7f4580004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a393d431ee5ff09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f457e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f457e7fc640 1 -- 172.21.15.12:0/470999526 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458000e6a0 con 0x55748cab52f0 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f457e7fc640 1 -- 172.21.15.12:0/470999526 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f458000e840 con 0x55748cab52f0 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f459fa5b740 1 -- 172.21.15.12:0/470999526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45880c09e0 con 0x55748cab52f0 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f457e7fc640 1 -- 172.21.15.12:0/470999526 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f458000ea40 con 0x55748cab52f0 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f459fa5b740 10 client.15573 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.482+0000 7f459fa5b740 1 -- 172.21.15.12:0/470999526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55748cacde30 con 0x55748cab52f0 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f457e7fc640 1 -- 172.21.15.12:0/470999526 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45880c09e0 con 0x55748cab52f0 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f457e7fc640 1 -- 172.21.15.12:0/470999526 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f458001d410 con 0x55748cab52f0 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f459fa5b740 10 client.15573 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f459fa5b740 10 client.15573 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:40:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f459fa5b740 20 client.15573 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f459fa5b740 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55748cad04e0 0x55748cad1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f459fa5b740 4 client.15573 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f459fa5b740 1 -- 172.21.15.12:0/470999526 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55748ca28600 con 0x55748cad04e0 2024-09-19T06:40:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f4596ffd640 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55748cad04e0 0x55748cad1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f4596ffd640 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55748cad04e0 0x55748cad1950 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=713d0d7cf98e9988 server_cookie=5494c0dd11b2343d in_seq=0 out_seq=0 2024-09-19T06:40:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.483+0000 7f457e7fc640 10 client.15573 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f457e7fc640 1 -- 172.21.15.12:0/470999526 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55748ca28600 con 0x55748cad04e0 2024-09-19T06:40:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f457e7fc640 10 client.15573 handle_command_reply: tid=0 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f459fa5b740 1 client.15573 shutdown 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f459fa5b740 1 -- 172.21.15.12:0/470999526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab52f0 msgr2=0x55748cabc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f459fa5b740 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab52f0 0x55748cabc7b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f45800038a0 tx=0x7f4580004730 comp rx=0 tx=0).stop 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f459fa5b740 1 -- 172.21.15.12:0/470999526 shutdown_connections 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f459fa5b740 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55748cad04e0 0x55748cad1950 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f459fa5b740 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748cabccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f459fa5b740 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab52f0 0x55748cabc7b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f457e7fc640 0 client.15573 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f459fa5b740 1 --2- 172.21.15.12:0/470999526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab49d0 0x55748cabf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.485+0000 7f459fa5b740 1 -- 172.21.15.12:0/470999526 >> 172.21.15.12:0/470999526 conn(0x55748cab0f60 msgr2=0x55748cab6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.486+0000 7f459fa5b740 1 -- 172.21.15.12:0/470999526 shutdown_connections 2024-09-19T06:40:39.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.486+0000 7f459fa5b740 1 -- 172.21.15.12:0/470999526 wait complete. 2024-09-19T06:40:39.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.486+0000 7f459fa5b740 20 client.15573 trim_cache size 0 max 16384 2024-09-19T06:40:39.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f459fa5b740 1 Processor -- start 2024-09-19T06:40:39.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f459fa5b740 1 -- start start 2024-09-19T06:40:39.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cad1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cacb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748caabce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f459fa5b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55748cacfc90 con 0x55748cab49d0 2024-09-19T06:40:39.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f459fa5b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55748cad0360 con 0x55748cab52f0 2024-09-19T06:40:39.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f459fa5b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55748cad0a30 con 0x55748cabfbb0 2024-09-19T06:40:39.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f4596ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cad1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f4596ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cad1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41784/0 (socket says 172.21.15.12:41784) 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f4596ffd640 1 -- 172.21.15.12:0/2331581596 learned_addr learned my addr 172.21.15.12:0/2331581596 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.504+0000 7f45967fc640 1 --2- 172.21.15.12:0/2331581596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cacb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.505+0000 7f45977fe640 1 --2- 172.21.15.12:0/2331581596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748caabce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.505+0000 7f4596ffd640 1 -- 172.21.15.12:0/2331581596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 msgr2=0x55748caabce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.505+0000 7f4596ffd640 1 --2- 172.21.15.12:0/2331581596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748caabce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.505+0000 7f4596ffd640 1 -- 172.21.15.12:0/2331581596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 msgr2=0x55748cacb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.505+0000 7f4596ffd640 1 --2- 172.21.15.12:0/2331581596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cacb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.505+0000 7f4596ffd640 1 -- 172.21.15.12:0/2331581596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55748cabf080 con 0x55748cab49d0 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.505+0000 7f4596ffd640 1 --2- 172.21.15.12:0/2331581596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cad1950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4588006010 tx=0x7f45880bc350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fa051cc0e71ece server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.505+0000 7f458cff9640 1 -- 172.21.15.12:0/2331581596 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45880a3070 con 0x55748cab49d0 2024-09-19T06:40:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.505+0000 7f458cff9640 1 -- 172.21.15.12:0/2331581596 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45880ba9e0 con 0x55748cab49d0 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.505+0000 7f458cff9640 1 -- 172.21.15.12:0/2331581596 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588049040 con 0x55748cab49d0 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.506+0000 7f459fa5b740 1 -- 172.21.15.12:0/2331581596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 msgr2=0x55748cad1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.506+0000 7f459fa5b740 1 --2- 172.21.15.12:0/2331581596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cad1950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4588006010 tx=0x7f45880bc350 comp rx=0 tx=0).stop 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.506+0000 7f459fa5b740 1 -- 172.21.15.12:0/2331581596 shutdown_connections 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.506+0000 7f459fa5b740 1 --2- 172.21.15.12:0/2331581596 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cabfbb0 0x55748caabce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.506+0000 7f459fa5b740 1 --2- 172.21.15.12:0/2331581596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cacb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.506+0000 7f459fa5b740 1 --2- 172.21.15.12:0/2331581596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cab49d0 0x55748cad1950 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.506+0000 7f459fa5b740 1 -- 172.21.15.12:0/2331581596 >> 172.21.15.12:0/2331581596 conn(0x55748cab0f60 msgr2=0x55748cabc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.506+0000 7f459fa5b740 1 -- 172.21.15.12:0/2331581596 shutdown_connections 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.506+0000 7f459fa5b740 1 -- 172.21.15.12:0/2331581596 wait complete. 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.506+0000 7f459fa5b740 1 -- start start 2024-09-19T06:40:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f459fa5b740 1 Processor -- start 2024-09-19T06:40:39.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cab49d0 0x55748cada510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cad4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f459fa5b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cabfbb0 0x55748cad5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f459fa5b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55748cad17d0 con 0x55748cabfbb0 2024-09-19T06:40:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f459fa5b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55748cad1100 con 0x55748cab52f0 2024-09-19T06:40:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f459fa5b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55748cad1ea0 con 0x55748cab49d0 2024-09-19T06:40:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f459fa5b740 10 client.0 _ll_register_callbacks cb 0x7f45800045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f45977fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cabfbb0 0x55748cad5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f45967fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cad4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f45977fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cabfbb0 0x55748cad5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41798/0 (socket says 172.21.15.12:41798) 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f45977fe640 1 -- 172.21.15.12:0/3298444394 learned_addr learned my addr 172.21.15.12:0/3298444394 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f4596ffd640 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cab49d0 0x55748cada510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f45967fc640 1 -- 172.21.15.12:0/3298444394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cab49d0 msgr2=0x55748cada510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f45967fc640 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cab49d0 0x55748cada510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f45967fc640 1 -- 172.21.15.12:0/3298444394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cabfbb0 msgr2=0x55748cad5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f45967fc640 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cabfbb0 0x55748cad5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f45967fc640 1 -- 172.21.15.12:0/3298444394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55748cb38be0 con 0x55748cab52f0 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.507+0000 7f4596ffd640 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cab49d0 0x55748cada510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f45967fc640 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cad4c00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f458001d830 tx=0x7f458001d6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11cd2fc124bfe4b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f457e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:40:39.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f457e7fc640 1 -- 172.21.15.12:0/3298444394 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458000edf0 con 0x55748cab52f0 2024-09-19T06:40:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f457e7fc640 1 -- 172.21.15.12:0/3298444394 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4580009040 con 0x55748cab52f0 2024-09-19T06:40:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f459fa5b740 1 -- 172.21.15.12:0/3298444394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45880ba9e0 con 0x55748cab52f0 2024-09-19T06:40:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f457e7fc640 1 -- 172.21.15.12:0/3298444394 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f458001da20 con 0x55748cab52f0 2024-09-19T06:40:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f459fa5b740 10 client.25193 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f459fa5b740 1 -- 172.21.15.12:0/3298444394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55748cb39d40 con 0x55748cab52f0 2024-09-19T06:40:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f457e7fc640 1 -- 172.21.15.12:0/3298444394 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45880ba9e0 con 0x55748cab52f0 2024-09-19T06:40:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f457e7fc640 1 -- 172.21.15.12:0/3298444394 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f458003d070 con 0x55748cab52f0 2024-09-19T06:40:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f459fa5b740 10 client.25193 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:39.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f459fa5b740 10 client.25193 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f459fa5b740 20 client.25193 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f459fa5b740 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55748cb3e910 0x55748cb3d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f459fa5b740 4 client.25193 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.508+0000 7f459fa5b740 1 -- 172.21.15.12:0/3298444394 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "status"}) -- 0x55748ca22b10 con 0x55748cb3e910 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f4596ffd640 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55748cb3e910 0x55748cb3d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f457e7fc640 10 client.25193 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f4596ffd640 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55748cb3e910 0x55748cb3d620 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78261458b76d3037 server_cookie=22ff4090bbd34277 in_seq=0 out_seq=0 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f457e7fc640 1 -- 172.21.15.12:0/3298444394 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55748ca22b10 con 0x55748cb3e910 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f457e7fc640 10 client.25193 handle_command_reply: tid=0 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f459fa5b740 1 client.25193 shutdown 2024-09-19T06:40:39.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f459fa5b740 1 -- 172.21.15.12:0/3298444394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 msgr2=0x55748cad4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f459fa5b740 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cad4c00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f458001d830 tx=0x7f458001d6a0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f459fa5b740 1 -- 172.21.15.12:0/3298444394 shutdown_connections 2024-09-19T06:40:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f459fa5b740 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55748cb3e910 0x55748cb3d620 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f459fa5b740 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55748cabfbb0 0x55748cad5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f459fa5b740 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55748cab52f0 0x55748cad4c00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f457e7fc640 0 client.25193 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f459fa5b740 1 --2- 172.21.15.12:0/3298444394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55748cab49d0 0x55748cada510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.509+0000 7f459fa5b740 1 -- 172.21.15.12:0/3298444394 >> 172.21.15.12:0/3298444394 conn(0x55748cab0f60 msgr2=0x55748cabac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459fa5b740 1 -- 172.21.15.12:0/3298444394 shutdown_connections 2024-09-19T06:40:39.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459fa5b740 1 -- 172.21.15.12:0/3298444394 wait complete. 2024-09-19T06:40:39.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459fa5b740 20 client.25193 trim_cache size 0 max 16384 2024-09-19T06:40:39.519 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:40:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "8bf314c8-7650-11ef-bceb-c7b262605968", 2024-09-19T06:40:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-19T06:40:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24509, 2024-09-19T06:40:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-19T06:40:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-19T06:40:39.519 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-19T06:40:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 144.464743728, 2024-09-19T06:40:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 28, 2024-09-19T06:40:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 86, 2024-09-19T06:40:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2024-09-19T06:40:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 156.10193386200001 2024-09-19T06:40:39.520 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:40:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 -- 172.21.15.12:0/1336176082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45840a3440 msgr2=0x7f45840a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45840a3440 0x7f45840a5900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4598100050 tx=0x7f4580005f90 comp rx=0 tx=0).stop 2024-09-19T06:40:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 -- 172.21.15.12:0/1336176082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4598100e20 msgr2=0x7f4598198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4598100e20 0x7f4598198580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4588005940 tx=0x7f4588003c10 comp rx=0 tx=0).stop 2024-09-19T06:40:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 -- 172.21.15.12:0/1336176082 shutdown_connections 2024-09-19T06:40:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4598102ef0 0x7f459819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45840a3440 0x7f45840a5900 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4598102570 0x7f4598198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 --2- 172.21.15.12:0/1336176082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4598100e20 0x7f4598198580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:39.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 -- 172.21.15.12:0/1336176082 >> 172.21.15.12:0/1336176082 conn(0x7f45980fc7d0 msgr2=0x7f459806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 -- 172.21.15.12:0/1336176082 shutdown_connections 2024-09-19T06:40:39.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:39.510+0000 7f459d682640 1 -- 172.21.15.12:0/1336176082 wait complete. 2024-09-19T06:40:39.537 INFO:teuthology.orchestra.run.smithi012.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.08 s, remaining 2.41 s) 2024-09-19T06:40:39.715 INFO:teuthology.orchestra.run.smithi012.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.26 s, remaining 3.83 s) 2024-09-19T06:40:39.803 INFO:teuthology.orchestra.run.smithi012.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.34 s, remaining 3.32 s) 2024-09-19T06:40:39.944 INFO:teuthology.orchestra.run.smithi012.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.49 s, remaining 3.40 s) 2024-09-19T06:40:40.095 INFO:teuthology.orchestra.run.smithi012.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.64 s, remaining 3.43 s) 2024-09-19T06:40:40.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:39 smithi012 ceph-mon[30937]: pgmap v18: 97 pgs: 97 active+clean; 2.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 72 KiB/s wr, 17 op/s 2024-09-19T06:40:40.248 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T06:40:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:39 smithi016 ceph-mon[34911]: pgmap v18: 97 pgs: 97 active+clean; 2.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 72 KiB/s wr, 17 op/s 2024-09-19T06:40:40.271 INFO:teuthology.orchestra.run.smithi012.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.81 s, remaining 3.52 s) 2024-09-19T06:40:40.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:39 smithi173 ceph-mon[35349]: pgmap v18: 97 pgs: 97 active+clean; 2.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 72 KiB/s wr, 17 op/s 2024-09-19T06:40:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:700000 of 3200000 tuples (21%) done (elapsed 0.90 s, remaining 3.22 s) 2024-09-19T06:40:40.549 INFO:teuthology.orchestra.run.smithi012.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.09 s, remaining 3.27 s) 2024-09-19T06:40:40.705 INFO:teuthology.orchestra.run.smithi012.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.25 s, remaining 3.18 s) 2024-09-19T06:40:40.785 INFO:teuthology.orchestra.run.smithi012.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.33 s, remaining 2.92 s) 2024-09-19T06:40:40.972 INFO:teuthology.orchestra.run.smithi012.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.51 s, remaining 2.89 s) 2024-09-19T06:40:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.57 s, remaining 2.62 s) 2024-09-19T06:40:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.75 s, remaining 2.56 s) 2024-09-19T06:40:41.377 INFO:teuthology.orchestra.run.smithi012.stderr:1400000 of 3200000 tuples (43%) done (elapsed 1.92 s, remaining 2.47 s) 2024-09-19T06:40:41.458 INFO:teuthology.orchestra.run.smithi012.stderr:1500000 of 3200000 tuples (46%) done (elapsed 2.00 s, remaining 2.26 s) 2024-09-19T06:40:41.620 INFO:teuthology.orchestra.run.smithi012.stderr:1600000 of 3200000 tuples (50%) done (elapsed 2.16 s, remaining 2.16 s) 2024-09-19T06:40:41.786 INFO:teuthology.orchestra.run.smithi012.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.33 s, remaining 2.05 s) 2024-09-19T06:40:41.867 INFO:teuthology.orchestra.run.smithi012.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.41 s, remaining 1.87 s) 2024-09-19T06:40:42.042 INFO:teuthology.orchestra.run.smithi012.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.58 s, remaining 1.77 s) 2024-09-19T06:40:42.208 INFO:teuthology.orchestra.run.smithi012.stderr:2000000 of 3200000 tuples (62%) done (elapsed 2.75 s, remaining 1.65 s) 2024-09-19T06:40:42.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:41 smithi016 ceph-mon[34911]: pgmap v19: 97 pgs: 97 active+clean; 44 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 3.7 MiB/s wr, 124 op/s 2024-09-19T06:40:42.289 INFO:teuthology.orchestra.run.smithi012.stderr:2100000 of 3200000 tuples (65%) done (elapsed 2.83 s, remaining 1.48 s) 2024-09-19T06:40:42.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:41 smithi173 ceph-mon[35349]: pgmap v19: 97 pgs: 97 active+clean; 44 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 3.7 MiB/s wr, 124 op/s 2024-09-19T06:40:42.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:41 smithi012 ceph-mon[30937]: pgmap v19: 97 pgs: 97 active+clean; 44 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 3.7 MiB/s wr, 124 op/s 2024-09-19T06:40:42.432 INFO:teuthology.orchestra.run.smithi012.stderr:2200000 of 3200000 tuples (68%) done (elapsed 2.97 s, remaining 1.35 s) 2024-09-19T06:40:42.518 INFO:teuthology.orchestra.run.smithi012.stderr:2300000 of 3200000 tuples (71%) done (elapsed 3.06 s, remaining 1.20 s) 2024-09-19T06:40:42.658 INFO:teuthology.orchestra.run.smithi012.stderr:2400000 of 3200000 tuples (75%) done (elapsed 3.20 s, remaining 1.07 s) 2024-09-19T06:40:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.37 s, remaining 0.94 s) 2024-09-19T06:40:42.931 INFO:teuthology.orchestra.run.smithi012.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.47 s, remaining 0.80 s) 2024-09-19T06:40:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2700000 of 3200000 tuples (84%) done (elapsed 3.62 s, remaining 0.67 s) 2024-09-19T06:40:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2800000 of 3200000 tuples (87%) done (elapsed 3.73 s, remaining 0.53 s) 2024-09-19T06:40:43.346 INFO:teuthology.orchestra.run.smithi012.stderr:2900000 of 3200000 tuples (90%) done (elapsed 3.89 s, remaining 0.40 s) 2024-09-19T06:40:43.484 INFO:teuthology.orchestra.run.smithi012.stderr:3000000 of 3200000 tuples (93%) done (elapsed 4.02 s, remaining 0.27 s) 2024-09-19T06:40:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:3100000 of 3200000 tuples (96%) done (elapsed 4.12 s, remaining 0.13 s) 2024-09-19T06:40:43.728 INFO:teuthology.orchestra.run.smithi012.stderr:3200000 of 3200000 tuples (100%) done (elapsed 4.27 s, remaining 0.00 s) 2024-09-19T06:40:43.781 INFO:teuthology.orchestra.run.smithi012.stderr:vacuuming... 2024-09-19T06:40:44.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:43 smithi012 ceph-mon[30937]: pgmap v20: 97 pgs: 97 active+clean; 44 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 3.7 MiB/s wr, 120 op/s 2024-09-19T06:40:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:43 smithi016 ceph-mon[34911]: pgmap v20: 97 pgs: 97 active+clean; 44 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 3.7 MiB/s wr, 120 op/s 2024-09-19T06:40:44.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.306+0000 7fcb5773a640 1 -- 172.21.15.12:0/2574575606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb50107b80 msgr2=0x7fcb50107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.306+0000 7fcb5773a640 1 --2- 172.21.15.12:0/2574575606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb50107b80 0x7fcb50107f60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009cd0 tx=0x7fcb4c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.306+0000 7fcb5773a640 1 -- 172.21.15.12:0/2574575606 shutdown_connections 2024-09-19T06:40:44.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.306+0000 7fcb5773a640 1 --2- 172.21.15.12:0/2574575606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb50102480 0x7fcb5010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.306+0000 7fcb5773a640 1 --2- 172.21.15.12:0/2574575606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50101ae0 0x7fcb50101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.306+0000 7fcb5773a640 1 --2- 172.21.15.12:0/2574575606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb50107b80 0x7fcb50107f60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.306+0000 7fcb5773a640 1 -- 172.21.15.12:0/2574575606 >> 172.21.15.12:0/2574575606 conn(0x7fcb500fd7e0 msgr2=0x7fcb500ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.307+0000 7fcb5773a640 1 -- 172.21.15.12:0/2574575606 shutdown_connections 2024-09-19T06:40:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.307+0000 7fcb5773a640 1 -- 172.21.15.12:0/2574575606 wait complete. 2024-09-19T06:40:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.307+0000 7fcb5773a640 1 Processor -- start 2024-09-19T06:40:44.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.307+0000 7fcb5773a640 1 -- start start 2024-09-19T06:40:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.307+0000 7fcb5773a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb50101ae0 0x7fcb500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.307+0000 7fcb5773a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50102480 0x7fcb50074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.307+0000 7fcb5773a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb50107b80 0x7fcb50074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.307+0000 7fcb5773a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb50111f30 con 0x7fcb50107b80 2024-09-19T06:40:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.307+0000 7fcb5773a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb50111db0 con 0x7fcb50102480 2024-09-19T06:40:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.307+0000 7fcb5773a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb501120b0 con 0x7fcb50101ae0 2024-09-19T06:40:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb55cd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb50107b80 0x7fcb50074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb55cd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb50107b80 0x7fcb50074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52742/0 (socket says 172.21.15.12:52742) 2024-09-19T06:40:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb55cd7640 1 -- 172.21.15.12:0/3813699631 learned_addr learned my addr 172.21.15.12:0/3813699631 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb554d6640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb50101ae0 0x7fcb500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50102480 0x7fcb50074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb55cd7640 1 -- 172.21.15.12:0/3813699631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb50101ae0 msgr2=0x7fcb500744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb55cd7640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb50101ae0 0x7fcb500744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb55cd7640 1 -- 172.21.15.12:0/3813699631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50102480 msgr2=0x7fcb50074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb55cd7640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50102480 0x7fcb50074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb55cd7640 1 -- 172.21.15.12:0/3813699631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb501a6840 con 0x7fcb50107b80 2024-09-19T06:40:44.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50102480 0x7fcb50074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:44.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb55cd7640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb50107b80 0x7fcb50074f70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800e970 tx=0x7fcb4800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:44.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb467fc640 1 -- 172.21.15.12:0/3813699631 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800ccc0 con 0x7fcb50107b80 2024-09-19T06:40:44.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb467fc640 1 -- 172.21.15.12:0/3813699631 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb4800ce60 con 0x7fcb50107b80 2024-09-19T06:40:44.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb5773a640 1 -- 172.21.15.12:0/3813699631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb501a6b30 con 0x7fcb50107b80 2024-09-19T06:40:44.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb467fc640 1 -- 172.21.15.12:0/3813699631 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48010490 con 0x7fcb50107b80 2024-09-19T06:40:44.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.308+0000 7fcb5773a640 1 -- 172.21.15.12:0/3813699631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb501a7080 con 0x7fcb50107b80 2024-09-19T06:40:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.311+0000 7fcb467fc640 1 -- 172.21.15.12:0/3813699631 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fcb48005020 con 0x7fcb50107b80 2024-09-19T06:40:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.311+0000 7fcb5a4d4740 1 Processor -- start 2024-09-19T06:40:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.311+0000 7fcb5a4d4740 1 -- start start 2024-09-19T06:40:44.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64179af0 0x564d64179ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 0x564d64184770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 0x564d641870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564d640de2f0 con 0x564d64179af0 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564d64086270 con 0x564d6417a410 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564d640da2b0 con 0x564d64184cb0 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb54cd5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64179af0 0x564d64179ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb467fc640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb3c0a3500 0x7fcb3c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb54cd5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64179af0 0x564d64179ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52756/0 (socket says 172.21.15.12:52756) 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb54cd5640 1 -- 172.21.15.12:0/1299780898 learned_addr learned my addr 172.21.15.12:0/1299780898 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb554d6640 1 --2- 172.21.15.12:0/1299780898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 0x564d64184770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb55cd7640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb3c0a3500 0x7fcb3c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/1299780898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 0x564d641870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb467fc640 1 -- 172.21.15.12:0/3813699631 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcb480d0380 con 0x7fcb50107b80 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb54cd5640 1 -- 172.21.15.12:0/1299780898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 msgr2=0x564d641870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/1299780898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 0x564d641870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb54cd5640 1 -- 172.21.15.12:0/1299780898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 msgr2=0x564d64184770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/1299780898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 0x564d64184770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.312+0000 7fcb54cd5640 1 -- 172.21.15.12:0/1299780898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d64085340 con 0x564d64179af0 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.313+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/1299780898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64179af0 0x564d64179ed0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcb40013590 tx=0x7fcb400097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb813b1034980654 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.313+0000 7fcb55cd7640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb3c0a3500 0x7fcb3c0a59c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb480cd9d0 tx=0x7fcb4806e1d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.313+0000 7fcb3b7fe640 1 -- 172.21.15.12:0/1299780898 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000f520 con 0x564d64179af0 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.313+0000 7fcb3b7fe640 1 -- 172.21.15.12:0/1299780898 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb4000fba0 con 0x564d64179af0 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.313+0000 7fcb3b7fe640 1 -- 172.21.15.12:0/1299780898 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40011a70 con 0x564d64179af0 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/1299780898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64179af0 msgr2=0x564d64179ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/1299780898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64179af0 0x564d64179ed0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcb40013590 tx=0x7fcb400097d0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/1299780898 shutdown_connections 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/1299780898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 0x564d641870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/1299780898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 0x564d64184770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/1299780898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64179af0 0x564d64179ed0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/1299780898 >> 172.21.15.12:0/1299780898 conn(0x564d64176060 msgr2=0x564d64176440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/1299780898 shutdown_connections 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/1299780898 wait complete. 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 -- start start 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.314+0000 7fcb5a4d4740 1 Processor -- start 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64179af0 0x564d64181b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 0x564d64182070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d641825b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564d64187880 con 0x564d64184cb0 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564d64067290 con 0x564d6417a410 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564d64187a00 con 0x564d64179af0 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb5a4d4740 10 client.0 _ll_register_callbacks cb 0x564d64098140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb54cd5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d641825b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb554d6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 0x564d64182070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb554d6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 0x564d64182070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45134/0 (socket says 172.21.15.12:45134) 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb54cd5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d641825b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52762/0 (socket says 172.21.15.12:52762) 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb554d6640 1 -- 172.21.15.12:0/4090056724 learned_addr learned my addr 172.21.15.12:0/4090056724 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64179af0 0x564d64181b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb554d6640 1 -- 172.21.15.12:0/4090056724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64179af0 msgr2=0x564d64181b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb554d6640 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64179af0 0x564d64181b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb554d6640 1 -- 172.21.15.12:0/4090056724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 msgr2=0x564d641825b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb554d6640 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d641825b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb554d6640 1 -- 172.21.15.12:0/4090056724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d63df1210 con 0x564d6417a410 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.315+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64179af0 0x564d64181b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb554d6640 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 0x564d64182070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c02ae00 tx=0x7fcb4c031af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dfec36609a35625 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb38ff9640 1 -- 172.21.15.12:0/4090056724 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c003970 con 0x564d6417a410 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/4090056724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb4000fba0 con 0x564d6417a410 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb38ff9640 1 -- 172.21.15.12:0/4090056724 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcb4c003b10 con 0x564d6417a410 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb38ff9640 1 -- 172.21.15.12:0/4090056724 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb4c003d10 con 0x564d6417a410 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb5a4d4740 10 client.25205 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/4090056724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564d63ebd620 con 0x564d6417a410 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb38ff9640 1 -- 172.21.15.12:0/4090056724 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb4000fba0 con 0x564d6417a410 2024-09-19T06:40:44.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb38ff9640 1 -- 172.21.15.12:0/4090056724 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb4c030070 con 0x564d6417a410 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb5a4d4740 10 client.25205 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb5a4d4740 10 client.25205 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb5a4d4740 20 client.25205 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564d64194bf0 0x564d64196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb5a4d4740 4 client.25205 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.316+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/4090056724 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d640eba20 con 0x564d64194bf0 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.317+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564d64194bf0 0x564d64196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.317+0000 7fcb38ff9640 10 client.25205 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.317+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564d64194bf0 0x564d64196fe0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68681c1b747be5ca server_cookie=bc33a5edd4d98f09 in_seq=0 out_seq=0 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb38ff9640 1 -- 172.21.15.12:0/4090056724 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d640eba20 con 0x564d64194bf0 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb38ff9640 10 client.25205 handle_command_reply: tid=0 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 client.25205 shutdown 2024-09-19T06:40:44.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/4090056724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 msgr2=0x564d64182070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 0x564d64182070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c02ae00 tx=0x7fcb4c031af0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/4090056724 shutdown_connections 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564d64194bf0 0x564d64196fe0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d641825b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d6417a410 0x564d64182070 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/4090056724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64179af0 0x564d64181b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb38ff9640 0 client.25205 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/4090056724 >> 172.21.15.12:0/4090056724 conn(0x564d64176060 msgr2=0x564d6417bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/4090056724 shutdown_connections 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/4090056724 wait complete. 2024-09-19T06:40:44.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.318+0000 7fcb5a4d4740 20 client.25205 trim_cache size 0 max 16384 2024-09-19T06:40:44.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:43 smithi173 ceph-mon[35349]: pgmap v20: 97 pgs: 97 active+clean; 44 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 3.7 MiB/s wr, 120 op/s 2024-09-19T06:40:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb5a4d4740 1 Processor -- start 2024-09-19T06:40:44.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb5a4d4740 1 -- start start 2024-09-19T06:40:44.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d64179af0 0x564d641823e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d6417a410 0x564d6419c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 0x564d6419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb501afbc0 con 0x564d6417a410 2024-09-19T06:40:44.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb501b1700 con 0x564d64179af0 2024-09-19T06:40:44.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb501b0290 con 0x564d64184cb0 2024-09-19T06:40:44.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb554d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d6417a410 0x564d6419c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb554d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d6417a410 0x564d6419c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52774/0 (socket says 172.21.15.12:52774) 2024-09-19T06:40:44.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb554d6640 1 -- 172.21.15.12:0/906932918 learned_addr learned my addr 172.21.15.12:0/906932918 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/906932918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d64179af0 0x564d641823e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/906932918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 0x564d6419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb554d6640 1 -- 172.21.15.12:0/906932918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 msgr2=0x564d6419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb554d6640 1 --2- 172.21.15.12:0/906932918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 0x564d6419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb554d6640 1 -- 172.21.15.12:0/906932918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d64179af0 msgr2=0x564d641823e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb554d6640 1 --2- 172.21.15.12:0/906932918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d64179af0 0x564d641823e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb554d6640 1 -- 172.21.15.12:0/906932918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d64175e90 con 0x564d6417a410 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/906932918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 0x564d6419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.333+0000 7fcb554d6640 1 --2- 172.21.15.12:0/906932918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d6417a410 0x564d6419c8a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c005e30 tx=0x7fcb4c02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deee6a92f1777ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.334+0000 7fcb3affd640 1 -- 172.21.15.12:0/906932918 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c003970 con 0x564d6417a410 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.334+0000 7fcb3affd640 1 -- 172.21.15.12:0/906932918 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb4c036040 con 0x564d6417a410 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.334+0000 7fcb3affd640 1 -- 172.21.15.12:0/906932918 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c004c70 con 0x564d6417a410 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.334+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/906932918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d6417a410 msgr2=0x564d6419c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.334+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/906932918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d6417a410 0x564d6419c8a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c005e30 tx=0x7fcb4c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.334+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/906932918 shutdown_connections 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.334+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/906932918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d64184cb0 0x564d6419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.334+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/906932918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d6417a410 0x564d6419c8a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.334+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/906932918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d64179af0 0x564d641823e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.334+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/906932918 >> 172.21.15.12:0/906932918 conn(0x564d64176060 msgr2=0x564d64183bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/906932918 shutdown_connections 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/906932918 wait complete. 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 1 -- start start 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 1 Processor -- start 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d64179af0 0x564d64186010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d6417a410 0x564d64186550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d64186a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb501b1030 con 0x564d64184cb0 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb501b0960 con 0x564d64179af0 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb501adbf0 con 0x564d6417a410 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb5a4d4740 10 client.0 _ll_register_callbacks cb 0x7fcb4c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb54cd5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d64186a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb54cd5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d64186a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52784/0 (socket says 172.21.15.12:52784) 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.335+0000 7fcb54cd5640 1 -- 172.21.15.12:0/3105502448 learned_addr learned my addr 172.21.15.12:0/3105502448 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d64179af0 0x564d64186010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb554d6640 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d6417a410 0x564d64186550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb54cd5640 1 -- 172.21.15.12:0/3105502448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d6417a410 msgr2=0x564d64186550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d6417a410 0x564d64186550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb54cd5640 1 -- 172.21.15.12:0/3105502448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d64179af0 msgr2=0x564d64186010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d64179af0 0x564d64186010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb54cd5640 1 -- 172.21.15.12:0/3105502448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d641712d0 con 0x564d64184cb0 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb54cd5640 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d64186a90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000f430 tx=0x7fcb400097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1eb62824175b2db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb38ff9640 1 -- 172.21.15.12:0/3105502448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb400130d0 con 0x564d64184cb0 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb38ff9640 1 -- 172.21.15.12:0/3105502448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcb4002ee80 con 0x564d64184cb0 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/3105502448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb4c036040 con 0x564d64184cb0 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb38ff9640 1 -- 172.21.15.12:0/3105502448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb40005250 con 0x564d64184cb0 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb5a4d4740 10 client.15597 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.336+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/3105502448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564d641ffb00 con 0x564d64184cb0 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb38ff9640 1 -- 172.21.15.12:0/3105502448 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb4c036040 con 0x564d64184cb0 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb38ff9640 1 -- 172.21.15.12:0/3105502448 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb4000f520 con 0x564d64184cb0 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb5a4d4740 10 client.15597 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb5a4d4740 10 client.15597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb5a4d4740 20 client.15597 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564d642000e0 0x564d642024d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb5a4d4740 4 client.15597 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:40:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/3105502448 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d640e5d70 con 0x564d642000e0 2024-09-19T06:40:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb554d6640 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564d642000e0 0x564d642024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb554d6640 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564d642000e0 0x564d642024d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8168ce4489dafd96 server_cookie=69790e90ef741d59 in_seq=0 out_seq=0 2024-09-19T06:40:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.337+0000 7fcb38ff9640 10 client.15597 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.509+0000 7fcb38ff9640 1 -- 172.21.15.12:0/3105502448 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d640e5d70 con 0x564d642000e0 2024-09-19T06:40:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.509+0000 7fcb38ff9640 10 client.15597 handle_command_reply: tid=0 2024-09-19T06:40:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.509+0000 7fcb5a4d4740 1 client.15597 shutdown 2024-09-19T06:40:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.509+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/3105502448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 msgr2=0x564d64186a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.509+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d64186a90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000f430 tx=0x7fcb400097d0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/3105502448 shutdown_connections 2024-09-19T06:40:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564d642000e0 0x564d642024d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564d64184cb0 0x564d64186a90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564d6417a410 0x564d64186550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb38ff9640 0 client.15597 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5a4d4740 1 --2- 172.21.15.12:0/3105502448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564d64179af0 0x564d64186010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/3105502448 >> 172.21.15.12:0/3105502448 conn(0x564d64176060 msgr2=0x564d641749a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/3105502448 shutdown_connections 2024-09-19T06:40:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5a4d4740 1 -- 172.21.15.12:0/3105502448 wait complete. 2024-09-19T06:40:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5a4d4740 20 client.15597 trim_cache size 0 max 16384 2024-09-19T06:40:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:40:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:40:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:40:44.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:40:44.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5773a640 1 -- 172.21.15.12:0/3813699631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb3c0a3500 msgr2=0x7fcb3c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5773a640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb3c0a3500 0x7fcb3c0a59c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb480cd9d0 tx=0x7fcb4806e1d0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5773a640 1 -- 172.21.15.12:0/3813699631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb50107b80 msgr2=0x7fcb50074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.510+0000 7fcb5773a640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb50107b80 0x7fcb50074f70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800e970 tx=0x7fcb4800ed70 comp rx=0 tx=0).stop 2024-09-19T06:40:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.511+0000 7fcb5773a640 1 -- 172.21.15.12:0/3813699631 shutdown_connections 2024-09-19T06:40:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.511+0000 7fcb5773a640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb50107b80 0x7fcb50074f70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.511+0000 7fcb5773a640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50102480 0x7fcb50074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.511+0000 7fcb5773a640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb3c0a3500 0x7fcb3c0a59c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.511+0000 7fcb5773a640 1 --2- 172.21.15.12:0/3813699631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb50101ae0 0x7fcb500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.511+0000 7fcb5773a640 1 -- 172.21.15.12:0/3813699631 >> 172.21.15.12:0/3813699631 conn(0x7fcb500fd7e0 msgr2=0x7fcb500fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.511+0000 7fcb5773a640 1 -- 172.21.15.12:0/3813699631 shutdown_connections 2024-09-19T06:40:44.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:44.511+0000 7fcb5773a640 1 -- 172.21.15.12:0/3813699631 wait complete. 2024-09-19T06:40:44.525 INFO:teuthology.orchestra.run.smithi012.stderr:creating primary keys... 2024-09-19T06:40:45.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:44 smithi016 ceph-mon[34911]: pgmap v21: 97 pgs: 97 active+clean; 44 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 3.7 MiB/s wr, 120 op/s 2024-09-19T06:40:45.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:44 smithi173 ceph-mon[35349]: pgmap v21: 97 pgs: 97 active+clean; 44 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 3.7 MiB/s wr, 120 op/s 2024-09-19T06:40:45.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:44 smithi012 ceph-mon[30937]: pgmap v21: 97 pgs: 97 active+clean; 44 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 3.7 MiB/s wr, 120 op/s 2024-09-19T06:40:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:done in 6.27 s (drop tables 0.00 s, create tables 0.01 s, client-side generate 4.34 s, vacuum 0.74 s, primary keys 1.17 s). 2024-09-19T06:40:45.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-19T06:40:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:starting vacuum...end. 2024-09-19T06:40:47.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:47 smithi016 ceph-mon[34911]: pgmap v22: 97 pgs: 97 active+clean; 365 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 58 MiB/s wr, 156 op/s 2024-09-19T06:40:47.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:47 smithi173 ceph-mon[35349]: pgmap v22: 97 pgs: 97 active+clean; 365 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 58 MiB/s wr, 156 op/s 2024-09-19T06:40:47.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:47 smithi012 ceph-mon[30937]: pgmap v22: 97 pgs: 97 active+clean; 365 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 58 MiB/s wr, 156 op/s 2024-09-19T06:40:48.638 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:40:49.122 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:49.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:49 smithi012 ceph-mon[30937]: pgmap v23: 97 pgs: 97 active+clean; 365 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 58 MiB/s wr, 143 op/s 2024-09-19T06:40:49.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:49 smithi016 ceph-mon[34911]: pgmap v23: 97 pgs: 97 active+clean; 365 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 58 MiB/s wr, 143 op/s 2024-09-19T06:40:49.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:49 smithi173 ceph-mon[35349]: pgmap v23: 97 pgs: 97 active+clean; 365 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 58 MiB/s wr, 143 op/s 2024-09-19T06:40:49.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.738+0000 7ff9127fc640 1 -- 172.21.15.12:0/2508041009 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c030950 con 0x7ff914101de0 2024-09-19T06:40:49.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.739+0000 7ff919d20640 1 -- 172.21.15.12:0/2508041009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff914101de0 msgr2=0x7ff9141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.739+0000 7ff919d20640 1 --2- 172.21.15.12:0/2508041009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff914101de0 0x7ff9141021c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009860 tx=0x7ff90c02a340 comp rx=0 tx=0).stop 2024-09-19T06:40:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.739+0000 7ff919d20640 1 -- 172.21.15.12:0/2508041009 shutdown_connections 2024-09-19T06:40:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.739+0000 7ff919d20640 1 --2- 172.21.15.12:0/2508041009 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff914106f10 0x7ff91410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.739+0000 7ff919d20640 1 --2- 172.21.15.12:0/2508041009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff914102790 0x7ff9141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.739+0000 7ff919d20640 1 --2- 172.21.15.12:0/2508041009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff914101de0 0x7ff9141021c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.739+0000 7ff919d20640 1 -- 172.21.15.12:0/2508041009 >> 172.21.15.12:0/2508041009 conn(0x7ff9140fd880 msgr2=0x7ff9140ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.739+0000 7ff919d20640 1 -- 172.21.15.12:0/2508041009 shutdown_connections 2024-09-19T06:40:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.739+0000 7ff919d20640 1 -- 172.21.15.12:0/2508041009 wait complete. 2024-09-19T06:40:49.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.740+0000 7ff919d20640 1 Processor -- start 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.740+0000 7ff919d20640 1 -- start start 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.740+0000 7ff919d20640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff914101de0 0x7ff914117390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.740+0000 7ff919d20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff914102790 0x7ff914110420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.740+0000 7ff919d20640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff914106f10 0x7ff914110960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.740+0000 7ff919d20640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141185a0 con 0x7ff914102790 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.740+0000 7ff919d20640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff914118420 con 0x7ff914106f10 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.740+0000 7ff919d20640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff914118720 con 0x7ff914101de0 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff913fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff914106f10 0x7ff914110960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff914101de0 0x7ff914117390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff912ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff914102790 0x7ff914110420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff914101de0 0x7ff914117390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:55784/0 (socket says 172.21.15.12:55784) 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff912ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff914102790 0x7ff914110420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52796/0 (socket says 172.21.15.12:52796) 2024-09-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff9137fe640 1 -- 172.21.15.12:0/2325848776 learned_addr learned my addr 172.21.15.12:0/2325848776 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:49.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff913fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff914106f10 0x7ff914110960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45164/0 (socket says 172.21.15.12:45164) 2024-09-19T06:40:49.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff9137fe640 1 -- 172.21.15.12:0/2325848776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff914106f10 msgr2=0x7ff914110960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:49.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff9137fe640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff914106f10 0x7ff914110960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff9137fe640 1 -- 172.21.15.12:0/2325848776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff914102790 msgr2=0x7ff914110420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:49.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff9137fe640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff914102790 0x7ff914110420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.741+0000 7ff9137fe640 1 -- 172.21.15.12:0/2325848776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff914110f20 con 0x7ff914101de0 2024-09-19T06:40:49.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.742+0000 7ff9137fe640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff914101de0 0x7ff914117390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff90c02a8b0 tx=0x7ff90c033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:49.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.742+0000 7ff910ff9640 1 -- 172.21.15.12:0/2325848776 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c037040 con 0x7ff914101de0 2024-09-19T06:40:49.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.742+0000 7ff910ff9640 1 -- 172.21.15.12:0/2325848776 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff90c030550 con 0x7ff914101de0 2024-09-19T06:40:49.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.743+0000 7ff910ff9640 1 -- 172.21.15.12:0/2325848776 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c037040 con 0x7ff914101de0 2024-09-19T06:40:49.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.743+0000 7ff919d20640 1 -- 172.21.15.12:0/2325848776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9141111b0 con 0x7ff914101de0 2024-09-19T06:40:49.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.743+0000 7ff919d20640 1 -- 172.21.15.12:0/2325848776 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9141150f0 con 0x7ff914101de0 2024-09-19T06:40:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.747+0000 7ff91c0f9740 1 Processor -- start 2024-09-19T06:40:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.747+0000 7ff910ff9640 1 -- 172.21.15.12:0/2325848776 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7ff90c042020 con 0x7ff914101de0 2024-09-19T06:40:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.748+0000 7ff910ff9640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff9000a3680 0x7ff9000a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.749+0000 7ff910ff9640 1 -- 172.21.15.12:0/2325848776 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ff90c0ef100 con 0x7ff914101de0 2024-09-19T06:40:49.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.749+0000 7ff91c0f9740 1 -- start start 2024-09-19T06:40:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.750+0000 7ff913fff640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff9000a3680 0x7ff9000a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.750+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e7044880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.750+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 0x5602e704f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.750+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e704f680 0x5602e7051a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.750+0000 7ff91c0f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5602e6faa2e0 con 0x5602e70444a0 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.750+0000 7ff91c0f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5602e6f51ce0 con 0x5602e7044dc0 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.750+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e7044880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.750+0000 7ff91c0f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5602e6fa62a0 con 0x5602e704f680 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.751+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e7044880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52804/0 (socket says 172.21.15.12:52804) 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.751+0000 7ff9137fe640 1 -- 172.21.15.12:0/706751943 learned_addr learned my addr 172.21.15.12:0/706751943 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.751+0000 7ff912ffd640 1 --2- 172.21.15.12:0/706751943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 0x5602e704f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.751+0000 7ff912ffd640 1 -- 172.21.15.12:0/706751943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e704f680 msgr2=0x5602e7051a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.751+0000 7ff912ffd640 1 --2- 172.21.15.12:0/706751943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e704f680 0x5602e7051a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.751+0000 7ff912ffd640 1 -- 172.21.15.12:0/706751943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 msgr2=0x5602e7044880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.751+0000 7ff912ffd640 1 --2- 172.21.15.12:0/706751943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e7044880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.751+0000 7ff912ffd640 1 -- 172.21.15.12:0/706751943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e6f36440 con 0x5602e7044dc0 2024-09-19T06:40:49.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.751+0000 7ff9137fe640 1 --2- 172.21.15.12:0/706751943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e7044880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.752+0000 7ff912ffd640 1 --2- 172.21.15.12:0/706751943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 0x5602e704f140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff914111be0 tx=0x7ff9040095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a87acb008962a9a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.752+0000 7ff909ffb640 1 -- 172.21.15.12:0/706751943 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904003e40 con 0x5602e7044dc0 2024-09-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.752+0000 7ff909ffb640 1 -- 172.21.15.12:0/706751943 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff904004530 con 0x5602e7044dc0 2024-09-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.752+0000 7ff909ffb640 1 -- 172.21.15.12:0/706751943 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904003e40 con 0x5602e7044dc0 2024-09-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.753+0000 7ff91c0f9740 1 -- 172.21.15.12:0/706751943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 msgr2=0x5602e704f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.754+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/706751943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 0x5602e704f140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff914111be0 tx=0x7ff9040095c0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.754+0000 7ff913fff640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff9000a3680 0x7ff9000a5b40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc005fd0 tx=0x7ff8fc00d4b0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.754+0000 7ff91c0f9740 1 -- 172.21.15.12:0/706751943 shutdown_connections 2024-09-19T06:40:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.754+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/706751943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e704f680 0x5602e7051a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.754+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/706751943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 0x5602e704f140 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.754+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/706751943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e7044880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.754+0000 7ff91c0f9740 1 -- 172.21.15.12:0/706751943 >> 172.21.15.12:0/706751943 conn(0x5602e7040a30 msgr2=0x5602e7040e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.754+0000 7ff91c0f9740 1 -- 172.21.15.12:0/706751943 shutdown_connections 2024-09-19T06:40:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.754+0000 7ff91c0f9740 1 -- 172.21.15.12:0/706751943 wait complete. 2024-09-19T06:40:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.755+0000 7ff91c0f9740 1 -- start start 2024-09-19T06:40:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.755+0000 7ff91c0f9740 1 Processor -- start 2024-09-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.756+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e704ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.756+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 0x5602e704c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.756+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e704ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.756+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e704f680 0x5602e704c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.756+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e704ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52806/0 (socket says 172.21.15.12:52806) 2024-09-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.756+0000 7ff9137fe640 1 -- 172.21.15.12:0/3511156547 learned_addr learned my addr 172.21.15.12:0/3511156547 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.756+0000 7ff912ffd640 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 0x5602e704c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.757+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5602e7052250 con 0x5602e70444a0 2024-09-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.757+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5602e6f65050 con 0x5602e7044dc0 2024-09-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.757+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5602e70523d0 con 0x5602e704f680 2024-09-19T06:40:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.757+0000 7ff91c0f9740 10 client.0 _ll_register_callbacks cb 0x5602e6fa5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.757+0000 7ff913fff640 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e704f680 0x5602e704c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.757+0000 7ff912ffd640 1 -- 172.21.15.12:0/3511156547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e704f680 msgr2=0x5602e704c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.758+0000 7ff912ffd640 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e704f680 0x5602e704c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.758+0000 7ff912ffd640 1 -- 172.21.15.12:0/3511156547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 msgr2=0x5602e704ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.758+0000 7ff912ffd640 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e704ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.758+0000 7ff912ffd640 1 -- 172.21.15.12:0/3511156547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e6d1b3c0 con 0x5602e7044dc0 2024-09-19T06:40:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.759+0000 7ff912ffd640 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 0x5602e704c1c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9040197e0 tx=0x7ff9040047f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b5f10306ec5da06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.759+0000 7ff8f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:40:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.759+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/3511156547 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904029020 con 0x5602e7044dc0 2024-09-19T06:40:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.759+0000 7ff9137fe640 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e704ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.759+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/3511156547 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ff904004250 con 0x5602e7044dc0 2024-09-19T06:40:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.759+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff904004530 con 0x5602e7044dc0 2024-09-19T06:40:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.760+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/3511156547 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff904003e50 con 0x5602e7044dc0 2024-09-19T06:40:49.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.760+0000 7ff91c0f9740 10 client.25223 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:49.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.760+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5602e705dab0 con 0x5602e7044dc0 2024-09-19T06:40:49.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.761+0000 7ff913fff640 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e704f680 0x5602e704c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:49.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.761+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/3511156547 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff904004530 con 0x5602e7044dc0 2024-09-19T06:40:49.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.761+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/3511156547 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff90400b030 con 0x5602e7044dc0 2024-09-19T06:40:49.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.761+0000 7ff91c0f9740 10 client.25223 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:49.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.761+0000 7ff91c0f9740 10 client.25223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:49.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.761+0000 7ff91c0f9740 20 client.25223 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:49.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.761+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602e705ee60 0x5602e7061250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.761+0000 7ff91c0f9740 4 client.25223 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:49.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.761+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602e6fb7850 con 0x5602e705ee60 2024-09-19T06:40:49.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.761+0000 7ff9137fe640 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602e705ee60 0x5602e7061250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.762+0000 7ff8f2ffd640 10 client.25223 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:49.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.762+0000 7ff9137fe640 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602e705ee60 0x5602e7061250 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fb34707672bc0d6 server_cookie=c88b1970a63d4a37 in_seq=0 out_seq=0 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/3511156547 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602e6fb7850 con 0x5602e705ee60 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff8f2ffd640 10 client.25223 handle_command_reply: tid=0 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 client.25223 shutdown 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 msgr2=0x5602e704c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 0x5602e704c1c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9040197e0 tx=0x7ff9040047f0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 shutdown_connections 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602e705ee60 0x5602e7061250 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e704f680 0x5602e704c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7044dc0 0x5602e704c1c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/3511156547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e704ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 >> 172.21.15.12:0/3511156547 conn(0x5602e7040a30 msgr2=0x5602e7046760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff8f2ffd640 0 client.25223 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 shutdown_connections 2024-09-19T06:40:49.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 1 -- 172.21.15.12:0/3511156547 wait complete. 2024-09-19T06:40:49.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.763+0000 7ff91c0f9740 20 client.25223 trim_cache size 0 max 16384 2024-09-19T06:40:49.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.797+0000 7ff91c0f9740 1 Processor -- start 2024-09-19T06:40:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.797+0000 7ff91c0f9740 1 -- start start 2024-09-19T06:40:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e7040a30 0x5602e705b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e70444a0 0x5602e704e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e7044dc0 0x5602e7066880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff91c0f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141bca20 con 0x5602e7040a30 2024-09-19T06:40:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff91c0f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141be560 con 0x5602e70444a0 2024-09-19T06:40:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff91c0f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141bd0f0 con 0x5602e7044dc0 2024-09-19T06:40:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e7040a30 0x5602e705b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e7040a30 0x5602e705b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52816/0 (socket says 172.21.15.12:52816) 2024-09-19T06:40:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff9137fe640 1 -- 172.21.15.12:0/1516809281 learned_addr learned my addr 172.21.15.12:0/1516809281 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff912ffd640 1 --2- 172.21.15.12:0/1516809281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e70444a0 0x5602e704e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff912ffd640 1 -- 172.21.15.12:0/1516809281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e7044dc0 msgr2=0x5602e7066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.798+0000 7ff912ffd640 1 --2- 172.21.15.12:0/1516809281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e7044dc0 0x5602e7066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.799+0000 7ff912ffd640 1 -- 172.21.15.12:0/1516809281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e7040a30 msgr2=0x5602e705b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.799+0000 7ff912ffd640 1 --2- 172.21.15.12:0/1516809281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e7040a30 0x5602e705b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.799+0000 7ff912ffd640 1 -- 172.21.15.12:0/1516809281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e704f280 con 0x5602e70444a0 2024-09-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.799+0000 7ff912ffd640 1 --2- 172.21.15.12:0/1516809281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e70444a0 0x5602e704e130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5602e704d770 tx=0x7ff9040055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5cd32d1ae554071 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.799+0000 7ff9097fa640 1 -- 172.21.15.12:0/1516809281 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904003e50 con 0x5602e70444a0 2024-09-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.799+0000 7ff9097fa640 1 -- 172.21.15.12:0/1516809281 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff904005960 con 0x5602e70444a0 2024-09-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.799+0000 7ff9097fa640 1 -- 172.21.15.12:0/1516809281 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904004e60 con 0x5602e70444a0 2024-09-19T06:40:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.800+0000 7ff91c0f9740 1 -- 172.21.15.12:0/1516809281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e70444a0 msgr2=0x5602e704e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.800+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/1516809281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e70444a0 0x5602e704e130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5602e704d770 tx=0x7ff9040055a0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.800+0000 7ff91c0f9740 1 -- 172.21.15.12:0/1516809281 shutdown_connections 2024-09-19T06:40:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.800+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/1516809281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e7044dc0 0x5602e7066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.800+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/1516809281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e70444a0 0x5602e704e130 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.800+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/1516809281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e7040a30 0x5602e705b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.800+0000 7ff91c0f9740 1 -- 172.21.15.12:0/1516809281 >> 172.21.15.12:0/1516809281 conn(0x5602e704c860 msgr2=0x5602e704da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:49.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.801+0000 7ff91c0f9740 1 -- 172.21.15.12:0/1516809281 shutdown_connections 2024-09-19T06:40:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.801+0000 7ff91c0f9740 1 -- 172.21.15.12:0/1516809281 wait complete. 2024-09-19T06:40:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.801+0000 7ff91c0f9740 1 -- start start 2024-09-19T06:40:49.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.802+0000 7ff91c0f9740 1 Processor -- start 2024-09-19T06:40:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7040a30 0x5602e7057760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e7057ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff91c0f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e7044dc0 0x5602e7052ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff91c0f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141bde90 con 0x5602e70444a0 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff91c0f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141bd7c0 con 0x5602e7040a30 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff91c0f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141ba9c0 con 0x5602e7044dc0 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff91c0f9740 10 client.0 _ll_register_callbacks cb 0x7ff904009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7040a30 0x5602e7057760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7040a30 0x5602e7057760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45202/0 (socket says 172.21.15.12:45202) 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff9137fe640 1 -- 172.21.15.12:0/263937070 learned_addr learned my addr 172.21.15.12:0/263937070 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff912ffd640 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e7057ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff9137fe640 1 -- 172.21.15.12:0/263937070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e7044dc0 msgr2=0x5602e7052ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff9137fe640 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e7044dc0 0x5602e7052ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff9137fe640 1 -- 172.21.15.12:0/263937070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 msgr2=0x5602e7057ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff9137fe640 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e7057ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.804+0000 7ff9137fe640 1 -- 172.21.15.12:0/263937070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e70533d0 con 0x5602e7040a30 2024-09-19T06:40:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.805+0000 7ff9137fe640 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7040a30 0x5602e7057760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0ec900 tx=0x7ff90c0ee040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fad385e0beb6b6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.805+0000 7ff8f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:40:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.805+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/263937070 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0bb300 con 0x5602e7040a30 2024-09-19T06:40:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.805+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/263937070 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ff90c0b7970 con 0x5602e7040a30 2024-09-19T06:40:49.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.805+0000 7ff91c0f9740 1 -- 172.21.15.12:0/263937070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff904005960 con 0x5602e7040a30 2024-09-19T06:40:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/263937070 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff90c0bf6b0 con 0x5602e7040a30 2024-09-19T06:40:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff91c0f9740 10 client.25229 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff91c0f9740 1 -- 172.21.15.12:0/263937070 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5602e70c9360 con 0x5602e7040a30 2024-09-19T06:40:49.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/263937070 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff904005960 con 0x5602e7040a30 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/263937070 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff90c03a070 con 0x5602e7040a30 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff91c0f9740 10 client.25229 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff91c0f9740 10 client.25229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff91c0f9740 20 client.25229 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602e704f680 0x5602e70cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff91c0f9740 4 client.25229 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.806+0000 7ff91c0f9740 1 -- 172.21.15.12:0/263937070 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5602e6fb1d60 con 0x5602e704f680 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.807+0000 7ff912ffd640 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602e704f680 0x5602e70cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.807+0000 7ff912ffd640 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602e704f680 0x5602e70cbb20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d4951cf7c23f9c server_cookie=d8a1f5f97fb3fa5 in_seq=0 out_seq=0 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.807+0000 7ff8f2ffd640 10 client.25229 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.807+0000 7ff8f2ffd640 1 -- 172.21.15.12:0/263937070 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5602e6fb1d60 con 0x5602e704f680 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.807+0000 7ff8f2ffd640 10 client.25229 handle_command_reply: tid=0 2024-09-19T06:40:49.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.808+0000 7ff91c0f9740 1 client.25229 shutdown 2024-09-19T06:40:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.808+0000 7ff91c0f9740 1 -- 172.21.15.12:0/263937070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7040a30 msgr2=0x5602e7057760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.808+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7040a30 0x5602e7057760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0ec900 tx=0x7ff90c0ee040 comp rx=0 tx=0).stop 2024-09-19T06:40:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.809+0000 7ff91c0f9740 1 -- 172.21.15.12:0/263937070 shutdown_connections 2024-09-19T06:40:49.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.809+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602e704f680 0x5602e70cbb20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.809+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602e7044dc0 0x5602e7052ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.809+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602e70444a0 0x5602e7057ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.809+0000 7ff91c0f9740 1 --2- 172.21.15.12:0/263937070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602e7040a30 0x5602e7057760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.809+0000 7ff91c0f9740 1 -- 172.21.15.12:0/263937070 >> 172.21.15.12:0/263937070 conn(0x5602e704c860 msgr2=0x5602e704e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.809+0000 7ff8f2ffd640 0 client.25229 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.809+0000 7ff91c0f9740 1 -- 172.21.15.12:0/263937070 shutdown_connections 2024-09-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.810+0000 7ff91c0f9740 1 -- 172.21.15.12:0/263937070 wait complete. 2024-09-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.810+0000 7ff91c0f9740 20 client.25229 trim_cache size 0 max 16384 2024-09-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:40:49.813 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:40:49.813 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:40:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.811+0000 7ff919d20640 1 -- 172.21.15.12:0/2325848776 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff9000a3680 msgr2=0x7ff9000a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.811+0000 7ff919d20640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff9000a3680 0x7ff9000a5b40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc005fd0 tx=0x7ff8fc00d4b0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.811+0000 7ff919d20640 1 -- 172.21.15.12:0/2325848776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff914101de0 msgr2=0x7ff914117390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.811+0000 7ff919d20640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff914101de0 0x7ff914117390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff90c02a8b0 tx=0x7ff90c033d10 comp rx=0 tx=0).stop 2024-09-19T06:40:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.812+0000 7ff919d20640 1 -- 172.21.15.12:0/2325848776 shutdown_connections 2024-09-19T06:40:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.812+0000 7ff919d20640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff914106f10 0x7ff914110960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.812+0000 7ff919d20640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff914102790 0x7ff914110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.812+0000 7ff919d20640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff9000a3680 0x7ff9000a5b40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.812+0000 7ff919d20640 1 --2- 172.21.15.12:0/2325848776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff914101de0 0x7ff914117390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.812+0000 7ff919d20640 1 -- 172.21.15.12:0/2325848776 >> 172.21.15.12:0/2325848776 conn(0x7ff9140fd880 msgr2=0x7ff9140feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.812+0000 7ff919d20640 1 -- 172.21.15.12:0/2325848776 shutdown_connections 2024-09-19T06:40:49.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:49.812+0000 7ff919d20640 1 -- 172.21.15.12:0/2325848776 wait complete. 2024-09-19T06:40:50.613 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:40:50.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:40:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 5.0 s, 6019.7 tps, lat 16.304 ms stddev 15.478 2024-09-19T06:40:51.046 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:51.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:51 smithi012 ceph-mon[30937]: pgmap v24: 97 pgs: 97 active+clean; 860 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 78 MiB/s wr, 564 op/s 2024-09-19T06:40:51.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:51 smithi016 ceph-mon[34911]: pgmap v24: 97 pgs: 97 active+clean; 860 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 78 MiB/s wr, 564 op/s 2024-09-19T06:40:51.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:51 smithi173 ceph-mon[35349]: pgmap v24: 97 pgs: 97 active+clean; 860 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 78 MiB/s wr, 564 op/s 2024-09-19T06:40:51.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.650+0000 7f81efcd9640 1 -- 172.21.15.12:0/3786796846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e8109450 msgr2=0x7f81e8110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:51.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.650+0000 7f81efcd9640 1 --2- 172.21.15.12:0/3786796846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e8109450 0x7f81e8110250 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009900 tx=0x7f81e402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.650+0000 7f81efcd9640 1 -- 172.21.15.12:0/3786796846 shutdown_connections 2024-09-19T06:40:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.650+0000 7f81efcd9640 1 --2- 172.21.15.12:0/3786796846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e811b140 0x7f81e811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.650+0000 7f81efcd9640 1 --2- 172.21.15.12:0/3786796846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e8109830 0x7f81e8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.650+0000 7f81efcd9640 1 --2- 172.21.15.12:0/3786796846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e8109450 0x7f81e8110250 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.650+0000 7f81efcd9640 1 -- 172.21.15.12:0/3786796846 >> 172.21.15.12:0/3786796846 conn(0x7f81e806e140 msgr2=0x7f81e806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.650+0000 7f81efcd9640 1 -- 172.21.15.12:0/3786796846 shutdown_connections 2024-09-19T06:40:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.650+0000 7f81efcd9640 1 -- 172.21.15.12:0/3786796846 wait complete. 2024-09-19T06:40:51.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.651+0000 7f81efcd9640 1 Processor -- start 2024-09-19T06:40:51.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.651+0000 7f81efcd9640 1 -- start start 2024-09-19T06:40:51.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.652+0000 7f81efcd9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e8109450 0x7f81e811a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.652+0000 7f81efcd9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e8109830 0x7f81e81148a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.652+0000 7f81efcd9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e811b140 0x7f81e8114de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.652+0000 7f81efcd9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f81e8111330 con 0x7f81e811b140 2024-09-19T06:40:51.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.652+0000 7f81efcd9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81e81111b0 con 0x7f81e8109450 2024-09-19T06:40:51.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.652+0000 7f81efcd9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f81e81114b0 con 0x7f81e8109830 2024-09-19T06:40:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.652+0000 7f81ee276640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e811b140 0x7f81e8114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.652+0000 7f81eda75640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e8109450 0x7f81e811a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.652+0000 7f81ee276640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e811b140 0x7f81e8114de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38402/0 (socket says 172.21.15.12:38402) 2024-09-19T06:40:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.652+0000 7f81ee276640 1 -- 172.21.15.12:0/1855690108 learned_addr learned my addr 172.21.15.12:0/1855690108 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.653+0000 7f81ed274640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e8109830 0x7f81e81148a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.653+0000 7f81eda75640 1 -- 172.21.15.12:0/1855690108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e8109830 msgr2=0x7f81e81148a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.653+0000 7f81eda75640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e8109830 0x7f81e81148a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.653+0000 7f81eda75640 1 -- 172.21.15.12:0/1855690108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e811b140 msgr2=0x7f81e8114de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.653+0000 7f81eda75640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e811b140 0x7f81e8114de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:51.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.653+0000 7f81eda75640 1 -- 172.21.15.12:0/1855690108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e8115510 con 0x7f81e8109450 2024-09-19T06:40:51.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.654+0000 7f81eda75640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e8109450 0x7f81e811a820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81e402a9e0 tx=0x7f81e4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:51.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.654+0000 7f81deffd640 1 -- 172.21.15.12:0/1855690108 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e403f070 con 0x7f81e8109450 2024-09-19T06:40:51.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.654+0000 7f81deffd640 1 -- 172.21.15.12:0/1855690108 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e4031c90 con 0x7f81e8109450 2024-09-19T06:40:51.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.654+0000 7f81deffd640 1 -- 172.21.15.12:0/1855690108 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4035030 con 0x7f81e8109450 2024-09-19T06:40:51.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.654+0000 7f81efcd9640 1 -- 172.21.15.12:0/1855690108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e81bc130 con 0x7f81e8109450 2024-09-19T06:40:51.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.655+0000 7f81efcd9640 1 -- 172.21.15.12:0/1855690108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e81bc4d0 con 0x7f81e8109450 2024-09-19T06:40:51.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.656+0000 7f81efcd9640 1 -- 172.21.15.12:0/1855690108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e8073b00 con 0x7f81e8109450 2024-09-19T06:40:51.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.658+0000 7f81deffd640 1 -- 172.21.15.12:0/1855690108 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f81e4042070 con 0x7f81e8109450 2024-09-19T06:40:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.659+0000 7f81deffd640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81d40a3660 0x7f81d40a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:51.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.659+0000 7f81deffd640 1 -- 172.21.15.12:0/1855690108 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f81e40f0520 con 0x7f81e8109450 2024-09-19T06:40:51.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.660+0000 7f81ed274640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81d40a3660 0x7f81d40a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:51.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.660+0000 7f81ed274640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81d40a3660 0x7f81d40a5b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f81e8116060 tx=0x7f81d8005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:51.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:51.663+0000 7f81deffd640 1 -- 172.21.15.12:0/1855690108 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81e40bc660 con 0x7f81e8109450 2024-09-19T06:40:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.103+0000 7f81efcd9640 1 -- 172.21.15.12:0/1855690108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81e810d5c0 con 0x7f81e8109450 2024-09-19T06:40:52.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:52.107 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-19T06:40:07:090225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:40:07.040062+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:40:52.107 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-19T06:40:52.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.104+0000 7f81deffd640 1 -- 172.21.15.12:0/1855690108 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7f81e40c0960 con 0x7f81e8109450 2024-09-19T06:40:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 -- 172.21.15.12:0/1855690108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81d40a3660 msgr2=0x7f81d40a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81d40a3660 0x7f81d40a5b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f81e8116060 tx=0x7f81d8005f90 comp rx=0 tx=0).stop 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 -- 172.21.15.12:0/1855690108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e8109450 msgr2=0x7f81e811a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e8109450 0x7f81e811a820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81e402a9e0 tx=0x7f81e4003b90 comp rx=0 tx=0).stop 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 -- 172.21.15.12:0/1855690108 shutdown_connections 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e811b140 0x7f81e8114de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81d40a3660 0x7f81d40a5b20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81e8109830 0x7f81e81148a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 --2- 172.21.15.12:0/1855690108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e8109450 0x7f81e811a820 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 -- 172.21.15.12:0/1855690108 >> 172.21.15.12:0/1855690108 conn(0x7f81e806e140 msgr2=0x7f81e80722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.108+0000 7f81efcd9640 1 -- 172.21.15.12:0/1855690108 shutdown_connections 2024-09-19T06:40:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:52.109+0000 7f81efcd9640 1 -- 172.21.15.12:0/1855690108 wait complete. 2024-09-19T06:40:52.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:52 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1855690108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:52.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:52 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1855690108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:52.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:52 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1855690108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:53.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:40:53.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:53 smithi016 ceph-mon[34911]: pgmap v25: 97 pgs: 97 active+clean; 860 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 75 MiB/s wr, 457 op/s 2024-09-19T06:40:53.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:53 smithi173 ceph-mon[35349]: pgmap v25: 97 pgs: 97 active+clean; 860 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 75 MiB/s wr, 457 op/s 2024-09-19T06:40:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:53 smithi012 ceph-mon[30937]: pgmap v25: 97 pgs: 97 active+clean; 860 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 75 MiB/s wr, 457 op/s 2024-09-19T06:40:53.632 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:54.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.213+0000 7f9dba6b6640 1 -- 172.21.15.12:0/503141272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db41027a0 msgr2=0x7f9db41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:54.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.213+0000 7f9dba6b6640 1 --2- 172.21.15.12:0/503141272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db41027a0 0x7f9db41067f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009900 tx=0x7f9da402a410 comp rx=0 tx=0).stop 2024-09-19T06:40:54.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.213+0000 7f9dba6b6640 1 -- 172.21.15.12:0/503141272 shutdown_connections 2024-09-19T06:40:54.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.213+0000 7f9dba6b6640 1 --2- 172.21.15.12:0/503141272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9db4106f20 0x7f9db410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.213+0000 7f9dba6b6640 1 --2- 172.21.15.12:0/503141272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db41027a0 0x7f9db41067f0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009900 tx=0x7f9da402a410 comp rx=0 tx=0).stop 2024-09-19T06:40:54.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.213+0000 7f9dba6b6640 1 --2- 172.21.15.12:0/503141272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9db4101df0 0x7f9db41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.213+0000 7f9dba6b6640 1 -- 172.21.15.12:0/503141272 >> 172.21.15.12:0/503141272 conn(0x7f9db40fd8b0 msgr2=0x7f9db40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:54.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.214+0000 7f9dba6b6640 1 -- 172.21.15.12:0/503141272 shutdown_connections 2024-09-19T06:40:54.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.214+0000 7f9dba6b6640 1 -- 172.21.15.12:0/503141272 wait complete. 2024-09-19T06:40:54.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.215+0000 7f9dba6b6640 1 Processor -- start 2024-09-19T06:40:54.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.215+0000 7f9dba6b6640 1 -- start start 2024-09-19T06:40:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.215+0000 7f9dba6b6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db4101df0 0x7f9db410bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.215+0000 7f9dba6b6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9db4106f20 0x7f9db410c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.215+0000 7f9dba6b6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9db410c6a0 0x7f9db41a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.215+0000 7f9dba6b6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9db4076480 con 0x7f9db4106f20 2024-09-19T06:40:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.215+0000 7f9dba6b6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9db4076300 con 0x7f9db410c6a0 2024-09-19T06:40:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.215+0000 7f9dba6b6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9db4114380 con 0x7f9db4101df0 2024-09-19T06:40:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.216+0000 7f9db37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9db4106f20 0x7f9db410c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.216+0000 7f9db37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9db4106f20 0x7f9db410c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38422/0 (socket says 172.21.15.12:38422) 2024-09-19T06:40:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.216+0000 7f9db37fe640 1 -- 172.21.15.12:0/3018389029 learned_addr learned my addr 172.21.15.12:0/3018389029 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:54.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.217+0000 7f9db8c53640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9db410c6a0 0x7f9db41a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.218+0000 7f9db37fe640 1 -- 172.21.15.12:0/3018389029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db4101df0 msgr2=0x7f9db410bc20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:40:54.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.218+0000 7f9db37fe640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db4101df0 0x7f9db410bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.218+0000 7f9db37fe640 1 -- 172.21.15.12:0/3018389029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9db410c6a0 msgr2=0x7f9db41a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:54.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.218+0000 7f9db37fe640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9db410c6a0 0x7f9db41a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.218+0000 7f9db37fe640 1 -- 172.21.15.12:0/3018389029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db41a0bd0 con 0x7f9db4106f20 2024-09-19T06:40:54.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.218+0000 7f9db8c53640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9db410c6a0 0x7f9db41a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:54.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.218+0000 7f9db37fe640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9db4106f20 0x7f9db410c160 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9da4033040 tx=0x7f9da4005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:54.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.219+0000 7f9db17fa640 1 -- 172.21.15.12:0/3018389029 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4040030 con 0x7f9db4106f20 2024-09-19T06:40:54.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.219+0000 7f9db17fa640 1 -- 172.21.15.12:0/3018389029 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9da403cb30 con 0x7f9db4106f20 2024-09-19T06:40:54.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.219+0000 7f9db17fa640 1 -- 172.21.15.12:0/3018389029 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4040030 con 0x7f9db4106f20 2024-09-19T06:40:54.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.220+0000 7f9dba6b6640 1 -- 172.21.15.12:0/3018389029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db41a0e60 con 0x7f9db4106f20 2024-09-19T06:40:54.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.220+0000 7f9dba6b6640 1 -- 172.21.15.12:0/3018389029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db41a12c0 con 0x7f9db4106f20 2024-09-19T06:40:54.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.224+0000 7f9dbca8f740 1 Processor -- start 2024-09-19T06:40:54.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.224+0000 7f9dbca8f740 1 -- start start 2024-09-19T06:40:54.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d8b40 0x5631806d7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d75d0 0x5631806d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806e2370 0x5631806e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9dbca8f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56318063d2f0 con 0x5631806d75d0 2024-09-19T06:40:54.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9dbca8f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5631805e4cf0 con 0x5631806d8b40 2024-09-19T06:40:54.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9dbca8f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5631806392b0 con 0x5631806e2370 2024-09-19T06:40:54.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9db37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806e2370 0x5631806e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9db37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806e2370 0x5631806e4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:39562/0 (socket says 172.21.15.12:39562) 2024-09-19T06:40:54.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9db37fe640 1 -- 172.21.15.12:0/2438882628 learned_addr learned my addr 172.21.15.12:0/2438882628 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:54.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9db8c53640 1 --2- 172.21.15.12:0/2438882628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d8b40 0x5631806d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9db37fe640 1 -- 172.21.15.12:0/2438882628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d8b40 msgr2=0x5631806d7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:54.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9db37fe640 1 --2- 172.21.15.12:0/2438882628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d8b40 0x5631806d7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9db37fe640 1 -- 172.21.15.12:0/2438882628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d75d0 msgr2=0x5631806d7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:54.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9db37fe640 1 --2- 172.21.15.12:0/2438882628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d75d0 0x5631806d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.225+0000 7f9db37fe640 1 -- 172.21.15.12:0/2438882628 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631805c93a0 con 0x5631806e2370 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.226+0000 7f9db37fe640 1 --2- 172.21.15.12:0/2438882628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806e2370 0x5631806e4760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9da4047030 tx=0x7f9da403cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2991aeaf9080fb2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.226+0000 7f9daa7fc640 1 -- 172.21.15.12:0/2438882628 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4040030 con 0x5631806e2370 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.226+0000 7f9daa7fc640 1 -- 172.21.15.12:0/2438882628 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9da4031d80 con 0x5631806e2370 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.226+0000 7f9daa7fc640 1 -- 172.21.15.12:0/2438882628 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4059d40 con 0x5631806e2370 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.227+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2438882628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806e2370 msgr2=0x5631806e4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.227+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/2438882628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806e2370 0x5631806e4760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9da4047030 tx=0x7f9da403cce0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.227+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2438882628 shutdown_connections 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.227+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/2438882628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806e2370 0x5631806e4760 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9da4047030 tx=0x7f9da403cce0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.227+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/2438882628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d75d0 0x5631806d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.227+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/2438882628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d8b40 0x5631806d7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.227+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2438882628 >> 172.21.15.12:0/2438882628 conn(0x5631806a0310 msgr2=0x5631806d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:54.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.229+0000 7f9db17fa640 1 -- 172.21.15.12:0/3018389029 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f9da4043030 con 0x7f9db4106f20 2024-09-19T06:40:54.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.229+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2438882628 shutdown_connections 2024-09-19T06:40:54.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.229+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2438882628 wait complete. 2024-09-19T06:40:54.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.230+0000 7f9dbca8f740 1 -- start start 2024-09-19T06:40:54.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.230+0000 7f9dbca8f740 1 Processor -- start 2024-09-19T06:40:54.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9db17fa640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9da00a37a0 0x7f9da00a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9db17fa640 1 -- 172.21.15.12:0/3018389029 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9da40f2d50 con 0x7f9db4106f20 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d75d0 0x5631806df190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806d8b40 0x5631806df6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806dfc10 0x5631806ee260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9dbca8f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5631806e4e30 con 0x5631806d75d0 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9dbca8f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5631805f8060 con 0x5631806dfc10 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9dbca8f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5631806e4fb0 con 0x5631806d8b40 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9dbca8f740 10 client.0 _ll_register_callbacks cb 0x56318034b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9db8c53640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9da00a37a0 0x7f9da00a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d75d0 0x5631806df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9db8c53640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806dfc10 0x5631806ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9db8c53640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806dfc10 0x5631806ee260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38514/0 (socket says 172.21.15.12:38514) 2024-09-19T06:40:54.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.231+0000 7f9db8c53640 1 -- 172.21.15.12:0/4070528982 learned_addr learned my addr 172.21.15.12:0/4070528982 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:54.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.232+0000 7f9db3fff640 1 -- 172.21.15.12:0/4070528982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806d8b40 msgr2=0x5631806df6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:54.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.232+0000 7f9db3fff640 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806d8b40 0x5631806df6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.232+0000 7f9db3fff640 1 -- 172.21.15.12:0/4070528982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806dfc10 msgr2=0x5631806ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:54.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.232+0000 7f9db3fff640 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806dfc10 0x5631806ee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.232+0000 7f9db3fff640 1 -- 172.21.15.12:0/4070528982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631803ae3c0 con 0x5631806d75d0 2024-09-19T06:40:54.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.232+0000 7f9db8c53640 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806dfc10 0x5631806ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:54.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.232+0000 7f9db3fff640 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d75d0 0x5631806df190 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00bb10 tx=0x7f9d9c00d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de627c912e39eb29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:54.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.232+0000 7f9d937fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:40:54.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.233+0000 7f9d937fe640 1 -- 172.21.15.12:0/4070528982 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c016070 con 0x5631806d75d0 2024-09-19T06:40:54.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.233+0000 7f9d937fe640 1 -- 172.21.15.12:0/4070528982 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9d9c010460 con 0x5631806d75d0 2024-09-19T06:40:54.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.233+0000 7f9db8c53640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9da00a37a0 0x7f9da00a5c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9dac012f70 tx=0x7f9dac0123f0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:54.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.234+0000 7f9dbca8f740 1 -- 172.21.15.12:0/4070528982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da4031d80 con 0x5631806d75d0 2024-09-19T06:40:54.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.234+0000 7f9d937fe640 1 -- 172.21.15.12:0/4070528982 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d9c020050 con 0x5631806d75d0 2024-09-19T06:40:54.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.234+0000 7f9dbca8f740 10 client.15630 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:54.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.234+0000 7f9dbca8f740 1 -- 172.21.15.12:0/4070528982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5631806f0d80 con 0x5631806d75d0 2024-09-19T06:40:54.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.234+0000 7f9d937fe640 1 -- 172.21.15.12:0/4070528982 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9da4031d80 con 0x5631806d75d0 2024-09-19T06:40:54.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.235+0000 7f9d937fe640 1 -- 172.21.15.12:0/4070528982 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9d9c01b860 con 0x5631806d75d0 2024-09-19T06:40:54.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.235+0000 7f9dbca8f740 10 client.15630 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:54.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.235+0000 7f9dbca8f740 10 client.15630 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:40:54.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.235+0000 7f9dbca8f740 20 client.15630 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:54.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.235+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5631806f2240 0x5631806f4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.235+0000 7f9dbca8f740 4 client.15630 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:54.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.235+0000 7f9dbca8f740 1 -- 172.21.15.12:0/4070528982 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56318064a860 con 0x5631806f2240 2024-09-19T06:40:54.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.235+0000 7f9db37fe640 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5631806f2240 0x5631806f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.236+0000 7f9db37fe640 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5631806f2240 0x5631806f4650 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=18f97afa620c172e server_cookie=992818e24a55819e in_seq=0 out_seq=0 2024-09-19T06:40:54.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.236+0000 7f9d937fe640 10 client.15630 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:40:54.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.236+0000 7f9d937fe640 1 -- 172.21.15.12:0/4070528982 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56318064a860 con 0x5631806f2240 2024-09-19T06:40:54.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.236+0000 7f9d937fe640 10 client.15630 handle_command_reply: tid=0 2024-09-19T06:40:54.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 client.15630 shutdown 2024-09-19T06:40:54.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 -- 172.21.15.12:0/4070528982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d75d0 msgr2=0x5631806df190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:54.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d75d0 0x5631806df190 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00bb10 tx=0x7f9d9c00d2e0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 -- 172.21.15.12:0/4070528982 shutdown_connections 2024-09-19T06:40:54.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5631806f2240 0x5631806f4650 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806dfc10 0x5631806ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806d8b40 0x5631806df6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/4070528982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d75d0 0x5631806df190 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 -- 172.21.15.12:0/4070528982 >> 172.21.15.12:0/4070528982 conn(0x5631806a0310 msgr2=0x5631806d9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:54.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9d937fe640 0 client.15630 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:40:54.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 -- 172.21.15.12:0/4070528982 shutdown_connections 2024-09-19T06:40:54.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 1 -- 172.21.15.12:0/4070528982 wait complete. 2024-09-19T06:40:54.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.237+0000 7f9dbca8f740 20 client.15630 trim_cache size 0 max 16384 2024-09-19T06:40:54.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.264+0000 7f9dbca8f740 1 Processor -- start 2024-09-19T06:40:54.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.264+0000 7f9dbca8f740 1 -- start start 2024-09-19T06:40:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.264+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.264+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d8b40 0x5631806d3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.264+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806dfc10 0x5631806da120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.264+0000 7f9dbca8f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9db41bd010 con 0x5631806d8b40 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.264+0000 7f9dbca8f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9db41beb50 con 0x5631806d75d0 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.264+0000 7f9dbca8f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9db41bd6e0 con 0x5631806dfc10 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.264+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.265+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806d2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38526/0 (socket says 172.21.15.12:38526) 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.265+0000 7f9db3fff640 1 -- 172.21.15.12:0/3562875857 learned_addr learned my addr 172.21.15.12:0/3562875857 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.265+0000 7f9db8c53640 1 --2- 172.21.15.12:0/3562875857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806dfc10 0x5631806da120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.265+0000 7f9db37fe640 1 --2- 172.21.15.12:0/3562875857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d8b40 0x5631806d3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.265+0000 7f9db8c53640 1 -- 172.21.15.12:0/3562875857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 msgr2=0x5631806d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.265+0000 7f9db8c53640 1 --2- 172.21.15.12:0/3562875857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806d2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.265+0000 7f9db8c53640 1 -- 172.21.15.12:0/3562875857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d8b40 msgr2=0x5631806d3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.265+0000 7f9db8c53640 1 --2- 172.21.15.12:0/3562875857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d8b40 0x5631806d3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.265+0000 7f9db8c53640 1 -- 172.21.15.12:0/3562875857 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631806dfa40 con 0x5631806dfc10 2024-09-19T06:40:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.265+0000 7f9db37fe640 1 --2- 172.21.15.12:0/3562875857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d8b40 0x5631806d3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:40:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.266+0000 7f9db8c53640 1 --2- 172.21.15.12:0/3562875857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806dfc10 0x5631806da120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00fbc0 tx=0x7f9dac009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dc0316a72da35a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.266+0000 7f9da9ffb640 1 -- 172.21.15.12:0/3562875857 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00fdd0 con 0x5631806dfc10 2024-09-19T06:40:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.266+0000 7f9da9ffb640 1 -- 172.21.15.12:0/3562875857 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dac01fc40 con 0x5631806dfc10 2024-09-19T06:40:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.266+0000 7f9da9ffb640 1 -- 172.21.15.12:0/3562875857 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0058a0 con 0x5631806dfc10 2024-09-19T06:40:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.267+0000 7f9dbca8f740 1 -- 172.21.15.12:0/3562875857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806dfc10 msgr2=0x5631806da120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.267+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/3562875857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806dfc10 0x5631806da120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00fbc0 tx=0x7f9dac009600 comp rx=0 tx=0).stop 2024-09-19T06:40:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.267+0000 7f9dbca8f740 1 -- 172.21.15.12:0/3562875857 shutdown_connections 2024-09-19T06:40:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.267+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/3562875857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806dfc10 0x5631806da120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.267+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/3562875857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806d8b40 0x5631806d3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.267+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/3562875857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806d2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.267+0000 7f9dbca8f740 1 -- 172.21.15.12:0/3562875857 >> 172.21.15.12:0/3562875857 conn(0x5631806a0310 msgr2=0x5631806d2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.268+0000 7f9dbca8f740 1 -- 172.21.15.12:0/3562875857 shutdown_connections 2024-09-19T06:40:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.268+0000 7f9dbca8f740 1 -- 172.21.15.12:0/3562875857 wait complete. 2024-09-19T06:40:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.268+0000 7f9dbca8f740 1 -- start start 2024-09-19T06:40:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.269+0000 7f9dbca8f740 1 Processor -- start 2024-09-19T06:40:54.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806ea860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806d8b40 0x5631806dbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9dbca8f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806dfc10 0x5631806dc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9db3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806ea860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38532/0 (socket says 172.21.15.12:38532) 2024-09-19T06:40:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9db3fff640 1 -- 172.21.15.12:0/2772220190 learned_addr learned my addr 172.21.15.12:0/2772220190 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9db41be480 con 0x5631806dfc10 2024-09-19T06:40:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9db41bddb0 con 0x5631806d75d0 2024-09-19T06:40:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9db41baff0 con 0x5631806d8b40 2024-09-19T06:40:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9dbca8f740 10 client.0 _ll_register_callbacks cb 0x7f9d9c005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.270+0000 7f9db37fe640 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806d8b40 0x5631806dbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.271+0000 7f9db8c53640 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806dfc10 0x5631806dc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.271+0000 7f9db3fff640 1 -- 172.21.15.12:0/2772220190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806d8b40 msgr2=0x5631806dbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.271+0000 7f9db3fff640 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806d8b40 0x5631806dbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.271+0000 7f9db3fff640 1 -- 172.21.15.12:0/2772220190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806dfc10 msgr2=0x5631806dc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.271+0000 7f9db3fff640 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806dfc10 0x5631806dc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.271+0000 7f9db3fff640 1 -- 172.21.15.12:0/2772220190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631806dc960 con 0x5631806d75d0 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.271+0000 7f9db3fff640 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806ea860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00bb10 tx=0x7f9d9c01b740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d2b4b1795f15c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.271+0000 7f9d937fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.272+0000 7f9d937fe640 1 -- 172.21.15.12:0/2772220190 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c016070 con 0x5631806d75d0 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.272+0000 7f9d937fe640 1 -- 172.21.15.12:0/2772220190 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9d9c005240 con 0x5631806d75d0 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.272+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dac01fc40 con 0x5631806d75d0 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.272+0000 7f9d937fe640 1 -- 172.21.15.12:0/2772220190 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d9c005440 con 0x5631806d75d0 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.272+0000 7f9dbca8f740 10 client.25253 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.272+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56318075ccf0 con 0x5631806d75d0 2024-09-19T06:40:54.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.273+0000 7f9d937fe640 1 -- 172.21.15.12:0/2772220190 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d9c0055e0 con 0x5631806d75d0 2024-09-19T06:40:54.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.273+0000 7f9d937fe640 1 -- 172.21.15.12:0/2772220190 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9d9c02c020 con 0x5631806d75d0 2024-09-19T06:40:54.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.273+0000 7f9dbca8f740 10 client.25253 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:54.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.273+0000 7f9dbca8f740 10 client.25253 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:40:54.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.273+0000 7f9dbca8f740 20 client.25253 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:54.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.273+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56318075d4a0 0x56318075f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:54.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.273+0000 7f9dbca8f740 4 client.25253 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:40:54.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.274+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9dac01fc40 con 0x56318075d4a0 2024-09-19T06:40:54.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.274+0000 7f9db37fe640 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56318075d4a0 0x56318075f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:54.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.275+0000 7f9db37fe640 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56318075d4a0 0x56318075f8c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2665d565b5a34a86 server_cookie=3db7bc86dc9656b in_seq=0 out_seq=0 2024-09-19T06:40:54.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.275+0000 7f9d937fe640 10 client.25253 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:40:54.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.275+0000 7f9d937fe640 1 -- 172.21.15.12:0/2772220190 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9dac01fc40 con 0x56318075d4a0 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.275+0000 7f9d937fe640 10 client.25253 handle_command_reply: tid=0 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.275+0000 7f9dbca8f740 1 client.25253 shutdown 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.276+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 msgr2=0x5631806ea860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.276+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806ea860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00bb10 tx=0x7f9d9c01b740 comp rx=0 tx=0).stop 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.276+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 shutdown_connections 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.276+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56318075d4a0 0x56318075f8c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.276+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5631806dfc10 0x5631806dc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.276+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5631806d8b40 0x5631806dbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.276+0000 7f9dbca8f740 1 --2- 172.21.15.12:0/2772220190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5631806d75d0 0x5631806ea860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.276+0000 7f9d937fe640 0 client.25253 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.276+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 >> 172.21.15.12:0/2772220190 conn(0x5631806a0310 msgr2=0x5631806d2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.277+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 shutdown_connections 2024-09-19T06:40:54.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.277+0000 7f9dbca8f740 1 -- 172.21.15.12:0/2772220190 wait complete. 2024-09-19T06:40:54.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.277+0000 7f9dbca8f740 20 client.25253 trim_cache size 0 max 16384 2024-09-19T06:40:54.280 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:40:54.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.278+0000 7f9dba6b6640 1 -- 172.21.15.12:0/3018389029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9da00a37a0 msgr2=0x7f9da00a5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:54.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.278+0000 7f9dba6b6640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9da00a37a0 0x7f9da00a5c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9dac012f70 tx=0x7f9dac0123f0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.278+0000 7f9dba6b6640 1 -- 172.21.15.12:0/3018389029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9db4106f20 msgr2=0x7f9db410c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:54.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.278+0000 7f9dba6b6640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9db4106f20 0x7f9db410c160 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9da4033040 tx=0x7f9da4005430 comp rx=0 tx=0).stop 2024-09-19T06:40:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.283+0000 7f9dba6b6640 1 -- 172.21.15.12:0/3018389029 shutdown_connections 2024-09-19T06:40:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.283+0000 7f9dba6b6640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9db410c6a0 0x7f9db41a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.283+0000 7f9dba6b6640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9db4106f20 0x7f9db410c160 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.283+0000 7f9dba6b6640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9da00a37a0 0x7f9da00a5c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.283+0000 7f9dba6b6640 1 --2- 172.21.15.12:0/3018389029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db4101df0 0x7f9db410bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:54.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.283+0000 7f9dba6b6640 1 -- 172.21.15.12:0/3018389029 >> 172.21.15.12:0/3018389029 conn(0x7f9db40fd8b0 msgr2=0x7f9db40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:54.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.283+0000 7f9dba6b6640 1 -- 172.21.15.12:0/3018389029 shutdown_connections 2024-09-19T06:40:54.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:54.283+0000 7f9dba6b6640 1 -- 172.21.15.12:0/3018389029 wait complete. 2024-09-19T06:40:55.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:40:55.249 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T06:40:55.250 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:40:55.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:55 smithi012 ceph-mon[30937]: pgmap v26: 97 pgs: 97 active+clean; 860 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 75 MiB/s wr, 457 op/s 2024-09-19T06:40:55.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:55 smithi016 ceph-mon[34911]: pgmap v26: 97 pgs: 97 active+clean; 860 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 75 MiB/s wr, 457 op/s 2024-09-19T06:40:55.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:55 smithi173 ceph-mon[35349]: pgmap v26: 97 pgs: 97 active+clean; 860 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 75 MiB/s wr, 457 op/s 2024-09-19T06:40:55.649 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 10.0 s, 5573.8 tps, lat 17.954 ms stddev 17.750 2024-09-19T06:40:56.240 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.260+0000 7ff3ba075640 1 -- 172.21.15.12:0/3317700008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3b4102570 msgr2=0x7ff3b41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.260+0000 7ff3ba075640 1 --2- 172.21.15.12:0/3317700008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3b4102570 0x7ff3b41029b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009be0 tx=0x7ff3ac02a770 comp rx=0 tx=0).stop 2024-09-19T06:40:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.261+0000 7ff3ba075640 1 -- 172.21.15.12:0/3317700008 shutdown_connections 2024-09-19T06:40:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.261+0000 7ff3ba075640 1 --2- 172.21.15.12:0/3317700008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3b4102ef0 0x7ff3b410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.261+0000 7ff3ba075640 1 --2- 172.21.15.12:0/3317700008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3b4102570 0x7ff3b41029b0 secure :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009be0 tx=0x7ff3ac02a770 comp rx=0 tx=0).stop 2024-09-19T06:40:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.261+0000 7ff3ba075640 1 --2- 172.21.15.12:0/3317700008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b4100e20 0x7ff3b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.261+0000 7ff3ba075640 1 -- 172.21.15.12:0/3317700008 >> 172.21.15.12:0/3317700008 conn(0x7ff3b40fc7d0 msgr2=0x7ff3b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.262+0000 7ff3ba075640 1 -- 172.21.15.12:0/3317700008 shutdown_connections 2024-09-19T06:40:56.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.264+0000 7ff3ba075640 1 -- 172.21.15.12:0/3317700008 wait complete. 2024-09-19T06:40:56.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.265+0000 7ff3ba075640 1 Processor -- start 2024-09-19T06:40:56.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.265+0000 7ff3ba075640 1 -- start start 2024-09-19T06:40:56.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.265+0000 7ff3ba075640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b4100e20 0x7ff3b419e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.265+0000 7ff3ba075640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3b4102ef0 0x7ff3b419e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.265+0000 7ff3ba075640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3b41985f0 0x7ff3b4198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.266+0000 7ff3ba075640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b4112090 con 0x7ff3b41985f0 2024-09-19T06:40:56.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.266+0000 7ff3ba075640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b4111f10 con 0x7ff3b4102ef0 2024-09-19T06:40:56.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.266+0000 7ff3ba075640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b4112210 con 0x7ff3b4100e20 2024-09-19T06:40:56.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.266+0000 7ff3b2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3b4102ef0 0x7ff3b419e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.266+0000 7ff3b2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3b4102ef0 0x7ff3b419e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38560/0 (socket says 172.21.15.12:38560) 2024-09-19T06:40:56.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.266+0000 7ff3b2ffd640 1 -- 172.21.15.12:0/482085065 learned_addr learned my addr 172.21.15.12:0/482085065 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:56.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.266+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b4100e20 0x7ff3b419e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.267+0000 7ff3b37fe640 1 -- 172.21.15.12:0/482085065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3b4102ef0 msgr2=0x7ff3b419e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.267+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3b4102ef0 0x7ff3b419e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.267+0000 7ff3b37fe640 1 -- 172.21.15.12:0/482085065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3b41985f0 msgr2=0x7ff3b4198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.267+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3b41985f0 0x7ff3b4198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.267+0000 7ff3b37fe640 1 -- 172.21.15.12:0/482085065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b4199110 con 0x7ff3b4100e20 2024-09-19T06:40:56.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.267+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b4100e20 0x7ff3b419e430 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009bf0 tx=0x7ff3a400b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.268+0000 7ff3b0ff9640 1 -- 172.21.15.12:0/482085065 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a401e070 con 0x7ff3b4100e20 2024-09-19T06:40:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.268+0000 7ff3b0ff9640 1 -- 172.21.15.12:0/482085065 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3a4009ce0 con 0x7ff3b4100e20 2024-09-19T06:40:56.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.268+0000 7ff3b0ff9640 1 -- 172.21.15.12:0/482085065 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4018730 con 0x7ff3b4100e20 2024-09-19T06:40:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.269+0000 7ff3ba075640 1 -- 172.21.15.12:0/482085065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b4199400 con 0x7ff3b4100e20 2024-09-19T06:40:56.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.269+0000 7ff3ba075640 1 -- 172.21.15.12:0/482085065 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b410e3f0 con 0x7ff3b4100e20 2024-09-19T06:40:56.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.273+0000 7ff3bc44e740 1 Processor -- start 2024-09-19T06:40:56.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.273+0000 7ff3bc44e740 1 -- start start 2024-09-19T06:40:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.273+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c02f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.273+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 0x555f5c02fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.273+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 0x555f5c044f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.273+0000 7ff3bc44e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555f5bf952f0 con 0x555f5c030b40 2024-09-19T06:40:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.273+0000 7ff3bc44e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555f5bf3ccf0 con 0x555f5c02f5d0 2024-09-19T06:40:56.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.273+0000 7ff3bc44e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555f5bf912b0 con 0x555f5c042b80 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.274+0000 7ff3b3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c02f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.274+0000 7ff3b3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c02f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38476/0 (socket says 172.21.15.12:38476) 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.274+0000 7ff3b3fff640 1 -- 172.21.15.12:0/3208618503 learned_addr learned my addr 172.21.15.12:0/3208618503 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.274+0000 7ff3b2ffd640 1 --2- 172.21.15.12:0/3208618503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 0x555f5c044f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.274+0000 7ff3b2ffd640 1 -- 172.21.15.12:0/3208618503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 msgr2=0x555f5c02fa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.274+0000 7ff3b2ffd640 1 --2- 172.21.15.12:0/3208618503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 0x555f5c02fa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.274+0000 7ff3b2ffd640 1 -- 172.21.15.12:0/3208618503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 msgr2=0x555f5c02f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.274+0000 7ff3b2ffd640 1 --2- 172.21.15.12:0/3208618503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c02f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.274+0000 7ff3b2ffd640 1 -- 172.21.15.12:0/3208618503 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f5bf213a0 con 0x555f5c042b80 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.274+0000 7ff3b2ffd640 1 --2- 172.21.15.12:0/3208618503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 0x555f5c044f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac004af0 tx=0x7ff3ac0305c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ac00415fd9adaa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:56.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.276+0000 7ff3b0ff9640 1 -- 172.21.15.12:0/482085065 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7ff3a40188d0 con 0x7ff3b4100e20 2024-09-19T06:40:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.277+0000 7ff399ffb640 1 -- 172.21.15.12:0/3208618503 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac041030 con 0x555f5c042b80 2024-09-19T06:40:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.278+0000 7ff3b0ff9640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff39c0a3640 0x7ff39c0a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.278+0000 7ff399ffb640 1 -- 172.21.15.12:0/3208618503 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3ac0307b0 con 0x555f5c042b80 2024-09-19T06:40:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.279+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3208618503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 msgr2=0x555f5c044f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.279+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3208618503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 0x555f5c044f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac004af0 tx=0x7ff3ac0305c0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.279+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3208618503 shutdown_connections 2024-09-19T06:40:56.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.279+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3208618503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 0x555f5c044f70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.279+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3208618503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 0x555f5c02fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.279+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3208618503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c02f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.279+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3208618503 >> 172.21.15.12:0/3208618503 conn(0x555f5bff8310 msgr2=0x555f5c02bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:56.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.280+0000 7ff3b0ff9640 1 -- 172.21.15.12:0/482085065 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ff3a40cf160 con 0x7ff3b4100e20 2024-09-19T06:40:56.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.281+0000 7ff3b3fff640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff39c0a3640 0x7ff39c0a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.281+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3208618503 shutdown_connections 2024-09-19T06:40:56.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.281+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3208618503 wait complete. 2024-09-19T06:40:56.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.281+0000 7ff3b3fff640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff39c0a3640 0x7ff39c0a5b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8006bd0 tx=0x7ff3a80090e0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:56.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.281+0000 7ff3bc44e740 1 -- start start 2024-09-19T06:40:56.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.282+0000 7ff3bc44e740 1 Processor -- start 2024-09-19T06:40:56.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.282+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c02f5d0 0x555f5c042500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.282+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c030b40 0x555f5c03f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.282+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c042b80 0x555f5c03fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c02f5d0 0x555f5c042500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c02f5d0 0x555f5c042500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38484/0 (socket says 172.21.15.12:38484) 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3bc44e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555f5c045870 con 0x555f5c02f5d0 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3bc44e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555f5bf50060 con 0x555f5c042b80 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3bc44e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555f5c0459f0 con 0x555f5c030b40 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b2ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c030b40 0x555f5c03f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b2ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c030b40 0x555f5c03f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:39626/0 (socket says 172.21.15.12:39626) 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b2ffd640 1 -- 172.21.15.12:0/2779141651 learned_addr learned my addr 172.21.15.12:0/2779141651 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b3fff640 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c042b80 0x555f5c03fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3bc44e740 10 client.0 _ll_register_callbacks cb 0x555f5bca38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b2ffd640 1 -- 172.21.15.12:0/2779141651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c042b80 msgr2=0x555f5c03fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b2ffd640 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c042b80 0x555f5c03fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b2ffd640 1 -- 172.21.15.12:0/2779141651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c02f5d0 msgr2=0x555f5c042500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b2ffd640 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c02f5d0 0x555f5c042500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.283+0000 7ff3b2ffd640 1 -- 172.21.15.12:0/2779141651 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f5bd063c0 con 0x555f5c030b40 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.284+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c02f5d0 0x555f5c042500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.284+0000 7ff3b2ffd640 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c030b40 0x555f5c03f7b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0304c0 tx=0x7ff3ac000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f8661298091068b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.284+0000 7ff392ffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.284+0000 7ff392ffd640 1 -- 172.21.15.12:0/2779141651 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac06c020 con 0x555f5c030b40 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.285+0000 7ff3bc44e740 1 -- 172.21.15.12:0/2779141651 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3ac0307b0 con 0x555f5c030b40 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.285+0000 7ff392ffd640 1 -- 172.21.15.12:0/2779141651 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ff3ac030a20 con 0x555f5c030b40 2024-09-19T06:40:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.285+0000 7ff392ffd640 1 -- 172.21.15.12:0/2779141651 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff3ac077050 con 0x555f5c030b40 2024-09-19T06:40:56.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.285+0000 7ff3bc44e740 10 client.25282 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:56.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.285+0000 7ff3bc44e740 1 -- 172.21.15.12:0/2779141651 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555f5c045870 con 0x555f5c030b40 2024-09-19T06:40:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.286+0000 7ff392ffd640 1 -- 172.21.15.12:0/2779141651 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3ac0307b0 con 0x555f5c030b40 2024-09-19T06:40:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.286+0000 7ff392ffd640 1 -- 172.21.15.12:0/2779141651 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff3ac03d750 con 0x555f5c030b40 2024-09-19T06:40:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.286+0000 7ff3bc44e740 10 client.25282 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.286+0000 7ff3bc44e740 10 client.25282 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:40:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.286+0000 7ff3bc44e740 20 client.25282 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.286+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555f5c052890 0x555f5c054cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.286+0000 7ff3bc44e740 4 client.25282 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.286+0000 7ff3bc44e740 1 -- 172.21.15.12:0/2779141651 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f5bfa2860 con 0x555f5c052890 2024-09-19T06:40:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.287+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555f5c052890 0x555f5c054cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.287+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555f5c052890 0x555f5c054cd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e9feaaf1751ac077 server_cookie=6ca43e66736a34d0 in_seq=0 out_seq=0 2024-09-19T06:40:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.288+0000 7ff392ffd640 10 client.25282 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:40:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.288+0000 7ff392ffd640 1 -- 172.21.15.12:0/2779141651 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f5bfa2860 con 0x555f5c052890 2024-09-19T06:40:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.288+0000 7ff392ffd640 10 client.25282 handle_command_reply: tid=0 2024-09-19T06:40:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.288+0000 7ff3bc44e740 1 client.25282 shutdown 2024-09-19T06:40:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.289+0000 7ff3bc44e740 1 -- 172.21.15.12:0/2779141651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c030b40 msgr2=0x555f5c03f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.289+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c030b40 0x555f5c03f7b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0304c0 tx=0x7ff3ac000f40 comp rx=0 tx=0).stop 2024-09-19T06:40:56.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.291+0000 7ff3bc44e740 1 -- 172.21.15.12:0/2779141651 shutdown_connections 2024-09-19T06:40:56.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.291+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555f5c052890 0x555f5c054cd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.291+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c042b80 0x555f5c03fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.291+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c030b40 0x555f5c03f7b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.291+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/2779141651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c02f5d0 0x555f5c042500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.291+0000 7ff3bc44e740 1 -- 172.21.15.12:0/2779141651 >> 172.21.15.12:0/2779141651 conn(0x555f5bff8310 msgr2=0x555f5c031960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:56.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.291+0000 7ff392ffd640 0 client.25282 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:40:56.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.291+0000 7ff3bc44e740 1 -- 172.21.15.12:0/2779141651 shutdown_connections 2024-09-19T06:40:56.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.291+0000 7ff3bc44e740 1 -- 172.21.15.12:0/2779141651 wait complete. 2024-09-19T06:40:56.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.292+0000 7ff3bc44e740 20 client.25282 trim_cache size 0 max 16384 2024-09-19T06:40:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.327+0000 7ff3bc44e740 1 Processor -- start 2024-09-19T06:40:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.327+0000 7ff3bc44e740 1 -- start start 2024-09-19T06:40:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.327+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 0x555f5c04eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c05a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 0x555f5c05aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3bc44e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b4072900 con 0x555f5c030b40 2024-09-19T06:40:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3bc44e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b41a5350 con 0x555f5c02f5d0 2024-09-19T06:40:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3bc44e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b4072fd0 con 0x555f5c042b80 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 0x555f5c04eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 0x555f5c04eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38572/0 (socket says 172.21.15.12:38572) 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3b37fe640 1 -- 172.21.15.12:0/3119633534 learned_addr learned my addr 172.21.15.12:0/3119633534 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3b3fff640 1 --2- 172.21.15.12:0/3119633534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 0x555f5c05aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3b2ffd640 1 --2- 172.21.15.12:0/3119633534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c05a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3b37fe640 1 -- 172.21.15.12:0/3119633534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 msgr2=0x555f5c05aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/3119633534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 0x555f5c05aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3b37fe640 1 -- 172.21.15.12:0/3119633534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 msgr2=0x555f5c05a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/3119633534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c05a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.328+0000 7ff3b37fe640 1 -- 172.21.15.12:0/3119633534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f5c02c960 con 0x555f5c02f5d0 2024-09-19T06:40:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.329+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/3119633534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 0x555f5c04eb60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4005fd0 tx=0x7ff3a40cf040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a67d1ece26f10983 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.329+0000 7ff3997fa640 1 -- 172.21.15.12:0/3119633534 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a409f5a0 con 0x555f5c02f5d0 2024-09-19T06:40:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.329+0000 7ff3997fa640 1 -- 172.21.15.12:0/3119633534 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3a40a3e60 con 0x555f5c02f5d0 2024-09-19T06:40:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.329+0000 7ff3997fa640 1 -- 172.21.15.12:0/3119633534 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a40a3c30 con 0x555f5c02f5d0 2024-09-19T06:40:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.330+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3119633534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 msgr2=0x555f5c04eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.330+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3119633534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 0x555f5c04eb60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4005fd0 tx=0x7ff3a40cf040 comp rx=0 tx=0).stop 2024-09-19T06:40:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.331+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3119633534 shutdown_connections 2024-09-19T06:40:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.331+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3119633534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c042b80 0x555f5c05aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.331+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3119633534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c05a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.331+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3119633534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c02f5d0 0x555f5c04eb60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.331+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3119633534 >> 172.21.15.12:0/3119633534 conn(0x555f5bff8310 msgr2=0x555f5c041830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.331+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3119633534 shutdown_connections 2024-09-19T06:40:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.331+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3119633534 wait complete. 2024-09-19T06:40:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.332+0000 7ff3bc44e740 1 -- start start 2024-09-19T06:40:56.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.332+0000 7ff3bc44e740 1 Processor -- start 2024-09-19T06:40:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.333+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c02f5d0 0x555f5c04b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.333+0000 7ff3bc44e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c0468f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.333+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c02f5d0 0x555f5c04b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.333+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c02f5d0 0x555f5c04b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:39648/0 (socket says 172.21.15.12:39648) 2024-09-19T06:40:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.333+0000 7ff3b37fe640 1 -- 172.21.15.12:0/3556305770 learned_addr learned my addr 172.21.15.12:0/3556305770 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.333+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c042b80 0x555f5c047030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.334+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b4073d70 con 0x555f5c030b40 2024-09-19T06:40:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.334+0000 7ff3b3fff640 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c042b80 0x555f5c047030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.334+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b40736a0 con 0x555f5c042b80 2024-09-19T06:40:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.334+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b40708e0 con 0x555f5c02f5d0 2024-09-19T06:40:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.334+0000 7ff3bc44e740 10 client.0 _ll_register_callbacks cb 0x7ff3a8006f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.334+0000 7ff3b37fe640 1 -- 172.21.15.12:0/3556305770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c042b80 msgr2=0x555f5c047030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.334+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c042b80 0x555f5c047030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.334+0000 7ff3b37fe640 1 -- 172.21.15.12:0/3556305770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 msgr2=0x555f5c0468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.334+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c0468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.334+0000 7ff3b37fe640 1 -- 172.21.15.12:0/3556305770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f5c0bc570 con 0x555f5c02f5d0 2024-09-19T06:40:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.335+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3a40a3e60 con 0x555f5c02f5d0 2024-09-19T06:40:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.335+0000 7ff3b37fe640 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c02f5d0 0x555f5c04b5c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40cf010 tx=0x7ff3a40cc6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=335f313b8fb665b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.335+0000 7ff392ffd640 10 client.25288 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:40:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.335+0000 7ff392ffd640 1 -- 172.21.15.12:0/3556305770 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a40ae070 con 0x555f5c02f5d0 2024-09-19T06:40:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.335+0000 7ff392ffd640 1 -- 172.21.15.12:0/3556305770 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ff3a40a39d0 con 0x555f5c02f5d0 2024-09-19T06:40:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.335+0000 7ff392ffd640 1 -- 172.21.15.12:0/3556305770 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff3a40a3bd0 con 0x555f5c02f5d0 2024-09-19T06:40:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.336+0000 7ff3bc44e740 10 client.25288 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.336+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555f5c0bd5a0 con 0x555f5c02f5d0 2024-09-19T06:40:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.336+0000 7ff392ffd640 1 -- 172.21.15.12:0/3556305770 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff3a40cc9c0 con 0x555f5c02f5d0 2024-09-19T06:40:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.336+0000 7ff3bc44e740 10 client.25288 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.336+0000 7ff3bc44e740 10 client.25288 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:40:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.336+0000 7ff3bc44e740 20 client.25288 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.336+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555f5c0bd840 0x555f5c0bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.337+0000 7ff3bc44e740 4 client.25288 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:40:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.337+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555f5bf9cd70 con 0x555f5c0bd840 2024-09-19T06:40:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.337+0000 7ff3b2ffd640 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555f5c0bd840 0x555f5c0bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.337+0000 7ff3b2ffd640 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555f5c0bd840 0x555f5c0bfc60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c7210af6782cab80 server_cookie=4d875642aa62d2 in_seq=0 out_seq=0 2024-09-19T06:40:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.337+0000 7ff392ffd640 10 client.25288 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:40:56.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.338+0000 7ff392ffd640 1 -- 172.21.15.12:0/3556305770 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555f5bf9cd70 con 0x555f5c0bd840 2024-09-19T06:40:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.338+0000 7ff392ffd640 10 client.25288 handle_command_reply: tid=0 2024-09-19T06:40:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.338+0000 7ff3bc44e740 1 client.25288 shutdown 2024-09-19T06:40:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.338+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c02f5d0 msgr2=0x555f5c04b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.338+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c02f5d0 0x555f5c04b5c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40cf010 tx=0x7ff3a40cc6f0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.338+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 shutdown_connections 2024-09-19T06:40:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.338+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555f5c0bd840 0x555f5c0bfc60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.338+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f5c042b80 0x555f5c047030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.338+0000 7ff392ffd640 0 client.25288 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:40:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.339+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f5c030b40 0x555f5c0468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.339+0000 7ff3bc44e740 1 --2- 172.21.15.12:0/3556305770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f5c02f5d0 0x555f5c04b5c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.339+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 >> 172.21.15.12:0/3556305770 conn(0x555f5bff8310 msgr2=0x555f5c03f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.339+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 shutdown_connections 2024-09-19T06:40:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.339+0000 7ff3bc44e740 1 -- 172.21.15.12:0/3556305770 wait complete. 2024-09-19T06:40:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.339+0000 7ff3bc44e740 20 client.25288 trim_cache size 0 max 16384 2024-09-19T06:40:56.344 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:40:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 -- 172.21.15.12:0/482085065 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff39c0a3640 msgr2=0x7ff39c0a5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff39c0a3640 0x7ff39c0a5b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8006bd0 tx=0x7ff3a80090e0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 -- 172.21.15.12:0/482085065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b4100e20 msgr2=0x7ff3b419e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b4100e20 0x7ff3b419e430 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009bf0 tx=0x7ff3a400b690 comp rx=0 tx=0).stop 2024-09-19T06:40:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 -- 172.21.15.12:0/482085065 shutdown_connections 2024-09-19T06:40:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3b41985f0 0x7ff3b4198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3b4102ef0 0x7ff3b419e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff39c0a3640 0x7ff39c0a5b00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 --2- 172.21.15.12:0/482085065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3b4100e20 0x7ff3b419e430 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 -- 172.21.15.12:0/482085065 >> 172.21.15.12:0/482085065 conn(0x7ff3b40fc7d0 msgr2=0x7ff3b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 -- 172.21.15.12:0/482085065 shutdown_connections 2024-09-19T06:40:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:56.341+0000 7ff3ba075640 1 -- 172.21.15.12:0/482085065 wait complete. 2024-09-19T06:40:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.042+0000 7f8124b4b640 1 -- 172.21.15.12:0/2858748927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8120074590 msgr2=0x7f8120074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.042+0000 7f8124b4b640 1 --2- 172.21.15.12:0/2858748927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8120074590 0x7f8120074970 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8114009900 tx=0x7f811402a480 comp rx=0 tx=0).stop 2024-09-19T06:40:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.042+0000 7f8124b4b640 1 -- 172.21.15.12:0/2858748927 shutdown_connections 2024-09-19T06:40:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.042+0000 7f8124b4b640 1 --2- 172.21.15.12:0/2858748927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8120112b90 0x7f8120114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.042+0000 7f8124b4b640 1 --2- 172.21.15.12:0/2858748927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8120074eb0 0x7f8120112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.042+0000 7f8124b4b640 1 --2- 172.21.15.12:0/2858748927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8120074590 0x7f8120074970 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.042+0000 7f8124b4b640 1 -- 172.21.15.12:0/2858748927 >> 172.21.15.12:0/2858748927 conn(0x7f81200fd8e0 msgr2=0x7f81200ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.042+0000 7f8124b4b640 1 -- 172.21.15.12:0/2858748927 shutdown_connections 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.042+0000 7f8124b4b640 1 -- 172.21.15.12:0/2858748927 wait complete. 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f8124b4b640 1 Processor -- start 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f8124b4b640 1 -- start start 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f8124b4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8120074590 0x7f81201a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f8124b4b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8120074eb0 0x7f81201a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f8124b4b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8120112b90 0x7f812019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f8124b4b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8120118570 con 0x7f8120074590 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f8124b4b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81201183f0 con 0x7f8120112b90 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f8124b4b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f81201186f0 con 0x7f8120074eb0 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f811e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8120074590 0x7f81201a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f811e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8120074590 0x7f81201a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38528/0 (socket says 172.21.15.12:38528) 2024-09-19T06:40:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.043+0000 7f811e59c640 1 -- 172.21.15.12:0/2133045379 learned_addr learned my addr 172.21.15.12:0/2133045379 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f811ed9d640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8120112b90 0x7f812019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f811dd9b640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8120074eb0 0x7f81201a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f811e59c640 1 -- 172.21.15.12:0/2133045379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8120074eb0 msgr2=0x7f81201a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f811e59c640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8120074eb0 0x7f81201a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f811e59c640 1 -- 172.21.15.12:0/2133045379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8120112b90 msgr2=0x7f812019e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f811e59c640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8120112b90 0x7f812019e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f811e59c640 1 -- 172.21.15.12:0/2133045379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812019f010 con 0x7f8120074590 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f811e59c640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8120074590 0x7f81201a4720 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8114006010 tx=0x7f8114004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f810f7fe640 1 -- 172.21.15.12:0/2133045379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811403f030 con 0x7f8120074590 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f810f7fe640 1 -- 172.21.15.12:0/2133045379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8114004440 con 0x7f8120074590 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f8124b4b640 1 -- 172.21.15.12:0/2133045379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812019f2a0 con 0x7f8120074590 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f810f7fe640 1 -- 172.21.15.12:0/2133045379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114035070 con 0x7f8120074590 2024-09-19T06:40:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.044+0000 7f8124b4b640 1 -- 172.21.15.12:0/2133045379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81201ab5f0 con 0x7f8120074590 2024-09-19T06:40:57.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.045+0000 7f8124b4b640 1 -- 172.21.15.12:0/2133045379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8120074970 con 0x7f8120074590 2024-09-19T06:40:57.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.046+0000 7f810f7fe640 1 -- 172.21.15.12:0/2133045379 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f8114042030 con 0x7f8120074590 2024-09-19T06:40:57.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.047+0000 7f810f7fe640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81080a34c0 0x7f81080a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.047+0000 7f810f7fe640 1 -- 172.21.15.12:0/2133045379 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f81140f0530 con 0x7f8120074590 2024-09-19T06:40:57.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.047+0000 7f811dd9b640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81080a34c0 0x7f81080a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.048+0000 7f811dd9b640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81080a34c0 0x7f81080a5980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81200fff50 tx=0x7f8110005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.050+0000 7f810f7fe640 1 -- 172.21.15.12:0/2133045379 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81140bc790 con 0x7f8120074590 2024-09-19T06:40:57.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.407+0000 7f8124b4b640 1 -- 172.21.15.12:0/2133045379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f812019fe10 con 0x7f8120074590 2024-09-19T06:40:57.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.408+0000 7f810f7fe640 1 -- 172.21.15.12:0/2133045379 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11971 (secure 0 0 0) 0x7f812019fe10 con 0x7f8120074590 2024-09-19T06:40:57.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:40:57.411 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-19T06:40:07:090225+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:40:07.040062+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:40:57.411 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-19T06:40:57.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 -- 172.21.15.12:0/2133045379 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81080a34c0 msgr2=0x7f81080a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81080a34c0 0x7f81080a5980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81200fff50 tx=0x7f8110005f90 comp rx=0 tx=0).stop 2024-09-19T06:40:57.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 -- 172.21.15.12:0/2133045379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8120074590 msgr2=0x7f81201a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8120074590 0x7f81201a4720 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8114006010 tx=0x7f8114004040 comp rx=0 tx=0).stop 2024-09-19T06:40:57.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 -- 172.21.15.12:0/2133045379 shutdown_connections 2024-09-19T06:40:57.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8120112b90 0x7f812019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f81080a34c0 0x7f81080a5980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8120074eb0 0x7f81201a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 --2- 172.21.15.12:0/2133045379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8120074590 0x7f81201a4720 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 -- 172.21.15.12:0/2133045379 >> 172.21.15.12:0/2133045379 conn(0x7f81200fd8e0 msgr2=0x7f81200ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.410+0000 7f8124b4b640 1 -- 172.21.15.12:0/2133045379 shutdown_connections 2024-09-19T06:40:57.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:57.411+0000 7f8124b4b640 1 -- 172.21.15.12:0/2133045379 wait complete. 2024-09-19T06:40:57.484 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:57 smithi012 ceph-mon[30937]: pgmap v27: 97 pgs: 97 active+clean; 923 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 80 MiB/s wr, 856 op/s 2024-09-19T06:40:57.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:57 smithi016 ceph-mon[34911]: pgmap v27: 97 pgs: 97 active+clean; 923 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 80 MiB/s wr, 856 op/s 2024-09-19T06:40:57.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:57 smithi173 ceph-mon[35349]: pgmap v27: 97 pgs: 97 active+clean; 923 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 80 MiB/s wr, 856 op/s 2024-09-19T06:40:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.656+0000 7ffafad5b640 1 -- 172.21.15.12:0/976965327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf4101ad0 msgr2=0x7ffaf4101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.656+0000 7ffafad5b640 1 --2- 172.21.15.12:0/976965327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf4101ad0 0x7ffaf4101f30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009930 tx=0x7ffae802a440 comp rx=0 tx=0).stop 2024-09-19T06:40:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.657+0000 7ffafad5b640 1 -- 172.21.15.12:0/976965327 shutdown_connections 2024-09-19T06:40:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.657+0000 7ffafad5b640 1 --2- 172.21.15.12:0/976965327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaf4102470 0x7ffaf410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.657+0000 7ffafad5b640 1 --2- 172.21.15.12:0/976965327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf4101ad0 0x7ffaf4101f30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.657+0000 7ffafad5b640 1 --2- 172.21.15.12:0/976965327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaf4107b70 0x7ffaf4107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.657+0000 7ffafad5b640 1 -- 172.21.15.12:0/976965327 >> 172.21.15.12:0/976965327 conn(0x7ffaf40fd7b0 msgr2=0x7ffaf40ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.657+0000 7ffafad5b640 1 -- 172.21.15.12:0/976965327 shutdown_connections 2024-09-19T06:40:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.657+0000 7ffafad5b640 1 -- 172.21.15.12:0/976965327 wait complete. 2024-09-19T06:40:57.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.658+0000 7ffafad5b640 1 Processor -- start 2024-09-19T06:40:57.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffafad5b640 1 -- start start 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffafad5b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaf4101ad0 0x7ffaf41a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffafad5b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaf4102470 0x7ffaf41a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffafad5b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf4107b70 0x7ffaf419e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffafad5b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf410fd10 con 0x7ffaf4107b70 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffafad5b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf410fb90 con 0x7ffaf4101ad0 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffafad5b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf410fe90 con 0x7ffaf4102470 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffaf3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaf4102470 0x7ffaf41a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffaf3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaf4102470 0x7ffaf41a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:39676/0 (socket says 172.21.15.12:39676) 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffaf3fff640 1 -- 172.21.15.12:0/220624933 learned_addr learned my addr 172.21.15.12:0/220624933 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf4107b70 0x7ffaf419e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.659+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaf4101ad0 0x7ffaf41a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.660+0000 7ffaf8af7640 1 -- 172.21.15.12:0/220624933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaf4102470 msgr2=0x7ffaf41a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.660+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaf4102470 0x7ffaf41a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.660+0000 7ffaf8af7640 1 -- 172.21.15.12:0/220624933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf4107b70 msgr2=0x7ffaf419e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.660+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf4107b70 0x7ffaf419e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.660+0000 7ffaf8af7640 1 -- 172.21.15.12:0/220624933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf419ef60 con 0x7ffaf4101ad0 2024-09-19T06:40:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.660+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaf4101ad0 0x7ffaf41a4620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffae400bb20 tx=0x7ffae40091e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.660+0000 7ffaf1ffb640 1 -- 172.21.15.12:0/220624933 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4009af0 con 0x7ffaf4101ad0 2024-09-19T06:40:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.660+0000 7ffaf1ffb640 1 -- 172.21.15.12:0/220624933 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae4009c90 con 0x7ffaf4101ad0 2024-09-19T06:40:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.660+0000 7ffaf1ffb640 1 -- 172.21.15.12:0/220624933 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4015620 con 0x7ffaf4101ad0 2024-09-19T06:40:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.660+0000 7ffafad5b640 1 -- 172.21.15.12:0/220624933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf419f250 con 0x7ffaf4101ad0 2024-09-19T06:40:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.661+0000 7ffafad5b640 1 -- 172.21.15.12:0/220624933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf41ab470 con 0x7ffaf4101ad0 2024-09-19T06:40:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.665+0000 7ffaf1ffb640 1 -- 172.21.15.12:0/220624933 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7ffae4016420 con 0x7ffaf4101ad0 2024-09-19T06:40:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.665+0000 7ffafdbce740 1 Processor -- start 2024-09-19T06:40:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.665+0000 7ffafdbce740 1 -- start start 2024-09-19T06:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.665+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 0x55c5a404eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.665+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a404f410 0x55c5a4059770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.666+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 0x55c5a405c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.666+0000 7ffafdbce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c5a3fb32f0 con 0x55c5a404f410 2024-09-19T06:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.666+0000 7ffafdbce740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c5a3f5b270 con 0x55c5a4059cb0 2024-09-19T06:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.666+0000 7ffafdbce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c5a3faf2b0 con 0x55c5a404eaf0 2024-09-19T06:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.666+0000 7ffaf92f8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 0x55c5a404eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.666+0000 7ffaf92f8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 0x55c5a404eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:39690/0 (socket says 172.21.15.12:39690) 2024-09-19T06:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.666+0000 7ffaf92f8640 1 -- 172.21.15.12:0/2805734377 learned_addr learned my addr 172.21.15.12:0/2805734377 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.666+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/2805734377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a404f410 0x55c5a4059770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.666+0000 7ffaf3fff640 1 --2- 172.21.15.12:0/2805734377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 0x55c5a405c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.667+0000 7ffaf1ffb640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffadc0a3600 0x7ffadc0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.667+0000 7ffaf1ffb640 1 -- 172.21.15.12:0/220624933 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ffae40cfc70 con 0x7ffaf4101ad0 2024-09-19T06:40:57.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.667+0000 7ffaf92f8640 1 -- 172.21.15.12:0/2805734377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 msgr2=0x55c5a405c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.667+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/2805734377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 0x55c5a405c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.667+0000 7ffaf92f8640 1 -- 172.21.15.12:0/2805734377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a404f410 msgr2=0x55c5a4059770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.667+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/2805734377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a404f410 0x55c5a4059770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.667+0000 7ffaf92f8640 1 -- 172.21.15.12:0/2805734377 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a3f5a340 con 0x55c5a404eaf0 2024-09-19T06:40:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.668+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/2805734377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 0x55c5a404eed0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009fd0 tx=0x7ffaec0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7feec02627590a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.668+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffadc0a3600 0x7ffadc0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.668+0000 7ffadaffd640 1 -- 172.21.15.12:0/2805734377 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec01e070 con 0x55c5a404eaf0 2024-09-19T06:40:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.668+0000 7ffadaffd640 1 -- 172.21.15.12:0/2805734377 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaec003db0 con 0x55c5a404eaf0 2024-09-19T06:40:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.669+0000 7ffadaffd640 1 -- 172.21.15.12:0/2805734377 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00fd40 con 0x55c5a404eaf0 2024-09-19T06:40:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.669+0000 7ffafdbce740 1 -- 172.21.15.12:0/2805734377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 msgr2=0x55c5a404eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.669+0000 7ffafdbce740 1 --2- 172.21.15.12:0/2805734377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 0x55c5a404eed0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009fd0 tx=0x7ffaec0118d0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.669+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffadc0a3600 0x7ffadc0a5ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffaec01b000 tx=0x7ffaec019ca0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.670+0000 7ffafdbce740 1 -- 172.21.15.12:0/2805734377 shutdown_connections 2024-09-19T06:40:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.670+0000 7ffafdbce740 1 --2- 172.21.15.12:0/2805734377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 0x55c5a405c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.670+0000 7ffafdbce740 1 --2- 172.21.15.12:0/2805734377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a404f410 0x55c5a4059770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.670+0000 7ffafdbce740 1 --2- 172.21.15.12:0/2805734377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 0x55c5a404eed0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.670+0000 7ffafdbce740 1 -- 172.21.15.12:0/2805734377 >> 172.21.15.12:0/2805734377 conn(0x55c5a404b060 msgr2=0x55c5a404b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.670+0000 7ffafdbce740 1 -- 172.21.15.12:0/2805734377 shutdown_connections 2024-09-19T06:40:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.670+0000 7ffafdbce740 1 -- 172.21.15.12:0/2805734377 wait complete. 2024-09-19T06:40:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.671+0000 7ffafdbce740 1 -- start start 2024-09-19T06:40:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.671+0000 7ffafdbce740 1 Processor -- start 2024-09-19T06:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.671+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 0x55c5a4056b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.672+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404f410 0x55c5a4057060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.672+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a4059cb0 0x55c5a40575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.672+0000 7ffafdbce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c5a405c920 con 0x55c5a4059cb0 2024-09-19T06:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.672+0000 7ffafdbce740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c5a3f3c290 con 0x55c5a404f410 2024-09-19T06:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.672+0000 7ffafdbce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c5a405caa0 con 0x55c5a404eaf0 2024-09-19T06:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.672+0000 7ffafdbce740 10 client.0 _ll_register_callbacks cb 0x55c5a3f6d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.672+0000 7ffaf3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404f410 0x55c5a4057060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.672+0000 7ffaf3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404f410 0x55c5a4057060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38638/0 (socket says 172.21.15.12:38638) 2024-09-19T06:40:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.672+0000 7ffaf3fff640 1 -- 172.21.15.12:0/3993250052 learned_addr learned my addr 172.21.15.12:0/3993250052 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.672+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a4059cb0 0x55c5a40575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.673+0000 7ffaf3fff640 1 -- 172.21.15.12:0/3993250052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 msgr2=0x55c5a4056b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:40:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.673+0000 7ffaf3fff640 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 0x55c5a4056b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.673+0000 7ffaf3fff640 1 -- 172.21.15.12:0/3993250052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a4059cb0 msgr2=0x55c5a40575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.673+0000 7ffaf3fff640 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a4059cb0 0x55c5a40575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.673+0000 7ffaf3fff640 1 -- 172.21.15.12:0/3993250052 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5a3cc6210 con 0x55c5a404f410 2024-09-19T06:40:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.673+0000 7ffaf3fff640 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404f410 0x55c5a4057060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffae8006010 tx=0x7ffae8031850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b37e3ee77cb4c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.673+0000 7ffad3fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:40:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.673+0000 7ffad3fff640 1 -- 172.21.15.12:0/3993250052 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8035040 con 0x55c5a404f410 2024-09-19T06:40:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.673+0000 7ffad3fff640 1 -- 172.21.15.12:0/3993250052 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ffae8004460 con 0x55c5a404f410 2024-09-19T06:40:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.673+0000 7ffafdbce740 1 -- 172.21.15.12:0/3993250052 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaec003db0 con 0x55c5a404f410 2024-09-19T06:40:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.674+0000 7ffad3fff640 1 -- 172.21.15.12:0/3993250052 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffae8031a30 con 0x55c5a404f410 2024-09-19T06:40:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.674+0000 7ffafdbce740 10 client.25283 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.674+0000 7ffafdbce740 1 -- 172.21.15.12:0/3993250052 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c5a3d92620 con 0x55c5a404f410 2024-09-19T06:40:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.675+0000 7ffad3fff640 1 -- 172.21.15.12:0/3993250052 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaec003db0 con 0x55c5a404f410 2024-09-19T06:40:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.675+0000 7ffad3fff640 1 -- 172.21.15.12:0/3993250052 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffae804b070 con 0x55c5a404f410 2024-09-19T06:40:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.675+0000 7ffafdbce740 10 client.25283 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.675+0000 7ffafdbce740 10 client.25283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.675+0000 7ffafdbce740 20 client.25283 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.675+0000 7ffafdbce740 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5a407b090 0x55c5a407d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.675+0000 7ffafdbce740 4 client.25283 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.675+0000 7ffafdbce740 1 -- 172.21.15.12:0/3993250052 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5a3fc0a20 con 0x55c5a407b090 2024-09-19T06:40:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.678+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5a407b090 0x55c5a407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.678+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5a407b090 0x55c5a407d530 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e69e6a23ba4e4b server_cookie=3f041da7d25e4e80 in_seq=0 out_seq=0 2024-09-19T06:40:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.678+0000 7ffad3fff640 10 client.25283 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.679+0000 7ffad3fff640 1 -- 172.21.15.12:0/3993250052 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5a3fc0a20 con 0x55c5a407b090 2024-09-19T06:40:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.679+0000 7ffad3fff640 10 client.25283 handle_command_reply: tid=0 2024-09-19T06:40:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.679+0000 7ffafdbce740 1 client.25283 shutdown 2024-09-19T06:40:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.680+0000 7ffafdbce740 1 -- 172.21.15.12:0/3993250052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404f410 msgr2=0x55c5a4057060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.680+0000 7ffafdbce740 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404f410 0x55c5a4057060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffae8006010 tx=0x7ffae8031850 comp rx=0 tx=0).stop 2024-09-19T06:40:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.681+0000 7ffafdbce740 1 -- 172.21.15.12:0/3993250052 shutdown_connections 2024-09-19T06:40:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.682+0000 7ffafdbce740 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5a407b090 0x55c5a407d530 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.682+0000 7ffafdbce740 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a4059cb0 0x55c5a40575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.682+0000 7ffafdbce740 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404f410 0x55c5a4057060 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.682+0000 7ffafdbce740 1 --2- 172.21.15.12:0/3993250052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404eaf0 0x55c5a4056b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.682+0000 7ffafdbce740 1 -- 172.21.15.12:0/3993250052 >> 172.21.15.12:0/3993250052 conn(0x55c5a404b060 msgr2=0x55c5a404a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.682+0000 7ffad3fff640 0 client.25283 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.682+0000 7ffafdbce740 1 -- 172.21.15.12:0/3993250052 shutdown_connections 2024-09-19T06:40:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.682+0000 7ffafdbce740 1 -- 172.21.15.12:0/3993250052 wait complete. 2024-09-19T06:40:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.682+0000 7ffafdbce740 20 client.25283 trim_cache size 0 max 16384 2024-09-19T06:40:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.710+0000 7ffafdbce740 1 Processor -- start 2024-09-19T06:40:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.710+0000 7ffafdbce740 1 -- start start 2024-09-19T06:40:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.710+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a404eaf0 0x55c5a40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.710+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 0x55c5a4082e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.710+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 0x55c5a4083380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.710+0000 7ffafdbce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf41ab8c0 con 0x55c5a404eaf0 2024-09-19T06:40:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffafdbce740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf41ad400 con 0x55c5a4059cb0 2024-09-19T06:40:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffaf92f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 0x55c5a4083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffaf92f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 0x55c5a4083380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38644/0 (socket says 172.21.15.12:38644) 2024-09-19T06:40:57.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffaf92f8640 1 -- 172.21.15.12:0/1316753780 learned_addr learned my addr 172.21.15.12:0/1316753780 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffafdbce740 1 -- 172.21.15.12:0/1316753780 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf41abf90 con 0x55c5a404f410 2024-09-19T06:40:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/1316753780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a404eaf0 0x55c5a40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffaf92f8640 1 -- 172.21.15.12:0/1316753780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 msgr2=0x55c5a4082e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:40:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/1316753780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 0x55c5a4082e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffaf92f8640 1 -- 172.21.15.12:0/1316753780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a404eaf0 msgr2=0x55c5a40573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/1316753780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a404eaf0 0x55c5a40573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.711+0000 7ffaf92f8640 1 -- 172.21.15.12:0/1316753780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a404ae90 con 0x55c5a4059cb0 2024-09-19T06:40:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.712+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/1316753780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 0x55c5a4083380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009f70 tx=0x7ffaec027000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54964951daf78511 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.712+0000 7ffada7fc640 1 -- 172.21.15.12:0/1316753780 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec037070 con 0x55c5a4059cb0 2024-09-19T06:40:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.712+0000 7ffada7fc640 1 -- 172.21.15.12:0/1316753780 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaec02a040 con 0x55c5a4059cb0 2024-09-19T06:40:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.712+0000 7ffada7fc640 1 -- 172.21.15.12:0/1316753780 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec01e040 con 0x55c5a4059cb0 2024-09-19T06:40:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.713+0000 7ffafdbce740 1 -- 172.21.15.12:0/1316753780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 msgr2=0x55c5a4083380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.713+0000 7ffafdbce740 1 --2- 172.21.15.12:0/1316753780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 0x55c5a4083380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009f70 tx=0x7ffaec027000 comp rx=0 tx=0).stop 2024-09-19T06:40:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.714+0000 7ffafdbce740 1 -- 172.21.15.12:0/1316753780 shutdown_connections 2024-09-19T06:40:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.715+0000 7ffafdbce740 1 --2- 172.21.15.12:0/1316753780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a4059cb0 0x55c5a4083380 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.715+0000 7ffafdbce740 1 --2- 172.21.15.12:0/1316753780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 0x55c5a4082e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.715+0000 7ffafdbce740 1 --2- 172.21.15.12:0/1316753780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a404eaf0 0x55c5a40573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.715+0000 7ffafdbce740 1 -- 172.21.15.12:0/1316753780 >> 172.21.15.12:0/1316753780 conn(0x55c5a404b060 msgr2=0x55c5a4058ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.715+0000 7ffafdbce740 1 -- 172.21.15.12:0/1316753780 shutdown_connections 2024-09-19T06:40:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.715+0000 7ffafdbce740 1 -- 172.21.15.12:0/1316753780 wait complete. 2024-09-19T06:40:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.716+0000 7ffafdbce740 1 -- start start 2024-09-19T06:40:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.716+0000 7ffafdbce740 1 Processor -- start 2024-09-19T06:40:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.717+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404eaf0 0x55c5a4062510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.717+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 0x55c5a40537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.717+0000 7ffafdbce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a4059cb0 0x55c5a4053d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.717+0000 7ffafdbce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf41acd30 con 0x55c5a4059cb0 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.717+0000 7ffaf3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 0x55c5a40537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.717+0000 7ffafdbce740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf41ac660 con 0x55c5a404eaf0 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.717+0000 7ffafdbce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf4101f30 con 0x55c5a404f410 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 0x55c5a40537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:39712/0 (socket says 172.21.15.12:39712) 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf3fff640 1 -- 172.21.15.12:0/1882847862 learned_addr learned my addr 172.21.15.12:0/1882847862 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffafdbce740 10 client.0 _ll_register_callbacks cb 0x7ffae8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404eaf0 0x55c5a4062510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf92f8640 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a4059cb0 0x55c5a4053d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf3fff640 1 -- 172.21.15.12:0/1882847862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404eaf0 msgr2=0x55c5a4062510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf3fff640 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404eaf0 0x55c5a4062510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf3fff640 1 -- 172.21.15.12:0/1882847862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a4059cb0 msgr2=0x55c5a4053d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf3fff640 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a4059cb0 0x55c5a4053d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf3fff640 1 -- 172.21.15.12:0/1882847862 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5a40544a0 con 0x55c5a404f410 2024-09-19T06:40:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404eaf0 0x55c5a4062510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:40:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffaf3fff640 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 0x55c5a40537d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffae804daa0 tx=0x7ffae8004510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd5347b197c642f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.718+0000 7ffad3fff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.719+0000 7ffad3fff640 1 -- 172.21.15.12:0/1882847862 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8052030 con 0x55c5a404f410 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.719+0000 7ffafdbce740 1 -- 172.21.15.12:0/1882847862 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaec02a040 con 0x55c5a404f410 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.719+0000 7ffad3fff640 1 -- 172.21.15.12:0/1882847862 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ffae804d670 con 0x55c5a404f410 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.719+0000 7ffad3fff640 1 -- 172.21.15.12:0/1882847862 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffae805c050 con 0x55c5a404f410 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.719+0000 7ffafdbce740 10 client.25306 fetch_fsmap learned FSMap version 28 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.719+0000 7ffafdbce740 1 -- 172.21.15.12:0/1882847862 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c5a40e5e10 con 0x55c5a404f410 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.719+0000 7ffad3fff640 1 -- 172.21.15.12:0/1882847862 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaec02a040 con 0x55c5a404f410 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.720+0000 7ffad3fff640 1 -- 172.21.15.12:0/1882847862 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffae804b070 con 0x55c5a404f410 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.720+0000 7ffafdbce740 10 client.25306 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:40:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.720+0000 7ffafdbce740 10 client.25306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:40:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.720+0000 7ffafdbce740 20 client.25306 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.720+0000 7ffafdbce740 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5a40e6500 0x55c5a40e8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:57.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.720+0000 7ffafdbce740 4 client.25306 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:40:57.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.720+0000 7ffafdbce740 1 -- 172.21.15.12:0/1882847862 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c5a3fbad70 con 0x55c5a40e6500 2024-09-19T06:40:57.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.720+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5a40e6500 0x55c5a40e8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:57.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.721+0000 7ffaf8af7640 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5a40e6500 0x55c5a40e8920 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31ffe60fe6b36736 server_cookie=b1d73375878cc413 in_seq=0 out_seq=0 2024-09-19T06:40:57.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.721+0000 7ffad3fff640 10 client.25306 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.742+0000 7ffad3fff640 1 -- 172.21.15.12:0/1882847862 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c5a3fbad70 con 0x55c5a40e6500 2024-09-19T06:40:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.742+0000 7ffad3fff640 10 client.25306 handle_command_reply: tid=0 2024-09-19T06:40:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.742+0000 7ffafdbce740 1 client.25306 shutdown 2024-09-19T06:40:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffafdbce740 1 -- 172.21.15.12:0/1882847862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 msgr2=0x55c5a40537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffafdbce740 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 0x55c5a40537d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffae804daa0 tx=0x7ffae8004510 comp rx=0 tx=0).stop 2024-09-19T06:40:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffafdbce740 1 -- 172.21.15.12:0/1882847862 shutdown_connections 2024-09-19T06:40:57.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffafdbce740 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5a40e6500 0x55c5a40e8920 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffafdbce740 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5a4059cb0 0x55c5a4053d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffad3fff640 0 client.25306 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:40:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffafdbce740 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5a404f410 0x55c5a40537d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffafdbce740 1 --2- 172.21.15.12:0/1882847862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5a404eaf0 0x55c5a4062510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffafdbce740 1 -- 172.21.15.12:0/1882847862 >> 172.21.15.12:0/1882847862 conn(0x55c5a404b060 msgr2=0x55c5a40499a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffafdbce740 1 -- 172.21.15.12:0/1882847862 shutdown_connections 2024-09-19T06:40:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.743+0000 7ffafdbce740 1 -- 172.21.15.12:0/1882847862 wait complete. 2024-09-19T06:40:57.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafdbce740 20 client.25306 trim_cache size 0 max 16384 2024-09-19T06:40:57.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:40:57.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:40:57.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:40:57.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:40:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafad5b640 1 -- 172.21.15.12:0/220624933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffadc0a3600 msgr2=0x7ffadc0a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafad5b640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffadc0a3600 0x7ffadc0a5ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffaec01b000 tx=0x7ffaec019ca0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafad5b640 1 -- 172.21.15.12:0/220624933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaf4101ad0 msgr2=0x7ffaf41a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafad5b640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaf4101ad0 0x7ffaf41a4620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffae400bb20 tx=0x7ffae40091e0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafad5b640 1 -- 172.21.15.12:0/220624933 shutdown_connections 2024-09-19T06:40:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafad5b640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf4107b70 0x7ffaf419e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafad5b640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffadc0a3600 0x7ffadc0a5ac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafad5b640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaf4102470 0x7ffaf41a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafad5b640 1 --2- 172.21.15.12:0/220624933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffaf4101ad0 0x7ffaf41a4620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.744+0000 7ffafad5b640 1 -- 172.21.15.12:0/220624933 >> 172.21.15.12:0/220624933 conn(0x7ffaf40fd7b0 msgr2=0x7ffaf40fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.745+0000 7ffafad5b640 1 -- 172.21.15.12:0/220624933 shutdown_connections 2024-09-19T06:40:57.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:40:57.745+0000 7ffafad5b640 1 -- 172.21.15.12:0/220624933 wait complete. 2024-09-19T06:40:58.078 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:40:58.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:58 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2133045379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:58.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:58 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2133045379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:58.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:58 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2133045379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:40:58.970 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T06:40:58.971 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T06:40:58.976 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:40:59.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:40:59 smithi012 ceph-mon[30937]: pgmap v28: 97 pgs: 97 active+clean; 923 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 819 op/s 2024-09-19T06:40:59.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:40:59 smithi016 ceph-mon[34911]: pgmap v28: 97 pgs: 97 active+clean; 923 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 819 op/s 2024-09-19T06:40:59.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:40:59 smithi173 ceph-mon[35349]: pgmap v28: 97 pgs: 97 active+clean; 923 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 819 op/s 2024-09-19T06:40:59.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.612+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/3888434470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd810ea80 msgr2=0x7fbbd81154f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:59.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.612+0000 7fbbdd0b8640 1 --2- 172.21.15.12:0/3888434470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd810ea80 0x7fbbd81154f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0005fd0 tx=0x7fbbd002a300 comp rx=0 tx=0).stop 2024-09-19T06:40:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.614+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/3888434470 shutdown_connections 2024-09-19T06:40:59.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.614+0000 7fbbdd0b8640 1 --2- 172.21.15.12:0/3888434470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd810ea80 0x7fbbd81154f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.614+0000 7fbbdd0b8640 1 --2- 172.21.15.12:0/3888434470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd8109e00 0x7fbbd810e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.614+0000 7fbbdd0b8640 1 --2- 172.21.15.12:0/3888434470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd8109450 0x7fbbd8109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.614+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/3888434470 >> 172.21.15.12:0/3888434470 conn(0x7fbbd806e2d0 msgr2=0x7fbbd806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:59.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.615+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/3888434470 shutdown_connections 2024-09-19T06:40:59.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.615+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/3888434470 wait complete. 2024-09-19T06:40:59.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.616+0000 7fbbdd0b8640 1 Processor -- start 2024-09-19T06:40:59.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.616+0000 7fbbdd0b8640 1 -- start start 2024-09-19T06:40:59.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.616+0000 7fbbdd0b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd8109450 0x7fbbd810a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.616+0000 7fbbdd0b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd8109e00 0x7fbbd810a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.616+0000 7fbbdd0b8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd810ea80 0x7fbbd810ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.616+0000 7fbbdd0b8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd8118520 con 0x7fbbd8109450 2024-09-19T06:40:59.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbdd0b8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd81183a0 con 0x7fbbd8109e00 2024-09-19T06:40:59.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbdd0b8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd81186a0 con 0x7fbbd810ea80 2024-09-19T06:40:59.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbd759e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd810ea80 0x7fbbd810ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbd759e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd810ea80 0x7fbbd810ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:39736/0 (socket says 172.21.15.12:39736) 2024-09-19T06:40:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbd759e640 1 -- 172.21.15.12:0/1012236610 learned_addr learned my addr 172.21.15.12:0/1012236610 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbd6d9d640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd8109450 0x7fbbd810a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbd659c640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd8109e00 0x7fbbd810a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbd759e640 1 -- 172.21.15.12:0/1012236610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd8109e00 msgr2=0x7fbbd810a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbd759e640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd8109e00 0x7fbbd810a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbd759e640 1 -- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd8109450 msgr2=0x7fbbd810a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.617+0000 7fbbd759e640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd8109450 0x7fbbd810a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.618+0000 7fbbd759e640 1 -- 172.21.15.12:0/1012236610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd81b3420 con 0x7fbbd810ea80 2024-09-19T06:40:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.618+0000 7fbbd6d9d640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd8109450 0x7fbbd810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:59.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.618+0000 7fbbd759e640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd810ea80 0x7fbbd810ae60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0007780 tx=0x7fbbd0032730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:59.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.618+0000 7fbbbffff640 1 -- 172.21.15.12:0/1012236610 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0003b70 con 0x7fbbd810ea80 2024-09-19T06:40:59.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.618+0000 7fbbbffff640 1 -- 172.21.15.12:0/1012236610 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbd0003d10 con 0x7fbbd810ea80 2024-09-19T06:40:59.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.618+0000 7fbbbffff640 1 -- 172.21.15.12:0/1012236610 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000a6c0 con 0x7fbbd810ea80 2024-09-19T06:40:59.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.619+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/1012236610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd81b36b0 con 0x7fbbd810ea80 2024-09-19T06:40:59.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.619+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/1012236610 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd81b3b40 con 0x7fbbd810ea80 2024-09-19T06:40:59.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.623+0000 7fbbdf491740 1 Processor -- start 2024-09-19T06:40:59.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.623+0000 7fbbbffff640 1 -- 172.21.15.12:0/1012236610 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fbbd0039070 con 0x7fbbd810ea80 2024-09-19T06:40:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.623+0000 7fbbdf491740 1 -- start start 2024-09-19T06:40:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.624+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52edb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.624+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edb5d0 0x555f52edba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.624+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52ee6370 0x555f52ee8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.624+0000 7fbbdf491740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555f52e412f0 con 0x555f52edb5d0 2024-09-19T06:40:59.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.624+0000 7fbbdf491740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555f52de8cf0 con 0x555f52edcb40 2024-09-19T06:40:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.624+0000 7fbbdf491740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555f52e3d2b0 con 0x555f52ee6370 2024-09-19T06:40:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edb5d0 0x555f52edba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbd659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52edb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edb5d0 0x555f52edba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38632/0 (socket says 172.21.15.12:38632) 2024-09-19T06:40:59.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbd6d9d640 1 -- 172.21.15.12:0/848758297 learned_addr learned my addr 172.21.15.12:0/848758297 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbd659c640 1 --2- 172.21.15.12:0/848758297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52ee6370 0x555f52ee8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbbffff640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbc00a3510 0x7fbbc00a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbd659c640 1 -- 172.21.15.12:0/848758297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52ee6370 msgr2=0x555f52ee8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbd659c640 1 --2- 172.21.15.12:0/848758297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52ee6370 0x555f52ee8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbd659c640 1 -- 172.21.15.12:0/848758297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edb5d0 msgr2=0x555f52edba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:59.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbd659c640 1 --2- 172.21.15.12:0/848758297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edb5d0 0x555f52edba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.625+0000 7fbbd659c640 1 -- 172.21.15.12:0/848758297 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f52dcd3a0 con 0x555f52edcb40 2024-09-19T06:40:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.626+0000 7fbbd759e640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbc00a3510 0x7fbbc00a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.626+0000 7fbbbffff640 1 -- 172.21.15.12:0/1012236610 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbbd00ef4c0 con 0x7fbbd810ea80 2024-09-19T06:40:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.627+0000 7fbbd759e640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbc00a3510 0x7fbbc00a59d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00ecc40 tx=0x7fbbd00b73f0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.627+0000 7fbbd659c640 1 --2- 172.21.15.12:0/848758297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52edb090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009fd0 tx=0x7fbbc8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cead0647483dcba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.627+0000 7fbbbd7fa640 1 -- 172.21.15.12:0/848758297 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80130d0 con 0x555f52edcb40 2024-09-19T06:40:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.627+0000 7fbbbd7fa640 1 -- 172.21.15.12:0/848758297 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc8013270 con 0x555f52edcb40 2024-09-19T06:40:59.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.628+0000 7fbbbd7fa640 1 -- 172.21.15.12:0/848758297 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80117c0 con 0x555f52edcb40 2024-09-19T06:40:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.628+0000 7fbbdf491740 1 -- 172.21.15.12:0/848758297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 msgr2=0x555f52edb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.628+0000 7fbbdf491740 1 --2- 172.21.15.12:0/848758297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52edb090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009fd0 tx=0x7fbbc8005f90 comp rx=0 tx=0).stop 2024-09-19T06:40:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.629+0000 7fbbdf491740 1 -- 172.21.15.12:0/848758297 shutdown_connections 2024-09-19T06:40:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.629+0000 7fbbdf491740 1 --2- 172.21.15.12:0/848758297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52ee6370 0x555f52ee8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.629+0000 7fbbdf491740 1 --2- 172.21.15.12:0/848758297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edb5d0 0x555f52edba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.629+0000 7fbbdf491740 1 --2- 172.21.15.12:0/848758297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52edb090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.629+0000 7fbbdf491740 1 -- 172.21.15.12:0/848758297 >> 172.21.15.12:0/848758297 conn(0x555f52ea4310 msgr2=0x555f52ed7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.629+0000 7fbbdf491740 1 -- 172.21.15.12:0/848758297 shutdown_connections 2024-09-19T06:40:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.629+0000 7fbbdf491740 1 -- 172.21.15.12:0/848758297 wait complete. 2024-09-19T06:40:59.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.629+0000 7fbbdf491740 1 -- start start 2024-09-19T06:40:59.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.629+0000 7fbbdf491740 1 Processor -- start 2024-09-19T06:40:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edb5d0 0x555f52ee5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edcb40 0x555f52ee2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52ee6370 0x555f52ee35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbdf491740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555f52ee90c0 con 0x555f52ee6370 2024-09-19T06:40:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbdf491740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555f52dfc060 con 0x555f52edb5d0 2024-09-19T06:40:59.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbdf491740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555f52ee9240 con 0x555f52edcb40 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbdf491740 10 client.0 _ll_register_callbacks cb 0x555f52b4f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbd659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edb5d0 0x555f52ee5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edcb40 0x555f52ee2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbd659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edb5d0 0x555f52ee5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38688/0 (socket says 172.21.15.12:38688) 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.630+0000 7fbbd659c640 1 -- 172.21.15.12:0/292729662 learned_addr learned my addr 172.21.15.12:0/292729662 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.632+0000 7fbbd659c640 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52ee6370 0x555f52ee35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.633+0000 7fbbd6d9d640 1 -- 172.21.15.12:0/292729662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edb5d0 msgr2=0x555f52ee5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.633+0000 7fbbd6d9d640 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edb5d0 0x555f52ee5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.633+0000 7fbbd6d9d640 1 -- 172.21.15.12:0/292729662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52ee6370 msgr2=0x555f52ee35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.633+0000 7fbbd6d9d640 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52ee6370 0x555f52ee35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.633+0000 7fbbd6d9d640 1 -- 172.21.15.12:0/292729662 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f52bb23c0 con 0x555f52edcb40 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.633+0000 7fbbd6d9d640 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edcb40 0x555f52ee2ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00ac90 tx=0x7fbbcc013600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=811a01dda07b327f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:59.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.633+0000 7fbbbaff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.633+0000 7fbbbaff5640 1 -- 172.21.15.12:0/292729662 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc013e90 con 0x555f52edcb40 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.634+0000 7fbbdf491740 1 -- 172.21.15.12:0/292729662 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbc8013270 con 0x555f52edcb40 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.634+0000 7fbbbaff5640 1 -- 172.21.15.12:0/292729662 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbbcc005020 con 0x555f52edcb40 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.634+0000 7fbbbaff5640 1 -- 172.21.15.12:0/292729662 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbbcc005220 con 0x555f52edcb40 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.634+0000 7fbbdf491740 10 client.25318 fetch_fsmap learned FSMap version 29 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.634+0000 7fbbdf491740 1 -- 172.21.15.12:0/292729662 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555f52f05c70 con 0x555f52edcb40 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.634+0000 7fbbbaff5640 1 -- 172.21.15.12:0/292729662 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc8013270 con 0x555f52edcb40 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.635+0000 7fbbbaff5640 1 -- 172.21.15.12:0/292729662 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fbbcc025070 con 0x555f52edcb40 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.635+0000 7fbbdf491740 10 client.25318 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.635+0000 7fbbdf491740 10 client.25318 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.635+0000 7fbbdf491740 20 client.25318 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.635+0000 7fbbdf491740 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555f52f07540 0x555f52f09960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.635+0000 7fbbdf491740 4 client.25318 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.635+0000 7fbbdf491740 1 -- 172.21.15.12:0/292729662 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f52e4e860 con 0x555f52f07540 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.636+0000 7fbbd659c640 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555f52f07540 0x555f52f09960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.637+0000 7fbbd659c640 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555f52f07540 0x555f52f09960 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7f95fb7f210ebc79 server_cookie=8402da171e6f229a in_seq=0 out_seq=0 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.637+0000 7fbbbaff5640 10 client.25318 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbbaff5640 1 -- 172.21.15.12:0/292729662 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f52e4e860 con 0x555f52f07540 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbbaff5640 10 client.25318 handle_command_reply: tid=0 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbdf491740 1 client.25318 shutdown 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbdf491740 1 -- 172.21.15.12:0/292729662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edcb40 msgr2=0x555f52ee2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbdf491740 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edcb40 0x555f52ee2ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00ac90 tx=0x7fbbcc013600 comp rx=0 tx=0).stop 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbdf491740 1 -- 172.21.15.12:0/292729662 shutdown_connections 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbdf491740 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555f52f07540 0x555f52f09960 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbdf491740 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52ee6370 0x555f52ee35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbdf491740 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edcb40 0x555f52ee2ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbdf491740 1 --2- 172.21.15.12:0/292729662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edb5d0 0x555f52ee5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbdf491740 1 -- 172.21.15.12:0/292729662 >> 172.21.15.12:0/292729662 conn(0x555f52ea4310 msgr2=0x555f52edd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.638+0000 7fbbbaff5640 0 client.25318 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:40:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.639+0000 7fbbdf491740 1 -- 172.21.15.12:0/292729662 shutdown_connections 2024-09-19T06:40:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.639+0000 7fbbdf491740 1 -- 172.21.15.12:0/292729662 wait complete. 2024-09-19T06:40:59.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.639+0000 7fbbdf491740 20 client.25318 trim_cache size 0 max 16384 2024-09-19T06:40:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.666+0000 7fbbdf491740 1 Processor -- start 2024-09-19T06:40:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.666+0000 7fbbdf491740 1 -- start start 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.666+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 0x555f52ee28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.666+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52ee18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.666+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52ee6370 0x555f52ee1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.666+0000 7fbbdf491740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd81b4100 con 0x555f52ee6370 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.666+0000 7fbbdf491740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd81b5c70 con 0x555f52edcb40 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.666+0000 7fbbdf491740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd81b47d0 con 0x555f52edb5d0 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.667+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52ee18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.667+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52ee18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38696/0 (socket says 172.21.15.12:38696) 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.667+0000 7fbbd6d9d640 1 -- 172.21.15.12:0/3899718320 learned_addr learned my addr 172.21.15.12:0/3899718320 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.667+0000 7fbbd659c640 1 --2- 172.21.15.12:0/3899718320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52ee6370 0x555f52ee1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.667+0000 7fbbd659c640 1 --2- 172.21.15.12:0/3899718320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 0x555f52ee28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.667+0000 7fbbd6d9d640 1 -- 172.21.15.12:0/3899718320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 msgr2=0x555f52ee28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.667+0000 7fbbd6d9d640 1 --2- 172.21.15.12:0/3899718320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 0x555f52ee28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.667+0000 7fbbd6d9d640 1 -- 172.21.15.12:0/3899718320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52ee6370 msgr2=0x555f52ee1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.667+0000 7fbbd6d9d640 1 --2- 172.21.15.12:0/3899718320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52ee6370 0x555f52ee1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.667+0000 7fbbd6d9d640 1 -- 172.21.15.12:0/3899718320 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f52ed8960 con 0x555f52edcb40 2024-09-19T06:40:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.668+0000 7fbbd6d9d640 1 --2- 172.21.15.12:0/3899718320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52ee18c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00b680 tx=0x7fbbcc005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575ac134b11bdbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.669+0000 7fbbbcff9640 1 -- 172.21.15.12:0/3899718320 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc02b040 con 0x555f52edcb40 2024-09-19T06:40:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.669+0000 7fbbbcff9640 1 -- 172.21.15.12:0/3899718320 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbcc013e90 con 0x555f52edcb40 2024-09-19T06:40:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.669+0000 7fbbbcff9640 1 -- 172.21.15.12:0/3899718320 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc027ba0 con 0x555f52edcb40 2024-09-19T06:40:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.671+0000 7fbbdf491740 1 -- 172.21.15.12:0/3899718320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 msgr2=0x555f52ee18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.671+0000 7fbbdf491740 1 --2- 172.21.15.12:0/3899718320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52ee18c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00b680 tx=0x7fbbcc005850 comp rx=0 tx=0).stop 2024-09-19T06:40:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.671+0000 7fbbdf491740 1 -- 172.21.15.12:0/3899718320 shutdown_connections 2024-09-19T06:40:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.671+0000 7fbbdf491740 1 --2- 172.21.15.12:0/3899718320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52ee6370 0x555f52ee1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.671+0000 7fbbdf491740 1 --2- 172.21.15.12:0/3899718320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52edcb40 0x555f52ee18c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.671+0000 7fbbdf491740 1 --2- 172.21.15.12:0/3899718320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 0x555f52ee28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.671+0000 7fbbdf491740 1 -- 172.21.15.12:0/3899718320 >> 172.21.15.12:0/3899718320 conn(0x555f52ea4310 msgr2=0x555f52ede310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.671+0000 7fbbdf491740 1 -- 172.21.15.12:0/3899718320 shutdown_connections 2024-09-19T06:40:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.671+0000 7fbbdf491740 1 -- 172.21.15.12:0/3899718320 wait complete. 2024-09-19T06:40:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.672+0000 7fbbdf491740 1 -- start start 2024-09-19T06:40:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.672+0000 7fbbdf491740 1 Processor -- start 2024-09-19T06:40:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.673+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 0x555f52eee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.673+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edcb40 0x555f52eeedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.673+0000 7fbbdf491740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52ee6370 0x555f52ee9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.673+0000 7fbbdf491740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd81b5570 con 0x555f52edcb40 2024-09-19T06:40:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.673+0000 7fbbdf491740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd81b4ea0 con 0x555f52ee6370 2024-09-19T06:40:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.674+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edcb40 0x555f52eeedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.674+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edcb40 0x555f52eeedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38674/0 (socket says 172.21.15.12:38674) 2024-09-19T06:40:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.674+0000 7fbbd6d9d640 1 -- 172.21.15.12:0/2977824797 learned_addr learned my addr 172.21.15.12:0/2977824797 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:40:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.674+0000 7fbbd659c640 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 0x555f52eee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.674+0000 7fbbdf491740 1 -- 172.21.15.12:0/2977824797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd81a95d0 con 0x555f52edb5d0 2024-09-19T06:40:59.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.675+0000 7fbbdf491740 10 client.0 _ll_register_callbacks cb 0x7fbbcc00bcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:40:59.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.675+0000 7fbbd659c640 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52ee6370 0x555f52ee9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.675+0000 7fbbd659c640 1 -- 172.21.15.12:0/2977824797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52ee6370 msgr2=0x555f52ee9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.675+0000 7fbbd659c640 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52ee6370 0x555f52ee9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.675+0000 7fbbd659c640 1 -- 172.21.15.12:0/2977824797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edcb40 msgr2=0x555f52eeedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:40:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.675+0000 7fbbd659c640 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edcb40 0x555f52eeedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.675+0000 7fbbd659c640 1 -- 172.21.15.12:0/2977824797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f52eea490 con 0x555f52edb5d0 2024-09-19T06:40:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.676+0000 7fbbd659c640 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 0x555f52eee880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8016040 tx=0x7fbbc8011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7d170518f0799ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:59.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.676+0000 7fbbbaff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:40:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.676+0000 7fbbbaff5640 1 -- 172.21.15.12:0/2977824797 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8017040 con 0x555f52edb5d0 2024-09-19T06:40:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.676+0000 7fbbbaff5640 1 -- 172.21.15.12:0/2977824797 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbbc802ee80 con 0x555f52edb5d0 2024-09-19T06:40:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.676+0000 7fbbdf491740 1 -- 172.21.15.12:0/2977824797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbcc013e90 con 0x555f52edb5d0 2024-09-19T06:40:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.676+0000 7fbbbaff5640 1 -- 172.21.15.12:0/2977824797 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbbc8005480 con 0x555f52edb5d0 2024-09-19T06:40:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.676+0000 7fbbdf491740 10 client.25324 fetch_fsmap learned FSMap version 29 2024-09-19T06:40:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.677+0000 7fbbdf491740 1 -- 172.21.15.12:0/2977824797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555f52f71e00 con 0x555f52edb5d0 2024-09-19T06:40:59.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.677+0000 7fbbbaff5640 1 -- 172.21.15.12:0/2977824797 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc8005620 con 0x555f52edb5d0 2024-09-19T06:40:59.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.677+0000 7fbbbaff5640 1 -- 172.21.15.12:0/2977824797 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fbbc802e5b0 con 0x555f52edb5d0 2024-09-19T06:40:59.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.677+0000 7fbbdf491740 10 client.25324 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:40:59.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.677+0000 7fbbdf491740 10 client.25324 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:40:59.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.677+0000 7fbbdf491740 20 client.25324 populate_metadata read hostname 'smithi012' 2024-09-19T06:40:59.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.677+0000 7fbbdf491740 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555f52f722e0 0x555f52f746d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:59.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.677+0000 7fbbdf491740 4 client.25324 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:40:59.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.677+0000 7fbbdf491740 1 -- 172.21.15.12:0/2977824797 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbbcc013e90 con 0x555f52f722e0 2024-09-19T06:40:59.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.678+0000 7fbbd6d9d640 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555f52f722e0 0x555f52f746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:59.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.679+0000 7fbbd6d9d640 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555f52f722e0 0x555f52f746d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=241e12b854463988 server_cookie=df1d16fce12f917b in_seq=0 out_seq=0 2024-09-19T06:40:59.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.679+0000 7fbbbaff5640 10 client.25324 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:40:59.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.679+0000 7fbbbaff5640 1 -- 172.21.15.12:0/2977824797 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbbcc013e90 con 0x555f52f722e0 2024-09-19T06:40:59.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.679+0000 7fbbbaff5640 10 client.25324 handle_command_reply: tid=0 2024-09-19T06:40:59.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.679+0000 7fbbdf491740 1 client.25324 shutdown 2024-09-19T06:40:59.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.680+0000 7fbbdf491740 1 -- 172.21.15.12:0/2977824797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 msgr2=0x555f52eee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:59.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.680+0000 7fbbdf491740 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 0x555f52eee880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8016040 tx=0x7fbbc8011440 comp rx=0 tx=0).stop 2024-09-19T06:40:59.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.680+0000 7fbbdf491740 1 -- 172.21.15.12:0/2977824797 shutdown_connections 2024-09-19T06:40:59.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.680+0000 7fbbdf491740 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555f52f722e0 0x555f52f746d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.680+0000 7fbbdf491740 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555f52ee6370 0x555f52ee9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.680+0000 7fbbdf491740 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555f52edcb40 0x555f52eeedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.680+0000 7fbbdf491740 1 --2- 172.21.15.12:0/2977824797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f52edb5d0 0x555f52eee880 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.680+0000 7fbbbaff5640 0 client.25324 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:40:59.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.680+0000 7fbbdf491740 1 -- 172.21.15.12:0/2977824797 >> 172.21.15.12:0/2977824797 conn(0x555f52ea4310 msgr2=0x555f52ee1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:59.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.680+0000 7fbbdf491740 1 -- 172.21.15.12:0/2977824797 shutdown_connections 2024-09-19T06:40:59.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.682+0000 7fbbdf491740 1 -- 172.21.15.12:0/2977824797 wait complete. 2024-09-19T06:40:59.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.682+0000 7fbbdf491740 20 client.25324 trim_cache size 0 max 16384 2024-09-19T06:40:59.688 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:40:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.687+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbc00a3510 msgr2=0x7fbbc00a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.687+0000 7fbbdd0b8640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbc00a3510 0x7fbbc00a59d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00ecc40 tx=0x7fbbd00b73f0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.687+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/1012236610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd810ea80 msgr2=0x7fbbd810ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.687+0000 7fbbdd0b8640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd810ea80 0x7fbbd810ae60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0007780 tx=0x7fbbd0032730 comp rx=0 tx=0).stop 2024-09-19T06:40:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.687+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/1012236610 shutdown_connections 2024-09-19T06:40:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.687+0000 7fbbdd0b8640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbc00a3510 0x7fbbc00a59d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.687+0000 7fbbdd0b8640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd810ea80 0x7fbbd810ae60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.687+0000 7fbbdd0b8640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd8109e00 0x7fbbd810a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.687+0000 7fbbdd0b8640 1 --2- 172.21.15.12:0/1012236610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd8109450 0x7fbbd810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.687+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/1012236610 >> 172.21.15.12:0/1012236610 conn(0x7fbbd806e2d0 msgr2=0x7fbbd8111420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.690+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/1012236610 shutdown_connections 2024-09-19T06:40:59.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:40:59.690+0000 7fbbdd0b8640 1 -- 172.21.15.12:0/1012236610 wait complete. 2024-09-19T06:40:59.721 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:00 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:41:00.379 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:41:00 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:41:00.277+0000 7f4c7a234640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:41:00.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:41:00 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:41:00.277+0000 7f4c7a234640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:41:00.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:41:00 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:41:00.277+0000 7f4c7a234640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:41:00.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:41:00 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:41:00.277+0000 7f4c7a234640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:41:00.380 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:41:00 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:41:00.277+0000 7f4c7a234640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:41:00.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:00 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:41:00.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:41:00.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:00 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:41:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 15.0 s, 4583.4 tps, lat 21.443 ms stddev 29.376 2024-09-19T06:41:01.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.030+0000 7f8b7e04a640 1 -- 172.21.15.12:0/4177517399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b78106f20 msgr2=0x7f8b7810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.030+0000 7f8b7e04a640 1 --2- 172.21.15.12:0/4177517399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b78106f20 0x7f8b7810eaa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009ca0 tx=0x7f8b7002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.030+0000 7f8b7e04a640 1 -- 172.21.15.12:0/4177517399 shutdown_connections 2024-09-19T06:41:01.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.030+0000 7f8b7e04a640 1 --2- 172.21.15.12:0/4177517399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b78106f20 0x7f8b7810eaa0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.030+0000 7f8b7e04a640 1 --2- 172.21.15.12:0/4177517399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b781027a0 0x7f8b781067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.030+0000 7f8b7e04a640 1 --2- 172.21.15.12:0/4177517399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b78101df0 0x7f8b781021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.030+0000 7f8b7e04a640 1 -- 172.21.15.12:0/4177517399 >> 172.21.15.12:0/4177517399 conn(0x7f8b780fd8f0 msgr2=0x7f8b780ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:01.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.030+0000 7f8b7e04a640 1 -- 172.21.15.12:0/4177517399 shutdown_connections 2024-09-19T06:41:01.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.030+0000 7f8b7e04a640 1 -- 172.21.15.12:0/4177517399 wait complete. 2024-09-19T06:41:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.031+0000 7f8b7e04a640 1 Processor -- start 2024-09-19T06:41:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.031+0000 7f8b7e04a640 1 -- start start 2024-09-19T06:41:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.031+0000 7f8b7e04a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b78101df0 0x7f8b781961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b7e04a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b781027a0 0x7f8b78196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b7e04a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b78106f20 0x7f8b7819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b7e04a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7810fd70 con 0x7f8b78101df0 2024-09-19T06:41:01.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b7e04a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7810fbf0 con 0x7f8b781027a0 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b7e04a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7810fef0 con 0x7f8b78106f20 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b76ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b781027a0 0x7f8b78196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b78106f20 0x7f8b7819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b76ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b781027a0 0x7f8b78196730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37558/0 (socket says 172.21.15.12:37558) 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b78106f20 0x7f8b7819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43824/0 (socket says 172.21.15.12:43824) 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b76ffd640 1 -- 172.21.15.12:0/481746930 learned_addr learned my addr 172.21.15.12:0/481746930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b76ffd640 1 -- 172.21.15.12:0/481746930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b78106f20 msgr2=0x7f8b7819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b78106f20 0x7f8b7819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b76ffd640 1 -- 172.21.15.12:0/481746930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b78101df0 msgr2=0x7f8b781961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b78101df0 0x7f8b781961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b76ffd640 1 -- 172.21.15.12:0/481746930 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7819b1a0 con 0x7f8b781027a0 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.032+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b781027a0 0x7f8b78196730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c004650 tx=0x7f8b6c003da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.033+0000 7f8b74ff9640 1 -- 172.21.15.12:0/481746930 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c009b60 con 0x7f8b781027a0 2024-09-19T06:41:01.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.033+0000 7f8b74ff9640 1 -- 172.21.15.12:0/481746930 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b6c009d00 con 0x7f8b781027a0 2024-09-19T06:41:01.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.033+0000 7f8b7e04a640 1 -- 172.21.15.12:0/481746930 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7819b490 con 0x7f8b781027a0 2024-09-19T06:41:01.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.033+0000 7f8b74ff9640 1 -- 172.21.15.12:0/481746930 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c004e60 con 0x7f8b781027a0 2024-09-19T06:41:01.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.033+0000 7f8b7e04a640 1 -- 172.21.15.12:0/481746930 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b781a2d70 con 0x7f8b781027a0 2024-09-19T06:41:01.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.035+0000 7f8b74ff9640 1 -- 172.21.15.12:0/481746930 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f8b6c01f020 con 0x7f8b781027a0 2024-09-19T06:41:01.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.036+0000 7f8b74ff9640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8b600a34c0 0x7f8b600a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.036+0000 7f8b80423740 1 Processor -- start 2024-09-19T06:41:01.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.036+0000 7f8b777fe640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8b600a34c0 0x7f8b600a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.036+0000 7f8b74ff9640 1 -- 172.21.15.12:0/481746930 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8b6c0d38b0 con 0x7f8b781027a0 2024-09-19T06:41:01.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.036+0000 7f8b80423740 1 -- start start 2024-09-19T06:41:01.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b80423740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e21a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b80423740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 0x55b332e34c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b80423740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e35150 0x55b332e37540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b80423740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b332d872a0 con 0x55b332e21f60 2024-09-19T06:41:01.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b80423740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b332d2eb10 con 0x55b332e35150 2024-09-19T06:41:01.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b80423740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b332d83260 con 0x55b332e21640 2024-09-19T06:41:01.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e35150 0x55b332e37540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b76ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 0x55b332e34c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e35150 0x55b332e37540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37564/0 (socket says 172.21.15.12:37564) 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b77fff640 1 -- 172.21.15.12:0/1439871043 learned_addr learned my addr 172.21.15.12:0/1439871043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b777fe640 1 --2- 172.21.15.12:0/1439871043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e21a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b777fe640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8b600a34c0 0x7f8b600a5980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b68005d00 tx=0x7f8b68005c50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b77fff640 1 -- 172.21.15.12:0/1439871043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 msgr2=0x55b332e21a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b77fff640 1 --2- 172.21.15.12:0/1439871043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e21a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b77fff640 1 -- 172.21.15.12:0/1439871043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 msgr2=0x55b332e34c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b77fff640 1 --2- 172.21.15.12:0/1439871043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 0x55b332e34c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b77fff640 1 -- 172.21.15.12:0/1439871043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b332af8b90 con 0x55b332e35150 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b777fe640 1 --2- 172.21.15.12:0/1439871043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e21a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/1439871043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 0x55b332e34c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.037+0000 7f8b77fff640 1 --2- 172.21.15.12:0/1439871043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e35150 0x55b332e37540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009ca0 tx=0x7f8b70005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c13b83e14fb398bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.038+0000 7f8b5dffb640 1 -- 172.21.15.12:0/1439871043 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70031db0 con 0x55b332e35150 2024-09-19T06:41:01.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.038+0000 7f8b5dffb640 1 -- 172.21.15.12:0/1439871043 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b70036040 con 0x55b332e35150 2024-09-19T06:41:01.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.038+0000 7f8b5dffb640 1 -- 172.21.15.12:0/1439871043 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70004280 con 0x55b332e35150 2024-09-19T06:41:01.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.038+0000 7f8b80423740 1 -- 172.21.15.12:0/1439871043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e35150 msgr2=0x55b332e37540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.038+0000 7f8b80423740 1 --2- 172.21.15.12:0/1439871043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e35150 0x55b332e37540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009ca0 tx=0x7f8b70005f10 comp rx=0 tx=0).stop 2024-09-19T06:41:01.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.038+0000 7f8b80423740 1 -- 172.21.15.12:0/1439871043 shutdown_connections 2024-09-19T06:41:01.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.038+0000 7f8b80423740 1 --2- 172.21.15.12:0/1439871043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e35150 0x55b332e37540 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.038+0000 7f8b80423740 1 --2- 172.21.15.12:0/1439871043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 0x55b332e34c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.038+0000 7f8b80423740 1 --2- 172.21.15.12:0/1439871043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e21a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.038+0000 7f8b80423740 1 -- 172.21.15.12:0/1439871043 >> 172.21.15.12:0/1439871043 conn(0x55b332e1dcf0 msgr2=0x55b332e1e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.039+0000 7f8b80423740 1 -- 172.21.15.12:0/1439871043 shutdown_connections 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.039+0000 7f8b80423740 1 -- 172.21.15.12:0/1439871043 wait complete. 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.039+0000 7f8b80423740 1 -- start start 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.039+0000 7f8b80423740 1 Processor -- start 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.039+0000 7f8b80423740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e320b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.039+0000 7f8b80423740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 0x55b332e325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.039+0000 7f8b80423740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e35150 0x55b332e32b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.039+0000 7f8b80423740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b332e37ba0 con 0x55b332e21f60 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.039+0000 7f8b80423740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b332d0f6e0 con 0x55b332e21640 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.039+0000 7f8b80423740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b332e37d20 con 0x55b332e35150 2024-09-19T06:41:01.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b80423740 10 client.0 _ll_register_callbacks cb 0x55b332d33a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b777fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b777fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e320b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37568/0 (socket says 172.21.15.12:37568) 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b777fe640 1 -- 172.21.15.12:0/3837207603 learned_addr learned my addr 172.21.15.12:0/3837207603 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 0x55b332e325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b77fff640 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e35150 0x55b332e32b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b777fe640 1 -- 172.21.15.12:0/3837207603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e35150 msgr2=0x55b332e32b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b777fe640 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e35150 0x55b332e32b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b777fe640 1 -- 172.21.15.12:0/3837207603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 msgr2=0x55b332e325f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b777fe640 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 0x55b332e325f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b777fe640 1 -- 172.21.15.12:0/3837207603 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b332e41120 con 0x55b332e21640 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b777fe640 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e320b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b680106b0 tx=0x7f8b680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b97b8008d03a690d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.040+0000 7f8b56ffd640 1 -- 172.21.15.12:0/3837207603 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68004220 con 0x55b332e21640 2024-09-19T06:41:01.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b80423740 1 -- 172.21.15.12:0/3837207603 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b70036040 con 0x55b332e21640 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b56ffd640 1 -- 172.21.15.12:0/3837207603 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8b680043c0 con 0x55b332e21640 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b56ffd640 1 -- 172.21.15.12:0/3837207603 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8b6801b700 con 0x55b332e21640 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b80423740 10 client.25325 fetch_fsmap learned FSMap version 29 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b80423740 1 -- 172.21.15.12:0/3837207603 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b332e43aa0 con 0x55b332e21640 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b56ffd640 1 -- 172.21.15.12:0/3837207603 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b70036040 con 0x55b332e21640 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b56ffd640 1 -- 172.21.15.12:0/3837207603 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8b6802c070 con 0x55b332e21640 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b80423740 10 client.25325 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b80423740 10 client.25325 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b80423740 20 client.25325 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.041+0000 7f8b80423740 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b332e45400 0x55b332e478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.042+0000 7f8b80423740 4 client.25325 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.042+0000 7f8b80423740 1 -- 172.21.15.12:0/3837207603 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b332d949d0 con 0x55b332e45400 2024-09-19T06:41:01.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.042+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b332e45400 0x55b332e478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.042+0000 7f8b56ffd640 10 client.25325 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:01.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.042+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b332e45400 0x55b332e478c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebe55ad50dcb04ad server_cookie=234a8c57d95dff4a in_seq=0 out_seq=0 2024-09-19T06:41:01.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.043+0000 7f8b56ffd640 1 -- 172.21.15.12:0/3837207603 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b332d949d0 con 0x55b332e45400 2024-09-19T06:41:01.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.043+0000 7f8b56ffd640 10 client.25325 handle_command_reply: tid=0 2024-09-19T06:41:01.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.043+0000 7f8b80423740 1 client.25325 shutdown 2024-09-19T06:41:01.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.043+0000 7f8b80423740 1 -- 172.21.15.12:0/3837207603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 msgr2=0x55b332e320b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.043+0000 7f8b80423740 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e320b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b680106b0 tx=0x7f8b680046c0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.044+0000 7f8b80423740 1 -- 172.21.15.12:0/3837207603 shutdown_connections 2024-09-19T06:41:01.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.044+0000 7f8b80423740 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b332e45400 0x55b332e478c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.044+0000 7f8b80423740 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e35150 0x55b332e32b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.044+0000 7f8b80423740 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e21f60 0x55b332e325f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.044+0000 7f8b56ffd640 0 client.25325 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:01.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.044+0000 7f8b80423740 1 --2- 172.21.15.12:0/3837207603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e320b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.044+0000 7f8b80423740 1 -- 172.21.15.12:0/3837207603 >> 172.21.15.12:0/3837207603 conn(0x55b332e1dcf0 msgr2=0x55b332e23a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:01.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.044+0000 7f8b80423740 1 -- 172.21.15.12:0/3837207603 shutdown_connections 2024-09-19T06:41:01.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.044+0000 7f8b80423740 1 -- 172.21.15.12:0/3837207603 wait complete. 2024-09-19T06:41:01.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.044+0000 7f8b80423740 20 client.25325 trim_cache size 0 max 16384 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.063+0000 7f8b80423740 1 Processor -- start 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.063+0000 7f8b80423740 1 -- start start 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b80423740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e32780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b80423740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21f60 0x55b332e4d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b80423740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 0x55b332e4d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b80423740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8b781ab840 con 0x55b332e35150 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b80423740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b781ad3b0 con 0x55b332e21640 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b80423740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8b781abf10 con 0x55b332e21f60 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b76ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21f60 0x55b332e4d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b76ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21f60 0x55b332e4d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43844/0 (socket says 172.21.15.12:43844) 2024-09-19T06:41:01.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b76ffd640 1 -- 172.21.15.12:0/4138695307 learned_addr learned my addr 172.21.15.12:0/4138695307 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b777fe640 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e32780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b77fff640 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 0x55b332e4d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b76ffd640 1 -- 172.21.15.12:0/4138695307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 msgr2=0x55b332e32780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e32780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b76ffd640 1 -- 172.21.15.12:0/4138695307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 msgr2=0x55b332e4d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 0x55b332e4d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b76ffd640 1 -- 172.21.15.12:0/4138695307 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b332e37d10 con 0x55b332e21f60 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b77fff640 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 0x55b332e4d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.064+0000 7f8b777fe640 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e32780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.065+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21f60 0x55b332e4d1d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c09f930 tx=0x7f8b6c0d3040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d552d9810f434d98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.065+0000 7f8b5d7fa640 1 -- 172.21.15.12:0/4138695307 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0a3d50 con 0x55b332e21f60 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.065+0000 7f8b5d7fa640 1 -- 172.21.15.12:0/4138695307 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b6c0a8610 con 0x55b332e21f60 2024-09-19T06:41:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.065+0000 7f8b5d7fa640 1 -- 172.21.15.12:0/4138695307 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c09edf0 con 0x55b332e21f60 2024-09-19T06:41:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.065+0000 7f8b80423740 1 -- 172.21.15.12:0/4138695307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21f60 msgr2=0x55b332e4d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.065+0000 7f8b80423740 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21f60 0x55b332e4d1d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c09f930 tx=0x7f8b6c0d3040 comp rx=0 tx=0).stop 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.066+0000 7f8b80423740 1 -- 172.21.15.12:0/4138695307 shutdown_connections 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.066+0000 7f8b80423740 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 0x55b332e4d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.066+0000 7f8b80423740 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21f60 0x55b332e4d1d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.066+0000 7f8b80423740 1 --2- 172.21.15.12:0/4138695307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21640 0x55b332e32780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.066+0000 7f8b80423740 1 -- 172.21.15.12:0/4138695307 >> 172.21.15.12:0/4138695307 conn(0x55b332e1dcf0 msgr2=0x55b332e32070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.066+0000 7f8b80423740 1 -- 172.21.15.12:0/4138695307 shutdown_connections 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.066+0000 7f8b80423740 1 -- 172.21.15.12:0/4138695307 wait complete. 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.066+0000 7f8b80423740 1 -- start start 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.066+0000 7f8b80423740 1 Processor -- start 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b80423740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e390c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b80423740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21f60 0x55b332e39600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b80423740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 0x55b332eaf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b80423740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8b781accb0 con 0x55b332e35150 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b80423740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b781ac5e0 con 0x55b332e21f60 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b80423740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8b781a9820 con 0x55b332e21640 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b80423740 10 client.0 _ll_register_callbacks cb 0x7f8b6800eee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b777fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 0x55b332eaf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b777fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e390c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43850/0 (socket says 172.21.15.12:43850) 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b777fe640 1 -- 172.21.15.12:0/2016404861 learned_addr learned my addr 172.21.15.12:0/2016404861 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21f60 0x55b332e39600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b77fff640 1 -- 172.21.15.12:0/2016404861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 msgr2=0x55b332e390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b77fff640 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b77fff640 1 -- 172.21.15.12:0/2016404861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21f60 msgr2=0x55b332e39600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b77fff640 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21f60 0x55b332e39600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b77fff640 1 -- 172.21.15.12:0/2016404861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b332eaf6e0 con 0x55b332e35150 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b76ffd640 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21f60 0x55b332e39600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.067+0000 7f8b777fe640 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.068+0000 7f8b77fff640 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 0x55b332eaf1a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8b70006010 tx=0x7f8b70031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5fda236c56fe88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.068+0000 7f8b56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.068+0000 7f8b56ffd640 1 -- 172.21.15.12:0/2016404861 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700319b0 con 0x55b332e35150 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.068+0000 7f8b56ffd640 1 -- 172.21.15.12:0/2016404861 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8b70003b80 con 0x55b332e35150 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.068+0000 7f8b80423740 1 -- 172.21.15.12:0/2016404861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b6c0a8610 con 0x55b332e35150 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.068+0000 7f8b56ffd640 1 -- 172.21.15.12:0/2016404861 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8b70003da0 con 0x55b332e35150 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.068+0000 7f8b80423740 10 client.15702 fetch_fsmap learned FSMap version 29 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.068+0000 7f8b80423740 1 -- 172.21.15.12:0/2016404861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b332eb0780 con 0x55b332e35150 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.069+0000 7f8b56ffd640 1 -- 172.21.15.12:0/2016404861 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b6c0a8610 con 0x55b332e35150 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.069+0000 7f8b56ffd640 1 -- 172.21.15.12:0/2016404861 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8b70055030 con 0x55b332e35150 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.069+0000 7f8b80423740 10 client.15702 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:41:01.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.069+0000 7f8b80423740 10 client.15702 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:41:01.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.069+0000 7f8b80423740 20 client.15702 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:01.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.069+0000 7f8b80423740 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b332eb0c40 0x55b332eb3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.069+0000 7f8b80423740 4 client.15702 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T06:41:01.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.069+0000 7f8b80423740 1 -- 172.21.15.12:0/2016404861 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x55b332d8ed20 con 0x55b332eb0c40 2024-09-19T06:41:01.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.069+0000 7f8b777fe640 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b332eb0c40 0x55b332eb3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.070+0000 7f8b56ffd640 10 client.15702 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:01.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.070+0000 7f8b777fe640 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b332eb0c40 0x55b332eb3030 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68720efa0ea3f5a5 server_cookie=a7ec581cfb6b08d2 in_seq=0 out_seq=0 2024-09-19T06:41:01.141 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:01.296 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:01 smithi012 ceph-mon[30937]: pgmap v29: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 31 MiB/s wr, 1.20k op/s 2024-09-19T06:41:01.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:01 smithi016 ceph-mon[34911]: pgmap v29: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 31 MiB/s wr, 1.20k op/s 2024-09-19T06:41:01.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:01 smithi173 ceph-mon[35349]: pgmap v29: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 31 MiB/s wr, 1.20k op/s 2024-09-19T06:41:01.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.675+0000 7f8d3692c640 1 -- 172.21.15.12:0/2280226464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d30103700 msgr2=0x7f8d3010bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.675+0000 7f8d3692c640 1 --2- 172.21.15.12:0/2280226464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d30103700 0x7f8d3010bbf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009900 tx=0x7f8d2402a480 comp rx=0 tx=0).stop 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.675+0000 7f8d3692c640 1 -- 172.21.15.12:0/2280226464 shutdown_connections 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.675+0000 7f8d3692c640 1 --2- 172.21.15.12:0/2280226464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d3010c180 0x7f8d3010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.675+0000 7f8d3692c640 1 --2- 172.21.15.12:0/2280226464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d30103700 0x7f8d3010bbf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.675+0000 7f8d3692c640 1 --2- 172.21.15.12:0/2280226464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d30102de0 0x7f8d301031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.675+0000 7f8d3692c640 1 -- 172.21.15.12:0/2280226464 >> 172.21.15.12:0/2280226464 conn(0x7f8d300fc7a0 msgr2=0x7f8d300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.675+0000 7f8d3692c640 1 -- 172.21.15.12:0/2280226464 shutdown_connections 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.675+0000 7f8d3692c640 1 -- 172.21.15.12:0/2280226464 wait complete. 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d3692c640 1 Processor -- start 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d3692c640 1 -- start start 2024-09-19T06:41:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d3692c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d30102de0 0x7f8d3019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d3692c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d30103700 0x7f8d3019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d3692c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d3010c180 0x7f8d3019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d3692c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8d30111f70 con 0x7f8d30103700 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d3692c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8d30111df0 con 0x7f8d30102de0 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d3692c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8d301120f0 con 0x7f8d3010c180 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d30103700 0x7f8d3019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d30103700 0x7f8d3019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59772/0 (socket says 172.21.15.12:59772) 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d2f7fe640 1 -- 172.21.15.12:0/1067622983 learned_addr learned my addr 172.21.15.12:0/1067622983 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d34ec9640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d3010c180 0x7f8d3019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.676+0000 7f8d2ffff640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d30102de0 0x7f8d3019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d2f7fe640 1 -- 172.21.15.12:0/1067622983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d3010c180 msgr2=0x7f8d3019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d3010c180 0x7f8d3019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d2f7fe640 1 -- 172.21.15.12:0/1067622983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d30102de0 msgr2=0x7f8d3019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d30102de0 0x7f8d3019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d2f7fe640 1 -- 172.21.15.12:0/1067622983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3019f600 con 0x7f8d30103700 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d30103700 0x7f8d3019ab90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8d24006010 tx=0x7f8d24004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d2d7fa640 1 -- 172.21.15.12:0/1067622983 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2403f030 con 0x7f8d30103700 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d3692c640 1 -- 172.21.15.12:0/1067622983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3019f890 con 0x7f8d30103700 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d2d7fa640 1 -- 172.21.15.12:0/1067622983 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d24004440 con 0x7f8d30103700 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d2d7fa640 1 -- 172.21.15.12:0/1067622983 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24035070 con 0x7f8d30103700 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.677+0000 7f8d3692c640 1 -- 172.21.15.12:0/1067622983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d301a71d0 con 0x7f8d30103700 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.679+0000 7f8d2d7fa640 1 -- 172.21.15.12:0/1067622983 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f8d24042030 con 0x7f8d30103700 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d38d05740 1 Processor -- start 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d38d05740 1 -- start start 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d2d7fa640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8d180a3440 0x7f8d180a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1ceb40 0x56333f1cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1d8370 0x56333f1da760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d38d05740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56333f1332f0 con 0x56333f1d8370 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d38d05740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56333f0dacf0 con 0x56333f1ceb40 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d38d05740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56333f12f2b0 con 0x56333f1cd5d0 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d2ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1ceb40 0x56333f1cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d34ec9640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8d180a3440 0x7f8d180a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d2d7fa640 1 -- 172.21.15.12:0/1067622983 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8d240efef0 con 0x7f8d30103700 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d2ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1ceb40 0x56333f1cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37620/0 (socket says 172.21.15.12:37620) 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d2ffff640 1 -- 172.21.15.12:0/154964751 learned_addr learned my addr 172.21.15.12:0/154964751 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.680+0000 7f8d34ec9640 1 --2- 172.21.15.12:0/154964751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1d8370 0x56333f1da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d2ffff640 1 -- 172.21.15.12:0/154964751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 msgr2=0x56333f1cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d2ffff640 1 --2- 172.21.15.12:0/154964751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d2ffff640 1 -- 172.21.15.12:0/154964751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1d8370 msgr2=0x56333f1da760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d2ffff640 1 --2- 172.21.15.12:0/154964751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1d8370 0x56333f1da760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d2ffff640 1 -- 172.21.15.12:0/154964751 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56333f0bf3a0 con 0x56333f1ceb40 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/154964751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d2ffff640 1 --2- 172.21.15.12:0/154964751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1ceb40 0x56333f1cd090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009cf0 tx=0x7f8d20011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90ea2a1f37406a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d34ec9640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8d180a3440 0x7f8d180a5900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d28005fd0 tx=0x7f8d28009e90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d167fc640 1 -- 172.21.15.12:0/154964751 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2001e070 con 0x56333f1ceb40 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d167fc640 1 -- 172.21.15.12:0/154964751 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d20019b10 con 0x56333f1ceb40 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.681+0000 7f8d167fc640 1 -- 172.21.15.12:0/154964751 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2000ea00 con 0x56333f1ceb40 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 -- 172.21.15.12:0/154964751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1ceb40 msgr2=0x56333f1cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 --2- 172.21.15.12:0/154964751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1ceb40 0x56333f1cd090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009cf0 tx=0x7f8d20011810 comp rx=0 tx=0).stop 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 -- 172.21.15.12:0/154964751 shutdown_connections 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 --2- 172.21.15.12:0/154964751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1d8370 0x56333f1da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 --2- 172.21.15.12:0/154964751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 --2- 172.21.15.12:0/154964751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1ceb40 0x56333f1cd090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 -- 172.21.15.12:0/154964751 >> 172.21.15.12:0/154964751 conn(0x56333f196310 msgr2=0x56333f1c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 -- 172.21.15.12:0/154964751 shutdown_connections 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 -- 172.21.15.12:0/154964751 wait complete. 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 -- start start 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.682+0000 7f8d38d05740 1 Processor -- start 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1cd5d0 0x56333f1d7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1ceb40 0x56333f1d5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d38d05740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56333f1db070 con 0x56333f1cd5d0 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d38d05740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56333f0ee060 con 0x56333f1d8370 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d38d05740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56333f1db1f0 con 0x56333f1ceb40 2024-09-19T06:41:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d38d05740 10 client.0 _ll_register_callbacks cb 0x56333ee418c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d2ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1cd5d0 0x56333f1d7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d2ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1cd5d0 0x56333f1d7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59794/0 (socket says 172.21.15.12:59794) 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d2ffff640 1 -- 172.21.15.12:0/63895344 learned_addr learned my addr 172.21.15.12:0/63895344 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d34ec9640 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1ceb40 0x56333f1d5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d2ffff640 1 -- 172.21.15.12:0/63895344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1ceb40 msgr2=0x56333f1d5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d2ffff640 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1ceb40 0x56333f1d5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d2ffff640 1 -- 172.21.15.12:0/63895344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 msgr2=0x56333f1d5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d2ffff640 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.683+0000 7f8d2ffff640 1 -- 172.21.15.12:0/63895344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56333eea43c0 con 0x56333f1cd5d0 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d2ffff640 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1cd5d0 0x56333f1d7d60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8d2001c040 tx=0x7f8d200198a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c47d69d6fca8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/63895344 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20026020 con 0x56333f1cd5d0 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d38d05740 1 -- 172.21.15.12:0/63895344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d20019b10 con 0x56333f1cd5d0 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/63895344 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8d20005230 con 0x56333f1cd5d0 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/63895344 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8d2001e040 con 0x56333f1cd5d0 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d38d05740 10 client.15714 fetch_fsmap learned FSMap version 29 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d38d05740 1 -- 172.21.15.12:0/63895344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56333f1e6b10 con 0x56333f1cd5d0 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/63895344 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d20019b10 con 0x56333f1cd5d0 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/63895344 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8d2000ecf0 con 0x56333f1cd5d0 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d38d05740 10 client.15714 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.684+0000 7f8d38d05740 10 client.15714 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.685+0000 7f8d38d05740 20 client.15714 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.685+0000 7f8d38d05740 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56333f1e7f10 0x56333f1ea300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.685+0000 7f8d38d05740 4 client.15714 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.685+0000 7f8d38d05740 1 -- 172.21.15.12:0/63895344 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56333f140860 con 0x56333f1e7f10 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.685+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56333f1e7f10 0x56333f1ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.685+0000 7f8d0f7fe640 10 client.15714 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.685+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56333f1e7f10 0x56333f1ea300 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9119a2748f8cf38e server_cookie=2fef1652b3895fd0 in_seq=0 out_seq=0 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/63895344 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56333f140860 con 0x56333f1e7f10 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d0f7fe640 10 client.15714 handle_command_reply: tid=0 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 client.15714 shutdown 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 -- 172.21.15.12:0/63895344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1cd5d0 msgr2=0x56333f1d7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1cd5d0 0x56333f1d7d60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8d2001c040 tx=0x7f8d200198a0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 -- 172.21.15.12:0/63895344 shutdown_connections 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56333f1e7f10 0x56333f1ea300 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1ceb40 0x56333f1d5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 --2- 172.21.15.12:0/63895344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1cd5d0 0x56333f1d7d60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 -- 172.21.15.12:0/63895344 >> 172.21.15.12:0/63895344 conn(0x56333f196310 msgr2=0x56333f1cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d0f7fe640 0 client.15714 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 -- 172.21.15.12:0/63895344 shutdown_connections 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 1 -- 172.21.15.12:0/63895344 wait complete. 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.686+0000 7f8d38d05740 20 client.15714 trim_cache size 0 max 16384 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d38d05740 1 Processor -- start 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d38d05740 1 -- start start 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1e4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d38d05740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8d301afd80 con 0x56333f1ceb40 2024-09-19T06:41:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d38d05740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8d301b18f0 con 0x56333f1d8370 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d38d05740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8d301b0450 con 0x56333f1cd5d0 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d2ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1e4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59796/0 (socket says 172.21.15.12:59796) 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.699+0000 7f8d2f7fe640 1 -- 172.21.15.12:0/1552773521 learned_addr learned my addr 172.21.15.12:0/1552773521 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.700+0000 7f8d34ec9640 1 --2- 172.21.15.12:0/1552773521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.700+0000 7f8d2f7fe640 1 -- 172.21.15.12:0/1552773521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 msgr2=0x56333f1e4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.700+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/1552773521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1e4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.700+0000 7f8d2f7fe640 1 -- 172.21.15.12:0/1552773521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 msgr2=0x56333f1d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.700+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/1552773521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.700+0000 7f8d2f7fe640 1 -- 172.21.15.12:0/1552773521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56333f1cdbe0 con 0x56333f1ceb40 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.700+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/1552773521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1d0120 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8d240edbc0 tx=0x7f8d2402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef67e7ed5fc5198 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.700+0000 7f8d15ffb640 1 -- 172.21.15.12:0/1552773521 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24049040 con 0x56333f1ceb40 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.700+0000 7f8d15ffb640 1 -- 172.21.15.12:0/1552773521 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d240cbe50 con 0x56333f1ceb40 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.700+0000 7f8d15ffb640 1 -- 172.21.15.12:0/1552773521 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d240ba390 con 0x56333f1ceb40 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 -- 172.21.15.12:0/1552773521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 msgr2=0x56333f1d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 --2- 172.21.15.12:0/1552773521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1d0120 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8d240edbc0 tx=0x7f8d2402a480 comp rx=0 tx=0).stop 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 -- 172.21.15.12:0/1552773521 shutdown_connections 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 --2- 172.21.15.12:0/1552773521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 --2- 172.21.15.12:0/1552773521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1d0120 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 --2- 172.21.15.12:0/1552773521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1e4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 -- 172.21.15.12:0/1552773521 >> 172.21.15.12:0/1552773521 conn(0x56333f196310 msgr2=0x56333f1d38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 -- 172.21.15.12:0/1552773521 shutdown_connections 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 -- 172.21.15.12:0/1552773521 wait complete. 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 -- start start 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.701+0000 7f8d38d05740 1 Processor -- start 2024-09-19T06:41:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1e0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1e09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d38d05740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d38d05740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8d301b11f0 con 0x56333f1ceb40 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d38d05740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8d301b0b20 con 0x56333f1d8370 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d38d05740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8d301add60 con 0x56333f1cd5d0 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d38d05740 10 client.0 _ll_register_callbacks cb 0x7f8d2001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1e0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1e09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1e0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43894/0 (socket says 172.21.15.12:43894) 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1e09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59802/0 (socket says 172.21.15.12:59802) 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2ffff640 1 -- 172.21.15.12:0/1880156017 learned_addr learned my addr 172.21.15.12:0/1880156017 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:01.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d34ec9640 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2ffff640 1 -- 172.21.15.12:0/1880156017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 msgr2=0x56333f1d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2ffff640 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2ffff640 1 -- 172.21.15.12:0/1880156017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 msgr2=0x56333f1e09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2ffff640 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1e09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2ffff640 1 -- 172.21.15.12:0/1880156017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56333f1d1bb0 con 0x56333f1cd5d0 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1e09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d2ffff640 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1e0480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009250 tx=0x7f8d20009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7858dc36c2619097 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.702+0000 7f8d0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/1880156017 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2003a060 con 0x56333f1cd5d0 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d38d05740 1 -- 172.21.15.12:0/1880156017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d240cbe50 con 0x56333f1cd5d0 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/1880156017 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8d20004240 con 0x56333f1cd5d0 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/1880156017 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8d20026070 con 0x56333f1cd5d0 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d38d05740 10 client.25363 fetch_fsmap learned FSMap version 29 2024-09-19T06:41:01.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d38d05740 1 -- 172.21.15.12:0/1880156017 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56333f2521b0 con 0x56333f1cd5d0 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/1880156017 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d240cbe50 con 0x56333f1cd5d0 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/1880156017 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8d2000eb90 con 0x56333f1cd5d0 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d38d05740 10 client.25363 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d38d05740 10 client.25363 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d38d05740 20 client.25363 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d38d05740 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56333f252880 0x56333f254c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d38d05740 4 client.25363 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d38d05740 1 -- 172.21.15.12:0/1880156017 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56333f13ad70 con 0x56333f252880 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.703+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56333f252880 0x56333f254c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d0f7fe640 10 client.25363 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d2f7fe640 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56333f252880 0x56333f254c70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d151ed736e39047 server_cookie=8de428fe44f03082 in_seq=0 out_seq=0 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d0f7fe640 1 -- 172.21.15.12:0/1880156017 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56333f13ad70 con 0x56333f252880 2024-09-19T06:41:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d0f7fe640 10 client.25363 handle_command_reply: tid=0 2024-09-19T06:41:01.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 client.25363 shutdown 2024-09-19T06:41:01.743 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:41:01.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 -- 172.21.15.12:0/1880156017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 msgr2=0x56333f1e0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1e0480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009250 tx=0x7f8d20009c20 comp rx=0 tx=0).stop 2024-09-19T06:41:01.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 -- 172.21.15.12:0/1880156017 shutdown_connections 2024-09-19T06:41:01.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56333f252880 0x56333f254c70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56333f1d8370 0x56333f1d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56333f1ceb40 0x56333f1e09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 --2- 172.21.15.12:0/1880156017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333f1cd5d0 0x56333f1e0480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d0f7fe640 0 client.25363 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 -- 172.21.15.12:0/1880156017 >> 172.21.15.12:0/1880156017 conn(0x56333f196310 msgr2=0x56333f1d6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 -- 172.21.15.12:0/1880156017 shutdown_connections 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 1 -- 172.21.15.12:0/1880156017 wait complete. 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.704+0000 7f8d38d05740 20 client.25363 trim_cache size 0 max 16384 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 -- 172.21.15.12:0/1067622983 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8d180a3440 msgr2=0x7f8d180a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8d180a3440 0x7f8d180a5900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d28005fd0 tx=0x7f8d28009e90 comp rx=0 tx=0).stop 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 -- 172.21.15.12:0/1067622983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d30103700 msgr2=0x7f8d3019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d30103700 0x7f8d3019ab90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8d24006010 tx=0x7f8d24004040 comp rx=0 tx=0).stop 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 -- 172.21.15.12:0/1067622983 shutdown_connections 2024-09-19T06:41:01.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8d180a3440 0x7f8d180a5900 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d3010c180 0x7f8d3019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d30103700 0x7f8d3019ab90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 --2- 172.21.15.12:0/1067622983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d30102de0 0x7f8d3019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 -- 172.21.15.12:0/1067622983 >> 172.21.15.12:0/1067622983 conn(0x7f8d300fc7a0 msgr2=0x7f8d30101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 -- 172.21.15.12:0/1067622983 shutdown_connections 2024-09-19T06:41:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:01.705+0000 7f8d3692c640 1 -- 172.21.15.12:0/1067622983 wait complete. 2024-09-19T06:41:02.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.232+0000 7f8b74ff9640 1 -- 172.21.15.12:0/481746930 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f8b6c0d1170 con 0x7f8b781027a0 2024-09-19T06:41:02.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:41:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b56ffd640 1 -- 172.21.15.12:0/2016404861 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b332d8ed20 con 0x55b332eb0c40 2024-09-19T06:41:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b56ffd640 10 client.15702 handle_command_reply: tid=0 2024-09-19T06:41:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 client.15702 shutdown 2024-09-19T06:41:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 -- 172.21.15.12:0/2016404861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 msgr2=0x55b332eaf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 0x55b332eaf1a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8b70006010 tx=0x7f8b70031680 comp rx=0 tx=0).stop 2024-09-19T06:41:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 -- 172.21.15.12:0/2016404861 shutdown_connections 2024-09-19T06:41:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b332eb0c40 0x55b332eb3030 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b332e35150 0x55b332eaf1a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b332e21f60 0x55b332e39600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:02.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b56ffd640 0 client.15702 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:02.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 --2- 172.21.15.12:0/2016404861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b332e21640 0x55b332e390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:02.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 -- 172.21.15.12:0/2016404861 >> 172.21.15.12:0/2016404861 conn(0x55b332e1dcf0 msgr2=0x55b332e32870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:02.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 -- 172.21.15.12:0/2016404861 shutdown_connections 2024-09-19T06:41:02.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.457+0000 7f8b80423740 1 -- 172.21.15.12:0/2016404861 wait complete. 2024-09-19T06:41:02.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b80423740 20 client.15702 trim_cache size 0 max 16384 2024-09-19T06:41:02.461 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:41:02.461 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 29, 2024-09-19T06:41:02.461 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:41:02.461 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 2, 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "aa879d56": { 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 2, 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 131.2, 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:41:02.462 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:41:02.463 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:41:02.463 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:41:02.463 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:41:02.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:02.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:02.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:02.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:02.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:02.463 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 -- 172.21.15.12:0/481746930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8b600a34c0 msgr2=0x7f8b600a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8b600a34c0 0x7f8b600a5980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b68005d00 tx=0x7f8b68005c50 comp rx=0 tx=0).stop 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 -- 172.21.15.12:0/481746930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b781027a0 msgr2=0x7f8b78196730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b781027a0 0x7f8b78196730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c004650 tx=0x7f8b6c003da0 comp rx=0 tx=0).stop 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 -- 172.21.15.12:0/481746930 shutdown_connections 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8b600a34c0 0x7f8b600a5980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b78106f20 0x7f8b7819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b781027a0 0x7f8b78196730 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 --2- 172.21.15.12:0/481746930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b78101df0 0x7f8b781961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 -- 172.21.15.12:0/481746930 >> 172.21.15.12:0/481746930 conn(0x7f8b780fd8f0 msgr2=0x7f8b780febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 -- 172.21.15.12:0/481746930 shutdown_connections 2024-09-19T06:41:02.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:02.458+0000 7f8b7e04a640 1 -- 172.21.15.12:0/481746930 wait complete. 2024-09-19T06:41:02.797 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.286+0000 7f5aca45e640 1 -- 172.21.15.12:0/83687406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac4101de0 msgr2=0x7f5ac41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.286+0000 7f5aca45e640 1 --2- 172.21.15.12:0/83687406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac4101de0 0x7f5ac41021c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009900 tx=0x7f5ab402a410 comp rx=0 tx=0).stop 2024-09-19T06:41:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.286+0000 7f5aca45e640 1 -- 172.21.15.12:0/83687406 shutdown_connections 2024-09-19T06:41:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.286+0000 7f5aca45e640 1 --2- 172.21.15.12:0/83687406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4106f10 0x7f5ac410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.286+0000 7f5aca45e640 1 --2- 172.21.15.12:0/83687406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ac4102790 0x7f5ac41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.286+0000 7f5aca45e640 1 --2- 172.21.15.12:0/83687406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac4101de0 0x7f5ac41021c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.286+0000 7f5aca45e640 1 -- 172.21.15.12:0/83687406 >> 172.21.15.12:0/83687406 conn(0x7f5ac40fd880 msgr2=0x7f5ac40ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:03.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.286+0000 7f5aca45e640 1 -- 172.21.15.12:0/83687406 shutdown_connections 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.286+0000 7f5aca45e640 1 -- 172.21.15.12:0/83687406 wait complete. 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5aca45e640 1 Processor -- start 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5aca45e640 1 -- start start 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5aca45e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ac4101de0 0x7f5ac419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5aca45e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac4102790 0x7f5ac419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5aca45e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4106f10 0x7f5ac419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5aca45e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac4111fe0 con 0x7f5ac4102790 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5aca45e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac4111e60 con 0x7f5ac4106f10 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5aca45e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac4112160 con 0x7f5ac4101de0 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5abbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac4102790 0x7f5ac419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5abbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac4102790 0x7f5ac419abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59820/0 (socket says 172.21.15.12:59820) 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5abbfff640 1 -- 172.21.15.12:0/3476112966 learned_addr learned my addr 172.21.15.12:0/3476112966 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:03.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4106f10 0x7f5ac419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ac4101de0 0x7f5ac419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.287+0000 7f5abbfff640 1 -- 172.21.15.12:0/3476112966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ac4101de0 msgr2=0x7f5ac419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5abbfff640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ac4101de0 0x7f5ac419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5abbfff640 1 -- 172.21.15.12:0/3476112966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4106f10 msgr2=0x7f5ac419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5abbfff640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4106f10 0x7f5ac419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5abbfff640 1 -- 172.21.15.12:0/3476112966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac419f660 con 0x7f5ac4102790 2024-09-19T06:41:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ac4101de0 0x7f5ac419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5abbfff640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac4102790 0x7f5ac419abf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00b4a0 tx=0x7f5aac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5ac1ffb640 1 -- 172.21.15.12:0/3476112966 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac014070 con 0x7f5ac4102790 2024-09-19T06:41:03.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5aca45e640 1 -- 172.21.15.12:0/3476112966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac419f950 con 0x7f5ac4102790 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5ac1ffb640 1 -- 172.21.15.12:0/3476112966 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aac010af0 con 0x7f5ac4102790 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5ac1ffb640 1 -- 172.21.15.12:0/3476112966 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac017d10 con 0x7f5ac4102790 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.288+0000 7f5aca45e640 1 -- 172.21.15.12:0/3476112966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac41a7230 con 0x7f5ac4102790 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.290+0000 7f5ac1ffb640 1 -- 172.21.15.12:0/3476112966 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f5aac017070 con 0x7f5ac4102790 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5acc837740 1 Processor -- start 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5acc837740 1 -- start start 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5acc837740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 0x55de04c2c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5acc837740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 0x55de04c2ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5acc837740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c39760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5acc837740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55de04b922f0 con 0x55de04c37370 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5acc837740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55de04b39cf0 con 0x55de04c2db40 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5acc837740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de04b8e2b0 con 0x55de04c2c5d0 2024-09-19T06:41:03.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5abbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c39760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5abbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c39760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59836/0 (socket says 172.21.15.12:59836) 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5abbfff640 1 -- 172.21.15.12:0/2366899801 learned_addr learned my addr 172.21.15.12:0/2366899801 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/2366899801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 0x55de04c2c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5ac1ffb640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ab00a34d0 0x7f5ab00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/2366899801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 0x55de04c2ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ab00a34d0 0x7f5ab00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5ac1ffb640 1 -- 172.21.15.12:0/3476112966 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5aac0cf380 con 0x7f5ac4102790 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5abbfff640 1 -- 172.21.15.12:0/2366899801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 msgr2=0x55de04c2ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5abbfff640 1 --2- 172.21.15.12:0/2366899801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 0x55de04c2ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5abbfff640 1 -- 172.21.15.12:0/2366899801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 msgr2=0x55de04c2c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5abbfff640 1 --2- 172.21.15.12:0/2366899801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 0x55de04c2c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5abbfff640 1 -- 172.21.15.12:0/2366899801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de04b1e3a0 con 0x55de04c37370 2024-09-19T06:41:03.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.291+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/2366899801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 0x55de04c2c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.292+0000 7f5abbfff640 1 --2- 172.21.15.12:0/2366899801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c39760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0cca70 tx=0x7f5aac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdf4234176a5ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.292+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ab00a34d0 0x7f5ab00a5990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0098b0 tx=0x7f5abc004ab0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.292+0000 7f5aba7fc640 1 -- 172.21.15.12:0/2366899801 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac01e050 con 0x55de04c37370 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.292+0000 7f5aba7fc640 1 -- 172.21.15.12:0/2366899801 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aac09bba0 con 0x55de04c37370 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.292+0000 7f5aba7fc640 1 -- 172.21.15.12:0/2366899801 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0ccbb0 con 0x55de04c37370 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.292+0000 7f5acc837740 1 -- 172.21.15.12:0/2366899801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 msgr2=0x55de04c39760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 --2- 172.21.15.12:0/2366899801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c39760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0cca70 tx=0x7f5aac0046c0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 -- 172.21.15.12:0/2366899801 shutdown_connections 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 --2- 172.21.15.12:0/2366899801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c39760 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 --2- 172.21.15.12:0/2366899801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 0x55de04c2ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 --2- 172.21.15.12:0/2366899801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 0x55de04c2c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 -- 172.21.15.12:0/2366899801 >> 172.21.15.12:0/2366899801 conn(0x55de04bf5310 msgr2=0x55de04c28c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 -- 172.21.15.12:0/2366899801 shutdown_connections 2024-09-19T06:41:03.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 -- 172.21.15.12:0/2366899801 wait complete. 2024-09-19T06:41:03.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 -- start start 2024-09-19T06:41:03.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 Processor -- start 2024-09-19T06:41:03.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2c5d0 0x55de04c36df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2db40 0x55de04c340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c347e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55de04c3a010 con 0x55de04c37370 2024-09-19T06:41:03.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55de04b4d060 con 0x55de04c2c5d0 2024-09-19T06:41:03.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.293+0000 7f5acc837740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de04c3a190 con 0x55de04c2db40 2024-09-19T06:41:03.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5acc837740 10 client.0 _ll_register_callbacks cb 0x55de048a08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5ac89fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5ac89fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c347e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59846/0 (socket says 172.21.15.12:59846) 2024-09-19T06:41:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5ac89fb640 1 -- 172.21.15.12:0/3159268561 learned_addr learned my addr 172.21.15.12:0/3159268561 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2c5d0 0x55de04c36df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5abbfff640 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2db40 0x55de04c340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5ac89fb640 1 -- 172.21.15.12:0/3159268561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2db40 msgr2=0x55de04c340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2db40 0x55de04c340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5ac89fb640 1 -- 172.21.15.12:0/3159268561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2c5d0 msgr2=0x55de04c36df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:03.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2c5d0 0x55de04c36df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5ac89fb640 1 -- 172.21.15.12:0/3159268561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de049033c0 con 0x55de04c37370 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c347e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0144e0 tx=0x7f5abc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0c710f4d78bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5aa37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3159268561 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc025020 con 0x55de04c37370 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3159268561 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5abc0043b0 con 0x55de04c37370 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.294+0000 7f5acc837740 1 -- 172.21.15.12:0/3159268561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aac09bba0 con 0x55de04c37370 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3159268561 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5abc030050 con 0x55de04c37370 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5acc837740 10 client.15732 fetch_fsmap learned FSMap version 29 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5acc837740 1 -- 172.21.15.12:0/3159268561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55de04c45ba0 con 0x55de04c37370 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3159268561 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aac09bba0 con 0x55de04c37370 2024-09-19T06:41:03.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3159268561 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f5abc020040 con 0x55de04c37370 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5acc837740 10 client.15732 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5acc837740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5acc837740 20 client.15732 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5acc837740 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de04c470b0 0x55de04c49530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5acc837740 4 client.15732 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5acc837740 1 -- 172.21.15.12:0/3159268561 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de04b9f860 con 0x55de04c470b0 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.295+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de04c470b0 0x55de04c49530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.296+0000 7f5aa37fe640 10 client.15732 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.296+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de04c470b0 0x55de04c49530 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bed74f4fd7d5ae12 server_cookie=c10618b4ea6ad828 in_seq=0 out_seq=0 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3159268561 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de04b9f860 con 0x55de04c470b0 2024-09-19T06:41:03.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5aa37fe640 10 client.15732 handle_command_reply: tid=0 2024-09-19T06:41:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 client.15732 shutdown 2024-09-19T06:41:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 -- 172.21.15.12:0/3159268561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 msgr2=0x55de04c347e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c347e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0144e0 tx=0x7f5abc004a40 comp rx=0 tx=0).stop 2024-09-19T06:41:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 -- 172.21.15.12:0/3159268561 shutdown_connections 2024-09-19T06:41:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de04c470b0 0x55de04c49530 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c37370 0x55de04c347e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2db40 0x55de04c340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 --2- 172.21.15.12:0/3159268561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2c5d0 0x55de04c36df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5aa37fe640 0 client.15732 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:03.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 -- 172.21.15.12:0/3159268561 >> 172.21.15.12:0/3159268561 conn(0x55de04bf5310 msgr2=0x55de04c2e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 -- 172.21.15.12:0/3159268561 shutdown_connections 2024-09-19T06:41:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 1 -- 172.21.15.12:0/3159268561 wait complete. 2024-09-19T06:41:03.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.297+0000 7f5acc837740 20 client.15732 trim_cache size 0 max 16384 2024-09-19T06:41:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.310+0000 7f5acc837740 1 Processor -- start 2024-09-19T06:41:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.310+0000 7f5acc837740 1 -- start start 2024-09-19T06:41:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5acc837740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 0x55de04c432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5acc837740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2db40 0x55de04c2f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5acc837740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c37370 0x55de04c2f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5acc837740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac41afcc0 con 0x55de04c2db40 2024-09-19T06:41:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5acc837740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac41b1830 con 0x55de04c37370 2024-09-19T06:41:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5acc837740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac41b0390 con 0x55de04c2c5d0 2024-09-19T06:41:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5abbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2db40 0x55de04c2f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5abbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2db40 0x55de04c2f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59860/0 (socket says 172.21.15.12:59860) 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5abbfff640 1 -- 172.21.15.12:0/1911692979 learned_addr learned my addr 172.21.15.12:0/1911692979 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 0x55de04c432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c37370 0x55de04c2f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5abbfff640 1 -- 172.21.15.12:0/1911692979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 msgr2=0x55de04c432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5abbfff640 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 0x55de04c432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5abbfff640 1 -- 172.21.15.12:0/1911692979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c37370 msgr2=0x55de04c2f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5abbfff640 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c37370 0x55de04c2f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5abbfff640 1 -- 172.21.15.12:0/1911692979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de04c437f0 con 0x55de04c2db40 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 0x55de04c432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c37370 0x55de04c2f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.311+0000 7f5abbfff640 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2db40 0x55de04c2f120 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5aac097e70 tx=0x7f5aac00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8581e9d71238f1a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5ab9ffb640 1 -- 172.21.15.12:0/1911692979 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac09f850 con 0x55de04c2db40 2024-09-19T06:41:03.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5ab9ffb640 1 -- 172.21.15.12:0/1911692979 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aac09bba0 con 0x55de04c2db40 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5ab9ffb640 1 -- 172.21.15.12:0/1911692979 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac09ab50 con 0x55de04c2db40 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5acc837740 1 -- 172.21.15.12:0/1911692979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2db40 msgr2=0x55de04c2f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5acc837740 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2db40 0x55de04c2f120 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5aac097e70 tx=0x7f5aac00bf90 comp rx=0 tx=0).stop 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5acc837740 1 -- 172.21.15.12:0/1911692979 shutdown_connections 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5acc837740 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c37370 0x55de04c2f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5acc837740 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2db40 0x55de04c2f120 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5acc837740 1 --2- 172.21.15.12:0/1911692979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c2c5d0 0x55de04c432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5acc837740 1 -- 172.21.15.12:0/1911692979 >> 172.21.15.12:0/1911692979 conn(0x55de04bf5310 msgr2=0x55de04c27d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.312+0000 7f5acc837740 1 -- 172.21.15.12:0/1911692979 shutdown_connections 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.313+0000 7f5acc837740 1 -- 172.21.15.12:0/1911692979 wait complete. 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.313+0000 7f5acc837740 1 -- start start 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.313+0000 7f5acc837740 1 Processor -- start 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.313+0000 7f5acc837740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2c5d0 0x55de04c3f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.313+0000 7f5acc837740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 0x55de04c30d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.313+0000 7f5acc837740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c37370 0x55de04c31240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.313+0000 7f5acc837740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac41b1130 con 0x55de04c2c5d0 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.313+0000 7f5acc837740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac41b0a60 con 0x55de04c2db40 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.313+0000 7f5acc837740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac41adca0 con 0x55de04c37370 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.313+0000 7f5acc837740 10 client.0 _ll_register_callbacks cb 0x7f5abc014410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5ac3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2c5d0 0x55de04c3f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5ac3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2c5d0 0x55de04c3f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59876/0 (socket says 172.21.15.12:59876) 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5ac3fff640 1 -- 172.21.15.12:0/3743769888 learned_addr learned my addr 172.21.15.12:0/3743769888 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5ac89fb640 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c37370 0x55de04c31240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5abbfff640 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 0x55de04c30d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5ac3fff640 1 -- 172.21.15.12:0/3743769888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c37370 msgr2=0x55de04c31240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:03.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c37370 0x55de04c31240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5ac3fff640 1 -- 172.21.15.12:0/3743769888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 msgr2=0x55de04c30d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 0x55de04c30d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5ac3fff640 1 -- 172.21.15.12:0/3743769888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de04c31930 con 0x55de04c2c5d0 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5ac3fff640 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2c5d0 0x55de04c3f9d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5ab402a9d0 tx=0x7f5ab4005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1ccebe141f9c08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5aa37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3743769888 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4048020 con 0x55de04c2c5d0 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3743769888 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5ab4005450 con 0x55de04c2c5d0 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.314+0000 7f5acc837740 1 -- 172.21.15.12:0/3743769888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aac09bba0 con 0x55de04c2c5d0 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3743769888 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ab4053050 con 0x55de04c2c5d0 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5acc837740 10 client.15738 fetch_fsmap learned FSMap version 29 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5acc837740 1 -- 172.21.15.12:0/3743769888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55de04cb1c80 con 0x55de04c2c5d0 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3743769888 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aac09bba0 con 0x55de04c2c5d0 2024-09-19T06:41:03.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3743769888 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f5ab4031880 con 0x55de04c2c5d0 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5acc837740 10 client.15738 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5acc837740 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5acc837740 20 client.15738 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5acc837740 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de04cb2400 0x55de04cb4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5acc837740 4 client.15738 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5acc837740 1 -- 172.21.15.12:0/3743769888 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55de04b99d70 con 0x55de04cb2400 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.315+0000 7f5abbfff640 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de04cb2400 0x55de04cb4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5abbfff640 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de04cb2400 0x55de04cb4820 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa35633b2539f47d server_cookie=491cdee3e8686b80 in_seq=0 out_seq=0 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5aa37fe640 10 client.15738 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5aa37fe640 1 -- 172.21.15.12:0/3743769888 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55de04b99d70 con 0x55de04cb2400 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5aa37fe640 10 client.15738 handle_command_reply: tid=0 2024-09-19T06:41:03.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 client.15738 shutdown 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 -- 172.21.15.12:0/3743769888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2c5d0 msgr2=0x55de04c3f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2c5d0 0x55de04c3f9d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5ab402a9d0 tx=0x7f5ab4005da0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 -- 172.21.15.12:0/3743769888 shutdown_connections 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de04cb2400 0x55de04cb4820 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de04c37370 0x55de04c31240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de04c2db40 0x55de04c30d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 --2- 172.21.15.12:0/3743769888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de04c2c5d0 0x55de04c3f9d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 -- 172.21.15.12:0/3743769888 >> 172.21.15.12:0/3743769888 conn(0x55de04bf5310 msgr2=0x55de04c32880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5aa37fe640 0 client.15738 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 -- 172.21.15.12:0/3743769888 shutdown_connections 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 1 -- 172.21.15.12:0/3743769888 wait complete. 2024-09-19T06:41:03.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.316+0000 7f5acc837740 20 client.15738 trim_cache size 0 max 16384 2024-09-19T06:41:03.328 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 -- 172.21.15.12:0/3476112966 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ab00a34d0 msgr2=0x7f5ab00a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ab00a34d0 0x7f5ab00a5990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0098b0 tx=0x7f5abc004ab0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 -- 172.21.15.12:0/3476112966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac4102790 msgr2=0x7f5ac419abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac4102790 0x7f5ac419abf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00b4a0 tx=0x7f5aac00b960 comp rx=0 tx=0).stop 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 -- 172.21.15.12:0/3476112966 shutdown_connections 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ac4106f10 0x7f5ac419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ac4102790 0x7f5ac419abf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ab00a34d0 0x7f5ab00a5990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 --2- 172.21.15.12:0/3476112966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ac4101de0 0x7f5ac419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 -- 172.21.15.12:0/3476112966 >> 172.21.15.12:0/3476112966 conn(0x7f5ac40fd880 msgr2=0x7f5ac40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 -- 172.21.15.12:0/3476112966 shutdown_connections 2024-09-19T06:41:03.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:03.317+0000 7f5aca45e640 1 -- 172.21.15.12:0/3476112966 wait complete. 2024-09-19T06:41:03.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:03 smithi016 ceph-mon[34911]: pgmap v30: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 782 op/s 2024-09-19T06:41:03.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:03 smithi016 ceph-mon[34911]: mgrmap e24: x(active, since 54s), standbys: y, z 2024-09-19T06:41:03.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:03 smithi173 ceph-mon[35349]: pgmap v30: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 782 op/s 2024-09-19T06:41:03.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:03 smithi173 ceph-mon[35349]: mgrmap e24: x(active, since 54s), standbys: y, z 2024-09-19T06:41:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:03 smithi012 ceph-mon[30937]: pgmap v30: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 782 op/s 2024-09-19T06:41:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:03 smithi012 ceph-mon[30937]: mgrmap e24: x(active, since 54s), standbys: y, z 2024-09-19T06:41:04.620 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'aa879d56', quiesce took 9.4 seconds. Will release after: 1.799999999999999 2024-09-19T06:41:05.147 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:41:05.148 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:41:05.421 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:05.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:05 smithi016 ceph-mon[34911]: pgmap v31: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 782 op/s 2024-09-19T06:41:05.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:05 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:41:05.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:05 smithi012 ceph-mon[30937]: pgmap v31: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 782 op/s 2024-09-19T06:41:05.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:05 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:41:05.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:05 smithi173 ceph-mon[35349]: pgmap v31: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 782 op/s 2024-09-19T06:41:05.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:05 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:41:05.811 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 20.0 s, 14.4 tps, lat 240.910 ms stddev 149.072 2024-09-19T06:41:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.825+0000 7f8967a22640 1 -- 172.21.15.12:0/492754973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8960102570 msgr2=0x7f89601029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.825+0000 7f8967a22640 1 --2- 172.21.15.12:0/492754973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8960102570 0x7f89601029b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8954009900 tx=0x7f895402a480 comp rx=0 tx=0).stop 2024-09-19T06:41:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.825+0000 7f8967a22640 1 -- 172.21.15.12:0/492754973 shutdown_connections 2024-09-19T06:41:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.825+0000 7f8967a22640 1 --2- 172.21.15.12:0/492754973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8960102ef0 0x7f896010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.825+0000 7f8967a22640 1 --2- 172.21.15.12:0/492754973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8960102570 0x7f89601029b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.825+0000 7f8967a22640 1 --2- 172.21.15.12:0/492754973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8960100e20 0x7f8960101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.825+0000 7f8967a22640 1 -- 172.21.15.12:0/492754973 >> 172.21.15.12:0/492754973 conn(0x7f89600fc7d0 msgr2=0x7f89600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.825+0000 7f8967a22640 1 -- 172.21.15.12:0/492754973 shutdown_connections 2024-09-19T06:41:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.825+0000 7f8967a22640 1 -- 172.21.15.12:0/492754973 wait complete. 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8967a22640 1 Processor -- start 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8967a22640 1 -- start start 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8967a22640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8960100e20 0x7f89601973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8967a22640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8960102570 0x7f8960197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8967a22640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8960102ef0 0x7f896019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8967a22640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8960110f80 con 0x7f8960102ef0 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8967a22640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8960110e00 con 0x7f8960100e20 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8967a22640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8960111100 con 0x7f8960102570 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8965fbf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8960102ef0 0x7f896019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8965fbf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8960102ef0 0x7f896019bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59890/0 (socket says 172.21.15.12:59890) 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.826+0000 7f8965fbf640 1 -- 172.21.15.12:0/666357254 learned_addr learned my addr 172.21.15.12:0/666357254 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:05.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f8964fbd640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8960102570 0x7f8960197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f89657be640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8960100e20 0x7f89601973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f8965fbf640 1 -- 172.21.15.12:0/666357254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8960102570 msgr2=0x7f8960197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f8965fbf640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8960102570 0x7f8960197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f8965fbf640 1 -- 172.21.15.12:0/666357254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8960100e20 msgr2=0x7f89601973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f8965fbf640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8960100e20 0x7f89601973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f8965fbf640 1 -- 172.21.15.12:0/666357254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896019c390 con 0x7f8960102ef0 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f8965fbf640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8960102ef0 0x7f896019bcb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f895800d750 tx=0x7f895800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f89527fc640 1 -- 172.21.15.12:0/666357254 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958017070 con 0x7f8960102ef0 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f89527fc640 1 -- 172.21.15.12:0/666357254 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8958005500 con 0x7f8960102ef0 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f89527fc640 1 -- 172.21.15.12:0/666357254 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958004d90 con 0x7f8960102ef0 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f8967a22640 1 -- 172.21.15.12:0/666357254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f896019c680 con 0x7f8960102ef0 2024-09-19T06:41:05.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.827+0000 7f8967a22640 1 -- 172.21.15.12:0/666357254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89601a3f60 con 0x7f8960102ef0 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8969dfb740 1 Processor -- start 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f89527fc640 1 -- 172.21.15.12:0/666357254 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f8958004f30 con 0x7f8960102ef0 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8969dfb740 1 -- start start 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db385de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db386320 0x5615db392a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 0x5615db395340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8969dfb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5615db2eb280 con 0x5615db385a00 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8969dfb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5615db292b10 con 0x5615db386320 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8969dfb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5615db2e7240 con 0x5615db392f50 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8964fbd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db385de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8964fbd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db385de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59894/0 (socket says 172.21.15.12:59894) 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.830+0000 7f8964fbd640 1 -- 172.21.15.12:0/3086793500 learned_addr learned my addr 172.21.15.12:0/3086793500 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f89657be640 1 --2- 172.21.15.12:0/3086793500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db386320 0x5615db392a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3086793500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 0x5615db395340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f89527fc640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f894c0a3550 0x7f894c0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f8964fbd640 1 -- 172.21.15.12:0/3086793500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 msgr2=0x5615db395340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3086793500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 0x5615db395340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f8964fbd640 1 -- 172.21.15.12:0/3086793500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db386320 msgr2=0x5615db392a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3086793500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db386320 0x5615db392a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f8964fbd640 1 -- 172.21.15.12:0/3086793500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615db29f1f0 con 0x5615db385a00 2024-09-19T06:41:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f8965fbf640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f894c0a3550 0x7f894c0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3086793500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db385de0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f895402a9a0 tx=0x7f8954005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771f00164c034c70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f89527fc640 1 -- 172.21.15.12:0/666357254 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f89580cf990 con 0x7f8960102ef0 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f894b7fe640 1 -- 172.21.15.12:0/3086793500 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954035070 con 0x5615db385a00 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f894b7fe640 1 -- 172.21.15.12:0/3086793500 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8954003cd0 con 0x5615db385a00 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.831+0000 7f894b7fe640 1 -- 172.21.15.12:0/3086793500 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954031d60 con 0x5615db385a00 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.832+0000 7f8969dfb740 1 -- 172.21.15.12:0/3086793500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 msgr2=0x5615db385de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.832+0000 7f8965fbf640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f894c0a3550 0x7f894c0a5a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f89580ccee0 tx=0x7f8958086040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.832+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3086793500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db385de0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f895402a9a0 tx=0x7f8954005c00 comp rx=0 tx=0).stop 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.832+0000 7f8969dfb740 1 -- 172.21.15.12:0/3086793500 shutdown_connections 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.832+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3086793500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 0x5615db395340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.832+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3086793500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db386320 0x5615db392a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.832+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3086793500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db385de0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.832+0000 7f8969dfb740 1 -- 172.21.15.12:0/3086793500 >> 172.21.15.12:0/3086793500 conn(0x5615db3820f0 msgr2=0x5615db3824d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.832+0000 7f8969dfb740 1 -- 172.21.15.12:0/3086793500 shutdown_connections 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.832+0000 7f8969dfb740 1 -- 172.21.15.12:0/3086793500 wait complete. 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f8969dfb740 1 -- start start 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f8969dfb740 1 Processor -- start 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db385a00 0x5615db38fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3903e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 0x5615db390920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f8969dfb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5615db395b20 con 0x5615db386320 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f8969dfb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5615db2a5f10 con 0x5615db385a00 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f8969dfb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5615db395ca0 con 0x5615db392f50 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f8969dfb740 10 client.0 _ll_register_callbacks cb 0x5615db26ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f89657be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3903e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f89657be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3903e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59900/0 (socket says 172.21.15.12:59900) 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.833+0000 7f89657be640 1 -- 172.21.15.12:0/3973313621 learned_addr learned my addr 172.21.15.12:0/3973313621 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db385a00 0x5615db38fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 0x5615db390920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f89657be640 1 -- 172.21.15.12:0/3973313621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 msgr2=0x5615db390920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f89657be640 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 0x5615db390920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f89657be640 1 -- 172.21.15.12:0/3973313621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db385a00 msgr2=0x5615db38fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f89657be640 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db385a00 0x5615db38fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f89657be640 1 -- 172.21.15.12:0/3973313621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615db05c6a0 con 0x5615db386320 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 0x5615db390920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f89657be640 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3903e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f895c013d60 tx=0x7f895c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e85800dc355c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:05.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8948ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:05.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8948ff9640 1 -- 172.21.15.12:0/3973313621 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c003b70 con 0x5615db386320 2024-09-19T06:41:05.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8969dfb740 1 -- 172.21.15.12:0/3973313621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8954003cd0 con 0x5615db386320 2024-09-19T06:41:05.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8948ff9640 1 -- 172.21.15.12:0/3973313621 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f895c003d10 con 0x5615db386320 2024-09-19T06:41:05.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8948ff9640 1 -- 172.21.15.12:0/3973313621 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f895c004050 con 0x5615db386320 2024-09-19T06:41:05.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8969dfb740 10 client.15750 fetch_fsmap learned FSMap version 30 2024-09-19T06:41:05.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8969dfb740 1 -- 172.21.15.12:0/3973313621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5615db3a1890 con 0x5615db386320 2024-09-19T06:41:05.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.834+0000 7f8948ff9640 1 -- 172.21.15.12:0/3973313621 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8954003cd0 con 0x5615db386320 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.835+0000 7f8948ff9640 1 -- 172.21.15.12:0/3973313621 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f895c01a020 con 0x5615db386320 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.835+0000 7f8969dfb740 10 client.15750 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.835+0000 7f8969dfb740 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.835+0000 7f8969dfb740 20 client.15750 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.835+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615db3a2da0 0x5615db3a5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.835+0000 7f8969dfb740 4 client.15750 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.835+0000 7f8969dfb740 1 -- 172.21.15.12:0/3973313621 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615db2f87f0 con 0x5615db3a2da0 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.835+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615db3a2da0 0x5615db3a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.836+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615db3a2da0 0x5615db3a5210 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9939106d7de930dd server_cookie=ace40a1f2b1b887e in_seq=0 out_seq=0 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.836+0000 7f8948ff9640 10 client.15750 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.836+0000 7f8948ff9640 1 -- 172.21.15.12:0/3973313621 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615db2f87f0 con 0x5615db3a2da0 2024-09-19T06:41:05.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.836+0000 7f8948ff9640 10 client.15750 handle_command_reply: tid=0 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 client.15750 shutdown 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 -- 172.21.15.12:0/3973313621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 msgr2=0x5615db3903e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3903e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f895c013d60 tx=0x7f895c0117b0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 -- 172.21.15.12:0/3973313621 shutdown_connections 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615db3a2da0 0x5615db3a5210 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db392f50 0x5615db390920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8948ff9640 0 client.15750 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3903e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3973313621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db385a00 0x5615db38fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 -- 172.21.15.12:0/3973313621 >> 172.21.15.12:0/3973313621 conn(0x5615db3820f0 msgr2=0x5615db387e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 -- 172.21.15.12:0/3973313621 shutdown_connections 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 1 -- 172.21.15.12:0/3973313621 wait complete. 2024-09-19T06:41:05.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.837+0000 7f8969dfb740 20 client.15750 trim_cache size 0 max 16384 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.854+0000 7f8969dfb740 1 Processor -- start 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.854+0000 7f8969dfb740 1 -- start start 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db3aab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db386320 0x5615db3ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 0x5615db38d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8969dfb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89601ab730 con 0x5615db385a00 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8969dfb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89601ad330 con 0x5615db392f50 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8969dfb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89601abe00 con 0x5615db386320 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8964fbd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db3aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8964fbd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db3aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59908/0 (socket says 172.21.15.12:59908) 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8964fbd640 1 -- 172.21.15.12:0/3148126409 learned_addr learned my addr 172.21.15.12:0/3148126409 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3148126409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 0x5615db38d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8964fbd640 1 -- 172.21.15.12:0/3148126409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db386320 msgr2=0x5615db3ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3148126409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db386320 0x5615db3ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8964fbd640 1 -- 172.21.15.12:0/3148126409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 msgr2=0x5615db38d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3148126409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 0x5615db38d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8964fbd640 1 -- 172.21.15.12:0/3148126409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615db3a16a0 con 0x5615db385a00 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.855+0000 7f8964fbd640 1 --2- 172.21.15.12:0/3148126409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db3aab20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8954006010 tx=0x7f8954004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc7c26f2a3eb8e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f894affd640 1 -- 172.21.15.12:0/3148126409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954035040 con 0x5615db385a00 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f894affd640 1 -- 172.21.15.12:0/3148126409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8954050070 con 0x5615db385a00 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f894affd640 1 -- 172.21.15.12:0/3148126409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954004bf0 con 0x5615db385a00 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f8969dfb740 1 -- 172.21.15.12:0/3148126409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 msgr2=0x5615db3aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3148126409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db3aab20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8954006010 tx=0x7f8954004280 comp rx=0 tx=0).stop 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f8969dfb740 1 -- 172.21.15.12:0/3148126409 shutdown_connections 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3148126409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 0x5615db38d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3148126409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db386320 0x5615db3ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f8969dfb740 1 --2- 172.21.15.12:0/3148126409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db385a00 0x5615db3aab20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f8969dfb740 1 -- 172.21.15.12:0/3148126409 >> 172.21.15.12:0/3148126409 conn(0x5615db3820f0 msgr2=0x5615db391e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:05.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f8969dfb740 1 -- 172.21.15.12:0/3148126409 shutdown_connections 2024-09-19T06:41:05.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.856+0000 7f8969dfb740 1 -- 172.21.15.12:0/3148126409 wait complete. 2024-09-19T06:41:05.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.857+0000 7f8969dfb740 1 -- start start 2024-09-19T06:41:05.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.857+0000 7f8969dfb740 1 Processor -- start 2024-09-19T06:41:05.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.857+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db385a00 0x5615db397380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.857+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3978c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.857+0000 7f8969dfb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 0x5615db40caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.857+0000 7f8969dfb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89601acba0 con 0x5615db386320 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.857+0000 7f8969dfb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89601ac4d0 con 0x5615db392f50 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.857+0000 7f8969dfb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89601a9710 con 0x5615db385a00 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.857+0000 7f8969dfb740 10 client.0 _ll_register_callbacks cb 0x7f895c009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f89657be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f89657be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59912/0 (socket says 172.21.15.12:59912) 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f89657be640 1 -- 172.21.15.12:0/2301946372 learned_addr learned my addr 172.21.15.12:0/2301946372 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f8964fbd640 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db385a00 0x5615db397380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f8964fbd640 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 0x5615db40caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f89657be640 1 -- 172.21.15.12:0/2301946372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db385a00 msgr2=0x5615db397380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f89657be640 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db385a00 0x5615db397380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f89657be640 1 -- 172.21.15.12:0/2301946372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 msgr2=0x5615db40caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f89657be640 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 0x5615db40caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f89657be640 1 -- 172.21.15.12:0/2301946372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615db40d030 con 0x5615db386320 2024-09-19T06:41:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f8964fbd640 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 0x5615db40caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f89657be640 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3978c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f895c016040 tx=0x7f895c013800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cbff50da9f4dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f8948ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f8948ff9640 1 -- 172.21.15.12:0/2301946372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c01c650 con 0x5615db386320 2024-09-19T06:41:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f8948ff9640 1 -- 172.21.15.12:0/2301946372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f895c01c7f0 con 0x5615db386320 2024-09-19T06:41:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.858+0000 7f8969dfb740 1 -- 172.21.15.12:0/2301946372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8954050070 con 0x5615db386320 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8948ff9640 1 -- 172.21.15.12:0/2301946372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f895c003970 con 0x5615db386320 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8969dfb740 10 client.15756 fetch_fsmap learned FSMap version 30 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8969dfb740 1 -- 172.21.15.12:0/2301946372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5615db40e2d0 con 0x5615db386320 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8948ff9640 1 -- 172.21.15.12:0/2301946372 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8954050070 con 0x5615db386320 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8948ff9640 1 -- 172.21.15.12:0/2301946372 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f895c02b070 con 0x5615db386320 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8969dfb740 10 client.15756 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8969dfb740 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8969dfb740 20 client.15756 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8969dfb740 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615db3a2da0 0x5615db410ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8969dfb740 4 client.15756 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8969dfb740 1 -- 172.21.15.12:0/2301946372 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5615db2f2d00 con 0x5615db3a2da0 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.859+0000 7f8964fbd640 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615db3a2da0 0x5615db410ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.860+0000 7f8964fbd640 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615db3a2da0 0x5615db410ba0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a81f157b00fce032 server_cookie=e5c43abd54cb6f73 in_seq=0 out_seq=0 2024-09-19T06:41:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.860+0000 7f8948ff9640 10 client.15756 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8948ff9640 1 -- 172.21.15.12:0/2301946372 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5615db2f2d00 con 0x5615db3a2da0 2024-09-19T06:41:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8948ff9640 10 client.15756 handle_command_reply: tid=0 2024-09-19T06:41:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 client.15756 shutdown 2024-09-19T06:41:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 -- 172.21.15.12:0/2301946372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 msgr2=0x5615db3978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3978c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f895c016040 tx=0x7f895c013800 comp rx=0 tx=0).stop 2024-09-19T06:41:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 -- 172.21.15.12:0/2301946372 shutdown_connections 2024-09-19T06:41:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615db3a2da0 0x5615db410ba0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615db392f50 0x5615db40caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615db386320 0x5615db3978c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 --2- 172.21.15.12:0/2301946372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615db385a00 0x5615db397380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8948ff9640 0 client.15756 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 -- 172.21.15.12:0/2301946372 >> 172.21.15.12:0/2301946372 conn(0x5615db3820f0 msgr2=0x5615db380a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 -- 172.21.15.12:0/2301946372 shutdown_connections 2024-09-19T06:41:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 1 -- 172.21.15.12:0/2301946372 wait complete. 2024-09-19T06:41:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.861+0000 7f8969dfb740 20 client.15756 trim_cache size 0 max 16384 2024-09-19T06:41:05.879 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:41:05.879 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:41:05.879 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "fd684640-b18a-43ba-95b0-d439c76ac8a8", 2024-09-19T06:41:05.879 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:41:05.880 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:41:05.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 -- 172.21.15.12:0/666357254 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f894c0a3550 msgr2=0x7f894c0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f894c0a3550 0x7f894c0a5a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f89580ccee0 tx=0x7f8958086040 comp rx=0 tx=0).stop 2024-09-19T06:41:05.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 -- 172.21.15.12:0/666357254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8960102ef0 msgr2=0x7f896019bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8960102ef0 0x7f896019bcb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f895800d750 tx=0x7f895800dc10 comp rx=0 tx=0).stop 2024-09-19T06:41:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 -- 172.21.15.12:0/666357254 shutdown_connections 2024-09-19T06:41:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8960102ef0 0x7f896019bcb0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f894c0a3550 0x7f894c0a5a10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8960102570 0x7f8960197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 --2- 172.21.15.12:0/666357254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8960100e20 0x7f89601973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 -- 172.21.15.12:0/666357254 >> 172.21.15.12:0/666357254 conn(0x7f89600fc7d0 msgr2=0x7f89600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 -- 172.21.15.12:0/666357254 shutdown_connections 2024-09-19T06:41:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:05.862+0000 7f8967a22640 1 -- 172.21.15.12:0/666357254 wait complete. 2024-09-19T06:41:06.421 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:41:06.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:41:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:07.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.265+0000 7ff6222c4640 1 -- 172.21.15.12:0/2577280312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c106f10 msgr2=0x7ff61c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:07.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.265+0000 7ff6222c4640 1 --2- 172.21.15.12:0/2577280312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c106f10 0x7ff61c10ea90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff614009ca0 tx=0x7ff61402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.265+0000 7ff6222c4640 1 -- 172.21.15.12:0/2577280312 shutdown_connections 2024-09-19T06:41:07.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.265+0000 7ff6222c4640 1 --2- 172.21.15.12:0/2577280312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c106f10 0x7ff61c10ea90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.265+0000 7ff6222c4640 1 --2- 172.21.15.12:0/2577280312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff61c102790 0x7ff61c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.265+0000 7ff6222c4640 1 --2- 172.21.15.12:0/2577280312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff61c101de0 0x7ff61c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.265+0000 7ff6222c4640 1 -- 172.21.15.12:0/2577280312 >> 172.21.15.12:0/2577280312 conn(0x7ff61c0fd8c0 msgr2=0x7ff61c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.265+0000 7ff6222c4640 1 -- 172.21.15.12:0/2577280312 shutdown_connections 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.266+0000 7ff6222c4640 1 -- 172.21.15.12:0/2577280312 wait complete. 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.266+0000 7ff6222c4640 1 Processor -- start 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.266+0000 7ff6222c4640 1 -- start start 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.266+0000 7ff6222c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c101de0 0x7ff61c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.266+0000 7ff6222c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff61c102790 0x7ff61c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.266+0000 7ff6222c4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff61c106f10 0x7ff61c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.266+0000 7ff6222c4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c111f70 con 0x7ff61c101de0 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.266+0000 7ff6222c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c111df0 con 0x7ff61c102790 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.266+0000 7ff6222c4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c1120f0 con 0x7ff61c106f10 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff61bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c101de0 0x7ff61c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff61bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c101de0 0x7ff61c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59916/0 (socket says 172.21.15.12:59916) 2024-09-19T06:41:07.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff61bfff640 1 -- 172.21.15.12:0/2055574037 learned_addr learned my addr 172.21.15.12:0/2055574037 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff613fff640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff61c102790 0x7ff61c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff620861640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff61c106f10 0x7ff61c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff61bfff640 1 -- 172.21.15.12:0/2055574037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff61c106f10 msgr2=0x7ff61c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff61bfff640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff61c106f10 0x7ff61c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff61bfff640 1 -- 172.21.15.12:0/2055574037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff61c102790 msgr2=0x7ff61c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff61bfff640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff61c102790 0x7ff61c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff61bfff640 1 -- 172.21.15.12:0/2055574037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c1a68b0 con 0x7ff61c101de0 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff613fff640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff61c102790 0x7ff61c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff61bfff640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c101de0 0x7ff61c0744f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00e9f0 tx=0x7ff60c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff619ffb640 1 -- 172.21.15.12:0/2055574037 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c00cd80 con 0x7ff61c101de0 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff619ffb640 1 -- 172.21.15.12:0/2055574037 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff60c010910 con 0x7ff61c101de0 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff6222c4640 1 -- 172.21.15.12:0/2055574037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c1a6ba0 con 0x7ff61c101de0 2024-09-19T06:41:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff619ffb640 1 -- 172.21.15.12:0/2055574037 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c018990 con 0x7ff61c101de0 2024-09-19T06:41:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.267+0000 7ff6222c4640 1 -- 172.21.15.12:0/2055574037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c1a7130 con 0x7ff61c101de0 2024-09-19T06:41:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.268+0000 7ff6222c4640 1 -- 172.21.15.12:0/2055574037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c1021c0 con 0x7ff61c101de0 2024-09-19T06:41:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.270+0000 7ff619ffb640 1 -- 172.21.15.12:0/2055574037 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7ff60c010ac0 con 0x7ff61c101de0 2024-09-19T06:41:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.270+0000 7ff619ffb640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff6080a3550 0x7ff6080a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.270+0000 7ff619ffb640 1 -- 172.21.15.12:0/2055574037 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ff60c0d02b0 con 0x7ff61c101de0 2024-09-19T06:41:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.270+0000 7ff613fff640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff6080a3550 0x7ff6080a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.271+0000 7ff613fff640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff6080a3550 0x7ff6080a5a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff61c075f80 tx=0x7ff60400a2d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.274+0000 7ff619ffb640 1 -- 172.21.15.12:0/2055574037 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff60c09c370 con 0x7ff61c101de0 2024-09-19T06:41:07.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:07 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:41:07.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:07 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:07 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:41:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:07 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:41:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:07 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:07 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:41:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:07 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:07 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:07 smithi012 ceph-mon[30937]: pgmap v32: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-09-19T06:41:07.359 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:07.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.495+0000 7ff6222c4640 1 -- 172.21.15.12:0/2055574037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff61c075a20 con 0x7ff61c101de0 2024-09-19T06:41:07.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.495+0000 7ff619ffb640 1 -- 172.21.15.12:0/2055574037 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11978 (secure 0 0 0) 0x7ff60c0a0670 con 0x7ff61c101de0 2024-09-19T06:41:07.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:41:07.497 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":30,"btime":"2024-09-19T06:41:04:222771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:41:03.415120+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:41:07.497 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 30 2024-09-19T06:41:07.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.497+0000 7ff6222c4640 1 -- 172.21.15.12:0/2055574037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff6080a3550 msgr2=0x7ff6080a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:07.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.497+0000 7ff6222c4640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff6080a3550 0x7ff6080a5a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff61c075f80 tx=0x7ff60400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.497+0000 7ff6222c4640 1 -- 172.21.15.12:0/2055574037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c101de0 msgr2=0x7ff61c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:07.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.497+0000 7ff6222c4640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c101de0 0x7ff61c0744f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00e9f0 tx=0x7ff60c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.497+0000 7ff6222c4640 1 -- 172.21.15.12:0/2055574037 shutdown_connections 2024-09-19T06:41:07.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.497+0000 7ff6222c4640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff6080a3550 0x7ff6080a5a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.497+0000 7ff6222c4640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff61c106f10 0x7ff61c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.497+0000 7ff6222c4640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff61c102790 0x7ff61c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.498+0000 7ff6222c4640 1 --2- 172.21.15.12:0/2055574037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c101de0 0x7ff61c0744f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:07.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.498+0000 7ff6222c4640 1 -- 172.21.15.12:0/2055574037 >> 172.21.15.12:0/2055574037 conn(0x7ff61c0fd8c0 msgr2=0x7ff61c0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:07.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.498+0000 7ff6222c4640 1 -- 172.21.15.12:0/2055574037 shutdown_connections 2024-09-19T06:41:07.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.498+0000 7ff6222c4640 1 -- 172.21.15.12:0/2055574037 wait complete. 2024-09-19T06:41:07.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:07 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:41:07.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:07 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:07 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:41:07.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:07 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:41:07.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:07 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:07 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:41:07.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:07 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:07 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:07 smithi016 ceph-mon[34911]: pgmap v32: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-09-19T06:41:07.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:07 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:41:07.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:07 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:07 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:41:07.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:07 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:41:07.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:07 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:07 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:41:07.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:07 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:07 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:07.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:07 smithi173 ceph-mon[35349]: pgmap v32: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-09-19T06:41:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.998+0000 7f418a4ef640 1 -- 172.21.15.12:0/2997284501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184100e20 msgr2=0x7f4184101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.998+0000 7f418a4ef640 1 --2- 172.21.15.12:0/2997284501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184100e20 0x7f4184101200 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4174009900 tx=0x7f417402a480 comp rx=0 tx=0).stop 2024-09-19T06:41:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.998+0000 7f418a4ef640 1 -- 172.21.15.12:0/2997284501 shutdown_connections 2024-09-19T06:41:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.998+0000 7f418a4ef640 1 --2- 172.21.15.12:0/2997284501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102ef0 0x7f418410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.998+0000 7f418a4ef640 1 --2- 172.21.15.12:0/2997284501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184102570 0x7f41841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.998+0000 7f418a4ef640 1 --2- 172.21.15.12:0/2997284501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184100e20 0x7f4184101200 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.998+0000 7f418a4ef640 1 -- 172.21.15.12:0/2997284501 >> 172.21.15.12:0/2997284501 conn(0x7f41840fc7d0 msgr2=0x7f41840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.998+0000 7f418a4ef640 1 -- 172.21.15.12:0/2997284501 shutdown_connections 2024-09-19T06:41:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.998+0000 7f418a4ef640 1 -- 172.21.15.12:0/2997284501 wait complete. 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.999+0000 7f418a4ef640 1 Processor -- start 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.999+0000 7f418a4ef640 1 -- start start 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.999+0000 7f418a4ef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184100e20 0x7f4184199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.999+0000 7f418a4ef640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102570 0x7f41841998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.999+0000 7f418a4ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184102ef0 0x7f41841a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.999+0000 7f418a4ef640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4184110fa0 con 0x7f4184102ef0 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.999+0000 7f418a4ef640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4184110e20 con 0x7f4184102570 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:07.999+0000 7f418a4ef640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4184111120 con 0x7f4184100e20 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f4188a8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184102ef0 0x7f41841a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f4188a8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184102ef0 0x7f41841a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59938/0 (socket says 172.21.15.12:59938) 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f4188a8c640 1 -- 172.21.15.12:0/3450386658 learned_addr learned my addr 172.21.15.12:0/3450386658 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f41837fe640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102570 0x7f41841998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f4183fff640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184100e20 0x7f4184199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f4188a8c640 1 -- 172.21.15.12:0/3450386658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184100e20 msgr2=0x7f4184199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f4188a8c640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184100e20 0x7f4184199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f4188a8c640 1 -- 172.21.15.12:0/3450386658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102570 msgr2=0x7f41841998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f4188a8c640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102570 0x7f41841998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f4188a8c640 1 -- 172.21.15.12:0/3450386658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41841a4930 con 0x7f4184102ef0 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f4188a8c640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184102ef0 0x7f41841a43f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f417c00cce0 tx=0x7f417c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f41817fa640 1 -- 172.21.15.12:0/3450386658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c00f450 con 0x7f4184102ef0 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f418a4ef640 1 -- 172.21.15.12:0/3450386658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41841a4b00 con 0x7f4184102ef0 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f41817fa640 1 -- 172.21.15.12:0/3450386658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417c00fad0 con 0x7f4184102ef0 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f41817fa640 1 -- 172.21.15.12:0/3450386658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c018b60 con 0x7f4184102ef0 2024-09-19T06:41:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.000+0000 7f418a4ef640 1 -- 172.21.15.12:0/3450386658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41841a5010 con 0x7f4184102ef0 2024-09-19T06:41:08.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.003+0000 7f41817fa640 1 -- 172.21.15.12:0/3450386658 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f417c018d00 con 0x7f4184102ef0 2024-09-19T06:41:08.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.003+0000 7f418c8c8740 1 Processor -- start 2024-09-19T06:41:08.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.003+0000 7f418c8c8740 1 -- start start 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.003+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164f4a0 0x5637a164f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.003+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a165a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.003+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a165a680 0x5637a165ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.003+0000 7f418c8c8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5637a15b52e0 con 0x5637a164f4a0 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.003+0000 7f418c8c8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5637a155cce0 con 0x5637a165a680 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.003+0000 7f418c8c8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5637a15b12a0 con 0x5637a164fdc0 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.003+0000 7f41837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164f4a0 0x5637a164f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164f4a0 0x5637a164f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59944/0 (socket says 172.21.15.12:59944) 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41837fe640 1 -- 172.21.15.12:0/1484432370 learned_addr learned my addr 172.21.15.12:0/1484432370 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41817fa640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f416c0a34d0 0x7f416c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f4183fff640 1 --2- 172.21.15.12:0/1484432370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a165a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41837fe640 1 --2- 172.21.15.12:0/1484432370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a165a680 0x5637a165ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41837fe640 1 -- 172.21.15.12:0/1484432370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 msgr2=0x5637a165a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41837fe640 1 --2- 172.21.15.12:0/1484432370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a165a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41837fe640 1 -- 172.21.15.12:0/1484432370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a165a680 msgr2=0x5637a165ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41837fe640 1 --2- 172.21.15.12:0/1484432370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a165a680 0x5637a165ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41837fe640 1 -- 172.21.15.12:0/1484432370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637a1541440 con 0x5637a164f4a0 2024-09-19T06:41:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f4188a8c640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f416c0a34d0 0x7f416c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41817fa640 1 -- 172.21.15.12:0/3450386658 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f417c0d0650 con 0x7f4184102ef0 2024-09-19T06:41:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f41837fe640 1 --2- 172.21.15.12:0/1484432370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164f4a0 0x5637a164f880 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4178006aa0 tx=0x7f41780095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d41e0028ae752a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f416a7fc640 1 -- 172.21.15.12:0/1484432370 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178017610 con 0x5637a164f4a0 2024-09-19T06:41:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f416a7fc640 1 -- 172.21.15.12:0/1484432370 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417801c070 con 0x5637a164f4a0 2024-09-19T06:41:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.004+0000 7f416a7fc640 1 -- 172.21.15.12:0/1484432370 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41780159d0 con 0x5637a164f4a0 2024-09-19T06:41:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f418c8c8740 1 -- 172.21.15.12:0/1484432370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164f4a0 msgr2=0x5637a164f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f4188a8c640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f416c0a34d0 0x7f416c0a5990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f417c0cdba0 tx=0x7f417c066f40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1484432370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164f4a0 0x5637a164f880 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4178006aa0 tx=0x7f41780095d0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f418c8c8740 1 -- 172.21.15.12:0/1484432370 shutdown_connections 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1484432370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a165a680 0x5637a165ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1484432370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a165a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1484432370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164f4a0 0x5637a164f880 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f418c8c8740 1 -- 172.21.15.12:0/1484432370 >> 172.21.15.12:0/1484432370 conn(0x5637a164ba30 msgr2=0x5637a164be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f418c8c8740 1 -- 172.21.15.12:0/1484432370 shutdown_connections 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f418c8c8740 1 -- 172.21.15.12:0/1484432370 wait complete. 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.005+0000 7f418c8c8740 1 -- start start 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f418c8c8740 1 Processor -- start 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 0x5637a1659fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a1657270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a165a680 0x5637a16577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f418c8c8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5637a165d250 con 0x5637a165a680 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f418c8c8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5637a1570050 con 0x5637a164f4a0 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f418c8c8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5637a165d3d0 con 0x5637a164fdc0 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f418c8c8740 10 client.0 _ll_register_callbacks cb 0x5637a15b0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f41837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a165a680 0x5637a16577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f41837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a165a680 0x5637a16577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59952/0 (socket says 172.21.15.12:59952) 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f41837fe640 1 -- 172.21.15.12:0/1405600117 learned_addr learned my addr 172.21.15.12:0/1405600117 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f41837fe640 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 0x5637a1659fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.006+0000 7f4183fff640 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a1657270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41837fe640 1 -- 172.21.15.12:0/1405600117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 msgr2=0x5637a1657270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41837fe640 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a1657270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41837fe640 1 -- 172.21.15.12:0/1405600117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 msgr2=0x5637a1659fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41837fe640 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 0x5637a1659fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41837fe640 1 -- 172.21.15.12:0/1405600117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637a13263c0 con 0x5637a165a680 2024-09-19T06:41:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41837fe640 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a165a680 0x5637a16577b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4178019040 tx=0x7f41780155b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee19ce4a88098767 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41637fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41637fe640 1 -- 172.21.15.12:0/1405600117 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178015b70 con 0x5637a165a680 2024-09-19T06:41:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f418c8c8740 1 -- 172.21.15.12:0/1405600117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f417801c070 con 0x5637a165a680 2024-09-19T06:41:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41637fe640 1 -- 172.21.15.12:0/1405600117 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4178015d10 con 0x5637a165a680 2024-09-19T06:41:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41637fe640 1 -- 172.21.15.12:0/1405600117 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4178017410 con 0x5637a165a680 2024-09-19T06:41:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f418c8c8740 10 client.15774 fetch_fsmap learned FSMap version 30 2024-09-19T06:41:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f418c8c8740 1 -- 172.21.15.12:0/1405600117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5637a1668c00 con 0x5637a165a680 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.007+0000 7f41637fe640 1 -- 172.21.15.12:0/1405600117 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417801c070 con 0x5637a165a680 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.008+0000 7f41637fe640 1 -- 172.21.15.12:0/1405600117 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f4178021700 con 0x5637a165a680 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.008+0000 7f418c8c8740 10 client.15774 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.008+0000 7f418c8c8740 10 client.15774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.008+0000 7f418c8c8740 20 client.15774 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.008+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5637a1669f50 0x5637a166c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.008+0000 7f418c8c8740 4 client.15774 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.008+0000 7f418c8c8740 1 -- 172.21.15.12:0/1405600117 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637a15c2850 con 0x5637a1669f50 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.008+0000 7f4183fff640 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5637a1669f50 0x5637a166c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.008+0000 7f4183fff640 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5637a1669f50 0x5637a166c340 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d65dd8287cc0a195 server_cookie=f976ddbb6fd6dcb9 in_seq=0 out_seq=0 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.008+0000 7f41637fe640 10 client.15774 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f41637fe640 1 -- 172.21.15.12:0/1405600117 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637a15c2850 con 0x5637a1669f50 2024-09-19T06:41:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f41637fe640 10 client.15774 handle_command_reply: tid=0 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 client.15774 shutdown 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 -- 172.21.15.12:0/1405600117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a165a680 msgr2=0x5637a16577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a165a680 0x5637a16577b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4178019040 tx=0x7f41780155b0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 -- 172.21.15.12:0/1405600117 shutdown_connections 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5637a1669f50 0x5637a166c340 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a165a680 0x5637a16577b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a1657270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1405600117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 0x5637a1659fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 -- 172.21.15.12:0/1405600117 >> 172.21.15.12:0/1405600117 conn(0x5637a164ba30 msgr2=0x5637a1651710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f41637fe640 0 client.15774 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 -- 172.21.15.12:0/1405600117 shutdown_connections 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 1 -- 172.21.15.12:0/1405600117 wait complete. 2024-09-19T06:41:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.009+0000 7f418c8c8740 20 client.15774 trim_cache size 0 max 16384 2024-09-19T06:41:08.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.026+0000 7f418c8c8740 1 Processor -- start 2024-09-19T06:41:08.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f418c8c8740 1 -- start start 2024-09-19T06:41:08.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164ba30 0x5637a16591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164f4a0 0x5637a16719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164fdc0 0x5637a1671f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f418c8c8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41841adaf0 con 0x5637a164fdc0 2024-09-19T06:41:08.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f418c8c8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41841af6f0 con 0x5637a164ba30 2024-09-19T06:41:08.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f418c8c8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41841ae1c0 con 0x5637a164f4a0 2024-09-19T06:41:08.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f41837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164fdc0 0x5637a1671f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f41837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164fdc0 0x5637a1671f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59962/0 (socket says 172.21.15.12:59962) 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f41837fe640 1 -- 172.21.15.12:0/1513303576 learned_addr learned my addr 172.21.15.12:0/1513303576 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f41837fe640 1 --2- 172.21.15.12:0/1513303576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164ba30 0x5637a16591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f4183fff640 1 --2- 172.21.15.12:0/1513303576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164f4a0 0x5637a16719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f41837fe640 1 -- 172.21.15.12:0/1513303576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164f4a0 msgr2=0x5637a16719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f41837fe640 1 --2- 172.21.15.12:0/1513303576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164f4a0 0x5637a16719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f41837fe640 1 -- 172.21.15.12:0/1513303576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164ba30 msgr2=0x5637a16591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f41837fe640 1 --2- 172.21.15.12:0/1513303576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164ba30 0x5637a16591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f41837fe640 1 -- 172.21.15.12:0/1513303576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637a1659be0 con 0x5637a164fdc0 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f41837fe640 1 --2- 172.21.15.12:0/1513303576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164fdc0 0x5637a1671f10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f41780204b0 tx=0x7f4178006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f88f3d6b25ff056 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.027+0000 7f4169ffb640 1 -- 172.21.15.12:0/1513303576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178009420 con 0x5637a164fdc0 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f4169ffb640 1 -- 172.21.15.12:0/1513303576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417801c070 con 0x5637a164fdc0 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f4169ffb640 1 -- 172.21.15.12:0/1513303576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178017810 con 0x5637a164fdc0 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f418c8c8740 1 -- 172.21.15.12:0/1513303576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164fdc0 msgr2=0x5637a1671f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1513303576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164fdc0 0x5637a1671f10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f41780204b0 tx=0x7f4178006ca0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f418c8c8740 1 -- 172.21.15.12:0/1513303576 shutdown_connections 2024-09-19T06:41:08.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1513303576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164fdc0 0x5637a1671f10 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1513303576 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164f4a0 0x5637a16719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f418c8c8740 1 --2- 172.21.15.12:0/1513303576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164ba30 0x5637a16591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f418c8c8740 1 -- 172.21.15.12:0/1513303576 >> 172.21.15.12:0/1513303576 conn(0x5637a1657910 msgr2=0x5637a1658ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:08.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f418c8c8740 1 -- 172.21.15.12:0/1513303576 shutdown_connections 2024-09-19T06:41:08.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f418c8c8740 1 -- 172.21.15.12:0/1513303576 wait complete. 2024-09-19T06:41:08.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.028+0000 7f418c8c8740 1 -- start start 2024-09-19T06:41:08.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f418c8c8740 1 Processor -- start 2024-09-19T06:41:08.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164ba30 0x5637a165fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 0x5637a1660420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f418c8c8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a16cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f418c8c8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41841aef60 con 0x5637a164ba30 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f418c8c8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41841ae890 con 0x5637a164f4a0 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f418c8c8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41841abad0 con 0x5637a164fdc0 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f418c8c8740 10 client.0 _ll_register_callbacks cb 0x7f4178009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f41837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164ba30 0x5637a165fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f41837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164ba30 0x5637a165fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59976/0 (socket says 172.21.15.12:59976) 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f41837fe640 1 -- 172.21.15.12:0/2046927635 learned_addr learned my addr 172.21.15.12:0/2046927635 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f4183fff640 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 0x5637a1660420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.029+0000 7f41837fe640 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a16cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f4183fff640 1 -- 172.21.15.12:0/2046927635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 msgr2=0x5637a16cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f4183fff640 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a16cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f4183fff640 1 -- 172.21.15.12:0/2046927635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164ba30 msgr2=0x5637a165fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f4183fff640 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164ba30 0x5637a165fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f4183fff640 1 -- 172.21.15.12:0/2046927635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637a16cc000 con 0x5637a164f4a0 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f41837fe640 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164ba30 0x5637a165fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f4183fff640 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 0x5637a1660420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4174009230 tx=0x7f41740045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f03883e25c9fdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f41637fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f41637fe640 1 -- 172.21.15.12:0/2046927635 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174049070 con 0x5637a164f4a0 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f418c8c8740 1 -- 172.21.15.12:0/2046927635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f417801c070 con 0x5637a164f4a0 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f41637fe640 1 -- 172.21.15.12:0/2046927635 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4174031a90 con 0x5637a164f4a0 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f41637fe640 1 -- 172.21.15.12:0/2046927635 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4174054050 con 0x5637a164f4a0 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f418c8c8740 10 client.25403 fetch_fsmap learned FSMap version 30 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f418c8c8740 1 -- 172.21.15.12:0/2046927635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5637a16d4600 con 0x5637a164f4a0 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.030+0000 7f41637fe640 1 -- 172.21.15.12:0/2046927635 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417801c070 con 0x5637a164f4a0 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f41637fe640 1 -- 172.21.15.12:0/2046927635 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f4174004b10 con 0x5637a164f4a0 2024-09-19T06:41:08.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f418c8c8740 10 client.25403 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f418c8c8740 10 client.25403 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f418c8c8740 20 client.25403 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f418c8c8740 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5637a165a680 0x5637a16d6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f418c8c8740 4 client.25403 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f418c8c8740 1 -- 172.21.15.12:0/2046927635 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5637a15bcd60 con 0x5637a165a680 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f41837fe640 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5637a165a680 0x5637a16d6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f41837fe640 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5637a165a680 0x5637a16d6e10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe98823ba2be30a2 server_cookie=7435c3b79ab338fd in_seq=0 out_seq=0 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f41637fe640 10 client.25403 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f41637fe640 1 -- 172.21.15.12:0/2046927635 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5637a15bcd60 con 0x5637a165a680 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f41637fe640 10 client.25403 handle_command_reply: tid=0 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.031+0000 7f418c8c8740 1 client.25403 shutdown 2024-09-19T06:41:08.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 1 -- 172.21.15.12:0/2046927635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 msgr2=0x5637a1660420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 0x5637a1660420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4174009230 tx=0x7f41740045e0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 1 -- 172.21.15.12:0/2046927635 shutdown_connections 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5637a165a680 0x5637a16d6e10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637a164fdc0 0x5637a16cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5637a164f4a0 0x5637a1660420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 1 --2- 172.21.15.12:0/2046927635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637a164ba30 0x5637a165fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f41637fe640 0 client.25403 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 1 -- 172.21.15.12:0/2046927635 >> 172.21.15.12:0/2046927635 conn(0x5637a1657910 msgr2=0x5637a164a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 1 -- 172.21.15.12:0/2046927635 shutdown_connections 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 1 -- 172.21.15.12:0/2046927635 wait complete. 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418c8c8740 20 client.25403 trim_cache size 0 max 16384 2024-09-19T06:41:08.039 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:41:08.040 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:41:08.040 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:41:08.040 INFO:teuthology.orchestra.run.smithi012.stdout: "fd684640-b18a-43ba-95b0-d439c76ac8a8": { 2024-09-19T06:41:08.040 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:41:08.040 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "fd684640-b18a-43ba-95b0-d439c76ac8a8", 2024-09-19T06:41:08.040 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:41:08.040 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:08.040 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:08.040 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:41:08.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418a4ef640 1 -- 172.21.15.12:0/3450386658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f416c0a34d0 msgr2=0x7f416c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:08.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418a4ef640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f416c0a34d0 0x7f416c0a5990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f417c0cdba0 tx=0x7f417c066f40 comp rx=0 tx=0).stop 2024-09-19T06:41:08.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418a4ef640 1 -- 172.21.15.12:0/3450386658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184102ef0 msgr2=0x7f41841a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:08.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418a4ef640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184102ef0 0x7f41841a43f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f417c00cce0 tx=0x7f417c00a620 comp rx=0 tx=0).stop 2024-09-19T06:41:08.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418a4ef640 1 -- 172.21.15.12:0/3450386658 shutdown_connections 2024-09-19T06:41:08.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418a4ef640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4184102ef0 0x7f41841a43f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418a4ef640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4184102570 0x7f41841998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418a4ef640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f416c0a34d0 0x7f416c0a5990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418a4ef640 1 --2- 172.21.15.12:0/3450386658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4184100e20 0x7f4184199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:08.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.032+0000 7f418a4ef640 1 -- 172.21.15.12:0/3450386658 >> 172.21.15.12:0/3450386658 conn(0x7f41840fc7d0 msgr2=0x7f41840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:08.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.033+0000 7f418a4ef640 1 -- 172.21.15.12:0/3450386658 shutdown_connections 2024-09-19T06:41:08.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:08.033+0000 7f418a4ef640 1 -- 172.21.15.12:0/3450386658 wait complete. 2024-09-19T06:41:08.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:08 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2055574037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:08.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:08 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2055574037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:08.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:08 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2055574037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:08.769 INFO:tasks.cephfs.filesystem:scrub status for tag:fd684640-b18a-43ba-95b0-d439c76ac8a8 - {'path': '/', 'tag': 'fd684640-b18a-43ba-95b0-d439c76ac8a8', 'options': 'recursive,force'} 2024-09-19T06:41:09.249 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id aa879d56 --release --await' 2024-09-19T06:41:09.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id aa879d56 --release --await 2024-09-19T06:41:09.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:09 smithi016 ceph-mon[34911]: pgmap v33: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 6.9 MiB/s wr, 655 op/s 2024-09-19T06:41:09.514 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:09.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:09 smithi173 ceph-mon[35349]: pgmap v33: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 6.9 MiB/s wr, 655 op/s 2024-09-19T06:41:09.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:09 smithi012 ceph-mon[30937]: pgmap v33: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 6.9 MiB/s wr, 655 op/s 2024-09-19T06:41:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 -- 172.21.15.12:0/143621323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe18106f10 msgr2=0x7fbe1810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 --2- 172.21.15.12:0/143621323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe18106f10 0x7fbe1810ea90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbe10009ca0 tx=0x7fbe1002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 -- 172.21.15.12:0/143621323 shutdown_connections 2024-09-19T06:41:10.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 --2- 172.21.15.12:0/143621323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe18106f10 0x7fbe1810ea90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 --2- 172.21.15.12:0/143621323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe18102790 0x7fbe181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 --2- 172.21.15.12:0/143621323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe18101de0 0x7fbe181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 -- 172.21.15.12:0/143621323 >> 172.21.15.12:0/143621323 conn(0x7fbe180fd8c0 msgr2=0x7fbe180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 -- 172.21.15.12:0/143621323 shutdown_connections 2024-09-19T06:41:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 -- 172.21.15.12:0/143621323 wait complete. 2024-09-19T06:41:10.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 Processor -- start 2024-09-19T06:41:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.996+0000 7fbe1e574640 1 -- start start 2024-09-19T06:41:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1e574640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe18101de0 0x7fbe18198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1e574640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe18102790 0x7fbe18198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1e574640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe18106f10 0x7fbe1819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1e574640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18111f70 con 0x7fbe18106f10 2024-09-19T06:41:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1e574640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18111df0 con 0x7fbe18101de0 2024-09-19T06:41:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1e574640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181120f0 con 0x7fbe18102790 2024-09-19T06:41:10.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1cb11640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe18106f10 0x7fbe1819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1cb11640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe18106f10 0x7fbe1819cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59986/0 (socket says 172.21.15.12:59986) 2024-09-19T06:41:10.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1cb11640 1 -- 172.21.15.12:0/1134475441 learned_addr learned my addr 172.21.15.12:0/1134475441 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:10.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe17fff640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe18101de0 0x7fbe18198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe18102790 0x7fbe18198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1cb11640 1 -- 172.21.15.12:0/1134475441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe18102790 msgr2=0x7fbe18198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1cb11640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe18102790 0x7fbe18198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1cb11640 1 -- 172.21.15.12:0/1134475441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe18101de0 msgr2=0x7fbe18198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1cb11640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe18101de0 0x7fbe18198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1cb11640 1 -- 172.21.15.12:0/1134475441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1819d2f0 con 0x7fbe18106f10 2024-09-19T06:41:10.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.997+0000 7fbe1cb11640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe18106f10 0x7fbe1819cc10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbe10031a20 tx=0x7fbe10031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.998+0000 7fbe15ffb640 1 -- 172.21.15.12:0/1134475441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10003b70 con 0x7fbe18106f10 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.998+0000 7fbe15ffb640 1 -- 172.21.15.12:0/1134475441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe10003d10 con 0x7fbe18106f10 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.998+0000 7fbe1e574640 1 -- 172.21.15.12:0/1134475441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1819d580 con 0x7fbe18106f10 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.998+0000 7fbe15ffb640 1 -- 172.21.15.12:0/1134475441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1002fc80 con 0x7fbe18106f10 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:09.998+0000 7fbe1e574640 1 -- 172.21.15.12:0/1134475441 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe181a4ec0 con 0x7fbe18106f10 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.000+0000 7fbe15ffb640 1 -- 172.21.15.12:0/1134475441 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7fbe100046a0 con 0x7fbe18106f10 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.000+0000 7fbe2094d740 1 Processor -- start 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.000+0000 7fbe2094d740 1 -- start start 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d29f20 0x557f55d2a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d39110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 0x557f55d3ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe2094d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f55c8f620 con 0x557f55d29f20 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe2094d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557f55c36e50 con 0x557f55d2a840 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe2094d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557f55c8b5e0 con 0x557f55d39650 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d29f20 0x557f55d2a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d29f20 0x557f55d2a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60000/0 (socket says 172.21.15.12:60000) 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe0ffff640 1 -- 172.21.15.12:0/2466925333 learned_addr learned my addr 172.21.15.12:0/2466925333 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe17fff640 1 --2- 172.21.15.12:0/2466925333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d39110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe15ffb640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbe040a3550 0x7fbe040a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/2466925333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 0x557f55d3ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe17fff640 1 -- 172.21.15.12:0/2466925333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 msgr2=0x557f55d3ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe17fff640 1 --2- 172.21.15.12:0/2466925333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 0x557f55d3ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe17fff640 1 -- 172.21.15.12:0/2466925333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d29f20 msgr2=0x557f55d2a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe17fff640 1 --2- 172.21.15.12:0/2466925333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d29f20 0x557f55d2a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe17fff640 1 -- 172.21.15.12:0/2466925333 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f55c27d40 con 0x557f55d2a840 2024-09-19T06:41:10.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/2466925333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d29f20 0x557f55d2a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:10.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe15ffb640 1 -- 172.21.15.12:0/1134475441 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbe100f10a0 con 0x7fbe18106f10 2024-09-19T06:41:10.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe1cb11640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbe040a3550 0x7fbe040a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.001+0000 7fbe17fff640 1 --2- 172.21.15.12:0/2466925333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d39110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe08004630 tx=0x7fbe0800bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fec3849fb177bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe0e7fc640 1 -- 172.21.15.12:0/2466925333 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08003bd0 con 0x557f55d2a840 2024-09-19T06:41:10.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe1cb11640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbe040a3550 0x7fbe040a5a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe100ee760 tx=0x7fbe1002f720 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe0e7fc640 1 -- 172.21.15.12:0/2466925333 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe08015070 con 0x557f55d2a840 2024-09-19T06:41:10.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe0e7fc640 1 -- 172.21.15.12:0/2466925333 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08004d90 con 0x557f55d2a840 2024-09-19T06:41:10.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe2094d740 1 -- 172.21.15.12:0/2466925333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 msgr2=0x557f55d39110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe2094d740 1 --2- 172.21.15.12:0/2466925333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d39110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe08004630 tx=0x7fbe0800bb20 comp rx=0 tx=0).stop 2024-09-19T06:41:10.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe2094d740 1 -- 172.21.15.12:0/2466925333 shutdown_connections 2024-09-19T06:41:10.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe2094d740 1 --2- 172.21.15.12:0/2466925333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 0x557f55d3ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe2094d740 1 --2- 172.21.15.12:0/2466925333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d39110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe2094d740 1 --2- 172.21.15.12:0/2466925333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d29f20 0x557f55d2a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe2094d740 1 -- 172.21.15.12:0/2466925333 >> 172.21.15.12:0/2466925333 conn(0x557f55d265f0 msgr2=0x557f55d269d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe2094d740 1 -- 172.21.15.12:0/2466925333 shutdown_connections 2024-09-19T06:41:10.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.002+0000 7fbe2094d740 1 -- 172.21.15.12:0/2466925333 wait complete. 2024-09-19T06:41:10.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe2094d740 1 -- start start 2024-09-19T06:41:10.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe2094d740 1 Processor -- start 2024-09-19T06:41:10.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d29f20 0x557f55d36590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d2a840 0x557f55d36ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 0x557f55d37010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe2094d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f55d3c220 con 0x557f55d2a840 2024-09-19T06:41:10.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe2094d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557f55c17f10 con 0x557f55d29f20 2024-09-19T06:41:10.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe2094d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557f55d3c3a0 con 0x557f55d39650 2024-09-19T06:41:10.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe2094d740 10 client.0 _ll_register_callbacks cb 0x557f55c3bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe17fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d2a840 0x557f55d36ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe17fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d2a840 0x557f55d36ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60014/0 (socket says 172.21.15.12:60014) 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe17fff640 1 -- 172.21.15.12:0/3940922305 learned_addr learned my addr 172.21.15.12:0/3940922305 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.003+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 0x557f55d37010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d29f20 0x557f55d36590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe17fff640 1 -- 172.21.15.12:0/3940922305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 msgr2=0x557f55d37010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe17fff640 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 0x557f55d37010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe17fff640 1 -- 172.21.15.12:0/3940922305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d29f20 msgr2=0x557f55d36590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe17fff640 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d29f20 0x557f55d36590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe17fff640 1 -- 172.21.15.12:0/3940922305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5599e580 con 0x557f55d2a840 2024-09-19T06:41:10.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 0x557f55d37010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:10.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe17fff640 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d2a840 0x557f55d36ad0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800bfd0 tx=0x7fbe080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc4a75c087dc8e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbdf77fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:10.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3940922305 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08028060 con 0x557f55d2a840 2024-09-19T06:41:10.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3940922305 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbe08011640 con 0x557f55d2a840 2024-09-19T06:41:10.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe2094d740 1 -- 172.21.15.12:0/3940922305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe08015070 con 0x557f55d2a840 2024-09-19T06:41:10.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3940922305 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbe08003e60 con 0x557f55d2a840 2024-09-19T06:41:10.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe2094d740 10 client.15792 fetch_fsmap learned FSMap version 30 2024-09-19T06:41:10.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbe2094d740 1 -- 172.21.15.12:0/3940922305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557f55a68960 con 0x557f55d2a840 2024-09-19T06:41:10.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.004+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3940922305 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe08015070 con 0x557f55d2a840 2024-09-19T06:41:10.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.005+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3940922305 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fbe08022070 con 0x557f55d2a840 2024-09-19T06:41:10.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.005+0000 7fbe2094d740 10 client.15792 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:41:10.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.005+0000 7fbe2094d740 10 client.15792 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:41:10.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.005+0000 7fbe2094d740 20 client.15792 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:10.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.005+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f55d49110 0x557f55d4b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.005+0000 7fbe2094d740 4 client.15792 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:10.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.005+0000 7fbe2094d740 1 -- 172.21.15.12:0/3940922305 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f55c9cb90 con 0x557f55d49110 2024-09-19T06:41:10.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.005+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f55d49110 0x557f55d4b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.005+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f55d49110 0x557f55d4b500 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cf719e811b13f23 server_cookie=a2d8f53c18374b93 in_seq=0 out_seq=0 2024-09-19T06:41:10.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.005+0000 7fbdf77fe640 10 client.15792 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:10.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3940922305 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f55c9cb90 con 0x557f55d49110 2024-09-19T06:41:10.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbdf77fe640 10 client.15792 handle_command_reply: tid=0 2024-09-19T06:41:10.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 client.15792 shutdown 2024-09-19T06:41:10.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 -- 172.21.15.12:0/3940922305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d2a840 msgr2=0x557f55d36ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d2a840 0x557f55d36ad0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800bfd0 tx=0x7fbe080046c0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 -- 172.21.15.12:0/3940922305 shutdown_connections 2024-09-19T06:41:10.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f55d49110 0x557f55d4b500 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbdf77fe640 0 client.15792 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:10.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d39650 0x557f55d37010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d2a840 0x557f55d36ad0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3940922305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d29f20 0x557f55d36590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 -- 172.21.15.12:0/3940922305 >> 172.21.15.12:0/3940922305 conn(0x557f55d265f0 msgr2=0x557f55d2c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 -- 172.21.15.12:0/3940922305 shutdown_connections 2024-09-19T06:41:10.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.006+0000 7fbe2094d740 1 -- 172.21.15.12:0/3940922305 wait complete. 2024-09-19T06:41:10.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.007+0000 7fbe2094d740 20 client.15792 trim_cache size 0 max 16384 2024-09-19T06:41:10.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe2094d740 1 Processor -- start 2024-09-19T06:41:10.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe2094d740 1 -- start start 2024-09-19T06:41:10.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d29f20 0x557f55d25a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d50b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d51070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe2094d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181ab7e0 con 0x557f55d39650 2024-09-19T06:41:10.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe2094d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181ad3e0 con 0x557f55d2a840 2024-09-19T06:41:10.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe2094d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181abeb0 con 0x557f55d29f20 2024-09-19T06:41:10.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d51070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d51070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60026/0 (socket says 172.21.15.12:60026) 2024-09-19T06:41:10.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe0ffff640 1 -- 172.21.15.12:0/4231134277 learned_addr learned my addr 172.21.15.12:0/4231134277 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:10.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/4231134277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d29f20 0x557f55d25a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe17fff640 1 --2- 172.21.15.12:0/4231134277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d50b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe0ffff640 1 -- 172.21.15.12:0/4231134277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d29f20 msgr2=0x557f55d25a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/4231134277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d29f20 0x557f55d25a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe0ffff640 1 -- 172.21.15.12:0/4231134277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 msgr2=0x557f55d50b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/4231134277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d50b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe0ffff640 1 -- 172.21.15.12:0/4231134277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f55d35540 con 0x557f55d39650 2024-09-19T06:41:10.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.024+0000 7fbe17fff640 1 --2- 172.21.15.12:0/4231134277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d50b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:10.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.025+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/4231134277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d51070 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000af20 tx=0x7fbe0000a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23219b695a3e4eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.025+0000 7fbe0dffb640 1 -- 172.21.15.12:0/4231134277 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0001c040 con 0x557f55d39650 2024-09-19T06:41:10.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.025+0000 7fbe0dffb640 1 -- 172.21.15.12:0/4231134277 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe00025070 con 0x557f55d39650 2024-09-19T06:41:10.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.025+0000 7fbe0dffb640 1 -- 172.21.15.12:0/4231134277 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00004a00 con 0x557f55d39650 2024-09-19T06:41:10.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.025+0000 7fbe2094d740 1 -- 172.21.15.12:0/4231134277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 msgr2=0x557f55d51070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.025+0000 7fbe2094d740 1 --2- 172.21.15.12:0/4231134277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d51070 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000af20 tx=0x7fbe0000a780 comp rx=0 tx=0).stop 2024-09-19T06:41:10.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 -- 172.21.15.12:0/4231134277 shutdown_connections 2024-09-19T06:41:10.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 --2- 172.21.15.12:0/4231134277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d51070 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 --2- 172.21.15.12:0/4231134277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d50b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 --2- 172.21.15.12:0/4231134277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d29f20 0x557f55d25a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 -- 172.21.15.12:0/4231134277 >> 172.21.15.12:0/4231134277 conn(0x557f55d265f0 msgr2=0x557f55d37df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 -- 172.21.15.12:0/4231134277 shutdown_connections 2024-09-19T06:41:10.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 -- 172.21.15.12:0/4231134277 wait complete. 2024-09-19T06:41:10.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 -- start start 2024-09-19T06:41:10.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 Processor -- start 2024-09-19T06:41:10.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d29f20 0x557f55d41ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d3de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d3e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.026+0000 7fbe2094d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181acc50 con 0x557f55d39650 2024-09-19T06:41:10.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe2094d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181ac580 con 0x557f55d2a840 2024-09-19T06:41:10.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe2094d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181a97c0 con 0x557f55d29f20 2024-09-19T06:41:10.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe2094d740 10 client.0 _ll_register_callbacks cb 0x7fbe08004290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:10.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d3e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d3e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60040/0 (socket says 172.21.15.12:60040) 2024-09-19T06:41:10.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe0ffff640 1 -- 172.21.15.12:0/3292841508 learned_addr learned my addr 172.21.15.12:0/3292841508 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:10.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe17fff640 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d3de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d29f20 0x557f55d41ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe0ffff640 1 -- 172.21.15.12:0/3292841508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d29f20 msgr2=0x557f55d41ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d29f20 0x557f55d41ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe0ffff640 1 -- 172.21.15.12:0/3292841508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 msgr2=0x557f55d3de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d3de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe0ffff640 1 -- 172.21.15.12:0/3292841508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f55d3e880 con 0x557f55d39650 2024-09-19T06:41:10.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe17fff640 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d3de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:10.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe0ffff640 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d3e340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbe00005600 tx=0x7fbe00005500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d04814e5189e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbdf77fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3292841508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000fd10 con 0x557f55d39650 2024-09-19T06:41:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3292841508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbe00004730 con 0x557f55d39650 2024-09-19T06:41:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.027+0000 7fbe2094d740 1 -- 172.21.15.12:0/3292841508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe00025070 con 0x557f55d39650 2024-09-19T06:41:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3292841508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbe00004970 con 0x557f55d39650 2024-09-19T06:41:10.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbe2094d740 10 client.15798 fetch_fsmap learned FSMap version 30 2024-09-19T06:41:10.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbe2094d740 1 -- 172.21.15.12:0/3292841508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557f55db47d0 con 0x557f55d39650 2024-09-19T06:41:10.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3292841508 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe00025070 con 0x557f55d39650 2024-09-19T06:41:10.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3292841508 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fbe0002a940 con 0x557f55d39650 2024-09-19T06:41:10.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbe2094d740 10 client.15798 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:41:10.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbe2094d740 10 client.15798 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:41:10.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbe2094d740 20 client.15798 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:10.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f55d49110 0x557f55db6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbe2094d740 4 client.15798 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "aa879d56", "release": true, "await": true}] 2024-09-19T06:41:10.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbe2094d740 1 -- 172.21.15.12:0/3292841508 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "aa879d56", "release": true, "await": true}) -- 0x557f55c970a0 con 0x557f55d49110 2024-09-19T06:41:10.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.028+0000 7fbe17fff640 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f55d49110 0x557f55db6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.029+0000 7fbe17fff640 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f55d49110 0x557f55db6fc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dcdb95fc354ca82 server_cookie=5a7b49443e229eb6 in_seq=0 out_seq=0 2024-09-19T06:41:10.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.029+0000 7fbdf77fe640 10 client.15798 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:10.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.080+0000 7fbdf77fe640 1 -- 172.21.15.12:0/3292841508 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fbe08015260 con 0x557f55d49110 2024-09-19T06:41:10.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.080+0000 7fbdf77fe640 10 client.15798 handle_command_reply: tid=0 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.080+0000 7fbe2094d740 1 client.15798 shutdown 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 1 -- 172.21.15.12:0/3292841508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 msgr2=0x557f55d3e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d3e340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbe00005600 tx=0x7fbe00005500 comp rx=0 tx=0).stop 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 1 -- 172.21.15.12:0/3292841508 shutdown_connections 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f55d49110 0x557f55db6fc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f55d39650 0x557f55d3e340 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f55d2a840 0x557f55d3de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 1 --2- 172.21.15.12:0/3292841508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f55d29f20 0x557f55d41ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbdf77fe640 0 client.15798 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 1 -- 172.21.15.12:0/3292841508 >> 172.21.15.12:0/3292841508 conn(0x557f55d265f0 msgr2=0x557f55d363b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 1 -- 172.21.15.12:0/3292841508 shutdown_connections 2024-09-19T06:41:10.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 1 -- 172.21.15.12:0/3292841508 wait complete. 2024-09-19T06:41:10.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.081+0000 7fbe2094d740 20 client.15798 trim_cache size 0 max 16384 2024-09-19T06:41:10.084 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:41:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 30, 2024-09-19T06:41:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:41:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 4, 2024-09-19T06:41:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:41:10.084 INFO:teuthology.orchestra.run.smithi012.stdout: "aa879d56": { 2024-09-19T06:41:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 4, 2024-09-19T06:41:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:41:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:41:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:41:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:41:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:41:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:41:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 131.2, 2024-09-19T06:41:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:41:10.085 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:41:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:41:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:41:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:41:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:41:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:10.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:10.086 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:41:10.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 -- 172.21.15.12:0/1134475441 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbe040a3550 msgr2=0x7fbe040a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbe040a3550 0x7fbe040a5a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe100ee760 tx=0x7fbe1002f720 comp rx=0 tx=0).stop 2024-09-19T06:41:10.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 -- 172.21.15.12:0/1134475441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe18106f10 msgr2=0x7fbe1819cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe18106f10 0x7fbe1819cc10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbe10031a20 tx=0x7fbe10031a50 comp rx=0 tx=0).stop 2024-09-19T06:41:10.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 -- 172.21.15.12:0/1134475441 shutdown_connections 2024-09-19T06:41:10.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe18106f10 0x7fbe1819cc10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbe040a3550 0x7fbe040a5a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe18102790 0x7fbe18198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 --2- 172.21.15.12:0/1134475441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe18101de0 0x7fbe18198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 -- 172.21.15.12:0/1134475441 >> 172.21.15.12:0/1134475441 conn(0x7fbe180fd8c0 msgr2=0x7fbe180fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 -- 172.21.15.12:0/1134475441 shutdown_connections 2024-09-19T06:41:10.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:10.082+0000 7fbe1e574640 1 -- 172.21.15.12:0/1134475441 wait complete. 2024-09-19T06:41:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 25.0 s, 84.9 tps, lat 2315.293 ms stddev 3841.963 2024-09-19T06:41:10.841 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'aa879d56', total seconds elapsed: 15.6 2024-09-19T06:41:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.858+0000 7fcb945fd640 1 -- 172.21.15.12:0/990300025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb8c1008e0 msgr2=0x7fcb8c10ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.858+0000 7fcb945fd640 1 --2- 172.21.15.12:0/990300025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb8c1008e0 0x7fcb8c10ea40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009900 tx=0x7fcb8402a410 comp rx=0 tx=0).stop 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.858+0000 7fcb945fd640 1 -- 172.21.15.12:0/990300025 shutdown_connections 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.858+0000 7fcb945fd640 1 --2- 172.21.15.12:0/990300025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb8c1008e0 0x7fcb8c10ea40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.858+0000 7fcb945fd640 1 --2- 172.21.15.12:0/990300025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c0fff60 0x7fcb8c1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.858+0000 7fcb945fd640 1 --2- 172.21.15.12:0/990300025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb8c103aa0 0x7fcb8c103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.858+0000 7fcb945fd640 1 -- 172.21.15.12:0/990300025 >> 172.21.15.12:0/990300025 conn(0x7fcb8c0770f0 msgr2=0x7fcb8c0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.858+0000 7fcb945fd640 1 -- 172.21.15.12:0/990300025 shutdown_connections 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.858+0000 7fcb945fd640 1 -- 172.21.15.12:0/990300025 wait complete. 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb945fd640 1 Processor -- start 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb945fd640 1 -- start start 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb945fd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb8c0fff60 0x7fcb8c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb945fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c1008e0 0x7fcb8c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb945fd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb8c103aa0 0x7fcb8c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb945fd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c112050 con 0x7fcb8c0fff60 2024-09-19T06:41:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb945fd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c111ed0 con 0x7fcb8c1008e0 2024-09-19T06:41:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb945fd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1121d0 con 0x7fcb8c103aa0 2024-09-19T06:41:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb92399640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb8c0fff60 0x7fcb8c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb92399640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb8c0fff60 0x7fcb8c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57340/0 (socket says 172.21.15.12:57340) 2024-09-19T06:41:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb92399640 1 -- 172.21.15.12:0/1434545935 learned_addr learned my addr 172.21.15.12:0/1434545935 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb91b98640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c1008e0 0x7fcb8c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb8c103aa0 0x7fcb8c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb92399640 1 -- 172.21.15.12:0/1434545935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb8c103aa0 msgr2=0x7fcb8c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb92399640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb8c103aa0 0x7fcb8c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb92399640 1 -- 172.21.15.12:0/1434545935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c1008e0 msgr2=0x7fcb8c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb92399640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c1008e0 0x7fcb8c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb92399640 1 -- 172.21.15.12:0/1434545935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8c19d470 con 0x7fcb8c0fff60 2024-09-19T06:41:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.859+0000 7fcb91b98640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c1008e0 0x7fcb8c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.860+0000 7fcb92399640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb8c0fff60 0x7fcb8c198480 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00ebc0 tx=0x7fcb7c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.860+0000 7fcb8b7fe640 1 -- 172.21.15.12:0/1434545935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c010630 con 0x7fcb8c0fff60 2024-09-19T06:41:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.860+0000 7fcb8b7fe640 1 -- 172.21.15.12:0/1434545935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb7c010cb0 con 0x7fcb8c0fff60 2024-09-19T06:41:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.860+0000 7fcb8b7fe640 1 -- 172.21.15.12:0/1434545935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c018bd0 con 0x7fcb8c0fff60 2024-09-19T06:41:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.860+0000 7fcb945fd640 1 -- 172.21.15.12:0/1434545935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8c19d760 con 0x7fcb8c0fff60 2024-09-19T06:41:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.860+0000 7fcb945fd640 1 -- 172.21.15.12:0/1434545935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8c1a4ff0 con 0x7fcb8c0fff60 2024-09-19T06:41:10.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.863+0000 7fcb8b7fe640 1 -- 172.21.15.12:0/1434545935 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7fcb7c0107d0 con 0x7fcb8c0fff60 2024-09-19T06:41:10.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.863+0000 7fcb9747c740 1 Processor -- start 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.863+0000 7fcb9747c740 1 -- start start 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.863+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002daf0 0x55b4a002ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.863+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 0x55b4a0038770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.863+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a0038cb0 0x55b4a003b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.863+0000 7fcb9747c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b49ff922f0 con 0x55b4a0038cb0 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.863+0000 7fcb9747c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b49ff3a270 con 0x55b4a002e410 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.863+0000 7fcb9747c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b49ff8e2b0 con 0x55b4a002daf0 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92b9a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002daf0 0x55b4a002ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92399640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 0x55b4a0038770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb91b98640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a0038cb0 0x55b4a003b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92b9a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002daf0 0x55b4a002ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:36458/0 (socket says 172.21.15.12:36458) 2024-09-19T06:41:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92b9a640 1 -- 172.21.15.12:0/2909394809 learned_addr learned my addr 172.21.15.12:0/2909394809 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92b9a640 1 -- 172.21.15.12:0/2909394809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 msgr2=0x55b4a0038770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/2909394809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 0x55b4a0038770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92b9a640 1 -- 172.21.15.12:0/2909394809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a0038cb0 msgr2=0x55b4a003b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/2909394809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a0038cb0 0x55b4a003b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb8b7fe640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb740a3580 0x7fcb740a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92b9a640 1 -- 172.21.15.12:0/2909394809 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b49ff39340 con 0x55b4a002daf0 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92399640 1 --2- 172.21.15.12:0/2909394809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 0x55b4a0038770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb8b7fe640 1 -- 172.21.15.12:0/1434545935 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcb7c0d05b0 con 0x7fcb8c0fff60 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/2909394809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002daf0 0x55b4a002ded0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb8402aa00 tx=0x7fcb84005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4774bd6ee4afdefb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb92399640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb740a3580 0x7fcb740a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.864+0000 7fcb88bfe640 1 -- 172.21.15.12:0/2909394809 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84040070 con 0x55b4a002daf0 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.865+0000 7fcb88bfe640 1 -- 172.21.15.12:0/2909394809 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb84004300 con 0x55b4a002daf0 2024-09-19T06:41:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.865+0000 7fcb88bfe640 1 -- 172.21.15.12:0/2909394809 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84035040 con 0x55b4a002daf0 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 -- 172.21.15.12:0/2909394809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002daf0 msgr2=0x55b4a002ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb92399640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb740a3580 0x7fcb740a5a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0cdb60 tx=0x7fcb7c0d6510 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 --2- 172.21.15.12:0/2909394809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002daf0 0x55b4a002ded0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb8402aa00 tx=0x7fcb84005c00 comp rx=0 tx=0).stop 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 -- 172.21.15.12:0/2909394809 shutdown_connections 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 --2- 172.21.15.12:0/2909394809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a0038cb0 0x55b4a003b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 --2- 172.21.15.12:0/2909394809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 0x55b4a0038770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 --2- 172.21.15.12:0/2909394809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002daf0 0x55b4a002ded0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 -- 172.21.15.12:0/2909394809 >> 172.21.15.12:0/2909394809 conn(0x55b4a002a060 msgr2=0x55b4a002a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 -- 172.21.15.12:0/2909394809 shutdown_connections 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 -- 172.21.15.12:0/2909394809 wait complete. 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 -- start start 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.866+0000 7fcb9747c740 1 Processor -- start 2024-09-19T06:41:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0035ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 0x55b4a00360e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 0x55b4a0036620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb9747c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b4a003b880 con 0x55b4a002daf0 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb9747c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b49ff1b290 con 0x55b4a0038cb0 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb9747c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b4a003ba00 con 0x55b4a002e410 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb9747c740 10 client.0 _ll_register_callbacks cb 0x55b49ff4c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb92b9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0035ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb92b9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0035ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57358/0 (socket says 172.21.15.12:57358) 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb92b9a640 1 -- 172.21.15.12:0/3678472694 learned_addr learned my addr 172.21.15.12:0/3678472694 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 0x55b4a0036620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb91b98640 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 0x55b4a00360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb92b9a640 1 -- 172.21.15.12:0/3678472694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 msgr2=0x55b4a00360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 0x55b4a00360e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb92b9a640 1 -- 172.21.15.12:0/3678472694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 msgr2=0x55b4a0035ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0035ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb92b9a640 1 -- 172.21.15.12:0/3678472694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b49fca5210 con 0x55b4a0038cb0 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.867+0000 7fcb91b98640 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 0x55b4a00360e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.868+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 0x55b4a0036620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb840096c0 tx=0x7fcb840046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b2284d881f79ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.868+0000 7fcb71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.868+0000 7fcb71ffb640 1 -- 172.21.15.12:0/3678472694 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84051060 con 0x55b4a0038cb0 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.868+0000 7fcb9747c740 1 -- 172.21.15.12:0/3678472694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb84004300 con 0x55b4a0038cb0 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.868+0000 7fcb71ffb640 1 -- 172.21.15.12:0/3678472694 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcb840315b0 con 0x55b4a0038cb0 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.868+0000 7fcb71ffb640 1 -- 172.21.15.12:0/3678472694 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcb84040030 con 0x55b4a0038cb0 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.868+0000 7fcb9747c740 10 client.25427 fetch_fsmap learned FSMap version 30 2024-09-19T06:41:10.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.868+0000 7fcb9747c740 1 -- 172.21.15.12:0/3678472694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b49fd71620 con 0x55b4a0038cb0 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.868+0000 7fcb71ffb640 1 -- 172.21.15.12:0/3678472694 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb84004300 con 0x55b4a0038cb0 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.868+0000 7fcb71ffb640 1 -- 172.21.15.12:0/3678472694 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fcb84004730 con 0x55b4a0038cb0 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.869+0000 7fcb9747c740 10 client.25427 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.869+0000 7fcb9747c740 10 client.25427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.869+0000 7fcb9747c740 20 client.25427 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.869+0000 7fcb9747c740 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4a0048a90 0x55b4a004ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.869+0000 7fcb9747c740 4 client.25427 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.869+0000 7fcb9747c740 1 -- 172.21.15.12:0/3678472694 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b49ff9fa20 con 0x55b4a0048a90 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.869+0000 7fcb91b98640 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4a0048a90 0x55b4a004ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.869+0000 7fcb91b98640 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4a0048a90 0x55b4a004ae80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b25b7406dad1e32a server_cookie=5d804826ac0236c8 in_seq=0 out_seq=0 2024-09-19T06:41:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.869+0000 7fcb71ffb640 10 client.25427 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:10.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb71ffb640 1 -- 172.21.15.12:0/3678472694 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b49ff9fa20 con 0x55b4a0048a90 2024-09-19T06:41:10.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb71ffb640 10 client.25427 handle_command_reply: tid=0 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 client.25427 shutdown 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 -- 172.21.15.12:0/3678472694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 msgr2=0x55b4a0036620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 0x55b4a0036620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb840096c0 tx=0x7fcb840046c0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 -- 172.21.15.12:0/3678472694 shutdown_connections 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4a0048a90 0x55b4a004ae80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 0x55b4a0036620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb71ffb640 0 client.25427 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 0x55b4a00360e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 --2- 172.21.15.12:0/3678472694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0035ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 -- 172.21.15.12:0/3678472694 >> 172.21.15.12:0/3678472694 conn(0x55b4a002a060 msgr2=0x55b4a002fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 -- 172.21.15.12:0/3678472694 shutdown_connections 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 1 -- 172.21.15.12:0/3678472694 wait complete. 2024-09-19T06:41:10.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.870+0000 7fcb9747c740 20 client.25427 trim_cache size 0 max 16384 2024-09-19T06:41:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb9747c740 1 Processor -- start 2024-09-19T06:41:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb9747c740 1 -- start start 2024-09-19T06:41:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0036450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 0x55b4a0050480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a0038cb0 0x55b4a00509c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb9747c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1ab830 con 0x55b4a002daf0 2024-09-19T06:41:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb9747c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1ad430 con 0x55b4a002e410 2024-09-19T06:41:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb9747c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1abf00 con 0x55b4a0038cb0 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb92b9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0036450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb92b9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0036450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57368/0 (socket says 172.21.15.12:57368) 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb92b9a640 1 -- 172.21.15.12:0/1721040730 learned_addr learned my addr 172.21.15.12:0/1721040730 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb91b98640 1 --2- 172.21.15.12:0/1721040730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 0x55b4a0050480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.888+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/1721040730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a0038cb0 0x55b4a00509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.889+0000 7fcb91b98640 1 -- 172.21.15.12:0/1721040730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a0038cb0 msgr2=0x55b4a00509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.889+0000 7fcb91b98640 1 --2- 172.21.15.12:0/1721040730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a0038cb0 0x55b4a00509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.889+0000 7fcb91b98640 1 -- 172.21.15.12:0/1721040730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 msgr2=0x55b4a0036450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.889+0000 7fcb91b98640 1 --2- 172.21.15.12:0/1721040730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0036450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.889+0000 7fcb91b98640 1 -- 172.21.15.12:0/1721040730 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4a002f070 con 0x55b4a002e410 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.889+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/1721040730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0036450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.889+0000 7fcb91b98640 1 --2- 172.21.15.12:0/1721040730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 0x55b4a0050480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55b4a00371e0 tx=0x7fcb80005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26bd1d6af8b8ecf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.889+0000 7fcb73fff640 1 -- 172.21.15.12:0/1721040730 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb80003ca0 con 0x55b4a002e410 2024-09-19T06:41:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.889+0000 7fcb73fff640 1 -- 172.21.15.12:0/1721040730 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb80003e40 con 0x55b4a002e410 2024-09-19T06:41:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.889+0000 7fcb73fff640 1 -- 172.21.15.12:0/1721040730 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb80010a90 con 0x55b4a002e410 2024-09-19T06:41:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.890+0000 7fcb9747c740 1 -- 172.21.15.12:0/1721040730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 msgr2=0x55b4a0050480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.890+0000 7fcb9747c740 1 --2- 172.21.15.12:0/1721040730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 0x55b4a0050480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55b4a00371e0 tx=0x7fcb80005f90 comp rx=0 tx=0).stop 2024-09-19T06:41:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.890+0000 7fcb9747c740 1 -- 172.21.15.12:0/1721040730 shutdown_connections 2024-09-19T06:41:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.890+0000 7fcb9747c740 1 --2- 172.21.15.12:0/1721040730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a0038cb0 0x55b4a00509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.890+0000 7fcb9747c740 1 --2- 172.21.15.12:0/1721040730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a002e410 0x55b4a0050480 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.890+0000 7fcb9747c740 1 --2- 172.21.15.12:0/1721040730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0036450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.890+0000 7fcb9747c740 1 -- 172.21.15.12:0/1721040730 >> 172.21.15.12:0/1721040730 conn(0x55b4a002a060 msgr2=0x55b4a0037c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.890+0000 7fcb9747c740 1 -- 172.21.15.12:0/1721040730 shutdown_connections 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.890+0000 7fcb9747c740 1 -- 172.21.15.12:0/1721040730 wait complete. 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.890+0000 7fcb9747c740 1 -- start start 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb9747c740 1 Processor -- start 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0041310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 0x55b4a003c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb9747c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 0x55b4a003cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb9747c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1acca0 con 0x55b4a002daf0 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb9747c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1ac5d0 con 0x55b4a0038cb0 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb9747c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1a9830 con 0x55b4a002e410 2024-09-19T06:41:10.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb9747c740 10 client.0 _ll_register_callbacks cb 0x7fcb7c0d63e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb92b9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0041310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb92b9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0041310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57378/0 (socket says 172.21.15.12:57378) 2024-09-19T06:41:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb92b9a640 1 -- 172.21.15.12:0/1554672254 learned_addr learned my addr 172.21.15.12:0/1554672254 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb91b98640 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 0x55b4a003c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 0x55b4a003cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb92b9a640 1 -- 172.21.15.12:0/1554672254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 msgr2=0x55b4a003c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 0x55b4a003c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb92b9a640 1 -- 172.21.15.12:0/1554672254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 msgr2=0x55b4a003cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:10.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 0x55b4a003cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb92b9a640 1 -- 172.21.15.12:0/1554672254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4a003d3a0 con 0x55b4a002daf0 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb92b9a640 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0041310 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcb8402a910 tx=0x7fcb84005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbe0c184f22d760 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.891+0000 7fcb71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb71ffb640 1 -- 172.21.15.12:0/1554672254 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8405c040 con 0x55b4a002daf0 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb71ffb640 1 -- 172.21.15.12:0/1554672254 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcb84004380 con 0x55b4a002daf0 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb9747c740 1 -- 172.21.15.12:0/1554672254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b49ff99d70 con 0x55b4a002daf0 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb71ffb640 1 -- 172.21.15.12:0/1554672254 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcb84067050 con 0x55b4a002daf0 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb9747c740 10 client.15816 fetch_fsmap learned FSMap version 30 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb9747c740 1 -- 172.21.15.12:0/1554672254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b4a00b33a0 con 0x55b4a002daf0 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb71ffb640 1 -- 172.21.15.12:0/1554672254 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b49ff99d70 con 0x55b4a002daf0 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb71ffb640 1 -- 172.21.15.12:0/1554672254 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fcb84060060 con 0x55b4a002daf0 2024-09-19T06:41:10.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb9747c740 10 client.15816 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:41:10.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb9747c740 10 client.15816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:10.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb9747c740 20 client.15816 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:10.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb9747c740 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4a00b3af0 0x55b4a00b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:10.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb9747c740 4 client.15816 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:41:10.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb9747c740 1 -- 172.21.15.12:0/1554672254 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b49ff16900 con 0x55b4a00b3af0 2024-09-19T06:41:10.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.892+0000 7fcb91b98640 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4a00b3af0 0x55b4a00b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:10.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.893+0000 7fcb91b98640 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4a00b3af0 0x55b4a00b5f10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17d065e30660f6b2 server_cookie=2e2e1888efe1e545 in_seq=0 out_seq=0 2024-09-19T06:41:10.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.893+0000 7fcb71ffb640 10 client.15816 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb71ffb640 1 -- 172.21.15.12:0/1554672254 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b49ff16900 con 0x55b4a00b3af0 2024-09-19T06:41:10.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb71ffb640 10 client.15816 handle_command_reply: tid=0 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb9747c740 1 client.15816 shutdown 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb9747c740 1 -- 172.21.15.12:0/1554672254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 msgr2=0x55b4a0041310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb9747c740 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0041310 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcb8402a910 tx=0x7fcb84005fd0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb9747c740 1 -- 172.21.15.12:0/1554672254 shutdown_connections 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb9747c740 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4a00b3af0 0x55b4a00b5f10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb9747c740 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4a0038cb0 0x55b4a003cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb71ffb640 0 client.15816 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb9747c740 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4a002e410 0x55b4a003c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb9747c740 1 --2- 172.21.15.12:0/1554672254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4a002daf0 0x55b4a0041310 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.942+0000 7fcb9747c740 1 -- 172.21.15.12:0/1554672254 >> 172.21.15.12:0/1554672254 conn(0x55b4a002a060 msgr2=0x55b4a002f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb9747c740 1 -- 172.21.15.12:0/1554672254 shutdown_connections 2024-09-19T06:41:10.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb9747c740 1 -- 172.21.15.12:0/1554672254 wait complete. 2024-09-19T06:41:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb9747c740 20 client.15816 trim_cache size 0 max 16384 2024-09-19T06:41:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:41:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:41:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:41:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb945fd640 1 -- 172.21.15.12:0/1434545935 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb740a3580 msgr2=0x7fcb740a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb945fd640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb740a3580 0x7fcb740a5a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0cdb60 tx=0x7fcb7c0d6510 comp rx=0 tx=0).stop 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb945fd640 1 -- 172.21.15.12:0/1434545935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb8c0fff60 msgr2=0x7fcb8c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb945fd640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb8c0fff60 0x7fcb8c198480 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00ebc0 tx=0x7fcb7c00c6a0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb945fd640 1 -- 172.21.15.12:0/1434545935 shutdown_connections 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb945fd640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb740a3580 0x7fcb740a5a40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb945fd640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb8c103aa0 0x7fcb8c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb945fd640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c1008e0 0x7fcb8c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb945fd640 1 --2- 172.21.15.12:0/1434545935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb8c0fff60 0x7fcb8c198480 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.943+0000 7fcb945fd640 1 -- 172.21.15.12:0/1434545935 >> 172.21.15.12:0/1434545935 conn(0x7fcb8c0770f0 msgr2=0x7fcb8c1059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:10.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.944+0000 7fcb945fd640 1 -- 172.21.15.12:0/1434545935 shutdown_connections 2024-09-19T06:41:10.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:10.944+0000 7fcb945fd640 1 -- 172.21.15.12:0/1434545935 wait complete. 2024-09-19T06:41:11.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:11 smithi016 ceph-mon[34911]: pgmap v34: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 6.9 MiB/s wr, 748 op/s 2024-09-19T06:41:11.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:11 smithi173 ceph-mon[35349]: pgmap v34: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 6.9 MiB/s wr, 748 op/s 2024-09-19T06:41:11.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:11 smithi012 ceph-mon[30937]: pgmap v34: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 6.9 MiB/s wr, 748 op/s 2024-09-19T06:41:13.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:13 smithi016 ceph-mon[34911]: pgmap v35: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.7 MiB/s wr, 365 op/s 2024-09-19T06:41:13.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:13 smithi173 ceph-mon[35349]: pgmap v35: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.7 MiB/s wr, 365 op/s 2024-09-19T06:41:13.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:13 smithi012 ceph-mon[30937]: pgmap v35: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.7 MiB/s wr, 365 op/s 2024-09-19T06:41:14.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:41:14.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:41:14.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:41:14.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:41:14.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:41:14.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:41:15.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:15 smithi016 ceph-mon[34911]: pgmap v36: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.7 MiB/s wr, 365 op/s 2024-09-19T06:41:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:15 smithi173 ceph-mon[35349]: pgmap v36: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.7 MiB/s wr, 365 op/s 2024-09-19T06:41:15.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:15 smithi012 ceph-mon[30937]: pgmap v36: 97 pgs: 97 active+clean; 953 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.7 MiB/s wr, 365 op/s 2024-09-19T06:41:15.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 30.0 s, 2044.4 tps, lat 49.805 ms stddev 109.614 2024-09-19T06:41:17.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:17 smithi016 ceph-mon[34911]: pgmap v37: 97 pgs: 97 active+clean; 983 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 41 MiB/s wr, 1.35k op/s 2024-09-19T06:41:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:17 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:17 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:41:17.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:17 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:41:17.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:17 smithi173 ceph-mon[35349]: pgmap v37: 97 pgs: 97 active+clean; 983 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 41 MiB/s wr, 1.35k op/s 2024-09-19T06:41:17.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:17 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:17.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:17 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:41:17.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:17 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:41:17.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:17 smithi012 ceph-mon[30937]: pgmap v37: 97 pgs: 97 active+clean; 983 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 41 MiB/s wr, 1.35k op/s 2024-09-19T06:41:17.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:17 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:17.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:17 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:41:17.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:17 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:41:18.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:18 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:18.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:18 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:18.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:18 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:41:18.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:18 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:18.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:18 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:18.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:18 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:41:18.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:18 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:18.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:18 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:18.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:18 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:41:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:19 smithi016 ceph-mon[34911]: pgmap v38: 97 pgs: 97 active+clean; 983 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 39 MiB/s wr, 1.07k op/s 2024-09-19T06:41:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:19 smithi173 ceph-mon[35349]: pgmap v38: 97 pgs: 97 active+clean; 983 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 39 MiB/s wr, 1.07k op/s 2024-09-19T06:41:20.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:19 smithi012 ceph-mon[30937]: pgmap v38: 97 pgs: 97 active+clean; 983 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 39 MiB/s wr, 1.07k op/s 2024-09-19T06:41:20.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 35.0 s, 5447.0 tps, lat 18.328 ms stddev 19.727 2024-09-19T06:41:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:21 smithi016 ceph-mon[34911]: pgmap v39: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 51 MiB/s wr, 1.59k op/s 2024-09-19T06:41:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:21 smithi173 ceph-mon[35349]: pgmap v39: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 51 MiB/s wr, 1.59k op/s 2024-09-19T06:41:22.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:21 smithi012 ceph-mon[30937]: pgmap v39: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 51 MiB/s wr, 1.59k op/s 2024-09-19T06:41:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.086+0000 7f0ce8742640 1 -- 172.21.15.12:0/503675664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ce0103f40 msgr2=0x7f0ce0104320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.086+0000 7f0ce8742640 1 --2- 172.21.15.12:0/503675664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ce0103f40 0x7f0ce0104320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009ca0 tx=0x7f0cd802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.087+0000 7f0ce8742640 1 -- 172.21.15.12:0/503675664 shutdown_connections 2024-09-19T06:41:24.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.087+0000 7f0ce8742640 1 --2- 172.21.15.12:0/503675664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ce0109090 0x7f0ce0110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.087+0000 7f0ce8742640 1 --2- 172.21.15.12:0/503675664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce01048f0 0x7f0ce0108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.087+0000 7f0ce8742640 1 --2- 172.21.15.12:0/503675664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ce0103f40 0x7f0ce0104320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.087+0000 7f0ce8742640 1 -- 172.21.15.12:0/503675664 >> 172.21.15.12:0/503675664 conn(0x7f0ce00ff970 msgr2=0x7f0ce0101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:24.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.087+0000 7f0ce8742640 1 -- 172.21.15.12:0/503675664 shutdown_connections 2024-09-19T06:41:24.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.087+0000 7f0ce8742640 1 -- 172.21.15.12:0/503675664 wait complete. 2024-09-19T06:41:24.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.088+0000 7f0ce8742640 1 Processor -- start 2024-09-19T06:41:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.089+0000 7f0ce8742640 1 -- start start 2024-09-19T06:41:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.089+0000 7f0ce8742640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ce0103f40 0x7f0ce0110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.089+0000 7f0ce8742640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce0109090 0x7f0ce010dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.089+0000 7f0ce8742640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ce010e010 0x7f0ce010e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.089+0000 7f0ce8742640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce01140c0 con 0x7f0ce0109090 2024-09-19T06:41:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.089+0000 7f0ce8742640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce0113f40 con 0x7f0ce010e010 2024-09-19T06:41:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.089+0000 7f0ce8742640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce0114240 con 0x7f0ce0103f40 2024-09-19T06:41:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.089+0000 7f0ce5cdd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce0109090 0x7f0ce010dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce5cdd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce0109090 0x7f0ce010dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45494/0 (socket says 172.21.15.12:45494) 2024-09-19T06:41:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/1718078810 learned_addr learned my addr 172.21.15.12:0/1718078810 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce64de640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ce0103f40 0x7f0ce0110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce6cdf640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ce010e010 0x7f0ce010e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/1718078810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ce0103f40 msgr2=0x7f0ce0110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ce0103f40 0x7f0ce0110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/1718078810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ce010e010 msgr2=0x7f0ce010e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ce010e010 0x7f0ce010e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/1718078810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce01aaff0 con 0x7f0ce0109090 2024-09-19T06:41:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce64de640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ce0103f40 0x7f0ce0110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.090+0000 7f0ce6cdf640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ce010e010 0x7f0ce010e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.091+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce0109090 0x7f0ce010dad0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc005fd0 tx=0x7f0cdc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.091+0000 7f0cd77fe640 1 -- 172.21.15.12:0/1718078810 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc017070 con 0x7f0ce0109090 2024-09-19T06:41:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.091+0000 7f0cd77fe640 1 -- 172.21.15.12:0/1718078810 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cdc009c30 con 0x7f0ce0109090 2024-09-19T06:41:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.091+0000 7f0cd77fe640 1 -- 172.21.15.12:0/1718078810 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc010460 con 0x7f0ce0109090 2024-09-19T06:41:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.091+0000 7f0ce8742640 1 -- 172.21.15.12:0/1718078810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce01ab2e0 con 0x7f0ce0109090 2024-09-19T06:41:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.091+0000 7f0ce8742640 1 -- 172.21.15.12:0/1718078810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce01ab7e0 con 0x7f0ce0109090 2024-09-19T06:41:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.096+0000 7f0ceb4d9740 1 Processor -- start 2024-09-19T06:41:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.097+0000 7f0cd77fe640 1 -- 172.21.15.12:0/1718078810 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f0cdc0035f0 con 0x7f0ce0109090 2024-09-19T06:41:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.098+0000 7f0ceb4d9740 1 -- start start 2024-09-19T06:41:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6171feed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6171ff410 0x55b617209770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b617209cb0 0x55b61720c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0ceb4d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b6171632f0 con 0x55b6171ff410 2024-09-19T06:41:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0ce6cdf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6171feed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0ce6cdf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6171feed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43258/0 (socket says 172.21.15.12:43258) 2024-09-19T06:41:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0ce6cdf640 1 -- 172.21.15.12:0/3191439457 learned_addr learned my addr 172.21.15.12:0/3191439457 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0cd77fe640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0ccc0a3760 0x7f0ccc0a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/3191439457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b617209cb0 0x55b61720c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0cd77fe640 1 -- 172.21.15.12:0/1718078810 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0cdc0cfb70 con 0x7f0ce0109090 2024-09-19T06:41:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.099+0000 7f0ceb4d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b61710b270 con 0x55b6171feaf0 2024-09-19T06:41:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.100+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3191439457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b61715f2b0 con 0x55b617209cb0 2024-09-19T06:41:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.100+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/3191439457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 msgr2=0x55b6171feed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.100+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/3191439457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6171feed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.100+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/3191439457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6171ff410 msgr2=0x55b617209770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:41:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.100+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/3191439457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6171ff410 0x55b617209770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.100+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/3191439457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b61710a340 con 0x55b617209cb0 2024-09-19T06:41:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.100+0000 7f0ce6cdf640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0ccc0a3760 0x7f0ccc0a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.101+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/3191439457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b617209cb0 0x55b61720c0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0cd060 tx=0x7f0cdc06e9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eca959e411f76ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.101+0000 7f0ce6cdf640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0ccc0a3760 0x7f0ccc0a5c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0005940 tx=0x7f0cd0004730 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.102+0000 7f0cd4ff9640 1 -- 172.21.15.12:0/3191439457 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc09de60 con 0x55b617209cb0 2024-09-19T06:41:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.103+0000 7f0cd4ff9640 1 -- 172.21.15.12:0/3191439457 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cdc0669f0 con 0x55b617209cb0 2024-09-19T06:41:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.104+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3191439457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b617209cb0 msgr2=0x55b61720c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.104+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3191439457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b617209cb0 0x55b61720c0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0cd060 tx=0x7f0cdc06e9d0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.104+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3191439457 shutdown_connections 2024-09-19T06:41:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.104+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3191439457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b617209cb0 0x55b61720c0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.104+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3191439457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6171ff410 0x55b617209770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.104+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3191439457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6171feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.104+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3191439457 >> 172.21.15.12:0/3191439457 conn(0x55b6171fb060 msgr2=0x55b6171fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:24.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.105+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3191439457 shutdown_connections 2024-09-19T06:41:24.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.105+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3191439457 wait complete. 2024-09-19T06:41:24.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.105+0000 7f0ceb4d9740 1 -- start start 2024-09-19T06:41:24.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.105+0000 7f0ceb4d9740 1 Processor -- start 2024-09-19T06:41:24.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.106+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 0x55b617206c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.106+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 0x55b617207170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.106+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b6172076b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.106+0000 7f0ceb4d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b61720c8d0 con 0x55b617209cb0 2024-09-19T06:41:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.106+0000 7f0ceb4d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b6170ec290 con 0x55b6171ff410 2024-09-19T06:41:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.106+0000 7f0ceb4d9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b61720ca50 con 0x55b6171feaf0 2024-09-19T06:41:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.106+0000 7f0ceb4d9740 10 client.0 _ll_register_callbacks cb 0x55b61711d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.109+0000 7f0ce64de640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 0x55b617206c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.109+0000 7f0ce5cdd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 0x55b617207170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.109+0000 7f0ce64de640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 0x55b617206c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49908/0 (socket says 172.21.15.12:49908) 2024-09-19T06:41:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.109+0000 7f0ce64de640 1 -- 172.21.15.12:0/3947820260 learned_addr learned my addr 172.21.15.12:0/3947820260 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.112+0000 7f0ce6cdf640 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b6172076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.114+0000 7f0ce6cdf640 1 -- 172.21.15.12:0/3947820260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 msgr2=0x55b617206c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.114+0000 7f0ce6cdf640 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 0x55b617206c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.114+0000 7f0ce6cdf640 1 -- 172.21.15.12:0/3947820260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 msgr2=0x55b617207170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.114+0000 7f0ce6cdf640 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 0x55b617207170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.114+0000 7f0ce6cdf640 1 -- 172.21.15.12:0/3947820260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b616e76210 con 0x55b617209cb0 2024-09-19T06:41:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.115+0000 7f0ce6cdf640 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b6172076b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0012f70 tx=0x7f0cd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4a723071f4929c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.115+0000 7f0cc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.115+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/3947820260 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0018070 con 0x55b617209cb0 2024-09-19T06:41:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.115+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/3947820260 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0cd000fd50 con 0x55b617209cb0 2024-09-19T06:41:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.115+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3947820260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cdc0669f0 con 0x55b617209cb0 2024-09-19T06:41:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.116+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/3947820260 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0cd0005020 con 0x55b617209cb0 2024-09-19T06:41:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.116+0000 7f0ceb4d9740 10 client.15825 fetch_fsmap learned FSMap version 30 2024-09-19T06:41:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.116+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3947820260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b616f42620 con 0x55b617209cb0 2024-09-19T06:41:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.117+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/3947820260 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cdc0669f0 con 0x55b617209cb0 2024-09-19T06:41:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.117+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/3947820260 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f0cd0027400 con 0x55b617209cb0 2024-09-19T06:41:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.117+0000 7f0ceb4d9740 10 client.15825 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:41:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.117+0000 7f0ceb4d9740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.117+0000 7f0ceb4d9740 20 client.15825 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.117+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b61722ae40 0x55b61722d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.117+0000 7f0ceb4d9740 4 client.15825 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.117+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3947820260 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b617170a20 con 0x55b61722ae40 2024-09-19T06:41:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.117+0000 7f0ce64de640 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b61722ae40 0x55b61722d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.118+0000 7f0ce64de640 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b61722ae40 0x55b61722d280 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3339a2fecd12528e server_cookie=4b1a5ba2b283f81b in_seq=0 out_seq=0 2024-09-19T06:41:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.118+0000 7f0cc9ffb640 10 client.15825 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.120+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/3947820260 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b617170a20 con 0x55b61722ae40 2024-09-19T06:41:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.120+0000 7f0cc9ffb640 10 client.15825 handle_command_reply: tid=0 2024-09-19T06:41:24.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.121+0000 7f0ceb4d9740 1 client.15825 shutdown 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.122+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3947820260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 msgr2=0x55b6172076b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.122+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b6172076b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0012f70 tx=0x7f0cd00046c0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.122+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3947820260 shutdown_connections 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.122+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b61722ae40 0x55b61722d280 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.122+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b6172076b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.122+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 0x55b617207170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.122+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3947820260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 0x55b617206c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.122+0000 7f0cc9ffb640 0 client.15825 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.122+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3947820260 >> 172.21.15.12:0/3947820260 conn(0x55b6171fb060 msgr2=0x55b617200dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.123+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3947820260 shutdown_connections 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.123+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3947820260 wait complete. 2024-09-19T06:41:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.124+0000 7f0ceb4d9740 20 client.15825 trim_cache size 0 max 16384 2024-09-19T06:41:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.151+0000 7f0ceb4d9740 1 Processor -- start 2024-09-19T06:41:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.151+0000 7f0ceb4d9740 1 -- start start 2024-09-19T06:41:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.151+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6172074e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.151+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171ff410 0x55b617200cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.151+0000 7f0ce64de640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6172074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.151+0000 7f0ce64de640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6172074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43284/0 (socket says 172.21.15.12:43284) 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.151+0000 7f0ce64de640 1 -- 172.21.15.12:0/3083130881 learned_addr learned my addr 172.21.15.12:0/3083130881 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.151+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3083130881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b617232b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.151+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/3083130881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171ff410 0x55b617200cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.152+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3083130881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc400ea20 con 0x55b617209cb0 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.152+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3083130881 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc4010620 con 0x55b6171feaf0 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.152+0000 7f0ce6cdf640 1 --2- 172.21.15.12:0/3083130881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b617232b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.152+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3083130881 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc400f0f0 con 0x55b6171ff410 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.152+0000 7f0ce64de640 1 -- 172.21.15.12:0/3083130881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171ff410 msgr2=0x55b617200cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.152+0000 7f0ce64de640 1 --2- 172.21.15.12:0/3083130881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171ff410 0x55b617200cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.152+0000 7f0ce64de640 1 -- 172.21.15.12:0/3083130881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 msgr2=0x55b617232b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.152+0000 7f0ce64de640 1 --2- 172.21.15.12:0/3083130881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b617232b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.152+0000 7f0ce64de640 1 -- 172.21.15.12:0/3083130881 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b617227710 con 0x55b6171feaf0 2024-09-19T06:41:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.154+0000 7f0ce64de640 1 --2- 172.21.15.12:0/3083130881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6172074e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8006010 tx=0x7f0cd8005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=370cb1e868b62279 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.155+0000 7f0ccbfff640 1 -- 172.21.15.12:0/3083130881 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd804c030 con 0x55b6171feaf0 2024-09-19T06:41:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.155+0000 7f0ccbfff640 1 -- 172.21.15.12:0/3083130881 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd8036040 con 0x55b6171feaf0 2024-09-19T06:41:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.156+0000 7f0ccbfff640 1 -- 172.21.15.12:0/3083130881 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd802f870 con 0x55b6171feaf0 2024-09-19T06:41:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.156+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3083130881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 msgr2=0x55b6172074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.156+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3083130881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6172074e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8006010 tx=0x7f0cd8005fa0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.157+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3083130881 shutdown_connections 2024-09-19T06:41:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.157+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3083130881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b617232b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.157+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3083130881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171ff410 0x55b617200cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.157+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/3083130881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171feaf0 0x55b6172074e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.157+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3083130881 >> 172.21.15.12:0/3083130881 conn(0x55b6171fb060 msgr2=0x55b6172005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.157+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3083130881 shutdown_connections 2024-09-19T06:41:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.157+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/3083130881 wait complete. 2024-09-19T06:41:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.157+0000 7f0ceb4d9740 1 -- start start 2024-09-19T06:41:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.157+0000 7f0ceb4d9740 1 Processor -- start 2024-09-19T06:41:24.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.158+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 0x55b61720db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.158+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 0x55b61720e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.158+0000 7f0ceb4d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b61720e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.158+0000 7f0ceb4d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc400fe90 con 0x55b617209cb0 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.158+0000 7f0ceb4d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc400f7c0 con 0x55b6171ff410 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.158+0000 7f0ceb4d9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc400ca00 con 0x55b6171feaf0 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.158+0000 7f0ceb4d9740 10 client.0 _ll_register_callbacks cb 0x7f0cd000cc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.158+0000 7f0ce5cdd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 0x55b61720e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.158+0000 7f0ce5cdd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 0x55b61720e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43300/0 (socket says 172.21.15.12:43300) 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.158+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/849980699 learned_addr learned my addr 172.21.15.12:0/849980699 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0ce6cdf640 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b61720e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0ce64de640 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 0x55b61720db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/849980699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 msgr2=0x55b61720db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 0x55b61720db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/849980699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 msgr2=0x55b61720e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:24.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b61720e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0ce5cdd640 1 -- 172.21.15.12:0/849980699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6172a5bf0 con 0x55b6171ff410 2024-09-19T06:41:24.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0ce5cdd640 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 0x55b61720e040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc097f80 tx=0x7f0cdc097ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5843a24a9f9aabd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:24.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0cc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:41:24.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/849980699 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc09de60 con 0x55b6171ff410 2024-09-19T06:41:24.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/849980699 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0cdc0ba270 con 0x55b6171ff410 2024-09-19T06:41:24.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.159+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/849980699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd8036040 con 0x55b6171ff410 2024-09-19T06:41:24.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.160+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/849980699 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0cdc0a4790 con 0x55b6171ff410 2024-09-19T06:41:24.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.160+0000 7f0ceb4d9740 10 client.25448 fetch_fsmap learned FSMap version 30 2024-09-19T06:41:24.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.160+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/849980699 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b6172a6ee0 con 0x55b6171ff410 2024-09-19T06:41:24.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.161+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/849980699 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd8036040 con 0x55b6171ff410 2024-09-19T06:41:24.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.161+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/849980699 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f0cdc09af70 con 0x55b6171ff410 2024-09-19T06:41:24.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.161+0000 7f0ceb4d9740 10 client.25448 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T06:41:24.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.161+0000 7f0ceb4d9740 10 client.25448 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:24.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.161+0000 7f0ceb4d9740 20 client.25448 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:24.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.161+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b6172a7690 0x55b6172a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:24.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.161+0000 7f0ceb4d9740 4 client.25448 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:41:24.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.161+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/849980699 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b61716ad70 con 0x55b6172a7690 2024-09-19T06:41:24.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.161+0000 7f0ce64de640 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b6172a7690 0x55b6172a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:24.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.161+0000 7f0cc9ffb640 10 client.25448 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:24.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.162+0000 7f0ce64de640 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b6172a7690 0x55b6172a9ab0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18ceb4d8f24bacd3 server_cookie=8a413e4159b9dccb in_seq=0 out_seq=0 2024-09-19T06:41:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.178+0000 7f0cc9ffb640 1 -- 172.21.15.12:0/849980699 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b61716ad70 con 0x55b6172a7690 2024-09-19T06:41:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.178+0000 7f0cc9ffb640 10 client.25448 handle_command_reply: tid=0 2024-09-19T06:41:24.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 client.25448 shutdown 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/849980699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 msgr2=0x55b61720e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 0x55b61720e040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc097f80 tx=0x7f0cdc097ec0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/849980699 shutdown_connections 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b6172a7690 0x55b6172a9ab0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b617209cb0 0x55b61720e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6171ff410 0x55b61720e040 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 --2- 172.21.15.12:0/849980699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6171feaf0 0x55b61720db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0cc9ffb640 0 client.25448 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/849980699 >> 172.21.15.12:0/849980699 conn(0x55b6171fb060 msgr2=0x55b617200dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/849980699 shutdown_connections 2024-09-19T06:41:24.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 1 -- 172.21.15.12:0/849980699 wait complete. 2024-09-19T06:41:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.179+0000 7f0ceb4d9740 20 client.25448 trim_cache size 0 max 16384 2024-09-19T06:41:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:41:24.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:41:24.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:41:24.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:41:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 -- 172.21.15.12:0/1718078810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0ccc0a3760 msgr2=0x7f0ccc0a5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0ccc0a3760 0x7f0ccc0a5c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0005940 tx=0x7f0cd0004730 comp rx=0 tx=0).stop 2024-09-19T06:41:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 -- 172.21.15.12:0/1718078810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce0109090 msgr2=0x7f0ce010dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce0109090 0x7f0ce010dad0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc005fd0 tx=0x7f0cdc00dde0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 -- 172.21.15.12:0/1718078810 shutdown_connections 2024-09-19T06:41:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ce010e010 0x7f0ce010e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ce0109090 0x7f0ce010dad0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0ccc0a3760 0x7f0ccc0a5c20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 --2- 172.21.15.12:0/1718078810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ce0103f40 0x7f0ce0110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:24.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 -- 172.21.15.12:0/1718078810 >> 172.21.15.12:0/1718078810 conn(0x7f0ce00ff970 msgr2=0x7f0ce0101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:24.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.183+0000 7f0ce8742640 1 -- 172.21.15.12:0/1718078810 shutdown_connections 2024-09-19T06:41:24.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:24.184+0000 7f0ce8742640 1 -- 172.21.15.12:0/1718078810 wait complete. 2024-09-19T06:41:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:23 smithi016 ceph-mon[34911]: pgmap v40: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 1.50k op/s 2024-09-19T06:41:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:23 smithi173 ceph-mon[35349]: pgmap v40: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 1.50k op/s 2024-09-19T06:41:24.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:23 smithi012 ceph-mon[30937]: pgmap v40: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 1.50k op/s 2024-09-19T06:41:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 40.0 s, 6445.0 tps, lat 15.544 ms stddev 16.009 2024-09-19T06:41:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:25 smithi012 ceph-mon[30937]: pgmap v41: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 1.50k op/s 2024-09-19T06:41:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:25 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:41:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:25 smithi016 ceph-mon[34911]: pgmap v41: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 1.50k op/s 2024-09-19T06:41:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:25 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:41:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:25 smithi173 ceph-mon[35349]: pgmap v41: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 1.50k op/s 2024-09-19T06:41:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:25 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:41:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:27 smithi016 ceph-mon[34911]: pgmap v42: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 57 MiB/s wr, 1.93k op/s 2024-09-19T06:41:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:27 smithi173 ceph-mon[35349]: pgmap v42: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 57 MiB/s wr, 1.93k op/s 2024-09-19T06:41:28.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:27 smithi012 ceph-mon[30937]: pgmap v42: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 57 MiB/s wr, 1.93k op/s 2024-09-19T06:41:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:29 smithi016 ceph-mon[34911]: pgmap v43: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 18 MiB/s wr, 943 op/s 2024-09-19T06:41:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:29 smithi173 ceph-mon[35349]: pgmap v43: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 18 MiB/s wr, 943 op/s 2024-09-19T06:41:30.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:29 smithi012 ceph-mon[30937]: pgmap v43: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 18 MiB/s wr, 943 op/s 2024-09-19T06:41:30.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 45.0 s, 6211.5 tps, lat 16.096 ms stddev 16.107 2024-09-19T06:41:31.642 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T06:41:31.643 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T06:41:31.643 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:41:32.092 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:32.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:31 smithi012 ceph-mon[30937]: pgmap v44: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 24 MiB/s wr, 1.36k op/s 2024-09-19T06:41:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:31 smithi016 ceph-mon[34911]: pgmap v44: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 24 MiB/s wr, 1.36k op/s 2024-09-19T06:41:32.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:31 smithi173 ceph-mon[35349]: pgmap v44: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 24 MiB/s wr, 1.36k op/s 2024-09-19T06:41:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.699+0000 7f4e6c457640 1 -- 172.21.15.12:0/3937041547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e64101de0 msgr2=0x7f4e641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.699+0000 7f4e6c457640 1 --2- 172.21.15.12:0/3937041547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e64101de0 0x7f4e641021c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c013f30 tx=0x7f4e5c032c60 comp rx=0 tx=0).stop 2024-09-19T06:41:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.700+0000 7f4e6c457640 1 -- 172.21.15.12:0/3937041547 shutdown_connections 2024-09-19T06:41:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.700+0000 7f4e6c457640 1 --2- 172.21.15.12:0/3937041547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e64106f10 0x7f4e6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.700+0000 7f4e6c457640 1 --2- 172.21.15.12:0/3937041547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e64102790 0x7f4e641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.700+0000 7f4e6c457640 1 --2- 172.21.15.12:0/3937041547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e64101de0 0x7f4e641021c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.700+0000 7f4e6c457640 1 -- 172.21.15.12:0/3937041547 >> 172.21.15.12:0/3937041547 conn(0x7f4e640fd880 msgr2=0x7f4e640ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.700+0000 7f4e6c457640 1 -- 172.21.15.12:0/3937041547 shutdown_connections 2024-09-19T06:41:32.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.700+0000 7f4e6c457640 1 -- 172.21.15.12:0/3937041547 wait complete. 2024-09-19T06:41:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.702+0000 7f4e6c457640 1 Processor -- start 2024-09-19T06:41:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.702+0000 7f4e6c457640 1 -- start start 2024-09-19T06:41:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.702+0000 7f4e6c457640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e64101de0 0x7f4e641a7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.702+0000 7f4e6c457640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e64102790 0x7f4e641a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.702+0000 7f4e6c457640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e64106f10 0x7f4e641abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.702+0000 7f4e6a1f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e64101de0 0x7f4e641a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.702+0000 7f4e6a1f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e64101de0 0x7f4e641a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50144/0 (socket says 172.21.15.12:50144) 2024-09-19T06:41:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.703+0000 7f4e699f2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e64102790 0x7f4e641a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.703+0000 7f4e6a1f3640 1 -- 172.21.15.12:0/1130611271 learned_addr learned my addr 172.21.15.12:0/1130611271 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.703+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4e64120e00 con 0x7f4e64101de0 2024-09-19T06:41:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.703+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4e64120c80 con 0x7f4e64102790 2024-09-19T06:41:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.703+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4e64120f80 con 0x7f4e64106f10 2024-09-19T06:41:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.703+0000 7f4e6a9f4640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e64106f10 0x7f4e641abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:32.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.704+0000 7f4e699f2640 1 -- 172.21.15.12:0/1130611271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e64106f10 msgr2=0x7f4e641abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:32.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.704+0000 7f4e699f2640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e64106f10 0x7f4e641abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:32.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.704+0000 7f4e699f2640 1 -- 172.21.15.12:0/1130611271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e64101de0 msgr2=0x7f4e641a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.704+0000 7f4e699f2640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e64101de0 0x7f4e641a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.704+0000 7f4e699f2640 1 -- 172.21.15.12:0/1130611271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e641ac1b0 con 0x7f4e64102790 2024-09-19T06:41:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.704+0000 7f4e699f2640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e64102790 0x7f4e641a7740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400d930 tx=0x7f4e5400dd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.705+0000 7f4e5b7fe640 1 -- 172.21.15.12:0/1130611271 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400cac0 con 0x7f4e64102790 2024-09-19T06:41:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.705+0000 7f4e5b7fe640 1 -- 172.21.15.12:0/1130611271 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e54005500 con 0x7f4e64102790 2024-09-19T06:41:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.705+0000 7f4e5b7fe640 1 -- 172.21.15.12:0/1130611271 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e54015410 con 0x7f4e64102790 2024-09-19T06:41:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.705+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e641ac4a0 con 0x7f4e64102790 2024-09-19T06:41:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.705+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e641b3d80 con 0x7f4e64102790 2024-09-19T06:41:32.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.707+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e641021c0 con 0x7f4e64102790 2024-09-19T06:41:32.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.710+0000 7f4e5b7fe640 1 -- 172.21.15.12:0/1130611271 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f4e54004f50 con 0x7f4e64102790 2024-09-19T06:41:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.711+0000 7f4e5b7fe640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4e500a3660 0x7f4e500a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.711+0000 7f4e5b7fe640 1 -- 172.21.15.12:0/1130611271 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4e540cf8b0 con 0x7f4e64102790 2024-09-19T06:41:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.712+0000 7f4e6a1f3640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4e500a3660 0x7f4e500a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:32.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.713+0000 7f4e6a1f3640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4e500a3660 0x7f4e500a5b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c013cf0 tx=0x7f4e5c000f40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:32.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:32.714+0000 7f4e5b7fe640 1 -- 172.21.15.12:0/1130611271 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4e5409c0d0 con 0x7f4e64102790 2024-09-19T06:41:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.157+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e6402d7c0 con 0x7f4e64102790 2024-09-19T06:41:33.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:41:33.160 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"btime":"2024-09-19T06:41:24:903521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:41:24.405002+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:41:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2024-09-19T06:41:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.158+0000 7f4e5b7fe640 1 -- 172.21.15.12:0/1130611271 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11979 (secure 0 0 0) 0x7f4e5409c0d0 con 0x7f4e64102790 2024-09-19T06:41:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.162+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4e500a3660 msgr2=0x7f4e500a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.162+0000 7f4e6c457640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4e500a3660 0x7f4e500a5b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c013cf0 tx=0x7f4e5c000f40 comp rx=0 tx=0).stop 2024-09-19T06:41:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.163+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e64102790 msgr2=0x7f4e641a7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.163+0000 7f4e6c457640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e64102790 0x7f4e641a7740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400d930 tx=0x7f4e5400dd30 comp rx=0 tx=0).stop 2024-09-19T06:41:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.163+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 shutdown_connections 2024-09-19T06:41:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.163+0000 7f4e6c457640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4e500a3660 0x7f4e500a5b20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.163+0000 7f4e6c457640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e64106f10 0x7f4e641abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.163+0000 7f4e6c457640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e64102790 0x7f4e641a7740 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.163+0000 7f4e6c457640 1 --2- 172.21.15.12:0/1130611271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e64101de0 0x7f4e641a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.163+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 >> 172.21.15.12:0/1130611271 conn(0x7f4e640fd880 msgr2=0x7f4e640feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.163+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 shutdown_connections 2024-09-19T06:41:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:33.163+0000 7f4e6c457640 1 -- 172.21.15.12:0/1130611271 wait complete. 2024-09-19T06:41:34.083 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T06:41:34.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T06:41:34.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:33 smithi016 ceph-mon[34911]: pgmap v45: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-09-19T06:41:34.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:33 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1130611271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:34.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:33 smithi173 ceph-mon[35349]: pgmap v45: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-09-19T06:41:34.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:33 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1130611271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:34.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:33 smithi012 ceph-mon[30937]: pgmap v45: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-09-19T06:41:34.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:33 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1130611271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:34.538 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:35.233 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:34 smithi173 ceph-mon[35349]: pgmap v46: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-09-19T06:41:35.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:34 smithi016 ceph-mon[34911]: pgmap v46: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-09-19T06:41:35.295 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:34 smithi012 ceph-mon[30937]: pgmap v46: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-09-19T06:41:35.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.451+0000 7fe39754e640 1 -- 172.21.15.12:0/2118448040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe390106f10 msgr2=0x7fe39010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:35.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.451+0000 7fe39754e640 1 --2- 172.21.15.12:0/2118448040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe390106f10 0x7fe39010ea90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe388009be0 tx=0x7fe38802a710 comp rx=0 tx=0).stop 2024-09-19T06:41:35.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.452+0000 7fe39754e640 1 -- 172.21.15.12:0/2118448040 shutdown_connections 2024-09-19T06:41:35.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.452+0000 7fe39754e640 1 --2- 172.21.15.12:0/2118448040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe390106f10 0x7fe39010ea90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.452+0000 7fe39754e640 1 --2- 172.21.15.12:0/2118448040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe390102790 0x7fe3901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.452+0000 7fe39754e640 1 --2- 172.21.15.12:0/2118448040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe390101de0 0x7fe3901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.452+0000 7fe39754e640 1 -- 172.21.15.12:0/2118448040 >> 172.21.15.12:0/2118448040 conn(0x7fe3900fd8e0 msgr2=0x7fe3900ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:35.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.452+0000 7fe39754e640 1 -- 172.21.15.12:0/2118448040 shutdown_connections 2024-09-19T06:41:35.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.452+0000 7fe39754e640 1 -- 172.21.15.12:0/2118448040 wait complete. 2024-09-19T06:41:35.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.453+0000 7fe39754e640 1 Processor -- start 2024-09-19T06:41:35.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.454+0000 7fe39754e640 1 -- start start 2024-09-19T06:41:35.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.454+0000 7fe39754e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe390101de0 0x7fe39019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.454+0000 7fe39754e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe390102790 0x7fe39019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.454+0000 7fe39754e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe390106f10 0x7fe39019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.454+0000 7fe39754e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe390111f70 con 0x7fe390106f10 2024-09-19T06:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.454+0000 7fe395aeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe390106f10 0x7fe39019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.455+0000 7fe395aeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe390106f10 0x7fe39019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50160/0 (socket says 172.21.15.12:50160) 2024-09-19T06:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.455+0000 7fe395aeb640 1 -- 172.21.15.12:0/561746117 learned_addr learned my addr 172.21.15.12:0/561746117 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.455+0000 7fe39754e640 1 -- 172.21.15.12:0/561746117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe390111df0 con 0x7fe390101de0 2024-09-19T06:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.455+0000 7fe39754e640 1 -- 172.21.15.12:0/561746117 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe3901120f0 con 0x7fe390102790 2024-09-19T06:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.455+0000 7fe394ae9640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe390102790 0x7fe39019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.455+0000 7fe3952ea640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe390101de0 0x7fe39019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.456+0000 7fe394ae9640 1 -- 172.21.15.12:0/561746117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe390101de0 msgr2=0x7fe39019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.456+0000 7fe394ae9640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe390101de0 0x7fe39019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.456+0000 7fe394ae9640 1 -- 172.21.15.12:0/561746117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe390106f10 msgr2=0x7fe39019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.456+0000 7fe394ae9640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe390106f10 0x7fe39019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.456+0000 7fe394ae9640 1 -- 172.21.15.12:0/561746117 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39019f540 con 0x7fe390102790 2024-09-19T06:41:35.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.458+0000 7fe394ae9640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe390102790 0x7fe39019aad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe38000d6d0 tx=0x7fe38000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.458+0000 7fe3867fc640 1 -- 172.21.15.12:0/561746117 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe380017070 con 0x7fe390102790 2024-09-19T06:41:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.458+0000 7fe3867fc640 1 -- 172.21.15.12:0/561746117 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe380009820 con 0x7fe390102790 2024-09-19T06:41:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.459+0000 7fe39754e640 1 -- 172.21.15.12:0/561746117 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39019f830 con 0x7fe390102790 2024-09-19T06:41:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.459+0000 7fe39754e640 1 -- 172.21.15.12:0/561746117 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3901a7110 con 0x7fe390102790 2024-09-19T06:41:35.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.459+0000 7fe3867fc640 1 -- 172.21.15.12:0/561746117 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe380004d00 con 0x7fe390102790 2024-09-19T06:41:35.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.465+0000 7fe399927740 1 Processor -- start 2024-09-19T06:41:35.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.466+0000 7fe3867fc640 1 -- 172.21.15.12:0/561746117 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7fe380010670 con 0x7fe390102790 2024-09-19T06:41:35.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.466+0000 7fe399927740 1 -- start start 2024-09-19T06:41:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.466+0000 7fe399927740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 0x556d66b2ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe399927740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b2b170 0x556d66b354f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe399927740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b35a30 0x556d66b37e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe399927740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556d66a8f160 con 0x556d66b2a850 2024-09-19T06:41:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe395aeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 0x556d66b2ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe395aeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 0x556d66b2ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50172/0 (socket says 172.21.15.12:50172) 2024-09-19T06:41:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe395aeb640 1 -- 172.21.15.12:0/639101737 learned_addr learned my addr 172.21.15.12:0/639101737 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe399927740 1 -- 172.21.15.12:0/639101737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556d66a36720 con 0x556d66b2b170 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe394ae9640 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b35a30 0x556d66b37e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe3952ea640 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b2b170 0x556d66b354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe399927740 1 -- 172.21.15.12:0/639101737 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556d66a8b120 con 0x556d66b35a30 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.467+0000 7fe3867fc640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe37c0a36a0 0x7fe37c0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.468+0000 7fe3867fc640 1 -- 172.21.15.12:0/561746117 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fe3800cfa10 con 0x7fe390102790 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.468+0000 7fe395aeb640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe37c0a36a0 0x7fe37c0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.468+0000 7fe3952ea640 1 -- 172.21.15.12:0/639101737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b35a30 msgr2=0x556d66b37e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.468+0000 7fe3952ea640 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b35a30 0x556d66b37e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.468+0000 7fe3952ea640 1 -- 172.21.15.12:0/639101737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 msgr2=0x556d66b2ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.468+0000 7fe3952ea640 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 0x556d66b2ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.468+0000 7fe3952ea640 1 -- 172.21.15.12:0/639101737 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d66800ba0 con 0x556d66b2b170 2024-09-19T06:41:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.468+0000 7fe394ae9640 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b35a30 0x556d66b37e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.468+0000 7fe395aeb640 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 0x556d66b2ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.468+0000 7fe3952ea640 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b2b170 0x556d66b354f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe38c004600 tx=0x7fe38c00bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3271ec6fe0ec5f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.469+0000 7fe395aeb640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe37c0a36a0 0x7fe37c0a5b60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3880099a0 tx=0x7fe38802a710 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.469+0000 7fe37b7fe640 1 -- 172.21.15.12:0/639101737 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c003da0 con 0x556d66b2b170 2024-09-19T06:41:35.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.469+0000 7fe37b7fe640 1 -- 172.21.15.12:0/639101737 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe38c015070 con 0x556d66b2b170 2024-09-19T06:41:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.469+0000 7fe37b7fe640 1 -- 172.21.15.12:0/639101737 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c011680 con 0x556d66b2b170 2024-09-19T06:41:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.470+0000 7fe399927740 1 -- 172.21.15.12:0/639101737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b2b170 msgr2=0x556d66b354f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.470+0000 7fe399927740 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b2b170 0x556d66b354f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe38c004600 tx=0x7fe38c00bb20 comp rx=0 tx=0).stop 2024-09-19T06:41:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.471+0000 7fe399927740 1 -- 172.21.15.12:0/639101737 shutdown_connections 2024-09-19T06:41:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.471+0000 7fe399927740 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b35a30 0x556d66b37e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.471+0000 7fe399927740 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b2b170 0x556d66b354f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.471+0000 7fe399927740 1 --2- 172.21.15.12:0/639101737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 0x556d66b2ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.471+0000 7fe399927740 1 -- 172.21.15.12:0/639101737 >> 172.21.15.12:0/639101737 conn(0x556d66b26de0 msgr2=0x556d66b271c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.471+0000 7fe399927740 1 -- 172.21.15.12:0/639101737 shutdown_connections 2024-09-19T06:41:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.471+0000 7fe399927740 1 -- 172.21.15.12:0/639101737 wait complete. 2024-09-19T06:41:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.472+0000 7fe399927740 1 -- start start 2024-09-19T06:41:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.472+0000 7fe399927740 1 Processor -- start 2024-09-19T06:41:35.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.475+0000 7fe399927740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b2a850 0x556d66b32960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.475+0000 7fe399927740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 0x556d66b32ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.475+0000 7fe399927740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b35a30 0x556d66b333e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.475+0000 7fe399927740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556d66b38600 con 0x556d66b35a30 2024-09-19T06:41:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.475+0000 7fe399927740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556d66a17900 con 0x556d66b2a850 2024-09-19T06:41:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.475+0000 7fe399927740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556d66b38780 con 0x556d66b2b170 2024-09-19T06:41:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.475+0000 7fe394ae9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 0x556d66b32ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.475+0000 7fe394ae9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 0x556d66b32ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:50468/0 (socket says 172.21.15.12:50468) 2024-09-19T06:41:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.475+0000 7fe394ae9640 1 -- 172.21.15.12:0/4265695210 learned_addr learned my addr 172.21.15.12:0/4265695210 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.475+0000 7fe399927740 10 client.0 _ll_register_callbacks cb 0x556d66a15780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.476+0000 7fe394ae9640 1 -- 172.21.15.12:0/4265695210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b2a850 msgr2=0x556d66b32960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.476+0000 7fe394ae9640 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b2a850 0x556d66b32960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.476+0000 7fe394ae9640 1 -- 172.21.15.12:0/4265695210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b35a30 msgr2=0x556d66b333e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.476+0000 7fe394ae9640 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b35a30 0x556d66b333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.476+0000 7fe394ae9640 1 -- 172.21.15.12:0/4265695210 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d66a57c50 con 0x556d66b2b170 2024-09-19T06:41:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.483+0000 7fe394ae9640 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 0x556d66b32ea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe380098440 tx=0x7fe38009b3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e65feb24ad11647e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.484+0000 7fe378ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:41:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.485+0000 7fe378ff9640 1 -- 172.21.15.12:0/4265695210 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3800b4060 con 0x556d66b2b170 2024-09-19T06:41:35.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.485+0000 7fe378ff9640 1 -- 172.21.15.12:0/4265695210 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fe3800cd1e0 con 0x556d66b2b170 2024-09-19T06:41:35.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.487+0000 7fe399927740 1 -- 172.21.15.12:0/4265695210 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe38c015070 con 0x556d66b2b170 2024-09-19T06:41:35.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.488+0000 7fe378ff9640 1 -- 172.21.15.12:0/4265695210 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe380020040 con 0x556d66b2b170 2024-09-19T06:41:35.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.488+0000 7fe399927740 10 client.25477 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:35.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.488+0000 7fe399927740 1 -- 172.21.15.12:0/4265695210 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556d66b5dbd0 con 0x556d66b2b170 2024-09-19T06:41:35.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.491+0000 7fe378ff9640 1 -- 172.21.15.12:0/4265695210 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe38009fd70 con 0x556d66b2b170 2024-09-19T06:41:35.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.491+0000 7fe378ff9640 1 -- 172.21.15.12:0/4265695210 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fe38009aec0 con 0x556d66b2b170 2024-09-19T06:41:35.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.491+0000 7fe399927740 10 client.25477 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:35.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.491+0000 7fe399927740 10 client.25477 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:41:35.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.491+0000 7fe399927740 20 client.25477 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:35.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.491+0000 7fe399927740 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556d66b5efa0 0x556d66b61440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.491+0000 7fe399927740 4 client.25477 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:35.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.491+0000 7fe399927740 1 -- 172.21.15.12:0/4265695210 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe38c015070 con 0x556d66b5efa0 2024-09-19T06:41:35.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.493+0000 7fe3952ea640 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556d66b5efa0 0x556d66b61440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.499+0000 7fe3952ea640 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556d66b5efa0 0x556d66b61440 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18522c1c14536eb1 server_cookie=92ee7725ffe9453e in_seq=0 out_seq=0 2024-09-19T06:41:35.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.500+0000 7fe378ff9640 10 client.25477 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:35.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.500+0000 7fe378ff9640 1 -- 172.21.15.12:0/4265695210 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe38c027e80 con 0x556d66b5efa0 2024-09-19T06:41:35.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.500+0000 7fe378ff9640 10 client.25477 handle_command_reply: tid=0 2024-09-19T06:41:35.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.500+0000 7fe399927740 1 client.25477 shutdown 2024-09-19T06:41:35.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.500+0000 7fe399927740 1 -- 172.21.15.12:0/4265695210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 msgr2=0x556d66b32ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:35.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.500+0000 7fe399927740 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 0x556d66b32ea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe380098440 tx=0x7fe38009b3d0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.501+0000 7fe399927740 1 -- 172.21.15.12:0/4265695210 shutdown_connections 2024-09-19T06:41:35.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.501+0000 7fe399927740 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556d66b5efa0 0x556d66b61440 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.501+0000 7fe399927740 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b35a30 0x556d66b333e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.501+0000 7fe399927740 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 0x556d66b32ea0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.501+0000 7fe399927740 1 --2- 172.21.15.12:0/4265695210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b2a850 0x556d66b32960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.501+0000 7fe399927740 1 -- 172.21.15.12:0/4265695210 >> 172.21.15.12:0/4265695210 conn(0x556d66b26de0 msgr2=0x556d66b2cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:35.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.501+0000 7fe378ff9640 0 client.25477 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:35.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.501+0000 7fe399927740 1 -- 172.21.15.12:0/4265695210 shutdown_connections 2024-09-19T06:41:35.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.502+0000 7fe399927740 1 -- 172.21.15.12:0/4265695210 wait complete. 2024-09-19T06:41:35.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.502+0000 7fe399927740 20 client.25477 trim_cache size 0 max 16384 2024-09-19T06:41:35.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.533+0000 7fe399927740 1 Processor -- start 2024-09-19T06:41:35.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.533+0000 7fe399927740 1 -- start start 2024-09-19T06:41:35.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.533+0000 7fe399927740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2a850 0x556d66b2d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.533+0000 7fe399927740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2b170 0x556d66b31290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.533+0000 7fe399927740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b66d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.533+0000 7fe399927740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe3900702f0 con 0x556d66b2b170 2024-09-19T06:41:35.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.533+0000 7fe399927740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe390071f20 con 0x556d66b35a30 2024-09-19T06:41:35.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.533+0000 7fe399927740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe3900709c0 con 0x556d66b2a850 2024-09-19T06:41:35.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.534+0000 7fe3952ea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2a850 0x556d66b2d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.534+0000 7fe3952ea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2a850 0x556d66b2d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:50474/0 (socket says 172.21.15.12:50474) 2024-09-19T06:41:35.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.534+0000 7fe3952ea640 1 -- 172.21.15.12:0/3914940199 learned_addr learned my addr 172.21.15.12:0/3914940199 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:35.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.534+0000 7fe395aeb640 1 --2- 172.21.15.12:0/3914940199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b66d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.534+0000 7fe394ae9640 1 --2- 172.21.15.12:0/3914940199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2b170 0x556d66b31290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.534+0000 7fe395aeb640 1 -- 172.21.15.12:0/3914940199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2a850 msgr2=0x556d66b2d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:35.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.534+0000 7fe395aeb640 1 --2- 172.21.15.12:0/3914940199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2a850 0x556d66b2d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.534+0000 7fe395aeb640 1 -- 172.21.15.12:0/3914940199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2b170 msgr2=0x556d66b31290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:35.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.534+0000 7fe395aeb640 1 --2- 172.21.15.12:0/3914940199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2b170 0x556d66b31290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.534+0000 7fe395aeb640 1 -- 172.21.15.12:0/3914940199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d66b2e390 con 0x556d66b35a30 2024-09-19T06:41:35.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.535+0000 7fe395aeb640 1 --2- 172.21.15.12:0/3914940199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b66d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe388030600 tx=0x7fe388030b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da1b1d8d6bf9639d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:35.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.535+0000 7fe37affd640 1 -- 172.21.15.12:0/3914940199 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388036070 con 0x556d66b35a30 2024-09-19T06:41:35.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.535+0000 7fe37affd640 1 -- 172.21.15.12:0/3914940199 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe388051070 con 0x556d66b35a30 2024-09-19T06:41:35.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.535+0000 7fe37affd640 1 -- 172.21.15.12:0/3914940199 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3880046f0 con 0x556d66b35a30 2024-09-19T06:41:35.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.536+0000 7fe399927740 1 -- 172.21.15.12:0/3914940199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 msgr2=0x556d66b66d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:35.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.536+0000 7fe399927740 1 --2- 172.21.15.12:0/3914940199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b66d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe388030600 tx=0x7fe388030b70 comp rx=0 tx=0).stop 2024-09-19T06:41:35.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.536+0000 7fe399927740 1 -- 172.21.15.12:0/3914940199 shutdown_connections 2024-09-19T06:41:35.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.536+0000 7fe399927740 1 --2- 172.21.15.12:0/3914940199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b66d50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.536+0000 7fe399927740 1 --2- 172.21.15.12:0/3914940199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2b170 0x556d66b31290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.536+0000 7fe399927740 1 --2- 172.21.15.12:0/3914940199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2a850 0x556d66b2d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.536+0000 7fe399927740 1 -- 172.21.15.12:0/3914940199 >> 172.21.15.12:0/3914940199 conn(0x556d66b26de0 msgr2=0x556d66b349e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:35.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.537+0000 7fe399927740 1 -- 172.21.15.12:0/3914940199 shutdown_connections 2024-09-19T06:41:35.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.537+0000 7fe399927740 1 -- 172.21.15.12:0/3914940199 wait complete. 2024-09-19T06:41:35.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.537+0000 7fe399927740 1 -- start start 2024-09-19T06:41:35.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe399927740 1 Processor -- start 2024-09-19T06:41:35.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe399927740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 0x556d66b46260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe399927740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 0x556d66b467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe399927740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b43230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe399927740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe390071790 con 0x556d66b2a850 2024-09-19T06:41:35.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe399927740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe3900710c0 con 0x556d66b35a30 2024-09-19T06:41:35.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe399927740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe39006e310 con 0x556d66b2b170 2024-09-19T06:41:35.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe399927740 10 client.0 _ll_register_callbacks cb 0x7fe3800046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:35.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe395aeb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b43230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe395aeb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b43230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34344/0 (socket says 172.21.15.12:34344) 2024-09-19T06:41:35.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe395aeb640 1 -- 172.21.15.12:0/371228058 learned_addr learned my addr 172.21.15.12:0/371228058 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:35.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.538+0000 7fe3952ea640 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 0x556d66b46260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.539+0000 7fe395aeb640 1 -- 172.21.15.12:0/371228058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 msgr2=0x556d66b467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:35.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.539+0000 7fe395aeb640 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 0x556d66b467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.539+0000 7fe395aeb640 1 -- 172.21.15.12:0/371228058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 msgr2=0x556d66b46260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:35.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.539+0000 7fe395aeb640 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 0x556d66b46260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.539+0000 7fe395aeb640 1 -- 172.21.15.12:0/371228058 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d66b31970 con 0x556d66b35a30 2024-09-19T06:41:35.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.539+0000 7fe395aeb640 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b43230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe388034040 tx=0x7fe388004900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a0e7b3f7143886c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:35.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.539+0000 7fe378ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:41:35.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.539+0000 7fe378ff9640 1 -- 172.21.15.12:0/371228058 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388036050 con 0x556d66b35a30 2024-09-19T06:41:35.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.540+0000 7fe378ff9640 1 -- 172.21.15.12:0/371228058 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fe388003b80 con 0x556d66b35a30 2024-09-19T06:41:35.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.541+0000 7fe399927740 1 -- 172.21.15.12:0/371228058 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe388051070 con 0x556d66b35a30 2024-09-19T06:41:35.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.541+0000 7fe378ff9640 1 -- 172.21.15.12:0/371228058 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe388003d80 con 0x556d66b35a30 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.541+0000 7fe399927740 10 client.25469 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.541+0000 7fe399927740 1 -- 172.21.15.12:0/371228058 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556d66b38190 con 0x556d66b35a30 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.541+0000 7fe378ff9640 1 -- 172.21.15.12:0/371228058 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe388003f20 con 0x556d66b35a30 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.541+0000 7fe378ff9640 1 -- 172.21.15.12:0/371228058 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fe388057460 con 0x556d66b35a30 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.541+0000 7fe399927740 10 client.25469 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.541+0000 7fe399927740 10 client.25469 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.542+0000 7fe399927740 20 client.25469 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.542+0000 7fe399927740 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556d66bca830 0x556d66bccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.542+0000 7fe399927740 4 client.25469 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.542+0000 7fe399927740 1 -- 172.21.15.12:0/371228058 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x7fe388051070 con 0x556d66bca830 2024-09-19T06:41:35.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.542+0000 7fe3952ea640 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556d66bca830 0x556d66bccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:35.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.543+0000 7fe3952ea640 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556d66bca830 0x556d66bccc50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5c1024f2dfcd5a4 server_cookie=b1e314e01f556c68 in_seq=0 out_seq=0 2024-09-19T06:41:35.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.543+0000 7fe378ff9640 10 client.25469 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:35.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe378ff9640 1 -- 172.21.15.12:0/371228058 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fe388051070 con 0x556d66bca830 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe378ff9640 10 client.25469 handle_command_reply: tid=0 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 client.25469 shutdown 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 -- 172.21.15.12:0/371228058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 msgr2=0x556d66b43230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b43230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe388034040 tx=0x7fe388004900 comp rx=0 tx=0).stop 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 -- 172.21.15.12:0/371228058 shutdown_connections 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556d66bca830 0x556d66bccc50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556d66b35a30 0x556d66b43230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556d66b2b170 0x556d66b467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 --2- 172.21.15.12:0/371228058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556d66b2a850 0x556d66b46260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe378ff9640 0 client.25469 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 -- 172.21.15.12:0/371228058 >> 172.21.15.12:0/371228058 conn(0x556d66b26de0 msgr2=0x556d66b49900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:35.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 -- 172.21.15.12:0/371228058 shutdown_connections 2024-09-19T06:41:35.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 1 -- 172.21.15.12:0/371228058 wait complete. 2024-09-19T06:41:35.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.693+0000 7fe399927740 20 client.25469 trim_cache size 0 max 16384 2024-09-19T06:41:35.696 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:41:35.696 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 31, 2024-09-19T06:41:35.696 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:41:35.696 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 6, 2024-09-19T06:41:35.696 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:41:35.696 INFO:teuthology.orchestra.run.smithi012.stdout: "46c41cf7": { 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 6, 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 140.3, 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:41:35.697 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:41:35.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:35.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:35.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:35.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:35.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:35.698 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:41:35.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 -- 172.21.15.12:0/561746117 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe37c0a36a0 msgr2=0x7fe37c0a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:35.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe37c0a36a0 0x7fe37c0a5b60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3880099a0 tx=0x7fe38802a710 comp rx=0 tx=0).stop 2024-09-19T06:41:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 -- 172.21.15.12:0/561746117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe390102790 msgr2=0x7fe39019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe390102790 0x7fe39019aad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe38000d6d0 tx=0x7fe38000db90 comp rx=0 tx=0).stop 2024-09-19T06:41:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 -- 172.21.15.12:0/561746117 shutdown_connections 2024-09-19T06:41:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe390106f10 0x7fe39019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe37c0a36a0 0x7fe37c0a5b60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe390102790 0x7fe39019aad0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 --2- 172.21.15.12:0/561746117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe390101de0 0x7fe39019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 -- 172.21.15.12:0/561746117 >> 172.21.15.12:0/561746117 conn(0x7fe3900fd8e0 msgr2=0x7fe3900fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 -- 172.21.15.12:0/561746117 shutdown_connections 2024-09-19T06:41:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:35.694+0000 7fe39754e640 1 -- 172.21.15.12:0/561746117 wait complete. 2024-09-19T06:41:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 50.0 s, 4882.3 tps, lat 19.420 ms stddev 18.945 2024-09-19T06:41:36.446 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '46c41cf7', quiesce took 4.8 seconds. Will release after: 15.55 2024-09-19T06:41:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.292+0000 7f4c72c53640 1 -- 172.21.15.12:0/941952804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c6c1009d0 msgr2=0x7f4c6c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.292+0000 7f4c72c53640 1 --2- 172.21.15.12:0/941952804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c6c1009d0 0x7f4c6c100e30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009890 tx=0x7f4c5c02a380 comp rx=0 tx=0).stop 2024-09-19T06:41:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.292+0000 7f4c72c53640 1 -- 172.21.15.12:0/941952804 shutdown_connections 2024-09-19T06:41:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.292+0000 7f4c72c53640 1 --2- 172.21.15.12:0/941952804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c6c101370 0x7f4c6c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.292+0000 7f4c72c53640 1 --2- 172.21.15.12:0/941952804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c6c1009d0 0x7f4c6c100e30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.292+0000 7f4c72c53640 1 --2- 172.21.15.12:0/941952804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c6c1069e0 0x7f4c6c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.292+0000 7f4c72c53640 1 -- 172.21.15.12:0/941952804 >> 172.21.15.12:0/941952804 conn(0x7f4c6c0fc6b0 msgr2=0x7f4c6c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.292+0000 7f4c72c53640 1 -- 172.21.15.12:0/941952804 shutdown_connections 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.292+0000 7f4c72c53640 1 -- 172.21.15.12:0/941952804 wait complete. 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c72c53640 1 Processor -- start 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c72c53640 1 -- start start 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c72c53640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c6c1009d0 0x7f4c6c1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c72c53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c6c101370 0x7f4c6c1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c72c53640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c6c1069e0 0x7f4c6c19bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c72c53640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c110de0 con 0x7f4c6c101370 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c72c53640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c110c60 con 0x7f4c6c1009d0 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c72c53640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c110f60 con 0x7f4c6c1069e0 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c6c101370 0x7f4c6c1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c6c101370 0x7f4c6c1977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50230/0 (socket says 172.21.15.12:50230) 2024-09-19T06:41:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c63fff640 1 -- 172.21.15.12:0/2349759494 learned_addr learned my addr 172.21.15.12:0/2349759494 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c709ef640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c6c1009d0 0x7f4c6c1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c711f0640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c6c1069e0 0x7f4c6c19bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c63fff640 1 -- 172.21.15.12:0/2349759494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c6c1069e0 msgr2=0x7f4c6c19bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c6c1069e0 0x7f4c6c19bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c63fff640 1 -- 172.21.15.12:0/2349759494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c6c1009d0 msgr2=0x7f4c6c1972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c6c1009d0 0x7f4c6c1972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.293+0000 7f4c63fff640 1 -- 172.21.15.12:0/2349759494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c19c2a0 con 0x7f4c6c101370 2024-09-19T06:41:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.294+0000 7f4c711f0640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c6c1069e0 0x7f4c6c19bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.294+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c6c101370 0x7f4c6c1977f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c035040 tx=0x7f4c5c033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.294+0000 7f4c61ffb640 1 -- 172.21.15.12:0/2349759494 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c037040 con 0x7f4c6c101370 2024-09-19T06:41:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.294+0000 7f4c61ffb640 1 -- 172.21.15.12:0/2349759494 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c5c040070 con 0x7f4c6c101370 2024-09-19T06:41:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.294+0000 7f4c61ffb640 1 -- 172.21.15.12:0/2349759494 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c003a50 con 0x7f4c6c101370 2024-09-19T06:41:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.294+0000 7f4c72c53640 1 -- 172.21.15.12:0/2349759494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6c19c530 con 0x7f4c6c101370 2024-09-19T06:41:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.294+0000 7f4c72c53640 1 -- 172.21.15.12:0/2349759494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6c1a3e20 con 0x7f4c6c101370 2024-09-19T06:41:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.297+0000 7f4c61ffb640 1 -- 172.21.15.12:0/2349759494 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f4c5c003bf0 con 0x7f4c6c101370 2024-09-19T06:41:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.297+0000 7f4c759ec740 1 Processor -- start 2024-09-19T06:41:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.297+0000 7f4c759ec740 1 -- start start 2024-09-19T06:41:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.297+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 0x55f3fefc4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.297+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc5410 0x55f3fefcf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.297+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.297+0000 7f4c759ec740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f3fef292f0 con 0x55f3fefcfcb0 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.297+0000 7f4c759ec740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f3feed1270 con 0x55f3fefc5410 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.297+0000 7f4c759ec740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f3fef252b0 con 0x55f3fefc4af0 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.297+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50234/0 (socket says 172.21.15.12:50234) 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c63fff640 1 -- 172.21.15.12:0/2083517071 learned_addr learned my addr 172.21.15.12:0/2083517071 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c711f0640 1 --2- 172.21.15.12:0/2083517071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 0x55f3fefc4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c709ef640 1 --2- 172.21.15.12:0/2083517071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc5410 0x55f3fefcf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c61ffb640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a3600 0x7f4c540a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c711f0640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a3600 0x7f4c540a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c63fff640 1 -- 172.21.15.12:0/2083517071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 msgr2=0x55f3fefc4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2083517071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 0x55f3fefc4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c63fff640 1 -- 172.21.15.12:0/2083517071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc5410 msgr2=0x55f3fefcf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2083517071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc5410 0x55f3fefcf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c61ffb640 1 -- 172.21.15.12:0/2349759494 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4c5c0f0120 con 0x7f4c6c101370 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c63fff640 1 -- 172.21.15.12:0/2083517071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3feed0340 con 0x55f3fefcfcb0 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c709ef640 1 --2- 172.21.15.12:0/2083517071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc5410 0x55f3fefcf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2083517071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd20a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0bbee0 tx=0x7f4c5c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adee57ef3df02fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c711f0640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a3600 0x7f4c540a5ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c64005fd0 tx=0x7f4c64004ab0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.298+0000 7f4c52ffd640 1 -- 172.21.15.12:0/2083517071 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0bbd20 con 0x55f3fefcfcb0 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c52ffd640 1 -- 172.21.15.12:0/2083517071 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c5c0bc8e0 con 0x55f3fefcfcb0 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c52ffd640 1 -- 172.21.15.12:0/2083517071 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0bbb40 con 0x55f3fefcfcb0 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c759ec740 1 -- 172.21.15.12:0/2083517071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefcfcb0 msgr2=0x55f3fefd20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2083517071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd20a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0bbee0 tx=0x7f4c5c005f90 comp rx=0 tx=0).stop 2024-09-19T06:41:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c759ec740 1 -- 172.21.15.12:0/2083517071 shutdown_connections 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2083517071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd20a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2083517071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc5410 0x55f3fefcf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2083517071 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 0x55f3fefc4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c759ec740 1 -- 172.21.15.12:0/2083517071 >> 172.21.15.12:0/2083517071 conn(0x55f3fefc1060 msgr2=0x55f3fefc1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c759ec740 1 -- 172.21.15.12:0/2083517071 shutdown_connections 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.299+0000 7f4c759ec740 1 -- 172.21.15.12:0/2083517071 wait complete. 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c759ec740 1 -- start start 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c759ec740 1 Processor -- start 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc4af0 0x55f3fefd29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefd2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c759ec740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f3fefd2640 con 0x55f3fefc5410 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c759ec740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f3feeb2290 con 0x55f3fefc4af0 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c759ec740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f3fefd27c0 con 0x55f3fefcfcb0 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c759ec740 10 client.0 _ll_register_callbacks cb 0x55f3feee3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefd2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefd2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50246/0 (socket says 172.21.15.12:50246) 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.300+0000 7f4c63fff640 1 -- 172.21.15.12:0/425577558 learned_addr learned my addr 172.21.15.12:0/425577558 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c711f0640 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c709ef640 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc4af0 0x55f3fefd29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c63fff640 1 -- 172.21.15.12:0/425577558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefcfcb0 msgr2=0x55f3fefd3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c63fff640 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c63fff640 1 -- 172.21.15.12:0/425577558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc4af0 msgr2=0x55f3fefd29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c63fff640 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc4af0 0x55f3fefd29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c63fff640 1 -- 172.21.15.12:0/425577558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3fec3c210 con 0x55f3fefc5410 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c711f0640 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c709ef640 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc4af0 0x55f3fefd29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c63fff640 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefd2f00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0099b0 tx=0x7f4c5c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d3ad4f14e0d61c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c4bfff640 1 -- 172.21.15.12:0/425577558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0bbb40 con 0x55f3fefc5410 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c4bfff640 1 -- 172.21.15.12:0/425577558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4c5c0c0170 con 0x55f3fefc5410 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c759ec740 1 -- 172.21.15.12:0/425577558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c5c0bc8e0 con 0x55f3fefc5410 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c4bfff640 1 -- 172.21.15.12:0/425577558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4c5c0bbd20 con 0x55f3fefc5410 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c759ec740 10 client.15861 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c759ec740 1 -- 172.21.15.12:0/425577558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f3fed08620 con 0x55f3fefc5410 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.301+0000 7f4c4bfff640 1 -- 172.21.15.12:0/425577558 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c5c0bc8e0 con 0x55f3fefc5410 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.302+0000 7f4c4bfff640 1 -- 172.21.15.12:0/425577558 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f4c5c03a070 con 0x55f3fefc5410 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.302+0000 7f4c759ec740 10 client.15861 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.302+0000 7f4c759ec740 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.302+0000 7f4c759ec740 20 client.15861 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.302+0000 7f4c759ec740 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f3fefe1a90 0x55f3fefe3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.302+0000 7f4c759ec740 4 client.15861 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.302+0000 7f4c759ec740 1 -- 172.21.15.12:0/425577558 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3fef36a20 con 0x55f3fefe1a90 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.302+0000 7f4c709ef640 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f3fefe1a90 0x55f3fefe3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c709ef640 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f3fefe1a90 0x55f3fefe3e80 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7bdab402b784bcf server_cookie=57a952d47c560f71 in_seq=0 out_seq=0 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c4bfff640 10 client.15861 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c4bfff640 1 -- 172.21.15.12:0/425577558 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3fef36a20 con 0x55f3fefe1a90 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c4bfff640 10 client.15861 handle_command_reply: tid=0 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c759ec740 1 client.15861 shutdown 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c759ec740 1 -- 172.21.15.12:0/425577558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 msgr2=0x55f3fefd2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c759ec740 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefd2f00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0099b0 tx=0x7f4c5c0042e0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c759ec740 1 -- 172.21.15.12:0/425577558 shutdown_connections 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c759ec740 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f3fefe1a90 0x55f3fefe3e80 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c759ec740 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefcfcb0 0x55f3fefd3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c759ec740 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefd2f00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c759ec740 1 --2- 172.21.15.12:0/425577558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefc4af0 0x55f3fefd29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c4bfff640 0 client.15861 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.303+0000 7f4c759ec740 1 -- 172.21.15.12:0/425577558 >> 172.21.15.12:0/425577558 conn(0x55f3fefc1060 msgr2=0x55f3fefc6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.304+0000 7f4c759ec740 1 -- 172.21.15.12:0/425577558 shutdown_connections 2024-09-19T06:41:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.304+0000 7f4c759ec740 1 -- 172.21.15.12:0/425577558 wait complete. 2024-09-19T06:41:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.304+0000 7f4c759ec740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T06:41:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.318+0000 7f4c759ec740 1 Processor -- start 2024-09-19T06:41:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.318+0000 7f4c759ec740 1 -- start start 2024-09-19T06:41:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.318+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 0x55f3fefc8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.318+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefc00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.318+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 0x55f3fefe9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.318+0000 7f4c759ec740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1ab890 con 0x55f3fefc5410 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.318+0000 7f4c759ec740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1ad4c0 con 0x55f3fefcfcb0 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.318+0000 7f4c759ec740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1abf60 con 0x55f3fefc4af0 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefc00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefc00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50250/0 (socket says 172.21.15.12:50250) 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c63fff640 1 -- 172.21.15.12:0/2690992294 learned_addr learned my addr 172.21.15.12:0/2690992294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c709ef640 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 0x55f3fefc8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c711f0640 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 0x55f3fefe9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c63fff640 1 -- 172.21.15.12:0/2690992294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 msgr2=0x55f3fefc8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 0x55f3fefc8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c63fff640 1 -- 172.21.15.12:0/2690992294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 msgr2=0x55f3fefe9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 0x55f3fefe9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c63fff640 1 -- 172.21.15.12:0/2690992294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3fefc0e90 con 0x55f3fefc5410 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c709ef640 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 0x55f3fefc8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c711f0640 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 0x55f3fefe9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefc00b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0b8b60 tx=0x7f4c5c0c4ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9687ddb70c4a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c527fc640 1 -- 172.21.15.12:0/2690992294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0bbb40 con 0x55f3fefc5410 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c527fc640 1 -- 172.21.15.12:0/2690992294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c5c0bc8e0 con 0x55f3fefc5410 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.319+0000 7f4c527fc640 1 -- 172.21.15.12:0/2690992294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0c0170 con 0x55f3fefc5410 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 -- 172.21.15.12:0/2690992294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 msgr2=0x55f3fefc00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefc00b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0b8b60 tx=0x7f4c5c0c4ed0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 -- 172.21.15.12:0/2690992294 shutdown_connections 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 0x55f3fefe9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc5410 0x55f3fefc00b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2690992294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc4af0 0x55f3fefc8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 -- 172.21.15.12:0/2690992294 >> 172.21.15.12:0/2690992294 conn(0x55f3fefc1060 msgr2=0x55f3fefbf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 -- 172.21.15.12:0/2690992294 shutdown_connections 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 -- 172.21.15.12:0/2690992294 wait complete. 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 -- start start 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.320+0000 7f4c759ec740 1 Processor -- start 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc4af0 0x55f3fefd2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc5410 0x55f3fefd3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c759ec740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 0x55f3ff04a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c759ec740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1acd30 con 0x55f3fefc4af0 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c759ec740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1ac660 con 0x55f3fefcfcb0 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c759ec740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1a9870 con 0x55f3fefc5410 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c759ec740 10 client.0 _ll_register_callbacks cb 0x7f4c68009500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c709ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc4af0 0x55f3fefd2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c709ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc4af0 0x55f3fefd2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50260/0 (socket says 172.21.15.12:50260) 2024-09-19T06:41:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c709ef640 1 -- 172.21.15.12:0/2014490641 learned_addr learned my addr 172.21.15.12:0/2014490641 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c711f0640 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 0x55f3ff04a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc5410 0x55f3fefd3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c709ef640 1 -- 172.21.15.12:0/2014490641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc5410 msgr2=0x55f3fefd3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c709ef640 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc5410 0x55f3fefd3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c709ef640 1 -- 172.21.15.12:0/2014490641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 msgr2=0x55f3ff04a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c709ef640 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 0x55f3ff04a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c709ef640 1 -- 172.21.15.12:0/2014490641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ff04ac50 con 0x55f3fefc4af0 2024-09-19T06:41:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc5410 0x55f3fefd3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c709ef640 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc4af0 0x55f3fefd2df0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x55f3fefe46c0 tx=0x7f4c68009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bc0e642fbb13dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.321+0000 7f4c4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c4bfff640 1 -- 172.21.15.12:0/2014490641 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6802a060 con 0x55f3fefc4af0 2024-09-19T06:41:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c4bfff640 1 -- 172.21.15.12:0/2014490641 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4c68011440 con 0x55f3fefc4af0 2024-09-19T06:41:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c759ec740 1 -- 172.21.15.12:0/2014490641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c5c0bc8e0 con 0x55f3fefc4af0 2024-09-19T06:41:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c4bfff640 1 -- 172.21.15.12:0/2014490641 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4c68011640 con 0x55f3fefc4af0 2024-09-19T06:41:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c759ec740 10 client.15867 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c759ec740 1 -- 172.21.15.12:0/2014490641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f3ff04bf00 con 0x55f3fefc4af0 2024-09-19T06:41:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c4bfff640 1 -- 172.21.15.12:0/2014490641 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c5c0bc8e0 con 0x55f3fefc4af0 2024-09-19T06:41:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c4bfff640 1 -- 172.21.15.12:0/2014490641 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f4c68024070 con 0x55f3fefc4af0 2024-09-19T06:41:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c759ec740 10 client.15867 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c759ec740 10 client.15867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c759ec740 20 client.15867 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f3ff04c670 0x55f3ff04ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c759ec740 4 client.15867 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:41:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.322+0000 7f4c759ec740 1 -- 172.21.15.12:0/2014490641 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f3fef30d70 con 0x55f3ff04c670 2024-09-19T06:41:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.323+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f3ff04c670 0x55f3ff04ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.323+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f3ff04c670 0x55f3ff04ea90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93e5ea016736cc2f server_cookie=7bc19e64da073f62 in_seq=0 out_seq=0 2024-09-19T06:41:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.323+0000 7f4c4bfff640 10 client.15867 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c4bfff640 1 -- 172.21.15.12:0/2014490641 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f3fef30d70 con 0x55f3ff04c670 2024-09-19T06:41:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c4bfff640 10 client.15867 handle_command_reply: tid=0 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c759ec740 1 client.15867 shutdown 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c759ec740 1 -- 172.21.15.12:0/2014490641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc4af0 msgr2=0x55f3fefd2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc4af0 0x55f3fefd2df0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x55f3fefe46c0 tx=0x7f4c68009d10 comp rx=0 tx=0).stop 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c759ec740 1 -- 172.21.15.12:0/2014490641 shutdown_connections 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f3ff04c670 0x55f3ff04ea90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f3fefcfcb0 0x55f3ff04a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3fefc5410 0x55f3fefd3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c759ec740 1 --2- 172.21.15.12:0/2014490641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3fefc4af0 0x55f3fefd2df0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c4bfff640 0 client.15867 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.340+0000 7f4c759ec740 1 -- 172.21.15.12:0/2014490641 >> 172.21.15.12:0/2014490641 conn(0x55f3fefc1060 msgr2=0x55f3fefc01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c759ec740 1 -- 172.21.15.12:0/2014490641 shutdown_connections 2024-09-19T06:41:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c759ec740 1 -- 172.21.15.12:0/2014490641 wait complete. 2024-09-19T06:41:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c759ec740 20 client.15867 trim_cache size 0 max 16384 2024-09-19T06:41:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:41:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:41:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:41:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:41:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c72c53640 1 -- 172.21.15.12:0/2349759494 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a3600 msgr2=0x7f4c540a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c72c53640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a3600 0x7f4c540a5ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c64005fd0 tx=0x7f4c64004ab0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c72c53640 1 -- 172.21.15.12:0/2349759494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c6c101370 msgr2=0x7f4c6c1977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c72c53640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c6c101370 0x7f4c6c1977f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c035040 tx=0x7f4c5c033d90 comp rx=0 tx=0).stop 2024-09-19T06:41:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c72c53640 1 -- 172.21.15.12:0/2349759494 shutdown_connections 2024-09-19T06:41:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c72c53640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a3600 0x7f4c540a5ac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c72c53640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c6c1069e0 0x7f4c6c19bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c72c53640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c6c101370 0x7f4c6c1977f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c72c53640 1 --2- 172.21.15.12:0/2349759494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c6c1009d0 0x7f4c6c1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.341+0000 7f4c72c53640 1 -- 172.21.15.12:0/2349759494 >> 172.21.15.12:0/2349759494 conn(0x7f4c6c0fc6b0 msgr2=0x7f4c6c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.342+0000 7f4c72c53640 1 -- 172.21.15.12:0/2349759494 shutdown_connections 2024-09-19T06:41:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:37.342+0000 7f4c72c53640 1 -- 172.21.15.12:0/2349759494 wait complete. 2024-09-19T06:41:37.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:37 smithi016 ceph-mon[34911]: pgmap v47: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2024-09-19T06:41:37.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:37 smithi173 ceph-mon[35349]: pgmap v47: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2024-09-19T06:41:37.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:37 smithi012 ceph-mon[30937]: pgmap v47: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2024-09-19T06:41:38.770 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:41:39.042 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:39.462 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:39 smithi012 ceph-mon[30937]: pgmap v48: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-19T06:41:39.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:39 smithi016 ceph-mon[34911]: pgmap v48: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-19T06:41:39.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.545+0000 7f184351b640 1 -- 172.21.15.12:0/4140101044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c10c180 msgr2=0x7f183c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:39.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.545+0000 7f184351b640 1 --2- 172.21.15.12:0/4140101044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c10c180 0x7f183c10e600 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1834009ca0 tx=0x7f183402a950 comp rx=0 tx=0).stop 2024-09-19T06:41:39.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.545+0000 7f184351b640 1 -- 172.21.15.12:0/4140101044 shutdown_connections 2024-09-19T06:41:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.545+0000 7f184351b640 1 --2- 172.21.15.12:0/4140101044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c10c180 0x7f183c10e600 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.545+0000 7f184351b640 1 --2- 172.21.15.12:0/4140101044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f183c1036c0 0x7f183c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.545+0000 7f184351b640 1 --2- 172.21.15.12:0/4140101044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f183c102da0 0x7f183c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.546+0000 7f184351b640 1 -- 172.21.15.12:0/4140101044 >> 172.21.15.12:0/4140101044 conn(0x7f183c0fc7a0 msgr2=0x7f183c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.546+0000 7f184351b640 1 -- 172.21.15.12:0/4140101044 shutdown_connections 2024-09-19T06:41:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.546+0000 7f184351b640 1 -- 172.21.15.12:0/4140101044 wait complete. 2024-09-19T06:41:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.546+0000 7f184351b640 1 Processor -- start 2024-09-19T06:41:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.546+0000 7f184351b640 1 -- start start 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.546+0000 7f184351b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f183c102da0 0x7f183c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f184351b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f183c1036c0 0x7f183c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f184351b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c10c180 0x7f183c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f184351b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f183c111fc0 con 0x7f183c10c180 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f184351b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f183c111e40 con 0x7f183c1036c0 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f184351b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f183c112140 con 0x7f183c102da0 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f1841ab8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c10c180 0x7f183c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f1841ab8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c10c180 0x7f183c101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50288/0 (socket says 172.21.15.12:50288) 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f1841ab8640 1 -- 172.21.15.12:0/2682619713 learned_addr learned my addr 172.21.15.12:0/2682619713 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f18412b7640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f183c102da0 0x7f183c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f1840ab6640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f183c1036c0 0x7f183c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f1841ab8640 1 -- 172.21.15.12:0/2682619713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f183c102da0 msgr2=0x7f183c100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f1841ab8640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f183c102da0 0x7f183c100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f1841ab8640 1 -- 172.21.15.12:0/2682619713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f183c1036c0 msgr2=0x7f183c100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f1841ab8640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f183c1036c0 0x7f183c100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f1841ab8640 1 -- 172.21.15.12:0/2682619713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c1a6920 con 0x7f183c10c180 2024-09-19T06:41:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f1841ab8640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c10c180 0x7f183c101480 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f183402ae70 tx=0x7f183402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f18327fc640 1 -- 172.21.15.12:0/2682619713 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834034040 con 0x7f183c10c180 2024-09-19T06:41:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f18327fc640 1 -- 172.21.15.12:0/2682619713 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1834030920 con 0x7f183c10c180 2024-09-19T06:41:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.547+0000 7f184351b640 1 -- 172.21.15.12:0/2682619713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c1a6bb0 con 0x7f183c10c180 2024-09-19T06:41:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.548+0000 7f18327fc640 1 -- 172.21.15.12:0/2682619713 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18340047b0 con 0x7f183c10c180 2024-09-19T06:41:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.548+0000 7f184351b640 1 -- 172.21.15.12:0/2682619713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c1a70e0 con 0x7f183c10c180 2024-09-19T06:41:39.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.550+0000 7f18327fc640 1 -- 172.21.15.12:0/2682619713 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f1834037020 con 0x7f183c10c180 2024-09-19T06:41:39.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.550+0000 7f18458f4740 1 Processor -- start 2024-09-19T06:41:39.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f18458f4740 1 -- start start 2024-09-19T06:41:39.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f18458f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f5414a0 0x56060f541880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f18458f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f541dc0 0x56060f54c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f18458f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f54ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f18458f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56060f4a72e0 con 0x56060f54c680 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f18458f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56060f44ece0 con 0x56060f5414a0 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f18458f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56060f4a32a0 con 0x56060f541dc0 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f18327fc640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18280a3550 0x7f18280a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f1840ab6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f54ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f1840ab6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f54ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50292/0 (socket says 172.21.15.12:50292) 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f1840ab6640 1 -- 172.21.15.12:0/4251568882 learned_addr learned my addr 172.21.15.12:0/4251568882 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f1841ab8640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18280a3550 0x7f18280a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f1840ab6640 1 --2- 172.21.15.12:0/4251568882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f5414a0 0x56060f541880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f18327fc640 1 -- 172.21.15.12:0/2682619713 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f18340f0e20 con 0x7f183c10c180 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.551+0000 7f18412b7640 1 --2- 172.21.15.12:0/4251568882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f541dc0 0x56060f54c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.552+0000 7f1840ab6640 1 -- 172.21.15.12:0/4251568882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f541dc0 msgr2=0x56060f54c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.552+0000 7f1840ab6640 1 --2- 172.21.15.12:0/4251568882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f541dc0 0x56060f54c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.552+0000 7f1840ab6640 1 -- 172.21.15.12:0/4251568882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f5414a0 msgr2=0x56060f541880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.552+0000 7f1840ab6640 1 --2- 172.21.15.12:0/4251568882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f5414a0 0x56060f541880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.552+0000 7f1840ab6640 1 -- 172.21.15.12:0/4251568882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56060f433440 con 0x56060f54c680 2024-09-19T06:41:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.552+0000 7f1841ab8640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18280a3550 0x7f18280a5a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18340ee480 tx=0x7f18340dd040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.552+0000 7f1840ab6640 1 --2- 172.21.15.12:0/4251568882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f54ea70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f182c0149c0 tx=0x7f182c00c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c47a876d807e9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.552+0000 7f18277fe640 1 -- 172.21.15.12:0/4251568882 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c0142d0 con 0x56060f54c680 2024-09-19T06:41:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.552+0000 7f18277fe640 1 -- 172.21.15.12:0/4251568882 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f182c005500 con 0x56060f54c680 2024-09-19T06:41:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.552+0000 7f18277fe640 1 -- 172.21.15.12:0/4251568882 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c00f760 con 0x56060f54c680 2024-09-19T06:41:39.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 -- 172.21.15.12:0/4251568882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 msgr2=0x56060f54ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 --2- 172.21.15.12:0/4251568882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f54ea70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f182c0149c0 tx=0x7f182c00c4d0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 -- 172.21.15.12:0/4251568882 shutdown_connections 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 --2- 172.21.15.12:0/4251568882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f54ea70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 --2- 172.21.15.12:0/4251568882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f541dc0 0x56060f54c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 --2- 172.21.15.12:0/4251568882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f5414a0 0x56060f541880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 -- 172.21.15.12:0/4251568882 >> 172.21.15.12:0/4251568882 conn(0x56060f53da30 msgr2=0x56060f53de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 -- 172.21.15.12:0/4251568882 shutdown_connections 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 -- 172.21.15.12:0/4251568882 wait complete. 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 -- start start 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.553+0000 7f18458f4740 1 Processor -- start 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18458f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f5414a0 0x56060f54c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18458f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f541dc0 0x56060f549310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18458f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f54c680 0x56060f5498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18458f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56060f54f250 con 0x56060f541dc0 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18458f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56060f462050 con 0x56060f5414a0 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18458f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56060f54f3d0 con 0x56060f54c680 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18458f4740 10 client.0 _ll_register_callbacks cb 0x56060f4a2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18412b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f541dc0 0x56060f549310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18412b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f541dc0 0x56060f549310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50306/0 (socket says 172.21.15.12:50306) 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18412b7640 1 -- 172.21.15.12:0/4022547465 learned_addr learned my addr 172.21.15.12:0/4022547465 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f1840ab6640 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f54c680 0x56060f5498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18412b7640 1 -- 172.21.15.12:0/4022547465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f54c680 msgr2=0x56060f5498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18412b7640 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f54c680 0x56060f5498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18412b7640 1 -- 172.21.15.12:0/4022547465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f5414a0 msgr2=0x56060f54c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18412b7640 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f5414a0 0x56060f54c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f18412b7640 1 -- 172.21.15.12:0/4022547465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56060f2183c0 con 0x56060f541dc0 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.554+0000 7f1840ab6640 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f54c680 0x56060f5498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f18412b7640 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f541dc0 0x56060f549310 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1838011540 tx=0x7f1838011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fe51851f3b49b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f1824ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f1824ff9640 1 -- 172.21.15.12:0/4022547465 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183800f6d0 con 0x56060f541dc0 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f1824ff9640 1 -- 172.21.15.12:0/4022547465 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f183800f870 con 0x56060f541dc0 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f18458f4740 1 -- 172.21.15.12:0/4022547465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f182c005500 con 0x56060f541dc0 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f1824ff9640 1 -- 172.21.15.12:0/4022547465 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f183800fab0 con 0x56060f541dc0 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f18458f4740 10 client.15879 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f18458f4740 1 -- 172.21.15.12:0/4022547465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56060f55ad20 con 0x56060f541dc0 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f1824ff9640 1 -- 172.21.15.12:0/4022547465 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f182c005500 con 0x56060f541dc0 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f1824ff9640 1 -- 172.21.15.12:0/4022547465 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f1838025430 con 0x56060f541dc0 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f18458f4740 10 client.15879 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f18458f4740 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f18458f4740 20 client.15879 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f18458f4740 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56060f55c280 0x56060f55e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f18458f4740 4 client.15879 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.555+0000 7f18458f4740 1 -- 172.21.15.12:0/4022547465 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56060f4b4850 con 0x56060f55c280 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.556+0000 7f1840ab6640 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56060f55c280 0x56060f55e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.556+0000 7f1840ab6640 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56060f55c280 0x56060f55e6b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fcc16d020abac0a server_cookie=670c1c74fc11cac4 in_seq=0 out_seq=0 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.556+0000 7f1824ff9640 10 client.15879 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f1824ff9640 1 -- 172.21.15.12:0/4022547465 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56060f4b4850 con 0x56060f55c280 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f1824ff9640 10 client.15879 handle_command_reply: tid=0 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 client.15879 shutdown 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 -- 172.21.15.12:0/4022547465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f541dc0 msgr2=0x56060f549310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f541dc0 0x56060f549310 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1838011540 tx=0x7f1838011a00 comp rx=0 tx=0).stop 2024-09-19T06:41:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 -- 172.21.15.12:0/4022547465 shutdown_connections 2024-09-19T06:41:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56060f55c280 0x56060f55e6b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f1824ff9640 0 client.15879 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f54c680 0x56060f5498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f541dc0 0x56060f549310 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 --2- 172.21.15.12:0/4022547465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f5414a0 0x56060f54c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 -- 172.21.15.12:0/4022547465 >> 172.21.15.12:0/4022547465 conn(0x56060f53da30 msgr2=0x56060f543710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 -- 172.21.15.12:0/4022547465 shutdown_connections 2024-09-19T06:41:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 1 -- 172.21.15.12:0/4022547465 wait complete. 2024-09-19T06:41:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.557+0000 7f18458f4740 20 client.15879 trim_cache size 0 max 16384 2024-09-19T06:41:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.574+0000 7f18458f4740 1 Processor -- start 2024-09-19T06:41:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f18458f4740 1 -- start start 2024-09-19T06:41:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f18458f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f5414a0 0x56060f5584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f18458f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 0x56060f563f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f18458f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f54c680 0x56060f5644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f18458f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f183c1afca0 con 0x56060f5414a0 2024-09-19T06:41:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f18458f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f183c1b18d0 con 0x56060f541dc0 2024-09-19T06:41:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f18458f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f183c1b0370 con 0x56060f54c680 2024-09-19T06:41:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f1840ab6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f5414a0 0x56060f5584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f1840ab6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f5414a0 0x56060f5584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50318/0 (socket says 172.21.15.12:50318) 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f1840ab6640 1 -- 172.21.15.12:0/2724888914 learned_addr learned my addr 172.21.15.12:0/2724888914 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f18412b7640 1 --2- 172.21.15.12:0/2724888914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 0x56060f563f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f1840ab6640 1 -- 172.21.15.12:0/2724888914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f54c680 msgr2=0x56060f5644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f1840ab6640 1 --2- 172.21.15.12:0/2724888914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f54c680 0x56060f5644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f1840ab6640 1 -- 172.21.15.12:0/2724888914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 msgr2=0x56060f563f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f1840ab6640 1 --2- 172.21.15.12:0/2724888914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 0x56060f563f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f1840ab6640 1 -- 172.21.15.12:0/2724888914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56060f54ede0 con 0x56060f5414a0 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f18412b7640 1 --2- 172.21.15.12:0/2724888914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 0x56060f563f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.575+0000 7f1840ab6640 1 --2- 172.21.15.12:0/2724888914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f5414a0 0x56060f5584e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f182c0149c0 tx=0x7f182c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add70149c5d1bb40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f1826ffd640 1 -- 172.21.15.12:0/2724888914 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c02f070 con 0x56060f5414a0 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f1826ffd640 1 -- 172.21.15.12:0/2724888914 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f182c027070 con 0x56060f5414a0 2024-09-19T06:41:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f1826ffd640 1 -- 172.21.15.12:0/2724888914 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c00fe10 con 0x56060f5414a0 2024-09-19T06:41:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f18458f4740 1 -- 172.21.15.12:0/2724888914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f5414a0 msgr2=0x56060f5584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f18458f4740 1 --2- 172.21.15.12:0/2724888914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f5414a0 0x56060f5584e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f182c0149c0 tx=0x7f182c004b40 comp rx=0 tx=0).stop 2024-09-19T06:41:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f18458f4740 1 -- 172.21.15.12:0/2724888914 shutdown_connections 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f18458f4740 1 --2- 172.21.15.12:0/2724888914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f54c680 0x56060f5644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f18458f4740 1 --2- 172.21.15.12:0/2724888914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 0x56060f563f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f18458f4740 1 --2- 172.21.15.12:0/2724888914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f5414a0 0x56060f5584e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f18458f4740 1 -- 172.21.15.12:0/2724888914 >> 172.21.15.12:0/2724888914 conn(0x56060f53da30 msgr2=0x56060f5448b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f18458f4740 1 -- 172.21.15.12:0/2724888914 shutdown_connections 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f18458f4740 1 -- 172.21.15.12:0/2724888914 wait complete. 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.576+0000 7f18458f4740 1 -- start start 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f18458f4740 1 Processor -- start 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f18458f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f5414a0 0x56060f554830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f18458f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 0x56060f554d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f18458f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f551620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f18458f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f183c1b1140 con 0x56060f54c680 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f18458f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f183c1b0a70 con 0x56060f541dc0 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f18458f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f183c1adc80 con 0x56060f5414a0 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f18458f4740 10 client.0 _ll_register_callbacks cb 0x7f1838009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f1840ab6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f551620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f1840ab6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f551620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50320/0 (socket says 172.21.15.12:50320) 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f1840ab6640 1 -- 172.21.15.12:0/2738067966 learned_addr learned my addr 172.21.15.12:0/2738067966 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f1840ab6640 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f5414a0 0x56060f554830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.577+0000 7f18412b7640 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 0x56060f554d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1840ab6640 1 -- 172.21.15.12:0/2738067966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f5414a0 msgr2=0x56060f554830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1840ab6640 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f5414a0 0x56060f554830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1840ab6640 1 -- 172.21.15.12:0/2738067966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 msgr2=0x56060f554d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1840ab6640 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 0x56060f554d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1840ab6640 1 -- 172.21.15.12:0/2738067966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56060f551d60 con 0x56060f54c680 2024-09-19T06:41:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1840ab6640 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f551620 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f182c00faf0 tx=0x7f182c004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9542c8b152033c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1824ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1824ff9640 1 -- 172.21.15.12:0/2738067966 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c02f030 con 0x56060f54c680 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f18458f4740 1 -- 172.21.15.12:0/2738067966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f182c027070 con 0x56060f54c680 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1824ff9640 1 -- 172.21.15.12:0/2738067966 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f182c00fda0 con 0x56060f54c680 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1824ff9640 1 -- 172.21.15.12:0/2738067966 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f182c0140c0 con 0x56060f54c680 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f18458f4740 10 client.15885 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f18458f4740 1 -- 172.21.15.12:0/2738067966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56060f5c78e0 con 0x56060f54c680 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.578+0000 7f1824ff9640 1 -- 172.21.15.12:0/2738067966 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f182c027070 con 0x56060f54c680 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.579+0000 7f1824ff9640 1 -- 172.21.15.12:0/2738067966 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f182c005210 con 0x56060f54c680 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.579+0000 7f18458f4740 10 client.15885 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.579+0000 7f18458f4740 10 client.15885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.579+0000 7f18458f4740 20 client.15885 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.579+0000 7f18458f4740 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56060f55c280 0x56060f5c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.579+0000 7f18458f4740 4 client.15885 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.579+0000 7f18458f4740 1 -- 172.21.15.12:0/2738067966 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56060f4aed60 con 0x56060f55c280 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.579+0000 7f18412b7640 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56060f55c280 0x56060f5c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.579+0000 7f1824ff9640 10 client.15885 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.579+0000 7f18412b7640 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56060f55c280 0x56060f5c9c70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6d8649a160bb1da server_cookie=73addf19e96e8a6b in_seq=0 out_seq=0 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f1824ff9640 1 -- 172.21.15.12:0/2738067966 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56060f4aed60 con 0x56060f55c280 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f1824ff9640 10 client.15885 handle_command_reply: tid=0 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 client.15885 shutdown 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 -- 172.21.15.12:0/2738067966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 msgr2=0x56060f551620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f551620 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f182c00faf0 tx=0x7f182c004be0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 -- 172.21.15.12:0/2738067966 shutdown_connections 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56060f55c280 0x56060f5c9c70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56060f54c680 0x56060f551620 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56060f541dc0 0x56060f554d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 --2- 172.21.15.12:0/2738067966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56060f5414a0 0x56060f554830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f1824ff9640 0 client.15885 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 -- 172.21.15.12:0/2738067966 >> 172.21.15.12:0/2738067966 conn(0x56060f53da30 msgr2=0x56060f543f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 -- 172.21.15.12:0/2738067966 shutdown_connections 2024-09-19T06:41:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 1 -- 172.21.15.12:0/2738067966 wait complete. 2024-09-19T06:41:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f18458f4740 20 client.15885 trim_cache size 0 max 16384 2024-09-19T06:41:39.588 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:41:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:41:39.588 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:41:39.588 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:41:39.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f184351b640 1 -- 172.21.15.12:0/2682619713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18280a3550 msgr2=0x7f18280a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:39.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f184351b640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18280a3550 0x7f18280a5a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18340ee480 tx=0x7f18340dd040 comp rx=0 tx=0).stop 2024-09-19T06:41:39.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f184351b640 1 -- 172.21.15.12:0/2682619713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c10c180 msgr2=0x7f183c101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:39.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.580+0000 7f184351b640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c10c180 0x7f183c101480 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f183402ae70 tx=0x7f183402f5b0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.581+0000 7f184351b640 1 -- 172.21.15.12:0/2682619713 shutdown_connections 2024-09-19T06:41:39.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.581+0000 7f184351b640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c10c180 0x7f183c101480 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.581+0000 7f184351b640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f183c1036c0 0x7f183c100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.581+0000 7f184351b640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18280a3550 0x7f18280a5a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.581+0000 7f184351b640 1 --2- 172.21.15.12:0/2682619713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f183c102da0 0x7f183c100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.581+0000 7f184351b640 1 -- 172.21.15.12:0/2682619713 >> 172.21.15.12:0/2682619713 conn(0x7f183c0fc7a0 msgr2=0x7f183c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.581+0000 7f184351b640 1 -- 172.21.15.12:0/2682619713 shutdown_connections 2024-09-19T06:41:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:39.581+0000 7f184351b640 1 -- 172.21.15.12:0/2682619713 wait complete. 2024-09-19T06:41:39.591 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:39 smithi173 ceph-mon[35349]: pgmap v48: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-19T06:41:40.287 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:41:40.287 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:41:40.543 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:40.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 55.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:41:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.992+0000 7f6d2026a640 1 -- 172.21.15.12:0/1385676653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d18101de0 msgr2=0x7f6d181021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.992+0000 7f6d2026a640 1 --2- 172.21.15.12:0/1385676653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d18101de0 0x7f6d181021c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009900 tx=0x7f6d1402a410 comp rx=0 tx=0).stop 2024-09-19T06:41:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.993+0000 7f6d2026a640 1 -- 172.21.15.12:0/1385676653 shutdown_connections 2024-09-19T06:41:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.993+0000 7f6d2026a640 1 --2- 172.21.15.12:0/1385676653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d18106f10 0x7f6d1810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.993+0000 7f6d2026a640 1 --2- 172.21.15.12:0/1385676653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d18102790 0x7f6d181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.993+0000 7f6d2026a640 1 --2- 172.21.15.12:0/1385676653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d18101de0 0x7f6d181021c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.993+0000 7f6d2026a640 1 -- 172.21.15.12:0/1385676653 >> 172.21.15.12:0/1385676653 conn(0x7f6d180fd8c0 msgr2=0x7f6d180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:41.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.993+0000 7f6d2026a640 1 -- 172.21.15.12:0/1385676653 shutdown_connections 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.993+0000 7f6d2026a640 1 -- 172.21.15.12:0/1385676653 wait complete. 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.993+0000 7f6d2026a640 1 Processor -- start 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.993+0000 7f6d2026a640 1 -- start start 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.993+0000 7f6d2026a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d18101de0 0x7f6d18198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d2026a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d18102790 0x7f6d18198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d2026a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d18106f10 0x7f6d1819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d2026a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d18111f70 con 0x7f6d18106f10 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d2026a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6d18111df0 con 0x7f6d18101de0 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d2026a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181120f0 con 0x7f6d18102790 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1e807640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d18106f10 0x7f6d1819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1e807640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d18106f10 0x7f6d1819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33292/0 (socket says 172.21.15.12:33292) 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1e807640 1 -- 172.21.15.12:0/1946929522 learned_addr learned my addr 172.21.15.12:0/1946929522 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:41.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1e006640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d18101de0 0x7f6d18198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1d805640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d18102790 0x7f6d18198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1e807640 1 -- 172.21.15.12:0/1946929522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d18102790 msgr2=0x7f6d18198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1e807640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d18102790 0x7f6d18198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1e807640 1 -- 172.21.15.12:0/1946929522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d18101de0 msgr2=0x7f6d18198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1e807640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d18101de0 0x7f6d18198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1e807640 1 -- 172.21.15.12:0/1946929522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1819d3e0 con 0x7f6d18106f10 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d1e807640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d18106f10 0x7f6d1819cd00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000eb10 tx=0x7f6d1000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d0f7fe640 1 -- 172.21.15.12:0/1946929522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10004b20 con 0x7f6d18106f10 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d2026a640 1 -- 172.21.15.12:0/1946929522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1819d6d0 con 0x7f6d18106f10 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d0f7fe640 1 -- 172.21.15.12:0/1946929522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d10004cc0 con 0x7f6d18106f10 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d0f7fe640 1 -- 172.21.15.12:0/1946929522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10010760 con 0x7f6d18106f10 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.994+0000 7f6d2026a640 1 -- 172.21.15.12:0/1946929522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d181a4fb0 con 0x7f6d18106f10 2024-09-19T06:41:41.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.996+0000 7f6d2026a640 1 -- 172.21.15.12:0/1946929522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d181021c0 con 0x7f6d18106f10 2024-09-19T06:41:41.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.997+0000 7f6d0f7fe640 1 -- 172.21.15.12:0/1946929522 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6d10005020 con 0x7f6d18106f10 2024-09-19T06:41:41.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.997+0000 7f6d0f7fe640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6d040a33b0 0x7f6d040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:41.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.997+0000 7f6d0f7fe640 1 -- 172.21.15.12:0/1946929522 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f6d100d03d0 con 0x7f6d18106f10 2024-09-19T06:41:41.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.997+0000 7f6d1e006640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6d040a33b0 0x7f6d040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:41.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:40.998+0000 7f6d1e006640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6d040a33b0 0x7f6d040a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009230 tx=0x7f6d140058d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:41.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.002+0000 7f6d0f7fe640 1 -- 172.21.15.12:0/1946929522 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d1009cd30 con 0x7f6d18106f10 2024-09-19T06:41:41.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.215+0000 7f6d2026a640 1 -- 172.21.15.12:0/1946929522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d1802d7c0 con 0x7f6d18106f10 2024-09-19T06:41:41.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.215+0000 7f6d0f7fe640 1 -- 172.21.15.12:0/1946929522 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11979 (secure 0 0 0) 0x7f6d1009c630 con 0x7f6d18106f10 2024-09-19T06:41:41.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:41:41.217 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"btime":"2024-09-19T06:41:24:903521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:41:24.405002+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:41:41.217 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2024-09-19T06:41:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.217+0000 7f6d2026a640 1 -- 172.21.15.12:0/1946929522 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6d040a33b0 msgr2=0x7f6d040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.217+0000 7f6d2026a640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6d040a33b0 0x7f6d040a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009230 tx=0x7f6d140058d0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.217+0000 7f6d2026a640 1 -- 172.21.15.12:0/1946929522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d18106f10 msgr2=0x7f6d1819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.217+0000 7f6d2026a640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d18106f10 0x7f6d1819cd00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000eb10 tx=0x7f6d1000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.217+0000 7f6d2026a640 1 -- 172.21.15.12:0/1946929522 shutdown_connections 2024-09-19T06:41:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.217+0000 7f6d2026a640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d18106f10 0x7f6d1819cd00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.217+0000 7f6d2026a640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6d040a33b0 0x7f6d040a5870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.217+0000 7f6d2026a640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d18102790 0x7f6d18198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.217+0000 7f6d2026a640 1 --2- 172.21.15.12:0/1946929522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d18101de0 0x7f6d18198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.217+0000 7f6d2026a640 1 -- 172.21.15.12:0/1946929522 >> 172.21.15.12:0/1946929522 conn(0x7f6d180fd8c0 msgr2=0x7f6d180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:41.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.218+0000 7f6d2026a640 1 -- 172.21.15.12:0/1946929522 shutdown_connections 2024-09-19T06:41:41.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:41.218+0000 7f6d2026a640 1 -- 172.21.15.12:0/1946929522 wait complete. 2024-09-19T06:41:41.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:41 smithi016 ceph-mon[34911]: pgmap v49: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 918 op/s 2024-09-19T06:41:41.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:41 smithi016 ceph-mon[34911]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T06:41:41.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:41 smithi012 ceph-mon[30937]: pgmap v49: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 918 op/s 2024-09-19T06:41:41.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:41 smithi012 ceph-mon[30937]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T06:41:41.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:41 smithi173 ceph-mon[35349]: pgmap v49: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 918 op/s 2024-09-19T06:41:41.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:41 smithi173 ceph-mon[35349]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T06:41:41.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:41:42.099 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:42.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:42 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1946929522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:42.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:42 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1946929522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:42.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:42 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1946929522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:42.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.596+0000 7f20ffb0b640 1 -- 172.21.15.12:0/3535646109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f8100a80 msgr2=0x7f20f8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:42.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.596+0000 7f20ffb0b640 1 --2- 172.21.15.12:0/3535646109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f8100a80 0x7f20f8100ee0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009930 tx=0x7f20e802a420 comp rx=0 tx=0).stop 2024-09-19T06:41:42.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.596+0000 7f20ffb0b640 1 -- 172.21.15.12:0/3535646109 shutdown_connections 2024-09-19T06:41:42.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.596+0000 7f20ffb0b640 1 --2- 172.21.15.12:0/3535646109 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f8101420 0x7f20f810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.596+0000 7f20ffb0b640 1 --2- 172.21.15.12:0/3535646109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f8100a80 0x7f20f8100ee0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.596+0000 7f20ffb0b640 1 --2- 172.21.15.12:0/3535646109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f8106a80 0x7f20f8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.596+0000 7f20ffb0b640 1 -- 172.21.15.12:0/3535646109 >> 172.21.15.12:0/3535646109 conn(0x7f20f80fc780 msgr2=0x7f20f80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:42.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.596+0000 7f20ffb0b640 1 -- 172.21.15.12:0/3535646109 shutdown_connections 2024-09-19T06:41:42.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.596+0000 7f20ffb0b640 1 -- 172.21.15.12:0/3535646109 wait complete. 2024-09-19T06:41:42.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.597+0000 7f20ffb0b640 1 Processor -- start 2024-09-19T06:41:42.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.597+0000 7f20ffb0b640 1 -- start start 2024-09-19T06:41:42.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.597+0000 7f20ffb0b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f8100a80 0x7f20f81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.597+0000 7f20ffb0b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f8101420 0x7f20f8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.597+0000 7f20ffb0b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f8106a80 0x7f20f819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.597+0000 7f20ffb0b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8110e80 con 0x7f20f8100a80 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.597+0000 7f20ffb0b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8110d00 con 0x7f20f8101420 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.597+0000 7f20ffb0b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8111000 con 0x7f20f8106a80 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fd8a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f8100a80 0x7f20f81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fd8a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f8100a80 0x7f20f81984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33300/0 (socket says 172.21.15.12:33300) 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fd8a7640 1 -- 172.21.15.12:0/1355798688 learned_addr learned my addr 172.21.15.12:0/1355798688 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f8101420 0x7f20f8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f8106a80 0x7f20f819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fd8a7640 1 -- 172.21.15.12:0/1355798688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f8106a80 msgr2=0x7f20f819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fd8a7640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f8106a80 0x7f20f819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fd8a7640 1 -- 172.21.15.12:0/1355798688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f8101420 msgr2=0x7f20f8198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:42.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fd8a7640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f8101420 0x7f20f8198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fd8a7640 1 -- 172.21.15.12:0/1355798688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f819d480 con 0x7f20f8100a80 2024-09-19T06:41:42.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20fd8a7640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f8100a80 0x7f20f81984d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f20f400d950 tx=0x7f20f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:42.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20eeffd640 1 -- 172.21.15.12:0/1355798688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f4017070 con 0x7f20f8100a80 2024-09-19T06:41:42.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20eeffd640 1 -- 172.21.15.12:0/1355798688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20f4009c30 con 0x7f20f8100a80 2024-09-19T06:41:42.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20ffb0b640 1 -- 172.21.15.12:0/1355798688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f819d770 con 0x7f20f8100a80 2024-09-19T06:41:42.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20eeffd640 1 -- 172.21.15.12:0/1355798688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f400f6b0 con 0x7f20f8100a80 2024-09-19T06:41:42.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.598+0000 7f20ffb0b640 1 -- 172.21.15.12:0/1355798688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f81a5050 con 0x7f20f8100a80 2024-09-19T06:41:42.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.601+0000 7f2101ee4740 1 Processor -- start 2024-09-19T06:41:42.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.601+0000 7f20eeffd640 1 -- 172.21.15.12:0/1355798688 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f20f40109d0 con 0x7f20f8100a80 2024-09-19T06:41:42.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.601+0000 7f2101ee4740 1 -- start start 2024-09-19T06:41:42.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.601+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92fb40 0x55d9ca92e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92e5d0 0x55d9ca92ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca93b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f2101ee4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca8942f0 con 0x55d9ca92fb40 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f2101ee4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca83bcf0 con 0x55d9ca939370 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f2101ee4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca8902b0 con 0x55d9ca92e5d0 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fe0a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92fb40 0x55d9ca92e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fe0a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92fb40 0x55d9ca92e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33312/0 (socket says 172.21.15.12:33312) 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fe0a8640 1 -- 172.21.15.12:0/2939721093 learned_addr learned my addr 172.21.15.12:0/2939721093 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/2939721093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca93b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fd8a7640 1 --2- 172.21.15.12:0/2939721093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92e5d0 0x55d9ca92ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fe0a8640 1 -- 172.21.15.12:0/2939721093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92e5d0 msgr2=0x55d9ca92ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/2939721093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92e5d0 0x55d9ca92ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fe0a8640 1 -- 172.21.15.12:0/2939721093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 msgr2=0x55d9ca93b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/2939721093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca93b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fe0a8640 1 -- 172.21.15.12:0/2939721093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ca8203a0 con 0x55d9ca92fb40 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/2939721093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca93b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20eeffd640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20e40a33b0 0x7f20e40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.602+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/2939721093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92fb40 0x55d9ca92e090 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009fd0 tx=0x7f20f00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd34cbd3f5a8e1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.603+0000 7f20fd8a7640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20e40a33b0 0x7f20e40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.603+0000 7f20eeffd640 1 -- 172.21.15.12:0/1355798688 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f20f40cf880 con 0x7f20f8100a80 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.603+0000 7f20e3fff640 1 -- 172.21.15.12:0/2939721093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0004d20 con 0x55d9ca92fb40 2024-09-19T06:41:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.603+0000 7f20e3fff640 1 -- 172.21.15.12:0/2939721093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20f0004050 con 0x55d9ca92fb40 2024-09-19T06:41:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.603+0000 7f20e3fff640 1 -- 172.21.15.12:0/2939721093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0005260 con 0x55d9ca92fb40 2024-09-19T06:41:42.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.603+0000 7f2101ee4740 1 -- 172.21.15.12:0/2939721093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92fb40 msgr2=0x55d9ca92e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:42.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.603+0000 7f20fd8a7640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20e40a33b0 0x7f20e40a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20f40cd000 tx=0x7f20f40d5550 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:42.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.603+0000 7f2101ee4740 1 --2- 172.21.15.12:0/2939721093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92fb40 0x55d9ca92e090 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009fd0 tx=0x7f20f00118d0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.603+0000 7f2101ee4740 1 -- 172.21.15.12:0/2939721093 shutdown_connections 2024-09-19T06:41:42.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.603+0000 7f2101ee4740 1 --2- 172.21.15.12:0/2939721093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca93b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 --2- 172.21.15.12:0/2939721093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92e5d0 0x55d9ca92ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 --2- 172.21.15.12:0/2939721093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92fb40 0x55d9ca92e090 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 -- 172.21.15.12:0/2939721093 >> 172.21.15.12:0/2939721093 conn(0x55d9ca8f7310 msgr2=0x55d9ca92ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:42.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 -- 172.21.15.12:0/2939721093 shutdown_connections 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 -- 172.21.15.12:0/2939721093 wait complete. 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 -- start start 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 Processor -- start 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca938cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 0x55d9ca935ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca936600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca940480 con 0x55d9ca92e5d0 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.604+0000 7f2101ee4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca84f060 con 0x55d9ca939370 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f2101ee4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca940600 con 0x55d9ca92fb40 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f2101ee4740 10 client.0 _ll_register_callbacks cb 0x55d9ca5a28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fe0a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca938cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fe0a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca938cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33318/0 (socket says 172.21.15.12:33318) 2024-09-19T06:41:42.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fe0a8640 1 -- 172.21.15.12:0/1229512498 learned_addr learned my addr 172.21.15.12:0/1229512498 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 0x55d9ca935ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca936600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fe0a8640 1 -- 172.21.15.12:0/1229512498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 msgr2=0x55d9ca935ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 0x55d9ca935ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fe0a8640 1 -- 172.21.15.12:0/1229512498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 msgr2=0x55d9ca936600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca936600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fe0a8640 1 -- 172.21.15.12:0/1229512498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ca6053c0 con 0x55d9ca92e5d0 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca938cf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f20f00099b0 tx=0x7f20f0009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7747a58227cba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20e17fa640 1 -- 172.21.15.12:0/1229512498 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0029020 con 0x55d9ca92e5d0 2024-09-19T06:41:42.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f2101ee4740 1 -- 172.21.15.12:0/1229512498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20f0004050 con 0x55d9ca92e5d0 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.605+0000 7f20e17fa640 1 -- 172.21.15.12:0/1229512498 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f20f0004610 con 0x55d9ca92e5d0 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f20e17fa640 1 -- 172.21.15.12:0/1229512498 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f20f0034050 con 0x55d9ca92e5d0 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f2101ee4740 10 client.15903 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f2101ee4740 1 -- 172.21.15.12:0/1229512498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d9ca94bef0 con 0x55d9ca92e5d0 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f20e17fa640 1 -- 172.21.15.12:0/1229512498 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20f0004050 con 0x55d9ca92e5d0 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f20e17fa640 1 -- 172.21.15.12:0/1229512498 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f20f000f570 con 0x55d9ca92e5d0 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f2101ee4740 10 client.15903 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f2101ee4740 10 client.15903 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f2101ee4740 20 client.15903 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f2101ee4740 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d9ca94d350 0x55d9ca94f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f2101ee4740 4 client.15903 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f2101ee4740 1 -- 172.21.15.12:0/1229512498 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9ca8a1860 con 0x55d9ca94d350 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.606+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d9ca94d350 0x55d9ca94f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.607+0000 7f20e17fa640 10 client.15903 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.607+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d9ca94d350 0x55d9ca94f740 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=290949529d3516bd server_cookie=ab7448c610dd184b in_seq=0 out_seq=0 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.607+0000 7f20e17fa640 1 -- 172.21.15.12:0/1229512498 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d9ca8a1860 con 0x55d9ca94d350 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f20e17fa640 10 client.15903 handle_command_reply: tid=0 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 client.15903 shutdown 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 -- 172.21.15.12:0/1229512498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 msgr2=0x55d9ca938cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca938cf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f20f00099b0 tx=0x7f20f0009c80 comp rx=0 tx=0).stop 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 -- 172.21.15.12:0/1229512498 shutdown_connections 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d9ca94d350 0x55d9ca94f740 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca936600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 0x55d9ca935ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 --2- 172.21.15.12:0/1229512498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca938cf0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f20e17fa640 0 client.15903 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:41:42.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 -- 172.21.15.12:0/1229512498 >> 172.21.15.12:0/1229512498 conn(0x55d9ca8f7310 msgr2=0x55d9ca930960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:42.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 -- 172.21.15.12:0/1229512498 shutdown_connections 2024-09-19T06:41:42.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 1 -- 172.21.15.12:0/1229512498 wait complete. 2024-09-19T06:41:42.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.608+0000 7f2101ee4740 20 client.15903 trim_cache size 0 max 16384 2024-09-19T06:41:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f2101ee4740 1 Processor -- start 2024-09-19T06:41:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f2101ee4740 1 -- start start 2024-09-19T06:41:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca949720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca92fb40 0x55d9ca935880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca939370 0x55d9ca929d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f2101ee4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81aba20 con 0x55d9ca92e5d0 2024-09-19T06:41:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f2101ee4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81ad650 con 0x55d9ca92fb40 2024-09-19T06:41:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f2101ee4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81ac0f0 con 0x55d9ca939370 2024-09-19T06:41:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f20fe0a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca949720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f20fe0a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca949720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33334/0 (socket says 172.21.15.12:33334) 2024-09-19T06:41:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f20fe0a8640 1 -- 172.21.15.12:0/2845187187 learned_addr learned my addr 172.21.15.12:0/2845187187 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/2845187187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca92fb40 0x55d9ca935880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f20fe0a8640 1 -- 172.21.15.12:0/2845187187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca939370 msgr2=0x55d9ca929d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/2845187187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca939370 0x55d9ca929d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f20fe0a8640 1 -- 172.21.15.12:0/2845187187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca92fb40 msgr2=0x55d9ca935880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/2845187187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca92fb40 0x55d9ca935880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.621+0000 7f20fe0a8640 1 -- 172.21.15.12:0/2845187187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ca935dc0 con 0x55d9ca92e5d0 2024-09-19T06:41:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/2845187187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca949720 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f20f0005d50 tx=0x7f20f0005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a36211246ac084 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f20e37fe640 1 -- 172.21.15.12:0/2845187187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f003d070 con 0x55d9ca92e5d0 2024-09-19T06:41:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f20e37fe640 1 -- 172.21.15.12:0/2845187187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20f0009480 con 0x55d9ca92e5d0 2024-09-19T06:41:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f20e37fe640 1 -- 172.21.15.12:0/2845187187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0029030 con 0x55d9ca92e5d0 2024-09-19T06:41:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f2101ee4740 1 -- 172.21.15.12:0/2845187187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 msgr2=0x55d9ca949720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f2101ee4740 1 --2- 172.21.15.12:0/2845187187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca949720 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f20f0005d50 tx=0x7f20f0005f10 comp rx=0 tx=0).stop 2024-09-19T06:41:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f2101ee4740 1 -- 172.21.15.12:0/2845187187 shutdown_connections 2024-09-19T06:41:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f2101ee4740 1 --2- 172.21.15.12:0/2845187187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca939370 0x55d9ca929d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f2101ee4740 1 --2- 172.21.15.12:0/2845187187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca92fb40 0x55d9ca935880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f2101ee4740 1 --2- 172.21.15.12:0/2845187187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca949720 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.622+0000 7f2101ee4740 1 -- 172.21.15.12:0/2845187187 >> 172.21.15.12:0/2845187187 conn(0x55d9ca8f7310 msgr2=0x55d9ca925a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 1 -- 172.21.15.12:0/2845187187 shutdown_connections 2024-09-19T06:41:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 1 -- 172.21.15.12:0/2845187187 wait complete. 2024-09-19T06:41:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 1 -- start start 2024-09-19T06:41:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 1 Processor -- start 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca945890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 0x55d9ca945dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca932260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81acec0 con 0x55d9ca92e5d0 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81ac7f0 con 0x55d9ca939370 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20f81a9a00 con 0x55d9ca92fb40 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f2101ee4740 10 client.0 _ll_register_callbacks cb 0x7f20e8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f20fe0a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca945890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.623+0000 7f20fe0a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca945890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33346/0 (socket says 172.21.15.12:33346) 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20fe0a8640 1 -- 172.21.15.12:0/3874566076 learned_addr learned my addr 172.21.15.12:0/3874566076 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca932260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 0x55d9ca945dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20fe0a8640 1 -- 172.21.15.12:0/3874566076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 msgr2=0x55d9ca945dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 0x55d9ca945dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20fe0a8640 1 -- 172.21.15.12:0/3874566076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 msgr2=0x55d9ca932260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca932260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20fe0a8640 1 -- 172.21.15.12:0/3874566076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ca946410 con 0x55d9ca92e5d0 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 0x55d9ca945dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20fe0a8640 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca945890 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f20f003b040 tx=0x7f20f0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cee011f8761cdb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20e17fa640 1 -- 172.21.15.12:0/3874566076 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0029030 con 0x55d9ca92e5d0 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20e17fa640 1 -- 172.21.15.12:0/3874566076 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f20f0004820 con 0x55d9ca92e5d0 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f2101ee4740 1 -- 172.21.15.12:0/3874566076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20f0009480 con 0x55d9ca92e5d0 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f20e17fa640 1 -- 172.21.15.12:0/3874566076 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f20f003d070 con 0x55d9ca92e5d0 2024-09-19T06:41:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.624+0000 7f2101ee4740 10 client.15909 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.625+0000 7f2101ee4740 1 -- 172.21.15.12:0/3874566076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d9ca9b7330 con 0x55d9ca92e5d0 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.625+0000 7f20e17fa640 1 -- 172.21.15.12:0/3874566076 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20f0009480 con 0x55d9ca92e5d0 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.625+0000 7f20e17fa640 1 -- 172.21.15.12:0/3874566076 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f20f0043030 con 0x55d9ca92e5d0 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.625+0000 7f2101ee4740 10 client.15909 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.625+0000 7f2101ee4740 10 client.15909 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.625+0000 7f2101ee4740 20 client.15909 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.625+0000 7f2101ee4740 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d9ca9b7940 0x55d9ca9b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.625+0000 7f2101ee4740 4 client.15909 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.625+0000 7f2101ee4740 1 -- 172.21.15.12:0/3874566076 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9ca89bd70 con 0x55d9ca9b7940 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.625+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d9ca9b7940 0x55d9ca9b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f20e17fa640 10 client.15909 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f20fd0a6640 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d9ca9b7940 0x55d9ca9b9d30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1fd59b76024cf610 server_cookie=406ca9973a329354 in_seq=0 out_seq=0 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f20e17fa640 1 -- 172.21.15.12:0/3874566076 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9ca89bd70 con 0x55d9ca9b7940 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f20e17fa640 10 client.15909 handle_command_reply: tid=0 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 client.15909 shutdown 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 -- 172.21.15.12:0/3874566076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 msgr2=0x55d9ca945890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca945890 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f20f003b040 tx=0x7f20f0004af0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 -- 172.21.15.12:0/3874566076 shutdown_connections 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d9ca9b7940 0x55d9ca9b9d30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d9ca939370 0x55d9ca932260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d9ca92fb40 0x55d9ca945dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 --2- 172.21.15.12:0/3874566076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d9ca92e5d0 0x55d9ca945890 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f20e17fa640 0 client.15909 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:41:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 -- 172.21.15.12:0/3874566076 >> 172.21.15.12:0/3874566076 conn(0x55d9ca8f7310 msgr2=0x55d9ca929d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 -- 172.21.15.12:0/3874566076 shutdown_connections 2024-09-19T06:41:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 1 -- 172.21.15.12:0/3874566076 wait complete. 2024-09-19T06:41:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.626+0000 7f2101ee4740 20 client.15909 trim_cache size 0 max 16384 2024-09-19T06:41:42.634 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:41:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 -- 172.21.15.12:0/1355798688 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20e40a33b0 msgr2=0x7f20e40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20e40a33b0 0x7f20e40a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20f40cd000 tx=0x7f20f40d5550 comp rx=0 tx=0).stop 2024-09-19T06:41:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 -- 172.21.15.12:0/1355798688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f8100a80 msgr2=0x7f20f81984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f8100a80 0x7f20f81984d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f20f400d950 tx=0x7f20f400de10 comp rx=0 tx=0).stop 2024-09-19T06:41:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 -- 172.21.15.12:0/1355798688 shutdown_connections 2024-09-19T06:41:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20e40a33b0 0x7f20e40a5870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f8106a80 0x7f20f819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f8101420 0x7f20f8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 --2- 172.21.15.12:0/1355798688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f8100a80 0x7f20f81984d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 -- 172.21.15.12:0/1355798688 >> 172.21.15.12:0/1355798688 conn(0x7f20f80fc780 msgr2=0x7f20f806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 -- 172.21.15.12:0/1355798688 shutdown_connections 2024-09-19T06:41:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:42.627+0000 7f20ffb0b640 1 -- 172.21.15.12:0/1355798688 wait complete. 2024-09-19T06:41:43.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:43 smithi012 ceph-mon[30937]: pgmap v50: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 503 op/s 2024-09-19T06:41:43.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:41:43.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:43 smithi016 ceph-mon[34911]: pgmap v50: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 503 op/s 2024-09-19T06:41:43.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:43 smithi173 ceph-mon[35349]: pgmap v50: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 503 op/s 2024-09-19T06:41:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:44.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.162+0000 7f3353ff2640 1 -- 172.21.15.12:0/1349987546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f334c106f10 msgr2=0x7f334c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.162+0000 7f3353ff2640 1 --2- 172.21.15.12:0/1349987546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f334c106f10 0x7f334c10ea90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3344009ca0 tx=0x7f334402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.162+0000 7f3353ff2640 1 -- 172.21.15.12:0/1349987546 shutdown_connections 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.162+0000 7f3353ff2640 1 --2- 172.21.15.12:0/1349987546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f334c106f10 0x7f334c10ea90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.162+0000 7f3353ff2640 1 --2- 172.21.15.12:0/1349987546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f334c102790 0x7f334c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.162+0000 7f3353ff2640 1 --2- 172.21.15.12:0/1349987546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f334c101de0 0x7f334c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.162+0000 7f3353ff2640 1 -- 172.21.15.12:0/1349987546 >> 172.21.15.12:0/1349987546 conn(0x7f334c0fd8c0 msgr2=0x7f334c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.162+0000 7f3353ff2640 1 -- 172.21.15.12:0/1349987546 shutdown_connections 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.162+0000 7f3353ff2640 1 -- 172.21.15.12:0/1349987546 wait complete. 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.163+0000 7f3353ff2640 1 Processor -- start 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.163+0000 7f3353ff2640 1 -- start start 2024-09-19T06:41:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.163+0000 7f3353ff2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f334c101de0 0x7f334c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.163+0000 7f3353ff2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f334c102790 0x7f334c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.163+0000 7f3353ff2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f334c106f10 0x7f334c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.163+0000 7f3353ff2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f334c111f90 con 0x7f334c106f10 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.163+0000 7f3353ff2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f334c111e10 con 0x7f334c102790 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.163+0000 7f3353ff2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f334c112110 con 0x7f334c101de0 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f335258f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f334c106f10 0x7f334c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f3351d8e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f334c101de0 0x7f334c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f335158d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f334c102790 0x7f334c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f335258f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f334c106f10 0x7f334c19ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33356/0 (socket says 172.21.15.12:33356) 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f335258f640 1 -- 172.21.15.12:0/2835821763 learned_addr learned my addr 172.21.15.12:0/2835821763 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f3351d8e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f334c101de0 0x7f334c198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:34848/0 (socket says 172.21.15.12:34848) 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f335258f640 1 -- 172.21.15.12:0/2835821763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f334c101de0 msgr2=0x7f334c198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f335258f640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f334c101de0 0x7f334c198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f335258f640 1 -- 172.21.15.12:0/2835821763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f334c102790 msgr2=0x7f334c198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f335258f640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f334c102790 0x7f334c198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f335258f640 1 -- 172.21.15.12:0/2835821763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c19d500 con 0x7f334c106f10 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.164+0000 7f335258f640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f334c106f10 0x7f334c19ce20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3344031a20 tx=0x7f3344031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.165+0000 7f3342ffd640 1 -- 172.21.15.12:0/2835821763 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334404b070 con 0x7f334c106f10 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.165+0000 7f3353ff2640 1 -- 172.21.15.12:0/2835821763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334c19d790 con 0x7f334c106f10 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.165+0000 7f3342ffd640 1 -- 172.21.15.12:0/2835821763 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f334403cc80 con 0x7f334c106f10 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.165+0000 7f3342ffd640 1 -- 172.21.15.12:0/2835821763 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33440045b0 con 0x7f334c106f10 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.165+0000 7f3353ff2640 1 -- 172.21.15.12:0/2835821763 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f334c074420 con 0x7f334c106f10 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.167+0000 7f3342ffd640 1 -- 172.21.15.12:0/2835821763 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f334404e070 con 0x7f334c106f10 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.167+0000 7f33563cb740 1 Processor -- start 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f33563cb740 1 -- start start 2024-09-19T06:41:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f33563cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f3b40 0x5597fd0f2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f33563cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f25d0 0x5597fd0f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f33563cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0ff760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f33563cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5597fd0582f0 con 0x5597fd0f3b40 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f33563cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5597fcfffcf0 con 0x5597fd0fd370 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f33563cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5597fd0542b0 con 0x5597fd0f25d0 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f335158d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f3b40 0x5597fd0f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f335158d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f3b40 0x5597fd0f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33362/0 (socket says 172.21.15.12:33362) 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f335158d640 1 -- 172.21.15.12:0/2039175217 learned_addr learned my addr 172.21.15.12:0/2039175217 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f3351d8e640 1 --2- 172.21.15.12:0/2039175217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f25d0 0x5597fd0f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f335158d640 1 --2- 172.21.15.12:0/2039175217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0ff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f3342ffd640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33380a33b0 0x7f33380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f335158d640 1 -- 172.21.15.12:0/2039175217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f25d0 msgr2=0x5597fd0f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f335158d640 1 --2- 172.21.15.12:0/2039175217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f25d0 0x5597fd0f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f335158d640 1 -- 172.21.15.12:0/2039175217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 msgr2=0x5597fd0ff760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f335158d640 1 --2- 172.21.15.12:0/2039175217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0ff760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f335258f640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33380a33b0 0x7f33380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f335158d640 1 -- 172.21.15.12:0/2039175217 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597fcfe43a0 con 0x5597fd0f3b40 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.168+0000 7f3351d8e640 1 --2- 172.21.15.12:0/2039175217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f25d0 0x5597fd0f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.169+0000 7f3342ffd640 1 -- 172.21.15.12:0/2835821763 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f33440f45f0 con 0x7f334c106f10 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.169+0000 7f335158d640 1 --2- 172.21.15.12:0/2039175217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f3b40 0x5597fd0f2090 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f333c0176c0 tx=0x7f333c009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32f496a7e4083de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.169+0000 7f3337fff640 1 -- 172.21.15.12:0/2039175217 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c00f040 con 0x5597fd0f3b40 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.169+0000 7f3337fff640 1 -- 172.21.15.12:0/2039175217 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c01d070 con 0x5597fd0f3b40 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.169+0000 7f3337fff640 1 -- 172.21.15.12:0/2039175217 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c018650 con 0x5597fd0f3b40 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 -- 172.21.15.12:0/2039175217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f3b40 msgr2=0x5597fd0f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f335258f640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33380a33b0 0x7f33380a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33440bd3c0 tx=0x7f33440bb400 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 --2- 172.21.15.12:0/2039175217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f3b40 0x5597fd0f2090 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f333c0176c0 tx=0x7f333c009520 comp rx=0 tx=0).stop 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 -- 172.21.15.12:0/2039175217 shutdown_connections 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 --2- 172.21.15.12:0/2039175217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 --2- 172.21.15.12:0/2039175217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f25d0 0x5597fd0f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 --2- 172.21.15.12:0/2039175217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f3b40 0x5597fd0f2090 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 -- 172.21.15.12:0/2039175217 >> 172.21.15.12:0/2039175217 conn(0x5597fd0bb310 msgr2=0x5597fd0eec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 -- 172.21.15.12:0/2039175217 shutdown_connections 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 -- 172.21.15.12:0/2039175217 wait complete. 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 -- start start 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.170+0000 7f33563cb740 1 Processor -- start 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f33563cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f33563cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd0f9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f33563cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0fa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f33563cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5597fd100010 con 0x5597fd0f25d0 2024-09-19T06:41:44.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f33563cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5597fd013060 con 0x5597fd0fd370 2024-09-19T06:41:44.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f33563cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5597fd100190 con 0x5597fd0f3b40 2024-09-19T06:41:44.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f33563cb740 10 client.0 _ll_register_callbacks cb 0x5597fcd668c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:44.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f335158d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f335158d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0fccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33364/0 (socket says 172.21.15.12:33364) 2024-09-19T06:41:44.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f335158d640 1 -- 172.21.15.12:0/1358881089 learned_addr learned my addr 172.21.15.12:0/1358881089 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:44.637 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:41:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f3351d8e640 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd0f9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f335158d640 1 -- 172.21.15.12:0/1358881089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 msgr2=0x5597fd0f9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f335158d640 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd0f9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f335158d640 1 -- 172.21.15.12:0/1358881089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 msgr2=0x5597fd0fa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f335158d640 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0fa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f335158d640 1 -- 172.21.15.12:0/1358881089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597fcdc93c0 con 0x5597fd0f25d0 2024-09-19T06:41:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f335158d640 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0fccc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f333c004810 tx=0x7f333c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5a1d6b4d1d44a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.171+0000 7f33357fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33357fa640 1 -- 172.21.15.12:0/1358881089 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c025070 con 0x5597fd0f25d0 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33563cb740 1 -- 172.21.15.12:0/1358881089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f333c01d070 con 0x5597fd0f25d0 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33357fa640 1 -- 172.21.15.12:0/1358881089 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f333c0158e0 con 0x5597fd0f25d0 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33357fa640 1 -- 172.21.15.12:0/1358881089 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f333c015ea0 con 0x5597fd0f25d0 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33563cb740 10 client.15921 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33563cb740 1 -- 172.21.15.12:0/1358881089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5597fd10ba20 con 0x5597fd0f25d0 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33357fa640 1 -- 172.21.15.12:0/1358881089 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c01d070 con 0x5597fd0f25d0 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33357fa640 1 -- 172.21.15.12:0/1358881089 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f333c0183f0 con 0x5597fd0f25d0 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33563cb740 10 client.15921 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33563cb740 10 client.15921 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33563cb740 20 client.15921 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33563cb740 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5597fd10cd70 0x5597fd10f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33563cb740 4 client.15921 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.172+0000 7f33563cb740 1 -- 172.21.15.12:0/1358881089 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597fd065860 con 0x5597fd10cd70 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.173+0000 7f3351d8e640 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5597fd10cd70 0x5597fd10f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.173+0000 7f3351d8e640 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5597fd10cd70 0x5597fd10f160 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7bc0bb326582bb48 server_cookie=7ec79f7a4c519333 in_seq=0 out_seq=0 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.173+0000 7f33357fa640 10 client.15921 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33357fa640 1 -- 172.21.15.12:0/1358881089 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597fd065860 con 0x5597fd10cd70 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33357fa640 10 client.15921 handle_command_reply: tid=0 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 client.15921 shutdown 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 -- 172.21.15.12:0/1358881089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 msgr2=0x5597fd0fccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0fccc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f333c004810 tx=0x7f333c009ba0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 -- 172.21.15.12:0/1358881089 shutdown_connections 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5597fd10cd70 0x5597fd10f160 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0fa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd0f9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33357fa640 0 client.15921 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 --2- 172.21.15.12:0/1358881089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0fccc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 -- 172.21.15.12:0/1358881089 >> 172.21.15.12:0/1358881089 conn(0x5597fd0bb310 msgr2=0x5597fd0f4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 -- 172.21.15.12:0/1358881089 shutdown_connections 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 1 -- 172.21.15.12:0/1358881089 wait complete. 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.174+0000 7f33563cb740 20 client.15921 trim_cache size 0 max 16384 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f33563cb740 1 Processor -- start 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f33563cb740 1 -- start start 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f33563cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0f8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f33563cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd0f5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f33563cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0f5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f33563cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f334c1ab8a0 con 0x5597fd0f25d0 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f33563cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f334c1ad4d0 con 0x5597fd0fd370 2024-09-19T06:41:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f33563cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f334c1abf70 con 0x5597fd0f3b40 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f335158d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f335158d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0f8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33370/0 (socket says 172.21.15.12:33370) 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.187+0000 7f335158d640 1 -- 172.21.15.12:0/3317756347 learned_addr learned my addr 172.21.15.12:0/3317756347 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f335158d640 1 --2- 172.21.15.12:0/3317756347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f3351d8e640 1 --2- 172.21.15.12:0/3317756347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd0f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f335158d640 1 -- 172.21.15.12:0/3317756347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 msgr2=0x5597fd0f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f335158d640 1 --2- 172.21.15.12:0/3317756347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd0f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f335158d640 1 -- 172.21.15.12:0/3317756347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 msgr2=0x5597fd0f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f335158d640 1 --2- 172.21.15.12:0/3317756347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f335158d640 1 -- 172.21.15.12:0/3317756347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597fd0f3300 con 0x5597fd0f25d0 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f335158d640 1 --2- 172.21.15.12:0/3317756347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0f8840 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f333c0098f0 tx=0x7f333c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447a0c7b3fabd964 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f33377fe640 1 -- 172.21.15.12:0/3317756347 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c018e60 con 0x5597fd0f25d0 2024-09-19T06:41:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f33377fe640 1 -- 172.21.15.12:0/3317756347 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c034020 con 0x5597fd0f25d0 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.188+0000 7f33377fe640 1 -- 172.21.15.12:0/3317756347 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c025050 con 0x5597fd0f25d0 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 -- 172.21.15.12:0/3317756347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 msgr2=0x5597fd0f8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 --2- 172.21.15.12:0/3317756347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0f8840 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f333c0098f0 tx=0x7f333c001e50 comp rx=0 tx=0).stop 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 -- 172.21.15.12:0/3317756347 shutdown_connections 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 --2- 172.21.15.12:0/3317756347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0fd370 0x5597fd0f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 --2- 172.21.15.12:0/3317756347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd0f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 --2- 172.21.15.12:0/3317756347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0f25d0 0x5597fd0f8840 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 -- 172.21.15.12:0/3317756347 >> 172.21.15.12:0/3317756347 conn(0x5597fd0bb310 msgr2=0x5597fd0edd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 -- 172.21.15.12:0/3317756347 shutdown_connections 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 -- 172.21.15.12:0/3317756347 wait complete. 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 -- start start 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.189+0000 7f33563cb740 1 Processor -- start 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f33563cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0f25d0 0x5597fd1013f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f33563cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd101930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f33563cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0fd370 0x5597fd101e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f33563cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f334c1acd40 con 0x5597fd0fd370 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f33563cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f334c1ac670 con 0x5597fd0f25d0 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f33563cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f334c1a9880 con 0x5597fd0f3b40 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f33563cb740 10 client.0 _ll_register_callbacks cb 0x7f333c009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f335158d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0fd370 0x5597fd101e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f335158d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0fd370 0x5597fd101e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33372/0 (socket says 172.21.15.12:33372) 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f335158d640 1 -- 172.21.15.12:0/537545669 learned_addr learned my addr 172.21.15.12:0/537545669 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f335158d640 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0f25d0 0x5597fd1013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f3351d8e640 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd101930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f335158d640 1 -- 172.21.15.12:0/537545669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 msgr2=0x5597fd101930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f335158d640 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd101930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f335158d640 1 -- 172.21.15.12:0/537545669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0f25d0 msgr2=0x5597fd1013f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f335158d640 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0f25d0 0x5597fd1013f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.190+0000 7f335158d640 1 -- 172.21.15.12:0/537545669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597fd176a70 con 0x5597fd0fd370 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.191+0000 7f335158d640 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0fd370 0x5597fd101e70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f333c017680 tx=0x7f333c018a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b675114ca5c936d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.191+0000 7f33357fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.191+0000 7f33357fa640 1 -- 172.21.15.12:0/537545669 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c025070 con 0x5597fd0fd370 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.191+0000 7f33357fa640 1 -- 172.21.15.12:0/537545669 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f333c02a440 con 0x5597fd0fd370 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.191+0000 7f33563cb740 1 -- 172.21.15.12:0/537545669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f333c034020 con 0x5597fd0fd370 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.191+0000 7f33357fa640 1 -- 172.21.15.12:0/537545669 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f333c018e60 con 0x5597fd0fd370 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.191+0000 7f33563cb740 10 client.15927 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.191+0000 7f33563cb740 1 -- 172.21.15.12:0/537545669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5597fd177d70 con 0x5597fd0fd370 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f33357fa640 1 -- 172.21.15.12:0/537545669 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c034020 con 0x5597fd0fd370 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f33357fa640 1 -- 172.21.15.12:0/537545669 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f333c03b040 con 0x5597fd0fd370 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f33563cb740 10 client.15927 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f33563cb740 10 client.15927 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f33563cb740 20 client.15927 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f33563cb740 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5597fd1783e0 0x5597fd17a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f33563cb740 4 client.15927 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f33563cb740 1 -- 172.21.15.12:0/537545669 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5597fd05fd70 con 0x5597fd1783e0 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f3351d8e640 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5597fd1783e0 0x5597fd17a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f33357fa640 10 client.15927 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.192+0000 7f3351d8e640 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5597fd1783e0 0x5597fd17a800 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=18542ce99b50d29a server_cookie=1884d12c0d6e5585 in_seq=0 out_seq=0 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33357fa640 1 -- 172.21.15.12:0/537545669 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5597fd05fd70 con 0x5597fd1783e0 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33357fa640 10 client.15927 handle_command_reply: tid=0 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 client.15927 shutdown 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 -- 172.21.15.12:0/537545669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0fd370 msgr2=0x5597fd101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0fd370 0x5597fd101e70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f333c017680 tx=0x7f333c018a80 comp rx=0 tx=0).stop 2024-09-19T06:41:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 -- 172.21.15.12:0/537545669 shutdown_connections 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5597fd1783e0 0x5597fd17a800 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5597fd0fd370 0x5597fd101e70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597fd0f3b40 0x5597fd101930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33357fa640 0 client.15927 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 --2- 172.21.15.12:0/537545669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5597fd0f25d0 0x5597fd1013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 -- 172.21.15.12:0/537545669 >> 172.21.15.12:0/537545669 conn(0x5597fd0bb310 msgr2=0x5597fd0fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 -- 172.21.15.12:0/537545669 shutdown_connections 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 1 -- 172.21.15.12:0/537545669 wait complete. 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.193+0000 7f33563cb740 20 client.15927 trim_cache size 0 max 16384 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 -- 172.21.15.12:0/2835821763 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33380a33b0 msgr2=0x7f33380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33380a33b0 0x7f33380a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33440bd3c0 tx=0x7f33440bb400 comp rx=0 tx=0).stop 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 -- 172.21.15.12:0/2835821763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f334c106f10 msgr2=0x7f334c19ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f334c106f10 0x7f334c19ce20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3344031a20 tx=0x7f3344031a50 comp rx=0 tx=0).stop 2024-09-19T06:41:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 -- 172.21.15.12:0/2835821763 shutdown_connections 2024-09-19T06:41:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f334c106f10 0x7f334c19ce20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f334c102790 0x7f334c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33380a33b0 0x7f33380a5870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 --2- 172.21.15.12:0/2835821763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f334c101de0 0x7f334c198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 -- 172.21.15.12:0/2835821763 >> 172.21.15.12:0/2835821763 conn(0x7f334c0fd8c0 msgr2=0x7f334c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 -- 172.21.15.12:0/2835821763 shutdown_connections 2024-09-19T06:41:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:44.194+0000 7f3353ff2640 1 -- 172.21.15.12:0/2835821763 wait complete. 2024-09-19T06:41:45.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:45 smithi016 ceph-mon[34911]: pgmap v51: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 503 op/s 2024-09-19T06:41:45.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:45 smithi012 ceph-mon[30937]: pgmap v51: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 503 op/s 2024-09-19T06:41:45.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:41:45.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:45 smithi173 ceph-mon[35349]: pgmap v51: 97 pgs: 97 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 503 op/s 2024-09-19T06:41:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 60.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:41:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:46.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.305+0000 7f79d51d7640 1 -- 172.21.15.12:0/502218137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79d0101e10 msgr2=0x7f79d01021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.305+0000 7f79d51d7640 1 --2- 172.21.15.12:0/502218137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79d0101e10 0x7f79d01021f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f79c8009900 tx=0x7f79c802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.305+0000 7f79d51d7640 1 -- 172.21.15.12:0/502218137 shutdown_connections 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.305+0000 7f79d51d7640 1 --2- 172.21.15.12:0/502218137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d0106f40 0x7f79d010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.305+0000 7f79d51d7640 1 --2- 172.21.15.12:0/502218137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79d01027c0 0x7f79d0106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.305+0000 7f79d51d7640 1 --2- 172.21.15.12:0/502218137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79d0101e10 0x7f79d01021f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.305+0000 7f79d51d7640 1 -- 172.21.15.12:0/502218137 >> 172.21.15.12:0/502218137 conn(0x7f79d00fd8d0 msgr2=0x7f79d00ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.305+0000 7f79d51d7640 1 -- 172.21.15.12:0/502218137 shutdown_connections 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.305+0000 7f79d51d7640 1 -- 172.21.15.12:0/502218137 wait complete. 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79d51d7640 1 Processor -- start 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79d51d7640 1 -- start start 2024-09-19T06:41:46.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79d51d7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d0101e10 0x7f79d0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79d51d7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79d01027c0 0x7f79d01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79d51d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79d0106f40 0x7f79d019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79d51d7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0111fc0 con 0x7f79d0106f40 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79d51d7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0111e40 con 0x7f79d0101e10 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79d51d7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0112140 con 0x7f79d01027c0 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79cf59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79d0106f40 0x7f79d019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79cf59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79d0106f40 0x7f79d019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33390/0 (socket says 172.21.15.12:33390) 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79cf59e640 1 -- 172.21.15.12:0/901140924 learned_addr learned my addr 172.21.15.12:0/901140924 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79ced9d640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d0101e10 0x7f79d0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79cf59e640 1 -- 172.21.15.12:0/901140924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79d01027c0 msgr2=0x7f79d01989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.306+0000 7f79ce59c640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79d01027c0 0x7f79d01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79cf59e640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79d01027c0 0x7f79d01989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79cf59e640 1 -- 172.21.15.12:0/901140924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d0101e10 msgr2=0x7f79d0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79cf59e640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d0101e10 0x7f79d0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79cf59e640 1 -- 172.21.15.12:0/901140924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d019d410 con 0x7f79d0106f40 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79ced9d640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d0101e10 0x7f79d0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79ce59c640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79d01027c0 0x7f79d01989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79cf59e640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79d0106f40 0x7f79d019cd30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f79c000cce0 tx=0x7f79c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79c7fff640 1 -- 172.21.15.12:0/901140924 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c000f450 con 0x7f79d0106f40 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79c7fff640 1 -- 172.21.15.12:0/901140924 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79c000fad0 con 0x7f79d0106f40 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79d51d7640 1 -- 172.21.15.12:0/901140924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d019d700 con 0x7f79d0106f40 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79c7fff640 1 -- 172.21.15.12:0/901140924 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0018c10 con 0x7f79d0106f40 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.307+0000 7f79d51d7640 1 -- 172.21.15.12:0/901140924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d01a4fe0 con 0x7f79d0106f40 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.309+0000 7f79c7fff640 1 -- 172.21.15.12:0/901140924 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f79c000f5f0 con 0x7f79d0106f40 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.309+0000 7f79d75b0740 1 Processor -- start 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79d75b0740 1 -- start start 2024-09-19T06:41:46.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06bde090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bde5d0 0x55ee06bdea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 0x55ee06beb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79d75b0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ee06b442f0 con 0x55ee06bdfb40 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79d75b0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ee06aebcf0 con 0x55ee06be9370 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79d75b0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ee06b402b0 con 0x55ee06bde5d0 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79ce59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06bde090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79ce59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06bde090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33398/0 (socket says 172.21.15.12:33398) 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79ce59c640 1 -- 172.21.15.12:0/1025876311 learned_addr learned my addr 172.21.15.12:0/1025876311 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79c7fff640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79bc0a33b0 0x7f79bc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79ced9d640 1 --2- 172.21.15.12:0/1025876311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bde5d0 0x55ee06bdea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79cf59e640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79bc0a33b0 0x7f79bc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.310+0000 7f79ce59c640 1 --2- 172.21.15.12:0/1025876311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 0x55ee06beb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.311+0000 7f79ce59c640 1 -- 172.21.15.12:0/1025876311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bde5d0 msgr2=0x55ee06bdea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.311+0000 7f79ce59c640 1 --2- 172.21.15.12:0/1025876311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bde5d0 0x55ee06bdea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.311+0000 7f79ce59c640 1 -- 172.21.15.12:0/1025876311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 msgr2=0x55ee06beb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.311+0000 7f79ce59c640 1 --2- 172.21.15.12:0/1025876311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 0x55ee06beb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.311+0000 7f79ce59c640 1 -- 172.21.15.12:0/1025876311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee06ad03a0 con 0x55ee06bdfb40 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.311+0000 7f79c7fff640 1 -- 172.21.15.12:0/901140924 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f79c00d0510 con 0x7f79d0106f40 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.311+0000 7f79ce59c640 1 --2- 172.21.15.12:0/1025876311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06bde090 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f79b800ac60 tx=0x7f79b800a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360f00b2cdb2877e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.311+0000 7f79c57fa640 1 -- 172.21.15.12:0/1025876311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b800f040 con 0x55ee06bdfb40 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.311+0000 7f79c57fa640 1 -- 172.21.15.12:0/1025876311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b800ed80 con 0x55ee06bdfb40 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.311+0000 7f79c57fa640 1 -- 172.21.15.12:0/1025876311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b801d940 con 0x55ee06bdfb40 2024-09-19T06:41:46.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 -- 172.21.15.12:0/1025876311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 msgr2=0x55ee06bde090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 --2- 172.21.15.12:0/1025876311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06bde090 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f79b800ac60 tx=0x7f79b800a410 comp rx=0 tx=0).stop 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79cf59e640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79bc0a33b0 0x7f79bc0a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f79c009c470 tx=0x7f79c000af30 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 -- 172.21.15.12:0/1025876311 shutdown_connections 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 --2- 172.21.15.12:0/1025876311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 0x55ee06beb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 --2- 172.21.15.12:0/1025876311 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bde5d0 0x55ee06bdea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 --2- 172.21.15.12:0/1025876311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06bde090 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 -- 172.21.15.12:0/1025876311 >> 172.21.15.12:0/1025876311 conn(0x55ee06ba7310 msgr2=0x55ee06bdac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 -- 172.21.15.12:0/1025876311 shutdown_connections 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 -- 172.21.15.12:0/1025876311 wait complete. 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 -- start start 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.312+0000 7f79d75b0740 1 Processor -- start 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bde5d0 0x55ee06be8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06be6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 0x55ee06be65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79d75b0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ee06bec070 con 0x55ee06bdfb40 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79d75b0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ee06aff060 con 0x55ee06be9370 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79d75b0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ee06bec1f0 con 0x55ee06bde5d0 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79d75b0740 10 client.0 _ll_register_callbacks cb 0x55ee068528c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ced9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06be6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ced9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06be6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33414/0 (socket says 172.21.15.12:33414) 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ced9d640 1 -- 172.21.15.12:0/2135020654 learned_addr learned my addr 172.21.15.12:0/2135020654 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ce59c640 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bde5d0 0x55ee06be8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ce59c640 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 0x55ee06be65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ced9d640 1 -- 172.21.15.12:0/2135020654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bde5d0 msgr2=0x55ee06be8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ced9d640 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bde5d0 0x55ee06be8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ced9d640 1 -- 172.21.15.12:0/2135020654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 msgr2=0x55ee06be65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ced9d640 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 0x55ee06be65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ced9d640 1 -- 172.21.15.12:0/2135020654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee068b53c0 con 0x55ee06bdfb40 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ce59c640 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 0x55ee06be65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79ced9d640 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06be6000 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f79c802a910 tx=0x7f79c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8bb360f12f3d45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.313+0000 7f79b67fc640 1 -- 172.21.15.12:0/2135020654 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c8035070 con 0x55ee06bdfb40 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79d75b0740 1 -- 172.21.15.12:0/2135020654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79b800ed80 con 0x55ee06bdfb40 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79b67fc640 1 -- 172.21.15.12:0/2135020654 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f79c8005220 con 0x55ee06bdfb40 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79b67fc640 1 -- 172.21.15.12:0/2135020654 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f79c8005d50 con 0x55ee06bdfb40 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79d75b0740 10 client.15939 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79d75b0740 1 -- 172.21.15.12:0/2135020654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ee06bf7b70 con 0x55ee06bdfb40 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79b67fc640 1 -- 172.21.15.12:0/2135020654 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b800ed80 con 0x55ee06bdfb40 2024-09-19T06:41:46.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79b67fc640 1 -- 172.21.15.12:0/2135020654 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f79c804a070 con 0x55ee06bdfb40 2024-09-19T06:41:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79d75b0740 10 client.15939 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79d75b0740 10 client.15939 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:41:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79d75b0740 20 client.15939 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79d75b0740 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ee06bf8fd0 0x55ee06bfb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79d75b0740 4 client.15939 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.314+0000 7f79d75b0740 1 -- 172.21.15.12:0/2135020654 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee06b51860 con 0x55ee06bf8fd0 2024-09-19T06:41:46.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.315+0000 7f79ce59c640 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ee06bf8fd0 0x55ee06bfb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.315+0000 7f79ce59c640 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ee06bf8fd0 0x55ee06bfb3f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0b55b87a246323d server_cookie=561b39dcd27c2fce in_seq=0 out_seq=0 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.315+0000 7f79b67fc640 10 client.15939 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79b67fc640 1 -- 172.21.15.12:0/2135020654 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee06b51860 con 0x55ee06bf8fd0 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79b67fc640 10 client.15939 handle_command_reply: tid=0 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 client.15939 shutdown 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 -- 172.21.15.12:0/2135020654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 msgr2=0x55ee06be6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06be6000 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f79c802a910 tx=0x7f79c80042f0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 -- 172.21.15.12:0/2135020654 shutdown_connections 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ee06bf8fd0 0x55ee06bfb3f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06be9370 0x55ee06be65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bdfb40 0x55ee06be6000 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79b67fc640 0 client.15939 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:41:46.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 --2- 172.21.15.12:0/2135020654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bde5d0 0x55ee06be8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 -- 172.21.15.12:0/2135020654 >> 172.21.15.12:0/2135020654 conn(0x55ee06ba7310 msgr2=0x55ee06be0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:46.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 -- 172.21.15.12:0/2135020654 shutdown_connections 2024-09-19T06:41:46.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 1 -- 172.21.15.12:0/2135020654 wait complete. 2024-09-19T06:41:46.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.316+0000 7f79d75b0740 20 client.15939 trim_cache size 0 max 16384 2024-09-19T06:41:46.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.329+0000 7f79d75b0740 1 Processor -- start 2024-09-19T06:41:46.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.329+0000 7f79d75b0740 1 -- start start 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bde5d0 0x55ee06bf5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06bdfb40 0x55ee06be4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06be9370 0x55ee06c00ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79d75b0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01ab8d0 con 0x55ee06bde5d0 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79d75b0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01ad500 con 0x55ee06bdfb40 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79d75b0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01abfa0 con 0x55ee06be9370 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79ce59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bde5d0 0x55ee06bf5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79ce59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bde5d0 0x55ee06bf5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33422/0 (socket says 172.21.15.12:33422) 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79ce59c640 1 -- 172.21.15.12:0/4062834171 learned_addr learned my addr 172.21.15.12:0/4062834171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79ced9d640 1 --2- 172.21.15.12:0/4062834171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06bdfb40 0x55ee06be4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79ce59c640 1 -- 172.21.15.12:0/4062834171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06be9370 msgr2=0x55ee06c00ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:46.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79ce59c640 1 --2- 172.21.15.12:0/4062834171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06be9370 0x55ee06c00ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79ce59c640 1 -- 172.21.15.12:0/4062834171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06bdfb40 msgr2=0x55ee06be4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79ce59c640 1 --2- 172.21.15.12:0/4062834171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06bdfb40 0x55ee06be4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79ce59c640 1 -- 172.21.15.12:0/4062834171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee06bd9310 con 0x55ee06bde5d0 2024-09-19T06:41:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79ce59c640 1 --2- 172.21.15.12:0/4062834171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bde5d0 0x55ee06bf5340 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f79b800ac60 tx=0x7f79b801d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598694283eb8efa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79c4ff9640 1 -- 172.21.15.12:0/4062834171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b801d470 con 0x55ee06bde5d0 2024-09-19T06:41:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79c4ff9640 1 -- 172.21.15.12:0/4062834171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b800ed80 con 0x55ee06bde5d0 2024-09-19T06:41:46.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.330+0000 7f79c4ff9640 1 -- 172.21.15.12:0/4062834171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b801ddd0 con 0x55ee06bde5d0 2024-09-19T06:41:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.331+0000 7f79d75b0740 1 -- 172.21.15.12:0/4062834171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bde5d0 msgr2=0x55ee06bf5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.331+0000 7f79d75b0740 1 --2- 172.21.15.12:0/4062834171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bde5d0 0x55ee06bf5340 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f79b800ac60 tx=0x7f79b801d400 comp rx=0 tx=0).stop 2024-09-19T06:41:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.331+0000 7f79d75b0740 1 -- 172.21.15.12:0/4062834171 shutdown_connections 2024-09-19T06:41:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.331+0000 7f79d75b0740 1 --2- 172.21.15.12:0/4062834171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06be9370 0x55ee06c00ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.331+0000 7f79d75b0740 1 --2- 172.21.15.12:0/4062834171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06bdfb40 0x55ee06be4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.331+0000 7f79d75b0740 1 --2- 172.21.15.12:0/4062834171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06bde5d0 0x55ee06bf5340 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.331+0000 7f79d75b0740 1 -- 172.21.15.12:0/4062834171 >> 172.21.15.12:0/4062834171 conn(0x55ee06ba7310 msgr2=0x55ee06be48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.331+0000 7f79d75b0740 1 -- 172.21.15.12:0/4062834171 shutdown_connections 2024-09-19T06:41:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.331+0000 7f79d75b0740 1 -- 172.21.15.12:0/4062834171 wait complete. 2024-09-19T06:41:46.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79d75b0740 1 -- start start 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79d75b0740 1 Processor -- start 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06bde5d0 0x55ee06bf1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bdfb40 0x55ee06bece10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79d75b0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06be9370 0x55ee06bed350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79d75b0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01acd70 con 0x55ee06be9370 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79d75b0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01ac6a0 con 0x55ee06bde5d0 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79d75b0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01a98b0 con 0x55ee06bdfb40 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79d75b0740 10 client.0 _ll_register_callbacks cb 0x7f79c8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79ce59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06be9370 0x55ee06bed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79ce59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06be9370 0x55ee06bed350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33426/0 (socket says 172.21.15.12:33426) 2024-09-19T06:41:46.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79ce59c640 1 -- 172.21.15.12:0/1152403633 learned_addr learned my addr 172.21.15.12:0/1152403633 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79ced9d640 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bdfb40 0x55ee06bece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79ce59c640 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06bde5d0 0x55ee06bf1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79ce59c640 1 -- 172.21.15.12:0/1152403633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bdfb40 msgr2=0x55ee06bece10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79ce59c640 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bdfb40 0x55ee06bece10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79ce59c640 1 -- 172.21.15.12:0/1152403633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06bde5d0 msgr2=0x55ee06bf1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.332+0000 7f79ce59c640 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06bde5d0 0x55ee06bf1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79ce59c640 1 -- 172.21.15.12:0/1152403633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee06be1120 con 0x55ee06be9370 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79ced9d640 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bdfb40 0x55ee06bece10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79ce59c640 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06be9370 0x55ee06bed350 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f79b802f040 tx=0x7f79b801da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de92defb7e9da2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79b67fc640 1 -- 172.21.15.12:0/1152403633 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b803e060 con 0x55ee06be9370 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79b67fc640 1 -- 172.21.15.12:0/1152403633 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f79b801d470 con 0x55ee06be9370 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79d75b0740 1 -- 172.21.15.12:0/1152403633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79b800ed80 con 0x55ee06be9370 2024-09-19T06:41:46.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79b67fc640 1 -- 172.21.15.12:0/1152403633 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f79b801d690 con 0x55ee06be9370 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79d75b0740 10 client.15945 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79d75b0740 1 -- 172.21.15.12:0/1152403633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ee06c63930 con 0x55ee06be9370 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79b67fc640 1 -- 172.21.15.12:0/1152403633 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79b800ed80 con 0x55ee06be9370 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.333+0000 7f79b67fc640 1 -- 172.21.15.12:0/1152403633 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f79b802b830 con 0x55ee06be9370 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79d75b0740 10 client.15945 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79d75b0740 10 client.15945 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79d75b0740 20 client.15945 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79d75b0740 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ee06c63db0 0x55ee06c661a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79d75b0740 4 client.15945 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79d75b0740 1 -- 172.21.15.12:0/1152403633 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee06b4bd70 con 0x55ee06c63db0 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79ced9d640 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ee06c63db0 0x55ee06c661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79ced9d640 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ee06c63db0 0x55ee06c661a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a7e1107eb28c39c server_cookie=476edc9fe0f2b479 in_seq=0 out_seq=0 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79b67fc640 10 client.15945 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79b67fc640 1 -- 172.21.15.12:0/1152403633 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee06b4bd70 con 0x55ee06c63db0 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79b67fc640 10 client.15945 handle_command_reply: tid=0 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.334+0000 7f79d75b0740 1 client.15945 shutdown 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 1 -- 172.21.15.12:0/1152403633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06be9370 msgr2=0x55ee06bed350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06be9370 0x55ee06bed350 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f79b802f040 tx=0x7f79b801da50 comp rx=0 tx=0).stop 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 1 -- 172.21.15.12:0/1152403633 shutdown_connections 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ee06c63db0 0x55ee06c661a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee06be9370 0x55ee06bed350 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ee06bdfb40 0x55ee06bece10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79b67fc640 0 client.15945 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 1 --2- 172.21.15.12:0/1152403633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ee06bde5d0 0x55ee06bf1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 1 -- 172.21.15.12:0/1152403633 >> 172.21.15.12:0/1152403633 conn(0x55ee06ba7310 msgr2=0x55ee06be50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 1 -- 172.21.15.12:0/1152403633 shutdown_connections 2024-09-19T06:41:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 1 -- 172.21.15.12:0/1152403633 wait complete. 2024-09-19T06:41:46.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d75b0740 20 client.15945 trim_cache size 0 max 16384 2024-09-19T06:41:46.342 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d51d7640 1 -- 172.21.15.12:0/901140924 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79bc0a33b0 msgr2=0x7f79bc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d51d7640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79bc0a33b0 0x7f79bc0a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f79c009c470 tx=0x7f79c000af30 comp rx=0 tx=0).stop 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d51d7640 1 -- 172.21.15.12:0/901140924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79d0106f40 msgr2=0x7f79d019cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d51d7640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79d0106f40 0x7f79d019cd30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f79c000cce0 tx=0x7f79c000a620 comp rx=0 tx=0).stop 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d51d7640 1 -- 172.21.15.12:0/901140924 shutdown_connections 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d51d7640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79d0106f40 0x7f79d019cd30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d51d7640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79bc0a33b0 0x7f79bc0a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d51d7640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79d01027c0 0x7f79d01989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d51d7640 1 --2- 172.21.15.12:0/901140924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79d0101e10 0x7f79d0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.335+0000 7f79d51d7640 1 -- 172.21.15.12:0/901140924 >> 172.21.15.12:0/901140924 conn(0x7f79d00fd8d0 msgr2=0x7f79d00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:46.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.336+0000 7f79d51d7640 1 -- 172.21.15.12:0/901140924 shutdown_connections 2024-09-19T06:41:46.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:46.336+0000 7f79d51d7640 1 -- 172.21.15.12:0/901140924 wait complete. 2024-09-19T06:41:46.999 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:41:47.260 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:47.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:47 smithi012 ceph-mon[30937]: pgmap v52: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 524 op/s 2024-09-19T06:41:47.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:47 smithi016 ceph-mon[34911]: pgmap v52: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 524 op/s 2024-09-19T06:41:47.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:47 smithi173 ceph-mon[35349]: pgmap v52: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 524 op/s 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.775+0000 7fc25ed9e640 1 -- 172.21.15.12:0/109831501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2581009d0 msgr2=0x7fc258100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.775+0000 7fc25ed9e640 1 --2- 172.21.15.12:0/109831501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2581009d0 0x7fc258100db0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009860 tx=0x7fc24c02a340 comp rx=0 tx=0).stop 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.776+0000 7fc25ed9e640 1 -- 172.21.15.12:0/109831501 shutdown_connections 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.776+0000 7fc25ed9e640 1 --2- 172.21.15.12:0/109831501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc25810e4f0 0x7fc258110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.776+0000 7fc25ed9e640 1 --2- 172.21.15.12:0/109831501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc258101380 0x7fc25810dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.776+0000 7fc25ed9e640 1 --2- 172.21.15.12:0/109831501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2581009d0 0x7fc258100db0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.776+0000 7fc25ed9e640 1 -- 172.21.15.12:0/109831501 >> 172.21.15.12:0/109831501 conn(0x7fc2580fc7d0 msgr2=0x7fc2580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.776+0000 7fc25ed9e640 1 -- 172.21.15.12:0/109831501 shutdown_connections 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.776+0000 7fc25ed9e640 1 -- 172.21.15.12:0/109831501 wait complete. 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.777+0000 7fc25ed9e640 1 Processor -- start 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.777+0000 7fc25ed9e640 1 -- start start 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.778+0000 7fc25ed9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2581009d0 0x7fc2581a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.778+0000 7fc25ed9e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc258101380 0x7fc2581a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.778+0000 7fc25ed9e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc25810e4f0 0x7fc25819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.778+0000 7fc25ed9e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc258114250 con 0x7fc2581009d0 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.778+0000 7fc25ed9e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581140d0 con 0x7fc25810e4f0 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.778+0000 7fc25ed9e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581143d0 con 0x7fc258101380 2024-09-19T06:41:47.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.782+0000 7fc257fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc258101380 0x7fc2581a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.782+0000 7fc25d33b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc25810e4f0 0x7fc25819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.783+0000 7fc25cb3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2581009d0 0x7fc2581a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.783+0000 7fc25cb3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2581009d0 0x7fc2581a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33444/0 (socket says 172.21.15.12:33444) 2024-09-19T06:41:47.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.783+0000 7fc25cb3a640 1 -- 172.21.15.12:0/4127984353 learned_addr learned my addr 172.21.15.12:0/4127984353 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:47.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.786+0000 7fc25cb3a640 1 -- 172.21.15.12:0/4127984353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc258101380 msgr2=0x7fc2581a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.786+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc258101380 0x7fc2581a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.786+0000 7fc25cb3a640 1 -- 172.21.15.12:0/4127984353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc25810e4f0 msgr2=0x7fc25819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.786+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc25810e4f0 0x7fc25819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.786+0000 7fc25cb3a640 1 -- 172.21.15.12:0/4127984353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25819ae90 con 0x7fc2581009d0 2024-09-19T06:41:47.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.788+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2581009d0 0x7fc2581a0500 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009980 tx=0x7fc24c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.790+0000 7fc255ffb640 1 -- 172.21.15.12:0/4127984353 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c041020 con 0x7fc2581009d0 2024-09-19T06:41:47.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.790+0000 7fc255ffb640 1 -- 172.21.15.12:0/4127984353 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc24c033e50 con 0x7fc2581009d0 2024-09-19T06:41:47.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.790+0000 7fc255ffb640 1 -- 172.21.15.12:0/4127984353 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c041020 con 0x7fc2581009d0 2024-09-19T06:41:47.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.791+0000 7fc25ed9e640 1 -- 172.21.15.12:0/4127984353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25819b120 con 0x7fc2581009d0 2024-09-19T06:41:47.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.791+0000 7fc25ed9e640 1 -- 172.21.15.12:0/4127984353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc258102b50 con 0x7fc2581009d0 2024-09-19T06:41:47.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.796+0000 7fc261177740 1 Processor -- start 2024-09-19T06:41:47.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.797+0000 7fc261177740 1 -- start start 2024-09-19T06:41:47.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.797+0000 7fc261177740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 0x5649e6783090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.797+0000 7fc261177740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e6783a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.797+0000 7fc261177740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e678e370 0x5649e6790760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.797+0000 7fc261177740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649e66e92f0 con 0x5649e67835d0 2024-09-19T06:41:47.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.797+0000 7fc261177740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5649e6690cf0 con 0x5649e6784b40 2024-09-19T06:41:47.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.797+0000 7fc261177740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5649e66e52b0 con 0x5649e678e370 2024-09-19T06:41:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.799+0000 7fc25d33b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 0x5649e6783090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.799+0000 7fc255ffb640 1 -- 172.21.15.12:0/4127984353 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc24c044020 con 0x7fc2581009d0 2024-09-19T06:41:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.799+0000 7fc257fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e678e370 0x5649e6790760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.800+0000 7fc25cb3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e6783a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.800+0000 7fc25d33b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 0x5649e6783090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37466/0 (socket says 172.21.15.12:37466) 2024-09-19T06:41:47.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.800+0000 7fc25d33b640 1 -- 172.21.15.12:0/138687895 learned_addr learned my addr 172.21.15.12:0/138687895 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:47.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.804+0000 7fc255ffb640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc2400a37b0 0x7fc2400a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.804+0000 7fc255ffb640 1 -- 172.21.15.12:0/4127984353 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc24c02ac80 con 0x7fc2581009d0 2024-09-19T06:41:47.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.804+0000 7fc25cb3a640 1 -- 172.21.15.12:0/138687895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e678e370 msgr2=0x5649e6790760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:47.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.804+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/138687895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e678e370 0x5649e6790760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.804+0000 7fc25cb3a640 1 -- 172.21.15.12:0/138687895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 msgr2=0x5649e6783090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:47.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.805+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/138687895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 0x5649e6783090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.805+0000 7fc25cb3a640 1 -- 172.21.15.12:0/138687895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649e66753a0 con 0x5649e67835d0 2024-09-19T06:41:47.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.805+0000 7fc25d33b640 1 --2- 172.21.15.12:0/138687895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 0x5649e6783090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:47.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.805+0000 7fc25d33b640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc2400a37b0 0x7fc2400a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.806+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/138687895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e6783a10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0ed640 tx=0x7fc24c0037d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4258e21fa968c642 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.806+0000 7fc25d33b640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc2400a37b0 0x7fc2400a5c70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc24800dd90 tx=0x7fc2480046c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.806+0000 7fc23effd640 1 -- 172.21.15.12:0/138687895 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c037070 con 0x5649e67835d0 2024-09-19T06:41:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.806+0000 7fc23effd640 1 -- 172.21.15.12:0/138687895 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc24c0035f0 con 0x5649e67835d0 2024-09-19T06:41:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.806+0000 7fc23effd640 1 -- 172.21.15.12:0/138687895 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c041070 con 0x5649e67835d0 2024-09-19T06:41:47.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.807+0000 7fc261177740 1 -- 172.21.15.12:0/138687895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 msgr2=0x5649e6783a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.807+0000 7fc261177740 1 --2- 172.21.15.12:0/138687895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e6783a10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0ed640 tx=0x7fc24c0037d0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.808+0000 7fc261177740 1 -- 172.21.15.12:0/138687895 shutdown_connections 2024-09-19T06:41:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.808+0000 7fc261177740 1 --2- 172.21.15.12:0/138687895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e678e370 0x5649e6790760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.808+0000 7fc261177740 1 --2- 172.21.15.12:0/138687895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e6783a10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.808+0000 7fc261177740 1 --2- 172.21.15.12:0/138687895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 0x5649e6783090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.808+0000 7fc261177740 1 -- 172.21.15.12:0/138687895 >> 172.21.15.12:0/138687895 conn(0x5649e674c310 msgr2=0x5649e677fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.808+0000 7fc261177740 1 -- 172.21.15.12:0/138687895 shutdown_connections 2024-09-19T06:41:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.808+0000 7fc261177740 1 -- 172.21.15.12:0/138687895 wait complete. 2024-09-19T06:41:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.808+0000 7fc261177740 1 -- start start 2024-09-19T06:41:47.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.809+0000 7fc261177740 1 Processor -- start 2024-09-19T06:41:47.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.809+0000 7fc261177740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e678b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.810+0000 7fc261177740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 0x5649e678b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.810+0000 7fc261177740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e678e370 0x5649e678bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.810+0000 7fc261177740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649e66e92f0 con 0x5649e67835d0 2024-09-19T06:41:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.810+0000 7fc261177740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5649e66a4060 con 0x5649e678e370 2024-09-19T06:41:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.810+0000 7fc261177740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5649e67a1e40 con 0x5649e6784b40 2024-09-19T06:41:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.810+0000 7fc261177740 10 client.0 _ll_register_callbacks cb 0x5649e63f78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.811+0000 7fc25cb3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e678b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.811+0000 7fc25cb3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e678b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33464/0 (socket says 172.21.15.12:33464) 2024-09-19T06:41:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.811+0000 7fc25cb3a640 1 -- 172.21.15.12:0/1687015993 learned_addr learned my addr 172.21.15.12:0/1687015993 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.811+0000 7fc25d33b640 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e678e370 0x5649e678bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.811+0000 7fc25cb3a640 1 -- 172.21.15.12:0/1687015993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 msgr2=0x5649e678b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.811+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 0x5649e678b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.811+0000 7fc25cb3a640 1 -- 172.21.15.12:0/1687015993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e678e370 msgr2=0x5649e678bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.811+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e678e370 0x5649e678bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.811+0000 7fc25cb3a640 1 -- 172.21.15.12:0/1687015993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649e645a3c0 con 0x5649e67835d0 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.812+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e678b0f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0bbed0 tx=0x7fc24c02a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b513034d12319ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.812+0000 7fc237fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.812+0000 7fc237fff640 1 -- 172.21.15.12:0/1687015993 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0f2070 con 0x5649e67835d0 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.812+0000 7fc237fff640 1 -- 172.21.15.12:0/1687015993 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc24c0dc0f0 con 0x5649e67835d0 2024-09-19T06:41:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.812+0000 7fc261177740 1 -- 172.21.15.12:0/1687015993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5649e66f6860 con 0x5649e67835d0 2024-09-19T06:41:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.813+0000 7fc237fff640 1 -- 172.21.15.12:0/1687015993 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc24c037070 con 0x5649e67835d0 2024-09-19T06:41:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.814+0000 7fc261177740 10 client.15957 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.814+0000 7fc261177740 1 -- 172.21.15.12:0/1687015993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5649e67ad740 con 0x5649e67835d0 2024-09-19T06:41:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.814+0000 7fc237fff640 1 -- 172.21.15.12:0/1687015993 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5649e66f6860 con 0x5649e67835d0 2024-09-19T06:41:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.814+0000 7fc237fff640 1 -- 172.21.15.12:0/1687015993 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fc24c03a070 con 0x5649e67835d0 2024-09-19T06:41:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.815+0000 7fc261177740 10 client.15957 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.815+0000 7fc261177740 10 client.15957 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:41:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.815+0000 7fc261177740 20 client.15957 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.816+0000 7fc261177740 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5649e67aeba0 0x5649e67b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.816+0000 7fc261177740 4 client.15957 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.816+0000 7fc261177740 1 -- 172.21.15.12:0/1687015993 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649e66f0d70 con 0x5649e67aeba0 2024-09-19T06:41:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.817+0000 7fc257fff640 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5649e67aeba0 0x5649e67b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.818+0000 7fc257fff640 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5649e67aeba0 0x5649e67b0fd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af4c3c102ec84da0 server_cookie=9a81d7209aa07c92 in_seq=0 out_seq=0 2024-09-19T06:41:47.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.818+0000 7fc237fff640 10 client.15957 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:41:47.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc237fff640 1 -- 172.21.15.12:0/1687015993 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649e66f0d70 con 0x5649e67aeba0 2024-09-19T06:41:47.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc237fff640 10 client.15957 handle_command_reply: tid=0 2024-09-19T06:41:47.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc261177740 1 client.15957 shutdown 2024-09-19T06:41:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc261177740 1 -- 172.21.15.12:0/1687015993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 msgr2=0x5649e678b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc261177740 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e678b0f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0bbed0 tx=0x7fc24c02a340 comp rx=0 tx=0).stop 2024-09-19T06:41:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc261177740 1 -- 172.21.15.12:0/1687015993 shutdown_connections 2024-09-19T06:41:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc261177740 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5649e67aeba0 0x5649e67b0fd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc261177740 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e678e370 0x5649e678bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc261177740 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 0x5649e678b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc261177740 1 --2- 172.21.15.12:0/1687015993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e67835d0 0x5649e678b0f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc261177740 1 -- 172.21.15.12:0/1687015993 >> 172.21.15.12:0/1687015993 conn(0x5649e674c310 msgr2=0x5649e6785990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc237fff640 0 client.15957 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:41:47.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.819+0000 7fc261177740 1 -- 172.21.15.12:0/1687015993 shutdown_connections 2024-09-19T06:41:47.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.820+0000 7fc261177740 1 -- 172.21.15.12:0/1687015993 wait complete. 2024-09-19T06:41:47.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.820+0000 7fc261177740 20 client.15957 trim_cache size 0 max 16384 2024-09-19T06:41:47.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.836+0000 7fc261177740 1 Processor -- start 2024-09-19T06:41:47.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.836+0000 7fc261177740 1 -- start start 2024-09-19T06:41:47.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.836+0000 7fc261177740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e67835d0 0x5649e677ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.836+0000 7fc261177740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 0x5649e6786120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.836+0000 7fc261177740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 0x5649e6786660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.836+0000 7fc261177740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581ab8d0 con 0x5649e678e370 2024-09-19T06:41:47.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.836+0000 7fc261177740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581ad500 con 0x5649e67835d0 2024-09-19T06:41:47.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.836+0000 7fc261177740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581abfa0 con 0x5649e6784b40 2024-09-19T06:41:47.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc257fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 0x5649e6786120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc25cb3a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e67835d0 0x5649e677ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc257fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 0x5649e6786120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:34982/0 (socket says 172.21.15.12:34982) 2024-09-19T06:41:47.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc257fff640 1 -- 172.21.15.12:0/1443373053 learned_addr learned my addr 172.21.15.12:0/1443373053 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:47.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/1443373053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e67835d0 0x5649e677ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37470/0 (socket says 172.21.15.12:37470) 2024-09-19T06:41:47.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc25d33b640 1 --2- 172.21.15.12:0/1443373053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 0x5649e6786660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc257fff640 1 -- 172.21.15.12:0/1443373053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e67835d0 msgr2=0x5649e677ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:47.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc257fff640 1 --2- 172.21.15.12:0/1443373053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e67835d0 0x5649e677ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc257fff640 1 -- 172.21.15.12:0/1443373053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 msgr2=0x5649e6786660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:47.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc257fff640 1 --2- 172.21.15.12:0/1443373053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 0x5649e6786660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc257fff640 1 -- 172.21.15.12:0/1443373053 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649e6789640 con 0x5649e6784b40 2024-09-19T06:41:47.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.837+0000 7fc25d33b640 1 --2- 172.21.15.12:0/1443373053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 0x5649e6786660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:47.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.838+0000 7fc257fff640 1 --2- 172.21.15.12:0/1443373053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 0x5649e6786120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc25001bfd0 tx=0x7fc250009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd9207f04649d0c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.838+0000 7fc23e7fc640 1 -- 172.21.15.12:0/1443373053 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250004d20 con 0x5649e6784b40 2024-09-19T06:41:47.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.838+0000 7fc23e7fc640 1 -- 172.21.15.12:0/1443373053 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc25001b950 con 0x5649e6784b40 2024-09-19T06:41:47.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.838+0000 7fc23e7fc640 1 -- 172.21.15.12:0/1443373053 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250011c40 con 0x5649e6784b40 2024-09-19T06:41:47.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.839+0000 7fc261177740 1 -- 172.21.15.12:0/1443373053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 msgr2=0x5649e6786120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.839+0000 7fc261177740 1 --2- 172.21.15.12:0/1443373053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 0x5649e6786120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc25001bfd0 tx=0x7fc250009a20 comp rx=0 tx=0).stop 2024-09-19T06:41:47.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.839+0000 7fc261177740 1 -- 172.21.15.12:0/1443373053 shutdown_connections 2024-09-19T06:41:47.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.839+0000 7fc261177740 1 --2- 172.21.15.12:0/1443373053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 0x5649e6786660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.839+0000 7fc261177740 1 --2- 172.21.15.12:0/1443373053 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e6784b40 0x5649e6786120 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.839+0000 7fc261177740 1 --2- 172.21.15.12:0/1443373053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e67835d0 0x5649e677ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.839+0000 7fc261177740 1 -- 172.21.15.12:0/1443373053 >> 172.21.15.12:0/1443373053 conn(0x5649e674c310 msgr2=0x5649e67aa930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.839+0000 7fc261177740 1 -- 172.21.15.12:0/1443373053 shutdown_connections 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.839+0000 7fc261177740 1 -- 172.21.15.12:0/1443373053 wait complete. 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.839+0000 7fc261177740 1 -- start start 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc261177740 1 Processor -- start 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc261177740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e67835d0 0x5649e67a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc261177740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 0x5649e67a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc261177740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 0x5649e67a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc261177740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581acd70 con 0x5649e678e370 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc261177740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581ac6a0 con 0x5649e6784b40 2024-09-19T06:41:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc25cb3a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e67835d0 0x5649e67a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc261177740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581a98b0 con 0x5649e67835d0 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc25cb3a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e67835d0 0x5649e67a77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:34988/0 (socket says 172.21.15.12:34988) 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc25cb3a640 1 -- 172.21.15.12:0/1058447029 learned_addr learned my addr 172.21.15.12:0/1058447029 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc261177740 10 client.0 _ll_register_callbacks cb 0x7fc250009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc25d33b640 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 0x5649e67a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.840+0000 7fc257fff640 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 0x5649e67a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.841+0000 7fc25cb3a640 1 -- 172.21.15.12:0/1058447029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 msgr2=0x5649e67a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.841+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 0x5649e67a2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.841+0000 7fc25cb3a640 1 -- 172.21.15.12:0/1058447029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 msgr2=0x5649e67a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.841+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 0x5649e67a3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.841+0000 7fc25cb3a640 1 -- 172.21.15.12:0/1058447029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649e67a3860 con 0x5649e67835d0 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.841+0000 7fc25cb3a640 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e67835d0 0x5649e67a77a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0d5290 tx=0x7fc24c0bbb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=361865909f07080e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.841+0000 7fc237fff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.842+0000 7fc237fff640 1 -- 172.21.15.12:0/1058447029 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0d4070 con 0x5649e67835d0 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.842+0000 7fc261177740 1 -- 172.21.15.12:0/1058447029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc25001b950 con 0x5649e67835d0 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.842+0000 7fc237fff640 1 -- 172.21.15.12:0/1058447029 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc24c0c49b0 con 0x5649e67835d0 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.842+0000 7fc237fff640 1 -- 172.21.15.12:0/1058447029 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc24c0f2040 con 0x5649e67835d0 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.842+0000 7fc261177740 10 client.25564 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.842+0000 7fc261177740 1 -- 172.21.15.12:0/1058447029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5649e67a3860 con 0x5649e67835d0 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.842+0000 7fc237fff640 1 -- 172.21.15.12:0/1058447029 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc25001b950 con 0x5649e67835d0 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.843+0000 7fc237fff640 1 -- 172.21.15.12:0/1058447029 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fc24c0c00f0 con 0x5649e67835d0 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.843+0000 7fc261177740 10 client.25564 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.843+0000 7fc261177740 10 client.25564 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:41:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.843+0000 7fc261177740 20 client.25564 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.843+0000 7fc261177740 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5649e6819c70 0x5649e681c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.843+0000 7fc261177740 4 client.25564 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:41:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.843+0000 7fc261177740 1 -- 172.21.15.12:0/1058447029 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649e666d170 con 0x5649e6819c70 2024-09-19T06:41:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.843+0000 7fc257fff640 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5649e6819c70 0x5649e681c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.844+0000 7fc257fff640 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5649e6819c70 0x5649e681c060 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af22161411295e9d server_cookie=64727b8f9e53d542 in_seq=0 out_seq=0 2024-09-19T06:41:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.844+0000 7fc237fff640 10 client.25564 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.844+0000 7fc237fff640 1 -- 172.21.15.12:0/1058447029 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649e666d170 con 0x5649e6819c70 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.844+0000 7fc237fff640 10 client.25564 handle_command_reply: tid=0 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.844+0000 7fc261177740 1 client.25564 shutdown 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.844+0000 7fc261177740 1 -- 172.21.15.12:0/1058447029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e67835d0 msgr2=0x5649e67a77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc261177740 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e67835d0 0x5649e67a77a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0d5290 tx=0x7fc24c0bbb30 comp rx=0 tx=0).stop 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc261177740 1 -- 172.21.15.12:0/1058447029 shutdown_connections 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc261177740 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5649e6819c70 0x5649e681c060 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc261177740 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649e678e370 0x5649e67a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc261177740 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5649e6784b40 0x5649e67a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc261177740 1 --2- 172.21.15.12:0/1058447029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5649e67835d0 0x5649e67a77a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc261177740 1 -- 172.21.15.12:0/1058447029 >> 172.21.15.12:0/1058447029 conn(0x5649e674c310 msgr2=0x5649e677ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc237fff640 0 client.25564 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc261177740 1 -- 172.21.15.12:0/1058447029 shutdown_connections 2024-09-19T06:41:47.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc261177740 1 -- 172.21.15.12:0/1058447029 wait complete. 2024-09-19T06:41:47.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.845+0000 7fc261177740 20 client.25564 trim_cache size 0 max 16384 2024-09-19T06:41:47.851 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:41:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 -- 172.21.15.12:0/4127984353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc2400a37b0 msgr2=0x7fc2400a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc2400a37b0 0x7fc2400a5c70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc24800dd90 tx=0x7fc2480046c0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 -- 172.21.15.12:0/4127984353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2581009d0 msgr2=0x7fc2581a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2581009d0 0x7fc2581a0500 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009980 tx=0x7fc24c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 -- 172.21.15.12:0/4127984353 shutdown_connections 2024-09-19T06:41:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc25810e4f0 0x7fc25819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc2400a37b0 0x7fc2400a5c70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc258101380 0x7fc2581a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 --2- 172.21.15.12:0/4127984353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2581009d0 0x7fc2581a0500 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 -- 172.21.15.12:0/4127984353 >> 172.21.15.12:0/4127984353 conn(0x7fc2580fc7d0 msgr2=0x7fc2580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.846+0000 7fc25ed9e640 1 -- 172.21.15.12:0/4127984353 shutdown_connections 2024-09-19T06:41:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:47.847+0000 7fc25ed9e640 1 -- 172.21.15.12:0/4127984353 wait complete. 2024-09-19T06:41:48.580 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:41:48.835 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:49.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:49 smithi012 ceph-mon[30937]: pgmap v53: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 125 op/s 2024-09-19T06:41:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.368+0000 7f3496019640 1 -- 172.21.15.12:0/1880823294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3490102d40 msgr2=0x7f3490103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.368+0000 7f3496019640 1 --2- 172.21.15.12:0/1880823294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3490102d40 0x7f3490103120 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3480009900 tx=0x7f348002a480 comp rx=0 tx=0).stop 2024-09-19T06:41:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.368+0000 7f3496019640 1 -- 172.21.15.12:0/1880823294 shutdown_connections 2024-09-19T06:41:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.368+0000 7f3496019640 1 --2- 172.21.15.12:0/1880823294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f349010c170 0x7f349010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.368+0000 7f3496019640 1 --2- 172.21.15.12:0/1880823294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3490103660 0x7f349010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.368+0000 7f3496019640 1 --2- 172.21.15.12:0/1880823294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3490102d40 0x7f3490103120 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.368+0000 7f3496019640 1 -- 172.21.15.12:0/1880823294 >> 172.21.15.12:0/1880823294 conn(0x7f34900fc7a0 msgr2=0x7f34900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.368+0000 7f3496019640 1 -- 172.21.15.12:0/1880823294 shutdown_connections 2024-09-19T06:41:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.368+0000 7f3496019640 1 -- 172.21.15.12:0/1880823294 wait complete. 2024-09-19T06:41:49.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f3496019640 1 Processor -- start 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f3496019640 1 -- start start 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f3496019640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3490102d40 0x7f34901009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f3496019640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3490103660 0x7f3490100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f3496019640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f349010c170 0x7f3490101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f3496019640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3490111f70 con 0x7f3490103660 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f3496019640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3490111df0 con 0x7f3490102d40 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f3496019640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f34901120f0 con 0x7f349010c170 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f348effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3490103660 0x7f3490100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f348effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3490103660 0x7f3490100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33512/0 (socket says 172.21.15.12:33512) 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.369+0000 7f348effd640 1 -- 172.21.15.12:0/1595870611 learned_addr learned my addr 172.21.15.12:0/1595870611 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348f7fe640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3490102d40 0x7f34901009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348ffff640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f349010c170 0x7f3490101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348effd640 1 -- 172.21.15.12:0/1595870611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f349010c170 msgr2=0x7f3490101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348effd640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f349010c170 0x7f3490101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348effd640 1 -- 172.21.15.12:0/1595870611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3490102d40 msgr2=0x7f34901009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348effd640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3490102d40 0x7f34901009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348effd640 1 -- 172.21.15.12:0/1595870611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34901a6830 con 0x7f3490103660 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348f7fe640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3490102d40 0x7f34901009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348effd640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3490103660 0x7f3490100ee0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f348400c970 tx=0x7f348400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348cff9640 1 -- 172.21.15.12:0/1595870611 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484007bb0 con 0x7f3490103660 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348cff9640 1 -- 172.21.15.12:0/1595870611 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3484007d50 con 0x7f3490103660 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f348cff9640 1 -- 172.21.15.12:0/1595870611 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484018820 con 0x7f3490103660 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f3496019640 1 -- 172.21.15.12:0/1595870611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34901a6b20 con 0x7f3490103660 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.370+0000 7f3496019640 1 -- 172.21.15.12:0/1595870611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34901a7060 con 0x7f3490103660 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.372+0000 7f348cff9640 1 -- 172.21.15.12:0/1595870611 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f34840189c0 con 0x7f3490103660 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f34983f2740 1 Processor -- start 2024-09-19T06:41:49.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f34983f2740 1 -- start start 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f34983f2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557052111b40 0x557052110090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f34983f2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x557052110a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f34983f2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55705211b370 0x55705211d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f34983f2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5570520762f0 con 0x5570521105d0 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f34983f2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55705201dcf0 con 0x55705211b370 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f34983f2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5570520722b0 con 0x557052111b40 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348cff9640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34780a33b0 0x7f34780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x557052110a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x557052110a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33524/0 (socket says 172.21.15.12:33524) 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348f7fe640 1 -- 172.21.15.12:0/1438308982 learned_addr learned my addr 172.21.15.12:0/1438308982 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348ffff640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34780a33b0 0x7f34780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348cff9640 1 -- 172.21.15.12:0/1595870611 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f34840cff10 con 0x7f3490103660 2024-09-19T06:41:49.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348effd640 1 --2- 172.21.15.12:0/1438308982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55705211b370 0x55705211d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348ffff640 1 --2- 172.21.15.12:0/1438308982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557052111b40 0x557052110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348f7fe640 1 -- 172.21.15.12:0/1438308982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557052111b40 msgr2=0x557052110090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348f7fe640 1 --2- 172.21.15.12:0/1438308982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557052111b40 0x557052110090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348f7fe640 1 -- 172.21.15.12:0/1438308982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55705211b370 msgr2=0x55705211d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348f7fe640 1 --2- 172.21.15.12:0/1438308982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55705211b370 0x55705211d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.373+0000 7f348f7fe640 1 -- 172.21.15.12:0/1438308982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570520023a0 con 0x5570521105d0 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.374+0000 7f348f7fe640 1 --2- 172.21.15.12:0/1438308982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x557052110a10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3480009900 tx=0x7f34800316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5c13ed86d1af76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.374+0000 7f348ffff640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34780a33b0 0x7f34780a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34880126f0 tx=0x7f348800a2b0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.374+0000 7f3475ffb640 1 -- 172.21.15.12:0/1438308982 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348003f070 con 0x5570521105d0 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.374+0000 7f3475ffb640 1 -- 172.21.15.12:0/1438308982 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34800035f0 con 0x5570521105d0 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.374+0000 7f3475ffb640 1 -- 172.21.15.12:0/1438308982 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480035070 con 0x5570521105d0 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 -- 172.21.15.12:0/1438308982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 msgr2=0x557052110a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 --2- 172.21.15.12:0/1438308982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x557052110a10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3480009900 tx=0x7f34800316e0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 -- 172.21.15.12:0/1438308982 shutdown_connections 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 --2- 172.21.15.12:0/1438308982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55705211b370 0x55705211d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 --2- 172.21.15.12:0/1438308982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x557052110a10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 --2- 172.21.15.12:0/1438308982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557052111b40 0x557052110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 -- 172.21.15.12:0/1438308982 >> 172.21.15.12:0/1438308982 conn(0x5570520d9310 msgr2=0x55705210cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 -- 172.21.15.12:0/1438308982 shutdown_connections 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 -- 172.21.15.12:0/1438308982 wait complete. 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 -- start start 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.375+0000 7f34983f2740 1 Processor -- start 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f34983f2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570521105d0 0x55705211ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f34983f2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x557052117fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f34983f2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55705211b370 0x5570521185d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f34983f2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55705211e010 con 0x557052111b40 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f34983f2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557052031060 con 0x5570521105d0 2024-09-19T06:41:49.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f34983f2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55705211e190 con 0x55705211b370 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f34983f2740 10 client.0 _ll_register_callbacks cb 0x557051d848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x557052117fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x557052117fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33528/0 (socket says 172.21.15.12:33528) 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348effd640 1 -- 172.21.15.12:0/3344871260 learned_addr learned my addr 172.21.15.12:0/3344871260 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348f7fe640 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570521105d0 0x55705211ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348ffff640 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55705211b370 0x5570521185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348effd640 1 -- 172.21.15.12:0/3344871260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55705211b370 msgr2=0x5570521185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348effd640 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55705211b370 0x5570521185d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348effd640 1 -- 172.21.15.12:0/3344871260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570521105d0 msgr2=0x55705211ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348effd640 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570521105d0 0x55705211ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348effd640 1 -- 172.21.15.12:0/3344871260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557051de73c0 con 0x557052111b40 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f348effd640 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x557052117fe0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f34840cd640 tx=0x7f3484018cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a344d66beba1b23c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:49.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f346effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.376+0000 7f346effd640 1 -- 172.21.15.12:0/3344871260 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348409c170 con 0x557052111b40 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f346effd640 1 -- 172.21.15.12:0/3344871260 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f34840a0170 con 0x557052111b40 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f34983f2740 1 -- 172.21.15.12:0/3344871260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34800035f0 con 0x557052111b40 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f346effd640 1 -- 172.21.15.12:0/3344871260 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f34840a0520 con 0x557052111b40 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f34983f2740 10 client.15975 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f34983f2740 1 -- 172.21.15.12:0/3344871260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557052129ad0 con 0x557052111b40 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f346effd640 1 -- 172.21.15.12:0/3344871260 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34800035f0 con 0x557052111b40 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f346effd640 1 -- 172.21.15.12:0/3344871260 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f34840a2d10 con 0x557052111b40 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f34983f2740 10 client.15975 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f34983f2740 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f34983f2740 20 client.15975 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f34983f2740 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55705212af80 0x55705212d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f34983f2740 4 client.15975 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:49.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f34983f2740 1 -- 172.21.15.12:0/3344871260 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557052083860 con 0x55705212af80 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.377+0000 7f348f7fe640 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55705212af80 0x55705212d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.378+0000 7f348f7fe640 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55705212af80 0x55705212d3b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46878eeec154ab62 server_cookie=a5112b44001d042a in_seq=0 out_seq=0 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.378+0000 7f346effd640 10 client.15975 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f346effd640 1 -- 172.21.15.12:0/3344871260 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557052083860 con 0x55705212af80 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f346effd640 10 client.15975 handle_command_reply: tid=0 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 client.15975 shutdown 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 -- 172.21.15.12:0/3344871260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 msgr2=0x557052117fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x557052117fe0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f34840cd640 tx=0x7f3484018cb0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 -- 172.21.15.12:0/3344871260 shutdown_connections 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55705212af80 0x55705212d3b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55705211b370 0x5570521185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x557052117fe0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f346effd640 0 client.15975 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 --2- 172.21.15.12:0/3344871260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570521105d0 0x55705211ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 -- 172.21.15.12:0/3344871260 >> 172.21.15.12:0/3344871260 conn(0x5570520d9310 msgr2=0x557052112960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 -- 172.21.15.12:0/3344871260 shutdown_connections 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 1 -- 172.21.15.12:0/3344871260 wait complete. 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.379+0000 7f34983f2740 20 client.15975 trim_cache size 0 max 16384 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f34983f2740 1 Processor -- start 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f34983f2740 1 -- start start 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f34983f2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x5570521272b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f34983f2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557052111b40 0x557052116fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f34983f2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55705211b370 0x557052132cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f34983f2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f34901afaf0 con 0x5570521105d0 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f34983f2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f34901b1720 con 0x557052111b40 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f34983f2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f34901b01c0 con 0x55705211b370 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f348f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x5570521272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f348f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x5570521272b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33532/0 (socket says 172.21.15.12:33532) 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.392+0000 7f348f7fe640 1 -- 172.21.15.12:0/2246145262 learned_addr learned my addr 172.21.15.12:0/2246145262 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f348effd640 1 --2- 172.21.15.12:0/2246145262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557052111b40 0x557052116fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f348f7fe640 1 -- 172.21.15.12:0/2246145262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55705211b370 msgr2=0x557052132cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f348f7fe640 1 --2- 172.21.15.12:0/2246145262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55705211b370 0x557052132cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f348f7fe640 1 -- 172.21.15.12:0/2246145262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557052111b40 msgr2=0x557052116fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f348f7fe640 1 --2- 172.21.15.12:0/2246145262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557052111b40 0x557052116fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f348f7fe640 1 -- 172.21.15.12:0/2246145262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557052116530 con 0x5570521105d0 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f348effd640 1 --2- 172.21.15.12:0/2246145262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557052111b40 0x557052116fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f348f7fe640 1 --2- 172.21.15.12:0/2246145262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x5570521272b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3480009900 tx=0x7f348002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b4e70c46883d08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f34757fa640 1 -- 172.21.15.12:0/2246145262 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480053070 con 0x5570521105d0 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f34757fa640 1 -- 172.21.15.12:0/2246145262 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34800319f0 con 0x5570521105d0 2024-09-19T06:41:49.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f34757fa640 1 -- 172.21.15.12:0/2246145262 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480035040 con 0x5570521105d0 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f34983f2740 1 -- 172.21.15.12:0/2246145262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 msgr2=0x5570521272b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f34983f2740 1 --2- 172.21.15.12:0/2246145262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x5570521272b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3480009900 tx=0x7f348002a480 comp rx=0 tx=0).stop 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f34983f2740 1 -- 172.21.15.12:0/2246145262 shutdown_connections 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f34983f2740 1 --2- 172.21.15.12:0/2246145262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55705211b370 0x557052132cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f34983f2740 1 --2- 172.21.15.12:0/2246145262 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557052111b40 0x557052116fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.393+0000 7f34983f2740 1 --2- 172.21.15.12:0/2246145262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570521105d0 0x5570521272b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 -- 172.21.15.12:0/2246145262 >> 172.21.15.12:0/2246145262 conn(0x5570520d9310 msgr2=0x5570521168b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 -- 172.21.15.12:0/2246145262 shutdown_connections 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 -- 172.21.15.12:0/2246145262 wait complete. 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 -- start start 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 Processor -- start 2024-09-19T06:41:49.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570521105d0 0x55705211f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x55705211f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55705211b370 0x55705211fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f34901b0f90 con 0x557052111b40 2024-09-19T06:41:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f34901b08c0 con 0x55705211b370 2024-09-19T06:41:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f34901adad0 con 0x5570521105d0 2024-09-19T06:41:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f34983f2740 10 client.0 _ll_register_callbacks cb 0x7f348400c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f348effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x55705211f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f348effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x55705211f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33538/0 (socket says 172.21.15.12:33538) 2024-09-19T06:41:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.394+0000 7f348effd640 1 -- 172.21.15.12:0/1791654416 learned_addr learned my addr 172.21.15.12:0/1791654416 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f348ffff640 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55705211b370 0x55705211fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f348f7fe640 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570521105d0 0x55705211f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f348effd640 1 -- 172.21.15.12:0/1791654416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570521105d0 msgr2=0x55705211f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f348effd640 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570521105d0 0x55705211f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f348effd640 1 -- 172.21.15.12:0/1791654416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55705211b370 msgr2=0x55705211fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f348effd640 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55705211b370 0x55705211fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f348effd640 1 -- 172.21.15.12:0/1791654416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557052194c90 con 0x557052111b40 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f348effd640 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x55705211f5e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f34840985d0 tx=0x7f34840a03a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bf474a68c812d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f346effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f346effd640 1 -- 172.21.15.12:0/1791654416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348409c170 con 0x557052111b40 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f346effd640 1 -- 172.21.15.12:0/1791654416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f34840a4950 con 0x557052111b40 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f34983f2740 1 -- 172.21.15.12:0/1791654416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34800319f0 con 0x557052111b40 2024-09-19T06:41:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f346effd640 1 -- 172.21.15.12:0/1791654416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f34840a2af0 con 0x557052111b40 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f34983f2740 10 client.15981 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f34983f2740 1 -- 172.21.15.12:0/1791654416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557052195e00 con 0x557052111b40 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.395+0000 7f346effd640 1 -- 172.21.15.12:0/1791654416 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34800319f0 con 0x557052111b40 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.396+0000 7f346effd640 1 -- 172.21.15.12:0/1791654416 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f3484096ce0 con 0x557052111b40 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.396+0000 7f34983f2740 10 client.15981 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.396+0000 7f34983f2740 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.396+0000 7f34983f2740 20 client.15981 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.396+0000 7f34983f2740 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557052196560 0x557052198980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.396+0000 7f34983f2740 4 client.15981 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.396+0000 7f34983f2740 1 -- 172.21.15.12:0/1791654416 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55705207dd70 con 0x557052196560 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.396+0000 7f348f7fe640 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557052196560 0x557052198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.397+0000 7f348f7fe640 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557052196560 0x557052198980 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41eb23dd6153bf18 server_cookie=61d3cdeea99c3f08 in_seq=0 out_seq=0 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.397+0000 7f346effd640 10 client.15981 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.397+0000 7f346effd640 1 -- 172.21.15.12:0/1791654416 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55705207dd70 con 0x557052196560 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.397+0000 7f346effd640 10 client.15981 handle_command_reply: tid=0 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.397+0000 7f34983f2740 1 client.15981 shutdown 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.397+0000 7f34983f2740 1 -- 172.21.15.12:0/1791654416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 msgr2=0x55705211f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.397+0000 7f34983f2740 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x55705211f5e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f34840985d0 tx=0x7f34840a03a0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.397+0000 7f34983f2740 1 -- 172.21.15.12:0/1791654416 shutdown_connections 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f34983f2740 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557052196560 0x557052198980 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f34983f2740 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55705211b370 0x55705211fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f34983f2740 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557052111b40 0x55705211f5e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f346effd640 0 client.15981 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f34983f2740 1 --2- 172.21.15.12:0/1791654416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570521105d0 0x55705211f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f34983f2740 1 -- 172.21.15.12:0/1791654416 >> 172.21.15.12:0/1791654416 conn(0x5570520d9310 msgr2=0x5570521170d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f34983f2740 1 -- 172.21.15.12:0/1791654416 shutdown_connections 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f34983f2740 1 -- 172.21.15.12:0/1791654416 wait complete. 2024-09-19T06:41:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f34983f2740 20 client.15981 trim_cache size 0 max 16384 2024-09-19T06:41:49.416 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f3496019640 1 -- 172.21.15.12:0/1595870611 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34780a33b0 msgr2=0x7f34780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f3496019640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34780a33b0 0x7f34780a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34880126f0 tx=0x7f348800a2b0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f3496019640 1 -- 172.21.15.12:0/1595870611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3490103660 msgr2=0x7f3490100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f3496019640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3490103660 0x7f3490100ee0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f348400c970 tx=0x7f348400ce30 comp rx=0 tx=0).stop 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f3496019640 1 -- 172.21.15.12:0/1595870611 shutdown_connections 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f3496019640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34780a33b0 0x7f34780a5870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f3496019640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f349010c170 0x7f3490101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f3496019640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3490103660 0x7f3490100ee0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f3496019640 1 --2- 172.21.15.12:0/1595870611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3490102d40 0x7f34901009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.398+0000 7f3496019640 1 -- 172.21.15.12:0/1595870611 >> 172.21.15.12:0/1595870611 conn(0x7f34900fc7a0 msgr2=0x7f34900fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.399+0000 7f3496019640 1 -- 172.21.15.12:0/1595870611 shutdown_connections 2024-09-19T06:41:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:49.399+0000 7f3496019640 1 -- 172.21.15.12:0/1595870611 wait complete. 2024-09-19T06:41:49.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:49 smithi016 ceph-mon[34911]: pgmap v53: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 125 op/s 2024-09-19T06:41:49.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:49 smithi173 ceph-mon[35349]: pgmap v53: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 125 op/s 2024-09-19T06:41:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.442+0000 7f937c677640 1 -- 172.21.15.12:0/230338792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9374106a00 msgr2=0x7f9374106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.442+0000 7f937c677640 1 --2- 172.21.15.12:0/230338792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9374106a00 0x7f9374106de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9370009930 tx=0x7f937002a420 comp rx=0 tx=0).stop 2024-09-19T06:41:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.442+0000 7f937c677640 1 -- 172.21.15.12:0/230338792 shutdown_connections 2024-09-19T06:41:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.442+0000 7f937c677640 1 --2- 172.21.15.12:0/230338792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9374101390 0x7f937410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.442+0000 7f937c677640 1 --2- 172.21.15.12:0/230338792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93741009f0 0x7f9374100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.442+0000 7f937c677640 1 --2- 172.21.15.12:0/230338792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9374106a00 0x7f9374106de0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.442+0000 7f937c677640 1 -- 172.21.15.12:0/230338792 >> 172.21.15.12:0/230338792 conn(0x7f93740fc6b0 msgr2=0x7f93740fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.442+0000 7f937c677640 1 -- 172.21.15.12:0/230338792 shutdown_connections 2024-09-19T06:41:50.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.442+0000 7f937c677640 1 -- 172.21.15.12:0/230338792 wait complete. 2024-09-19T06:41:50.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.443+0000 7f937c677640 1 Processor -- start 2024-09-19T06:41:50.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.443+0000 7f937c677640 1 -- start start 2024-09-19T06:41:50.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.443+0000 7f937c677640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93741009f0 0x7f93741983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.443+0000 7f937c677640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9374101390 0x7f93741988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.443+0000 7f937c677640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9374106a00 0x7f937419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.443+0000 7f937c677640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9374110e40 con 0x7f9374106a00 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.443+0000 7f937c677640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9374110cc0 con 0x7f9374101390 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.443+0000 7f937c677640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9374110fc0 con 0x7f93741009f0 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937ac14640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9374106a00 0x7f937419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937ac14640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9374106a00 0x7f937419cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60196/0 (socket says 172.21.15.12:60196) 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937ac14640 1 -- 172.21.15.12:0/2931633290 learned_addr learned my addr 172.21.15.12:0/2931633290 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937a413640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93741009f0 0x7f93741983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f9379c12640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9374101390 0x7f93741988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937ac14640 1 -- 172.21.15.12:0/2931633290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93741009f0 msgr2=0x7f93741983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937ac14640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93741009f0 0x7f93741983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937ac14640 1 -- 172.21.15.12:0/2931633290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9374101390 msgr2=0x7f93741988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937ac14640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9374101390 0x7f93741988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937ac14640 1 -- 172.21.15.12:0/2931633290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937419d3a0 con 0x7f9374106a00 2024-09-19T06:41:50.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937ac14640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9374106a00 0x7f937419cc70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f936c00eb10 tx=0x7f936c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:50.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f936b7fe640 1 -- 172.21.15.12:0/2931633290 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c004b20 con 0x7f9374106a00 2024-09-19T06:41:50.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f936b7fe640 1 -- 172.21.15.12:0/2931633290 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f936c004cc0 con 0x7f9374106a00 2024-09-19T06:41:50.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937c677640 1 -- 172.21.15.12:0/2931633290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937419d690 con 0x7f9374106a00 2024-09-19T06:41:50.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f936b7fe640 1 -- 172.21.15.12:0/2931633290 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c010760 con 0x7f9374106a00 2024-09-19T06:41:50.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.444+0000 7f937c677640 1 -- 172.21.15.12:0/2931633290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93741a4f20 con 0x7f9374106a00 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.447+0000 7f936b7fe640 1 -- 172.21.15.12:0/2931633290 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f936c005020 con 0x7f9374106a00 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.447+0000 7f937f40d740 1 Processor -- start 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.447+0000 7f937f40d740 1 -- start start 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f937f40d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865069d0 0x560486506db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f937f40d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 0x560486515b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f937f40d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865160c0 0x5604865184b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f937f40d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56048646b2f0 con 0x5604865069d0 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f937f40d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560486413270 con 0x5604865160c0 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f937f40d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5604864672b0 con 0x5604865072f0 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f9379c12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865069d0 0x560486506db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f9379c12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865069d0 0x560486506db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60206/0 (socket says 172.21.15.12:60206) 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f9379c12640 1 -- 172.21.15.12:0/1933579827 learned_addr learned my addr 172.21.15.12:0/1933579827 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f937a413640 1 --2- 172.21.15.12:0/1933579827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 0x560486515b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f9379c12640 1 --2- 172.21.15.12:0/1933579827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865160c0 0x5604865184b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f936b7fe640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f93600a3460 0x7f93600a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f9379c12640 1 -- 172.21.15.12:0/1933579827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 msgr2=0x560486515b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f9379c12640 1 --2- 172.21.15.12:0/1933579827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 0x560486515b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f9379c12640 1 -- 172.21.15.12:0/1933579827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865160c0 msgr2=0x5604865184b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f9379c12640 1 --2- 172.21.15.12:0/1933579827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865160c0 0x5604865184b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f937ac14640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f93600a3460 0x7f93600a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f9379c12640 1 -- 172.21.15.12:0/1933579827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560486412340 con 0x5604865069d0 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f937a413640 1 --2- 172.21.15.12:0/1933579827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 0x560486515b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f936b7fe640 1 -- 172.21.15.12:0/2931633290 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f936c0d0340 con 0x7f9374106a00 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.448+0000 7f9379c12640 1 --2- 172.21.15.12:0/1933579827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865069d0 0x560486506db0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9364013760 tx=0x7f93640096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544f02adcd372d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f9368ff9640 1 -- 172.21.15.12:0/1933579827 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364013ce0 con 0x5604865069d0 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f9368ff9640 1 -- 172.21.15.12:0/1933579827 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9364013080 con 0x5604865069d0 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f9368ff9640 1 -- 172.21.15.12:0/1933579827 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936400fd40 con 0x5604865069d0 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f937f40d740 1 -- 172.21.15.12:0/1933579827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865069d0 msgr2=0x560486506db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f937ac14640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f93600a3460 0x7f93600a5920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f936c09c530 tx=0x7f936c06e320 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f937f40d740 1 --2- 172.21.15.12:0/1933579827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865069d0 0x560486506db0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9364013760 tx=0x7f93640096b0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f937f40d740 1 -- 172.21.15.12:0/1933579827 shutdown_connections 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f937f40d740 1 --2- 172.21.15.12:0/1933579827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865160c0 0x5604865184b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f937f40d740 1 --2- 172.21.15.12:0/1933579827 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 0x560486515b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f937f40d740 1 --2- 172.21.15.12:0/1933579827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865069d0 0x560486506db0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.449+0000 7f937f40d740 1 -- 172.21.15.12:0/1933579827 >> 172.21.15.12:0/1933579827 conn(0x560486503060 msgr2=0x560486503440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 1 -- 172.21.15.12:0/1933579827 shutdown_connections 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 1 -- 172.21.15.12:0/1933579827 wait complete. 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 1 -- start start 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 1 Processor -- start 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865069d0 0x560486512ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865072f0 0x560486513530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x560486513a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560486518c90 con 0x5604865160c0 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5604863f4290 con 0x5604865072f0 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560486518e10 con 0x5604865069d0 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.450+0000 7f937f40d740 10 client.0 _ll_register_callbacks cb 0x560486425140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f9379c12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x560486513a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f9379c12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x560486513a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60216/0 (socket says 172.21.15.12:60216) 2024-09-19T06:41:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f9379c12640 1 -- 172.21.15.12:0/1843599817 learned_addr learned my addr 172.21.15.12:0/1843599817 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f937a413640 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865072f0 0x560486513530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f9379c12640 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865069d0 0x560486512ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f937a413640 1 -- 172.21.15.12:0/1843599817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865069d0 msgr2=0x560486512ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f937a413640 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865069d0 0x560486512ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f937a413640 1 -- 172.21.15.12:0/1843599817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 msgr2=0x560486513a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f937a413640 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x560486513a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f937a413640 1 -- 172.21.15.12:0/1843599817 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56048617e210 con 0x5604865072f0 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f9379c12640 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865069d0 0x560486512ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f937a413640 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865072f0 0x560486513530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9370005940 tx=0x7f93700317e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f88bc814dfce6627 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f935dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f935dffb640 1 -- 172.21.15.12:0/1843599817 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370035040 con 0x5604865072f0 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f937f40d740 1 -- 172.21.15.12:0/1843599817 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9364013080 con 0x5604865072f0 2024-09-19T06:41:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.451+0000 7f935dffb640 1 -- 172.21.15.12:0/1843599817 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9370004240 con 0x5604865072f0 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f935dffb640 1 -- 172.21.15.12:0/1843599817 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9370031a10 con 0x5604865072f0 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f937f40d740 10 client.25577 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f937f40d740 1 -- 172.21.15.12:0/1843599817 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56048624a620 con 0x5604865072f0 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f935dffb640 1 -- 172.21.15.12:0/1843599817 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9364013080 con 0x5604865072f0 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f935dffb640 1 -- 172.21.15.12:0/1843599817 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f937004c070 con 0x5604865072f0 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f937f40d740 10 client.25577 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f937f40d740 10 client.25577 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f937f40d740 20 client.25577 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f937f40d740 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604865260c0 0x5604865284e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f937f40d740 4 client.25577 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f937f40d740 1 -- 172.21.15.12:0/1843599817 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560486478a20 con 0x5604865260c0 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.452+0000 7f9379c12640 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604865260c0 0x5604865284e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.453+0000 7f9379c12640 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604865260c0 0x5604865284e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee28cc57385f5c93 server_cookie=5c19b8a648edf8b3 in_seq=0 out_seq=0 2024-09-19T06:41:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.453+0000 7f935dffb640 10 client.25577 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.453+0000 7f935dffb640 1 -- 172.21.15.12:0/1843599817 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560486478a20 con 0x5604865260c0 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.453+0000 7f935dffb640 10 client.25577 handle_command_reply: tid=0 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 client.25577 shutdown 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 -- 172.21.15.12:0/1843599817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865072f0 msgr2=0x560486513530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865072f0 0x560486513530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9370005940 tx=0x7f93700317e0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 -- 172.21.15.12:0/1843599817 shutdown_connections 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604865260c0 0x5604865284e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x560486513a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865072f0 0x560486513530 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f935dffb640 0 client.25577 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 --2- 172.21.15.12:0/1843599817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865069d0 0x560486512ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 -- 172.21.15.12:0/1843599817 >> 172.21.15.12:0/1843599817 conn(0x560486503060 msgr2=0x560486508dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 -- 172.21.15.12:0/1843599817 shutdown_connections 2024-09-19T06:41:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 1 -- 172.21.15.12:0/1843599817 wait complete. 2024-09-19T06:41:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.454+0000 7f937f40d740 20 client.25577 trim_cache size 0 max 16384 2024-09-19T06:41:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.468+0000 7f937f40d740 1 Processor -- start 2024-09-19T06:41:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.468+0000 7f937f40d740 1 -- start start 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f937f40d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865069d0 0x5604865118a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f937f40d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 0x5604865138a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f937f40d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x56048652de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f937f40d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f93741ab830 con 0x5604865160c0 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f937f40d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f93741ad460 con 0x5604865069d0 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f937f40d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f93741abf00 con 0x5604865072f0 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f9379c12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x56048652de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f9379c12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x56048652de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60222/0 (socket says 172.21.15.12:60222) 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f9379c12640 1 -- 172.21.15.12:0/454791192 learned_addr learned my addr 172.21.15.12:0/454791192 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f9379c12640 1 --2- 172.21.15.12:0/454791192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865069d0 0x5604865118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f937a413640 1 --2- 172.21.15.12:0/454791192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 0x5604865138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f9379c12640 1 -- 172.21.15.12:0/454791192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 msgr2=0x5604865138a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f9379c12640 1 --2- 172.21.15.12:0/454791192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 0x5604865138a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f9379c12640 1 -- 172.21.15.12:0/454791192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865069d0 msgr2=0x5604865118a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f9379c12640 1 --2- 172.21.15.12:0/454791192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865069d0 0x5604865118a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f9379c12640 1 -- 172.21.15.12:0/454791192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560486524c20 con 0x5604865160c0 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f9379c12640 1 --2- 172.21.15.12:0/454791192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x56048652de00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9364013760 tx=0x7f9364009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4158ec146483c368 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f935ffff640 1 -- 172.21.15.12:0/454791192 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364013080 con 0x5604865160c0 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f935ffff640 1 -- 172.21.15.12:0/454791192 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93640050c0 con 0x5604865160c0 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.469+0000 7f935ffff640 1 -- 172.21.15.12:0/454791192 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93640039f0 con 0x5604865160c0 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 -- 172.21.15.12:0/454791192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 msgr2=0x56048652de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 --2- 172.21.15.12:0/454791192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x56048652de00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9364013760 tx=0x7f9364009b90 comp rx=0 tx=0).stop 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 -- 172.21.15.12:0/454791192 shutdown_connections 2024-09-19T06:41:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 --2- 172.21.15.12:0/454791192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865160c0 0x56048652de00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 --2- 172.21.15.12:0/454791192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865072f0 0x5604865138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 --2- 172.21.15.12:0/454791192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865069d0 0x5604865118a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 -- 172.21.15.12:0/454791192 >> 172.21.15.12:0/454791192 conn(0x560486503060 msgr2=0x560486515070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 -- 172.21.15.12:0/454791192 shutdown_connections 2024-09-19T06:41:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 -- 172.21.15.12:0/454791192 wait complete. 2024-09-19T06:41:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 -- start start 2024-09-19T06:41:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.470+0000 7f937f40d740 1 Processor -- start 2024-09-19T06:41:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937f40d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865069d0 0x56048651e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937f40d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865072f0 0x56048650fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937f40d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865160c0 0x5604865100a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937f40d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f93741accd0 con 0x5604865072f0 2024-09-19T06:41:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937f40d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f93741ac600 con 0x5604865069d0 2024-09-19T06:41:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937f40d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f93741a9810 con 0x5604865160c0 2024-09-19T06:41:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937f40d740 10 client.0 _ll_register_callbacks cb 0x7f9370009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937a413640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865072f0 0x56048650fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937a413640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865072f0 0x56048650fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60234/0 (socket says 172.21.15.12:60234) 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937a413640 1 -- 172.21.15.12:0/3021547930 learned_addr learned my addr 172.21.15.12:0/3021547930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f9379c12640 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865069d0 0x56048651e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f9379c12640 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865160c0 0x5604865100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937a413640 1 -- 172.21.15.12:0/3021547930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865160c0 msgr2=0x5604865100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937a413640 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865160c0 0x5604865100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937a413640 1 -- 172.21.15.12:0/3021547930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865069d0 msgr2=0x56048651e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937a413640 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865069d0 0x56048651e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937a413640 1 -- 172.21.15.12:0/3021547930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604865106e0 con 0x5604865072f0 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f9379c12640 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865160c0 0x5604865100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f937a413640 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865072f0 0x56048650fb60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9370004d70 tx=0x7f9370009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e6eea4c0e23279 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.471+0000 7f935dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f935dffb640 1 -- 172.21.15.12:0/3021547930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370035050 con 0x5604865072f0 2024-09-19T06:41:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f937f40d740 1 -- 172.21.15.12:0/3021547930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93640050c0 con 0x5604865072f0 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f935dffb640 1 -- 172.21.15.12:0/3021547930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9370004970 con 0x5604865072f0 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f935dffb640 1 -- 172.21.15.12:0/3021547930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9370052040 con 0x5604865072f0 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f937f40d740 10 client.15999 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f937f40d740 1 -- 172.21.15.12:0/3021547930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560486590c60 con 0x5604865072f0 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f935dffb640 1 -- 172.21.15.12:0/3021547930 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93640050c0 con 0x5604865072f0 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f935dffb640 1 -- 172.21.15.12:0/3021547930 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f937004c040 con 0x5604865072f0 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f937f40d740 10 client.15999 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f937f40d740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f937f40d740 20 client.15999 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f937f40d740 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560486591520 0x560486593940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f937f40d740 4 client.15999 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:41:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.472+0000 7f937f40d740 1 -- 172.21.15.12:0/3021547930 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560486472d70 con 0x560486591520 2024-09-19T06:41:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.473+0000 7f9379c12640 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560486591520 0x560486593940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.473+0000 7f9379c12640 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560486591520 0x560486593940 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8195d0ff1f784c7 server_cookie=ccc0f9966f838b85 in_seq=0 out_seq=0 2024-09-19T06:41:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.473+0000 7f935dffb640 10 client.15999 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f935dffb640 1 -- 172.21.15.12:0/3021547930 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560486472d70 con 0x560486591520 2024-09-19T06:41:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f935dffb640 10 client.15999 handle_command_reply: tid=0 2024-09-19T06:41:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f937f40d740 1 client.15999 shutdown 2024-09-19T06:41:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f937f40d740 1 -- 172.21.15.12:0/3021547930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865072f0 msgr2=0x56048650fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f937f40d740 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865072f0 0x56048650fb60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9370004d70 tx=0x7f9370009230 comp rx=0 tx=0).stop 2024-09-19T06:41:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f937f40d740 1 -- 172.21.15.12:0/3021547930 shutdown_connections 2024-09-19T06:41:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f937f40d740 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560486591520 0x560486593940 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f937f40d740 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604865160c0 0x5604865100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f937f40d740 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604865072f0 0x56048650fb60 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f937f40d740 1 --2- 172.21.15.12:0/3021547930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604865069d0 0x56048651e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f935dffb640 0 client.15999 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.488+0000 7f937f40d740 1 -- 172.21.15.12:0/3021547930 >> 172.21.15.12:0/3021547930 conn(0x560486503060 msgr2=0x5604865019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937f40d740 1 -- 172.21.15.12:0/3021547930 shutdown_connections 2024-09-19T06:41:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937f40d740 1 -- 172.21.15.12:0/3021547930 wait complete. 2024-09-19T06:41:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937f40d740 20 client.15999 trim_cache size 0 max 16384 2024-09-19T06:41:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:41:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:41:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:41:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:41:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 -- 172.21.15.12:0/2931633290 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f93600a3460 msgr2=0x7f93600a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f93600a3460 0x7f93600a5920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f936c09c530 tx=0x7f936c06e320 comp rx=0 tx=0).stop 2024-09-19T06:41:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 -- 172.21.15.12:0/2931633290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9374106a00 msgr2=0x7f937419cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9374106a00 0x7f937419cc70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f936c00eb10 tx=0x7f936c00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 -- 172.21.15.12:0/2931633290 shutdown_connections 2024-09-19T06:41:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9374106a00 0x7f937419cc70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9374101390 0x7f93741988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f93600a3460 0x7f93600a5920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 --2- 172.21.15.12:0/2931633290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93741009f0 0x7f93741983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 -- 172.21.15.12:0/2931633290 >> 172.21.15.12:0/2931633290 conn(0x7f93740fc6b0 msgr2=0x7f937406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 -- 172.21.15.12:0/2931633290 shutdown_connections 2024-09-19T06:41:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:41:50.489+0000 7f937c677640 1 -- 172.21.15.12:0/2931633290 wait complete. 2024-09-19T06:41:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 65.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:41:51.137 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:41:51.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:41:51.409 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:51.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:51 smithi016 ceph-mon[34911]: pgmap v54: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 363 op/s 2024-09-19T06:41:51.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:51 smithi012 ceph-mon[30937]: pgmap v54: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 363 op/s 2024-09-19T06:41:51.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:51 smithi173 ceph-mon[35349]: pgmap v54: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 363 op/s 2024-09-19T06:41:51.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 -- 172.21.15.12:0/433991120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff80103780 msgr2=0x7eff80107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 --2- 172.21.15.12:0/433991120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff80103780 0x7eff80107bc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7eff74009930 tx=0x7eff7402a420 comp rx=0 tx=0).stop 2024-09-19T06:41:51.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 -- 172.21.15.12:0/433991120 shutdown_connections 2024-09-19T06:41:51.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 --2- 172.21.15.12:0/433991120 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff80108300 0x7eff8010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 --2- 172.21.15.12:0/433991120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff80103780 0x7eff80107bc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 --2- 172.21.15.12:0/433991120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff80102dd0 0x7eff801031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 -- 172.21.15.12:0/433991120 >> 172.21.15.12:0/433991120 conn(0x7eff800fc7d0 msgr2=0x7eff800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 -- 172.21.15.12:0/433991120 shutdown_connections 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 -- 172.21.15.12:0/433991120 wait complete. 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 Processor -- start 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.843+0000 7eff885eb640 1 -- start start 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff885eb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff80102dd0 0x7eff80100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff885eb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff80103780 0x7eff80100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff885eb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff80108300 0x7eff801014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff885eb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff80112070 con 0x7eff80103780 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff885eb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff80111ef0 con 0x7eff80108300 2024-09-19T06:41:51.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff885eb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7eff801121f0 con 0x7eff80102dd0 2024-09-19T06:41:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff85b86640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff80103780 0x7eff80100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff85b86640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff80103780 0x7eff80100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60242/0 (socket says 172.21.15.12:60242) 2024-09-19T06:41:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff85b86640 1 -- 172.21.15.12:0/1076598208 learned_addr learned my addr 172.21.15.12:0/1076598208 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff86387640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff80102dd0 0x7eff80100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff86b88640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff80108300 0x7eff801014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff85b86640 1 -- 172.21.15.12:0/1076598208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff80102dd0 msgr2=0x7eff80100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff85b86640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff80102dd0 0x7eff80100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff85b86640 1 -- 172.21.15.12:0/1076598208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff80108300 msgr2=0x7eff801014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff85b86640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff80108300 0x7eff801014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff85b86640 1 -- 172.21.15.12:0/1076598208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff801a69d0 con 0x7eff80103780 2024-09-19T06:41:51.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff86387640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff80102dd0 0x7eff80100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:51.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff86b88640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff80108300 0x7eff801014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:51.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.844+0000 7eff85b86640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff80103780 0x7eff80100f70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7eff74005940 tx=0x7eff740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:51.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.845+0000 7eff7f7fe640 1 -- 172.21.15.12:0/1076598208 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7403f030 con 0x7eff80103780 2024-09-19T06:41:51.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.845+0000 7eff885eb640 1 -- 172.21.15.12:0/1076598208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff801a6c60 con 0x7eff80103780 2024-09-19T06:41:51.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.845+0000 7eff7f7fe640 1 -- 172.21.15.12:0/1076598208 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff74003ce0 con 0x7eff80103780 2024-09-19T06:41:51.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.845+0000 7eff7f7fe640 1 -- 172.21.15.12:0/1076598208 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74035070 con 0x7eff80103780 2024-09-19T06:41:51.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.845+0000 7eff885eb640 1 -- 172.21.15.12:0/1076598208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff801a7190 con 0x7eff80103780 2024-09-19T06:41:51.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.847+0000 7eff7f7fe640 1 -- 172.21.15.12:0/1076598208 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7eff74042030 con 0x7eff80103780 2024-09-19T06:41:51.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.847+0000 7eff8a9c4740 1 Processor -- start 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.847+0000 7eff8a9c4740 1 -- start start 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004baf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004bb480 0x562d004c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004c5d40 0x562d004c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562d00420280 con 0x562d004bab60 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562d003c7b10 con 0x562d004bb480 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562d0041c240 con 0x562d004c5d40 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff7f7fe640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff680a33b0 0x7eff680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86b88640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004baf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86b88640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004baf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60246/0 (socket says 172.21.15.12:60246) 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86b88640 1 -- 172.21.15.12:0/270935836 learned_addr learned my addr 172.21.15.12:0/270935836 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff85b86640 1 --2- 172.21.15.12:0/270935836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004c5d40 0x562d004c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86387640 1 --2- 172.21.15.12:0/270935836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004bb480 0x562d004c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86b88640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff680a33b0 0x7eff680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff7f7fe640 1 -- 172.21.15.12:0/1076598208 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7eff740f02b0 con 0x7eff80103780 2024-09-19T06:41:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86b88640 1 -- 172.21.15.12:0/270935836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004c5d40 msgr2=0x562d004c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86b88640 1 --2- 172.21.15.12:0/270935836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004c5d40 0x562d004c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86b88640 1 -- 172.21.15.12:0/270935836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004bb480 msgr2=0x562d004c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86b88640 1 --2- 172.21.15.12:0/270935836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004bb480 0x562d004c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86b88640 1 -- 172.21.15.12:0/270935836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d003d41f0 con 0x562d004bab60 2024-09-19T06:41:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.848+0000 7eff86387640 1 --2- 172.21.15.12:0/270935836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004bb480 0x562d004c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.849+0000 7eff86b88640 1 --2- 172.21.15.12:0/270935836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004baf40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7eff78015b00 tx=0x7eff78012390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e32933b5bf7cb64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.849+0000 7eff86b88640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff680a33b0 0x7eff680a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff78005fd0 tx=0x7eff7801b000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.849+0000 7eff7cff9640 1 -- 172.21.15.12:0/270935836 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff78010810 con 0x562d004bab60 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.849+0000 7eff7cff9640 1 -- 172.21.15.12:0/270935836 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff78015540 con 0x562d004bab60 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.849+0000 7eff7cff9640 1 -- 172.21.15.12:0/270935836 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7801ec20 con 0x562d004bab60 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 -- 172.21.15.12:0/270935836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 msgr2=0x562d004baf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/270935836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004baf40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7eff78015b00 tx=0x7eff78012390 comp rx=0 tx=0).stop 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 -- 172.21.15.12:0/270935836 shutdown_connections 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/270935836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004c5d40 0x562d004c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/270935836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004bb480 0x562d004c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/270935836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004baf40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 -- 172.21.15.12:0/270935836 >> 172.21.15.12:0/270935836 conn(0x562d004b70f0 msgr2=0x562d004b74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:51.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 -- 172.21.15.12:0/270935836 shutdown_connections 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 -- 172.21.15.12:0/270935836 wait complete. 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 -- start start 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 Processor -- start 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bb480 0x562d004c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562d004c8910 con 0x562d004bab60 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562d003daf10 con 0x562d004c5d40 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562d004c8a90 con 0x562d004bb480 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.850+0000 7eff8a9c4740 10 client.0 _ll_register_callbacks cb 0x562d003a3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff86387640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff86387640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004c2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60258/0 (socket says 172.21.15.12:60258) 2024-09-19T06:41:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff86387640 1 -- 172.21.15.12:0/308700858 learned_addr learned my addr 172.21.15.12:0/308700858 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff86b88640 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff85b86640 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bb480 0x562d004c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff86387640 1 -- 172.21.15.12:0/308700858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bb480 msgr2=0x562d004c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff86387640 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bb480 0x562d004c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff86387640 1 -- 172.21.15.12:0/308700858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 msgr2=0x562d004c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff86387640 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff86387640 1 -- 172.21.15.12:0/308700858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d001916a0 con 0x562d004bab60 2024-09-19T06:41:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff85b86640 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bb480 0x562d004c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff86387640 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004c2c60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7eff70010bc0 tx=0x7eff7000e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d96b229cae6838 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.851+0000 7eff65ffb640 1 -- 172.21.15.12:0/308700858 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70004b20 con 0x562d004bab60 2024-09-19T06:41:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff8a9c4740 1 -- 172.21.15.12:0/308700858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff78015540 con 0x562d004bab60 2024-09-19T06:41:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff65ffb640 1 -- 172.21.15.12:0/308700858 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7eff70004cc0 con 0x562d004bab60 2024-09-19T06:41:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff65ffb640 1 -- 172.21.15.12:0/308700858 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7eff70005020 con 0x562d004bab60 2024-09-19T06:41:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff8a9c4740 10 client.16011 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff8a9c4740 1 -- 172.21.15.12:0/308700858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562d004dcdc0 con 0x562d004bab60 2024-09-19T06:41:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff65ffb640 1 -- 172.21.15.12:0/308700858 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff78015540 con 0x562d004bab60 2024-09-19T06:41:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff65ffb640 1 -- 172.21.15.12:0/308700858 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7eff700116a0 con 0x562d004bab60 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff8a9c4740 10 client.16011 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff8a9c4740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff8a9c4740 20 client.16011 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562d004de320 0x562d004e07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff8a9c4740 4 client.16011 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff8a9c4740 1 -- 172.21.15.12:0/308700858 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d0042d7f0 con 0x562d004de320 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.852+0000 7eff85b86640 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562d004de320 0x562d004e07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.853+0000 7eff85b86640 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562d004de320 0x562d004e07a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e90e1eef9a532c server_cookie=5bf24bed90e621b6 in_seq=0 out_seq=0 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.853+0000 7eff65ffb640 10 client.16011 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.853+0000 7eff65ffb640 1 -- 172.21.15.12:0/308700858 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d0042d7f0 con 0x562d004de320 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.853+0000 7eff65ffb640 10 client.16011 handle_command_reply: tid=0 2024-09-19T06:41:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 client.16011 shutdown 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 -- 172.21.15.12:0/308700858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 msgr2=0x562d004c2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004c2c60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7eff70010bc0 tx=0x7eff7000e350 comp rx=0 tx=0).stop 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 -- 172.21.15.12:0/308700858 shutdown_connections 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562d004de320 0x562d004e07a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bb480 0x562d004c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff65ffb640 0 client.16011 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/308700858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004c2c60 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 -- 172.21.15.12:0/308700858 >> 172.21.15.12:0/308700858 conn(0x562d004b70f0 msgr2=0x562d004b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 -- 172.21.15.12:0/308700858 shutdown_connections 2024-09-19T06:41:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 1 -- 172.21.15.12:0/308700858 wait complete. 2024-09-19T06:41:51.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.854+0000 7eff8a9c4740 20 client.16011 trim_cache size 0 max 16384 2024-09-19T06:41:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff8a9c4740 1 Processor -- start 2024-09-19T06:41:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff8a9c4740 1 -- start start 2024-09-19T06:41:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bb480 0x562d004e6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004e65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff801ab900 con 0x562d004bab60 2024-09-19T06:41:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff801ad530 con 0x562d004c5d40 2024-09-19T06:41:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7eff801abfd0 con 0x562d004bb480 2024-09-19T06:41:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff86387640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff86387640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004bd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60262/0 (socket says 172.21.15.12:60262) 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff86387640 1 -- 172.21.15.12:0/3779061327 learned_addr learned my addr 172.21.15.12:0/3779061327 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.872+0000 7eff86b88640 1 --2- 172.21.15.12:0/3779061327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004e65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.873+0000 7eff86387640 1 -- 172.21.15.12:0/3779061327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bb480 msgr2=0x562d004e6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.873+0000 7eff86387640 1 --2- 172.21.15.12:0/3779061327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bb480 0x562d004e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.873+0000 7eff86387640 1 -- 172.21.15.12:0/3779061327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 msgr2=0x562d004e65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.873+0000 7eff86387640 1 --2- 172.21.15.12:0/3779061327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004e65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.873+0000 7eff86387640 1 -- 172.21.15.12:0/3779061327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d004b81a0 con 0x562d004bab60 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.873+0000 7eff86b88640 1 --2- 172.21.15.12:0/3779061327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004e65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.873+0000 7eff86387640 1 --2- 172.21.15.12:0/3779061327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004bd5c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7eff70010450 tx=0x7eff7000e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2442e49cb8eeda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.873+0000 7eff67fff640 1 -- 172.21.15.12:0/3779061327 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff700078d0 con 0x562d004bab60 2024-09-19T06:41:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.873+0000 7eff67fff640 1 -- 172.21.15.12:0/3779061327 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff70003970 con 0x562d004bab60 2024-09-19T06:41:51.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.873+0000 7eff67fff640 1 -- 172.21.15.12:0/3779061327 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70005540 con 0x562d004bab60 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 -- 172.21.15.12:0/3779061327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 msgr2=0x562d004bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/3779061327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004bd5c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7eff70010450 tx=0x7eff7000e900 comp rx=0 tx=0).stop 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 -- 172.21.15.12:0/3779061327 shutdown_connections 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/3779061327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004e65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/3779061327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bb480 0x562d004e6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/3779061327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bab60 0x562d004bd5c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 -- 172.21.15.12:0/3779061327 >> 172.21.15.12:0/3779061327 conn(0x562d004b70f0 msgr2=0x562d004c4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 -- 172.21.15.12:0/3779061327 shutdown_connections 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 -- 172.21.15.12:0/3779061327 wait complete. 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 -- start start 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.874+0000 7eff8a9c4740 1 Processor -- start 2024-09-19T06:41:51.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bab60 0x562d004c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bb480 0x562d004ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff8a9c4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff801acda0 con 0x562d004bb480 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff801ac6d0 con 0x562d004c5d40 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff8a9c4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7eff801a9900 con 0x562d004bab60 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff8a9c4740 10 client.0 _ll_register_callbacks cb 0x7eff70007700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff85b86640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bb480 0x562d004ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff85b86640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bb480 0x562d004ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60274/0 (socket says 172.21.15.12:60274) 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff85b86640 1 -- 172.21.15.12:0/533746298 learned_addr learned my addr 172.21.15.12:0/533746298 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff86b88640 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff86387640 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bab60 0x562d004c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff85b86640 1 -- 172.21.15.12:0/533746298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bab60 msgr2=0x562d004c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:51.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff85b86640 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bab60 0x562d004c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff85b86640 1 -- 172.21.15.12:0/533746298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 msgr2=0x562d004ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff85b86640 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff85b86640 1 -- 172.21.15.12:0/533746298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d005481a0 con 0x562d004bb480 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff85b86640 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bb480 0x562d004ca0b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7eff740bc4a0 tx=0x7eff74041d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74d6d017b2bffbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.875+0000 7eff65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff65ffb640 1 -- 172.21.15.12:0/533746298 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74049040 con 0x562d004bb480 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff65ffb640 1 -- 172.21.15.12:0/533746298 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7eff74041d80 con 0x562d004bb480 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff8a9c4740 1 -- 172.21.15.12:0/533746298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff70003970 con 0x562d004bb480 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff65ffb640 1 -- 172.21.15.12:0/533746298 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7eff740bbe70 con 0x562d004bb480 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff8a9c4740 10 client.16017 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff8a9c4740 1 -- 172.21.15.12:0/533746298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562d005494e0 con 0x562d004bb480 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff65ffb640 1 -- 172.21.15.12:0/533746298 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff70003970 con 0x562d004bb480 2024-09-19T06:41:51.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff65ffb640 1 -- 172.21.15.12:0/533746298 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7eff740b8b80 con 0x562d004bb480 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff8a9c4740 10 client.16017 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff8a9c4740 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff8a9c4740 20 client.16017 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562d00549cd0 0x562d0054c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff8a9c4740 4 client.16017 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.876+0000 7eff8a9c4740 1 -- 172.21.15.12:0/533746298 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562d00427d00 con 0x562d00549cd0 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.877+0000 7eff86387640 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562d00549cd0 0x562d0054c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.877+0000 7eff86387640 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562d00549cd0 0x562d0054c0f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e81726daefad5bf server_cookie=df3f8ec38e710625 in_seq=0 out_seq=0 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.877+0000 7eff65ffb640 10 client.16017 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff65ffb640 1 -- 172.21.15.12:0/533746298 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562d00427d00 con 0x562d00549cd0 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff65ffb640 10 client.16017 handle_command_reply: tid=0 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 client.16017 shutdown 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 -- 172.21.15.12:0/533746298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bb480 msgr2=0x562d004ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bb480 0x562d004ca0b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7eff740bc4a0 tx=0x7eff74041d10 comp rx=0 tx=0).stop 2024-09-19T06:41:51.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 -- 172.21.15.12:0/533746298 shutdown_connections 2024-09-19T06:41:51.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562d00549cd0 0x562d0054c0f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562d004c5d40 0x562d004ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d004bb480 0x562d004ca0b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff65ffb640 0 client.16017 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:51.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 --2- 172.21.15.12:0/533746298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562d004bab60 0x562d004c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 -- 172.21.15.12:0/533746298 >> 172.21.15.12:0/533746298 conn(0x562d004b70f0 msgr2=0x562d004d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:51.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 -- 172.21.15.12:0/533746298 shutdown_connections 2024-09-19T06:41:51.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 1 -- 172.21.15.12:0/533746298 wait complete. 2024-09-19T06:41:51.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.878+0000 7eff8a9c4740 20 client.16017 trim_cache size 0 max 16384 2024-09-19T06:41:51.885 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:41:51.885 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:41:51.885 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "315bfb3c-9dc7-4e65-8da4-515e5de079f9", 2024-09-19T06:41:51.885 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:41:51.885 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:41:51.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 -- 172.21.15.12:0/1076598208 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff680a33b0 msgr2=0x7eff680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff680a33b0 0x7eff680a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff78005fd0 tx=0x7eff7801b000 comp rx=0 tx=0).stop 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 -- 172.21.15.12:0/1076598208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff80103780 msgr2=0x7eff80100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff80103780 0x7eff80100f70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7eff74005940 tx=0x7eff740042f0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 -- 172.21.15.12:0/1076598208 shutdown_connections 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff80108300 0x7eff801014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff80103780 0x7eff80100f70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff680a33b0 0x7eff680a5870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 --2- 172.21.15.12:0/1076598208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff80102dd0 0x7eff80100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 -- 172.21.15.12:0/1076598208 >> 172.21.15.12:0/1076598208 conn(0x7eff800fc7d0 msgr2=0x7eff801063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 -- 172.21.15.12:0/1076598208 shutdown_connections 2024-09-19T06:41:51.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:51.879+0000 7eff885eb640 1 -- 172.21.15.12:0/1076598208 wait complete. 2024-09-19T06:41:51.997 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:41:52.206 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:41:51 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: 2024-09-19T06:41:51.895+0000 7f466df5b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...3,head] /volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_wal/ auth{1=1,2=1,3=1,4=1} v1403 ap=3 f(v2 m2024-09-19T06:41:33.977594+0000 33=32+1) n(v4 rc2024-09-19T06:41:35.549579+0000 b536870912 34=32+2) old_inodes=1 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:1089 nref=3)) caps={15252=pAsLsXsFs/pAsLsXsFsx@209} mcw={1=AsLsXsFs} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55a161e5e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000007:[<0x10000000006/pg_wal v954>,<0x10000000005/data v119>,<0x100000001fb/postgres v23>,<0x100000001fa/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 v38>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000007:[<0x10000000006/pg_wal v1403>,<0x10000000005/data v211>,<0x100000001fb/postgres v93>,<0x100000001fa/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 v112>,<0x10000000001/sv_1 v124>,<0x10000000000/qa v118>,<0x1/volumes v102>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:41:22.401703+0000 31=30+1)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:41:35.549579+0000 b536870912 34=32+2)","memory_value.dirstat":"f(v2 m2024-09-19T06:41:33.977594+0000 33=32+1)","memory_value.rstat":"n(v4 rc2024-09-19T06:41:35.549579+0000 b536870912 34=32+2)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-19T06:41:52.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:52 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:41:52.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:52 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:41:52.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:52 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:52.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:52 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:41:52.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:52 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:41:52.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:52 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:52.548 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:41:52.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:52 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:41:52.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:52 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:41:52.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:52 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:53.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.055+0000 7f0a79b28640 1 -- 172.21.15.12:0/3646327333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a74106f10 msgr2=0x7f0a7410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:53.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.055+0000 7f0a79b28640 1 --2- 172.21.15.12:0/3646327333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a74106f10 0x7f0a7410ea90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009ca0 tx=0x7f0a6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.055+0000 7f0a79b28640 1 -- 172.21.15.12:0/3646327333 shutdown_connections 2024-09-19T06:41:53.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.055+0000 7f0a79b28640 1 --2- 172.21.15.12:0/3646327333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a74106f10 0x7f0a7410ea90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.055+0000 7f0a79b28640 1 --2- 172.21.15.12:0/3646327333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a74102790 0x7f0a741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.055+0000 7f0a79b28640 1 --2- 172.21.15.12:0/3646327333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a74101de0 0x7f0a741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.055+0000 7f0a79b28640 1 -- 172.21.15.12:0/3646327333 >> 172.21.15.12:0/3646327333 conn(0x7f0a740fd8c0 msgr2=0x7f0a740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.055+0000 7f0a79b28640 1 -- 172.21.15.12:0/3646327333 shutdown_connections 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.055+0000 7f0a79b28640 1 -- 172.21.15.12:0/3646327333 wait complete. 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a79b28640 1 Processor -- start 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a79b28640 1 -- start start 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a79b28640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a74101de0 0x7f0a740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a79b28640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a74102790 0x7f0a74074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a79b28640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a74106f10 0x7f0a74074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a79b28640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74111f90 con 0x7f0a74102790 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a79b28640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74111e10 con 0x7f0a74106f10 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a79b28640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74112110 con 0x7f0a74101de0 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a72ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a74102790 0x7f0a74074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a72ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a74102790 0x7f0a74074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60292/0 (socket says 172.21.15.12:60292) 2024-09-19T06:41:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a72ffd640 1 -- 172.21.15.12:0/408743586 learned_addr learned my addr 172.21.15.12:0/408743586 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.056+0000 7f0a73fff640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a74106f10 0x7f0a74074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a737fe640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a74101de0 0x7f0a740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a72ffd640 1 -- 172.21.15.12:0/408743586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a74101de0 msgr2=0x7f0a740744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a72ffd640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a74101de0 0x7f0a740744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a72ffd640 1 -- 172.21.15.12:0/408743586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a74106f10 msgr2=0x7f0a74074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a72ffd640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a74106f10 0x7f0a74074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a72ffd640 1 -- 172.21.15.12:0/408743586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a741a68d0 con 0x7f0a74102790 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a72ffd640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a74102790 0x7f0a74074a30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800b4a0 tx=0x7f0a6800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a70ff9640 1 -- 172.21.15.12:0/408743586 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68014070 con 0x7f0a74102790 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a70ff9640 1 -- 172.21.15.12:0/408743586 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a68010af0 con 0x7f0a74102790 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a79b28640 1 -- 172.21.15.12:0/408743586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a741a6bc0 con 0x7f0a74102790 2024-09-19T06:41:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a70ff9640 1 -- 172.21.15.12:0/408743586 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68017d10 con 0x7f0a74102790 2024-09-19T06:41:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.057+0000 7f0a79b28640 1 -- 172.21.15.12:0/408743586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a741a7100 con 0x7f0a74102790 2024-09-19T06:41:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.058+0000 7f0a79b28640 1 -- 172.21.15.12:0/408743586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a741021c0 con 0x7f0a74102790 2024-09-19T06:41:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.059+0000 7f0a70ff9640 1 -- 172.21.15.12:0/408743586 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0a68017070 con 0x7f0a74102790 2024-09-19T06:41:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.060+0000 7f0a70ff9640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0a5c0a33b0 0x7f0a5c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.061+0000 7f0a737fe640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0a5c0a33b0 0x7f0a5c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.061+0000 7f0a70ff9640 1 -- 172.21.15.12:0/408743586 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0a680cf000 con 0x7f0a74102790 2024-09-19T06:41:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.061+0000 7f0a737fe640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0a5c0a33b0 0x7f0a5c0a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0a64005e10 tx=0x7f0a64005da0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.065+0000 7f0a70ff9640 1 -- 172.21.15.12:0/408743586 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a6809ba70 con 0x7f0a74102790 2024-09-19T06:41:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.288+0000 7f0a79b28640 1 -- 172.21.15.12:0/408743586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a741a7330 con 0x7f0a74102790 2024-09-19T06:41:53.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.289+0000 7f0a70ff9640 1 -- 172.21.15.12:0/408743586 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11979 (secure 0 0 0) 0x7f0a6809b370 con 0x7f0a74102790 2024-09-19T06:41:53.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:41:53.290 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"btime":"2024-09-19T06:41:24:903521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:41:24.405002+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:41:53.291 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2024-09-19T06:41:53.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 -- 172.21.15.12:0/408743586 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0a5c0a33b0 msgr2=0x7f0a5c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:53.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0a5c0a33b0 0x7f0a5c0a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0a64005e10 tx=0x7f0a64005da0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 -- 172.21.15.12:0/408743586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a74102790 msgr2=0x7f0a74074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:53.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a74102790 0x7f0a74074a30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800b4a0 tx=0x7f0a6800b960 comp rx=0 tx=0).stop 2024-09-19T06:41:53.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 -- 172.21.15.12:0/408743586 shutdown_connections 2024-09-19T06:41:53.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a74106f10 0x7f0a74074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a74102790 0x7f0a74074a30 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0a5c0a33b0 0x7f0a5c0a5870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 --2- 172.21.15.12:0/408743586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a74101de0 0x7f0a740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:53.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 -- 172.21.15.12:0/408743586 >> 172.21.15.12:0/408743586 conn(0x7f0a740fd8c0 msgr2=0x7f0a740ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:53.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 -- 172.21.15.12:0/408743586 shutdown_connections 2024-09-19T06:41:53.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:53.291+0000 7f0a79b28640 1 -- 172.21.15.12:0/408743586 wait complete. 2024-09-19T06:41:53.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:53 smithi016 ceph-mon[34911]: pgmap v55: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 MiB/s wr, 258 op/s 2024-09-19T06:41:53.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:41:53.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:53 smithi173 ceph-mon[35349]: pgmap v55: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 MiB/s wr, 258 op/s 2024-09-19T06:41:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:41:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:41:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:41:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:41:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:41:53.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:41:53.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-09-19T06:41:53.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:41:53.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:53 smithi012 ceph-mon[30937]: pgmap v55: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 MiB/s wr, 258 op/s 2024-09-19T06:41:53.954 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 46c41cf7 --release --await' 2024-09-19T06:41:53.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 46c41cf7 --release --await 2024-09-19T06:41:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.108+0000 7fc49d3b2640 1 -- 172.21.15.12:0/473044086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc498101de0 msgr2=0x7fc4981021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.108+0000 7fc49d3b2640 1 --2- 172.21.15.12:0/473044086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc498101de0 0x7fc4981021c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc488009900 tx=0x7fc48802a410 comp rx=0 tx=0).stop 2024-09-19T06:41:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.108+0000 7fc49d3b2640 1 -- 172.21.15.12:0/473044086 shutdown_connections 2024-09-19T06:41:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.108+0000 7fc49d3b2640 1 --2- 172.21.15.12:0/473044086 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc498106f10 0x7fc49810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.108+0000 7fc49d3b2640 1 --2- 172.21.15.12:0/473044086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498102790 0x7fc4981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.108+0000 7fc49d3b2640 1 --2- 172.21.15.12:0/473044086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc498101de0 0x7fc4981021c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.108+0000 7fc49d3b2640 1 -- 172.21.15.12:0/473044086 >> 172.21.15.12:0/473044086 conn(0x7fc4980fd8c0 msgr2=0x7fc4980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.108+0000 7fc49d3b2640 1 -- 172.21.15.12:0/473044086 shutdown_connections 2024-09-19T06:41:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.108+0000 7fc49d3b2640 1 -- 172.21.15.12:0/473044086 wait complete. 2024-09-19T06:41:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.109+0000 7fc49d3b2640 1 Processor -- start 2024-09-19T06:41:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.109+0000 7fc49d3b2640 1 -- start start 2024-09-19T06:41:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.109+0000 7fc49d3b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc498101de0 0x7fc4980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.109+0000 7fc49d3b2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498102790 0x7fc498074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.109+0000 7fc49d3b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc498106f10 0x7fc498074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.109+0000 7fc49d3b2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc498111f30 con 0x7fc498106f10 2024-09-19T06:41:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.109+0000 7fc49d3b2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc498111db0 con 0x7fc498101de0 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.109+0000 7fc49d3b2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981120b0 con 0x7fc498102790 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc4977fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc498106f10 0x7fc498074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc4977fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc498106f10 0x7fc498074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60314/0 (socket says 172.21.15.12:60314) 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc496ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc498101de0 0x7fc4980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc4977fe640 1 -- 172.21.15.12:0/2595337956 learned_addr learned my addr 172.21.15.12:0/2595337956 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc4967fc640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498102790 0x7fc498074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc4977fe640 1 -- 172.21.15.12:0/2595337956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498102790 msgr2=0x7fc498074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc4977fe640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498102790 0x7fc498074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc4977fe640 1 -- 172.21.15.12:0/2595337956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc498101de0 msgr2=0x7fc4980744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc4977fe640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc498101de0 0x7fc4980744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc4977fe640 1 -- 172.21.15.12:0/2595337956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4981a6850 con 0x7fc498106f10 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc4977fe640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc498106f10 0x7fc498074f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc49000eaa0 tx=0x7fc49000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:54.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc47ffff640 1 -- 172.21.15.12:0/2595337956 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49000cdb0 con 0x7fc498106f10 2024-09-19T06:41:54.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.110+0000 7fc49d3b2640 1 -- 172.21.15.12:0/2595337956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4981a6b40 con 0x7fc498106f10 2024-09-19T06:41:54.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.111+0000 7fc47ffff640 1 -- 172.21.15.12:0/2595337956 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc490005020 con 0x7fc498106f10 2024-09-19T06:41:54.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.111+0000 7fc47ffff640 1 -- 172.21.15.12:0/2595337956 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4900116b0 con 0x7fc498106f10 2024-09-19T06:41:54.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.111+0000 7fc49d3b2640 1 -- 172.21.15.12:0/2595337956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4981a7080 con 0x7fc498106f10 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc49f78b740 1 Processor -- start 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc47ffff640 1 -- 172.21.15.12:0/2595337956 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc490005560 con 0x7fc498106f10 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc49f78b740 1 -- start start 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459e4a0 0x55689459e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459edc0 0x5568945a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5568945a9680 0x5568945aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc49f78b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5568945042e0 con 0x55689459e4a0 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc49f78b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5568944abce0 con 0x5568945a9680 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc49f78b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5568945002a0 con 0x55689459edc0 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc4967fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459e4a0 0x55689459e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc4967fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459e4a0 0x55689459e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60318/0 (socket says 172.21.15.12:60318) 2024-09-19T06:41:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.114+0000 7fc4967fc640 1 -- 172.21.15.12:0/4133209308 learned_addr learned my addr 172.21.15.12:0/4133209308 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc496ffd640 1 --2- 172.21.15.12:0/4133209308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459edc0 0x5568945a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc47ffff640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4800a33b0 0x7fc4800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc4967fc640 1 -- 172.21.15.12:0/4133209308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459edc0 msgr2=0x5568945a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc4967fc640 1 --2- 172.21.15.12:0/4133209308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459edc0 0x5568945a9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc4967fc640 1 -- 172.21.15.12:0/4133209308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5568945a9680 msgr2=0x5568945aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc4967fc640 1 --2- 172.21.15.12:0/4133209308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5568945a9680 0x5568945aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc4967fc640 1 -- 172.21.15.12:0/4133209308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556894490440 con 0x55689459e4a0 2024-09-19T06:41:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc47ffff640 1 -- 172.21.15.12:0/2595337956 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc4900cff80 con 0x7fc498106f10 2024-09-19T06:41:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc4967fc640 1 --2- 172.21.15.12:0/4133209308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459e4a0 0x55689459e880 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00cca0 tx=0x7fc48c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a866285a7430b396 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc4977fe640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4800a33b0 0x7fc4800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc47d7fa640 1 -- 172.21.15.12:0/4133209308 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c016070 con 0x55689459e4a0 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc47d7fa640 1 -- 172.21.15.12:0/4133209308 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc48c0047a0 con 0x55689459e4a0 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.115+0000 7fc47d7fa640 1 -- 172.21.15.12:0/4133209308 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c012840 con 0x55689459e4a0 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 -- 172.21.15.12:0/4133209308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459e4a0 msgr2=0x55689459e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc4977fe640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4800a33b0 0x7fc4800a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc49009c170 tx=0x7fc490009270 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 --2- 172.21.15.12:0/4133209308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459e4a0 0x55689459e880 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00cca0 tx=0x7fc48c010740 comp rx=0 tx=0).stop 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 -- 172.21.15.12:0/4133209308 shutdown_connections 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 --2- 172.21.15.12:0/4133209308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5568945a9680 0x5568945aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 --2- 172.21.15.12:0/4133209308 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459edc0 0x5568945a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 --2- 172.21.15.12:0/4133209308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459e4a0 0x55689459e880 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 -- 172.21.15.12:0/4133209308 >> 172.21.15.12:0/4133209308 conn(0x55689459aa30 msgr2=0x55689459ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 -- 172.21.15.12:0/4133209308 shutdown_connections 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 -- 172.21.15.12:0/4133209308 wait complete. 2024-09-19T06:41:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 -- start start 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.116+0000 7fc49f78b740 1 Processor -- start 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459e4a0 0x5568945a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5568945a9680 0x5568945a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc49f78b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5568945ac250 con 0x55689459edc0 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc49f78b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5568944bf050 con 0x5568945a9680 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc49f78b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5568945ac3d0 con 0x55689459e4a0 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc49f78b740 10 client.0 _ll_register_callbacks cb 0x5568944ff160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc4967fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459e4a0 0x5568945a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc496ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc496ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60324/0 (socket says 172.21.15.12:60324) 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc4967fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459e4a0 0x5568945a8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33730/0 (socket says 172.21.15.12:33730) 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc496ffd640 1 -- 172.21.15.12:0/3348338866 learned_addr learned my addr 172.21.15.12:0/3348338866 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.117+0000 7fc4967fc640 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5568945a9680 0x5568945a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc496ffd640 1 -- 172.21.15.12:0/3348338866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459e4a0 msgr2=0x5568945a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc496ffd640 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459e4a0 0x5568945a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc496ffd640 1 -- 172.21.15.12:0/3348338866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5568945a9680 msgr2=0x5568945a67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc496ffd640 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5568945a9680 0x5568945a67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc496ffd640 1 -- 172.21.15.12:0/3348338866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568942753c0 con 0x55689459edc0 2024-09-19T06:41:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc496ffd640 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a6270 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc48802a930 tx=0x7fc488031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776220f6393d6d75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc47aff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc47aff5640 1 -- 172.21.15.12:0/3348338866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488035040 con 0x55689459edc0 2024-09-19T06:41:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc47aff5640 1 -- 172.21.15.12:0/3348338866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc488004240 con 0x55689459edc0 2024-09-19T06:41:54.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc49f78b740 1 -- 172.21.15.12:0/3348338866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc48c0047a0 con 0x55689459edc0 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc47aff5640 1 -- 172.21.15.12:0/3348338866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc488004440 con 0x55689459edc0 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc49f78b740 10 client.16035 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.118+0000 7fc49f78b740 1 -- 172.21.15.12:0/3348338866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5568945b7c00 con 0x55689459edc0 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.119+0000 7fc47aff5640 1 -- 172.21.15.12:0/3348338866 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc48c0047a0 con 0x55689459edc0 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.119+0000 7fc47aff5640 1 -- 172.21.15.12:0/3348338866 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fc48803c740 con 0x55689459edc0 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.119+0000 7fc49f78b740 10 client.16035 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.119+0000 7fc49f78b740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.119+0000 7fc49f78b740 20 client.16035 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.119+0000 7fc49f78b740 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5568945b9180 0x5568945bb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.119+0000 7fc49f78b740 4 client.16035 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.119+0000 7fc49f78b740 1 -- 172.21.15.12:0/3348338866 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556894511850 con 0x5568945b9180 2024-09-19T06:41:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.119+0000 7fc4967fc640 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5568945b9180 0x5568945bb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.120+0000 7fc4967fc640 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5568945b9180 0x5568945bb570 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aa1d74b43f49dc4 server_cookie=8b2e19cad2886e57 in_seq=0 out_seq=0 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.120+0000 7fc47aff5640 10 client.16035 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.120+0000 7fc47aff5640 1 -- 172.21.15.12:0/3348338866 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556894511850 con 0x5568945b9180 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.120+0000 7fc47aff5640 10 client.16035 handle_command_reply: tid=0 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.120+0000 7fc49f78b740 1 client.16035 shutdown 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.120+0000 7fc49f78b740 1 -- 172.21.15.12:0/3348338866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 msgr2=0x5568945a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.120+0000 7fc49f78b740 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a6270 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc48802a930 tx=0x7fc488031920 comp rx=0 tx=0).stop 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.120+0000 7fc49f78b740 1 -- 172.21.15.12:0/3348338866 shutdown_connections 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.120+0000 7fc49f78b740 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5568945b9180 0x5568945bb570 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.121+0000 7fc49f78b740 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5568945a9680 0x5568945a67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.121+0000 7fc47aff5640 0 client.16035 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.121+0000 7fc49f78b740 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a6270 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.121+0000 7fc49f78b740 1 --2- 172.21.15.12:0/3348338866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55689459e4a0 0x5568945a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.121+0000 7fc49f78b740 1 -- 172.21.15.12:0/3348338866 >> 172.21.15.12:0/3348338866 conn(0x55689459aa30 msgr2=0x5568945a0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.121+0000 7fc49f78b740 1 -- 172.21.15.12:0/3348338866 shutdown_connections 2024-09-19T06:41:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.121+0000 7fc49f78b740 1 -- 172.21.15.12:0/3348338866 wait complete. 2024-09-19T06:41:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.121+0000 7fc49f78b740 20 client.16035 trim_cache size 0 max 16384 2024-09-19T06:41:54.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc49f78b740 1 Processor -- start 2024-09-19T06:41:54.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc49f78b740 1 -- start start 2024-09-19T06:41:54.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 0x5568945b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 0x5568945c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc49f78b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981afd50 con 0x55689459edc0 2024-09-19T06:41:54.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc49f78b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981b1980 con 0x55689459e4a0 2024-09-19T06:41:54.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc49f78b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981b0420 con 0x5568945a9680 2024-09-19T06:41:54.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc496ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc496ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60330/0 (socket says 172.21.15.12:60330) 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.138+0000 7fc496ffd640 1 -- 172.21.15.12:0/1277362617 learned_addr learned my addr 172.21.15.12:0/1277362617 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc4967fc640 1 --2- 172.21.15.12:0/1277362617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 0x5568945c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc4967fc640 1 --2- 172.21.15.12:0/1277362617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 0x5568945b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc496ffd640 1 -- 172.21.15.12:0/1277362617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 msgr2=0x5568945c0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc496ffd640 1 --2- 172.21.15.12:0/1277362617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 0x5568945c0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc496ffd640 1 -- 172.21.15.12:0/1277362617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 msgr2=0x5568945b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc496ffd640 1 --2- 172.21.15.12:0/1277362617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 0x5568945b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc496ffd640 1 -- 172.21.15.12:0/1277362617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568945a9330 con 0x55689459edc0 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc4967fc640 1 --2- 172.21.15.12:0/1277362617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 0x5568945b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc496ffd640 1 --2- 172.21.15.12:0/1277362617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a4b40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc48803cb60 tx=0x7fc488005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4e050f9b281918 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:54.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc47cff9640 1 -- 172.21.15.12:0/1277362617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488035030 con 0x55689459edc0 2024-09-19T06:41:54.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc47cff9640 1 -- 172.21.15.12:0/1277362617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc48803c640 con 0x55689459edc0 2024-09-19T06:41:54.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.139+0000 7fc47cff9640 1 -- 172.21.15.12:0/1277362617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488045db0 con 0x55689459edc0 2024-09-19T06:41:54.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.140+0000 7fc49f78b740 1 -- 172.21.15.12:0/1277362617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 msgr2=0x5568945a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.140+0000 7fc49f78b740 1 --2- 172.21.15.12:0/1277362617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a4b40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc48803cb60 tx=0x7fc488005fd0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.140+0000 7fc49f78b740 1 -- 172.21.15.12:0/1277362617 shutdown_connections 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.140+0000 7fc49f78b740 1 --2- 172.21.15.12:0/1277362617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 0x5568945c0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.140+0000 7fc49f78b740 1 --2- 172.21.15.12:0/1277362617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945a4b40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.140+0000 7fc49f78b740 1 --2- 172.21.15.12:0/1277362617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 0x5568945b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.140+0000 7fc49f78b740 1 -- 172.21.15.12:0/1277362617 >> 172.21.15.12:0/1277362617 conn(0x55689459aa30 msgr2=0x556894599b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.140+0000 7fc49f78b740 1 -- 172.21.15.12:0/1277362617 shutdown_connections 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.140+0000 7fc49f78b740 1 -- 172.21.15.12:0/1277362617 wait complete. 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc49f78b740 1 -- start start 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc49f78b740 1 Processor -- start 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 0x5568945ad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945ad890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc49f78b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 0x5568945addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc49f78b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981b11f0 con 0x55689459edc0 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc49f78b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981b0b20 con 0x55689459e4a0 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc49f78b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4981add30 con 0x5568945a9680 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc49f78b740 10 client.0 _ll_register_callbacks cb 0x7fc488009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc496ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc496ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945ad890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60340/0 (socket says 172.21.15.12:60340) 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc496ffd640 1 -- 172.21.15.12:0/2195953445 learned_addr learned my addr 172.21.15.12:0/2195953445 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc4967fc640 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 0x5568945ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.141+0000 7fc4967fc640 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 0x5568945addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc496ffd640 1 -- 172.21.15.12:0/2195953445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 msgr2=0x5568945addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc496ffd640 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 0x5568945addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc496ffd640 1 -- 172.21.15.12:0/2195953445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 msgr2=0x5568945ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc496ffd640 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 0x5568945ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc496ffd640 1 -- 172.21.15.12:0/2195953445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556894622e30 con 0x55689459edc0 2024-09-19T06:41:54.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc4967fc640 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 0x5568945addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc496ffd640 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945ad890 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc488009850 tx=0x7fc48803ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee6808d826b09d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc47aff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc47aff5640 1 -- 172.21.15.12:0/2195953445 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488035070 con 0x55689459edc0 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc47aff5640 1 -- 172.21.15.12:0/2195953445 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc488045430 con 0x55689459edc0 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc49f78b740 1 -- 172.21.15.12:0/2195953445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc48803c640 con 0x55689459edc0 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc47aff5640 1 -- 172.21.15.12:0/2195953445 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc48805a040 con 0x55689459edc0 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc49f78b740 10 client.16041 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc49f78b740 1 -- 172.21.15.12:0/2195953445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5568946240f0 con 0x55689459edc0 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.142+0000 7fc47aff5640 1 -- 172.21.15.12:0/2195953445 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc48803c640 con 0x55689459edc0 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.143+0000 7fc47aff5640 1 -- 172.21.15.12:0/2195953445 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fc48805d070 con 0x55689459edc0 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.143+0000 7fc49f78b740 10 client.16041 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.143+0000 7fc49f78b740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:41:54.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.143+0000 7fc49f78b740 20 client.16041 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:54.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.143+0000 7fc49f78b740 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5568945b9180 0x5568946267e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:54.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.143+0000 7fc49f78b740 4 client.16041 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:41:54.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.143+0000 7fc49f78b740 1 -- 172.21.15.12:0/2195953445 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55689450bd60 con 0x5568945b9180 2024-09-19T06:41:54.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.143+0000 7fc4967fc640 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5568945b9180 0x5568946267e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc4967fc640 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5568945b9180 0x5568946267e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4754060f9d64febe server_cookie=d46fe97aacd6974e in_seq=0 out_seq=0 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc47aff5640 10 client.16041 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc47aff5640 1 -- 172.21.15.12:0/2195953445 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55689450bd60 con 0x5568945b9180 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc47aff5640 10 client.16041 handle_command_reply: tid=0 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc49f78b740 1 client.16041 shutdown 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc49f78b740 1 -- 172.21.15.12:0/2195953445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 msgr2=0x5568945ad890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc49f78b740 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945ad890 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc488009850 tx=0x7fc48803ca20 comp rx=0 tx=0).stop 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc49f78b740 1 -- 172.21.15.12:0/2195953445 shutdown_connections 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc49f78b740 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5568945b9180 0x5568946267e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc49f78b740 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5568945a9680 0x5568945addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc49f78b740 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55689459edc0 0x5568945ad890 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc49f78b740 1 --2- 172.21.15.12:0/2195953445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55689459e4a0 0x5568945ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc49f78b740 1 -- 172.21.15.12:0/2195953445 >> 172.21.15.12:0/2195953445 conn(0x55689459aa30 msgr2=0x5568945a7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.144+0000 7fc47aff5640 0 client.16041 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49f78b740 1 -- 172.21.15.12:0/2195953445 shutdown_connections 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49f78b740 1 -- 172.21.15.12:0/2195953445 wait complete. 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49f78b740 20 client.16041 trim_cache size 0 max 16384 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "315bfb3c-9dc7-4e65-8da4-515e5de079f9": { 2024-09-19T06:41:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:41:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "315bfb3c-9dc7-4e65-8da4-515e5de079f9", 2024-09-19T06:41:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:41:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:54.151 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:41:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49d3b2640 1 -- 172.21.15.12:0/2595337956 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4800a33b0 msgr2=0x7fc4800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49d3b2640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4800a33b0 0x7fc4800a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc49009c170 tx=0x7fc490009270 comp rx=0 tx=0).stop 2024-09-19T06:41:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49d3b2640 1 -- 172.21.15.12:0/2595337956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc498106f10 msgr2=0x7fc498074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49d3b2640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc498106f10 0x7fc498074f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc49000eaa0 tx=0x7fc49000ef60 comp rx=0 tx=0).stop 2024-09-19T06:41:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49d3b2640 1 -- 172.21.15.12:0/2595337956 shutdown_connections 2024-09-19T06:41:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49d3b2640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc498106f10 0x7fc498074f70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49d3b2640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4800a33b0 0x7fc4800a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49d3b2640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc498102790 0x7fc498074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49d3b2640 1 --2- 172.21.15.12:0/2595337956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc498101de0 0x7fc4980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:54.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.145+0000 7fc49d3b2640 1 -- 172.21.15.12:0/2595337956 >> 172.21.15.12:0/2595337956 conn(0x7fc4980fd8c0 msgr2=0x7fc4980fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:54.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.146+0000 7fc49d3b2640 1 -- 172.21.15.12:0/2595337956 shutdown_connections 2024-09-19T06:41:54.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:54.146+0000 7fc49d3b2640 1 -- 172.21.15.12:0/2595337956 wait complete. 2024-09-19T06:41:54.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:54 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/408743586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:54.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:54 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/408743586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:54.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:54 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/408743586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:54.935 INFO:tasks.cephfs.filesystem:scrub status for tag:315bfb3c-9dc7-4e65-8da4-515e5de079f9 - {'path': '/', 'tag': '315bfb3c-9dc7-4e65-8da4-515e5de079f9', 'options': 'recursive,force'} 2024-09-19T06:41:54.939 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:55.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.406+0000 7f7076ae0640 1 -- 172.21.15.12:0/624674151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070108300 msgr2=0x7f707010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:55.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.406+0000 7f7076ae0640 1 --2- 172.21.15.12:0/624674151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070108300 0x7f707010ec70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7068009cd0 tx=0x7f706802a8f0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.407+0000 7f7076ae0640 1 -- 172.21.15.12:0/624674151 shutdown_connections 2024-09-19T06:41:55.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.407+0000 7f7076ae0640 1 --2- 172.21.15.12:0/624674151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070108300 0x7f707010ec70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.407+0000 7f7076ae0640 1 --2- 172.21.15.12:0/624674151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7070103780 0x7f7070107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.407+0000 7f7076ae0640 1 --2- 172.21.15.12:0/624674151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7070102dd0 0x7f70701031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.407+0000 7f7076ae0640 1 -- 172.21.15.12:0/624674151 >> 172.21.15.12:0/624674151 conn(0x7f70700fc7d0 msgr2=0x7f70700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:55.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.407+0000 7f7076ae0640 1 -- 172.21.15.12:0/624674151 shutdown_connections 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.407+0000 7f7076ae0640 1 -- 172.21.15.12:0/624674151 wait complete. 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.407+0000 7f7076ae0640 1 Processor -- start 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.407+0000 7f7076ae0640 1 -- start start 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f7076ae0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070102dd0 0x7f7070198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f7076ae0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7070103780 0x7f7070198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f7076ae0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7070108300 0x7f707019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f7076ae0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f70701120f0 con 0x7f7070102dd0 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f7076ae0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7070111f70 con 0x7f7070108300 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f7076ae0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7070112270 con 0x7f7070103780 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707487c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070102dd0 0x7f7070198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707487c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070102dd0 0x7f7070198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60358/0 (socket says 172.21.15.12:60358) 2024-09-19T06:41:55.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707487c640 1 -- 172.21.15.12:0/2958499135 learned_addr learned my addr 172.21.15.12:0/2958499135 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f706ffff640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7070103780 0x7f7070198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707507d640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7070108300 0x7f707019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707487c640 1 -- 172.21.15.12:0/2958499135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7070103780 msgr2=0x7f7070198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707487c640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7070103780 0x7f7070198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707487c640 1 -- 172.21.15.12:0/2958499135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7070108300 msgr2=0x7f707019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707487c640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7070108300 0x7f707019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707487c640 1 -- 172.21.15.12:0/2958499135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707019d540 con 0x7f7070102dd0 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707507d640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7070108300 0x7f707019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.408+0000 7f707487c640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070102dd0 0x7f7070198590 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f706000d950 tx=0x7f706000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.409+0000 7f706dffb640 1 -- 172.21.15.12:0/2958499135 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7060017070 con 0x7f7070102dd0 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.409+0000 7f706dffb640 1 -- 172.21.15.12:0/2958499135 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7060009c30 con 0x7f7070102dd0 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.409+0000 7f7076ae0640 1 -- 172.21.15.12:0/2958499135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707019d830 con 0x7f7070102dd0 2024-09-19T06:41:55.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.409+0000 7f706dffb640 1 -- 172.21.15.12:0/2958499135 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706000f6b0 con 0x7f7070102dd0 2024-09-19T06:41:55.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.409+0000 7f7076ae0640 1 -- 172.21.15.12:0/2958499135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70701a5110 con 0x7f7070102dd0 2024-09-19T06:41:55.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.412+0000 7f706dffb640 1 -- 172.21.15.12:0/2958499135 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f70600109d0 con 0x7f7070102dd0 2024-09-19T06:41:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.412+0000 7f7078eb9740 1 Processor -- start 2024-09-19T06:41:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.412+0000 7f7078eb9740 1 -- start start 2024-09-19T06:41:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.412+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca209360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.412+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca2098a0 0x55c8ca218110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.412+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca21aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.412+0000 7f7078eb9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c8ca16e620 con 0x55c8ca208f80 2024-09-19T06:41:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.412+0000 7f7078eb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c8ca115e50 con 0x55c8ca218650 2024-09-19T06:41:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.412+0000 7f7078eb9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c8ca16a5e0 con 0x55c8ca2098a0 2024-09-19T06:41:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f706dffb640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f705c0a33b0 0x7f705c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707507d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca209360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707507d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca209360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60366/0 (socket says 172.21.15.12:60366) 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707507d640 1 -- 172.21.15.12:0/1427309930 learned_addr learned my addr 172.21.15.12:0/1427309930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f706ffff640 1 --2- 172.21.15.12:0/1427309930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca21aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707507d640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f705c0a33b0 0x7f705c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f706dffb640 1 -- 172.21.15.12:0/2958499135 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f70600cfae0 con 0x7f7070102dd0 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707487c640 1 --2- 172.21.15.12:0/1427309930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca2098a0 0x55c8ca218110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707507d640 1 -- 172.21.15.12:0/1427309930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca2098a0 msgr2=0x55c8ca218110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707507d640 1 --2- 172.21.15.12:0/1427309930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca2098a0 0x55c8ca218110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707507d640 1 -- 172.21.15.12:0/1427309930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 msgr2=0x55c8ca21aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707507d640 1 --2- 172.21.15.12:0/1427309930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca21aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707507d640 1 -- 172.21.15.12:0/1427309930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ca106d40 con 0x55c8ca208f80 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f707507d640 1 --2- 172.21.15.12:0/1427309930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca209360 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7068006010 tx=0x7f70680309b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d191cc5fafbd598f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:55.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.413+0000 7f7066ffd640 1 -- 172.21.15.12:0/1427309930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068004d40 con 0x55c8ca208f80 2024-09-19T06:41:55.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7066ffd640 1 -- 172.21.15.12:0/1427309930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f706804d070 con 0x55c8ca208f80 2024-09-19T06:41:55.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7066ffd640 1 -- 172.21.15.12:0/1427309930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068004730 con 0x55c8ca208f80 2024-09-19T06:41:55.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f707507d640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f705c0a33b0 0x7f705c0a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7068009a60 tx=0x7f706804a000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7078eb9740 1 -- 172.21.15.12:0/1427309930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 msgr2=0x55c8ca209360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1427309930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca209360 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7068006010 tx=0x7f70680309b0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7078eb9740 1 -- 172.21.15.12:0/1427309930 shutdown_connections 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1427309930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca21aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1427309930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca2098a0 0x55c8ca218110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1427309930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca209360 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7078eb9740 1 -- 172.21.15.12:0/1427309930 >> 172.21.15.12:0/1427309930 conn(0x55c8ca2055f0 msgr2=0x55c8ca2059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7078eb9740 1 -- 172.21.15.12:0/1427309930 shutdown_connections 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.414+0000 7f7078eb9740 1 -- 172.21.15.12:0/1427309930 wait complete. 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f7078eb9740 1 -- start start 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f7078eb9740 1 Processor -- start 2024-09-19T06:41:55.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca2155f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca2098a0 0x55c8ca215b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca216070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f7078eb9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c8ca21b1c0 con 0x55c8ca208f80 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f7078eb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c8ca0f6f10 con 0x55c8ca218650 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f7078eb9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c8ca21b340 con 0x55c8ca2098a0 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f7078eb9740 10 client.0 _ll_register_callbacks cb 0x55c8ca11adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f707487c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca2155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f707487c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca2155f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60376/0 (socket says 172.21.15.12:60376) 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.415+0000 7f707487c640 1 -- 172.21.15.12:0/2091148926 learned_addr learned my addr 172.21.15.12:0/2091148926 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f707507d640 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca216070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f706ffff640 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca2098a0 0x55c8ca215b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f707487c640 1 -- 172.21.15.12:0/2091148926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca2098a0 msgr2=0x55c8ca215b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f707487c640 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca2098a0 0x55c8ca215b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f707487c640 1 -- 172.21.15.12:0/2091148926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 msgr2=0x55c8ca216070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f707487c640 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca216070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f707487c640 1 -- 172.21.15.12:0/2091148926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c9e7d580 con 0x55c8ca208f80 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f707507d640 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca216070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f707487c640 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca2155f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7060098150 tx=0x7f7060000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f401fe478dcdfe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f704ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f704ffff640 1 -- 172.21.15.12:0/2091148926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7060020040 con 0x55c8ca208f80 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f704ffff640 1 -- 172.21.15.12:0/2091148926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f706009b190 con 0x55c8ca208f80 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f7078eb9740 1 -- 172.21.15.12:0/2091148926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f706804d070 con 0x55c8ca208f80 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f704ffff640 1 -- 172.21.15.12:0/2091148926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f70600a49b0 con 0x55c8ca208f80 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f7078eb9740 10 client.16053 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.416+0000 7f7078eb9740 1 -- 172.21.15.12:0/2091148926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c8c9f47960 con 0x55c8ca208f80 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.417+0000 7f704ffff640 1 -- 172.21.15.12:0/2091148926 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f706804d070 con 0x55c8ca208f80 2024-09-19T06:41:55.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.417+0000 7f704ffff640 1 -- 172.21.15.12:0/2091148926 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f7060010460 con 0x55c8ca208f80 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.417+0000 7f7078eb9740 10 client.16053 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.417+0000 7f7078eb9740 10 client.16053 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.417+0000 7f7078eb9740 20 client.16053 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.417+0000 7f7078eb9740 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c8ca2283c0 0x55c8ca22a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.417+0000 7f7078eb9740 4 client.16053 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.417+0000 7f7078eb9740 1 -- 172.21.15.12:0/2091148926 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8ca17bb90 con 0x55c8ca2283c0 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.417+0000 7f706ffff640 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c8ca2283c0 0x55c8ca22a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.418+0000 7f706ffff640 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c8ca2283c0 0x55c8ca22a800 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27ccbe4946921c1 server_cookie=9e67dd0df0267e13 in_seq=0 out_seq=0 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.418+0000 7f704ffff640 10 client.16053 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.418+0000 7f704ffff640 1 -- 172.21.15.12:0/2091148926 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8ca17bb90 con 0x55c8ca2283c0 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.418+0000 7f704ffff640 10 client.16053 handle_command_reply: tid=0 2024-09-19T06:41:55.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.418+0000 7f7078eb9740 1 client.16053 shutdown 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 1 -- 172.21.15.12:0/2091148926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 msgr2=0x55c8ca2155f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca2155f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7060098150 tx=0x7f7060000bc0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 1 -- 172.21.15.12:0/2091148926 shutdown_connections 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c8ca2283c0 0x55c8ca22a800 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca216070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca2098a0 0x55c8ca215b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 1 --2- 172.21.15.12:0/2091148926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca2155f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f704ffff640 0 client.16053 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 1 -- 172.21.15.12:0/2091148926 >> 172.21.15.12:0/2091148926 conn(0x55c8ca2055f0 msgr2=0x55c8ca20b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 1 -- 172.21.15.12:0/2091148926 shutdown_connections 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 1 -- 172.21.15.12:0/2091148926 wait complete. 2024-09-19T06:41:55.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.419+0000 7f7078eb9740 20 client.16053 trim_cache size 0 max 16384 2024-09-19T06:41:55.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f7078eb9740 1 Processor -- start 2024-09-19T06:41:55.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f7078eb9740 1 -- start start 2024-09-19T06:41:55.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:55 smithi012 ceph-mon[30937]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 MiB/s wr, 258 op/s 2024-09-19T06:41:55.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca208f80 0x55c8ca2300d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca2098a0 0x55c8ca230610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca212890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f7078eb9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f70701ab910 con 0x55c8ca2098a0 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f7078eb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f70701ad540 con 0x55c8ca218650 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f7078eb9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f70701abfe0 con 0x55c8ca208f80 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f706ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca2098a0 0x55c8ca230610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f706ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca2098a0 0x55c8ca230610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60382/0 (socket says 172.21.15.12:60382) 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f706ffff640 1 -- 172.21.15.12:0/1555085195 learned_addr learned my addr 172.21.15.12:0/1555085195 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.436+0000 7f707487c640 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca208f80 0x55c8ca2300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f707507d640 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca212890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f706ffff640 1 -- 172.21.15.12:0/1555085195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca208f80 msgr2=0x55c8ca2300d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f706ffff640 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca208f80 0x55c8ca2300d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f706ffff640 1 -- 172.21.15.12:0/1555085195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 msgr2=0x55c8ca212890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f706ffff640 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca212890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f706ffff640 1 -- 172.21.15.12:0/1555085195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ca21adb0 con 0x55c8ca2098a0 2024-09-19T06:41:55.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f707487c640 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca208f80 0x55c8ca2300d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f707507d640 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca212890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f706ffff640 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca2098a0 0x55c8ca230610 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f7058000c00 tx=0x7f7058008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b09bb99abd11a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f70667fc640 1 -- 172.21.15.12:0/1555085195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058016ac0 con 0x55c8ca2098a0 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f70667fc640 1 -- 172.21.15.12:0/1555085195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7058016c60 con 0x55c8ca2098a0 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.437+0000 7f70667fc640 1 -- 172.21.15.12:0/1555085195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70580143b0 con 0x55c8ca2098a0 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 -- 172.21.15.12:0/1555085195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca2098a0 msgr2=0x55c8ca230610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca2098a0 0x55c8ca230610 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f7058000c00 tx=0x7f7058008040 comp rx=0 tx=0).stop 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 -- 172.21.15.12:0/1555085195 shutdown_connections 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca218650 0x55c8ca212890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca2098a0 0x55c8ca230610 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1555085195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca208f80 0x55c8ca2300d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 -- 172.21.15.12:0/1555085195 >> 172.21.15.12:0/1555085195 conn(0x55c8ca2055f0 msgr2=0x55c8ca204750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:55.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 -- 172.21.15.12:0/1555085195 shutdown_connections 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 -- 172.21.15.12:0/1555085195 wait complete. 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 -- start start 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.438+0000 7f7078eb9740 1 Processor -- start 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca220a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca2098a0 0x55c8ca21d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f7078eb9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca218650 0x55c8ca21dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f7078eb9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f70701acdb0 con 0x55c8ca208f80 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f7078eb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f70701ac6e0 con 0x55c8ca2098a0 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f7078eb9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f70701a98f0 con 0x55c8ca218650 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f7078eb9740 10 client.0 _ll_register_callbacks cb 0x7f706009b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707487c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca220a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707487c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca220a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60390/0 (socket says 172.21.15.12:60390) 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707487c640 1 -- 172.21.15.12:0/1163689412 learned_addr learned my addr 172.21.15.12:0/1163689412 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:55.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f706ffff640 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca2098a0 0x55c8ca21d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707507d640 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca218650 0x55c8ca21dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707487c640 1 -- 172.21.15.12:0/1163689412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca218650 msgr2=0x55c8ca21dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707487c640 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca218650 0x55c8ca21dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707487c640 1 -- 172.21.15.12:0/1163689412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca2098a0 msgr2=0x55c8ca21d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707487c640 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca2098a0 0x55c8ca21d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707487c640 1 -- 172.21.15.12:0/1163689412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ca21e020 con 0x55c8ca208f80 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707507d640 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca218650 0x55c8ca21dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f707487c640 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca220a40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f70600058c0 tx=0x7f706000b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21099e9a78f14bb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.439+0000 7f704ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f704ffff640 1 -- 172.21.15.12:0/1163689412 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7060020040 con 0x55c8ca208f80 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f704ffff640 1 -- 172.21.15.12:0/1163689412 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f706009b190 con 0x55c8ca208f80 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f7078eb9740 1 -- 172.21.15.12:0/1163689412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7058016c60 con 0x55c8ca208f80 2024-09-19T06:41:55.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f704ffff640 1 -- 172.21.15.12:0/1163689412 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f706009c440 con 0x55c8ca208f80 2024-09-19T06:41:55.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f7078eb9740 10 client.16059 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:55.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f7078eb9740 1 -- 172.21.15.12:0/1163689412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c8ca293db0 con 0x55c8ca208f80 2024-09-19T06:41:55.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f704ffff640 1 -- 172.21.15.12:0/1163689412 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7058016c60 con 0x55c8ca208f80 2024-09-19T06:41:55.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f704ffff640 1 -- 172.21.15.12:0/1163689412 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f70600a13a0 con 0x55c8ca208f80 2024-09-19T06:41:55.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f7078eb9740 10 client.16059 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:55.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f7078eb9740 10 client.16059 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:41:55.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f7078eb9740 20 client.16059 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:55.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c8ca294550 0x55c8ca296970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:55.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f7078eb9740 4 client.16059 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "46c41cf7", "release": true, "await": true}] 2024-09-19T06:41:55.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.440+0000 7f7078eb9740 1 -- 172.21.15.12:0/1163689412 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "46c41cf7", "release": true, "await": true}) -- 0x55c8ca1760a0 con 0x55c8ca294550 2024-09-19T06:41:55.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.441+0000 7f706ffff640 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c8ca294550 0x55c8ca296970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:55.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.441+0000 7f706ffff640 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c8ca294550 0x55c8ca296970 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e17022358beefd58 server_cookie=9dc5da04d9c401d3 in_seq=0 out_seq=0 2024-09-19T06:41:55.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.441+0000 7f704ffff640 10 client.16059 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f704ffff640 1 -- 172.21.15.12:0/1163689412 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c8ca1760a0 con 0x55c8ca294550 2024-09-19T06:41:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f704ffff640 10 client.16059 handle_command_reply: tid=0 2024-09-19T06:41:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f7078eb9740 1 client.16059 shutdown 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f7078eb9740 1 -- 172.21.15.12:0/1163689412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 msgr2=0x55c8ca220a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca220a40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f70600058c0 tx=0x7f706000b530 comp rx=0 tx=0).stop 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f7078eb9740 1 -- 172.21.15.12:0/1163689412 shutdown_connections 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c8ca294550 0x55c8ca296970 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c8ca218650 0x55c8ca21dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c8ca2098a0 0x55c8ca21d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f7078eb9740 1 --2- 172.21.15.12:0/1163689412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c8ca208f80 0x55c8ca220a40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f7078eb9740 1 -- 172.21.15.12:0/1163689412 >> 172.21.15.12:0/1163689412 conn(0x55c8ca2055f0 msgr2=0x55c8ca20a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.479+0000 7f704ffff640 0 client.16059 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.480+0000 7f7078eb9740 1 -- 172.21.15.12:0/1163689412 shutdown_connections 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.480+0000 7f7078eb9740 1 -- 172.21.15.12:0/1163689412 wait complete. 2024-09-19T06:41:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.480+0000 7f7078eb9740 20 client.16059 trim_cache size 0 max 16384 2024-09-19T06:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 31, 2024-09-19T06:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 8, 2024-09-19T06:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "46c41cf7": { 2024-09-19T06:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 8, 2024-09-19T06:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 140.3, 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:41:55.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.481+0000 7f7076ae0640 1 -- 172.21.15.12:0/2958499135 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f705c0a33b0 msgr2=0x7f705c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:55.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.481+0000 7f7076ae0640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f705c0a33b0 0x7f705c0a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7068009a60 tx=0x7f706804a000 comp rx=0 tx=0).stop 2024-09-19T06:41:55.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.481+0000 7f7076ae0640 1 -- 172.21.15.12:0/2958499135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070102dd0 msgr2=0x7f7070198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:55.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.481+0000 7f7076ae0640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070102dd0 0x7f7070198590 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f706000d950 tx=0x7f706000de10 comp rx=0 tx=0).stop 2024-09-19T06:41:55.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.481+0000 7f7076ae0640 1 -- 172.21.15.12:0/2958499135 shutdown_connections 2024-09-19T06:41:55.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.481+0000 7f7076ae0640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7070108300 0x7f707019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.481+0000 7f7076ae0640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f705c0a33b0 0x7f705c0a5870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.481+0000 7f7076ae0640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7070103780 0x7f7070198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.481+0000 7f7076ae0640 1 --2- 172.21.15.12:0/2958499135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070102dd0 0x7f7070198590 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:55.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.481+0000 7f7076ae0640 1 -- 172.21.15.12:0/2958499135 >> 172.21.15.12:0/2958499135 conn(0x7f70700fc7d0 msgr2=0x7f70701063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:55.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.482+0000 7f7076ae0640 1 -- 172.21.15.12:0/2958499135 shutdown_connections 2024-09-19T06:41:55.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:55.482+0000 7f7076ae0640 1 -- 172.21.15.12:0/2958499135 wait complete. 2024-09-19T06:41:55.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:55 smithi016 ceph-mon[34911]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 MiB/s wr, 258 op/s 2024-09-19T06:41:55.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:55 smithi173 ceph-mon[35349]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 MiB/s wr, 258 op/s 2024-09-19T06:41:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 70.0 s, 320.3 tps, lat 1265.922 ms stddev 4824.153 2024-09-19T06:41:56.223 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '46c41cf7', total seconds elapsed: 24.6 2024-09-19T06:41:56.223 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T06:41:56.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:41:56.692 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:57.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.305+0000 7f154d9bc640 1 -- 172.21.15.12:0/2696709419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548103fe0 msgr2=0x7f15481043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:57.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.305+0000 7f154d9bc640 1 --2- 172.21.15.12:0/2696709419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548103fe0 0x7f15481043c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1540009900 tx=0x7f154002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.306+0000 7f154d9bc640 1 -- 172.21.15.12:0/2696709419 shutdown_connections 2024-09-19T06:41:57.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.306+0000 7f154d9bc640 1 --2- 172.21.15.12:0/2696709419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1548109110 0x7f1548110c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.306+0000 7f154d9bc640 1 --2- 172.21.15.12:0/2696709419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548104990 0x7f15481089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.306+0000 7f154d9bc640 1 --2- 172.21.15.12:0/2696709419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548103fe0 0x7f15481043c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.306+0000 7f154d9bc640 1 -- 172.21.15.12:0/2696709419 >> 172.21.15.12:0/2696709419 conn(0x7f15480ffa80 msgr2=0x7f1548101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:57.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.306+0000 7f154d9bc640 1 -- 172.21.15.12:0/2696709419 shutdown_connections 2024-09-19T06:41:57.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.307+0000 7f154d9bc640 1 -- 172.21.15.12:0/2696709419 wait complete. 2024-09-19T06:41:57.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.307+0000 7f154d9bc640 1 Processor -- start 2024-09-19T06:41:57.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.309+0000 7f154d9bc640 1 -- start start 2024-09-19T06:41:57.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.309+0000 7f154d9bc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548103fe0 0x7f154819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:57.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.309+0000 7f154d9bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548104990 0x7f154819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:57.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.310+0000 7f154d9bc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1548109110 0x7f154819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:57.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.310+0000 7f1546ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548103fe0 0x7f154819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:57.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.310+0000 7f1546ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548103fe0 0x7f154819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33842/0 (socket says 172.21.15.12:33842) 2024-09-19T06:41:57.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.310+0000 7f15467fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548104990 0x7f154819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:57.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.310+0000 7f15467fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548104990 0x7f154819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60402/0 (socket says 172.21.15.12:60402) 2024-09-19T06:41:57.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.310+0000 7f1546ffd640 1 -- 172.21.15.12:0/307218789 learned_addr learned my addr 172.21.15.12:0/307218789 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:57.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.310+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1548114160 con 0x7f1548104990 2024-09-19T06:41:57.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.310+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1548113fe0 con 0x7f1548109110 2024-09-19T06:41:57.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.310+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f15481142e0 con 0x7f1548103fe0 2024-09-19T06:41:57.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.311+0000 7f15467fc640 1 -- 172.21.15.12:0/307218789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548103fe0 msgr2=0x7f154819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:57.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.311+0000 7f15467fc640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548103fe0 0x7f154819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.311+0000 7f15467fc640 1 -- 172.21.15.12:0/307218789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1548109110 msgr2=0x7f154819ef10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:41:57.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.311+0000 7f15467fc640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1548109110 0x7f154819ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.311+0000 7f15467fc640 1 -- 172.21.15.12:0/307218789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154819f5f0 con 0x7f1548104990 2024-09-19T06:41:57.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.311+0000 7f15467fc640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548104990 0x7f154819ab80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f153c00e9f0 tx=0x7f153c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:57.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.312+0000 7f154c9ba640 1 -- 172.21.15.12:0/307218789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c01dce0 con 0x7f1548104990 2024-09-19T06:41:57.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.312+0000 7f154c9ba640 1 -- 172.21.15.12:0/307218789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f153c022070 con 0x7f1548104990 2024-09-19T06:41:57.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.312+0000 7f154c9ba640 1 -- 172.21.15.12:0/307218789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c01dce0 con 0x7f1548104990 2024-09-19T06:41:57.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.312+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154819f8e0 con 0x7f1548104990 2024-09-19T06:41:57.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.312+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1548076630 con 0x7f1548104990 2024-09-19T06:41:57.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.315+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1534005290 con 0x7f1548104990 2024-09-19T06:41:57.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.316+0000 7f154c9ba640 1 -- 172.21.15.12:0/307218789 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f153c010d00 con 0x7f1548104990 2024-09-19T06:41:57.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.317+0000 7f154c9ba640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15300a37f0 0x7f15300a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:57.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.317+0000 7f154c9ba640 1 -- 172.21.15.12:0/307218789 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f153c01dae0 con 0x7f1548104990 2024-09-19T06:41:57.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.319+0000 7f1546ffd640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15300a37f0 0x7f15300a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:57.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.319+0000 7f1546ffd640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15300a37f0 0x7f15300a5cb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f15400096c0 tx=0x7f15400040c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:57.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.326+0000 7f154c9ba640 1 -- 172.21.15.12:0/307218789 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f153c0a4b60 con 0x7f1548104990 2024-09-19T06:41:57.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:57 smithi016 ceph-mon[34911]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 9.8 MiB/s wr, 354 op/s 2024-09-19T06:41:57.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:57 smithi173 ceph-mon[35349]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 9.8 MiB/s wr, 354 op/s 2024-09-19T06:41:57.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:57 smithi012 ceph-mon[30937]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 9.8 MiB/s wr, 354 op/s 2024-09-19T06:41:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.728+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1534005850 con 0x7f1548104990 2024-09-19T06:41:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.729+0000 7f154c9ba640 1 -- 172.21.15.12:0/307218789 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11979 (secure 0 0 0) 0x7f153c0a4b60 con 0x7f1548104990 2024-09-19T06:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:41:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2024-09-19T06:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"btime":"2024-09-19T06:41:24:903521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:41:24.405002+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:41:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.733+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15300a37f0 msgr2=0x7f15300a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.733+0000 7f154d9bc640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15300a37f0 0x7f15300a5cb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f15400096c0 tx=0x7f15400040c0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.734+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548104990 msgr2=0x7f154819ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.734+0000 7f154d9bc640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548104990 0x7f154819ab80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f153c00e9f0 tx=0x7f153c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.735+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 shutdown_connections 2024-09-19T06:41:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.735+0000 7f154d9bc640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1548109110 0x7f154819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.735+0000 7f154d9bc640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548104990 0x7f154819ab80 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.735+0000 7f154d9bc640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15300a37f0 0x7f15300a5cb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.735+0000 7f154d9bc640 1 --2- 172.21.15.12:0/307218789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548103fe0 0x7f154819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.735+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 >> 172.21.15.12:0/307218789 conn(0x7f15480ffa80 msgr2=0x7f1548100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.736+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 shutdown_connections 2024-09-19T06:41:57.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:57.736+0000 7f154d9bc640 1 -- 172.21.15.12:0/307218789 wait complete. 2024-09-19T06:41:58.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:58 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/307218789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:58.452 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T06:41:58.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T06:41:58.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:58 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/307218789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:58.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:58 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/307218789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:41:58.929 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:41:59.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:59 smithi012 ceph-mon[30937]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.1 MiB/s wr, 333 op/s 2024-09-19T06:41:59.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:59 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:41:59.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:59 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:41:59.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:59 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:41:59.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:59 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:41:59.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:41:59 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:41:59.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:59 smithi016 ceph-mon[34911]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.1 MiB/s wr, 333 op/s 2024-09-19T06:41:59.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:59 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:41:59.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:59 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:41:59.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:59 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:41:59.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:59 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:41:59.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:41:59 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:41:59.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.530+0000 7fc905213640 1 -- 172.21.15.12:0/225627752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90010ea80 msgr2=0x7fc9001154f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.530+0000 7fc905213640 1 --2- 172.21.15.12:0/225627752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90010ea80 0x7fc9001154f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8005fd0 tx=0x7fc8f8032d90 comp rx=0 tx=0).stop 2024-09-19T06:41:59.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.532+0000 7fc905213640 1 -- 172.21.15.12:0/225627752 shutdown_connections 2024-09-19T06:41:59.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.532+0000 7fc905213640 1 --2- 172.21.15.12:0/225627752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc90010ea80 0x7fc9001154f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.532+0000 7fc905213640 1 --2- 172.21.15.12:0/225627752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc900109e00 0x7fc90010e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.532+0000 7fc905213640 1 --2- 172.21.15.12:0/225627752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc900109450 0x7fc900109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.532+0000 7fc905213640 1 -- 172.21.15.12:0/225627752 >> 172.21.15.12:0/225627752 conn(0x7fc90006e2d0 msgr2=0x7fc90006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:59.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.532+0000 7fc905213640 1 -- 172.21.15.12:0/225627752 shutdown_connections 2024-09-19T06:41:59.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.532+0000 7fc905213640 1 -- 172.21.15.12:0/225627752 wait complete. 2024-09-19T06:41:59.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.533+0000 7fc905213640 1 Processor -- start 2024-09-19T06:41:59.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.534+0000 7fc905213640 1 -- start start 2024-09-19T06:41:59.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.534+0000 7fc905213640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc900109450 0x7fc9001b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.534+0000 7fc905213640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc900109e00 0x7fc9001b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.534+0000 7fc905213640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc90010ea80 0x7fc9001af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.534+0000 7fc905213640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc900118560 con 0x7fc900109e00 2024-09-19T06:41:59.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.534+0000 7fc905213640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9001183e0 con 0x7fc900109450 2024-09-19T06:41:59.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.534+0000 7fc905213640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc9001186e0 con 0x7fc90010ea80 2024-09-19T06:41:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.534+0000 7fc8fed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc900109450 0x7fc9001b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8fed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc900109450 0x7fc9001b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60130/0 (socket says 172.21.15.12:60130) 2024-09-19T06:41:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8fed9d640 1 -- 172.21.15.12:0/1578165144 learned_addr learned my addr 172.21.15.12:0/1578165144 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc90010ea80 0x7fc9001af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8f659c640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc900109e00 0x7fc9001b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8fed9d640 1 -- 172.21.15.12:0/1578165144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc90010ea80 msgr2=0x7fc9001af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc90010ea80 0x7fc9001af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8fed9d640 1 -- 172.21.15.12:0/1578165144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc900109e00 msgr2=0x7fc9001b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc900109e00 0x7fc9001b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8fed9d640 1 -- 172.21.15.12:0/1578165144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9001affe0 con 0x7fc900109450 2024-09-19T06:41:59.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc900109450 0x7fc9001b56c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800bed0 tx=0x7fc8e80095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:59.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.535+0000 7fc8fcd99640 1 -- 172.21.15.12:0/1578165144 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e800db10 con 0x7fc900109450 2024-09-19T06:41:59.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.536+0000 7fc8fcd99640 1 -- 172.21.15.12:0/1578165144 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8e800dcb0 con 0x7fc900109450 2024-09-19T06:41:59.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.536+0000 7fc905213640 1 -- 172.21.15.12:0/1578165144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9001b02d0 con 0x7fc900109450 2024-09-19T06:41:59.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.536+0000 7fc905213640 1 -- 172.21.15.12:0/1578165144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9001bc520 con 0x7fc900109450 2024-09-19T06:41:59.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.536+0000 7fc8fcd99640 1 -- 172.21.15.12:0/1578165144 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8015620 con 0x7fc900109450 2024-09-19T06:41:59.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.539+0000 7fc9075ec740 1 Processor -- start 2024-09-19T06:41:59.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.540+0000 7fc9075ec740 1 -- start start 2024-09-19T06:41:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.540+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 0x55d1616e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc8ff59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 0x55d1616e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc9075ec740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d16164a160 con 0x55d1616e6170 2024-09-19T06:41:59.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc9075ec740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d1615f1720 con 0x55d1616f0a30 2024-09-19T06:41:59.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc9075ec740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d161646120 con 0x55d1616e5850 2024-09-19T06:41:59.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc8ff59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 0x55d1616e5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33856/0 (socket says 172.21.15.12:33856) 2024-09-19T06:41:59.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc8ff59e640 1 -- 172.21.15.12:0/764787738 learned_addr learned my addr 172.21.15.12:0/764787738 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:59.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc8f659c640 1 --2- 172.21.15.12:0/764787738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc8fcd99640 1 -- 172.21.15.12:0/1578165144 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc8e8016420 con 0x7fc900109450 2024-09-19T06:41:59.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.541+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/764787738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.542+0000 7fc8f659c640 1 -- 172.21.15.12:0/764787738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 msgr2=0x55d1616e5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:59.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.542+0000 7fc8f659c640 1 --2- 172.21.15.12:0/764787738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 0x55d1616e5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.542+0000 7fc8f659c640 1 -- 172.21.15.12:0/764787738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 msgr2=0x55d1616f04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.542+0000 7fc8f659c640 1 --2- 172.21.15.12:0/764787738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616f04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.542+0000 7fc8f659c640 1 -- 172.21.15.12:0/764787738 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1613bbba0 con 0x55d1616f0a30 2024-09-19T06:41:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.542+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/764787738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.543+0000 7fc8f659c640 1 --2- 172.21.15.12:0/764787738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616f2e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc9001b0b90 tx=0x7fc8f000bbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72a3507fb5684130 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.543+0000 7fc8f559a640 1 -- 172.21.15.12:0/764787738 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000be10 con 0x55d1616f0a30 2024-09-19T06:41:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.543+0000 7fc8f559a640 1 -- 172.21.15.12:0/764787738 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8f0019070 con 0x55d1616f0a30 2024-09-19T06:41:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.543+0000 7fc8fcd99640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc8ec0a3480 0x7fc8ec0a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.543+0000 7fc8f559a640 1 -- 172.21.15.12:0/764787738 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0014dd0 con 0x55d1616f0a30 2024-09-19T06:41:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.544+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc8ec0a3480 0x7fc8ec0a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.544+0000 7fc8fcd99640 1 -- 172.21.15.12:0/1578165144 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc8e80cfc80 con 0x7fc900109450 2024-09-19T06:41:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.544+0000 7fc9075ec740 1 -- 172.21.15.12:0/764787738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 msgr2=0x55d1616f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.544+0000 7fc9075ec740 1 --2- 172.21.15.12:0/764787738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616f2e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc9001b0b90 tx=0x7fc8f000bbc0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.545+0000 7fc9075ec740 1 -- 172.21.15.12:0/764787738 shutdown_connections 2024-09-19T06:41:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.545+0000 7fc9075ec740 1 --2- 172.21.15.12:0/764787738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616f2e20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.545+0000 7fc9075ec740 1 --2- 172.21.15.12:0/764787738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.545+0000 7fc9075ec740 1 --2- 172.21.15.12:0/764787738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 0x55d1616e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.545+0000 7fc9075ec740 1 -- 172.21.15.12:0/764787738 >> 172.21.15.12:0/764787738 conn(0x55d1616e1de0 msgr2=0x55d1616e21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:59.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.545+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc8ec0a3480 0x7fc8ec0a5940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8008790 tx=0x7fc8f8035040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:59.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.546+0000 7fc9075ec740 1 -- 172.21.15.12:0/764787738 shutdown_connections 2024-09-19T06:41:59.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.546+0000 7fc9075ec740 1 -- 172.21.15.12:0/764787738 wait complete. 2024-09-19T06:41:59.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.546+0000 7fc9075ec740 1 -- start start 2024-09-19T06:41:59.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.547+0000 7fc9075ec740 1 Processor -- start 2024-09-19T06:41:59.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.547+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616e5850 0x55d1616ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.547+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616ede10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.547+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616f0a30 0x55d1616ee350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.547+0000 7fc9075ec740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d1616f36a0 con 0x55d1616e6170 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.547+0000 7fc9075ec740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d1615d2900 con 0x55d1616e5850 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.547+0000 7fc9075ec740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d1616f3820 con 0x55d1616f0a30 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.547+0000 7fc9075ec740 10 client.0 _ll_register_callbacks cb 0x55d1615d0780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8ff59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616f0a30 0x55d1616ee350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8ff59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616f0a30 0x55d1616ee350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33864/0 (socket says 172.21.15.12:33864) 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8ff59e640 1 -- 172.21.15.12:0/1393005490 learned_addr learned my addr 172.21.15.12:0/1393005490 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616e5850 0x55d1616ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8ff59e640 1 -- 172.21.15.12:0/1393005490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616e5850 msgr2=0x55d1616ed8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:59.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616e5850 0x55d1616ed8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8ff59e640 1 -- 172.21.15.12:0/1393005490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 msgr2=0x55d1616ede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:59.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616ede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8ff59e640 1 -- 172.21.15.12:0/1393005490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d161612c50 con 0x55d1616f0a30 2024-09-19T06:41:59.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616e5850 0x55d1616ed8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:41:59.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616f0a30 0x55d1616ee350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8f803d040 tx=0x7fc8f800aec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b39de33bb6f9715 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:59.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.548+0000 7fc8e67fc640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:41:59.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.549+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1393005490 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8054060 con 0x55d1616f0a30 2024-09-19T06:41:59.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.549+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1393005490 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc8f8033a60 con 0x55d1616f0a30 2024-09-19T06:41:59.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.549+0000 7fc9075ec740 1 -- 172.21.15.12:0/1393005490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8f0019070 con 0x55d1616f0a30 2024-09-19T06:41:59.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.549+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1393005490 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc8f8033c60 con 0x55d1616f0a30 2024-09-19T06:41:59.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.549+0000 7fc9075ec740 10 client.25648 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:59.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.549+0000 7fc9075ec740 1 -- 172.21.15.12:0/1393005490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d1616ff2f0 con 0x55d1616f0a30 2024-09-19T06:41:59.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.549+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1393005490 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8f0019070 con 0x55d1616f0a30 2024-09-19T06:41:59.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.549+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1393005490 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fc8f804e030 con 0x55d1616f0a30 2024-09-19T06:41:59.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.550+0000 7fc9075ec740 10 client.25648 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:59.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.550+0000 7fc9075ec740 10 client.25648 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:41:59.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.550+0000 7fc9075ec740 20 client.25648 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:59.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.550+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d161700830 0x55d161702cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.550+0000 7fc9075ec740 4 client.25648 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:41:59.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.550+0000 7fc9075ec740 1 -- 172.21.15.12:0/1393005490 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d161657890 con 0x55d161700830 2024-09-19T06:41:59.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.550+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d161700830 0x55d161702cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.551+0000 7fc8e67fc640 10 client.25648 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:59.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.552+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d161700830 0x55d161702cf0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a38e3da290aaad6e server_cookie=1f03af93d9e9de3f in_seq=0 out_seq=0 2024-09-19T06:41:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.553+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1393005490 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d161657890 con 0x55d161700830 2024-09-19T06:41:59.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.553+0000 7fc8e67fc640 10 client.25648 handle_command_reply: tid=0 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.553+0000 7fc9075ec740 1 client.25648 shutdown 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.553+0000 7fc9075ec740 1 -- 172.21.15.12:0/1393005490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616f0a30 msgr2=0x55d1616ee350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.553+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616f0a30 0x55d1616ee350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8f803d040 tx=0x7fc8f800aec0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.553+0000 7fc9075ec740 1 -- 172.21.15.12:0/1393005490 shutdown_connections 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.553+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d161700830 0x55d161702cf0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.554+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616f0a30 0x55d1616ee350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.554+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616ede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.554+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1393005490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616e5850 0x55d1616ed8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.554+0000 7fc8e67fc640 0 client.25648 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.554+0000 7fc9075ec740 1 -- 172.21.15.12:0/1393005490 >> 172.21.15.12:0/1393005490 conn(0x55d1616e1de0 msgr2=0x55d1616e7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.554+0000 7fc9075ec740 1 -- 172.21.15.12:0/1393005490 shutdown_connections 2024-09-19T06:41:59.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.554+0000 7fc9075ec740 1 -- 172.21.15.12:0/1393005490 wait complete. 2024-09-19T06:41:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.554+0000 7fc9075ec740 20 client.25648 trim_cache size 0 max 16384 2024-09-19T06:41:59.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:59 smithi173 ceph-mon[35349]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.1 MiB/s wr, 333 op/s 2024-09-19T06:41:59.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:59 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:41:59.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:59 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:41:59.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:59 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:41:59.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:59 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:41:59.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:41:59 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:41:59.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc9075ec740 1 Processor -- start 2024-09-19T06:41:59.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc9075ec740 1 -- start start 2024-09-19T06:41:59.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e5850 0x55d1616ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e6170 0x55d1616e82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc9075ec740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc9001c51e0 con 0x55d1616e5850 2024-09-19T06:41:59.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc9075ec740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9001c6e10 con 0x55d1616f0a30 2024-09-19T06:41:59.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc9075ec740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc9001c58b0 con 0x55d1616e6170 2024-09-19T06:41:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc8ff59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc8ff59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616ec1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60164/0 (socket says 172.21.15.12:60164) 2024-09-19T06:41:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc8ff59e640 1 -- 172.21.15.12:0/3247909301 learned_addr learned my addr 172.21.15.12:0/3247909301 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.585+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/3247909301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e5850 0x55d1616ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.586+0000 7fc8f659c640 1 --2- 172.21.15.12:0/3247909301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e6170 0x55d1616e82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.586+0000 7fc8ff59e640 1 -- 172.21.15.12:0/3247909301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e6170 msgr2=0x55d1616e82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.586+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/3247909301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e6170 0x55d1616e82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.586+0000 7fc8ff59e640 1 -- 172.21.15.12:0/3247909301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e5850 msgr2=0x55d1616ef7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.586+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/3247909301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e5850 0x55d1616ef7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.586+0000 7fc8ff59e640 1 -- 172.21.15.12:0/3247909301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1616e5fa0 con 0x55d1616f0a30 2024-09-19T06:41:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.586+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/3247909301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616ec1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8008570 tx=0x7fc8f8032d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7d831026595cfb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.587+0000 7fc8f4d99640 1 -- 172.21.15.12:0/3247909301 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8054040 con 0x55d1616f0a30 2024-09-19T06:41:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.587+0000 7fc8f4d99640 1 -- 172.21.15.12:0/3247909301 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8f8003d30 con 0x55d1616f0a30 2024-09-19T06:41:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.587+0000 7fc8f4d99640 1 -- 172.21.15.12:0/3247909301 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f80165f0 con 0x55d1616f0a30 2024-09-19T06:41:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.588+0000 7fc9075ec740 1 -- 172.21.15.12:0/3247909301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 msgr2=0x55d1616ec1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.588+0000 7fc9075ec740 1 --2- 172.21.15.12:0/3247909301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616ec1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8008570 tx=0x7fc8f8032d90 comp rx=0 tx=0).stop 2024-09-19T06:41:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.589+0000 7fc9075ec740 1 -- 172.21.15.12:0/3247909301 shutdown_connections 2024-09-19T06:41:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.589+0000 7fc9075ec740 1 --2- 172.21.15.12:0/3247909301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1616ec1a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.589+0000 7fc9075ec740 1 --2- 172.21.15.12:0/3247909301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e6170 0x55d1616e82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.589+0000 7fc9075ec740 1 --2- 172.21.15.12:0/3247909301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e5850 0x55d1616ef7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.589+0000 7fc9075ec740 1 -- 172.21.15.12:0/3247909301 >> 172.21.15.12:0/3247909301 conn(0x55d1616e1de0 msgr2=0x55d1616ee0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.590+0000 7fc9075ec740 1 -- 172.21.15.12:0/3247909301 shutdown_connections 2024-09-19T06:41:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.590+0000 7fc9075ec740 1 -- 172.21.15.12:0/3247909301 wait complete. 2024-09-19T06:41:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.590+0000 7fc9075ec740 1 -- start start 2024-09-19T06:41:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.591+0000 7fc9075ec740 1 Processor -- start 2024-09-19T06:41:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.591+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 0x55d1616f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.592+0000 7fc9075ec740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616f5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.592+0000 7fc8fed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 0x55d1616f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.592+0000 7fc8fed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 0x55d1616f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33880/0 (socket says 172.21.15.12:33880) 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.592+0000 7fc8fed9d640 1 -- 172.21.15.12:0/1235950271 learned_addr learned my addr 172.21.15.12:0/1235950271 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.592+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1617645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.592+0000 7fc8f659c640 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.592+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc9001c6680 con 0x55d1616e6170 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.592+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9001c5fb0 con 0x55d1616f0a30 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.592+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc9001c31c0 con 0x55d1616e5850 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.593+0000 7fc9075ec740 10 client.0 _ll_register_callbacks cb 0x7fc8f8003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.593+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1617645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.593+0000 7fc8ff59e640 1 -- 172.21.15.12:0/1235950271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 msgr2=0x55d1616f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.593+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 0x55d1616f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.593+0000 7fc8ff59e640 1 -- 172.21.15.12:0/1235950271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 msgr2=0x55d1616f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:41:59.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.593+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.593+0000 7fc8ff59e640 1 -- 172.21.15.12:0/1235950271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d161764c40 con 0x55d1616f0a30 2024-09-19T06:41:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.593+0000 7fc8ff59e640 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1617645d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8004ee0 tx=0x7fc8f8033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e95af49eff8f102 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.593+0000 7fc8e67fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:41:59.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.594+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1235950271 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8065060 con 0x55d1616f0a30 2024-09-19T06:41:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.594+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1235950271 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc8f8004290 con 0x55d1616f0a30 2024-09-19T06:41:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.594+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8f8003d30 con 0x55d1616f0a30 2024-09-19T06:41:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.594+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1235950271 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc8f8054040 con 0x55d1616f0a30 2024-09-19T06:41:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.594+0000 7fc9075ec740 10 client.25640 fetch_fsmap learned FSMap version 31 2024-09-19T06:41:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.594+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d16176bfa0 con 0x55d1616f0a30 2024-09-19T06:41:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.595+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1235950271 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8f8003d30 con 0x55d1616f0a30 2024-09-19T06:41:59.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.596+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1235950271 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fc8f804e070 con 0x55d1616f0a30 2024-09-19T06:41:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.596+0000 7fc9075ec740 10 client.25640 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:41:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.596+0000 7fc9075ec740 10 client.25640 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:41:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.596+0000 7fc9075ec740 20 client.25640 populate_metadata read hostname 'smithi012' 2024-09-19T06:41:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.596+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d16176c680 0x55d16176eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.596+0000 7fc9075ec740 4 client.25640 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T06:41:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.596+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55d161651be0 con 0x55d16176c680 2024-09-19T06:41:59.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.596+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d16176c680 0x55d16176eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:59.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.597+0000 7fc8fed9d640 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d16176c680 0x55d16176eaa0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa97c9dc1c30026c server_cookie=8eae5fb1f9621d5a in_seq=0 out_seq=0 2024-09-19T06:41:59.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.597+0000 7fc8e67fc640 10 client.25640 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.795+0000 7fc8e67fc640 1 -- 172.21.15.12:0/1235950271 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d161651be0 con 0x55d16176c680 2024-09-19T06:41:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.795+0000 7fc8e67fc640 10 client.25640 handle_command_reply: tid=0 2024-09-19T06:41:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.795+0000 7fc9075ec740 1 client.25640 shutdown 2024-09-19T06:41:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 msgr2=0x55d1617645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1617645d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8004ee0 tx=0x7fc8f8033ba0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 shutdown_connections 2024-09-19T06:41:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d16176c680 0x55d16176eaa0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1616f0a30 0x55d1617645d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1616e6170 0x55d1616f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 1 --2- 172.21.15.12:0/1235950271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1616e5850 0x55d1616f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc8e67fc640 0 client.25640 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:41:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 >> 172.21.15.12:0/1235950271 conn(0x55d1616e1de0 msgr2=0x55d1616e0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 shutdown_connections 2024-09-19T06:41:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 1 -- 172.21.15.12:0/1235950271 wait complete. 2024-09-19T06:41:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc9075ec740 20 client.25640 trim_cache size 0 max 16384 2024-09-19T06:41:59.801 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:41:59.802 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 31, 2024-09-19T06:41:59.802 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:41:59.802 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 10, 2024-09-19T06:41:59.802 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:41:59.802 INFO:teuthology.orchestra.run.smithi012.stdout: "c60e7e05": { 2024-09-19T06:41:59.803 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 10, 2024-09-19T06:41:59.803 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:41:59.803 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:41:59.803 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:41:59.804 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:41:59.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:41:59.804 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:41:59.804 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 140.3, 2024-09-19T06:41:59.804 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:41:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:41:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:41:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:41:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:41:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:41:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:59.805 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:59.806 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:59.806 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:59.806 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:41:59.806 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:41:59.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc905213640 1 -- 172.21.15.12:0/1578165144 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc8ec0a3480 msgr2=0x7fc8ec0a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc905213640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc8ec0a3480 0x7fc8ec0a5940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8008790 tx=0x7fc8f8035040 comp rx=0 tx=0).stop 2024-09-19T06:41:59.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc905213640 1 -- 172.21.15.12:0/1578165144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc900109450 msgr2=0x7fc9001b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:59.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.796+0000 7fc905213640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc900109450 0x7fc9001b56c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800bed0 tx=0x7fc8e80095b0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.797+0000 7fc905213640 1 -- 172.21.15.12:0/1578165144 shutdown_connections 2024-09-19T06:41:59.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.797+0000 7fc905213640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc8ec0a3480 0x7fc8ec0a5940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.797+0000 7fc905213640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc90010ea80 0x7fc9001af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.797+0000 7fc905213640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc900109e00 0x7fc9001b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.797+0000 7fc905213640 1 --2- 172.21.15.12:0/1578165144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc900109450 0x7fc9001b56c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:59.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.797+0000 7fc905213640 1 -- 172.21.15.12:0/1578165144 >> 172.21.15.12:0/1578165144 conn(0x7fc90006e2d0 msgr2=0x7fc90010c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:59.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.797+0000 7fc905213640 1 -- 172.21.15.12:0/1578165144 shutdown_connections 2024-09-19T06:41:59.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:41:59.797+0000 7fc905213640 1 -- 172.21.15.12:0/1578165144 wait complete. 2024-09-19T06:42:00.545 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c60e7e05', quiesce took 4.3 seconds. Will release after: 16.05 2024-09-19T06:42:00.808 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 75.0 s, 4042.2 tps, lat 18.825 ms stddev 19.046 2024-09-19T06:42:01.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:01 smithi016 ceph-mon[34911]: pgmap v59: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 12 MiB/s wr, 626 op/s 2024-09-19T06:42:01.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:01 smithi173 ceph-mon[35349]: pgmap v59: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 12 MiB/s wr, 626 op/s 2024-09-19T06:42:01.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:01 smithi012 ceph-mon[30937]: pgmap v59: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 12 MiB/s wr, 626 op/s 2024-09-19T06:42:03.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:03 smithi016 ceph-mon[34911]: pgmap v60: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2024-09-19T06:42:03.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:03 smithi173 ceph-mon[35349]: pgmap v60: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2024-09-19T06:42:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.590+0000 7fcb366ba640 1 -- 172.21.15.12:0/3314166819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb30106a00 msgr2=0x7fcb30106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.590+0000 7fcb366ba640 1 --2- 172.21.15.12:0/3314166819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb30106a00 0x7fcb30106de0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009930 tx=0x7fcb2002a420 comp rx=0 tx=0).stop 2024-09-19T06:42:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.590+0000 7fcb366ba640 1 -- 172.21.15.12:0/3314166819 shutdown_connections 2024-09-19T06:42:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.590+0000 7fcb366ba640 1 --2- 172.21.15.12:0/3314166819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb30101390 0x7fcb3010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.590+0000 7fcb366ba640 1 --2- 172.21.15.12:0/3314166819 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb301009f0 0x7fcb30100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.591+0000 7fcb366ba640 1 --2- 172.21.15.12:0/3314166819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb30106a00 0x7fcb30106de0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.591+0000 7fcb366ba640 1 -- 172.21.15.12:0/3314166819 >> 172.21.15.12:0/3314166819 conn(0x7fcb300fc6b0 msgr2=0x7fcb300fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.591+0000 7fcb366ba640 1 -- 172.21.15.12:0/3314166819 shutdown_connections 2024-09-19T06:42:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.591+0000 7fcb366ba640 1 -- 172.21.15.12:0/3314166819 wait complete. 2024-09-19T06:42:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.591+0000 7fcb366ba640 1 Processor -- start 2024-09-19T06:42:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.591+0000 7fcb366ba640 1 -- start start 2024-09-19T06:42:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb366ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb301009f0 0x7fcb301991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb366ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb30101390 0x7fcb30199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb366ba640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb30106a00 0x7fcb301a4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb366ba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30110e40 con 0x7fcb301009f0 2024-09-19T06:42:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb366ba640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30110cc0 con 0x7fcb30101390 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb366ba640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30110fc0 con 0x7fcb30106a00 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb2ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb301009f0 0x7fcb301991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb2ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb301009f0 0x7fcb301991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50926/0 (socket says 172.21.15.12:50926) 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb2ffff640 1 -- 172.21.15.12:0/24308447 learned_addr learned my addr 172.21.15.12:0/24308447 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb30101390 0x7fcb30199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb34c57640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb30106a00 0x7fcb301a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb2ffff640 1 -- 172.21.15.12:0/24308447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb30106a00 msgr2=0x7fcb301a4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb30106a00 0x7fcb301a4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb2ffff640 1 -- 172.21.15.12:0/24308447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb30101390 msgr2=0x7fcb30199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb30101390 0x7fcb30199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb2ffff640 1 -- 172.21.15.12:0/24308447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb301a4790 con 0x7fcb301009f0 2024-09-19T06:42:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.592+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb301009f0 0x7fcb301991d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009230 tx=0x7fcb20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.593+0000 7fcb2d7fa640 1 -- 172.21.15.12:0/24308447 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2003f030 con 0x7fcb301009f0 2024-09-19T06:42:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.593+0000 7fcb2d7fa640 1 -- 172.21.15.12:0/24308447 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb20003ad0 con 0x7fcb301009f0 2024-09-19T06:42:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.593+0000 7fcb366ba640 1 -- 172.21.15.12:0/24308447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb301a4960 con 0x7fcb301009f0 2024-09-19T06:42:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.593+0000 7fcb2d7fa640 1 -- 172.21.15.12:0/24308447 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20035070 con 0x7fcb301009f0 2024-09-19T06:42:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.593+0000 7fcb366ba640 1 -- 172.21.15.12:0/24308447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb301a4e20 con 0x7fcb301009f0 2024-09-19T06:42:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.595+0000 7fcb2d7fa640 1 -- 172.21.15.12:0/24308447 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcb20042030 con 0x7fcb301009f0 2024-09-19T06:42:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb3945b740 1 Processor -- start 2024-09-19T06:42:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb3945b740 1 -- start start 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6baf0 0x556ca8c6bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 0x556ca8c76770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c76cb0 0x556ca8c790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb3945b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556ca8bd02f0 con 0x556ca8c76cb0 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb3945b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556ca8b78270 con 0x556ca8c6baf0 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb3945b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556ca8bcc2b0 con 0x556ca8c6c410 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2d7fa640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb180a3460 0x7fcb180a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c76cb0 0x556ca8c790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c76cb0 0x556ca8c790a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50930/0 (socket says 172.21.15.12:50930) 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2f7fe640 1 -- 172.21.15.12:0/1803627737 learned_addr learned my addr 172.21.15.12:0/1803627737 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb34c57640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb180a3460 0x7fcb180a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2d7fa640 1 -- 172.21.15.12:0/24308447 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcb200f03d0 con 0x7fcb301009f0 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 0x556ca8c76770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb34c57640 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6baf0 0x556ca8c6bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2f7fe640 1 -- 172.21.15.12:0/1803627737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 msgr2=0x556ca8c76770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 0x556ca8c76770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2f7fe640 1 -- 172.21.15.12:0/1803627737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6baf0 msgr2=0x556ca8c6bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6baf0 0x556ca8c6bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2f7fe640 1 -- 172.21.15.12:0/1803627737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca8b77340 con 0x556ca8c76cb0 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb34c57640 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6baf0 0x556ca8c6bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.596+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 0x556ca8c76770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.597+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c76cb0 0x556ca8c790a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009c90 tx=0x7fcb24011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb259e6f78f63b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.597+0000 7fcb34c57640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb180a3460 0x7fcb180a5920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcb280098b0 tx=0x7fcb28009840 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.597+0000 7fcb167fc640 1 -- 172.21.15.12:0/1803627737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2401e070 con 0x556ca8c76cb0 2024-09-19T06:42:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.597+0000 7fcb167fc640 1 -- 172.21.15.12:0/1803627737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb24019b10 con 0x556ca8c76cb0 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.597+0000 7fcb167fc640 1 -- 172.21.15.12:0/1803627737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400ea70 con 0x556ca8c76cb0 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 -- 172.21.15.12:0/1803627737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c76cb0 msgr2=0x556ca8c790a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c76cb0 0x556ca8c790a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009c90 tx=0x7fcb24011810 comp rx=0 tx=0).stop 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 -- 172.21.15.12:0/1803627737 shutdown_connections 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c76cb0 0x556ca8c790a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 0x556ca8c76770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 --2- 172.21.15.12:0/1803627737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6baf0 0x556ca8c6bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 -- 172.21.15.12:0/1803627737 >> 172.21.15.12:0/1803627737 conn(0x556ca8c68060 msgr2=0x556ca8c68440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 -- 172.21.15.12:0/1803627737 shutdown_connections 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 -- 172.21.15.12:0/1803627737 wait complete. 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 -- start start 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.598+0000 7fcb3945b740 1 Processor -- start 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6baf0 0x556ca8c73b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6c410 0x556ca8c740b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 0x556ca8c745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb3945b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556ca8c79880 con 0x556ca8c6c410 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb3945b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556ca8b59290 con 0x556ca8c76cb0 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb3945b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556ca8c79a00 con 0x556ca8c6baf0 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb3945b740 10 client.0 _ll_register_callbacks cb 0x556ca8b8a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6c410 0x556ca8c740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6c410 0x556ca8c740b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50942/0 (socket says 172.21.15.12:50942) 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb2f7fe640 1 -- 172.21.15.12:0/2247441288 learned_addr learned my addr 172.21.15.12:0/2247441288 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb34c57640 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 0x556ca8c745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6baf0 0x556ca8c73b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb2f7fe640 1 -- 172.21.15.12:0/2247441288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6baf0 msgr2=0x556ca8c73b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6baf0 0x556ca8c73b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb2f7fe640 1 -- 172.21.15.12:0/2247441288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 msgr2=0x556ca8c745f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 0x556ca8c745f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb2f7fe640 1 -- 172.21.15.12:0/2247441288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca88e3210 con 0x556ca8c6c410 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb34c57640 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 0x556ca8c745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6c410 0x556ca8c740b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcb2401c040 tx=0x7fcb24005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0497b31cf6ceef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.599+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/2247441288 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2401e050 con 0x556ca8c6c410 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/2247441288 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcb24005450 con 0x556ca8c6c410 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb3945b740 1 -- 172.21.15.12:0/2247441288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb24019b10 con 0x556ca8c6c410 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/2247441288 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcb24032050 con 0x556ca8c6c410 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb3945b740 10 client.16089 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb3945b740 1 -- 172.21.15.12:0/2247441288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556ca89af620 con 0x556ca8c6c410 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/2247441288 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb24019b10 con 0x556ca8c6c410 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/2247441288 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fcb2402d030 con 0x556ca8c6c410 2024-09-19T06:42:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb3945b740 10 client.16089 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb3945b740 10 client.16089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb3945b740 20 client.16089 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb3945b740 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ca8c86c30 0x556ca8c89020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb3945b740 4 client.16089 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb3945b740 1 -- 172.21.15.12:0/2247441288 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ca8bdda20 con 0x556ca8c86c30 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.600+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ca8c86c30 0x556ca8c89020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.601+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ca8c86c30 0x556ca8c89020 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e29a6e708741c9b server_cookie=ab189b3f0cb024 in_seq=0 out_seq=0 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.601+0000 7fcb0f7fe640 10 client.16089 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.601+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/2247441288 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ca8bdda20 con 0x556ca8c86c30 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.601+0000 7fcb0f7fe640 10 client.16089 handle_command_reply: tid=0 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 client.16089 shutdown 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 -- 172.21.15.12:0/2247441288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6c410 msgr2=0x556ca8c740b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6c410 0x556ca8c740b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcb2401c040 tx=0x7fcb24005850 comp rx=0 tx=0).stop 2024-09-19T06:42:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 -- 172.21.15.12:0/2247441288 shutdown_connections 2024-09-19T06:42:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ca8c86c30 0x556ca8c89020 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 0x556ca8c745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6c410 0x556ca8c740b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb0f7fe640 0 client.16089 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 --2- 172.21.15.12:0/2247441288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6baf0 0x556ca8c73b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 -- 172.21.15.12:0/2247441288 >> 172.21.15.12:0/2247441288 conn(0x556ca8c68060 msgr2=0x556ca8c6dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 -- 172.21.15.12:0/2247441288 shutdown_connections 2024-09-19T06:42:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 1 -- 172.21.15.12:0/2247441288 wait complete. 2024-09-19T06:42:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.602+0000 7fcb3945b740 20 client.16089 trim_cache size 0 max 16384 2024-09-19T06:42:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb3945b740 1 Processor -- start 2024-09-19T06:42:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb3945b740 1 -- start start 2024-09-19T06:42:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c74420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 0x556ca8c6dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 0x556ca8c8e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb3945b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301ada30 con 0x556ca8c6baf0 2024-09-19T06:42:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb3945b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301af660 con 0x556ca8c76cb0 2024-09-19T06:42:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb3945b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301ae100 con 0x556ca8c6c410 2024-09-19T06:42:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c74420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c74420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50946/0 (socket says 172.21.15.12:50946) 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2ffff640 1 -- 172.21.15.12:0/428596154 learned_addr learned my addr 172.21.15.12:0/428596154 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb34c57640 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 0x556ca8c8e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 0x556ca8c6dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2ffff640 1 -- 172.21.15.12:0/428596154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 msgr2=0x556ca8c6dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 0x556ca8c6dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2ffff640 1 -- 172.21.15.12:0/428596154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 msgr2=0x556ca8c8e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 0x556ca8c8e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2ffff640 1 -- 172.21.15.12:0/428596154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca8c67e90 con 0x556ca8c6baf0 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb34c57640 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 0x556ca8c8e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 0x556ca8c6dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.617+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c74420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcb20000c00 tx=0x7fcb200b8240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c464d4585e35c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb15ffb640 1 -- 172.21.15.12:0/428596154 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20049040 con 0x556ca8c6baf0 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb15ffb640 1 -- 172.21.15.12:0/428596154 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb200d5070 con 0x556ca8c6baf0 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb15ffb640 1 -- 172.21.15.12:0/428596154 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb200035f0 con 0x556ca8c6baf0 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb3945b740 1 -- 172.21.15.12:0/428596154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 msgr2=0x556ca8c74420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb3945b740 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c74420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcb20000c00 tx=0x7fcb200b8240 comp rx=0 tx=0).stop 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb3945b740 1 -- 172.21.15.12:0/428596154 shutdown_connections 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb3945b740 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c76cb0 0x556ca8c8e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb3945b740 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c6c410 0x556ca8c6dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb3945b740 1 --2- 172.21.15.12:0/428596154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c74420 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb3945b740 1 -- 172.21.15.12:0/428596154 >> 172.21.15.12:0/428596154 conn(0x556ca8c68060 msgr2=0x556ca8c6d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb3945b740 1 -- 172.21.15.12:0/428596154 shutdown_connections 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb3945b740 1 -- 172.21.15.12:0/428596154 wait complete. 2024-09-19T06:42:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.618+0000 7fcb3945b740 1 -- start start 2024-09-19T06:42:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb3945b740 1 Processor -- start 2024-09-19T06:42:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c7ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6c410 0x556ca8c7f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb3945b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c76cb0 0x556ca8c701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb3945b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301aeed0 con 0x556ca8c6baf0 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb3945b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301ae800 con 0x556ca8c6c410 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb3945b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301aba10 con 0x556ca8c76cb0 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb3945b740 10 client.0 _ll_register_callbacks cb 0x7fcb2401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb2ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c7ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb2ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c7ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50950/0 (socket says 172.21.15.12:50950) 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb2ffff640 1 -- 172.21.15.12:0/979784194 learned_addr learned my addr 172.21.15.12:0/979784194 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6c410 0x556ca8c7f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb34c57640 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c76cb0 0x556ca8c701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb2ffff640 1 -- 172.21.15.12:0/979784194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c76cb0 msgr2=0x556ca8c701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c76cb0 0x556ca8c701b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb2ffff640 1 -- 172.21.15.12:0/979784194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6c410 msgr2=0x556ca8c7f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6c410 0x556ca8c7f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb2ffff640 1 -- 172.21.15.12:0/979784194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca8c706f0 con 0x556ca8c6baf0 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.619+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6c410 0x556ca8c7f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb2ffff640 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c7ec90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcb200bc380 tx=0x7fcb200c5380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f604518954405e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/979784194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb200da020 con 0x556ca8c6baf0 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/979784194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcb200035f0 con 0x556ca8c6baf0 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb3945b740 1 -- 172.21.15.12:0/979784194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb200d5070 con 0x556ca8c6baf0 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/979784194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcb20049040 con 0x556ca8c6baf0 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb3945b740 10 client.16095 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb3945b740 1 -- 172.21.15.12:0/979784194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556ca8cf0ec0 con 0x556ca8c6baf0 2024-09-19T06:42:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/979784194 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb200d5070 con 0x556ca8c6baf0 2024-09-19T06:42:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/979784194 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fcb20031bd0 con 0x556ca8c6baf0 2024-09-19T06:42:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb3945b740 10 client.16095 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb3945b740 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb3945b740 20 client.16095 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb3945b740 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ca8cf1530 0x556ca8cf3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb3945b740 4 client.16095 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:42:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.620+0000 7fcb3945b740 1 -- 172.21.15.12:0/979784194 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ca8bd7d70 con 0x556ca8cf1530 2024-09-19T06:42:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.621+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ca8cf1530 0x556ca8cf3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.621+0000 7fcb2f7fe640 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ca8cf1530 0x556ca8cf3950 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cd684773bcce748 server_cookie=ed3a1dc0d00a2243 in_seq=0 out_seq=0 2024-09-19T06:42:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.621+0000 7fcb0f7fe640 10 client.16095 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:03 smithi012 ceph-mon[30937]: pgmap v60: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2024-09-19T06:42:03.636 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb0f7fe640 1 -- 172.21.15.12:0/979784194 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ca8bd7d70 con 0x556ca8cf1530 2024-09-19T06:42:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb0f7fe640 10 client.16095 handle_command_reply: tid=0 2024-09-19T06:42:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 client.16095 shutdown 2024-09-19T06:42:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 -- 172.21.15.12:0/979784194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 msgr2=0x556ca8c7ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c7ec90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcb200bc380 tx=0x7fcb200c5380 comp rx=0 tx=0).stop 2024-09-19T06:42:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 -- 172.21.15.12:0/979784194 shutdown_connections 2024-09-19T06:42:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ca8cf1530 0x556ca8cf3950 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ca8c76cb0 0x556ca8c701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb0f7fe640 0 client.16095 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ca8c6c410 0x556ca8c7f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 --2- 172.21.15.12:0/979784194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ca8c6baf0 0x556ca8c7ec90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 -- 172.21.15.12:0/979784194 >> 172.21.15.12:0/979784194 conn(0x556ca8c68060 msgr2=0x556ca8c671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 -- 172.21.15.12:0/979784194 shutdown_connections 2024-09-19T06:42:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 1 -- 172.21.15.12:0/979784194 wait complete. 2024-09-19T06:42:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.635+0000 7fcb3945b740 20 client.16095 trim_cache size 0 max 16384 2024-09-19T06:42:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:42:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:42:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:42:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:42:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 -- 172.21.15.12:0/24308447 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb180a3460 msgr2=0x7fcb180a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb180a3460 0x7fcb180a5920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcb280098b0 tx=0x7fcb28009840 comp rx=0 tx=0).stop 2024-09-19T06:42:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 -- 172.21.15.12:0/24308447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb301009f0 msgr2=0x7fcb301991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb301009f0 0x7fcb301991d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009230 tx=0x7fcb20004270 comp rx=0 tx=0).stop 2024-09-19T06:42:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 -- 172.21.15.12:0/24308447 shutdown_connections 2024-09-19T06:42:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcb180a3460 0x7fcb180a5920 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb30106a00 0x7fcb301a4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb30101390 0x7fcb30199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 --2- 172.21.15.12:0/24308447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb301009f0 0x7fcb301991d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 -- 172.21.15.12:0/24308447 >> 172.21.15.12:0/24308447 conn(0x7fcb300fc6b0 msgr2=0x7fcb300fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 -- 172.21.15.12:0/24308447 shutdown_connections 2024-09-19T06:42:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:03.636+0000 7fcb366ba640 1 -- 172.21.15.12:0/24308447 wait complete. 2024-09-19T06:42:05.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:05 smithi016 ceph-mon[34911]: pgmap v61: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2024-09-19T06:42:05.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:05 smithi173 ceph-mon[35349]: pgmap v61: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2024-09-19T06:42:05.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:05 smithi012 ceph-mon[30937]: pgmap v61: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2024-09-19T06:42:05.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 80.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:42:07.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:07 smithi016 ceph-mon[34911]: pgmap v62: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 3.3 MiB/s wr, 448 op/s 2024-09-19T06:42:07.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:07 smithi173 ceph-mon[35349]: pgmap v62: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 3.3 MiB/s wr, 448 op/s 2024-09-19T06:42:07.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:07 smithi012 ceph-mon[30937]: pgmap v62: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 3.3 MiB/s wr, 448 op/s 2024-09-19T06:42:09.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:09 smithi173 ceph-mon[35349]: pgmap v63: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 352 op/s 2024-09-19T06:42:09.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:09 smithi012 ceph-mon[30937]: pgmap v63: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 352 op/s 2024-09-19T06:42:09.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:09 smithi016 ceph-mon[34911]: pgmap v63: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 352 op/s 2024-09-19T06:42:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 85.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:42:11.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:11 smithi173 ceph-mon[35349]: pgmap v64: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-09-19T06:42:11.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:11 smithi012 ceph-mon[30937]: pgmap v64: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-09-19T06:42:11.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:11 smithi016 ceph-mon[34911]: pgmap v64: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-09-19T06:42:13.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:13 smithi173 ceph-mon[35349]: pgmap v65: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 398 KiB/s wr, 65 op/s 2024-09-19T06:42:13.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:13 smithi012 ceph-mon[30937]: pgmap v65: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 398 KiB/s wr, 65 op/s 2024-09-19T06:42:13.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:13 smithi016 ceph-mon[34911]: pgmap v65: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 398 KiB/s wr, 65 op/s 2024-09-19T06:42:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:15 smithi173 ceph-mon[35349]: pgmap v66: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 398 KiB/s wr, 65 op/s 2024-09-19T06:42:15.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:15 smithi012 ceph-mon[30937]: pgmap v66: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 398 KiB/s wr, 65 op/s 2024-09-19T06:42:15.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:15 smithi016 ceph-mon[34911]: pgmap v66: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 398 KiB/s wr, 65 op/s 2024-09-19T06:42:15.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 90.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:42:16.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:42:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.732+0000 7f1265913640 1 -- 172.21.15.12:0/3516763663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12601080f0 msgr2=0x7f126010e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.732+0000 7f1265913640 1 --2- 172.21.15.12:0/3516763663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12601080f0 0x7f126010e9f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1258009900 tx=0x7f125802a410 comp rx=0 tx=0).stop 2024-09-19T06:42:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.733+0000 7f1265913640 1 -- 172.21.15.12:0/3516763663 shutdown_connections 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.733+0000 7f1265913640 1 --2- 172.21.15.12:0/3516763663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12601080f0 0x7f126010e9f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.733+0000 7f1265913640 1 --2- 172.21.15.12:0/3516763663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1260101250 0x7f1260107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.733+0000 7f1265913640 1 --2- 172.21.15.12:0/3516763663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12601008a0 0x7f1260100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.733+0000 7f1265913640 1 -- 172.21.15.12:0/3516763663 >> 172.21.15.12:0/3516763663 conn(0x7f1260075e20 msgr2=0x7f1260076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.733+0000 7f1265913640 1 -- 172.21.15.12:0/3516763663 shutdown_connections 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.733+0000 7f1265913640 1 -- 172.21.15.12:0/3516763663 wait complete. 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.733+0000 7f1265913640 1 Processor -- start 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.733+0000 7f1265913640 1 -- start start 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f1265913640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12601008a0 0x7f12601982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f1265913640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12601080f0 0x7f1260198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f1265913640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f126019cbb0 0x7f126019d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f1265913640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1260111f00 con 0x7f126019cbb0 2024-09-19T06:42:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f1265913640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1260111d80 con 0x7f12601080f0 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f1265913640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1260112080 con 0x7f12601008a0 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f126019cbb0 0x7f126019d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f126019cbb0 0x7f126019d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59074/0 (socket says 172.21.15.12:59074) 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125f7fe640 1 -- 172.21.15.12:0/330045925 learned_addr learned my addr 172.21.15.12:0/330045925 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125effd640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12601008a0 0x7f12601982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125e7fc640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12601080f0 0x7f1260198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125f7fe640 1 -- 172.21.15.12:0/330045925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12601008a0 msgr2=0x7f12601982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125f7fe640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12601008a0 0x7f12601982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125f7fe640 1 -- 172.21.15.12:0/330045925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12601080f0 msgr2=0x7f1260198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125f7fe640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12601080f0 0x7f1260198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125f7fe640 1 -- 172.21.15.12:0/330045925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126019d6a0 con 0x7f126019cbb0 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.734+0000 7f125f7fe640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f126019cbb0 0x7f126019d060 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1258005ab0 tx=0x7f12580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.735+0000 7f1264911640 1 -- 172.21.15.12:0/330045925 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125803f030 con 0x7f126019cbb0 2024-09-19T06:42:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.735+0000 7f1264911640 1 -- 172.21.15.12:0/330045925 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1258003ce0 con 0x7f126019cbb0 2024-09-19T06:42:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.735+0000 7f1265913640 1 -- 172.21.15.12:0/330045925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126019d930 con 0x7f126019cbb0 2024-09-19T06:42:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.735+0000 7f1264911640 1 -- 172.21.15.12:0/330045925 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258035070 con 0x7f126019cbb0 2024-09-19T06:42:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.735+0000 7f1265913640 1 -- 172.21.15.12:0/330045925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12601a5150 con 0x7f126019cbb0 2024-09-19T06:42:16.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.737+0000 7f1264911640 1 -- 172.21.15.12:0/330045925 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1258042030 con 0x7f126019cbb0 2024-09-19T06:42:16.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.737+0000 7f12686a3740 1 Processor -- start 2024-09-19T06:42:16.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.737+0000 7f12686a3740 1 -- start start 2024-09-19T06:42:16.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f12686a3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927a9f0 0x55bfb927add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f12686a3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927b310 0x55bfb9289b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f12686a3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f12686a3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bfb91df2f0 con 0x55bfb928a0c0 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f12686a3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bfb9187270 con 0x55bfb927a9f0 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f12686a3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bfb91db2b0 con 0x55bfb927b310 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f1264911640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f124c0a34e0 0x7f124c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59084/0 (socket says 172.21.15.12:59084) 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125e7fc640 1 -- 172.21.15.12:0/36683684 learned_addr learned my addr 172.21.15.12:0/36683684 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125f7fe640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f124c0a34e0 0x7f124c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125e7fc640 1 --2- 172.21.15.12:0/36683684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927a9f0 0x55bfb927add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125effd640 1 --2- 172.21.15.12:0/36683684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927b310 0x55bfb9289b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f1264911640 1 -- 172.21.15.12:0/330045925 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f12580f0190 con 0x7f126019cbb0 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125e7fc640 1 -- 172.21.15.12:0/36683684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927b310 msgr2=0x55bfb9289b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125e7fc640 1 --2- 172.21.15.12:0/36683684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927b310 0x55bfb9289b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125e7fc640 1 -- 172.21.15.12:0/36683684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927a9f0 msgr2=0x55bfb927add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125e7fc640 1 --2- 172.21.15.12:0/36683684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927a9f0 0x55bfb927add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.738+0000 7f125e7fc640 1 -- 172.21.15.12:0/36683684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfb9186340 con 0x55bfb928a0c0 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.739+0000 7f125f7fe640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f124c0a34e0 0x7f124c0a59a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12580bc090 tx=0x7f12580dc040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.739+0000 7f125e7fc640 1 --2- 172.21.15.12:0/36683684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928c4b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1250014920 tx=0x7f125000c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2660a8fa8f1e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.739+0000 7f1255ffb640 1 -- 172.21.15.12:0/36683684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12500142d0 con 0x55bfb928a0c0 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.739+0000 7f1255ffb640 1 -- 172.21.15.12:0/36683684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f125000fc40 con 0x55bfb928a0c0 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.739+0000 7f1255ffb640 1 -- 172.21.15.12:0/36683684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12500129b0 con 0x55bfb928a0c0 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 -- 172.21.15.12:0/36683684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 msgr2=0x55bfb928c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 --2- 172.21.15.12:0/36683684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928c4b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1250014920 tx=0x7f125000c430 comp rx=0 tx=0).stop 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 -- 172.21.15.12:0/36683684 shutdown_connections 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 --2- 172.21.15.12:0/36683684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928c4b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 --2- 172.21.15.12:0/36683684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927b310 0x55bfb9289b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 --2- 172.21.15.12:0/36683684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927a9f0 0x55bfb927add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 -- 172.21.15.12:0/36683684 >> 172.21.15.12:0/36683684 conn(0x55bfb9277060 msgr2=0x55bfb9277440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 -- 172.21.15.12:0/36683684 shutdown_connections 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 -- 172.21.15.12:0/36683684 wait complete. 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 -- start start 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.740+0000 7f12686a3740 1 Processor -- start 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f12686a3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927a9f0 0x55bfb9287060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f12686a3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 0x55bfb92875a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f12686a3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb9287ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f12686a3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bfb928cd20 con 0x55bfb928a0c0 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f12686a3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bfb9168290 con 0x55bfb927b310 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f12686a3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bfb928cea0 con 0x55bfb927a9f0 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f12686a3740 10 client.0 _ll_register_callbacks cb 0x55bfb9199140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:16.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb9287ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb9287ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59100/0 (socket says 172.21.15.12:59100) 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125e7fc640 1 -- 172.21.15.12:0/193475767 learned_addr learned my addr 172.21.15.12:0/193475767 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125effd640 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 0x55bfb92875a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125e7fc640 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927a9f0 0x55bfb9287060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125e7fc640 1 -- 172.21.15.12:0/193475767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927a9f0 msgr2=0x55bfb9287060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125e7fc640 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927a9f0 0x55bfb9287060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125e7fc640 1 -- 172.21.15.12:0/193475767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 msgr2=0x55bfb92875a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125e7fc640 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 0x55bfb92875a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125e7fc640 1 -- 172.21.15.12:0/193475767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfb8ef2210 con 0x55bfb928a0c0 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f125e7fc640 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb9287ae0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1250001eb0 tx=0x7f1250012590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c81f95340293220 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.741+0000 7f123effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f123effd640 1 -- 172.21.15.12:0/193475767 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12500140d0 con 0x55bfb928a0c0 2024-09-19T06:42:16.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f123effd640 1 -- 172.21.15.12:0/193475767 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f1250014270 con 0x55bfb928a0c0 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f12686a3740 1 -- 172.21.15.12:0/193475767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f125000fc40 con 0x55bfb928a0c0 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f123effd640 1 -- 172.21.15.12:0/193475767 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f125000f730 con 0x55bfb928a0c0 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f12686a3740 10 client.16107 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f12686a3740 1 -- 172.21.15.12:0/193475767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55bfb8fbe620 con 0x55bfb928a0c0 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f123effd640 1 -- 172.21.15.12:0/193475767 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f125000fc40 con 0x55bfb928a0c0 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f123effd640 1 -- 172.21.15.12:0/193475767 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f12500114d0 con 0x55bfb928a0c0 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f12686a3740 10 client.16107 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f12686a3740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f12686a3740 20 client.16107 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f12686a3740 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfb9299fe0 0x55bfb929c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f12686a3740 4 client.16107 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.742+0000 7f12686a3740 1 -- 172.21.15.12:0/193475767 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfb91eca20 con 0x55bfb9299fe0 2024-09-19T06:42:16.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.743+0000 7f125effd640 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfb9299fe0 0x55bfb929c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.743+0000 7f123effd640 10 client.16107 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.743+0000 7f125effd640 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfb9299fe0 0x55bfb929c3d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6a758726ea4f125 server_cookie=ce6a1b00f680b582 in_seq=0 out_seq=0 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f123effd640 1 -- 172.21.15.12:0/193475767 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bfb91eca20 con 0x55bfb9299fe0 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f123effd640 10 client.16107 handle_command_reply: tid=0 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 client.16107 shutdown 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 -- 172.21.15.12:0/193475767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 msgr2=0x55bfb9287ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb9287ae0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1250001eb0 tx=0x7f1250012590 comp rx=0 tx=0).stop 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 -- 172.21.15.12:0/193475767 shutdown_connections 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfb9299fe0 0x55bfb929c3d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb9287ae0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 0x55bfb92875a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f123effd640 0 client.16107 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:16.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 --2- 172.21.15.12:0/193475767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927a9f0 0x55bfb9287060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 -- 172.21.15.12:0/193475767 >> 172.21.15.12:0/193475767 conn(0x55bfb9277060 msgr2=0x55bfb927cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:16.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 -- 172.21.15.12:0/193475767 shutdown_connections 2024-09-19T06:42:16.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 1 -- 172.21.15.12:0/193475767 wait complete. 2024-09-19T06:42:16.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.744+0000 7f12686a3740 20 client.16107 trim_cache size 0 max 16384 2024-09-19T06:42:16.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f12686a3740 1 Processor -- start 2024-09-19T06:42:16.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f12686a3740 1 -- start start 2024-09-19T06:42:16.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f12686a3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb927a9f0 0x55bfb92a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f12686a3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 0x55bfb92a2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f12686a3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb928a0c0 0x55bfb92842a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f12686a3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12601ab820 con 0x55bfb927a9f0 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f12686a3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f12601ad450 con 0x55bfb927b310 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f12686a3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f12601abef0 con 0x55bfb928a0c0 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f125e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb927a9f0 0x55bfb92a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f125e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb927a9f0 0x55bfb92a1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59102/0 (socket says 172.21.15.12:59102) 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f125e7fc640 1 -- 172.21.15.12:0/768849191 learned_addr learned my addr 172.21.15.12:0/768849191 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f125effd640 1 --2- 172.21.15.12:0/768849191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 0x55bfb92a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f125e7fc640 1 -- 172.21.15.12:0/768849191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb928a0c0 msgr2=0x55bfb92842a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f125e7fc640 1 --2- 172.21.15.12:0/768849191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb928a0c0 0x55bfb92842a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f125e7fc640 1 -- 172.21.15.12:0/768849191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 msgr2=0x55bfb92a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f125e7fc640 1 --2- 172.21.15.12:0/768849191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 0x55bfb92a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f125e7fc640 1 -- 172.21.15.12:0/768849191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfb9277fc0 con 0x55bfb927a9f0 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.759+0000 7f125effd640 1 --2- 172.21.15.12:0/768849191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 0x55bfb92a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.760+0000 7f125e7fc640 1 --2- 172.21.15.12:0/768849191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb927a9f0 0x55bfb92a1ac0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1250014860 tx=0x7f1250014890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1ffc8aab7ae01a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.760+0000 7f12557fa640 1 -- 172.21.15.12:0/768849191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125000c8f0 con 0x55bfb927a9f0 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.760+0000 7f12557fa640 1 -- 172.21.15.12:0/768849191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f125000c630 con 0x55bfb927a9f0 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.760+0000 7f12557fa640 1 -- 172.21.15.12:0/768849191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125000f8d0 con 0x55bfb927a9f0 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 -- 172.21.15.12:0/768849191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb927a9f0 msgr2=0x55bfb92a1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 --2- 172.21.15.12:0/768849191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb927a9f0 0x55bfb92a1ac0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1250014860 tx=0x7f1250014890 comp rx=0 tx=0).stop 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 -- 172.21.15.12:0/768849191 shutdown_connections 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 --2- 172.21.15.12:0/768849191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb928a0c0 0x55bfb92842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 --2- 172.21.15.12:0/768849191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927b310 0x55bfb92a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 --2- 172.21.15.12:0/768849191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb927a9f0 0x55bfb92a1ac0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 -- 172.21.15.12:0/768849191 >> 172.21.15.12:0/768849191 conn(0x55bfb9277060 msgr2=0x55bfb9282300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 -- 172.21.15.12:0/768849191 shutdown_connections 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 -- 172.21.15.12:0/768849191 wait complete. 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 -- start start 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 Processor -- start 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927a9f0 0x55bfb9292410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927b310 0x55bfb9292950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12601accc0 con 0x55bfb928a0c0 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f12601ac5f0 con 0x55bfb927a9f0 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.761+0000 7f12686a3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f12601a9800 con 0x55bfb927b310 2024-09-19T06:42:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f12686a3740 10 client.0 _ll_register_callbacks cb 0x7f125000ce90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59116/0 (socket says 172.21.15.12:59116) 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125e7fc640 1 -- 172.21.15.12:0/2376128665 learned_addr learned my addr 172.21.15.12:0/2376128665 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125e7fc640 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927a9f0 0x55bfb9292410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125effd640 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927b310 0x55bfb9292950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125e7fc640 1 -- 172.21.15.12:0/2376128665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927b310 msgr2=0x55bfb9292950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125e7fc640 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927b310 0x55bfb9292950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125e7fc640 1 -- 172.21.15.12:0/2376128665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927a9f0 msgr2=0x55bfb9292410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125e7fc640 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927a9f0 0x55bfb9292410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125e7fc640 1 -- 172.21.15.12:0/2376128665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfb929c830 con 0x55bfb928a0c0 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f125e7fc640 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928d790 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1250000c00 tx=0x7f1250005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1cb87c26b7d9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f123effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f123effd640 1 -- 172.21.15.12:0/2376128665 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125003d040 con 0x55bfb928a0c0 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f123effd640 1 -- 172.21.15.12:0/2376128665 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f1250011650 con 0x55bfb928a0c0 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.762+0000 7f12686a3740 1 -- 172.21.15.12:0/2376128665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f125000c630 con 0x55bfb928a0c0 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f123effd640 1 -- 172.21.15.12:0/2376128665 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f125000f8d0 con 0x55bfb928a0c0 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f12686a3740 10 client.16113 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f12686a3740 1 -- 172.21.15.12:0/2376128665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55bfb93043d0 con 0x55bfb928a0c0 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f123effd640 1 -- 172.21.15.12:0/2376128665 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f125000c630 con 0x55bfb928a0c0 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f123effd640 1 -- 172.21.15.12:0/2376128665 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f1250043070 con 0x55bfb928a0c0 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f12686a3740 10 client.16113 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f12686a3740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f12686a3740 20 client.16113 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f12686a3740 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfb9304a40 0x55bfb9306e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f12686a3740 4 client.16113 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:42:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f12686a3740 1 -- 172.21.15.12:0/2376128665 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bfb91e6d70 con 0x55bfb9304a40 2024-09-19T06:42:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.763+0000 7f125effd640 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfb9304a40 0x55bfb9306e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.764+0000 7f125effd640 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfb9304a40 0x55bfb9306e60 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4d768f1e0fba72d server_cookie=ef5ab6c39bc2a6aa in_seq=0 out_seq=0 2024-09-19T06:42:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.764+0000 7f123effd640 10 client.16113 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f123effd640 1 -- 172.21.15.12:0/2376128665 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bfb91e6d70 con 0x55bfb9304a40 2024-09-19T06:42:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f123effd640 10 client.16113 handle_command_reply: tid=0 2024-09-19T06:42:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 client.16113 shutdown 2024-09-19T06:42:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 -- 172.21.15.12:0/2376128665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 msgr2=0x55bfb928d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928d790 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1250000c00 tx=0x7f1250005970 comp rx=0 tx=0).stop 2024-09-19T06:42:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 -- 172.21.15.12:0/2376128665 shutdown_connections 2024-09-19T06:42:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55bfb9304a40 0x55bfb9306e60 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bfb928a0c0 0x55bfb928d790 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f123effd640 0 client.16113 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bfb927b310 0x55bfb9292950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 --2- 172.21.15.12:0/2376128665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bfb927a9f0 0x55bfb9292410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 -- 172.21.15.12:0/2376128665 >> 172.21.15.12:0/2376128665 conn(0x55bfb9277060 msgr2=0x55bfb92759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 -- 172.21.15.12:0/2376128665 shutdown_connections 2024-09-19T06:42:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.778+0000 7f12686a3740 1 -- 172.21.15.12:0/2376128665 wait complete. 2024-09-19T06:42:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f12686a3740 20 client.16113 trim_cache size 0 max 16384 2024-09-19T06:42:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:42:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:42:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:42:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:42:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 -- 172.21.15.12:0/330045925 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f124c0a34e0 msgr2=0x7f124c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f124c0a34e0 0x7f124c0a59a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12580bc090 tx=0x7f12580dc040 comp rx=0 tx=0).stop 2024-09-19T06:42:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 -- 172.21.15.12:0/330045925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f126019cbb0 msgr2=0x7f126019d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f126019cbb0 0x7f126019d060 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1258005ab0 tx=0x7f12580042f0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 -- 172.21.15.12:0/330045925 shutdown_connections 2024-09-19T06:42:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f126019cbb0 0x7f126019d060 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12601080f0 0x7f1260198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f124c0a34e0 0x7f124c0a59a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 --2- 172.21.15.12:0/330045925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12601008a0 0x7f12601982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 -- 172.21.15.12:0/330045925 >> 172.21.15.12:0/330045925 conn(0x7f1260075e20 msgr2=0x7f12600ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 -- 172.21.15.12:0/330045925 shutdown_connections 2024-09-19T06:42:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:16.779+0000 7f1265913640 1 -- 172.21.15.12:0/330045925 wait complete. 2024-09-19T06:42:16.875 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.352+0000 7ff2c685c640 1 -- 172.21.15.12:0/4183581499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c0106f10 msgr2=0x7ff2c010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.352+0000 7ff2c685c640 1 --2- 172.21.15.12:0/4183581499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c0106f10 0x7ff2c010ea90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009ca0 tx=0x7ff2b802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.352+0000 7ff2c685c640 1 -- 172.21.15.12:0/4183581499 shutdown_connections 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.352+0000 7ff2c685c640 1 --2- 172.21.15.12:0/4183581499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c0106f10 0x7ff2c010ea90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.352+0000 7ff2c685c640 1 --2- 172.21.15.12:0/4183581499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2c0102790 0x7ff2c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.352+0000 7ff2c685c640 1 --2- 172.21.15.12:0/4183581499 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2c0101de0 0x7ff2c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.352+0000 7ff2c685c640 1 -- 172.21.15.12:0/4183581499 >> 172.21.15.12:0/4183581499 conn(0x7ff2c00fd880 msgr2=0x7ff2c00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.352+0000 7ff2c685c640 1 -- 172.21.15.12:0/4183581499 shutdown_connections 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.352+0000 7ff2c685c640 1 -- 172.21.15.12:0/4183581499 wait complete. 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2c685c640 1 Processor -- start 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2c685c640 1 -- start start 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2c685c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c0101de0 0x7ff2c0198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2c685c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2c0102790 0x7ff2c0198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2c685c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2c0106f10 0x7ff2c019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2c685c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0111f70 con 0x7ff2c0101de0 2024-09-19T06:42:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2c685c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0111df0 con 0x7ff2c0102790 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2c685c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01120f0 con 0x7ff2c0106f10 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2bffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c0101de0 0x7ff2c0198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2bffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c0101de0 0x7ff2c0198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59130/0 (socket says 172.21.15.12:59130) 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2bffff640 1 -- 172.21.15.12:0/3084285817 learned_addr learned my addr 172.21.15.12:0/3084285817 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2b7fff640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2c0102790 0x7ff2c0198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2bffff640 1 -- 172.21.15.12:0/3084285817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2c0106f10 msgr2=0x7ff2c019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2c4df9640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2c0106f10 0x7ff2c019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2bffff640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2c0106f10 0x7ff2c019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2bffff640 1 -- 172.21.15.12:0/3084285817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2c0102790 msgr2=0x7ff2c0198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2bffff640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2c0102790 0x7ff2c0198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2bffff640 1 -- 172.21.15.12:0/3084285817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c019d300 con 0x7ff2c0101de0 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.353+0000 7ff2b7fff640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2c0102790 0x7ff2c0198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:17.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.354+0000 7ff2bffff640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c0101de0 0x7ff2c0198350 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000e9f0 tx=0x7ff2b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.354+0000 7ff2bdffb640 1 -- 172.21.15.12:0/3084285817 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000cd80 con 0x7ff2c0101de0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.354+0000 7ff2bdffb640 1 -- 172.21.15.12:0/3084285817 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2b0010910 con 0x7ff2c0101de0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.354+0000 7ff2c685c640 1 -- 172.21.15.12:0/3084285817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c019d5f0 con 0x7ff2c0101de0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.354+0000 7ff2bdffb640 1 -- 172.21.15.12:0/3084285817 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0018990 con 0x7ff2c0101de0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.354+0000 7ff2c685c640 1 -- 172.21.15.12:0/3084285817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c01a4ed0 con 0x7ff2c0101de0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.355+0000 7ff2c685c640 1 -- 172.21.15.12:0/3084285817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c01021c0 con 0x7ff2c0101de0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.356+0000 7ff2bdffb640 1 -- 172.21.15.12:0/3084285817 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff2b0010ac0 con 0x7ff2c0101de0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.357+0000 7ff2bdffb640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff2ac0a3430 0x7ff2ac0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.357+0000 7ff2b7fff640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff2ac0a3430 0x7ff2ac0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.357+0000 7ff2bdffb640 1 -- 172.21.15.12:0/3084285817 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ff2b00d0590 con 0x7ff2c0101de0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.358+0000 7ff2b7fff640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff2ac0a3430 0x7ff2ac0a58f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8005fd0 tx=0x7ff2a80094d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.361+0000 7ff2bdffb640 1 -- 172.21.15.12:0/3084285817 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2b009cef0 con 0x7ff2c0101de0 2024-09-19T06:42:17.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.574+0000 7ff2c685c640 1 -- 172.21.15.12:0/3084285817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2c01996b0 con 0x7ff2c0101de0 2024-09-19T06:42:17.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:17 smithi012 ceph-mon[30937]: pgmap v67: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 427 op/s 2024-09-19T06:42:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.575+0000 7ff2bdffb640 1 -- 172.21.15.12:0/3084285817 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11979 (secure 0 0 0) 0x7ff2b009c7f0 con 0x7ff2c0101de0 2024-09-19T06:42:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:42:17.577 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"btime":"2024-09-19T06:41:24:903521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:41:24.405002+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:42:17.577 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2024-09-19T06:42:17.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 -- 172.21.15.12:0/3084285817 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff2ac0a3430 msgr2=0x7ff2ac0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:17.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff2ac0a3430 0x7ff2ac0a58f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8005fd0 tx=0x7ff2a80094d0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 -- 172.21.15.12:0/3084285817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c0101de0 msgr2=0x7ff2c0198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:17.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c0101de0 0x7ff2c0198350 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000e9f0 tx=0x7ff2b000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 -- 172.21.15.12:0/3084285817 shutdown_connections 2024-09-19T06:42:17.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff2ac0a3430 0x7ff2ac0a58f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2c0106f10 0x7ff2c019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2c0102790 0x7ff2c0198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 --2- 172.21.15.12:0/3084285817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2c0101de0 0x7ff2c0198350 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:17.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 -- 172.21.15.12:0/3084285817 >> 172.21.15.12:0/3084285817 conn(0x7ff2c00fd880 msgr2=0x7ff2c00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:17.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 -- 172.21.15.12:0/3084285817 shutdown_connections 2024-09-19T06:42:17.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:17.577+0000 7ff2c685c640 1 -- 172.21.15.12:0/3084285817 wait complete. 2024-09-19T06:42:17.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:17 smithi173 ceph-mon[35349]: pgmap v67: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 427 op/s 2024-09-19T06:42:17.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:17 smithi016 ceph-mon[34911]: pgmap v67: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 16 MiB/s wr, 427 op/s 2024-09-19T06:42:18.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:18 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3084285817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:42:18.299 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:18 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:18.300 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id c60e7e05 --release --await' 2024-09-19T06:42:18.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id c60e7e05 --release --await 2024-09-19T06:42:18.574 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:18.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:18 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3084285817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:42:18.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:18 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:18.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:18 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3084285817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:42:18.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:18 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.060+0000 7fbfda831640 1 -- 172.21.15.12:0/2803358367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfd4101de0 msgr2=0x7fbfd41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.060+0000 7fbfda831640 1 --2- 172.21.15.12:0/2803358367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfd4101de0 0x7fbfd41021c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009900 tx=0x7fbfc402a410 comp rx=0 tx=0).stop 2024-09-19T06:42:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.060+0000 7fbfda831640 1 -- 172.21.15.12:0/2803358367 shutdown_connections 2024-09-19T06:42:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.060+0000 7fbfda831640 1 --2- 172.21.15.12:0/2803358367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4106f10 0x7fbfd410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.060+0000 7fbfda831640 1 --2- 172.21.15.12:0/2803358367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd4102790 0x7fbfd41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.060+0000 7fbfda831640 1 --2- 172.21.15.12:0/2803358367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfd4101de0 0x7fbfd41021c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.060+0000 7fbfda831640 1 -- 172.21.15.12:0/2803358367 >> 172.21.15.12:0/2803358367 conn(0x7fbfd40fd8c0 msgr2=0x7fbfd40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.060+0000 7fbfda831640 1 -- 172.21.15.12:0/2803358367 shutdown_connections 2024-09-19T06:42:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.060+0000 7fbfda831640 1 -- 172.21.15.12:0/2803358367 wait complete. 2024-09-19T06:42:19.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfda831640 1 Processor -- start 2024-09-19T06:42:19.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfda831640 1 -- start start 2024-09-19T06:42:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfda831640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd4101de0 0x7fbfd40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfda831640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfd4102790 0x7fbfd4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfda831640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4106f10 0x7fbfd4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfda831640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd4111f70 con 0x7fbfd4102790 2024-09-19T06:42:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfda831640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd4111df0 con 0x7fbfd4106f10 2024-09-19T06:42:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfda831640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd41120f0 con 0x7fbfd4101de0 2024-09-19T06:42:19.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfd37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfd4102790 0x7fbfd4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfd37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfd4102790 0x7fbfd4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59158/0 (socket says 172.21.15.12:59158) 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfd37fe640 1 -- 172.21.15.12:0/719852930 learned_addr learned my addr 172.21.15.12:0/719852930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfd8dce640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4106f10 0x7fbfd4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.061+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd4101de0 0x7fbfd40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfd37fe640 1 -- 172.21.15.12:0/719852930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd4101de0 msgr2=0x7fbfd40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd4101de0 0x7fbfd40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfd37fe640 1 -- 172.21.15.12:0/719852930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4106f10 msgr2=0x7fbfd4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4106f10 0x7fbfd4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfd37fe640 1 -- 172.21.15.12:0/719852930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd41a6900 con 0x7fbfd4102790 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfd4102790 0x7fbfd4074a30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800e9f0 tx=0x7fbfc800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfd17fa640 1 -- 172.21.15.12:0/719852930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc800cd80 con 0x7fbfd4102790 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfd17fa640 1 -- 172.21.15.12:0/719852930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfc8005500 con 0x7fbfd4102790 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfda831640 1 -- 172.21.15.12:0/719852930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd41a6bf0 con 0x7fbfd4102790 2024-09-19T06:42:19.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfd17fa640 1 -- 172.21.15.12:0/719852930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8010690 con 0x7fbfd4102790 2024-09-19T06:42:19.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.062+0000 7fbfda831640 1 -- 172.21.15.12:0/719852930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd41a7130 con 0x7fbfd4102790 2024-09-19T06:42:19.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.064+0000 7fbfd17fa640 1 -- 172.21.15.12:0/719852930 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbfc80046c0 con 0x7fbfd4102790 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfdcc0a740 1 Processor -- start 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfdcc0a740 1 -- start start 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53060 0x557000e53440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e5dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 0x557000e60630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557000db8620 con 0x557000e5e240 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557000d5fe50 con 0x557000e53980 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557000db45e0 con 0x557000e53060 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfd17fa640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfbc0a3430 0x7fbfbc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfd3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e5dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfd37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 0x557000e60630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfd3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e5dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:51566/0 (socket says 172.21.15.12:51566) 2024-09-19T06:42:19.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfd8dce640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53060 0x557000e53440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfd3fff640 1 -- 172.21.15.12:0/1937411951 learned_addr learned my addr 172.21.15.12:0/1937411951 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:19.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.065+0000 7fbfd8dce640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfbc0a3430 0x7fbfbc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfd3fff640 1 -- 172.21.15.12:0/1937411951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53060 msgr2=0x557000e53440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/1937411951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53060 0x557000e53440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfd3fff640 1 -- 172.21.15.12:0/1937411951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 msgr2=0x557000e60630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/1937411951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 0x557000e60630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfd3fff640 1 -- 172.21.15.12:0/1937411951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557000d50d40 con 0x557000e53980 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfd17fa640 1 -- 172.21.15.12:0/719852930 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbfc80d0180 con 0x7fbfd4102790 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/1937411951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e5dd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009900 tx=0x7fbfc4005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b4c4e72303404b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfd8dce640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfbc0a3430 0x7fbfbc0a58f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc005fd0 tx=0x7fbfcc009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfba7fc640 1 -- 172.21.15.12:0/1937411951 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4040070 con 0x557000e53980 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfba7fc640 1 -- 172.21.15.12:0/1937411951 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfc4031870 con 0x557000e53980 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.066+0000 7fbfba7fc640 1 -- 172.21.15.12:0/1937411951 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4035040 con 0x557000e53980 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.067+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1937411951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 msgr2=0x557000e5dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.067+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/1937411951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e5dd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009900 tx=0x7fbfc4005be0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.067+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1937411951 shutdown_connections 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.067+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/1937411951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 0x557000e60630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.067+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/1937411951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e5dd00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.067+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/1937411951 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53060 0x557000e53440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.067+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1937411951 >> 172.21.15.12:0/1937411951 conn(0x557000e4f5f0 msgr2=0x557000e4f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.067+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1937411951 shutdown_connections 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.067+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1937411951 wait complete. 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.067+0000 7fbfdcc0a740 1 -- start start 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfdcc0a740 1 Processor -- start 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e5b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 0x557000e5b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e5e240 0x557000e5bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557000e60e10 con 0x557000e53060 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557000d40f10 con 0x557000e5e240 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557000e60f90 con 0x557000e53980 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfdcc0a740 10 client.0 _ll_register_callbacks cb 0x557000d64db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e5b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e5b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59180/0 (socket says 172.21.15.12:59180) 2024-09-19T06:42:19.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd3fff640 1 -- 172.21.15.12:0/414565200 learned_addr learned my addr 172.21.15.12:0/414565200 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 0x557000e5b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd8dce640 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e5e240 0x557000e5bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd3fff640 1 -- 172.21.15.12:0/414565200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 msgr2=0x557000e5b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 0x557000e5b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd3fff640 1 -- 172.21.15.12:0/414565200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e5e240 msgr2=0x557000e5bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:19.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e5e240 0x557000e5bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd3fff640 1 -- 172.21.15.12:0/414565200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557000ac7580 con 0x557000e53060 2024-09-19T06:42:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 0x557000e5b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd8dce640 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e5e240 0x557000e5bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e5b120 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4005940 tx=0x7fbfc4005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70ac5ef4c693c9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.068+0000 7fbfb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:19.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfb37fe640 1 -- 172.21.15.12:0/414565200 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4040030 con 0x557000e53060 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/414565200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfc4031870 con 0x557000e53060 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfb37fe640 1 -- 172.21.15.12:0/414565200 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbfc4004260 con 0x557000e53060 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfb37fe640 1 -- 172.21.15.12:0/414565200 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbfc4056050 con 0x557000e53060 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfdcc0a740 10 client.16131 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/414565200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557000b91960 con 0x557000e53060 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfb37fe640 1 -- 172.21.15.12:0/414565200 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfc4031870 con 0x557000e53060 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfb37fe640 1 -- 172.21.15.12:0/414565200 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fbfc4004750 con 0x557000e53060 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfdcc0a740 10 client.16131 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfdcc0a740 10 client.16131 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfdcc0a740 20 client.16131 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557000e6dc40 0x557000e70030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfdcc0a740 4 client.16131 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.069+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/414565200 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557000dc5b90 con 0x557000e6dc40 2024-09-19T06:42:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.070+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557000e6dc40 0x557000e70030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.070+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557000e6dc40 0x557000e70030 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8121b097111ca0a6 server_cookie=953e7c5d9db63028 in_seq=0 out_seq=0 2024-09-19T06:42:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.070+0000 7fbfb37fe640 10 client.16131 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfb37fe640 1 -- 172.21.15.12:0/414565200 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557000dc5b90 con 0x557000e6dc40 2024-09-19T06:42:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfb37fe640 10 client.16131 handle_command_reply: tid=0 2024-09-19T06:42:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 client.16131 shutdown 2024-09-19T06:42:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/414565200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 msgr2=0x557000e5b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e5b120 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4005940 tx=0x7fbfc4005390 comp rx=0 tx=0).stop 2024-09-19T06:42:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/414565200 shutdown_connections 2024-09-19T06:42:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557000e6dc40 0x557000e70030 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e5e240 0x557000e5bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 0x557000e5b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/414565200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e5b120 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/414565200 >> 172.21.15.12:0/414565200 conn(0x557000e4f5f0 msgr2=0x557000e552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:19.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfb37fe640 0 client.16131 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:19.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/414565200 shutdown_connections 2024-09-19T06:42:19.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/414565200 wait complete. 2024-09-19T06:42:19.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.071+0000 7fbfdcc0a740 20 client.16131 trim_cache size 0 max 16384 2024-09-19T06:42:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.088+0000 7fbfdcc0a740 1 Processor -- start 2024-09-19T06:42:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.088+0000 7fbfdcc0a740 1 -- start start 2024-09-19T06:42:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.088+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53060 0x557000e5d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.088+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 0x557000e75660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.088+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 0x557000e75ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.088+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd41ab8e0 con 0x557000e5e240 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.088+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd41ad510 con 0x557000e53060 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.088+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd41abfb0 con 0x557000e53980 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd8dce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 0x557000e75ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd8dce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 0x557000e75ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59192/0 (socket says 172.21.15.12:59192) 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd8dce640 1 -- 172.21.15.12:0/3685941985 learned_addr learned my addr 172.21.15.12:0/3685941985 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/3685941985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 0x557000e75660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/3685941985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53060 0x557000e5d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd8dce640 1 -- 172.21.15.12:0/3685941985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 msgr2=0x557000e75660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd8dce640 1 --2- 172.21.15.12:0/3685941985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 0x557000e75660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd8dce640 1 -- 172.21.15.12:0/3685941985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53060 msgr2=0x557000e5d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd8dce640 1 --2- 172.21.15.12:0/3685941985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53060 0x557000e5d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd8dce640 1 -- 172.21.15.12:0/3685941985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557000e4f090 con 0x557000e5e240 2024-09-19T06:42:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfd8dce640 1 --2- 172.21.15.12:0/3685941985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 0x557000e75ba0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0097a0 tx=0x7fbfcc008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af51c40b84fcb18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfb9ffb640 1 -- 172.21.15.12:0/3685941985 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc009d80 con 0x557000e5e240 2024-09-19T06:42:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfb9ffb640 1 -- 172.21.15.12:0/3685941985 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfcc036070 con 0x557000e5e240 2024-09-19T06:42:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.089+0000 7fbfb9ffb640 1 -- 172.21.15.12:0/3685941985 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc031d00 con 0x557000e5e240 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/3685941985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 msgr2=0x557000e75ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/3685941985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 0x557000e75ba0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0097a0 tx=0x7fbfcc008000 comp rx=0 tx=0).stop 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/3685941985 shutdown_connections 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/3685941985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e5e240 0x557000e75ba0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/3685941985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e53980 0x557000e75660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/3685941985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53060 0x557000e5d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/3685941985 >> 172.21.15.12:0/3685941985 conn(0x557000e4f5f0 msgr2=0x557000e5c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/3685941985 shutdown_connections 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/3685941985 wait complete. 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 -- start start 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.090+0000 7fbfdcc0a740 1 Processor -- start 2024-09-19T06:42:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e66820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e61b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfdcc0a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e5e240 0x557000e62090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd41acd80 con 0x557000e53060 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd41ac6b0 con 0x557000e53980 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfdcc0a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd41a98c0 con 0x557000e5e240 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfdcc0a740 10 client.0 _ll_register_callbacks cb 0x7fbfc4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e66820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e66820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59204/0 (socket says 172.21.15.12:59204) 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd3fff640 1 -- 172.21.15.12:0/1935547126 learned_addr learned my addr 172.21.15.12:0/1935547126 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e61b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd8dce640 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e5e240 0x557000e62090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd3fff640 1 -- 172.21.15.12:0/1935547126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e5e240 msgr2=0x557000e62090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e5e240 0x557000e62090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd3fff640 1 -- 172.21.15.12:0/1935547126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 msgr2=0x557000e61b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e61b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd3fff640 1 -- 172.21.15.12:0/1935547126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557000e62780 con 0x557000e53060 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e61b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfd3fff640 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e66820 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4004b20 tx=0x7fbfc4031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4940e1275ff99da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.091+0000 7fbfb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfb37fe640 1 -- 172.21.15.12:0/1935547126 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4040050 con 0x557000e53060 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfb37fe640 1 -- 172.21.15.12:0/1935547126 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbfc4004260 con 0x557000e53060 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1935547126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfcc036070 con 0x557000e53060 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfb37fe640 1 -- 172.21.15.12:0/1935547126 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbfc4068050 con 0x557000e53060 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfdcc0a740 10 client.16137 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1935547126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557000ed8550 con 0x557000e53060 2024-09-19T06:42:19.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfb37fe640 1 -- 172.21.15.12:0/1935547126 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfcc036070 con 0x557000e53060 2024-09-19T06:42:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfb37fe640 1 -- 172.21.15.12:0/1935547126 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fbfc4003930 con 0x557000e53060 2024-09-19T06:42:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfdcc0a740 10 client.16137 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfdcc0a740 10 client.16137 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:42:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfdcc0a740 20 client.16137 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557000ed8d20 0x557000edb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfdcc0a740 4 client.16137 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c60e7e05", "release": true, "await": true}] 2024-09-19T06:42:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1935547126 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c60e7e05", "release": true, "await": true}) -- 0x557000dc00a0 con 0x557000ed8d20 2024-09-19T06:42:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.092+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557000ed8d20 0x557000edb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.093+0000 7fbfb37fe640 10 client.16137 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:19.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.093+0000 7fbfd37fe640 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557000ed8d20 0x557000edb140 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c9d0e3a23ae6b6a server_cookie=37a4a05fd3a83820 in_seq=0 out_seq=0 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfb37fe640 1 -- 172.21.15.12:0/1935547126 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557000dc00a0 con 0x557000ed8d20 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfb37fe640 10 client.16137 handle_command_reply: tid=0 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfdcc0a740 1 client.16137 shutdown 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1935547126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 msgr2=0x557000e66820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e66820 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4004b20 tx=0x7fbfc4031920 comp rx=0 tx=0).stop 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1935547126 shutdown_connections 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557000ed8d20 0x557000edb140 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557000e5e240 0x557000e62090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557000e53980 0x557000e61b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfdcc0a740 1 --2- 172.21.15.12:0/1935547126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557000e53060 0x557000e66820 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1935547126 >> 172.21.15.12:0/1935547126 conn(0x557000e4f5f0 msgr2=0x557000e4e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.117+0000 7fbfb37fe640 0 client.16137 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.118+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1935547126 shutdown_connections 2024-09-19T06:42:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.118+0000 7fbfdcc0a740 1 -- 172.21.15.12:0/1935547126 wait complete. 2024-09-19T06:42:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.118+0000 7fbfdcc0a740 20 client.16137 trim_cache size 0 max 16384 2024-09-19T06:42:19.120 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:42:19.120 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 31, 2024-09-19T06:42:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:42:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 12, 2024-09-19T06:42:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:42:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: "c60e7e05": { 2024-09-19T06:42:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 12, 2024-09-19T06:42:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:42:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:42:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:42:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:42:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 140.3, 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:42:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:42:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:42:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:42:19.123 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:42:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.120+0000 7fbfda831640 1 -- 172.21.15.12:0/719852930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfbc0a3430 msgr2=0x7fbfbc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.120+0000 7fbfda831640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfbc0a3430 0x7fbfbc0a58f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc005fd0 tx=0x7fbfcc009500 comp rx=0 tx=0).stop 2024-09-19T06:42:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.120+0000 7fbfda831640 1 -- 172.21.15.12:0/719852930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfd4102790 msgr2=0x7fbfd4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.120+0000 7fbfda831640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfd4102790 0x7fbfd4074a30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800e9f0 tx=0x7fbfc800edf0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.120+0000 7fbfda831640 1 -- 172.21.15.12:0/719852930 shutdown_connections 2024-09-19T06:42:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.120+0000 7fbfda831640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4106f10 0x7fbfd4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.120+0000 7fbfda831640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbfd4102790 0x7fbfd4074a30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.120+0000 7fbfda831640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbfbc0a3430 0x7fbfbc0a58f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.120+0000 7fbfda831640 1 --2- 172.21.15.12:0/719852930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfd4101de0 0x7fbfd40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.120+0000 7fbfda831640 1 -- 172.21.15.12:0/719852930 >> 172.21.15.12:0/719852930 conn(0x7fbfd40fd8c0 msgr2=0x7fbfd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.121+0000 7fbfda831640 1 -- 172.21.15.12:0/719852930 shutdown_connections 2024-09-19T06:42:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:19.121+0000 7fbfda831640 1 -- 172.21.15.12:0/719852930 wait complete. 2024-09-19T06:42:19.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:19 smithi012 ceph-mon[30937]: pgmap v68: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 367 op/s 2024-09-19T06:42:19.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:19.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:19.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:19 smithi016 ceph-mon[34911]: pgmap v68: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 367 op/s 2024-09-19T06:42:19.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:19.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:19.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:19 smithi173 ceph-mon[35349]: pgmap v68: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 367 op/s 2024-09-19T06:42:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:19.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:19.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:42:19.998 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c60e7e05', total seconds elapsed: 23.8 2024-09-19T06:42:20.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 95.0 s, 760.3 tps, lat 558.170 ms stddev 3122.342 2024-09-19T06:42:21.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:21 smithi012 ceph-mon[30937]: pgmap v69: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 380 op/s 2024-09-19T06:42:21.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:21 smithi016 ceph-mon[34911]: pgmap v69: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 380 op/s 2024-09-19T06:42:21.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:21 smithi173 ceph-mon[35349]: pgmap v69: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 380 op/s 2024-09-19T06:42:23.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:23 smithi012 ceph-mon[30937]: pgmap v70: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 374 op/s 2024-09-19T06:42:23.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:23 smithi016 ceph-mon[34911]: pgmap v70: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 374 op/s 2024-09-19T06:42:23.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:23 smithi173 ceph-mon[35349]: pgmap v70: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 374 op/s 2024-09-19T06:42:24.936 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:42:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:25.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:25 smithi012 ceph-mon[30937]: pgmap v71: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 374 op/s 2024-09-19T06:42:25.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:25 smithi016 ceph-mon[34911]: pgmap v71: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 374 op/s 2024-09-19T06:42:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 100.0 s, 5717.9 tps, lat 17.450 ms stddev 18.453 2024-09-19T06:42:25.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:25 smithi173 ceph-mon[35349]: pgmap v71: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 374 op/s 2024-09-19T06:42:25.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.948+0000 7f54857b8640 1 -- 172.21.15.12:0/3491046701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54801068f0 msgr2=0x7f5480106cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:25.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.948+0000 7f54857b8640 1 --2- 172.21.15.12:0/3491046701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54801068f0 0x7f5480106cd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5470009860 tx=0x7f547002a340 comp rx=0 tx=0).stop 2024-09-19T06:42:25.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.949+0000 7f54857b8640 1 -- 172.21.15.12:0/3491046701 shutdown_connections 2024-09-19T06:42:25.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.949+0000 7f54857b8640 1 --2- 172.21.15.12:0/3491046701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5480101290 0x7f548010d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.949+0000 7f54857b8640 1 --2- 172.21.15.12:0/3491046701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54801008f0 0x7f5480100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.949+0000 7f54857b8640 1 --2- 172.21.15.12:0/3491046701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54801068f0 0x7f5480106cd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.949+0000 7f54857b8640 1 -- 172.21.15.12:0/3491046701 >> 172.21.15.12:0/3491046701 conn(0x7f54800fc630 msgr2=0x7f54800fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.949+0000 7f54857b8640 1 -- 172.21.15.12:0/3491046701 shutdown_connections 2024-09-19T06:42:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.949+0000 7f54857b8640 1 -- 172.21.15.12:0/3491046701 wait complete. 2024-09-19T06:42:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.950+0000 7f54857b8640 1 Processor -- start 2024-09-19T06:42:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.950+0000 7f54857b8640 1 -- start start 2024-09-19T06:42:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.951+0000 7f54857b8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54801008f0 0x7f5480116090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.951+0000 7f54857b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5480101290 0x7f54801165d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.951+0000 7f54857b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54801068f0 0x7f54801111b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.952+0000 7f54857b8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f548010fb90 con 0x7f54801068f0 2024-09-19T06:42:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.952+0000 7f54857b8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f548010fa10 con 0x7f5480101290 2024-09-19T06:42:25.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.952+0000 7f54857b8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f548010fd10 con 0x7f54801008f0 2024-09-19T06:42:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.952+0000 7f547e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5480101290 0x7f54801165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.952+0000 7f547f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54801068f0 0x7f54801111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.952+0000 7f547e7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5480101290 0x7f54801165d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34012/0 (socket says 172.21.15.12:34012) 2024-09-19T06:42:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.952+0000 7f547e7fc640 1 -- 172.21.15.12:0/3808306484 learned_addr learned my addr 172.21.15.12:0/3808306484 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.952+0000 7f547e7fc640 1 -- 172.21.15.12:0/3808306484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54801008f0 msgr2=0x7f5480116090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.952+0000 7f547effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54801008f0 0x7f5480116090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.953+0000 7f547e7fc640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54801008f0 0x7f5480116090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.953+0000 7f547e7fc640 1 -- 172.21.15.12:0/3808306484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54801068f0 msgr2=0x7f54801111b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.953+0000 7f547e7fc640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54801068f0 0x7f54801111b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.953+0000 7f547e7fc640 1 -- 172.21.15.12:0/3808306484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5480111a70 con 0x7f5480101290 2024-09-19T06:42:25.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.953+0000 7f547effd640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54801008f0 0x7f5480116090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:25.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.953+0000 7f547f7fe640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54801068f0 0x7f54801111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:25.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.955+0000 7f547e7fc640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5480101290 0x7f54801165d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f547400e9f0 tx=0x7f547400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:25.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.960+0000 7f5467fff640 1 -- 172.21.15.12:0/3808306484 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547400cd80 con 0x7f5480101290 2024-09-19T06:42:25.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.960+0000 7f54857b8640 1 -- 172.21.15.12:0/3808306484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5480111d60 con 0x7f5480101290 2024-09-19T06:42:25.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.960+0000 7f54857b8640 1 -- 172.21.15.12:0/3808306484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5480119f70 con 0x7f5480101290 2024-09-19T06:42:25.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.960+0000 7f5467fff640 1 -- 172.21.15.12:0/3808306484 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5474010910 con 0x7f5480101290 2024-09-19T06:42:25.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.961+0000 7f5467fff640 1 -- 172.21.15.12:0/3808306484 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474018990 con 0x7f5480101290 2024-09-19T06:42:25.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.963+0000 7f5487b91740 1 Processor -- start 2024-09-19T06:42:25.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.964+0000 7f5487b91740 1 -- start start 2024-09-19T06:42:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.964+0000 7f5487b91740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a1877ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.964+0000 7f5487b91740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a1877ef90 0x558a18789310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.964+0000 7f5487b91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a18789850 0x558a1878bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.964+0000 7f5487b91740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a186e42e0 con 0x558a1877e670 2024-09-19T06:42:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.964+0000 7f5487b91740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558a1868bce0 con 0x558a1877ef90 2024-09-19T06:42:25.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.964+0000 7f5487b91740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558a186e02a0 con 0x558a18789850 2024-09-19T06:42:25.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.965+0000 7f547e7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a18789850 0x558a1878bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.965+0000 7f547e7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a18789850 0x558a1878bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:37116/0 (socket says 172.21.15.12:37116) 2024-09-19T06:42:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.965+0000 7f547e7fc640 1 -- 172.21.15.12:0/2870185 learned_addr learned my addr 172.21.15.12:0/2870185 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.966+0000 7f547effd640 1 --2- 172.21.15.12:0/2870185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a1877ef90 0x558a18789310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.966+0000 7f547e7fc640 1 -- 172.21.15.12:0/2870185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a1877ef90 msgr2=0x558a18789310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.966+0000 7f547e7fc640 1 --2- 172.21.15.12:0/2870185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a1877ef90 0x558a18789310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.966+0000 7f547f7fe640 1 --2- 172.21.15.12:0/2870185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a1877ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.966+0000 7f547e7fc640 1 -- 172.21.15.12:0/2870185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 msgr2=0x558a1877ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.967+0000 7f547e7fc640 1 --2- 172.21.15.12:0/2870185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a1877ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.967+0000 7f547e7fc640 1 -- 172.21.15.12:0/2870185 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a18670440 con 0x558a18789850 2024-09-19T06:42:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.969+0000 7f547f7fe640 1 --2- 172.21.15.12:0/2870185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a1877ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.970+0000 7f547e7fc640 1 --2- 172.21.15.12:0/2870185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a18789850 0x558a1878bc40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5474009740 tx=0x7f5474010430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa475b80bc75f07f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.970+0000 7f5467fff640 1 -- 172.21.15.12:0/3808306484 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5474010c80 con 0x7f5480101290 2024-09-19T06:42:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.972+0000 7f5467fff640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54680a3450 0x7f54680a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.973+0000 7f547f7fe640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54680a3450 0x7f54680a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.974+0000 7f54657fa640 1 -- 172.21.15.12:0/2870185 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54740d6030 con 0x558a18789850 2024-09-19T06:42:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.974+0000 7f54657fa640 1 -- 172.21.15.12:0/2870185 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54740d2bb0 con 0x558a18789850 2024-09-19T06:42:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.974+0000 7f5467fff640 1 -- 172.21.15.12:0/3808306484 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f54740d11b0 con 0x7f5480101290 2024-09-19T06:42:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.974+0000 7f54657fa640 1 -- 172.21.15.12:0/2870185 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5474099870 con 0x558a18789850 2024-09-19T06:42:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.975+0000 7f5487b91740 1 -- 172.21.15.12:0/2870185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a18789850 msgr2=0x558a1878bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.975+0000 7f5487b91740 1 --2- 172.21.15.12:0/2870185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a18789850 0x558a1878bc40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5474009740 tx=0x7f5474010430 comp rx=0 tx=0).stop 2024-09-19T06:42:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.975+0000 7f547f7fe640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54680a3450 0x7f54680a5910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5480105f70 tx=0x7f54780095c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.977+0000 7f5487b91740 1 -- 172.21.15.12:0/2870185 shutdown_connections 2024-09-19T06:42:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.977+0000 7f5487b91740 1 --2- 172.21.15.12:0/2870185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a18789850 0x558a1878bc40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.977+0000 7f5487b91740 1 --2- 172.21.15.12:0/2870185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a1877ef90 0x558a18789310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.977+0000 7f5487b91740 1 --2- 172.21.15.12:0/2870185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a1877ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.977+0000 7f5487b91740 1 -- 172.21.15.12:0/2870185 >> 172.21.15.12:0/2870185 conn(0x558a1877ac00 msgr2=0x558a1877afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.977+0000 7f5487b91740 1 -- 172.21.15.12:0/2870185 shutdown_connections 2024-09-19T06:42:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.979+0000 7f5487b91740 1 -- 172.21.15.12:0/2870185 wait complete. 2024-09-19T06:42:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.980+0000 7f5487b91740 1 -- start start 2024-09-19T06:42:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.980+0000 7f5487b91740 1 Processor -- start 2024-09-19T06:42:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.980+0000 7f5487b91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877e670 0x558a187890b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f5487b91740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877ef90 0x558a18786360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f5487b91740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187868a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f547effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877e670 0x558a187890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f547effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877e670 0x558a187890b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:37126/0 (socket says 172.21.15.12:37126) 2024-09-19T06:42:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f547effd640 1 -- 172.21.15.12:0/561001010 learned_addr learned my addr 172.21.15.12:0/561001010 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f547f7fe640 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a1878c420 con 0x558a1877ef90 2024-09-19T06:42:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558a1869f050 con 0x558a18789850 2024-09-19T06:42:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558a1878c5a0 con 0x558a1877e670 2024-09-19T06:42:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f5487b91740 10 client.0 _ll_register_callbacks cb 0x558a186df160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f547f7fe640 1 -- 172.21.15.12:0/561001010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877e670 msgr2=0x558a187890b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.981+0000 7f547f7fe640 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877e670 0x558a187890b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.982+0000 7f547f7fe640 1 -- 172.21.15.12:0/561001010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877ef90 msgr2=0x558a18786360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:42:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.982+0000 7f547f7fe640 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877ef90 0x558a18786360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.982+0000 7f547f7fe640 1 -- 172.21.15.12:0/561001010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a184553c0 con 0x558a18789850 2024-09-19T06:42:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.982+0000 7f547f7fe640 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187868a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5480116cc0 tx=0x7f5478004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98d98acb80eaa9a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.982+0000 7f5462ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:42:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.982+0000 7f5462ff5640 1 -- 172.21.15.12:0/561001010 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478003970 con 0x558a18789850 2024-09-19T06:42:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.982+0000 7f5462ff5640 1 -- 172.21.15.12:0/561001010 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5478003b10 con 0x558a18789850 2024-09-19T06:42:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.983+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54740d2bb0 con 0x558a18789850 2024-09-19T06:42:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.983+0000 7f5462ff5640 1 -- 172.21.15.12:0/561001010 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5478003d10 con 0x558a18789850 2024-09-19T06:42:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.983+0000 7f5487b91740 10 client.25694 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.983+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558a18797d80 con 0x558a18789850 2024-09-19T06:42:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.985+0000 7f5462ff5640 1 -- 172.21.15.12:0/561001010 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54740d2bb0 con 0x558a18789850 2024-09-19T06:42:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.985+0000 7f5462ff5640 1 -- 172.21.15.12:0/561001010 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f547800b040 con 0x558a18789850 2024-09-19T06:42:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.985+0000 7f5487b91740 10 client.25694 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.985+0000 7f5487b91740 10 client.25694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.985+0000 7f5487b91740 20 client.25694 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.985+0000 7f5487b91740 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a18799760 0x558a1879bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.985+0000 7f5487b91740 4 client.25694 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.985+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a186f1850 con 0x558a18799760 2024-09-19T06:42:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.985+0000 7f547effd640 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a18799760 0x558a1879bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.986+0000 7f547effd640 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a18799760 0x558a1879bc20 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b59a57f7f9a41d28 server_cookie=75af6eff4a849551 in_seq=0 out_seq=0 2024-09-19T06:42:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.986+0000 7f5462ff5640 10 client.25694 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.987+0000 7f5462ff5640 1 -- 172.21.15.12:0/561001010 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a186f1850 con 0x558a18799760 2024-09-19T06:42:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.987+0000 7f5462ff5640 10 client.25694 handle_command_reply: tid=0 2024-09-19T06:42:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.987+0000 7f5487b91740 1 client.25694 shutdown 2024-09-19T06:42:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.987+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 msgr2=0x558a187868a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.987+0000 7f5487b91740 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187868a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5480116cc0 tx=0x7f5478004ab0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.987+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 shutdown_connections 2024-09-19T06:42:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.987+0000 7f5487b91740 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a18799760 0x558a1879bc20 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.987+0000 7f5487b91740 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187868a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.987+0000 7f5487b91740 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877ef90 0x558a18786360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.987+0000 7f5487b91740 1 --2- 172.21.15.12:0/561001010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877e670 0x558a187890b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.988+0000 7f5462ff5640 0 client.25694 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.988+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 >> 172.21.15.12:0/561001010 conn(0x558a1877ac00 msgr2=0x558a18780930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.988+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 shutdown_connections 2024-09-19T06:42:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.988+0000 7f5487b91740 1 -- 172.21.15.12:0/561001010 wait complete. 2024-09-19T06:42:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:25.988+0000 7f5487b91740 20 client.25694 trim_cache size 0 max 16384 2024-09-19T06:42:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.016+0000 7f5487b91740 1 Processor -- start 2024-09-19T06:42:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.017+0000 7f5487b91740 1 -- start start 2024-09-19T06:42:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.017+0000 7f5487b91740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a1877afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.017+0000 7f5487b91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877ef90 0x558a18781970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.017+0000 7f5487b91740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187a1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.017+0000 7f547e7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877ef90 0x558a18781970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f547e7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877ef90 0x558a18781970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:37142/0 (socket says 172.21.15.12:37142) 2024-09-19T06:42:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f547f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f547f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34048/0 (socket says 172.21.15.12:34048) 2024-09-19T06:42:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f547e7fc640 1 -- 172.21.15.12:0/3009866728 learned_addr learned my addr 172.21.15.12:0/3009866728 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:26.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f5487b91740 1 -- 172.21.15.12:0/3009866728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f546c00ea20 con 0x558a1877e670 2024-09-19T06:42:26.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f5487b91740 1 -- 172.21.15.12:0/3009866728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f546c010650 con 0x558a18789850 2024-09-19T06:42:26.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f5487b91740 1 -- 172.21.15.12:0/3009866728 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f546c00f0f0 con 0x558a1877ef90 2024-09-19T06:42:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f547f7fe640 1 -- 172.21.15.12:0/3009866728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877ef90 msgr2=0x558a18781970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f547f7fe640 1 --2- 172.21.15.12:0/3009866728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877ef90 0x558a18781970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f547f7fe640 1 -- 172.21.15.12:0/3009866728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 msgr2=0x558a1877afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f547f7fe640 1 --2- 172.21.15.12:0/3009866728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a1877afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.018+0000 7f547f7fe640 1 -- 172.21.15.12:0/3009866728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a18785310 con 0x558a18789850 2024-09-19T06:42:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.019+0000 7f547f7fe640 1 --2- 172.21.15.12:0/3009866728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187a1530 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f547801a8d0 tx=0x7f5478000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9414172895aacea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.019+0000 7f5464ff9640 1 -- 172.21.15.12:0/3009866728 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547801a470 con 0x558a18789850 2024-09-19T06:42:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.019+0000 7f5464ff9640 1 -- 172.21.15.12:0/3009866728 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f547801a610 con 0x558a18789850 2024-09-19T06:42:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.019+0000 7f5464ff9640 1 -- 172.21.15.12:0/3009866728 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478004650 con 0x558a18789850 2024-09-19T06:42:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.020+0000 7f5487b91740 1 -- 172.21.15.12:0/3009866728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 msgr2=0x558a187a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.020+0000 7f5487b91740 1 --2- 172.21.15.12:0/3009866728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187a1530 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f547801a8d0 tx=0x7f5478000f40 comp rx=0 tx=0).stop 2024-09-19T06:42:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.020+0000 7f5487b91740 1 -- 172.21.15.12:0/3009866728 shutdown_connections 2024-09-19T06:42:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.020+0000 7f5487b91740 1 --2- 172.21.15.12:0/3009866728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a187a1530 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.020+0000 7f5487b91740 1 --2- 172.21.15.12:0/3009866728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877ef90 0x558a18781970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.020+0000 7f5487b91740 1 --2- 172.21.15.12:0/3009866728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a1877afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.021+0000 7f5487b91740 1 -- 172.21.15.12:0/3009866728 >> 172.21.15.12:0/3009866728 conn(0x558a1877ac00 msgr2=0x558a18781260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:26.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.021+0000 7f5487b91740 1 -- 172.21.15.12:0/3009866728 shutdown_connections 2024-09-19T06:42:26.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.021+0000 7f5487b91740 1 -- 172.21.15.12:0/3009866728 wait complete. 2024-09-19T06:42:26.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.021+0000 7f5487b91740 1 -- start start 2024-09-19T06:42:26.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f5487b91740 1 Processor -- start 2024-09-19T06:42:26.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f5487b91740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a18791a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f5487b91740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877ef90 0x558a18791fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f5487b91740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a18782b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f5487b91740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f546c00fec0 con 0x558a1877e670 2024-09-19T06:42:26.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f5487b91740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f546c00f7f0 con 0x558a18789850 2024-09-19T06:42:26.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f5487b91740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f546c00ca00 con 0x558a1877ef90 2024-09-19T06:42:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f547f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a18782b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f547f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a18782b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34052/0 (socket says 172.21.15.12:34052) 2024-09-19T06:42:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f547f7fe640 1 -- 172.21.15.12:0/2664852198 learned_addr learned my addr 172.21.15.12:0/2664852198 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.022+0000 7f5487b91740 10 client.0 _ll_register_callbacks cb 0x7f547800e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.023+0000 7f547f7fe640 1 -- 172.21.15.12:0/2664852198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877ef90 msgr2=0x558a18791fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:42:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.023+0000 7f547f7fe640 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877ef90 0x558a18791fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.023+0000 7f547f7fe640 1 -- 172.21.15.12:0/2664852198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 msgr2=0x558a18791a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.023+0000 7f547f7fe640 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a18791a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.023+0000 7f547f7fe640 1 -- 172.21.15.12:0/2664852198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a18789420 con 0x558a18789850 2024-09-19T06:42:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.023+0000 7f547f7fe640 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a18782b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5478009670 tx=0x7f547801acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47a200b89b33eee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.023+0000 7f5462ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:42:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.023+0000 7f5462ff5640 1 -- 172.21.15.12:0/2664852198 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547801a470 con 0x558a18789850 2024-09-19T06:42:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.023+0000 7f5462ff5640 1 -- 172.21.15.12:0/2664852198 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f54780055e0 con 0x558a18789850 2024-09-19T06:42:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.024+0000 7f5487b91740 1 -- 172.21.15.12:0/2664852198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f547801a610 con 0x558a18789850 2024-09-19T06:42:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.024+0000 7f5462ff5640 1 -- 172.21.15.12:0/2664852198 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f54780057e0 con 0x558a18789850 2024-09-19T06:42:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.024+0000 7f5487b91740 10 client.25700 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.024+0000 7f5487b91740 1 -- 172.21.15.12:0/2664852198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558a18814da0 con 0x558a18789850 2024-09-19T06:42:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.024+0000 7f5462ff5640 1 -- 172.21.15.12:0/2664852198 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f547803b070 con 0x558a18789850 2024-09-19T06:42:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.025+0000 7f5462ff5640 1 -- 172.21.15.12:0/2664852198 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f5478035070 con 0x558a18789850 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.025+0000 7f5487b91740 10 client.25700 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.025+0000 7f5487b91740 10 client.25700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.025+0000 7f5487b91740 20 client.25700 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.025+0000 7f5487b91740 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a188154c0 0x558a188178e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.025+0000 7f5487b91740 4 client.25700 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.025+0000 7f5487b91740 1 -- 172.21.15.12:0/2664852198 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f547801a610 con 0x558a188154c0 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.026+0000 7f547effd640 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a188154c0 0x558a188178e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.026+0000 7f547effd640 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a188154c0 0x558a188178e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=514e3e7c8a991f7c server_cookie=13a4e3af8e2cf508 in_seq=0 out_seq=0 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.026+0000 7f5462ff5640 10 client.25700 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.026+0000 7f5462ff5640 1 -- 172.21.15.12:0/2664852198 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f547801a610 con 0x558a188154c0 2024-09-19T06:42:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.026+0000 7f5462ff5640 10 client.25700 handle_command_reply: tid=0 2024-09-19T06:42:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.026+0000 7f5487b91740 1 client.25700 shutdown 2024-09-19T06:42:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.027+0000 7f5487b91740 1 -- 172.21.15.12:0/2664852198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 msgr2=0x558a18782b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.027+0000 7f5487b91740 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a18782b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5478009670 tx=0x7f547801acd0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.027+0000 7f5487b91740 1 -- 172.21.15.12:0/2664852198 shutdown_connections 2024-09-19T06:42:26.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.027+0000 7f5487b91740 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a188154c0 0x558a188178e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.027+0000 7f5487b91740 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a18789850 0x558a18782b90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.027+0000 7f5487b91740 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a1877ef90 0x558a18791fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.027+0000 7f5487b91740 1 --2- 172.21.15.12:0/2664852198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a1877e670 0x558a18791a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.027+0000 7f5487b91740 1 -- 172.21.15.12:0/2664852198 >> 172.21.15.12:0/2664852198 conn(0x558a1877ac00 msgr2=0x558a18779500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:26.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.028+0000 7f5462ff5640 0 client.25700 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:26.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.028+0000 7f5487b91740 1 -- 172.21.15.12:0/2664852198 shutdown_connections 2024-09-19T06:42:26.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.028+0000 7f5487b91740 1 -- 172.21.15.12:0/2664852198 wait complete. 2024-09-19T06:42:26.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.028+0000 7f5487b91740 20 client.25700 trim_cache size 0 max 16384 2024-09-19T06:42:26.034 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:42:26.034 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:42:26.034 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:42:26.034 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:42:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.029+0000 7f54857b8640 1 -- 172.21.15.12:0/3808306484 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54680a3450 msgr2=0x7f54680a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.029+0000 7f54857b8640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54680a3450 0x7f54680a5910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5480105f70 tx=0x7f54780095c0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.029+0000 7f54857b8640 1 -- 172.21.15.12:0/3808306484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5480101290 msgr2=0x7f54801165d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.029+0000 7f54857b8640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5480101290 0x7f54801165d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f547400e9f0 tx=0x7f547400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.029+0000 7f54857b8640 1 -- 172.21.15.12:0/3808306484 shutdown_connections 2024-09-19T06:42:26.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.029+0000 7f54857b8640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54801068f0 0x7f54801111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.029+0000 7f54857b8640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5480101290 0x7f54801165d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.029+0000 7f54857b8640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54680a3450 0x7f54680a5910 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.029+0000 7f54857b8640 1 --2- 172.21.15.12:0/3808306484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54801008f0 0x7f5480116090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:26.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.029+0000 7f54857b8640 1 -- 172.21.15.12:0/3808306484 >> 172.21.15.12:0/3808306484 conn(0x7f54800fc630 msgr2=0x7f54800fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:26.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.030+0000 7f54857b8640 1 -- 172.21.15.12:0/3808306484 shutdown_connections 2024-09-19T06:42:26.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:26.030+0000 7f54857b8640 1 -- 172.21.15.12:0/3808306484 wait complete. 2024-09-19T06:42:27.222 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:42:27.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:42:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:27 smithi012 ceph-mon[30937]: pgmap v72: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 MiB/s wr, 1.12k op/s 2024-09-19T06:42:27.682 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:27.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:27 smithi016 ceph-mon[34911]: pgmap v72: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 MiB/s wr, 1.12k op/s 2024-09-19T06:42:27.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:27 smithi173 ceph-mon[35349]: pgmap v72: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 32 MiB/s wr, 1.12k op/s 2024-09-19T06:42:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.235+0000 7faaae579640 1 -- 172.21.15.12:0/78994158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faaa8113940 msgr2=0x7faaa8115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.235+0000 7faaae579640 1 --2- 172.21.15.12:0/78994158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faaa8113940 0x7faaa8115d30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faa98009900 tx=0x7faa9802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.235+0000 7faaae579640 1 -- 172.21.15.12:0/78994158 shutdown_connections 2024-09-19T06:42:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.235+0000 7faaae579640 1 --2- 172.21.15.12:0/78994158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faaa8113940 0x7faaa8115d30 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.235+0000 7faaae579640 1 --2- 172.21.15.12:0/78994158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faaa810ae80 0x7faaa8113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.235+0000 7faaae579640 1 --2- 172.21.15.12:0/78994158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaa810a560 0x7faaa810a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.235+0000 7faaae579640 1 -- 172.21.15.12:0/78994158 >> 172.21.15.12:0/78994158 conn(0x7faaa806e140 msgr2=0x7faaa806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:28.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.236+0000 7faaae579640 1 -- 172.21.15.12:0/78994158 shutdown_connections 2024-09-19T06:42:28.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.236+0000 7faaae579640 1 -- 172.21.15.12:0/78994158 wait complete. 2024-09-19T06:42:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.237+0000 7faaae579640 1 Processor -- start 2024-09-19T06:42:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.238+0000 7faaae579640 1 -- start start 2024-09-19T06:42:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.238+0000 7faaae579640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faaa810a560 0x7faaa8111d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.238+0000 7faaae579640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaa810ae80 0x7faaa8112270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.238+0000 7faaa7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faaa810a560 0x7faaa8111d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.238+0000 7faaae579640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faaa8113940 0x7faaa81b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaa7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faaa810a560 0x7faaa8111d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57656/0 (socket says 172.21.15.12:57656) 2024-09-19T06:42:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaa7fff640 1 -- 172.21.15.12:0/825162375 learned_addr learned my addr 172.21.15.12:0/825162375 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faaa8117fe0 con 0x7faaa810a560 2024-09-19T06:42:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faaa8117e60 con 0x7faaa810ae80 2024-09-19T06:42:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faaa8118160 con 0x7faaa8113940 2024-09-19T06:42:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaa77fe640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaa810ae80 0x7faaa8112270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaacb16640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faaa8113940 0x7faaa81b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaa7fff640 1 -- 172.21.15.12:0/825162375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faaa8113940 msgr2=0x7faaa81b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaa7fff640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faaa8113940 0x7faaa81b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaa7fff640 1 -- 172.21.15.12:0/825162375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaa810ae80 msgr2=0x7faaa8112270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaa7fff640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaa810ae80 0x7faaa8112270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaa7fff640 1 -- 172.21.15.12:0/825162375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa81b3290 con 0x7faaa810a560 2024-09-19T06:42:28.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.239+0000 7faaa77fe640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaa810ae80 0x7faaa8112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:28.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.240+0000 7faaa7fff640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faaa810a560 0x7faaa8111d30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7faaa000db80 tx=0x7faaa000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:28.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.240+0000 7faaa57fa640 1 -- 172.21.15.12:0/825162375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa0017070 con 0x7faaa810a560 2024-09-19T06:42:28.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.240+0000 7faaa57fa640 1 -- 172.21.15.12:0/825162375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaa0003b70 con 0x7faaa810a560 2024-09-19T06:42:28.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.240+0000 7faaa57fa640 1 -- 172.21.15.12:0/825162375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa00106c0 con 0x7faaa810a560 2024-09-19T06:42:28.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.240+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa81b3580 con 0x7faaa810a560 2024-09-19T06:42:28.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.240+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa81b3a70 con 0x7faaa810a560 2024-09-19T06:42:28.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.243+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa8112ff0 con 0x7faaa810a560 2024-09-19T06:42:28.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.245+0000 7faaa57fa640 1 -- 172.21.15.12:0/825162375 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7faaa0004020 con 0x7faaa810a560 2024-09-19T06:42:28.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.246+0000 7faaa57fa640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa900a3500 0x7faa900a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:28.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.246+0000 7faaa57fa640 1 -- 172.21.15.12:0/825162375 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7faaa00cfa60 con 0x7faaa810a560 2024-09-19T06:42:28.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.250+0000 7faaa77fe640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa900a3500 0x7faa900a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:28.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.250+0000 7faaa77fe640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa900a3500 0x7faa900a59c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faaa8113550 tx=0x7faa9c00f040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:28.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.254+0000 7faaa57fa640 1 -- 172.21.15.12:0/825162375 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faaa0020070 con 0x7faaa810a560 2024-09-19T06:42:28.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.663+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaa810b4a0 con 0x7faaa810a560 2024-09-19T06:42:28.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.664+0000 7faaa57fa640 1 -- 172.21.15.12:0/825162375 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11979 (secure 0 0 0) 0x7faaa009c360 con 0x7faaa810a560 2024-09-19T06:42:28.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:42:28.666 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"btime":"2024-09-19T06:41:24:903521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:41:24.405002+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:42:28.667 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2024-09-19T06:42:28.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa900a3500 msgr2=0x7faa900a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa900a3500 0x7faa900a59c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faaa8113550 tx=0x7faa9c00f040 comp rx=0 tx=0).stop 2024-09-19T06:42:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faaa810a560 msgr2=0x7faaa8111d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faaa810a560 0x7faaa8111d30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7faaa000db80 tx=0x7faaa000b630 comp rx=0 tx=0).stop 2024-09-19T06:42:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 shutdown_connections 2024-09-19T06:42:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7faa900a3500 0x7faa900a59c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faaa8113940 0x7faaa81b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faaa810ae80 0x7faaa8112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 --2- 172.21.15.12:0/825162375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faaa810a560 0x7faaa8111d30 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 >> 172.21.15.12:0/825162375 conn(0x7faaa806e140 msgr2=0x7faaa8118f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.668+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 shutdown_connections 2024-09-19T06:42:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:28.669+0000 7faaae579640 1 -- 172.21.15.12:0/825162375 wait complete. 2024-09-19T06:42:29.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:42:29.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:29 smithi012 ceph-mon[30937]: pgmap v73: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 17 MiB/s wr, 754 op/s 2024-09-19T06:42:29.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:29 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/825162375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:42:29.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:29 smithi016 ceph-mon[34911]: pgmap v73: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 17 MiB/s wr, 754 op/s 2024-09-19T06:42:29.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:29 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/825162375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:42:29.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:29 smithi173 ceph-mon[35349]: pgmap v73: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 17 MiB/s wr, 754 op/s 2024-09-19T06:42:29.855 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:29 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/825162375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:42:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.941+0000 7fb17a94b640 1 -- 172.21.15.12:0/2937090767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1741091f0 msgr2=0x7fb174110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.941+0000 7fb17a94b640 1 --2- 172.21.15.12:0/2937090767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1741091f0 0x7fb174110250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009cd0 tx=0x7fb16c02a910 comp rx=0 tx=0).stop 2024-09-19T06:42:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.942+0000 7fb17a94b640 1 -- 172.21.15.12:0/2937090767 shutdown_connections 2024-09-19T06:42:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.942+0000 7fb17a94b640 1 --2- 172.21.15.12:0/2937090767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb17411b140 0x7fb17411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.942+0000 7fb17a94b640 1 --2- 172.21.15.12:0/2937090767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1741095d0 0x7fb174109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.942+0000 7fb17a94b640 1 --2- 172.21.15.12:0/2937090767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1741091f0 0x7fb174110250 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.942+0000 7fb17a94b640 1 -- 172.21.15.12:0/2937090767 >> 172.21.15.12:0/2937090767 conn(0x7fb17406ce00 msgr2=0x7fb17406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.942+0000 7fb17a94b640 1 -- 172.21.15.12:0/2937090767 shutdown_connections 2024-09-19T06:42:29.944 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.943+0000 7fb17a94b640 1 -- 172.21.15.12:0/2937090767 wait complete. 2024-09-19T06:42:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.943+0000 7fb17a94b640 1 Processor -- start 2024-09-19T06:42:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.943+0000 7fb17a94b640 1 -- start start 2024-09-19T06:42:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.944+0000 7fb17a94b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1741095d0 0x7fb17411a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.944+0000 7fb17a94b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb17411b140 0x7fb17411a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.944+0000 7fb17a94b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb174113480 0x7fb174113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.945 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.944+0000 7fb17a94b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb174120d50 con 0x7fb17411b140 2024-09-19T06:42:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.944+0000 7fb17a94b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb174120bd0 con 0x7fb1741095d0 2024-09-19T06:42:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.944+0000 7fb17a94b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb174120ed0 con 0x7fb174113480 2024-09-19T06:42:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.944+0000 7fb178ee8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb174113480 0x7fb174113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.945+0000 7fb1737fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb17411b140 0x7fb17411a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.945+0000 7fb178ee8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb174113480 0x7fb174113930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:37176/0 (socket says 172.21.15.12:37176) 2024-09-19T06:42:29.946 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.945+0000 7fb178ee8640 1 -- 172.21.15.12:0/2505550928 learned_addr learned my addr 172.21.15.12:0/2505550928 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.945+0000 7fb173fff640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1741095d0 0x7fb17411a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.946+0000 7fb178ee8640 1 -- 172.21.15.12:0/2505550928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1741095d0 msgr2=0x7fb17411a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.946+0000 7fb178ee8640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1741095d0 0x7fb17411a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.946+0000 7fb178ee8640 1 -- 172.21.15.12:0/2505550928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb17411b140 msgr2=0x7fb17411a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.946+0000 7fb178ee8640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb17411b140 0x7fb17411a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.946+0000 7fb178ee8640 1 -- 172.21.15.12:0/2505550928 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1741140d0 con 0x7fb174113480 2024-09-19T06:42:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.947+0000 7fb178ee8640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb174113480 0x7fb174113930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb16400b3f0 tx=0x7fb16400b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.948+0000 7fb1717fa640 1 -- 172.21.15.12:0/2505550928 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164015020 con 0x7fb174113480 2024-09-19T06:42:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.948+0000 7fb1717fa640 1 -- 172.21.15.12:0/2505550928 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb164011d10 con 0x7fb174113480 2024-09-19T06:42:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.948+0000 7fb1717fa640 1 -- 172.21.15.12:0/2505550928 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16400f2e0 con 0x7fb174113480 2024-09-19T06:42:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.948+0000 7fb17a94b640 1 -- 172.21.15.12:0/2505550928 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb174117f20 con 0x7fb174113480 2024-09-19T06:42:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.949+0000 7fb17a94b640 1 -- 172.21.15.12:0/2505550928 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb174118420 con 0x7fb174113480 2024-09-19T06:42:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.953+0000 7fb1717fa640 1 -- 172.21.15.12:0/2505550928 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb164018020 con 0x7fb174113480 2024-09-19T06:42:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.954+0000 7fb17d7c7740 1 Processor -- start 2024-09-19T06:42:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.955+0000 7fb1717fa640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb15c0a3600 0x7fb15c0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.955+0000 7fb17d7c7740 1 -- start start 2024-09-19T06:42:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.956+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561274797af0 0x561274797ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.956+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 0x5612747a2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.956+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5612747a2cb0 0x5612747a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.956+0000 7fb1737fe640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb15c0a3600 0x7fb15c0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.956+0000 7fb17d7c7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5612746fc2f0 con 0x5612747a2cb0 2024-09-19T06:42:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.956+0000 7fb17d7c7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5612746a4270 con 0x561274798410 2024-09-19T06:42:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.956+0000 7fb17d7c7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5612746f82b0 con 0x561274797af0 2024-09-19T06:42:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.956+0000 7fb1717fa640 1 -- 172.21.15.12:0/2505550928 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fb164097e40 con 0x7fb174113480 2024-09-19T06:42:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.956+0000 7fb173fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561274797af0 0x561274797ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.957+0000 7fb173fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561274797af0 0x561274797ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:37178/0 (socket says 172.21.15.12:37178) 2024-09-19T06:42:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.957+0000 7fb173fff640 1 -- 172.21.15.12:0/4220960195 learned_addr learned my addr 172.21.15.12:0/4220960195 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.957+0000 7fb178ee8640 1 --2- 172.21.15.12:0/4220960195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5612747a2cb0 0x5612747a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.957+0000 7fb1737fe640 1 --2- 172.21.15.12:0/4220960195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 0x5612747a2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.957+0000 7fb1737fe640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb15c0a3600 0x7fb15c0a5ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb174114c40 tx=0x7fb168011440 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.957+0000 7fb178ee8640 1 -- 172.21.15.12:0/4220960195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561274797af0 msgr2=0x561274797ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.957+0000 7fb178ee8640 1 --2- 172.21.15.12:0/4220960195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561274797af0 0x561274797ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.958+0000 7fb178ee8640 1 -- 172.21.15.12:0/4220960195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 msgr2=0x5612747a2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.958+0000 7fb178ee8640 1 --2- 172.21.15.12:0/4220960195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 0x5612747a2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.958+0000 7fb178ee8640 1 -- 172.21.15.12:0/4220960195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612746a3340 con 0x5612747a2cb0 2024-09-19T06:42:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.958+0000 7fb178ee8640 1 --2- 172.21.15.12:0/4220960195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5612747a2cb0 0x5612747a50a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb1640ccc40 tx=0x7fb16409b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1657e9c5f20a3dce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.959+0000 7fb15a7fc640 1 -- 172.21.15.12:0/4220960195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1640b4070 con 0x5612747a2cb0 2024-09-19T06:42:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.959+0000 7fb15a7fc640 1 -- 172.21.15.12:0/4220960195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb16409b7d0 con 0x5612747a2cb0 2024-09-19T06:42:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.959+0000 7fb15a7fc640 1 -- 172.21.15.12:0/4220960195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16409a4d0 con 0x5612747a2cb0 2024-09-19T06:42:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.960+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4220960195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5612747a2cb0 msgr2=0x5612747a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.960+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/4220960195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5612747a2cb0 0x5612747a50a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb1640ccc40 tx=0x7fb16409b310 comp rx=0 tx=0).stop 2024-09-19T06:42:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.960+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4220960195 shutdown_connections 2024-09-19T06:42:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.960+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/4220960195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5612747a2cb0 0x5612747a50a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.960+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/4220960195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 0x5612747a2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.960+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/4220960195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561274797af0 0x561274797ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.960+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4220960195 >> 172.21.15.12:0/4220960195 conn(0x561274794060 msgr2=0x561274794440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.960+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4220960195 shutdown_connections 2024-09-19T06:42:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.961+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4220960195 wait complete. 2024-09-19T06:42:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.961+0000 7fb17d7c7740 1 -- start start 2024-09-19T06:42:29.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.961+0000 7fb17d7c7740 1 Processor -- start 2024-09-19T06:42:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274797af0 0x56127479fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 0x5612747a0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747a0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb17d7c7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5612747a5880 con 0x561274797af0 2024-09-19T06:42:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb17d7c7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561274685290 con 0x561274798410 2024-09-19T06:42:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb17d7c7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5612747a5a00 con 0x5612747a2cb0 2024-09-19T06:42:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb17d7c7740 10 client.0 _ll_register_callbacks cb 0x5612746b6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb173fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274797af0 0x56127479fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb173fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274797af0 0x56127479fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57698/0 (socket says 172.21.15.12:57698) 2024-09-19T06:42:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb173fff640 1 -- 172.21.15.12:0/1677840674 learned_addr learned my addr 172.21.15.12:0/1677840674 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb178ee8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.962+0000 7fb1737fe640 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 0x5612747a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb178ee8640 1 -- 172.21.15.12:0/1677840674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 msgr2=0x5612747a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb178ee8640 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 0x5612747a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb178ee8640 1 -- 172.21.15.12:0/1677840674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274797af0 msgr2=0x56127479fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:29.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb178ee8640 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274797af0 0x56127479fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb178ee8640 1 -- 172.21.15.12:0/1677840674 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127440f210 con 0x5612747a2cb0 2024-09-19T06:42:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb1737fe640 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 0x5612747a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb178ee8640 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747a0680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb164097c30 tx=0x7fb164004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f2d79884857632f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb1537fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:42:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb1537fe640 1 -- 172.21.15.12:0/1677840674 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1640b8070 con 0x5612747a2cb0 2024-09-19T06:42:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb1537fe640 1 -- 172.21.15.12:0/1677840674 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fb164099d90 con 0x5612747a2cb0 2024-09-19T06:42:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.963+0000 7fb17d7c7740 1 -- 172.21.15.12:0/1677840674 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb16409b7d0 con 0x5612747a2cb0 2024-09-19T06:42:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.964+0000 7fb1537fe640 1 -- 172.21.15.12:0/1677840674 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb1640b4040 con 0x5612747a2cb0 2024-09-19T06:42:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.964+0000 7fb17d7c7740 10 client.25726 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:29.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.964+0000 7fb17d7c7740 1 -- 172.21.15.12:0/1677840674 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5612744db620 con 0x5612747a2cb0 2024-09-19T06:42:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.965+0000 7fb1537fe640 1 -- 172.21.15.12:0/1677840674 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb16409b7d0 con 0x5612747a2cb0 2024-09-19T06:42:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.965+0000 7fb1537fe640 1 -- 172.21.15.12:0/1677840674 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fb16409a8b0 con 0x5612747a2cb0 2024-09-19T06:42:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.965+0000 7fb17d7c7740 10 client.25726 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.965+0000 7fb17d7c7740 10 client.25726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.965+0000 7fb17d7c7740 20 client.25726 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.965+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5612747b2b00 0x5612747b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.965+0000 7fb17d7c7740 4 client.25726 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.965+0000 7fb17d7c7740 1 -- 172.21.15.12:0/1677840674 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561274709a20 con 0x5612747b2b00 2024-09-19T06:42:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.965+0000 7fb173fff640 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5612747b2b00 0x5612747b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.966+0000 7fb173fff640 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5612747b2b00 0x5612747b4ef0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a008dcb0cf20dc server_cookie=c1671b322abbc953 in_seq=0 out_seq=0 2024-09-19T06:42:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.966+0000 7fb1537fe640 10 client.25726 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb1537fe640 1 -- 172.21.15.12:0/1677840674 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561274709a20 con 0x5612747b2b00 2024-09-19T06:42:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb1537fe640 10 client.25726 handle_command_reply: tid=0 2024-09-19T06:42:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb17d7c7740 1 client.25726 shutdown 2024-09-19T06:42:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb17d7c7740 1 -- 172.21.15.12:0/1677840674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 msgr2=0x5612747a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747a0680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb164097c30 tx=0x7fb164004750 comp rx=0 tx=0).stop 2024-09-19T06:42:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb17d7c7740 1 -- 172.21.15.12:0/1677840674 shutdown_connections 2024-09-19T06:42:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5612747b2b00 0x5612747b4ef0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747a0680 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274798410 0x5612747a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb1537fe640 0 client.25726 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/1677840674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274797af0 0x56127479fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb17d7c7740 1 -- 172.21.15.12:0/1677840674 >> 172.21.15.12:0/1677840674 conn(0x561274794060 msgr2=0x561274799dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.967+0000 7fb17d7c7740 1 -- 172.21.15.12:0/1677840674 shutdown_connections 2024-09-19T06:42:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.968+0000 7fb17d7c7740 1 -- 172.21.15.12:0/1677840674 wait complete. 2024-09-19T06:42:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.969+0000 7fb17d7c7740 20 client.25726 trim_cache size 0 max 16384 2024-09-19T06:42:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.999+0000 7fb17d7c7740 1 Processor -- start 2024-09-19T06:42:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.999+0000 7fb17d7c7740 1 -- start start 2024-09-19T06:42:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:29.999+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 0x5612747a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.000+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 0x5612747ba490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.000+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747ba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.000+0000 7fb173fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 0x5612747a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.000+0000 7fb173fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 0x5612747a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34116/0 (socket says 172.21.15.12:34116) 2024-09-19T06:42:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.000+0000 7fb178ee8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747ba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.000+0000 7fb178ee8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747ba9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:37198/0 (socket says 172.21.15.12:37198) 2024-09-19T06:42:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.000+0000 7fb173fff640 1 -- 172.21.15.12:0/2781242655 learned_addr learned my addr 172.21.15.12:0/2781242655 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.000+0000 7fb17d7c7740 1 -- 172.21.15.12:0/2781242655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741c5330 con 0x561274798410 2024-09-19T06:42:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.000+0000 7fb17d7c7740 1 -- 172.21.15.12:0/2781242655 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741c6f60 con 0x561274797af0 2024-09-19T06:42:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.000+0000 7fb17d7c7740 1 -- 172.21.15.12:0/2781242655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741c5a00 con 0x5612747a2cb0 2024-09-19T06:42:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.001+0000 7fb1737fe640 1 --2- 172.21.15.12:0/2781242655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 0x5612747ba490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.003+0000 7fb178ee8640 1 -- 172.21.15.12:0/2781242655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 msgr2=0x5612747a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.003+0000 7fb178ee8640 1 --2- 172.21.15.12:0/2781242655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 0x5612747a04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.003+0000 7fb178ee8640 1 -- 172.21.15.12:0/2781242655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 msgr2=0x5612747ba490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.003+0000 7fb178ee8640 1 --2- 172.21.15.12:0/2781242655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 0x5612747ba490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.003+0000 7fb178ee8640 1 -- 172.21.15.12:0/2781242655 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561274793e90 con 0x5612747a2cb0 2024-09-19T06:42:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.004+0000 7fb178ee8640 1 --2- 172.21.15.12:0/2781242655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747ba9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb16409b4d0 tx=0x7fb164099ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edc3f517011363ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.004+0000 7fb159ffb640 1 -- 172.21.15.12:0/2781242655 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1640b8070 con 0x5612747a2cb0 2024-09-19T06:42:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.005+0000 7fb159ffb640 1 -- 172.21.15.12:0/2781242655 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb16409b7d0 con 0x5612747a2cb0 2024-09-19T06:42:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.005+0000 7fb159ffb640 1 -- 172.21.15.12:0/2781242655 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1640cccf0 con 0x5612747a2cb0 2024-09-19T06:42:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.006+0000 7fb17d7c7740 1 -- 172.21.15.12:0/2781242655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 msgr2=0x5612747ba9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.006+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/2781242655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747ba9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb16409b4d0 tx=0x7fb164099ce0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.009+0000 7fb17d7c7740 1 -- 172.21.15.12:0/2781242655 shutdown_connections 2024-09-19T06:42:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.009+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/2781242655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x5612747ba9d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.009+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/2781242655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 0x5612747ba490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.009+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/2781242655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 0x5612747a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.010+0000 7fb17d7c7740 1 -- 172.21.15.12:0/2781242655 >> 172.21.15.12:0/2781242655 conn(0x561274794060 msgr2=0x5612747a1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.010+0000 7fb17d7c7740 1 -- 172.21.15.12:0/2781242655 shutdown_connections 2024-09-19T06:42:30.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.010+0000 7fb17d7c7740 1 -- 172.21.15.12:0/2781242655 wait complete. 2024-09-19T06:42:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.011+0000 7fb17d7c7740 1 -- start start 2024-09-19T06:42:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.011+0000 7fb17d7c7740 1 Processor -- start 2024-09-19T06:42:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.011+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 0x5612747a6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.011+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 0x5612747a6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.011+0000 7fb17d7c7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x56127481b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.012+0000 7fb17d7c7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741c67d0 con 0x561274798410 2024-09-19T06:42:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.012+0000 7fb17d7c7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741c6100 con 0x561274797af0 2024-09-19T06:42:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.012+0000 7fb17d7c7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741c3310 con 0x5612747a2cb0 2024-09-19T06:42:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.012+0000 7fb17d7c7740 10 client.0 _ll_register_callbacks cb 0x7fb1680099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.013+0000 7fb178ee8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x56127481b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.015+0000 7fb1737fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 0x5612747a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.015+0000 7fb1737fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 0x5612747a6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57714/0 (socket says 172.21.15.12:57714) 2024-09-19T06:42:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.015+0000 7fb1737fe640 1 -- 172.21.15.12:0/4080675731 learned_addr learned my addr 172.21.15.12:0/4080675731 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.015+0000 7fb173fff640 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 0x5612747a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.015+0000 7fb178ee8640 1 -- 172.21.15.12:0/4080675731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 msgr2=0x5612747a6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.015+0000 7fb178ee8640 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 0x5612747a6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.015+0000 7fb178ee8640 1 -- 172.21.15.12:0/4080675731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 msgr2=0x5612747a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.015+0000 7fb178ee8640 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 0x5612747a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.015+0000 7fb178ee8640 1 -- 172.21.15.12:0/4080675731 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127478f2d0 con 0x5612747a2cb0 2024-09-19T06:42:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.016+0000 7fb178ee8640 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x56127481b450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb16409ad10 tx=0x7fb164099fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=708c5c73dbe3d139 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.016+0000 7fb1537fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:42:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.016+0000 7fb1537fe640 1 -- 172.21.15.12:0/4080675731 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1640b8070 con 0x5612747a2cb0 2024-09-19T06:42:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.017+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4080675731 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb16409b7d0 con 0x5612747a2cb0 2024-09-19T06:42:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.017+0000 7fb1537fe640 1 -- 172.21.15.12:0/4080675731 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fb16409a420 con 0x5612747a2cb0 2024-09-19T06:42:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.017+0000 7fb1537fe640 1 -- 172.21.15.12:0/4080675731 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb1640cccf0 con 0x5612747a2cb0 2024-09-19T06:42:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.018+0000 7fb17d7c7740 10 client.25732 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.018+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4080675731 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56127478f2d0 con 0x5612747a2cb0 2024-09-19T06:42:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.018+0000 7fb1537fe640 1 -- 172.21.15.12:0/4080675731 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb16409b7d0 con 0x5612747a2cb0 2024-09-19T06:42:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.018+0000 7fb1537fe640 1 -- 172.21.15.12:0/4080675731 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fb164088020 con 0x5612747a2cb0 2024-09-19T06:42:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.019+0000 7fb17d7c7740 10 client.25732 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.019+0000 7fb17d7c7740 10 client.25732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.019+0000 7fb17d7c7740 20 client.25732 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.019+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56127481cf50 0x56127481f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.019+0000 7fb17d7c7740 4 client.25732 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:42:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.019+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4080675731 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561274703d70 con 0x56127481cf50 2024-09-19T06:42:30.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.019+0000 7fb173fff640 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56127481cf50 0x56127481f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.020+0000 7fb173fff640 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56127481cf50 0x56127481f370 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1deb5df1171c1ca7 server_cookie=a361081d6135e428 in_seq=0 out_seq=0 2024-09-19T06:42:30.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.020+0000 7fb1537fe640 10 client.25732 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:30.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.032+0000 7fb1537fe640 1 -- 172.21.15.12:0/4080675731 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561274703d70 con 0x56127481cf50 2024-09-19T06:42:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.032+0000 7fb1537fe640 10 client.25732 handle_command_reply: tid=0 2024-09-19T06:42:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.032+0000 7fb17d7c7740 1 client.25732 shutdown 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.033+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4080675731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 msgr2=0x56127481b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.033+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x56127481b450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb16409ad10 tx=0x7fb164099fc0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.033+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4080675731 shutdown_connections 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.033+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56127481cf50 0x56127481f370 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.033+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5612747a2cb0 0x56127481b450 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.033+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561274798410 0x5612747a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.033+0000 7fb17d7c7740 1 --2- 172.21.15.12:0/4080675731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561274797af0 0x5612747a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.033+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4080675731 >> 172.21.15.12:0/4080675731 conn(0x561274794060 msgr2=0x561274799550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.033+0000 7fb1537fe640 0 client.25732 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.034+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4080675731 shutdown_connections 2024-09-19T06:42:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.034+0000 7fb17d7c7740 1 -- 172.21.15.12:0/4080675731 wait complete. 2024-09-19T06:42:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.034+0000 7fb17d7c7740 20 client.25732 trim_cache size 0 max 16384 2024-09-19T06:42:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:42:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:42:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:42:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:42:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.036+0000 7fb17a94b640 1 -- 172.21.15.12:0/2505550928 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb15c0a3600 msgr2=0x7fb15c0a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.036+0000 7fb17a94b640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb15c0a3600 0x7fb15c0a5ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb174114c40 tx=0x7fb168011440 comp rx=0 tx=0).stop 2024-09-19T06:42:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.036+0000 7fb17a94b640 1 -- 172.21.15.12:0/2505550928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb174113480 msgr2=0x7fb174113930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.036+0000 7fb17a94b640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb174113480 0x7fb174113930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb16400b3f0 tx=0x7fb16400b8b0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.037+0000 7fb17a94b640 1 -- 172.21.15.12:0/2505550928 shutdown_connections 2024-09-19T06:42:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.037+0000 7fb17a94b640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb15c0a3600 0x7fb15c0a5ac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.037+0000 7fb17a94b640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb174113480 0x7fb174113930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.037+0000 7fb17a94b640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb17411b140 0x7fb17411a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.037+0000 7fb17a94b640 1 --2- 172.21.15.12:0/2505550928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1741095d0 0x7fb17411a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.037+0000 7fb17a94b640 1 -- 172.21.15.12:0/2505550928 >> 172.21.15.12:0/2505550928 conn(0x7fb17406ce00 msgr2=0x7fb174070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.037+0000 7fb17a94b640 1 -- 172.21.15.12:0/2505550928 shutdown_connections 2024-09-19T06:42:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:30.038+0000 7fb17a94b640 1 -- 172.21.15.12:0/2505550928 wait complete. 2024-09-19T06:42:30.076 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.690+0000 7f92deb74640 1 -- 172.21.15.12:0/2793308424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92d8102ef0 msgr2=0x7f92d810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.690+0000 7f92deb74640 1 --2- 172.21.15.12:0/2793308424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92d8102ef0 0x7f92d810da40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009cd0 tx=0x7f92d002a980 comp rx=0 tx=0).stop 2024-09-19T06:42:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.690+0000 7f92deb74640 1 -- 172.21.15.12:0/2793308424 shutdown_connections 2024-09-19T06:42:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.690+0000 7f92deb74640 1 --2- 172.21.15.12:0/2793308424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92d8102ef0 0x7f92d810da40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.690+0000 7f92deb74640 1 --2- 172.21.15.12:0/2793308424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d8102570 0x7f92d81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.690+0000 7f92deb74640 1 --2- 172.21.15.12:0/2793308424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92d8100e20 0x7f92d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.690+0000 7f92deb74640 1 -- 172.21.15.12:0/2793308424 >> 172.21.15.12:0/2793308424 conn(0x7f92d80fc7d0 msgr2=0x7f92d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.690+0000 7f92deb74640 1 -- 172.21.15.12:0/2793308424 shutdown_connections 2024-09-19T06:42:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.690+0000 7f92deb74640 1 -- 172.21.15.12:0/2793308424 wait complete. 2024-09-19T06:42:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.691+0000 7f92deb74640 1 Processor -- start 2024-09-19T06:42:30.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.691+0000 7f92deb74640 1 -- start start 2024-09-19T06:42:30.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.691+0000 7f92deb74640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d8100e20 0x7f92d81a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92deb74640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92d8102570 0x7f92d81a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92deb74640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92d8102ef0 0x7f92d819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92dc910640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d8100e20 0x7f92d81a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92dc910640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d8100e20 0x7f92d81a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45118/0 (socket says 172.21.15.12:45118) 2024-09-19T06:42:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92dc910640 1 -- 172.21.15.12:0/2518973739 learned_addr learned my addr 172.21.15.12:0/2518973739 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f92d810fea0 con 0x7f92d8102ef0 2024-09-19T06:42:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f92d810fd20 con 0x7f92d8102570 2024-09-19T06:42:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f92d8110020 con 0x7f92d8100e20 2024-09-19T06:42:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92dc910640 1 -- 172.21.15.12:0/2518973739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92d8102570 msgr2=0x7f92d81a0990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:42:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92dc910640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92d8102570 0x7f92d81a0990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92dc910640 1 -- 172.21.15.12:0/2518973739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92d8102ef0 msgr2=0x7f92d819a610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:42:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92dc910640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92d8102ef0 0x7f92d819a610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.692+0000 7f92dc910640 1 -- 172.21.15.12:0/2518973739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d819ad40 con 0x7f92d8100e20 2024-09-19T06:42:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.693+0000 7f92dc910640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d8100e20 0x7f92d81a0450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00e9f0 tx=0x7f92cc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.693+0000 7f92d5ffb640 1 -- 172.21.15.12:0/2518973739 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00cd80 con 0x7f92d8100e20 2024-09-19T06:42:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.693+0000 7f92d5ffb640 1 -- 172.21.15.12:0/2518973739 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92cc010910 con 0x7f92d8100e20 2024-09-19T06:42:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.693+0000 7f92d5ffb640 1 -- 172.21.15.12:0/2518973739 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc018950 con 0x7f92d8100e20 2024-09-19T06:42:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.693+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d819b030 con 0x7f92d8100e20 2024-09-19T06:42:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.694+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d81a7320 con 0x7f92d8100e20 2024-09-19T06:42:30.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.698+0000 7f92e0f4d740 1 Processor -- start 2024-09-19T06:42:30.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.699+0000 7f92d5ffb640 1 -- 172.21.15.12:0/2518973739 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f92cc010ac0 con 0x7f92d8100e20 2024-09-19T06:42:30.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.699+0000 7f92e0f4d740 1 -- start start 2024-09-19T06:42:30.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec2b40 0x56348bec1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bec1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348becc370 0x56348bece760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56348be272f0 con 0x56348bec2b40 2024-09-19T06:42:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56348bdcecf0 con 0x56348becc370 2024-09-19T06:42:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56348be232b0 con 0x56348bec15d0 2024-09-19T06:42:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92dc910640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bec1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92dc910640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bec1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45132/0 (socket says 172.21.15.12:45132) 2024-09-19T06:42:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92dc910640 1 -- 172.21.15.12:0/934216868 learned_addr learned my addr 172.21.15.12:0/934216868 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92d5ffb640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92c80a3500 0x7f92c80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92d5ffb640 1 -- 172.21.15.12:0/2518973739 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f92cc0d0160 con 0x7f92d8100e20 2024-09-19T06:42:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92dc910640 1 -- 172.21.15.12:0/934216868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348becc370 msgr2=0x56348bece760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.700+0000 7f92dc910640 1 --2- 172.21.15.12:0/934216868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348becc370 0x56348bece760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.701+0000 7f92dc910640 1 -- 172.21.15.12:0/934216868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec2b40 msgr2=0x56348bec1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.701+0000 7f92dc910640 1 --2- 172.21.15.12:0/934216868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec2b40 0x56348bec1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.701+0000 7f92dc910640 1 -- 172.21.15.12:0/934216868 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348bdb33a0 con 0x56348bec15d0 2024-09-19T06:42:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.701+0000 7f92dd111640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92c80a3500 0x7f92c80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.702+0000 7f92dd111640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92c80a3500 0x7f92c80a59c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009430 tx=0x7f92d0009360 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.702+0000 7f92dc910640 1 --2- 172.21.15.12:0/934216868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bec1a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f92cc09c2f0 tx=0x7f92cc018420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35c1879e925809c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.702+0000 7f92c2ffd640 1 -- 172.21.15.12:0/934216868 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc09c360 con 0x56348bec15d0 2024-09-19T06:42:30.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.702+0000 7f92c2ffd640 1 -- 172.21.15.12:0/934216868 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92cc0a0710 con 0x56348bec15d0 2024-09-19T06:42:30.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.703+0000 7f92c2ffd640 1 -- 172.21.15.12:0/934216868 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0d2370 con 0x56348bec15d0 2024-09-19T06:42:30.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.703+0000 7f92e0f4d740 1 -- 172.21.15.12:0/934216868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 msgr2=0x56348bec1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.703+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/934216868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bec1a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f92cc09c2f0 tx=0x7f92cc018420 comp rx=0 tx=0).stop 2024-09-19T06:42:30.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.704+0000 7f92e0f4d740 1 -- 172.21.15.12:0/934216868 shutdown_connections 2024-09-19T06:42:30.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.704+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/934216868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348becc370 0x56348bece760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.704+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/934216868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bec1a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.704+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/934216868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec2b40 0x56348bec1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.704+0000 7f92e0f4d740 1 -- 172.21.15.12:0/934216868 >> 172.21.15.12:0/934216868 conn(0x56348be8a310 msgr2=0x56348bebdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:30.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.705+0000 7f92e0f4d740 1 -- 172.21.15.12:0/934216868 shutdown_connections 2024-09-19T06:42:30.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.705+0000 7f92e0f4d740 1 -- 172.21.15.12:0/934216868 wait complete. 2024-09-19T06:42:30.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.705+0000 7f92e0f4d740 1 -- start start 2024-09-19T06:42:30.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.705+0000 7f92e0f4d740 1 Processor -- start 2024-09-19T06:42:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.706+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec15d0 0x56348becbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.706+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec2b40 0x56348bec90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.706+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348becc370 0x56348bec97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.707+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56348becf060 con 0x56348bec15d0 2024-09-19T06:42:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.707+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56348bde2060 con 0x56348becc370 2024-09-19T06:42:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.707+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56348becf1e0 con 0x56348bec2b40 2024-09-19T06:42:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.707+0000 7f92dd111640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348becc370 0x56348bec97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.707+0000 7f92d7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec2b40 0x56348bec90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.707+0000 7f92d7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec2b40 0x56348bec90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45134/0 (socket says 172.21.15.12:45134) 2024-09-19T06:42:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.707+0000 7f92d7fff640 1 -- 172.21.15.12:0/2250067970 learned_addr learned my addr 172.21.15.12:0/2250067970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.707+0000 7f92dc910640 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec15d0 0x56348becbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.707+0000 7f92e0f4d740 10 client.0 _ll_register_callbacks cb 0x56348bb358c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.708+0000 7f92dc910640 1 -- 172.21.15.12:0/2250067970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec2b40 msgr2=0x56348bec90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.708+0000 7f92dc910640 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec2b40 0x56348bec90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.708+0000 7f92dc910640 1 -- 172.21.15.12:0/2250067970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348becc370 msgr2=0x56348bec97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.708+0000 7f92dc910640 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348becc370 0x56348bec97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.708+0000 7f92dc910640 1 -- 172.21.15.12:0/2250067970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348bb983c0 con 0x56348bec15d0 2024-09-19T06:42:30.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.708+0000 7f92dc910640 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec15d0 0x56348becbdf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f92cc09c2f0 tx=0x7f92cc09cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7831fe37538ba614 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.708+0000 7f92b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:30.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.709+0000 7f92b7fff640 1 -- 172.21.15.12:0/2250067970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0cda50 con 0x56348bec15d0 2024-09-19T06:42:30.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.709+0000 7f92b7fff640 1 -- 172.21.15.12:0/2250067970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f92cc010640 con 0x56348bec15d0 2024-09-19T06:42:30.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.709+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2250067970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92cc0a0710 con 0x56348bec15d0 2024-09-19T06:42:30.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.709+0000 7f92b7fff640 1 -- 172.21.15.12:0/2250067970 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f92cc09c360 con 0x56348bec15d0 2024-09-19T06:42:30.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.709+0000 7f92e0f4d740 10 client.16173 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:30.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.709+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2250067970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56348bedab90 con 0x56348bec15d0 2024-09-19T06:42:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.711+0000 7f92b7fff640 1 -- 172.21.15.12:0/2250067970 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92cc0a4fd0 con 0x56348bec15d0 2024-09-19T06:42:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.712+0000 7f92b7fff640 1 -- 172.21.15.12:0/2250067970 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f92cc09b220 con 0x56348bec15d0 2024-09-19T06:42:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.712+0000 7f92e0f4d740 10 client.16173 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.712+0000 7f92e0f4d740 10 client.16173 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:42:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.712+0000 7f92e0f4d740 20 client.16173 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.712+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56348bedbee0 0x56348bede2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.712+0000 7f92e0f4d740 4 client.16173 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.712+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2250067970 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f92cc0a0710 con 0x56348bedbee0 2024-09-19T06:42:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.712+0000 7f92d7fff640 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56348bedbee0 0x56348bede2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.713+0000 7f92d7fff640 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56348bedbee0 0x56348bede2d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ea958f04d76ea935 server_cookie=ef81062741758414 in_seq=0 out_seq=0 2024-09-19T06:42:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.713+0000 7f92b7fff640 10 client.16173 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:42:30.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.714+0000 7f92b7fff640 1 -- 172.21.15.12:0/2250067970 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f92cc0a0710 con 0x56348bedbee0 2024-09-19T06:42:30.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.714+0000 7f92b7fff640 10 client.16173 handle_command_reply: tid=0 2024-09-19T06:42:30.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.714+0000 7f92e0f4d740 1 client.16173 shutdown 2024-09-19T06:42:30.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.715+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2250067970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec15d0 msgr2=0x56348becbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.715+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec15d0 0x56348becbdf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f92cc09c2f0 tx=0x7f92cc09cba0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.715+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2250067970 shutdown_connections 2024-09-19T06:42:30.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.715+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56348bedbee0 0x56348bede2d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.715+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348becc370 0x56348bec97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.715+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec2b40 0x56348bec90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.715+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/2250067970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec15d0 0x56348becbdf0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.715+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2250067970 >> 172.21.15.12:0/2250067970 conn(0x56348be8a310 msgr2=0x56348bec3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.715+0000 7f92b7fff640 0 client.16173 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:42:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.715+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2250067970 shutdown_connections 2024-09-19T06:42:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.716+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2250067970 wait complete. 2024-09-19T06:42:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.716+0000 7f92e0f4d740 20 client.16173 trim_cache size 0 max 16384 2024-09-19T06:42:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.738+0000 7f92e0f4d740 1 Processor -- start 2024-09-19T06:42:30.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.738+0000 7f92e0f4d740 1 -- start start 2024-09-19T06:42:30.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.739+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec15d0 0x56348bed8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.739+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec2b40 0x56348bec8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.739+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348becc370 0x56348bee0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.739+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f92d81afea0 con 0x56348bec2b40 2024-09-19T06:42:30.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.739+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f92d81b1ad0 con 0x56348bec15d0 2024-09-19T06:42:30.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.739+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f92d81b0570 con 0x56348becc370 2024-09-19T06:42:30.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.739+0000 7f92dc910640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec15d0 0x56348bed8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.739+0000 7f92dc910640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec15d0 0x56348bed8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:55058/0 (socket says 172.21.15.12:55058) 2024-09-19T06:42:30.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.739+0000 7f92dc910640 1 -- 172.21.15.12:0/2407148389 learned_addr learned my addr 172.21.15.12:0/2407148389 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:30.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.739+0000 7f92dd111640 1 --2- 172.21.15.12:0/2407148389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348becc370 0x56348bee0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.740+0000 7f92dc910640 1 -- 172.21.15.12:0/2407148389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348becc370 msgr2=0x56348bee0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.740+0000 7f92dc910640 1 --2- 172.21.15.12:0/2407148389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348becc370 0x56348bee0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.740+0000 7f92dc910640 1 -- 172.21.15.12:0/2407148389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec2b40 msgr2=0x56348bec8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.740+0000 7f92dc910640 1 --2- 172.21.15.12:0/2407148389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec2b40 0x56348bec8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.740+0000 7f92dc910640 1 -- 172.21.15.12:0/2407148389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56348bebddc0 con 0x56348bec15d0 2024-09-19T06:42:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.740+0000 7f92dc910640 1 --2- 172.21.15.12:0/2407148389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec15d0 0x56348bed8480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f92cc098d30 tx=0x7f92cc0a18a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=613960b2f712f711 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.740+0000 7f92c27fc640 1 -- 172.21.15.12:0/2407148389 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0a4fd0 con 0x56348bec15d0 2024-09-19T06:42:30.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.741+0000 7f92c27fc640 1 -- 172.21.15.12:0/2407148389 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92cc0a0710 con 0x56348bec15d0 2024-09-19T06:42:30.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.741+0000 7f92c27fc640 1 -- 172.21.15.12:0/2407148389 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc09b220 con 0x56348bec15d0 2024-09-19T06:42:30.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.742+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2407148389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec15d0 msgr2=0x56348bed8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.742+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/2407148389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec15d0 0x56348bed8480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f92cc098d30 tx=0x7f92cc0a18a0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.742+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2407148389 shutdown_connections 2024-09-19T06:42:30.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.742+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/2407148389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348becc370 0x56348bee0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.742+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/2407148389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348bec2b40 0x56348bec8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.742+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/2407148389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec15d0 0x56348bed8480 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.742+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2407148389 >> 172.21.15.12:0/2407148389 conn(0x56348be8a310 msgr2=0x56348bec7970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:30.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.742+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2407148389 shutdown_connections 2024-09-19T06:42:30.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.742+0000 7f92e0f4d740 1 -- 172.21.15.12:0/2407148389 wait complete. 2024-09-19T06:42:30.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.743+0000 7f92e0f4d740 1 -- start start 2024-09-19T06:42:30.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.743+0000 7f92e0f4d740 1 Processor -- start 2024-09-19T06:42:30.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bf3db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec2b40 0x56348bf3e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92e0f4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348becc370 0x56348bede4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f92d81b1340 con 0x56348becc370 2024-09-19T06:42:30.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f92d81b0c70 con 0x56348bec2b40 2024-09-19T06:42:30.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92e0f4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f92d81adec0 con 0x56348bec15d0 2024-09-19T06:42:30.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92e0f4d740 10 client.0 _ll_register_callbacks cb 0x7f92cc00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92d7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec2b40 0x56348bf3e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92dc910640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bf3db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92d7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec2b40 0x56348bf3e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:55070/0 (socket says 172.21.15.12:55070) 2024-09-19T06:42:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92d7fff640 1 -- 172.21.15.12:0/1042704147 learned_addr learned my addr 172.21.15.12:0/1042704147 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.744+0000 7f92dd111640 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348becc370 0x56348bede4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.745+0000 7f92dc910640 1 -- 172.21.15.12:0/1042704147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec2b40 msgr2=0x56348bf3e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.745+0000 7f92dc910640 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec2b40 0x56348bf3e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.745+0000 7f92dc910640 1 -- 172.21.15.12:0/1042704147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348becc370 msgr2=0x56348bede4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.745+0000 7f92dc910640 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348becc370 0x56348bede4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.745+0000 7f92dc910640 1 -- 172.21.15.12:0/1042704147 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56348bedecd0 con 0x56348bec15d0 2024-09-19T06:42:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.745+0000 7f92dc910640 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bf3db00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f92cc09a610 tx=0x7f92cc097fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3dd5cd78484523 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.745+0000 7f92b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:42:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.745+0000 7f92b7fff640 1 -- 172.21.15.12:0/1042704147 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0a4fd0 con 0x56348bec15d0 2024-09-19T06:42:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.745+0000 7f92b7fff640 1 -- 172.21.15.12:0/1042704147 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f92cc0a1910 con 0x56348bec15d0 2024-09-19T06:42:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.745+0000 7f92e0f4d740 1 -- 172.21.15.12:0/1042704147 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92cc0a0710 con 0x56348bec15d0 2024-09-19T06:42:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92b7fff640 1 -- 172.21.15.12:0/1042704147 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f92cc0a1b50 con 0x56348bec15d0 2024-09-19T06:42:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92e0f4d740 10 client.25747 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92e0f4d740 1 -- 172.21.15.12:0/1042704147 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56348bedecd0 con 0x56348bec15d0 2024-09-19T06:42:30.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92b7fff640 1 -- 172.21.15.12:0/1042704147 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92cc0a0710 con 0x56348bec15d0 2024-09-19T06:42:30.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92b7fff640 1 -- 172.21.15.12:0/1042704147 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f92cc0a0120 con 0x56348bec15d0 2024-09-19T06:42:30.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92e0f4d740 10 client.25747 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:30.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92e0f4d740 10 client.25747 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:42:30.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92e0f4d740 20 client.25747 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56348bf445e0 0x56348bf449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92e0f4d740 4 client.25747 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:42:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.746+0000 7f92e0f4d740 1 -- 172.21.15.12:0/1042704147 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56348be34860 con 0x56348bf445e0 2024-09-19T06:42:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.749+0000 7f92d7fff640 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56348bf445e0 0x56348bf449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.749+0000 7f92d7fff640 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56348bf445e0 0x56348bf449c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d442f87020808a97 server_cookie=34c143d625955aa in_seq=0 out_seq=0 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.749+0000 7f92b7fff640 10 client.25747 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92b7fff640 1 -- 172.21.15.12:0/1042704147 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56348be34860 con 0x56348bf445e0 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92b7fff640 10 client.25747 handle_command_reply: tid=0 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92e0f4d740 1 client.25747 shutdown 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92e0f4d740 1 -- 172.21.15.12:0/1042704147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 msgr2=0x56348bf3db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bf3db00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f92cc09a610 tx=0x7f92cc097fd0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92e0f4d740 1 -- 172.21.15.12:0/1042704147 shutdown_connections 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56348bf445e0 0x56348bf449c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56348becc370 0x56348bede4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92b7fff640 0 client.25747 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:42:30.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56348bec2b40 0x56348bf3e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92e0f4d740 1 --2- 172.21.15.12:0/1042704147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56348bec15d0 0x56348bf3db00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.751+0000 7f92e0f4d740 1 -- 172.21.15.12:0/1042704147 >> 172.21.15.12:0/1042704147 conn(0x56348be8a310 msgr2=0x56348bec8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:30.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.753+0000 7f92e0f4d740 1 -- 172.21.15.12:0/1042704147 shutdown_connections 2024-09-19T06:42:30.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.753+0000 7f92e0f4d740 1 -- 172.21.15.12:0/1042704147 wait complete. 2024-09-19T06:42:30.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.753+0000 7f92e0f4d740 20 client.25747 trim_cache size 0 max 16384 2024-09-19T06:42:30.755 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:42:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92c80a3500 msgr2=0x7f92c80a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92c80a3500 0x7f92c80a59c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009430 tx=0x7f92d0009360 comp rx=0 tx=0).stop 2024-09-19T06:42:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d8100e20 msgr2=0x7f92d81a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d8100e20 0x7f92d81a0450 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00e9f0 tx=0x7f92cc00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 shutdown_connections 2024-09-19T06:42:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92d8102ef0 0x7f92d819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92d8102570 0x7f92d81a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92c80a3500 0x7f92c80a59c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 --2- 172.21.15.12:0/2518973739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92d8100e20 0x7f92d81a0450 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 >> 172.21.15.12:0/2518973739 conn(0x7f92d80fc7d0 msgr2=0x7f92d8104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 shutdown_connections 2024-09-19T06:42:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:30.755+0000 7f92deb74640 1 -- 172.21.15.12:0/2518973739 wait complete. 2024-09-19T06:42:30.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 105.0 s, 5386.1 tps, lat 18.587 ms stddev 19.821 2024-09-19T06:42:31.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:31 smithi012 ceph-mon[30937]: pgmap v74: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 22 MiB/s wr, 1.15k op/s 2024-09-19T06:42:31.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:31 smithi016 ceph-mon[34911]: pgmap v74: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 22 MiB/s wr, 1.15k op/s 2024-09-19T06:42:31.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:31 smithi173 ceph-mon[35349]: pgmap v74: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 22 MiB/s wr, 1.15k op/s 2024-09-19T06:42:32.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:42:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:33.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.354+0000 7f3c5159a640 1 -- 172.21.15.12:0/492765320 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44037070 con 0x7f3c54101de0 2024-09-19T06:42:33.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.355+0000 7f3c58b73640 1 -- 172.21.15.12:0/492765320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c54101de0 msgr2=0x7f3c541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.355+0000 7f3c58b73640 1 --2- 172.21.15.12:0/492765320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c54101de0 0x7f3c541021c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009860 tx=0x7f3c4402a340 comp rx=0 tx=0).stop 2024-09-19T06:42:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.355+0000 7f3c58b73640 1 -- 172.21.15.12:0/492765320 shutdown_connections 2024-09-19T06:42:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.355+0000 7f3c58b73640 1 --2- 172.21.15.12:0/492765320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c54106f10 0x7f3c5410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.355+0000 7f3c58b73640 1 --2- 172.21.15.12:0/492765320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c54102790 0x7f3c541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.355+0000 7f3c58b73640 1 --2- 172.21.15.12:0/492765320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c54101de0 0x7f3c541021c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.355+0000 7f3c58b73640 1 -- 172.21.15.12:0/492765320 >> 172.21.15.12:0/492765320 conn(0x7f3c540fd8c0 msgr2=0x7f3c540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.356+0000 7f3c58b73640 1 -- 172.21.15.12:0/492765320 shutdown_connections 2024-09-19T06:42:33.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.356+0000 7f3c58b73640 1 -- 172.21.15.12:0/492765320 wait complete. 2024-09-19T06:42:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.357+0000 7f3c58b73640 1 Processor -- start 2024-09-19T06:42:33.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.357+0000 7f3c58b73640 1 -- start start 2024-09-19T06:42:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.358+0000 7f3c58b73640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c54101de0 0x7f3c54112d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.358+0000 7f3c58b73640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c54102790 0x7f3c5410fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.358+0000 7f3c58b73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c54106f10 0x7f3c541103b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.358+0000 7f3c58b73640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c54114150 con 0x7f3c54106f10 2024-09-19T06:42:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c58b73640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3c54113fd0 con 0x7f3c54102790 2024-09-19T06:42:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c51d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c54102790 0x7f3c5410fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c51d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c54102790 0x7f3c5410fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:55096/0 (socket says 172.21.15.12:55096) 2024-09-19T06:42:33.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c51d9b640 1 -- 172.21.15.12:0/3927931050 learned_addr learned my addr 172.21.15.12:0/3927931050 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c58b73640 1 -- 172.21.15.12:0/3927931050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541142d0 con 0x7f3c54101de0 2024-09-19T06:42:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c5259c640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c54101de0 0x7f3c54112d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c5259c640 1 -- 172.21.15.12:0/3927931050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c54102790 msgr2=0x7f3c5410fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c5259c640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c54102790 0x7f3c5410fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c5259c640 1 -- 172.21.15.12:0/3927931050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c54106f10 msgr2=0x7f3c541103b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:33.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c5259c640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c54106f10 0x7f3c541103b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.359+0000 7f3c5259c640 1 -- 172.21.15.12:0/3927931050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c54110c70 con 0x7f3c54101de0 2024-09-19T06:42:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.360+0000 7f3c5259c640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c54101de0 0x7f3c54112d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3c44035040 tx=0x7f3c44033e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.361+0000 7f3c437fe640 1 -- 172.21.15.12:0/3927931050 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44037040 con 0x7f3c54101de0 2024-09-19T06:42:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.361+0000 7f3c437fe640 1 -- 172.21.15.12:0/3927931050 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c44030820 con 0x7f3c54101de0 2024-09-19T06:42:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.361+0000 7f3c437fe640 1 -- 172.21.15.12:0/3927931050 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44003970 con 0x7f3c54101de0 2024-09-19T06:42:33.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.361+0000 7f3c58b73640 1 -- 172.21.15.12:0/3927931050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c541aaf10 con 0x7f3c54101de0 2024-09-19T06:42:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.361+0000 7f3c58b73640 1 -- 172.21.15.12:0/3927931050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c541ab370 con 0x7f3c54101de0 2024-09-19T06:42:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.365+0000 7f3c5af4c740 1 Processor -- start 2024-09-19T06:42:33.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.365+0000 7f3c437fe640 1 -- 172.21.15.12:0/3927931050 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3c44044030 con 0x7f3c54101de0 2024-09-19T06:42:33.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.366+0000 7f3c437fe640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3c3c0a34b0 0x7f3c3c0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.367+0000 7f3c437fe640 1 -- 172.21.15.12:0/3927931050 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f3c440efb00 con 0x7f3c54101de0 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.369+0000 7f3c5af4c740 1 -- start start 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d7b40 0x5621b20d6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 0x5621b20d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20e1370 0x5621b20e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5af4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5621b203c2f0 con 0x5621b20e1370 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5af4c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5621b1fe3cf0 con 0x5621b20d65d0 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5af4c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5621b20382b0 con 0x5621b20d7b40 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d7b40 0x5621b20d6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d7b40 0x5621b20d6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45180/0 (socket says 172.21.15.12:45180) 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5259c640 1 -- 172.21.15.12:0/883552155 learned_addr learned my addr 172.21.15.12:0/883552155 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c51d9b640 1 --2- 172.21.15.12:0/883552155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 0x5621b20d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5259c640 1 -- 172.21.15.12:0/883552155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 msgr2=0x5621b20d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5259c640 1 --2- 172.21.15.12:0/883552155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 0x5621b20d6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5259c640 1 -- 172.21.15.12:0/883552155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20e1370 msgr2=0x5621b20e3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5259c640 1 --2- 172.21.15.12:0/883552155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20e1370 0x5621b20e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.370+0000 7f3c5259c640 1 -- 172.21.15.12:0/883552155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621b1fc83a0 con 0x5621b20d7b40 2024-09-19T06:42:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.371+0000 7f3c5259c640 1 --2- 172.21.15.12:0/883552155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d7b40 0x5621b20d6090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3c440b8900 tx=0x7f3c4402a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c37a6cf02748035 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.371+0000 7f3c40ff9640 1 -- 172.21.15.12:0/883552155 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c440bbf30 con 0x5621b20d7b40 2024-09-19T06:42:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.371+0000 7f3c52d9d640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3c3c0a34b0 0x7f3c3c0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.371+0000 7f3c40ff9640 1 -- 172.21.15.12:0/883552155 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c440c02e0 con 0x5621b20d7b40 2024-09-19T06:42:33.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.371+0000 7f3c40ff9640 1 -- 172.21.15.12:0/883552155 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c440b85a0 con 0x5621b20d7b40 2024-09-19T06:42:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.372+0000 7f3c5af4c740 1 -- 172.21.15.12:0/883552155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d7b40 msgr2=0x5621b20d6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:33.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.372+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/883552155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d7b40 0x5621b20d6090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3c440b8900 tx=0x7f3c4402a340 comp rx=0 tx=0).stop 2024-09-19T06:42:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.372+0000 7f3c52d9d640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3c3c0a34b0 0x7f3c3c0a5970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c005c40 tx=0x7f3c4c0093c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.375+0000 7f3c5af4c740 1 -- 172.21.15.12:0/883552155 shutdown_connections 2024-09-19T06:42:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.375+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/883552155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20e1370 0x5621b20e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.375+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/883552155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 0x5621b20d6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.375+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/883552155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d7b40 0x5621b20d6090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.375+0000 7f3c5af4c740 1 -- 172.21.15.12:0/883552155 >> 172.21.15.12:0/883552155 conn(0x5621b209f310 msgr2=0x5621b20d2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:33.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.375+0000 7f3c5af4c740 1 -- 172.21.15.12:0/883552155 shutdown_connections 2024-09-19T06:42:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.376+0000 7f3c5af4c740 1 -- 172.21.15.12:0/883552155 wait complete. 2024-09-19T06:42:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.376+0000 7f3c5af4c740 1 -- start start 2024-09-19T06:42:33.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5af4c740 1 Processor -- start 2024-09-19T06:42:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d65d0 0x5621b20e0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 0x5621b20de0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b20de850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5af4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5621b20f4e40 con 0x5621b20d65d0 2024-09-19T06:42:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5af4c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5621b1ff7060 con 0x5621b20d7b40 2024-09-19T06:42:33.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5af4c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5621b20f4fc0 con 0x5621b20e1370 2024-09-19T06:42:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5af4c740 10 client.0 _ll_register_callbacks cb 0x5621b1d4a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d65d0 0x5621b20e0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d65d0 0x5621b20e0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42248/0 (socket says 172.21.15.12:42248) 2024-09-19T06:42:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c5259c640 1 -- 172.21.15.12:0/427000754 learned_addr learned my addr 172.21.15.12:0/427000754 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c51d9b640 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 0x5621b20de0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.377+0000 7f3c52d9d640 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b20de850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.378+0000 7f3c52d9d640 1 -- 172.21.15.12:0/427000754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 msgr2=0x5621b20de0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.378+0000 7f3c52d9d640 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 0x5621b20de0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.378+0000 7f3c52d9d640 1 -- 172.21.15.12:0/427000754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d65d0 msgr2=0x5621b20e0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.378+0000 7f3c52d9d640 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d65d0 0x5621b20e0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.378+0000 7f3c52d9d640 1 -- 172.21.15.12:0/427000754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621b1dad3c0 con 0x5621b20e1370 2024-09-19T06:42:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.378+0000 7f3c52d9d640 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b20de850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5621b20d7070 tx=0x7f3c4c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d48c5c95442ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.378+0000 7f3c39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:42:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.379+0000 7f3c39ffb640 1 -- 172.21.15.12:0/427000754 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c022030 con 0x5621b20e1370 2024-09-19T06:42:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.379+0000 7f3c39ffb640 1 -- 172.21.15.12:0/427000754 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f3c4c011d90 con 0x5621b20e1370 2024-09-19T06:42:33.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.379+0000 7f3c5af4c740 1 -- 172.21.15.12:0/427000754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c440c02e0 con 0x5621b20e1370 2024-09-19T06:42:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.381+0000 7f3c39ffb640 1 -- 172.21.15.12:0/427000754 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3c4c02c050 con 0x5621b20e1370 2024-09-19T06:42:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.382+0000 7f3c5af4c740 10 client.25759 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.382+0000 7f3c5af4c740 1 -- 172.21.15.12:0/427000754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5621b2100930 con 0x5621b20e1370 2024-09-19T06:42:33.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.382+0000 7f3c39ffb640 1 -- 172.21.15.12:0/427000754 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c440c02e0 con 0x5621b20e1370 2024-09-19T06:42:33.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.382+0000 7f3c39ffb640 1 -- 172.21.15.12:0/427000754 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f3c4c00f040 con 0x5621b20e1370 2024-09-19T06:42:33.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.382+0000 7f3c5af4c740 10 client.25759 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:33.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.382+0000 7f3c5af4c740 10 client.25759 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:42:33.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.382+0000 7f3c5af4c740 20 client.25759 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:33.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.382+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5621b21022b0 0x5621b21046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.382+0000 7f3c5af4c740 4 client.25759 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:33.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.382+0000 7f3c5af4c740 1 -- 172.21.15.12:0/427000754 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621b2049860 con 0x5621b21022b0 2024-09-19T06:42:33.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.383+0000 7f3c5259c640 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5621b21022b0 0x5621b21046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.383+0000 7f3c5259c640 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5621b21022b0 0x5621b21046d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bd2c443255b45d55 server_cookie=4e7580964ec58615 in_seq=0 out_seq=0 2024-09-19T06:42:33.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.383+0000 7f3c39ffb640 10 client.25759 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:42:33.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c39ffb640 1 -- 172.21.15.12:0/427000754 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621b2049860 con 0x5621b21022b0 2024-09-19T06:42:33.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c39ffb640 10 client.25759 handle_command_reply: tid=0 2024-09-19T06:42:33.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 client.25759 shutdown 2024-09-19T06:42:33.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 -- 172.21.15.12:0/427000754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 msgr2=0x5621b20de850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:33.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b20de850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5621b20d7070 tx=0x7f3c4c004a40 comp rx=0 tx=0).stop 2024-09-19T06:42:33.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 -- 172.21.15.12:0/427000754 shutdown_connections 2024-09-19T06:42:33.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5621b21022b0 0x5621b21046d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b20de850 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 0x5621b20de0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/427000754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d65d0 0x5621b20e0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 -- 172.21.15.12:0/427000754 >> 172.21.15.12:0/427000754 conn(0x5621b209f310 msgr2=0x5621b20d8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:33.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c39ffb640 0 client.25759 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:42:33.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 -- 172.21.15.12:0/427000754 shutdown_connections 2024-09-19T06:42:33.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.384+0000 7f3c5af4c740 1 -- 172.21.15.12:0/427000754 wait complete. 2024-09-19T06:42:33.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.385+0000 7f3c5af4c740 20 client.25759 trim_cache size 0 max 16384 2024-09-19T06:42:33.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.408+0000 7f3c5af4c740 1 Processor -- start 2024-09-19T06:42:33.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.408+0000 7f3c5af4c740 1 -- start start 2024-09-19T06:42:33.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.408+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d65d0 0x5621b20d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.408+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 0x5621b20dd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.408+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20e1370 0x5621b20ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.409+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d65d0 0x5621b20d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.409+0000 7f3c5259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d65d0 0x5621b20d2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45200/0 (socket says 172.21.15.12:45200) 2024-09-19T06:42:33.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.409+0000 7f3c5af4c740 1 -- 172.21.15.12:0/3753025977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541ab8f0 con 0x5621b20e1370 2024-09-19T06:42:33.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.409+0000 7f3c5259c640 1 -- 172.21.15.12:0/3753025977 learned_addr learned my addr 172.21.15.12:0/3753025977 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:33.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.409+0000 7f3c5af4c740 1 -- 172.21.15.12:0/3753025977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541ad520 con 0x5621b20d7b40 2024-09-19T06:42:33.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.409+0000 7f3c5af4c740 1 -- 172.21.15.12:0/3753025977 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541abfc0 con 0x5621b20d65d0 2024-09-19T06:42:33.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.409+0000 7f3c51d9b640 1 --2- 172.21.15.12:0/3753025977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 0x5621b20dd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.409+0000 7f3c52d9d640 1 --2- 172.21.15.12:0/3753025977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20e1370 0x5621b20ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.409+0000 7f3c51d9b640 1 -- 172.21.15.12:0/3753025977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d65d0 msgr2=0x5621b20d2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:33.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.409+0000 7f3c51d9b640 1 --2- 172.21.15.12:0/3753025977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d65d0 0x5621b20d2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.410+0000 7f3c51d9b640 1 -- 172.21.15.12:0/3753025977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20e1370 msgr2=0x5621b20ddec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:33.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.410+0000 7f3c51d9b640 1 --2- 172.21.15.12:0/3753025977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20e1370 0x5621b20ddec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.410+0000 7f3c51d9b640 1 -- 172.21.15.12:0/3753025977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621b20d9120 con 0x5621b20d7b40 2024-09-19T06:42:33.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.410+0000 7f3c51d9b640 1 --2- 172.21.15.12:0/3753025977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 0x5621b20dd980 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5621b20dd950 tx=0x7f3c48009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1fa2960f5806362 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:33.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.410+0000 7f3c3bfff640 1 -- 172.21.15.12:0/3753025977 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48011640 con 0x5621b20d7b40 2024-09-19T06:42:33.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.410+0000 7f3c3bfff640 1 -- 172.21.15.12:0/3753025977 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c48021070 con 0x5621b20d7b40 2024-09-19T06:42:33.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.411+0000 7f3c5af4c740 1 -- 172.21.15.12:0/3753025977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 msgr2=0x5621b20dd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:33.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.411+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/3753025977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 0x5621b20dd980 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5621b20dd950 tx=0x7f3c48009260 comp rx=0 tx=0).stop 2024-09-19T06:42:33.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.411+0000 7f3c5af4c740 1 -- 172.21.15.12:0/3753025977 shutdown_connections 2024-09-19T06:42:33.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.411+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/3753025977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20e1370 0x5621b20ddec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.411+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/3753025977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d7b40 0x5621b20dd980 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.411+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/3753025977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20d65d0 0x5621b20d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.411+0000 7f3c5af4c740 1 -- 172.21.15.12:0/3753025977 >> 172.21.15.12:0/3753025977 conn(0x5621b209f310 msgr2=0x5621b20d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:33.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.413+0000 7f3c5af4c740 1 -- 172.21.15.12:0/3753025977 shutdown_connections 2024-09-19T06:42:33.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.413+0000 7f3c5af4c740 1 -- 172.21.15.12:0/3753025977 wait complete. 2024-09-19T06:42:33.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.413+0000 7f3c5af4c740 1 -- start start 2024-09-19T06:42:33.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.413+0000 7f3c5af4c740 1 Processor -- start 2024-09-19T06:42:33.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 0x5621b20f5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d7b40 0x5621b20f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c5af4c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b216afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c5af4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541acd90 con 0x5621b20d7b40 2024-09-19T06:42:33.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c5af4c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3c541ac6c0 con 0x5621b20d65d0 2024-09-19T06:42:33.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c5af4c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3c54072710 con 0x5621b20e1370 2024-09-19T06:42:33.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c5af4c740 10 client.0 _ll_register_callbacks cb 0x7f3c4c011540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:33.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c52d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b216afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c51d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d7b40 0x5621b20f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c51d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d7b40 0x5621b20f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42272/0 (socket says 172.21.15.12:42272) 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c52d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b216afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45202/0 (socket says 172.21.15.12:45202) 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c51d9b640 1 -- 172.21.15.12:0/2529996761 learned_addr learned my addr 172.21.15.12:0/2529996761 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.414+0000 7f3c5259c640 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 0x5621b20f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.415+0000 7f3c5259c640 1 -- 172.21.15.12:0/2529996761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 msgr2=0x5621b216afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.415+0000 7f3c5259c640 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b216afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.415+0000 7f3c5259c640 1 -- 172.21.15.12:0/2529996761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d7b40 msgr2=0x5621b20f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.415+0000 7f3c5259c640 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d7b40 0x5621b20f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.415+0000 7f3c5259c640 1 -- 172.21.15.12:0/2529996761 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621b20d24f0 con 0x5621b20d65d0 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.415+0000 7f3c51d9b640 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d7b40 0x5621b20f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:33.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.415+0000 7f3c52d9d640 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b216afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:33.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.416+0000 7f3c5259c640 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 0x5621b20f5770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3c440bbc30 tx=0x7f3c44005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7258817857d7d3de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:33.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.416+0000 7f3c39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:42:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.416+0000 7f3c39ffb640 1 -- 172.21.15.12:0/2529996761 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c440c02e0 con 0x5621b20d65d0 2024-09-19T06:42:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.416+0000 7f3c39ffb640 1 -- 172.21.15.12:0/2529996761 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f3c440ba230 con 0x5621b20d65d0 2024-09-19T06:42:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.416+0000 7f3c5af4c740 1 -- 172.21.15.12:0/2529996761 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c48021070 con 0x5621b20d65d0 2024-09-19T06:42:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.416+0000 7f3c39ffb640 1 -- 172.21.15.12:0/2529996761 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3c440bbf30 con 0x5621b20d65d0 2024-09-19T06:42:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.416+0000 7f3c5af4c740 10 client.25748 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.416+0000 7f3c5af4c740 1 -- 172.21.15.12:0/2529996761 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5621b216c660 con 0x5621b20d65d0 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.417+0000 7f3c39ffb640 1 -- 172.21.15.12:0/2529996761 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c48021070 con 0x5621b20d65d0 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.417+0000 7f3c39ffb640 1 -- 172.21.15.12:0/2529996761 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f3c4403a030 con 0x5621b20d65d0 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.417+0000 7f3c5af4c740 10 client.25748 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.417+0000 7f3c5af4c740 10 client.25748 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.417+0000 7f3c5af4c740 20 client.25748 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.417+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5621b216cc00 0x5621b216f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.417+0000 7f3c5af4c740 4 client.25748 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.417+0000 7f3c5af4c740 1 -- 172.21.15.12:0/2529996761 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5621b2043d70 con 0x5621b216cc00 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.417+0000 7f3c51d9b640 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5621b216cc00 0x5621b216f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.418+0000 7f3c51d9b640 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5621b216cc00 0x5621b216f020 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=affa4f54f4f62f45 server_cookie=4c4cada5cb073733 in_seq=0 out_seq=0 2024-09-19T06:42:33.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.418+0000 7f3c39ffb640 10 client.25748 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:42:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.418+0000 7f3c39ffb640 1 -- 172.21.15.12:0/2529996761 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5621b2043d70 con 0x5621b216cc00 2024-09-19T06:42:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.418+0000 7f3c39ffb640 10 client.25748 handle_command_reply: tid=0 2024-09-19T06:42:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.418+0000 7f3c5af4c740 1 client.25748 shutdown 2024-09-19T06:42:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.418+0000 7f3c5af4c740 1 -- 172.21.15.12:0/2529996761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 msgr2=0x5621b20f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.418+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 0x5621b20f5770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3c440bbc30 tx=0x7f3c44005f90 comp rx=0 tx=0).stop 2024-09-19T06:42:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.419+0000 7f3c5af4c740 1 -- 172.21.15.12:0/2529996761 shutdown_connections 2024-09-19T06:42:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.419+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5621b216cc00 0x5621b216f020 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.419+0000 7f3c39ffb640 0 client.25748 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:42:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.419+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621b20e1370 0x5621b216afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.419+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621b20d7b40 0x5621b20f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.419+0000 7f3c5af4c740 1 --2- 172.21.15.12:0/2529996761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621b20d65d0 0x5621b20f5770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.419+0000 7f3c5af4c740 1 -- 172.21.15.12:0/2529996761 >> 172.21.15.12:0/2529996761 conn(0x5621b209f310 msgr2=0x5621b20d26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.419+0000 7f3c5af4c740 1 -- 172.21.15.12:0/2529996761 shutdown_connections 2024-09-19T06:42:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.419+0000 7f3c5af4c740 1 -- 172.21.15.12:0/2529996761 wait complete. 2024-09-19T06:42:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.419+0000 7f3c5af4c740 20 client.25748 trim_cache size 0 max 16384 2024-09-19T06:42:33.424 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:42:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.420+0000 7f3c58b73640 1 -- 172.21.15.12:0/3927931050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3c3c0a34b0 msgr2=0x7f3c3c0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.420+0000 7f3c58b73640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3c3c0a34b0 0x7f3c3c0a5970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c005c40 tx=0x7f3c4c0093c0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.420+0000 7f3c58b73640 1 -- 172.21.15.12:0/3927931050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c54101de0 msgr2=0x7f3c54112d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.420+0000 7f3c58b73640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c54101de0 0x7f3c54112d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3c44035040 tx=0x7f3c44033e50 comp rx=0 tx=0).stop 2024-09-19T06:42:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.421+0000 7f3c58b73640 1 -- 172.21.15.12:0/3927931050 shutdown_connections 2024-09-19T06:42:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.421+0000 7f3c58b73640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c54106f10 0x7f3c541103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.421+0000 7f3c58b73640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c54102790 0x7f3c5410fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.421+0000 7f3c58b73640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3c3c0a34b0 0x7f3c3c0a5970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.421+0000 7f3c58b73640 1 --2- 172.21.15.12:0/3927931050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c54101de0 0x7f3c54112d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:33.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.421+0000 7f3c58b73640 1 -- 172.21.15.12:0/3927931050 >> 172.21.15.12:0/3927931050 conn(0x7f3c540fd8c0 msgr2=0x7f3c540febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:33.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.422+0000 7f3c58b73640 1 -- 172.21.15.12:0/3927931050 shutdown_connections 2024-09-19T06:42:33.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:33.422+0000 7f3c58b73640 1 -- 172.21.15.12:0/3927931050 wait complete. 2024-09-19T06:42:33.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:33 smithi012 ceph-mon[30937]: pgmap v75: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 22 MiB/s wr, 1.13k op/s 2024-09-19T06:42:33.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:33 smithi016 ceph-mon[34911]: pgmap v75: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 22 MiB/s wr, 1.13k op/s 2024-09-19T06:42:33.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:33 smithi173 ceph-mon[35349]: pgmap v75: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 22 MiB/s wr, 1.13k op/s 2024-09-19T06:42:34.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:42:34.600 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:35.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.197+0000 7f8be8682640 1 -- 172.21.15.12:0/1380810735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be01091f0 msgr2=0x7f8be01095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:35.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.197+0000 7f8be8682640 1 --2- 172.21.15.12:0/1380810735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be01091f0 0x7f8be01095d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009860 tx=0x7f8bd002a340 comp rx=0 tx=0).stop 2024-09-19T06:42:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.198+0000 7f8be8682640 1 -- 172.21.15.12:0/1380810735 shutdown_connections 2024-09-19T06:42:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.198+0000 7f8be8682640 1 --2- 172.21.15.12:0/1380810735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be0116ea0 0x7f8be0119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.198+0000 7f8be8682640 1 --2- 172.21.15.12:0/1380810735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8be0109b10 0x7f8be0116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.198+0000 7f8be8682640 1 --2- 172.21.15.12:0/1380810735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be01091f0 0x7f8be01095d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.198+0000 7f8be8682640 1 -- 172.21.15.12:0/1380810735 >> 172.21.15.12:0/1380810735 conn(0x7f8be006e140 msgr2=0x7f8be006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.198+0000 7f8be8682640 1 -- 172.21.15.12:0/1380810735 shutdown_connections 2024-09-19T06:42:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.199+0000 7f8be8682640 1 -- 172.21.15.12:0/1380810735 wait complete. 2024-09-19T06:42:35.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be8682640 1 Processor -- start 2024-09-19T06:42:35.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be8682640 1 -- start start 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be8682640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be01091f0 0x7f8be0116920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be8682640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8be0109b10 0x7f8be01139d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be8682640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be0116ea0 0x7f8be01140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be8682640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8be011c9b0 con 0x7f8be01091f0 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be8682640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8be011c830 con 0x7f8be0109b10 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be8682640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8be011cb30 con 0x7f8be0116ea0 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be5c1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8be0109b10 0x7f8be01139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be641e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be01091f0 0x7f8be0116920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be5c1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8be0109b10 0x7f8be01139d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:55136/0 (socket says 172.21.15.12:55136) 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be5c1d640 1 -- 172.21.15.12:0/2240297203 learned_addr learned my addr 172.21.15.12:0/2240297203 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.200+0000 7f8be6c1f640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be0116ea0 0x7f8be01140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.201+0000 7f8be5c1d640 1 -- 172.21.15.12:0/2240297203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be0116ea0 msgr2=0x7f8be01140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.201+0000 7f8be5c1d640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be0116ea0 0x7f8be01140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.201+0000 7f8be5c1d640 1 -- 172.21.15.12:0/2240297203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be01091f0 msgr2=0x7f8be0116920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:35.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.201+0000 7f8be5c1d640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be01091f0 0x7f8be0116920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.201+0000 7f8be5c1d640 1 -- 172.21.15.12:0/2240297203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be01b36b0 con 0x7f8be0109b10 2024-09-19T06:42:35.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.201+0000 7f8be641e640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be01091f0 0x7f8be0116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:35.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.201+0000 7f8be5c1d640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8be0109b10 0x7f8be01139d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e9c0 tx=0x7f8bdc00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:35.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.201+0000 7f8bd77fe640 1 -- 172.21.15.12:0/2240297203 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00cd80 con 0x7f8be0109b10 2024-09-19T06:42:35.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.201+0000 7f8be8682640 1 -- 172.21.15.12:0/2240297203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be01b38e0 con 0x7f8be0109b10 2024-09-19T06:42:35.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.202+0000 7f8be8682640 1 -- 172.21.15.12:0/2240297203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be01b3e40 con 0x7f8be0109b10 2024-09-19T06:42:35.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.202+0000 7f8bd77fe640 1 -- 172.21.15.12:0/2240297203 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bdc0035f0 con 0x7f8be0109b10 2024-09-19T06:42:35.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.202+0000 7f8bd77fe640 1 -- 172.21.15.12:0/2240297203 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc010670 con 0x7f8be0109b10 2024-09-19T06:42:35.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.205+0000 7f8bd77fe640 1 -- 172.21.15.12:0/2240297203 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8bdc004020 con 0x7f8be0109b10 2024-09-19T06:42:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.206+0000 7f8beaa5b740 1 Processor -- start 2024-09-19T06:42:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.206+0000 7f8beaa5b740 1 -- start start 2024-09-19T06:42:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.207+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d71090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.207+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d71a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.207+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d7c370 0x561b48d7e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.207+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561b48cd72f0 con 0x561b48d72b40 2024-09-19T06:42:35.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.207+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561b48c7ecf0 con 0x561b48d7c370 2024-09-19T06:42:35.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.207+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561b48cd32b0 con 0x561b48d715d0 2024-09-19T06:42:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.207+0000 7f8bd77fe640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8bcc0a34b0 0x7f8bcc0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.207+0000 7f8be641e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d71a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8be641e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d71a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45224/0 (socket says 172.21.15.12:45224) 2024-09-19T06:42:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8be641e640 1 -- 172.21.15.12:0/447627136 learned_addr learned my addr 172.21.15.12:0/447627136 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8bd77fe640 1 -- 172.21.15.12:0/2240297203 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8bdc0d0010 con 0x7f8be0109b10 2024-09-19T06:42:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8be6c1f640 1 --2- 172.21.15.12:0/447627136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d71090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8be641e640 1 -- 172.21.15.12:0/447627136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d7c370 msgr2=0x561b48d7e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8be6c1f640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8bcc0a34b0 0x7f8bcc0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8be641e640 1 --2- 172.21.15.12:0/447627136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d7c370 0x561b48d7e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8be641e640 1 -- 172.21.15.12:0/447627136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 msgr2=0x561b48d71090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8be641e640 1 --2- 172.21.15.12:0/447627136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d71090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8be641e640 1 -- 172.21.15.12:0/447627136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b48c633a0 con 0x561b48d715d0 2024-09-19T06:42:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.208+0000 7f8be641e640 1 --2- 172.21.15.12:0/447627136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d71a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00057c0 tx=0x7f8bd0009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24106d4454aa09f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.209+0000 7f8bd4ff9640 1 -- 172.21.15.12:0/447627136 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0041020 con 0x561b48d715d0 2024-09-19T06:42:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.209+0000 7f8bd4ff9640 1 -- 172.21.15.12:0/447627136 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd0004240 con 0x561b48d715d0 2024-09-19T06:42:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.210+0000 7f8beaa5b740 1 -- 172.21.15.12:0/447627136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 msgr2=0x561b48d71a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.210+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/447627136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d71a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00057c0 tx=0x7f8bd0009520 comp rx=0 tx=0).stop 2024-09-19T06:42:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.211+0000 7f8be6c1f640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8bcc0a34b0 0x7f8bcc0a5970 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8be006b430 tx=0x7f8bd8009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.211+0000 7f8beaa5b740 1 -- 172.21.15.12:0/447627136 shutdown_connections 2024-09-19T06:42:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.211+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/447627136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d7c370 0x561b48d7e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.211+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/447627136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d71a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.211+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/447627136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d71090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.211+0000 7f8beaa5b740 1 -- 172.21.15.12:0/447627136 >> 172.21.15.12:0/447627136 conn(0x561b48d3a310 msgr2=0x561b48d6dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.212+0000 7f8beaa5b740 1 -- 172.21.15.12:0/447627136 shutdown_connections 2024-09-19T06:42:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.212+0000 7f8beaa5b740 1 -- 172.21.15.12:0/447627136 wait complete. 2024-09-19T06:42:35.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.213+0000 7f8beaa5b740 1 -- start start 2024-09-19T06:42:35.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.213+0000 7f8beaa5b740 1 Processor -- start 2024-09-19T06:42:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d7bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d78f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d7c370 0x561b48d79450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8be641e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d7bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561b48d7f060 con 0x561b48d72b40 2024-09-19T06:42:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561b48c92060 con 0x561b48d7c370 2024-09-19T06:42:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561b48d7f1e0 con 0x561b48d715d0 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8be641e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d7bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45238/0 (socket says 172.21.15.12:45238) 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8be6c1f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d7c370 0x561b48d79450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8be641e640 1 -- 172.21.15.12:0/3312479242 learned_addr learned my addr 172.21.15.12:0/3312479242 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8beaa5b740 10 client.0 _ll_register_callbacks cb 0x561b489e58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.214+0000 7f8be5c1d640 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d78f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8be6c1f640 1 -- 172.21.15.12:0/3312479242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 msgr2=0x561b48d7bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8be6c1f640 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d7bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8be6c1f640 1 -- 172.21.15.12:0/3312479242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 msgr2=0x561b48d78f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8be6c1f640 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d78f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8be6c1f640 1 -- 172.21.15.12:0/3312479242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b48a483c0 con 0x561b48d7c370 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8be641e640 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d7bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8be6c1f640 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d7c370 0x561b48d79450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8005fd0 tx=0x7f8bd8004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c9014ad1c6583 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8bc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:42:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/3312479242 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd802c060 con 0x561b48d7c370 2024-09-19T06:42:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8beaa5b740 1 -- 172.21.15.12:0/3312479242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bd0004240 con 0x561b48d7c370 2024-09-19T06:42:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/3312479242 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8bd800fc40 con 0x561b48d7c370 2024-09-19T06:42:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/3312479242 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8bd801ce30 con 0x561b48d7c370 2024-09-19T06:42:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.215+0000 7f8beaa5b740 10 client.25757 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.216+0000 7f8beaa5b740 1 -- 172.21.15.12:0/3312479242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561b48d8ab10 con 0x561b48d7c370 2024-09-19T06:42:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.216+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/3312479242 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd0004240 con 0x561b48d7c370 2024-09-19T06:42:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.216+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/3312479242 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f8bd80274b0 con 0x561b48d7c370 2024-09-19T06:42:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.216+0000 7f8beaa5b740 10 client.25757 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:35.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.216+0000 7f8beaa5b740 10 client.25757 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:42:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.216+0000 7f8beaa5b740 20 client.25757 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.216+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x561b48d8c070 0x561b48d8e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.216+0000 7f8beaa5b740 4 client.25757 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.216+0000 7f8beaa5b740 1 -- 172.21.15.12:0/3312479242 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b48ce4860 con 0x561b48d8c070 2024-09-19T06:42:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.216+0000 7f8be641e640 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x561b48d8c070 0x561b48d8e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.219+0000 7f8be641e640 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x561b48d8c070 0x561b48d8e4b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d65a633e371039d server_cookie=8621d2d094a9f6e6 in_seq=0 out_seq=0 2024-09-19T06:42:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.219+0000 7f8bc9ffb640 10 client.25757 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:42:35.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.220+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/3312479242 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b48ce4860 con 0x561b48d8c070 2024-09-19T06:42:35.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.220+0000 7f8bc9ffb640 10 client.25757 handle_command_reply: tid=0 2024-09-19T06:42:35.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.220+0000 7f8beaa5b740 1 client.25757 shutdown 2024-09-19T06:42:35.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.220+0000 7f8beaa5b740 1 -- 172.21.15.12:0/3312479242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d7c370 msgr2=0x561b48d79450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:35.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.220+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d7c370 0x561b48d79450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8005fd0 tx=0x7f8bd8004ab0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.221+0000 7f8beaa5b740 1 -- 172.21.15.12:0/3312479242 shutdown_connections 2024-09-19T06:42:35.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.221+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x561b48d8c070 0x561b48d8e4b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.221+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d7c370 0x561b48d79450 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.221+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d78f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.221+0000 7f8bc9ffb640 0 client.25757 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:42:35.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.221+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/3312479242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d715d0 0x561b48d7bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.221+0000 7f8beaa5b740 1 -- 172.21.15.12:0/3312479242 >> 172.21.15.12:0/3312479242 conn(0x561b48d3a310 msgr2=0x561b48d73930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:35.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.221+0000 7f8beaa5b740 1 -- 172.21.15.12:0/3312479242 shutdown_connections 2024-09-19T06:42:35.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.221+0000 7f8beaa5b740 1 -- 172.21.15.12:0/3312479242 wait complete. 2024-09-19T06:42:35.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.222+0000 7f8beaa5b740 20 client.25757 trim_cache size 0 max 16384 2024-09-19T06:42:35.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.249+0000 7f8beaa5b740 1 Processor -- start 2024-09-19T06:42:35.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8beaa5b740 1 -- start start 2024-09-19T06:42:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d3a310 0x561b48d6de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d715d0 0x561b48d883e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d72b40 0x561b48d787d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc400ea20 con 0x561b48d715d0 2024-09-19T06:42:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4010650 con 0x561b48d3a310 2024-09-19T06:42:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc400f0f0 con 0x561b48d72b40 2024-09-19T06:42:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8be641e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d3a310 0x561b48d6de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8be641e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d3a310 0x561b48d6de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:55156/0 (socket says 172.21.15.12:55156) 2024-09-19T06:42:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8be641e640 1 -- 172.21.15.12:0/820634057 learned_addr learned my addr 172.21.15.12:0/820634057 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8be6c1f640 1 --2- 172.21.15.12:0/820634057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d72b40 0x561b48d787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8be5c1d640 1 --2- 172.21.15.12:0/820634057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d715d0 0x561b48d883e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8be641e640 1 -- 172.21.15.12:0/820634057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d72b40 msgr2=0x561b48d787d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.250+0000 7f8be641e640 1 --2- 172.21.15.12:0/820634057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d72b40 0x561b48d787d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.251+0000 7f8be641e640 1 -- 172.21.15.12:0/820634057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d715d0 msgr2=0x561b48d883e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.251+0000 7f8be641e640 1 --2- 172.21.15.12:0/820634057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d715d0 0x561b48d883e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.251+0000 7f8be641e640 1 -- 172.21.15.12:0/820634057 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b48d7b880 con 0x561b48d3a310 2024-09-19T06:42:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.251+0000 7f8be641e640 1 --2- 172.21.15.12:0/820634057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d3a310 0x561b48d6de10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00057c0 tx=0x7f8bd0005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d37ed2710872a23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.251+0000 7f8bcbfff640 1 -- 172.21.15.12:0/820634057 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0041070 con 0x561b48d3a310 2024-09-19T06:42:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.251+0000 7f8bcbfff640 1 -- 172.21.15.12:0/820634057 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd0005520 con 0x561b48d3a310 2024-09-19T06:42:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.251+0000 7f8bcbfff640 1 -- 172.21.15.12:0/820634057 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0004240 con 0x561b48d3a310 2024-09-19T06:42:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.252+0000 7f8beaa5b740 1 -- 172.21.15.12:0/820634057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d3a310 msgr2=0x561b48d6de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.252+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/820634057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d3a310 0x561b48d6de10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00057c0 tx=0x7f8bd0005dc0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.252+0000 7f8beaa5b740 1 -- 172.21.15.12:0/820634057 shutdown_connections 2024-09-19T06:42:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.252+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/820634057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d72b40 0x561b48d787d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.252+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/820634057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d715d0 0x561b48d883e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.252+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/820634057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d3a310 0x561b48d6de10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.252+0000 7f8beaa5b740 1 -- 172.21.15.12:0/820634057 >> 172.21.15.12:0/820634057 conn(0x561b48d795b0 msgr2=0x561b48d6d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.253+0000 7f8beaa5b740 1 -- 172.21.15.12:0/820634057 shutdown_connections 2024-09-19T06:42:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.253+0000 7f8beaa5b740 1 -- 172.21.15.12:0/820634057 wait complete. 2024-09-19T06:42:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.253+0000 7f8beaa5b740 1 -- start start 2024-09-19T06:42:35.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.254+0000 7f8beaa5b740 1 Processor -- start 2024-09-19T06:42:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.254+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d3a310 0x561b48d84b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.254+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d715d0 0x561b48d7fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.254+0000 7f8beaa5b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.254+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc400fec0 con 0x561b48d72b40 2024-09-19T06:42:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.254+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc400f7f0 con 0x561b48d715d0 2024-09-19T06:42:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.254+0000 7f8beaa5b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc400ca00 con 0x561b48d3a310 2024-09-19T06:42:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.254+0000 7f8beaa5b740 10 client.0 _ll_register_callbacks cb 0x7f8bd8009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be641e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d3a310 0x561b48d84b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be641e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d3a310 0x561b48d84b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45248/0 (socket says 172.21.15.12:45248) 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be641e640 1 -- 172.21.15.12:0/1458840357 learned_addr learned my addr 172.21.15.12:0/1458840357 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be5c1d640 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d715d0 0x561b48d7fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be6c1f640 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be641e640 1 -- 172.21.15.12:0/1458840357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d715d0 msgr2=0x561b48d7fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be641e640 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d715d0 0x561b48d7fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be641e640 1 -- 172.21.15.12:0/1458840357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 msgr2=0x561b48d803c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be641e640 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d803c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be641e640 1 -- 172.21.15.12:0/1458840357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b48d80a30 con 0x561b48d3a310 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be5c1d640 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d715d0 0x561b48d7fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.255+0000 7f8be6c1f640 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d803c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.259+0000 7f8be641e640 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d3a310 0x561b48d84b00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8bd002a900 tx=0x7f8bd002a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e108d93a13bb31bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.259+0000 7f8bc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:42:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.260+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/1458840357 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0052060 con 0x561b48d3a310 2024-09-19T06:42:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.260+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/1458840357 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8bd0003730 con 0x561b48d3a310 2024-09-19T06:42:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.261+0000 7f8beaa5b740 1 -- 172.21.15.12:0/1458840357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bd0005520 con 0x561b48d3a310 2024-09-19T06:42:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.262+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/1458840357 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8bd0041040 con 0x561b48d3a310 2024-09-19T06:42:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.263+0000 7f8beaa5b740 10 client.25783 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.263+0000 7f8beaa5b740 1 -- 172.21.15.12:0/1458840357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561b48df6c00 con 0x561b48d3a310 2024-09-19T06:42:35.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.264+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/1458840357 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bd0005520 con 0x561b48d3a310 2024-09-19T06:42:35.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.264+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/1458840357 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f8bd00047d0 con 0x561b48d3a310 2024-09-19T06:42:35.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.264+0000 7f8beaa5b740 10 client.25783 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.264+0000 7f8beaa5b740 10 client.25783 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:42:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.264+0000 7f8beaa5b740 20 client.25783 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.264+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x561b48d7c370 0x561b48df8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.264+0000 7f8beaa5b740 4 client.25783 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:42:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.264+0000 7f8beaa5b740 1 -- 172.21.15.12:0/1458840357 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b48cded70 con 0x561b48d7c370 2024-09-19T06:42:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.265+0000 7f8be5c1d640 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x561b48d7c370 0x561b48df8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.266+0000 7f8be5c1d640 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x561b48d7c370 0x561b48df8de0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b9c4dda3f055c926 server_cookie=fcecace0b8e4f19d in_seq=0 out_seq=0 2024-09-19T06:42:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.266+0000 7f8bc9ffb640 10 client.25783 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:42:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.266+0000 7f8bc9ffb640 1 -- 172.21.15.12:0/1458840357 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b48cded70 con 0x561b48d7c370 2024-09-19T06:42:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.266+0000 7f8bc9ffb640 10 client.25783 handle_command_reply: tid=0 2024-09-19T06:42:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.266+0000 7f8beaa5b740 1 client.25783 shutdown 2024-09-19T06:42:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.267+0000 7f8beaa5b740 1 -- 172.21.15.12:0/1458840357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d3a310 msgr2=0x561b48d84b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.267+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d3a310 0x561b48d84b00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8bd002a900 tx=0x7f8bd002a340 comp rx=0 tx=0).stop 2024-09-19T06:42:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.267+0000 7f8beaa5b740 1 -- 172.21.15.12:0/1458840357 shutdown_connections 2024-09-19T06:42:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.267+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x561b48d7c370 0x561b48df8de0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.267+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b48d72b40 0x561b48d803c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.267+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b48d715d0 0x561b48d7fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.267+0000 7f8beaa5b740 1 --2- 172.21.15.12:0/1458840357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b48d3a310 0x561b48d84b00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.267+0000 7f8beaa5b740 1 -- 172.21.15.12:0/1458840357 >> 172.21.15.12:0/1458840357 conn(0x561b48d795b0 msgr2=0x561b48d773e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:35.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.267+0000 7f8bc9ffb640 0 client.25783 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:42:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.268+0000 7f8beaa5b740 1 -- 172.21.15.12:0/1458840357 shutdown_connections 2024-09-19T06:42:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.268+0000 7f8beaa5b740 1 -- 172.21.15.12:0/1458840357 wait complete. 2024-09-19T06:42:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.269+0000 7f8beaa5b740 20 client.25783 trim_cache size 0 max 16384 2024-09-19T06:42:35.271 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:42:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.270+0000 7f8be8682640 1 -- 172.21.15.12:0/2240297203 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8bcc0a34b0 msgr2=0x7f8bcc0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.270+0000 7f8be8682640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8bcc0a34b0 0x7f8bcc0a5970 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8be006b430 tx=0x7f8bd8009500 comp rx=0 tx=0).stop 2024-09-19T06:42:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.270+0000 7f8be8682640 1 -- 172.21.15.12:0/2240297203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8be0109b10 msgr2=0x7f8be01139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.270+0000 7f8be8682640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8be0109b10 0x7f8be01139d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e9c0 tx=0x7f8bdc00edc0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.270+0000 7f8be8682640 1 -- 172.21.15.12:0/2240297203 shutdown_connections 2024-09-19T06:42:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.270+0000 7f8be8682640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8bcc0a34b0 0x7f8bcc0a5970 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.270+0000 7f8be8682640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be0116ea0 0x7f8be01140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.271+0000 7f8be8682640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8be0109b10 0x7f8be01139d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.271+0000 7f8be8682640 1 --2- 172.21.15.12:0/2240297203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8be01091f0 0x7f8be0116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.271+0000 7f8be8682640 1 -- 172.21.15.12:0/2240297203 >> 172.21.15.12:0/2240297203 conn(0x7f8be006e140 msgr2=0x7f8be0117500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:35.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.271+0000 7f8be8682640 1 -- 172.21.15.12:0/2240297203 shutdown_connections 2024-09-19T06:42:35.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:35.271+0000 7f8be8682640 1 -- 172.21.15.12:0/2240297203 wait complete. 2024-09-19T06:42:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 110.0 s, 4677.4 tps, lat 21.375 ms stddev 22.965 2024-09-19T06:42:36.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:35 smithi016 ceph-mon[34911]: pgmap v76: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 22 MiB/s wr, 1.13k op/s 2024-09-19T06:42:36.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:35 smithi173 ceph-mon[35349]: pgmap v76: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 22 MiB/s wr, 1.13k op/s 2024-09-19T06:42:36.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:35 smithi012 ceph-mon[30937]: pgmap v76: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 22 MiB/s wr, 1.13k op/s 2024-09-19T06:42:36.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:42:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.512+0000 7f09c9ce4640 1 -- 172.21.15.12:0/2375400500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c410e7b0 msgr2=0x7f09c4115130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.513+0000 7f09c9ce4640 1 --2- 172.21.15.12:0/2375400500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c410e7b0 0x7f09c4115130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009be0 tx=0x7f09bc02a6c0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.513+0000 7f09c9ce4640 1 -- 172.21.15.12:0/2375400500 shutdown_connections 2024-09-19T06:42:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.513+0000 7f09c9ce4640 1 --2- 172.21.15.12:0/2375400500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c410e7b0 0x7f09c4115130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.513+0000 7f09c9ce4640 1 --2- 172.21.15.12:0/2375400500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09c4109c40 0x7f09c410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.513+0000 7f09c9ce4640 1 --2- 172.21.15.12:0/2375400500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c4109290 0x7f09c4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.513+0000 7f09c9ce4640 1 -- 172.21.15.12:0/2375400500 >> 172.21.15.12:0/2375400500 conn(0x7f09c4077c10 msgr2=0x7f09c407a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.514+0000 7f09c9ce4640 1 -- 172.21.15.12:0/2375400500 shutdown_connections 2024-09-19T06:42:37.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.514+0000 7f09c9ce4640 1 -- 172.21.15.12:0/2375400500 wait complete. 2024-09-19T06:42:37.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.515+0000 7f09c9ce4640 1 Processor -- start 2024-09-19T06:42:37.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.516+0000 7f09c9ce4640 1 -- start start 2024-09-19T06:42:37.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.517+0000 7f09c9ce4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09c4109290 0x7f09c419ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.517+0000 7f09c9ce4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4109c40 0x7f09c419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.517+0000 7f09c9ce4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c410e7b0 0x7f09c41a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.517+0000 7f09c9ce4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09c41185c0 con 0x7f09c410e7b0 2024-09-19T06:42:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.517+0000 7f09baffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4109c40 0x7f09c419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.517+0000 7f09baffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4109c40 0x7f09c419f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45264/0 (socket says 172.21.15.12:45264) 2024-09-19T06:42:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.517+0000 7f09baffd640 1 -- 172.21.15.12:0/1360500438 learned_addr learned my addr 172.21.15.12:0/1360500438 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.518+0000 7f09c3fff640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c410e7b0 0x7f09c41a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.518+0000 7f09c9ce4640 1 -- 172.21.15.12:0/1360500438 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f09c4118440 con 0x7f09c4109290 2024-09-19T06:42:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.518+0000 7f09c9ce4640 1 -- 172.21.15.12:0/1360500438 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09c4118740 con 0x7f09c4109c40 2024-09-19T06:42:37.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.519+0000 7f09c37fe640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09c4109290 0x7f09c419ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.520+0000 7f09c37fe640 1 -- 172.21.15.12:0/1360500438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4109c40 msgr2=0x7f09c419f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:37.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.520+0000 7f09c37fe640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4109c40 0x7f09c419f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.520+0000 7f09c37fe640 1 -- 172.21.15.12:0/1360500438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c410e7b0 msgr2=0x7f09c41a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:37.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.520+0000 7f09c37fe640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c410e7b0 0x7f09c41a33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.520+0000 7f09c37fe640 1 -- 172.21.15.12:0/1360500438 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c41a3b00 con 0x7f09c4109290 2024-09-19T06:42:37.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.520+0000 7f09c37fe640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09c4109290 0x7f09c419ead0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09b4005fd0 tx=0x7f09b400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:37.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.521+0000 7f09c17fa640 1 -- 172.21.15.12:0/1360500438 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4009c30 con 0x7f09c4109290 2024-09-19T06:42:37.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.521+0000 7f09c17fa640 1 -- 172.21.15.12:0/1360500438 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09b4009dd0 con 0x7f09c4109290 2024-09-19T06:42:37.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.521+0000 7f09c17fa640 1 -- 172.21.15.12:0/1360500438 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4010460 con 0x7f09c4109290 2024-09-19T06:42:37.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.521+0000 7f09c9ce4640 1 -- 172.21.15.12:0/1360500438 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c41a3df0 con 0x7f09c4109290 2024-09-19T06:42:37.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.521+0000 7f09c9ce4640 1 -- 172.21.15.12:0/1360500438 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c41ab680 con 0x7f09c4109290 2024-09-19T06:42:37.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.525+0000 7f09c17fa640 1 -- 172.21.15.12:0/1360500438 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f09b4003ef0 con 0x7f09c4109290 2024-09-19T06:42:37.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.527+0000 7f09c17fa640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09b00a3430 0x7f09b00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.527+0000 7f09c17fa640 1 -- 172.21.15.12:0/1360500438 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f09b40cf990 con 0x7f09c4109290 2024-09-19T06:42:37.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.527+0000 7f09cc0bd740 1 Processor -- start 2024-09-19T06:42:37.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.528+0000 7f09cc0bd740 1 -- start start 2024-09-19T06:42:37.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.528+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.528+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.528+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00da760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.528+0000 7f09cc0bd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5585e00332f0 con 0x5585e00d8370 2024-09-19T06:42:37.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.528+0000 7f09cc0bd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5585dffdacf0 con 0x5585e00cd5d0 2024-09-19T06:42:37.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.528+0000 7f09cc0bd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5585e002f2b0 con 0x5585e00ceb40 2024-09-19T06:42:37.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.528+0000 7f09baffd640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09b00a3430 0x7f09b00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.528+0000 7f09c37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.529+0000 7f09baffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.529+0000 7f09baffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:55188/0 (socket says 172.21.15.12:55188) 2024-09-19T06:42:37.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.529+0000 7f09baffd640 1 -- 172.21.15.12:0/2407449413 learned_addr learned my addr 172.21.15.12:0/2407449413 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:37.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.529+0000 7f09baffd640 1 -- 172.21.15.12:0/2407449413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 msgr2=0x5585e00cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:37.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.529+0000 7f09baffd640 1 --2- 172.21.15.12:0/2407449413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.529+0000 7f09baffd640 1 -- 172.21.15.12:0/2407449413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 msgr2=0x5585e00da760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:37.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.529+0000 7f09c3fff640 1 --2- 172.21.15.12:0/2407449413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.529+0000 7f09baffd640 1 --2- 172.21.15.12:0/2407449413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00da760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.529+0000 7f09baffd640 1 -- 172.21.15.12:0/2407449413 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dffbf3a0 con 0x5585e00cd5d0 2024-09-19T06:42:37.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.529+0000 7f09c3fff640 1 --2- 172.21.15.12:0/2407449413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:42:37.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.530+0000 7f09baffd640 1 --2- 172.21.15.12:0/2407449413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00cda10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00e6b0 tx=0x7f09ac01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ea4a5abdc60b1de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:37.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.530+0000 7f09baffd640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09b00a3430 0x7f09b00a58f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f09ac012440 tx=0x7f09ac012840 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:37.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.530+0000 7f09b9ffb640 1 -- 172.21.15.12:0/2407449413 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac023030 con 0x5585e00cd5d0 2024-09-19T06:42:37.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.530+0000 7f09b9ffb640 1 -- 172.21.15.12:0/2407449413 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09ac01f9d0 con 0x5585e00cd5d0 2024-09-19T06:42:37.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.531+0000 7f09b9ffb640 1 -- 172.21.15.12:0/2407449413 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac027a00 con 0x5585e00cd5d0 2024-09-19T06:42:37.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.532+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2407449413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 msgr2=0x5585e00cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:37.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.532+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2407449413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00cda10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00e6b0 tx=0x7f09ac01a000 comp rx=0 tx=0).stop 2024-09-19T06:42:37.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.532+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2407449413 shutdown_connections 2024-09-19T06:42:37.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.532+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2407449413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.532+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2407449413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00cda10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.532+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2407449413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.532+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2407449413 >> 172.21.15.12:0/2407449413 conn(0x5585e0096310 msgr2=0x5585e00c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:37.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.532+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2407449413 shutdown_connections 2024-09-19T06:42:37.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.533+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2407449413 wait complete. 2024-09-19T06:42:37.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.533+0000 7f09cc0bd740 1 -- start start 2024-09-19T06:42:37.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.533+0000 7f09cc0bd740 1 Processor -- start 2024-09-19T06:42:37.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.534+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00cd5d0 0x5585e00d7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.534+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00ceb40 0x5585e00d5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.534+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00d8370 0x5585e00d57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.534+0000 7f09cc0bd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5585e00db060 con 0x5585e00ceb40 2024-09-19T06:42:37.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.534+0000 7f09cc0bd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5585dffee060 con 0x5585e00d8370 2024-09-19T06:42:37.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.534+0000 7f09cc0bd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5585e00db1e0 con 0x5585e00cd5d0 2024-09-19T06:42:37.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.534+0000 7f09cc0bd740 10 client.0 _ll_register_callbacks cb 0x5585dfd418c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:37.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.534+0000 7f09c37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00cd5d0 0x5585e00d7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.534+0000 7f09c37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00cd5d0 0x5585e00d7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45276/0 (socket says 172.21.15.12:45276) 2024-09-19T06:42:37.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.534+0000 7f09c37fe640 1 -- 172.21.15.12:0/2619777043 learned_addr learned my addr 172.21.15.12:0/2619777043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:37.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.535+0000 7f09c3fff640 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00d8370 0x5585e00d57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.535+0000 7f09c3fff640 1 -- 172.21.15.12:0/2619777043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00cd5d0 msgr2=0x5585e00d7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:37.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.535+0000 7f09c3fff640 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00cd5d0 0x5585e00d7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.535+0000 7f09c3fff640 1 -- 172.21.15.12:0/2619777043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00ceb40 msgr2=0x5585e00d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.535+0000 7f09c3fff640 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00ceb40 0x5585e00d5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.535+0000 7f09c3fff640 1 -- 172.21.15.12:0/2619777043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585dfda43c0 con 0x5585e00d8370 2024-09-19T06:42:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.535+0000 7f09c3fff640 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00d8370 0x5585e00d57e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009b30 tx=0x7f09bc030ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa2ffb3abf704a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.535+0000 7f09a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:42:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.536+0000 7f09a2ffd640 1 -- 172.21.15.12:0/2619777043 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc041070 con 0x5585e00d8370 2024-09-19T06:42:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.536+0000 7f09a2ffd640 1 -- 172.21.15.12:0/2619777043 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f09bc0303a0 con 0x5585e00d8370 2024-09-19T06:42:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.536+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2619777043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09ac01f9d0 con 0x5585e00d8370 2024-09-19T06:42:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.536+0000 7f09a2ffd640 1 -- 172.21.15.12:0/2619777043 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f09bc04b050 con 0x5585e00d8370 2024-09-19T06:42:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.536+0000 7f09cc0bd740 10 client.25775 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.536+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2619777043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5585e00e6ab0 con 0x5585e00d8370 2024-09-19T06:42:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.537+0000 7f09a2ffd640 1 -- 172.21.15.12:0/2619777043 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09ac01f9d0 con 0x5585e00d8370 2024-09-19T06:42:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.537+0000 7f09a2ffd640 1 -- 172.21.15.12:0/2619777043 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f09bc004340 con 0x5585e00d8370 2024-09-19T06:42:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.537+0000 7f09cc0bd740 10 client.25775 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.537+0000 7f09cc0bd740 10 client.25775 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:42:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.537+0000 7f09cc0bd740 20 client.25775 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.537+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5585e00e7f70 0x5585e00ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.537+0000 7f09cc0bd740 4 client.25775 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.537+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2619777043 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585e0040860 con 0x5585e00e7f70 2024-09-19T06:42:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.539+0000 7f09c37fe640 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5585e00e7f70 0x5585e00ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.540+0000 7f09a2ffd640 10 client.25775 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:42:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.540+0000 7f09c37fe640 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5585e00e7f70 0x5585e00ea3e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=31ac7b271ee14486 server_cookie=cfbb27f1d18dc786 in_seq=0 out_seq=0 2024-09-19T06:42:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.541+0000 7f09a2ffd640 1 -- 172.21.15.12:0/2619777043 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585e0040860 con 0x5585e00e7f70 2024-09-19T06:42:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.541+0000 7f09a2ffd640 10 client.25775 handle_command_reply: tid=0 2024-09-19T06:42:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.541+0000 7f09cc0bd740 1 client.25775 shutdown 2024-09-19T06:42:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.545+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2619777043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00d8370 msgr2=0x5585e00d57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.545+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00d8370 0x5585e00d57e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f09bc009b30 tx=0x7f09bc030ac0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.545+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2619777043 shutdown_connections 2024-09-19T06:42:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.545+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5585e00e7f70 0x5585e00ea3e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.545+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00d8370 0x5585e00d57e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.545+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00ceb40 0x5585e00d5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.545+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2619777043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00cd5d0 0x5585e00d7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.545+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2619777043 >> 172.21.15.12:0/2619777043 conn(0x5585e0096310 msgr2=0x5585e00cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.545+0000 7f09a2ffd640 0 client.25775 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:42:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.548+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2619777043 shutdown_connections 2024-09-19T06:42:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.548+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2619777043 wait complete. 2024-09-19T06:42:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.548+0000 7f09cc0bd740 20 client.25775 trim_cache size 0 max 16384 2024-09-19T06:42:37.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.575+0000 7f09cc0bd740 1 Processor -- start 2024-09-19T06:42:37.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.575+0000 7f09cc0bd740 1 -- start start 2024-09-19T06:42:37.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.576+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.576+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.576+0000 7f09c37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.576+0000 7f09c37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:55202/0 (socket says 172.21.15.12:55202) 2024-09-19T06:42:37.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.576+0000 7f09baffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.577+0000 7f09baffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00efcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45282/0 (socket says 172.21.15.12:45282) 2024-09-19T06:42:37.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.577+0000 7f09c37fe640 1 -- 172.21.15.12:0/2837011842 learned_addr learned my addr 172.21.15.12:0/2837011842 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:37.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.577+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2837011842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.577+0000 7f09c3fff640 1 --2- 172.21.15.12:0/2837011842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.578+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2837011842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09c41b4290 con 0x5585e00d8370 2024-09-19T06:42:37.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.578+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2837011842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f09c41b5ec0 con 0x5585e00cd5d0 2024-09-19T06:42:37.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.578+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2837011842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09c41b4960 con 0x5585e00ceb40 2024-09-19T06:42:37.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.580+0000 7f09c37fe640 1 -- 172.21.15.12:0/2837011842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 msgr2=0x5585e00efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:37.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.580+0000 7f09c37fe640 1 --2- 172.21.15.12:0/2837011842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00efcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.580+0000 7f09c37fe640 1 -- 172.21.15.12:0/2837011842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 msgr2=0x5585e00f01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:37.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.580+0000 7f09c37fe640 1 --2- 172.21.15.12:0/2837011842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00f01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.580+0000 7f09c37fe640 1 -- 172.21.15.12:0/2837011842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585e00c9510 con 0x5585e00cd5d0 2024-09-19T06:42:37.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.581+0000 7f09baffd640 1 --2- 172.21.15.12:0/2837011842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:37.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.581+0000 7f09c37fe640 1 --2- 172.21.15.12:0/2837011842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00c9e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09b409bb80 tx=0x7f09b4086040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d70ab2a6a2a02b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:37.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.581+0000 7f09b97fa640 1 -- 172.21.15.12:0/2837011842 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b40b2070 con 0x5585e00cd5d0 2024-09-19T06:42:37.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.581+0000 7f09b97fa640 1 -- 172.21.15.12:0/2837011842 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09b40a4860 con 0x5585e00cd5d0 2024-09-19T06:42:37.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.582+0000 7f09b97fa640 1 -- 172.21.15.12:0/2837011842 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4020040 con 0x5585e00cd5d0 2024-09-19T06:42:37.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.584+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2837011842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 msgr2=0x5585e00c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:37.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.584+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2837011842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00c9e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09b409bb80 tx=0x7f09b4086040 comp rx=0 tx=0).stop 2024-09-19T06:42:37.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.584+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2837011842 shutdown_connections 2024-09-19T06:42:37.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.584+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2837011842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.584+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2837011842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.584+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/2837011842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00c9e10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.584+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2837011842 >> 172.21.15.12:0/2837011842 conn(0x5585e0096310 msgr2=0x5585e00c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:37.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.585+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2837011842 shutdown_connections 2024-09-19T06:42:37.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.585+0000 7f09cc0bd740 1 -- 172.21.15.12:0/2837011842 wait complete. 2024-09-19T06:42:37.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.586+0000 7f09cc0bd740 1 -- start start 2024-09-19T06:42:37.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.586+0000 7f09cc0bd740 1 Processor -- start 2024-09-19T06:42:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.587+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00e0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.587+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.587+0000 7f09c37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.587+0000 7f09c37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00e0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:55214/0 (socket says 172.21.15.12:55214) 2024-09-19T06:42:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.587+0000 7f09baffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.587+0000 7f09baffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00e0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45296/0 (socket says 172.21.15.12:45296) 2024-09-19T06:42:37.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.587+0000 7f09cc0bd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00dc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.588+0000 7f09c3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00dc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.588+0000 7f09c3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00dc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42400/0 (socket says 172.21.15.12:42400) 2024-09-19T06:42:37.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.588+0000 7f09c37fe640 1 -- 172.21.15.12:0/797459668 learned_addr learned my addr 172.21.15.12:0/797459668 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:37.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.588+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09c41b5730 con 0x5585e00d8370 2024-09-19T06:42:37.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.589+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f09c41b5060 con 0x5585e00cd5d0 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.589+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09c41b2270 con 0x5585e00ceb40 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.589+0000 7f09cc0bd740 10 client.0 _ll_register_callbacks cb 0x7f09c4076560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.589+0000 7f09c37fe640 1 -- 172.21.15.12:0/797459668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 msgr2=0x5585e00e0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.589+0000 7f09c37fe640 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00e0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.589+0000 7f09c37fe640 1 -- 172.21.15.12:0/797459668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 msgr2=0x5585e00dc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.589+0000 7f09c37fe640 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00dc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.589+0000 7f09c37fe640 1 -- 172.21.15.12:0/797459668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585e00dd1b0 con 0x5585e00cd5d0 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.590+0000 7f09c37fe640 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00e0540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09b409bdb0 tx=0x7f09b400df10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e3794046ccfd9eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.590+0000 7f09a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.590+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09b40a4860 con 0x5585e00cd5d0 2024-09-19T06:42:37.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.590+0000 7f09a2ffd640 1 -- 172.21.15.12:0/797459668 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4020070 con 0x5585e00cd5d0 2024-09-19T06:42:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.591+0000 7f09a2ffd640 1 -- 172.21.15.12:0/797459668 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f09b4098260 con 0x5585e00cd5d0 2024-09-19T06:42:37.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.591+0000 7f09a2ffd640 1 -- 172.21.15.12:0/797459668 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f09b40b2070 con 0x5585e00cd5d0 2024-09-19T06:42:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.591+0000 7f09cc0bd740 10 client.25781 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.591+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5585e01535c0 con 0x5585e00cd5d0 2024-09-19T06:42:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.592+0000 7f09a2ffd640 1 -- 172.21.15.12:0/797459668 <== mon.2 v2:172.21.15.16:3300/0 4 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f09b40a43d0 con 0x5585e00cd5d0 2024-09-19T06:42:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.592+0000 7f09cc0bd740 10 client.25781 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.592+0000 7f09cc0bd740 10 client.25781 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:42:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.592+0000 7f09cc0bd740 20 client.25781 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.592+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5585e0153b60 0x5585e0155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.592+0000 7f09cc0bd740 4 client.25781 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:42:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.592+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585e003ad70 con 0x5585e0153b60 2024-09-19T06:42:37.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.592+0000 7f09baffd640 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5585e0153b60 0x5585e0155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.593+0000 7f09a2ffd640 10 client.25781 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:42:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.593+0000 7f09baffd640 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5585e0153b60 0x5585e0155fa0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b41416745553c07 server_cookie=e306486956e2645b in_seq=0 out_seq=0 2024-09-19T06:42:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.593+0000 7f09a2ffd640 1 -- 172.21.15.12:0/797459668 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585e003ad70 con 0x5585e0153b60 2024-09-19T06:42:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.593+0000 7f09a2ffd640 10 client.25781 handle_command_reply: tid=0 2024-09-19T06:42:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.594+0000 7f09cc0bd740 1 client.25781 shutdown 2024-09-19T06:42:37.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.596+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 msgr2=0x5585e00e0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:37.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.596+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00e0540 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09b409bdb0 tx=0x7f09b400df10 comp rx=0 tx=0).stop 2024-09-19T06:42:37.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.596+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 shutdown_connections 2024-09-19T06:42:37.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.596+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5585e0153b60 0x5585e0155fa0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.596+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585e00d8370 0x5585e00dc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.596+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585e00ceb40 0x5585e00e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.596+0000 7f09cc0bd740 1 --2- 172.21.15.12:0/797459668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5585e00cd5d0 0x5585e00e0540 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.596+0000 7f09a2ffd640 0 client.25781 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:42:37.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.596+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 >> 172.21.15.12:0/797459668 conn(0x5585e0096310 msgr2=0x5585e00c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:37.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.599+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 shutdown_connections 2024-09-19T06:42:37.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.599+0000 7f09cc0bd740 1 -- 172.21.15.12:0/797459668 wait complete. 2024-09-19T06:42:37.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.600+0000 7f09cc0bd740 20 client.25781 trim_cache size 0 max 16384 2024-09-19T06:42:37.603 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:42:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.602+0000 7f09c9ce4640 1 -- 172.21.15.12:0/1360500438 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09b00a3430 msgr2=0x7f09b00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.602+0000 7f09c9ce4640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09b00a3430 0x7f09b00a58f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f09ac012440 tx=0x7f09ac012840 comp rx=0 tx=0).stop 2024-09-19T06:42:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.602+0000 7f09c9ce4640 1 -- 172.21.15.12:0/1360500438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09c4109290 msgr2=0x7f09c419ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.602+0000 7f09c9ce4640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09c4109290 0x7f09c419ead0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09b4005fd0 tx=0x7f09b400dde0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.603+0000 7f09c9ce4640 1 -- 172.21.15.12:0/1360500438 shutdown_connections 2024-09-19T06:42:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.603+0000 7f09c9ce4640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c410e7b0 0x7f09c41a33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.603+0000 7f09c9ce4640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09b00a3430 0x7f09b00a58f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.603+0000 7f09c9ce4640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c4109c40 0x7f09c419f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.603+0000 7f09c9ce4640 1 --2- 172.21.15.12:0/1360500438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09c4109290 0x7f09c419ead0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.603+0000 7f09c9ce4640 1 -- 172.21.15.12:0/1360500438 >> 172.21.15.12:0/1360500438 conn(0x7f09c4077c10 msgr2=0x7f09c410c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.603+0000 7f09c9ce4640 1 -- 172.21.15.12:0/1360500438 shutdown_connections 2024-09-19T06:42:37.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:37.603+0000 7f09c9ce4640 1 -- 172.21.15.12:0/1360500438 wait complete. 2024-09-19T06:42:37.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:37 smithi012 ceph-mon[30937]: pgmap v77: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 26 MiB/s wr, 1.49k op/s 2024-09-19T06:42:38.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:37 smithi016 ceph-mon[34911]: pgmap v77: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 26 MiB/s wr, 1.49k op/s 2024-09-19T06:42:38.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:37 smithi173 ceph-mon[35349]: pgmap v77: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 26 MiB/s wr, 1.49k op/s 2024-09-19T06:42:38.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:42:38.951 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:39.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.550+0000 7f769bfff640 1 -- 172.21.15.12:0/3589556396 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c030e30 con 0x7f76a4103e60 2024-09-19T06:42:39.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.550+0000 7f76ab63d640 1 -- 172.21.15.12:0/3589556396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76a4103e60 msgr2=0x7f76a4104240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:39.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.550+0000 7f76ab63d640 1 --2- 172.21.15.12:0/3589556396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76a4103e60 0x7f76a4104240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f769c009be0 tx=0x7f769c02a6d0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.551+0000 7f76ab63d640 1 -- 172.21.15.12:0/3589556396 shutdown_connections 2024-09-19T06:42:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.551+0000 7f76ab63d640 1 --2- 172.21.15.12:0/3589556396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a4108f90 0x7f76a4110b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.551+0000 7f76ab63d640 1 --2- 172.21.15.12:0/3589556396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76a4104810 0x7f76a4108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.551+0000 7f76ab63d640 1 --2- 172.21.15.12:0/3589556396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76a4103e60 0x7f76a4104240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.551+0000 7f76ab63d640 1 -- 172.21.15.12:0/3589556396 >> 172.21.15.12:0/3589556396 conn(0x7f76a40ff8e0 msgr2=0x7f76a4101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:39.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.551+0000 7f76ab63d640 1 -- 172.21.15.12:0/3589556396 shutdown_connections 2024-09-19T06:42:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.551+0000 7f76ab63d640 1 -- 172.21.15.12:0/3589556396 wait complete. 2024-09-19T06:42:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.552+0000 7f76ab63d640 1 Processor -- start 2024-09-19T06:42:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.552+0000 7f76ab63d640 1 -- start start 2024-09-19T06:42:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.552+0000 7f76ab63d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a4103e60 0x7f76a410f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.552+0000 7f76ab63d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76a4104810 0x7f76a410fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.552+0000 7f76ab63d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76a4108f90 0x7f76a4116ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.552+0000 7f76ab63d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f76a40777d0 con 0x7f76a4103e60 2024-09-19T06:42:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.552+0000 7f76ab63d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f76a4077650 con 0x7f76a4104810 2024-09-19T06:42:39.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.552+0000 7f76ab63d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f76a4077950 con 0x7f76a4108f90 2024-09-19T06:42:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a9bda640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76a4108f90 0x7f76a4116ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a93d9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a4103e60 0x7f76a410f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a8bd8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76a4104810 0x7f76a410fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a93d9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a4103e60 0x7f76a410f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42428/0 (socket says 172.21.15.12:42428) 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a8bd8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76a4104810 0x7f76a410fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:55218/0 (socket says 172.21.15.12:55218) 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a93d9640 1 -- 172.21.15.12:0/1199042715 learned_addr learned my addr 172.21.15.12:0/1199042715 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a9bda640 1 -- 172.21.15.12:0/1199042715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76a4104810 msgr2=0x7f76a410fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a9bda640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76a4104810 0x7f76a410fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a9bda640 1 -- 172.21.15.12:0/1199042715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a4103e60 msgr2=0x7f76a410f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a9bda640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a4103e60 0x7f76a410f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a9bda640 1 -- 172.21.15.12:0/1199042715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a41175f0 con 0x7f76a4108f90 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f76a9bda640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76a4108f90 0x7f76a4116ec0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009fd0 tx=0x7f76a000eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.553+0000 7f769a7fc640 1 -- 172.21.15.12:0/1199042715 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0004220 con 0x7f76a4108f90 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.554+0000 7f769a7fc640 1 -- 172.21.15.12:0/1199042715 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76a00043c0 con 0x7f76a4108f90 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.554+0000 7f76ab63d640 1 -- 172.21.15.12:0/1199042715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a41178e0 con 0x7f76a4108f90 2024-09-19T06:42:39.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.554+0000 7f76ab63d640 1 -- 172.21.15.12:0/1199042715 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a411dfb0 con 0x7f76a4108f90 2024-09-19T06:42:39.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.555+0000 7f769a7fc640 1 -- 172.21.15.12:0/1199042715 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0004a00 con 0x7f76a4108f90 2024-09-19T06:42:39.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.558+0000 7f76ada16740 1 Processor -- start 2024-09-19T06:42:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.560+0000 7f769a7fc640 1 -- 172.21.15.12:0/1199042715 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f76a0004ba0 con 0x7f76a4108f90 2024-09-19T06:42:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.560+0000 7f76ada16740 1 -- start start 2024-09-19T06:42:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.560+0000 7f76ada16740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a4cf0 0x55d1391a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.560+0000 7f76ada16740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a3780 0x55d1391a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.561+0000 7f76ada16740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391ae520 0x55d1391b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.561+0000 7f76ada16740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d1391092f0 con 0x55d1391ae520 2024-09-19T06:42:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.561+0000 7f76ada16740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d1390b0cf0 con 0x55d1391a4cf0 2024-09-19T06:42:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.561+0000 7f76ada16740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d1391052b0 con 0x55d1391a3780 2024-09-19T06:42:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.561+0000 7f76a93d9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a3780 0x55d1391a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.561+0000 7f76a93d9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a3780 0x55d1391a3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45316/0 (socket says 172.21.15.12:45316) 2024-09-19T06:42:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.561+0000 7f76a93d9640 1 -- 172.21.15.12:0/283671930 learned_addr learned my addr 172.21.15.12:0/283671930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:39.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.561+0000 7f76a8bd8640 1 --2- 172.21.15.12:0/283671930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a4cf0 0x55d1391a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.561+0000 7f76a8bd8640 1 --2- 172.21.15.12:0/283671930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391ae520 0x55d1391b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.561+0000 7f76a93d9640 1 -- 172.21.15.12:0/283671930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a4cf0 msgr2=0x55d1391a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.562+0000 7f76a93d9640 1 --2- 172.21.15.12:0/283671930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a4cf0 0x55d1391a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.562+0000 7f76a93d9640 1 -- 172.21.15.12:0/283671930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391ae520 msgr2=0x55d1391b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.562+0000 7f76a93d9640 1 --2- 172.21.15.12:0/283671930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391ae520 0x55d1391b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.562+0000 7f76a93d9640 1 -- 172.21.15.12:0/283671930 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1390953a0 con 0x55d1391a3780 2024-09-19T06:42:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.562+0000 7f769a7fc640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76900a3480 0x7f76900a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.562+0000 7f76a93d9640 1 --2- 172.21.15.12:0/283671930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a3780 0x55d1391a3bc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f769c034040 tx=0x7f769c032ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b14215861466f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.562+0000 7f769a7fc640 1 -- 172.21.15.12:0/1199042715 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f76a00cfa20 con 0x7f76a4108f90 2024-09-19T06:42:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.563+0000 7f768f7fe640 1 -- 172.21.15.12:0/283671930 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c041030 con 0x55d1391a3780 2024-09-19T06:42:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.563+0000 7f768f7fe640 1 -- 172.21.15.12:0/283671930 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f769c0303a0 con 0x55d1391a3780 2024-09-19T06:42:39.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.564+0000 7f76ada16740 1 -- 172.21.15.12:0/283671930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a3780 msgr2=0x55d1391a3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:39.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.564+0000 7f76ada16740 1 --2- 172.21.15.12:0/283671930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a3780 0x55d1391a3bc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f769c034040 tx=0x7f769c032ed0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.564+0000 7f76a8bd8640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76900a3480 0x7f76900a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.566+0000 7f76ada16740 1 -- 172.21.15.12:0/283671930 shutdown_connections 2024-09-19T06:42:39.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.566+0000 7f76ada16740 1 --2- 172.21.15.12:0/283671930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391ae520 0x55d1391b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.566+0000 7f76ada16740 1 --2- 172.21.15.12:0/283671930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a3780 0x55d1391a3bc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.566+0000 7f76ada16740 1 --2- 172.21.15.12:0/283671930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a4cf0 0x55d1391a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.566+0000 7f76ada16740 1 -- 172.21.15.12:0/283671930 >> 172.21.15.12:0/283671930 conn(0x55d13916c310 msgr2=0x55d13919fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:39.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.566+0000 7f76a8bd8640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76900a3480 0x7f76900a5940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f769400b010 tx=0x7f7694004730 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:39.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.566+0000 7f76ada16740 1 -- 172.21.15.12:0/283671930 shutdown_connections 2024-09-19T06:42:39.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.566+0000 7f76ada16740 1 -- 172.21.15.12:0/283671930 wait complete. 2024-09-19T06:42:39.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.567+0000 7f76ada16740 1 -- start start 2024-09-19T06:42:39.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.567+0000 7f76ada16740 1 Processor -- start 2024-09-19T06:42:39.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76ada16740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a3780 0x55d1391add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76ada16740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a4cf0 0x55d1391aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76ada16740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391ae520 0x55d1391ab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76ada16740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d1391b1210 con 0x55d1391a4cf0 2024-09-19T06:42:39.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76ada16740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d1390c4060 con 0x55d1391a3780 2024-09-19T06:42:39.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76ada16740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d1391b1390 con 0x55d1391ae520 2024-09-19T06:42:39.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76ada16740 10 client.0 _ll_register_callbacks cb 0x55d138e178c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:39.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76a8bd8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a4cf0 0x55d1391aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76a93d9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a3780 0x55d1391add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76a8bd8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a4cf0 0x55d1391aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42436/0 (socket says 172.21.15.12:42436) 2024-09-19T06:42:39.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76a8bd8640 1 -- 172.21.15.12:0/3289311410 learned_addr learned my addr 172.21.15.12:0/3289311410 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:39.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76a93d9640 1 -- 172.21.15.12:0/3289311410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391ae520 msgr2=0x55d1391ab530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:42:39.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.568+0000 7f76a93d9640 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391ae520 0x55d1391ab530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.569+0000 7f76a93d9640 1 -- 172.21.15.12:0/3289311410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a4cf0 msgr2=0x55d1391aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:39.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.569+0000 7f76a93d9640 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a4cf0 0x55d1391aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.569+0000 7f76a93d9640 1 -- 172.21.15.12:0/3289311410 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d138e7a3c0 con 0x55d1391a3780 2024-09-19T06:42:39.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.569+0000 7f76a93d9640 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a3780 0x55d1391add40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f769c004af0 tx=0x7f769c003af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52abf183e278d9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:39.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.569+0000 7f768cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:42:39.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.569+0000 7f768cff9640 1 -- 172.21.15.12:0/3289311410 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c04a070 con 0x55d1391a3780 2024-09-19T06:42:39.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.569+0000 7f76ada16740 1 -- 172.21.15.12:0/3289311410 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f769c0303a0 con 0x55d1391a3780 2024-09-19T06:42:39.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.570+0000 7f768cff9640 1 -- 172.21.15.12:0/3289311410 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f769c030750 con 0x55d1391a3780 2024-09-19T06:42:39.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.570+0000 7f768cff9640 1 -- 172.21.15.12:0/3289311410 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f769c056050 con 0x55d1391a3780 2024-09-19T06:42:39.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.572+0000 7f76ada16740 10 client.25790 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:39.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.572+0000 7f76ada16740 1 -- 172.21.15.12:0/3289311410 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d1391bcbe0 con 0x55d1391a3780 2024-09-19T06:42:39.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.572+0000 7f768cff9640 1 -- 172.21.15.12:0/3289311410 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f769c0303a0 con 0x55d1391a3780 2024-09-19T06:42:39.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.572+0000 7f768cff9640 1 -- 172.21.15.12:0/3289311410 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f769c0046d0 con 0x55d1391a3780 2024-09-19T06:42:39.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.572+0000 7f76ada16740 10 client.25790 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:39.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.572+0000 7f76ada16740 10 client.25790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:39.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.572+0000 7f76ada16740 20 client.25790 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:39.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.573+0000 7f76ada16740 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d1391bdf30 0x55d1391c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.573+0000 7f76ada16740 4 client.25790 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:39.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.573+0000 7f76ada16740 1 -- 172.21.15.12:0/3289311410 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d139116860 con 0x55d1391bdf30 2024-09-19T06:42:39.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.573+0000 7f76a8bd8640 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d1391bdf30 0x55d1391c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.575+0000 7f768cff9640 10 client.25790 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.575+0000 7f76a8bd8640 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d1391bdf30 0x55d1391c0320 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeda179a252267a7 server_cookie=bd71b96e74c5f4f4 in_seq=0 out_seq=0 2024-09-19T06:42:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.576+0000 7f768cff9640 1 -- 172.21.15.12:0/3289311410 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d139116860 con 0x55d1391bdf30 2024-09-19T06:42:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.576+0000 7f768cff9640 10 client.25790 handle_command_reply: tid=0 2024-09-19T06:42:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.576+0000 7f76ada16740 1 client.25790 shutdown 2024-09-19T06:42:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.577+0000 7f76ada16740 1 -- 172.21.15.12:0/3289311410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a3780 msgr2=0x55d1391add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.577+0000 7f76ada16740 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a3780 0x55d1391add40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f769c004af0 tx=0x7f769c003af0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.577+0000 7f76ada16740 1 -- 172.21.15.12:0/3289311410 shutdown_connections 2024-09-19T06:42:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.577+0000 7f76ada16740 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d1391bdf30 0x55d1391c0320 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.577+0000 7f76ada16740 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391ae520 0x55d1391ab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.577+0000 7f76ada16740 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a4cf0 0x55d1391aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.577+0000 7f76ada16740 1 --2- 172.21.15.12:0/3289311410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a3780 0x55d1391add40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.577+0000 7f76ada16740 1 -- 172.21.15.12:0/3289311410 >> 172.21.15.12:0/3289311410 conn(0x55d13916c310 msgr2=0x55d1391a5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:39.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.577+0000 7f768cff9640 0 client.25790 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:39.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.577+0000 7f76ada16740 1 -- 172.21.15.12:0/3289311410 shutdown_connections 2024-09-19T06:42:39.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.578+0000 7f76ada16740 1 -- 172.21.15.12:0/3289311410 wait complete. 2024-09-19T06:42:39.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.578+0000 7f76ada16740 20 client.25790 trim_cache size 0 max 16384 2024-09-19T06:42:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.605+0000 7f76ada16740 1 Processor -- start 2024-09-19T06:42:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.605+0000 7f76ada16740 1 -- start start 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76ada16740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d13916c310 0x55d1391aa050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76ada16740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a3780 0x55d1391c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76ada16740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a4cf0 0x55d1391c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76ada16740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f768800ea20 con 0x55d1391a3780 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76a93d9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d13916c310 0x55d1391aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76a93d9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d13916c310 0x55d1391aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:45330/0 (socket says 172.21.15.12:45330) 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76a8bd8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a3780 0x55d1391c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76a93d9640 1 -- 172.21.15.12:0/3571617247 learned_addr learned my addr 172.21.15.12:0/3571617247 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76ada16740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7688010650 con 0x55d1391a4cf0 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76ada16740 1 -- 172.21.15.12:0/3571617247 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f768800f0f0 con 0x55d13916c310 2024-09-19T06:42:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.606+0000 7f76a9bda640 1 --2- 172.21.15.12:0/3571617247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a4cf0 0x55d1391c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.607+0000 7f76a93d9640 1 -- 172.21.15.12:0/3571617247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a4cf0 msgr2=0x55d1391c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.607+0000 7f76a93d9640 1 --2- 172.21.15.12:0/3571617247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a4cf0 0x55d1391c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.607+0000 7f76a93d9640 1 -- 172.21.15.12:0/3571617247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a3780 msgr2=0x55d1391c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.607+0000 7f76a93d9640 1 --2- 172.21.15.12:0/3571617247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a3780 0x55d1391c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.607+0000 7f76a93d9640 1 -- 172.21.15.12:0/3571617247 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1391ae0b0 con 0x55d13916c310 2024-09-19T06:42:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.607+0000 7f76a93d9640 1 --2- 172.21.15.12:0/3571617247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d13916c310 0x55d1391aa050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f769c003b60 tx=0x7f769c009300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7079a0b7c06858ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.608+0000 7f768effd640 1 -- 172.21.15.12:0/3571617247 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c04a040 con 0x55d13916c310 2024-09-19T06:42:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.608+0000 7f768effd640 1 -- 172.21.15.12:0/3571617247 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f769c053030 con 0x55d13916c310 2024-09-19T06:42:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.608+0000 7f768effd640 1 -- 172.21.15.12:0/3571617247 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c04a040 con 0x55d13916c310 2024-09-19T06:42:39.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.609+0000 7f76ada16740 1 -- 172.21.15.12:0/3571617247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d13916c310 msgr2=0x55d1391aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:39.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.609+0000 7f76ada16740 1 --2- 172.21.15.12:0/3571617247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d13916c310 0x55d1391aa050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f769c003b60 tx=0x7f769c009300 comp rx=0 tx=0).stop 2024-09-19T06:42:39.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.609+0000 7f76ada16740 1 -- 172.21.15.12:0/3571617247 shutdown_connections 2024-09-19T06:42:39.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.609+0000 7f76ada16740 1 --2- 172.21.15.12:0/3571617247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a4cf0 0x55d1391c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.609+0000 7f76ada16740 1 --2- 172.21.15.12:0/3571617247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d1391a3780 0x55d1391c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.609+0000 7f76ada16740 1 --2- 172.21.15.12:0/3571617247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d13916c310 0x55d1391aa050 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.609+0000 7f76ada16740 1 -- 172.21.15.12:0/3571617247 >> 172.21.15.12:0/3571617247 conn(0x55d1391ab690 msgr2=0x55d1391a9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:39.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.611+0000 7f76ada16740 1 -- 172.21.15.12:0/3571617247 shutdown_connections 2024-09-19T06:42:39.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.611+0000 7f76ada16740 1 -- 172.21.15.12:0/3571617247 wait complete. 2024-09-19T06:42:39.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.612+0000 7f76ada16740 1 -- start start 2024-09-19T06:42:39.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.612+0000 7f76ada16740 1 Processor -- start 2024-09-19T06:42:39.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.612+0000 7f76ada16740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d13916c310 0x55d1391b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.612+0000 7f76a93d9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d13916c310 0x55d1391b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.612+0000 7f76a93d9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d13916c310 0x55d1391b68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42454/0 (socket says 172.21.15.12:42454) 2024-09-19T06:42:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.612+0000 7f76a93d9640 1 -- 172.21.15.12:0/880375121 learned_addr learned my addr 172.21.15.12:0/880375121 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76ada16740 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a3780 0x55d1391b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76ada16740 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a4cf0 0x55d1391a7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f768800fec0 con 0x55d13916c310 2024-09-19T06:42:39.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f768800f7f0 con 0x55d1391a3780 2024-09-19T06:42:39.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f768800ca00 con 0x55d1391a4cf0 2024-09-19T06:42:39.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76ada16740 10 client.0 _ll_register_callbacks cb 0x7f769400aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76a93d9640 1 -- 172.21.15.12:0/880375121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a4cf0 msgr2=0x55d1391a7880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:42:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76a93d9640 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a4cf0 0x55d1391a7880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76a93d9640 1 -- 172.21.15.12:0/880375121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a3780 msgr2=0x55d1391b6e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:42:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76a93d9640 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a3780 0x55d1391b6e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.613+0000 7f76a93d9640 1 -- 172.21.15.12:0/880375121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1391a7ef0 con 0x55d13916c310 2024-09-19T06:42:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.614+0000 7f76a93d9640 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d13916c310 0x55d1391b68e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f769c006010 tx=0x7f769c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e403cbf7dc3d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.614+0000 7f768cff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.614+0000 7f768cff9640 1 -- 172.21.15.12:0/880375121 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c04a040 con 0x55d13916c310 2024-09-19T06:42:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.614+0000 7f768cff9640 1 -- 172.21.15.12:0/880375121 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f769c03dae0 con 0x55d13916c310 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.614+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f769c053030 con 0x55d13916c310 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.615+0000 7f768cff9640 1 -- 172.21.15.12:0/880375121 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f769c069050 con 0x55d13916c310 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.615+0000 7f76ada16740 10 client.16236 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.615+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d139228330 con 0x55d13916c310 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.616+0000 7f768cff9640 1 -- 172.21.15.12:0/880375121 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f769c053030 con 0x55d13916c310 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.616+0000 7f768cff9640 1 -- 172.21.15.12:0/880375121 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f769c062060 con 0x55d13916c310 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.616+0000 7f76ada16740 10 client.16236 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.616+0000 7f76ada16740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.616+0000 7f76ada16740 20 client.16236 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.616+0000 7f76ada16740 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d1391ae520 0x55d13922a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.616+0000 7f76ada16740 4 client.16236 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:42:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.616+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d139110d70 con 0x55d1391ae520 2024-09-19T06:42:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.617+0000 7f76a8bd8640 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d1391ae520 0x55d13922a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:39.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.618+0000 7f76a8bd8640 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d1391ae520 0x55d13922a930 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4689c73ee4c9e284 server_cookie=8dfdc389e66c8115 in_seq=0 out_seq=0 2024-09-19T06:42:39.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.618+0000 7f768cff9640 10 client.16236 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:39.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.619+0000 7f768cff9640 1 -- 172.21.15.12:0/880375121 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d139110d70 con 0x55d1391ae520 2024-09-19T06:42:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.619+0000 7f768cff9640 10 client.16236 handle_command_reply: tid=0 2024-09-19T06:42:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.619+0000 7f76ada16740 1 client.16236 shutdown 2024-09-19T06:42:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.619+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d13916c310 msgr2=0x55d1391b68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.619+0000 7f76ada16740 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d13916c310 0x55d1391b68e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f769c006010 tx=0x7f769c030d60 comp rx=0 tx=0).stop 2024-09-19T06:42:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.619+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 shutdown_connections 2024-09-19T06:42:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.619+0000 7f76ada16740 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d1391ae520 0x55d13922a930 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.620+0000 7f76ada16740 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d1391a4cf0 0x55d1391a7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.620+0000 7f768cff9640 0 client.16236 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.620+0000 7f76ada16740 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d1391a3780 0x55d1391b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.620+0000 7f76ada16740 1 --2- 172.21.15.12:0/880375121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d13916c310 0x55d1391b68e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.620+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 >> 172.21.15.12:0/880375121 conn(0x55d1391ab690 msgr2=0x55d1391aa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:39.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.620+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 shutdown_connections 2024-09-19T06:42:39.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.620+0000 7f76ada16740 1 -- 172.21.15.12:0/880375121 wait complete. 2024-09-19T06:42:39.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.620+0000 7f76ada16740 20 client.16236 trim_cache size 0 max 16384 2024-09-19T06:42:39.624 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.621+0000 7f76ab63d640 1 -- 172.21.15.12:0/1199042715 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76900a3480 msgr2=0x7f76900a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.621+0000 7f76ab63d640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76900a3480 0x7f76900a5940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f769400b010 tx=0x7f7694004730 comp rx=0 tx=0).stop 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.621+0000 7f76ab63d640 1 -- 172.21.15.12:0/1199042715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76a4108f90 msgr2=0x7f76a4116ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.621+0000 7f76ab63d640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76a4108f90 0x7f76a4116ec0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009fd0 tx=0x7f76a000eae0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.622+0000 7f76ab63d640 1 -- 172.21.15.12:0/1199042715 shutdown_connections 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.622+0000 7f76ab63d640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76900a3480 0x7f76900a5940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.622+0000 7f76ab63d640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76a4108f90 0x7f76a4116ec0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.622+0000 7f76ab63d640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76a4104810 0x7f76a410fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.622+0000 7f76ab63d640 1 --2- 172.21.15.12:0/1199042715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a4103e60 0x7f76a410f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.622+0000 7f76ab63d640 1 -- 172.21.15.12:0/1199042715 >> 172.21.15.12:0/1199042715 conn(0x7f76a40ff8e0 msgr2=0x7f76a4100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.623+0000 7f76ab63d640 1 -- 172.21.15.12:0/1199042715 shutdown_connections 2024-09-19T06:42:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:39.624+0000 7f76ab63d640 1 -- 172.21.15.12:0/1199042715 wait complete. 2024-09-19T06:42:40.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:39 smithi016 ceph-mon[34911]: pgmap v78: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 752 op/s 2024-09-19T06:42:40.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:39 smithi173 ceph-mon[35349]: pgmap v78: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 752 op/s 2024-09-19T06:42:40.111 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:39 smithi012 ceph-mon[30937]: pgmap v78: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.0 MiB/s wr, 752 op/s 2024-09-19T06:42:40.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 115.0 s, 5947.4 tps, lat 16.777 ms stddev 16.944 2024-09-19T06:42:41.557 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:42:41.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:42:41.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:41 smithi012 ceph-mon[30937]: pgmap v79: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-09-19T06:42:42.001 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:42.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:41 smithi016 ceph-mon[34911]: pgmap v79: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-09-19T06:42:42.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:41 smithi173 ceph-mon[35349]: pgmap v79: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-09-19T06:42:42.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.569+0000 7f9ba737d640 1 -- 172.21.15.12:0/2005758138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ba010d530 msgr2=0x7f9ba01150b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:42.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.569+0000 7f9ba737d640 1 --2- 172.21.15.12:0/2005758138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ba010d530 0x7f9ba01150b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009860 tx=0x7f9b9802a340 comp rx=0 tx=0).stop 2024-09-19T06:42:42.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.569+0000 7f9ba737d640 1 -- 172.21.15.12:0/2005758138 shutdown_connections 2024-09-19T06:42:42.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.569+0000 7f9ba737d640 1 --2- 172.21.15.12:0/2005758138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ba010d530 0x7f9ba01150b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.569+0000 7f9ba737d640 1 --2- 172.21.15.12:0/2005758138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba0108e00 0x7f9ba010ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.569+0000 7f9ba737d640 1 --2- 172.21.15.12:0/2005758138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ba0108450 0x7f9ba0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.569+0000 7f9ba737d640 1 -- 172.21.15.12:0/2005758138 >> 172.21.15.12:0/2005758138 conn(0x7f9ba0077ba0 msgr2=0x7f9ba0079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:42.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.569+0000 7f9ba737d640 1 -- 172.21.15.12:0/2005758138 shutdown_connections 2024-09-19T06:42:42.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.569+0000 7f9ba737d640 1 -- 172.21.15.12:0/2005758138 wait complete. 2024-09-19T06:42:42.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.570+0000 7f9ba737d640 1 Processor -- start 2024-09-19T06:42:42.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.570+0000 7f9ba737d640 1 -- start start 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.571+0000 7f9ba737d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ba0108450 0x7f9ba01a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.571+0000 7f9ba737d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba0108e00 0x7f9ba01a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.571+0000 7f9ba737d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ba010d530 0x7f9ba019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.571+0000 7f9ba737d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0118540 con 0x7f9ba0108450 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.571+0000 7f9ba737d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba01183c0 con 0x7f9ba0108e00 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.571+0000 7f9ba737d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba01186c0 con 0x7f9ba010d530 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.571+0000 7f9ba4918640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba0108e00 0x7f9ba01a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.571+0000 7f9ba4918640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba0108e00 0x7f9ba01a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44582/0 (socket says 172.21.15.12:44582) 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.571+0000 7f9ba4918640 1 -- 172.21.15.12:0/1235163845 learned_addr learned my addr 172.21.15.12:0/1235163845 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.571+0000 7f9ba5119640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ba0108450 0x7f9ba01a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.572+0000 7f9ba591a640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ba010d530 0x7f9ba019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.572+0000 7f9ba4918640 1 -- 172.21.15.12:0/1235163845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ba010d530 msgr2=0x7f9ba019e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.572+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ba010d530 0x7f9ba019e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.572+0000 7f9ba4918640 1 -- 172.21.15.12:0/1235163845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ba0108450 msgr2=0x7f9ba01a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.572+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ba0108450 0x7f9ba01a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.572+0000 7f9ba4918640 1 -- 172.21.15.12:0/1235163845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba019eff0 con 0x7f9ba0108e00 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.573+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba0108e00 0x7f9ba01a4c10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00e9c0 tx=0x7f9b8c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.574+0000 7f9b9e7fc640 1 -- 172.21.15.12:0/1235163845 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00ccc0 con 0x7f9ba0108e00 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.574+0000 7f9b9e7fc640 1 -- 172.21.15.12:0/1235163845 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b8c005500 con 0x7f9ba0108e00 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.574+0000 7f9b9e7fc640 1 -- 172.21.15.12:0/1235163845 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c010430 con 0x7f9ba0108e00 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.574+0000 7f9ba737d640 1 -- 172.21.15.12:0/1235163845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba019f2e0 con 0x7f9ba0108e00 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.574+0000 7f9ba737d640 1 -- 172.21.15.12:0/1235163845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba01ab530 con 0x7f9ba0108e00 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.577+0000 7f9b9e7fc640 1 -- 172.21.15.12:0/1235163845 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9b8c0046c0 con 0x7f9ba0108e00 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.578+0000 7f9ba9756740 1 Processor -- start 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.579+0000 7f9b9e7fc640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9b900a3500 0x7f9b900a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.579+0000 7f9b9e7fc640 1 -- 172.21.15.12:0/1235163845 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9b8c0d00d0 con 0x7f9ba0108e00 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.579+0000 7f9ba9756740 1 -- start start 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.579+0000 7f9ba591a640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9b900a3500 0x7f9b900a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facab60 0x55850facaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 0x55850fad8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba9756740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55850fa30280 con 0x55850facab60 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba9756740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55850f9d7b10 con 0x55850fad5d40 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba5119640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facab60 0x55850facaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba5119640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facab60 0x55850facaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33092/0 (socket says 172.21.15.12:33092) 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba5119640 1 -- 172.21.15.12:0/1972474697 learned_addr learned my addr 172.21.15.12:0/1972474697 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1972474697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba591a640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9b900a3500 0x7f9b900a59c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009830 tx=0x7f9b98005d20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba591a640 1 --2- 172.21.15.12:0/1972474697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 0x55850fad8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.580+0000 7f9ba9756740 1 -- 172.21.15.12:0/1972474697 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55850fa2c240 con 0x55850facb480 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.583+0000 7f9ba4918640 1 -- 172.21.15.12:0/1972474697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 msgr2=0x55850fad8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.583+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1972474697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 0x55850fad8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.583+0000 7f9ba4918640 1 -- 172.21.15.12:0/1972474697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facab60 msgr2=0x55850facaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.583+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1972474697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facab60 0x55850facaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.583+0000 7f9ba4918640 1 -- 172.21.15.12:0/1972474697 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55850f9e41f0 con 0x55850facb480 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.583+0000 7f9ba591a640 1 --2- 172.21.15.12:0/1972474697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 0x55850fad8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.583+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1972474697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad5800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0cd740 tx=0x7f9b8c09bc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ab07ed0c7ea5aea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.583+0000 7f9b8b7fe640 1 -- 172.21.15.12:0/1972474697 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0a0680 con 0x55850facb480 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.583+0000 7f9b8b7fe640 1 -- 172.21.15.12:0/1972474697 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b8c0a4f40 con 0x55850facb480 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.583+0000 7f9b8b7fe640 1 -- 172.21.15.12:0/1972474697 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0a4d10 con 0x55850facb480 2024-09-19T06:42:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.584+0000 7f9ba9756740 1 -- 172.21.15.12:0/1972474697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 msgr2=0x55850fad5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.584+0000 7f9ba9756740 1 --2- 172.21.15.12:0/1972474697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad5800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0cd740 tx=0x7f9b8c09bc30 comp rx=0 tx=0).stop 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.585+0000 7f9ba9756740 1 -- 172.21.15.12:0/1972474697 shutdown_connections 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.585+0000 7f9ba9756740 1 --2- 172.21.15.12:0/1972474697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 0x55850fad8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.585+0000 7f9ba9756740 1 --2- 172.21.15.12:0/1972474697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad5800 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.585+0000 7f9ba9756740 1 --2- 172.21.15.12:0/1972474697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facab60 0x55850facaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.585+0000 7f9ba9756740 1 -- 172.21.15.12:0/1972474697 >> 172.21.15.12:0/1972474697 conn(0x55850fac70f0 msgr2=0x55850fac74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.585+0000 7f9ba9756740 1 -- 172.21.15.12:0/1972474697 shutdown_connections 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.585+0000 7f9ba9756740 1 -- 172.21.15.12:0/1972474697 wait complete. 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.585+0000 7f9ba9756740 1 -- start start 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.586+0000 7f9ba9756740 1 Processor -- start 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.586+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850facab60 0x55850fad2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.586+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.586+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 0x55850fad3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba9756740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55850fad8910 con 0x55850fad5d40 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba591a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 0x55850fad3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba5119640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850facab60 0x55850fad2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba591a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 0x55850fad3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33102/0 (socket says 172.21.15.12:33102) 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba591a640 1 -- 172.21.15.12:0/1463337405 learned_addr learned my addr 172.21.15.12:0/1463337405 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba9756740 1 -- 172.21.15.12:0/1463337405 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55850f9eaf10 con 0x55850facab60 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba9756740 1 -- 172.21.15.12:0/1463337405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55850fad8a90 con 0x55850facb480 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba9756740 10 client.0 _ll_register_callbacks cb 0x55850f9b3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba4918640 1 -- 172.21.15.12:0/1463337405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850facab60 msgr2=0x55850fad2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850facab60 0x55850fad2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba4918640 1 -- 172.21.15.12:0/1463337405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 msgr2=0x55850fad3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 0x55850fad3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba4918640 1 -- 172.21.15.12:0/1463337405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55850f7a16a0 con 0x55850facb480 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.587+0000 7f9ba591a640 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 0x55850fad3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.588+0000 7f9ba4918640 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad31c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0cd740 tx=0x7f9b8c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3a7a85f19a1fd85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.588+0000 7f9b88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.588+0000 7f9b88ff9640 1 -- 172.21.15.12:0/1463337405 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0b9030 con 0x55850facb480 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.588+0000 7f9ba9756740 1 -- 172.21.15.12:0/1463337405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b8c0a4f40 con 0x55850facb480 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.588+0000 7f9b88ff9640 1 -- 172.21.15.12:0/1463337405 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9b8c0a4ab0 con 0x55850facb480 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.588+0000 7f9b88ff9640 1 -- 172.21.15.12:0/1463337405 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9b8c0a4cd0 con 0x55850facb480 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.588+0000 7f9ba9756740 10 client.25825 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.588+0000 7f9ba9756740 1 -- 172.21.15.12:0/1463337405 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55850fad8910 con 0x55850facb480 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.589+0000 7f9b88ff9640 1 -- 172.21.15.12:0/1463337405 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b8c0a4f40 con 0x55850facb480 2024-09-19T06:42:42.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.589+0000 7f9b88ff9640 1 -- 172.21.15.12:0/1463337405 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f9b8c0bc050 con 0x55850facb480 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.589+0000 7f9ba9756740 10 client.25825 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.589+0000 7f9ba9756740 10 client.25825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.589+0000 7f9ba9756740 20 client.25825 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.589+0000 7f9ba9756740 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55850fae56d0 0x55850fae7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.589+0000 7f9ba9756740 4 client.25825 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.589+0000 7f9ba9756740 1 -- 172.21.15.12:0/1463337405 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55850fa3d7f0 con 0x55850fae56d0 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.590+0000 7f9ba5119640 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55850fae56d0 0x55850fae7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.590+0000 7f9ba5119640 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55850fae56d0 0x55850fae7ac0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76c0610dc547fa1a server_cookie=60ee6824843673b9 in_seq=0 out_seq=0 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.590+0000 7f9b88ff9640 10 client.25825 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.591+0000 7f9b88ff9640 1 -- 172.21.15.12:0/1463337405 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55850fa3d7f0 con 0x55850fae56d0 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.591+0000 7f9b88ff9640 10 client.25825 handle_command_reply: tid=0 2024-09-19T06:42:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.591+0000 7f9ba9756740 1 client.25825 shutdown 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.591+0000 7f9ba9756740 1 -- 172.21.15.12:0/1463337405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 msgr2=0x55850fad31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.591+0000 7f9ba9756740 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad31c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0cd740 tx=0x7f9b8c009f90 comp rx=0 tx=0).stop 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.591+0000 7f9ba9756740 1 -- 172.21.15.12:0/1463337405 shutdown_connections 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.591+0000 7f9ba9756740 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55850fae56d0 0x55850fae7ac0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.592+0000 7f9ba9756740 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 0x55850fad3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.592+0000 7f9ba9756740 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad31c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.592+0000 7f9ba9756740 1 --2- 172.21.15.12:0/1463337405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850facab60 0x55850fad2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.592+0000 7f9ba9756740 1 -- 172.21.15.12:0/1463337405 >> 172.21.15.12:0/1463337405 conn(0x55850fac70f0 msgr2=0x55850facce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.592+0000 7f9b88ff9640 0 client.25825 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.593+0000 7f9ba9756740 1 -- 172.21.15.12:0/1463337405 shutdown_connections 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.593+0000 7f9ba9756740 1 -- 172.21.15.12:0/1463337405 wait complete. 2024-09-19T06:42:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.594+0000 7f9ba9756740 20 client.25825 trim_cache size 0 max 16384 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.622+0000 7f9ba9756740 1 Processor -- start 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.622+0000 7f9ba9756740 1 -- start start 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.622+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facab60 0x55850facd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facb480 0x55850fac6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 0x55850faed250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba9756740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba01b4160 con 0x55850facb480 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba9756740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba01b5d90 con 0x55850fad5d40 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba9756740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba01b4830 con 0x55850facab60 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba4918640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facb480 0x55850fac6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba4918640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facb480 0x55850fac6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33112/0 (socket says 172.21.15.12:33112) 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba4918640 1 -- 172.21.15.12:0/109498040 learned_addr learned my addr 172.21.15.12:0/109498040 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba5119640 1 --2- 172.21.15.12:0/109498040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facab60 0x55850facd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba591a640 1 --2- 172.21.15.12:0/109498040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 0x55850faed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba4918640 1 -- 172.21.15.12:0/109498040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facab60 msgr2=0x55850facd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba4918640 1 --2- 172.21.15.12:0/109498040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facab60 0x55850facd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba4918640 1 -- 172.21.15.12:0/109498040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 msgr2=0x55850faed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba4918640 1 --2- 172.21.15.12:0/109498040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 0x55850faed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.623+0000 7f9ba4918640 1 -- 172.21.15.12:0/109498040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55850fad11d0 con 0x55850facb480 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.624+0000 7f9ba4918640 1 --2- 172.21.15.12:0/109498040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facb480 0x55850fac6160 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c09a580 tx=0x7f9b8c0a4e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a874bc0c6e0ba30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.624+0000 7f9b8affd640 1 -- 172.21.15.12:0/109498040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c09c9d0 con 0x55850facb480 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.624+0000 7f9b8affd640 1 -- 172.21.15.12:0/109498040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b8c0a4f40 con 0x55850facb480 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.624+0000 7f9b8affd640 1 -- 172.21.15.12:0/109498040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c098160 con 0x55850facb480 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.625+0000 7f9ba9756740 1 -- 172.21.15.12:0/109498040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facb480 msgr2=0x55850fac6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.625+0000 7f9ba9756740 1 --2- 172.21.15.12:0/109498040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facb480 0x55850fac6160 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c09a580 tx=0x7f9b8c0a4e70 comp rx=0 tx=0).stop 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.626+0000 7f9ba9756740 1 -- 172.21.15.12:0/109498040 shutdown_connections 2024-09-19T06:42:42.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.626+0000 7f9ba9756740 1 --2- 172.21.15.12:0/109498040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850fad5d40 0x55850faed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.626+0000 7f9ba9756740 1 --2- 172.21.15.12:0/109498040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850facb480 0x55850fac6160 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.626+0000 7f9ba9756740 1 --2- 172.21.15.12:0/109498040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facab60 0x55850facd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.626+0000 7f9ba9756740 1 -- 172.21.15.12:0/109498040 >> 172.21.15.12:0/109498040 conn(0x55850fac70f0 msgr2=0x55850fac5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.626+0000 7f9ba9756740 1 -- 172.21.15.12:0/109498040 shutdown_connections 2024-09-19T06:42:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.626+0000 7f9ba9756740 1 -- 172.21.15.12:0/109498040 wait complete. 2024-09-19T06:42:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.626+0000 7f9ba9756740 1 -- start start 2024-09-19T06:42:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.626+0000 7f9ba9756740 1 Processor -- start 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850facab60 0x55850fade5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba9756740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 0x55850fada0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba9756740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba01b5600 con 0x55850fad5d40 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba9756740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba01b4f30 con 0x55850facab60 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba9756740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba01b2140 con 0x55850facb480 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba4918640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba4918640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:42138/0 (socket says 172.21.15.12:42138) 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba4918640 1 -- 172.21.15.12:0/2658308623 learned_addr learned my addr 172.21.15.12:0/2658308623 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba591a640 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 0x55850fada0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.627+0000 7f9ba9756740 10 client.0 _ll_register_callbacks cb 0x7f9b94009a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.628+0000 7f9ba5119640 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850facab60 0x55850fade5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.628+0000 7f9ba4918640 1 -- 172.21.15.12:0/2658308623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850facab60 msgr2=0x55850fade5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.628+0000 7f9ba4918640 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850facab60 0x55850fade5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.628+0000 7f9ba4918640 1 -- 172.21.15.12:0/2658308623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 msgr2=0x55850fada0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.628+0000 7f9ba4918640 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 0x55850fada0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.628+0000 7f9ba4918640 1 -- 172.21.15.12:0/2658308623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55850fb4f220 con 0x55850facb480 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.628+0000 7f9ba4918640 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad9920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00f010 tx=0x7f9b8c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d17673cc29a2941 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.628+0000 7f9b88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.628+0000 7f9b88ff9640 1 -- 172.21.15.12:0/2658308623 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0b9070 con 0x55850facb480 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.628+0000 7f9b88ff9640 1 -- 172.21.15.12:0/2658308623 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9b8c098110 con 0x55850facb480 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9ba9756740 1 -- 172.21.15.12:0/2658308623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b8c0a4f40 con 0x55850facb480 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9b88ff9640 1 -- 172.21.15.12:0/2658308623 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9b8c07f050 con 0x55850facb480 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9ba9756740 10 client.25831 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:42.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9ba9756740 1 -- 172.21.15.12:0/2658308623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55850fb4f220 con 0x55850facb480 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9b88ff9640 1 -- 172.21.15.12:0/2658308623 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b8c09c9d0 con 0x55850facb480 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9b88ff9640 1 -- 172.21.15.12:0/2658308623 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f9b8c09b190 con 0x55850facb480 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9ba9756740 10 client.25831 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9ba9756740 10 client.25831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9ba9756740 20 client.25831 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9ba9756740 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55850fb50630 0x55850fb52a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9ba9756740 4 client.25831 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.629+0000 7f9ba9756740 1 -- 172.21.15.12:0/2658308623 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f9b8c0a4f40 con 0x55850fb50630 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.630+0000 7f9ba5119640 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55850fb50630 0x55850fb52a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.630+0000 7f9ba5119640 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55850fb50630 0x55850fb52a50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96cf8d2b4d3e7750 server_cookie=752f62e71f508c38 in_seq=0 out_seq=0 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.630+0000 7f9b88ff9640 10 client.25831 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.631+0000 7f9b88ff9640 1 -- 172.21.15.12:0/2658308623 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f9b8c0a4f40 con 0x55850fb50630 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.631+0000 7f9b88ff9640 10 client.25831 handle_command_reply: tid=0 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.631+0000 7f9ba9756740 1 client.25831 shutdown 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.632+0000 7f9ba9756740 1 -- 172.21.15.12:0/2658308623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 msgr2=0x55850fad9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.632+0000 7f9ba9756740 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad9920 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00f010 tx=0x7f9b8c009f90 comp rx=0 tx=0).stop 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.632+0000 7f9ba9756740 1 -- 172.21.15.12:0/2658308623 shutdown_connections 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.632+0000 7f9ba9756740 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55850fb50630 0x55850fb52a50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.632+0000 7f9ba9756740 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55850fad5d40 0x55850fada0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.632+0000 7f9b88ff9640 0 client.25831 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.632+0000 7f9ba9756740 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55850facb480 0x55850fad9920 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.632+0000 7f9ba9756740 1 --2- 172.21.15.12:0/2658308623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55850facab60 0x55850fade5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.632+0000 7f9ba9756740 1 -- 172.21.15.12:0/2658308623 >> 172.21.15.12:0/2658308623 conn(0x55850fac70f0 msgr2=0x55850fac6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.634+0000 7f9ba9756740 1 -- 172.21.15.12:0/2658308623 shutdown_connections 2024-09-19T06:42:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.634+0000 7f9ba9756740 1 -- 172.21.15.12:0/2658308623 wait complete. 2024-09-19T06:42:42.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.634+0000 7f9ba9756740 20 client.25831 trim_cache size 0 max 16384 2024-09-19T06:42:42.833 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:42:42.833 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:42:42.833 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "b8227e9b-1df1-4492-8290-9b325ef2c71e", 2024-09-19T06:42:42.833 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:42:42.833 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.635+0000 7f9ba737d640 1 -- 172.21.15.12:0/1235163845 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9b900a3500 msgr2=0x7f9b900a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.635+0000 7f9ba737d640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9b900a3500 0x7f9b900a59c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009830 tx=0x7f9b98005d20 comp rx=0 tx=0).stop 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.635+0000 7f9ba737d640 1 -- 172.21.15.12:0/1235163845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba0108e00 msgr2=0x7f9ba01a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.635+0000 7f9ba737d640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba0108e00 0x7f9ba01a4c10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00e9c0 tx=0x7f9b8c00ee80 comp rx=0 tx=0).stop 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.635+0000 7f9ba737d640 1 -- 172.21.15.12:0/1235163845 shutdown_connections 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.635+0000 7f9ba737d640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9b900a3500 0x7f9b900a59c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.635+0000 7f9ba737d640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ba010d530 0x7f9ba019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.635+0000 7f9ba737d640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ba0108e00 0x7f9ba01a4c10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.635+0000 7f9ba737d640 1 --2- 172.21.15.12:0/1235163845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ba0108450 0x7f9ba01a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.635+0000 7f9ba737d640 1 -- 172.21.15.12:0/1235163845 >> 172.21.15.12:0/1235163845 conn(0x7f9ba0077ba0 msgr2=0x7f9ba0078e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.637+0000 7f9ba737d640 1 -- 172.21.15.12:0/1235163845 shutdown_connections 2024-09-19T06:42:42.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:42.637+0000 7f9ba737d640 1 -- 172.21.15.12:0/1235163845 wait complete. 2024-09-19T06:42:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.168+0000 7f35a00ba640 1 -- 172.21.15.12:0/3801192715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3598102470 msgr2=0x7f359810e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.168+0000 7f35a00ba640 1 --2- 172.21.15.12:0/3801192715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3598102470 0x7f359810e9a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3590009cd0 tx=0x7f359002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 -- 172.21.15.12:0/3801192715 shutdown_connections 2024-09-19T06:42:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 --2- 172.21.15.12:0/3801192715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3598102470 0x7f359810e9a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 --2- 172.21.15.12:0/3801192715 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598101ad0 0x7f3598101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 --2- 172.21.15.12:0/3801192715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598107b70 0x7f3598107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 -- 172.21.15.12:0/3801192715 >> 172.21.15.12:0/3801192715 conn(0x7f35980fd7d0 msgr2=0x7f35980ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 -- 172.21.15.12:0/3801192715 shutdown_connections 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 -- 172.21.15.12:0/3801192715 wait complete. 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 Processor -- start 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 -- start start 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598101ad0 0x7f3598198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598102470 0x7f3598198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3598107b70 0x7f359819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3598111f20 con 0x7f3598107b70 2024-09-19T06:42:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3598111da0 con 0x7f3598102470 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.169+0000 7f35a00ba640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35981120a0 con 0x7f3598101ad0 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359e657640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3598107b70 0x7f359819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359d655640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598102470 0x7f3598198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359e657640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3598107b70 0x7f359819cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33132/0 (socket says 172.21.15.12:33132) 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359de56640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598101ad0 0x7f3598198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359e657640 1 -- 172.21.15.12:0/3932750304 learned_addr learned my addr 172.21.15.12:0/3932750304 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359d655640 1 -- 172.21.15.12:0/3932750304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598101ad0 msgr2=0x7f3598198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359d655640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598101ad0 0x7f3598198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359d655640 1 -- 172.21.15.12:0/3932750304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3598107b70 msgr2=0x7f359819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359d655640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3598107b70 0x7f359819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359d655640 1 -- 172.21.15.12:0/3932750304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359819d320 con 0x7f3598102470 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359e657640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3598107b70 0x7f359819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f359d655640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598102470 0x7f3598198870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f358800e9f0 tx=0x7f358800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f358effd640 1 -- 172.21.15.12:0/3932750304 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358800ccc0 con 0x7f3598102470 2024-09-19T06:42:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f358effd640 1 -- 172.21.15.12:0/3932750304 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3588010910 con 0x7f3598102470 2024-09-19T06:42:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f35a00ba640 1 -- 172.21.15.12:0/3932750304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359819d610 con 0x7f3598102470 2024-09-19T06:42:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f358effd640 1 -- 172.21.15.12:0/3932750304 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588018960 con 0x7f3598102470 2024-09-19T06:42:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.170+0000 7f35a00ba640 1 -- 172.21.15.12:0/3932750304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35981a4ea0 con 0x7f3598102470 2024-09-19T06:42:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f358effd640 1 -- 172.21.15.12:0/3932750304 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3588010ac0 con 0x7f3598102470 2024-09-19T06:42:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f35a2e56740 1 Processor -- start 2024-09-19T06:42:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f35a2e56740 1 -- start start 2024-09-19T06:42:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c0999b0 0x56391c099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c09a2d0 0x56391c0a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0a90c0 0x56391c0ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f35a2e56740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56391bffe2f0 con 0x56391c0a90c0 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f35a2e56740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56391bfa6270 con 0x56391c09a2d0 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f35a2e56740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56391bffa2b0 con 0x56391c0999b0 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f359d655640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0a90c0 0x56391c0ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f359d655640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0a90c0 0x56391c0ab4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33144/0 (socket says 172.21.15.12:33144) 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.173+0000 7f359d655640 1 -- 172.21.15.12:0/1863039278 learned_addr learned my addr 172.21.15.12:0/1863039278 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359e657640 1 --2- 172.21.15.12:0/1863039278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c0999b0 0x56391c099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359de56640 1 --2- 172.21.15.12:0/1863039278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c09a2d0 0x56391c0a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f358effd640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35840a3460 0x7f35840a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359e657640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35840a3460 0x7f35840a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359d655640 1 -- 172.21.15.12:0/1863039278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c0999b0 msgr2=0x56391c099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359d655640 1 --2- 172.21.15.12:0/1863039278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c0999b0 0x56391c099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359d655640 1 -- 172.21.15.12:0/1863039278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c09a2d0 msgr2=0x56391c0a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359d655640 1 --2- 172.21.15.12:0/1863039278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c09a2d0 0x56391c0a8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359d655640 1 -- 172.21.15.12:0/1863039278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391bfa5340 con 0x56391c0a90c0 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359de56640 1 --2- 172.21.15.12:0/1863039278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c09a2d0 0x56391c0a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f358effd640 1 -- 172.21.15.12:0/3932750304 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f35880d0110 con 0x7f3598102470 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359d655640 1 --2- 172.21.15.12:0/1863039278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0a90c0 0x56391c0ab4b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3588098df0 tx=0x7f3588024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fee076e289c2442 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f359e657640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35840a3460 0x7f35840a5920 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3590031860 tx=0x7f359002a8e0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f3583fff640 1 -- 172.21.15.12:0/1863039278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588013190 con 0x56391c0a90c0 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f3583fff640 1 -- 172.21.15.12:0/1863039278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f358809c420 con 0x56391c0a90c0 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.174+0000 7f3583fff640 1 -- 172.21.15.12:0/1863039278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588025170 con 0x56391c0a90c0 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.175+0000 7f35a2e56740 1 -- 172.21.15.12:0/1863039278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0a90c0 msgr2=0x56391c0ab4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.175+0000 7f35a2e56740 1 --2- 172.21.15.12:0/1863039278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0a90c0 0x56391c0ab4b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3588098df0 tx=0x7f3588024000 comp rx=0 tx=0).stop 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.175+0000 7f35a2e56740 1 -- 172.21.15.12:0/1863039278 shutdown_connections 2024-09-19T06:42:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.175+0000 7f35a2e56740 1 --2- 172.21.15.12:0/1863039278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0a90c0 0x56391c0ab4b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.175+0000 7f35a2e56740 1 --2- 172.21.15.12:0/1863039278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c09a2d0 0x56391c0a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.175+0000 7f35a2e56740 1 --2- 172.21.15.12:0/1863039278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c0999b0 0x56391c099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.175+0000 7f35a2e56740 1 -- 172.21.15.12:0/1863039278 >> 172.21.15.12:0/1863039278 conn(0x56391c096060 msgr2=0x56391c096440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.175+0000 7f35a2e56740 1 -- 172.21.15.12:0/1863039278 shutdown_connections 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.175+0000 7f35a2e56740 1 -- 172.21.15.12:0/1863039278 wait complete. 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.175+0000 7f35a2e56740 1 -- start start 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f35a2e56740 1 Processor -- start 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0a6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 0x56391c0a6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 0x56391c0a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f35a2e56740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56391c0abbd0 con 0x56391c0999b0 2024-09-19T06:42:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f35a2e56740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56391bf87290 con 0x56391c0a90c0 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f35a2e56740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56391c0abd50 con 0x56391c09a2d0 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f35a2e56740 10 client.0 _ll_register_callbacks cb 0x56391bfb8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f359de56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f359de56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33148/0 (socket says 172.21.15.12:33148) 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f359de56640 1 -- 172.21.15.12:0/3539860749 learned_addr learned my addr 172.21.15.12:0/3539860749 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f359e657640 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 0x56391c0a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f359d655640 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 0x56391c0a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f359de56640 1 -- 172.21.15.12:0/3539860749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 msgr2=0x56391c0a6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.176+0000 7f359de56640 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 0x56391c0a6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f359de56640 1 -- 172.21.15.12:0/3539860749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 msgr2=0x56391c0a6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f359de56640 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 0x56391c0a6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f359de56640 1 -- 172.21.15.12:0/3539860749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391bd11210 con 0x56391c0999b0 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f359d655640 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 0x56391c0a6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f359de56640 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0a6000 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f359400beb0 tx=0x7f3594012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb98a9515901200 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f35817fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f35817fa640 1 -- 172.21.15.12:0/3539860749 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359401f060 con 0x56391c0999b0 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f35817fa640 1 -- 172.21.15.12:0/3539860749 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f3594010910 con 0x56391c0999b0 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f35a2e56740 1 -- 172.21.15.12:0/3539860749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f358809c420 con 0x56391c0999b0 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f35817fa640 1 -- 172.21.15.12:0/3539860749 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3594010b10 con 0x56391c0999b0 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f35a2e56740 10 client.16266 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f35a2e56740 1 -- 172.21.15.12:0/3539860749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56391bddd620 con 0x56391c0999b0 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f35817fa640 1 -- 172.21.15.12:0/3539860749 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f358809c420 con 0x56391c0999b0 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.177+0000 7f35817fa640 1 -- 172.21.15.12:0/3539860749 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f3594019030 con 0x56391c0999b0 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.178+0000 7f35a2e56740 10 client.16266 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.178+0000 7f35a2e56740 10 client.16266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.178+0000 7f35a2e56740 20 client.16266 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.178+0000 7f35a2e56740 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56391c0b9080 0x56391c0bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.178+0000 7f35a2e56740 4 client.16266 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.178+0000 7f35a2e56740 1 -- 172.21.15.12:0/3539860749 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56391c00ba20 con 0x56391c0b9080 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.178+0000 7f359d655640 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56391c0b9080 0x56391c0bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.178+0000 7f359d655640 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56391c0b9080 0x56391c0bb4d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ff831257ee52a41 server_cookie=8915ec16d8281a29 in_seq=0 out_seq=0 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.178+0000 7f35817fa640 10 client.16266 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35817fa640 1 -- 172.21.15.12:0/3539860749 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56391c00ba20 con 0x56391c0b9080 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35817fa640 10 client.16266 handle_command_reply: tid=0 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 client.16266 shutdown 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 -- 172.21.15.12:0/3539860749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 msgr2=0x56391c0a6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0a6000 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f359400beb0 tx=0x7f3594012820 comp rx=0 tx=0).stop 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 -- 172.21.15.12:0/3539860749 shutdown_connections 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56391c0b9080 0x56391c0bb4d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 0x56391c0a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 0x56391c0a6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35817fa640 0 client.16266 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 --2- 172.21.15.12:0/3539860749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0a6000 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 -- 172.21.15.12:0/3539860749 >> 172.21.15.12:0/3539860749 conn(0x56391c096060 msgr2=0x56391c09bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 -- 172.21.15.12:0/3539860749 shutdown_connections 2024-09-19T06:42:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 1 -- 172.21.15.12:0/3539860749 wait complete. 2024-09-19T06:42:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.179+0000 7f35a2e56740 20 client.16266 trim_cache size 0 max 16384 2024-09-19T06:42:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.200+0000 7f35a2e56740 1 Processor -- start 2024-09-19T06:42:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.200+0000 7f35a2e56740 1 -- start start 2024-09-19T06:42:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.200+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0999b0 0x56391c0c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.200+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c09a2d0 0x56391c0c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.200+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c0a90c0 0x56391c0a3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.200+0000 7f35a2e56740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f35981ab840 con 0x56391c09a2d0 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.200+0000 7f35a2e56740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f35981ad470 con 0x56391c0999b0 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.200+0000 7f35a2e56740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35981abf10 con 0x56391c0a90c0 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.200+0000 7f359d655640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c09a2d0 0x56391c0c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f359d655640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c09a2d0 0x56391c0c1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33162/0 (socket says 172.21.15.12:33162) 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f359d655640 1 -- 172.21.15.12:0/3760835198 learned_addr learned my addr 172.21.15.12:0/3760835198 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f359e657640 1 --2- 172.21.15.12:0/3760835198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c0a90c0 0x56391c0a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f359de56640 1 --2- 172.21.15.12:0/3760835198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0999b0 0x56391c0c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f359d655640 1 -- 172.21.15.12:0/3760835198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c0a90c0 msgr2=0x56391c0a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f359d655640 1 --2- 172.21.15.12:0/3760835198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c0a90c0 0x56391c0a3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f359d655640 1 -- 172.21.15.12:0/3760835198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0999b0 msgr2=0x56391c0c0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f359d655640 1 --2- 172.21.15.12:0/3760835198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0999b0 0x56391c0c0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f359d655640 1 -- 172.21.15.12:0/3760835198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391c0a1bb0 con 0x56391c09a2d0 2024-09-19T06:42:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f359d655640 1 --2- 172.21.15.12:0/3760835198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c09a2d0 0x56391c0c1320 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f358809c3b0 tx=0x7f35880d3c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd67b6c972a5db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.201+0000 7f35837fe640 1 -- 172.21.15.12:0/3760835198 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880a0720 con 0x56391c09a2d0 2024-09-19T06:42:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.202+0000 7f35837fe640 1 -- 172.21.15.12:0/3760835198 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35880b0550 con 0x56391c09a2d0 2024-09-19T06:42:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.202+0000 7f35837fe640 1 -- 172.21.15.12:0/3760835198 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3588014cd0 con 0x56391c09a2d0 2024-09-19T06:42:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.203+0000 7f35a2e56740 1 -- 172.21.15.12:0/3760835198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c09a2d0 msgr2=0x56391c0c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.203+0000 7f35a2e56740 1 --2- 172.21.15.12:0/3760835198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c09a2d0 0x56391c0c1320 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f358809c3b0 tx=0x7f35880d3c60 comp rx=0 tx=0).stop 2024-09-19T06:42:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.203+0000 7f35a2e56740 1 -- 172.21.15.12:0/3760835198 shutdown_connections 2024-09-19T06:42:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.203+0000 7f35a2e56740 1 --2- 172.21.15.12:0/3760835198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c0a90c0 0x56391c0a3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.203+0000 7f35a2e56740 1 --2- 172.21.15.12:0/3760835198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c09a2d0 0x56391c0c1320 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.203+0000 7f35a2e56740 1 --2- 172.21.15.12:0/3760835198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0999b0 0x56391c0c0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.203+0000 7f35a2e56740 1 -- 172.21.15.12:0/3760835198 >> 172.21.15.12:0/3760835198 conn(0x56391c096060 msgr2=0x56391c0951c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.204+0000 7f35a2e56740 1 -- 172.21.15.12:0/3760835198 shutdown_connections 2024-09-19T06:42:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.204+0000 7f35a2e56740 1 -- 172.21.15.12:0/3760835198 wait complete. 2024-09-19T06:42:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.204+0000 7f35a2e56740 1 -- start start 2024-09-19T06:42:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.204+0000 7f35a2e56740 1 Processor -- start 2024-09-19T06:42:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 0x56391c0b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f359de56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f35a2e56740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 0x56391c09fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f35a2e56740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f35981acce0 con 0x56391c0999b0 2024-09-19T06:42:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f359d655640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 0x56391c0b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f359de56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33172/0 (socket says 172.21.15.12:33172) 2024-09-19T06:42:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f359de56640 1 -- 172.21.15.12:0/944780534 learned_addr learned my addr 172.21.15.12:0/944780534 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f35a2e56740 1 -- 172.21.15.12:0/944780534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f35981ac610 con 0x56391c0a90c0 2024-09-19T06:42:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f35a2e56740 1 -- 172.21.15.12:0/944780534 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35981a9840 con 0x56391c09a2d0 2024-09-19T06:42:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f35a2e56740 10 client.0 _ll_register_callbacks cb 0x7f359400ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.205+0000 7f359e657640 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 0x56391c09fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.206+0000 7f359de56640 1 -- 172.21.15.12:0/944780534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 msgr2=0x56391c0b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.206+0000 7f359de56640 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 0x56391c0b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.206+0000 7f359de56640 1 -- 172.21.15.12:0/944780534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 msgr2=0x56391c09fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.206+0000 7f359de56640 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 0x56391c09fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.206+0000 7f359de56640 1 -- 172.21.15.12:0/944780534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391c0a0520 con 0x56391c0999b0 2024-09-19T06:42:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.206+0000 7f359e657640 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 0x56391c09fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.206+0000 7f359de56640 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0b13e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f359400f3c0 tx=0x7f3594010710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c9a6502468b4a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.206+0000 7f35817fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35817fa640 1 -- 172.21.15.12:0/944780534 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594004220 con 0x56391c0999b0 2024-09-19T06:42:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35817fa640 1 -- 172.21.15.12:0/944780534 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f35940043c0 con 0x56391c0999b0 2024-09-19T06:42:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35a2e56740 1 -- 172.21.15.12:0/944780534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35880b0550 con 0x56391c0999b0 2024-09-19T06:42:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35817fa640 1 -- 172.21.15.12:0/944780534 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3594005040 con 0x56391c0999b0 2024-09-19T06:42:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35a2e56740 10 client.16272 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35a2e56740 1 -- 172.21.15.12:0/944780534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56391c09df30 con 0x56391c0999b0 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35817fa640 1 -- 172.21.15.12:0/944780534 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35880b0550 con 0x56391c0999b0 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35817fa640 1 -- 172.21.15.12:0/944780534 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f3594019040 con 0x56391c0999b0 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35a2e56740 10 client.16272 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35a2e56740 10 client.16272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.207+0000 7f35a2e56740 20 client.16272 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.208+0000 7f35a2e56740 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56391c11c1e0 0x56391c11e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.208+0000 7f35a2e56740 4 client.16272 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.208+0000 7f35a2e56740 1 -- 172.21.15.12:0/944780534 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56391c005d70 con 0x56391c11c1e0 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.208+0000 7f359d655640 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56391c11c1e0 0x56391c11e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.209+0000 7f359d655640 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56391c11c1e0 0x56391c11e600 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=265a1b32b1f75ebc server_cookie=5c61c190ba508c46 in_seq=0 out_seq=0 2024-09-19T06:42:43.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.209+0000 7f35817fa640 10 client.16272 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.218+0000 7f35817fa640 1 -- 172.21.15.12:0/944780534 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56391c005d70 con 0x56391c11c1e0 2024-09-19T06:42:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.218+0000 7f35817fa640 10 client.16272 handle_command_reply: tid=0 2024-09-19T06:42:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.218+0000 7f35a2e56740 1 client.16272 shutdown 2024-09-19T06:42:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.219+0000 7f35a2e56740 1 -- 172.21.15.12:0/944780534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 msgr2=0x56391c0b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:43.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.219+0000 7f35a2e56740 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0b13e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f359400f3c0 tx=0x7f3594010710 comp rx=0 tx=0).stop 2024-09-19T06:42:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.219+0000 7f35a2e56740 1 -- 172.21.15.12:0/944780534 shutdown_connections 2024-09-19T06:42:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.219+0000 7f35a2e56740 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56391c11c1e0 0x56391c11e600 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.219+0000 7f35a2e56740 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56391c0a90c0 0x56391c09fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.219+0000 7f35a2e56740 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56391c09a2d0 0x56391c0b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.219+0000 7f35a2e56740 1 --2- 172.21.15.12:0/944780534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56391c0999b0 0x56391c0b13e0 secure :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f359400f3c0 tx=0x7f3594010710 comp rx=0 tx=0).stop 2024-09-19T06:42:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.219+0000 7f35a2e56740 1 -- 172.21.15.12:0/944780534 >> 172.21.15.12:0/944780534 conn(0x56391c096060 msgr2=0x56391c0a5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.220+0000 7f35817fa640 0 client.16272 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.220+0000 7f35a2e56740 1 -- 172.21.15.12:0/944780534 shutdown_connections 2024-09-19T06:42:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.220+0000 7f35a2e56740 1 -- 172.21.15.12:0/944780534 wait complete. 2024-09-19T06:42:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.220+0000 7f35a2e56740 20 client.16272 trim_cache size 0 max 16384 2024-09-19T06:42:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:42:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:42:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:42:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:42:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.222+0000 7f35a00ba640 1 -- 172.21.15.12:0/3932750304 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35840a3460 msgr2=0x7f35840a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.222+0000 7f35a00ba640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35840a3460 0x7f35840a5920 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3590031860 tx=0x7f359002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.222+0000 7f35a00ba640 1 -- 172.21.15.12:0/3932750304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598102470 msgr2=0x7f3598198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.222+0000 7f35a00ba640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598102470 0x7f3598198870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f358800e9f0 tx=0x7f358800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.222+0000 7f35a00ba640 1 -- 172.21.15.12:0/3932750304 shutdown_connections 2024-09-19T06:42:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.222+0000 7f35a00ba640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3598107b70 0x7f359819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.222+0000 7f35a00ba640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3598102470 0x7f3598198870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.222+0000 7f35a00ba640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35840a3460 0x7f35840a5920 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.222+0000 7f35a00ba640 1 --2- 172.21.15.12:0/3932750304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3598101ad0 0x7f3598198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.222+0000 7f35a00ba640 1 -- 172.21.15.12:0/3932750304 >> 172.21.15.12:0/3932750304 conn(0x7f35980fd7d0 msgr2=0x7f35980fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.223+0000 7f35a00ba640 1 -- 172.21.15.12:0/3932750304 shutdown_connections 2024-09-19T06:42:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:43.223+0000 7f35a00ba640 1 -- 172.21.15.12:0/3932750304 wait complete. 2024-09-19T06:42:43.927 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:42:44.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: pgmap v80: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 752 op/s 2024-09-19T06:42:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:42:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:42:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:42:44.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:42:44.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:42:44.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.010 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:42:44.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:42:44.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:42:44.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:42:44.011 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.012 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:42:44.012 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.012 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.012 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.012 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:43 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: pgmap v80: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 752 op/s 2024-09-19T06:42:44.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:42:44.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:42:44.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.084 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:43 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: pgmap v80: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 752 op/s 2024-09-19T06:42:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:42:44.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:42:44.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:42:44.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:42:44.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:42:44.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:42:44.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:42:44.132 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.132 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:42:44.132 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:42:44.132 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.132 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:42:44.132 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.133 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.133 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.133 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:43 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:42:44.353 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:42:44.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.941+0000 7f0d8365b640 1 -- 172.21.15.12:0/3010342905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d7c101de0 msgr2=0x7f0d7c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:44.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.941+0000 7f0d8365b640 1 --2- 172.21.15.12:0/3010342905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d7c101de0 0x7f0d7c1021c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009900 tx=0x7f0d7402a400 comp rx=0 tx=0).stop 2024-09-19T06:42:44.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.941+0000 7f0d8365b640 1 -- 172.21.15.12:0/3010342905 shutdown_connections 2024-09-19T06:42:44.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.941+0000 7f0d8365b640 1 --2- 172.21.15.12:0/3010342905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d7c106f10 0x7f0d7c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.941+0000 7f0d8365b640 1 --2- 172.21.15.12:0/3010342905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d7c102790 0x7f0d7c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.941+0000 7f0d8365b640 1 --2- 172.21.15.12:0/3010342905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d7c101de0 0x7f0d7c1021c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.941+0000 7f0d8365b640 1 -- 172.21.15.12:0/3010342905 >> 172.21.15.12:0/3010342905 conn(0x7f0d7c0fd880 msgr2=0x7f0d7c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:44.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.942+0000 7f0d8365b640 1 -- 172.21.15.12:0/3010342905 shutdown_connections 2024-09-19T06:42:44.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.942+0000 7f0d8365b640 1 -- 172.21.15.12:0/3010342905 wait complete. 2024-09-19T06:42:44.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.943+0000 7f0d8365b640 1 Processor -- start 2024-09-19T06:42:44.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.943+0000 7f0d8365b640 1 -- start start 2024-09-19T06:42:44.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d8365b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d7c101de0 0x7f0d7c0739e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d8365b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d7c102790 0x7f0d7c06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d8365b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d7c106f10 0x7f0d7c06cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d8365b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c111fc0 con 0x7f0d7c102790 2024-09-19T06:42:44.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d8365b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c111e40 con 0x7f0d7c101de0 2024-09-19T06:42:44.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d8365b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c112140 con 0x7f0d7c106f10 2024-09-19T06:42:44.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d813f7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d7c101de0 0x7f0d7c0739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d80bf6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d7c102790 0x7f0d7c06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d813f7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d7c101de0 0x7f0d7c0739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44682/0 (socket says 172.21.15.12:44682) 2024-09-19T06:42:44.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d813f7640 1 -- 172.21.15.12:0/1203390023 learned_addr learned my addr 172.21.15.12:0/1203390023 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:44.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.944+0000 7f0d81bf8640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d7c106f10 0x7f0d7c06cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.945+0000 7f0d80bf6640 1 -- 172.21.15.12:0/1203390023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d7c106f10 msgr2=0x7f0d7c06cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:44.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.945+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d7c106f10 0x7f0d7c06cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.945+0000 7f0d80bf6640 1 -- 172.21.15.12:0/1203390023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d7c101de0 msgr2=0x7f0d7c0739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:44.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.945+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d7c101de0 0x7f0d7c0739e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.945+0000 7f0d80bf6640 1 -- 172.21.15.12:0/1203390023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c06d570 con 0x7f0d7c102790 2024-09-19T06:42:44.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.945+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d7c102790 0x7f0d7c06ca70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000eb00 tx=0x7f0d7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:44.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.945+0000 7f0d7a7fc640 1 -- 172.21.15.12:0/1203390023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70010430 con 0x7f0d7c102790 2024-09-19T06:42:44.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.945+0000 7f0d8365b640 1 -- 172.21.15.12:0/1203390023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c06d860 con 0x7f0d7c102790 2024-09-19T06:42:44.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.945+0000 7f0d8365b640 1 -- 172.21.15.12:0/1203390023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c071880 con 0x7f0d7c102790 2024-09-19T06:42:44.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.945+0000 7f0d7a7fc640 1 -- 172.21.15.12:0/1203390023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d70010ab0 con 0x7f0d7c102790 2024-09-19T06:42:44.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.946+0000 7f0d7a7fc640 1 -- 172.21.15.12:0/1203390023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70021ad0 con 0x7f0d7c102790 2024-09-19T06:42:44.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.950+0000 7f0d85a34740 1 Processor -- start 2024-09-19T06:42:44.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.950+0000 7f0d85a34740 1 -- start start 2024-09-19T06:42:44.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.950+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae2b70 0x5594d6ae2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 0x5594d6ade460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6af6900 0x5594d6af8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d85a34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5594d6a402e0 con 0x5594d6af6900 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d85a34740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5594d69e7ce0 con 0x5594d6ae2b70 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d85a34740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5594d6a3c2a0 con 0x5594d6ae3490 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d81bf8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae2b70 0x5594d6ae2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d81bf8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae2b70 0x5594d6ae2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44694/0 (socket says 172.21.15.12:44694) 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d81bf8640 1 -- 172.21.15.12:0/3996684212 learned_addr learned my addr 172.21.15.12:0/3996684212 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d7a7fc640 1 -- 172.21.15.12:0/1203390023 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0d70021c70 con 0x7f0d7c102790 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d81bf8640 1 -- 172.21.15.12:0/3996684212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 msgr2=0x5594d6ade460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d81bf8640 1 --2- 172.21.15.12:0/3996684212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 0x5594d6ade460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d81bf8640 1 -- 172.21.15.12:0/3996684212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6af6900 msgr2=0x5594d6af8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d81bf8640 1 --2- 172.21.15.12:0/3996684212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6af6900 0x5594d6af8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.951+0000 7f0d81bf8640 1 -- 172.21.15.12:0/3996684212 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d69cc440 con 0x5594d6ae2b70 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.952+0000 7f0d81bf8640 1 --2- 172.21.15.12:0/3996684212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae2b70 0x5594d6ae2f50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800bba0 tx=0x7f0d68031740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdc7950b7cf9ce46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:44.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.952+0000 7f0d677fe640 1 -- 172.21.15.12:0/3996684212 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68037070 con 0x5594d6ae2b70 2024-09-19T06:42:44.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.953+0000 7f0d677fe640 1 -- 172.21.15.12:0/3996684212 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d68005500 con 0x5594d6ae2b70 2024-09-19T06:42:44.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.953+0000 7f0d7a7fc640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d6c0a35b0 0x7f0d6c0a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.953+0000 7f0d813f7640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d6c0a35b0 0x7f0d6c0a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.953+0000 7f0d7a7fc640 1 -- 172.21.15.12:0/1203390023 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0d70021870 con 0x7f0d7c102790 2024-09-19T06:42:44.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.953+0000 7f0d677fe640 1 -- 172.21.15.12:0/3996684212 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d680336b0 con 0x5594d6ae2b70 2024-09-19T06:42:44.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.954+0000 7f0d85a34740 1 -- 172.21.15.12:0/3996684212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae2b70 msgr2=0x5594d6ae2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:44.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.954+0000 7f0d85a34740 1 --2- 172.21.15.12:0/3996684212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae2b70 0x5594d6ae2f50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800bba0 tx=0x7f0d68031740 comp rx=0 tx=0).stop 2024-09-19T06:42:44.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.954+0000 7f0d85a34740 1 -- 172.21.15.12:0/3996684212 shutdown_connections 2024-09-19T06:42:44.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.954+0000 7f0d85a34740 1 --2- 172.21.15.12:0/3996684212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6af6900 0x5594d6af8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.954+0000 7f0d85a34740 1 --2- 172.21.15.12:0/3996684212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 0x5594d6ade460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.954+0000 7f0d85a34740 1 --2- 172.21.15.12:0/3996684212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae2b70 0x5594d6ae2f50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.954+0000 7f0d85a34740 1 -- 172.21.15.12:0/3996684212 >> 172.21.15.12:0/3996684212 conn(0x5594d6adf240 msgr2=0x5594d6adf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:44.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.954+0000 7f0d85a34740 1 -- 172.21.15.12:0/3996684212 shutdown_connections 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.954+0000 7f0d85a34740 1 -- 172.21.15.12:0/3996684212 wait complete. 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.954+0000 7f0d813f7640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d6c0a35b0 0x7f0d6c0a5a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d740096c0 tx=0x7f0d740046c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.955+0000 7f0d85a34740 1 -- start start 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.955+0000 7f0d85a34740 1 Processor -- start 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.955+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.955+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae3490 0x5594d6ae6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.955+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6af6900 0x5594d6ae6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.955+0000 7f0d85a34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5594d6ae5a10 con 0x5594d6ae2b70 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.955+0000 7f0d85a34740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5594d69fb050 con 0x5594d6ae3490 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.955+0000 7f0d85a34740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5594d6ae5b90 con 0x5594d6af6900 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d85a34740 10 client.0 _ll_register_callbacks cb 0x5594d6a3b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:44.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d813f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d813f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33190/0 (socket says 172.21.15.12:33190) 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d813f7640 1 -- 172.21.15.12:0/2976375093 learned_addr learned my addr 172.21.15.12:0/2976375093 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae3490 0x5594d6ae6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d81bf8640 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6af6900 0x5594d6ae6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d813f7640 1 -- 172.21.15.12:0/2976375093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6af6900 msgr2=0x5594d6ae6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d813f7640 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6af6900 0x5594d6ae6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d813f7640 1 -- 172.21.15.12:0/2976375093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae3490 msgr2=0x5594d6ae6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d813f7640 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae3490 0x5594d6ae6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d813f7640 1 -- 172.21.15.12:0/2976375093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594d67b13c0 con 0x5594d6ae2b70 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d81bf8640 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6af6900 0x5594d6ae6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae3490 0x5594d6ae6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.956+0000 7f0d813f7640 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5ef0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0d74006010 tx=0x7f0d74009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304454926b081ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.957+0000 7f0d64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:42:44.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.957+0000 7f0d64ff9640 1 -- 172.21.15.12:0/2976375093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7404c020 con 0x5594d6ae2b70 2024-09-19T06:42:44.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.957+0000 7f0d64ff9640 1 -- 172.21.15.12:0/2976375093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0d740037f0 con 0x5594d6ae2b70 2024-09-19T06:42:44.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.957+0000 7f0d85a34740 1 -- 172.21.15.12:0/2976375093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d68005500 con 0x5594d6ae2b70 2024-09-19T06:42:44.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.957+0000 7f0d64ff9640 1 -- 172.21.15.12:0/2976375093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0d74057050 con 0x5594d6ae2b70 2024-09-19T06:42:44.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.957+0000 7f0d85a34740 10 client.16281 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:44.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.957+0000 7f0d85a34740 1 -- 172.21.15.12:0/2976375093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5594d6af39e0 con 0x5594d6ae2b70 2024-09-19T06:42:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.959+0000 7f0d64ff9640 1 -- 172.21.15.12:0/2976375093 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d68005500 con 0x5594d6ae2b70 2024-09-19T06:42:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.959+0000 7f0d64ff9640 1 -- 172.21.15.12:0/2976375093 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f0d74048b90 con 0x5594d6ae2b70 2024-09-19T06:42:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.959+0000 7f0d85a34740 10 client.16281 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.959+0000 7f0d85a34740 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.959+0000 7f0d85a34740 20 client.16281 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.959+0000 7f0d85a34740 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594d6af53c0 0x5594d6af5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.959+0000 7f0d85a34740 4 client.16281 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.959+0000 7f0d85a34740 1 -- 172.21.15.12:0/2976375093 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594d6a4d850 con 0x5594d6af53c0 2024-09-19T06:42:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.959+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594d6af53c0 0x5594d6af5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.960+0000 7f0d64ff9640 10 client.16281 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.960+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594d6af53c0 0x5594d6af5830 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9feae39d6c97add server_cookie=c2cebb46199a4c8c in_seq=0 out_seq=0 2024-09-19T06:42:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.961+0000 7f0d64ff9640 1 -- 172.21.15.12:0/2976375093 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594d6a4d850 con 0x5594d6af53c0 2024-09-19T06:42:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.961+0000 7f0d64ff9640 10 client.16281 handle_command_reply: tid=0 2024-09-19T06:42:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.961+0000 7f0d85a34740 1 client.16281 shutdown 2024-09-19T06:42:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.961+0000 7f0d85a34740 1 -- 172.21.15.12:0/2976375093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 msgr2=0x5594d6ae5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.961+0000 7f0d85a34740 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5ef0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0d74006010 tx=0x7f0d74009260 comp rx=0 tx=0).stop 2024-09-19T06:42:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.961+0000 7f0d85a34740 1 -- 172.21.15.12:0/2976375093 shutdown_connections 2024-09-19T06:42:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.962+0000 7f0d85a34740 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594d6af53c0 0x5594d6af5830 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.962+0000 7f0d85a34740 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6af6900 0x5594d6ae6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.962+0000 7f0d85a34740 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6ae3490 0x5594d6ae6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.962+0000 7f0d85a34740 1 --2- 172.21.15.12:0/2976375093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5ef0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.962+0000 7f0d85a34740 1 -- 172.21.15.12:0/2976375093 >> 172.21.15.12:0/2976375093 conn(0x5594d6adf240 msgr2=0x5594d6ae4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.962+0000 7f0d64ff9640 0 client.16281 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.962+0000 7f0d85a34740 1 -- 172.21.15.12:0/2976375093 shutdown_connections 2024-09-19T06:42:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.962+0000 7f0d85a34740 1 -- 172.21.15.12:0/2976375093 wait complete. 2024-09-19T06:42:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.962+0000 7f0d85a34740 20 client.16281 trim_cache size 0 max 16384 2024-09-19T06:42:44.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.993+0000 7f0d85a34740 1 Processor -- start 2024-09-19T06:42:44.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.993+0000 7f0d85a34740 1 -- start start 2024-09-19T06:42:44.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.993+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.993+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae3490 0x5594d6af05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6af6900 0x5594d6afcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d85a34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6000ea20 con 0x5594d6ae3490 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d85a34740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d60010650 con 0x5594d6af6900 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d85a34740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6000f0f0 con 0x5594d6ae2b70 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d813f7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d813f7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:42238/0 (socket says 172.21.15.12:42238) 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d813f7640 1 -- 172.21.15.12:0/1736218373 learned_addr learned my addr 172.21.15.12:0/1736218373 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/1736218373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae3490 0x5594d6af05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d81bf8640 1 --2- 172.21.15.12:0/1736218373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6af6900 0x5594d6afcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d813f7640 1 -- 172.21.15.12:0/1736218373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6af6900 msgr2=0x5594d6afcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d813f7640 1 --2- 172.21.15.12:0/1736218373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6af6900 0x5594d6afcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d813f7640 1 -- 172.21.15.12:0/1736218373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae3490 msgr2=0x5594d6af05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d813f7640 1 --2- 172.21.15.12:0/1736218373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae3490 0x5594d6af05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.994+0000 7f0d813f7640 1 -- 172.21.15.12:0/1736218373 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d6ae4120 con 0x5594d6ae2b70 2024-09-19T06:42:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.995+0000 7f0d813f7640 1 --2- 172.21.15.12:0/1736218373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d74031980 tx=0x7f0d7403b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d6e366dc7b71a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.995+0000 7f0d66ffd640 1 -- 172.21.15.12:0/1736218373 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7404c070 con 0x5594d6ae2b70 2024-09-19T06:42:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.995+0000 7f0d66ffd640 1 -- 172.21.15.12:0/1736218373 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d7405f020 con 0x5594d6ae2b70 2024-09-19T06:42:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.995+0000 7f0d66ffd640 1 -- 172.21.15.12:0/1736218373 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74035050 con 0x5594d6ae2b70 2024-09-19T06:42:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.996+0000 7f0d85a34740 1 -- 172.21.15.12:0/1736218373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae2b70 msgr2=0x5594d6ae5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.997+0000 7f0d85a34740 1 --2- 172.21.15.12:0/1736218373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d74031980 tx=0x7f0d7403b7b0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.997+0000 7f0d85a34740 1 -- 172.21.15.12:0/1736218373 shutdown_connections 2024-09-19T06:42:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.997+0000 7f0d85a34740 1 --2- 172.21.15.12:0/1736218373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6af6900 0x5594d6afcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.997+0000 7f0d85a34740 1 --2- 172.21.15.12:0/1736218373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae3490 0x5594d6af05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.997+0000 7f0d85a34740 1 --2- 172.21.15.12:0/1736218373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae2b70 0x5594d6ae5690 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.997+0000 7f0d85a34740 1 -- 172.21.15.12:0/1736218373 >> 172.21.15.12:0/1736218373 conn(0x5594d6adf240 msgr2=0x5594d6aefec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.998+0000 7f0d85a34740 1 -- 172.21.15.12:0/1736218373 shutdown_connections 2024-09-19T06:42:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.998+0000 7f0d85a34740 1 -- 172.21.15.12:0/1736218373 wait complete. 2024-09-19T06:42:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.998+0000 7f0d85a34740 1 -- start start 2024-09-19T06:42:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.998+0000 7f0d85a34740 1 Processor -- start 2024-09-19T06:42:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.999+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 0x5594d6afe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.999+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 0x5594d6afe600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:44.999+0000 7f0d85a34740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6af6900 0x5594d6afc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d80bf6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 0x5594d6afe600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d80bf6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 0x5594d6afe600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:42252/0 (socket says 172.21.15.12:42252) 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d85a34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6000fec0 con 0x5594d6ae2b70 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d85a34740 1 -- 172.21.15.12:0/1332278970 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6000f7f0 con 0x5594d6af6900 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d80bf6640 1 -- 172.21.15.12:0/1332278970 learned_addr learned my addr 172.21.15.12:0/1332278970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d85a34740 1 -- 172.21.15.12:0/1332278970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6000ca00 con 0x5594d6ae3490 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d85a34740 10 client.0 _ll_register_callbacks cb 0x7f0d7403f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d813f7640 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 0x5594d6afe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d81bf8640 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6af6900 0x5594d6afc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d80bf6640 1 -- 172.21.15.12:0/1332278970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6af6900 msgr2=0x5594d6afc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6af6900 0x5594d6afc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d80bf6640 1 -- 172.21.15.12:0/1332278970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 msgr2=0x5594d6afe0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 0x5594d6afe0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.000+0000 7f0d80bf6640 1 -- 172.21.15.12:0/1332278970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594d6afce90 con 0x5594d6ae3490 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.001+0000 7f0d80bf6640 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 0x5594d6afe600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0d700992a0 tx=0x7f0d70098ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b387728734c53703 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.001+0000 7f0d64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.001+0000 7f0d64ff9640 1 -- 172.21.15.12:0/1332278970 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d700a0c80 con 0x5594d6ae3490 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.001+0000 7f0d64ff9640 1 -- 172.21.15.12:0/1332278970 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0d7009abd0 con 0x5594d6ae3490 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.001+0000 7f0d85a34740 1 -- 172.21.15.12:0/1332278970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d7405f020 con 0x5594d6ae3490 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.001+0000 7f0d64ff9640 1 -- 172.21.15.12:0/1332278970 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0d700a5540 con 0x5594d6ae3490 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.001+0000 7f0d85a34740 10 client.25864 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.001+0000 7f0d85a34740 1 -- 172.21.15.12:0/1332278970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5594d6b5fa80 con 0x5594d6ae3490 2024-09-19T06:42:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.002+0000 7f0d64ff9640 1 -- 172.21.15.12:0/1332278970 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d7405f020 con 0x5594d6ae3490 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.002+0000 7f0d64ff9640 1 -- 172.21.15.12:0/1332278970 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f0d700a50b0 con 0x5594d6ae3490 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.002+0000 7f0d85a34740 10 client.25864 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.002+0000 7f0d85a34740 10 client.25864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.002+0000 7f0d85a34740 20 client.25864 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.002+0000 7f0d85a34740 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594d6b60270 0x5594d6b62690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.002+0000 7f0d85a34740 4 client.25864 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.002+0000 7f0d85a34740 1 -- 172.21.15.12:0/1332278970 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5594d6a47d60 con 0x5594d6b60270 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.002+0000 7f0d813f7640 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594d6b60270 0x5594d6b62690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.005+0000 7f0d813f7640 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594d6b60270 0x5594d6b62690 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a33553737720ee7d server_cookie=5ce2bda96099f55f in_seq=0 out_seq=0 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.005+0000 7f0d64ff9640 10 client.25864 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.005+0000 7f0d64ff9640 1 -- 172.21.15.12:0/1332278970 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5594d6a47d60 con 0x5594d6b60270 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.005+0000 7f0d64ff9640 10 client.25864 handle_command_reply: tid=0 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.005+0000 7f0d85a34740 1 client.25864 shutdown 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 1 -- 172.21.15.12:0/1332278970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 msgr2=0x5594d6afe600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 0x5594d6afe600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0d700992a0 tx=0x7f0d70098ca0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 1 -- 172.21.15.12:0/1332278970 shutdown_connections 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594d6b60270 0x5594d6b62690 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594d6af6900 0x5594d6afc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594d6ae3490 0x5594d6afe600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 1 --2- 172.21.15.12:0/1332278970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594d6ae2b70 0x5594d6afe0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 1 -- 172.21.15.12:0/1332278970 >> 172.21.15.12:0/1332278970 conn(0x5594d6adf240 msgr2=0x5594d6af06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d64ff9640 0 client.25864 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 1 -- 172.21.15.12:0/1332278970 shutdown_connections 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 1 -- 172.21.15.12:0/1332278970 wait complete. 2024-09-19T06:42:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.006+0000 7f0d85a34740 20 client.25864 trim_cache size 0 max 16384 2024-09-19T06:42:45.012 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:42:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:42:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:42:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "b8227e9b-1df1-4492-8290-9b325ef2c71e": { 2024-09-19T06:42:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:42:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "b8227e9b-1df1-4492-8290-9b325ef2c71e", 2024-09-19T06:42:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:42:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:42:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:42:45.012 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:42:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.007+0000 7f0d8365b640 1 -- 172.21.15.12:0/1203390023 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d6c0a35b0 msgr2=0x7f0d6c0a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.007+0000 7f0d8365b640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d6c0a35b0 0x7f0d6c0a5a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d740096c0 tx=0x7f0d740046c0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.007+0000 7f0d8365b640 1 -- 172.21.15.12:0/1203390023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d7c102790 msgr2=0x7f0d7c06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.007+0000 7f0d8365b640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d7c102790 0x7f0d7c06ca70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000eb00 tx=0x7f0d7000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.008+0000 7f0d8365b640 1 -- 172.21.15.12:0/1203390023 shutdown_connections 2024-09-19T06:42:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.008+0000 7f0d8365b640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d6c0a35b0 0x7f0d6c0a5a70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.008+0000 7f0d8365b640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d7c106f10 0x7f0d7c06cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.008+0000 7f0d8365b640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d7c102790 0x7f0d7c06ca70 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.008+0000 7f0d8365b640 1 --2- 172.21.15.12:0/1203390023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d7c101de0 0x7f0d7c0739e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.008+0000 7f0d8365b640 1 -- 172.21.15.12:0/1203390023 >> 172.21.15.12:0/1203390023 conn(0x7f0d7c0fd880 msgr2=0x7f0d7c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.008+0000 7f0d8365b640 1 -- 172.21.15.12:0/1203390023 shutdown_connections 2024-09-19T06:42:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:42:45.008+0000 7f0d8365b640 1 -- 172.21.15.12:0/1203390023 wait complete. 2024-09-19T06:42:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 120.0 s, 4126.2 tps, lat 24.259 ms stddev 25.903 2024-09-19T06:42:45.834 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:45 smithi012 ceph-mon[30937]: pgmap v81: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 752 op/s 2024-09-19T06:42:45.877 INFO:tasks.cephfs.filesystem:scrub status for tag:b8227e9b-1df1-4492-8290-9b325ef2c71e - {'path': '/', 'tag': 'b8227e9b-1df1-4492-8290-9b325ef2c71e', 'options': 'recursive,force'} 2024-09-19T06:42:46.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:45 smithi016 ceph-mon[34911]: pgmap v81: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 752 op/s 2024-09-19T06:42:46.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:45 smithi173 ceph-mon[35349]: pgmap v81: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 752 op/s 2024-09-19T06:42:48.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:47 smithi016 ceph-mon[34911]: pgmap v82: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 15 MiB/s wr, 1.21k op/s 2024-09-19T06:42:48.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:47 smithi173 ceph-mon[35349]: pgmap v82: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 15 MiB/s wr, 1.21k op/s 2024-09-19T06:42:48.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:47 smithi012 ceph-mon[30937]: pgmap v82: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 15 MiB/s wr, 1.21k op/s 2024-09-19T06:42:49.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:48 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:42:49.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:48 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:42:49.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:48 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:42:49.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:48 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:42:49.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:48 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:42:49.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:48 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:42:49.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:48 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:42:49.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:48 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:42:49.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:48 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:42:50.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:49 smithi016 ceph-mon[34911]: pgmap v83: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 11 MiB/s wr, 843 op/s 2024-09-19T06:42:50.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:49 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:42:50.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:49 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:42:50.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:49 smithi173 ceph-mon[35349]: pgmap v83: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 11 MiB/s wr, 843 op/s 2024-09-19T06:42:50.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:49 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:42:50.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:49 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:42:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:49 smithi012 ceph-mon[30937]: pgmap v83: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 11 MiB/s wr, 843 op/s 2024-09-19T06:42:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:49 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:42:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:49 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:42:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 125.0 s, 4528.2 tps, lat 22.092 ms stddev 26.238 2024-09-19T06:42:52.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:51 smithi016 ceph-mon[34911]: pgmap v84: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 15 MiB/s wr, 1.24k op/s 2024-09-19T06:42:52.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:51 smithi173 ceph-mon[35349]: pgmap v84: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 15 MiB/s wr, 1.24k op/s 2024-09-19T06:42:52.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:51 smithi012 ceph-mon[30937]: pgmap v84: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 15 MiB/s wr, 1.24k op/s 2024-09-19T06:42:54.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:53 smithi016 ceph-mon[34911]: pgmap v85: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.7 MiB/s wr, 849 op/s 2024-09-19T06:42:54.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:53 smithi173 ceph-mon[35349]: pgmap v85: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.7 MiB/s wr, 849 op/s 2024-09-19T06:42:54.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:53 smithi012 ceph-mon[30937]: pgmap v85: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.7 MiB/s wr, 849 op/s 2024-09-19T06:42:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 130.0 s, 4677.4 tps, lat 21.377 ms stddev 21.635 2024-09-19T06:42:56.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:55 smithi016 ceph-mon[34911]: pgmap v86: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.7 MiB/s wr, 849 op/s 2024-09-19T06:42:56.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:55 smithi173 ceph-mon[35349]: pgmap v86: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.7 MiB/s wr, 849 op/s 2024-09-19T06:42:56.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:55 smithi012 ceph-mon[30937]: pgmap v86: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.7 MiB/s wr, 849 op/s 2024-09-19T06:42:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.369+0000 7f7252766640 1 -- 172.21.15.12:0/2288557516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f724c1009b0 msgr2=0x7f724c100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:56.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.369+0000 7f7252766640 1 --2- 172.21.15.12:0/2288557516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f724c1009b0 0x7f724c100e10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7240009930 tx=0x7f724002a420 comp rx=0 tx=0).stop 2024-09-19T06:42:56.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.370+0000 7f7252766640 1 -- 172.21.15.12:0/2288557516 shutdown_connections 2024-09-19T06:42:56.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.370+0000 7f7252766640 1 --2- 172.21.15.12:0/2288557516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f724c101350 0x7f724c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.370+0000 7f7252766640 1 --2- 172.21.15.12:0/2288557516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f724c1009b0 0x7f724c100e10 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.370+0000 7f7252766640 1 --2- 172.21.15.12:0/2288557516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f724c1069c0 0x7f724c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.370+0000 7f7252766640 1 -- 172.21.15.12:0/2288557516 >> 172.21.15.12:0/2288557516 conn(0x7f724c077990 msgr2=0x7f724c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:56.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.371+0000 7f7252766640 1 -- 172.21.15.12:0/2288557516 shutdown_connections 2024-09-19T06:42:56.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.371+0000 7f7252766640 1 -- 172.21.15.12:0/2288557516 wait complete. 2024-09-19T06:42:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.371+0000 7f7252766640 1 Processor -- start 2024-09-19T06:42:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.372+0000 7f7252766640 1 -- start start 2024-09-19T06:42:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.372+0000 7f7252766640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f724c1009b0 0x7f724c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.372+0000 7f7252766640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f724c101350 0x7f724c19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.372+0000 7f7252766640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f724c1069c0 0x7f724c19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.372+0000 7f7252766640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f724c110e50 con 0x7f724c1009b0 2024-09-19T06:42:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.372+0000 7f7252766640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f724c110cd0 con 0x7f724c101350 2024-09-19T06:42:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.372+0000 7f7252766640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f724c110fd0 con 0x7f724c1069c0 2024-09-19T06:42:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.373+0000 7f724bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f724c1009b0 0x7f724c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.373+0000 7f724bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f724c1009b0 0x7f724c19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53326/0 (socket says 172.21.15.12:53326) 2024-09-19T06:42:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.373+0000 7f724bfff640 1 -- 172.21.15.12:0/2039696412 learned_addr learned my addr 172.21.15.12:0/2039696412 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.373+0000 7f724b7fe640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f724c101350 0x7f724c19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.373+0000 7f724bfff640 1 -- 172.21.15.12:0/2039696412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f724c1069c0 msgr2=0x7f724c19ecb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:42:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.373+0000 7f7250d03640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f724c1069c0 0x7f724c19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.374+0000 7f724bfff640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f724c1069c0 0x7f724c19ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.374+0000 7f724bfff640 1 -- 172.21.15.12:0/2039696412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f724c101350 msgr2=0x7f724c19a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.374+0000 7f724bfff640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f724c101350 0x7f724c19a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.374+0000 7f724bfff640 1 -- 172.21.15.12:0/2039696412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c19f3e0 con 0x7f724c1009b0 2024-09-19T06:42:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.374+0000 7f724b7fe640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f724c101350 0x7f724c19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.374+0000 7f724bfff640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f724c1009b0 0x7f724c19a3f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f723c00e9f0 tx=0x7f723c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.375+0000 7f72497fa640 1 -- 172.21.15.12:0/2039696412 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c00cd80 con 0x7f724c1009b0 2024-09-19T06:42:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.375+0000 7f7252766640 1 -- 172.21.15.12:0/2039696412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724c19f6d0 con 0x7f724c1009b0 2024-09-19T06:42:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.375+0000 7f72497fa640 1 -- 172.21.15.12:0/2039696412 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f723c010910 con 0x7f724c1009b0 2024-09-19T06:42:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.375+0000 7f7252766640 1 -- 172.21.15.12:0/2039696412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724c1a6f60 con 0x7f724c1009b0 2024-09-19T06:42:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.375+0000 7f72497fa640 1 -- 172.21.15.12:0/2039696412 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c018990 con 0x7f724c1009b0 2024-09-19T06:42:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.379+0000 7f72555e0740 1 Processor -- start 2024-09-19T06:42:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.379+0000 7f72555e0740 1 -- start start 2024-09-19T06:42:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.380+0000 7f72555e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32942df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.380+0000 7f72555e0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32943330 0x562f32955f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.380+0000 7f72555e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329564c0 0x562f329588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.380+0000 7f72555e0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562f328a72f0 con 0x562f32943330 2024-09-19T06:42:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.380+0000 7f72555e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562f3284f270 con 0x562f329564c0 2024-09-19T06:42:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.380+0000 7f72555e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562f328a32b0 con 0x562f32942a10 2024-09-19T06:42:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.380+0000 7f724b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329564c0 0x562f329588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.380+0000 7f724b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329564c0 0x562f329588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34160/0 (socket says 172.21.15.12:34160) 2024-09-19T06:42:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.380+0000 7f724b7fe640 1 -- 172.21.15.12:0/809404895 learned_addr learned my addr 172.21.15.12:0/809404895 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.380+0000 7f7250d03640 1 --2- 172.21.15.12:0/809404895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32942df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.381+0000 7f724b7fe640 1 -- 172.21.15.12:0/809404895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 msgr2=0x562f32942df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.381+0000 7f724b7fe640 1 --2- 172.21.15.12:0/809404895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32942df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.381+0000 7f724b7fe640 1 -- 172.21.15.12:0/809404895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32943330 msgr2=0x562f32955f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:42:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.381+0000 7f724b7fe640 1 --2- 172.21.15.12:0/809404895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32943330 0x562f32955f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.381+0000 7f724b7fe640 1 -- 172.21.15.12:0/809404895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3284e340 con 0x562f329564c0 2024-09-19T06:42:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.381+0000 7f72497fa640 1 -- 172.21.15.12:0/2039696412 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f723c018c10 con 0x7f724c1009b0 2024-09-19T06:42:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.381+0000 7f724b7fe640 1 --2- 172.21.15.12:0/809404895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329564c0 0x562f329588b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7240009930 tx=0x7f724000b0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3297e4f6da134b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.382+0000 7f72327fc640 1 -- 172.21.15.12:0/809404895 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240040070 con 0x562f329564c0 2024-09-19T06:42:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.382+0000 7f72327fc640 1 -- 172.21.15.12:0/809404895 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72400044d0 con 0x562f329564c0 2024-09-19T06:42:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.382+0000 7f72327fc640 1 -- 172.21.15.12:0/809404895 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240035040 con 0x562f329564c0 2024-09-19T06:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.382+0000 7f72497fa640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72340a3640 0x7f72340a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.383+0000 7f72497fa640 1 -- 172.21.15.12:0/2039696412 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f723c0cff00 con 0x7f724c1009b0 2024-09-19T06:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.383+0000 7f72555e0740 1 -- 172.21.15.12:0/809404895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329564c0 msgr2=0x562f329588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.383+0000 7f72555e0740 1 --2- 172.21.15.12:0/809404895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329564c0 0x562f329588b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7240009930 tx=0x7f724000b0d0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.384+0000 7f7250d03640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72340a3640 0x7f72340a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.384+0000 7f72555e0740 1 -- 172.21.15.12:0/809404895 shutdown_connections 2024-09-19T06:42:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.384+0000 7f72555e0740 1 --2- 172.21.15.12:0/809404895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329564c0 0x562f329588b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.384+0000 7f72555e0740 1 --2- 172.21.15.12:0/809404895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32943330 0x562f32955f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.384+0000 7f72555e0740 1 --2- 172.21.15.12:0/809404895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32942df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.384+0000 7f72555e0740 1 -- 172.21.15.12:0/809404895 >> 172.21.15.12:0/809404895 conn(0x562f3293f060 msgr2=0x562f3293f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.385+0000 7f72555e0740 1 -- 172.21.15.12:0/809404895 shutdown_connections 2024-09-19T06:42:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.385+0000 7f7250d03640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72340a3640 0x7f72340a5b00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f724400bd50 tx=0x7f724400b300 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.385+0000 7f72555e0740 1 -- 172.21.15.12:0/809404895 wait complete. 2024-09-19T06:42:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.386+0000 7f72555e0740 1 -- start start 2024-09-19T06:42:56.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.386+0000 7f72555e0740 1 Processor -- start 2024-09-19T06:42:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f72555e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32953460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f72555e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f32943330 0x562f329539a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f72555e0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f329564c0 0x562f32953ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f72555e0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562f32959090 con 0x562f329564c0 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f72555e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562f32830290 con 0x562f32943330 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f72555e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562f32959210 con 0x562f32942a10 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f724bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32953460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f72555e0740 10 client.0 _ll_register_callbacks cb 0x562f32861140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f724bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32953460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33346/0 (socket says 172.21.15.12:33346) 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f724bfff640 1 -- 172.21.15.12:0/4067844122 learned_addr learned my addr 172.21.15.12:0/4067844122 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f724b7fe640 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f32943330 0x562f329539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.387+0000 7f7250d03640 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f329564c0 0x562f32953ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f724bfff640 1 -- 172.21.15.12:0/4067844122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f32943330 msgr2=0x562f329539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f724bfff640 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f32943330 0x562f329539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f724bfff640 1 -- 172.21.15.12:0/4067844122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f329564c0 msgr2=0x562f32953ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:56.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f724bfff640 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f329564c0 0x562f32953ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f724bfff640 1 -- 172.21.15.12:0/4067844122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f325ba210 con 0x562f32942a10 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f7250d03640 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f329564c0 0x562f32953ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f724bfff640 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32953460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f723c00e9c0 tx=0x7f723c09bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6977640094b0de12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f722b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f722b7fe640 1 -- 172.21.15.12:0/4067844122 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c09c100 con 0x562f32942a10 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f722b7fe640 1 -- 172.21.15.12:0/4067844122 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f723c0cd7f0 con 0x562f32942a10 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f72555e0740 1 -- 172.21.15.12:0/4067844122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72400044d0 con 0x562f32942a10 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f722b7fe640 1 -- 172.21.15.12:0/4067844122 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f723c0cd9f0 con 0x562f32942a10 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f72555e0740 10 client.25870 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.388+0000 7f72555e0740 1 -- 172.21.15.12:0/4067844122 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562f32686620 con 0x562f32942a10 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.389+0000 7f722b7fe640 1 -- 172.21.15.12:0/4067844122 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72400044d0 con 0x562f32942a10 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.389+0000 7f722b7fe640 1 -- 172.21.15.12:0/4067844122 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f723c097e50 con 0x562f32942a10 2024-09-19T06:42:56.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.389+0000 7f72555e0740 10 client.25870 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.389+0000 7f72555e0740 10 client.25870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.389+0000 7f72555e0740 20 client.25870 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.389+0000 7f72555e0740 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f329496c0 0x562f3294bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.389+0000 7f72555e0740 4 client.25870 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:42:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.389+0000 7f72555e0740 1 -- 172.21.15.12:0/4067844122 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f328b4a20 con 0x562f329496c0 2024-09-19T06:42:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.389+0000 7f724b7fe640 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f329496c0 0x562f3294bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.391+0000 7f724b7fe640 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f329496c0 0x562f3294bae0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd6dc9bfeffd6797 server_cookie=bf69d8347e3e2e35 in_seq=0 out_seq=0 2024-09-19T06:42:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.391+0000 7f722b7fe640 10 client.25870 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.392+0000 7f722b7fe640 1 -- 172.21.15.12:0/4067844122 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f328b4a20 con 0x562f329496c0 2024-09-19T06:42:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.392+0000 7f722b7fe640 10 client.25870 handle_command_reply: tid=0 2024-09-19T06:42:56.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.392+0000 7f72555e0740 1 client.25870 shutdown 2024-09-19T06:42:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.393+0000 7f72555e0740 1 -- 172.21.15.12:0/4067844122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 msgr2=0x562f32953460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.393+0000 7f72555e0740 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32953460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f723c00e9c0 tx=0x7f723c09bd70 comp rx=0 tx=0).stop 2024-09-19T06:42:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.393+0000 7f72555e0740 1 -- 172.21.15.12:0/4067844122 shutdown_connections 2024-09-19T06:42:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.393+0000 7f72555e0740 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f329496c0 0x562f3294bae0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.393+0000 7f72555e0740 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f329564c0 0x562f32953ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.393+0000 7f722b7fe640 0 client.25870 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.393+0000 7f72555e0740 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f32943330 0x562f329539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.393+0000 7f72555e0740 1 --2- 172.21.15.12:0/4067844122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32953460 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.393+0000 7f72555e0740 1 -- 172.21.15.12:0/4067844122 >> 172.21.15.12:0/4067844122 conn(0x562f3293f060 msgr2=0x562f32944d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.394+0000 7f72555e0740 1 -- 172.21.15.12:0/4067844122 shutdown_connections 2024-09-19T06:42:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.394+0000 7f72555e0740 1 -- 172.21.15.12:0/4067844122 wait complete. 2024-09-19T06:42:56.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.394+0000 7f72555e0740 20 client.25870 trim_cache size 0 max 16384 2024-09-19T06:42:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.418+0000 7f72555e0740 1 Processor -- start 2024-09-19T06:42:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.419+0000 7f72555e0740 1 -- start start 2024-09-19T06:42:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.419+0000 7f72555e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32978670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.419+0000 7f72555e0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32943330 0x562f32978bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.419+0000 7f72555e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 0x562f329506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.419+0000 7f72555e0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f723800e9d0 con 0x562f32943330 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.419+0000 7f724bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32978670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f724b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32943330 0x562f32978bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f724b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32943330 0x562f32978bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53344/0 (socket says 172.21.15.12:53344) 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f724b7fe640 1 -- 172.21.15.12:0/330164439 learned_addr learned my addr 172.21.15.12:0/330164439 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f72555e0740 1 -- 172.21.15.12:0/330164439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7238010600 con 0x562f329496c0 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f7250d03640 1 --2- 172.21.15.12:0/330164439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 0x562f329506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f72555e0740 1 -- 172.21.15.12:0/330164439 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f723800f0a0 con 0x562f32942a10 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f7250d03640 1 -- 172.21.15.12:0/330164439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 msgr2=0x562f32978670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f7250d03640 1 --2- 172.21.15.12:0/330164439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32978670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f7250d03640 1 -- 172.21.15.12:0/330164439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32943330 msgr2=0x562f32978bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f7250d03640 1 --2- 172.21.15.12:0/330164439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32943330 0x562f32978bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f7250d03640 1 -- 172.21.15.12:0/330164439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f329392f0 con 0x562f329496c0 2024-09-19T06:42:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f724bfff640 1 --2- 172.21.15.12:0/330164439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32978670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:42:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.420+0000 7f7250d03640 1 --2- 172.21.15.12:0/330164439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 0x562f329506c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7244011650 tx=0x7f7244013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7630a4ab0e54dbe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.421+0000 7f7231ffb640 1 -- 172.21.15.12:0/330164439 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724401f900 con 0x562f329496c0 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.421+0000 7f7231ffb640 1 -- 172.21.15.12:0/330164439 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7244023070 con 0x562f329496c0 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.421+0000 7f7231ffb640 1 -- 172.21.15.12:0/330164439 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724401e430 con 0x562f329496c0 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.422+0000 7f72555e0740 1 -- 172.21.15.12:0/330164439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 msgr2=0x562f329506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.422+0000 7f72555e0740 1 --2- 172.21.15.12:0/330164439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 0x562f329506c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7244011650 tx=0x7f7244013000 comp rx=0 tx=0).stop 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.422+0000 7f72555e0740 1 -- 172.21.15.12:0/330164439 shutdown_connections 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.422+0000 7f72555e0740 1 --2- 172.21.15.12:0/330164439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 0x562f329506c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.422+0000 7f72555e0740 1 --2- 172.21.15.12:0/330164439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32943330 0x562f32978bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.422+0000 7f72555e0740 1 --2- 172.21.15.12:0/330164439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32942a10 0x562f32978670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.422+0000 7f72555e0740 1 -- 172.21.15.12:0/330164439 >> 172.21.15.12:0/330164439 conn(0x562f3293f060 msgr2=0x562f32953c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.423+0000 7f72555e0740 1 -- 172.21.15.12:0/330164439 shutdown_connections 2024-09-19T06:42:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.423+0000 7f72555e0740 1 -- 172.21.15.12:0/330164439 wait complete. 2024-09-19T06:42:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.423+0000 7f72555e0740 1 -- start start 2024-09-19T06:42:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.424+0000 7f72555e0740 1 Processor -- start 2024-09-19T06:42:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.424+0000 7f72555e0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32942a10 0x562f3295e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f72555e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32943330 0x562f3295ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f724bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32942a10 0x562f3295e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f724b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32943330 0x562f3295ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f724bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32942a10 0x562f3295e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53360/0 (socket says 172.21.15.12:53360) 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f724b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32943330 0x562f3295ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33368/0 (socket says 172.21.15.12:33368) 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f72555e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 0x562f3295b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f72555e0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f723800fe70 con 0x562f32942a10 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f72555e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f723800f7a0 con 0x562f329496c0 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f72555e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f723800c9b0 con 0x562f32943330 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f72555e0740 10 client.0 _ll_register_callbacks cb 0x7f723c018b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f724bfff640 1 -- 172.21.15.12:0/845963550 learned_addr learned my addr 172.21.15.12:0/845963550 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.425+0000 7f7250d03640 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 0x562f3295b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f724b7fe640 1 -- 172.21.15.12:0/845963550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 msgr2=0x562f3295b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f724b7fe640 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 0x562f3295b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f724b7fe640 1 -- 172.21.15.12:0/845963550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32942a10 msgr2=0x562f3295e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:42:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f724b7fe640 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32942a10 0x562f3295e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f724b7fe640 1 -- 172.21.15.12:0/845963550 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3295f0e0 con 0x562f32943330 2024-09-19T06:42:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f724b7fe640 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32943330 0x562f3295ea70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f72400056f0 tx=0x7f7240005680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4766d0c0408be756 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f722b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:42:56.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f722b7fe640 1 -- 172.21.15.12:0/845963550 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240035040 con 0x562f32943330 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f722b7fe640 1 -- 172.21.15.12:0/845963550 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f72400035f0 con 0x562f32943330 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f72555e0740 1 -- 172.21.15.12:0/845963550 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7244023070 con 0x562f32943330 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.426+0000 7f722b7fe640 1 -- 172.21.15.12:0/845963550 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7240060050 con 0x562f32943330 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.427+0000 7f72555e0740 10 client.25876 fetch_fsmap learned FSMap version 31 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.427+0000 7f72555e0740 1 -- 172.21.15.12:0/845963550 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562f329d9c20 con 0x562f32943330 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.427+0000 7f722b7fe640 1 -- 172.21.15.12:0/845963550 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7244023070 con 0x562f32943330 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.428+0000 7f722b7fe640 1 -- 172.21.15.12:0/845963550 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f724003c7f0 con 0x562f32943330 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.428+0000 7f72555e0740 10 client.25876 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.428+0000 7f72555e0740 10 client.25876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.428+0000 7f72555e0740 20 client.25876 populate_metadata read hostname 'smithi012' 2024-09-19T06:42:56.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.428+0000 7f72555e0740 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f329564c0 0x562f329dbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.429+0000 7f72555e0740 4 client.25876 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:42:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.429+0000 7f724bfff640 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f329564c0 0x562f329dbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.429+0000 7f72555e0740 1 -- 172.21.15.12:0/845963550 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f328aed70 con 0x562f329564c0 2024-09-19T06:42:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.429+0000 7f724bfff640 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f329564c0 0x562f329dbfa0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e195090e78d4681 server_cookie=6f03cbda886b76c7 in_seq=0 out_seq=0 2024-09-19T06:42:56.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.429+0000 7f722b7fe640 10 client.25876 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.440+0000 7f722b7fe640 1 -- 172.21.15.12:0/845963550 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f328aed70 con 0x562f329564c0 2024-09-19T06:42:56.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f722b7fe640 10 client.25876 handle_command_reply: tid=0 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 client.25876 shutdown 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 -- 172.21.15.12:0/845963550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32943330 msgr2=0x562f3295ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32943330 0x562f3295ea70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f72400056f0 tx=0x7f7240005680 comp rx=0 tx=0).stop 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 -- 172.21.15.12:0/845963550 shutdown_connections 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f329564c0 0x562f329dbfa0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f329496c0 0x562f3295b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f32943330 0x562f3295ea70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 --2- 172.21.15.12:0/845963550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f32942a10 0x562f3295e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 -- 172.21.15.12:0/845963550 >> 172.21.15.12:0/845963550 conn(0x562f3293f060 msgr2=0x562f329613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f722b7fe640 0 client.25876 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 -- 172.21.15.12:0/845963550 shutdown_connections 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 1 -- 172.21.15.12:0/845963550 wait complete. 2024-09-19T06:42:56.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.441+0000 7f72555e0740 20 client.25876 trim_cache size 0 max 16384 2024-09-19T06:42:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:42:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:42:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:42:56.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:42:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.442+0000 7f7252766640 1 -- 172.21.15.12:0/2039696412 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72340a3640 msgr2=0x7f72340a5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.442+0000 7f7252766640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72340a3640 0x7f72340a5b00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f724400bd50 tx=0x7f724400b300 comp rx=0 tx=0).stop 2024-09-19T06:42:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.442+0000 7f7252766640 1 -- 172.21.15.12:0/2039696412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f724c1009b0 msgr2=0x7f724c19a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.442+0000 7f7252766640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f724c1009b0 0x7f724c19a3f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f723c00e9f0 tx=0x7f723c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.443+0000 7f7252766640 1 -- 172.21.15.12:0/2039696412 shutdown_connections 2024-09-19T06:42:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.443+0000 7f7252766640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72340a3640 0x7f72340a5b00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.443+0000 7f7252766640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f724c1069c0 0x7f724c19ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.443+0000 7f7252766640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f724c101350 0x7f724c19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.443+0000 7f7252766640 1 --2- 172.21.15.12:0/2039696412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f724c1009b0 0x7f724c19a3f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.443+0000 7f7252766640 1 -- 172.21.15.12:0/2039696412 >> 172.21.15.12:0/2039696412 conn(0x7f724c077990 msgr2=0x7f724c0698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.443+0000 7f7252766640 1 -- 172.21.15.12:0/2039696412 shutdown_connections 2024-09-19T06:42:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:42:56.443+0000 7f7252766640 1 -- 172.21.15.12:0/2039696412 wait complete. 2024-09-19T06:42:58.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:57 smithi016 ceph-mon[34911]: pgmap v87: 97 pgs: 97 active+clean; 1.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-09-19T06:42:58.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:57 smithi173 ceph-mon[35349]: pgmap v87: 97 pgs: 97 active+clean; 1.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-09-19T06:42:58.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:57 smithi012 ceph-mon[30937]: pgmap v87: 97 pgs: 97 active+clean; 1.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2024-09-19T06:43:00.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:42:59 smithi016 ceph-mon[34911]: pgmap v88: 97 pgs: 97 active+clean; 1.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 9.0 MiB/s wr, 742 op/s 2024-09-19T06:43:00.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:42:59 smithi173 ceph-mon[35349]: pgmap v88: 97 pgs: 97 active+clean; 1.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 9.0 MiB/s wr, 742 op/s 2024-09-19T06:43:00.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:42:59 smithi012 ceph-mon[30937]: pgmap v88: 97 pgs: 97 active+clean; 1.7 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 9.0 MiB/s wr, 742 op/s 2024-09-19T06:43:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 135.0 s, 3978.3 tps, lat 24.306 ms stddev 38.375 2024-09-19T06:43:02.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:01 smithi173 ceph-mon[35349]: pgmap v89: 97 pgs: 97 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 45 MiB/s wr, 1.59k op/s 2024-09-19T06:43:02.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:01 smithi012 ceph-mon[30937]: pgmap v89: 97 pgs: 97 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 45 MiB/s wr, 1.59k op/s 2024-09-19T06:43:02.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:01 smithi016 ceph-mon[34911]: pgmap v89: 97 pgs: 97 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 45 MiB/s wr, 1.59k op/s 2024-09-19T06:43:04.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:03 smithi173 ceph-mon[35349]: pgmap v90: 97 pgs: 97 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 41 MiB/s wr, 1.20k op/s 2024-09-19T06:43:04.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:03 smithi012 ceph-mon[30937]: pgmap v90: 97 pgs: 97 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 41 MiB/s wr, 1.20k op/s 2024-09-19T06:43:04.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:03 smithi016 ceph-mon[34911]: pgmap v90: 97 pgs: 97 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 41 MiB/s wr, 1.20k op/s 2024-09-19T06:43:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 140.0 s, 3544.6 tps, lat 29.130 ms stddev 52.681 2024-09-19T06:43:06.060 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:05 smithi016 ceph-mon[34911]: pgmap v91: 97 pgs: 97 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 41 MiB/s wr, 1.20k op/s 2024-09-19T06:43:06.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:05 smithi173 ceph-mon[35349]: pgmap v91: 97 pgs: 97 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 41 MiB/s wr, 1.20k op/s 2024-09-19T06:43:06.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:05 smithi012 ceph-mon[30937]: pgmap v91: 97 pgs: 97 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 41 MiB/s wr, 1.20k op/s 2024-09-19T06:43:08.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:07 smithi173 ceph-mon[35349]: pgmap v92: 97 pgs: 97 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 58 MiB/s wr, 2.50k op/s 2024-09-19T06:43:08.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:07 smithi012 ceph-mon[30937]: pgmap v92: 97 pgs: 97 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 58 MiB/s wr, 2.50k op/s 2024-09-19T06:43:08.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:07 smithi016 ceph-mon[34911]: pgmap v92: 97 pgs: 97 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 58 MiB/s wr, 2.50k op/s 2024-09-19T06:43:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.590+0000 7f33ba30c640 1 -- 172.21.15.12:0/604687986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b41069c0 msgr2=0x7f33b4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.590+0000 7f33ba30c640 1 --2- 172.21.15.12:0/604687986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b41069c0 0x7f33b4106da0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009930 tx=0x7f33a402a420 comp rx=0 tx=0).stop 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.590+0000 7f33ba30c640 1 -- 172.21.15.12:0/604687986 shutdown_connections 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.590+0000 7f33ba30c640 1 --2- 172.21.15.12:0/604687986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b4101350 0x7f33b410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.590+0000 7f33ba30c640 1 --2- 172.21.15.12:0/604687986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33b41009b0 0x7f33b4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.590+0000 7f33ba30c640 1 --2- 172.21.15.12:0/604687986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b41069c0 0x7f33b4106da0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.590+0000 7f33ba30c640 1 -- 172.21.15.12:0/604687986 >> 172.21.15.12:0/604687986 conn(0x7f33b4077990 msgr2=0x7f33b40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.590+0000 7f33ba30c640 1 -- 172.21.15.12:0/604687986 shutdown_connections 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.590+0000 7f33ba30c640 1 -- 172.21.15.12:0/604687986 wait complete. 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.590+0000 7f33ba30c640 1 Processor -- start 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33ba30c640 1 -- start start 2024-09-19T06:43:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33ba30c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b41009b0 0x7f33b41991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33ba30c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b4101350 0x7f33b4199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33ba30c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33b41069c0 0x7f33b41a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33ba30c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4110e50 con 0x7f33b41009b0 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33ba30c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4110cd0 con 0x7f33b4101350 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33ba30c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4110fd0 con 0x7f33b41069c0 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b41009b0 0x7f33b41991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b41009b0 0x7f33b41991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52448/0 (socket says 172.21.15.12:52448) 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b3fff640 1 -- 172.21.15.12:0/4102813108 learned_addr learned my addr 172.21.15.12:0/4102813108 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b88a9640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33b41069c0 0x7f33b41a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b37fe640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b4101350 0x7f33b4199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b3fff640 1 -- 172.21.15.12:0/4102813108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33b41069c0 msgr2=0x7f33b41a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b3fff640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33b41069c0 0x7f33b41a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b3fff640 1 -- 172.21.15.12:0/4102813108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b4101350 msgr2=0x7f33b4199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b3fff640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b4101350 0x7f33b4199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b3fff640 1 -- 172.21.15.12:0/4102813108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b41a4780 con 0x7f33b41009b0 2024-09-19T06:43:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.591+0000 7f33b88a9640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33b41069c0 0x7f33b41a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.592+0000 7f33b3fff640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b41009b0 0x7f33b41991c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f33a402a940 tx=0x7f33a4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.592+0000 7f33b17fa640 1 -- 172.21.15.12:0/4102813108 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a403f070 con 0x7f33b41009b0 2024-09-19T06:43:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.592+0000 7f33ba30c640 1 -- 172.21.15.12:0/4102813108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b41a4950 con 0x7f33b41009b0 2024-09-19T06:43:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.592+0000 7f33ba30c640 1 -- 172.21.15.12:0/4102813108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b41a4e10 con 0x7f33b41009b0 2024-09-19T06:43:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.592+0000 7f33b17fa640 1 -- 172.21.15.12:0/4102813108 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33a4031c90 con 0x7f33b41009b0 2024-09-19T06:43:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.593+0000 7f33b17fa640 1 -- 172.21.15.12:0/4102813108 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4035030 con 0x7f33b41009b0 2024-09-19T06:43:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.595+0000 7f33bd09d740 1 Processor -- start 2024-09-19T06:43:09.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.596+0000 7f33bd09d740 1 -- start start 2024-09-19T06:43:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.596+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfa8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.596+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfa8ed0 0x558a6dfa9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.596+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfbe740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.596+0000 7f33bd09d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a6df0d2f0 con 0x558a6dfaa080 2024-09-19T06:43:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.596+0000 7f33bd09d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558a6deb5270 con 0x558a6dfa8ed0 2024-09-19T06:43:09.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.596+0000 7f33bd09d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558a6df092b0 con 0x558a6dfbc350 2024-09-19T06:43:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.597+0000 7f33b88a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfa8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.597+0000 7f33b88a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfa8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52450/0 (socket says 172.21.15.12:52450) 2024-09-19T06:43:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.597+0000 7f33b88a9640 1 -- 172.21.15.12:0/1018921316 learned_addr learned my addr 172.21.15.12:0/1018921316 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.597+0000 7f33b88a9640 1 -- 172.21.15.12:0/1018921316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 msgr2=0x558a6dfbe740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:43:09.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.597+0000 7f33b88a9640 1 --2- 172.21.15.12:0/1018921316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfbe740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.597+0000 7f33b88a9640 1 -- 172.21.15.12:0/1018921316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfa8ed0 msgr2=0x558a6dfa9310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:43:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.597+0000 7f33b88a9640 1 --2- 172.21.15.12:0/1018921316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfa8ed0 0x558a6dfa9310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.597+0000 7f33b88a9640 1 -- 172.21.15.12:0/1018921316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6deb4340 con 0x558a6dfaa080 2024-09-19T06:43:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.598+0000 7f33b88a9640 1 --2- 172.21.15.12:0/1018921316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfa8990 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f33ac011790 tx=0x7f33ac011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aee90defd18accc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.598+0000 7f339a7fc640 1 -- 172.21.15.12:0/1018921316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac003c30 con 0x558a6dfaa080 2024-09-19T06:43:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.598+0000 7f339a7fc640 1 -- 172.21.15.12:0/1018921316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ac00fe80 con 0x558a6dfaa080 2024-09-19T06:43:09.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.598+0000 7f339a7fc640 1 -- 172.21.15.12:0/1018921316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0193e0 con 0x558a6dfaa080 2024-09-19T06:43:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.598+0000 7f33b17fa640 1 -- 172.21.15.12:0/4102813108 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f33a4042070 con 0x7f33b41009b0 2024-09-19T06:43:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.599+0000 7f33bd09d740 1 -- 172.21.15.12:0/1018921316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 msgr2=0x558a6dfa8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.599+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1018921316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfa8990 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f33ac011790 tx=0x7f33ac011c50 comp rx=0 tx=0).stop 2024-09-19T06:43:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.600+0000 7f33b17fa640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f339c0a3350 0x7f339c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.600+0000 7f33b17fa640 1 -- 172.21.15.12:0/4102813108 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f33a40f0390 con 0x7f33b41009b0 2024-09-19T06:43:09.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.600+0000 7f33b88a9640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f339c0a3350 0x7f339c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.601+0000 7f33bd09d740 1 -- 172.21.15.12:0/1018921316 shutdown_connections 2024-09-19T06:43:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.601+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1018921316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfbe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.601+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1018921316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfa8ed0 0x558a6dfa9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.601+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1018921316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfa8990 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.601+0000 7f33bd09d740 1 -- 172.21.15.12:0/1018921316 >> 172.21.15.12:0/1018921316 conn(0x558a6dfa5060 msgr2=0x558a6dfa5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:09.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.601+0000 7f33b88a9640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f339c0a3350 0x7f339c0a5810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f33ac011790 tx=0x7f33ac019580 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.602+0000 7f33bd09d740 1 -- 172.21.15.12:0/1018921316 shutdown_connections 2024-09-19T06:43:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.602+0000 7f33bd09d740 1 -- 172.21.15.12:0/1018921316 wait complete. 2024-09-19T06:43:09.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.602+0000 7f33bd09d740 1 -- start start 2024-09-19T06:43:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.602+0000 7f33bd09d740 1 Processor -- start 2024-09-19T06:43:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfa8ed0 0x558a6dfac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfaccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33bd09d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a6dfbf0b0 con 0x558a6dfaa080 2024-09-19T06:43:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33bd09d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558a6de96290 con 0x558a6dfa8ed0 2024-09-19T06:43:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33bd09d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558a6dfbf230 con 0x558a6dfbc350 2024-09-19T06:43:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33bd09d740 10 client.0 _ll_register_callbacks cb 0x558a6dec7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33b88a9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfaccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33b88a9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40824/0 (socket says 172.21.15.12:40824) 2024-09-19T06:43:09.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.603+0000 7f33b88a9640 1 -- 172.21.15.12:0/3198764209 learned_addr learned my addr 172.21.15.12:0/3198764209 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.604+0000 7f33b37fe640 1 -- 172.21.15.12:0/3198764209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 msgr2=0x558a6dfad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.604+0000 7f33b37fe640 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.604+0000 7f33b37fe640 1 -- 172.21.15.12:0/3198764209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfa8ed0 msgr2=0x558a6dfac7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.604+0000 7f33b37fe640 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfa8ed0 0x558a6dfac7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.604+0000 7f33b37fe640 1 -- 172.21.15.12:0/3198764209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a6dc20210 con 0x558a6dfaa080 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.604+0000 7f33b37fe640 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfaccf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f33a800bd10 tx=0x7f33a80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15152ba5edb232 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.604+0000 7f33937fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.604+0000 7f33937fe640 1 -- 172.21.15.12:0/3198764209 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8011650 con 0x558a6dfaa080 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.604+0000 7f33bd09d740 1 -- 172.21.15.12:0/3198764209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a6df1aa20 con 0x558a6dfaa080 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.605+0000 7f33937fe640 1 -- 172.21.15.12:0/3198764209 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f33a80117f0 con 0x558a6dfaa080 2024-09-19T06:43:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.605+0000 7f33937fe640 1 -- 172.21.15.12:0/3198764209 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f33a80119f0 con 0x558a6dfaa080 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.605+0000 7f33bd09d740 10 client.16314 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.605+0000 7f33bd09d740 1 -- 172.21.15.12:0/3198764209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558a6dcec620 con 0x558a6dfaa080 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.606+0000 7f33937fe640 1 -- 172.21.15.12:0/3198764209 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558a6df1aa20 con 0x558a6dfaa080 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.606+0000 7f33937fe640 1 -- 172.21.15.12:0/3198764209 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f33a8024430 con 0x558a6dfaa080 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.606+0000 7f33bd09d740 10 client.16314 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.606+0000 7f33bd09d740 10 client.16314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.606+0000 7f33bd09d740 20 client.16314 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.606+0000 7f33bd09d740 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a6dfcc730 0x558a6dfceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.606+0000 7f33bd09d740 4 client.16314 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.606+0000 7f33bd09d740 1 -- 172.21.15.12:0/3198764209 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a6df14d70 con 0x558a6dfcc730 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.608+0000 7f33b3fff640 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a6dfcc730 0x558a6dfceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.609+0000 7f33b3fff640 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a6dfcc730 0x558a6dfceb90 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f6d1563477b7155 server_cookie=d60d708b407d56e1 in_seq=0 out_seq=0 2024-09-19T06:43:09.614 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.609+0000 7f33937fe640 10 client.16314 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.610+0000 7f33937fe640 1 -- 172.21.15.12:0/3198764209 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a6df14d70 con 0x558a6dfcc730 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.610+0000 7f33937fe640 10 client.16314 handle_command_reply: tid=0 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.610+0000 7f33bd09d740 1 client.16314 shutdown 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.610+0000 7f33bd09d740 1 -- 172.21.15.12:0/3198764209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 msgr2=0x558a6dfaccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.610+0000 7f33bd09d740 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfaccf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f33a800bd10 tx=0x7f33a80107a0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.610+0000 7f33bd09d740 1 -- 172.21.15.12:0/3198764209 shutdown_connections 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.610+0000 7f33bd09d740 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a6dfcc730 0x558a6dfceb90 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.610+0000 7f33937fe640 0 client.16314 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.611+0000 7f33bd09d740 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.611+0000 7f33bd09d740 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfaa080 0x558a6dfaccf0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.611+0000 7f33bd09d740 1 --2- 172.21.15.12:0/3198764209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfa8ed0 0x558a6dfac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.611+0000 7f33bd09d740 1 -- 172.21.15.12:0/3198764209 >> 172.21.15.12:0/3198764209 conn(0x558a6dfa5060 msgr2=0x558a6dfaada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.613+0000 7f33bd09d740 1 -- 172.21.15.12:0/3198764209 shutdown_connections 2024-09-19T06:43:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.613+0000 7f33bd09d740 1 -- 172.21.15.12:0/3198764209 wait complete. 2024-09-19T06:43:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.613+0000 7f33bd09d740 20 client.16314 trim_cache size 0 max 16384 2024-09-19T06:43:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.642+0000 7f33bd09d740 1 Processor -- start 2024-09-19T06:43:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.642+0000 7f33bd09d740 1 -- start start 2024-09-19T06:43:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.642+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfa8ed0 0x558a6dfab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.642+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfaba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.642+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfbc350 0x558a6dfa39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.642+0000 7f33bd09d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33a000e9d0 con 0x558a6dfbc350 2024-09-19T06:43:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.642+0000 7f33bd09d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0010600 con 0x558a6dfaa080 2024-09-19T06:43:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.642+0000 7f33bd09d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33a000f0a0 con 0x558a6dfa8ed0 2024-09-19T06:43:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfaba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b88a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfbc350 0x558a6dfa39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfaba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:51920/0 (socket says 172.21.15.12:51920) 2024-09-19T06:43:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b37fe640 1 -- 172.21.15.12:0/650926691 learned_addr learned my addr 172.21.15.12:0/650926691 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b88a9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfbc350 0x558a6dfa39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52454/0 (socket says 172.21.15.12:52454) 2024-09-19T06:43:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b37fe640 1 -- 172.21.15.12:0/650926691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfa8ed0 msgr2=0x558a6dfab550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:43:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b3fff640 1 --2- 172.21.15.12:0/650926691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfa8ed0 0x558a6dfab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b37fe640 1 --2- 172.21.15.12:0/650926691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfa8ed0 0x558a6dfab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b37fe640 1 -- 172.21.15.12:0/650926691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfbc350 msgr2=0x558a6dfa39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b37fe640 1 --2- 172.21.15.12:0/650926691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfbc350 0x558a6dfa39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b37fe640 1 -- 172.21.15.12:0/650926691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6dfaf2b0 con 0x558a6dfaa080 2024-09-19T06:43:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.643+0000 7f33b88a9640 1 --2- 172.21.15.12:0/650926691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfbc350 0x558a6dfa39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.644+0000 7f33b37fe640 1 --2- 172.21.15.12:0/650926691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfaba90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f33a800bd10 tx=0x7f33a8010ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed56dc580de1c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.644+0000 7f3399ffb640 1 -- 172.21.15.12:0/650926691 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8031070 con 0x558a6dfaa080 2024-09-19T06:43:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.644+0000 7f3399ffb640 1 -- 172.21.15.12:0/650926691 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33a8024cc0 con 0x558a6dfaa080 2024-09-19T06:43:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.644+0000 7f3399ffb640 1 -- 172.21.15.12:0/650926691 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8011df0 con 0x558a6dfaa080 2024-09-19T06:43:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.645+0000 7f33bd09d740 1 -- 172.21.15.12:0/650926691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 msgr2=0x558a6dfaba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.645+0000 7f33bd09d740 1 --2- 172.21.15.12:0/650926691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfaba90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f33a800bd10 tx=0x7f33a8010ca0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.645+0000 7f33bd09d740 1 -- 172.21.15.12:0/650926691 shutdown_connections 2024-09-19T06:43:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.645+0000 7f33bd09d740 1 --2- 172.21.15.12:0/650926691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfbc350 0x558a6dfa39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.645+0000 7f33bd09d740 1 --2- 172.21.15.12:0/650926691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfaba90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.645+0000 7f33bd09d740 1 --2- 172.21.15.12:0/650926691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfa8ed0 0x558a6dfab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.645+0000 7f33bd09d740 1 -- 172.21.15.12:0/650926691 >> 172.21.15.12:0/650926691 conn(0x558a6dfa5060 msgr2=0x558a6dfb86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.645+0000 7f33bd09d740 1 -- 172.21.15.12:0/650926691 shutdown_connections 2024-09-19T06:43:09.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.645+0000 7f33bd09d740 1 -- 172.21.15.12:0/650926691 wait complete. 2024-09-19T06:43:09.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.646+0000 7f33bd09d740 1 -- start start 2024-09-19T06:43:09.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.647+0000 7f33bd09d740 1 Processor -- start 2024-09-19T06:43:09.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.647+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfa8ed0 0x558a6dfc4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.647+0000 7f33bd09d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfc4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfc4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfa8ed0 0x558a6dfc4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfa8ed0 0x558a6dfc4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52462/0 (socket says 172.21.15.12:52462) 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfc4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:51930/0 (socket says 172.21.15.12:51930) 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b3fff640 1 -- 172.21.15.12:0/1218033816 learned_addr learned my addr 172.21.15.12:0/1218033816 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfba660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33a000fe70 con 0x558a6dfa8ed0 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33a000f7a0 con 0x558a6dfaa080 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33a000c9b0 con 0x558a6dfbc350 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b88a9640 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b37fe640 1 -- 172.21.15.12:0/1218033816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 msgr2=0x558a6dfba660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b37fe640 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfba660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b37fe640 1 -- 172.21.15.12:0/1218033816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfa8ed0 msgr2=0x558a6dfc4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b37fe640 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfa8ed0 0x558a6dfc4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b37fe640 1 -- 172.21.15.12:0/1218033816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a6dfbad50 con 0x558a6dfaa080 2024-09-19T06:43:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.648+0000 7f33b3fff640 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfa8ed0 0x558a6dfc4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.649+0000 7f33bd09d740 10 client.0 _ll_register_callbacks cb 0x7f33a800b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.649+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33a8024cc0 con 0x558a6dfaa080 2024-09-19T06:43:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.649+0000 7f33b37fe640 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfc4c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x558a6dfa03f0 tx=0x7f33a8011e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8ced12c40d60db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.649+0000 7f33937fe640 10 client.25877 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:09.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.649+0000 7f33937fe640 1 -- 172.21.15.12:0/1218033816 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8031070 con 0x558a6dfaa080 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.649+0000 7f33937fe640 1 -- 172.21.15.12:0/1218033816 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f33a80052e0 con 0x558a6dfaa080 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.649+0000 7f33937fe640 1 -- 172.21.15.12:0/1218033816 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f33a8005580 con 0x558a6dfaa080 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.650+0000 7f33bd09d740 10 client.25877 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.650+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=31}) -- 0x558a6dfd4050 con 0x558a6dfaa080 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.650+0000 7f33937fe640 1 -- 172.21.15.12:0/1218033816 <== mon.2 v2:172.21.15.16:3300/0 4 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f33a80035f0 con 0x558a6dfaa080 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.650+0000 7f33bd09d740 10 client.25877 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.650+0000 7f33bd09d740 10 client.25877 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.650+0000 7f33bd09d740 20 client.25877 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.650+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a6dfcc730 0x558a6e039480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.650+0000 7f33bd09d740 4 client.25877 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.650+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558a6de91900 con 0x558a6dfcc730 2024-09-19T06:43:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.651+0000 7f33b3fff640 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a6dfcc730 0x558a6e039480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.651+0000 7f33b3fff640 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a6dfcc730 0x558a6e039480 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d3643d83667c5b3 server_cookie=20e3d2de16c3b69 in_seq=0 out_seq=0 2024-09-19T06:43:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.651+0000 7f33937fe640 10 client.25877 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.675+0000 7f33937fe640 1 -- 172.21.15.12:0/1218033816 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558a6de91900 con 0x558a6dfcc730 2024-09-19T06:43:09.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.675+0000 7f33937fe640 10 client.25877 handle_command_reply: tid=0 2024-09-19T06:43:09.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.675+0000 7f33bd09d740 1 client.25877 shutdown 2024-09-19T06:43:09.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.676+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 msgr2=0x558a6dfc4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:09.677 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.676+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfc4c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x558a6dfa03f0 tx=0x7f33a8011e40 comp rx=0 tx=0).stop 2024-09-19T06:43:09.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.676+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 shutdown_connections 2024-09-19T06:43:09.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.676+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a6dfcc730 0x558a6e039480 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.676+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a6dfbc350 0x558a6dfba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.676+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a6dfaa080 0x558a6dfc4c80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.676+0000 7f33bd09d740 1 --2- 172.21.15.12:0/1218033816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a6dfa8ed0 0x558a6dfc4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.678 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.676+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 >> 172.21.15.12:0/1218033816 conn(0x558a6dfa5060 msgr2=0x558a6dfac750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.677+0000 7f33937fe640 0 client.25877 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.677+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 shutdown_connections 2024-09-19T06:43:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.677+0000 7f33bd09d740 1 -- 172.21.15.12:0/1218033816 wait complete. 2024-09-19T06:43:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.677+0000 7f33bd09d740 20 client.25877 trim_cache size 0 max 16384 2024-09-19T06:43:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:43:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:43:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:43:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:43:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.678+0000 7f33ba30c640 1 -- 172.21.15.12:0/4102813108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f339c0a3350 msgr2=0x7f339c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.678+0000 7f33ba30c640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f339c0a3350 0x7f339c0a5810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f33ac011790 tx=0x7f33ac019580 comp rx=0 tx=0).stop 2024-09-19T06:43:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.678+0000 7f33ba30c640 1 -- 172.21.15.12:0/4102813108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b41009b0 msgr2=0x7f33b41991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.678+0000 7f33ba30c640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b41009b0 0x7f33b41991c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f33a402a940 tx=0x7f33a4003b90 comp rx=0 tx=0).stop 2024-09-19T06:43:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.679+0000 7f33ba30c640 1 -- 172.21.15.12:0/4102813108 shutdown_connections 2024-09-19T06:43:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.679+0000 7f33ba30c640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f339c0a3350 0x7f339c0a5810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.679+0000 7f33ba30c640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33b41069c0 0x7f33b41a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.679+0000 7f33ba30c640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b4101350 0x7f33b4199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.679+0000 7f33ba30c640 1 --2- 172.21.15.12:0/4102813108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33b41009b0 0x7f33b41991c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.679+0000 7f33ba30c640 1 -- 172.21.15.12:0/4102813108 >> 172.21.15.12:0/4102813108 conn(0x7f33b4077990 msgr2=0x7f33b40ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.679+0000 7f33ba30c640 1 -- 172.21.15.12:0/4102813108 shutdown_connections 2024-09-19T06:43:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:09.679+0000 7f33ba30c640 1 -- 172.21.15.12:0/4102813108 wait complete. 2024-09-19T06:43:10.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:09 smithi173 ceph-mon[35349]: pgmap v93: 97 pgs: 97 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 53 MiB/s wr, 2.15k op/s 2024-09-19T06:43:10.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:09 smithi012 ceph-mon[30937]: pgmap v93: 97 pgs: 97 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 53 MiB/s wr, 2.15k op/s 2024-09-19T06:43:10.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:09 smithi016 ceph-mon[34911]: pgmap v93: 97 pgs: 97 active+clean; 2.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 53 MiB/s wr, 2.15k op/s 2024-09-19T06:43:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 145.0 s, 4721.8 tps, lat 21.158 ms stddev 23.460 2024-09-19T06:43:12.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:11 smithi173 ceph-mon[35349]: pgmap v94: 97 pgs: 97 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 58 MiB/s wr, 2.50k op/s 2024-09-19T06:43:12.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:11 smithi012 ceph-mon[30937]: pgmap v94: 97 pgs: 97 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 58 MiB/s wr, 2.50k op/s 2024-09-19T06:43:12.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:11 smithi016 ceph-mon[34911]: pgmap v94: 97 pgs: 97 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 58 MiB/s wr, 2.50k op/s 2024-09-19T06:43:14.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:13 smithi173 ceph-mon[35349]: pgmap v95: 97 pgs: 97 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 MiB/s wr, 1.65k op/s 2024-09-19T06:43:14.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:13 smithi012 ceph-mon[30937]: pgmap v95: 97 pgs: 97 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 MiB/s wr, 1.65k op/s 2024-09-19T06:43:14.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:13 smithi016 ceph-mon[34911]: pgmap v95: 97 pgs: 97 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 MiB/s wr, 1.65k op/s 2024-09-19T06:43:15.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 150.0 s, 4371.0 tps, lat 22.903 ms stddev 24.525 2024-09-19T06:43:15.878 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:43:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:15 smithi173 ceph-mon[35349]: pgmap v96: 97 pgs: 97 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 MiB/s wr, 1.65k op/s 2024-09-19T06:43:16.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:15 smithi012 ceph-mon[30937]: pgmap v96: 97 pgs: 97 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 MiB/s wr, 1.65k op/s 2024-09-19T06:43:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:15 smithi016 ceph-mon[34911]: pgmap v96: 97 pgs: 97 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 22 MiB/s wr, 1.65k op/s 2024-09-19T06:43:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.957+0000 7fbbd6100640 1 -- 172.21.15.12:0/2913302649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd0109b10 msgr2=0x7fbbd0116960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.957+0000 7fbbd6100640 1 --2- 172.21.15.12:0/2913302649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd0109b10 0x7fbbd0116960 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4009860 tx=0x7fbbc402a340 comp rx=0 tx=0).stop 2024-09-19T06:43:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.957+0000 7fbbd6100640 1 -- 172.21.15.12:0/2913302649 shutdown_connections 2024-09-19T06:43:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.957+0000 7fbbd6100640 1 --2- 172.21.15.12:0/2913302649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd0116ea0 0x7fbbd0119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.957+0000 7fbbd6100640 1 --2- 172.21.15.12:0/2913302649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd0109b10 0x7fbbd0116960 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.957+0000 7fbbd6100640 1 --2- 172.21.15.12:0/2913302649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd01091f0 0x7fbbd01095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.957+0000 7fbbd6100640 1 -- 172.21.15.12:0/2913302649 >> 172.21.15.12:0/2913302649 conn(0x7fbbd006e140 msgr2=0x7fbbd006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:16.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.957+0000 7fbbd6100640 1 -- 172.21.15.12:0/2913302649 shutdown_connections 2024-09-19T06:43:16.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.958+0000 7fbbd6100640 1 -- 172.21.15.12:0/2913302649 wait complete. 2024-09-19T06:43:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.958+0000 7fbbd6100640 1 Processor -- start 2024-09-19T06:43:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbd6100640 1 -- start start 2024-09-19T06:43:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbd6100640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd01091f0 0x7fbbd0111650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbd6100640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd0109b10 0x7fbbd0111b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbd6100640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd0116ea0 0x7fbbd0122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbd6100640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd010d410 con 0x7fbbd01091f0 2024-09-19T06:43:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbd6100640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd010d290 con 0x7fbbd0109b10 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbd6100640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd010d590 con 0x7fbbd0116ea0 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd01091f0 0x7fbbd0111650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd01091f0 0x7fbbd0111650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60244/0 (socket says 172.21.15.12:60244) 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbcffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd0116ea0 0x7fbbd0122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/1464637388 learned_addr learned my addr 172.21.15.12:0/1464637388 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbceffd640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd0109b10 0x7fbbd0111b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbcffff640 1 -- 172.21.15.12:0/1464637388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd0109b10 msgr2=0x7fbbd0111b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbcffff640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd0109b10 0x7fbbd0111b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbcffff640 1 -- 172.21.15.12:0/1464637388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd01091f0 msgr2=0x7fbbd0111650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbcffff640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd01091f0 0x7fbbd0111650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.959+0000 7fbbcffff640 1 -- 172.21.15.12:0/1464637388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd0123760 con 0x7fbbd0116ea0 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.960+0000 7fbbcffff640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd0116ea0 0x7fbbd0122ea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8005fd0 tx=0x7fbbc800c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.960+0000 7fbbccff9640 1 -- 172.21.15.12:0/1464637388 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8004b20 con 0x7fbbd0116ea0 2024-09-19T06:43:16.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.960+0000 7fbbd6100640 1 -- 172.21.15.12:0/1464637388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd0123a50 con 0x7fbbd0116ea0 2024-09-19T06:43:16.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.960+0000 7fbbccff9640 1 -- 172.21.15.12:0/1464637388 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc8003e50 con 0x7fbbd0116ea0 2024-09-19T06:43:16.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.960+0000 7fbbccff9640 1 -- 172.21.15.12:0/1464637388 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc800b570 con 0x7fbbd0116ea0 2024-09-19T06:43:16.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.960+0000 7fbbd6100640 1 -- 172.21.15.12:0/1464637388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd0115530 con 0x7fbbd0116ea0 2024-09-19T06:43:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.963+0000 7fbbccff9640 1 -- 172.21.15.12:0/1464637388 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbbc801d020 con 0x7fbbd0116ea0 2024-09-19T06:43:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.963+0000 7fbbd84d9740 1 Processor -- start 2024-09-19T06:43:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.963+0000 7fbbd84d9740 1 -- start start 2024-09-19T06:43:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed14a0 0x56151fed1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 0x56151fedc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fedc680 0x56151fedea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbd84d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56151fe372e0 con 0x56151fedc680 2024-09-19T06:43:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbd84d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56151fddece0 con 0x56151fed1dc0 2024-09-19T06:43:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbd84d9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56151fe332a0 con 0x56151fed14a0 2024-09-19T06:43:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 0x56151fedc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fedc680 0x56151fedea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 0x56151fedc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:35432/0 (socket says 172.21.15.12:35432) 2024-09-19T06:43:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fedc680 0x56151fedea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60250/0 (socket says 172.21.15.12:60250) 2024-09-19T06:43:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/1910088651 learned_addr learned my addr 172.21.15.12:0/1910088651 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbceffd640 1 --2- 172.21.15.12:0/1910088651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed14a0 0x56151fed1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/1910088651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed14a0 msgr2=0x56151fed1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/1910088651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed14a0 0x56151fed1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/1910088651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fedc680 msgr2=0x56151fedea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/1910088651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fedc680 0x56151fedea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/1910088651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151fdc3440 con 0x56151fed1dc0 2024-09-19T06:43:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.964+0000 7fbbceffd640 1 --2- 172.21.15.12:0/1910088651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed14a0 0x56151fed1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.965+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/1910088651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 0x56151fedc140 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000b7e0 tx=0x7fbbc000bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=579ad4698d74c374 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.965+0000 7fbbb5ffb640 1 -- 172.21.15.12:0/1910088651 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0003dd0 con 0x56151fed1dc0 2024-09-19T06:43:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.965+0000 7fbbb5ffb640 1 -- 172.21.15.12:0/1910088651 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc0015070 con 0x56151fed1dc0 2024-09-19T06:43:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.965+0000 7fbbb5ffb640 1 -- 172.21.15.12:0/1910088651 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00107c0 con 0x56151fed1dc0 2024-09-19T06:43:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.965+0000 7fbbccff9640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbb80a34b0 0x7fbbb80a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.966+0000 7fbbccff9640 1 -- 172.21.15.12:0/1464637388 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbbc80cfb80 con 0x7fbbd0116ea0 2024-09-19T06:43:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.966+0000 7fbbd84d9740 1 -- 172.21.15.12:0/1910088651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 msgr2=0x56151fedc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.966+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/1910088651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 0x56151fedc140 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000b7e0 tx=0x7fbbc000bca0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.967+0000 7fbbceffd640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbb80a34b0 0x7fbbb80a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.967+0000 7fbbd84d9740 1 -- 172.21.15.12:0/1910088651 shutdown_connections 2024-09-19T06:43:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.967+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/1910088651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fedc680 0x56151fedea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.967+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/1910088651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 0x56151fedc140 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.967+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/1910088651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed14a0 0x56151fed1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.967+0000 7fbbd84d9740 1 -- 172.21.15.12:0/1910088651 >> 172.21.15.12:0/1910088651 conn(0x56151fecda30 msgr2=0x56151fecde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.968+0000 7fbbd84d9740 1 -- 172.21.15.12:0/1910088651 shutdown_connections 2024-09-19T06:43:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.968+0000 7fbbd84d9740 1 -- 172.21.15.12:0/1910088651 wait complete. 2024-09-19T06:43:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.968+0000 7fbbceffd640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbb80a34b0 0x7fbbb80a5970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbbc402a930 tx=0x7fbbc402c040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.968+0000 7fbbd84d9740 1 -- start start 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.968+0000 7fbbd84d9740 1 Processor -- start 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed14a0 0x56151fedbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed1dc0 0x56151fed91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fedc680 0x56151fed9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed14a0 0x56151fedbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed1dc0 0x56151fed91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed14a0 0x56151fedbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:35446/0 (socket says 172.21.15.12:35446) 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed1dc0 0x56151fed91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60256/0 (socket says 172.21.15.12:60256) 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbd84d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56151fedf250 con 0x56151fed1dc0 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/56477628 learned_addr learned my addr 172.21.15.12:0/56477628 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbd84d9740 1 -- 172.21.15.12:0/56477628 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56151fdf2050 con 0x56151fed14a0 2024-09-19T06:43:16.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbd84d9740 1 -- 172.21.15.12:0/56477628 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56151fedf3d0 con 0x56151fedc680 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbcffff640 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fedc680 0x56151fed9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.969+0000 7fbbd84d9740 10 client.0 _ll_register_callbacks cb 0x56151fe32160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/56477628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fedc680 msgr2=0x56151fed9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fedc680 0x56151fed9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/56477628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed1dc0 msgr2=0x56151fed91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed1dc0 0x56151fed91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/56477628 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151fba83c0 con 0x56151fed14a0 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbd84d9740 1 -- 172.21.15.12:0/56477628 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbc0015070 con 0x56151fed14a0 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed14a0 0x56151fedbf40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c010 tx=0x7fbbc0003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598d0e6f912a9d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbaeffd640 10 client.25889 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbaeffd640 1 -- 172.21.15.12:0/56477628 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0011650 con 0x56151fed14a0 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbaeffd640 1 -- 172.21.15.12:0/56477628 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbbc00117f0 con 0x56151fed14a0 2024-09-19T06:43:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbaeffd640 1 -- 172.21.15.12:0/56477628 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbbc00119f0 con 0x56151fed14a0 2024-09-19T06:43:16.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbd84d9740 10 client.25889 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:16.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.970+0000 7fbbd84d9740 1 -- 172.21.15.12:0/56477628 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=31}) -- 0x56151feeaac0 con 0x56151fed14a0 2024-09-19T06:43:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.971+0000 7fbbaeffd640 1 -- 172.21.15.12:0/56477628 <== mon.2 v2:172.21.15.16:3300/0 4 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fbbc0010540 con 0x56151fed14a0 2024-09-19T06:43:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.971+0000 7fbbd84d9740 10 client.25889 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.971+0000 7fbbd84d9740 10 client.25889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.971+0000 7fbbd84d9740 20 client.25889 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.971+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56151feebe10 0x56151feee200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.971+0000 7fbbd84d9740 4 client.25889 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.971+0000 7fbbd84d9740 1 -- 172.21.15.12:0/56477628 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56151fe44850 con 0x56151feebe10 2024-09-19T06:43:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.973+0000 7fbbceffd640 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56151feebe10 0x56151feee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:16.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.973+0000 7fbbaeffd640 10 client.25889 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.973+0000 7fbbceffd640 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56151feebe10 0x56151feee200 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47d1b6ed133b77c6 server_cookie=cc9c64fc2ce58736 in_seq=0 out_seq=0 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbaeffd640 1 -- 172.21.15.12:0/56477628 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56151fe44850 con 0x56151feebe10 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbaeffd640 10 client.25889 handle_command_reply: tid=0 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbd84d9740 1 client.25889 shutdown 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbd84d9740 1 -- 172.21.15.12:0/56477628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed14a0 msgr2=0x56151fedbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed14a0 0x56151fedbf40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c010 tx=0x7fbbc0003e00 comp rx=0 tx=0).stop 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbd84d9740 1 -- 172.21.15.12:0/56477628 shutdown_connections 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56151feebe10 0x56151feee200 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fedc680 0x56151fed9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbaeffd640 0 client.25889 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed1dc0 0x56151fed91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/56477628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed14a0 0x56151fedbf40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.974+0000 7fbbd84d9740 1 -- 172.21.15.12:0/56477628 >> 172.21.15.12:0/56477628 conn(0x56151fecda30 msgr2=0x56151fed3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.975+0000 7fbbd84d9740 1 -- 172.21.15.12:0/56477628 shutdown_connections 2024-09-19T06:43:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.975+0000 7fbbd84d9740 1 -- 172.21.15.12:0/56477628 wait complete. 2024-09-19T06:43:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:16.975+0000 7fbbd84d9740 20 client.25889 trim_cache size 0 max 16384 2024-09-19T06:43:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.009+0000 7fbbd84d9740 1 Processor -- start 2024-09-19T06:43:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.009+0000 7fbbd84d9740 1 -- start start 2024-09-19T06:43:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fecda30 0x56151fecca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed14a0 0x56151fef38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed1dc0 0x56151fef3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbd84d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01c5250 con 0x56151fed14a0 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbd84d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01c6e80 con 0x56151fecda30 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbd84d9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01c5920 con 0x56151fed1dc0 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fecda30 0x56151fecca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed14a0 0x56151fef38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbcffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed1dc0 0x56151fef3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed14a0 0x56151fef38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60268/0 (socket says 172.21.15.12:60268) 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbceffd640 1 -- 172.21.15.12:0/1124690057 learned_addr learned my addr 172.21.15.12:0/1124690057 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/1124690057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed1dc0 msgr2=0x56151fef3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/1124690057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed1dc0 0x56151fef3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/1124690057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed14a0 msgr2=0x56151fef38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/1124690057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed14a0 0x56151fef38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/1124690057 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151fecd4d0 con 0x56151fecda30 2024-09-19T06:43:17.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.010+0000 7fbbcffff640 1 --2- 172.21.15.12:0/1124690057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed1dc0 0x56151fef3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:17.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.011+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/1124690057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fecda30 0x56151fecca60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0006010 tx=0x7fbbc0021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18c8d52a6f22b8dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:17.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.011+0000 7fbbb57fa640 1 -- 172.21.15.12:0/1124690057 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0003ef0 con 0x56151fecda30 2024-09-19T06:43:17.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.011+0000 7fbbb57fa640 1 -- 172.21.15.12:0/1124690057 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc0015070 con 0x56151fecda30 2024-09-19T06:43:17.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.011+0000 7fbbb57fa640 1 -- 172.21.15.12:0/1124690057 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0010440 con 0x56151fecda30 2024-09-19T06:43:17.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.012+0000 7fbbd84d9740 1 -- 172.21.15.12:0/1124690057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fecda30 msgr2=0x56151fecca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:17.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.012+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/1124690057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fecda30 0x56151fecca60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0006010 tx=0x7fbbc0021000 comp rx=0 tx=0).stop 2024-09-19T06:43:17.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.013+0000 7fbbd84d9740 1 -- 172.21.15.12:0/1124690057 shutdown_connections 2024-09-19T06:43:17.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.013+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/1124690057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fed1dc0 0x56151fef3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.013+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/1124690057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed14a0 0x56151fef38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.013+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/1124690057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fecda30 0x56151fecca60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.013+0000 7fbbd84d9740 1 -- 172.21.15.12:0/1124690057 >> 172.21.15.12:0/1124690057 conn(0x56151fed9890 msgr2=0x56151fecc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:17.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.013+0000 7fbbd84d9740 1 -- 172.21.15.12:0/1124690057 shutdown_connections 2024-09-19T06:43:17.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.014+0000 7fbbd84d9740 1 -- 172.21.15.12:0/1124690057 wait complete. 2024-09-19T06:43:17.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.014+0000 7fbbd84d9740 1 -- start start 2024-09-19T06:43:17.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.014+0000 7fbbd84d9740 1 Processor -- start 2024-09-19T06:43:17.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fecda30 0x56151ff4ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbd84d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed14a0 0x56151ff4f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fecda30 0x56151ff4ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbcf7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fecda30 0x56151ff4ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:52104/0 (socket says 172.21.15.12:52104) 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/3322781401 learned_addr learned my addr 172.21.15.12:0/3322781401 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 0x56151fee1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01c66f0 con 0x56151fed14a0 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01c6020 con 0x56151fed1dc0 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01c3230 con 0x56151fecda30 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbcffff640 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 0x56151fee1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.015+0000 7fbbd84d9740 10 client.0 _ll_register_callbacks cb 0x7fbbc8009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.016+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/3322781401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 msgr2=0x56151fee1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.016+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 0x56151fee1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.016+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/3322781401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed14a0 msgr2=0x56151ff4f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.016+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed14a0 0x56151ff4f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.016+0000 7fbbcf7fe640 1 -- 172.21.15.12:0/3322781401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151fee2460 con 0x56151fecda30 2024-09-19T06:43:17.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.016+0000 7fbbcf7fe640 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fecda30 0x56151ff4ec80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00106a0 tx=0x7fbbc00056f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3058776cbeb00166 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:17.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.016+0000 7fbbaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:43:17.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.016+0000 7fbbaeffd640 1 -- 172.21.15.12:0/3322781401 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc003d060 con 0x56151fecda30 2024-09-19T06:43:17.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.016+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbc0015070 con 0x56151fecda30 2024-09-19T06:43:17.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.016+0000 7fbbaeffd640 1 -- 172.21.15.12:0/3322781401 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fbbc0005040 con 0x56151fecda30 2024-09-19T06:43:17.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.017+0000 7fbbaeffd640 1 -- 172.21.15.12:0/3322781401 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbbc0011650 con 0x56151fecda30 2024-09-19T06:43:17.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.017+0000 7fbbd84d9740 10 client.25906 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:17.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.017+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56151ff564c0 con 0x56151fecda30 2024-09-19T06:43:17.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.018+0000 7fbbaeffd640 1 -- 172.21.15.12:0/3322781401 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbc0015070 con 0x56151fecda30 2024-09-19T06:43:17.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.018+0000 7fbbaeffd640 1 -- 172.21.15.12:0/3322781401 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fbbc0004ce0 con 0x56151fecda30 2024-09-19T06:43:17.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.018+0000 7fbbd84d9740 10 client.25906 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:17.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.018+0000 7fbbd84d9740 10 client.25906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:17.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.018+0000 7fbbd84d9740 20 client.25906 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:17.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.018+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56151fedc680 0x56151ff58bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:17.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.018+0000 7fbbd84d9740 4 client.25906 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:43:17.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.018+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56151fe3ed60 con 0x56151fedc680 2024-09-19T06:43:17.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.018+0000 7fbbceffd640 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56151fedc680 0x56151ff58bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:17.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.019+0000 7fbbaeffd640 10 client.25906 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:17.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.019+0000 7fbbceffd640 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56151fedc680 0x56151ff58bc0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ef22950fd2517de server_cookie=f2c0317904e3031d in_seq=0 out_seq=0 2024-09-19T06:43:17.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.020+0000 7fbbaeffd640 1 -- 172.21.15.12:0/3322781401 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56151fe3ed60 con 0x56151fedc680 2024-09-19T06:43:17.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.020+0000 7fbbaeffd640 10 client.25906 handle_command_reply: tid=0 2024-09-19T06:43:17.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.020+0000 7fbbd84d9740 1 client.25906 shutdown 2024-09-19T06:43:17.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fecda30 msgr2=0x56151ff4ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fecda30 0x56151ff4ec80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00106a0 tx=0x7fbbc00056f0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 shutdown_connections 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56151fedc680 0x56151ff58bc0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56151fed1dc0 0x56151fee1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56151fed14a0 0x56151ff4f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbaeffd640 0 client.25906 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbd84d9740 1 --2- 172.21.15.12:0/3322781401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56151fecda30 0x56151ff4ec80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 >> 172.21.15.12:0/3322781401 conn(0x56151fed9890 msgr2=0x56151fecc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 shutdown_connections 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.021+0000 7fbbd84d9740 1 -- 172.21.15.12:0/3322781401 wait complete. 2024-09-19T06:43:17.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.022+0000 7fbbd84d9740 20 client.25906 trim_cache size 0 max 16384 2024-09-19T06:43:17.025 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:43:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:43:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:43:17.027 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:43:17.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.023+0000 7fbbd6100640 1 -- 172.21.15.12:0/1464637388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbb80a34b0 msgr2=0x7fbbb80a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:17.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.023+0000 7fbbd6100640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbb80a34b0 0x7fbbb80a5970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbbc402a930 tx=0x7fbbc402c040 comp rx=0 tx=0).stop 2024-09-19T06:43:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.023+0000 7fbbd6100640 1 -- 172.21.15.12:0/1464637388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd0116ea0 msgr2=0x7fbbd0122ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.023+0000 7fbbd6100640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd0116ea0 0x7fbbd0122ea0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8005fd0 tx=0x7fbbc800c740 comp rx=0 tx=0).stop 2024-09-19T06:43:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.023+0000 7fbbd6100640 1 -- 172.21.15.12:0/1464637388 shutdown_connections 2024-09-19T06:43:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.024+0000 7fbbd6100640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbbb80a34b0 0x7fbbb80a5970 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.024+0000 7fbbd6100640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbbd0116ea0 0x7fbbd0122ea0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.024+0000 7fbbd6100640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbd0109b10 0x7fbbd0111b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.024+0000 7fbbd6100640 1 --2- 172.21.15.12:0/1464637388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbd01091f0 0x7fbbd0111650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.024+0000 7fbbd6100640 1 -- 172.21.15.12:0/1464637388 >> 172.21.15.12:0/1464637388 conn(0x7fbbd006e140 msgr2=0x7fbbd0117420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.024+0000 7fbbd6100640 1 -- 172.21.15.12:0/1464637388 shutdown_connections 2024-09-19T06:43:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:17.024+0000 7fbbd6100640 1 -- 172.21.15.12:0/1464637388 wait complete. 2024-09-19T06:43:17.904 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:43:17.904 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:43:18.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:17 smithi173 ceph-mon[35349]: pgmap v97: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 27 MiB/s wr, 2.01k op/s 2024-09-19T06:43:18.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:17 smithi012 ceph-mon[30937]: pgmap v97: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 27 MiB/s wr, 2.01k op/s 2024-09-19T06:43:18.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:17 smithi016 ceph-mon[34911]: pgmap v97: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 27 MiB/s wr, 2.01k op/s 2024-09-19T06:43:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:18.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.937+0000 7f9c00eed640 1 -- 172.21.15.12:0/1774210098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf40997b0 msgr2=0x7f9bf4099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:18.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.937+0000 7f9c00eed640 1 --2- 172.21.15.12:0/1774210098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf40997b0 0x7f9bf4099b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009860 tx=0x7f9bf002a340 comp rx=0 tx=0).stop 2024-09-19T06:43:18.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.938+0000 7f9c00eed640 1 -- 172.21.15.12:0/1774210098 shutdown_connections 2024-09-19T06:43:18.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.938+0000 7f9c00eed640 1 --2- 172.21.15.12:0/1774210098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf4094600 0x7f9bf40a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.938+0000 7f9c00eed640 1 --2- 172.21.15.12:0/1774210098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bf4093c60 0x7f9bf40940c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.938+0000 7f9c00eed640 1 --2- 172.21.15.12:0/1774210098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf40997b0 0x7f9bf4099b90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.938+0000 7f9c00eed640 1 -- 172.21.15.12:0/1774210098 >> 172.21.15.12:0/1774210098 conn(0x7f9bf4009520 msgr2=0x7f9bf4009930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:18.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.938+0000 7f9c00eed640 1 -- 172.21.15.12:0/1774210098 shutdown_connections 2024-09-19T06:43:18.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.938+0000 7f9c00eed640 1 -- 172.21.15.12:0/1774210098 wait complete. 2024-09-19T06:43:18.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.939+0000 7f9c00eed640 1 Processor -- start 2024-09-19T06:43:18.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.939+0000 7f9c00eed640 1 -- start start 2024-09-19T06:43:18.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.940+0000 7f9c00eed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf4093c60 0x7f9bf412ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:18.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.940+0000 7f9c00eed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bf4094600 0x7f9bf412b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:18.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.940+0000 7f9c00eed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf40997b0 0x7f9bf412f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.940+0000 7f9bfb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf4093c60 0x7f9bf412ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9bfb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf4093c60 0x7f9bf412ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:35470/0 (socket says 172.21.15.12:35470) 2024-09-19T06:43:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9c00eed640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40a4890 con 0x7f9bf40997b0 2024-09-19T06:43:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9c00eed640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40a4710 con 0x7f9bf4093c60 2024-09-19T06:43:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9c00eed640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40a4a10 con 0x7f9bf4094600 2024-09-19T06:43:18.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9bfb7fe640 1 -- 172.21.15.12:0/933510178 learned_addr learned my addr 172.21.15.12:0/933510178 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:18.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9bfbfff640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf40997b0 0x7f9bf412f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:18.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9bfaffd640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bf4094600 0x7f9bf412b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9bfb7fe640 1 -- 172.21.15.12:0/933510178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bf4094600 msgr2=0x7f9bf412b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9bfb7fe640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bf4094600 0x7f9bf412b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9bfb7fe640 1 -- 172.21.15.12:0/933510178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf40997b0 msgr2=0x7f9bf412f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9bfb7fe640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf40997b0 0x7f9bf412f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.941+0000 7f9bfb7fe640 1 -- 172.21.15.12:0/933510178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf412fd40 con 0x7f9bf4093c60 2024-09-19T06:43:18.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.942+0000 7f9bfb7fe640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf4093c60 0x7f9bf412ad90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0035040 tx=0x7f9bf0033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.942+0000 7f9bf8ff9640 1 -- 172.21.15.12:0/933510178 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0037040 con 0x7f9bf4093c60 2024-09-19T06:43:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.942+0000 7f9bf8ff9640 1 -- 172.21.15.12:0/933510178 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bf0040070 con 0x7f9bf4093c60 2024-09-19T06:43:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.943+0000 7f9c00eed640 1 -- 172.21.15.12:0/933510178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf412ffd0 con 0x7f9bf4093c60 2024-09-19T06:43:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.943+0000 7f9bf8ff9640 1 -- 172.21.15.12:0/933510178 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00039b0 con 0x7f9bf4093c60 2024-09-19T06:43:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.943+0000 7f9c00eed640 1 -- 172.21.15.12:0/933510178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf41303f0 con 0x7f9bf4093c60 2024-09-19T06:43:18.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.945+0000 7f9be67fc640 1 -- 172.21.15.12:0/933510178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf40940c0 con 0x7f9bf4093c60 2024-09-19T06:43:18.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.947+0000 7f9bf8ff9640 1 -- 172.21.15.12:0/933510178 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9bf00305e0 con 0x7f9bf4093c60 2024-09-19T06:43:18.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.948+0000 7f9bf8ff9640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bec0a3590 0x7f9bec0a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:18.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.948+0000 7f9bf8ff9640 1 -- 172.21.15.12:0/933510178 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9bf00efb70 con 0x7f9bf4093c60 2024-09-19T06:43:18.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.949+0000 7f9bfaffd640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bec0a3590 0x7f9bec0a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.954+0000 7f9bfaffd640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bec0a3590 0x7f9bec0a5a50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40937c0 tx=0x7f9be8005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:18.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:18.954+0000 7f9bf8ff9640 1 -- 172.21.15.12:0/933510178 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9bf00bc580 con 0x7f9bf4093c60 2024-09-19T06:43:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.364+0000 7f9be67fc640 1 -- 172.21.15.12:0/933510178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bf40a1c70 con 0x7f9bf4093c60 2024-09-19T06:43:19.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.366+0000 7f9bf8ff9640 1 -- 172.21.15.12:0/933510178 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11979 (secure 0 0 0) 0x7f9bf00bbe80 con 0x7f9bf4093c60 2024-09-19T06:43:19.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:43:19.368 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"btime":"2024-09-19T06:41:24:903521+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:41:24.405002+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:43:19.368 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2024-09-19T06:43:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.370+0000 7f9be67fc640 1 -- 172.21.15.12:0/933510178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bec0a3590 msgr2=0x7f9bec0a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.370+0000 7f9be67fc640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bec0a3590 0x7f9bec0a5a50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40937c0 tx=0x7f9be8005f90 comp rx=0 tx=0).stop 2024-09-19T06:43:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.370+0000 7f9be67fc640 1 -- 172.21.15.12:0/933510178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf4093c60 msgr2=0x7f9bf412ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.370+0000 7f9be67fc640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf4093c60 0x7f9bf412ad90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0035040 tx=0x7f9bf0033b60 comp rx=0 tx=0).stop 2024-09-19T06:43:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.370+0000 7f9be67fc640 1 -- 172.21.15.12:0/933510178 shutdown_connections 2024-09-19T06:43:19.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.370+0000 7f9be67fc640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf40997b0 0x7f9bf412f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.371+0000 7f9be67fc640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bec0a3590 0x7f9bec0a5a50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.371+0000 7f9be67fc640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bf4094600 0x7f9bf412b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.371+0000 7f9be67fc640 1 --2- 172.21.15.12:0/933510178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf4093c60 0x7f9bf412ad90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.371+0000 7f9be67fc640 1 -- 172.21.15.12:0/933510178 >> 172.21.15.12:0/933510178 conn(0x7f9bf4009520 msgr2=0x7f9bf4091a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.371+0000 7f9be67fc640 1 -- 172.21.15.12:0/933510178 shutdown_connections 2024-09-19T06:43:19.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:19.371+0000 7f9be67fc640 1 -- 172.21.15.12:0/933510178 wait complete. 2024-09-19T06:43:20.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:19 smithi173 ceph-mon[35349]: pgmap v98: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 707 op/s 2024-09-19T06:43:20.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:20.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:19 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/933510178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:43:20.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:20.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:20.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:19 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:43:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:19 smithi012 ceph-mon[30937]: pgmap v98: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 707 op/s 2024-09-19T06:43:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:19 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/933510178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:43:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:19 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:43:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:19 smithi016 ceph-mon[34911]: pgmap v98: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 707 op/s 2024-09-19T06:43:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:19 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/933510178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:43:20.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:20.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:20.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:19 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:43:20.808 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 155.0 s, 4361.2 tps, lat 22.934 ms stddev 24.644 2024-09-19T06:43:20.960 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:43:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:22.050 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:21 smithi012 ceph-mon[30937]: pgmap v99: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 1.09k op/s 2024-09-19T06:43:22.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.047+0000 7fc10a7c1640 1 -- 172.21.15.12:0/4268722774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc104112ba0 msgr2=0x7fc104114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.048+0000 7fc10a7c1640 1 --2- 172.21.15.12:0/4268722774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc104112ba0 0x7fc104114f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009be0 tx=0x7fc0fc02a750 comp rx=0 tx=0).stop 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.048+0000 7fc10a7c1640 1 -- 172.21.15.12:0/4268722774 shutdown_connections 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.048+0000 7fc10a7c1640 1 --2- 172.21.15.12:0/4268722774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc104112ba0 0x7fc104114f90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.048+0000 7fc10a7c1640 1 --2- 172.21.15.12:0/4268722774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104074eb0 0x7fc104112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.048+0000 7fc10a7c1640 1 --2- 172.21.15.12:0/4268722774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc104074590 0x7fc104074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.048+0000 7fc10a7c1640 1 -- 172.21.15.12:0/4268722774 >> 172.21.15.12:0/4268722774 conn(0x7fc1040fd8f0 msgr2=0x7fc1040ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.048+0000 7fc10a7c1640 1 -- 172.21.15.12:0/4268722774 shutdown_connections 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.048+0000 7fc10a7c1640 1 -- 172.21.15.12:0/4268722774 wait complete. 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.048+0000 7fc10a7c1640 1 Processor -- start 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.048+0000 7fc10a7c1640 1 -- start start 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc10a7c1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc104074590 0x7fc1041a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc10a7c1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc104074eb0 0x7fc1041a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc10a7c1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104112ba0 0x7fc10419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc10a7c1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc104118510 con 0x7fc104074590 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc10a7c1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc104118390 con 0x7fc104074eb0 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc10a7c1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc104118690 con 0x7fc104112ba0 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc1037fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc104074eb0 0x7fc1041a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc103fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc104074590 0x7fc1041a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc1037fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc104074eb0 0x7fc1041a4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41266/0 (socket says 172.21.15.12:41266) 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc1037fe640 1 -- 172.21.15.12:0/1595000620 learned_addr learned my addr 172.21.15.12:0/1595000620 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc108d5e640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104112ba0 0x7fc10419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc1037fe640 1 -- 172.21.15.12:0/1595000620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104112ba0 msgr2=0x7fc10419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc1037fe640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104112ba0 0x7fc10419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc1037fe640 1 -- 172.21.15.12:0/1595000620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc104074590 msgr2=0x7fc1041a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc1037fe640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc104074590 0x7fc1041a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.049+0000 7fc1037fe640 1 -- 172.21.15.12:0/1595000620 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10419ef90 con 0x7fc104074eb0 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.050+0000 7fc1037fe640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc104074eb0 0x7fc1041a4be0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800e9f0 tx=0x7fc0f800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.050+0000 7fc1017fa640 1 -- 172.21.15.12:0/1595000620 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800ccc0 con 0x7fc104074eb0 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.050+0000 7fc1017fa640 1 -- 172.21.15.12:0/1595000620 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f8010910 con 0x7fc104074eb0 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.050+0000 7fc10a7c1640 1 -- 172.21.15.12:0/1595000620 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10419f280 con 0x7fc104074eb0 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.050+0000 7fc1017fa640 1 -- 172.21.15.12:0/1595000620 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80188a0 con 0x7fc104074eb0 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.050+0000 7fc10a7c1640 1 -- 172.21.15.12:0/1595000620 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1041ab570 con 0x7fc104074eb0 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.052+0000 7fc1017fa640 1 -- 172.21.15.12:0/1595000620 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc0f8010ac0 con 0x7fc104074eb0 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.053+0000 7fc10cb9a740 1 Processor -- start 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.053+0000 7fc1017fa640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc0ec0a3430 0x7fc0ec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.054+0000 7fc1017fa640 1 -- 172.21.15.12:0/1595000620 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc0f80d0130 con 0x7fc104074eb0 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.054+0000 7fc10cb9a740 1 -- start start 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.054+0000 7fc108d5e640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc0ec0a3430 0x7fc0ec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.054+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d487090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.054+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d487a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.054+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d494760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc10cb9a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56484d3ed2f0 con 0x56484d488b40 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc10cb9a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56484d394cf0 con 0x56484d492370 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc10cb9a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56484d3e92b0 con 0x56484d4875d0 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc103fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d487090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc1037fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d487a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc103fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d487090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53226/0 (socket says 172.21.15.12:53226) 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc103fff640 1 -- 172.21.15.12:0/631837046 learned_addr learned my addr 172.21.15.12:0/631837046 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc108d5e640 1 --2- 172.21.15.12:0/631837046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d494760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc103fff640 1 -- 172.21.15.12:0/631837046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 msgr2=0x56484d487a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc103fff640 1 --2- 172.21.15.12:0/631837046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d487a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc103fff640 1 -- 172.21.15.12:0/631837046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 msgr2=0x56484d494760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc103fff640 1 --2- 172.21.15.12:0/631837046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d494760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc103fff640 1 -- 172.21.15.12:0/631837046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484d3793a0 con 0x56484d488b40 2024-09-19T06:43:22.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.055+0000 7fc108d5e640 1 --2- 172.21.15.12:0/631837046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d494760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:22.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.056+0000 7fc103fff640 1 --2- 172.21.15.12:0/631837046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d487090 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009c90 tx=0x7fc0f4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab12ced61366c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.056+0000 7fc0ea7fc640 1 -- 172.21.15.12:0/631837046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4004230 con 0x56484d488b40 2024-09-19T06:43:22.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.056+0000 7fc0ea7fc640 1 -- 172.21.15.12:0/631837046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f40043d0 con 0x56484d488b40 2024-09-19T06:43:22.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.056+0000 7fc0ea7fc640 1 -- 172.21.15.12:0/631837046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4019880 con 0x56484d488b40 2024-09-19T06:43:22.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.057+0000 7fc10cb9a740 1 -- 172.21.15.12:0/631837046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 msgr2=0x56484d487090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.057+0000 7fc108d5e640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc0ec0a3430 0x7fc0ec0a58f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x56484d488070 tx=0x7fc0fc005c40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.057+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/631837046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d487090 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009c90 tx=0x7fc0f4011810 comp rx=0 tx=0).stop 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.057+0000 7fc10cb9a740 1 -- 172.21.15.12:0/631837046 shutdown_connections 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.057+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/631837046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d494760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.057+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/631837046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d487a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.057+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/631837046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d487090 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.057+0000 7fc10cb9a740 1 -- 172.21.15.12:0/631837046 >> 172.21.15.12:0/631837046 conn(0x56484d450310 msgr2=0x56484d483c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.058+0000 7fc10cb9a740 1 -- 172.21.15.12:0/631837046 shutdown_connections 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.058+0000 7fc10cb9a740 1 -- 172.21.15.12:0/631837046 wait complete. 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.059+0000 7fc10cb9a740 1 -- start start 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.059+0000 7fc10cb9a740 1 Processor -- start 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d4875d0 0x56484d491c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d492370 0x56484d48f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc10cb9a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56484d4950c0 con 0x56484d488b40 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc10cb9a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56484d3a8060 con 0x56484d4875d0 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc10cb9a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56484d495240 con 0x56484d492370 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc10cb9a740 10 client.0 _ll_register_callbacks cb 0x56484d0fb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc103fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d4875d0 0x56484d491c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc103fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d4875d0 0x56484d491c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41280/0 (socket says 172.21.15.12:41280) 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc103fff640 1 -- 172.21.15.12:0/919876294 learned_addr learned my addr 172.21.15.12:0/919876294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc103fff640 1 -- 172.21.15.12:0/919876294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d492370 msgr2=0x56484d48f460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.060+0000 7fc103fff640 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d492370 0x56484d48f460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.061+0000 7fc103fff640 1 -- 172.21.15.12:0/919876294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 msgr2=0x56484d48ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.061+0000 7fc103fff640 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.061+0000 7fc103fff640 1 -- 172.21.15.12:0/919876294 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484d15e3c0 con 0x56484d4875d0 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.061+0000 7fc103fff640 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d4875d0 0x56484d491c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4006010 tx=0x7fc0f4003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a2e85dc000a089 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.061+0000 7fc0e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.061+0000 7fc0e37fe640 1 -- 172.21.15.12:0/919876294 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4028020 con 0x56484d4875d0 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.061+0000 7fc0e37fe640 1 -- 172.21.15.12:0/919876294 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc0f4005040 con 0x56484d4875d0 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.062+0000 7fc10cb9a740 1 -- 172.21.15.12:0/919876294 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0f40043d0 con 0x56484d4875d0 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.062+0000 7fc0e37fe640 1 -- 172.21.15.12:0/919876294 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc0f401f040 con 0x56484d4875d0 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.062+0000 7fc10cb9a740 10 client.25913 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.062+0000 7fc10cb9a740 1 -- 172.21.15.12:0/919876294 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56484d4a0a70 con 0x56484d4875d0 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.063+0000 7fc0e37fe640 1 -- 172.21.15.12:0/919876294 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f40043d0 con 0x56484d4875d0 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.063+0000 7fc0e37fe640 1 -- 172.21.15.12:0/919876294 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fc0f4018070 con 0x56484d4875d0 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.063+0000 7fc10cb9a740 10 client.25913 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.063+0000 7fc10cb9a740 10 client.25913 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.063+0000 7fc10cb9a740 20 client.25913 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.063+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56484d4a1dc0 0x56484d4a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.064+0000 7fc10cb9a740 4 client.25913 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.064+0000 7fc10cb9a740 1 -- 172.21.15.12:0/919876294 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56484d3fa860 con 0x56484d4a1dc0 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.064+0000 7fc1037fe640 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56484d4a1dc0 0x56484d4a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.066+0000 7fc1037fe640 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56484d4a1dc0 0x56484d4a41b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2bada88a7d7247a3 server_cookie=b38ac482e8ae9c39 in_seq=0 out_seq=0 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.066+0000 7fc0e37fe640 10 client.25913 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.066+0000 7fc0e37fe640 1 -- 172.21.15.12:0/919876294 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56484d3fa860 con 0x56484d4a1dc0 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.066+0000 7fc0e37fe640 10 client.25913 handle_command_reply: tid=0 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.066+0000 7fc10cb9a740 1 client.25913 shutdown 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 1 -- 172.21.15.12:0/919876294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d4875d0 msgr2=0x56484d491c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d4875d0 0x56484d491c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4006010 tx=0x7fc0f4003820 comp rx=0 tx=0).stop 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 1 -- 172.21.15.12:0/919876294 shutdown_connections 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56484d4a1dc0 0x56484d4a41b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d492370 0x56484d48f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/919876294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d4875d0 0x56484d491c20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc0e37fe640 0 client.25913 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:43:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 1 -- 172.21.15.12:0/919876294 >> 172.21.15.12:0/919876294 conn(0x56484d450310 msgr2=0x56484d489960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 1 -- 172.21.15.12:0/919876294 shutdown_connections 2024-09-19T06:43:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 1 -- 172.21.15.12:0/919876294 wait complete. 2024-09-19T06:43:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.067+0000 7fc10cb9a740 20 client.25913 trim_cache size 0 max 16384 2024-09-19T06:43:22.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:21 smithi173 ceph-mon[35349]: pgmap v99: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 1.09k op/s 2024-09-19T06:43:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.093+0000 7fc10cb9a740 1 Processor -- start 2024-09-19T06:43:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.093+0000 7fc10cb9a740 1 -- start start 2024-09-19T06:43:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d49e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d4a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc103fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d49e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc10cb9a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1041b42f0 con 0x56484d488b40 2024-09-19T06:43:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc103fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d49e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40840/0 (socket says 172.21.15.12:40840) 2024-09-19T06:43:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc103fff640 1 -- 172.21.15.12:0/1601137285 learned_addr learned my addr 172.21.15.12:0/1601137285 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1601137285 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc1041b5f20 con 0x56484d492370 2024-09-19T06:43:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1601137285 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc1041b49c0 con 0x56484d4875d0 2024-09-19T06:43:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc108d5e640 1 --2- 172.21.15.12:0/1601137285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d4a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.094+0000 7fc1037fe640 1 --2- 172.21.15.12:0/1601137285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.095+0000 7fc1037fe640 1 -- 172.21.15.12:0/1601137285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 msgr2=0x56484d49e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.095+0000 7fc1037fe640 1 --2- 172.21.15.12:0/1601137285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d49e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.095+0000 7fc1037fe640 1 -- 172.21.15.12:0/1601137285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 msgr2=0x56484d4a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.095+0000 7fc1037fe640 1 --2- 172.21.15.12:0/1601137285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d4a9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.095+0000 7fc1037fe640 1 -- 172.21.15.12:0/1601137285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484d48fce0 con 0x56484d488b40 2024-09-19T06:43:22.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.096+0000 7fc1037fe640 1 --2- 172.21.15.12:0/1601137285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48a310 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80cd7a0 tx=0x7fc0f801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148f4a9e449b040f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.096+0000 7fc0e9ffb640 1 -- 172.21.15.12:0/1601137285 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80b4070 con 0x56484d488b40 2024-09-19T06:43:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.096+0000 7fc0e9ffb640 1 -- 172.21.15.12:0/1601137285 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f80b5260 con 0x56484d488b40 2024-09-19T06:43:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.096+0000 7fc0e9ffb640 1 -- 172.21.15.12:0/1601137285 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80b4070 con 0x56484d488b40 2024-09-19T06:43:22.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.097+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1601137285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 msgr2=0x56484d48a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.097+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/1601137285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48a310 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80cd7a0 tx=0x7fc0f801a040 comp rx=0 tx=0).stop 2024-09-19T06:43:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.098+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1601137285 shutdown_connections 2024-09-19T06:43:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.098+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/1601137285 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d4a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.098+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/1601137285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48a310 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.098+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/1601137285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d49e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.098+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1601137285 >> 172.21.15.12:0/1601137285 conn(0x56484d450310 msgr2=0x56484d48d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.098+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1601137285 shutdown_connections 2024-09-19T06:43:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.098+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1601137285 wait complete. 2024-09-19T06:43:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.099+0000 7fc10cb9a740 1 -- start start 2024-09-19T06:43:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.099+0000 7fc10cb9a740 1 Processor -- start 2024-09-19T06:43:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.100+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d48beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.100+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.100+0000 7fc10cb9a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d48c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.100+0000 7fc10cb9a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1041b5790 con 0x56484d488b40 2024-09-19T06:43:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc10cb9a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc1041b50c0 con 0x56484d492370 2024-09-19T06:43:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc10cb9a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc1041b22d0 con 0x56484d4875d0 2024-09-19T06:43:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc1037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc1037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53246/0 (socket says 172.21.15.12:53246) 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc1037fe640 1 -- 172.21.15.12:0/1716370290 learned_addr learned my addr 172.21.15.12:0/1716370290 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc108d5e640 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d48c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc10cb9a740 10 client.0 _ll_register_callbacks cb 0x7fc0f4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc1037fe640 1 -- 172.21.15.12:0/1716370290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 msgr2=0x56484d48beb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc1037fe640 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d48beb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc1037fe640 1 -- 172.21.15.12:0/1716370290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 msgr2=0x56484d48c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc1037fe640 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d48c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.101+0000 7fc1037fe640 1 -- 172.21.15.12:0/1716370290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484d50b8f0 con 0x56484d488b40 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.102+0000 7fc1037fe640 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48c3f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80a4a70 tx=0x7fc0f809c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb8245e91daf6da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.102+0000 7fc0e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:22.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.102+0000 7fc0e37fe640 1 -- 172.21.15.12:0/1716370290 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80b4070 con 0x56484d488b40 2024-09-19T06:43:22.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.102+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1716370290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0f80b5260 con 0x56484d488b40 2024-09-19T06:43:22.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.103+0000 7fc0e37fe640 1 -- 172.21.15.12:0/1716370290 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc0f809b780 con 0x56484d488b40 2024-09-19T06:43:22.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.103+0000 7fc0e37fe640 1 -- 172.21.15.12:0/1716370290 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc0f8080050 con 0x56484d488b40 2024-09-19T06:43:22.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.103+0000 7fc10cb9a740 10 client.16356 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:22.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.103+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1716370290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56484d50cbb0 con 0x56484d488b40 2024-09-19T06:43:22.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.104+0000 7fc0e37fe640 1 -- 172.21.15.12:0/1716370290 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f80b5260 con 0x56484d488b40 2024-09-19T06:43:22.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.105+0000 7fc0e37fe640 1 -- 172.21.15.12:0/1716370290 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fc0f8083020 con 0x56484d488b40 2024-09-19T06:43:22.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.105+0000 7fc10cb9a740 10 client.16356 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:22.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.105+0000 7fc10cb9a740 10 client.16356 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:43:22.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.105+0000 7fc10cb9a740 20 client.16356 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:22.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.105+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56484d50d310 0x56484d50f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.105+0000 7fc10cb9a740 4 client.16356 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:43:22.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.105+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1716370290 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56484d3f4d70 con 0x56484d50d310 2024-09-19T06:43:22.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.111+0000 7fc103fff640 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56484d50d310 0x56484d50f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.111+0000 7fc0e37fe640 10 client.16356 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:43:22.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.111+0000 7fc103fff640 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56484d50d310 0x56484d50f730 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8dc741437200c4fc server_cookie=10d600ac6034ca49 in_seq=0 out_seq=0 2024-09-19T06:43:22.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.111+0000 7fc0e37fe640 1 -- 172.21.15.12:0/1716370290 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56484d3f4d70 con 0x56484d50d310 2024-09-19T06:43:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.111+0000 7fc0e37fe640 10 client.16356 handle_command_reply: tid=0 2024-09-19T06:43:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.111+0000 7fc10cb9a740 1 client.16356 shutdown 2024-09-19T06:43:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1716370290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 msgr2=0x56484d48c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48c3f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80a4a70 tx=0x7fc0f809c4b0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1716370290 shutdown_connections 2024-09-19T06:43:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56484d50d310 0x56484d50f730 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56484d492370 0x56484d48c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc0e37fe640 0 client.16356 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:43:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56484d488b40 0x56484d48c3f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 1 --2- 172.21.15.12:0/1716370290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56484d4875d0 0x56484d48beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1716370290 >> 172.21.15.12:0/1716370290 conn(0x56484d450310 msgr2=0x56484d482500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1716370290 shutdown_connections 2024-09-19T06:43:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 1 -- 172.21.15.12:0/1716370290 wait complete. 2024-09-19T06:43:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.112+0000 7fc10cb9a740 20 client.16356 trim_cache size 0 max 16384 2024-09-19T06:43:22.115 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:43:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 -- 172.21.15.12:0/1595000620 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc0ec0a3430 msgr2=0x7fc0ec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc0ec0a3430 0x7fc0ec0a58f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x56484d488070 tx=0x7fc0fc005c40 comp rx=0 tx=0).stop 2024-09-19T06:43:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 -- 172.21.15.12:0/1595000620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc104074eb0 msgr2=0x7fc1041a4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc104074eb0 0x7fc1041a4be0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800e9f0 tx=0x7fc0f800edf0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 -- 172.21.15.12:0/1595000620 shutdown_connections 2024-09-19T06:43:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc0ec0a3430 0x7fc0ec0a58f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc104112ba0 0x7fc10419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc104074eb0 0x7fc1041a4be0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 --2- 172.21.15.12:0/1595000620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc104074590 0x7fc1041a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 -- 172.21.15.12:0/1595000620 >> 172.21.15.12:0/1595000620 conn(0x7fc1040fd8f0 msgr2=0x7fc1040ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 -- 172.21.15.12:0/1595000620 shutdown_connections 2024-09-19T06:43:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:22.114+0000 7fc10a7c1640 1 -- 172.21.15.12:0/1595000620 wait complete. 2024-09-19T06:43:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:21 smithi016 ceph-mon[34911]: pgmap v99: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 1.09k op/s 2024-09-19T06:43:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.838+0000 7f3df9ae4640 1 -- 172.21.15.12:0/828719599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3df41091f0 msgr2=0x7f3df41095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.838+0000 7f3df9ae4640 1 --2- 172.21.15.12:0/828719599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3df41091f0 0x7f3df41095d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009890 tx=0x7f3de402a360 comp rx=0 tx=0).stop 2024-09-19T06:43:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.838+0000 7f3df9ae4640 1 -- 172.21.15.12:0/828719599 shutdown_connections 2024-09-19T06:43:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.838+0000 7f3df9ae4640 1 --2- 172.21.15.12:0/828719599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df4116ea0 0x7f3df4119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.838+0000 7f3df9ae4640 1 --2- 172.21.15.12:0/828719599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3df4109b10 0x7f3df4116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.838+0000 7f3df9ae4640 1 --2- 172.21.15.12:0/828719599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3df41091f0 0x7f3df41095d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.838+0000 7f3df9ae4640 1 -- 172.21.15.12:0/828719599 >> 172.21.15.12:0/828719599 conn(0x7f3df406d210 msgr2=0x7f3df406d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.839+0000 7f3df9ae4640 1 -- 172.21.15.12:0/828719599 shutdown_connections 2024-09-19T06:43:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.839+0000 7f3df9ae4640 1 -- 172.21.15.12:0/828719599 wait complete. 2024-09-19T06:43:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.840+0000 7f3df9ae4640 1 Processor -- start 2024-09-19T06:43:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.841+0000 7f3df9ae4640 1 -- start start 2024-09-19T06:43:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.841+0000 7f3df9ae4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3df41091f0 0x7f3df4114a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.841+0000 7f3df9ae4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df4109b10 0x7f3df4114fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.841+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3df41091f0 0x7f3df4114a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.841+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3df41091f0 0x7f3df4114a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40876/0 (socket says 172.21.15.12:40876) 2024-09-19T06:43:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.842+0000 7f3df9ae4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3df4116ea0 0x7f3df41154f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.842+0000 7f3df37fe640 1 -- 172.21.15.12:0/167722358 learned_addr learned my addr 172.21.15.12:0/167722358 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.842+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df4109b10 0x7f3df4114fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.842+0000 7f3df3fff640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3df4116ea0 0x7f3df41154f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.842+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3df410cf60 con 0x7f3df4116ea0 2024-09-19T06:43:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.842+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3df410cde0 con 0x7f3df4109b10 2024-09-19T06:43:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.842+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3df410d0e0 con 0x7f3df41091f0 2024-09-19T06:43:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.843+0000 7f3df37fe640 1 -- 172.21.15.12:0/167722358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df4109b10 msgr2=0x7f3df4114fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.843+0000 7f3df37fe640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df4109b10 0x7f3df4114fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.843+0000 7f3df37fe640 1 -- 172.21.15.12:0/167722358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3df4116ea0 msgr2=0x7f3df41154f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.843+0000 7f3df37fe640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3df4116ea0 0x7f3df41154f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.843+0000 7f3df37fe640 1 -- 172.21.15.12:0/167722358 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df41b3400 con 0x7f3df41091f0 2024-09-19T06:43:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.843+0000 7f3df37fe640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3df41091f0 0x7f3df4114a70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3de4035040 tx=0x7f3de4033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.845+0000 7f3df0ff9640 1 -- 172.21.15.12:0/167722358 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de4037040 con 0x7f3df41091f0 2024-09-19T06:43:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.845+0000 7f3df0ff9640 1 -- 172.21.15.12:0/167722358 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de4040070 con 0x7f3df41091f0 2024-09-19T06:43:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.845+0000 7f3df0ff9640 1 -- 172.21.15.12:0/167722358 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de40039f0 con 0x7f3df41091f0 2024-09-19T06:43:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.849+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df41b3690 con 0x7f3df41091f0 2024-09-19T06:43:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.849+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df41b3b00 con 0x7f3df41091f0 2024-09-19T06:43:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.853+0000 7f3dfc879740 1 Processor -- start 2024-09-19T06:43:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.854+0000 7f3dfc879740 1 -- start start 2024-09-19T06:43:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.858+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 0x5654d9b2aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.858+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 0x5654d9b35770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.858+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 0x5654d9b380a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.858+0000 7f3dfc879740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5654d9a8f2f0 con 0x5654d9b2b410 2024-09-19T06:43:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.858+0000 7f3dfc879740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5654d9a37270 con 0x5654d9b2aaf0 2024-09-19T06:43:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.858+0000 7f3dfc879740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5654d9a8b2b0 con 0x5654d9b35cb0 2024-09-19T06:43:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.858+0000 7f3df2ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 0x5654d9b380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.858+0000 7f3df2ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 0x5654d9b380a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40890/0 (socket says 172.21.15.12:40890) 2024-09-19T06:43:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.858+0000 7f3df2ffd640 1 -- 172.21.15.12:0/2863357869 learned_addr learned my addr 172.21.15.12:0/2863357869 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.860+0000 7f3df0ff9640 1 -- 172.21.15.12:0/167722358 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3de4003b90 con 0x7f3df41091f0 2024-09-19T06:43:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.860+0000 7f3df37fe640 1 --2- 172.21.15.12:0/2863357869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 0x5654d9b35770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.860+0000 7f3df3fff640 1 --2- 172.21.15.12:0/2863357869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 0x5654d9b2aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.861+0000 7f3df2ffd640 1 -- 172.21.15.12:0/2863357869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 msgr2=0x5654d9b2aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.861+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/2863357869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 0x5654d9b2aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.861+0000 7f3df0ff9640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3ddc0a3640 0x7f3ddc0a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.861+0000 7f3df2ffd640 1 -- 172.21.15.12:0/2863357869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 msgr2=0x5654d9b35770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.861+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/2863357869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 0x5654d9b35770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.861+0000 7f3df2ffd640 1 -- 172.21.15.12:0/2863357869 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654d9a36340 con 0x5654d9b35cb0 2024-09-19T06:43:22.863 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.861+0000 7f3df0ff9640 1 -- 172.21.15.12:0/167722358 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f3de40ef470 con 0x7f3df41091f0 2024-09-19T06:43:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.861+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/2863357869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 0x5654d9b380a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009ca0 tx=0x7f3de8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8efa233a54577c9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.862+0000 7f3dd9ffb640 1 -- 172.21.15.12:0/2863357869 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8004230 con 0x5654d9b35cb0 2024-09-19T06:43:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.862+0000 7f3dd9ffb640 1 -- 172.21.15.12:0/2863357869 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de80043d0 con 0x5654d9b35cb0 2024-09-19T06:43:22.864 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.862+0000 7f3dd9ffb640 1 -- 172.21.15.12:0/2863357869 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8019810 con 0x5654d9b35cb0 2024-09-19T06:43:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.863+0000 7f3df3fff640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3ddc0a3640 0x7f3ddc0a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.863+0000 7f3dfc879740 1 -- 172.21.15.12:0/2863357869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 msgr2=0x5654d9b380a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.863+0000 7f3dfc879740 1 --2- 172.21.15.12:0/2863357869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 0x5654d9b380a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009ca0 tx=0x7f3de8011810 comp rx=0 tx=0).stop 2024-09-19T06:43:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.864+0000 7f3dfc879740 1 -- 172.21.15.12:0/2863357869 shutdown_connections 2024-09-19T06:43:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.864+0000 7f3dfc879740 1 --2- 172.21.15.12:0/2863357869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 0x5654d9b380a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.864+0000 7f3dfc879740 1 --2- 172.21.15.12:0/2863357869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 0x5654d9b35770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.864+0000 7f3dfc879740 1 --2- 172.21.15.12:0/2863357869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 0x5654d9b2aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.864+0000 7f3dfc879740 1 -- 172.21.15.12:0/2863357869 >> 172.21.15.12:0/2863357869 conn(0x5654d9b27060 msgr2=0x5654d9b27440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.865+0000 7f3df3fff640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3ddc0a3640 0x7f3ddc0a5b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3df406b320 tx=0x7f3dec009600 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.866+0000 7f3dfc879740 1 -- 172.21.15.12:0/2863357869 shutdown_connections 2024-09-19T06:43:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.867+0000 7f3dfc879740 1 -- 172.21.15.12:0/2863357869 wait complete. 2024-09-19T06:43:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.867+0000 7f3dfc879740 1 -- start start 2024-09-19T06:43:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3dfc879740 1 Processor -- start 2024-09-19T06:43:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2aaf0 0x5654d9b32b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2b410 0x5654d9b330d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b35cb0 0x5654d9b33610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3dfc879740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5654d9b38880 con 0x5654d9b35cb0 2024-09-19T06:43:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3dfc879740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5654d9a18290 con 0x5654d9b2b410 2024-09-19T06:43:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3dfc879740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5654d9b38a00 con 0x5654d9b2aaf0 2024-09-19T06:43:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3dfc879740 10 client.0 _ll_register_callbacks cb 0x5654d9a49140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3df2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2b410 0x5654d9b330d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3df2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2b410 0x5654d9b330d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41328/0 (socket says 172.21.15.12:41328) 2024-09-19T06:43:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3df2ffd640 1 -- 172.21.15.12:0/1785308202 learned_addr learned my addr 172.21.15.12:0/1785308202 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:22.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.868+0000 7f3df37fe640 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2aaf0 0x5654d9b32b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.869+0000 7f3df3fff640 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b35cb0 0x5654d9b33610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.869+0000 7f3df2ffd640 1 -- 172.21.15.12:0/1785308202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2aaf0 msgr2=0x5654d9b32b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.869+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2aaf0 0x5654d9b32b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.869+0000 7f3df2ffd640 1 -- 172.21.15.12:0/1785308202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b35cb0 msgr2=0x5654d9b33610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.869+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b35cb0 0x5654d9b33610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.869+0000 7f3df2ffd640 1 -- 172.21.15.12:0/1785308202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654d97a2210 con 0x5654d9b2b410 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.869+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2b410 0x5654d9b330d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3de80194f0 tx=0x7f3de8003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f030b4395a514da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.870+0000 7f3dd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.870+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/1785308202 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de802a060 con 0x5654d9b2b410 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.870+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/1785308202 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f3de8005030 con 0x5654d9b2b410 2024-09-19T06:43:22.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.870+0000 7f3dfc879740 1 -- 172.21.15.12:0/1785308202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3de80043d0 con 0x5654d9b2b410 2024-09-19T06:43:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.872+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/1785308202 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3de801f040 con 0x5654d9b2b410 2024-09-19T06:43:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.872+0000 7f3dfc879740 10 client.25928 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.872+0000 7f3dfc879740 1 -- 172.21.15.12:0/1785308202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5654d986e620 con 0x5654d9b2b410 2024-09-19T06:43:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.873+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/1785308202 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de80046c0 con 0x5654d9b2b410 2024-09-19T06:43:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.873+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/1785308202 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f3de8018070 con 0x5654d9b2b410 2024-09-19T06:43:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.873+0000 7f3dfc879740 10 client.25928 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.873+0000 7f3dfc879740 10 client.25928 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.873+0000 7f3dfc879740 20 client.25928 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.873+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654d9b45bf0 0x5654d9b47fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.873+0000 7f3dfc879740 4 client.25928 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.873+0000 7f3dfc879740 1 -- 172.21.15.12:0/1785308202 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3de80043d0 con 0x5654d9b45bf0 2024-09-19T06:43:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.874+0000 7f3df37fe640 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654d9b45bf0 0x5654d9b47fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.874+0000 7f3dd2ffd640 10 client.25928 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.874+0000 7f3df37fe640 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654d9b45bf0 0x5654d9b47fe0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9efec0f0529bbd8 server_cookie=fd85739992bf0eb4 in_seq=0 out_seq=0 2024-09-19T06:43:22.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/1785308202 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3de80043d0 con 0x5654d9b45bf0 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dd2ffd640 10 client.25928 handle_command_reply: tid=0 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dfc879740 1 client.25928 shutdown 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dfc879740 1 -- 172.21.15.12:0/1785308202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2b410 msgr2=0x5654d9b330d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2b410 0x5654d9b330d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3de80194f0 tx=0x7f3de8003820 comp rx=0 tx=0).stop 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dfc879740 1 -- 172.21.15.12:0/1785308202 shutdown_connections 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654d9b45bf0 0x5654d9b47fe0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b35cb0 0x5654d9b33610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2b410 0x5654d9b330d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1785308202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2aaf0 0x5654d9b32b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dfc879740 1 -- 172.21.15.12:0/1785308202 >> 172.21.15.12:0/1785308202 conn(0x5654d9b27060 msgr2=0x5654d9b2cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.875+0000 7f3dd2ffd640 0 client.25928 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.877+0000 7f3dfc879740 1 -- 172.21.15.12:0/1785308202 shutdown_connections 2024-09-19T06:43:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.877+0000 7f3dfc879740 1 -- 172.21.15.12:0/1785308202 wait complete. 2024-09-19T06:43:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.877+0000 7f3dfc879740 20 client.25928 trim_cache size 0 max 16384 2024-09-19T06:43:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.905+0000 7f3dfc879740 1 Processor -- start 2024-09-19T06:43:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.905+0000 7f3dfc879740 1 -- start start 2024-09-19T06:43:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.906+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2aaf0 0x5654d9b2d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.906+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2b410 0x5654d9b33440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.906+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2aaf0 0x5654d9b2d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.906+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2aaf0 0x5654d9b2d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53290/0 (socket says 172.21.15.12:53290) 2024-09-19T06:43:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.906+0000 7f3df37fe640 1 -- 172.21.15.12:0/1821897976 learned_addr learned my addr 172.21.15.12:0/1821897976 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.906+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/1821897976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2b410 0x5654d9b33440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1821897976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b35cb0 0x5654d9b4d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3dfc879740 1 -- 172.21.15.12:0/1821897976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41c5130 con 0x5654d9b2aaf0 2024-09-19T06:43:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3dfc879740 1 -- 172.21.15.12:0/1821897976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41c6d60 con 0x5654d9b35cb0 2024-09-19T06:43:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3dfc879740 1 -- 172.21.15.12:0/1821897976 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41c5800 con 0x5654d9b2b410 2024-09-19T06:43:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3df3fff640 1 --2- 172.21.15.12:0/1821897976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b35cb0 0x5654d9b4d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3df2ffd640 1 -- 172.21.15.12:0/1821897976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b35cb0 msgr2=0x5654d9b4d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/1821897976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b35cb0 0x5654d9b4d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3df2ffd640 1 -- 172.21.15.12:0/1821897976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2aaf0 msgr2=0x5654d9b2d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/1821897976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2aaf0 0x5654d9b2d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3df2ffd640 1 -- 172.21.15.12:0/1821897976 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654d9b2b200 con 0x5654d9b2b410 2024-09-19T06:43:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.907+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/1821897976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2b410 0x5654d9b33440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3de8012fd0 tx=0x7f3de8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=319bfb77a8c58d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.908+0000 7f3dd97fa640 1 -- 172.21.15.12:0/1821897976 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8003a90 con 0x5654d9b2b410 2024-09-19T06:43:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.908+0000 7f3dd97fa640 1 -- 172.21.15.12:0/1821897976 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de8019a90 con 0x5654d9b2b410 2024-09-19T06:43:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.908+0000 7f3dd97fa640 1 -- 172.21.15.12:0/1821897976 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8025830 con 0x5654d9b2b410 2024-09-19T06:43:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.909+0000 7f3dfc879740 1 -- 172.21.15.12:0/1821897976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2b410 msgr2=0x5654d9b33440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.909+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1821897976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2b410 0x5654d9b33440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3de8012fd0 tx=0x7f3de8009260 comp rx=0 tx=0).stop 2024-09-19T06:43:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.909+0000 7f3dfc879740 1 -- 172.21.15.12:0/1821897976 shutdown_connections 2024-09-19T06:43:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.909+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1821897976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b35cb0 0x5654d9b4d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.909+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1821897976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b2b410 0x5654d9b33440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.909+0000 7f3dfc879740 1 --2- 172.21.15.12:0/1821897976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2aaf0 0x5654d9b2d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.909+0000 7f3dfc879740 1 -- 172.21.15.12:0/1821897976 >> 172.21.15.12:0/1821897976 conn(0x5654d9b27060 msgr2=0x5654d9b34c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.909+0000 7f3dfc879740 1 -- 172.21.15.12:0/1821897976 shutdown_connections 2024-09-19T06:43:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.909+0000 7f3dfc879740 1 -- 172.21.15.12:0/1821897976 wait complete. 2024-09-19T06:43:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.910+0000 7f3dfc879740 1 -- start start 2024-09-19T06:43:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.910+0000 7f3dfc879740 1 Processor -- start 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.911+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 0x5654d9b3e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.911+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 0x5654d9b39600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.911+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 0x5654d9b3e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.911+0000 7f3df37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 0x5654d9b3e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41344/0 (socket says 172.21.15.12:41344) 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.911+0000 7f3dfc879740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 0x5654d9b39b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.911+0000 7f3df2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 0x5654d9b39600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.911+0000 7f3df2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 0x5654d9b39600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53302/0 (socket says 172.21.15.12:53302) 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.911+0000 7f3dfc879740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41c65d0 con 0x5654d9b2b410 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.911+0000 7f3dfc879740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41c5f00 con 0x5654d9b2aaf0 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.911+0000 7f3dfc879740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3df4109610 con 0x5654d9b35cb0 2024-09-19T06:43:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.912+0000 7f3dfc879740 10 client.0 _ll_register_callbacks cb 0x7f3de8009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.912+0000 7f3df37fe640 1 -- 172.21.15.12:0/3448656219 learned_addr learned my addr 172.21.15.12:0/3448656219 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.912+0000 7f3df3fff640 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 0x5654d9b39b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.912+0000 7f3df37fe640 1 -- 172.21.15.12:0/3448656219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 msgr2=0x5654d9b39b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.912+0000 7f3df37fe640 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 0x5654d9b39b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.912+0000 7f3df37fe640 1 -- 172.21.15.12:0/3448656219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 msgr2=0x5654d9b39600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.912+0000 7f3df37fe640 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 0x5654d9b39600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.912+0000 7f3df37fe640 1 -- 172.21.15.12:0/3448656219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654d9b3a370 con 0x5654d9b2aaf0 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.912+0000 7f3df37fe640 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 0x5654d9b3e2e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3de402a950 tx=0x7f3de402a360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a60193accb2e5f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.913+0000 7f3dd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.913+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/3448656219 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de40d4060 con 0x5654d9b2aaf0 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.913+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/3448656219 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f3de40b9b10 con 0x5654d9b2aaf0 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.913+0000 7f3dfc879740 1 -- 172.21.15.12:0/3448656219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3de8019a90 con 0x5654d9b2aaf0 2024-09-19T06:43:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.913+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/3448656219 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3de40bb170 con 0x5654d9b2aaf0 2024-09-19T06:43:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.914+0000 7f3dfc879740 10 client.25934 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.914+0000 7f3dfc879740 1 -- 172.21.15.12:0/3448656219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5654d9bb0640 con 0x5654d9b2aaf0 2024-09-19T06:43:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.914+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/3448656219 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3de8019a90 con 0x5654d9b2aaf0 2024-09-19T06:43:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.914+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/3448656219 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f3de403a070 con 0x5654d9b2aaf0 2024-09-19T06:43:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.915+0000 7f3dfc879740 10 client.25934 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.915+0000 7f3dfc879740 10 client.25934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.915+0000 7f3dfc879740 20 client.25934 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.915+0000 7f3dfc879740 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654d9bb0d80 0x5654d9bb31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.915+0000 7f3dfc879740 4 client.25934 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:43:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.915+0000 7f3dfc879740 1 -- 172.21.15.12:0/3448656219 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5654d9a9ca20 con 0x5654d9bb0d80 2024-09-19T06:43:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.915+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654d9bb0d80 0x5654d9bb31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.916+0000 7f3dd2ffd640 10 client.25934 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:22.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.916+0000 7f3df2ffd640 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654d9bb0d80 0x5654d9bb31a0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3b0da39f0ce8ede server_cookie=c6628e0ac72fca84 in_seq=0 out_seq=0 2024-09-19T06:43:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.929+0000 7f3dd2ffd640 1 -- 172.21.15.12:0/3448656219 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5654d9a9ca20 con 0x5654d9bb0d80 2024-09-19T06:43:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.929+0000 7f3dd2ffd640 10 client.25934 handle_command_reply: tid=0 2024-09-19T06:43:22.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.929+0000 7f3dfc879740 1 client.25934 shutdown 2024-09-19T06:43:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.931+0000 7f3dfc879740 1 -- 172.21.15.12:0/3448656219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 msgr2=0x5654d9b3e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.931+0000 7f3dfc879740 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 0x5654d9b3e2e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3de402a950 tx=0x7f3de402a360 comp rx=0 tx=0).stop 2024-09-19T06:43:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.932+0000 7f3dfc879740 1 -- 172.21.15.12:0/3448656219 shutdown_connections 2024-09-19T06:43:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.932+0000 7f3dfc879740 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654d9bb0d80 0x5654d9bb31a0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.932+0000 7f3dfc879740 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654d9b35cb0 0x5654d9b39b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.932+0000 7f3dfc879740 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654d9b2b410 0x5654d9b39600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.932+0000 7f3dfc879740 1 --2- 172.21.15.12:0/3448656219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654d9b2aaf0 0x5654d9b3e2e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.932+0000 7f3dd2ffd640 0 client.25934 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.932+0000 7f3dfc879740 1 -- 172.21.15.12:0/3448656219 >> 172.21.15.12:0/3448656219 conn(0x5654d9b27060 msgr2=0x5654d9b343f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.932+0000 7f3dfc879740 1 -- 172.21.15.12:0/3448656219 shutdown_connections 2024-09-19T06:43:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.932+0000 7f3dfc879740 1 -- 172.21.15.12:0/3448656219 wait complete. 2024-09-19T06:43:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.933+0000 7f3dfc879740 20 client.25934 trim_cache size 0 max 16384 2024-09-19T06:43:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:43:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:43:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:43:22.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:43:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.934+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3ddc0a3640 msgr2=0x7f3ddc0a5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.935+0000 7f3df9ae4640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3ddc0a3640 0x7f3ddc0a5b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3df406b320 tx=0x7f3dec009600 comp rx=0 tx=0).stop 2024-09-19T06:43:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.935+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3df41091f0 msgr2=0x7f3df4114a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.935+0000 7f3df9ae4640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3df41091f0 0x7f3df4114a70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3de4035040 tx=0x7f3de4033d90 comp rx=0 tx=0).stop 2024-09-19T06:43:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.935+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 shutdown_connections 2024-09-19T06:43:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.935+0000 7f3df9ae4640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3df4116ea0 0x7f3df41154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.935+0000 7f3df9ae4640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df4109b10 0x7f3df4114fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.935+0000 7f3df9ae4640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3ddc0a3640 0x7f3ddc0a5b00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.935+0000 7f3df9ae4640 1 --2- 172.21.15.12:0/167722358 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3df41091f0 0x7f3df4114a70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.935+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 >> 172.21.15.12:0/167722358 conn(0x7f3df406d210 msgr2=0x7f3df4117380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.936+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 shutdown_connections 2024-09-19T06:43:22.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:22.936+0000 7f3df9ae4640 1 -- 172.21.15.12:0/167722358 wait complete. 2024-09-19T06:43:23.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:43:23.499 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:23.941 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:23 smithi012 ceph-mon[30937]: pgmap v100: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 740 op/s 2024-09-19T06:43:24.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:23 smithi173 ceph-mon[35349]: pgmap v100: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 740 op/s 2024-09-19T06:43:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.088+0000 7f72b626a640 1 -- 172.21.15.12:0/1142805755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b0102ef0 msgr2=0x7f72b010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.088+0000 7f72b626a640 1 --2- 172.21.15.12:0/1142805755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b0102ef0 0x7f72b010da40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009930 tx=0x7f72a002a4d0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.089+0000 7f72b626a640 1 -- 172.21.15.12:0/1142805755 shutdown_connections 2024-09-19T06:43:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.089+0000 7f72b626a640 1 --2- 172.21.15.12:0/1142805755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b0102ef0 0x7f72b010da40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.089+0000 7f72b626a640 1 --2- 172.21.15.12:0/1142805755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b0102570 0x7f72b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.089+0000 7f72b626a640 1 --2- 172.21.15.12:0/1142805755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b0100e20 0x7f72b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.089+0000 7f72b626a640 1 -- 172.21.15.12:0/1142805755 >> 172.21.15.12:0/1142805755 conn(0x7f72b00fc7d0 msgr2=0x7f72b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:24.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.089+0000 7f72b626a640 1 -- 172.21.15.12:0/1142805755 shutdown_connections 2024-09-19T06:43:24.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.089+0000 7f72b626a640 1 -- 172.21.15.12:0/1142805755 wait complete. 2024-09-19T06:43:24.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.090+0000 7f72b626a640 1 Processor -- start 2024-09-19T06:43:24.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.090+0000 7f72b626a640 1 -- start start 2024-09-19T06:43:24.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.091+0000 7f72b626a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b0100e20 0x7f72b0197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.091+0000 7f72b626a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b0102570 0x7f72b0197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.091+0000 7f72affff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b0100e20 0x7f72b0197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.091+0000 7f72affff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b0100e20 0x7f72b0197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53328/0 (socket says 172.21.15.12:53328) 2024-09-19T06:43:24.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.091+0000 7f72affff640 1 -- 172.21.15.12:0/2961451617 learned_addr learned my addr 172.21.15.12:0/2961451617 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:24.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.091+0000 7f72af7fe640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b0102570 0x7f72b0197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.091+0000 7f72b626a640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b0102ef0 0x7f72b019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.092+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0110f80 con 0x7f72b0100e20 2024-09-19T06:43:24.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.092+0000 7f72b4807640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b0102ef0 0x7f72b019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.092+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0110e00 con 0x7f72b0102ef0 2024-09-19T06:43:24.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.092+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0111100 con 0x7f72b0102570 2024-09-19T06:43:24.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.093+0000 7f72af7fe640 1 -- 172.21.15.12:0/2961451617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b0102ef0 msgr2=0x7f72b019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.093+0000 7f72af7fe640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b0102ef0 0x7f72b019b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.093+0000 7f72af7fe640 1 -- 172.21.15.12:0/2961451617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b0100e20 msgr2=0x7f72b0197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.093+0000 7f72af7fe640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b0100e20 0x7f72b0197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.093+0000 7f72af7fe640 1 -- 172.21.15.12:0/2961451617 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b019c0b0 con 0x7f72b0102570 2024-09-19T06:43:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.093+0000 7f72b4807640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b0102ef0 0x7f72b019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.093+0000 7f72affff640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b0100e20 0x7f72b0197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.093+0000 7f72af7fe640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b0102570 0x7f72b0197640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f72a400d6d0 tx=0x7f72a400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.094+0000 7f72ad7fa640 1 -- 172.21.15.12:0/2961451617 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4017070 con 0x7f72b0102570 2024-09-19T06:43:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.094+0000 7f72ad7fa640 1 -- 172.21.15.12:0/2961451617 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a4009820 con 0x7f72b0102570 2024-09-19T06:43:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.094+0000 7f72ad7fa640 1 -- 172.21.15.12:0/2961451617 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4004d00 con 0x7f72b0102570 2024-09-19T06:43:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.094+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b019c3a0 con 0x7f72b0102570 2024-09-19T06:43:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.094+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b0069f70 con 0x7f72b0102570 2024-09-19T06:43:24.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.099+0000 7f72b8643740 1 Processor -- start 2024-09-19T06:43:24.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.099+0000 7f72b8643740 1 -- start start 2024-09-19T06:43:24.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.099+0000 7f72b8643740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f2de090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.099+0000 7f72b8643740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f2dea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.099+0000 7f72b8643740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2fa380 0x55963f2fc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.099+0000 7f72b8643740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55963f2442f0 con 0x55963f2dfb40 2024-09-19T06:43:24.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.099+0000 7f72b8643740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55963f1ebcf0 con 0x55963f2de5d0 2024-09-19T06:43:24.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.099+0000 7f72b8643740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55963f2402b0 con 0x55963f2fa380 2024-09-19T06:43:24.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.100+0000 7f72affff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f2dea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.100+0000 7f72affff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f2dea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41370/0 (socket says 172.21.15.12:41370) 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.100+0000 7f72affff640 1 -- 172.21.15.12:0/241518683 learned_addr learned my addr 172.21.15.12:0/241518683 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.100+0000 7f72b4807640 1 --2- 172.21.15.12:0/241518683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f2de090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.100+0000 7f72af7fe640 1 --2- 172.21.15.12:0/241518683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2fa380 0x55963f2fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.100+0000 7f72affff640 1 -- 172.21.15.12:0/241518683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2fa380 msgr2=0x55963f2fc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.101+0000 7f72affff640 1 --2- 172.21.15.12:0/241518683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2fa380 0x55963f2fc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.101+0000 7f72affff640 1 -- 172.21.15.12:0/241518683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 msgr2=0x55963f2de090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.101+0000 7f72affff640 1 --2- 172.21.15.12:0/241518683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f2de090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.101+0000 7f72affff640 1 -- 172.21.15.12:0/241518683 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55963f1d03a0 con 0x55963f2de5d0 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.101+0000 7f72affff640 1 --2- 172.21.15.12:0/241518683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f2dea10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72a8030390 tx=0x7f72a8030850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f3fa919bbf0a83a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.101+0000 7f72967fc640 1 -- 172.21.15.12:0/241518683 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8036070 con 0x55963f2de5d0 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.101+0000 7f72967fc640 1 -- 172.21.15.12:0/241518683 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a8004d20 con 0x55963f2de5d0 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.102+0000 7f72967fc640 1 -- 172.21.15.12:0/241518683 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8005640 con 0x55963f2de5d0 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.102+0000 7f72ad7fa640 1 -- 172.21.15.12:0/2961451617 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f72a40099d0 con 0x7f72b0102570 2024-09-19T06:43:24.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.102+0000 7f72b8643740 1 -- 172.21.15.12:0/241518683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 msgr2=0x55963f2dea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.102+0000 7f72b8643740 1 --2- 172.21.15.12:0/241518683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f2dea10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72a8030390 tx=0x7f72a8030850 comp rx=0 tx=0).stop 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.102+0000 7f72b8643740 1 -- 172.21.15.12:0/241518683 shutdown_connections 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.102+0000 7f72b8643740 1 --2- 172.21.15.12:0/241518683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2fa380 0x55963f2fc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.102+0000 7f72b8643740 1 --2- 172.21.15.12:0/241518683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f2dea10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.102+0000 7f72b8643740 1 --2- 172.21.15.12:0/241518683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f2de090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.102+0000 7f72b8643740 1 -- 172.21.15.12:0/241518683 >> 172.21.15.12:0/241518683 conn(0x55963f2a7310 msgr2=0x55963f2dac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.103+0000 7f72b8643740 1 -- 172.21.15.12:0/241518683 shutdown_connections 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.103+0000 7f72b8643740 1 -- 172.21.15.12:0/241518683 wait complete. 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.103+0000 7f72ad7fa640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72980a3490 0x7f72980a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.103+0000 7f72ad7fa640 1 -- 172.21.15.12:0/2961451617 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f72a40cf750 con 0x7f72b0102570 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.103+0000 7f72b8643740 1 -- start start 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.103+0000 7f72affff640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72980a3490 0x7f72980a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b8643740 1 Processor -- start 2024-09-19T06:43:24.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b8643740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f2f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b8643740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2dfb40 0x55963f2f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b8643740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2fa380 0x55963f2f9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b8643740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55963f2e15a0 con 0x55963f2fa380 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b8643740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55963f1ff060 con 0x55963f2de5d0 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b8643740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55963f2e1720 con 0x55963f2dfb40 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b8643740 10 client.0 _ll_register_callbacks cb 0x55963ef528c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b4807640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2fa380 0x55963f2f9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b4807640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2fa380 0x55963f2f9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53352/0 (socket says 172.21.15.12:53352) 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.104+0000 7f72b4807640 1 -- 172.21.15.12:0/1039139839 learned_addr learned my addr 172.21.15.12:0/1039139839 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.105+0000 7f72affff640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72980a3490 0x7f72980a5950 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72a8005140 tx=0x7f72a80051a0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.105+0000 7f72affff640 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f2f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.105+0000 7f72b4807640 1 -- 172.21.15.12:0/1039139839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2dfb40 msgr2=0x55963f2f40c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.105+0000 7f72b4807640 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2dfb40 0x55963f2f40c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.105+0000 7f72b4807640 1 -- 172.21.15.12:0/1039139839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 msgr2=0x55963f2f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.105+0000 7f72b4807640 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f2f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.105+0000 7f72b4807640 1 -- 172.21.15.12:0/1039139839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963efb53c0 con 0x55963f2fa380 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.105+0000 7f72b4807640 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2fa380 0x55963f2f9900 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f72a0033000 tx=0x7f72a004da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed44746c9d6b345 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.105+0000 7f728f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.106+0000 7f728f7fe640 1 -- 172.21.15.12:0/1039139839 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0035070 con 0x55963f2fa380 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.106+0000 7f728f7fe640 1 -- 172.21.15.12:0/1039139839 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f72a0004460 con 0x55963f2fa380 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.106+0000 7f72b8643740 1 -- 172.21.15.12:0/1039139839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72a8004d20 con 0x55963f2fa380 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.106+0000 7f728f7fe640 1 -- 172.21.15.12:0/1039139839 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f72a0005d50 con 0x55963f2fa380 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.106+0000 7f72b8643740 10 client.16383 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.106+0000 7f72b8643740 1 -- 172.21.15.12:0/1039139839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55963f2e5e00 con 0x55963f2fa380 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.107+0000 7f728f7fe640 1 -- 172.21.15.12:0/1039139839 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a8004d20 con 0x55963f2fa380 2024-09-19T06:43:24.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.107+0000 7f728f7fe640 1 -- 172.21.15.12:0/1039139839 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f72a0054020 con 0x55963f2fa380 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.107+0000 7f72b8643740 10 client.16383 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.107+0000 7f72b8643740 10 client.16383 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.107+0000 7f72b8643740 20 client.16383 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.107+0000 7f72b8643740 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55963f2e72c0 0x55963f2e9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.107+0000 7f72b8643740 4 client.16383 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.107+0000 7f72b8643740 1 -- 172.21.15.12:0/1039139839 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55963f251860 con 0x55963f2e72c0 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.108+0000 7f72affff640 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55963f2e72c0 0x55963f2e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.108+0000 7f72affff640 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55963f2e72c0 0x55963f2e9760 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=49a88acd09c05869 server_cookie=9e0f3bdd7c0c1433 in_seq=0 out_seq=0 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.109+0000 7f728f7fe640 10 client.16383 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.109+0000 7f728f7fe640 1 -- 172.21.15.12:0/1039139839 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55963f251860 con 0x55963f2e72c0 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.109+0000 7f728f7fe640 10 client.16383 handle_command_reply: tid=0 2024-09-19T06:43:24.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.109+0000 7f72b8643740 1 client.16383 shutdown 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 1 -- 172.21.15.12:0/1039139839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2fa380 msgr2=0x55963f2f9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2fa380 0x55963f2f9900 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f72a0033000 tx=0x7f72a004da70 comp rx=0 tx=0).stop 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 1 -- 172.21.15.12:0/1039139839 shutdown_connections 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55963f2e72c0 0x55963f2e9760 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2fa380 0x55963f2f9900 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2dfb40 0x55963f2f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 1 --2- 172.21.15.12:0/1039139839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f2f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 1 -- 172.21.15.12:0/1039139839 >> 172.21.15.12:0/1039139839 conn(0x55963f2a7310 msgr2=0x55963f2e0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f728f7fe640 0 client.16383 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 1 -- 172.21.15.12:0/1039139839 shutdown_connections 2024-09-19T06:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 1 -- 172.21.15.12:0/1039139839 wait complete. 2024-09-19T06:43:24.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.110+0000 7f72b8643740 20 client.16383 trim_cache size 0 max 16384 2024-09-19T06:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.138+0000 7f72b8643740 1 Processor -- start 2024-09-19T06:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.138+0000 7f72b8643740 1 -- start start 2024-09-19T06:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.138+0000 7f72b8643740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2de5d0 0x55963f2f9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.138+0000 7f72b8643740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f2da700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.138+0000 7f72b8643740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2fa380 0x55963f2dac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.138+0000 7f72b8643740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0073850 con 0x55963f2dfb40 2024-09-19T06:43:24.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.138+0000 7f72b8643740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01a4cf0 con 0x55963f2fa380 2024-09-19T06:43:24.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.138+0000 7f72b8643740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0073f20 con 0x55963f2de5d0 2024-09-19T06:43:24.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.139+0000 7f72affff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2de5d0 0x55963f2f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.139+0000 7f72affff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2de5d0 0x55963f2f9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40948/0 (socket says 172.21.15.12:40948) 2024-09-19T06:43:24.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.139+0000 7f72affff640 1 -- 172.21.15.12:0/522744391 learned_addr learned my addr 172.21.15.12:0/522744391 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:24.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.139+0000 7f72af7fe640 1 --2- 172.21.15.12:0/522744391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f2da700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.139+0000 7f72affff640 1 -- 172.21.15.12:0/522744391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2fa380 msgr2=0x55963f2dac40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:43:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.139+0000 7f72affff640 1 --2- 172.21.15.12:0/522744391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2fa380 0x55963f2dac40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.139+0000 7f72affff640 1 -- 172.21.15.12:0/522744391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 msgr2=0x55963f2da700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.139+0000 7f72affff640 1 --2- 172.21.15.12:0/522744391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f2da700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.139+0000 7f72affff640 1 -- 172.21.15.12:0/522744391 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55963f2f3790 con 0x55963f2de5d0 2024-09-19T06:43:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.140+0000 7f72affff640 1 --2- 172.21.15.12:0/522744391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2de5d0 0x55963f2f9870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f72a8005210 tx=0x7f72a8007920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46db87dfd1fdf462 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.140+0000 7f7295ffb640 1 -- 172.21.15.12:0/522744391 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8007b40 con 0x55963f2de5d0 2024-09-19T06:43:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.140+0000 7f7295ffb640 1 -- 172.21.15.12:0/522744391 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a8032b60 con 0x55963f2de5d0 2024-09-19T06:43:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.140+0000 7f7295ffb640 1 -- 172.21.15.12:0/522744391 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8052600 con 0x55963f2de5d0 2024-09-19T06:43:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.141+0000 7f72b8643740 1 -- 172.21.15.12:0/522744391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2de5d0 msgr2=0x55963f2f9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.141+0000 7f72b8643740 1 --2- 172.21.15.12:0/522744391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2de5d0 0x55963f2f9870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f72a8005210 tx=0x7f72a8007920 comp rx=0 tx=0).stop 2024-09-19T06:43:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.141+0000 7f72b8643740 1 -- 172.21.15.12:0/522744391 shutdown_connections 2024-09-19T06:43:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.141+0000 7f72b8643740 1 --2- 172.21.15.12:0/522744391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2fa380 0x55963f2dac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.141+0000 7f72b8643740 1 --2- 172.21.15.12:0/522744391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f2da700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.141+0000 7f72b8643740 1 --2- 172.21.15.12:0/522744391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2de5d0 0x55963f2f9870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.141+0000 7f72b8643740 1 -- 172.21.15.12:0/522744391 >> 172.21.15.12:0/522744391 conn(0x55963f2a7310 msgr2=0x55963f2f3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.142+0000 7f72b8643740 1 -- 172.21.15.12:0/522744391 shutdown_connections 2024-09-19T06:43:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.142+0000 7f72b8643740 1 -- 172.21.15.12:0/522744391 wait complete. 2024-09-19T06:43:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.143+0000 7f72b8643740 1 -- start start 2024-09-19T06:43:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.143+0000 7f72b8643740 1 Processor -- start 2024-09-19T06:43:24.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.144+0000 7f72b8643740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f311450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.144+0000 7f72b8643740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f311990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.144+0000 7f72b8643740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2fa380 0x55963f2e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.144+0000 7f72b8643740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01a4560 con 0x55963f2dfb40 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.144+0000 7f72b8643740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01a3e90 con 0x55963f2de5d0 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.144+0000 7f72b8643740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0071830 con 0x55963f2fa380 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.144+0000 7f72b8643740 10 client.0 _ll_register_callbacks cb 0x7f72a004d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.144+0000 7f72b4807640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2fa380 0x55963f2e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.144+0000 7f72af7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f311990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.144+0000 7f72af7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f311990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53364/0 (socket says 172.21.15.12:53364) 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.145+0000 7f72af7fe640 1 -- 172.21.15.12:0/497348850 learned_addr learned my addr 172.21.15.12:0/497348850 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.145+0000 7f72affff640 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f311450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.145+0000 7f72af7fe640 1 -- 172.21.15.12:0/497348850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2fa380 msgr2=0x55963f2e2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.145+0000 7f72af7fe640 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2fa380 0x55963f2e2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.145+0000 7f72af7fe640 1 -- 172.21.15.12:0/497348850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 msgr2=0x55963f311450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.145+0000 7f72af7fe640 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f311450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.145+0000 7f72af7fe640 1 -- 172.21.15.12:0/497348850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963f2e37b0 con 0x55963f2dfb40 2024-09-19T06:43:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.146+0000 7f72af7fe640 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f311990 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009610 tx=0x7f72a40cfcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5265c42964cd4b9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.146+0000 7f728f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.146+0000 7f728f7fe640 1 -- 172.21.15.12:0/497348850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4020040 con 0x55963f2dfb40 2024-09-19T06:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.146+0000 7f728f7fe640 1 -- 172.21.15.12:0/497348850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f72a40cd040 con 0x55963f2dfb40 2024-09-19T06:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.147+0000 7f72b8643740 1 -- 172.21.15.12:0/497348850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72a8032b60 con 0x55963f2dfb40 2024-09-19T06:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.147+0000 7f728f7fe640 1 -- 172.21.15.12:0/497348850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f72a409b490 con 0x55963f2dfb40 2024-09-19T06:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.147+0000 7f72b8643740 10 client.16389 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.147+0000 7f72b8643740 1 -- 172.21.15.12:0/497348850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55963f363e60 con 0x55963f2dfb40 2024-09-19T06:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.148+0000 7f728f7fe640 1 -- 172.21.15.12:0/497348850 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a8032b60 con 0x55963f2dfb40 2024-09-19T06:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.148+0000 7f728f7fe640 1 -- 172.21.15.12:0/497348850 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f72a409ada0 con 0x55963f2dfb40 2024-09-19T06:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.148+0000 7f72b8643740 10 client.16389 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.148+0000 7f72b8643740 10 client.16389 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:43:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.148+0000 7f72b8643740 20 client.16389 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.148+0000 7f72b8643740 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55963f364620 0x55963f366ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.148+0000 7f72b8643740 4 client.16389 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:43:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.148+0000 7f72b8643740 1 -- 172.21.15.12:0/497348850 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55963f24bd70 con 0x55963f364620 2024-09-19T06:43:24.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.149+0000 7f72affff640 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55963f364620 0x55963f366ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.150+0000 7f72affff640 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55963f364620 0x55963f366ae0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=36988d17d850636 server_cookie=dc6a29d40a1b05dc in_seq=0 out_seq=0 2024-09-19T06:43:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.150+0000 7f728f7fe640 10 client.16389 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:43:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.150+0000 7f728f7fe640 1 -- 172.21.15.12:0/497348850 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55963f24bd70 con 0x55963f364620 2024-09-19T06:43:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.151+0000 7f728f7fe640 10 client.16389 handle_command_reply: tid=0 2024-09-19T06:43:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.151+0000 7f72b8643740 1 client.16389 shutdown 2024-09-19T06:43:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.151+0000 7f72b8643740 1 -- 172.21.15.12:0/497348850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 msgr2=0x55963f311990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.151+0000 7f72b8643740 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f311990 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009610 tx=0x7f72a40cfcc0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.152+0000 7f72b8643740 1 -- 172.21.15.12:0/497348850 shutdown_connections 2024-09-19T06:43:24.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.152+0000 7f72b8643740 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55963f364620 0x55963f366ae0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.152+0000 7f72b8643740 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55963f2fa380 0x55963f2e2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.152+0000 7f728f7fe640 0 client.16389 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:43:24.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.152+0000 7f72b8643740 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55963f2dfb40 0x55963f311990 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.152+0000 7f72b8643740 1 --2- 172.21.15.12:0/497348850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55963f2de5d0 0x55963f311450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.152+0000 7f72b8643740 1 -- 172.21.15.12:0/497348850 >> 172.21.15.12:0/497348850 conn(0x55963f2a7310 msgr2=0x55963f2da650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:24.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.152+0000 7f72b8643740 1 -- 172.21.15.12:0/497348850 shutdown_connections 2024-09-19T06:43:24.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.152+0000 7f72b8643740 1 -- 172.21.15.12:0/497348850 wait complete. 2024-09-19T06:43:24.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.153+0000 7f72b8643740 20 client.16389 trim_cache size 0 max 16384 2024-09-19T06:43:24.155 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:43:24.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72980a3490 msgr2=0x7f72980a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72980a3490 0x7f72980a5950 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72a8005140 tx=0x7f72a80051a0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b0102570 msgr2=0x7f72b0197640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b0102570 0x7f72b0197640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f72a400d6d0 tx=0x7f72a400db90 comp rx=0 tx=0).stop 2024-09-19T06:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 shutdown_connections 2024-09-19T06:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b0102ef0 0x7f72b019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72980a3490 0x7f72980a5950 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72b0102570 0x7f72b0197640 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 --2- 172.21.15.12:0/2961451617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b0100e20 0x7f72b0197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 >> 172.21.15.12:0/2961451617 conn(0x7f72b00fc7d0 msgr2=0x7f72b0105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 shutdown_connections 2024-09-19T06:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:24.154+0000 7f72b626a640 1 -- 172.21.15.12:0/2961451617 wait complete. 2024-09-19T06:43:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:23 smithi016 ceph-mon[34911]: pgmap v100: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 740 op/s 2024-09-19T06:43:25.048 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:43:25.491 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 160.0 s, 5326.8 tps, lat 18.735 ms stddev 19.992 2024-09-19T06:43:25.951 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:25 smithi012 ceph-mon[30937]: pgmap v101: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 740 op/s 2024-09-19T06:43:26.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:25 smithi173 ceph-mon[35349]: pgmap v101: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 740 op/s 2024-09-19T06:43:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.092+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/1538681530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc58106a90 msgr2=0x7fcc58106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.092+0000 7fcc5559a640 1 -- 172.21.15.12:0/1538681530 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48035020 con 0x7fcc58106a90 2024-09-19T06:43:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.092+0000 7fcc5cdc2640 1 --2- 172.21.15.12:0/1538681530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc58106a90 0x7fcc58106e70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009930 tx=0x7fcc4802a420 comp rx=0 tx=0).stop 2024-09-19T06:43:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.093+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/1538681530 shutdown_connections 2024-09-19T06:43:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.093+0000 7fcc5cdc2640 1 --2- 172.21.15.12:0/1538681530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc58101430 0x7fcc5810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.093+0000 7fcc5cdc2640 1 --2- 172.21.15.12:0/1538681530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc58100a90 0x7fcc58100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.093+0000 7fcc5cdc2640 1 --2- 172.21.15.12:0/1538681530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc58106a90 0x7fcc58106e70 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.093+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/1538681530 >> 172.21.15.12:0/1538681530 conn(0x7fcc580fc7d0 msgr2=0x7fcc580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.094+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/1538681530 shutdown_connections 2024-09-19T06:43:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.095+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/1538681530 wait complete. 2024-09-19T06:43:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.096+0000 7fcc5cdc2640 1 Processor -- start 2024-09-19T06:43:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.096+0000 7fcc5cdc2640 1 -- start start 2024-09-19T06:43:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.096+0000 7fcc5cdc2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc58100a90 0x7fcc58107930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.096+0000 7fcc5cdc2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc58101430 0x7fcc58107e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.096+0000 7fcc5cdc2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc58106a90 0x7fcc581083b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.096+0000 7fcc5cdc2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5806c1c0 con 0x7fcc58106a90 2024-09-19T06:43:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.096+0000 7fcc5cdc2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5806c040 con 0x7fcc58101430 2024-09-19T06:43:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.096+0000 7fcc5cdc2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5806c340 con 0x7fcc58100a90 2024-09-19T06:43:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.097+0000 7fcc56d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc58106a90 0x7fcc581083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.097+0000 7fcc56d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc58106a90 0x7fcc581083b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53378/0 (socket says 172.21.15.12:53378) 2024-09-19T06:43:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.097+0000 7fcc56d9d640 1 -- 172.21.15.12:0/3597343194 learned_addr learned my addr 172.21.15.12:0/3597343194 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.097+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc58101430 0x7fcc58107e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.097+0000 7fcc56d9d640 1 -- 172.21.15.12:0/3597343194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc58100a90 msgr2=0x7fcc58107930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:43:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.097+0000 7fcc56d9d640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc58100a90 0x7fcc58107930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.097+0000 7fcc56d9d640 1 -- 172.21.15.12:0/3597343194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc58101430 msgr2=0x7fcc58107e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.097+0000 7fcc56d9d640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc58101430 0x7fcc58107e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.097+0000 7fcc56d9d640 1 -- 172.21.15.12:0/3597343194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc58072ae0 con 0x7fcc58106a90 2024-09-19T06:43:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.098+0000 7fcc56d9d640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc58106a90 0x7fcc581083b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000efd0 tx=0x7fcc5000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:26.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.099+0000 7fcc477fe640 1 -- 172.21.15.12:0/3597343194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50003b70 con 0x7fcc58106a90 2024-09-19T06:43:26.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.099+0000 7fcc477fe640 1 -- 172.21.15.12:0/3597343194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc50003d10 con 0x7fcc58106a90 2024-09-19T06:43:26.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.099+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/3597343194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc58072dd0 con 0x7fcc58106a90 2024-09-19T06:43:26.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.099+0000 7fcc477fe640 1 -- 172.21.15.12:0/3597343194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50010a90 con 0x7fcc58106a90 2024-09-19T06:43:26.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.099+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/3597343194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc58073310 con 0x7fcc58106a90 2024-09-19T06:43:26.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.103+0000 7fcc5f19b740 1 Processor -- start 2024-09-19T06:43:26.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.103+0000 7fcc477fe640 1 -- 172.21.15.12:0/3597343194 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcc50010c30 con 0x7fcc58106a90 2024-09-19T06:43:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.104+0000 7fcc5f19b740 1 -- start start 2024-09-19T06:43:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.104+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e48090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.104+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e485d0 0x563fa5e48a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.104+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e53370 0x563fa5e55760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.104+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563fa5dae2f0 con 0x563fa5e49b40 2024-09-19T06:43:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.104+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563fa5d55cf0 con 0x563fa5e53370 2024-09-19T06:43:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.104+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563fa5daa2b0 con 0x563fa5e485d0 2024-09-19T06:43:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.104+0000 7fcc5659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e485d0 0x563fa5e48a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.104+0000 7fcc5659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e485d0 0x563fa5e48a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40988/0 (socket says 172.21.15.12:40988) 2024-09-19T06:43:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.104+0000 7fcc5659c640 1 -- 172.21.15.12:0/739844912 learned_addr learned my addr 172.21.15.12:0/739844912 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.105+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/739844912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e53370 0x563fa5e55760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.105+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/739844912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e48090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.107+0000 7fcc477fe640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcc400a3470 0x7fcc400a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.107+0000 7fcc5659c640 1 -- 172.21.15.12:0/739844912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e53370 msgr2=0x563fa5e55760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:26.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.107+0000 7fcc5659c640 1 --2- 172.21.15.12:0/739844912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e53370 0x563fa5e55760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.107+0000 7fcc5659c640 1 -- 172.21.15.12:0/739844912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 msgr2=0x563fa5e48090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:26.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.107+0000 7fcc5659c640 1 --2- 172.21.15.12:0/739844912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e48090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.107+0000 7fcc5659c640 1 -- 172.21.15.12:0/739844912 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa5d3a3a0 con 0x563fa5e485d0 2024-09-19T06:43:26.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.107+0000 7fcc56d9d640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcc400a3470 0x7fcc400a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.107+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/739844912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e48090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:26.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.107+0000 7fcc477fe640 1 -- 172.21.15.12:0/3597343194 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcc500d01b0 con 0x7fcc58106a90 2024-09-19T06:43:26.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.107+0000 7fcc5659c640 1 --2- 172.21.15.12:0/739844912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e485d0 0x563fa5e48a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcc48000c00 tx=0x7fcc48005750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a787ce7cebf2fde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:26.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.108+0000 7fcc56d9d640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcc400a3470 0x7fcc400a5930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcc500cd930 tx=0x7fcc500918a0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.110+0000 7fcc44ff9640 1 -- 172.21.15.12:0/739844912 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4803e030 con 0x563fa5e485d0 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.110+0000 7fcc44ff9640 1 -- 172.21.15.12:0/739844912 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc480035f0 con 0x563fa5e485d0 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.110+0000 7fcc44ff9640 1 -- 172.21.15.12:0/739844912 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48035040 con 0x563fa5e485d0 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.110+0000 7fcc5f19b740 1 -- 172.21.15.12:0/739844912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e485d0 msgr2=0x563fa5e48a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.110+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/739844912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e485d0 0x563fa5e48a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcc48000c00 tx=0x7fcc48005750 comp rx=0 tx=0).stop 2024-09-19T06:43:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.112+0000 7fcc5f19b740 1 -- 172.21.15.12:0/739844912 shutdown_connections 2024-09-19T06:43:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.112+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/739844912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e53370 0x563fa5e55760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.112+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/739844912 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e485d0 0x563fa5e48a10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.112+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/739844912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e48090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.112+0000 7fcc5f19b740 1 -- 172.21.15.12:0/739844912 >> 172.21.15.12:0/739844912 conn(0x563fa5e11310 msgr2=0x563fa5e44c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.112+0000 7fcc5f19b740 1 -- 172.21.15.12:0/739844912 shutdown_connections 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.112+0000 7fcc5f19b740 1 -- 172.21.15.12:0/739844912 wait complete. 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.113+0000 7fcc5f19b740 1 -- start start 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.113+0000 7fcc5f19b740 1 Processor -- start 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.113+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e485d0 0x563fa5e52d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.113+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e4ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.113+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e50570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.113+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563fa5e56060 con 0x563fa5e49b40 2024-09-19T06:43:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.113+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563fa5d69060 con 0x563fa5e485d0 2024-09-19T06:43:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.113+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563fa5e561e0 con 0x563fa5e53370 2024-09-19T06:43:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.113+0000 7fcc5f19b740 10 client.0 _ll_register_callbacks cb 0x563fa5abc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.114+0000 7fcc55d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e485d0 0x563fa5e52d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.114+0000 7fcc55d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e50570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.114+0000 7fcc55d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e485d0 0x563fa5e52d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41426/0 (socket says 172.21.15.12:41426) 2024-09-19T06:43:26.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.114+0000 7fcc55d9b640 1 -- 172.21.15.12:0/2803900907 learned_addr learned my addr 172.21.15.12:0/2803900907 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:26.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.115+0000 7fcc55d9b640 1 -- 172.21.15.12:0/2803900907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 msgr2=0x563fa5e50570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:26.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.115+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e50570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.115+0000 7fcc55d9b640 1 -- 172.21.15.12:0/2803900907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 msgr2=0x563fa5e4ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:26.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.115+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e4ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.115+0000 7fcc55d9b640 1 -- 172.21.15.12:0/2803900907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa5b1f3c0 con 0x563fa5e485d0 2024-09-19T06:43:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.116+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e485d0 0x563fa5e52d20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c012db0 tx=0x7fcc4c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c006bc9af478e99e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.116+0000 7fcc3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:26.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.118+0000 7fcc3dffb640 1 -- 172.21.15.12:0/2803900907 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c019040 con 0x563fa5e485d0 2024-09-19T06:43:26.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.118+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2803900907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc480035f0 con 0x563fa5e485d0 2024-09-19T06:43:26.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.118+0000 7fcc3dffb640 1 -- 172.21.15.12:0/2803900907 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcc4c0120d0 con 0x563fa5e485d0 2024-09-19T06:43:26.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc3dffb640 1 -- 172.21.15.12:0/2803900907 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcc4c019040 con 0x563fa5e485d0 2024-09-19T06:43:26.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc5f19b740 10 client.25961 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:26.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2803900907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563fa5e61b60 con 0x563fa5e485d0 2024-09-19T06:43:26.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc3dffb640 1 -- 172.21.15.12:0/2803900907 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc480035f0 con 0x563fa5e485d0 2024-09-19T06:43:26.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc3dffb640 1 -- 172.21.15.12:0/2803900907 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fcc4c026070 con 0x563fa5e485d0 2024-09-19T06:43:26.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc5f19b740 10 client.25961 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:26.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc5f19b740 10 client.25961 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:43:26.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc5f19b740 20 client.25961 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:26.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x563fa5e62fc0 0x563fa5e65410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc5f19b740 4 client.25961 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:26.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.119+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2803900907 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fa5dbb860 con 0x563fa5e62fc0 2024-09-19T06:43:26.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.120+0000 7fcc5659c640 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x563fa5e62fc0 0x563fa5e65410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.121+0000 7fcc5659c640 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x563fa5e62fc0 0x563fa5e65410 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f241f0bcc5441844 server_cookie=30ab5ef94323d5d8 in_seq=0 out_seq=0 2024-09-19T06:43:26.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.121+0000 7fcc3dffb640 10 client.25961 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:43:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.122+0000 7fcc3dffb640 1 -- 172.21.15.12:0/2803900907 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563fa5dbb860 con 0x563fa5e62fc0 2024-09-19T06:43:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.122+0000 7fcc3dffb640 10 client.25961 handle_command_reply: tid=0 2024-09-19T06:43:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.122+0000 7fcc5f19b740 1 client.25961 shutdown 2024-09-19T06:43:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.123+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2803900907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e485d0 msgr2=0x563fa5e52d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.123+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e485d0 0x563fa5e52d20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c012db0 tx=0x7fcc4c009b50 comp rx=0 tx=0).stop 2024-09-19T06:43:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.123+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2803900907 shutdown_connections 2024-09-19T06:43:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.123+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x563fa5e62fc0 0x563fa5e65410 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.123+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e50570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.123+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e4ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.123+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/2803900907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e485d0 0x563fa5e52d20 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c012db0 tx=0x7fcc4c009b50 comp rx=0 tx=0).stop 2024-09-19T06:43:26.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.123+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2803900907 >> 172.21.15.12:0/2803900907 conn(0x563fa5e11310 msgr2=0x563fa5e4a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.123+0000 7fcc3dffb640 0 client.25961 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:43:26.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.125+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2803900907 shutdown_connections 2024-09-19T06:43:26.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.125+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2803900907 wait complete. 2024-09-19T06:43:26.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.125+0000 7fcc5f19b740 20 client.25961 trim_cache size 0 max 16384 2024-09-19T06:43:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.150+0000 7fcc5f19b740 1 Processor -- start 2024-09-19T06:43:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc5f19b740 1 -- start start 2024-09-19T06:43:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e5f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e47de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e54760 0x563fa5e54bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581bc920 con 0x563fa5e49b40 2024-09-19T06:43:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581be550 con 0x563fa5e54760 2024-09-19T06:43:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581bcff0 con 0x563fa5e53370 2024-09-19T06:43:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc55d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e5f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc55d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e54760 0x563fa5e54bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc55d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e54760 0x563fa5e54bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41432/0 (socket says 172.21.15.12:41432) 2024-09-19T06:43:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.151+0000 7fcc55d9b640 1 -- 172.21.15.12:0/2082769087 learned_addr learned my addr 172.21.15.12:0/2082769087 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.152+0000 7fcc55d9b640 1 -- 172.21.15.12:0/2082769087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 msgr2=0x563fa5e47de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:43:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.152+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/2082769087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e47de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.152+0000 7fcc55d9b640 1 -- 172.21.15.12:0/2082769087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 msgr2=0x563fa5e5f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.152+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/2082769087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e5f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.152+0000 7fcc55d9b640 1 -- 172.21.15.12:0/2082769087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa5e55130 con 0x563fa5e54760 2024-09-19T06:43:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.152+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/2082769087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e54760 0x563fa5e54bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c020f10 tx=0x7fcc4c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9abf161483bc864 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.152+0000 7fcc3ffff640 1 -- 172.21.15.12:0/2082769087 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c02c070 con 0x563fa5e54760 2024-09-19T06:43:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.152+0000 7fcc3ffff640 1 -- 172.21.15.12:0/2082769087 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc4c02d040 con 0x563fa5e54760 2024-09-19T06:43:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.153+0000 7fcc3ffff640 1 -- 172.21.15.12:0/2082769087 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c003b30 con 0x563fa5e54760 2024-09-19T06:43:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.153+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2082769087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e54760 msgr2=0x563fa5e54bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.153+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/2082769087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e54760 0x563fa5e54bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c020f10 tx=0x7fcc4c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.154+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2082769087 shutdown_connections 2024-09-19T06:43:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.154+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/2082769087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e54760 0x563fa5e54bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.154+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/2082769087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e47de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.154+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/2082769087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e49b40 0x563fa5e5f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.154+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2082769087 >> 172.21.15.12:0/2082769087 conn(0x563fa5e11310 msgr2=0x563fa5e4b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.156+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2082769087 shutdown_connections 2024-09-19T06:43:26.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.156+0000 7fcc5f19b740 1 -- 172.21.15.12:0/2082769087 wait complete. 2024-09-19T06:43:26.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.157+0000 7fcc5f19b740 1 -- start start 2024-09-19T06:43:26.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.157+0000 7fcc5f19b740 1 Processor -- start 2024-09-19T06:43:26.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e49b40 0x563fa5e5bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e6a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc5f19b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e54760 0x563fa5e6abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581bddc0 con 0x563fa5e54760 2024-09-19T06:43:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581bd6f0 con 0x563fa5e49b40 2024-09-19T06:43:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc5f19b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581ba900 con 0x563fa5e53370 2024-09-19T06:43:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc5f19b740 10 client.0 _ll_register_callbacks cb 0x7fcc4c0129f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc55d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e54760 0x563fa5e6abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc55d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e54760 0x563fa5e6abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53430/0 (socket says 172.21.15.12:53430) 2024-09-19T06:43:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc55d9b640 1 -- 172.21.15.12:0/1040320479 learned_addr learned my addr 172.21.15.12:0/1040320479 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:26.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e49b40 0x563fa5e5bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc5659c640 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e6a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc55d9b640 1 -- 172.21.15.12:0/1040320479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 msgr2=0x563fa5e6a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e6a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc55d9b640 1 -- 172.21.15.12:0/1040320479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e54760 msgr2=0x563fa5e6abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e54760 0x563fa5e6abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.158+0000 7fcc55d9b640 1 -- 172.21.15.12:0/1040320479 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa5e6b3c0 con 0x563fa5e49b40 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.159+0000 7fcc55d9b640 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e49b40 0x563fa5e5bb70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0059f0 tx=0x7fcc4c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a2294c220209f50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.159+0000 7fcc3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.159+0000 7fcc3dffb640 1 -- 172.21.15.12:0/1040320479 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c03b070 con 0x563fa5e49b40 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.159+0000 7fcc3dffb640 1 -- 172.21.15.12:0/1040320479 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcc4c0052c0 con 0x563fa5e49b40 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.159+0000 7fcc5f19b740 1 -- 172.21.15.12:0/1040320479 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc4c02d040 con 0x563fa5e49b40 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.159+0000 7fcc3dffb640 1 -- 172.21.15.12:0/1040320479 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcc4c02c040 con 0x563fa5e49b40 2024-09-19T06:43:26.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.159+0000 7fcc5f19b740 10 client.25967 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.159+0000 7fcc5f19b740 1 -- 172.21.15.12:0/1040320479 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563fa5eded60 con 0x563fa5e49b40 2024-09-19T06:43:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.160+0000 7fcc3dffb640 1 -- 172.21.15.12:0/1040320479 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc4c02d040 con 0x563fa5e49b40 2024-09-19T06:43:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.160+0000 7fcc3dffb640 1 -- 172.21.15.12:0/1040320479 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fcc4c042060 con 0x563fa5e49b40 2024-09-19T06:43:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.160+0000 7fcc5f19b740 10 client.25967 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.160+0000 7fcc5f19b740 10 client.25967 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:43:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.160+0000 7fcc5f19b740 20 client.25967 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.160+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x563fa5edf3c0 0x563fa5ee17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.160+0000 7fcc5f19b740 4 client.25967 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:43:26.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.160+0000 7fcc5f19b740 1 -- 172.21.15.12:0/1040320479 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563fa5db5d70 con 0x563fa5edf3c0 2024-09-19T06:43:26.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.161+0000 7fcc5659c640 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x563fa5edf3c0 0x563fa5ee17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.161+0000 7fcc5659c640 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x563fa5edf3c0 0x563fa5ee17b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29be58d9f87deb22 server_cookie=9cbbe8a97663f3c in_seq=0 out_seq=0 2024-09-19T06:43:26.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.161+0000 7fcc3dffb640 10 client.25967 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:43:26.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.162+0000 7fcc3dffb640 1 -- 172.21.15.12:0/1040320479 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563fa5db5d70 con 0x563fa5edf3c0 2024-09-19T06:43:26.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.162+0000 7fcc3dffb640 10 client.25967 handle_command_reply: tid=0 2024-09-19T06:43:26.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.162+0000 7fcc5f19b740 1 client.25967 shutdown 2024-09-19T06:43:26.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 1 -- 172.21.15.12:0/1040320479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e49b40 msgr2=0x563fa5e5bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e49b40 0x563fa5e5bb70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0059f0 tx=0x7fcc4c009b50 comp rx=0 tx=0).stop 2024-09-19T06:43:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 1 -- 172.21.15.12:0/1040320479 shutdown_connections 2024-09-19T06:43:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x563fa5edf3c0 0x563fa5ee17b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fa5e54760 0x563fa5e6abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fa5e53370 0x563fa5e6a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 1 --2- 172.21.15.12:0/1040320479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fa5e49b40 0x563fa5e5bb70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 1 -- 172.21.15.12:0/1040320479 >> 172.21.15.12:0/1040320479 conn(0x563fa5e11310 msgr2=0x563fa5e4e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc3dffb640 0 client.25967 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:43:26.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 1 -- 172.21.15.12:0/1040320479 shutdown_connections 2024-09-19T06:43:26.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 1 -- 172.21.15.12:0/1040320479 wait complete. 2024-09-19T06:43:26.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.165+0000 7fcc5f19b740 20 client.25967 trim_cache size 0 max 16384 2024-09-19T06:43:26.169 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:43:26.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/3597343194 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcc400a3470 msgr2=0x7fcc400a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcc400a3470 0x7fcc400a5930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcc500cd930 tx=0x7fcc500918a0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/3597343194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc58106a90 msgr2=0x7fcc581083b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc58106a90 0x7fcc581083b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000efd0 tx=0x7fcc5000c6a0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/3597343194 shutdown_connections 2024-09-19T06:43:26.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc58106a90 0x7fcc581083b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc58101430 0x7fcc58107e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcc400a3470 0x7fcc400a5930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 --2- 172.21.15.12:0/3597343194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc58100a90 0x7fcc58107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/3597343194 >> 172.21.15.12:0/3597343194 conn(0x7fcc580fc7d0 msgr2=0x7fcc580fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/3597343194 shutdown_connections 2024-09-19T06:43:26.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:26.169+0000 7fcc5cdc2640 1 -- 172.21.15.12:0/3597343194 wait complete. 2024-09-19T06:43:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:25 smithi016 ceph-mon[34911]: pgmap v101: 97 pgs: 97 active+clean; 2.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 740 op/s 2024-09-19T06:43:27.270 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:43:27.717 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:28.066 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:27 smithi012 ceph-mon[30937]: pgmap v102: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.14k op/s 2024-09-19T06:43:28.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:27 smithi173 ceph-mon[35349]: pgmap v102: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.14k op/s 2024-09-19T06:43:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:27 smithi016 ceph-mon[34911]: pgmap v102: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 15 MiB/s wr, 1.14k op/s 2024-09-19T06:43:28.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.332+0000 7fe780c4f640 1 -- 172.21.15.12:0/1013217648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c100e20 msgr2=0x7fe77c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:28.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.332+0000 7fe780c4f640 1 --2- 172.21.15.12:0/1013217648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c100e20 0x7fe77c101200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009930 tx=0x7fe76c02a4f0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.332+0000 7fe780c4f640 1 -- 172.21.15.12:0/1013217648 shutdown_connections 2024-09-19T06:43:28.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.332+0000 7fe780c4f640 1 --2- 172.21.15.12:0/1013217648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe77c102ef0 0x7fe77c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.332+0000 7fe780c4f640 1 --2- 172.21.15.12:0/1013217648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe77c102570 0x7fe77c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.332+0000 7fe780c4f640 1 --2- 172.21.15.12:0/1013217648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c100e20 0x7fe77c101200 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.332+0000 7fe780c4f640 1 -- 172.21.15.12:0/1013217648 >> 172.21.15.12:0/1013217648 conn(0x7fe77c0fc7d0 msgr2=0x7fe77c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:28.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.332+0000 7fe780c4f640 1 -- 172.21.15.12:0/1013217648 shutdown_connections 2024-09-19T06:43:28.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.332+0000 7fe780c4f640 1 -- 172.21.15.12:0/1013217648 wait complete. 2024-09-19T06:43:28.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.334+0000 7fe780c4f640 1 Processor -- start 2024-09-19T06:43:28.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.334+0000 7fe780c4f640 1 -- start start 2024-09-19T06:43:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.334+0000 7fe780c4f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe77c100e20 0x7fe77c19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.334+0000 7fe780c4f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe77c102570 0x7fe77c19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe77c100e20 0x7fe77c19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe77c100e20 0x7fe77c19a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41012/0 (socket says 172.21.15.12:41012) 2024-09-19T06:43:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe780c4f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c102ef0 0x7fe77c19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe77a59c640 1 -- 172.21.15.12:0/2686009085 learned_addr learned my addr 172.21.15.12:0/2686009085 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c114280 con 0x7fe77c102570 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c114100 con 0x7fe77c102ef0 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c114400 con 0x7fe77c100e20 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe77ad9d640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c102ef0 0x7fe77c19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe779d9b640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe77c102570 0x7fe77c19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe77ad9d640 1 -- 172.21.15.12:0/2686009085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe77c100e20 msgr2=0x7fe77c19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe77ad9d640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe77c100e20 0x7fe77c19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe77ad9d640 1 -- 172.21.15.12:0/2686009085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe77c102570 msgr2=0x7fe77c19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe77ad9d640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe77c102570 0x7fe77c19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.335+0000 7fe77ad9d640 1 -- 172.21.15.12:0/2686009085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77c19f6d0 con 0x7fe77c102ef0 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.336+0000 7fe77ad9d640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c102ef0 0x7fe77c19eff0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe774009fd0 tx=0x7fe77400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.336+0000 7fe76b7fe640 1 -- 172.21.15.12:0/2686009085 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77400ce20 con 0x7fe77c102ef0 2024-09-19T06:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.336+0000 7fe76b7fe640 1 -- 172.21.15.12:0/2686009085 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe774005020 con 0x7fe77c102ef0 2024-09-19T06:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.336+0000 7fe76b7fe640 1 -- 172.21.15.12:0/2686009085 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774010720 con 0x7fe77c102ef0 2024-09-19T06:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.336+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77c19f9c0 con 0x7fe77c102ef0 2024-09-19T06:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.336+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe77c10e630 con 0x7fe77c102ef0 2024-09-19T06:43:28.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.340+0000 7fe783028740 1 Processor -- start 2024-09-19T06:43:28.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.341+0000 7fe783028740 1 -- start start 2024-09-19T06:43:28.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.341+0000 7fe783028740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 0x563534751090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.341+0000 7fe783028740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 0x563534751a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.341+0000 7fe783028740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x56353475e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.341+0000 7fe783028740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5635346b72f0 con 0x563534752b40 2024-09-19T06:43:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.341+0000 7fe783028740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56353465ecf0 con 0x56353475c370 2024-09-19T06:43:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.341+0000 7fe783028740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5635346b32b0 con 0x5635347515d0 2024-09-19T06:43:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.342+0000 7fe76b7fe640 1 -- 172.21.15.12:0/2686009085 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe774005540 con 0x7fe77c102ef0 2024-09-19T06:43:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.342+0000 7fe779d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x56353475e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.342+0000 7fe779d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x56353475e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41474/0 (socket says 172.21.15.12:41474) 2024-09-19T06:43:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.342+0000 7fe779d9b640 1 -- 172.21.15.12:0/3314188546 learned_addr learned my addr 172.21.15.12:0/3314188546 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.342+0000 7fe77a59c640 1 --2- 172.21.15.12:0/3314188546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 0x563534751a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.342+0000 7fe779d9b640 1 --2- 172.21.15.12:0/3314188546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 0x563534751090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.343+0000 7fe77a59c640 1 -- 172.21.15.12:0/3314188546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 msgr2=0x56353475e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.343+0000 7fe77a59c640 1 --2- 172.21.15.12:0/3314188546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x56353475e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.343+0000 7fe77a59c640 1 -- 172.21.15.12:0/3314188546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 msgr2=0x563534751090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.343+0000 7fe77a59c640 1 --2- 172.21.15.12:0/3314188546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 0x563534751090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.343+0000 7fe77a59c640 1 -- 172.21.15.12:0/3314188546 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635346433a0 con 0x5635347515d0 2024-09-19T06:43:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.344+0000 7fe76b7fe640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe7640a35c0 0x7fe7640a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.344+0000 7fe76b7fe640 1 -- 172.21.15.12:0/2686009085 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fe7740d04b0 con 0x7fe77c102ef0 2024-09-19T06:43:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.345+0000 7fe779d9b640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe7640a35c0 0x7fe7640a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.345+0000 7fe77a59c640 1 --2- 172.21.15.12:0/3314188546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 0x563534751a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe76c006010 tx=0x7fe76c005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7af87f2634e73b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:28.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.346+0000 7fe768ff9640 1 -- 172.21.15.12:0/3314188546 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0046c0 con 0x5635347515d0 2024-09-19T06:43:28.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.346+0000 7fe768ff9640 1 -- 172.21.15.12:0/3314188546 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe76c0054e0 con 0x5635347515d0 2024-09-19T06:43:28.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.346+0000 7fe768ff9640 1 -- 172.21.15.12:0/3314188546 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c031a60 con 0x5635347515d0 2024-09-19T06:43:28.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.347+0000 7fe783028740 1 -- 172.21.15.12:0/3314188546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 msgr2=0x563534751a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:28.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.347+0000 7fe783028740 1 --2- 172.21.15.12:0/3314188546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 0x563534751a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe76c006010 tx=0x7fe76c005be0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.347+0000 7fe779d9b640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe7640a35c0 0x7fe7640a5a80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x563534752070 tx=0x7fe770005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:28.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.347+0000 7fe783028740 1 -- 172.21.15.12:0/3314188546 shutdown_connections 2024-09-19T06:43:28.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.347+0000 7fe783028740 1 --2- 172.21.15.12:0/3314188546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x56353475e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.347+0000 7fe783028740 1 --2- 172.21.15.12:0/3314188546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 0x563534751a10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.347+0000 7fe783028740 1 --2- 172.21.15.12:0/3314188546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 0x563534751090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.347+0000 7fe783028740 1 -- 172.21.15.12:0/3314188546 >> 172.21.15.12:0/3314188546 conn(0x56353471a310 msgr2=0x56353474dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:28.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.347+0000 7fe783028740 1 -- 172.21.15.12:0/3314188546 shutdown_connections 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.348+0000 7fe783028740 1 -- 172.21.15.12:0/3314188546 wait complete. 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.348+0000 7fe783028740 1 -- start start 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.348+0000 7fe783028740 1 Processor -- start 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe783028740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635347515d0 0x56353475bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe783028740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x563534759030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe783028740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353475c370 0x563534759640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe783028740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563534770020 con 0x56353475c370 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe783028740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563534672060 con 0x5635347515d0 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe783028740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5635347701a0 con 0x563534752b40 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe779d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x563534759030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635347515d0 0x56353475bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe779d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x563534759030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41024/0 (socket says 172.21.15.12:41024) 2024-09-19T06:43:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe779d9b640 1 -- 172.21.15.12:0/2250895374 learned_addr learned my addr 172.21.15.12:0/2250895374 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe77ad9d640 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353475c370 0x563534759640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe783028740 10 client.0 _ll_register_callbacks cb 0x5635343c58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:28.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe779d9b640 1 -- 172.21.15.12:0/2250895374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635347515d0 msgr2=0x56353475bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe779d9b640 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635347515d0 0x56353475bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe779d9b640 1 -- 172.21.15.12:0/2250895374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353475c370 msgr2=0x563534759640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe779d9b640 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353475c370 0x563534759640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.349+0000 7fe779d9b640 1 -- 172.21.15.12:0/2250895374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635344283c0 con 0x563534752b40 2024-09-19T06:43:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.350+0000 7fe779d9b640 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x563534759030 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe770012db0 tx=0x7fe770004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c6fd2a7d1213829 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.350+0000 7fe761ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:43:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.351+0000 7fe761ffb640 1 -- 172.21.15.12:0/2250895374 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770004300 con 0x563534752b40 2024-09-19T06:43:28.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.351+0000 7fe761ffb640 1 -- 172.21.15.12:0/2250895374 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fe77001b070 con 0x563534752b40 2024-09-19T06:43:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.351+0000 7fe783028740 1 -- 172.21.15.12:0/2250895374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe76c0054e0 con 0x563534752b40 2024-09-19T06:43:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.352+0000 7fe761ffb640 1 -- 172.21.15.12:0/2250895374 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe7700044a0 con 0x563534752b40 2024-09-19T06:43:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.352+0000 7fe783028740 10 client.25981 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:28.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.352+0000 7fe783028740 1 -- 172.21.15.12:0/2250895374 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56353477bb50 con 0x563534752b40 2024-09-19T06:43:28.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.354+0000 7fe761ffb640 1 -- 172.21.15.12:0/2250895374 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe76c0054e0 con 0x563534752b40 2024-09-19T06:43:28.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.354+0000 7fe761ffb640 1 -- 172.21.15.12:0/2250895374 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fe770003c80 con 0x563534752b40 2024-09-19T06:43:28.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.354+0000 7fe783028740 10 client.25981 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:28.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.354+0000 7fe783028740 10 client.25981 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:43:28.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.354+0000 7fe783028740 20 client.25981 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:28.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.354+0000 7fe783028740 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56353477d010 0x56353477f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.354+0000 7fe783028740 4 client.25981 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:28.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.354+0000 7fe783028740 1 -- 172.21.15.12:0/2250895374 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635346c4860 con 0x56353477d010 2024-09-19T06:43:28.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.354+0000 7fe77a59c640 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56353477d010 0x56353477f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.355+0000 7fe77a59c640 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56353477d010 0x56353477f420 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fca057d713520a0 server_cookie=f711c9f2857f472a in_seq=0 out_seq=0 2024-09-19T06:43:28.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.355+0000 7fe761ffb640 10 client.25981 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:43:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.356+0000 7fe761ffb640 1 -- 172.21.15.12:0/2250895374 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635346c4860 con 0x56353477d010 2024-09-19T06:43:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.356+0000 7fe761ffb640 10 client.25981 handle_command_reply: tid=0 2024-09-19T06:43:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.356+0000 7fe783028740 1 client.25981 shutdown 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe783028740 1 -- 172.21.15.12:0/2250895374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 msgr2=0x563534759030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe783028740 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x563534759030 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe770012db0 tx=0x7fe770004730 comp rx=0 tx=0).stop 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe783028740 1 -- 172.21.15.12:0/2250895374 shutdown_connections 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe783028740 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56353477d010 0x56353477f420 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe783028740 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56353475c370 0x563534759640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe783028740 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x563534759030 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe783028740 1 --2- 172.21.15.12:0/2250895374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635347515d0 0x56353475bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe783028740 1 -- 172.21.15.12:0/2250895374 >> 172.21.15.12:0/2250895374 conn(0x56353471a310 msgr2=0x563534753960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe761ffb640 0 client.25981 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe783028740 1 -- 172.21.15.12:0/2250895374 shutdown_connections 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.357+0000 7fe783028740 1 -- 172.21.15.12:0/2250895374 wait complete. 2024-09-19T06:43:28.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.358+0000 7fe783028740 20 client.25981 trim_cache size 0 max 16384 2024-09-19T06:43:28.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.383+0000 7fe783028740 1 Processor -- start 2024-09-19T06:43:28.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.383+0000 7fe783028740 1 -- start start 2024-09-19T06:43:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe783028740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635347515d0 0x563534759000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe783028740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x5635347792c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe783028740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x563534784cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe783028740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1ab940 con 0x5635347515d0 2024-09-19T06:43:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe783028740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1ad570 con 0x56353475c370 2024-09-19T06:43:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe783028740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1ac010 con 0x563534752b40 2024-09-19T06:43:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635347515d0 0x563534759000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe779d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x5635347792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635347515d0 0x563534759000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53484/0 (socket says 172.21.15.12:53484) 2024-09-19T06:43:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe77a59c640 1 -- 172.21.15.12:0/3742047383 learned_addr learned my addr 172.21.15.12:0/3742047383 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.384+0000 7fe77ad9d640 1 --2- 172.21.15.12:0/3742047383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x563534784cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.385+0000 7fe779d9b640 1 -- 172.21.15.12:0/3742047383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 msgr2=0x563534784cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.385+0000 7fe779d9b640 1 --2- 172.21.15.12:0/3742047383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x563534784cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.385+0000 7fe779d9b640 1 -- 172.21.15.12:0/3742047383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635347515d0 msgr2=0x563534759000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.385+0000 7fe779d9b640 1 --2- 172.21.15.12:0/3742047383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635347515d0 0x563534759000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.385+0000 7fe779d9b640 1 -- 172.21.15.12:0/3742047383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563534752300 con 0x563534752b40 2024-09-19T06:43:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.385+0000 7fe779d9b640 1 --2- 172.21.15.12:0/3742047383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x5635347792c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe77002a650 tx=0x7fe770009b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1879c535634fffe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.385+0000 7fe763fff640 1 -- 172.21.15.12:0/3742047383 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770038070 con 0x563534752b40 2024-09-19T06:43:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.385+0000 7fe763fff640 1 -- 172.21.15.12:0/3742047383 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe770021e00 con 0x563534752b40 2024-09-19T06:43:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.385+0000 7fe763fff640 1 -- 172.21.15.12:0/3742047383 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770016040 con 0x563534752b40 2024-09-19T06:43:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.386+0000 7fe783028740 1 -- 172.21.15.12:0/3742047383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 msgr2=0x5635347792c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.386+0000 7fe783028740 1 --2- 172.21.15.12:0/3742047383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x5635347792c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe77002a650 tx=0x7fe770009b40 comp rx=0 tx=0).stop 2024-09-19T06:43:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.386+0000 7fe783028740 1 -- 172.21.15.12:0/3742047383 shutdown_connections 2024-09-19T06:43:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.386+0000 7fe783028740 1 --2- 172.21.15.12:0/3742047383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x563534784cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.386+0000 7fe783028740 1 --2- 172.21.15.12:0/3742047383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563534752b40 0x5635347792c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.386+0000 7fe783028740 1 --2- 172.21.15.12:0/3742047383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635347515d0 0x563534759000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.386+0000 7fe783028740 1 -- 172.21.15.12:0/3742047383 >> 172.21.15.12:0/3742047383 conn(0x56353471a310 msgr2=0x5635347588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.387+0000 7fe783028740 1 -- 172.21.15.12:0/3742047383 shutdown_connections 2024-09-19T06:43:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.387+0000 7fe783028740 1 -- 172.21.15.12:0/3742047383 wait complete. 2024-09-19T06:43:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.387+0000 7fe783028740 1 -- start start 2024-09-19T06:43:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.387+0000 7fe783028740 1 Processor -- start 2024-09-19T06:43:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.388+0000 7fe783028740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 0x563534775c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.388+0000 7fe783028740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 0x563534755df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.388+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 0x563534775c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 0x563534775c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41038/0 (socket says 172.21.15.12:41038) 2024-09-19T06:43:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe783028740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x563534756370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe783028740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1acde0 con 0x563534752b40 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe779d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 0x563534755df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe783028740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1ac710 con 0x56353475c370 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe783028740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1a9920 con 0x5635347515d0 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe779d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 0x563534755df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53488/0 (socket says 172.21.15.12:53488) 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe779d9b640 1 -- 172.21.15.12:0/3030337260 learned_addr learned my addr 172.21.15.12:0/3030337260 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe783028740 10 client.0 _ll_register_callbacks cb 0x7fe770009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe779d9b640 1 -- 172.21.15.12:0/3030337260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 msgr2=0x563534775c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe779d9b640 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 0x563534775c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe779d9b640 1 -- 172.21.15.12:0/3030337260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 msgr2=0x563534756370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe779d9b640 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x563534756370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.389+0000 7fe779d9b640 1 -- 172.21.15.12:0/3030337260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563534756ba0 con 0x563534752b40 2024-09-19T06:43:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.390+0000 7fe779d9b640 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 0x563534755df0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe77002a6a0 tx=0x7fe770021ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f725a00db1cb3db2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.390+0000 7fe761ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.390+0000 7fe761ffb640 1 -- 172.21.15.12:0/3030337260 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770041060 con 0x563534752b40 2024-09-19T06:43:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.391+0000 7fe761ffb640 1 -- 172.21.15.12:0/3030337260 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fe770003a00 con 0x563534752b40 2024-09-19T06:43:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.391+0000 7fe783028740 1 -- 172.21.15.12:0/3030337260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe770021e00 con 0x563534752b40 2024-09-19T06:43:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.393+0000 7fe761ffb640 1 -- 172.21.15.12:0/3030337260 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe770038070 con 0x563534752b40 2024-09-19T06:43:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.393+0000 7fe783028740 10 client.16422 fetch_fsmap learned FSMap version 31 2024-09-19T06:43:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.393+0000 7fe783028740 1 -- 172.21.15.12:0/3030337260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5635347e7d60 con 0x563534752b40 2024-09-19T06:43:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.393+0000 7fe761ffb640 1 -- 172.21.15.12:0/3030337260 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe770021e00 con 0x563534752b40 2024-09-19T06:43:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.394+0000 7fe761ffb640 1 -- 172.21.15.12:0/3030337260 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7fe77003c930 con 0x563534752b40 2024-09-19T06:43:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.394+0000 7fe783028740 10 client.16422 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T06:43:28.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.394+0000 7fe783028740 10 client.16422 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:43:28.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.394+0000 7fe783028740 20 client.16422 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:28.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.394+0000 7fe783028740 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5635347e8340 0x5635347ea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:28.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.394+0000 7fe783028740 4 client.16422 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:43:28.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.394+0000 7fe783028740 1 -- 172.21.15.12:0/3030337260 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5635346bed70 con 0x5635347e8340 2024-09-19T06:43:28.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.394+0000 7fe77a59c640 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5635347e8340 0x5635347ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.395+0000 7fe77a59c640 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5635347e8340 0x5635347ea760 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7018327248d0e7d3 server_cookie=7cbeb3c1251dc2a3 in_seq=0 out_seq=0 2024-09-19T06:43:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.395+0000 7fe761ffb640 10 client.16422 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.395+0000 7fe761ffb640 1 -- 172.21.15.12:0/3030337260 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5635346bed70 con 0x5635347e8340 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.395+0000 7fe761ffb640 10 client.16422 handle_command_reply: tid=0 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.395+0000 7fe783028740 1 client.16422 shutdown 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.395+0000 7fe783028740 1 -- 172.21.15.12:0/3030337260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 msgr2=0x563534755df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.395+0000 7fe783028740 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 0x563534755df0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe77002a6a0 tx=0x7fe770021ce0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.396+0000 7fe783028740 1 -- 172.21.15.12:0/3030337260 shutdown_connections 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.396+0000 7fe783028740 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5635347e8340 0x5635347ea760 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.396+0000 7fe783028740 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56353475c370 0x563534756370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.396+0000 7fe783028740 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563534752b40 0x563534755df0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.396+0000 7fe783028740 1 --2- 172.21.15.12:0/3030337260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635347515d0 0x563534775c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.396+0000 7fe783028740 1 -- 172.21.15.12:0/3030337260 >> 172.21.15.12:0/3030337260 conn(0x56353471a310 msgr2=0x56353475a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.396+0000 7fe761ffb640 0 client.16422 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:43:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.396+0000 7fe783028740 1 -- 172.21.15.12:0/3030337260 shutdown_connections 2024-09-19T06:43:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.396+0000 7fe783028740 1 -- 172.21.15.12:0/3030337260 wait complete. 2024-09-19T06:43:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.396+0000 7fe783028740 20 client.16422 trim_cache size 0 max 16384 2024-09-19T06:43:28.399 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:43:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.397+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe7640a35c0 msgr2=0x7fe7640a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.397+0000 7fe780c4f640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe7640a35c0 0x7fe7640a5a80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x563534752070 tx=0x7fe770005f90 comp rx=0 tx=0).stop 2024-09-19T06:43:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.397+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c102ef0 msgr2=0x7fe77c19eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.397+0000 7fe780c4f640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c102ef0 0x7fe77c19eff0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe774009fd0 tx=0x7fe77400ef10 comp rx=0 tx=0).stop 2024-09-19T06:43:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.397+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 shutdown_connections 2024-09-19T06:43:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.397+0000 7fe780c4f640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c102ef0 0x7fe77c19eff0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.397+0000 7fe780c4f640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe77c102570 0x7fe77c19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.397+0000 7fe780c4f640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe7640a35c0 0x7fe7640a5a80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.397+0000 7fe780c4f640 1 --2- 172.21.15.12:0/2686009085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe77c100e20 0x7fe77c19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.397+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 >> 172.21.15.12:0/2686009085 conn(0x7fe77c0fc7d0 msgr2=0x7fe77c104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.398+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 shutdown_connections 2024-09-19T06:43:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:28.398+0000 7fe780c4f640 1 -- 172.21.15.12:0/2686009085 wait complete. 2024-09-19T06:43:29.425 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:43:29.795 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:30.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:29 smithi173 ceph-mon[35349]: pgmap v103: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.9 MiB/s wr, 782 op/s 2024-09-19T06:43:30.090 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:29 smithi012 ceph-mon[30937]: pgmap v103: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.9 MiB/s wr, 782 op/s 2024-09-19T06:43:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:29 smithi016 ceph-mon[34911]: pgmap v103: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.9 MiB/s wr, 782 op/s 2024-09-19T06:43:30.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.580+0000 7f13f1d9b640 1 -- 172.21.15.12:0/667196442 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec02c040 con 0x7f13f4112b90 2024-09-19T06:43:30.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.581+0000 7f13f9170640 1 -- 172.21.15.12:0/667196442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13f4112b90 msgr2=0x7f13f4114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:30.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.581+0000 7f13f9170640 1 --2- 172.21.15.12:0/667196442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13f4112b90 0x7f13f4114f80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009ca0 tx=0x7f13ec02a950 comp rx=0 tx=0).stop 2024-09-19T06:43:30.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.581+0000 7f13f9170640 1 -- 172.21.15.12:0/667196442 shutdown_connections 2024-09-19T06:43:30.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.581+0000 7f13f9170640 1 --2- 172.21.15.12:0/667196442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13f4112b90 0x7f13f4114f80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.581+0000 7f13f9170640 1 --2- 172.21.15.12:0/667196442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13f4074eb0 0x7f13f4112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.581+0000 7f13f9170640 1 --2- 172.21.15.12:0/667196442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13f4074590 0x7f13f4074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.581+0000 7f13f9170640 1 -- 172.21.15.12:0/667196442 >> 172.21.15.12:0/667196442 conn(0x7f13f40fd8e0 msgr2=0x7f13f40ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:30.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.581+0000 7f13f9170640 1 -- 172.21.15.12:0/667196442 shutdown_connections 2024-09-19T06:43:30.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.581+0000 7f13f9170640 1 -- 172.21.15.12:0/667196442 wait complete. 2024-09-19T06:43:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.582+0000 7f13f9170640 1 Processor -- start 2024-09-19T06:43:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f9170640 1 -- start start 2024-09-19T06:43:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f9170640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13f4074590 0x7f13f41a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f9170640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13f4074eb0 0x7f13f41a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f9170640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13f4112b90 0x7f13f419e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f9170640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41185a0 con 0x7f13f4074eb0 2024-09-19T06:43:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f9170640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13f4118420 con 0x7f13f4074590 2024-09-19T06:43:30.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f9170640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f13f4118720 con 0x7f13f4112b90 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13f4074590 0x7f13f41a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13f4074590 0x7f13f41a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58150/0 (socket says 172.21.15.12:58150) 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f2d9d640 1 -- 172.21.15.12:0/2605179535 learned_addr learned my addr 172.21.15.12:0/2605179535 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f359e640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13f4112b90 0x7f13f419e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.583+0000 7f13f259c640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13f4074eb0 0x7f13f41a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.584+0000 7f13f2d9d640 1 -- 172.21.15.12:0/2605179535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13f4112b90 msgr2=0x7f13f419e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.584+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13f4112b90 0x7f13f419e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.584+0000 7f13f2d9d640 1 -- 172.21.15.12:0/2605179535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13f4074eb0 msgr2=0x7f13f41a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.584+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13f4074eb0 0x7f13f41a4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.584+0000 7f13f2d9d640 1 -- 172.21.15.12:0/2605179535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f419ef00 con 0x7f13f4074590 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.584+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13f4074590 0x7f13f41a45c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00d950 tx=0x7f13dc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.585+0000 7f13ebfff640 1 -- 172.21.15.12:0/2605179535 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc017030 con 0x7f13f4074590 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.585+0000 7f13ebfff640 1 -- 172.21.15.12:0/2605179535 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13dc004020 con 0x7f13f4074590 2024-09-19T06:43:30.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.585+0000 7f13f9170640 1 -- 172.21.15.12:0/2605179535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f419f1f0 con 0x7f13f4074590 2024-09-19T06:43:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.585+0000 7f13ebfff640 1 -- 172.21.15.12:0/2605179535 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0047a0 con 0x7f13f4074590 2024-09-19T06:43:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.585+0000 7f13f9170640 1 -- 172.21.15.12:0/2605179535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f41ab540 con 0x7f13f4074590 2024-09-19T06:43:30.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.588+0000 7f13ebfff640 1 -- 172.21.15.12:0/2605179535 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f13dc0041d0 con 0x7f13f4074590 2024-09-19T06:43:30.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.589+0000 7f13fb549740 1 Processor -- start 2024-09-19T06:43:30.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.589+0000 7f13fb549740 1 -- start start 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.589+0000 7f13fb549740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285941090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.589+0000 7f13fb549740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 0x55a285941a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.589+0000 7f13fb549740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.589+0000 7f13fb549740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a2858a72f0 con 0x55a28594c370 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.589+0000 7f13fb549740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a28584ecf0 con 0x55a2859415d0 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.589+0000 7f13fb549740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a2858a32b0 con 0x55a285942b40 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.590+0000 7f13f259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.590+0000 7f13f359e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285941090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.590+0000 7f13f259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59224/0 (socket says 172.21.15.12:59224) 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.590+0000 7f13f259c640 1 -- 172.21.15.12:0/3167580171 learned_addr learned my addr 172.21.15.12:0/3167580171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.590+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/3167580171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 0x55a285941a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.591+0000 7f13ebfff640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13e00a3430 0x7f13e00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.592+0000 7f13ebfff640 1 -- 172.21.15.12:0/2605179535 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f13dc0cf660 con 0x7f13f4074590 2024-09-19T06:43:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.592+0000 7f13f259c640 1 -- 172.21.15.12:0/3167580171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 msgr2=0x55a285941090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.592+0000 7f13f259c640 1 --2- 172.21.15.12:0/3167580171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285941090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.592+0000 7f13f259c640 1 -- 172.21.15.12:0/3167580171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 msgr2=0x55a285941a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.592+0000 7f13f259c640 1 --2- 172.21.15.12:0/3167580171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 0x55a285941a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.592+0000 7f13f259c640 1 -- 172.21.15.12:0/3167580171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2858333a0 con 0x55a28594c370 2024-09-19T06:43:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.592+0000 7f13f359e640 1 --2- 172.21.15.12:0/3167580171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285941090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.592+0000 7f13f259c640 1 --2- 172.21.15.12:0/3167580171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594e760 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009c10 tx=0x7f13e4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b5fe7cafd9075a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:30.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.592+0000 7f13f359e640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13e00a3430 0x7f13e00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.593+0000 7f13f359e640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13e00a3430 0x7f13e00a58f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13ec004af0 tx=0x7f13ec03c040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:30.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.593+0000 7f13e97fa640 1 -- 172.21.15.12:0/3167580171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4004230 con 0x55a28594c370 2024-09-19T06:43:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.593+0000 7f13e97fa640 1 -- 172.21.15.12:0/3167580171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13e40043d0 con 0x55a28594c370 2024-09-19T06:43:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.593+0000 7f13e97fa640 1 -- 172.21.15.12:0/3167580171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4019710 con 0x55a28594c370 2024-09-19T06:43:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.594+0000 7f13fb549740 1 -- 172.21.15.12:0/3167580171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 msgr2=0x55a28594e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.594+0000 7f13fb549740 1 --2- 172.21.15.12:0/3167580171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594e760 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009c10 tx=0x7f13e4011810 comp rx=0 tx=0).stop 2024-09-19T06:43:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.594+0000 7f13fb549740 1 -- 172.21.15.12:0/3167580171 shutdown_connections 2024-09-19T06:43:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.594+0000 7f13fb549740 1 --2- 172.21.15.12:0/3167580171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594e760 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.594+0000 7f13fb549740 1 --2- 172.21.15.12:0/3167580171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 0x55a285941a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.594+0000 7f13fb549740 1 --2- 172.21.15.12:0/3167580171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285941090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.594+0000 7f13fb549740 1 -- 172.21.15.12:0/3167580171 >> 172.21.15.12:0/3167580171 conn(0x55a28590a310 msgr2=0x55a28593dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.594+0000 7f13fb549740 1 -- 172.21.15.12:0/3167580171 shutdown_connections 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.594+0000 7f13fb549740 1 -- 172.21.15.12:0/3167580171 wait complete. 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.595+0000 7f13fb549740 1 -- start start 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.595+0000 7f13fb549740 1 Processor -- start 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.595+0000 7f13fb549740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 0x55a28594bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.595+0000 7f13fb549740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285949030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.595+0000 7f13fb549740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a285949640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.595+0000 7f13fb549740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a28594f070 con 0x55a28594c370 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.595+0000 7f13fb549740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a285862060 con 0x55a2859415d0 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.595+0000 7f13fb549740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a28594f1f0 con 0x55a285942b40 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13fb549740 10 client.0 _ll_register_callbacks cb 0x55a2855b58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 0x55a28594bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 0x55a28594bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58166/0 (socket says 172.21.15.12:58166) 2024-09-19T06:43:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f2d9d640 1 -- 172.21.15.12:0/549467878 learned_addr learned my addr 172.21.15.12:0/549467878 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f2d9d640 1 -- 172.21.15.12:0/549467878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 msgr2=0x55a285949030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:43:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f359e640 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a285949640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285949030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f2d9d640 1 -- 172.21.15.12:0/549467878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 msgr2=0x55a285949640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a285949640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f2d9d640 1 -- 172.21.15.12:0/549467878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2856183c0 con 0x55a2859415d0 2024-09-19T06:43:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f359e640 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a285949640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 0x55a28594bd80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009610 tx=0x7f13dc09b4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7146ac18e88046aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.596+0000 7f13da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13da7fc640 1 -- 172.21.15.12:0/549467878 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc09b8c0 con 0x55a2859415d0 2024-09-19T06:43:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13fb549740 1 -- 172.21.15.12:0/549467878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13e40043d0 con 0x55a2859415d0 2024-09-19T06:43:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13da7fc640 1 -- 172.21.15.12:0/549467878 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f13dc084bc0 con 0x55a2859415d0 2024-09-19T06:43:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13da7fc640 1 -- 172.21.15.12:0/549467878 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f13dc09fc70 con 0x55a2859415d0 2024-09-19T06:43:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13fb549740 10 client.25994 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13fb549740 1 -- 172.21.15.12:0/549467878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a28595ab90 con 0x55a2859415d0 2024-09-19T06:43:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13da7fc640 1 -- 172.21.15.12:0/549467878 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13e40043d0 con 0x55a2859415d0 2024-09-19T06:43:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13da7fc640 1 -- 172.21.15.12:0/549467878 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f13dc09ad10 con 0x55a2859415d0 2024-09-19T06:43:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13fb549740 10 client.25994 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13fb549740 10 client.25994 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13fb549740 20 client.25994 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13fb549740 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a28595c530 0x55a28595e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13fb549740 4 client.25994 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.597+0000 7f13fb549740 1 -- 172.21.15.12:0/549467878 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2858b4860 con 0x55a28595c530 2024-09-19T06:43:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.598+0000 7f13f259c640 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a28595c530 0x55a28595e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.598+0000 7f13da7fc640 10 client.25994 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.598+0000 7f13f259c640 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a28595c530 0x55a28595e9f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2bfa1eedb4532b1 server_cookie=d3f7ec75a3ade461 in_seq=0 out_seq=0 2024-09-19T06:43:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.599+0000 7f13da7fc640 1 -- 172.21.15.12:0/549467878 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2858b4860 con 0x55a28595c530 2024-09-19T06:43:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.599+0000 7f13da7fc640 10 client.25994 handle_command_reply: tid=0 2024-09-19T06:43:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.599+0000 7f13fb549740 1 client.25994 shutdown 2024-09-19T06:43:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.599+0000 7f13fb549740 1 -- 172.21.15.12:0/549467878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 msgr2=0x55a28594bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.599+0000 7f13fb549740 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 0x55a28594bd80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009610 tx=0x7f13dc09b4c0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.600+0000 7f13fb549740 1 -- 172.21.15.12:0/549467878 shutdown_connections 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.600+0000 7f13fb549740 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a28595c530 0x55a28595e9f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.600+0000 7f13fb549740 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a285949640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.600+0000 7f13fb549740 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285949030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.600+0000 7f13fb549740 1 --2- 172.21.15.12:0/549467878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a2859415d0 0x55a28594bd80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.600+0000 7f13fb549740 1 -- 172.21.15.12:0/549467878 >> 172.21.15.12:0/549467878 conn(0x55a28590a310 msgr2=0x55a285943960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.600+0000 7f13da7fc640 0 client.25994 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.601+0000 7f13fb549740 1 -- 172.21.15.12:0/549467878 shutdown_connections 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.601+0000 7f13fb549740 1 -- 172.21.15.12:0/549467878 wait complete. 2024-09-19T06:43:30.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.601+0000 7f13fb549740 20 client.25994 trim_cache size 0 max 16384 2024-09-19T06:43:30.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.625+0000 7f13fb549740 1 Processor -- start 2024-09-19T06:43:30.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.625+0000 7f13fb549740 1 -- start start 2024-09-19T06:43:30.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.625+0000 7f13fb549740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a2859415d0 0x55a285958310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13fb549740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a285942b40 0x55a28594d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13fb549740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13fb549740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b40f0 con 0x55a28594c370 2024-09-19T06:43:30.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13fb549740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b5cf0 con 0x55a285942b40 2024-09-19T06:43:30.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13fb549740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b47c0 con 0x55a2859415d0 2024-09-19T06:43:30.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59242/0 (socket says 172.21.15.12:59242) 2024-09-19T06:43:30.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f359e640 1 -- 172.21.15.12:0/3465784555 learned_addr learned my addr 172.21.15.12:0/3465784555 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:30.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f259c640 1 --2- 172.21.15.12:0/3465784555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a285942b40 0x55a28594d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/3465784555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a2859415d0 0x55a285958310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f359e640 1 -- 172.21.15.12:0/3465784555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a2859415d0 msgr2=0x55a285958310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:30.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f359e640 1 --2- 172.21.15.12:0/3465784555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a2859415d0 0x55a285958310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f359e640 1 -- 172.21.15.12:0/3465784555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a285942b40 msgr2=0x55a28594d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:30.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f359e640 1 --2- 172.21.15.12:0/3465784555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a285942b40 0x55a28594d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f359e640 1 -- 172.21.15.12:0/3465784555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a28593e960 con 0x55a28594c370 2024-09-19T06:43:30.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.626+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/3465784555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a2859415d0 0x55a285958310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:30.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.627+0000 7f13f359e640 1 --2- 172.21.15.12:0/3465784555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594dca0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f13f4076600 tx=0x7f13ec044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb7c7a0d647cbc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:30.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.628+0000 7f13e8ff9640 1 -- 172.21.15.12:0/3465784555 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec055070 con 0x55a28594c370 2024-09-19T06:43:30.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.628+0000 7f13e8ff9640 1 -- 172.21.15.12:0/3465784555 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13ec02fe90 con 0x55a28594c370 2024-09-19T06:43:30.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.628+0000 7f13e8ff9640 1 -- 172.21.15.12:0/3465784555 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec034040 con 0x55a28594c370 2024-09-19T06:43:30.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.629+0000 7f13fb549740 1 -- 172.21.15.12:0/3465784555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 msgr2=0x55a28594dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:30.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.629+0000 7f13fb549740 1 --2- 172.21.15.12:0/3465784555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594dca0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f13f4076600 tx=0x7f13ec044000 comp rx=0 tx=0).stop 2024-09-19T06:43:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.629+0000 7f13fb549740 1 -- 172.21.15.12:0/3465784555 shutdown_connections 2024-09-19T06:43:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.629+0000 7f13fb549740 1 --2- 172.21.15.12:0/3465784555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a28594c370 0x55a28594dca0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.629+0000 7f13fb549740 1 --2- 172.21.15.12:0/3465784555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a285942b40 0x55a28594d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.629+0000 7f13fb549740 1 --2- 172.21.15.12:0/3465784555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a2859415d0 0x55a285958310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.629+0000 7f13fb549740 1 -- 172.21.15.12:0/3465784555 >> 172.21.15.12:0/3465784555 conn(0x55a28590a310 msgr2=0x55a2859442c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.629+0000 7f13fb549740 1 -- 172.21.15.12:0/3465784555 shutdown_connections 2024-09-19T06:43:30.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.630+0000 7f13fb549740 1 -- 172.21.15.12:0/3465784555 wait complete. 2024-09-19T06:43:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.630+0000 7f13fb549740 1 -- start start 2024-09-19T06:43:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.630+0000 7f13fb549740 1 Processor -- start 2024-09-19T06:43:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.630+0000 7f13fb549740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2859415d0 0x55a285963890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13fb549740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285963dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13fb549740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a28594c370 0x55a285953480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13fb549740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b5560 con 0x55a2859415d0 2024-09-19T06:43:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13fb549740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b4e90 con 0x55a28594c370 2024-09-19T06:43:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13fb549740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f13f41b20d0 con 0x55a285942b40 2024-09-19T06:43:30.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13fb549740 10 client.0 _ll_register_callbacks cb 0x7f13dc09b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a28594c370 0x55a285953480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a28594c370 0x55a285953480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58182/0 (socket says 172.21.15.12:58182) 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f359e640 1 -- 172.21.15.12:0/680588193 learned_addr learned my addr 172.21.15.12:0/680588193 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f259c640 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285963dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2859415d0 0x55a285963890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f359e640 1 -- 172.21.15.12:0/680588193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 msgr2=0x55a285963dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f359e640 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285963dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f359e640 1 -- 172.21.15.12:0/680588193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2859415d0 msgr2=0x55a285963890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f359e640 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2859415d0 0x55a285963890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f359e640 1 -- 172.21.15.12:0/680588193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2859539c0 con 0x55a28594c370 2024-09-19T06:43:30.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.631+0000 7f13f259c640 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285963dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:30.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.632+0000 7f13f359e640 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a28594c370 0x55a285953480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f13ec02f8e0 tx=0x7f13ec003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7d2ac60f11f4761 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:30.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.632+0000 7f13da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.632+0000 7f13da7fc640 1 -- 172.21.15.12:0/680588193 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec055070 con 0x55a28594c370 2024-09-19T06:43:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.632+0000 7f13da7fc640 1 -- 172.21.15.12:0/680588193 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f13ec03a8b0 con 0x55a28594c370 2024-09-19T06:43:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.632+0000 7f13fb549740 1 -- 172.21.15.12:0/680588193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13ec02fe90 con 0x55a28594c370 2024-09-19T06:43:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.633+0000 7f13da7fc640 1 -- 172.21.15.12:0/680588193 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f13ec067050 con 0x55a28594c370 2024-09-19T06:43:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.633+0000 7f13fb549740 10 client.26000 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.633+0000 7f13fb549740 1 -- 172.21.15.12:0/680588193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a285954c80 con 0x55a28594c370 2024-09-19T06:43:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.633+0000 7f13da7fc640 1 -- 172.21.15.12:0/680588193 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13ec02fe90 con 0x55a28594c370 2024-09-19T06:43:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.633+0000 7f13da7fc640 1 -- 172.21.15.12:0/680588193 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f13ec062030 con 0x55a28594c370 2024-09-19T06:43:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.634+0000 7f13fb549740 10 client.26000 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.634+0000 7f13fb549740 10 client.26000 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.634+0000 7f13fb549740 20 client.26000 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.634+0000 7f13fb549740 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a2859c73e0 0x55a2859c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.634+0000 7f13fb549740 4 client.26000 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:43:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.634+0000 7f13fb549740 1 -- 172.21.15.12:0/680588193 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2858aed70 con 0x55a2859c73e0 2024-09-19T06:43:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.634+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a2859c73e0 0x55a2859c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.635+0000 7f13da7fc640 10 client.26000 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.635+0000 7f13f2d9d640 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a2859c73e0 0x55a2859c9800 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1138670ed70acaa7 server_cookie=dbc55ddd8618ec72 in_seq=0 out_seq=0 2024-09-19T06:43:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.635+0000 7f13da7fc640 1 -- 172.21.15.12:0/680588193 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2858aed70 con 0x55a2859c73e0 2024-09-19T06:43:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.635+0000 7f13da7fc640 10 client.26000 handle_command_reply: tid=0 2024-09-19T06:43:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.635+0000 7f13fb549740 1 client.26000 shutdown 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.635+0000 7f13fb549740 1 -- 172.21.15.12:0/680588193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a28594c370 msgr2=0x55a285953480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.635+0000 7f13fb549740 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a28594c370 0x55a285953480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f13ec02f8e0 tx=0x7f13ec003ba0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.635+0000 7f13fb549740 1 -- 172.21.15.12:0/680588193 shutdown_connections 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.635+0000 7f13fb549740 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a2859c73e0 0x55a2859c9800 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.636+0000 7f13fb549740 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a28594c370 0x55a285953480 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.636+0000 7f13da7fc640 0 client.26000 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.636+0000 7f13fb549740 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a285942b40 0x55a285963dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.636+0000 7f13fb549740 1 --2- 172.21.15.12:0/680588193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2859415d0 0x55a285963890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.636+0000 7f13fb549740 1 -- 172.21.15.12:0/680588193 >> 172.21.15.12:0/680588193 conn(0x55a28590a310 msgr2=0x55a285947880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.636+0000 7f13fb549740 1 -- 172.21.15.12:0/680588193 shutdown_connections 2024-09-19T06:43:30.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.636+0000 7f13fb549740 1 -- 172.21.15.12:0/680588193 wait complete. 2024-09-19T06:43:30.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.636+0000 7f13fb549740 20 client.26000 trim_cache size 0 max 16384 2024-09-19T06:43:30.642 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:43:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 -- 172.21.15.12:0/2605179535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13e00a3430 msgr2=0x7f13e00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13e00a3430 0x7f13e00a58f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13ec004af0 tx=0x7f13ec03c040 comp rx=0 tx=0).stop 2024-09-19T06:43:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 -- 172.21.15.12:0/2605179535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13f4074590 msgr2=0x7f13f41a45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13f4074590 0x7f13f41a45c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00d950 tx=0x7f13dc00de10 comp rx=0 tx=0).stop 2024-09-19T06:43:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 -- 172.21.15.12:0/2605179535 shutdown_connections 2024-09-19T06:43:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13e00a3430 0x7f13e00a58f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13f4112b90 0x7f13f419e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13f4074eb0 0x7f13f41a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 --2- 172.21.15.12:0/2605179535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13f4074590 0x7f13f41a45c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 -- 172.21.15.12:0/2605179535 >> 172.21.15.12:0/2605179535 conn(0x7f13f40fd8e0 msgr2=0x7f13f40fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 -- 172.21.15.12:0/2605179535 shutdown_connections 2024-09-19T06:43:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:30.638+0000 7f13f9170640 1 -- 172.21.15.12:0/2605179535 wait complete. 2024-09-19T06:43:30.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 165.0 s, 4000.8 tps, lat 24.954 ms stddev 28.658 2024-09-19T06:43:31.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:30 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:43:31.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:30 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:43:31.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:30 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:43:32.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:31 smithi173 ceph-mon[35349]: pgmap v104: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 1.14k op/s 2024-09-19T06:43:32.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:31 smithi012 ceph-mon[30937]: pgmap v104: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 1.14k op/s 2024-09-19T06:43:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:31 smithi016 ceph-mon[34911]: pgmap v104: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 1.14k op/s 2024-09-19T06:43:32.504 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:43:32.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:43:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:33.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.570+0000 7f70bca93640 1 -- 172.21.15.12:0/2927918771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b8074eb0 msgr2=0x7f70b8112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:33.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.570+0000 7f70bca93640 1 --2- 172.21.15.12:0/2927918771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b8074eb0 0x7f70b8112650 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009900 tx=0x7f70a802a4a0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.570+0000 7f70bca93640 1 -- 172.21.15.12:0/2927918771 shutdown_connections 2024-09-19T06:43:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.570+0000 7f70bca93640 1 --2- 172.21.15.12:0/2927918771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b8112b90 0x7f70b8114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.570+0000 7f70bca93640 1 --2- 172.21.15.12:0/2927918771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b8074eb0 0x7f70b8112650 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.570+0000 7f70bca93640 1 --2- 172.21.15.12:0/2927918771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70b8074590 0x7f70b8074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.570+0000 7f70bca93640 1 -- 172.21.15.12:0/2927918771 >> 172.21.15.12:0/2927918771 conn(0x7f70b80fd880 msgr2=0x7f70b80ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.570+0000 7f70bca93640 1 -- 172.21.15.12:0/2927918771 shutdown_connections 2024-09-19T06:43:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.570+0000 7f70bca93640 1 -- 172.21.15.12:0/2927918771 wait complete. 2024-09-19T06:43:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.571+0000 7f70bca93640 1 Processor -- start 2024-09-19T06:43:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.572+0000 7f70bca93640 1 -- start start 2024-09-19T06:43:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.572+0000 7f70bca93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b8074590 0x7f70b8112050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.572+0000 7f70bca93640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70b8074eb0 0x7f70b8112590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.572+0000 7f70bca93640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b8112b90 0x7f70b810b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.572+0000 7f70bca93640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f70b8118620 con 0x7f70b8074590 2024-09-19T06:43:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70bca93640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f70b81184a0 con 0x7f70b8074eb0 2024-09-19T06:43:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70bca93640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f70b81187a0 con 0x7f70b8112b90 2024-09-19T06:43:33.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70b5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70b8074eb0 0x7f70b8112590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70b5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70b8074eb0 0x7f70b8112590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58200/0 (socket says 172.21.15.12:58200) 2024-09-19T06:43:33.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70b5d9b640 1 -- 172.21.15.12:0/1597440498 learned_addr learned my addr 172.21.15.12:0/1597440498 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:33.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70b6d9d640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b8112b90 0x7f70b810b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70b659c640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b8074590 0x7f70b8112050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70b5d9b640 1 -- 172.21.15.12:0/1597440498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b8112b90 msgr2=0x7f70b810b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:33.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b8112b90 0x7f70b810b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70b5d9b640 1 -- 172.21.15.12:0/1597440498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b8074590 msgr2=0x7f70b8112050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:33.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b8074590 0x7f70b8112050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.573+0000 7f70b5d9b640 1 -- 172.21.15.12:0/1597440498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b810bac0 con 0x7f70b8074eb0 2024-09-19T06:43:33.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.574+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70b8074eb0 0x7f70b8112590 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f70a8006010 tx=0x7f70a8003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:33.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.574+0000 7f70a77fe640 1 -- 172.21.15.12:0/1597440498 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a803f070 con 0x7f70b8074eb0 2024-09-19T06:43:33.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.574+0000 7f70a77fe640 1 -- 172.21.15.12:0/1597440498 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a8031c90 con 0x7f70b8074eb0 2024-09-19T06:43:33.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.574+0000 7f70a77fe640 1 -- 172.21.15.12:0/1597440498 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8035030 con 0x7f70b8074eb0 2024-09-19T06:43:33.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.574+0000 7f70bca93640 1 -- 172.21.15.12:0/1597440498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b810bd50 con 0x7f70b8074eb0 2024-09-19T06:43:33.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.574+0000 7f70bca93640 1 -- 172.21.15.12:0/1597440498 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b810fd50 con 0x7f70b8074eb0 2024-09-19T06:43:33.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.578+0000 7f70bee6c740 1 Processor -- start 2024-09-19T06:43:33.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.578+0000 7f70a77fe640 1 -- 172.21.15.12:0/1597440498 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f70a8042070 con 0x7f70b8074eb0 2024-09-19T06:43:33.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70bee6c740 1 -- start start 2024-09-19T06:43:33.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d271b60 0x55ad8d271f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 0x55ad8d27c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d27f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70bee6c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ad8d1d7280 con 0x55ad8d272480 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70bee6c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ad8d17eb10 con 0x55ad8d27cd40 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70bee6c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ad8d1d3240 con 0x55ad8d271b60 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70b6d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d271b60 0x55ad8d271f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70b5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d27f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70b659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 0x55ad8d27c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70b6d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d271b60 0x55ad8d271f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49776/0 (socket says 172.21.15.12:49776) 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70b659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 0x55ad8d27c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59276/0 (socket says 172.21.15.12:59276) 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.579+0000 7f70b6d9d640 1 -- 172.21.15.12:0/727546030 learned_addr learned my addr 172.21.15.12:0/727546030 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.580+0000 7f70b6d9d640 1 -- 172.21.15.12:0/727546030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 msgr2=0x55ad8d27f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.580+0000 7f70b6d9d640 1 --2- 172.21.15.12:0/727546030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d27f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.580+0000 7f70b6d9d640 1 -- 172.21.15.12:0/727546030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 msgr2=0x55ad8d27c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:33.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.580+0000 7f70b6d9d640 1 --2- 172.21.15.12:0/727546030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 0x55ad8d27c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.580+0000 7f70b6d9d640 1 -- 172.21.15.12:0/727546030 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad8d18b1f0 con 0x55ad8d271b60 2024-09-19T06:43:33.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.580+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/727546030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d27f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:33.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.580+0000 7f70a77fe640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f70a00a3500 0x7f70a00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.580+0000 7f70b6d9d640 1 --2- 172.21.15.12:0/727546030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d271b60 0x55ad8d271f40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f70b000a400 tx=0x7f70b0009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92afb886523a8c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:33.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.580+0000 7f70a77fe640 1 -- 172.21.15.12:0/1597440498 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f70a80f0880 con 0x7f70b8074eb0 2024-09-19T06:43:33.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.580+0000 7f70b659c640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f70a00a3500 0x7f70a00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.581+0000 7f70a4ff9640 1 -- 172.21.15.12:0/727546030 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0013790 con 0x55ad8d271b60 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.581+0000 7f70a4ff9640 1 -- 172.21.15.12:0/727546030 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70b0019070 con 0x55ad8d271b60 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.581+0000 7f70a4ff9640 1 -- 172.21.15.12:0/727546030 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0014de0 con 0x55ad8d271b60 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 -- 172.21.15.12:0/727546030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d271b60 msgr2=0x55ad8d271f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 --2- 172.21.15.12:0/727546030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d271b60 0x55ad8d271f40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f70b000a400 tx=0x7f70b0009650 comp rx=0 tx=0).stop 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70b659c640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f70a00a3500 0x7f70a00a59c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55ad8d26ef50 tx=0x7f70ac00a2d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 -- 172.21.15.12:0/727546030 shutdown_connections 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 --2- 172.21.15.12:0/727546030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d27f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 --2- 172.21.15.12:0/727546030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 0x55ad8d27c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 --2- 172.21.15.12:0/727546030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d271b60 0x55ad8d271f40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 -- 172.21.15.12:0/727546030 >> 172.21.15.12:0/727546030 conn(0x55ad8d26e0f0 msgr2=0x55ad8d26e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 -- 172.21.15.12:0/727546030 shutdown_connections 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 -- 172.21.15.12:0/727546030 wait complete. 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 -- start start 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.582+0000 7f70bee6c740 1 Processor -- start 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d271b60 0x55ad8d279cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d27a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d27a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70bee6c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ad8d27f910 con 0x55ad8d271b60 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70bee6c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ad8d191f10 con 0x55ad8d27cd40 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70bee6c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ad8d27fa90 con 0x55ad8d272480 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70b5d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d27a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70b5d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d27a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49792/0 (socket says 172.21.15.12:49792) 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70b5d9b640 1 -- 172.21.15.12:0/162752373 learned_addr learned my addr 172.21.15.12:0/162752373 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70bee6c740 10 client.0 _ll_register_callbacks cb 0x55ad8d15aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70b6d9d640 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d27a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70b5d9b640 1 -- 172.21.15.12:0/162752373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 msgr2=0x55ad8d27a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.583+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d27a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.584+0000 7f70b5d9b640 1 -- 172.21.15.12:0/162752373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d271b60 msgr2=0x55ad8d279cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:43:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.584+0000 7f70b659c640 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d271b60 0x55ad8d279cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.584+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d271b60 0x55ad8d279cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.584+0000 7f70b5d9b640 1 -- 172.21.15.12:0/162752373 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad8cf486a0 con 0x55ad8d272480 2024-09-19T06:43:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.584+0000 7f70bee6c740 1 -- 172.21.15.12:0/162752373 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70b0019070 con 0x55ad8d272480 2024-09-19T06:43:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.584+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d27a230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70a8003fd0 tx=0x7f70a8005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47778260d044614c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:33.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.584+0000 7f709dffb640 10 client.26011 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:43:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.584+0000 7f709dffb640 1 -- 172.21.15.12:0/162752373 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8049040 con 0x55ad8d272480 2024-09-19T06:43:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.584+0000 7f709dffb640 1 -- 172.21.15.12:0/162752373 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f70a80ee170 con 0x55ad8d272480 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.585+0000 7f709dffb640 1 -- 172.21.15.12:0/162752373 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f70a80f3e60 con 0x55ad8d272480 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.585+0000 7f70bee6c740 10 client.26011 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.585+0000 7f70bee6c740 1 -- 172.21.15.12:0/162752373 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=32}) -- 0x55ad8d27f910 con 0x55ad8d272480 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.585+0000 7f709dffb640 1 -- 172.21.15.12:0/162752373 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f70a80bcce0 con 0x55ad8d272480 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.585+0000 7f70bee6c740 10 client.26011 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.585+0000 7f70bee6c740 10 client.26011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.585+0000 7f70bee6c740 20 client.26011 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.585+0000 7f70bee6c740 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ad8d28c910 0x55ad8d28ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.585+0000 7f70bee6c740 4 client.26011 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.585+0000 7f70bee6c740 1 -- 172.21.15.12:0/162752373 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad8d1e47f0 con 0x55ad8d28c910 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.586+0000 7f70b659c640 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ad8d28c910 0x55ad8d28ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.587+0000 7f70b659c640 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ad8d28c910 0x55ad8d28ed50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b28add5c2b6cd4ec server_cookie=9859a656ea0b01f7 in_seq=0 out_seq=0 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f709dffb640 10 client.26011 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f709dffb640 1 -- 172.21.15.12:0/162752373 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad8d1e47f0 con 0x55ad8d28c910 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f709dffb640 10 client.26011 handle_command_reply: tid=0 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f70bee6c740 1 client.26011 shutdown 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f70bee6c740 1 -- 172.21.15.12:0/162752373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 msgr2=0x55ad8d27a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f70bee6c740 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d27a230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70a8003fd0 tx=0x7f70a8005d50 comp rx=0 tx=0).stop 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f70bee6c740 1 -- 172.21.15.12:0/162752373 shutdown_connections 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f70bee6c740 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ad8d28c910 0x55ad8d28ed50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f70bee6c740 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d27a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f70bee6c740 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d27a230 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.588+0000 7f70bee6c740 1 --2- 172.21.15.12:0/162752373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d271b60 0x55ad8d279cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.589+0000 7f70bee6c740 1 -- 172.21.15.12:0/162752373 >> 172.21.15.12:0/162752373 conn(0x55ad8d26e0f0 msgr2=0x55ad8d273e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.589+0000 7f709dffb640 0 client.26011 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.589+0000 7f70bee6c740 1 -- 172.21.15.12:0/162752373 shutdown_connections 2024-09-19T06:43:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.589+0000 7f70bee6c740 1 -- 172.21.15.12:0/162752373 wait complete. 2024-09-19T06:43:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.589+0000 7f70bee6c740 20 client.26011 trim_cache size 0 max 16384 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.618+0000 7f70bee6c740 1 Processor -- start 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.618+0000 7f70bee6c740 1 -- start start 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.618+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d271b60 0x55ad8d273d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.618+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 0x55ad8d294620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70b659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d271b60 0x55ad8d273d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70b659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d271b60 0x55ad8d273d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58216/0 (socket says 172.21.15.12:58216) 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70b659c640 1 -- 172.21.15.12:0/3136710437 learned_addr learned my addr 172.21.15.12:0/3136710437 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/3136710437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 0x55ad8d294620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70bee6c740 1 --2- 172.21.15.12:0/3136710437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d27cd40 0x55ad8d294b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70bee6c740 1 -- 172.21.15.12:0/3136710437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f70b81bc850 con 0x55ad8d272480 2024-09-19T06:43:33.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70bee6c740 1 -- 172.21.15.12:0/3136710437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f70b81be450 con 0x55ad8d271b60 2024-09-19T06:43:33.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70bee6c740 1 -- 172.21.15.12:0/3136710437 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f70b81bcf20 con 0x55ad8d27cd40 2024-09-19T06:43:33.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70b6d9d640 1 --2- 172.21.15.12:0/3136710437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d27cd40 0x55ad8d294b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70b659c640 1 -- 172.21.15.12:0/3136710437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d27cd40 msgr2=0x55ad8d294b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:33.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70b659c640 1 --2- 172.21.15.12:0/3136710437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d27cd40 0x55ad8d294b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70b659c640 1 -- 172.21.15.12:0/3136710437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 msgr2=0x55ad8d294620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:33.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70b659c640 1 --2- 172.21.15.12:0/3136710437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 0x55ad8d294620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.619+0000 7f70b659c640 1 -- 172.21.15.12:0/3136710437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad8d278ca0 con 0x55ad8d271b60 2024-09-19T06:43:33.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.620+0000 7f70b659c640 1 --2- 172.21.15.12:0/3136710437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d271b60 0x55ad8d273d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00a7e0 tx=0x7f70ac017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d458a3143d160bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.620+0000 7f709ffff640 1 -- 172.21.15.12:0/3136710437 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac01bbd0 con 0x55ad8d271b60 2024-09-19T06:43:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.620+0000 7f709ffff640 1 -- 172.21.15.12:0/3136710437 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70ac01bd70 con 0x55ad8d271b60 2024-09-19T06:43:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.620+0000 7f709ffff640 1 -- 172.21.15.12:0/3136710437 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac027420 con 0x55ad8d271b60 2024-09-19T06:43:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.621+0000 7f70bee6c740 1 -- 172.21.15.12:0/3136710437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d271b60 msgr2=0x55ad8d273d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.621+0000 7f70bee6c740 1 --2- 172.21.15.12:0/3136710437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d271b60 0x55ad8d273d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00a7e0 tx=0x7f70ac017000 comp rx=0 tx=0).stop 2024-09-19T06:43:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.621+0000 7f70bee6c740 1 -- 172.21.15.12:0/3136710437 shutdown_connections 2024-09-19T06:43:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.621+0000 7f70bee6c740 1 --2- 172.21.15.12:0/3136710437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d27cd40 0x55ad8d294b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.621+0000 7f70bee6c740 1 --2- 172.21.15.12:0/3136710437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d272480 0x55ad8d294620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.621+0000 7f70bee6c740 1 --2- 172.21.15.12:0/3136710437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d271b60 0x55ad8d273d10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.621+0000 7f70bee6c740 1 -- 172.21.15.12:0/3136710437 >> 172.21.15.12:0/3136710437 conn(0x55ad8d26e0f0 msgr2=0x55ad8d273600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.621+0000 7f70bee6c740 1 -- 172.21.15.12:0/3136710437 shutdown_connections 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.621+0000 7f70bee6c740 1 -- 172.21.15.12:0/3136710437 wait complete. 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.622+0000 7f70bee6c740 1 -- start start 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.622+0000 7f70bee6c740 1 Processor -- start 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.622+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d271b60 0x55ad8d281590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.622+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d281ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.622+0000 7f70bee6c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d284b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.622+0000 7f70bee6c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f70b81bdcc0 con 0x55ad8d271b60 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.622+0000 7f70bee6c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f70b81bd5f0 con 0x55ad8d27cd40 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.622+0000 7f70bee6c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f70b81ba830 con 0x55ad8d272480 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.622+0000 7f70bee6c740 10 client.0 _ll_register_callbacks cb 0x7f70a8005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b5d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d281ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b5d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d281ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49812/0 (socket says 172.21.15.12:49812) 2024-09-19T06:43:33.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b5d9b640 1 -- 172.21.15.12:0/150860588 learned_addr learned my addr 172.21.15.12:0/150860588 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:33.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b6d9d640 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d284b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b659c640 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d271b60 0x55ad8d281590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b5d9b640 1 -- 172.21.15.12:0/150860588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 msgr2=0x55ad8d284b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d284b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b5d9b640 1 -- 172.21.15.12:0/150860588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d271b60 msgr2=0x55ad8d281590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d271b60 0x55ad8d281590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b5d9b640 1 -- 172.21.15.12:0/150860588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad8d269830 con 0x55ad8d272480 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f70b5d9b640 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d281ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f70a80bad30 tx=0x7f70a80f2cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deb1aa00c95d1c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.623+0000 7f709dffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.624+0000 7f709dffb640 1 -- 172.21.15.12:0/150860588 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8049040 con 0x55ad8d272480 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.624+0000 7f709dffb640 1 -- 172.21.15.12:0/150860588 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f70a80db250 con 0x55ad8d272480 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.625+0000 7f70bee6c740 1 -- 172.21.15.12:0/150860588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70ac01bd70 con 0x55ad8d272480 2024-09-19T06:43:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.625+0000 7f709dffb640 1 -- 172.21.15.12:0/150860588 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f70a80ee370 con 0x55ad8d272480 2024-09-19T06:43:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.625+0000 7f70bee6c740 10 client.26017 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.625+0000 7f70bee6c740 1 -- 172.21.15.12:0/150860588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ad8d309050 con 0x55ad8d272480 2024-09-19T06:43:33.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.625+0000 7f709dffb640 1 -- 172.21.15.12:0/150860588 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70b0019070 con 0x55ad8d272480 2024-09-19T06:43:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.626+0000 7f709dffb640 1 -- 172.21.15.12:0/150860588 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f70a80c5260 con 0x55ad8d272480 2024-09-19T06:43:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.626+0000 7f70bee6c740 10 client.26017 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.626+0000 7f70bee6c740 10 client.26017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.626+0000 7f70bee6c740 20 client.26017 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.626+0000 7f70bee6c740 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ad8d309610 0x55ad8d30ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.627+0000 7f70bee6c740 4 client.26017 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:43:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.627+0000 7f70bee6c740 1 -- 172.21.15.12:0/150860588 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f70ac01bd70 con 0x55ad8d309610 2024-09-19T06:43:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.627+0000 7f70b659c640 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ad8d309610 0x55ad8d30ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.627+0000 7f709dffb640 10 client.26017 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:33.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.627+0000 7f70b659c640 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ad8d309610 0x55ad8d30ba30 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=146512699da3a591 server_cookie=2d922b6078739d70 in_seq=0 out_seq=0 2024-09-19T06:43:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.628+0000 7f709dffb640 1 -- 172.21.15.12:0/150860588 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f70ac01bd70 con 0x55ad8d309610 2024-09-19T06:43:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.628+0000 7f709dffb640 10 client.26017 handle_command_reply: tid=0 2024-09-19T06:43:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.628+0000 7f70bee6c740 1 client.26017 shutdown 2024-09-19T06:43:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.628+0000 7f70bee6c740 1 -- 172.21.15.12:0/150860588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 msgr2=0x55ad8d281ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.628+0000 7f70bee6c740 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d281ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f70a80bad30 tx=0x7f70a80f2cd0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.629+0000 7f70bee6c740 1 -- 172.21.15.12:0/150860588 shutdown_connections 2024-09-19T06:43:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.629+0000 7f70bee6c740 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ad8d309610 0x55ad8d30ba30 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.629+0000 7f70bee6c740 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ad8d27cd40 0x55ad8d284b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.629+0000 7f70bee6c740 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad8d272480 0x55ad8d281ad0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.629+0000 7f70bee6c740 1 --2- 172.21.15.12:0/150860588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad8d271b60 0x55ad8d281590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.629+0000 7f70bee6c740 1 -- 172.21.15.12:0/150860588 >> 172.21.15.12:0/150860588 conn(0x55ad8d26e0f0 msgr2=0x55ad8d27a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.629+0000 7f709dffb640 0 client.26017 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.629+0000 7f70bee6c740 1 -- 172.21.15.12:0/150860588 shutdown_connections 2024-09-19T06:43:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.629+0000 7f70bee6c740 1 -- 172.21.15.12:0/150860588 wait complete. 2024-09-19T06:43:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.629+0000 7f70bee6c740 20 client.26017 trim_cache size 0 max 16384 2024-09-19T06:43:33.633 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:43:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:43:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "0ff984da-78eb-46ad-b2a9-dbc4a789ea1e", 2024-09-19T06:43:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:43:33.633 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:43:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.630+0000 7f70bca93640 1 -- 172.21.15.12:0/1597440498 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f70a00a3500 msgr2=0x7f70a00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.630+0000 7f70bca93640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f70a00a3500 0x7f70a00a59c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55ad8d26ef50 tx=0x7f70ac00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.630+0000 7f70bca93640 1 -- 172.21.15.12:0/1597440498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70b8074eb0 msgr2=0x7f70b8112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.630+0000 7f70bca93640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70b8074eb0 0x7f70b8112590 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f70a8006010 tx=0x7f70a8003ba0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.630+0000 7f70bca93640 1 -- 172.21.15.12:0/1597440498 shutdown_connections 2024-09-19T06:43:33.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.630+0000 7f70bca93640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f70a00a3500 0x7f70a00a59c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.630+0000 7f70bca93640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b8112b90 0x7f70b810b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.631+0000 7f70bca93640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70b8074eb0 0x7f70b8112590 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.631+0000 7f70bca93640 1 --2- 172.21.15.12:0/1597440498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70b8074590 0x7f70b8112050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:33.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.631+0000 7f70bca93640 1 -- 172.21.15.12:0/1597440498 >> 172.21.15.12:0/1597440498 conn(0x7f70b80fd880 msgr2=0x7f70b80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:33.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.631+0000 7f70bca93640 1 -- 172.21.15.12:0/1597440498 shutdown_connections 2024-09-19T06:43:33.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:33.631+0000 7f70bca93640 1 -- 172.21.15.12:0/1597440498 wait complete. 2024-09-19T06:43:34.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:33 smithi173 ceph-mon[35349]: pgmap v105: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 757 op/s 2024-09-19T06:43:34.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:33 smithi012 ceph-mon[30937]: pgmap v105: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 757 op/s 2024-09-19T06:43:34.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:33 smithi016 ceph-mon[34911]: pgmap v105: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 757 op/s 2024-09-19T06:43:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:43:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:43:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:43:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:43:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:43:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:43:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:43:35.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:43:35.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:34 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.256 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:43:35.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:34 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:43:35.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:43:35.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:34 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:43:35.584 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T06:43:35.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:43:35.717 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 170.0 s, 4922.6 tps, lat 20.378 ms stddev 23.778 2024-09-19T06:43:36.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:35 smithi012 ceph-mon[30937]: pgmap v106: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 757 op/s 2024-09-19T06:43:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.091+0000 7f4d3b59e640 1 -- 172.21.15.12:0/199117116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d34004740 msgr2=0x7f4d34004b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.091+0000 7f4d3b59e640 1 --2- 172.21.15.12:0/199117116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d34004740 0x7f4d34004b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009930 tx=0x7f4d3002a440 comp rx=0 tx=0).stop 2024-09-19T06:43:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.091+0000 7f4d3b59e640 1 -- 172.21.15.12:0/199117116 shutdown_connections 2024-09-19T06:43:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.091+0000 7f4d3b59e640 1 --2- 172.21.15.12:0/199117116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d340050c0 0x7f4d340a2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.091+0000 7f4d3b59e640 1 --2- 172.21.15.12:0/199117116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d34004740 0x7f4d34004b80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.091+0000 7f4d3b59e640 1 --2- 172.21.15.12:0/199117116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d3409b660 0x7f4d3409ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.091+0000 7f4d3b59e640 1 -- 172.21.15.12:0/199117116 >> 172.21.15.12:0/199117116 conn(0x7f4d3400a1e0 msgr2=0x7f4d3400a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.091+0000 7f4d3b59e640 1 -- 172.21.15.12:0/199117116 shutdown_connections 2024-09-19T06:43:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.092+0000 7f4d3b59e640 1 -- 172.21.15.12:0/199117116 wait complete. 2024-09-19T06:43:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.092+0000 7f4d3b59e640 1 Processor -- start 2024-09-19T06:43:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.092+0000 7f4d3b59e640 1 -- start start 2024-09-19T06:43:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.093+0000 7f4d3b59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d34004740 0x7f4d3409f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.093+0000 7f4d3b59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d340050c0 0x7f4d3409fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.093+0000 7f4d3b59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3409b660 0x7f4d340a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.093+0000 7f4d3b59e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d340964c0 con 0x7f4d3409b660 2024-09-19T06:43:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.093+0000 7f4d3b59e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34096340 con 0x7f4d340050c0 2024-09-19T06:43:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.093+0000 7f4d3b59e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34096640 con 0x7f4d34004740 2024-09-19T06:43:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.093+0000 7f4d39d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d340050c0 0x7f4d3409fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.093+0000 7f4d39d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d340050c0 0x7f4d3409fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58252/0 (socket says 172.21.15.12:58252) 2024-09-19T06:43:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.093+0000 7f4d39d9b640 1 -- 172.21.15.12:0/2316093683 learned_addr learned my addr 172.21.15.12:0/2316093683 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.093+0000 7f4d3ad9d640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3409b660 0x7f4d340a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.094+0000 7f4d39d9b640 1 -- 172.21.15.12:0/2316093683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d34004740 msgr2=0x7f4d3409f5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:43:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.094+0000 7f4d39d9b640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d34004740 0x7f4d3409f5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.094+0000 7f4d39d9b640 1 -- 172.21.15.12:0/2316093683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3409b660 msgr2=0x7f4d340a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.094+0000 7f4d39d9b640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3409b660 0x7f4d340a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.094+0000 7f4d39d9b640 1 -- 172.21.15.12:0/2316093683 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3413e820 con 0x7f4d340050c0 2024-09-19T06:43:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.094+0000 7f4d39d9b640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d340050c0 0x7f4d3409fae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4d3002a960 tx=0x7f4d30003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.094+0000 7f4d2b7fe640 1 -- 172.21.15.12:0/2316093683 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3003f070 con 0x7f4d340050c0 2024-09-19T06:43:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.094+0000 7f4d2b7fe640 1 -- 172.21.15.12:0/2316093683 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d30003e40 con 0x7f4d340050c0 2024-09-19T06:43:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.094+0000 7f4d3b59e640 1 -- 172.21.15.12:0/2316093683 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3413eab0 con 0x7f4d340050c0 2024-09-19T06:43:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.095+0000 7f4d3b59e640 1 -- 172.21.15.12:0/2316093683 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3413ef70 con 0x7f4d340050c0 2024-09-19T06:43:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.095+0000 7f4d2b7fe640 1 -- 172.21.15.12:0/2316093683 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30035030 con 0x7f4d340050c0 2024-09-19T06:43:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.099+0000 7f4d4388f740 1 Processor -- start 2024-09-19T06:43:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.099+0000 7f4d2b7fe640 1 -- 172.21.15.12:0/2316093683 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4d30042070 con 0x7f4d340050c0 2024-09-19T06:43:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.099+0000 7f4d4388f740 1 -- start start 2024-09-19T06:43:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65ecc0 0x55653c65f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 0x55653c669940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 0x55653c66c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d4388f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55653c5c32f0 con 0x55653c65f5e0 2024-09-19T06:43:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d39d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 0x55653c66c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d3ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65ecc0 0x55653c65f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d3ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65ecc0 0x55653c65f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49840/0 (socket says 172.21.15.12:49840) 2024-09-19T06:43:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d3ad9d640 1 -- 172.21.15.12:0/1052697558 learned_addr learned my addr 172.21.15.12:0/1052697558 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d4388f740 1 -- 172.21.15.12:0/1052697558 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55653c56b270 con 0x55653c669e80 2024-09-19T06:43:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d4388f740 1 -- 172.21.15.12:0/1052697558 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55653c5bf2b0 con 0x55653c65ecc0 2024-09-19T06:43:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.100+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/1052697558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 0x55653c669940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.101+0000 7f4d3a59c640 1 -- 172.21.15.12:0/1052697558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65ecc0 msgr2=0x55653c65f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.101+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/1052697558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65ecc0 0x55653c65f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.102+0000 7f4d3a59c640 1 -- 172.21.15.12:0/1052697558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 msgr2=0x55653c66c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.102+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/1052697558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 0x55653c66c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.102+0000 7f4d3a59c640 1 -- 172.21.15.12:0/1052697558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653c56a340 con 0x55653c65f5e0 2024-09-19T06:43:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.102+0000 7f4d2b7fe640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d240a33c0 0x7f4d240a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.102+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/1052697558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 0x55653c669940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0096e0 tx=0x7f4d2c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded798f8bd9d180c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.102+0000 7f4d3ad9d640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d240a33c0 0x7f4d240a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.102+0000 7f4d2b7fe640 1 -- 172.21.15.12:0/2316093683 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4d300f0660 con 0x7f4d340050c0 2024-09-19T06:43:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.102+0000 7f4d28ff9640 1 -- 172.21.15.12:0/1052697558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c015020 con 0x55653c65f5e0 2024-09-19T06:43:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.102+0000 7f4d28ff9640 1 -- 172.21.15.12:0/1052697558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d2c00bda0 con 0x55653c65f5e0 2024-09-19T06:43:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.102+0000 7f4d28ff9640 1 -- 172.21.15.12:0/1052697558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c015020 con 0x55653c65f5e0 2024-09-19T06:43:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.104+0000 7f4d4388f740 1 -- 172.21.15.12:0/1052697558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 msgr2=0x55653c669940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.104+0000 7f4d4388f740 1 --2- 172.21.15.12:0/1052697558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 0x55653c669940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0096e0 tx=0x7f4d2c009ba0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.104+0000 7f4d3ad9d640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d240a33c0 0x7f4d240a5880 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c065a40 tx=0x7f4d3c06a040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.104+0000 7f4d4388f740 1 -- 172.21.15.12:0/1052697558 shutdown_connections 2024-09-19T06:43:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.104+0000 7f4d4388f740 1 --2- 172.21.15.12:0/1052697558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 0x55653c66c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.104+0000 7f4d4388f740 1 --2- 172.21.15.12:0/1052697558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 0x55653c669940 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.104+0000 7f4d4388f740 1 --2- 172.21.15.12:0/1052697558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65ecc0 0x55653c65f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.104+0000 7f4d4388f740 1 -- 172.21.15.12:0/1052697558 >> 172.21.15.12:0/1052697558 conn(0x55653c65b230 msgr2=0x55653c65b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.104+0000 7f4d4388f740 1 -- 172.21.15.12:0/1052697558 shutdown_connections 2024-09-19T06:43:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.104+0000 7f4d4388f740 1 -- 172.21.15.12:0/1052697558 wait complete. 2024-09-19T06:43:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.105+0000 7f4d4388f740 1 -- start start 2024-09-19T06:43:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.105+0000 7f4d4388f740 1 Processor -- start 2024-09-19T06:43:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.105+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c666cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.105+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65f5e0 0x55653c667200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.105+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c669e80 0x55653c667740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.105+0000 7f4d4388f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55653c66ca50 con 0x55653c669e80 2024-09-19T06:43:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.105+0000 7f4d4388f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55653c54c290 con 0x55653c65ecc0 2024-09-19T06:43:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.105+0000 7f4d4388f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55653c66cbd0 con 0x55653c65f5e0 2024-09-19T06:43:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.106+0000 7f4d4388f740 10 client.0 _ll_register_callbacks cb 0x55653c57d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.106+0000 7f4d3a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c666cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.106+0000 7f4d3a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c666cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58274/0 (socket says 172.21.15.12:58274) 2024-09-19T06:43:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.106+0000 7f4d3a59c640 1 -- 172.21.15.12:0/471799404 learned_addr learned my addr 172.21.15.12:0/471799404 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.107+0000 7f4d3a59c640 1 -- 172.21.15.12:0/471799404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65f5e0 msgr2=0x55653c667200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:43:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.107+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65f5e0 0x55653c667200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.107+0000 7f4d3a59c640 1 -- 172.21.15.12:0/471799404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c669e80 msgr2=0x55653c667740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.107+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c669e80 0x55653c667740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.107+0000 7f4d3a59c640 1 -- 172.21.15.12:0/471799404 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653c2d6210 con 0x55653c65ecc0 2024-09-19T06:43:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.107+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c666cc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c011700 tx=0x7f4d2c011730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74c853e944da7e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.107+0000 7f4d21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.107+0000 7f4d21ffb640 1 -- 172.21.15.12:0/471799404 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c015020 con 0x55653c65ecc0 2024-09-19T06:43:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.108+0000 7f4d4388f740 1 -- 172.21.15.12:0/471799404 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d2c00bda0 con 0x55653c65ecc0 2024-09-19T06:43:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.108+0000 7f4d21ffb640 1 -- 172.21.15.12:0/471799404 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4d2c00bad0 con 0x55653c65ecc0 2024-09-19T06:43:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.109+0000 7f4d21ffb640 1 -- 172.21.15.12:0/471799404 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4d2c011820 con 0x55653c65ecc0 2024-09-19T06:43:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.109+0000 7f4d4388f740 10 client.26027 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.109+0000 7f4d4388f740 1 -- 172.21.15.12:0/471799404 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55653c3a2620 con 0x55653c65ecc0 2024-09-19T06:43:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.110+0000 7f4d21ffb640 1 -- 172.21.15.12:0/471799404 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d2c00bda0 con 0x55653c65ecc0 2024-09-19T06:43:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.110+0000 7f4d21ffb640 1 -- 172.21.15.12:0/471799404 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f4d2c01b5c0 con 0x55653c65ecc0 2024-09-19T06:43:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.110+0000 7f4d4388f740 10 client.26027 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.110+0000 7f4d4388f740 10 client.26027 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.110+0000 7f4d4388f740 20 client.26027 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.110+0000 7f4d4388f740 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653c67a1e0 0x55653c67c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.110+0000 7f4d4388f740 4 client.26027 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.110+0000 7f4d4388f740 1 -- 172.21.15.12:0/471799404 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55653c5d0a20 con 0x55653c67a1e0 2024-09-19T06:43:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.110+0000 7f4d39d9b640 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653c67a1e0 0x55653c67c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.111+0000 7f4d39d9b640 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653c67a1e0 0x55653c67c6a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a450661fa3825957 server_cookie=8b2dccae2afc8e9a in_seq=0 out_seq=0 2024-09-19T06:43:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.111+0000 7f4d21ffb640 10 client.26027 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.112+0000 7f4d21ffb640 1 -- 172.21.15.12:0/471799404 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55653c5d0a20 con 0x55653c67a1e0 2024-09-19T06:43:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.112+0000 7f4d21ffb640 10 client.26027 handle_command_reply: tid=0 2024-09-19T06:43:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.112+0000 7f4d4388f740 1 client.26027 shutdown 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.113+0000 7f4d4388f740 1 -- 172.21.15.12:0/471799404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 msgr2=0x55653c666cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.113+0000 7f4d4388f740 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c666cc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c011700 tx=0x7f4d2c011730 comp rx=0 tx=0).stop 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.113+0000 7f4d4388f740 1 -- 172.21.15.12:0/471799404 shutdown_connections 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.113+0000 7f4d4388f740 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653c67a1e0 0x55653c67c6a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.114+0000 7f4d4388f740 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c669e80 0x55653c667740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.114+0000 7f4d4388f740 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65f5e0 0x55653c667200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.114+0000 7f4d4388f740 1 --2- 172.21.15.12:0/471799404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c666cc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.114+0000 7f4d4388f740 1 -- 172.21.15.12:0/471799404 >> 172.21.15.12:0/471799404 conn(0x55653c65b230 msgr2=0x55653c660f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.114+0000 7f4d21ffb640 0 client.26027 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.114+0000 7f4d4388f740 1 -- 172.21.15.12:0/471799404 shutdown_connections 2024-09-19T06:43:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.114+0000 7f4d4388f740 1 -- 172.21.15.12:0/471799404 wait complete. 2024-09-19T06:43:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.114+0000 7f4d4388f740 20 client.26027 trim_cache size 0 max 16384 2024-09-19T06:43:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.151+0000 7f4d4388f740 1 Processor -- start 2024-09-19T06:43:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.152+0000 7f4d4388f740 1 -- start start 2024-09-19T06:43:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.154+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65ecc0 0x55653c665590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.154+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65f5e0 0x55653c65a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.154+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 0x55653c667570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.155+0000 7f4d39d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65f5e0 0x55653c65a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.155+0000 7f4d39d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65f5e0 0x55653c65a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49862/0 (socket says 172.21.15.12:49862) 2024-09-19T06:43:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.155+0000 7f4d39d9b640 1 -- 172.21.15.12:0/2345847022 learned_addr learned my addr 172.21.15.12:0/2345847022 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.155+0000 7f4d3ad9d640 1 --2- 172.21.15.12:0/2345847022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 0x55653c667570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.155+0000 7f4d4388f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34147c10 con 0x55653c65ecc0 2024-09-19T06:43:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.155+0000 7f4d4388f740 1 -- 172.21.15.12:0/2345847022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34149810 con 0x55653c669e80 2024-09-19T06:43:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.155+0000 7f4d4388f740 1 -- 172.21.15.12:0/2345847022 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341482e0 con 0x55653c65f5e0 2024-09-19T06:43:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.155+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/2345847022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65ecc0 0x55653c665590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.156+0000 7f4d3ad9d640 1 -- 172.21.15.12:0/2345847022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65f5e0 msgr2=0x55653c65a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.156+0000 7f4d3ad9d640 1 --2- 172.21.15.12:0/2345847022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65f5e0 0x55653c65a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.156+0000 7f4d3ad9d640 1 -- 172.21.15.12:0/2345847022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65ecc0 msgr2=0x55653c665590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.156+0000 7f4d3ad9d640 1 --2- 172.21.15.12:0/2345847022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65ecc0 0x55653c665590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.156+0000 7f4d3ad9d640 1 -- 172.21.15.12:0/2345847022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653c665c70 con 0x55653c669e80 2024-09-19T06:43:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.156+0000 7f4d3ad9d640 1 --2- 172.21.15.12:0/2345847022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 0x55653c667570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c050d60 tx=0x7f4d3c068340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=179b53ca4ec731e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.156+0000 7f4d23fff640 1 -- 172.21.15.12:0/2345847022 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c089460 con 0x55653c669e80 2024-09-19T06:43:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.157+0000 7f4d23fff640 1 -- 172.21.15.12:0/2345847022 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d3c089ae0 con 0x55653c669e80 2024-09-19T06:43:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.157+0000 7f4d23fff640 1 -- 172.21.15.12:0/2345847022 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c074ac0 con 0x55653c669e80 2024-09-19T06:43:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.158+0000 7f4d4388f740 1 -- 172.21.15.12:0/2345847022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 msgr2=0x55653c667570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.158+0000 7f4d4388f740 1 --2- 172.21.15.12:0/2345847022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 0x55653c667570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c050d60 tx=0x7f4d3c068340 comp rx=0 tx=0).stop 2024-09-19T06:43:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.158+0000 7f4d4388f740 1 -- 172.21.15.12:0/2345847022 shutdown_connections 2024-09-19T06:43:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.158+0000 7f4d4388f740 1 --2- 172.21.15.12:0/2345847022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c669e80 0x55653c667570 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.158+0000 7f4d4388f740 1 --2- 172.21.15.12:0/2345847022 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c65f5e0 0x55653c65a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.158+0000 7f4d4388f740 1 --2- 172.21.15.12:0/2345847022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65ecc0 0x55653c665590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.158+0000 7f4d4388f740 1 -- 172.21.15.12:0/2345847022 >> 172.21.15.12:0/2345847022 conn(0x55653c65b230 msgr2=0x55653c659a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.158+0000 7f4d4388f740 1 -- 172.21.15.12:0/2345847022 shutdown_connections 2024-09-19T06:43:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.158+0000 7f4d4388f740 1 -- 172.21.15.12:0/2345847022 wait complete. 2024-09-19T06:43:36.160 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:35 smithi016 ceph-mon[34911]: pgmap v106: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 757 op/s 2024-09-19T06:43:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.159+0000 7f4d4388f740 1 -- start start 2024-09-19T06:43:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.159+0000 7f4d4388f740 1 Processor -- start 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c662f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 0x55653c663470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d4388f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c669e80 0x55653c6639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c662f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d4388f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34149080 con 0x55653c65f5e0 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d4388f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341489b0 con 0x55653c65ecc0 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c662f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58292/0 (socket says 172.21.15.12:58292) 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d4388f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34145bf0 con 0x55653c669e80 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3a59c640 1 -- 172.21.15.12:0/3316765663 learned_addr learned my addr 172.21.15.12:0/3316765663 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d39d9b640 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 0x55653c663470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d4388f740 10 client.0 _ll_register_callbacks cb 0x7f4d300f6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3ad9d640 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c669e80 0x55653c6639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3a59c640 1 -- 172.21.15.12:0/3316765663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c669e80 msgr2=0x55653c6639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c669e80 0x55653c6639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3a59c640 1 -- 172.21.15.12:0/3316765663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 msgr2=0x55653c663470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 0x55653c663470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3a59c640 1 -- 172.21.15.12:0/3316765663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653c670ec0 con 0x55653c65ecc0 2024-09-19T06:43:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3ad9d640 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c669e80 0x55653c6639b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d3a59c640 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c662f30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0116d0 tx=0x7f4d2c00bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=582ec2926b1696e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.160+0000 7f4d21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:43:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.161+0000 7f4d21ffb640 1 -- 172.21.15.12:0/3316765663 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c015040 con 0x55653c65ecc0 2024-09-19T06:43:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.161+0000 7f4d21ffb640 1 -- 172.21.15.12:0/3316765663 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4d2c01b640 con 0x55653c65ecc0 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.161+0000 7f4d4388f740 1 -- 172.21.15.12:0/3316765663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d3c089ae0 con 0x55653c65ecc0 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.162+0000 7f4d21ffb640 1 -- 172.21.15.12:0/3316765663 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4d2c0059c0 con 0x55653c65ecc0 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.162+0000 7f4d4388f740 10 client.26033 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.162+0000 7f4d4388f740 1 -- 172.21.15.12:0/3316765663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55653c6721b0 con 0x55653c65ecc0 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.162+0000 7f4d21ffb640 1 -- 172.21.15.12:0/3316765663 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d2c033020 con 0x55653c65ecc0 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.162+0000 7f4d21ffb640 1 -- 172.21.15.12:0/3316765663 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f4d2c006520 con 0x55653c65ecc0 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.163+0000 7f4d4388f740 10 client.26033 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.163+0000 7f4d4388f740 10 client.26033 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.163+0000 7f4d4388f740 20 client.26033 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.163+0000 7f4d4388f740 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653c6e4f80 0x55653c6e7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.163+0000 7f4d4388f740 4 client.26033 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.163+0000 7f4d4388f740 1 -- 172.21.15.12:0/3316765663 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f4d3c089ae0 con 0x55653c6e4f80 2024-09-19T06:43:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.163+0000 7f4d39d9b640 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653c6e4f80 0x55653c6e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.165+0000 7f4d39d9b640 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653c6e4f80 0x55653c6e7370 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9995e9349badf168 server_cookie=cb6655612948b22a in_seq=0 out_seq=0 2024-09-19T06:43:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.165+0000 7f4d21ffb640 10 client.26033 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.179+0000 7f4d21ffb640 1 -- 172.21.15.12:0/3316765663 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f4d3c089ae0 con 0x55653c6e4f80 2024-09-19T06:43:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.179+0000 7f4d21ffb640 10 client.26033 handle_command_reply: tid=0 2024-09-19T06:43:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.179+0000 7f4d4388f740 1 client.26033 shutdown 2024-09-19T06:43:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 1 -- 172.21.15.12:0/3316765663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 msgr2=0x55653c662f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c662f30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0116d0 tx=0x7f4d2c00bd00 comp rx=0 tx=0).stop 2024-09-19T06:43:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 1 -- 172.21.15.12:0/3316765663 shutdown_connections 2024-09-19T06:43:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653c6e4f80 0x55653c6e7370 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653c669e80 0x55653c6639b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653c65f5e0 0x55653c663470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 1 --2- 172.21.15.12:0/3316765663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653c65ecc0 0x55653c662f30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d21ffb640 0 client.26033 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 1 -- 172.21.15.12:0/3316765663 >> 172.21.15.12:0/3316765663 conn(0x55653c65b230 msgr2=0x55653c65a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 1 -- 172.21.15.12:0/3316765663 shutdown_connections 2024-09-19T06:43:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 1 -- 172.21.15.12:0/3316765663 wait complete. 2024-09-19T06:43:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.182+0000 7f4d4388f740 20 client.26033 trim_cache size 0 max 16384 2024-09-19T06:43:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:43:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:43:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:43:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:43:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.186+0000 7f4d3b59e640 1 -- 172.21.15.12:0/2316093683 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d240a33c0 msgr2=0x7f4d240a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.186+0000 7f4d3b59e640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d240a33c0 0x7f4d240a5880 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c065a40 tx=0x7f4d3c06a040 comp rx=0 tx=0).stop 2024-09-19T06:43:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.186+0000 7f4d3b59e640 1 -- 172.21.15.12:0/2316093683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d340050c0 msgr2=0x7f4d3409fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.186+0000 7f4d3b59e640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d340050c0 0x7f4d3409fae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4d3002a960 tx=0x7f4d30003b90 comp rx=0 tx=0).stop 2024-09-19T06:43:36.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.187+0000 7f4d3b59e640 1 -- 172.21.15.12:0/2316093683 shutdown_connections 2024-09-19T06:43:36.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.187+0000 7f4d3b59e640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3409b660 0x7f4d340a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.187+0000 7f4d3b59e640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d340050c0 0x7f4d3409fae0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.187+0000 7f4d3b59e640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d240a33c0 0x7f4d240a5880 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.187+0000 7f4d3b59e640 1 --2- 172.21.15.12:0/2316093683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d34004740 0x7f4d3409f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.187+0000 7f4d3b59e640 1 -- 172.21.15.12:0/2316093683 >> 172.21.15.12:0/2316093683 conn(0x7f4d3400a1e0 msgr2=0x7f4d340935e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.188+0000 7f4d3b59e640 1 -- 172.21.15.12:0/2316093683 shutdown_connections 2024-09-19T06:43:36.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:36.188+0000 7f4d3b59e640 1 -- 172.21.15.12:0/2316093683 wait complete. 2024-09-19T06:43:36.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:35 smithi173 ceph-mon[35349]: pgmap v106: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 757 op/s 2024-09-19T06:43:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.578+0000 7efdbee1c640 1 -- 172.21.15.12:0/4240339994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb8101de0 msgr2=0x7efdb81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.578+0000 7efdbee1c640 1 --2- 172.21.15.12:0/4240339994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb8101de0 0x7efdb81021c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efda0009900 tx=0x7efda002a410 comp rx=0 tx=0).stop 2024-09-19T06:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.579+0000 7efdbee1c640 1 -- 172.21.15.12:0/4240339994 shutdown_connections 2024-09-19T06:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.579+0000 7efdbee1c640 1 --2- 172.21.15.12:0/4240339994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdb8106f10 0x7efdb810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.579+0000 7efdbee1c640 1 --2- 172.21.15.12:0/4240339994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb8102790 0x7efdb81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.579+0000 7efdbee1c640 1 --2- 172.21.15.12:0/4240339994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb8101de0 0x7efdb81021c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.579+0000 7efdbee1c640 1 -- 172.21.15.12:0/4240339994 >> 172.21.15.12:0/4240339994 conn(0x7efdb80fd880 msgr2=0x7efdb80ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.579+0000 7efdbee1c640 1 -- 172.21.15.12:0/4240339994 shutdown_connections 2024-09-19T06:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.579+0000 7efdbee1c640 1 -- 172.21.15.12:0/4240339994 wait complete. 2024-09-19T06:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.580+0000 7efdbee1c640 1 Processor -- start 2024-09-19T06:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.580+0000 7efdbee1c640 1 -- start start 2024-09-19T06:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.580+0000 7efdbee1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdb8101de0 0x7efdb8195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.580+0000 7efdbee1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb8102790 0x7efdb81963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.580+0000 7efdbee1c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb8106f10 0x7efdb819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.580+0000 7efdbee1c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efdb810fdd0 con 0x7efdb8101de0 2024-09-19T06:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.580+0000 7efdbee1c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efdb810fc50 con 0x7efdb8102790 2024-09-19T06:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.580+0000 7efdbee1c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efdb810ff50 con 0x7efdb8106f10 2024-09-19T06:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.581+0000 7efdbd3b9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb8106f10 0x7efdb819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.581+0000 7efdbcbb8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdb8101de0 0x7efdb8195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.581+0000 7efdbcbb8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdb8101de0 0x7efdb8195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59368/0 (socket says 172.21.15.12:59368) 2024-09-19T06:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.581+0000 7efdbcbb8640 1 -- 172.21.15.12:0/2348526786 learned_addr learned my addr 172.21.15.12:0/2348526786 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.582+0000 7efdb7fff640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb8102790 0x7efdb81963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.582+0000 7efdbcbb8640 1 -- 172.21.15.12:0/2348526786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb8106f10 msgr2=0x7efdb819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.582+0000 7efdbcbb8640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb8106f10 0x7efdb819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.582+0000 7efdbcbb8640 1 -- 172.21.15.12:0/2348526786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb8102790 msgr2=0x7efdb81963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.582+0000 7efdbcbb8640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb8102790 0x7efdb81963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.582+0000 7efdbcbb8640 1 -- 172.21.15.12:0/2348526786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb819ae90 con 0x7efdb8101de0 2024-09-19T06:43:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.582+0000 7efdb7fff640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb8102790 0x7efdb81963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.582+0000 7efdbcbb8640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdb8101de0 0x7efdb8195eb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7efda0009850 tx=0x7efda0030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.583+0000 7efdb5ffb640 1 -- 172.21.15.12:0/2348526786 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda003f070 con 0x7efdb8101de0 2024-09-19T06:43:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.583+0000 7efdbee1c640 1 -- 172.21.15.12:0/2348526786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb819b120 con 0x7efdb8101de0 2024-09-19T06:43:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.583+0000 7efdb5ffb640 1 -- 172.21.15.12:0/2348526786 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efda0004460 con 0x7efdb8101de0 2024-09-19T06:43:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.583+0000 7efdb5ffb640 1 -- 172.21.15.12:0/2348526786 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0035030 con 0x7efdb8101de0 2024-09-19T06:43:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.583+0000 7efdbee1c640 1 -- 172.21.15.12:0/2348526786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb819b620 con 0x7efdb8101de0 2024-09-19T06:43:36.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.587+0000 7efdb5ffb640 1 -- 172.21.15.12:0/2348526786 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7efda0042070 con 0x7efdb8101de0 2024-09-19T06:43:36.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.587+0000 7efdc11f5740 1 Processor -- start 2024-09-19T06:43:36.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.588+0000 7efdc11f5740 1 -- start start 2024-09-19T06:43:36.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.588+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d03880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.588+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d03dc0 0x558317d0e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.588+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 0x558317d10a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.588+0000 7efdc11f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558317c692e0 con 0x558317d03dc0 2024-09-19T06:43:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.588+0000 7efdc11f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558317c10ce0 con 0x558317d034a0 2024-09-19T06:43:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.588+0000 7efdc11f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558317c652a0 con 0x558317d0e680 2024-09-19T06:43:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.588+0000 7efdbd3b9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d03880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.588+0000 7efdbd3b9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d03880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58328/0 (socket says 172.21.15.12:58328) 2024-09-19T06:43:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.588+0000 7efdbd3b9640 1 -- 172.21.15.12:0/2180620772 learned_addr learned my addr 172.21.15.12:0/2180620772 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.589+0000 7efdbcbb8640 1 --2- 172.21.15.12:0/2180620772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d03dc0 0x558317d0e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.589+0000 7efdbd3b9640 1 -- 172.21.15.12:0/2180620772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 msgr2=0x558317d10a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.589+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/2180620772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 0x558317d10a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.589+0000 7efdbd3b9640 1 -- 172.21.15.12:0/2180620772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d03dc0 msgr2=0x558317d0e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.589+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/2180620772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d03dc0 0x558317d0e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.589+0000 7efdbd3b9640 1 -- 172.21.15.12:0/2180620772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558317bf5440 con 0x558317d034a0 2024-09-19T06:43:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.589+0000 7efdb5ffb640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efda40a34b0 0x7efda40a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.590+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/2180620772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d03880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009b90 tx=0x7efdb00117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ffa969ef985569a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.590+0000 7efdaeffd640 1 -- 172.21.15.12:0/2180620772 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0012450 con 0x558317d034a0 2024-09-19T06:43:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.590+0000 7efdb5ffb640 1 -- 172.21.15.12:0/2348526786 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7efda00f02c0 con 0x7efdb8101de0 2024-09-19T06:43:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.590+0000 7efdaeffd640 1 -- 172.21.15.12:0/2180620772 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb0012ad0 con 0x558317d034a0 2024-09-19T06:43:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.591+0000 7efdaeffd640 1 -- 172.21.15.12:0/2180620772 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb000fab0 con 0x558317d034a0 2024-09-19T06:43:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.591+0000 7efdc11f5740 1 -- 172.21.15.12:0/2180620772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 msgr2=0x558317d03880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.591+0000 7efdc11f5740 1 --2- 172.21.15.12:0/2180620772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d03880 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009b90 tx=0x7efdb00117b0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.592+0000 7efdbcbb8640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efda40a34b0 0x7efda40a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.592+0000 7efdc11f5740 1 -- 172.21.15.12:0/2180620772 shutdown_connections 2024-09-19T06:43:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.592+0000 7efdc11f5740 1 --2- 172.21.15.12:0/2180620772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 0x558317d10a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.592+0000 7efdc11f5740 1 --2- 172.21.15.12:0/2180620772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d03dc0 0x558317d0e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.592+0000 7efdc11f5740 1 --2- 172.21.15.12:0/2180620772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d03880 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.592+0000 7efdc11f5740 1 -- 172.21.15.12:0/2180620772 >> 172.21.15.12:0/2180620772 conn(0x558317cffa30 msgr2=0x558317cffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.594+0000 7efdc11f5740 1 -- 172.21.15.12:0/2180620772 shutdown_connections 2024-09-19T06:43:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.595+0000 7efdc11f5740 1 -- 172.21.15.12:0/2180620772 wait complete. 2024-09-19T06:43:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.596+0000 7efdc11f5740 1 -- start start 2024-09-19T06:43:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.596+0000 7efdc11f5740 1 Processor -- start 2024-09-19T06:43:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.596+0000 7efdbcbb8640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efda40a34b0 0x7efda40a5970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x558317d00890 tx=0x7efda000b040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.597+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 0x558317d0e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.597+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d03dc0 0x558317d0b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.597+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d0e680 0x558317d0b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.597+0000 7efdc11f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558317d112a0 con 0x558317d034a0 2024-09-19T06:43:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.597+0000 7efdc11f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558317c24050 con 0x558317d0e680 2024-09-19T06:43:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.597+0000 7efdc11f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558317d11420 con 0x558317d03dc0 2024-09-19T06:43:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.597+0000 7efdc11f5740 10 client.0 _ll_register_callbacks cb 0x558317c64160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.597+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d03dc0 0x558317d0b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.598+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d03dc0 0x558317d0b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49902/0 (socket says 172.21.15.12:49902) 2024-09-19T06:43:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.598+0000 7efdb7fff640 1 -- 172.21.15.12:0/931508794 learned_addr learned my addr 172.21.15.12:0/931508794 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.598+0000 7efdb7fff640 1 -- 172.21.15.12:0/931508794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d0e680 msgr2=0x558317d0b8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:43:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.598+0000 7efdb7fff640 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d0e680 0x558317d0b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.598+0000 7efdb7fff640 1 -- 172.21.15.12:0/931508794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 msgr2=0x558317d0e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.598+0000 7efdb7fff640 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 0x558317d0e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.598+0000 7efdb7fff640 1 -- 172.21.15.12:0/931508794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583179da3c0 con 0x558317d03dc0 2024-09-19T06:43:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.599+0000 7efdb7fff640 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d03dc0 0x558317d0b2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efda8011d10 tx=0x7efda800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=578aaf98c5f36d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.599+0000 7efd97fff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:43:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.599+0000 7efd97fff640 1 -- 172.21.15.12:0/931508794 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8003d80 con 0x558317d03dc0 2024-09-19T06:43:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.599+0000 7efdc11f5740 1 -- 172.21.15.12:0/931508794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdb0012ad0 con 0x558317d03dc0 2024-09-19T06:43:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.599+0000 7efd97fff640 1 -- 172.21.15.12:0/931508794 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7efda8004050 con 0x558317d03dc0 2024-09-19T06:43:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.600+0000 7efd97fff640 1 -- 172.21.15.12:0/931508794 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efda800fe60 con 0x558317d03dc0 2024-09-19T06:43:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.601+0000 7efdc11f5740 10 client.26032 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.601+0000 7efdc11f5740 1 -- 172.21.15.12:0/931508794 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558317d1cd20 con 0x558317d03dc0 2024-09-19T06:43:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.602+0000 7efd97fff640 1 -- 172.21.15.12:0/931508794 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb0012ad0 con 0x558317d03dc0 2024-09-19T06:43:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.602+0000 7efd97fff640 1 -- 172.21.15.12:0/931508794 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7efda8018070 con 0x558317d03dc0 2024-09-19T06:43:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.602+0000 7efdc11f5740 10 client.26032 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.602+0000 7efdc11f5740 10 client.26032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.602+0000 7efdc11f5740 20 client.26032 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.602+0000 7efdc11f5740 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558317d1e280 0x558317d20700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.602+0000 7efdc11f5740 4 client.26032 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.602+0000 7efdc11f5740 1 -- 172.21.15.12:0/931508794 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558317c76850 con 0x558317d1e280 2024-09-19T06:43:36.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.604+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558317d1e280 0x558317d20700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.607+0000 7efd97fff640 10 client.26032 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:36.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.607+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558317d1e280 0x558317d20700 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa9df03f439d4e0 server_cookie=10b98a7b477f8d02 in_seq=0 out_seq=0 2024-09-19T06:43:36.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.607+0000 7efd97fff640 1 -- 172.21.15.12:0/931508794 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558317c76850 con 0x558317d1e280 2024-09-19T06:43:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.607+0000 7efd97fff640 10 client.26032 handle_command_reply: tid=0 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 client.26032 shutdown 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 -- 172.21.15.12:0/931508794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d03dc0 msgr2=0x558317d0b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d03dc0 0x558317d0b2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efda8011d10 tx=0x7efda800f790 comp rx=0 tx=0).stop 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 -- 172.21.15.12:0/931508794 shutdown_connections 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558317d1e280 0x558317d20700 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d0e680 0x558317d0b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d03dc0 0x558317d0b2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 --2- 172.21.15.12:0/931508794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 0x558317d0e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 -- 172.21.15.12:0/931508794 >> 172.21.15.12:0/931508794 conn(0x558317cffa30 msgr2=0x558317d05760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efd97fff640 0 client.26032 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 -- 172.21.15.12:0/931508794 shutdown_connections 2024-09-19T06:43:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.608+0000 7efdc11f5740 1 -- 172.21.15.12:0/931508794 wait complete. 2024-09-19T06:43:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.609+0000 7efdc11f5740 20 client.26032 trim_cache size 0 max 16384 2024-09-19T06:43:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:36.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.644+0000 7efdc11f5740 1 Processor -- start 2024-09-19T06:43:36.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.646+0000 7efdc11f5740 1 -- start start 2024-09-19T06:43:36.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.646+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d1a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.646+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d03dc0 0x558317d25fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.647+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 0x558317d26510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.647+0000 7efdbd3b9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d1a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.647+0000 7efdbd3b9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d1a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58348/0 (socket says 172.21.15.12:58348) 2024-09-19T06:43:36.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.647+0000 7efdbd3b9640 1 -- 172.21.15.12:0/3998235777 learned_addr learned my addr 172.21.15.12:0/3998235777 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:36.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.647+0000 7efdb7fff640 1 --2- 172.21.15.12:0/3998235777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d03dc0 0x558317d25fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.647+0000 7efdc11f5740 1 -- 172.21.15.12:0/3998235777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81ade50 con 0x558317d03dc0 2024-09-19T06:43:36.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.647+0000 7efdc11f5740 1 -- 172.21.15.12:0/3998235777 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81abb80 con 0x558317d034a0 2024-09-19T06:43:36.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.647+0000 7efdc11f5740 1 -- 172.21.15.12:0/3998235777 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81ad780 con 0x558317d0e680 2024-09-19T06:43:36.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.648+0000 7efdbd3b9640 1 -- 172.21.15.12:0/3998235777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 msgr2=0x558317d26510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.648+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/3998235777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 0x558317d26510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.648+0000 7efdbd3b9640 1 -- 172.21.15.12:0/3998235777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d03dc0 msgr2=0x558317d25fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.648+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/3998235777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d03dc0 0x558317d25fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.648+0000 7efdbd3b9640 1 -- 172.21.15.12:0/3998235777 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558317d0b6f0 con 0x558317d034a0 2024-09-19T06:43:36.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.648+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/3998235777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d1a500 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efdb000f750 tx=0x7efdb0005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d00b17e95074cbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.649+0000 7efdae7fc640 1 -- 172.21.15.12:0/3998235777 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0009c80 con 0x558317d034a0 2024-09-19T06:43:36.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.649+0000 7efdae7fc640 1 -- 172.21.15.12:0/3998235777 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb0005520 con 0x558317d034a0 2024-09-19T06:43:36.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.649+0000 7efdae7fc640 1 -- 172.21.15.12:0/3998235777 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb000fe90 con 0x558317d034a0 2024-09-19T06:43:36.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.650+0000 7efdc11f5740 1 -- 172.21.15.12:0/3998235777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 msgr2=0x558317d1a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.650+0000 7efdc11f5740 1 --2- 172.21.15.12:0/3998235777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d1a500 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efdb000f750 tx=0x7efdb0005850 comp rx=0 tx=0).stop 2024-09-19T06:43:36.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.650+0000 7efdc11f5740 1 -- 172.21.15.12:0/3998235777 shutdown_connections 2024-09-19T06:43:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.650+0000 7efdc11f5740 1 --2- 172.21.15.12:0/3998235777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 0x558317d26510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.650+0000 7efdc11f5740 1 --2- 172.21.15.12:0/3998235777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d03dc0 0x558317d25fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.650+0000 7efdc11f5740 1 --2- 172.21.15.12:0/3998235777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d034a0 0x558317d1a500 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.650+0000 7efdc11f5740 1 -- 172.21.15.12:0/3998235777 >> 172.21.15.12:0/3998235777 conn(0x558317cffa30 msgr2=0x558317d0a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.651+0000 7efdc11f5740 1 -- 172.21.15.12:0/3998235777 shutdown_connections 2024-09-19T06:43:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.652+0000 7efdc11f5740 1 -- 172.21.15.12:0/3998235777 wait complete. 2024-09-19T06:43:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.652+0000 7efdc11f5740 1 -- start start 2024-09-19T06:43:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.652+0000 7efdc11f5740 1 Processor -- start 2024-09-19T06:43:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.653+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 0x558317d922a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.653+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d03dc0 0x558317d927e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.653+0000 7efdc11f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 0x558317d11c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.653+0000 7efdc11f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81ac920 con 0x558317d034a0 2024-09-19T06:43:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.653+0000 7efdc11f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81ac250 con 0x558317d03dc0 2024-09-19T06:43:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.653+0000 7efdc11f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81acff0 con 0x558317d0e680 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.653+0000 7efdc11f5740 10 client.0 _ll_register_callbacks cb 0x7efda8009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.653+0000 7efdbd3b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 0x558317d922a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.653+0000 7efdbd3b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 0x558317d922a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59400/0 (socket says 172.21.15.12:59400) 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.653+0000 7efdbd3b9640 1 -- 172.21.15.12:0/3011005863 learned_addr learned my addr 172.21.15.12:0/3011005863 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.654+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 0x558317d11c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.654+0000 7efdb7fff640 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d03dc0 0x558317d927e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.654+0000 7efdbd3b9640 1 -- 172.21.15.12:0/3011005863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 msgr2=0x558317d11c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.654+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 0x558317d11c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.654+0000 7efdbd3b9640 1 -- 172.21.15.12:0/3011005863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d03dc0 msgr2=0x558317d927e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.654+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d03dc0 0x558317d927e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.654+0000 7efdbd3b9640 1 -- 172.21.15.12:0/3011005863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558317d0bc50 con 0x558317d034a0 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.654+0000 7efdb7fff640 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d03dc0 0x558317d927e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.654+0000 7efdbd3b9640 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 0x558317d922a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7efdb000fab0 tx=0x7efdb0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00242dc68e098e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.655+0000 7efd97fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.655+0000 7efd97fff640 1 -- 172.21.15.12:0/3011005863 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb000fe10 con 0x558317d034a0 2024-09-19T06:43:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.655+0000 7efdc11f5740 1 -- 172.21.15.12:0/3011005863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdb0005520 con 0x558317d034a0 2024-09-19T06:43:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.655+0000 7efd97fff640 1 -- 172.21.15.12:0/3011005863 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7efdb00050b0 con 0x558317d034a0 2024-09-19T06:43:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.656+0000 7efd97fff640 1 -- 172.21.15.12:0/3011005863 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efdb00052b0 con 0x558317d034a0 2024-09-19T06:43:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.656+0000 7efdc11f5740 10 client.16482 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.656+0000 7efdc11f5740 1 -- 172.21.15.12:0/3011005863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558317d81130 con 0x558317d034a0 2024-09-19T06:43:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.657+0000 7efd97fff640 1 -- 172.21.15.12:0/3011005863 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb0005520 con 0x558317d034a0 2024-09-19T06:43:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.657+0000 7efd97fff640 1 -- 172.21.15.12:0/3011005863 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7efdb002e030 con 0x558317d034a0 2024-09-19T06:43:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.657+0000 7efdc11f5740 10 client.16482 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.657+0000 7efdc11f5740 10 client.16482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.657+0000 7efdc11f5740 20 client.16482 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.657+0000 7efdc11f5740 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558317d81620 0x558317d83a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.657+0000 7efdc11f5740 4 client.16482 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:43:36.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.657+0000 7efdc11f5740 1 -- 172.21.15.12:0/3011005863 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558317c70d60 con 0x558317d81620 2024-09-19T06:43:36.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.658+0000 7efdb7fff640 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558317d81620 0x558317d83a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:36.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.659+0000 7efd97fff640 10 client.16482 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:36.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.659+0000 7efdb7fff640 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558317d81620 0x558317d83a40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c7da090e57cf891 server_cookie=6198dacfee291ad5 in_seq=0 out_seq=0 2024-09-19T06:43:36.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.659+0000 7efd97fff640 1 -- 172.21.15.12:0/3011005863 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558317c70d60 con 0x558317d81620 2024-09-19T06:43:36.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.659+0000 7efd97fff640 10 client.16482 handle_command_reply: tid=0 2024-09-19T06:43:36.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.659+0000 7efdc11f5740 1 client.16482 shutdown 2024-09-19T06:43:36.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.659+0000 7efdc11f5740 1 -- 172.21.15.12:0/3011005863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 msgr2=0x558317d922a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.659+0000 7efdc11f5740 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 0x558317d922a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7efdb000fab0 tx=0x7efdb0009b30 comp rx=0 tx=0).stop 2024-09-19T06:43:36.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.660+0000 7efdc11f5740 1 -- 172.21.15.12:0/3011005863 shutdown_connections 2024-09-19T06:43:36.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.660+0000 7efdc11f5740 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558317d81620 0x558317d83a40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.660+0000 7efdc11f5740 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558317d0e680 0x558317d11c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.660+0000 7efd97fff640 0 client.16482 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.660+0000 7efdc11f5740 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558317d03dc0 0x558317d927e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.660+0000 7efdc11f5740 1 --2- 172.21.15.12:0/3011005863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558317d034a0 0x558317d922a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.660+0000 7efdc11f5740 1 -- 172.21.15.12:0/3011005863 >> 172.21.15.12:0/3011005863 conn(0x558317cffa30 msgr2=0x558317cfe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.660+0000 7efdc11f5740 1 -- 172.21.15.12:0/3011005863 shutdown_connections 2024-09-19T06:43:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.660+0000 7efdc11f5740 1 -- 172.21.15.12:0/3011005863 wait complete. 2024-09-19T06:43:36.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.660+0000 7efdc11f5740 20 client.16482 trim_cache size 0 max 16384 2024-09-19T06:43:36.664 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:43:36.664 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:43:36.664 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:43:36.664 INFO:teuthology.orchestra.run.smithi012.stdout: "0ff984da-78eb-46ad-b2a9-dbc4a789ea1e": { 2024-09-19T06:43:36.664 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:43:36.664 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "0ff984da-78eb-46ad-b2a9-dbc4a789ea1e", 2024-09-19T06:43:36.664 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:43:36.664 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:36.664 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:36.665 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:43:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.662+0000 7efdbee1c640 1 -- 172.21.15.12:0/2348526786 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efda40a34b0 msgr2=0x7efda40a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.662+0000 7efdbee1c640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efda40a34b0 0x7efda40a5970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x558317d00890 tx=0x7efda000b040 comp rx=0 tx=0).stop 2024-09-19T06:43:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.662+0000 7efdbee1c640 1 -- 172.21.15.12:0/2348526786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdb8101de0 msgr2=0x7efdb8195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.662+0000 7efdbee1c640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdb8101de0 0x7efdb8195eb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7efda0009850 tx=0x7efda0030650 comp rx=0 tx=0).stop 2024-09-19T06:43:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.663+0000 7efdbee1c640 1 -- 172.21.15.12:0/2348526786 shutdown_connections 2024-09-19T06:43:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.663+0000 7efdbee1c640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efda40a34b0 0x7efda40a5970 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.663+0000 7efdbee1c640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdb8106f10 0x7efdb819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.663+0000 7efdbee1c640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb8102790 0x7efdb81963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.663+0000 7efdbee1c640 1 --2- 172.21.15.12:0/2348526786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdb8101de0 0x7efdb8195eb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:36.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.663+0000 7efdbee1c640 1 -- 172.21.15.12:0/2348526786 >> 172.21.15.12:0/2348526786 conn(0x7efdb80fd880 msgr2=0x7efdb80fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:36.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.663+0000 7efdbee1c640 1 -- 172.21.15.12:0/2348526786 shutdown_connections 2024-09-19T06:43:36.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:36.663+0000 7efdbee1c640 1 -- 172.21.15.12:0/2348526786 wait complete. 2024-09-19T06:43:37.843 INFO:tasks.cephfs.filesystem:scrub status for tag:0ff984da-78eb-46ad-b2a9-dbc4a789ea1e - {'path': '/', 'tag': '0ff984da-78eb-46ad-b2a9-dbc4a789ea1e', 'options': 'recursive,force'} 2024-09-19T06:43:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.035+0000 7f050f293640 1 -- 172.21.15.12:0/1923207493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0508074eb0 msgr2=0x7f0508112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.035+0000 7f050f293640 1 --2- 172.21.15.12:0/1923207493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0508074eb0 0x7f0508112660 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009900 tx=0x7f04f802a4b0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.035+0000 7f050f293640 1 -- 172.21.15.12:0/1923207493 shutdown_connections 2024-09-19T06:43:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.035+0000 7f050f293640 1 --2- 172.21.15.12:0/1923207493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0508112ba0 0x7f0508114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.035+0000 7f050f293640 1 --2- 172.21.15.12:0/1923207493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0508074eb0 0x7f0508112660 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.035+0000 7f050f293640 1 --2- 172.21.15.12:0/1923207493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0508074590 0x7f0508074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.035+0000 7f050f293640 1 -- 172.21.15.12:0/1923207493 >> 172.21.15.12:0/1923207493 conn(0x7f05080fd8f0 msgr2=0x7f05080ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.035+0000 7f050f293640 1 -- 172.21.15.12:0/1923207493 shutdown_connections 2024-09-19T06:43:38.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.035+0000 7f050f293640 1 -- 172.21.15.12:0/1923207493 wait complete. 2024-09-19T06:43:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.037+0000 7f050f293640 1 Processor -- start 2024-09-19T06:43:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.037+0000 7f050f293640 1 -- start start 2024-09-19T06:43:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.037+0000 7f050f293640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0508074590 0x7f05081a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:38.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.037+0000 7f050f293640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0508074eb0 0x7f05081a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:38.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050d02f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0508074590 0x7f05081a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:38.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050d02f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0508074590 0x7f05081a4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49914/0 (socket says 172.21.15.12:49914) 2024-09-19T06:43:38.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050f293640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0508112ba0 0x7f050819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:38.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050d02f640 1 -- 172.21.15.12:0/3999763842 learned_addr learned my addr 172.21.15.12:0/3999763842 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:38.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0508118640 con 0x7f0508074eb0 2024-09-19T06:43:38.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f05081184c0 con 0x7f0508112ba0 2024-09-19T06:43:38.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f05081187c0 con 0x7f0508074590 2024-09-19T06:43:38.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050c82e640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0508074eb0 0x7f05081a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:38.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050d830640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0508112ba0 0x7f050819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:38.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050d02f640 1 -- 172.21.15.12:0/3999763842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0508112ba0 msgr2=0x7f050819e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050d02f640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0508112ba0 0x7f050819e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050d02f640 1 -- 172.21.15.12:0/3999763842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0508074eb0 msgr2=0x7f05081a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050d02f640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0508074eb0 0x7f05081a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.038+0000 7f050d02f640 1 -- 172.21.15.12:0/3999763842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050819f100 con 0x7f0508074590 2024-09-19T06:43:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.039+0000 7f050d02f640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0508074590 0x7f05081a4810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f050400b450 tx=0x7f050400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.039+0000 7f04fe7fc640 1 -- 172.21.15.12:0/3999763842 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504015020 con 0x7f0508074590 2024-09-19T06:43:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.039+0000 7f04fe7fc640 1 -- 172.21.15.12:0/3999763842 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0504011d70 con 0x7f0508074590 2024-09-19T06:43:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.039+0000 7f04fe7fc640 1 -- 172.21.15.12:0/3999763842 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050400f340 con 0x7f0508074590 2024-09-19T06:43:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.039+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050819f3f0 con 0x7f0508074590 2024-09-19T06:43:38.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.040+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05081ab6e0 con 0x7f0508074590 2024-09-19T06:43:38.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.043+0000 7f04fe7fc640 1 -- 172.21.15.12:0/3999763842 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0504018020 con 0x7f0508074590 2024-09-19T06:43:38.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.043+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0508074970 con 0x7f0508074590 2024-09-19T06:43:38.044 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:37 smithi012 ceph-mon[30937]: pgmap v107: 97 pgs: 97 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 16 MiB/s wr, 1.22k op/s 2024-09-19T06:43:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.044+0000 7f04fe7fc640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04f40a3500 0x7f04f40a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.044+0000 7f04fe7fc640 1 -- 172.21.15.12:0/3999763842 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f05040cf690 con 0x7f0508074590 2024-09-19T06:43:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.045+0000 7f050c82e640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04f40a3500 0x7f04f40a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.047+0000 7f050c82e640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04f40a3500 0x7f04f40a59c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f04f8005ab0 tx=0x7f04f802a9b0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.052+0000 7f04fe7fc640 1 -- 172.21.15.12:0/3999763842 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f050401f020 con 0x7f0508074590 2024-09-19T06:43:38.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:37 smithi173 ceph-mon[35349]: pgmap v107: 97 pgs: 97 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 16 MiB/s wr, 1.22k op/s 2024-09-19T06:43:38.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:37 smithi016 ceph-mon[34911]: pgmap v107: 97 pgs: 97 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 16 MiB/s wr, 1.22k op/s 2024-09-19T06:43:38.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.471+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0508105000 con 0x7f0508074590 2024-09-19T06:43:38.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.472+0000 7f04fe7fc640 1 -- 172.21.15.12:0/3999763842 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11978 (secure 0 0 0) 0x7f050400d040 con 0x7f0508074590 2024-09-19T06:43:38.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:43:38.474 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"btime":"2024-09-19T06:43:29:811210+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:43:29.407725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:43:38.474 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 32 2024-09-19T06:43:38.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04f40a3500 msgr2=0x7f04f40a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04f40a3500 0x7f04f40a59c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f04f8005ab0 tx=0x7f04f802a9b0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0508074590 msgr2=0x7f05081a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:38.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0508074590 0x7f05081a4810 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f050400b450 tx=0x7f050400b910 comp rx=0 tx=0).stop 2024-09-19T06:43:38.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 shutdown_connections 2024-09-19T06:43:38.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0508112ba0 0x7f050819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0508074eb0 0x7f05081a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04f40a3500 0x7f04f40a59c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 --2- 172.21.15.12:0/3999763842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0508074590 0x7f05081a4810 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:38.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 >> 172.21.15.12:0/3999763842 conn(0x7f05080fd8f0 msgr2=0x7f05080ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:38.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 shutdown_connections 2024-09-19T06:43:38.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:38.476+0000 7f050f293640 1 -- 172.21.15.12:0/3999763842 wait complete. 2024-09-19T06:43:39.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:38 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3999763842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:43:39.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:38 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3999763842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:43:39.298 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T06:43:39.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T06:43:39.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:38 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3999763842' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:43:39.734 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:40.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:39 smithi012 ceph-mon[30937]: pgmap v108: 97 pgs: 97 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 10 MiB/s wr, 812 op/s 2024-09-19T06:43:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:39 smithi016 ceph-mon[34911]: pgmap v108: 97 pgs: 97 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 10 MiB/s wr, 812 op/s 2024-09-19T06:43:40.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:39 smithi173 ceph-mon[35349]: pgmap v108: 97 pgs: 97 active+clean; 2.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 10 MiB/s wr, 812 op/s 2024-09-19T06:43:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.338+0000 7fd03f446640 1 -- 172.21.15.12:0/2795361469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0381049a0 msgr2=0x7fd0381089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.338+0000 7fd03f446640 1 --2- 172.21.15.12:0/2795361469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0381049a0 0x7fd0381089f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd034009860 tx=0x7fd03402a340 comp rx=0 tx=0).stop 2024-09-19T06:43:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.338+0000 7fd03f446640 1 -- 172.21.15.12:0/2795361469 shutdown_connections 2024-09-19T06:43:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.339+0000 7fd03f446640 1 --2- 172.21.15.12:0/2795361469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd038109120 0x7fd038110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.339+0000 7fd03f446640 1 --2- 172.21.15.12:0/2795361469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0381049a0 0x7fd0381089f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.339+0000 7fd03f446640 1 --2- 172.21.15.12:0/2795361469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd038103ff0 0x7fd0381043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.339+0000 7fd03f446640 1 -- 172.21.15.12:0/2795361469 >> 172.21.15.12:0/2795361469 conn(0x7fd0380ffab0 msgr2=0x7fd038101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.339+0000 7fd03f446640 1 -- 172.21.15.12:0/2795361469 shutdown_connections 2024-09-19T06:43:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.339+0000 7fd03f446640 1 -- 172.21.15.12:0/2795361469 wait complete. 2024-09-19T06:43:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03f446640 1 Processor -- start 2024-09-19T06:43:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03f446640 1 -- start start 2024-09-19T06:43:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03f446640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd038103ff0 0x7fd03819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03f446640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0381049a0 0x7fd03819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03f446640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd038109120 0x7fd03819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03f446640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd038114120 con 0x7fd038109120 2024-09-19T06:43:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03f446640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd038113fa0 con 0x7fd038103ff0 2024-09-19T06:43:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03f446640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381142a0 con 0x7fd0381049a0 2024-09-19T06:43:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03d1e2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd038103ff0 0x7fd03819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03c9e1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0381049a0 0x7fd03819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03d1e2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd038103ff0 0x7fd03819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58388/0 (socket says 172.21.15.12:58388) 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03d1e2640 1 -- 172.21.15.12:0/2364908976 learned_addr learned my addr 172.21.15.12:0/2364908976 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03d9e3640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd038109120 0x7fd03819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03c9e1640 1 -- 172.21.15.12:0/2364908976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd038103ff0 msgr2=0x7fd03819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd038103ff0 0x7fd03819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03c9e1640 1 -- 172.21.15.12:0/2364908976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd038109120 msgr2=0x7fd03819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd038109120 0x7fd03819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.340+0000 7fd03c9e1640 1 -- 172.21.15.12:0/2364908976 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03819f5f0 con 0x7fd0381049a0 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.341+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0381049a0 0x7fd03819ab80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd034035040 tx=0x7fd034033b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.341+0000 7fd02e7fc640 1 -- 172.21.15.12:0/2364908976 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03403f020 con 0x7fd0381049a0 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.341+0000 7fd02e7fc640 1 -- 172.21.15.12:0/2364908976 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd034030550 con 0x7fd0381049a0 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.341+0000 7fd02e7fc640 1 -- 172.21.15.12:0/2364908976 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034037040 con 0x7fd0381049a0 2024-09-19T06:43:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.342+0000 7fd03f446640 1 -- 172.21.15.12:0/2364908976 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03819f880 con 0x7fd0381049a0 2024-09-19T06:43:40.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.342+0000 7fd03f446640 1 -- 172.21.15.12:0/2364908976 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03819fd10 con 0x7fd0381049a0 2024-09-19T06:43:40.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.345+0000 7fd02e7fc640 1 -- 172.21.15.12:0/2364908976 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd034042020 con 0x7fd0381049a0 2024-09-19T06:43:40.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.346+0000 7fd04181f740 1 Processor -- start 2024-09-19T06:43:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.347+0000 7fd04181f740 1 -- start start 2024-09-19T06:43:40.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.347+0000 7fd02e7fc640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0240a3430 0x7fd0240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.347+0000 7fd02e7fc640 1 -- 172.21.15.12:0/2364908976 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd0340ef790 con 0x7fd0381049a0 2024-09-19T06:43:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.347+0000 7fd03d9e3640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0240a3430 0x7fd0240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd04181f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 0x55e394b43b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd04181f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 0x55e394b4e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd04181f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b50d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd04181f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e394aa92a0 con 0x55e394b43760 2024-09-19T06:43:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd04181f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e394a50b10 con 0x55e394b44080 2024-09-19T06:43:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd04181f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e394aa5260 con 0x55e394b4e940 2024-09-19T06:43:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd03c9e1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 0x55e394b4e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd03c9e1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 0x55e394b4e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58400/0 (socket says 172.21.15.12:58400) 2024-09-19T06:43:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd03c9e1640 1 -- 172.21.15.12:0/2916792046 learned_addr learned my addr 172.21.15.12:0/2916792046 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:40.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd03d1e2640 1 --2- 172.21.15.12:0/2916792046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 0x55e394b43b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd03d9e3640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0240a3430 0x7fd0240a58f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd030005fd0 tx=0x7fd0300095c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.348+0000 7fd03d9e3640 1 --2- 172.21.15.12:0/2916792046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b50d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.349+0000 7fd03c9e1640 1 -- 172.21.15.12:0/2916792046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 msgr2=0x55e394b50d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.349+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2916792046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b50d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.349+0000 7fd03c9e1640 1 -- 172.21.15.12:0/2916792046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 msgr2=0x55e394b43b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.349+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2916792046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 0x55e394b43b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.349+0000 7fd03c9e1640 1 -- 172.21.15.12:0/2916792046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e39481ab90 con 0x55e394b44080 2024-09-19T06:43:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.349+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2916792046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 0x55e394b4e400 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd0340b7f60 tx=0x7fd034030a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea0bc2e7ac28199 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.349+0000 7fd0237fe640 1 -- 172.21.15.12:0/2916792046 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0340bbb00 con 0x55e394b44080 2024-09-19T06:43:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.349+0000 7fd0237fe640 1 -- 172.21.15.12:0/2916792046 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0340bfeb0 con 0x55e394b44080 2024-09-19T06:43:40.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.349+0000 7fd0237fe640 1 -- 172.21.15.12:0/2916792046 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0340a60b0 con 0x55e394b44080 2024-09-19T06:43:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.350+0000 7fd04181f740 1 -- 172.21.15.12:0/2916792046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 msgr2=0x55e394b4e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.350+0000 7fd04181f740 1 --2- 172.21.15.12:0/2916792046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 0x55e394b4e400 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd0340b7f60 tx=0x7fd034030a00 comp rx=0 tx=0).stop 2024-09-19T06:43:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.351+0000 7fd04181f740 1 -- 172.21.15.12:0/2916792046 shutdown_connections 2024-09-19T06:43:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.351+0000 7fd04181f740 1 --2- 172.21.15.12:0/2916792046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b50d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.351+0000 7fd04181f740 1 --2- 172.21.15.12:0/2916792046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 0x55e394b4e400 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.351+0000 7fd04181f740 1 --2- 172.21.15.12:0/2916792046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 0x55e394b43b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.351+0000 7fd04181f740 1 -- 172.21.15.12:0/2916792046 >> 172.21.15.12:0/2916792046 conn(0x55e394b3fcf0 msgr2=0x55e394b400d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.351+0000 7fd04181f740 1 -- 172.21.15.12:0/2916792046 shutdown_connections 2024-09-19T06:43:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.351+0000 7fd04181f740 1 -- 172.21.15.12:0/2916792046 wait complete. 2024-09-19T06:43:40.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.351+0000 7fd04181f740 1 -- start start 2024-09-19T06:43:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.351+0000 7fd04181f740 1 Processor -- start 2024-09-19T06:43:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd04181f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b43760 0x55e394b4b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd04181f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b44080 0x55e394b4bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd04181f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b4c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd03d1e2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b43760 0x55e394b4b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd03d1e2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b43760 0x55e394b4b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58408/0 (socket says 172.21.15.12:58408) 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd03d1e2640 1 -- 172.21.15.12:0/2919848363 learned_addr learned my addr 172.21.15.12:0/2919848363 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd03d9e3640 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b4c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e394a50b10 con 0x55e394b44080 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e394a316e0 con 0x55e394b43760 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e394b512d0 con 0x55e394b4e940 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b44080 0x55e394b4bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.352+0000 7fd04181f740 10 client.0 _ll_register_callbacks cb 0x55e394a55a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.353+0000 7fd03c9e1640 1 -- 172.21.15.12:0/2919848363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 msgr2=0x55e394b4c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.353+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b4c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.353+0000 7fd03c9e1640 1 -- 172.21.15.12:0/2919848363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b43760 msgr2=0x55e394b4b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.353+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b43760 0x55e394b4b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.353+0000 7fd03c9e1640 1 -- 172.21.15.12:0/2919848363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e394b5a5b0 con 0x55e394b44080 2024-09-19T06:43:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.354+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b44080 0x55e394b4bde0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd0340c4930 tx=0x7fd0340b8420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e20fc6696b41885 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.354+0000 7fd020ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:40.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.354+0000 7fd020ff9640 1 -- 172.21.15.12:0/2919848363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0340bbb00 con 0x55e394b44080 2024-09-19T06:43:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.355+0000 7fd020ff9640 1 -- 172.21.15.12:0/2919848363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd0340b9e00 con 0x55e394b44080 2024-09-19T06:43:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.355+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0340bfeb0 con 0x55e394b44080 2024-09-19T06:43:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.355+0000 7fd020ff9640 1 -- 172.21.15.12:0/2919848363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd0340c42e0 con 0x55e394b44080 2024-09-19T06:43:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.355+0000 7fd04181f740 10 client.16500 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.355+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e394b5cf40 con 0x55e394b44080 2024-09-19T06:43:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.356+0000 7fd020ff9640 1 -- 172.21.15.12:0/2919848363 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0340bfeb0 con 0x55e394b44080 2024-09-19T06:43:40.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.356+0000 7fd020ff9640 1 -- 172.21.15.12:0/2919848363 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fd03403a030 con 0x55e394b44080 2024-09-19T06:43:40.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.356+0000 7fd04181f740 10 client.16500 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:40.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.356+0000 7fd04181f740 10 client.16500 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:43:40.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.356+0000 7fd04181f740 20 client.16500 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:40.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.356+0000 7fd04181f740 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e394b5e110 0x55e394b60530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.356+0000 7fd04181f740 4 client.16500 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:40.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.356+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e394ab69d0 con 0x55e394b5e110 2024-09-19T06:43:40.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.356+0000 7fd03d1e2640 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e394b5e110 0x55e394b60530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.357+0000 7fd020ff9640 10 client.16500 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:40.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.357+0000 7fd03d1e2640 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e394b5e110 0x55e394b60530 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea6551a79a16137c server_cookie=a373446ebb59084a in_seq=0 out_seq=0 2024-09-19T06:43:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.358+0000 7fd020ff9640 1 -- 172.21.15.12:0/2919848363 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e394ab69d0 con 0x55e394b5e110 2024-09-19T06:43:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.358+0000 7fd020ff9640 10 client.16500 handle_command_reply: tid=0 2024-09-19T06:43:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.358+0000 7fd04181f740 1 client.16500 shutdown 2024-09-19T06:43:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.359+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b44080 msgr2=0x55e394b4bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.359+0000 7fd04181f740 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b44080 0x55e394b4bde0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd0340c4930 tx=0x7fd0340b8420 comp rx=0 tx=0).stop 2024-09-19T06:43:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.359+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 shutdown_connections 2024-09-19T06:43:40.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.359+0000 7fd04181f740 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e394b5e110 0x55e394b60530 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.359+0000 7fd04181f740 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b4c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.360+0000 7fd04181f740 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b44080 0x55e394b4bde0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.360+0000 7fd020ff9640 0 client.16500 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.360+0000 7fd04181f740 1 --2- 172.21.15.12:0/2919848363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b43760 0x55e394b4b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.360+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 >> 172.21.15.12:0/2919848363 conn(0x55e394b3fcf0 msgr2=0x55e394b45a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.360+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 shutdown_connections 2024-09-19T06:43:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.360+0000 7fd04181f740 1 -- 172.21.15.12:0/2919848363 wait complete. 2024-09-19T06:43:40.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.360+0000 7fd04181f740 20 client.16500 trim_cache size 0 max 16384 2024-09-19T06:43:40.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.389+0000 7fd04181f740 1 Processor -- start 2024-09-19T06:43:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.389+0000 7fd04181f740 1 -- start start 2024-09-19T06:43:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.390+0000 7fd04181f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b43760 0x55e394b4d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.390+0000 7fd04181f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b44080 0x55e394b65de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.390+0000 7fd04181f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b4e940 0x55e394b66320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.390+0000 7fd04181f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381ab9d0 con 0x55e394b44080 2024-09-19T06:43:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.390+0000 7fd04181f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381ad5d0 con 0x55e394b4e940 2024-09-19T06:43:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.390+0000 7fd04181f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381ac0a0 con 0x55e394b43760 2024-09-19T06:43:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.390+0000 7fd03d1e2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b43760 0x55e394b4d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.390+0000 7fd03d1e2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b43760 0x55e394b4d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49956/0 (socket says 172.21.15.12:49956) 2024-09-19T06:43:40.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.390+0000 7fd03d1e2640 1 -- 172.21.15.12:0/3856919463 learned_addr learned my addr 172.21.15.12:0/3856919463 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:40.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.390+0000 7fd03d9e3640 1 --2- 172.21.15.12:0/3856919463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b4e940 0x55e394b66320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.391+0000 7fd03d1e2640 1 -- 172.21.15.12:0/3856919463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b4e940 msgr2=0x55e394b66320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:40.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.391+0000 7fd03d1e2640 1 --2- 172.21.15.12:0/3856919463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b4e940 0x55e394b66320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.391+0000 7fd03d1e2640 1 -- 172.21.15.12:0/3856919463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b44080 msgr2=0x55e394b65de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:40.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.391+0000 7fd03d1e2640 1 --2- 172.21.15.12:0/3856919463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b44080 0x55e394b65de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.391+0000 7fd03d1e2640 1 -- 172.21.15.12:0/3856919463 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e394b3b260 con 0x55e394b43760 2024-09-19T06:43:40.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.391+0000 7fd03d1e2640 1 --2- 172.21.15.12:0/3856919463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b43760 0x55e394b4d770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd028009de0 tx=0x7fd028012880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3015d867940e390a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:40.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.391+0000 7fd022ffd640 1 -- 172.21.15.12:0/3856919463 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028012310 con 0x55e394b43760 2024-09-19T06:43:40.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.391+0000 7fd022ffd640 1 -- 172.21.15.12:0/3856919463 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0280035f0 con 0x55e394b43760 2024-09-19T06:43:40.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.392+0000 7fd022ffd640 1 -- 172.21.15.12:0/3856919463 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280106f0 con 0x55e394b43760 2024-09-19T06:43:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.393+0000 7fd04181f740 1 -- 172.21.15.12:0/3856919463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b43760 msgr2=0x55e394b4d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.393+0000 7fd04181f740 1 --2- 172.21.15.12:0/3856919463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b43760 0x55e394b4d770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd028009de0 tx=0x7fd028012880 comp rx=0 tx=0).stop 2024-09-19T06:43:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.393+0000 7fd04181f740 1 -- 172.21.15.12:0/3856919463 shutdown_connections 2024-09-19T06:43:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.393+0000 7fd04181f740 1 --2- 172.21.15.12:0/3856919463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b4e940 0x55e394b66320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.393+0000 7fd04181f740 1 --2- 172.21.15.12:0/3856919463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b44080 0x55e394b65de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.393+0000 7fd04181f740 1 --2- 172.21.15.12:0/3856919463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b43760 0x55e394b4d770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.393+0000 7fd04181f740 1 -- 172.21.15.12:0/3856919463 >> 172.21.15.12:0/3856919463 conn(0x55e394b3fcf0 msgr2=0x55e394b3ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.394+0000 7fd04181f740 1 -- 172.21.15.12:0/3856919463 shutdown_connections 2024-09-19T06:43:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.394+0000 7fd04181f740 1 -- 172.21.15.12:0/3856919463 wait complete. 2024-09-19T06:43:40.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.394+0000 7fd04181f740 1 -- start start 2024-09-19T06:43:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.394+0000 7fd04181f740 1 Processor -- start 2024-09-19T06:43:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.394+0000 7fd04181f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 0x55e394b48a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd04181f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 0x55e394b48f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd03d1e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 0x55e394b48a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd04181f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd04181f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381ace40 con 0x55e394b43760 2024-09-19T06:43:40.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd03d1e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 0x55e394b48a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59460/0 (socket says 172.21.15.12:59460) 2024-09-19T06:43:40.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd03d1e2640 1 -- 172.21.15.12:0/2643922354 learned_addr learned my addr 172.21.15.12:0/2643922354 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd03d9e3640 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd04181f740 1 -- 172.21.15.12:0/2643922354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381ac770 con 0x55e394b44080 2024-09-19T06:43:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd04181f740 1 -- 172.21.15.12:0/2643922354 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0381a99b0 con 0x55e394b4e940 2024-09-19T06:43:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd04181f740 10 client.0 _ll_register_callbacks cb 0x7fd034030930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.395+0000 7fd03c9e1640 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 0x55e394b48f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.396+0000 7fd03d9e3640 1 -- 172.21.15.12:0/2643922354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 msgr2=0x55e394b48f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.396+0000 7fd03d9e3640 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 0x55e394b48f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.396+0000 7fd03d9e3640 1 -- 172.21.15.12:0/2643922354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 msgr2=0x55e394b48a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.396+0000 7fd03d9e3640 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 0x55e394b48a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.396+0000 7fd03d9e3640 1 -- 172.21.15.12:0/2643922354 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e394bc7eb0 con 0x55e394b4e940 2024-09-19T06:43:40.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.397+0000 7fd03d9e3640 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b494c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd030009a60 tx=0x7fd030004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb8fc606c9e8a733 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:40.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.397+0000 7fd020ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:43:40.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.397+0000 7fd020ff9640 1 -- 172.21.15.12:0/2643922354 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030019b40 con 0x55e394b4e940 2024-09-19T06:43:40.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.397+0000 7fd04181f740 1 -- 172.21.15.12:0/2643922354 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0280035f0 con 0x55e394b4e940 2024-09-19T06:43:40.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.397+0000 7fd020ff9640 1 -- 172.21.15.12:0/2643922354 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd030019ce0 con 0x55e394b4e940 2024-09-19T06:43:40.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd020ff9640 1 -- 172.21.15.12:0/2643922354 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd030047050 con 0x55e394b4e940 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd04181f740 10 client.26056 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd04181f740 1 -- 172.21.15.12:0/2643922354 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e394bc9200 con 0x55e394b4e940 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd020ff9640 1 -- 172.21.15.12:0/2643922354 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0280035f0 con 0x55e394b4e940 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd020ff9640 1 -- 172.21.15.12:0/2643922354 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fd03000b040 con 0x55e394b4e940 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd04181f740 10 client.26056 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd04181f740 10 client.26056 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd04181f740 20 client.26056 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd04181f740 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e394b5e110 0x55e394bcbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd04181f740 4 client.26056 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.398+0000 7fd04181f740 1 -- 172.21.15.12:0/2643922354 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x55e394ab0d20 con 0x55e394b5e110 2024-09-19T06:43:40.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.399+0000 7fd03d1e2640 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e394b5e110 0x55e394bcbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.401+0000 7fd020ff9640 10 client.26056 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:40.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.401+0000 7fd03d1e2640 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e394b5e110 0x55e394bcbb50 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7654692de63ab2eb server_cookie=d80c71e251e34113 in_seq=0 out_seq=0 2024-09-19T06:43:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.566+0000 7fd020ff9640 1 -- 172.21.15.12:0/2643922354 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e394ab0d20 con 0x55e394b5e110 2024-09-19T06:43:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.566+0000 7fd020ff9640 10 client.26056 handle_command_reply: tid=0 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.566+0000 7fd04181f740 1 client.26056 shutdown 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.566+0000 7fd04181f740 1 -- 172.21.15.12:0/2643922354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 msgr2=0x55e394b494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.566+0000 7fd04181f740 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b494c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd030009a60 tx=0x7fd030004ab0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd04181f740 1 -- 172.21.15.12:0/2643922354 shutdown_connections 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd04181f740 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e394b5e110 0x55e394bcbb50 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd04181f740 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e394b4e940 0x55e394b494c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd04181f740 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e394b44080 0x55e394b48f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd020ff9640 0 client.26056 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd04181f740 1 --2- 172.21.15.12:0/2643922354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e394b43760 0x55e394b48a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd04181f740 1 -- 172.21.15.12:0/2643922354 >> 172.21.15.12:0/2643922354 conn(0x55e394b3fcf0 msgr2=0x55e394b4a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd04181f740 1 -- 172.21.15.12:0/2643922354 shutdown_connections 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd04181f740 1 -- 172.21.15.12:0/2643922354 wait complete. 2024-09-19T06:43:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd04181f740 20 client.26056 trim_cache size 0 max 16384 2024-09-19T06:43:40.570 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:43:40.570 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 32, 2024-09-19T06:43:40.570 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:43:40.570 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 14, 2024-09-19T06:43:40.570 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:43:40.570 INFO:teuthology.orchestra.run.smithi012.stdout: "6ad699ba": { 2024-09-19T06:43:40.570 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 14, 2024-09-19T06:43:40.570 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:43:40.570 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:43:40.570 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 136.6, 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:40.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:40.572 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:40.572 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:43:40.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd03f446640 1 -- 172.21.15.12:0/2364908976 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0240a3430 msgr2=0x7fd0240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:40.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd03f446640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0240a3430 0x7fd0240a58f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd030005fd0 tx=0x7fd0300095c0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd03f446640 1 -- 172.21.15.12:0/2364908976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0381049a0 msgr2=0x7fd03819ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd03f446640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0381049a0 0x7fd03819ab80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd034035040 tx=0x7fd034033b60 comp rx=0 tx=0).stop 2024-09-19T06:43:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd03f446640 1 -- 172.21.15.12:0/2364908976 shutdown_connections 2024-09-19T06:43:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd03f446640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd038109120 0x7fd03819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd03f446640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0240a3430 0x7fd0240a58f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd03f446640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0381049a0 0x7fd03819ab80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.567+0000 7fd03f446640 1 --2- 172.21.15.12:0/2364908976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd038103ff0 0x7fd03819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.568+0000 7fd03f446640 1 -- 172.21.15.12:0/2364908976 >> 172.21.15.12:0/2364908976 conn(0x7fd0380ffab0 msgr2=0x7fd038100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.568+0000 7fd03f446640 1 -- 172.21.15.12:0/2364908976 shutdown_connections 2024-09-19T06:43:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:40.568+0000 7fd03f446640 1 -- 172.21.15.12:0/2364908976 wait complete. 2024-09-19T06:43:40.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 175.0 s, 3317.8 tps, lat 27.705 ms stddev 33.286 2024-09-19T06:43:41.604 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6ad699ba', quiesce took 6.0 seconds. Will release after: 10.600000000000001 2024-09-19T06:43:42.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:41 smithi012 ceph-mon[30937]: pgmap v109: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 23 MiB/s wr, 1.23k op/s 2024-09-19T06:43:42.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:41 smithi016 ceph-mon[34911]: pgmap v109: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 23 MiB/s wr, 1.23k op/s 2024-09-19T06:43:42.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:41 smithi173 ceph-mon[35349]: pgmap v109: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 23 MiB/s wr, 1.23k op/s 2024-09-19T06:43:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:43 smithi012 ceph-mon[30937]: pgmap v110: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 18 MiB/s wr, 873 op/s 2024-09-19T06:43:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:43 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:43:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:43 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:43:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:43 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:43:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:43 smithi016 ceph-mon[34911]: pgmap v110: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 18 MiB/s wr, 873 op/s 2024-09-19T06:43:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:43 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:43:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:43 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:43:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:43 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:43:44.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:43 smithi173 ceph-mon[35349]: pgmap v110: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 18 MiB/s wr, 873 op/s 2024-09-19T06:43:44.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:43 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:43:44.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:43 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:43:44.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:43 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:43:45.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:44 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:43:45.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:44 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:43:45.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:44 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:43:45.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:44 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:43:45.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:44 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:43:45.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:44 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:43:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:43:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:45 smithi012 ceph-mon[30937]: pgmap v111: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 18 MiB/s wr, 873 op/s 2024-09-19T06:43:46.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:45 smithi016 ceph-mon[34911]: pgmap v111: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 18 MiB/s wr, 873 op/s 2024-09-19T06:43:46.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:45 smithi173 ceph-mon[35349]: pgmap v111: 97 pgs: 97 active+clean; 2.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 18 MiB/s wr, 873 op/s 2024-09-19T06:43:48.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:47 smithi012 ceph-mon[30937]: pgmap v112: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 23 MiB/s wr, 985 op/s 2024-09-19T06:43:48.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:47 smithi016 ceph-mon[34911]: pgmap v112: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 23 MiB/s wr, 985 op/s 2024-09-19T06:43:48.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:47 smithi173 ceph-mon[35349]: pgmap v112: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 23 MiB/s wr, 985 op/s 2024-09-19T06:43:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.298+0000 7f88a0265640 1 -- 172.21.15.12:0/2024908690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88981013d0 msgr2=0x7f8898105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.298+0000 7f88a0265640 1 --2- 172.21.15.12:0/2024908690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88981013d0 0x7f8898105890 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8888009900 tx=0x7f888802a480 comp rx=0 tx=0).stop 2024-09-19T06:43:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.298+0000 7f88a0265640 1 -- 172.21.15.12:0/2024908690 shutdown_connections 2024-09-19T06:43:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.298+0000 7f88a0265640 1 --2- 172.21.15.12:0/2024908690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8898105ee0 0x7f8898106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.298+0000 7f88a0265640 1 --2- 172.21.15.12:0/2024908690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88981013d0 0x7f8898105890 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.298+0000 7f88a0265640 1 --2- 172.21.15.12:0/2024908690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8898100ab0 0x7f8898100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.298+0000 7f88a0265640 1 -- 172.21.15.12:0/2024908690 >> 172.21.15.12:0/2024908690 conn(0x7f88980fc6b0 msgr2=0x7f88980fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.298+0000 7f88a0265640 1 -- 172.21.15.12:0/2024908690 shutdown_connections 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.299+0000 7f88a0265640 1 -- 172.21.15.12:0/2024908690 wait complete. 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.299+0000 7f88a0265640 1 Processor -- start 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.299+0000 7f88a0265640 1 -- start start 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.299+0000 7f88a0265640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8898100ab0 0x7f88981a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.299+0000 7f88a0265640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88981013d0 0x7f88981a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.299+0000 7f88a0265640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8898105ee0 0x7f889819e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.299+0000 7f88a0265640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f88981184c0 con 0x7f88981013d0 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.299+0000 7f88a0265640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8898118340 con 0x7f8898100ab0 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.299+0000 7f88a0265640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8898118640 con 0x7f8898105ee0 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889d800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88981013d0 0x7f88981a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889d800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88981013d0 0x7f88981a4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55740/0 (socket says 172.21.15.12:55740) 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889d800640 1 -- 172.21.15.12:0/3889767451 learned_addr learned my addr 172.21.15.12:0/3889767451 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889e802640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8898105ee0 0x7f889819e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889e001640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8898100ab0 0x7f88981a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889d800640 1 -- 172.21.15.12:0/3889767451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8898105ee0 msgr2=0x7f889819e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889d800640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8898105ee0 0x7f889819e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889d800640 1 -- 172.21.15.12:0/3889767451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8898100ab0 msgr2=0x7f88981a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889d800640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8898100ab0 0x7f88981a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889d800640 1 -- 172.21.15.12:0/3889767451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889819ef80 con 0x7f88981013d0 2024-09-19T06:43:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889e001640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8898100ab0 0x7f88981a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f889d800640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88981013d0 0x7f88981a4b80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8888006010 tx=0x7f8888004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f888effd640 1 -- 172.21.15.12:0/3889767451 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888803f030 con 0x7f88981013d0 2024-09-19T06:43:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f888effd640 1 -- 172.21.15.12:0/3889767451 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8888004440 con 0x7f88981013d0 2024-09-19T06:43:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f888effd640 1 -- 172.21.15.12:0/3889767451 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888035070 con 0x7f88981013d0 2024-09-19T06:43:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.300+0000 7f88a0265640 1 -- 172.21.15.12:0/3889767451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889819f210 con 0x7f88981013d0 2024-09-19T06:43:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.301+0000 7f88a0265640 1 -- 172.21.15.12:0/3889767451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88981ab490 con 0x7f88981013d0 2024-09-19T06:43:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.303+0000 7f888effd640 1 -- 172.21.15.12:0/3889767451 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8888042030 con 0x7f88981013d0 2024-09-19T06:43:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.303+0000 7f88a3000740 1 Processor -- start 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f88a3000740 1 -- start start 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f88a3000740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657585af0 0x562657585ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f88a3000740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657586410 0x562657590770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f88a3000740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f88a3000740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5626574ea2f0 con 0x562657590cb0 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f88a3000740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562657492270 con 0x562657586410 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f88a3000740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5626574e62b0 con 0x562657585af0 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f889d800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f889e802640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657585af0 0x562657585ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f889d800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575930a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55750/0 (socket says 172.21.15.12:55750) 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f889d800640 1 -- 172.21.15.12:0/3902580871 learned_addr learned my addr 172.21.15.12:0/3902580871 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f889e001640 1 --2- 172.21.15.12:0/3902580871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657586410 0x562657590770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.304+0000 7f888effd640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f88840a3460 0x7f88840a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f889d800640 1 -- 172.21.15.12:0/3902580871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657585af0 msgr2=0x562657585ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f889d800640 1 --2- 172.21.15.12:0/3902580871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657585af0 0x562657585ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f889d800640 1 -- 172.21.15.12:0/3902580871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657586410 msgr2=0x562657590770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f889d800640 1 --2- 172.21.15.12:0/3902580871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657586410 0x562657590770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f889d800640 1 -- 172.21.15.12:0/3902580871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562657491340 con 0x562657590cb0 2024-09-19T06:43:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f889e802640 1 --2- 172.21.15.12:0/3902580871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657585af0 0x562657585ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:43:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f889e001640 1 --2- 172.21.15.12:0/3902580871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657586410 0x562657590770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f889e802640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f88840a3460 0x7f88840a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f888effd640 1 -- 172.21.15.12:0/3889767451 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f88880f01b0 con 0x7f88981013d0 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f889d800640 1 --2- 172.21.15.12:0/3902580871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575930a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f88880ed7f0 tx=0x7f888802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b635883c136880 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f8883fff640 1 -- 172.21.15.12:0/3902580871 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888049070 con 0x562657590cb0 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f889e802640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f88840a3460 0x7f88840a5920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8890005fd0 tx=0x7f8890004a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f8883fff640 1 -- 172.21.15.12:0/3902580871 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88880bcb10 con 0x562657590cb0 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.305+0000 7f8883fff640 1 -- 172.21.15.12:0/3902580871 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88880c07c0 con 0x562657590cb0 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.306+0000 7f88a3000740 1 -- 172.21.15.12:0/3902580871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 msgr2=0x5626575930a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.306+0000 7f88a3000740 1 --2- 172.21.15.12:0/3902580871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575930a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f88880ed7f0 tx=0x7f888802a480 comp rx=0 tx=0).stop 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.306+0000 7f88a3000740 1 -- 172.21.15.12:0/3902580871 shutdown_connections 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.306+0000 7f88a3000740 1 --2- 172.21.15.12:0/3902580871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575930a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.306+0000 7f88a3000740 1 --2- 172.21.15.12:0/3902580871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657586410 0x562657590770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.306+0000 7f88a3000740 1 --2- 172.21.15.12:0/3902580871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657585af0 0x562657585ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.306+0000 7f88a3000740 1 -- 172.21.15.12:0/3902580871 >> 172.21.15.12:0/3902580871 conn(0x562657582060 msgr2=0x562657582440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.306+0000 7f88a3000740 1 -- 172.21.15.12:0/3902580871 shutdown_connections 2024-09-19T06:43:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.306+0000 7f88a3000740 1 -- 172.21.15.12:0/3902580871 wait complete. 2024-09-19T06:43:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.306+0000 7f88a3000740 1 -- start start 2024-09-19T06:43:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f88a3000740 1 Processor -- start 2024-09-19T06:43:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f88a3000740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657585af0 0x56265758db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f88a3000740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 0x56265758e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f88a3000740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657590cb0 0x56265758e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f88a3000740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562657593640 con 0x562657585af0 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f88a3000740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562657473290 con 0x562657590cb0 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f88a3000740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5626575937c0 con 0x562657586410 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f88a3000740 10 client.0 _ll_register_callbacks cb 0x5626574a4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f889e001640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657585af0 0x56265758db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f889e001640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657585af0 0x56265758db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55762/0 (socket says 172.21.15.12:55762) 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f889e001640 1 -- 172.21.15.12:0/2435271209 learned_addr learned my addr 172.21.15.12:0/2435271209 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f889e802640 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657590cb0 0x56265758e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.307+0000 7f889e001640 1 -- 172.21.15.12:0/2435271209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 msgr2=0x56265758e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f889d800640 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 0x56265758e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f889e001640 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 0x56265758e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f889e001640 1 -- 172.21.15.12:0/2435271209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657590cb0 msgr2=0x56265758e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f889e001640 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657590cb0 0x56265758e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f889e001640 1 -- 172.21.15.12:0/2435271209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626571fd210 con 0x562657585af0 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f889e802640 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657590cb0 0x56265758e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f889d800640 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 0x56265758e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f889e001640 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657585af0 0x56265758db60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f88940137c0 tx=0x7f8894013bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b396e0ae1e98c1b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f88817fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f88817fa640 1 -- 172.21.15.12:0/2435271209 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894020060 con 0x562657585af0 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f88817fa640 1 -- 172.21.15.12:0/2435271209 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8894011dd0 con 0x562657585af0 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f88a3000740 1 -- 172.21.15.12:0/2435271209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88880bcb10 con 0x562657585af0 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f88817fa640 1 -- 172.21.15.12:0/2435271209 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f889400f450 con 0x562657585af0 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f88a3000740 10 client.16515 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f88a3000740 1 -- 172.21.15.12:0/2435271209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5626572c9620 con 0x562657585af0 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f88817fa640 1 -- 172.21.15.12:0/2435271209 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88880bcb10 con 0x562657585af0 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.308+0000 7f88817fa640 1 -- 172.21.15.12:0/2435271209 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f889401a030 con 0x562657585af0 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.309+0000 7f88a3000740 10 client.16515 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.309+0000 7f88a3000740 10 client.16515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.309+0000 7f88a3000740 20 client.16515 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.309+0000 7f88a3000740 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5626575a0920 0x5626575a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.309+0000 7f88a3000740 4 client.16515 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.309+0000 7f88a3000740 1 -- 172.21.15.12:0/2435271209 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626574f7a20 con 0x5626575a0920 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.309+0000 7f889d800640 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5626575a0920 0x5626575a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.309+0000 7f889d800640 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5626575a0920 0x5626575a2d90 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5997c0c30d82e3dd server_cookie=1ecff233510cbea5 in_seq=0 out_seq=0 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.309+0000 7f88817fa640 10 client.16515 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88817fa640 1 -- 172.21.15.12:0/2435271209 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626574f7a20 con 0x5626575a0920 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88817fa640 10 client.16515 handle_command_reply: tid=0 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 client.16515 shutdown 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 -- 172.21.15.12:0/2435271209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657585af0 msgr2=0x56265758db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657585af0 0x56265758db60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f88940137c0 tx=0x7f8894013bc0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 -- 172.21.15.12:0/2435271209 shutdown_connections 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5626575a0920 0x5626575a2d90 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657590cb0 0x56265758e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 0x56265758e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 --2- 172.21.15.12:0/2435271209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657585af0 0x56265758db60 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88817fa640 0 client.16515 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 -- 172.21.15.12:0/2435271209 >> 172.21.15.12:0/2435271209 conn(0x562657582060 msgr2=0x562657587dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 -- 172.21.15.12:0/2435271209 shutdown_connections 2024-09-19T06:43:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 1 -- 172.21.15.12:0/2435271209 wait complete. 2024-09-19T06:43:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.310+0000 7f88a3000740 20 client.16515 trim_cache size 0 max 16384 2024-09-19T06:43:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f88a3000740 1 Processor -- start 2024-09-19T06:43:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f88a3000740 1 -- start start 2024-09-19T06:43:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f88a3000740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657585af0 0x56265758def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f88a3000740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657586410 0x56265758e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f88a3000740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657590cb0 0x5626575a86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f88a3000740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f88981b4100 con 0x562657586410 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f88a3000740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f88981b5d00 con 0x562657585af0 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f88a3000740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f88981b47d0 con 0x562657590cb0 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f889d800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657586410 0x56265758e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f889d800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657586410 0x56265758e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55772/0 (socket says 172.21.15.12:55772) 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.325+0000 7f889d800640 1 -- 172.21.15.12:0/471363746 learned_addr learned my addr 172.21.15.12:0/471363746 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.326+0000 7f889d800640 1 -- 172.21.15.12:0/471363746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657590cb0 msgr2=0x5626575a86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.326+0000 7f889e001640 1 --2- 172.21.15.12:0/471363746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657585af0 0x56265758def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.326+0000 7f889d800640 1 --2- 172.21.15.12:0/471363746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657590cb0 0x5626575a86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.326+0000 7f889d800640 1 -- 172.21.15.12:0/471363746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657585af0 msgr2=0x56265758def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.326+0000 7f889d800640 1 --2- 172.21.15.12:0/471363746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657585af0 0x56265758def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.326+0000 7f889d800640 1 -- 172.21.15.12:0/471363746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562657585920 con 0x562657586410 2024-09-19T06:43:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.326+0000 7f889d800640 1 --2- 172.21.15.12:0/471363746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657586410 0x56265758e430 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f88880c4b50 tx=0x7f88880f0510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5637671945fbcae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.326+0000 7f88837fe640 1 -- 172.21.15.12:0/471363746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888049040 con 0x562657586410 2024-09-19T06:43:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.326+0000 7f88837fe640 1 -- 172.21.15.12:0/471363746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88880bcb10 con 0x562657586410 2024-09-19T06:43:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.326+0000 7f88837fe640 1 -- 172.21.15.12:0/471363746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88880bc410 con 0x562657586410 2024-09-19T06:43:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 -- 172.21.15.12:0/471363746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657586410 msgr2=0x56265758e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 --2- 172.21.15.12:0/471363746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657586410 0x56265758e430 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f88880c4b50 tx=0x7f88880f0510 comp rx=0 tx=0).stop 2024-09-19T06:43:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 -- 172.21.15.12:0/471363746 shutdown_connections 2024-09-19T06:43:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 --2- 172.21.15.12:0/471363746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657590cb0 0x5626575a86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 --2- 172.21.15.12:0/471363746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657586410 0x56265758e430 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 --2- 172.21.15.12:0/471363746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657585af0 0x56265758def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 -- 172.21.15.12:0/471363746 >> 172.21.15.12:0/471363746 conn(0x562657582060 msgr2=0x56265758fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 -- 172.21.15.12:0/471363746 shutdown_connections 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 -- 172.21.15.12:0/471363746 wait complete. 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 -- start start 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.327+0000 7f88a3000740 1 Processor -- start 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88a3000740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657585af0 0x562657598b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88a3000740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 0x5626575990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88a3000740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575940d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88a3000740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f88981b5570 con 0x562657590cb0 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88a3000740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f88981b4ea0 con 0x562657585af0 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88a3000740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f88981b20e0 con 0x562657586410 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88a3000740 10 client.0 _ll_register_callbacks cb 0x7f8894009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889e802640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889e802640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575940d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55786/0 (socket says 172.21.15.12:55786) 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889e802640 1 -- 172.21.15.12:0/1885813945 learned_addr learned my addr 172.21.15.12:0/1885813945 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889e001640 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657585af0 0x562657598b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889d800640 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 0x5626575990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889e802640 1 -- 172.21.15.12:0/1885813945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 msgr2=0x5626575990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889e802640 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 0x5626575990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889e802640 1 -- 172.21.15.12:0/1885813945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657585af0 msgr2=0x562657598b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889e802640 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657585af0 0x562657598b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889e802640 1 -- 172.21.15.12:0/1885813945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562657594900 con 0x562657590cb0 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f889e802640 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575940d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f88900106a0 tx=0x7f8890009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3755ba6b5d2da1a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88817fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88817fa640 1 -- 172.21.15.12:0/1885813945 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889002b060 con 0x562657590cb0 2024-09-19T06:43:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88817fa640 1 -- 172.21.15.12:0/1885813945 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8890018070 con 0x562657590cb0 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.328+0000 7f88a3000740 1 -- 172.21.15.12:0/1885813945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88880bcb10 con 0x562657590cb0 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88817fa640 1 -- 172.21.15.12:0/1885813945 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f889001d560 con 0x562657590cb0 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88a3000740 10 client.16521 fetch_fsmap learned FSMap version 32 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88a3000740 1 -- 172.21.15.12:0/1885813945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56265760b340 con 0x562657590cb0 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88817fa640 1 -- 172.21.15.12:0/1885813945 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88880bcb10 con 0x562657590cb0 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88817fa640 1 -- 172.21.15.12:0/1885813945 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f889000f040 con 0x562657590cb0 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88a3000740 10 client.16521 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88a3000740 10 client.16521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88a3000740 20 client.16521 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88a3000740 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56265760bb80 0x56265760dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88a3000740 4 client.16521 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:43:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f88a3000740 1 -- 172.21.15.12:0/1885813945 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5626574f1d70 con 0x56265760bb80 2024-09-19T06:43:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.329+0000 7f889e001640 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56265760bb80 0x56265760dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.330+0000 7f88817fa640 10 client.16521 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.330+0000 7f889e001640 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56265760bb80 0x56265760dfa0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42bdeb84fa6c6e81 server_cookie=8f736a9e86ee4c01 in_seq=0 out_seq=0 2024-09-19T06:43:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.342+0000 7f88817fa640 1 -- 172.21.15.12:0/1885813945 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5626574f1d70 con 0x56265760bb80 2024-09-19T06:43:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.342+0000 7f88817fa640 10 client.16521 handle_command_reply: tid=0 2024-09-19T06:43:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.342+0000 7f88a3000740 1 client.16521 shutdown 2024-09-19T06:43:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 1 -- 172.21.15.12:0/1885813945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 msgr2=0x5626575940d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575940d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f88900106a0 tx=0x7f8890009600 comp rx=0 tx=0).stop 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 1 -- 172.21.15.12:0/1885813945 shutdown_connections 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56265760bb80 0x56265760dfa0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562657590cb0 0x5626575940d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88817fa640 0 client.16521 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562657586410 0x5626575990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 1 --2- 172.21.15.12:0/1885813945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562657585af0 0x562657598b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 1 -- 172.21.15.12:0/1885813945 >> 172.21.15.12:0/1885813945 conn(0x562657582060 msgr2=0x5626575809a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 1 -- 172.21.15.12:0/1885813945 shutdown_connections 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 1 -- 172.21.15.12:0/1885813945 wait complete. 2024-09-19T06:43:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.343+0000 7f88a3000740 20 client.16521 trim_cache size 0 max 16384 2024-09-19T06:43:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:43:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:43:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:43:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 -- 172.21.15.12:0/3889767451 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f88840a3460 msgr2=0x7f88840a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f88840a3460 0x7f88840a5920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8890005fd0 tx=0x7f8890004a40 comp rx=0 tx=0).stop 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 -- 172.21.15.12:0/3889767451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88981013d0 msgr2=0x7f88981a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88981013d0 0x7f88981a4b80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8888006010 tx=0x7f8888004040 comp rx=0 tx=0).stop 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 -- 172.21.15.12:0/3889767451 shutdown_connections 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f88840a3460 0x7f88840a5920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8898105ee0 0x7f889819e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88981013d0 0x7f88981a4b80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 --2- 172.21.15.12:0/3889767451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8898100ab0 0x7f88981a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 -- 172.21.15.12:0/3889767451 >> 172.21.15.12:0/3889767451 conn(0x7f88980fc6b0 msgr2=0x7f8898103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 -- 172.21.15.12:0/3889767451 shutdown_connections 2024-09-19T06:43:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:43:49.344+0000 7f88a0265640 1 -- 172.21.15.12:0/3889767451 wait complete. 2024-09-19T06:43:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:49 smithi012 ceph-mon[30937]: pgmap v113: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 526 op/s 2024-09-19T06:43:50.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:49 smithi016 ceph-mon[34911]: pgmap v113: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 526 op/s 2024-09-19T06:43:50.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:49 smithi173 ceph-mon[35349]: pgmap v113: 97 pgs: 97 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 18 MiB/s wr, 526 op/s 2024-09-19T06:43:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:43:52.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:51 smithi012 ceph-mon[30937]: pgmap v114: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 19 MiB/s wr, 581 op/s 2024-09-19T06:43:52.205 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:43:52.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:51 smithi016 ceph-mon[34911]: pgmap v114: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 19 MiB/s wr, 581 op/s 2024-09-19T06:43:52.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:51 smithi173 ceph-mon[35349]: pgmap v114: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 19 MiB/s wr, 581 op/s 2024-09-19T06:43:52.475 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.943+0000 7fee35831640 1 -- 172.21.15.12:0/2017752719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee30100a80 msgr2=0x7fee30100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.943+0000 7fee35831640 1 --2- 172.21.15.12:0/2017752719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee30100a80 0x7fee30100ee0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fee18009930 tx=0x7fee1802a420 comp rx=0 tx=0).stop 2024-09-19T06:43:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.943+0000 7fee35831640 1 -- 172.21.15.12:0/2017752719 shutdown_connections 2024-09-19T06:43:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.943+0000 7fee35831640 1 --2- 172.21.15.12:0/2017752719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee30101420 0x7fee3010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.943+0000 7fee35831640 1 --2- 172.21.15.12:0/2017752719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee30100a80 0x7fee30100ee0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.943+0000 7fee35831640 1 --2- 172.21.15.12:0/2017752719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee30106a80 0x7fee30106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.943+0000 7fee35831640 1 -- 172.21.15.12:0/2017752719 >> 172.21.15.12:0/2017752719 conn(0x7fee300fc7a0 msgr2=0x7fee300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.943+0000 7fee35831640 1 -- 172.21.15.12:0/2017752719 shutdown_connections 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.943+0000 7fee35831640 1 -- 172.21.15.12:0/2017752719 wait complete. 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee35831640 1 Processor -- start 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee35831640 1 -- start start 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee35831640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee30100a80 0x7fee30198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee35831640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee30101420 0x7fee301989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee35831640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee30106a80 0x7fee3019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee35831640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fee30110ea0 con 0x7fee30106a80 2024-09-19T06:43:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee35831640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fee30110d20 con 0x7fee30100a80 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee35831640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fee30111020 con 0x7fee30101420 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee30106a80 0x7fee3019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee2f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee30106a80 0x7fee3019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35782/0 (socket says 172.21.15.12:35782) 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee2f7fe640 1 -- 172.21.15.12:0/1704771572 learned_addr learned my addr 172.21.15.12:0/1704771572 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee2effd640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee30100a80 0x7fee30198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.944+0000 7fee267fc640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee30101420 0x7fee301989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee2f7fe640 1 -- 172.21.15.12:0/1704771572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee30101420 msgr2=0x7fee301989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee2f7fe640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee30101420 0x7fee301989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee2f7fe640 1 -- 172.21.15.12:0/1704771572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee30100a80 msgr2=0x7fee30198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee2f7fe640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee30100a80 0x7fee30198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee2f7fe640 1 -- 172.21.15.12:0/1704771572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3019d430 con 0x7fee30106a80 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee2f7fe640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee30106a80 0x7fee3019cd50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fee2800eaa0 tx=0x7fee2800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee3482f640 1 -- 172.21.15.12:0/1704771572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee28004d20 con 0x7fee30106a80 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee3482f640 1 -- 172.21.15.12:0/1704771572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee28005020 con 0x7fee30106a80 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee35831640 1 -- 172.21.15.12:0/1704771572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3019d720 con 0x7fee30106a80 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee3482f640 1 -- 172.21.15.12:0/1704771572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280116d0 con 0x7fee30106a80 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.945+0000 7fee35831640 1 -- 172.21.15.12:0/1704771572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee301a5000 con 0x7fee30106a80 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.946+0000 7fee35831640 1 -- 172.21.15.12:0/1704771572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee301021c0 con 0x7fee30106a80 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.947+0000 7fee3482f640 1 -- 172.21.15.12:0/1704771572 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fee280051d0 con 0x7fee30106a80 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.948+0000 7fee3482f640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fee1c0a33b0 0x7fee1c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.948+0000 7fee3482f640 1 -- 172.21.15.12:0/1704771572 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fee280d0050 con 0x7fee30106a80 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.948+0000 7fee2effd640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fee1c0a33b0 0x7fee1c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.948+0000 7fee2effd640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fee1c0a33b0 0x7fee1c0a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fee20009990 tx=0x7fee20009110 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:52.952+0000 7fee3482f640 1 -- 172.21.15.12:0/1704771572 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fee28016030 con 0x7fee30106a80 2024-09-19T06:43:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.165+0000 7fee35831640 1 -- 172.21.15.12:0/1704771572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee30100ee0 con 0x7fee30106a80 2024-09-19T06:43:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.165+0000 7fee3482f640 1 -- 172.21.15.12:0/1704771572 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11978 (secure 0 0 0) 0x7fee30100ee0 con 0x7fee30106a80 2024-09-19T06:43:53.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:43:53.167 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":32,"btime":"2024-09-19T06:43:29:811210+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:43:29.407725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:43:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 32 2024-09-19T06:43:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.167+0000 7fee35831640 1 -- 172.21.15.12:0/1704771572 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fee1c0a33b0 msgr2=0x7fee1c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.167+0000 7fee35831640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fee1c0a33b0 0x7fee1c0a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fee20009990 tx=0x7fee20009110 comp rx=0 tx=0).stop 2024-09-19T06:43:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.167+0000 7fee35831640 1 -- 172.21.15.12:0/1704771572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee30106a80 msgr2=0x7fee3019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.167+0000 7fee35831640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee30106a80 0x7fee3019cd50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fee2800eaa0 tx=0x7fee2800eea0 comp rx=0 tx=0).stop 2024-09-19T06:43:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.168+0000 7fee35831640 1 -- 172.21.15.12:0/1704771572 shutdown_connections 2024-09-19T06:43:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.168+0000 7fee35831640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee30106a80 0x7fee3019cd50 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.168+0000 7fee35831640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fee1c0a33b0 0x7fee1c0a5870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.168+0000 7fee35831640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee30101420 0x7fee301989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.168+0000 7fee35831640 1 --2- 172.21.15.12:0/1704771572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee30100a80 0x7fee30198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.168+0000 7fee35831640 1 -- 172.21.15.12:0/1704771572 >> 172.21.15.12:0/1704771572 conn(0x7fee300fc7a0 msgr2=0x7fee3006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.168+0000 7fee35831640 1 -- 172.21.15.12:0/1704771572 shutdown_connections 2024-09-19T06:43:53.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:53.168+0000 7fee35831640 1 -- 172.21.15.12:0/1704771572 wait complete. 2024-09-19T06:43:53.926 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 6ad699ba --release --await' 2024-09-19T06:43:53.926 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 6ad699ba --release --await 2024-09-19T06:43:54.188 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:43:54.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:53 smithi016 ceph-mon[34911]: pgmap v115: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 165 op/s 2024-09-19T06:43:54.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:53 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1704771572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:43:54.309 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:53 smithi012 ceph-mon[30937]: pgmap v115: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 165 op/s 2024-09-19T06:43:54.309 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:53 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1704771572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:43:54.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:53 smithi173 ceph-mon[35349]: pgmap v115: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 165 op/s 2024-09-19T06:43:54.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:53 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1704771572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:43:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.660+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/3206984768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f8102ef0 msgr2=0x7fd2f810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.660+0000 7fd2fe2d9640 1 --2- 172.21.15.12:0/3206984768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f8102ef0 0x7fd2f810da40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009ca0 tx=0x7fd2f002a950 comp rx=0 tx=0).stop 2024-09-19T06:43:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.660+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/3206984768 shutdown_connections 2024-09-19T06:43:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.660+0000 7fd2fe2d9640 1 --2- 172.21.15.12:0/3206984768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f8102ef0 0x7fd2f810da40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.660+0000 7fd2fe2d9640 1 --2- 172.21.15.12:0/3206984768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f8102570 0x7fd2f81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.660+0000 7fd2fe2d9640 1 --2- 172.21.15.12:0/3206984768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2f8100e20 0x7fd2f8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.660+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/3206984768 >> 172.21.15.12:0/3206984768 conn(0x7fd2f80fc7d0 msgr2=0x7fd2f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.660+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/3206984768 shutdown_connections 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.660+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/3206984768 wait complete. 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fe2d9640 1 Processor -- start 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fe2d9640 1 -- start start 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fe2d9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2f8100e20 0x7fd2f81984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fe2d9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f8102570 0x7fd2f81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fe2d9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f8102ef0 0x7fd2f819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fe2d9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f8110fa0 con 0x7fd2f8102ef0 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fe2d9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f8110e20 con 0x7fd2f8100e20 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fe2d9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f8111120 con 0x7fd2f8102570 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fc876640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f8102ef0 0x7fd2f819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fc876640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f8102ef0 0x7fd2f819cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35800/0 (socket says 172.21.15.12:35800) 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fc876640 1 -- 172.21.15.12:0/1261744026 learned_addr learned my addr 172.21.15.12:0/1261744026 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2f7fff640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2f8100e20 0x7fd2f81984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2effff640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f8102570 0x7fd2f81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fc876640 1 -- 172.21.15.12:0/1261744026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f8102570 msgr2=0x7fd2f81989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fc876640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f8102570 0x7fd2f81989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fc876640 1 -- 172.21.15.12:0/1261744026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2f8100e20 msgr2=0x7fd2f81984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fc876640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2f8100e20 0x7fd2f81984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.661+0000 7fd2fc876640 1 -- 172.21.15.12:0/1261744026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f819d460 con 0x7fd2f8102ef0 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.662+0000 7fd2effff640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f8102570 0x7fd2f81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.662+0000 7fd2fc876640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f8102ef0 0x7fd2f819cd80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0006010 tx=0x7fd2f002f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.662+0000 7fd2f5ffb640 1 -- 172.21.15.12:0/1261744026 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0034040 con 0x7fd2f8102ef0 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.662+0000 7fd2f5ffb640 1 -- 172.21.15.12:0/1261744026 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2f0003e00 con 0x7fd2f8102ef0 2024-09-19T06:43:54.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.662+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/1261744026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f819d6f0 con 0x7fd2f8102ef0 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.662+0000 7fd2f5ffb640 1 -- 172.21.15.12:0/1261744026 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0045480 con 0x7fd2f8102ef0 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.662+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/1261744026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f81a5030 con 0x7fd2f8102ef0 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.664+0000 7fd3006b2740 1 Processor -- start 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.664+0000 7fd2f5ffb640 1 -- 172.21.15.12:0/1261744026 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd2f0037020 con 0x7fd2f8102ef0 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd3006b2740 1 -- start start 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 0x55d7dfae1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfaebd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 0x55d7dfaee630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd3006b2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d7dfa46620 con 0x55d7dfae1980 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd3006b2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d7df9ede50 con 0x55d7dfaec240 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd3006b2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d7dfa425e0 con 0x55d7dfae1060 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfaebd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfaebd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35812/0 (socket says 172.21.15.12:35812) 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2f7fff640 1 -- 172.21.15.12:0/1133271379 learned_addr learned my addr 172.21.15.12:0/1133271379 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2f7fff640 1 -- 172.21.15.12:0/1133271379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 msgr2=0x55d7dfae1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2effff640 1 --2- 172.21.15.12:0/1133271379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 0x55d7dfae1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2f7fff640 1 --2- 172.21.15.12:0/1133271379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 0x55d7dfae1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2effff640 1 --2- 172.21.15.12:0/1133271379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 0x55d7dfaee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2f7fff640 1 -- 172.21.15.12:0/1133271379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 msgr2=0x55d7dfaee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2f5ffb640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd2e40a33b0 0x7fd2e40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2f7fff640 1 --2- 172.21.15.12:0/1133271379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 0x55d7dfaee630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2f7fff640 1 -- 172.21.15.12:0/1133271379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7df9ded40 con 0x55d7dfae1980 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.665+0000 7fd2effff640 1 --2- 172.21.15.12:0/1133271379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 0x55d7dfaee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.666+0000 7fd2fc876640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd2e40a33b0 0x7fd2e40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.666+0000 7fd2f7fff640 1 --2- 172.21.15.12:0/1133271379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfaebd00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800ac20 tx=0x7fd2e800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d583c29e2545c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.666+0000 7fd2f5ffb640 1 -- 172.21.15.12:0/1261744026 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd2f00f0e10 con 0x7fd2f8102ef0 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.666+0000 7fd2ee7fc640 1 -- 172.21.15.12:0/1133271379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e801d070 con 0x55d7dfae1980 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.666+0000 7fd2ee7fc640 1 -- 172.21.15.12:0/1133271379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e8018b20 con 0x55d7dfae1980 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.666+0000 7fd2ee7fc640 1 -- 172.21.15.12:0/1133271379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8010c00 con 0x55d7dfae1980 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd2fc876640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd2e40a33b0 0x7fd2e40a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00ee6a0 tx=0x7fd2f002cf70 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 -- 172.21.15.12:0/1133271379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 msgr2=0x55d7dfaebd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 --2- 172.21.15.12:0/1133271379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfaebd00 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800ac20 tx=0x7fd2e800f790 comp rx=0 tx=0).stop 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 -- 172.21.15.12:0/1133271379 shutdown_connections 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 --2- 172.21.15.12:0/1133271379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 0x55d7dfaee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 --2- 172.21.15.12:0/1133271379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfaebd00 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 --2- 172.21.15.12:0/1133271379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 0x55d7dfae1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 -- 172.21.15.12:0/1133271379 >> 172.21.15.12:0/1133271379 conn(0x55d7dfadd5f0 msgr2=0x55d7dfadd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 -- 172.21.15.12:0/1133271379 shutdown_connections 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 -- 172.21.15.12:0/1133271379 wait complete. 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 -- start start 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.667+0000 7fd3006b2740 1 Processor -- start 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1060 0x55d7dfae91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1980 0x55d7dfae9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfaec240 0x55d7dfae9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd3006b2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d7dfaeee10 con 0x55d7dfae1060 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd3006b2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d7df9cef10 con 0x55d7dfae1980 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd3006b2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d7dfaeef90 con 0x55d7dfaec240 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd3006b2740 10 client.0 _ll_register_callbacks cb 0x55d7df9f2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1060 0x55d7dfae91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1060 0x55d7dfae91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35828/0 (socket says 172.21.15.12:35828) 2024-09-19T06:43:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2effff640 1 -- 172.21.15.12:0/1901017170 learned_addr learned my addr 172.21.15.12:0/1901017170 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2f7fff640 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1980 0x55d7dfae9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2effff640 1 -- 172.21.15.12:0/1901017170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfaec240 msgr2=0x55d7dfae9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2effff640 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfaec240 0x55d7dfae9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2effff640 1 -- 172.21.15.12:0/1901017170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1980 msgr2=0x55d7dfae9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2effff640 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1980 0x55d7dfae9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2effff640 1 -- 172.21.15.12:0/1901017170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7df755580 con 0x55d7dfae1060 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2effff640 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1060 0x55d7dfae91d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011620 tx=0x7fd2e0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ba88f07dff4df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2d77fe640 1 -- 172.21.15.12:0/1901017170 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0018020 con 0x55d7dfae1060 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd2d77fe640 1 -- 172.21.15.12:0/1901017170 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd2e000d8a0 con 0x55d7dfae1060 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.668+0000 7fd3006b2740 1 -- 172.21.15.12:0/1901017170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e8018b20 con 0x55d7dfae1060 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd2d77fe640 1 -- 172.21.15.12:0/1901017170 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd2e0023050 con 0x55d7dfae1060 2024-09-19T06:43:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd3006b2740 10 client.16539 fetch_fsmap learned FSMap version 33 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd3006b2740 1 -- 172.21.15.12:0/1901017170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d7df81f960 con 0x55d7dfae1060 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd2d77fe640 1 -- 172.21.15.12:0/1901017170 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e8018b20 con 0x55d7dfae1060 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd2d77fe640 1 -- 172.21.15.12:0/1901017170 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7fd2e001c3a0 con 0x55d7dfae1060 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd3006b2740 10 client.16539 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd3006b2740 10 client.16539 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd3006b2740 20 client.16539 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd3006b2740 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d7dfafbe20 0x55d7dfafe270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd3006b2740 4 client.16539 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd3006b2740 1 -- 172.21.15.12:0/1901017170 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7dfa53b90 con 0x55d7dfafbe20 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.669+0000 7fd2f7fff640 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d7dfafbe20 0x55d7dfafe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.670+0000 7fd2d77fe640 10 client.16539 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.670+0000 7fd2f7fff640 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d7dfafbe20 0x55d7dfafe270 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72afaec70d3a1868 server_cookie=aaca4046dd60367 in_seq=0 out_seq=0 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd2d77fe640 1 -- 172.21.15.12:0/1901017170 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7dfa53b90 con 0x55d7dfafbe20 2024-09-19T06:43:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd2d77fe640 10 client.16539 handle_command_reply: tid=0 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 client.16539 shutdown 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 -- 172.21.15.12:0/1901017170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1060 msgr2=0x55d7dfae91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1060 0x55d7dfae91d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0011620 tx=0x7fd2e0011ae0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 -- 172.21.15.12:0/1901017170 shutdown_connections 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d7dfafbe20 0x55d7dfafe270 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfaec240 0x55d7dfae9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1980 0x55d7dfae9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 --2- 172.21.15.12:0/1901017170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1060 0x55d7dfae91d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 -- 172.21.15.12:0/1901017170 >> 172.21.15.12:0/1901017170 conn(0x55d7dfadd5f0 msgr2=0x55d7dfae32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd2d77fe640 0 client.16539 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 -- 172.21.15.12:0/1901017170 shutdown_connections 2024-09-19T06:43:54.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 1 -- 172.21.15.12:0/1901017170 wait complete. 2024-09-19T06:43:54.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.671+0000 7fd3006b2740 20 client.16539 trim_cache size 0 max 16384 2024-09-19T06:43:54.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.688+0000 7fd3006b2740 1 Processor -- start 2024-09-19T06:43:54.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.688+0000 7fd3006b2740 1 -- start start 2024-09-19T06:43:54.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1060 0x55d7dfae3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfadc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfaec240 0x55d7dfaf45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd3006b2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f81ada70 con 0x55d7dfae1980 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd3006b2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f81af640 con 0x55d7dfae1060 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd3006b2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f81ae140 con 0x55d7dfaec240 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfadc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfadc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35836/0 (socket says 172.21.15.12:35836) 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2f7fff640 1 -- 172.21.15.12:0/2081608057 learned_addr learned my addr 172.21.15.12:0/2081608057 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2effff640 1 --2- 172.21.15.12:0/2081608057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1060 0x55d7dfae3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2effff640 1 --2- 172.21.15.12:0/2081608057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfaec240 0x55d7dfaf45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2effff640 1 -- 172.21.15.12:0/2081608057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfaec240 msgr2=0x55d7dfaf45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2effff640 1 --2- 172.21.15.12:0/2081608057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfaec240 0x55d7dfaf45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2effff640 1 -- 172.21.15.12:0/2081608057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 msgr2=0x55d7dfadc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:54.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2effff640 1 --2- 172.21.15.12:0/2081608057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfadc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2effff640 1 -- 172.21.15.12:0/2081608057 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7dfae8180 con 0x55d7dfae1060 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.689+0000 7fd2effff640 1 --2- 172.21.15.12:0/2081608057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1060 0x55d7dfae3ac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd2e001c960 tx=0x7fd2e00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f73b190234e551f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd2edffb640 1 -- 172.21.15.12:0/2081608057 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0018070 con 0x55d7dfae1060 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd2edffb640 1 -- 172.21.15.12:0/2081608057 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e001c9e0 con 0x55d7dfae1060 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd2edffb640 1 -- 172.21.15.12:0/2081608057 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00156c0 con 0x55d7dfae1060 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd3006b2740 1 -- 172.21.15.12:0/2081608057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1060 msgr2=0x55d7dfae3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd3006b2740 1 --2- 172.21.15.12:0/2081608057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1060 0x55d7dfae3ac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd2e001c960 tx=0x7fd2e00046c0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd3006b2740 1 -- 172.21.15.12:0/2081608057 shutdown_connections 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd3006b2740 1 --2- 172.21.15.12:0/2081608057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfaec240 0x55d7dfaf45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd3006b2740 1 --2- 172.21.15.12:0/2081608057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfadc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd3006b2740 1 --2- 172.21.15.12:0/2081608057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfae1060 0x55d7dfae3ac0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd3006b2740 1 -- 172.21.15.12:0/2081608057 >> 172.21.15.12:0/2081608057 conn(0x55d7dfadd5f0 msgr2=0x55d7dfadbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd3006b2740 1 -- 172.21.15.12:0/2081608057 shutdown_connections 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.690+0000 7fd3006b2740 1 -- 172.21.15.12:0/2081608057 wait complete. 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd3006b2740 1 -- start start 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd3006b2740 1 Processor -- start 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 0x55d7dfae66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfae6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd3006b2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 0x55d7dfae5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd3006b2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f81aeee0 con 0x55d7dfae1980 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd3006b2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f81ae810 con 0x55d7dfaec240 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd3006b2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f81aba50 con 0x55d7dfae1060 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd3006b2740 10 client.0 _ll_register_callbacks cb 0x7fd2e0011260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd2effff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 0x55d7dfae66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd2f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfae6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd2effff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 0x55d7dfae66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43686/0 (socket says 172.21.15.12:43686) 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd2effff640 1 -- 172.21.15.12:0/2323687795 learned_addr learned my addr 172.21.15.12:0/2323687795 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.691+0000 7fd2effff640 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 0x55d7dfae5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd2f7fff640 1 -- 172.21.15.12:0/2323687795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 msgr2=0x55d7dfae66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd2f7fff640 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 0x55d7dfae66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd2f7fff640 1 -- 172.21.15.12:0/2323687795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 msgr2=0x55d7dfae5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd2f7fff640 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 0x55d7dfae5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd2f7fff640 1 -- 172.21.15.12:0/2323687795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7dfae5b30 con 0x55d7dfae1980 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd2f7fff640 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfae6c20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8000c00 tx=0x7fd2e80105a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3e2a8763bd59f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd2d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd2d77fe640 1 -- 172.21.15.12:0/2323687795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8031030 con 0x55d7dfae1980 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd2d77fe640 1 -- 172.21.15.12:0/2323687795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd2e80184c0 con 0x55d7dfae1980 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd3006b2740 1 -- 172.21.15.12:0/2323687795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e001c9e0 con 0x55d7dfae1980 2024-09-19T06:43:54.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd2d77fe640 1 -- 172.21.15.12:0/2323687795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd2e801d040 con 0x55d7dfae1980 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd3006b2740 10 client.16545 fetch_fsmap learned FSMap version 33 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.692+0000 7fd3006b2740 1 -- 172.21.15.12:0/2323687795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d7dfb6b530 con 0x55d7dfae1980 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd2d77fe640 1 -- 172.21.15.12:0/2323687795 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2e001c9e0 con 0x55d7dfae1980 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd2d77fe640 1 -- 172.21.15.12:0/2323687795 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7fd2e803c070 con 0x55d7dfae1980 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd3006b2740 10 client.16545 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd3006b2740 10 client.16545 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd3006b2740 20 client.16545 populate_metadata read hostname 'smithi012' 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd3006b2740 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d7dfb6ba80 0x55d7dfb6dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd3006b2740 4 client.16545 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6ad699ba", "release": true, "await": true}] 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd3006b2740 1 -- 172.21.15.12:0/2323687795 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6ad699ba", "release": true, "await": true}) -- 0x55d7dfa4e0a0 con 0x55d7dfb6ba80 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd2effff640 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d7dfb6ba80 0x55d7dfb6dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd2d77fe640 10 client.16545 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.693+0000 7fd2effff640 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d7dfb6ba80 0x55d7dfb6dea0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef73e13283bfb7da server_cookie=722e307a242a2ea1 in_seq=0 out_seq=0 2024-09-19T06:43:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.738+0000 7fd2d77fe640 1 -- 172.21.15.12:0/2323687795 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d7dfa4e0a0 con 0x55d7dfb6ba80 2024-09-19T06:43:54.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.738+0000 7fd2d77fe640 10 client.16545 handle_command_reply: tid=0 2024-09-19T06:43:54.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.738+0000 7fd3006b2740 1 client.16545 shutdown 2024-09-19T06:43:54.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.738+0000 7fd3006b2740 1 -- 172.21.15.12:0/2323687795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 msgr2=0x55d7dfae6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:54.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.738+0000 7fd3006b2740 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfae6c20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8000c00 tx=0x7fd2e80105a0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.739+0000 7fd3006b2740 1 -- 172.21.15.12:0/2323687795 shutdown_connections 2024-09-19T06:43:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.739+0000 7fd3006b2740 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d7dfb6ba80 0x55d7dfb6dea0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.739+0000 7fd2d77fe640 0 client.16545 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:43:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.739+0000 7fd3006b2740 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7dfaec240 0x55d7dfae5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.739+0000 7fd3006b2740 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7dfae1980 0x55d7dfae6c20 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.739+0000 7fd3006b2740 1 --2- 172.21.15.12:0/2323687795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7dfae1060 0x55d7dfae66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.739+0000 7fd3006b2740 1 -- 172.21.15.12:0/2323687795 >> 172.21.15.12:0/2323687795 conn(0x55d7dfadd5f0 msgr2=0x55d7dfae99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:54.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.739+0000 7fd3006b2740 1 -- 172.21.15.12:0/2323687795 shutdown_connections 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.739+0000 7fd3006b2740 1 -- 172.21.15.12:0/2323687795 wait complete. 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.739+0000 7fd3006b2740 20 client.16545 trim_cache size 0 max 16384 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 33, 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 16, 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stdout: "6ad699ba": { 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 16, 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:43:54.742 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 136.6, 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:54.744 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:54.744 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:43:54.744 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:43:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.741+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/1261744026 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd2e40a33b0 msgr2=0x7fd2e40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.741+0000 7fd2fe2d9640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd2e40a33b0 0x7fd2e40a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00ee6a0 tx=0x7fd2f002cf70 comp rx=0 tx=0).stop 2024-09-19T06:43:54.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.741+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/1261744026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f8102ef0 msgr2=0x7fd2f819cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.741+0000 7fd2fe2d9640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f8102ef0 0x7fd2f819cd80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0006010 tx=0x7fd2f002f6f0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.741+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/1261744026 shutdown_connections 2024-09-19T06:43:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.741+0000 7fd2fe2d9640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f8102ef0 0x7fd2f819cd80 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.741+0000 7fd2fe2d9640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd2e40a33b0 0x7fd2e40a5870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.741+0000 7fd2fe2d9640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2f8102570 0x7fd2f81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.742+0000 7fd2fe2d9640 1 --2- 172.21.15.12:0/1261744026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2f8100e20 0x7fd2f81984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.742+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/1261744026 >> 172.21.15.12:0/1261744026 conn(0x7fd2f80fc7d0 msgr2=0x7fd2f806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.742+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/1261744026 shutdown_connections 2024-09-19T06:43:54.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:43:54.742+0000 7fd2fe2d9640 1 -- 172.21.15.12:0/1261744026 wait complete. 2024-09-19T06:43:55.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:54 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:43:55.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:54 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:43:55.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:54 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:43:55.684 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6ad699ba', total seconds elapsed: 20.1 2024-09-19T06:43:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 190.0 s, 743.4 tps, lat 414.072 ms stddev 2322.795 2024-09-19T06:43:56.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:55 smithi016 ceph-mon[34911]: pgmap v116: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 165 op/s 2024-09-19T06:43:56.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:55 smithi173 ceph-mon[35349]: pgmap v116: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 165 op/s 2024-09-19T06:43:56.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:55 smithi012 ceph-mon[30937]: pgmap v116: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.6 MiB/s wr, 165 op/s 2024-09-19T06:43:58.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:57 smithi012 ceph-mon[30937]: pgmap v117: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 224 op/s 2024-09-19T06:43:58.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:57 smithi016 ceph-mon[34911]: pgmap v117: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 224 op/s 2024-09-19T06:43:58.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:57 smithi173 ceph-mon[35349]: pgmap v117: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 224 op/s 2024-09-19T06:44:00.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:43:59 smithi016 ceph-mon[34911]: pgmap v118: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 112 op/s 2024-09-19T06:44:00.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:43:59 smithi173 ceph-mon[35349]: pgmap v118: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 112 op/s 2024-09-19T06:44:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:43:59 smithi012 ceph-mon[30937]: pgmap v118: 97 pgs: 97 active+clean; 2.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 112 op/s 2024-09-19T06:44:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 195.0 s, 3745.0 tps, lat 25.823 ms stddev 30.488 2024-09-19T06:44:02.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:01 smithi016 ceph-mon[34911]: pgmap v119: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 440 op/s 2024-09-19T06:44:02.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:01 smithi173 ceph-mon[35349]: pgmap v119: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 440 op/s 2024-09-19T06:44:02.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:01 smithi012 ceph-mon[30937]: pgmap v119: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 440 op/s 2024-09-19T06:44:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.454+0000 7fcffceaf640 1 -- 172.21.15.12:0/2290201090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff81069c0 msgr2=0x7fcff8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.454+0000 7fcffceaf640 1 --2- 172.21.15.12:0/2290201090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff81069c0 0x7fcff8106da0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009890 tx=0x7fcfe802a380 comp rx=0 tx=0).stop 2024-09-19T06:44:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.454+0000 7fcffceaf640 1 -- 172.21.15.12:0/2290201090 shutdown_connections 2024-09-19T06:44:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.454+0000 7fcffceaf640 1 --2- 172.21.15.12:0/2290201090 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff8101350 0x7fcff810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.454+0000 7fcffceaf640 1 --2- 172.21.15.12:0/2290201090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcff81009b0 0x7fcff8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.454+0000 7fcffceaf640 1 --2- 172.21.15.12:0/2290201090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff81069c0 0x7fcff8106da0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.454+0000 7fcffceaf640 1 -- 172.21.15.12:0/2290201090 >> 172.21.15.12:0/2290201090 conn(0x7fcff8077990 msgr2=0x7fcff80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.455+0000 7fcffceaf640 1 -- 172.21.15.12:0/2290201090 shutdown_connections 2024-09-19T06:44:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.455+0000 7fcffceaf640 1 -- 172.21.15.12:0/2290201090 wait complete. 2024-09-19T06:44:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.455+0000 7fcffceaf640 1 Processor -- start 2024-09-19T06:44:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.455+0000 7fcffceaf640 1 -- start start 2024-09-19T06:44:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcffceaf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcff81009b0 0x7fcff819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcffceaf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff8101350 0x7fcff819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcffceaf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff81069c0 0x7fcff819ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcffceaf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcff8110e00 con 0x7fcff81069c0 2024-09-19T06:44:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcffceaf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcff8110c80 con 0x7fcff81009b0 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcffceaf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcff8110f80 con 0x7fcff8101350 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff81069c0 0x7fcff819ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcff81009b0 0x7fcff819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff81069c0 0x7fcff819ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39854/0 (socket says 172.21.15.12:39854) 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff6d9d640 1 -- 172.21.15.12:0/502619250 learned_addr learned my addr 172.21.15.12:0/502619250 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcff81009b0 0x7fcff819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56998/0 (socket says 172.21.15.12:56998) 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff8101350 0x7fcff819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff5d9b640 1 -- 172.21.15.12:0/502619250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcff81009b0 msgr2=0x7fcff819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcff81009b0 0x7fcff819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff5d9b640 1 -- 172.21.15.12:0/502619250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff81069c0 msgr2=0x7fcff819ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff81069c0 0x7fcff819ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff5d9b640 1 -- 172.21.15.12:0/502619250 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff819f510 con 0x7fcff8101350 2024-09-19T06:44:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.456+0000 7fcff6d9d640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff81069c0 0x7fcff819ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.457+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff8101350 0x7fcff819aa60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00e9f0 tx=0x7fcfec00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.457+0000 7fcfe77fe640 1 -- 172.21.15.12:0/502619250 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00ccc0 con 0x7fcff8101350 2024-09-19T06:44:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.457+0000 7fcffceaf640 1 -- 172.21.15.12:0/502619250 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff819f800 con 0x7fcff8101350 2024-09-19T06:44:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.457+0000 7fcfe77fe640 1 -- 172.21.15.12:0/502619250 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfec010910 con 0x7fcff8101350 2024-09-19T06:44:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.457+0000 7fcfe77fe640 1 -- 172.21.15.12:0/502619250 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec018960 con 0x7fcff8101350 2024-09-19T06:44:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.457+0000 7fcffceaf640 1 -- 172.21.15.12:0/502619250 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff81a7090 con 0x7fcff8101350 2024-09-19T06:44:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.459+0000 7fcfe77fe640 1 -- 172.21.15.12:0/502619250 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcfec010ac0 con 0x7fcff8101350 2024-09-19T06:44:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcfffc40740 1 Processor -- start 2024-09-19T06:44:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcfffc40740 1 -- start start 2024-09-19T06:44:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a04aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcfe77fe640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcfe00a34e0 0x7fcfe00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04b410 0x56005a055770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a055cb0 0x56005a0580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcfffc40740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560059faf2f0 con 0x56005a04b410 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcfffc40740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560059f57270 con 0x56005a055cb0 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcfffc40740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560059fab2b0 con 0x56005a04aaf0 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcff659c640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcfe00a34e0 0x7fcfe00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcff6d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a04aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcff5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04b410 0x56005a055770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcfe77fe640 1 -- 172.21.15.12:0/502619250 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcfec0d00b0 con 0x7fcff8101350 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcff6d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a04aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:50720/0 (socket says 172.21.15.12:50720) 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcff5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04b410 0x56005a055770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39864/0 (socket says 172.21.15.12:39864) 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcff6d9d640 1 -- 172.21.15.12:0/2325386586 learned_addr learned my addr 172.21.15.12:0/2325386586 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.460+0000 7fcff6d9d640 1 --2- 172.21.15.12:0/2325386586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a055cb0 0x56005a0580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.461+0000 7fcff6d9d640 1 -- 172.21.15.12:0/2325386586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a055cb0 msgr2=0x56005a0580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.461+0000 7fcff6d9d640 1 --2- 172.21.15.12:0/2325386586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a055cb0 0x56005a0580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.461+0000 7fcff6d9d640 1 -- 172.21.15.12:0/2325386586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04b410 msgr2=0x56005a055770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.461+0000 7fcff6d9d640 1 --2- 172.21.15.12:0/2325386586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04b410 0x56005a055770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.461+0000 7fcff6d9d640 1 -- 172.21.15.12:0/2325386586 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560059f56340 con 0x56005a04aaf0 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.461+0000 7fcff659c640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcfe00a34e0 0x7fcfe00a59a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8000c00 tx=0x7fcfe8005890 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.461+0000 7fcff6d9d640 1 --2- 172.21.15.12:0/2325386586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a04aed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcff000efd0 tx=0x7fcff0010040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60bbc17b0a498a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.461+0000 7fcfe4ff9640 1 -- 172.21.15.12:0/2325386586 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff0022070 con 0x56005a04aaf0 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.461+0000 7fcfe4ff9640 1 -- 172.21.15.12:0/2325386586 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcff001d920 con 0x56005a04aaf0 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.461+0000 7fcfe4ff9640 1 -- 172.21.15.12:0/2325386586 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff001b880 con 0x56005a04aaf0 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 -- 172.21.15.12:0/2325386586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 msgr2=0x56005a04aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 --2- 172.21.15.12:0/2325386586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a04aed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcff000efd0 tx=0x7fcff0010040 comp rx=0 tx=0).stop 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 -- 172.21.15.12:0/2325386586 shutdown_connections 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 --2- 172.21.15.12:0/2325386586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a055cb0 0x56005a0580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 --2- 172.21.15.12:0/2325386586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04b410 0x56005a055770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 --2- 172.21.15.12:0/2325386586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a04aed0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 -- 172.21.15.12:0/2325386586 >> 172.21.15.12:0/2325386586 conn(0x56005a047060 msgr2=0x56005a047440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 -- 172.21.15.12:0/2325386586 shutdown_connections 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 -- 172.21.15.12:0/2325386586 wait complete. 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 -- start start 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.462+0000 7fcfffc40740 1 Processor -- start 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a052be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 0x56005a053120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a055cb0 0x56005a053660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcfffc40740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56005a058880 con 0x56005a055cb0 2024-09-19T06:44:02.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcfffc40740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560059f38290 con 0x56005a04b410 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcfffc40740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56005a058a00 con 0x56005a04aaf0 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcfffc40740 10 client.0 _ll_register_callbacks cb 0x560059f69140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a052be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a052be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:50728/0 (socket says 172.21.15.12:50728) 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff659c640 1 -- 172.21.15.12:0/447661241 learned_addr learned my addr 172.21.15.12:0/447661241 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 0x56005a053120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff6d9d640 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a055cb0 0x56005a053660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff5d9b640 1 -- 172.21.15.12:0/447661241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 msgr2=0x56005a052be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a052be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff5d9b640 1 -- 172.21.15.12:0/447661241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a055cb0 msgr2=0x56005a053660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a055cb0 0x56005a053660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff5d9b640 1 -- 172.21.15.12:0/447661241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560059cc2210 con 0x56005a04b410 2024-09-19T06:44:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff6d9d640 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a055cb0 0x56005a053660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff659c640 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a052be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 0x56005a053120 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0cd780 tx=0x7fcfec09be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da216c7c284b6ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcfddffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcfddffb640 1 -- 172.21.15.12:0/447661241 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec099bf0 con 0x56005a04b410 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.463+0000 7fcfddffb640 1 -- 172.21.15.12:0/447661241 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcfec0a42f0 con 0x56005a04b410 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfffc40740 1 -- 172.21.15.12:0/447661241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcff001d920 con 0x56005a04b410 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfddffb640 1 -- 172.21.15.12:0/447661241 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcfec0a46f0 con 0x56005a04b410 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfffc40740 10 client.26108 fetch_fsmap learned FSMap version 33 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfffc40740 1 -- 172.21.15.12:0/447661241 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560059d8e620 con 0x56005a04b410 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfddffb640 1 -- 172.21.15.12:0/447661241 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcff001d920 con 0x56005a04b410 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfddffb640 1 -- 172.21.15.12:0/447661241 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7fcfec0b5120 con 0x56005a04b410 2024-09-19T06:44:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfffc40740 10 client.26108 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T06:44:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfffc40740 10 client.26108 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfffc40740 20 client.26108 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfffc40740 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56005a065c40 0x56005a068070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfffc40740 4 client.26108 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcfffc40740 1 -- 172.21.15.12:0/447661241 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560059fbca20 con 0x56005a065c40 2024-09-19T06:44:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.464+0000 7fcff659c640 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56005a065c40 0x56005a068070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.465+0000 7fcff659c640 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56005a065c40 0x56005a068070 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3547e358301ebb09 server_cookie=4100bc1d2a7a80a8 in_seq=0 out_seq=0 2024-09-19T06:44:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.465+0000 7fcfddffb640 10 client.26108 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.465+0000 7fcfddffb640 1 -- 172.21.15.12:0/447661241 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560059fbca20 con 0x56005a065c40 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.465+0000 7fcfddffb640 10 client.26108 handle_command_reply: tid=0 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.465+0000 7fcfffc40740 1 client.26108 shutdown 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.465+0000 7fcfffc40740 1 -- 172.21.15.12:0/447661241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 msgr2=0x56005a053120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfffc40740 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 0x56005a053120 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0cd780 tx=0x7fcfec09be10 comp rx=0 tx=0).stop 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfffc40740 1 -- 172.21.15.12:0/447661241 shutdown_connections 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfffc40740 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56005a065c40 0x56005a068070 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfffc40740 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a055cb0 0x56005a053660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfffc40740 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 0x56005a053120 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfddffb640 0 client.26108 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfffc40740 1 --2- 172.21.15.12:0/447661241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04aaf0 0x56005a052be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfffc40740 1 -- 172.21.15.12:0/447661241 >> 172.21.15.12:0/447661241 conn(0x56005a047060 msgr2=0x56005a04cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfffc40740 1 -- 172.21.15.12:0/447661241 shutdown_connections 2024-09-19T06:44:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfffc40740 1 -- 172.21.15.12:0/447661241 wait complete. 2024-09-19T06:44:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.466+0000 7fcfffc40740 20 client.26108 trim_cache size 0 max 16384 2024-09-19T06:44:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.482+0000 7fcfffc40740 1 Processor -- start 2024-09-19T06:44:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.482+0000 7fcfffc40740 1 -- start start 2024-09-19T06:44:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.482+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a053490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.482+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04b410 0x56005a06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.482+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a055cb0 0x56005a06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.482+0000 7fcfffc40740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81afc50 con 0x56005a04aaf0 2024-09-19T06:44:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.482+0000 7fcfffc40740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81b1820 con 0x56005a055cb0 2024-09-19T06:44:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.482+0000 7fcfffc40740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81b0320 con 0x56005a04b410 2024-09-19T06:44:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a053490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a053490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39874/0 (socket says 172.21.15.12:39874) 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff659c640 1 -- 172.21.15.12:0/3187785065 learned_addr learned my addr 172.21.15.12:0/3187785065 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/3187785065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04b410 0x56005a06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff6d9d640 1 --2- 172.21.15.12:0/3187785065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a055cb0 0x56005a06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff659c640 1 -- 172.21.15.12:0/3187785065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04b410 msgr2=0x56005a06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff659c640 1 --2- 172.21.15.12:0/3187785065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04b410 0x56005a06d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff659c640 1 -- 172.21.15.12:0/3187785065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a055cb0 msgr2=0x56005a06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff659c640 1 --2- 172.21.15.12:0/3187785065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a055cb0 0x56005a06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff659c640 1 -- 172.21.15.12:0/3187785065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005a0686f0 con 0x56005a04aaf0 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcff659c640 1 --2- 172.21.15.12:0/3187785065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a053490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcfe802a970 tx=0x7fcfe803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41876915bbebaa87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcfdffff640 1 -- 172.21.15.12:0/3187785065 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8037040 con 0x56005a04aaf0 2024-09-19T06:44:02.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcfdffff640 1 -- 172.21.15.12:0/3187785065 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfe8003ad0 con 0x56005a04aaf0 2024-09-19T06:44:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.483+0000 7fcfdffff640 1 -- 172.21.15.12:0/3187785065 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe804a9c0 con 0x56005a04aaf0 2024-09-19T06:44:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 -- 172.21.15.12:0/3187785065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 msgr2=0x56005a053490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 --2- 172.21.15.12:0/3187785065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a053490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcfe802a970 tx=0x7fcfe803c000 comp rx=0 tx=0).stop 2024-09-19T06:44:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 -- 172.21.15.12:0/3187785065 shutdown_connections 2024-09-19T06:44:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 --2- 172.21.15.12:0/3187785065 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a055cb0 0x56005a06dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 --2- 172.21.15.12:0/3187785065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a04b410 0x56005a06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 --2- 172.21.15.12:0/3187785065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a053490 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 -- 172.21.15.12:0/3187785065 >> 172.21.15.12:0/3187785065 conn(0x56005a047060 msgr2=0x56005a054c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 -- 172.21.15.12:0/3187785065 shutdown_connections 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 -- 172.21.15.12:0/3187785065 wait complete. 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 -- start start 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.484+0000 7fcfffc40740 1 Processor -- start 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a04fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 0x56005a050160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfffc40740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a055cb0 0x56005a0506a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfffc40740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81b10c0 con 0x56005a04aaf0 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfffc40740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81b09f0 con 0x56005a04b410 2024-09-19T06:44:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfffc40740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81adc30 con 0x56005a055cb0 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfffc40740 10 client.0 _ll_register_callbacks cb 0x7fcfec098710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a04fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a04fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39890/0 (socket says 172.21.15.12:39890) 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff659c640 1 -- 172.21.15.12:0/3996518562 learned_addr learned my addr 172.21.15.12:0/3996518562 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff6d9d640 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a055cb0 0x56005a0506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 0x56005a050160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff659c640 1 -- 172.21.15.12:0/3996518562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a055cb0 msgr2=0x56005a0506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff659c640 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a055cb0 0x56005a0506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff659c640 1 -- 172.21.15.12:0/3996518562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 msgr2=0x56005a050160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff659c640 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 0x56005a050160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff659c640 1 -- 172.21.15.12:0/3996518562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56005a046e90 con 0x56005a04aaf0 2024-09-19T06:44:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 0x56005a050160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff6d9d640 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a055cb0 0x56005a0506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcff659c640 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a04fc20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80304f0 tx=0x7fcfe804a450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8dd4cbc0e443dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfddffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfddffb640 1 -- 172.21.15.12:0/3996518562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8061060 con 0x56005a04aaf0 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfddffb640 1 -- 172.21.15.12:0/3996518562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fcfe80035f0 con 0x56005a04aaf0 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.485+0000 7fcfffc40740 1 -- 172.21.15.12:0/3996518562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfe8003ad0 con 0x56005a04aaf0 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfddffb640 1 -- 172.21.15.12:0/3996518562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcfe8037070 con 0x56005a04aaf0 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfffc40740 10 client.16563 fetch_fsmap learned FSMap version 33 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfffc40740 1 -- 172.21.15.12:0/3996518562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56005a0d0a70 con 0x56005a04aaf0 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfddffb640 1 -- 172.21.15.12:0/3996518562 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfe8003ad0 con 0x56005a04aaf0 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfddffb640 1 -- 172.21.15.12:0/3996518562 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7fcfe8052070 con 0x56005a04aaf0 2024-09-19T06:44:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfffc40740 10 client.16563 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T06:44:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfffc40740 10 client.16563 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfffc40740 20 client.16563 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfffc40740 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56005a0d1270 0x56005a0d3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfffc40740 4 client.16563 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:44:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcfffc40740 1 -- 172.21.15.12:0/3996518562 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560059fb6d70 con 0x56005a0d1270 2024-09-19T06:44:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.486+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56005a0d1270 0x56005a0d3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.487+0000 7fcfddffb640 10 client.16563 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:02.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.487+0000 7fcff5d9b640 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56005a0d1270 0x56005a0d3690 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=784b6e825f5c7cdc server_cookie=634b1e2fa42ab653 in_seq=0 out_seq=0 2024-09-19T06:44:02.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfddffb640 1 -- 172.21.15.12:0/3996518562 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560059fb6d70 con 0x56005a0d1270 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfddffb640 10 client.16563 handle_command_reply: tid=0 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 client.16563 shutdown 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 -- 172.21.15.12:0/3996518562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 msgr2=0x56005a04fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a04fc20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80304f0 tx=0x7fcfe804a450 comp rx=0 tx=0).stop 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 -- 172.21.15.12:0/3996518562 shutdown_connections 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56005a0d1270 0x56005a0d3690 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56005a055cb0 0x56005a0506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56005a04b410 0x56005a050160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfddffb640 0 client.16563 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 --2- 172.21.15.12:0/3996518562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56005a04aaf0 0x56005a04fc20 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 -- 172.21.15.12:0/3996518562 >> 172.21.15.12:0/3996518562 conn(0x56005a047060 msgr2=0x56005a054c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:02.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 -- 172.21.15.12:0/3996518562 shutdown_connections 2024-09-19T06:44:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 1 -- 172.21.15.12:0/3996518562 wait complete. 2024-09-19T06:44:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.499+0000 7fcfffc40740 20 client.16563 trim_cache size 0 max 16384 2024-09-19T06:44:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:44:02.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:44:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:44:02.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:44:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 -- 172.21.15.12:0/502619250 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcfe00a34e0 msgr2=0x7fcfe00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcfe00a34e0 0x7fcfe00a59a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8000c00 tx=0x7fcfe8005890 comp rx=0 tx=0).stop 2024-09-19T06:44:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 -- 172.21.15.12:0/502619250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff8101350 msgr2=0x7fcff819aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff8101350 0x7fcff819aa60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00e9f0 tx=0x7fcfec00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 -- 172.21.15.12:0/502619250 shutdown_connections 2024-09-19T06:44:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff81069c0 0x7fcff819ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcfe00a34e0 0x7fcfe00a59a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff8101350 0x7fcff819aa60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 --2- 172.21.15.12:0/502619250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcff81009b0 0x7fcff819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 -- 172.21.15.12:0/502619250 >> 172.21.15.12:0/502619250 conn(0x7fcff8077990 msgr2=0x7fcff8104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 -- 172.21.15.12:0/502619250 shutdown_connections 2024-09-19T06:44:02.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:02.500+0000 7fcffceaf640 1 -- 172.21.15.12:0/502619250 wait complete. 2024-09-19T06:44:04.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:03 smithi016 ceph-mon[34911]: pgmap v120: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 21 MiB/s wr, 386 op/s 2024-09-19T06:44:04.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:03 smithi173 ceph-mon[35349]: pgmap v120: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 21 MiB/s wr, 386 op/s 2024-09-19T06:44:04.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:03 smithi012 ceph-mon[30937]: pgmap v120: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 21 MiB/s wr, 386 op/s 2024-09-19T06:44:05.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:04 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:44:05.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:04 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:44:05.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:04 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:44:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 200.0 s, 2071.6 tps, lat 50.037 ms stddev 115.727 2024-09-19T06:44:06.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:05 smithi016 ceph-mon[34911]: pgmap v121: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 21 MiB/s wr, 386 op/s 2024-09-19T06:44:06.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:05 smithi173 ceph-mon[35349]: pgmap v121: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 21 MiB/s wr, 386 op/s 2024-09-19T06:44:06.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:05 smithi012 ceph-mon[30937]: pgmap v121: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 21 MiB/s wr, 386 op/s 2024-09-19T06:44:07.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:44:08.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:07 smithi012 ceph-mon[30937]: pgmap v122: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 60 MiB/s wr, 1.42k op/s 2024-09-19T06:44:08.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:07 smithi016 ceph-mon[34911]: pgmap v122: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 60 MiB/s wr, 1.42k op/s 2024-09-19T06:44:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:08.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:07 smithi173 ceph-mon[35349]: pgmap v122: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 60 MiB/s wr, 1.42k op/s 2024-09-19T06:44:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.872+0000 7f0c216c7640 1 -- 172.21.15.12:0/3266993154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c140acc20 msgr2=0x7f0c140b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.872+0000 7f0c216c7640 1 --2- 172.21.15.12:0/3266993154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c140acc20 0x7f0c140b3570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c067960 tx=0x7f0c1c08e340 comp rx=0 tx=0).stop 2024-09-19T06:44:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.872+0000 7f0c216c7640 1 -- 172.21.15.12:0/3266993154 shutdown_connections 2024-09-19T06:44:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.872+0000 7f0c216c7640 1 --2- 172.21.15.12:0/3266993154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c140acc20 0x7f0c140b3570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.872+0000 7f0c216c7640 1 --2- 172.21.15.12:0/3266993154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c140a5400 0x7f0c140ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.872+0000 7f0c216c7640 1 --2- 172.21.15.12:0/3266993154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c140a4a50 0x7f0c140a4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.872+0000 7f0c216c7640 1 -- 172.21.15.12:0/3266993154 >> 172.21.15.12:0/3266993154 conn(0x7f0c1401a0a0 msgr2=0x7f0c1401a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:08.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.873+0000 7f0c216c7640 1 -- 172.21.15.12:0/3266993154 shutdown_connections 2024-09-19T06:44:08.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.873+0000 7f0c216c7640 1 -- 172.21.15.12:0/3266993154 wait complete. 2024-09-19T06:44:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.874+0000 7f0c216c7640 1 Processor -- start 2024-09-19T06:44:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.874+0000 7f0c216c7640 1 -- start start 2024-09-19T06:44:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.875+0000 7f0c216c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c140a4a50 0x7f0c1413cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.875+0000 7f0c216c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c140a5400 0x7f0c1413d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.875+0000 7f0c216c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c140acc20 0x7f0c14141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.875+0000 7f0c216c7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0c140b6950 con 0x7f0c140a5400 2024-09-19T06:44:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.875+0000 7f0c216c7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c140b67d0 con 0x7f0c140a4a50 2024-09-19T06:44:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.875+0000 7f0c216c7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0c140b6ad0 con 0x7f0c140acc20 2024-09-19T06:44:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.875+0000 7f0c20ec6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c140acc20 0x7f0c14141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.875+0000 7f0c20ec6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c140acc20 0x7f0c14141660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:50750/0 (socket says 172.21.15.12:50750) 2024-09-19T06:44:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.875+0000 7f0c20ec6640 1 -- 172.21.15.12:0/388876189 learned_addr learned my addr 172.21.15.12:0/388876189 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.875+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c140a5400 0x7f0c1413d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.876+0000 7f0c20ec6640 1 -- 172.21.15.12:0/388876189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c140a4a50 msgr2=0x7f0c1413cd90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:44:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.876+0000 7f0c20ec6640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c140a4a50 0x7f0c1413cd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.876+0000 7f0c20ec6640 1 -- 172.21.15.12:0/388876189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c140a5400 msgr2=0x7f0c1413d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.876+0000 7f0c20ec6640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c140a5400 0x7f0c1413d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.876+0000 7f0c20ec6640 1 -- 172.21.15.12:0/388876189 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c14141d40 con 0x7f0c140acc20 2024-09-19T06:44:08.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.876+0000 7f0c20ec6640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c140acc20 0x7f0c14141660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c067c70 tx=0x7f0c1c06dc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:08.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.876+0000 7f0c197fa640 1 -- 172.21.15.12:0/388876189 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0b8420 con 0x7f0c140acc20 2024-09-19T06:44:08.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.876+0000 7f0c197fa640 1 -- 172.21.15.12:0/388876189 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c1c0b8aa0 con 0x7f0c140acc20 2024-09-19T06:44:08.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.877+0000 7f0c197fa640 1 -- 172.21.15.12:0/388876189 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0b8420 con 0x7f0c140acc20 2024-09-19T06:44:08.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.877+0000 7f0c216c7640 1 -- 172.21.15.12:0/388876189 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c14141fd0 con 0x7f0c140acc20 2024-09-19T06:44:08.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.878+0000 7f0c216c7640 1 -- 172.21.15.12:0/388876189 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c14142370 con 0x7f0c140acc20 2024-09-19T06:44:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.881+0000 7f0c197fa640 1 -- 172.21.15.12:0/388876189 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0c1c094020 con 0x7f0c140acc20 2024-09-19T06:44:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.882+0000 7f0c24d02740 1 Processor -- start 2024-09-19T06:44:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.882+0000 7f0c24d02740 1 -- start start 2024-09-19T06:44:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.882+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 0x56042dac4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.882+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dac4f90 0x56042dacf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.882+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dacf850 0x56042dad1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.882+0000 7f0c24d02740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56042da2a2e0 con 0x56042dac4f90 2024-09-19T06:44:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.882+0000 7f0c24d02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56042d9d1ce0 con 0x56042dacf850 2024-09-19T06:44:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.882+0000 7f0c24d02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56042da262a0 con 0x56042dac4670 2024-09-19T06:44:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.883+0000 7f0c1bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dac4f90 0x56042dacf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.883+0000 7f0c1bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dac4f90 0x56042dacf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39932/0 (socket says 172.21.15.12:39932) 2024-09-19T06:44:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.883+0000 7f0c1bfff640 1 -- 172.21.15.12:0/1178342391 learned_addr learned my addr 172.21.15.12:0/1178342391 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.883+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1178342391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 0x56042dac4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.883+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1178342391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dacf850 0x56042dad1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.884+0000 7f0c197fa640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c0c0a37c0 0x7f0c0c0a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.885+0000 7f0c1bfff640 1 -- 172.21.15.12:0/1178342391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 msgr2=0x56042dac4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:08.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.885+0000 7f0c1bfff640 1 --2- 172.21.15.12:0/1178342391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 0x56042dac4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.885+0000 7f0c1bfff640 1 -- 172.21.15.12:0/1178342391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dacf850 msgr2=0x56042dad1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:08.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.885+0000 7f0c1bfff640 1 --2- 172.21.15.12:0/1178342391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dacf850 0x56042dad1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.885+0000 7f0c1bfff640 1 -- 172.21.15.12:0/1178342391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56042d9b6440 con 0x56042dac4f90 2024-09-19T06:44:08.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.885+0000 7f0c20ec6640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c0c0a37c0 0x7f0c0c0a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.885+0000 7f0c1bfff640 1 --2- 172.21.15.12:0/1178342391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dac4f90 0x56042dacf310 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000ba80 tx=0x7f0c1000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3395f5aea6120827 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.885+0000 7f0c197fa640 1 -- 172.21.15.12:0/388876189 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0c1c0be070 con 0x7f0c140acc20 2024-09-19T06:44:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.886+0000 7f0c067fc640 1 -- 172.21.15.12:0/1178342391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10016070 con 0x56042dac4f90 2024-09-19T06:44:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.886+0000 7f0c20ec6640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c0c0a37c0 0x7f0c0c0a5c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c172000 tx=0x7f0c1c1102c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.886+0000 7f0c067fc640 1 -- 172.21.15.12:0/1178342391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c10005500 con 0x56042dac4f90 2024-09-19T06:44:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.887+0000 7f0c24d02740 1 -- 172.21.15.12:0/1178342391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dac4f90 msgr2=0x56042dacf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.887+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1178342391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dac4f90 0x56042dacf310 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000ba80 tx=0x7f0c1000bf40 comp rx=0 tx=0).stop 2024-09-19T06:44:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.887+0000 7f0c24d02740 1 -- 172.21.15.12:0/1178342391 shutdown_connections 2024-09-19T06:44:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.887+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1178342391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dacf850 0x56042dad1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.887+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1178342391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dac4f90 0x56042dacf310 secure :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000ba80 tx=0x7f0c1000bf40 comp rx=0 tx=0).stop 2024-09-19T06:44:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.887+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1178342391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 0x56042dac4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.887+0000 7f0c24d02740 1 -- 172.21.15.12:0/1178342391 >> 172.21.15.12:0/1178342391 conn(0x56042dac0c00 msgr2=0x56042dac0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:08.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.888+0000 7f0c24d02740 1 -- 172.21.15.12:0/1178342391 shutdown_connections 2024-09-19T06:44:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.888+0000 7f0c24d02740 1 -- 172.21.15.12:0/1178342391 wait complete. 2024-09-19T06:44:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.888+0000 7f0c24d02740 1 -- start start 2024-09-19T06:44:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c24d02740 1 Processor -- start 2024-09-19T06:44:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 0x56042dacf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dacf850 0x56042dacc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacca80 0x56042daccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c24d02740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56042dad2470 con 0x56042dacca80 2024-09-19T06:44:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c24d02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56042d9e5050 con 0x56042dacf850 2024-09-19T06:44:08.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c24d02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56042dad25f0 con 0x56042dac4670 2024-09-19T06:44:08.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c24d02740 10 client.0 _ll_register_callbacks cb 0x56042da25160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:08.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 0x56042dacf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 0x56042dacf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:50780/0 (socket says 172.21.15.12:50780) 2024-09-19T06:44:08.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c1b7fe640 1 -- 172.21.15.12:0/1066032742 learned_addr learned my addr 172.21.15.12:0/1066032742 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:08.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacca80 0x56042daccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.889+0000 7f0c1bfff640 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dacf850 0x56042dacc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.890+0000 7f0c1b7fe640 1 -- 172.21.15.12:0/1066032742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dacf850 msgr2=0x56042dacc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:08.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.890+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dacf850 0x56042dacc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.890+0000 7f0c1b7fe640 1 -- 172.21.15.12:0/1066032742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacca80 msgr2=0x56042daccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.890+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacca80 0x56042daccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.890+0000 7f0c1b7fe640 1 -- 172.21.15.12:0/1066032742 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56042d79b3c0 con 0x56042dac4670 2024-09-19T06:44:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.891+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 0x56042dacf240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0c08011f00 tx=0x7f0c08005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=355bccca66558c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.892+0000 7f0bfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:44:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.892+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1066032742 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0801c040 con 0x56042dac4670 2024-09-19T06:44:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.892+0000 7f0c24d02740 1 -- 172.21.15.12:0/1066032742 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c10005500 con 0x56042dac4670 2024-09-19T06:44:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.892+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1066032742 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0c0800ee40 con 0x56042dac4670 2024-09-19T06:44:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.892+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1066032742 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0c08028050 con 0x56042dac4670 2024-09-19T06:44:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.892+0000 7f0c24d02740 10 client.26110 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.892+0000 7f0c24d02740 1 -- 172.21.15.12:0/1066032742 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56042dade450 con 0x56042dac4670 2024-09-19T06:44:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.892+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1066032742 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c10005500 con 0x56042dac4670 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.893+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1066032742 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f0c08021570 con 0x56042dac4670 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.893+0000 7f0c24d02740 10 client.26110 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.893+0000 7f0c24d02740 10 client.26110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.893+0000 7f0c24d02740 20 client.26110 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.893+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56042dadfcf0 0x56042dae2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.893+0000 7f0c24d02740 4 client.26110 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.893+0000 7f0c24d02740 1 -- 172.21.15.12:0/1066032742 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56042da37850 con 0x56042dadfcf0 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.893+0000 7f0c1bfff640 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56042dadfcf0 0x56042dae2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.894+0000 7f0c1bfff640 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56042dadfcf0 0x56042dae2170 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfc7f5084232ffde server_cookie=c3bb027c4657851a in_seq=0 out_seq=0 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.894+0000 7f0bfb7fe640 10 client.26110 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.895+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1066032742 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56042da37850 con 0x56042dadfcf0 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.895+0000 7f0bfb7fe640 10 client.26110 handle_command_reply: tid=0 2024-09-19T06:44:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.895+0000 7f0c24d02740 1 client.26110 shutdown 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0c24d02740 1 -- 172.21.15.12:0/1066032742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 msgr2=0x56042dacf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 0x56042dacf240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0c08011f00 tx=0x7f0c08005f90 comp rx=0 tx=0).stop 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0c24d02740 1 -- 172.21.15.12:0/1066032742 shutdown_connections 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56042dadfcf0 0x56042dae2170 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacca80 0x56042daccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dacf850 0x56042dacc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1066032742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dac4670 0x56042dacf240 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0c08011f00 tx=0x7f0c08005f90 comp rx=0 tx=0).stop 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0c24d02740 1 -- 172.21.15.12:0/1066032742 >> 172.21.15.12:0/1066032742 conn(0x56042dac0c00 msgr2=0x56042dac6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0bfb7fe640 0 client.26110 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0c24d02740 1 -- 172.21.15.12:0/1066032742 shutdown_connections 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.896+0000 7f0c24d02740 1 -- 172.21.15.12:0/1066032742 wait complete. 2024-09-19T06:44:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.897+0000 7f0c24d02740 20 client.26110 trim_cache size 0 max 16384 2024-09-19T06:44:08.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.933+0000 7f0c24d02740 1 Processor -- start 2024-09-19T06:44:08.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.933+0000 7f0c24d02740 1 -- start start 2024-09-19T06:44:08.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 0x56042dae7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 0x56042dae7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 0x56042dac9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c24d02740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14014940 con 0x56042dacf850 2024-09-19T06:44:08.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c24d02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14016480 con 0x56042dac9790 2024-09-19T06:44:08.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c24d02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14015010 con 0x56042dacca80 2024-09-19T06:44:08.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c1bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 0x56042dae7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 0x56042dac9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 0x56042dac9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:57080/0 (socket says 172.21.15.12:57080) 2024-09-19T06:44:08.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c1b7fe640 1 -- 172.21.15.12:0/1527586981 learned_addr learned my addr 172.21.15.12:0/1527586981 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:08.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.934+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1527586981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 0x56042dae7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.935+0000 7f0c1b7fe640 1 -- 172.21.15.12:0/1527586981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 msgr2=0x56042dae7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:08.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.935+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1527586981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 0x56042dae7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.935+0000 7f0c1b7fe640 1 -- 172.21.15.12:0/1527586981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 msgr2=0x56042dae7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:08.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.935+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1527586981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 0x56042dae7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.935+0000 7f0c1b7fe640 1 -- 172.21.15.12:0/1527586981 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56042dacf5b0 con 0x56042dac9790 2024-09-19T06:44:08.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.935+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1527586981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 0x56042dac9c10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0c080058c0 tx=0x7f0c08001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899479f33f54f1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:08.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.937+0000 7f0c05ffb640 1 -- 172.21.15.12:0/1527586981 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08021d60 con 0x56042dac9790 2024-09-19T06:44:08.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.937+0000 7f0c05ffb640 1 -- 172.21.15.12:0/1527586981 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c08021d60 con 0x56042dac9790 2024-09-19T06:44:08.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.937+0000 7f0c05ffb640 1 -- 172.21.15.12:0/1527586981 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c080053d0 con 0x56042dac9790 2024-09-19T06:44:08.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.938+0000 7f0c24d02740 1 -- 172.21.15.12:0/1527586981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 msgr2=0x56042dac9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.938+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1527586981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 0x56042dac9c10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0c080058c0 tx=0x7f0c08001e70 comp rx=0 tx=0).stop 2024-09-19T06:44:08.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.938+0000 7f0c24d02740 1 -- 172.21.15.12:0/1527586981 shutdown_connections 2024-09-19T06:44:08.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.938+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1527586981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 0x56042dac9c10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.938+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1527586981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 0x56042dae7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.938+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1527586981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 0x56042dae7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.938+0000 7f0c24d02740 1 -- 172.21.15.12:0/1527586981 >> 172.21.15.12:0/1527586981 conn(0x56042dac0c00 msgr2=0x56042dac0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:08.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.938+0000 7f0c24d02740 1 -- 172.21.15.12:0/1527586981 shutdown_connections 2024-09-19T06:44:08.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.939+0000 7f0c24d02740 1 -- 172.21.15.12:0/1527586981 wait complete. 2024-09-19T06:44:08.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.939+0000 7f0c24d02740 1 -- start start 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.939+0000 7f0c24d02740 1 Processor -- start 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 0x56042dad7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 0x56042dae7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c24d02740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 0x56042dae7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c24d02740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14015db0 con 0x56042dacf850 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c24d02740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c140156e0 con 0x56042dac9790 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c24d02740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14012920 con 0x56042dacca80 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c24d02740 10 client.0 _ll_register_callbacks cb 0x7f0c08009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c1bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 0x56042dae7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 0x56042dad7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c1bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 0x56042dae7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:50800/0 (socket says 172.21.15.12:50800) 2024-09-19T06:44:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.940+0000 7f0c1bfff640 1 -- 172.21.15.12:0/1487405459 learned_addr learned my addr 172.21.15.12:0/1487405459 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:08.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.941+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 0x56042dae7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.941+0000 7f0c1bfff640 1 -- 172.21.15.12:0/1487405459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 msgr2=0x56042dad7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:08.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.941+0000 7f0c1bfff640 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 0x56042dad7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.941+0000 7f0c1bfff640 1 -- 172.21.15.12:0/1487405459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 msgr2=0x56042dae7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:08.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.941+0000 7f0c1bfff640 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 0x56042dae7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.941+0000 7f0c1bfff640 1 -- 172.21.15.12:0/1487405459 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56042dae7e00 con 0x56042dacca80 2024-09-19T06:44:08.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.941+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 0x56042dae7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:08.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.941+0000 7f0c1bfff640 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 0x56042dae7220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000ba80 tx=0x7f0c10004a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7962963e0962ecad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:08.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.942+0000 7f0bfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:44:08.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.942+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1487405459 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1002b020 con 0x56042dacca80 2024-09-19T06:44:08.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.942+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1487405459 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0c10004f50 con 0x56042dacca80 2024-09-19T06:44:08.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.942+0000 7f0c24d02740 1 -- 172.21.15.12:0/1487405459 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c08021d60 con 0x56042dacca80 2024-09-19T06:44:08.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.942+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1487405459 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0c10016040 con 0x56042dacca80 2024-09-19T06:44:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.942+0000 7f0c24d02740 10 client.26116 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.942+0000 7f0c24d02740 1 -- 172.21.15.12:0/1487405459 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56042db4a8f0 con 0x56042dacca80 2024-09-19T06:44:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.943+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1487405459 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c08021d60 con 0x56042dacca80 2024-09-19T06:44:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.944+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1487405459 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f0c100044b0 con 0x56042dacca80 2024-09-19T06:44:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.944+0000 7f0c24d02740 10 client.26116 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.944+0000 7f0c24d02740 10 client.26116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.944+0000 7f0c24d02740 20 client.26116 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.944+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56042db4acf0 0x56042db4d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.944+0000 7f0c24d02740 4 client.26116 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:44:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.944+0000 7f0c24d02740 1 -- 172.21.15.12:0/1487405459 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56042da31d60 con 0x56042db4acf0 2024-09-19T06:44:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.944+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56042db4acf0 0x56042db4d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.945+0000 7f0c1b7fe640 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56042db4acf0 0x56042db4d0e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bc20a5ad165fa9e server_cookie=8d4feae33e4e6b1c in_seq=0 out_seq=0 2024-09-19T06:44:08.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.945+0000 7f0bfb7fe640 10 client.26116 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:08.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.945+0000 7f0bfb7fe640 1 -- 172.21.15.12:0/1487405459 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56042da31d60 con 0x56042db4acf0 2024-09-19T06:44:08.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.945+0000 7f0bfb7fe640 10 client.26116 handle_command_reply: tid=0 2024-09-19T06:44:08.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.945+0000 7f0c24d02740 1 client.26116 shutdown 2024-09-19T06:44:08.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.946+0000 7f0c24d02740 1 -- 172.21.15.12:0/1487405459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 msgr2=0x56042dae7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.946+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 0x56042dae7220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000ba80 tx=0x7f0c10004a10 comp rx=0 tx=0).stop 2024-09-19T06:44:08.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.947+0000 7f0c24d02740 1 -- 172.21.15.12:0/1487405459 shutdown_connections 2024-09-19T06:44:08.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.947+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56042db4acf0 0x56042db4d0e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.947+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56042dacf850 0x56042dae7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.947+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56042dacca80 0x56042dae7220 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.947+0000 7f0c24d02740 1 --2- 172.21.15.12:0/1487405459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56042dac9790 0x56042dad7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.947+0000 7f0c24d02740 1 -- 172.21.15.12:0/1487405459 >> 172.21.15.12:0/1487405459 conn(0x56042dac0c00 msgr2=0x56042daca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:08.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.947+0000 7f0bfb7fe640 0 client.26116 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:08.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.947+0000 7f0c24d02740 1 -- 172.21.15.12:0/1487405459 shutdown_connections 2024-09-19T06:44:08.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.948+0000 7f0c24d02740 1 -- 172.21.15.12:0/1487405459 wait complete. 2024-09-19T06:44:08.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.948+0000 7f0c24d02740 20 client.26116 trim_cache size 0 max 16384 2024-09-19T06:44:08.950 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:44:08.950 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:44:08.950 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:44:08.950 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:44:08.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.949+0000 7f0c216c7640 1 -- 172.21.15.12:0/388876189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c0c0a37c0 msgr2=0x7f0c0c0a5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.949+0000 7f0c216c7640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c0c0a37c0 0x7f0c0c0a5c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c172000 tx=0x7f0c1c1102c0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.949+0000 7f0c216c7640 1 -- 172.21.15.12:0/388876189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c140acc20 msgr2=0x7f0c14141660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:08.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.949+0000 7f0c216c7640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c140acc20 0x7f0c14141660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c067c70 tx=0x7f0c1c06dc70 comp rx=0 tx=0).stop 2024-09-19T06:44:08.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.949+0000 7f0c216c7640 1 -- 172.21.15.12:0/388876189 shutdown_connections 2024-09-19T06:44:08.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.949+0000 7f0c216c7640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c0c0a37c0 0x7f0c0c0a5c80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.949+0000 7f0c216c7640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c140acc20 0x7f0c14141660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.949+0000 7f0c216c7640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c140a5400 0x7f0c1413d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.949+0000 7f0c216c7640 1 --2- 172.21.15.12:0/388876189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c140a4a50 0x7f0c1413cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:08.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.949+0000 7f0c216c7640 1 -- 172.21.15.12:0/388876189 >> 172.21.15.12:0/388876189 conn(0x7f0c1401a0a0 msgr2=0x7f0c140aa560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:08.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.950+0000 7f0c216c7640 1 -- 172.21.15.12:0/388876189 shutdown_connections 2024-09-19T06:44:08.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:08.950+0000 7f0c216c7640 1 -- 172.21.15.12:0/388876189 wait complete. 2024-09-19T06:44:09.966 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:44:09.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:44:10.022 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:09 smithi012 ceph-mon[30937]: pgmap v123: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 59 MiB/s wr, 1.36k op/s 2024-09-19T06:44:10.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:09 smithi016 ceph-mon[34911]: pgmap v123: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 59 MiB/s wr, 1.36k op/s 2024-09-19T06:44:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:09 smithi173 ceph-mon[35349]: pgmap v123: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 59 MiB/s wr, 1.36k op/s 2024-09-19T06:44:10.447 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 205.0 s, 3975.8 tps, lat 25.114 ms stddev 29.655 2024-09-19T06:44:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.064+0000 7fd3e53f8640 1 -- 172.21.15.12:0/3338008380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e0114ab0 msgr2=0x7fd3e0116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.064+0000 7fd3e53f8640 1 --2- 172.21.15.12:0/3338008380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e0114ab0 0x7fd3e0116ea0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009900 tx=0x7fd3d402a480 comp rx=0 tx=0).stop 2024-09-19T06:44:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.064+0000 7fd3e53f8640 1 -- 172.21.15.12:0/3338008380 shutdown_connections 2024-09-19T06:44:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.064+0000 7fd3e53f8640 1 --2- 172.21.15.12:0/3338008380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e0114ab0 0x7fd3e0116ea0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.064+0000 7fd3e53f8640 1 --2- 172.21.15.12:0/3338008380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3e0109b10 0x7fd3e0114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.064+0000 7fd3e53f8640 1 --2- 172.21.15.12:0/3338008380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3e01091f0 0x7fd3e01095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.064+0000 7fd3e53f8640 1 -- 172.21.15.12:0/3338008380 >> 172.21.15.12:0/3338008380 conn(0x7fd3e006e140 msgr2=0x7fd3e006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.064+0000 7fd3e53f8640 1 -- 172.21.15.12:0/3338008380 shutdown_connections 2024-09-19T06:44:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.064+0000 7fd3e53f8640 1 -- 172.21.15.12:0/3338008380 wait complete. 2024-09-19T06:44:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.065+0000 7fd3e53f8640 1 Processor -- start 2024-09-19T06:44:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.065+0000 7fd3e53f8640 1 -- start start 2024-09-19T06:44:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3e53f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3e01091f0 0x7fd3e0113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3e53f8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e0109b10 0x7fd3e01144c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3e53f8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3e0114ab0 0x7fd3e010e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3e53f8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e0118570 con 0x7fd3e0109b10 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3e53f8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e01183f0 con 0x7fd3e01091f0 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3e53f8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e01186f0 con 0x7fd3e0114ab0 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3deffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3e01091f0 0x7fd3e0113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3deffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3e01091f0 0x7fd3e0113f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37882/0 (socket says 172.21.15.12:37882) 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3deffd640 1 -- 172.21.15.12:0/414045466 learned_addr learned my addr 172.21.15.12:0/414045466 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3de7fc640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e0109b10 0x7fd3e01144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.066+0000 7fd3deffd640 1 -- 172.21.15.12:0/414045466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3e0114ab0 msgr2=0x7fd3e010e120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.067+0000 7fd3deffd640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3e0114ab0 0x7fd3e010e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.067+0000 7fd3deffd640 1 -- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e0109b10 msgr2=0x7fd3e01144c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.067+0000 7fd3deffd640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e0109b10 0x7fd3e01144c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.067+0000 7fd3deffd640 1 -- 172.21.15.12:0/414045466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e010e9e0 con 0x7fd3e01091f0 2024-09-19T06:44:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.067+0000 7fd3de7fc640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e0109b10 0x7fd3e01144c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.067+0000 7fd3deffd640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3e01091f0 0x7fd3e0113f80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000e970 tx=0x7fd3d000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.068+0000 7fd3c7fff640 1 -- 172.21.15.12:0/414045466 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d000ccc0 con 0x7fd3e01091f0 2024-09-19T06:44:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.068+0000 7fd3e53f8640 1 -- 172.21.15.12:0/414045466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e010ecd0 con 0x7fd3e01091f0 2024-09-19T06:44:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.068+0000 7fd3e53f8640 1 -- 172.21.15.12:0/414045466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e01bc600 con 0x7fd3e01091f0 2024-09-19T06:44:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.068+0000 7fd3c7fff640 1 -- 172.21.15.12:0/414045466 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3d0010910 con 0x7fd3e01091f0 2024-09-19T06:44:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.068+0000 7fd3c7fff640 1 -- 172.21.15.12:0/414045466 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0018860 con 0x7fd3e01091f0 2024-09-19T06:44:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.069+0000 7fd3e53f8640 1 -- 172.21.15.12:0/414045466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e0073a40 con 0x7fd3e01091f0 2024-09-19T06:44:11.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.071+0000 7fd3c7fff640 1 -- 172.21.15.12:0/414045466 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd3d0010ac0 con 0x7fd3e01091f0 2024-09-19T06:44:11.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.072+0000 7fd3c7fff640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd3c80a3500 0x7fd3c80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:11.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.072+0000 7fd3c7fff640 1 -- 172.21.15.12:0/414045466 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd3d00d0180 con 0x7fd3e01091f0 2024-09-19T06:44:11.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.072+0000 7fd3de7fc640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd3c80a3500 0x7fd3c80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:11.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.073+0000 7fd3de7fc640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd3c80a3500 0x7fd3c80a59c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd3e010f7c0 tx=0x7fd3d8009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:11.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.078+0000 7fd3c7fff640 1 -- 172.21.15.12:0/414045466 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd3d009ca80 con 0x7fd3e01091f0 2024-09-19T06:44:11.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.450+0000 7fd3e53f8640 1 -- 172.21.15.12:0/414045466 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3e01bc9e0 con 0x7fd3e01091f0 2024-09-19T06:44:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.451+0000 7fd3c7fff640 1 -- 172.21.15.12:0/414045466 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11971 (secure 0 0 0) 0x7fd3d009c380 con 0x7fd3e01091f0 2024-09-19T06:44:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:44:11.453 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"btime":"2024-09-19T06:44:03:927993+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:44:03.419297+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:44:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2024-09-19T06:44:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.457+0000 7fd3e53f8640 1 -- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd3c80a3500 msgr2=0x7fd3c80a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.457+0000 7fd3e53f8640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd3c80a3500 0x7fd3c80a59c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd3e010f7c0 tx=0x7fd3d8009500 comp rx=0 tx=0).stop 2024-09-19T06:44:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.457+0000 7fd3e53f8640 1 -- 172.21.15.12:0/414045466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3e01091f0 msgr2=0x7fd3e0113f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.457+0000 7fd3e53f8640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3e01091f0 0x7fd3e0113f80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000e970 tx=0x7fd3d000ee30 comp rx=0 tx=0).stop 2024-09-19T06:44:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.457+0000 7fd3e53f8640 1 -- 172.21.15.12:0/414045466 shutdown_connections 2024-09-19T06:44:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.457+0000 7fd3e53f8640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd3c80a3500 0x7fd3c80a59c0 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd3e010f7c0 tx=0x7fd3d8009500 comp rx=0 tx=0).stop 2024-09-19T06:44:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.457+0000 7fd3e53f8640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3e0114ab0 0x7fd3e010e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.457+0000 7fd3e53f8640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3e0109b10 0x7fd3e01144c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.457+0000 7fd3e53f8640 1 --2- 172.21.15.12:0/414045466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3e01091f0 0x7fd3e0113f80 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000e970 tx=0x7fd3d000ee30 comp rx=0 tx=0).stop 2024-09-19T06:44:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.457+0000 7fd3e53f8640 1 -- 172.21.15.12:0/414045466 >> 172.21.15.12:0/414045466 conn(0x7fd3e006e140 msgr2=0x7fd3e0070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:11.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.465+0000 7fd3e53f8640 1 -- 172.21.15.12:0/414045466 shutdown_connections 2024-09-19T06:44:11.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:11.467+0000 7fd3e53f8640 1 -- 172.21.15.12:0/414045466 wait complete. 2024-09-19T06:44:12.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:11 smithi012 ceph-mon[30937]: pgmap v124: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 75 MiB/s wr, 1.73k op/s 2024-09-19T06:44:12.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:11 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/414045466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:12.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:11 smithi016 ceph-mon[34911]: pgmap v124: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 75 MiB/s wr, 1.73k op/s 2024-09-19T06:44:12.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:11 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/414045466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:12.316 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:44:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:11 smithi173 ceph-mon[35349]: pgmap v124: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 75 MiB/s wr, 1.73k op/s 2024-09-19T06:44:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:11 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/414045466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:12.838 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:13.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.463+0000 7f4503607640 1 -- 172.21.15.12:0/2340154249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44fc109450 msgr2=0x7f44fc109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:13.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.463+0000 7f4503607640 1 --2- 172.21.15.12:0/2340154249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44fc109450 0x7f44fc109830 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009ca0 tx=0x7f44f402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.463+0000 7f4503607640 1 -- 172.21.15.12:0/2340154249 shutdown_connections 2024-09-19T06:44:13.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.463+0000 7f4503607640 1 --2- 172.21.15.12:0/2340154249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44fc10ea80 0x7f44fc1154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.463+0000 7f4503607640 1 --2- 172.21.15.12:0/2340154249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44fc109e00 0x7f44fc10e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.463+0000 7f4503607640 1 --2- 172.21.15.12:0/2340154249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44fc109450 0x7f44fc109830 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.463+0000 7f4503607640 1 -- 172.21.15.12:0/2340154249 >> 172.21.15.12:0/2340154249 conn(0x7f44fc06e2d0 msgr2=0x7f44fc06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:13.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.463+0000 7f4503607640 1 -- 172.21.15.12:0/2340154249 shutdown_connections 2024-09-19T06:44:13.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.465+0000 7f4503607640 1 -- 172.21.15.12:0/2340154249 wait complete. 2024-09-19T06:44:13.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.466+0000 7f4503607640 1 Processor -- start 2024-09-19T06:44:13.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.466+0000 7f4503607640 1 -- start start 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f4503607640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44fc109450 0x7f44fc1abea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f4503607640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44fc109e00 0x7f44fc1ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f4503607640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44fc10ea80 0x7f44fc114650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f4503607640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc11a7d0 con 0x7f44fc109e00 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f4503607640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc11a650 con 0x7f44fc109450 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f4503607640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc11a950 con 0x7f44fc10ea80 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f4501ba4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44fc10ea80 0x7f44fc114650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f45013a3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44fc109450 0x7f44fc1abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f45013a3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44fc109450 0x7f44fc1abea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37898/0 (socket says 172.21.15.12:37898) 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f45013a3640 1 -- 172.21.15.12:0/74958031 learned_addr learned my addr 172.21.15.12:0/74958031 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f4501ba4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44fc10ea80 0x7f44fc114650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:47866/0 (socket says 172.21.15.12:47866) 2024-09-19T06:44:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.467+0000 7f4500ba2640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44fc109e00 0x7f44fc1ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.468+0000 7f4501ba4640 1 -- 172.21.15.12:0/74958031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44fc109450 msgr2=0x7f44fc1abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:13.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.468+0000 7f4501ba4640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44fc109450 0x7f44fc1abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.468+0000 7f4501ba4640 1 -- 172.21.15.12:0/74958031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44fc109e00 msgr2=0x7f44fc1ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:13.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.468+0000 7f4501ba4640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44fc109e00 0x7f44fc1ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.468+0000 7f4501ba4640 1 -- 172.21.15.12:0/74958031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc114dd0 con 0x7f44fc10ea80 2024-09-19T06:44:13.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.468+0000 7f4501ba4640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44fc10ea80 0x7f44fc114650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e970 tx=0x7f44f800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:13.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.469+0000 7f44f27fc640 1 -- 172.21.15.12:0/74958031 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f800ccc0 con 0x7f44fc10ea80 2024-09-19T06:44:13.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.469+0000 7f44f27fc640 1 -- 172.21.15.12:0/74958031 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44f8005020 con 0x7f44fc10ea80 2024-09-19T06:44:13.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.469+0000 7f44f27fc640 1 -- 172.21.15.12:0/74958031 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8004a00 con 0x7f44fc10ea80 2024-09-19T06:44:13.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.469+0000 7f4503607640 1 -- 172.21.15.12:0/74958031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44fc1150c0 con 0x7f44fc10ea80 2024-09-19T06:44:13.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.469+0000 7f4503607640 1 -- 172.21.15.12:0/74958031 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44fc1b3dd0 con 0x7f44fc10ea80 2024-09-19T06:44:13.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.473+0000 7f44f27fc640 1 -- 172.21.15.12:0/74958031 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f44f8004ba0 con 0x7f44fc10ea80 2024-09-19T06:44:13.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.474+0000 7f45059e0740 1 Processor -- start 2024-09-19T06:44:13.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.474+0000 7f45059e0740 1 -- start start 2024-09-19T06:44:13.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f45059e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbaab40 0x55917fba9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f45059e0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 0x55917fba9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f45059e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbb6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f45059e0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55917fb0f2f0 con 0x55917fba95d0 2024-09-19T06:44:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f45059e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55917fab6cf0 con 0x55917fbaab40 2024-09-19T06:44:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f45059e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55917fb0b2b0 con 0x55917fbb4370 2024-09-19T06:44:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f4500ba2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbaab40 0x55917fba9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f4500ba2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbaab40 0x55917fba9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37910/0 (socket says 172.21.15.12:37910) 2024-09-19T06:44:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f45013a3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 0x55917fba9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f4500ba2640 1 -- 172.21.15.12:0/3948680289 learned_addr learned my addr 172.21.15.12:0/3948680289 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f4500ba2640 1 --2- 172.21.15.12:0/3948680289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbb6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f4500ba2640 1 -- 172.21.15.12:0/3948680289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 msgr2=0x55917fbb6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f4500ba2640 1 --2- 172.21.15.12:0/3948680289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbb6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f4500ba2640 1 -- 172.21.15.12:0/3948680289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 msgr2=0x55917fba9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f4500ba2640 1 --2- 172.21.15.12:0/3948680289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 0x55917fba9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f4500ba2640 1 -- 172.21.15.12:0/3948680289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55917fa9b3a0 con 0x55917fbaab40 2024-09-19T06:44:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.475+0000 7f45013a3640 1 --2- 172.21.15.12:0/3948680289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 0x55917fba9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.476+0000 7f4500ba2640 1 --2- 172.21.15.12:0/3948680289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbaab40 0x55917fba9090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55917fbaa070 tx=0x7f44ec009540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cff07448a7061c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.476+0000 7f44e77fe640 1 -- 172.21.15.12:0/3948680289 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0130d0 con 0x55917fbaab40 2024-09-19T06:44:13.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.476+0000 7f44f27fc640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44e80a3580 0x7f44e80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.476+0000 7f44e77fe640 1 -- 172.21.15.12:0/3948680289 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44ec013270 con 0x55917fbaab40 2024-09-19T06:44:13.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.476+0000 7f44e77fe640 1 -- 172.21.15.12:0/3948680289 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec011470 con 0x55917fbaab40 2024-09-19T06:44:13.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.476+0000 7f44f27fc640 1 -- 172.21.15.12:0/74958031 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f44f80cfb60 con 0x7f44fc10ea80 2024-09-19T06:44:13.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.477+0000 7f45013a3640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44e80a3580 0x7f44e80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.477+0000 7f45059e0740 1 -- 172.21.15.12:0/3948680289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbaab40 msgr2=0x55917fba9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:13.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.477+0000 7f45059e0740 1 --2- 172.21.15.12:0/3948680289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbaab40 0x55917fba9090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55917fbaa070 tx=0x7f44ec009540 comp rx=0 tx=0).stop 2024-09-19T06:44:13.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.478+0000 7f45013a3640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44e80a3580 0x7f44e80a5a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55917fba6ac0 tx=0x7f44f4005d80 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:13.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.478+0000 7f45059e0740 1 -- 172.21.15.12:0/3948680289 shutdown_connections 2024-09-19T06:44:13.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.478+0000 7f45059e0740 1 --2- 172.21.15.12:0/3948680289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbb6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.478+0000 7f45059e0740 1 --2- 172.21.15.12:0/3948680289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 0x55917fba9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.478+0000 7f45059e0740 1 --2- 172.21.15.12:0/3948680289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbaab40 0x55917fba9090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.478+0000 7f45059e0740 1 -- 172.21.15.12:0/3948680289 >> 172.21.15.12:0/3948680289 conn(0x55917fb72310 msgr2=0x55917fba5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:13.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.478+0000 7f45059e0740 1 -- 172.21.15.12:0/3948680289 shutdown_connections 2024-09-19T06:44:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.478+0000 7f45059e0740 1 -- 172.21.15.12:0/3948680289 wait complete. 2024-09-19T06:44:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.478+0000 7f45059e0740 1 -- start start 2024-09-19T06:44:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.478+0000 7f45059e0740 1 Processor -- start 2024-09-19T06:44:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.479+0000 7f45059e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 0x55917fbb3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.479+0000 7f45059e0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 0x55917fbb1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.479+0000 7f45059e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbb1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.479+0000 7f45059e0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55917fbb7010 con 0x55917fbaab40 2024-09-19T06:44:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.479+0000 7f45059e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55917faca060 con 0x55917fba95d0 2024-09-19T06:44:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.479+0000 7f45059e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55917fbb7190 con 0x55917fbb4370 2024-09-19T06:44:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.479+0000 7f45059e0740 10 client.0 _ll_register_callbacks cb 0x55917f81d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.480+0000 7f4500ba2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 0x55917fbb1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.480+0000 7f4500ba2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 0x55917fbb1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59340/0 (socket says 172.21.15.12:59340) 2024-09-19T06:44:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.480+0000 7f4500ba2640 1 -- 172.21.15.12:0/2131593625 learned_addr learned my addr 172.21.15.12:0/2131593625 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.480+0000 7f4501ba4640 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbb1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.480+0000 7f4500ba2640 1 -- 172.21.15.12:0/2131593625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 msgr2=0x55917fbb1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:13.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.480+0000 7f4500ba2640 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbb1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.480+0000 7f4500ba2640 1 -- 172.21.15.12:0/2131593625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 msgr2=0x55917fbb3d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:13.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.480+0000 7f4500ba2640 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 0x55917fbb3d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.480+0000 7f4500ba2640 1 -- 172.21.15.12:0/2131593625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55917f8803c0 con 0x55917fbaab40 2024-09-19T06:44:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.481+0000 7f4500ba2640 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 0x55917fbb1020 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f44ec003b90 tx=0x7f44ec005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183d97ac866b77e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.481+0000 7f44e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.482+0000 7f44e4ff9640 1 -- 172.21.15.12:0/2131593625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0130d0 con 0x55917fbaab40 2024-09-19T06:44:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.482+0000 7f45059e0740 1 -- 172.21.15.12:0/2131593625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44ec013270 con 0x55917fbaab40 2024-09-19T06:44:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.482+0000 7f44e4ff9640 1 -- 172.21.15.12:0/2131593625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f44ec004430 con 0x55917fbaab40 2024-09-19T06:44:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.483+0000 7f44e4ff9640 1 -- 172.21.15.12:0/2131593625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f44ec011470 con 0x55917fbaab40 2024-09-19T06:44:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.490+0000 7f45059e0740 10 client.16593 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.490+0000 7f45059e0740 1 -- 172.21.15.12:0/2131593625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55917fbc2b40 con 0x55917fbaab40 2024-09-19T06:44:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.492+0000 7f44e4ff9640 1 -- 172.21.15.12:0/2131593625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44ec013270 con 0x55917fbaab40 2024-09-19T06:44:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.493+0000 7f44e4ff9640 1 -- 172.21.15.12:0/2131593625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f44ec0206d0 con 0x55917fbaab40 2024-09-19T06:44:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.493+0000 7f45059e0740 10 client.16593 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.493+0000 7f45059e0740 10 client.16593 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:44:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.493+0000 7f45059e0740 20 client.16593 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.493+0000 7f45059e0740 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55917fbc4390 0x55917fbc6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.493+0000 7f45059e0740 4 client.16593 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.493+0000 7f45059e0740 1 -- 172.21.15.12:0/2131593625 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55917fb1c860 con 0x55917fbc4390 2024-09-19T06:44:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.494+0000 7f45013a3640 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55917fbc4390 0x55917fbc6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.501+0000 7f45013a3640 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55917fbc4390 0x55917fbc6810 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c429aa660640cd30 server_cookie=7b1c4b2290a225ff in_seq=0 out_seq=0 2024-09-19T06:44:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.501+0000 7f44e4ff9640 10 client.16593 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:44:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f44e4ff9640 1 -- 172.21.15.12:0/2131593625 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55917fb1c860 con 0x55917fbc4390 2024-09-19T06:44:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f44e4ff9640 10 client.16593 handle_command_reply: tid=0 2024-09-19T06:44:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f45059e0740 1 client.16593 shutdown 2024-09-19T06:44:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f45059e0740 1 -- 172.21.15.12:0/2131593625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 msgr2=0x55917fbb1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f45059e0740 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 0x55917fbb1020 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f44ec003b90 tx=0x7f44ec005f90 comp rx=0 tx=0).stop 2024-09-19T06:44:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f45059e0740 1 -- 172.21.15.12:0/2131593625 shutdown_connections 2024-09-19T06:44:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f45059e0740 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55917fbc4390 0x55917fbc6810 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f45059e0740 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbb1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f45059e0740 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 0x55917fbb1020 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f45059e0740 1 --2- 172.21.15.12:0/2131593625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 0x55917fbb3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f45059e0740 1 -- 172.21.15.12:0/2131593625 >> 172.21.15.12:0/2131593625 conn(0x55917fb72310 msgr2=0x55917fbab930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.502+0000 7f44e4ff9640 0 client.16593 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:44:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.503+0000 7f45059e0740 1 -- 172.21.15.12:0/2131593625 shutdown_connections 2024-09-19T06:44:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.503+0000 7f45059e0740 1 -- 172.21.15.12:0/2131593625 wait complete. 2024-09-19T06:44:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.503+0000 7f45059e0740 20 client.16593 trim_cache size 0 max 16384 2024-09-19T06:44:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.528+0000 7f45059e0740 1 Processor -- start 2024-09-19T06:44:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.528+0000 7f45059e0740 1 -- start start 2024-09-19T06:44:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.528+0000 7f45059e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 0x55917fbc0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45059e0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 0x55917fbaf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45059e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbafe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45013a3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 0x55917fbc0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45059e0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f44e000ea80 con 0x55917fbaab40 2024-09-19T06:44:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45013a3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 0x55917fbc0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37920/0 (socket says 172.21.15.12:37920) 2024-09-19T06:44:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45013a3640 1 -- 172.21.15.12:0/2734545337 learned_addr learned my addr 172.21.15.12:0/2734545337 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45059e0740 1 -- 172.21.15.12:0/2734545337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f44e00105c0 con 0x55917fba95d0 2024-09-19T06:44:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45059e0740 1 -- 172.21.15.12:0/2734545337 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44e000f150 con 0x55917fbb4370 2024-09-19T06:44:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f4501ba4640 1 --2- 172.21.15.12:0/2734545337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbafe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f4500ba2640 1 --2- 172.21.15.12:0/2734545337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 0x55917fbaf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45013a3640 1 -- 172.21.15.12:0/2734545337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 msgr2=0x55917fbafe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45013a3640 1 --2- 172.21.15.12:0/2734545337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbafe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45013a3640 1 -- 172.21.15.12:0/2734545337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 msgr2=0x55917fbaf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45013a3640 1 --2- 172.21.15.12:0/2734545337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 0x55917fbaf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.529+0000 7f45013a3640 1 -- 172.21.15.12:0/2734545337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55917fbb1980 con 0x55917fba95d0 2024-09-19T06:44:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.530+0000 7f45013a3640 1 --2- 172.21.15.12:0/2734545337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 0x55917fbc0340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f44f4005e30 tx=0x7f44f4044000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5921e01a9979b92f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.530+0000 7f44e6ffd640 1 -- 172.21.15.12:0/2734545337 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4031450 con 0x55917fba95d0 2024-09-19T06:44:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.530+0000 7f44e6ffd640 1 -- 172.21.15.12:0/2734545337 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44f4036050 con 0x55917fba95d0 2024-09-19T06:44:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.530+0000 7f44e6ffd640 1 -- 172.21.15.12:0/2734545337 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f40305c0 con 0x55917fba95d0 2024-09-19T06:44:13.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.531+0000 7f45059e0740 1 -- 172.21.15.12:0/2734545337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 msgr2=0x55917fbc0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:13.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.531+0000 7f45059e0740 1 --2- 172.21.15.12:0/2734545337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 0x55917fbc0340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f44f4005e30 tx=0x7f44f4044000 comp rx=0 tx=0).stop 2024-09-19T06:44:13.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.532+0000 7f45059e0740 1 -- 172.21.15.12:0/2734545337 shutdown_connections 2024-09-19T06:44:13.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.532+0000 7f45059e0740 1 --2- 172.21.15.12:0/2734545337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbb4370 0x55917fbafe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.532+0000 7f45059e0740 1 --2- 172.21.15.12:0/2734545337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fbaab40 0x55917fbaf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.532+0000 7f45059e0740 1 --2- 172.21.15.12:0/2734545337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fba95d0 0x55917fbc0340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.532+0000 7f45059e0740 1 -- 172.21.15.12:0/2734545337 >> 172.21.15.12:0/2734545337 conn(0x55917fb72310 msgr2=0x55917fbac2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:13.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.533+0000 7f45059e0740 1 -- 172.21.15.12:0/2734545337 shutdown_connections 2024-09-19T06:44:13.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.533+0000 7f45059e0740 1 -- 172.21.15.12:0/2734545337 wait complete. 2024-09-19T06:44:13.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.533+0000 7f45059e0740 1 -- start start 2024-09-19T06:44:13.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.534+0000 7f45059e0740 1 Processor -- start 2024-09-19T06:44:13.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.534+0000 7f45059e0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 0x55917fbb7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.534+0000 7f45059e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbaab40 0x55917fbb7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.534+0000 7f45059e0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbb4370 0x55917fc2d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.534+0000 7f45059e0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f44e000fef0 con 0x55917fba95d0 2024-09-19T06:44:13.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f45059e0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f44e000f820 con 0x55917fbb4370 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f45059e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44e000ca60 con 0x55917fbaab40 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f45059e0740 10 client.0 _ll_register_callbacks cb 0x7f44f8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f4501ba4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbb4370 0x55917fc2d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f4501ba4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbb4370 0x55917fc2d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37922/0 (socket says 172.21.15.12:37922) 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f4501ba4640 1 -- 172.21.15.12:0/1376000879 learned_addr learned my addr 172.21.15.12:0/1376000879 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f4500ba2640 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbaab40 0x55917fbb7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f45013a3640 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 0x55917fbb7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f4501ba4640 1 -- 172.21.15.12:0/1376000879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbaab40 msgr2=0x55917fbb7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f4501ba4640 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbaab40 0x55917fbb7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f4501ba4640 1 -- 172.21.15.12:0/1376000879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 msgr2=0x55917fbb7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f4501ba4640 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 0x55917fbb7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f4501ba4640 1 -- 172.21.15.12:0/1376000879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55917fc2d620 con 0x55917fbb4370 2024-09-19T06:44:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.535+0000 7f4500ba2640 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbaab40 0x55917fbb7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.536+0000 7f4501ba4640 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbb4370 0x55917fc2d0e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c6a0 tx=0x7f44f809d5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd42ea507341bc18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.536+0000 7f44e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:44:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.536+0000 7f44e4ff9640 1 -- 172.21.15.12:0/1376000879 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f80aa060 con 0x55917fbb4370 2024-09-19T06:44:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.536+0000 7f44e4ff9640 1 -- 172.21.15.12:0/1376000879 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f44f80a55d0 con 0x55917fbb4370 2024-09-19T06:44:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.536+0000 7f45059e0740 1 -- 172.21.15.12:0/1376000879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f4036050 con 0x55917fbb4370 2024-09-19T06:44:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.536+0000 7f44e4ff9640 1 -- 172.21.15.12:0/1376000879 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f44f801c040 con 0x55917fbb4370 2024-09-19T06:44:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.536+0000 7f45059e0740 10 client.26150 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.536+0000 7f45059e0740 1 -- 172.21.15.12:0/1376000879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55917fc2e820 con 0x55917fbb4370 2024-09-19T06:44:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.537+0000 7f44e4ff9640 1 -- 172.21.15.12:0/1376000879 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44f4036050 con 0x55917fbb4370 2024-09-19T06:44:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.537+0000 7f44e4ff9640 1 -- 172.21.15.12:0/1376000879 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f44f809c240 con 0x55917fbb4370 2024-09-19T06:44:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.537+0000 7f45059e0740 10 client.26150 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.537+0000 7f45059e0740 10 client.26150 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:44:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.537+0000 7f45059e0740 20 client.26150 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.537+0000 7f45059e0740 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55917fc2eea0 0x55917fc31290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.537+0000 7f45059e0740 4 client.26150 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.537+0000 7f45059e0740 1 -- 172.21.15.12:0/1376000879 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55917fb16d70 con 0x55917fc2eea0 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.538+0000 7f45013a3640 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55917fc2eea0 0x55917fc31290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.539+0000 7f45013a3640 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55917fc2eea0 0x55917fc31290 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ad7e8a34674f8fd4 server_cookie=35c1750908d02a0a in_seq=0 out_seq=0 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.540+0000 7f44e4ff9640 10 client.26150 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.540+0000 7f44e4ff9640 1 -- 172.21.15.12:0/1376000879 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55917fb16d70 con 0x55917fc2eea0 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.540+0000 7f44e4ff9640 10 client.26150 handle_command_reply: tid=0 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.540+0000 7f45059e0740 1 client.26150 shutdown 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.540+0000 7f45059e0740 1 -- 172.21.15.12:0/1376000879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbb4370 msgr2=0x55917fc2d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.540+0000 7f45059e0740 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbb4370 0x55917fc2d0e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44f800c6a0 tx=0x7f44f809d5b0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.540+0000 7f45059e0740 1 -- 172.21.15.12:0/1376000879 shutdown_connections 2024-09-19T06:44:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.540+0000 7f45059e0740 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55917fc2eea0 0x55917fc31290 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.541+0000 7f45059e0740 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55917fbb4370 0x55917fc2d0e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.541+0000 7f45059e0740 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55917fbaab40 0x55917fbb7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.541+0000 7f45059e0740 1 --2- 172.21.15.12:0/1376000879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55917fba95d0 0x55917fbb7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.541+0000 7f45059e0740 1 -- 172.21.15.12:0/1376000879 >> 172.21.15.12:0/1376000879 conn(0x55917fb72310 msgr2=0x55917fbb2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.541+0000 7f44e4ff9640 0 client.26150 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:44:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.541+0000 7f45059e0740 1 -- 172.21.15.12:0/1376000879 shutdown_connections 2024-09-19T06:44:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.541+0000 7f45059e0740 1 -- 172.21.15.12:0/1376000879 wait complete. 2024-09-19T06:44:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.541+0000 7f45059e0740 20 client.26150 trim_cache size 0 max 16384 2024-09-19T06:44:13.546 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:44:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 -- 172.21.15.12:0/74958031 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44e80a3580 msgr2=0x7f44e80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44e80a3580 0x7f44e80a5a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55917fba6ac0 tx=0x7f44f4005d80 comp rx=0 tx=0).stop 2024-09-19T06:44:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 -- 172.21.15.12:0/74958031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44fc10ea80 msgr2=0x7f44fc114650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44fc10ea80 0x7f44fc114650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e970 tx=0x7f44f800ee30 comp rx=0 tx=0).stop 2024-09-19T06:44:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 -- 172.21.15.12:0/74958031 shutdown_connections 2024-09-19T06:44:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44e80a3580 0x7f44e80a5a40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44fc10ea80 0x7f44fc114650 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44fc109e00 0x7f44fc1ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 --2- 172.21.15.12:0/74958031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44fc109450 0x7f44fc1abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 -- 172.21.15.12:0/74958031 >> 172.21.15.12:0/74958031 conn(0x7f44fc06e2d0 msgr2=0x7f44fc10a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 -- 172.21.15.12:0/74958031 shutdown_connections 2024-09-19T06:44:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:13.542+0000 7f4503607640 1 -- 172.21.15.12:0/74958031 wait complete. 2024-09-19T06:44:14.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:13 smithi016 ceph-mon[34911]: pgmap v125: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 55 MiB/s wr, 1.40k op/s 2024-09-19T06:44:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:13 smithi173 ceph-mon[35349]: pgmap v125: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 55 MiB/s wr, 1.40k op/s 2024-09-19T06:44:14.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:13 smithi012 ceph-mon[30937]: pgmap v125: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 55 MiB/s wr, 1.40k op/s 2024-09-19T06:44:14.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:44:14.994 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:15.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:14 smithi016 ceph-mon[34911]: pgmap v126: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 55 MiB/s wr, 1.40k op/s 2024-09-19T06:44:15.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:14 smithi173 ceph-mon[35349]: pgmap v126: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 55 MiB/s wr, 1.40k op/s 2024-09-19T06:44:15.340 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:14 smithi012 ceph-mon[30937]: pgmap v126: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 55 MiB/s wr, 1.40k op/s 2024-09-19T06:44:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.602+0000 7f5e998e0640 1 -- 172.21.15.12:0/575477336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e94109b10 msgr2=0x7f5e94116960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.602+0000 7f5e998e0640 1 --2- 172.21.15.12:0/575477336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e94109b10 0x7f5e94116960 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009900 tx=0x7f5e7c02a410 comp rx=0 tx=0).stop 2024-09-19T06:44:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.603+0000 7f5e998e0640 1 -- 172.21.15.12:0/575477336 shutdown_connections 2024-09-19T06:44:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.603+0000 7f5e998e0640 1 --2- 172.21.15.12:0/575477336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e94116ea0 0x7f5e94119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.603+0000 7f5e998e0640 1 --2- 172.21.15.12:0/575477336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e94109b10 0x7f5e94116960 secure :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009900 tx=0x7f5e7c02a410 comp rx=0 tx=0).stop 2024-09-19T06:44:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.603+0000 7f5e998e0640 1 --2- 172.21.15.12:0/575477336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e941091f0 0x7f5e941095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.603+0000 7f5e998e0640 1 -- 172.21.15.12:0/575477336 >> 172.21.15.12:0/575477336 conn(0x7f5e9406e2d0 msgr2=0x7f5e9406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.605+0000 7f5e998e0640 1 -- 172.21.15.12:0/575477336 shutdown_connections 2024-09-19T06:44:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.605+0000 7f5e998e0640 1 -- 172.21.15.12:0/575477336 wait complete. 2024-09-19T06:44:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.606+0000 7f5e998e0640 1 Processor -- start 2024-09-19T06:44:15.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.606+0000 7f5e998e0640 1 -- start start 2024-09-19T06:44:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.606+0000 7f5e998e0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e941091f0 0x7f5e941a3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.606+0000 7f5e998e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e94116ea0 0x7f5e941a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.606+0000 7f5e998e0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e941a7940 0x7f5e941a7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e998e0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9411c9d0 con 0x7f5e94116ea0 2024-09-19T06:44:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e94116ea0 0x7f5e941a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e94116ea0 0x7f5e941a35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59394/0 (socket says 172.21.15.12:59394) 2024-09-19T06:44:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e8bfff640 1 -- 172.21.15.12:0/801030200 learned_addr learned my addr 172.21.15.12:0/801030200 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:15.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e937fe640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e941a7940 0x7f5e941a7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e998e0640 1 -- 172.21.15.12:0/801030200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9411c850 con 0x7f5e941091f0 2024-09-19T06:44:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e941091f0 0x7f5e941a3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e998e0640 1 -- 172.21.15.12:0/801030200 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9411cb50 con 0x7f5e941a7940 2024-09-19T06:44:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e92ffd640 1 -- 172.21.15.12:0/801030200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e941a7940 msgr2=0x7f5e941a7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e941a7940 0x7f5e941a7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e92ffd640 1 -- 172.21.15.12:0/801030200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e94116ea0 msgr2=0x7f5e941a35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e94116ea0 0x7f5e941a35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.607+0000 7f5e92ffd640 1 -- 172.21.15.12:0/801030200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e941a8400 con 0x7f5e941091f0 2024-09-19T06:44:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.608+0000 7f5e937fe640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e941a7940 0x7f5e941a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.608+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e94116ea0 0x7f5e941a35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.608+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e941091f0 0x7f5e941a3070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400e9f0 tx=0x7f5e8400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.608+0000 7f5e988de640 1 -- 172.21.15.12:0/801030200 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400ccc0 con 0x7f5e941091f0 2024-09-19T06:44:15.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.608+0000 7f5e998e0640 1 -- 172.21.15.12:0/801030200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e941a86f0 con 0x7f5e941091f0 2024-09-19T06:44:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.608+0000 7f5e988de640 1 -- 172.21.15.12:0/801030200 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e84010910 con 0x7f5e941091f0 2024-09-19T06:44:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.608+0000 7f5e988de640 1 -- 172.21.15.12:0/801030200 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84018960 con 0x7f5e941091f0 2024-09-19T06:44:15.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.608+0000 7f5e998e0640 1 -- 172.21.15.12:0/801030200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e941aff20 con 0x7f5e941091f0 2024-09-19T06:44:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.612+0000 7f5e988de640 1 -- 172.21.15.12:0/801030200 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5e84010430 con 0x7f5e941091f0 2024-09-19T06:44:15.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.612+0000 7f5e9bcb9740 1 Processor -- start 2024-09-19T06:44:15.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.613+0000 7f5e9bcb9740 1 -- start start 2024-09-19T06:44:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.613+0000 7f5e988de640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e800a33b0 0x7f5e800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1eb40 0x555df0b1d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b1da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 0x555df0b2a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e988de640 1 -- 172.21.15.12:0/801030200 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5e840d01a0 con 0x7f5e941091f0 2024-09-19T06:44:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555df0a832f0 con 0x555df0b28370 2024-09-19T06:44:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555df0a2acf0 con 0x555df0b1d5d0 2024-09-19T06:44:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555df0a7f2b0 con 0x555df0b1eb40 2024-09-19T06:44:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e937fe640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e800a33b0 0x7f5e800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b1da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b1da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37936/0 (socket says 172.21.15.12:37936) 2024-09-19T06:44:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e8bfff640 1 -- 172.21.15.12:0/3523610933 learned_addr learned my addr 172.21.15.12:0/3523610933 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:15.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.614+0000 7f5e937fe640 1 --2- 172.21.15.12:0/3523610933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 0x555df0b2a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.615+0000 7f5e8bfff640 1 -- 172.21.15.12:0/3523610933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1eb40 msgr2=0x555df0b1d090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.615+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/3523610933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1eb40 0x555df0b1d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.615+0000 7f5e8bfff640 1 -- 172.21.15.12:0/3523610933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 msgr2=0x555df0b2a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.615+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/3523610933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 0x555df0b2a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.615+0000 7f5e8bfff640 1 -- 172.21.15.12:0/3523610933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df0a0f3a0 con 0x555df0b1d5d0 2024-09-19T06:44:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.615+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/3523610933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b1da10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c006010 tx=0x7f5e7c005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a47d002483376df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.615+0000 7f5e937fe640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e800a33b0 0x7f5e800a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0099e0 tx=0x7f5e8c009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.616+0000 7f5e89ffb640 1 -- 172.21.15.12:0/3523610933 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c035040 con 0x555df0b1d5d0 2024-09-19T06:44:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.616+0000 7f5e89ffb640 1 -- 172.21.15.12:0/3523610933 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e7c031830 con 0x555df0b1d5d0 2024-09-19T06:44:15.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.616+0000 7f5e89ffb640 1 -- 172.21.15.12:0/3523610933 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c004a00 con 0x555df0b1d5d0 2024-09-19T06:44:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.617+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3523610933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 msgr2=0x555df0b1da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.617+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3523610933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b1da10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c006010 tx=0x7f5e7c005d50 comp rx=0 tx=0).stop 2024-09-19T06:44:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.617+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3523610933 shutdown_connections 2024-09-19T06:44:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.617+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3523610933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 0x555df0b2a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.618+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3523610933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b1da10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.618+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3523610933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1eb40 0x555df0b1d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.618+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3523610933 >> 172.21.15.12:0/3523610933 conn(0x555df0ae6310 msgr2=0x555df0b19c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.618+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3523610933 shutdown_connections 2024-09-19T06:44:15.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.618+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3523610933 wait complete. 2024-09-19T06:44:15.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.618+0000 7f5e9bcb9740 1 -- start start 2024-09-19T06:44:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.619+0000 7f5e9bcb9740 1 Processor -- start 2024-09-19T06:44:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.619+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.619+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b25060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.619+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b28370 0x555df0b257f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555df0b2b010 con 0x555df0b1d5d0 2024-09-19T06:44:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555df0a3e060 con 0x555df0b1eb40 2024-09-19T06:44:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555df0b2b190 con 0x555df0b28370 2024-09-19T06:44:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e9bcb9740 10 client.0 _ll_register_callbacks cb 0x555df07918c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b25060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b25060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37940/0 (socket says 172.21.15.12:37940) 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e8bfff640 1 -- 172.21.15.12:0/2785254834 learned_addr learned my addr 172.21.15.12:0/2785254834 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e937fe640 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b28370 0x555df0b257f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e8bfff640 1 -- 172.21.15.12:0/2785254834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b28370 msgr2=0x555df0b257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b28370 0x555df0b257f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e8bfff640 1 -- 172.21.15.12:0/2785254834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1d5d0 msgr2=0x555df0b27db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e8bfff640 1 -- 172.21.15.12:0/2785254834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555df07f43c0 con 0x555df0b1eb40 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b25060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c005460 tx=0x7f5e7c009590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c1c3ae9b252486 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.620+0000 7f5e72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.621+0000 7f5e72ffd640 1 -- 172.21.15.12:0/2785254834 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c04f060 con 0x555df0b1eb40 2024-09-19T06:44:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.621+0000 7f5e72ffd640 1 -- 172.21.15.12:0/2785254834 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5e7c004440 con 0x555df0b1eb40 2024-09-19T06:44:15.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.621+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/2785254834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e7c031830 con 0x555df0b1eb40 2024-09-19T06:44:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.621+0000 7f5e72ffd640 1 -- 172.21.15.12:0/2785254834 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5e7c035040 con 0x555df0b1eb40 2024-09-19T06:44:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.621+0000 7f5e9bcb9740 10 client.26162 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.621+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/2785254834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555df0b3f310 con 0x555df0b1eb40 2024-09-19T06:44:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.621+0000 7f5e72ffd640 1 -- 172.21.15.12:0/2785254834 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e7c031830 con 0x555df0b1eb40 2024-09-19T06:44:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.622+0000 7f5e72ffd640 1 -- 172.21.15.12:0/2785254834 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f5e7c0466f0 con 0x555df0b1eb40 2024-09-19T06:44:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.622+0000 7f5e9bcb9740 10 client.26162 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.622+0000 7f5e9bcb9740 10 client.26162 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:44:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.622+0000 7f5e9bcb9740 20 client.26162 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:15.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.622+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555df0b40810 0x555df0b42c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.622+0000 7f5e9bcb9740 4 client.26162 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.622+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/2785254834 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555df0a90860 con 0x555df0b40810 2024-09-19T06:44:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.623+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555df0b40810 0x555df0b42c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.623+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555df0b40810 0x555df0b42c20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ebd93a1355868832 server_cookie=2dca62104caf7c8a in_seq=0 out_seq=0 2024-09-19T06:44:15.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.623+0000 7f5e72ffd640 10 client.26162 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:44:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.625+0000 7f5e72ffd640 1 -- 172.21.15.12:0/2785254834 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555df0a90860 con 0x555df0b40810 2024-09-19T06:44:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.625+0000 7f5e72ffd640 10 client.26162 handle_command_reply: tid=0 2024-09-19T06:44:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.626+0000 7f5e9bcb9740 1 client.26162 shutdown 2024-09-19T06:44:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.630+0000 7f295118f640 1 -- 172.21.15.12:0/3417422671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f294c108cf0 msgr2=0x7f294c10cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.630+0000 7f295118f640 1 --2- 172.21.15.12:0/3417422671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f294c108cf0 0x7f294c10cd30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2940009860 tx=0x7f294002a340 comp rx=0 tx=0).stop 2024-09-19T06:44:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.626+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/2785254834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 msgr2=0x555df0b25060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.626+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b25060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c005460 tx=0x7f5e7c009590 comp rx=0 tx=0).stop 2024-09-19T06:44:15.636 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.634+0000 7f295118f640 1 -- 172.21.15.12:0/3417422671 shutdown_connections 2024-09-19T06:44:15.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.634+0000 7f295118f640 1 --2- 172.21.15.12:0/3417422671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f294c10d490 0x7f294c114fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.634+0000 7f295118f640 1 --2- 172.21.15.12:0/3417422671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f294c108cf0 0x7f294c10cd30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.634+0000 7f295118f640 1 --2- 172.21.15.12:0/3417422671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f294c108340 0x7f294c108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.634+0000 7f295118f640 1 -- 172.21.15.12:0/3417422671 >> 172.21.15.12:0/3417422671 conn(0x7f294c077a40 msgr2=0x7f294c079e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.635+0000 7f295118f640 1 -- 172.21.15.12:0/3417422671 shutdown_connections 2024-09-19T06:44:15.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.635+0000 7f295118f640 1 -- 172.21.15.12:0/3417422671 wait complete. 2024-09-19T06:44:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.629+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/2785254834 shutdown_connections 2024-09-19T06:44:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.629+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555df0b40810 0x555df0b42c20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.629+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b28370 0x555df0b257f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.629+0000 7f5e72ffd640 0 client.26162 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:44:15.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.629+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b25060 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.629+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/2785254834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.629+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/2785254834 >> 172.21.15.12:0/2785254834 conn(0x555df0ae6310 msgr2=0x555df0b1f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.636+0000 7f295118f640 1 Processor -- start 2024-09-19T06:44:15.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.637+0000 7f295118f640 1 -- start start 2024-09-19T06:44:15.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.637+0000 7f295118f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f294c108340 0x7f294c19ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.637+0000 7f295118f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f294c10d490 0x7f294c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.638+0000 7f295118f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f294c1a3380 0x7f294c1a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.638+0000 7f294ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f294c108340 0x7f294c19ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.638+0000 7f294ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f294c108340 0x7f294c19ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37960/0 (socket says 172.21.15.12:37960) 2024-09-19T06:44:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.638+0000 7f294ad9d640 1 -- 172.21.15.12:0/232634283 learned_addr learned my addr 172.21.15.12:0/232634283 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.638+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f294c1184e0 con 0x7f294c10d490 2024-09-19T06:44:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.638+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f294c118360 con 0x7f294c108340 2024-09-19T06:44:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.638+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f294c118660 con 0x7f294c1a3380 2024-09-19T06:44:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.639+0000 7f294ad9d640 1 -- 172.21.15.12:0/232634283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f294c1a3380 msgr2=0x7f294c1a3830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:44:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.639+0000 7f294ad9d640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f294c1a3380 0x7f294c1a3830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.639+0000 7f294a59c640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f294c10d490 0x7f294c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.639+0000 7f294ad9d640 1 -- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f294c10d490 msgr2=0x7f294c19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.639+0000 7f294ad9d640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f294c10d490 0x7f294c19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.639+0000 7f294ad9d640 1 -- 172.21.15.12:0/232634283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294c1a3e70 con 0x7f294c108340 2024-09-19T06:44:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.639+0000 7f294a59c640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f294c10d490 0x7f294c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.639+0000 7f294ad9d640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f294c108340 0x7f294c19ea90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f293c00e9f0 tx=0x7f293c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.634+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/2785254834 shutdown_connections 2024-09-19T06:44:15.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.634+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/2785254834 wait complete. 2024-09-19T06:44:15.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.634+0000 7f5e9bcb9740 20 client.26162 trim_cache size 0 max 16384 2024-09-19T06:44:15.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.641+0000 7f2933fff640 1 -- 172.21.15.12:0/232634283 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c00cd80 con 0x7f294c108340 2024-09-19T06:44:15.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.641+0000 7f2933fff640 1 -- 172.21.15.12:0/232634283 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f293c010910 con 0x7f294c108340 2024-09-19T06:44:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.642+0000 7f2933fff640 1 -- 172.21.15.12:0/232634283 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c018990 con 0x7f294c108340 2024-09-19T06:44:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.642+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294c1a4160 con 0x7f294c108340 2024-09-19T06:44:15.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.642+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f294c1ab8d0 con 0x7f294c108340 2024-09-19T06:44:15.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.647+0000 7f2933fff640 1 -- 172.21.15.12:0/232634283 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f293c018b30 con 0x7f294c108340 2024-09-19T06:44:15.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.648+0000 7f2953fff740 1 Processor -- start 2024-09-19T06:44:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.649+0000 7f2933fff640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29340a3560 0x7f29340a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.649+0000 7f2953fff740 1 -- start start 2024-09-19T06:44:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.649+0000 7f294b59e640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29340a3560 0x7f29340a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f2953fff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa357bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f2953fff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3586770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f2953fff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa35890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f2953fff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564aa34e02f0 con 0x564aa357baf0 2024-09-19T06:44:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f294ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa357bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f2953fff740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564aa3488270 con 0x564aa357c410 2024-09-19T06:44:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f294a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3586770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f294ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa357bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59434/0 (socket says 172.21.15.12:59434) 2024-09-19T06:44:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f294ad9d640 1 -- 172.21.15.12:0/1728037992 learned_addr learned my addr 172.21.15.12:0/1728037992 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f2953fff740 1 -- 172.21.15.12:0/1728037992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564aa34dc2b0 con 0x564aa3586cb0 2024-09-19T06:44:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.650+0000 7f2933fff640 1 -- 172.21.15.12:0/232634283 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f293c0d00b0 con 0x7f294c108340 2024-09-19T06:44:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f294b59e640 1 --2- 172.21.15.12:0/1728037992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa35890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f294b59e640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29340a3560 0x7f29340a5a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2944005e30 tx=0x7f2944005d80 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f294ad9d640 1 -- 172.21.15.12:0/1728037992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 msgr2=0x564aa35890a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f294ad9d640 1 --2- 172.21.15.12:0/1728037992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa35890a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f294ad9d640 1 -- 172.21.15.12:0/1728037992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 msgr2=0x564aa3586770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f294ad9d640 1 --2- 172.21.15.12:0/1728037992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3586770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f294ad9d640 1 -- 172.21.15.12:0/1728037992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aa3487340 con 0x564aa357baf0 2024-09-19T06:44:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f294a59c640 1 --2- 172.21.15.12:0/1728037992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3586770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f294ad9d640 1 --2- 172.21.15.12:0/1728037992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa357bed0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f293c098c80 tx=0x7f293c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c248dc957439fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f29317fa640 1 -- 172.21.15.12:0/1728037992 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c09bdf0 con 0x564aa357baf0 2024-09-19T06:44:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.651+0000 7f29317fa640 1 -- 172.21.15.12:0/1728037992 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f293c09c9b0 con 0x564aa357baf0 2024-09-19T06:44:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.652+0000 7f29317fa640 1 -- 172.21.15.12:0/1728037992 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c09bc10 con 0x564aa357baf0 2024-09-19T06:44:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.652+0000 7f2953fff740 1 -- 172.21.15.12:0/1728037992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 msgr2=0x564aa357bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.653+0000 7f2953fff740 1 --2- 172.21.15.12:0/1728037992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa357bed0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f293c098c80 tx=0x7f293c017000 comp rx=0 tx=0).stop 2024-09-19T06:44:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.653+0000 7f2953fff740 1 -- 172.21.15.12:0/1728037992 shutdown_connections 2024-09-19T06:44:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.653+0000 7f2953fff740 1 --2- 172.21.15.12:0/1728037992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa35890a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.653+0000 7f2953fff740 1 --2- 172.21.15.12:0/1728037992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3586770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.653+0000 7f2953fff740 1 --2- 172.21.15.12:0/1728037992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa357bed0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.653+0000 7f2953fff740 1 -- 172.21.15.12:0/1728037992 >> 172.21.15.12:0/1728037992 conn(0x564aa3578060 msgr2=0x564aa3578440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.654+0000 7f2953fff740 1 -- 172.21.15.12:0/1728037992 shutdown_connections 2024-09-19T06:44:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.655+0000 7f2953fff740 1 -- 172.21.15.12:0/1728037992 wait complete. 2024-09-19T06:44:15.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.656+0000 7f2953fff740 1 -- start start 2024-09-19T06:44:15.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.656+0000 7f2953fff740 1 Processor -- start 2024-09-19T06:44:15.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.656+0000 7f2953fff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa3583c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f2953fff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3584140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f2953fff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa3584680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f2953fff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564aa3589880 con 0x564aa357baf0 2024-09-19T06:44:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f2953fff740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564aa3469290 con 0x564aa357c410 2024-09-19T06:44:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f2953fff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564aa3589a00 con 0x564aa3586cb0 2024-09-19T06:44:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f2953fff740 10 client.0 _ll_register_callbacks cb 0x564aa349a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f294a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3584140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f294a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3584140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37976/0 (socket says 172.21.15.12:37976) 2024-09-19T06:44:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f294a59c640 1 -- 172.21.15.12:0/2955664255 learned_addr learned my addr 172.21.15.12:0/2955664255 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f294b59e640 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa3584680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f294ad9d640 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa3583c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f294a59c640 1 -- 172.21.15.12:0/2955664255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 msgr2=0x564aa3584680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f294a59c640 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa3584680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f294a59c640 1 -- 172.21.15.12:0/2955664255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 msgr2=0x564aa3583c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.657+0000 7f294a59c640 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa3583c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.658+0000 7f294a59c640 1 -- 172.21.15.12:0/2955664255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564aa31f3210 con 0x564aa357c410 2024-09-19T06:44:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.658+0000 7f5e9bcb9740 1 Processor -- start 2024-09-19T06:44:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.659+0000 7f5e9bcb9740 1 -- start start 2024-09-19T06:44:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.659+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b222c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 0x555df0b22800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e92ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e92ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:47972/0 (socket says 172.21.15.12:47972) 2024-09-19T06:44:15.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b222c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37988/0 (socket says 172.21.15.12:37988) 2024-09-19T06:44:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f294a59c640 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3584140 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2940009860 tx=0x7f2940004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e266e3e2985e8157 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f292eff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:44:15.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e941b4600 con 0x555df0b28370 2024-09-19T06:44:15.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5e941b6140 con 0x555df0b1eb40 2024-09-19T06:44:15.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5e941b4cd0 con 0x555df0b1d5d0 2024-09-19T06:44:15.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e92ffd640 1 -- 172.21.15.12:0/3585651966 learned_addr learned my addr 172.21.15.12:0/3585651966 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:15.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.660+0000 7f5e937fe640 1 --2- 172.21.15.12:0/3585651966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 0x555df0b22800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f5e92ffd640 1 -- 172.21.15.12:0/3585651966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 msgr2=0x555df0b222c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f292eff5640 1 -- 172.21.15.12:0/2955664255 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2940037040 con 0x564aa357c410 2024-09-19T06:44:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/3585651966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b222c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f292eff5640 1 -- 172.21.15.12:0/2955664255 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f2940030750 con 0x564aa357c410 2024-09-19T06:44:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f5e92ffd640 1 -- 172.21.15.12:0/3585651966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 msgr2=0x555df0b22800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/3585651966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 0x555df0b22800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f5e92ffd640 1 -- 172.21.15.12:0/3585651966 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df0b1a960 con 0x555df0b1d5d0 2024-09-19T06:44:15.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f5e937fe640 1 --2- 172.21.15.12:0/3585651966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 0x555df0b22800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f2953fff740 1 -- 172.21.15.12:0/2955664255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f293c09c9b0 con 0x564aa357c410 2024-09-19T06:44:15.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/3585651966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400cf10 tx=0x7f5e840bc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=230b7de202bdb093 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f5e897fa640 1 -- 172.21.15.12:0/3585651966 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84010720 con 0x555df0b1d5d0 2024-09-19T06:44:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f5e897fa640 1 -- 172.21.15.12:0/3585651966 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e8409a7b0 con 0x555df0b1d5d0 2024-09-19T06:44:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f5e897fa640 1 -- 172.21.15.12:0/3585651966 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8409b900 con 0x555df0b1d5d0 2024-09-19T06:44:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f292eff5640 1 -- 172.21.15.12:0/2955664255 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f294004b050 con 0x564aa357c410 2024-09-19T06:44:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f2953fff740 10 client.26174 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.661+0000 7f2953fff740 1 -- 172.21.15.12:0/2955664255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564aa32bf620 con 0x564aa357c410 2024-09-19T06:44:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f292eff5640 1 -- 172.21.15.12:0/2955664255 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f293c09c9b0 con 0x564aa357c410 2024-09-19T06:44:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f292eff5640 1 -- 172.21.15.12:0/2955664255 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f2940004b00 con 0x564aa357c410 2024-09-19T06:44:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f2953fff740 10 client.26174 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f2953fff740 10 client.26174 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f2953fff740 20 client.26174 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f2953fff740 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aa3596c70 0x564aa3599080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f2953fff740 4 client.26174 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f2953fff740 1 -- 172.21.15.12:0/2955664255 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564aa34eda20 con 0x564aa3596c70 2024-09-19T06:44:15.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3585651966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1d5d0 msgr2=0x555df0b27db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3585651966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400cf10 tx=0x7f5e840bc040 comp rx=0 tx=0).stop 2024-09-19T06:44:15.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.662+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3585651966 shutdown_connections 2024-09-19T06:44:15.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.663+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3585651966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b28370 0x555df0b22800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.663+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3585651966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1eb40 0x555df0b222c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.663+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3585651966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b1d5d0 0x555df0b27db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.663+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3585651966 >> 172.21.15.12:0/3585651966 conn(0x555df0ae6310 msgr2=0x555df0b14a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.663+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3585651966 shutdown_connections 2024-09-19T06:44:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.663+0000 7f294ad9d640 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aa3596c70 0x564aa3599080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.663+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3585651966 wait complete. 2024-09-19T06:44:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.664+0000 7f5e9bcb9740 1 -- start start 2024-09-19T06:44:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.664+0000 7f292eff5640 10 client.26174 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.664+0000 7f294ad9d640 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aa3596c70 0x564aa3599080 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46158ac1483ebdd server_cookie=13e06f5097d6b4cf in_seq=0 out_seq=0 2024-09-19T06:44:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.664+0000 7f5e9bcb9740 1 Processor -- start 2024-09-19T06:44:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b458a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1eb40 0x555df0b45de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f292eff5640 1 -- 172.21.15.12:0/2955664255 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564aa34eda20 con 0x564aa3596c70 2024-09-19T06:44:15.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f292eff5640 10 client.26174 handle_command_reply: tid=0 2024-09-19T06:44:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e9bcb9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b28370 0x555df0ba93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.671 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f2953fff740 1 client.26174 shutdown 2024-09-19T06:44:15.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e941b5a70 con 0x555df0b1eb40 2024-09-19T06:44:15.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5e941b53a0 con 0x555df0b1d5d0 2024-09-19T06:44:15.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e9bcb9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5e941b25e0 con 0x555df0b28370 2024-09-19T06:44:15.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1eb40 0x555df0b45de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e8bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1eb40 0x555df0b45de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59462/0 (socket says 172.21.15.12:59462) 2024-09-19T06:44:15.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e8bfff640 1 -- 172.21.15.12:0/3301699598 learned_addr learned my addr 172.21.15.12:0/3301699598 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:15.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e9bcb9740 10 client.0 _ll_register_callbacks cb 0x7f5e7c040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:15.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f2953fff740 1 -- 172.21.15.12:0/2955664255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 msgr2=0x564aa3584140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e937fe640 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b28370 0x555df0ba93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f2953fff740 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3584140 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2940009860 tx=0x7f2940004270 comp rx=0 tx=0).stop 2024-09-19T06:44:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f2953fff740 1 -- 172.21.15.12:0/2955664255 shutdown_connections 2024-09-19T06:44:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f2953fff740 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aa3596c70 0x564aa3599080 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f292eff5640 0 client.26174 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:15.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e8bfff640 1 -- 172.21.15.12:0/3301699598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b28370 msgr2=0x555df0ba93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b28370 0x555df0ba93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e8bfff640 1 -- 172.21.15.12:0/3301699598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 msgr2=0x555df0b458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.665+0000 7f5e8bfff640 1 -- 172.21.15.12:0/3301699598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555df0b20120 con 0x555df0b1eb40 2024-09-19T06:44:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.666+0000 7f2953fff740 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa3584680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.666+0000 7f2953fff740 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa3584140 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.666+0000 7f2953fff740 1 --2- 172.21.15.12:0/2955664255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa3583c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.666+0000 7f2953fff740 1 -- 172.21.15.12:0/2955664255 >> 172.21.15.12:0/2955664255 conn(0x564aa3578060 msgr2=0x564aa357ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.666+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:15.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.666+0000 7f2953fff740 1 -- 172.21.15.12:0/2955664255 shutdown_connections 2024-09-19T06:44:15.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.666+0000 7f2953fff740 1 -- 172.21.15.12:0/2955664255 wait complete. 2024-09-19T06:44:15.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.666+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1eb40 0x555df0b45de0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x555df0b266a0 tx=0x7f5e7c046700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8398a623a726834a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.666+0000 7f5e72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:15.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.668+0000 7f2953fff740 20 client.26174 trim_cache size 0 max 16384 2024-09-19T06:44:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.668+0000 7f5e72ffd640 1 -- 172.21.15.12:0/3301699598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c04f050 con 0x555df0b1eb40 2024-09-19T06:44:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.668+0000 7f5e72ffd640 1 -- 172.21.15.12:0/3301699598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5e7c03c810 con 0x555df0b1eb40 2024-09-19T06:44:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.668+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3301699598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e8409a7b0 con 0x555df0b1eb40 2024-09-19T06:44:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.668+0000 7f5e72ffd640 1 -- 172.21.15.12:0/3301699598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5e7c068050 con 0x555df0b1eb40 2024-09-19T06:44:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.669+0000 7f5e9bcb9740 10 client.16620 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.669+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3301699598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555df0baa9a0 con 0x555df0b1eb40 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.669+0000 7f5e72ffd640 1 -- 172.21.15.12:0/3301699598 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e7c05f070 con 0x555df0b1eb40 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.669+0000 7f5e72ffd640 1 -- 172.21.15.12:0/3301699598 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f5e7c0035f0 con 0x555df0b1eb40 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.669+0000 7f5e9bcb9740 10 client.16620 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.669+0000 7f5e9bcb9740 10 client.16620 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.669+0000 7f5e9bcb9740 20 client.16620 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.670+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555df0b40810 0x555df0bad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.670+0000 7f5e9bcb9740 4 client.16620 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.670+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3301699598 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5e8409a7b0 con 0x555df0b40810 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.670+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555df0b40810 0x555df0bad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.670+0000 7f5e72ffd640 10 client.16620 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.670+0000 7f5e92ffd640 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555df0b40810 0x555df0bad0d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=839a0032d8a038a1 server_cookie=578ce18de6263d73 in_seq=0 out_seq=0 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.670+0000 7f5e72ffd640 1 -- 172.21.15.12:0/3301699598 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5e8409a7b0 con 0x555df0b40810 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e72ffd640 10 client.16620 handle_command_reply: tid=0 2024-09-19T06:44:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 client.16620 shutdown 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3301699598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1eb40 msgr2=0x555df0b45de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1eb40 0x555df0b45de0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x555df0b266a0 tx=0x7f5e7c046700 comp rx=0 tx=0).stop 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3301699598 shutdown_connections 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x555df0b40810 0x555df0bad0d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555df0b28370 0x555df0ba93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555df0b1eb40 0x555df0b45de0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 --2- 172.21.15.12:0/3301699598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555df0b1d5d0 0x555df0b458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3301699598 >> 172.21.15.12:0/3301699598 conn(0x555df0ae6310 msgr2=0x555df0b23930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e72ffd640 0 client.16620 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3301699598 shutdown_connections 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 1 -- 172.21.15.12:0/3301699598 wait complete. 2024-09-19T06:44:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.671+0000 7f5e9bcb9740 20 client.16620 trim_cache size 0 max 16384 2024-09-19T06:44:15.683 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:44:15.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 -- 172.21.15.12:0/801030200 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e800a33b0 msgr2=0x7f5e800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e800a33b0 0x7f5e800a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0099e0 tx=0x7f5e8c009500 comp rx=0 tx=0).stop 2024-09-19T06:44:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 -- 172.21.15.12:0/801030200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e941091f0 msgr2=0x7f5e941a3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e941091f0 0x7f5e941a3070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400e9f0 tx=0x7f5e8400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 -- 172.21.15.12:0/801030200 shutdown_connections 2024-09-19T06:44:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e800a33b0 0x7f5e800a5870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e941a7940 0x7f5e941a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e94116ea0 0x7f5e941a35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 --2- 172.21.15.12:0/801030200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e941091f0 0x7f5e941a3070 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 -- 172.21.15.12:0/801030200 >> 172.21.15.12:0/801030200 conn(0x7f5e9406e2d0 msgr2=0x7f5e94117570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 -- 172.21.15.12:0/801030200 shutdown_connections 2024-09-19T06:44:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:15.672+0000 7f5e998e0640 1 -- 172.21.15.12:0/801030200 wait complete. 2024-09-19T06:44:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.698+0000 7f2953fff740 1 Processor -- start 2024-09-19T06:44:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.698+0000 7f2953fff740 1 -- start start 2024-09-19T06:44:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.698+0000 7f2953fff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa35844b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.698+0000 7f2953fff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa359e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.698+0000 7f2953fff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa359eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.698+0000 7f2953fff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f294c1b3ef0 con 0x564aa357baf0 2024-09-19T06:44:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.698+0000 7f2953fff740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f294c1b5a30 con 0x564aa357c410 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.698+0000 7f2953fff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f294c1b45c0 con 0x564aa3586cb0 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.699+0000 7f294ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa35844b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.699+0000 7f294a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa359e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.699+0000 7f294ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa35844b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59478/0 (socket says 172.21.15.12:59478) 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.699+0000 7f294ad9d640 1 -- 172.21.15.12:0/833136275 learned_addr learned my addr 172.21.15.12:0/833136275 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.699+0000 7f294a59c640 1 -- 172.21.15.12:0/833136275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 msgr2=0x564aa359eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.699+0000 7f294a59c640 1 --2- 172.21.15.12:0/833136275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa359eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.699+0000 7f294a59c640 1 -- 172.21.15.12:0/833136275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 msgr2=0x564aa35844b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.699+0000 7f294a59c640 1 --2- 172.21.15.12:0/833136275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa35844b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.699+0000 7f294a59c640 1 -- 172.21.15.12:0/833136275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aa357d000 con 0x564aa357c410 2024-09-19T06:44:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.699+0000 7f294a59c640 1 --2- 172.21.15.12:0/833136275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa359e990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2940009830 tx=0x7f294002a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2853870fe642e74a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.700+0000 7f2930ff9640 1 -- 172.21.15.12:0/833136275 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2940037040 con 0x564aa357c410 2024-09-19T06:44:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.700+0000 7f2930ff9640 1 -- 172.21.15.12:0/833136275 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2940038040 con 0x564aa357c410 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.700+0000 7f2930ff9640 1 -- 172.21.15.12:0/833136275 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2940004940 con 0x564aa357c410 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 -- 172.21.15.12:0/833136275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 msgr2=0x564aa359e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 --2- 172.21.15.12:0/833136275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa359e990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2940009830 tx=0x7f294002a340 comp rx=0 tx=0).stop 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 -- 172.21.15.12:0/833136275 shutdown_connections 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 --2- 172.21.15.12:0/833136275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa3586cb0 0x564aa359eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 --2- 172.21.15.12:0/833136275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa357c410 0x564aa359e990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 --2- 172.21.15.12:0/833136275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357baf0 0x564aa35844b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 -- 172.21.15.12:0/833136275 >> 172.21.15.12:0/833136275 conn(0x564aa3578060 msgr2=0x564aa3585c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 -- 172.21.15.12:0/833136275 shutdown_connections 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 -- 172.21.15.12:0/833136275 wait complete. 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 -- start start 2024-09-19T06:44:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.701+0000 7f2953fff740 1 Processor -- start 2024-09-19T06:44:15.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f2953fff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa357baf0 0x564aa358f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f2953fff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357c410 0x564aa358a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f2953fff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa3586cb0 0x564aa358afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f2953fff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f294c1b5360 con 0x564aa357c410 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f2953fff740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f294c1b4c90 con 0x564aa3586cb0 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f2953fff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f294c1b1ed0 con 0x564aa357baf0 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f2953fff740 10 client.0 _ll_register_callbacks cb 0x7f293c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357c410 0x564aa358a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294b59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa3586cb0 0x564aa358afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357c410 0x564aa358a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59486/0 (socket says 172.21.15.12:59486) 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa357baf0 0x564aa358f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294a59c640 1 -- 172.21.15.12:0/4134486484 learned_addr learned my addr 172.21.15.12:0/4134486484 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294ad9d640 1 -- 172.21.15.12:0/4134486484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa3586cb0 msgr2=0x564aa358afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294ad9d640 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa3586cb0 0x564aa358afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294ad9d640 1 -- 172.21.15.12:0/4134486484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357c410 msgr2=0x564aa358a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294ad9d640 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357c410 0x564aa358a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294ad9d640 1 -- 172.21.15.12:0/4134486484 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564aa3600960 con 0x564aa357baf0 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294a59c640 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357c410 0x564aa358a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.702+0000 7f294b59e640 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa3586cb0 0x564aa358afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f294ad9d640 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa357baf0 0x564aa358f530 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f293c0a49f0 tx=0x7f293c09be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66791aa297a48bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f292eff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f292eff5640 1 -- 172.21.15.12:0/4134486484 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c0ba060 con 0x564aa357baf0 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f292eff5640 1 -- 172.21.15.12:0/4134486484 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f293c0cd9a0 con 0x564aa357baf0 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f2953fff740 1 -- 172.21.15.12:0/4134486484 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2940038040 con 0x564aa357baf0 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f292eff5640 1 -- 172.21.15.12:0/4134486484 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f293c0abe80 con 0x564aa357baf0 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f2953fff740 10 client.26164 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f2953fff740 1 -- 172.21.15.12:0/4134486484 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564aa3601ac0 con 0x564aa357baf0 2024-09-19T06:44:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f292eff5640 1 -- 172.21.15.12:0/4134486484 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2940038040 con 0x564aa357baf0 2024-09-19T06:44:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f292eff5640 1 -- 172.21.15.12:0/4134486484 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f293c0a4a90 con 0x564aa357baf0 2024-09-19T06:44:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f2953fff740 10 client.26164 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f2953fff740 10 client.26164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.703+0000 7f2953fff740 20 client.26164 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.704+0000 7f2953fff740 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aa3596c70 0x564aa3603e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.704+0000 7f2953fff740 4 client.26164 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:44:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.704+0000 7f2953fff740 1 -- 172.21.15.12:0/4134486484 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564aa34e7d70 con 0x564aa3596c70 2024-09-19T06:44:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.704+0000 7f294a59c640 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aa3596c70 0x564aa3603e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.706+0000 7f294a59c640 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aa3596c70 0x564aa3603e10 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1806da6073e673f server_cookie=e5f4a0d527073a95 in_seq=0 out_seq=0 2024-09-19T06:44:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.706+0000 7f292eff5640 10 client.26164 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.719+0000 7f292eff5640 1 -- 172.21.15.12:0/4134486484 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564aa34e7d70 con 0x564aa3596c70 2024-09-19T06:44:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.719+0000 7f292eff5640 10 client.26164 handle_command_reply: tid=0 2024-09-19T06:44:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.719+0000 7f2953fff740 1 client.26164 shutdown 2024-09-19T06:44:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 1 -- 172.21.15.12:0/4134486484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa357baf0 msgr2=0x564aa358f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa357baf0 0x564aa358f530 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f293c0a49f0 tx=0x7f293c09be40 comp rx=0 tx=0).stop 2024-09-19T06:44:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 1 -- 172.21.15.12:0/4134486484 shutdown_connections 2024-09-19T06:44:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aa3596c70 0x564aa3603e10 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aa3586cb0 0x564aa358afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aa357c410 0x564aa358a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 1 --2- 172.21.15.12:0/4134486484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aa357baf0 0x564aa358f530 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f292eff5640 0 client.26164 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 1 -- 172.21.15.12:0/4134486484 >> 172.21.15.12:0/4134486484 conn(0x564aa3578060 msgr2=0x564aa35769a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 1 -- 172.21.15.12:0/4134486484 shutdown_connections 2024-09-19T06:44:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 1 -- 172.21.15.12:0/4134486484 wait complete. 2024-09-19T06:44:15.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.720+0000 7f2953fff740 20 client.26164 trim_cache size 0 max 16384 2024-09-19T06:44:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:44:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:44:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:44:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:44:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29340a3560 msgr2=0x7f29340a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29340a3560 0x7f29340a5a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2944005e30 tx=0x7f2944005d80 comp rx=0 tx=0).stop 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f294c108340 msgr2=0x7f294c19ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f294c108340 0x7f294c19ea90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f293c00e9f0 tx=0x7f293c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 shutdown_connections 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29340a3560 0x7f29340a5a20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f294c1a3380 0x7f294c1a3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f294c10d490 0x7f294c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 --2- 172.21.15.12:0/232634283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f294c108340 0x7f294c19ea90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 >> 172.21.15.12:0/232634283 conn(0x7f294c077a40 msgr2=0x7f294c078d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 shutdown_connections 2024-09-19T06:44:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:15.721+0000 7f295118f640 1 -- 172.21.15.12:0/232634283 wait complete. 2024-09-19T06:44:15.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 210.0 s, 3612.2 tps, lat 27.667 ms stddev 48.857 2024-09-19T06:44:16.578 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:44:17.017 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:17.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:17 smithi012 ceph-mon[30937]: pgmap v127: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 82 MiB/s wr, 2.89k op/s 2024-09-19T06:44:17.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:17 smithi016 ceph-mon[34911]: pgmap v127: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 82 MiB/s wr, 2.89k op/s 2024-09-19T06:44:17.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:17 smithi173 ceph-mon[35349]: pgmap v127: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 82 MiB/s wr, 2.89k op/s 2024-09-19T06:44:17.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.601+0000 7fc47628a640 1 -- 172.21.15.12:0/1715311653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc470100930 msgr2=0x7fc470100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.601+0000 7fc47628a640 1 --2- 172.21.15.12:0/1715311653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc470100930 0x7fc470100d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc460009900 tx=0x7fc46002a410 comp rx=0 tx=0).stop 2024-09-19T06:44:17.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.601+0000 7fc47628a640 1 -- 172.21.15.12:0/1715311653 shutdown_connections 2024-09-19T06:44:17.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.602+0000 7fc47628a640 1 --2- 172.21.15.12:0/1715311653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47010e4e0 0x7fc4701108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.602+0000 7fc47628a640 1 --2- 172.21.15.12:0/1715311653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4701012e0 0x7fc47010dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.602+0000 7fc47628a640 1 --2- 172.21.15.12:0/1715311653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc470100930 0x7fc470100d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.602+0000 7fc47628a640 1 -- 172.21.15.12:0/1715311653 >> 172.21.15.12:0/1715311653 conn(0x7fc4700fc7a0 msgr2=0x7fc4700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.602+0000 7fc47628a640 1 -- 172.21.15.12:0/1715311653 shutdown_connections 2024-09-19T06:44:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.602+0000 7fc47628a640 1 -- 172.21.15.12:0/1715311653 wait complete. 2024-09-19T06:44:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.603+0000 7fc47628a640 1 Processor -- start 2024-09-19T06:44:17.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.603+0000 7fc47628a640 1 -- start start 2024-09-19T06:44:17.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc47628a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc470100930 0x7fc4701a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc47628a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4701012e0 0x7fc4701a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc47628a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc47010e4e0 0x7fc47010d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc47628a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4701048e0 con 0x7fc4701012e0 2024-09-19T06:44:17.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc47628a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc470104760 con 0x7fc470100930 2024-09-19T06:44:17.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc47628a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc470104a60 con 0x7fc47010e4e0 2024-09-19T06:44:17.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc470100930 0x7fc4701a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc470100930 0x7fc4701a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38024/0 (socket says 172.21.15.12:38024) 2024-09-19T06:44:17.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc46ffff640 1 -- 172.21.15.12:0/3885381642 learned_addr learned my addr 172.21.15.12:0/3885381642 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:17.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc474827640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc47010e4e0 0x7fc47010d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4701012e0 0x7fc4701a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc474827640 1 -- 172.21.15.12:0/3885381642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc470100930 msgr2=0x7fc4701a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc474827640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc470100930 0x7fc4701a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc474827640 1 -- 172.21.15.12:0/3885381642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4701012e0 msgr2=0x7fc4701a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc474827640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4701012e0 0x7fc4701a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.604+0000 7fc474827640 1 -- 172.21.15.12:0/3885381642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47010db50 con 0x7fc47010e4e0 2024-09-19T06:44:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.605+0000 7fc474827640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc47010e4e0 0x7fc47010d420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc468005fd0 tx=0x7fc46800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.605+0000 7fc46d7fa640 1 -- 172.21.15.12:0/3885381642 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46800cdf0 con 0x7fc47010e4e0 2024-09-19T06:44:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.605+0000 7fc47628a640 1 -- 172.21.15.12:0/3885381642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc47010de40 con 0x7fc47010e4e0 2024-09-19T06:44:17.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.606+0000 7fc47628a640 1 -- 172.21.15.12:0/3885381642 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4701ab590 con 0x7fc47010e4e0 2024-09-19T06:44:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.606+0000 7fc46d7fa640 1 -- 172.21.15.12:0/3885381642 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc468005020 con 0x7fc47010e4e0 2024-09-19T06:44:17.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.606+0000 7fc46d7fa640 1 -- 172.21.15.12:0/3885381642 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4680106d0 con 0x7fc47010e4e0 2024-09-19T06:44:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.610+0000 7fc46d7fa640 1 -- 172.21.15.12:0/3885381642 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc468004b20 con 0x7fc47010e4e0 2024-09-19T06:44:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.614+0000 7fc478663740 1 Processor -- start 2024-09-19T06:44:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.614+0000 7fc478663740 1 -- start start 2024-09-19T06:44:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.614+0000 7fc478663740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41c5b40 0x5555f41c4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.614+0000 7fc478663740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c45d0 0x5555f41c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.614+0000 7fc478663740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41cf370 0x5555f41d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.614+0000 7fc478663740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5555f412a2f0 con 0x5555f41cf370 2024-09-19T06:44:17.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.614+0000 7fc478663740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5555f40d1cf0 con 0x5555f41c45d0 2024-09-19T06:44:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.614+0000 7fc478663740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5555f41262b0 con 0x5555f41c5b40 2024-09-19T06:44:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.615+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c45d0 0x5555f41c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.615+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c45d0 0x5555f41c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38032/0 (socket says 172.21.15.12:38032) 2024-09-19T06:44:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.615+0000 7fc46ffff640 1 -- 172.21.15.12:0/919117604 learned_addr learned my addr 172.21.15.12:0/919117604 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.616+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/919117604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41cf370 0x5555f41d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.616+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/919117604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41c5b40 0x5555f41c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.617+0000 7fc46f7fe640 1 -- 172.21.15.12:0/919117604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41c5b40 msgr2=0x5555f41c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.617+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/919117604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41c5b40 0x5555f41c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.617+0000 7fc46f7fe640 1 -- 172.21.15.12:0/919117604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c45d0 msgr2=0x5555f41c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.617+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/919117604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c45d0 0x5555f41c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.617+0000 7fc46f7fe640 1 -- 172.21.15.12:0/919117604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f40b63a0 con 0x5555f41cf370 2024-09-19T06:44:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.617+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/919117604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41cf370 0x5555f41d1760 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc47010ed50 tx=0x7fc464009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43eb86ff282acefa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:17.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.619+0000 7fc4567fc640 1 -- 172.21.15.12:0/919117604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46400f450 con 0x5555f41cf370 2024-09-19T06:44:17.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.620+0000 7fc4567fc640 1 -- 172.21.15.12:0/919117604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc46400fad0 con 0x5555f41cf370 2024-09-19T06:44:17.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.620+0000 7fc46d7fa640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4580a35c0 0x7fc4580a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.620+0000 7fc4567fc640 1 -- 172.21.15.12:0/919117604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46401eb70 con 0x5555f41cf370 2024-09-19T06:44:17.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.620+0000 7fc46d7fa640 1 -- 172.21.15.12:0/3885381642 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc4680d02d0 con 0x7fc47010e4e0 2024-09-19T06:44:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.621+0000 7fc478663740 1 -- 172.21.15.12:0/919117604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41cf370 msgr2=0x5555f41d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.621+0000 7fc478663740 1 --2- 172.21.15.12:0/919117604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41cf370 0x5555f41d1760 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc47010ed50 tx=0x7fc464009640 comp rx=0 tx=0).stop 2024-09-19T06:44:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.621+0000 7fc46ffff640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4580a35c0 0x7fc4580a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.622+0000 7fc478663740 1 -- 172.21.15.12:0/919117604 shutdown_connections 2024-09-19T06:44:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.622+0000 7fc478663740 1 --2- 172.21.15.12:0/919117604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41cf370 0x5555f41d1760 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.622+0000 7fc478663740 1 --2- 172.21.15.12:0/919117604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c45d0 0x5555f41c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.622+0000 7fc478663740 1 --2- 172.21.15.12:0/919117604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41c5b40 0x5555f41c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.622+0000 7fc478663740 1 -- 172.21.15.12:0/919117604 >> 172.21.15.12:0/919117604 conn(0x5555f418d310 msgr2=0x5555f41c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:17.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.627+0000 7fc46ffff640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4580a35c0 0x7fc4580a5a80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x5555f41c1ac0 tx=0x7fc46002a910 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:17.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.627+0000 7fc478663740 1 -- 172.21.15.12:0/919117604 shutdown_connections 2024-09-19T06:44:17.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.627+0000 7fc478663740 1 -- 172.21.15.12:0/919117604 wait complete. 2024-09-19T06:44:17.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.628+0000 7fc478663740 1 -- start start 2024-09-19T06:44:17.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.628+0000 7fc478663740 1 Processor -- start 2024-09-19T06:44:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.629+0000 7fc478663740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c45d0 0x5555f41ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.629+0000 7fc478663740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.629+0000 7fc478663740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41cf370 0x5555f41cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.629+0000 7fc478663740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5555f41e3080 con 0x5555f41c5b40 2024-09-19T06:44:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.629+0000 7fc478663740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5555f40e5060 con 0x5555f41c45d0 2024-09-19T06:44:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.629+0000 7fc478663740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5555f41e3200 con 0x5555f41cf370 2024-09-19T06:44:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.630+0000 7fc478663740 10 client.0 _ll_register_callbacks cb 0x5555f3e388c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.630+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.630+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59504/0 (socket says 172.21.15.12:59504) 2024-09-19T06:44:17.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.630+0000 7fc46f7fe640 1 -- 172.21.15.12:0/595998472 learned_addr learned my addr 172.21.15.12:0/595998472 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:17.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.630+0000 7fc46f7fe640 1 -- 172.21.15.12:0/595998472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41cf370 msgr2=0x5555f41cc650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:17.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.630+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41cf370 0x5555f41cc650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.630+0000 7fc46f7fe640 1 -- 172.21.15.12:0/595998472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c45d0 msgr2=0x5555f41ced90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:17.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.630+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c45d0 0x5555f41ced90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.630+0000 7fc46f7fe640 1 -- 172.21.15.12:0/595998472 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555f3e9b3c0 con 0x5555f41c5b40 2024-09-19T06:44:17.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.631+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41cc040 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc464015020 tx=0x7fc46401e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dd7b6c6830fa9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.631+0000 7fc44f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.632+0000 7fc44f7fe640 1 -- 172.21.15.12:0/595998472 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46400f720 con 0x5555f41c5b40 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.632+0000 7fc44f7fe640 1 -- 172.21.15.12:0/595998472 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc46400f8c0 con 0x5555f41c5b40 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.632+0000 7fc478663740 1 -- 172.21.15.12:0/595998472 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc46400fad0 con 0x5555f41c5b40 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.632+0000 7fc44f7fe640 1 -- 172.21.15.12:0/595998472 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc46401e8f0 con 0x5555f41c5b40 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.632+0000 7fc478663740 10 client.16638 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.632+0000 7fc478663740 1 -- 172.21.15.12:0/595998472 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5555f41eebc0 con 0x5555f41c5b40 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.633+0000 7fc44f7fe640 1 -- 172.21.15.12:0/595998472 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc464028480 con 0x5555f41c5b40 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.633+0000 7fc44f7fe640 1 -- 172.21.15.12:0/595998472 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fc464032420 con 0x5555f41c5b40 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.633+0000 7fc478663740 10 client.16638 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.633+0000 7fc478663740 10 client.16638 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.633+0000 7fc478663740 20 client.16638 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:17.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.633+0000 7fc478663740 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5555f41eff10 0x5555f41f2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.633+0000 7fc478663740 4 client.16638 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.633+0000 7fc478663740 1 -- 172.21.15.12:0/595998472 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc46400fad0 con 0x5555f41eff10 2024-09-19T06:44:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.633+0000 7fc46ffff640 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5555f41eff10 0x5555f41f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.634+0000 7fc46ffff640 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5555f41eff10 0x5555f41f2300 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b010f9f914d56ec4 server_cookie=8e7dc53b8c4ad367 in_seq=0 out_seq=0 2024-09-19T06:44:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.634+0000 7fc44f7fe640 10 client.16638 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:44:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.635+0000 7fc44f7fe640 1 -- 172.21.15.12:0/595998472 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc46400fad0 con 0x5555f41eff10 2024-09-19T06:44:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.635+0000 7fc44f7fe640 10 client.16638 handle_command_reply: tid=0 2024-09-19T06:44:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.635+0000 7fc478663740 1 client.16638 shutdown 2024-09-19T06:44:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.636+0000 7fc478663740 1 -- 172.21.15.12:0/595998472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 msgr2=0x5555f41cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.636+0000 7fc478663740 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41cc040 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc464015020 tx=0x7fc46401e5f0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.638+0000 7fc478663740 1 -- 172.21.15.12:0/595998472 shutdown_connections 2024-09-19T06:44:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.638+0000 7fc478663740 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5555f41eff10 0x5555f41f2300 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.639+0000 7fc44f7fe640 0 client.16638 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:44:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.639+0000 7fc478663740 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41cf370 0x5555f41cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.639+0000 7fc478663740 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41cc040 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.639+0000 7fc478663740 1 --2- 172.21.15.12:0/595998472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c45d0 0x5555f41ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.639+0000 7fc478663740 1 -- 172.21.15.12:0/595998472 >> 172.21.15.12:0/595998472 conn(0x5555f418d310 msgr2=0x5555f41c6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:17.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.639+0000 7fc478663740 1 -- 172.21.15.12:0/595998472 shutdown_connections 2024-09-19T06:44:17.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.639+0000 7fc478663740 1 -- 172.21.15.12:0/595998472 wait complete. 2024-09-19T06:44:17.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.639+0000 7fc478663740 20 client.16638 trim_cache size 0 max 16384 2024-09-19T06:44:17.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc478663740 1 Processor -- start 2024-09-19T06:44:17.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc478663740 1 -- start start 2024-09-19T06:44:17.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc478663740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c45d0 0x5555f41c7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc478663740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c5b40 0x5555f41c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc478663740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41cf370 0x5555f41d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc478663740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c00ea90 con 0x5555f41c45d0 2024-09-19T06:44:17.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc478663740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c0105d0 con 0x5555f41c5b40 2024-09-19T06:44:17.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc478663740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c00f160 con 0x5555f41cf370 2024-09-19T06:44:17.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c45d0 0x5555f41c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c45d0 0x5555f41c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59520/0 (socket says 172.21.15.12:59520) 2024-09-19T06:44:17.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc46ffff640 1 -- 172.21.15.12:0/1948313706 learned_addr learned my addr 172.21.15.12:0/1948313706 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:17.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.662+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/1948313706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c5b40 0x5555f41c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.663+0000 7fc474827640 1 --2- 172.21.15.12:0/1948313706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41cf370 0x5555f41d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.664+0000 7fc46ffff640 1 -- 172.21.15.12:0/1948313706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41cf370 msgr2=0x5555f41d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:17.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.664+0000 7fc46ffff640 1 --2- 172.21.15.12:0/1948313706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41cf370 0x5555f41d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.664+0000 7fc46ffff640 1 -- 172.21.15.12:0/1948313706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c5b40 msgr2=0x5555f41c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:17.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.664+0000 7fc46ffff640 1 --2- 172.21.15.12:0/1948313706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c5b40 0x5555f41c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.664+0000 7fc46ffff640 1 -- 172.21.15.12:0/1948313706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555f41c04f0 con 0x5555f41c45d0 2024-09-19T06:44:17.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.664+0000 7fc46ffff640 1 --2- 172.21.15.12:0/1948313706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c45d0 0x5555f41c7120 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc460000c00 tx=0x7fc46003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e796217ec4a0a71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:17.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.664+0000 7fc455ffb640 1 -- 172.21.15.12:0/1948313706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460035040 con 0x5555f41c45d0 2024-09-19T06:44:17.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.665+0000 7fc455ffb640 1 -- 172.21.15.12:0/1948313706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc460057070 con 0x5555f41c45d0 2024-09-19T06:44:17.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.665+0000 7fc455ffb640 1 -- 172.21.15.12:0/1948313706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460032820 con 0x5555f41c45d0 2024-09-19T06:44:17.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.666+0000 7fc478663740 1 -- 172.21.15.12:0/1948313706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c45d0 msgr2=0x5555f41c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.666+0000 7fc478663740 1 --2- 172.21.15.12:0/1948313706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c45d0 0x5555f41c7120 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc460000c00 tx=0x7fc46003f000 comp rx=0 tx=0).stop 2024-09-19T06:44:17.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.666+0000 7fc478663740 1 -- 172.21.15.12:0/1948313706 shutdown_connections 2024-09-19T06:44:17.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.666+0000 7fc478663740 1 --2- 172.21.15.12:0/1948313706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41cf370 0x5555f41d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.666+0000 7fc478663740 1 --2- 172.21.15.12:0/1948313706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41c5b40 0x5555f41c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.666+0000 7fc478663740 1 --2- 172.21.15.12:0/1948313706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c45d0 0x5555f41c7120 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.666+0000 7fc478663740 1 -- 172.21.15.12:0/1948313706 >> 172.21.15.12:0/1948313706 conn(0x5555f418d310 msgr2=0x5555f41ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:17.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.666+0000 7fc478663740 1 -- 172.21.15.12:0/1948313706 shutdown_connections 2024-09-19T06:44:17.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.666+0000 7fc478663740 1 -- 172.21.15.12:0/1948313706 wait complete. 2024-09-19T06:44:17.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.666+0000 7fc478663740 1 -- start start 2024-09-19T06:44:17.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.667+0000 7fc478663740 1 Processor -- start 2024-09-19T06:44:17.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.667+0000 7fc478663740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41c45d0 0x5555f41e8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.667+0000 7fc478663740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41e8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.668+0000 7fc478663740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41cf370 0x5555f41c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.668+0000 7fc478663740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c00ff00 con 0x5555f41c5b40 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.668+0000 7fc478663740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c00f830 con 0x5555f41cf370 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.668+0000 7fc478663740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c00ca70 con 0x5555f41c45d0 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.668+0000 7fc478663740 10 client.0 _ll_register_callbacks cb 0x7fc464005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.668+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41e8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.668+0000 7fc474827640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41cf370 0x5555f41c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.668+0000 7fc474827640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41cf370 0x5555f41c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38068/0 (socket says 172.21.15.12:38068) 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.668+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41e8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59532/0 (socket says 172.21.15.12:59532) 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.668+0000 7fc474827640 1 -- 172.21.15.12:0/2775221627 learned_addr learned my addr 172.21.15.12:0/2775221627 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:17.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.669+0000 7fc46f7fe640 1 -- 172.21.15.12:0/2775221627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41c45d0 msgr2=0x5555f41e8520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:17.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.669+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41c45d0 0x5555f41e8520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.669+0000 7fc46f7fe640 1 -- 172.21.15.12:0/2775221627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41cf370 msgr2=0x5555f41c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:17.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.669+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41cf370 0x5555f41c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.669+0000 7fc46f7fe640 1 -- 172.21.15.12:0/2775221627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555f41c87f0 con 0x5555f41c5b40 2024-09-19T06:44:17.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.669+0000 7fc46f7fe640 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41e8a60 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x5555f41cd5f0 tx=0x7fc464009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b5fae6d00238ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:17.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.669+0000 7fc44f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.670+0000 7fc44f7fe640 1 -- 172.21.15.12:0/2775221627 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46400f720 con 0x5555f41c5b40 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.670+0000 7fc478663740 1 -- 172.21.15.12:0/2775221627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc460057070 con 0x5555f41c5b40 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.670+0000 7fc44f7fe640 1 -- 172.21.15.12:0/2775221627 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc46400f8c0 con 0x5555f41c5b40 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.671+0000 7fc44f7fe640 1 -- 172.21.15.12:0/2775221627 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc464040050 con 0x5555f41c5b40 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.671+0000 7fc478663740 10 client.16644 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.671+0000 7fc478663740 1 -- 172.21.15.12:0/2775221627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5555f41c9a60 con 0x5555f41c5b40 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.672+0000 7fc44f7fe640 1 -- 172.21.15.12:0/2775221627 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc460057070 con 0x5555f41c5b40 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.672+0000 7fc44f7fe640 1 -- 172.21.15.12:0/2775221627 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fc4640035f0 con 0x5555f41c5b40 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.672+0000 7fc478663740 10 client.16644 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.672+0000 7fc478663740 10 client.16644 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:44:17.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.672+0000 7fc478663740 20 client.16644 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:17.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.672+0000 7fc478663740 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5555f41eff10 0x5555f425da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:17.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.672+0000 7fc478663740 4 client.16644 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:44:17.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.672+0000 7fc478663740 1 -- 172.21.15.12:0/2775221627 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5555f4137860 con 0x5555f41eff10 2024-09-19T06:44:17.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.672+0000 7fc46ffff640 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5555f41eff10 0x5555f425da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:17.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.673+0000 7fc46ffff640 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5555f41eff10 0x5555f425da10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ac63ab70d5af7ca server_cookie=14d65290b23467f1 in_seq=0 out_seq=0 2024-09-19T06:44:17.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.674+0000 7fc44f7fe640 10 client.16644 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:44:17.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.674+0000 7fc44f7fe640 1 -- 172.21.15.12:0/2775221627 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5555f4137860 con 0x5555f41eff10 2024-09-19T06:44:17.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.674+0000 7fc44f7fe640 10 client.16644 handle_command_reply: tid=0 2024-09-19T06:44:17.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.674+0000 7fc478663740 1 client.16644 shutdown 2024-09-19T06:44:17.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.674+0000 7fc478663740 1 -- 172.21.15.12:0/2775221627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 msgr2=0x5555f41e8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.674+0000 7fc478663740 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41e8a60 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x5555f41cd5f0 tx=0x7fc464009970 comp rx=0 tx=0).stop 2024-09-19T06:44:17.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.675+0000 7fc478663740 1 -- 172.21.15.12:0/2775221627 shutdown_connections 2024-09-19T06:44:17.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.675+0000 7fc478663740 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5555f41eff10 0x5555f425da10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.675+0000 7fc478663740 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5555f41cf370 0x5555f41c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.675+0000 7fc478663740 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5555f41c5b40 0x5555f41e8a60 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.675+0000 7fc478663740 1 --2- 172.21.15.12:0/2775221627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555f41c45d0 0x5555f41e8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.675+0000 7fc478663740 1 -- 172.21.15.12:0/2775221627 >> 172.21.15.12:0/2775221627 conn(0x5555f418d310 msgr2=0x5555f41bf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:17.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.675+0000 7fc44f7fe640 0 client.16644 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:44:17.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.675+0000 7fc478663740 1 -- 172.21.15.12:0/2775221627 shutdown_connections 2024-09-19T06:44:17.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.675+0000 7fc478663740 1 -- 172.21.15.12:0/2775221627 wait complete. 2024-09-19T06:44:17.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.675+0000 7fc478663740 20 client.16644 trim_cache size 0 max 16384 2024-09-19T06:44:17.678 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:44:17.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 -- 172.21.15.12:0/3885381642 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4580a35c0 msgr2=0x7fc4580a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4580a35c0 0x7fc4580a5a80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x5555f41c1ac0 tx=0x7fc46002a910 comp rx=0 tx=0).stop 2024-09-19T06:44:17.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 -- 172.21.15.12:0/3885381642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc47010e4e0 msgr2=0x7fc47010d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:17.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc47010e4e0 0x7fc47010d420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc468005fd0 tx=0x7fc46800ef10 comp rx=0 tx=0).stop 2024-09-19T06:44:17.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 -- 172.21.15.12:0/3885381642 shutdown_connections 2024-09-19T06:44:17.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4580a35c0 0x7fc4580a5a80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc47010e4e0 0x7fc47010d420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4701012e0 0x7fc4701a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 --2- 172.21.15.12:0/3885381642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc470100930 0x7fc4701a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:17.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 -- 172.21.15.12:0/3885381642 >> 172.21.15.12:0/3885381642 conn(0x7fc4700fc7a0 msgr2=0x7fc4700feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:17.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 -- 172.21.15.12:0/3885381642 shutdown_connections 2024-09-19T06:44:17.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:17.677+0000 7fc47628a640 1 -- 172.21.15.12:0/3885381642 wait complete. 2024-09-19T06:44:19.158 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:44:19.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:19 smithi012 ceph-mon[30937]: pgmap v128: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 MiB/s wr, 1.85k op/s 2024-09-19T06:44:19.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:19 smithi016 ceph-mon[34911]: pgmap v128: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 MiB/s wr, 1.85k op/s 2024-09-19T06:44:19.577 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:19.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:19 smithi173 ceph-mon[35349]: pgmap v128: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 MiB/s wr, 1.85k op/s 2024-09-19T06:44:20.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.203+0000 7f20f5196640 1 -- 172.21.15.12:0/2687765634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f0109120 msgr2=0x7f20f0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.203+0000 7f20f5196640 1 --2- 172.21.15.12:0/2687765634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f0109120 0x7f20f0110ca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009ca0 tx=0x7f20e802a8f0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.204+0000 7f20f5196640 1 -- 172.21.15.12:0/2687765634 shutdown_connections 2024-09-19T06:44:20.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.204+0000 7f20f5196640 1 --2- 172.21.15.12:0/2687765634 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f0109120 0x7f20f0110ca0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.204+0000 7f20f5196640 1 --2- 172.21.15.12:0/2687765634 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f01049a0 0x7f20f01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.204+0000 7f20f5196640 1 --2- 172.21.15.12:0/2687765634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f0103ff0 0x7f20f01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.204+0000 7f20f5196640 1 -- 172.21.15.12:0/2687765634 >> 172.21.15.12:0/2687765634 conn(0x7f20f00ffab0 msgr2=0x7f20f0101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:20.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.204+0000 7f20f5196640 1 -- 172.21.15.12:0/2687765634 shutdown_connections 2024-09-19T06:44:20.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.204+0000 7f20f5196640 1 -- 172.21.15.12:0/2687765634 wait complete. 2024-09-19T06:44:20.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.206+0000 7f20f5196640 1 Processor -- start 2024-09-19T06:44:20.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.206+0000 7f20f5196640 1 -- start start 2024-09-19T06:44:20.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.207+0000 7f20f5196640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f0103ff0 0x7f20f019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.207+0000 7f20f5196640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f01049a0 0x7f20f019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.207+0000 7f20f5196640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f0109120 0x7f20f019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.207+0000 7f20f5196640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20f01141f0 con 0x7f20f0109120 2024-09-19T06:44:20.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.207+0000 7f20f5196640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0114070 con 0x7f20f01049a0 2024-09-19T06:44:20.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.207+0000 7f20f5196640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0114370 con 0x7f20f0103ff0 2024-09-19T06:44:20.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.207+0000 7f20ef59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f0109120 0x7f20f019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.207+0000 7f20ef59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f0109120 0x7f20f019eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59552/0 (socket says 172.21.15.12:59552) 2024-09-19T06:44:20.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.207+0000 7f20ef59e640 1 -- 172.21.15.12:0/1661341894 learned_addr learned my addr 172.21.15.12:0/1661341894 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:20.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.208+0000 7f20ee59c640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f01049a0 0x7f20f019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.208+0000 7f20eed9d640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f0103ff0 0x7f20f019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.208+0000 7f20eed9d640 1 -- 172.21.15.12:0/1661341894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f01049a0 msgr2=0x7f20f019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.208+0000 7f20eed9d640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f01049a0 0x7f20f019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.208+0000 7f20eed9d640 1 -- 172.21.15.12:0/1661341894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f0109120 msgr2=0x7f20f019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.208+0000 7f20eed9d640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f0109120 0x7f20f019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.208+0000 7f20eed9d640 1 -- 172.21.15.12:0/1661341894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f019f5a0 con 0x7f20f0103ff0 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.209+0000 7f20eed9d640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f0103ff0 0x7f20f019a5f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f20e400d6d0 tx=0x7f20e400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.209+0000 7f20d7fff640 1 -- 172.21.15.12:0/1661341894 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4017070 con 0x7f20f0103ff0 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.209+0000 7f20f5196640 1 -- 172.21.15.12:0/1661341894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f019f890 con 0x7f20f0103ff0 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.209+0000 7f20f5196640 1 -- 172.21.15.12:0/1661341894 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f0076630 con 0x7f20f0103ff0 2024-09-19T06:44:20.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.210+0000 7f20d7fff640 1 -- 172.21.15.12:0/1661341894 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e4009820 con 0x7f20f0103ff0 2024-09-19T06:44:20.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.210+0000 7f20d7fff640 1 -- 172.21.15.12:0/1661341894 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4004d00 con 0x7f20f0103ff0 2024-09-19T06:44:20.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.212+0000 7f20d7fff640 1 -- 172.21.15.12:0/1661341894 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f20e4010670 con 0x7f20f0103ff0 2024-09-19T06:44:20.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.213+0000 7f20f756f740 1 Processor -- start 2024-09-19T06:44:20.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.213+0000 7f20f756f740 1 -- start start 2024-09-19T06:44:20.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.214+0000 7f20f756f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb7b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.214+0000 7f20f756f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb7ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.214+0000 7f20f756f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb99770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.214+0000 7f20f756f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564c6eae12f0 con 0x564c6eb7cb40 2024-09-19T06:44:20.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.214+0000 7f20f756f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564c6ea88cf0 con 0x564c6eb97380 2024-09-19T06:44:20.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.214+0000 7f20f756f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564c6eadd2b0 con 0x564c6eb7b5d0 2024-09-19T06:44:20.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.214+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb99770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.214+0000 7f20d7fff640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d80a3470 0x7f20d80a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.214+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb99770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38092/0 (socket says 172.21.15.12:38092) 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.215+0000 7f20ee59c640 1 -- 172.21.15.12:0/2322653273 learned_addr learned my addr 172.21.15.12:0/2322653273 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.215+0000 7f20d7fff640 1 -- 172.21.15.12:0/1661341894 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f20e40cf820 con 0x7f20f0103ff0 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.215+0000 7f20ee59c640 1 -- 172.21.15.12:0/2322653273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 msgr2=0x564c6eb7ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.215+0000 7f20ee59c640 1 --2- 172.21.15.12:0/2322653273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb7ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.215+0000 7f20ee59c640 1 -- 172.21.15.12:0/2322653273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 msgr2=0x564c6eb7b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.215+0000 7f20ee59c640 1 --2- 172.21.15.12:0/2322653273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb7b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.215+0000 7f20ee59c640 1 -- 172.21.15.12:0/2322653273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c6ea6d3a0 con 0x564c6eb97380 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.217+0000 7f20ee59c640 1 --2- 172.21.15.12:0/2322653273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb99770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f20e002d990 tx=0x7f20e002de50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d10ba54d62f7d7d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:20.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.217+0000 7f20ef59e640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d80a3470 0x7f20d80a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.218+0000 7f20d57fa640 1 -- 172.21.15.12:0/2322653273 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0038020 con 0x564c6eb97380 2024-09-19T06:44:20.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.218+0000 7f20d57fa640 1 -- 172.21.15.12:0/2322653273 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e00343f0 con 0x564c6eb97380 2024-09-19T06:44:20.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.218+0000 7f20d57fa640 1 -- 172.21.15.12:0/2322653273 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0030040 con 0x564c6eb97380 2024-09-19T06:44:20.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.219+0000 7f20ef59e640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d80a3470 0x7f20d80a5930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f20e8004af0 tx=0x7f20e8004a80 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:20.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.219+0000 7f20f756f740 1 -- 172.21.15.12:0/2322653273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 msgr2=0x564c6eb99770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.219+0000 7f20f756f740 1 --2- 172.21.15.12:0/2322653273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb99770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f20e002d990 tx=0x7f20e002de50 comp rx=0 tx=0).stop 2024-09-19T06:44:20.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.219+0000 7f20f756f740 1 -- 172.21.15.12:0/2322653273 shutdown_connections 2024-09-19T06:44:20.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.219+0000 7f20f756f740 1 --2- 172.21.15.12:0/2322653273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb99770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.219+0000 7f20f756f740 1 --2- 172.21.15.12:0/2322653273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb7ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.219+0000 7f20f756f740 1 --2- 172.21.15.12:0/2322653273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb7b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.219+0000 7f20f756f740 1 -- 172.21.15.12:0/2322653273 >> 172.21.15.12:0/2322653273 conn(0x564c6eb44310 msgr2=0x564c6eb77c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:20.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.220+0000 7f20f756f740 1 -- 172.21.15.12:0/2322653273 shutdown_connections 2024-09-19T06:44:20.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.220+0000 7f20f756f740 1 -- 172.21.15.12:0/2322653273 wait complete. 2024-09-19T06:44:20.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.221+0000 7f20f756f740 1 -- start start 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.221+0000 7f20f756f740 1 Processor -- start 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.221+0000 7f20f756f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb883c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.221+0000 7f20f756f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb88900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.221+0000 7f20f756f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb83700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.221+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb88900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.221+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb88900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59558/0 (socket says 172.21.15.12:59558) 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.221+0000 7f20ee59c640 1 -- 172.21.15.12:0/2440529799 learned_addr learned my addr 172.21.15.12:0/2440529799 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564c6eb7e5a0 con 0x564c6eb7cb40 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564c6ea9c060 con 0x564c6eb97380 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564c6eb7e720 con 0x564c6eb7b5d0 2024-09-19T06:44:20.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20ef59e640 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb83700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20f756f740 10 client.0 _ll_register_callbacks cb 0x564c6e7ef8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20eed9d640 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb883c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20ef59e640 1 -- 172.21.15.12:0/2440529799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 msgr2=0x564c6eb883c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20ef59e640 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb883c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20ef59e640 1 -- 172.21.15.12:0/2440529799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 msgr2=0x564c6eb88900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20ef59e640 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb88900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20ef59e640 1 -- 172.21.15.12:0/2440529799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c6e8523c0 con 0x564c6eb97380 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20ef59e640 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb83700 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f20e802ae60 tx=0x7f20e802adf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77c9f4067841a07f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20d2ff5640 1 -- 172.21.15.12:0/2440529799 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e802fe50 con 0x564c6eb97380 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20d2ff5640 1 -- 172.21.15.12:0/2440529799 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f20e80305f0 con 0x564c6eb97380 2024-09-19T06:44:20.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.222+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e00343f0 con 0x564c6eb97380 2024-09-19T06:44:20.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.223+0000 7f20d2ff5640 1 -- 172.21.15.12:0/2440529799 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f20e80307f0 con 0x564c6eb97380 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.223+0000 7f20f756f740 10 client.26213 fetch_fsmap learned FSMap version 34 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.223+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564c6eb92100 con 0x564c6eb97380 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.223+0000 7f20d2ff5640 1 -- 172.21.15.12:0/2440529799 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e00343f0 con 0x564c6eb97380 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.223+0000 7f20d2ff5640 1 -- 172.21.15.12:0/2440529799 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f20e8057070 con 0x564c6eb97380 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.224+0000 7f20f756f740 10 client.26213 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.224+0000 7f20f756f740 10 client.26213 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.224+0000 7f20f756f740 20 client.26213 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.224+0000 7f20f756f740 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x564c6eb93510 0x564c6eb95990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.224+0000 7f20f756f740 4 client.26213 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.224+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c6eaee860 con 0x564c6eb93510 2024-09-19T06:44:20.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.224+0000 7f20eed9d640 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x564c6eb93510 0x564c6eb95990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.225+0000 7f20eed9d640 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x564c6eb93510 0x564c6eb95990 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82c8b27c015b5d8a server_cookie=a65228db9eaad9be in_seq=0 out_seq=0 2024-09-19T06:44:20.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.225+0000 7f20d2ff5640 10 client.26213 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:44:20.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.225+0000 7f20d2ff5640 1 -- 172.21.15.12:0/2440529799 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c6eaee860 con 0x564c6eb93510 2024-09-19T06:44:20.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.225+0000 7f20d2ff5640 10 client.26213 handle_command_reply: tid=0 2024-09-19T06:44:20.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.225+0000 7f20f756f740 1 client.26213 shutdown 2024-09-19T06:44:20.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 msgr2=0x564c6eb83700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb83700 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f20e802ae60 tx=0x7f20e802adf0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 shutdown_connections 2024-09-19T06:44:20.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x564c6eb93510 0x564c6eb95990 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb97380 0x564c6eb83700 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20d2ff5640 0 client.26213 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:44:20.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb88900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 1 --2- 172.21.15.12:0/2440529799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb883c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 >> 172.21.15.12:0/2440529799 conn(0x564c6eb44310 msgr2=0x564c6eb7d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:20.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 shutdown_connections 2024-09-19T06:44:20.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 1 -- 172.21.15.12:0/2440529799 wait complete. 2024-09-19T06:44:20.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.226+0000 7f20f756f740 20 client.26213 trim_cache size 0 max 16384 2024-09-19T06:44:20.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20f756f740 1 Processor -- start 2024-09-19T06:44:20.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20f756f740 1 -- start start 2024-09-19T06:44:20.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20f756f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb82fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20f756f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb834e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20f756f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb93510 0x564c6eb9ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20f756f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc00e9d0 con 0x564c6eb7cb40 2024-09-19T06:44:20.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20f756f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc010510 con 0x564c6eb93510 2024-09-19T06:44:20.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb834e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb834e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59570/0 (socket says 172.21.15.12:59570) 2024-09-19T06:44:20.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20ee59c640 1 -- 172.21.15.12:0/1264361145 learned_addr learned my addr 172.21.15.12:0/1264361145 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:20.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.252+0000 7f20f756f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc00f0a0 con 0x564c6eb7b5d0 2024-09-19T06:44:20.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.253+0000 7f20eed9d640 1 --2- 172.21.15.12:0/1264361145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb82fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.253+0000 7f20ee59c640 1 -- 172.21.15.12:0/1264361145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 msgr2=0x564c6eb82fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:20.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.253+0000 7f20ee59c640 1 --2- 172.21.15.12:0/1264361145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb82fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.253+0000 7f20ee59c640 1 -- 172.21.15.12:0/1264361145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb93510 msgr2=0x564c6eb9ee70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.253+0000 7f20ee59c640 1 --2- 172.21.15.12:0/1264361145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb93510 0x564c6eb9ee70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.253+0000 7f20ee59c640 1 -- 172.21.15.12:0/1264361145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c6eb7bd50 con 0x564c6eb7cb40 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.253+0000 7f20ee59c640 1 --2- 172.21.15.12:0/1264361145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb834e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000c00 tx=0x7f20e0034e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d58179eefa3cfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.254+0000 7f20d4ff9640 1 -- 172.21.15.12:0/1264361145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e004a070 con 0x564c6eb7cb40 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.254+0000 7f20d4ff9640 1 -- 172.21.15.12:0/1264361145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e00343f0 con 0x564c6eb7cb40 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.254+0000 7f20d4ff9640 1 -- 172.21.15.12:0/1264361145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0038040 con 0x564c6eb7cb40 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.255+0000 7f20f756f740 1 -- 172.21.15.12:0/1264361145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 msgr2=0x564c6eb834e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.255+0000 7f20f756f740 1 --2- 172.21.15.12:0/1264361145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb834e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000c00 tx=0x7f20e0034e50 comp rx=0 tx=0).stop 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.255+0000 7f20f756f740 1 -- 172.21.15.12:0/1264361145 shutdown_connections 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.255+0000 7f20f756f740 1 --2- 172.21.15.12:0/1264361145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb93510 0x564c6eb9ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.255+0000 7f20f756f740 1 --2- 172.21.15.12:0/1264361145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb7cb40 0x564c6eb834e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.255+0000 7f20f756f740 1 --2- 172.21.15.12:0/1264361145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7b5d0 0x564c6eb82fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.255+0000 7f20f756f740 1 -- 172.21.15.12:0/1264361145 >> 172.21.15.12:0/1264361145 conn(0x564c6eb44310 msgr2=0x564c6eb883c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:20.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.255+0000 7f20f756f740 1 -- 172.21.15.12:0/1264361145 shutdown_connections 2024-09-19T06:44:20.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.255+0000 7f20f756f740 1 -- 172.21.15.12:0/1264361145 wait complete. 2024-09-19T06:44:20.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.256+0000 7f20f756f740 1 -- start start 2024-09-19T06:44:20.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.256+0000 7f20f756f740 1 Processor -- start 2024-09-19T06:44:20.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.257+0000 7f20f756f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb7b5d0 0x564c6eb8fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.257+0000 7f20f756f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7cb40 0x564c6eb80740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.257+0000 7f20f756f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb93510 0x564c6eb80c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.257+0000 7f20f756f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc00fe40 con 0x564c6eb93510 2024-09-19T06:44:20.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.257+0000 7f20f756f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc00f770 con 0x564c6eb7b5d0 2024-09-19T06:44:20.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.257+0000 7f20f756f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc00c9b0 con 0x564c6eb7cb40 2024-09-19T06:44:20.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.258+0000 7f20f756f740 10 client.0 _ll_register_callbacks cb 0x7f20e8031550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:20.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.258+0000 7f20ef59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb93510 0x564c6eb80c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.258+0000 7f20ef59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb93510 0x564c6eb80c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59574/0 (socket says 172.21.15.12:59574) 2024-09-19T06:44:20.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.258+0000 7f20ef59e640 1 -- 172.21.15.12:0/1203835351 learned_addr learned my addr 172.21.15.12:0/1203835351 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:20.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.258+0000 7f20ee59c640 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7cb40 0x564c6eb80740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.259+0000 7f20ef59e640 1 -- 172.21.15.12:0/1203835351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7cb40 msgr2=0x564c6eb80740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:20.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.259+0000 7f20ef59e640 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7cb40 0x564c6eb80740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.259+0000 7f20ef59e640 1 -- 172.21.15.12:0/1203835351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb7b5d0 msgr2=0x564c6eb8fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:20.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.259+0000 7f20ef59e640 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb7b5d0 0x564c6eb8fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.259+0000 7f20ef59e640 1 -- 172.21.15.12:0/1203835351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c6eb81460 con 0x564c6eb93510 2024-09-19T06:44:20.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.259+0000 7f20ef59e640 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb93510 0x564c6eb80c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009620 tx=0x7f20e802fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e06e89fb7097eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:20.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.259+0000 7f20d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.260+0000 7f20d2ff5640 1 -- 172.21.15.12:0/1203835351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8009890 con 0x564c6eb93510 2024-09-19T06:44:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.260+0000 7f20d2ff5640 1 -- 172.21.15.12:0/1203835351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f20e8030ba0 con 0x564c6eb93510 2024-09-19T06:44:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.260+0000 7f20f756f740 1 -- 172.21.15.12:0/1203835351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e00343f0 con 0x564c6eb93510 2024-09-19T06:44:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.261+0000 7f20d2ff5640 1 -- 172.21.15.12:0/1203835351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f20e8030da0 con 0x564c6eb93510 2024-09-19T06:44:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.261+0000 7f20f756f740 10 client.16656 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.261+0000 7f20f756f740 1 -- 172.21.15.12:0/1203835351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564c6ec00de0 con 0x564c6eb93510 2024-09-19T06:44:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.262+0000 7f20d2ff5640 1 -- 172.21.15.12:0/1203835351 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20e805e030 con 0x564c6eb93510 2024-09-19T06:44:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.262+0000 7f20d2ff5640 1 -- 172.21.15.12:0/1203835351 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f20e8057040 con 0x564c6eb93510 2024-09-19T06:44:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.262+0000 7f20f756f740 10 client.16656 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.262+0000 7f20f756f740 10 client.16656 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:44:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.262+0000 7f20f756f740 20 client.16656 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.262+0000 7f20f756f740 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x564c6eb97380 0x564c6ec035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.262+0000 7f20f756f740 4 client.16656 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:44:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.262+0000 7f20f756f740 1 -- 172.21.15.12:0/1203835351 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f20e00343f0 con 0x564c6eb97380 2024-09-19T06:44:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.262+0000 7f20eed9d640 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x564c6eb97380 0x564c6ec035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.263+0000 7f20eed9d640 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x564c6eb97380 0x564c6ec035a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d26bee940e4c1b1c server_cookie=f48b98239f37f1bd in_seq=0 out_seq=0 2024-09-19T06:44:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.263+0000 7f20d2ff5640 10 client.16656 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:44:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.263+0000 7f20d2ff5640 1 -- 172.21.15.12:0/1203835351 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f20e00343f0 con 0x564c6eb97380 2024-09-19T06:44:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.263+0000 7f20d2ff5640 10 client.16656 handle_command_reply: tid=0 2024-09-19T06:44:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.263+0000 7f20f756f740 1 client.16656 shutdown 2024-09-19T06:44:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.263+0000 7f20f756f740 1 -- 172.21.15.12:0/1203835351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb93510 msgr2=0x564c6eb80c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.263+0000 7f20f756f740 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb93510 0x564c6eb80c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009620 tx=0x7f20e802fa80 comp rx=0 tx=0).stop 2024-09-19T06:44:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.264+0000 7f20f756f740 1 -- 172.21.15.12:0/1203835351 shutdown_connections 2024-09-19T06:44:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.264+0000 7f20f756f740 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x564c6eb97380 0x564c6ec035a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.264+0000 7f20d2ff5640 0 client.16656 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:44:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.264+0000 7f20f756f740 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c6eb93510 0x564c6eb80c80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.264+0000 7f20f756f740 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c6eb7cb40 0x564c6eb80740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.264+0000 7f20f756f740 1 --2- 172.21.15.12:0/1203835351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c6eb7b5d0 0x564c6eb8fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.264+0000 7f20f756f740 1 -- 172.21.15.12:0/1203835351 >> 172.21.15.12:0/1203835351 conn(0x564c6eb44310 msgr2=0x564c6eb82e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:20.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.265+0000 7f20f756f740 1 -- 172.21.15.12:0/1203835351 shutdown_connections 2024-09-19T06:44:20.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.265+0000 7f20f756f740 1 -- 172.21.15.12:0/1203835351 wait complete. 2024-09-19T06:44:20.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.265+0000 7f20f756f740 20 client.16656 trim_cache size 0 max 16384 2024-09-19T06:44:20.267 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:44:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.266+0000 7f20f5196640 1 -- 172.21.15.12:0/1661341894 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d80a3470 msgr2=0x7f20d80a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.266+0000 7f20f5196640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d80a3470 0x7f20d80a5930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f20e8004af0 tx=0x7f20e8004a80 comp rx=0 tx=0).stop 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.266+0000 7f20f5196640 1 -- 172.21.15.12:0/1661341894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f0103ff0 msgr2=0x7f20f019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.266+0000 7f20f5196640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f0103ff0 0x7f20f019a5f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f20e400d6d0 tx=0x7f20e400db90 comp rx=0 tx=0).stop 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.266+0000 7f20f5196640 1 -- 172.21.15.12:0/1661341894 shutdown_connections 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.266+0000 7f20f5196640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20f0109120 0x7f20f019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.267+0000 7f20f5196640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20f01049a0 0x7f20f019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.267+0000 7f20f5196640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f20d80a3470 0x7f20d80a5930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.267+0000 7f20f5196640 1 --2- 172.21.15.12:0/1661341894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20f0103ff0 0x7f20f019a5f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.267+0000 7f20f5196640 1 -- 172.21.15.12:0/1661341894 >> 172.21.15.12:0/1661341894 conn(0x7f20f00ffab0 msgr2=0x7f20f01005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.267+0000 7f20f5196640 1 -- 172.21.15.12:0/1661341894 shutdown_connections 2024-09-19T06:44:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:20.267+0000 7f20f5196640 1 -- 172.21.15.12:0/1661341894 wait complete. 2024-09-19T06:44:20.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:20 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:20.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:20 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:20.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:20 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:20.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 215.0 s, 3548.4 tps, lat 28.083 ms stddev 34.611 2024-09-19T06:44:21.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:44:21.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:21 smithi016 ceph-mon[34911]: pgmap v129: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 51 MiB/s wr, 2.39k op/s 2024-09-19T06:44:21.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:21 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:44:21.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:21 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:21.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:21 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:21.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:21 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:44:21.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:21 smithi173 ceph-mon[35349]: pgmap v129: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 51 MiB/s wr, 2.39k op/s 2024-09-19T06:44:21.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:21 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:44:21.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:21 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:21.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:21 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:21.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:21 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:44:21.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:21 smithi012 ceph-mon[30937]: pgmap v129: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 51 MiB/s wr, 2.39k op/s 2024-09-19T06:44:21.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:21 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:44:21.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:21 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:21.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:21 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:21.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:21 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:44:21.681 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:22.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.306+0000 7f38c7ce4640 1 -- 172.21.15.12:0/2592815148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c0113940 msgr2=0x7f38c0115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.307+0000 7f38c7ce4640 1 --2- 172.21.15.12:0/2592815148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c0113940 0x7f38c0115d30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009ca0 tx=0x7f38b002a8b0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.307+0000 7f38c7ce4640 1 -- 172.21.15.12:0/2592815148 shutdown_connections 2024-09-19T06:44:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.307+0000 7f38c7ce4640 1 --2- 172.21.15.12:0/2592815148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c0113940 0x7f38c0115d30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.307+0000 7f38c7ce4640 1 --2- 172.21.15.12:0/2592815148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c010ae80 0x7f38c0113370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.307+0000 7f38c7ce4640 1 --2- 172.21.15.12:0/2592815148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c010a560 0x7f38c010a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.307+0000 7f38c7ce4640 1 -- 172.21.15.12:0/2592815148 >> 172.21.15.12:0/2592815148 conn(0x7f38c006e140 msgr2=0x7f38c006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.307+0000 7f38c7ce4640 1 -- 172.21.15.12:0/2592815148 shutdown_connections 2024-09-19T06:44:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.308+0000 7f38c7ce4640 1 -- 172.21.15.12:0/2592815148 wait complete. 2024-09-19T06:44:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.308+0000 7f38c7ce4640 1 Processor -- start 2024-09-19T06:44:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c7ce4640 1 -- start start 2024-09-19T06:44:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c7ce4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c010a560 0x7f38c01a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c7ce4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c010ae80 0x7f38c01a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c7ce4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c0113940 0x7f38c019e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c7ce4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01185b0 con 0x7f38c010ae80 2024-09-19T06:44:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c7ce4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0118430 con 0x7f38c0113940 2024-09-19T06:44:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c7ce4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0118730 con 0x7f38c010a560 2024-09-19T06:44:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c527f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c010ae80 0x7f38c01a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c527f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c010ae80 0x7f38c01a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35230/0 (socket says 172.21.15.12:35230) 2024-09-19T06:44:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c527f640 1 -- 172.21.15.12:0/16032063 learned_addr learned my addr 172.21.15.12:0/16032063 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.309+0000 7f38c5a80640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c010a560 0x7f38c01a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.310+0000 7f38c6281640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c0113940 0x7f38c019e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.310+0000 7f38c5a80640 1 -- 172.21.15.12:0/16032063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c0113940 msgr2=0x7f38c019e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:22.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.310+0000 7f38c5a80640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c0113940 0x7f38c019e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.310+0000 7f38c5a80640 1 -- 172.21.15.12:0/16032063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c010ae80 msgr2=0x7f38c01a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:22.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.310+0000 7f38c5a80640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c010ae80 0x7f38c01a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.310+0000 7f38c5a80640 1 -- 172.21.15.12:0/16032063 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c019ef70 con 0x7f38c010a560 2024-09-19T06:44:22.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.312+0000 7f38c5a80640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c010a560 0x7f38c01a4650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f38b800a870 tx=0x7f38b800ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:22.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.312+0000 7f38beffd640 1 -- 172.21.15.12:0/16032063 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b80079b0 con 0x7f38c010a560 2024-09-19T06:44:22.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.312+0000 7f38beffd640 1 -- 172.21.15.12:0/16032063 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b8005500 con 0x7f38c010a560 2024-09-19T06:44:22.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.312+0000 7f38beffd640 1 -- 172.21.15.12:0/16032063 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8004de0 con 0x7f38c010a560 2024-09-19T06:44:22.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.312+0000 7f38c7ce4640 1 -- 172.21.15.12:0/16032063 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c019f260 con 0x7f38c010a560 2024-09-19T06:44:22.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.313+0000 7f38c7ce4640 1 -- 172.21.15.12:0/16032063 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c01af8c0 con 0x7f38c010a560 2024-09-19T06:44:22.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.317+0000 7f38ca0bd740 1 Processor -- start 2024-09-19T06:44:22.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.317+0000 7f38ca0bd740 1 -- start start 2024-09-19T06:44:22.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38beffd640 1 -- 172.21.15.12:0/16032063 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f38b8004f80 con 0x7f38c010a560 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38ca0bd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5654dc7382f0 con 0x5654dc7e5b80 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38ca0bd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5654dc6dfcf0 con 0x5654dc7d3b40 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38c6281640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38c5a80640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38ca0bd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5654dc7342b0 con 0x5654dc7d25d0 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38c6281640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60256/0 (socket says 172.21.15.12:60256) 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.318+0000 7f38c6281640 1 -- 172.21.15.12:0/906783768 learned_addr learned my addr 172.21.15.12:0/906783768 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:22.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.319+0000 7f38c527f640 1 --2- 172.21.15.12:0/906783768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.319+0000 7f38c6281640 1 -- 172.21.15.12:0/906783768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 msgr2=0x5654dc7d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.319+0000 7f38c6281640 1 --2- 172.21.15.12:0/906783768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.319+0000 7f38c6281640 1 -- 172.21.15.12:0/906783768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 msgr2=0x5654dc7e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.319+0000 7f38c6281640 1 --2- 172.21.15.12:0/906783768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.319+0000 7f38c6281640 1 -- 172.21.15.12:0/906783768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654dc6c43a0 con 0x5654dc7d3b40 2024-09-19T06:44:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.319+0000 7f38beffd640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38a80a34b0 0x7f38a80a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.320+0000 7f38beffd640 1 -- 172.21.15.12:0/16032063 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f38b80cf170 con 0x7f38c010a560 2024-09-19T06:44:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.320+0000 7f38c6281640 1 --2- 172.21.15.12:0/906783768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7d2090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f38b002aea0 tx=0x7f38b0030450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7261f2832fa2863 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.320+0000 7f38c5a80640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38a80a34b0 0x7f38a80a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.320+0000 7f38a7fff640 1 -- 172.21.15.12:0/906783768 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0003970 con 0x5654dc7d3b40 2024-09-19T06:44:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.320+0000 7f38a7fff640 1 -- 172.21.15.12:0/906783768 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b0036030 con 0x5654dc7d3b40 2024-09-19T06:44:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.321+0000 7f38a7fff640 1 -- 172.21.15.12:0/906783768 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b00045a0 con 0x5654dc7d3b40 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.321+0000 7f38ca0bd740 1 -- 172.21.15.12:0/906783768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 msgr2=0x5654dc7d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.321+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/906783768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7d2090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f38b002aea0 tx=0x7f38b0030450 comp rx=0 tx=0).stop 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.322+0000 7f38c5a80640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38a80a34b0 0x7f38a80a5970 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5654dc7cfac0 tx=0x7f38b80d2ba0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.322+0000 7f38ca0bd740 1 -- 172.21.15.12:0/906783768 shutdown_connections 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.322+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/906783768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.322+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/906783768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.322+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/906783768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7d2090 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.322+0000 7f38ca0bd740 1 -- 172.21.15.12:0/906783768 >> 172.21.15.12:0/906783768 conn(0x5654dc79b310 msgr2=0x5654dc7cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.322+0000 7f38ca0bd740 1 -- 172.21.15.12:0/906783768 shutdown_connections 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.322+0000 7f38ca0bd740 1 -- 172.21.15.12:0/906783768 wait complete. 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.322+0000 7f38ca0bd740 1 -- start start 2024-09-19T06:44:22.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.323+0000 7f38ca0bd740 1 Processor -- start 2024-09-19T06:44:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.323+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7e5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.323+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.324+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.324+0000 7f38ca0bd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5654dc7e8870 con 0x5654dc7e5b80 2024-09-19T06:44:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.324+0000 7f38ca0bd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5654dc6f3060 con 0x5654dc7d3b40 2024-09-19T06:44:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.324+0000 7f38ca0bd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5654dc7e89f0 con 0x5654dc7d25d0 2024-09-19T06:44:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.324+0000 7f38c527f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.324+0000 7f38c527f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60262/0 (socket says 172.21.15.12:60262) 2024-09-19T06:44:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.324+0000 7f38c527f640 1 -- 172.21.15.12:0/768792873 learned_addr learned my addr 172.21.15.12:0/768792873 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:22.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.324+0000 7f38ca0bd740 10 client.0 _ll_register_callbacks cb 0x5654dc4468c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:22.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.324+0000 7f38c527f640 1 -- 172.21.15.12:0/768792873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 msgr2=0x5654dc7e5540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:22.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.324+0000 7f38c527f640 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7e5540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.325+0000 7f38c527f640 1 -- 172.21.15.12:0/768792873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 msgr2=0x5654dc7e2de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:22.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.325+0000 7f38c527f640 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.325+0000 7f38c527f640 1 -- 172.21.15.12:0/768792873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654dc4a93c0 con 0x5654dc7d3b40 2024-09-19T06:44:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.325+0000 7f38c527f640 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e27f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38b400bf80 tx=0x7f38b40128e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b8adb89c47cdadc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.325+0000 7f38a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:44:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.326+0000 7f38a57fa640 1 -- 172.21.15.12:0/768792873 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40035f0 con 0x5654dc7d3b40 2024-09-19T06:44:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.326+0000 7f38a57fa640 1 -- 172.21.15.12:0/768792873 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f38b4003790 con 0x5654dc7d3b40 2024-09-19T06:44:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.326+0000 7f38ca0bd740 1 -- 172.21.15.12:0/768792873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b0036030 con 0x5654dc7d3b40 2024-09-19T06:44:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.326+0000 7f38a57fa640 1 -- 172.21.15.12:0/768792873 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f38b4003990 con 0x5654dc7d3b40 2024-09-19T06:44:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.326+0000 7f38ca0bd740 10 client.26225 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.326+0000 7f38ca0bd740 1 -- 172.21.15.12:0/768792873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5654dc7f4360 con 0x5654dc7d3b40 2024-09-19T06:44:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.326+0000 7f38a57fa640 1 -- 172.21.15.12:0/768792873 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b4003b30 con 0x5654dc7d3b40 2024-09-19T06:44:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.327+0000 7f38a57fa640 1 -- 172.21.15.12:0/768792873 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f38b4021070 con 0x5654dc7d3b40 2024-09-19T06:44:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.327+0000 7f38ca0bd740 10 client.26225 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.327+0000 7f38ca0bd740 10 client.26225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.327+0000 7f38ca0bd740 20 client.26225 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.327+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654dc7f5870 0x5654dc7f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.327+0000 7f38ca0bd740 4 client.26225 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.327+0000 7f38ca0bd740 1 -- 172.21.15.12:0/768792873 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f38b0036030 con 0x5654dc7f5870 2024-09-19T06:44:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.327+0000 7f38c6281640 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654dc7f5870 0x5654dc7f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.328+0000 7f38c6281640 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654dc7f5870 0x5654dc7f7cd0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f85ad1f5c3b563ff server_cookie=a2621a1b23ba108f in_seq=0 out_seq=0 2024-09-19T06:44:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.328+0000 7f38a57fa640 10 client.26225 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38a57fa640 1 -- 172.21.15.12:0/768792873 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f38b0036030 con 0x5654dc7f5870 2024-09-19T06:44:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38a57fa640 10 client.26225 handle_command_reply: tid=0 2024-09-19T06:44:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38ca0bd740 1 client.26225 shutdown 2024-09-19T06:44:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38ca0bd740 1 -- 172.21.15.12:0/768792873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 msgr2=0x5654dc7e27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e27f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38b400bf80 tx=0x7f38b40128e0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38ca0bd740 1 -- 172.21.15.12:0/768792873 shutdown_connections 2024-09-19T06:44:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654dc7f5870 0x5654dc7f7cd0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38a57fa640 0 client.26225 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:22.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e27f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/768792873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7e5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.329+0000 7f38ca0bd740 1 -- 172.21.15.12:0/768792873 >> 172.21.15.12:0/768792873 conn(0x5654dc79b310 msgr2=0x5654dc7d4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:22.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.330+0000 7f38ca0bd740 1 -- 172.21.15.12:0/768792873 shutdown_connections 2024-09-19T06:44:22.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.330+0000 7f38ca0bd740 1 -- 172.21.15.12:0/768792873 wait complete. 2024-09-19T06:44:22.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.330+0000 7f38ca0bd740 20 client.26225 trim_cache size 0 max 16384 2024-09-19T06:44:22.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.353+0000 7f38ca0bd740 1 Processor -- start 2024-09-19T06:44:22.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.353+0000 7f38ca0bd740 1 -- start start 2024-09-19T06:44:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.354+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.354+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.354+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.354+0000 7f38c527f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.354+0000 7f38c527f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60264/0 (socket says 172.21.15.12:60264) 2024-09-19T06:44:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.354+0000 7f38c527f640 1 -- 172.21.15.12:0/2513265458 learned_addr learned my addr 172.21.15.12:0/2513265458 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.354+0000 7f38ca0bd740 1 -- 172.21.15.12:0/2513265458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01b4100 con 0x5654dc7e5b80 2024-09-19T06:44:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.354+0000 7f38c6281640 1 --2- 172.21.15.12:0/2513265458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.354+0000 7f38ca0bd740 1 -- 172.21.15.12:0/2513265458 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01b5c70 con 0x5654dc7d3b40 2024-09-19T06:44:22.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.354+0000 7f38ca0bd740 1 -- 172.21.15.12:0/2513265458 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01b47d0 con 0x5654dc7d25d0 2024-09-19T06:44:22.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.355+0000 7f38c6281640 1 --2- 172.21.15.12:0/2513265458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.355+0000 7f38c6281640 1 -- 172.21.15.12:0/2513265458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 msgr2=0x5654dc7e10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:22.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.355+0000 7f38c6281640 1 --2- 172.21.15.12:0/2513265458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.355+0000 7f38c6281640 1 -- 172.21.15.12:0/2513265458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 msgr2=0x5654dc7e1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.355+0000 7f38c6281640 1 --2- 172.21.15.12:0/2513265458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.355+0000 7f38c6281640 1 -- 172.21.15.12:0/2513265458 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654dc7d5120 con 0x5654dc7d25d0 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.355+0000 7f38c6281640 1 --2- 172.21.15.12:0/2513265458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7f1b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009430 tx=0x7f38b00040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63c17e83d9ad8b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.356+0000 7f38a77fe640 1 -- 172.21.15.12:0/2513265458 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0054040 con 0x5654dc7d25d0 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.356+0000 7f38a77fe640 1 -- 172.21.15.12:0/2513265458 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b0036070 con 0x5654dc7d25d0 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.356+0000 7f38a77fe640 1 -- 172.21.15.12:0/2513265458 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0003ea0 con 0x5654dc7d25d0 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.357+0000 7f38ca0bd740 1 -- 172.21.15.12:0/2513265458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 msgr2=0x5654dc7f1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.357+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/2513265458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7f1b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009430 tx=0x7f38b00040e0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.357+0000 7f38ca0bd740 1 -- 172.21.15.12:0/2513265458 shutdown_connections 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.357+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/2513265458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.357+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/2513265458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.357+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/2513265458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7f1b60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.357+0000 7f38ca0bd740 1 -- 172.21.15.12:0/2513265458 >> 172.21.15.12:0/2513265458 conn(0x5654dc79b310 msgr2=0x5654dc7ddb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:22.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.357+0000 7f38ca0bd740 1 -- 172.21.15.12:0/2513265458 shutdown_connections 2024-09-19T06:44:22.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.357+0000 7f38ca0bd740 1 -- 172.21.15.12:0/2513265458 wait complete. 2024-09-19T06:44:22.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.358+0000 7f38ca0bd740 1 -- start start 2024-09-19T06:44:22.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.358+0000 7f38ca0bd740 1 Processor -- start 2024-09-19T06:44:22.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.359+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.359+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.359+0000 7f38ca0bd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.359+0000 7f38ca0bd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01b55a0 con 0x5654dc7e5b80 2024-09-19T06:44:22.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.359+0000 7f38ca0bd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01b4ea0 con 0x5654dc7d3b40 2024-09-19T06:44:22.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.359+0000 7f38ca0bd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01b2140 con 0x5654dc7d25d0 2024-09-19T06:44:22.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.359+0000 7f38ca0bd740 10 client.0 _ll_register_callbacks cb 0x7f38b400b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:22.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.359+0000 7f38c527f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.359+0000 7f38c6281640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.359+0000 7f38c6281640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7ee3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41040/0 (socket says 172.21.15.12:41040) 2024-09-19T06:44:22.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.360+0000 7f38c6281640 1 -- 172.21.15.12:0/3527300100 learned_addr learned my addr 172.21.15.12:0/3527300100 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.360+0000 7f38c6281640 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.360+0000 7f38c527f640 1 -- 172.21.15.12:0/3527300100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 msgr2=0x5654dc7ee3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.360+0000 7f38c527f640 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7ee3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.360+0000 7f38c527f640 1 -- 172.21.15.12:0/3527300100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 msgr2=0x5654dc7e9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.360+0000 7f38c527f640 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.360+0000 7f38c527f640 1 -- 172.21.15.12:0/3527300100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654dc7ea410 con 0x5654dc7d3b40 2024-09-19T06:44:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.360+0000 7f38c6281640 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.360+0000 7f38c527f640 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e96f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c010 tx=0x7f38b4022750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80efc3fef69c32dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.361+0000 7f38a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:44:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.361+0000 7f38a57fa640 1 -- 172.21.15.12:0/3527300100 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4027040 con 0x5654dc7d3b40 2024-09-19T06:44:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.361+0000 7f38a57fa640 1 -- 172.21.15.12:0/3527300100 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f38b4003b30 con 0x5654dc7d3b40 2024-09-19T06:44:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.361+0000 7f38ca0bd740 1 -- 172.21.15.12:0/3527300100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b0036070 con 0x5654dc7d3b40 2024-09-19T06:44:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.361+0000 7f38a57fa640 1 -- 172.21.15.12:0/3527300100 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f38b4003d50 con 0x5654dc7d3b40 2024-09-19T06:44:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.362+0000 7f38ca0bd740 10 client.26231 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.362+0000 7f38ca0bd740 1 -- 172.21.15.12:0/3527300100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5654dc860520 con 0x5654dc7d3b40 2024-09-19T06:44:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.362+0000 7f38a57fa640 1 -- 172.21.15.12:0/3527300100 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b0036070 con 0x5654dc7d3b40 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.362+0000 7f38a57fa640 1 -- 172.21.15.12:0/3527300100 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f38b4021070 con 0x5654dc7d3b40 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.362+0000 7f38ca0bd740 10 client.26231 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.362+0000 7f38ca0bd740 10 client.26231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.362+0000 7f38ca0bd740 20 client.26231 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.362+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654dc860bd0 0x5654dc862ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.362+0000 7f38ca0bd740 4 client.26231 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.362+0000 7f38ca0bd740 1 -- 172.21.15.12:0/3527300100 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654dc745860 con 0x5654dc860bd0 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.363+0000 7f38c6281640 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654dc860bd0 0x5654dc862ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.363+0000 7f38a57fa640 10 client.26231 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.364+0000 7f38c6281640 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654dc860bd0 0x5654dc862ff0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd04bfe691957cda server_cookie=28ef9cf8f2977844 in_seq=0 out_seq=0 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.364+0000 7f38a57fa640 1 -- 172.21.15.12:0/3527300100 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654dc745860 con 0x5654dc860bd0 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.364+0000 7f38a57fa640 10 client.26231 handle_command_reply: tid=0 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.364+0000 7f38ca0bd740 1 client.26231 shutdown 2024-09-19T06:44:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 1 -- 172.21.15.12:0/3527300100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 msgr2=0x5654dc7e96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:22.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e96f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c010 tx=0x7f38b4022750 comp rx=0 tx=0).stop 2024-09-19T06:44:22.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 1 -- 172.21.15.12:0/3527300100 shutdown_connections 2024-09-19T06:44:22.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5654dc860bd0 0x5654dc862ff0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38a57fa640 0 client.26231 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:22.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5654dc7e5b80 0x5654dc7e9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5654dc7d3b40 0x5654dc7e96f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 1 --2- 172.21.15.12:0/3527300100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5654dc7d25d0 0x5654dc7ee3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 1 -- 172.21.15.12:0/3527300100 >> 172.21.15.12:0/3527300100 conn(0x5654dc79b310 msgr2=0x5654dc7e1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:22.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 1 -- 172.21.15.12:0/3527300100 shutdown_connections 2024-09-19T06:44:22.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 1 -- 172.21.15.12:0/3527300100 wait complete. 2024-09-19T06:44:22.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.365+0000 7f38ca0bd740 20 client.26231 trim_cache size 0 max 16384 2024-09-19T06:44:22.368 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:44:22.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 -- 172.21.15.12:0/16032063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38a80a34b0 msgr2=0x7f38a80a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38a80a34b0 0x7f38a80a5970 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5654dc7cfac0 tx=0x7f38b80d2ba0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 -- 172.21.15.12:0/16032063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c010a560 msgr2=0x7f38c01a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c010a560 0x7f38c01a4650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f38b800a870 tx=0x7f38b800ad30 comp rx=0 tx=0).stop 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 -- 172.21.15.12:0/16032063 shutdown_connections 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38c0113940 0x7f38c019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c010ae80 0x7f38c01a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38a80a34b0 0x7f38a80a5970 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 --2- 172.21.15.12:0/16032063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38c010a560 0x7f38c01a4650 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 -- 172.21.15.12:0/16032063 >> 172.21.15.12:0/16032063 conn(0x7f38c006e140 msgr2=0x7f38c00708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 -- 172.21.15.12:0/16032063 shutdown_connections 2024-09-19T06:44:22.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:22.366+0000 7f38c7ce4640 1 -- 172.21.15.12:0/16032063 wait complete. 2024-09-19T06:44:23.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:23 smithi016 ceph-mon[34911]: pgmap v130: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 2.03k op/s 2024-09-19T06:44:23.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:23 smithi173 ceph-mon[35349]: pgmap v130: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 2.03k op/s 2024-09-19T06:44:23.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:23 smithi012 ceph-mon[30937]: pgmap v130: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 2.03k op/s 2024-09-19T06:44:24.475 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:44:24.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:44:24.864 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:25.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.509+0000 7f9f8648e640 1 -- 172.21.15.12:0/2556658561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f801081f0 msgr2=0x7f9f80108610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.509+0000 7f9f8648e640 1 --2- 172.21.15.12:0/2556658561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f801081f0 0x7f9f80108610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009900 tx=0x7f9f7402a410 comp rx=0 tx=0).stop 2024-09-19T06:44:25.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.509+0000 7f9f8648e640 1 -- 172.21.15.12:0/2556658561 shutdown_connections 2024-09-19T06:44:25.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.509+0000 7f9f8648e640 1 --2- 172.21.15.12:0/2556658561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f80108b50 0x7f9f80115070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.509+0000 7f9f8648e640 1 --2- 172.21.15.12:0/2556658561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f801081f0 0x7f9f80108610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.509+0000 7f9f8648e640 1 --2- 172.21.15.12:0/2556658561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f8010e230 0x7f9f8010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.509+0000 7f9f8648e640 1 -- 172.21.15.12:0/2556658561 >> 172.21.15.12:0/2556658561 conn(0x7f9f80077bb0 msgr2=0x7f9f80079fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:25.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.510+0000 7f9f8648e640 1 -- 172.21.15.12:0/2556658561 shutdown_connections 2024-09-19T06:44:25.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.510+0000 7f9f8648e640 1 -- 172.21.15.12:0/2556658561 wait complete. 2024-09-19T06:44:25.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.511+0000 7f9f8648e640 1 Processor -- start 2024-09-19T06:44:25.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.511+0000 7f9f8648e640 1 -- start start 2024-09-19T06:44:25.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.512+0000 7f9f8648e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f801081f0 0x7f9f801a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.512+0000 7f9f8648e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f80108b50 0x7f9f801a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.512+0000 7f9f7ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f801081f0 0x7f9f801a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.512+0000 7f9f7ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f801081f0 0x7f9f801a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60290/0 (socket says 172.21.15.12:60290) 2024-09-19T06:44:25.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.512+0000 7f9f7ffff640 1 -- 172.21.15.12:0/1481124446 learned_addr learned my addr 172.21.15.12:0/1481124446 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:25.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.513+0000 7f9f8648e640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f8010e230 0x7f9f8019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.513+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f80108b50 0x7f9f801a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.513+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9f80118550 con 0x7f9f8010e230 2024-09-19T06:44:25.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.513+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9f801183d0 con 0x7f9f801081f0 2024-09-19T06:44:25.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.513+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9f801186d0 con 0x7f9f80108b50 2024-09-19T06:44:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.514+0000 7f9f7ffff640 1 -- 172.21.15.12:0/1481124446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f80108b50 msgr2=0x7f9f801a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.514+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f80108b50 0x7f9f801a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.514+0000 7f9f7ffff640 1 -- 172.21.15.12:0/1481124446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f8010e230 msgr2=0x7f9f8019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.514+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f8010e230 0x7f9f8019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.514+0000 7f9f7ffff640 1 -- 172.21.15.12:0/1481124446 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8019ef90 con 0x7f9f801081f0 2024-09-19T06:44:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.514+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f80108b50 0x7f9f801a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.514+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f801081f0 0x7f9f801a46a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000e9f0 tx=0x7f9f7000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.515+0000 7f9f7d7fa640 1 -- 172.21.15.12:0/1481124446 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000cd80 con 0x7f9f801081f0 2024-09-19T06:44:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.515+0000 7f9f7d7fa640 1 -- 172.21.15.12:0/1481124446 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f70010910 con 0x7f9f801081f0 2024-09-19T06:44:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.515+0000 7f9f7d7fa640 1 -- 172.21.15.12:0/1481124446 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70018990 con 0x7f9f801081f0 2024-09-19T06:44:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.515+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f8019f280 con 0x7f9f801081f0 2024-09-19T06:44:25.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.515+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f801ab570 con 0x7f9f801081f0 2024-09-19T06:44:25.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.518+0000 7f9f7d7fa640 1 -- 172.21.15.12:0/1481124446 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9f70018b30 con 0x7f9f801081f0 2024-09-19T06:44:25.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:25 smithi012 ceph-mon[30937]: pgmap v131: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 2.02k op/s 2024-09-19T06:44:25.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.519+0000 7f9f88867740 1 Processor -- start 2024-09-19T06:44:25.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.519+0000 7f9f88867740 1 -- start start 2024-09-19T06:44:25.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.519+0000 7f9f88867740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe6af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.519+0000 7f9f7d7fa640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f680a3500 0x7f9f680a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.519+0000 7f9f88867740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe6b480 0x55de1fe75800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.519+0000 7f9f88867740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe75d40 0x55de1fe78130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.519+0000 7f9f88867740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55de1fdd0280 con 0x55de1fe6ab60 2024-09-19T06:44:25.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.519+0000 7f9f88867740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55de1fd77b10 con 0x55de1fe6b480 2024-09-19T06:44:25.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.519+0000 7f9f88867740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de1fdcc240 con 0x55de1fe75d40 2024-09-19T06:44:25.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f84a2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe6af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f680a3500 0x7f9f680a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f84a2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe6af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35308/0 (socket says 172.21.15.12:35308) 2024-09-19T06:44:25.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f84a2b640 1 -- 172.21.15.12:0/1882834998 learned_addr learned my addr 172.21.15.12:0/1882834998 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:25.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/1882834998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe75d40 0x55de1fe78130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f7d7fa640 1 -- 172.21.15.12:0/1481124446 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9f700d00e0 con 0x7f9f801081f0 2024-09-19T06:44:25.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f84a2b640 1 -- 172.21.15.12:0/1882834998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe6b480 msgr2=0x55de1fe75800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:25.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/1882834998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe6b480 0x55de1fe75800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f84a2b640 1 -- 172.21.15.12:0/1882834998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 msgr2=0x55de1fe6af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/1882834998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe6af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f84a2b640 1 -- 172.21.15.12:0/1882834998 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de1fd841f0 con 0x55de1fe75d40 2024-09-19T06:44:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f680a3500 0x7f9f680a59c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f700185a0 tx=0x7f9f70018420 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.520+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/1882834998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe75d40 0x55de1fe78130 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9f78013ae0 tx=0x7f9f78009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d593b6ce5341eec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.521+0000 7f9f667fc640 1 -- 172.21.15.12:0/1882834998 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78013230 con 0x55de1fe75d40 2024-09-19T06:44:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.521+0000 7f9f667fc640 1 -- 172.21.15.12:0/1882834998 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f780108f0 con 0x55de1fe75d40 2024-09-19T06:44:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.521+0000 7f9f667fc640 1 -- 172.21.15.12:0/1882834998 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78005440 con 0x55de1fe75d40 2024-09-19T06:44:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.522+0000 7f9f88867740 1 -- 172.21.15.12:0/1882834998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe75d40 msgr2=0x55de1fe78130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.522+0000 7f9f88867740 1 --2- 172.21.15.12:0/1882834998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe75d40 0x55de1fe78130 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9f78013ae0 tx=0x7f9f78009500 comp rx=0 tx=0).stop 2024-09-19T06:44:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.522+0000 7f9f88867740 1 -- 172.21.15.12:0/1882834998 shutdown_connections 2024-09-19T06:44:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.522+0000 7f9f88867740 1 --2- 172.21.15.12:0/1882834998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe75d40 0x55de1fe78130 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.522+0000 7f9f88867740 1 --2- 172.21.15.12:0/1882834998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe6b480 0x55de1fe75800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.522+0000 7f9f88867740 1 --2- 172.21.15.12:0/1882834998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe6af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.522+0000 7f9f88867740 1 -- 172.21.15.12:0/1882834998 >> 172.21.15.12:0/1882834998 conn(0x55de1fe670f0 msgr2=0x55de1fe674d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.522+0000 7f9f88867740 1 -- 172.21.15.12:0/1882834998 shutdown_connections 2024-09-19T06:44:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.522+0000 7f9f88867740 1 -- 172.21.15.12:0/1882834998 wait complete. 2024-09-19T06:44:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.523+0000 7f9f88867740 1 -- start start 2024-09-19T06:44:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.523+0000 7f9f88867740 1 Processor -- start 2024-09-19T06:44:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f88867740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe72b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f88867740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe730d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f88867740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe75d40 0x55de1fe73610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f88867740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55de1fe78910 con 0x55de1fe6ab60 2024-09-19T06:44:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f88867740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55de1fd8af10 con 0x55de1fe75d40 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f88867740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de1fe78a90 con 0x55de1fe6b480 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f84a2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe72b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f88867740 10 client.0 _ll_register_callbacks cb 0x55de1fd53a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f84a2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe72b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35322/0 (socket says 172.21.15.12:35322) 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f84a2b640 1 -- 172.21.15.12:0/2227066764 learned_addr learned my addr 172.21.15.12:0/2227066764 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.524+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe75d40 0x55de1fe73610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.525+0000 7f9f84a2b640 1 -- 172.21.15.12:0/2227066764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 msgr2=0x55de1fe730d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.525+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe730d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.525+0000 7f9f84a2b640 1 -- 172.21.15.12:0/2227066764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe75d40 msgr2=0x55de1fe73610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.525+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe75d40 0x55de1fe73610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.525+0000 7f9f84a2b640 1 -- 172.21.15.12:0/2227066764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de1fb416a0 con 0x55de1fe6ab60 2024-09-19T06:44:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.525+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.525+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe72b90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9f78006010 tx=0x7f9f78005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1131f9538bd026 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.525+0000 7f9f5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.525+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/2227066764 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78010cb0 con 0x55de1fe6ab60 2024-09-19T06:44:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.525+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/2227066764 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9f78002030 con 0x55de1fe6ab60 2024-09-19T06:44:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.526+0000 7f9f88867740 1 -- 172.21.15.12:0/2227066764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f780108f0 con 0x55de1fe6ab60 2024-09-19T06:44:25.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.527+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/2227066764 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9f78003970 con 0x55de1fe6ab60 2024-09-19T06:44:25.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.527+0000 7f9f88867740 10 client.16677 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:25.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.527+0000 7f9f88867740 1 -- 172.21.15.12:0/2227066764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55de1fe84500 con 0x55de1fe6ab60 2024-09-19T06:44:25.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.528+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/2227066764 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f780108f0 con 0x55de1fe6ab60 2024-09-19T06:44:25.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.528+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/2227066764 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f9f780046b0 con 0x55de1fe6ab60 2024-09-19T06:44:25.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.529+0000 7f9f88867740 10 client.16677 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:25.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.529+0000 7f9f88867740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:25.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.529+0000 7f9f88867740 20 client.16677 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:25.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.529+0000 7f9f88867740 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de1fe85960 0x55de1fe87d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.529+0000 7f9f88867740 4 client.16677 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:25.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.529+0000 7f9f88867740 1 -- 172.21.15.12:0/2227066764 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de1fddd7f0 con 0x55de1fe85960 2024-09-19T06:44:25.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.530+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de1fe85960 0x55de1fe87d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.531+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de1fe85960 0x55de1fe87d50 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce27e1d5801aec2b server_cookie=c6387b793385f7ca in_seq=0 out_seq=0 2024-09-19T06:44:25.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.531+0000 7f9f5f7fe640 10 client.16677 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:25.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.532+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/2227066764 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de1fddd7f0 con 0x55de1fe85960 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.532+0000 7f9f5f7fe640 10 client.16677 handle_command_reply: tid=0 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.532+0000 7f9f88867740 1 client.16677 shutdown 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 1 -- 172.21.15.12:0/2227066764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 msgr2=0x55de1fe72b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe72b90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9f78006010 tx=0x7f9f78005020 comp rx=0 tx=0).stop 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 1 -- 172.21.15.12:0/2227066764 shutdown_connections 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de1fe85960 0x55de1fe87d50 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe75d40 0x55de1fe73610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 1 --2- 172.21.15.12:0/2227066764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe72b90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 1 -- 172.21.15.12:0/2227066764 >> 172.21.15.12:0/2227066764 conn(0x55de1fe670f0 msgr2=0x55de1fe6ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f5f7fe640 0 client.16677 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:25.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 1 -- 172.21.15.12:0/2227066764 shutdown_connections 2024-09-19T06:44:25.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 1 -- 172.21.15.12:0/2227066764 wait complete. 2024-09-19T06:44:25.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.533+0000 7f9f88867740 20 client.16677 trim_cache size 0 max 16384 2024-09-19T06:44:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.560+0000 7f9f88867740 1 Processor -- start 2024-09-19T06:44:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.560+0000 7f9f88867740 1 -- start start 2024-09-19T06:44:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f88867740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe6ab60 0x55de1fe71a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f88867740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe8d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f88867740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe75d40 0x55de1fe8d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f88867740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c00ea20 con 0x55de1fe75d40 2024-09-19T06:44:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f88867740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c010590 con 0x55de1fe6ab60 2024-09-19T06:44:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f88867740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c00f0f0 con 0x55de1fe6b480 2024-09-19T06:44:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f84a2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe6ab60 0x55de1fe71a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f84a2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe75d40 0x55de1fe8d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f84a2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe75d40 0x55de1fe8d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35336/0 (socket says 172.21.15.12:35336) 2024-09-19T06:44:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f84a2b640 1 -- 172.21.15.12:0/3211033648 learned_addr learned my addr 172.21.15.12:0/3211033648 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/3211033648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe8d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f84a2b640 1 -- 172.21.15.12:0/3211033648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 msgr2=0x55de1fe8d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:25.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/3211033648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe8d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f84a2b640 1 -- 172.21.15.12:0/3211033648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe75d40 msgr2=0x55de1fe8d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:25.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.561+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/3211033648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe75d40 0x55de1fe8d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.562+0000 7f9f84a2b640 1 -- 172.21.15.12:0/3211033648 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de1fe66f20 con 0x55de1fe6ab60 2024-09-19T06:44:25.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.562+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/3211033648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe6ab60 0x55de1fe71a40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9f78002230 tx=0x7f9f78005cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a11beebbdd46106 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:25.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.562+0000 7f9f65ffb640 1 -- 172.21.15.12:0/3211033648 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f780108f0 con 0x55de1fe6ab60 2024-09-19T06:44:25.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.562+0000 7f9f65ffb640 1 -- 172.21.15.12:0/3211033648 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f78004b20 con 0x55de1fe6ab60 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.562+0000 7f9f65ffb640 1 -- 172.21.15.12:0/3211033648 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7801ede0 con 0x55de1fe6ab60 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.563+0000 7f9f88867740 1 -- 172.21.15.12:0/3211033648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe6ab60 msgr2=0x55de1fe71a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.563+0000 7f9f88867740 1 --2- 172.21.15.12:0/3211033648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe6ab60 0x55de1fe71a40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9f78002230 tx=0x7f9f78005cf0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.563+0000 7f9f88867740 1 -- 172.21.15.12:0/3211033648 shutdown_connections 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.563+0000 7f9f88867740 1 --2- 172.21.15.12:0/3211033648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe75d40 0x55de1fe8d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.563+0000 7f9f88867740 1 --2- 172.21.15.12:0/3211033648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe8d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.563+0000 7f9f88867740 1 --2- 172.21.15.12:0/3211033648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe6ab60 0x55de1fe71a40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.563+0000 7f9f88867740 1 -- 172.21.15.12:0/3211033648 >> 172.21.15.12:0/3211033648 conn(0x55de1fe670f0 msgr2=0x55de1fe71330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.564+0000 7f9f88867740 1 -- 172.21.15.12:0/3211033648 shutdown_connections 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.564+0000 7f9f88867740 1 -- 172.21.15.12:0/3211033648 wait complete. 2024-09-19T06:44:25.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.564+0000 7f9f88867740 1 -- start start 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f88867740 1 Processor -- start 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f88867740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe6faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f88867740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe70030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f84a2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe6faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f88867740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe75d40 0x55de1fe70570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f88867740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c00fec0 con 0x55de1fe6ab60 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f84a2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe6faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35348/0 (socket says 172.21.15.12:35348) 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f84a2b640 1 -- 172.21.15.12:0/328799407 learned_addr learned my addr 172.21.15.12:0/328799407 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f88867740 1 -- 172.21.15.12:0/328799407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c00f7c0 con 0x55de1fe75d40 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f88867740 1 -- 172.21.15.12:0/328799407 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c00ca00 con 0x55de1fe6b480 2024-09-19T06:44:25.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.565+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe70030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.566+0000 7f9f88867740 10 client.0 _ll_register_callbacks cb 0x7f9f780134c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:25.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.566+0000 7f9f7f7fe640 1 -- 172.21.15.12:0/328799407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe75d40 msgr2=0x55de1fe70570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:25.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.566+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe75d40 0x55de1fe70570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.566+0000 7f9f7f7fe640 1 -- 172.21.15.12:0/328799407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 msgr2=0x55de1fe6faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:25.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.566+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe6faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.566+0000 7f9f7f7fe640 1 -- 172.21.15.12:0/328799407 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de1feef460 con 0x55de1fe6b480 2024-09-19T06:44:25.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.566+0000 7f9f7f7fe640 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe70030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009230 tx=0x7f9f74005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc59313dd5fe686f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:25.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.566+0000 7f9f5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:44:25.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.567+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/328799407 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f74035070 con 0x55de1fe6b480 2024-09-19T06:44:25.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.567+0000 7f9f88867740 1 -- 172.21.15.12:0/328799407 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f78004b20 con 0x55de1fe6b480 2024-09-19T06:44:25.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.567+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/328799407 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9f74005510 con 0x55de1fe6b480 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.567+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/328799407 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9f74053050 con 0x55de1fe6b480 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.567+0000 7f9f88867740 10 client.26224 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.567+0000 7f9f88867740 1 -- 172.21.15.12:0/328799407 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55de1fef0720 con 0x55de1fe6b480 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.568+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/328799407 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f78004b20 con 0x55de1fe6b480 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.568+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/328799407 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f9f74003bd0 con 0x55de1fe6b480 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.568+0000 7f9f88867740 10 client.26224 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.568+0000 7f9f88867740 10 client.26224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.568+0000 7f9f88867740 20 client.26224 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.568+0000 7f9f88867740 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de1fef0ed0 0x55de1fef32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.568+0000 7f9f88867740 4 client.26224 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.568+0000 7f9f88867740 1 -- 172.21.15.12:0/328799407 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55de1fdd7d00 con 0x55de1fef0ed0 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.569+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de1fef0ed0 0x55de1fef32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:25.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.569+0000 7f9f5f7fe640 10 client.26224 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:25.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.569+0000 7f9f84a2b640 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de1fef0ed0 0x55de1fef32f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=202ae9d742114171 server_cookie=95b222d56d53b74f in_seq=0 out_seq=0 2024-09-19T06:44:25.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f5f7fe640 1 -- 172.21.15.12:0/328799407 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55de1fdd7d00 con 0x55de1fef0ed0 2024-09-19T06:44:25.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f5f7fe640 10 client.26224 handle_command_reply: tid=0 2024-09-19T06:44:25.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f88867740 1 client.26224 shutdown 2024-09-19T06:44:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f88867740 1 -- 172.21.15.12:0/328799407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 msgr2=0x55de1fe70030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f88867740 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe70030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009230 tx=0x7f9f74005d50 comp rx=0 tx=0).stop 2024-09-19T06:44:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f88867740 1 -- 172.21.15.12:0/328799407 shutdown_connections 2024-09-19T06:44:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f88867740 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55de1fef0ed0 0x55de1fef32f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f88867740 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55de1fe75d40 0x55de1fe70570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f88867740 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de1fe6b480 0x55de1fe70030 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f5f7fe640 0 client.26224 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f88867740 1 --2- 172.21.15.12:0/328799407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55de1fe6ab60 0x55de1fe6faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f88867740 1 -- 172.21.15.12:0/328799407 >> 172.21.15.12:0/328799407 conn(0x55de1fe670f0 msgr2=0x55de1fe66270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:25.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.571+0000 7f9f88867740 1 -- 172.21.15.12:0/328799407 shutdown_connections 2024-09-19T06:44:25.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.572+0000 7f9f88867740 1 -- 172.21.15.12:0/328799407 wait complete. 2024-09-19T06:44:25.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.572+0000 7f9f88867740 20 client.26224 trim_cache size 0 max 16384 2024-09-19T06:44:25.575 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:44:25.575 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:44:25.576 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "f0ccf96d-6949-4ad0-acf6-e330e4001cfd", 2024-09-19T06:44:25.576 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:44:25.576 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:44:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.573+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f680a3500 msgr2=0x7f9f680a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.573+0000 7f9f8648e640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f680a3500 0x7f9f680a59c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f700185a0 tx=0x7f9f70018420 comp rx=0 tx=0).stop 2024-09-19T06:44:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.573+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f801081f0 msgr2=0x7f9f801a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.573+0000 7f9f8648e640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f801081f0 0x7f9f801a46a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000e9f0 tx=0x7f9f7000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.574+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 shutdown_connections 2024-09-19T06:44:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.574+0000 7f9f8648e640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f8010e230 0x7f9f8019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.574+0000 7f9f8648e640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f680a3500 0x7f9f680a59c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.574+0000 7f9f8648e640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9f80108b50 0x7f9f801a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.574+0000 7f9f8648e640 1 --2- 172.21.15.12:0/1481124446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f801081f0 0x7f9f801a46a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:25.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.574+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 >> 172.21.15.12:0/1481124446 conn(0x7f9f80077bb0 msgr2=0x7f9f80079400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:25.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.574+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 shutdown_connections 2024-09-19T06:44:25.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:25.575+0000 7f9f8648e640 1 -- 172.21.15.12:0/1481124446 wait complete. 2024-09-19T06:44:25.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:25 smithi173 ceph-mon[35349]: pgmap v131: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 2.02k op/s 2024-09-19T06:44:25.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:25 smithi016 ceph-mon[34911]: pgmap v131: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 2.02k op/s 2024-09-19T06:44:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 220.0 s, 3661.8 tps, lat 27.435 ms stddev 30.570 2024-09-19T06:44:26.440 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:44:26.513 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T06:44:26.513 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T06:44:26.514 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:44:26.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:26 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:44:26.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:26 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:44:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:26 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:44:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:26 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:26 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:26.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:26 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:26.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:26 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:44:26.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:26 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:44:26.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:26 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:44:26.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:26 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:26.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:26 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:26.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:26 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:26.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:26 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:44:26.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:26 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:44:26.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:26 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:44:26.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:26 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:26.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:26 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:26.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:26 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:26.929 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:44:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:44:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:44:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:44:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:44:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:27 smithi012 ceph-mon[30937]: pgmap v132: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 40 MiB/s wr, 2.40k op/s 2024-09-19T06:44:27.518 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.524+0000 7f2e6609f640 1 -- 172.21.15.12:0/2567106992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e60106f00 msgr2=0x7f2e6010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.524+0000 7f2e6609f640 1 --2- 172.21.15.12:0/2567106992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e60106f00 0x7f2e6010ea80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009ca0 tx=0x7f2e5802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.524+0000 7f2e6609f640 1 -- 172.21.15.12:0/2567106992 shutdown_connections 2024-09-19T06:44:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.524+0000 7f2e6609f640 1 --2- 172.21.15.12:0/2567106992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e60106f00 0x7f2e6010ea80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.524+0000 7f2e6609f640 1 --2- 172.21.15.12:0/2567106992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e60102780 0x7f2e601067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.524+0000 7f2e6609f640 1 --2- 172.21.15.12:0/2567106992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e60101dd0 0x7f2e601021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.524+0000 7f2e6609f640 1 -- 172.21.15.12:0/2567106992 >> 172.21.15.12:0/2567106992 conn(0x7f2e600fd8b0 msgr2=0x7f2e600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.524+0000 7f2e6609f640 1 -- 172.21.15.12:0/2567106992 shutdown_connections 2024-09-19T06:44:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.524+0000 7f2e6609f640 1 -- 172.21.15.12:0/2567106992 wait complete. 2024-09-19T06:44:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.525+0000 7f2e6609f640 1 Processor -- start 2024-09-19T06:44:27.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.526+0000 7f2e6609f640 1 -- start start 2024-09-19T06:44:27.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.526+0000 7f2e6609f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e60101dd0 0x7f2e60198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.526+0000 7f2e6609f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e60102780 0x7f2e601988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.527+0000 7f2e6609f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e60106f00 0x7f2e6019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.527+0000 7f2e6609f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2e60111f60 con 0x7f2e60101dd0 2024-09-19T06:44:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.527+0000 7f2e6609f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2e60111de0 con 0x7f2e60102780 2024-09-19T06:44:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.527+0000 7f2e6609f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2e601120e0 con 0x7f2e60106f00 2024-09-19T06:44:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.527+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e60106f00 0x7f2e6019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.527+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e60106f00 0x7f2e6019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41120/0 (socket says 172.21.15.12:41120) 2024-09-19T06:44:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.527+0000 7f2e5ffff640 1 -- 172.21.15.12:0/3242797658 learned_addr learned my addr 172.21.15.12:0/3242797658 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.528+0000 7f2e5f7fe640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e60101dd0 0x7f2e60198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.528+0000 7f2e5f7fe640 1 -- 172.21.15.12:0/3242797658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e60106f00 msgr2=0x7f2e6019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.528+0000 7f2e5f7fe640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e60106f00 0x7f2e6019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.528+0000 7f2e5f7fe640 1 -- 172.21.15.12:0/3242797658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e60102780 msgr2=0x7f2e601988d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:44:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.528+0000 7f2e5f7fe640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e60102780 0x7f2e601988d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.528+0000 7f2e5f7fe640 1 -- 172.21.15.12:0/3242797658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6019d340 con 0x7f2e60101dd0 2024-09-19T06:44:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.529+0000 7f2e5f7fe640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e60101dd0 0x7f2e60198390 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005fd0 tx=0x7f2e5000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.529+0000 7f2e5cff9640 1 -- 172.21.15.12:0/3242797658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50004230 con 0x7f2e60101dd0 2024-09-19T06:44:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.529+0000 7f2e5cff9640 1 -- 172.21.15.12:0/3242797658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e500043d0 con 0x7f2e60101dd0 2024-09-19T06:44:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.529+0000 7f2e5cff9640 1 -- 172.21.15.12:0/3242797658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50003e60 con 0x7f2e60101dd0 2024-09-19T06:44:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.529+0000 7f2e6609f640 1 -- 172.21.15.12:0/3242797658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6019d630 con 0x7f2e60101dd0 2024-09-19T06:44:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.529+0000 7f2e6609f640 1 -- 172.21.15.12:0/3242797658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6019da30 con 0x7f2e60101dd0 2024-09-19T06:44:27.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.533+0000 7f2e5cff9640 1 -- 172.21.15.12:0/3242797658 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2e500099b0 con 0x7f2e60101dd0 2024-09-19T06:44:27.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.534+0000 7f2e68478740 1 Processor -- start 2024-09-19T06:44:27.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.534+0000 7f2e68478740 1 -- start start 2024-09-19T06:44:27.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.534+0000 7f2e68478740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a99c4a0 0x563c5a99c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.534+0000 7f2e68478740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99cdc0 0x563c5a9a7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.534+0000 7f2e68478740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a9a7680 0x563c5a9a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.534+0000 7f2e68478740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563c5a9022e0 con 0x563c5a99cdc0 2024-09-19T06:44:27.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.534+0000 7f2e68478740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563c5a8a9ce0 con 0x563c5a9a7680 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.534+0000 7f2e68478740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563c5a8fe2a0 con 0x563c5a99c4a0 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a99c4a0 0x563c5a99c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a9a7680 0x563c5a9a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a99c4a0 0x563c5a99c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41122/0 (socket says 172.21.15.12:41122) 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a9a7680 0x563c5a9a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60342/0 (socket says 172.21.15.12:60342) 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5ffff640 1 -- 172.21.15.12:0/1991484252 learned_addr learned my addr 172.21.15.12:0/1991484252 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5ffff640 1 -- 172.21.15.12:0/1991484252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a9a7680 msgr2=0x563c5a9a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/1991484252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a9a7680 0x563c5a9a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5ffff640 1 -- 172.21.15.12:0/1991484252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99cdc0 msgr2=0x563c5a9a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/1991484252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99cdc0 0x563c5a9a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5ffff640 1 -- 172.21.15.12:0/1991484252 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c5a88e440 con 0x563c5a99c4a0 2024-09-19T06:44:27.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.535+0000 7f2e5effd640 1 --2- 172.21.15.12:0/1991484252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a9a7680 0x563c5a9a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:27.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.536+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/1991484252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a99c4a0 0x563c5a99c880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009970 tx=0x7f2e5802f500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdb523c627ae0cba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:27.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.536+0000 7f2e45ffb640 1 -- 172.21.15.12:0/1991484252 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58003970 con 0x563c5a99c4a0 2024-09-19T06:44:27.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.536+0000 7f2e45ffb640 1 -- 172.21.15.12:0/1991484252 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e58036030 con 0x563c5a99c4a0 2024-09-19T06:44:27.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.536+0000 7f2e45ffb640 1 -- 172.21.15.12:0/1991484252 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e580043b0 con 0x563c5a99c4a0 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.537+0000 7f2e5cff9640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2e480a3540 0x7f2e480a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.537+0000 7f2e68478740 1 -- 172.21.15.12:0/1991484252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a99c4a0 msgr2=0x563c5a99c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.537+0000 7f2e68478740 1 --2- 172.21.15.12:0/1991484252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a99c4a0 0x563c5a99c880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009970 tx=0x7f2e5802f500 comp rx=0 tx=0).stop 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.537+0000 7f2e5f7fe640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2e480a3540 0x7f2e480a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.537+0000 7f2e68478740 1 -- 172.21.15.12:0/1991484252 shutdown_connections 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.537+0000 7f2e68478740 1 --2- 172.21.15.12:0/1991484252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a9a7680 0x563c5a9a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.537+0000 7f2e68478740 1 --2- 172.21.15.12:0/1991484252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99cdc0 0x563c5a9a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.537+0000 7f2e68478740 1 --2- 172.21.15.12:0/1991484252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a99c4a0 0x563c5a99c880 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.537+0000 7f2e68478740 1 -- 172.21.15.12:0/1991484252 >> 172.21.15.12:0/1991484252 conn(0x563c5a998a30 msgr2=0x563c5a998e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.537+0000 7f2e68478740 1 -- 172.21.15.12:0/1991484252 shutdown_connections 2024-09-19T06:44:27.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.538+0000 7f2e68478740 1 -- 172.21.15.12:0/1991484252 wait complete. 2024-09-19T06:44:27.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.538+0000 7f2e5cff9640 1 -- 172.21.15.12:0/3242797658 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f2e500cf7e0 con 0x7f2e60101dd0 2024-09-19T06:44:27.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.538+0000 7f2e5f7fe640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2e480a3540 0x7f2e480a5a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x563c5a999890 tx=0x7f2e500b1040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:27.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.538+0000 7f2e68478740 1 -- start start 2024-09-19T06:44:27.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.539+0000 7f2e68478740 1 Processor -- start 2024-09-19T06:44:27.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.539+0000 7f2e68478740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.539+0000 7f2e68478740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9a4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.539+0000 7f2e68478740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.539+0000 7f2e68478740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563c5a9aa120 con 0x563c5a99c4a0 2024-09-19T06:44:27.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.539+0000 7f2e68478740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563c5a8bd050 con 0x563c5a99cdc0 2024-09-19T06:44:27.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.539+0000 7f2e68478740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563c5a9aa2a0 con 0x563c5a9a7680 2024-09-19T06:44:27.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.539+0000 7f2e68478740 10 client.0 _ll_register_callbacks cb 0x563c5a8fd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:27.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.539+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.539+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.540+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35382/0 (socket says 172.21.15.12:35382) 2024-09-19T06:44:27.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.540+0000 7f2e5ffff640 1 -- 172.21.15.12:0/3461698076 learned_addr learned my addr 172.21.15.12:0/3461698076 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:27.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.540+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.540+0000 7f2e5ffff640 1 -- 172.21.15.12:0/3461698076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 msgr2=0x563c5a9a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:27.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.540+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9a4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.540+0000 7f2e5ffff640 1 -- 172.21.15.12:0/3461698076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 msgr2=0x563c5a9a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:27.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.540+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.540+0000 7f2e5ffff640 1 -- 172.21.15.12:0/3461698076 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c5a6733c0 con 0x563c5a9a7680 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.540+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a47a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009620 tx=0x7f2e58031a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75426e10638802cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.540+0000 7f2e3effd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.541+0000 7f2e3effd640 1 -- 172.21.15.12:0/3461698076 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58059060 con 0x563c5a9a7680 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.541+0000 7f2e3effd640 1 -- 172.21.15.12:0/3461698076 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f2e58003da0 con 0x563c5a9a7680 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.541+0000 7f2e68478740 1 -- 172.21.15.12:0/3461698076 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e58036030 con 0x563c5a9a7680 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.541+0000 7f2e3effd640 1 -- 172.21.15.12:0/3461698076 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2e5804a040 con 0x563c5a9a7680 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.541+0000 7f2e68478740 10 client.26236 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.541+0000 7f2e68478740 1 -- 172.21.15.12:0/3461698076 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563c5a9aa120 con 0x563c5a9a7680 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.541+0000 7f2e3effd640 1 -- 172.21.15.12:0/3461698076 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e58036030 con 0x563c5a9a7680 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.542+0000 7f2e3effd640 1 -- 172.21.15.12:0/3461698076 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f2e58043070 con 0x563c5a9a7680 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.542+0000 7f2e68478740 10 client.26236 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.542+0000 7f2e68478740 10 client.26236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:27.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.542+0000 7f2e68478740 20 client.26236 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:27.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.542+0000 7f2e68478740 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c5a9b6c50 0x563c5a9b9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.542+0000 7f2e68478740 4 client.26236 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:27.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.542+0000 7f2e68478740 1 -- 172.21.15.12:0/3461698076 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c5a90f850 con 0x563c5a9b6c50 2024-09-19T06:44:27.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.542+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c5a9b6c50 0x563c5a9b9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.543+0000 7f2e3effd640 10 client.26236 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.543+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c5a9b6c50 0x563c5a9b9040 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f298ed1461aebdd server_cookie=4da4bee53f4fb36f in_seq=0 out_seq=0 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.543+0000 7f2e3effd640 1 -- 172.21.15.12:0/3461698076 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c5a90f850 con 0x563c5a9b6c50 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.543+0000 7f2e3effd640 10 client.26236 handle_command_reply: tid=0 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.543+0000 7f2e68478740 1 client.26236 shutdown 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 1 -- 172.21.15.12:0/3461698076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 msgr2=0x563c5a9a47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a47a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009620 tx=0x7f2e58031a50 comp rx=0 tx=0).stop 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 1 -- 172.21.15.12:0/3461698076 shutdown_connections 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c5a9b6c50 0x563c5a9b9040 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e3effd640 0 client.26236 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:27.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a47a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 1 --2- 172.21.15.12:0/3461698076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 1 -- 172.21.15.12:0/3461698076 >> 172.21.15.12:0/3461698076 conn(0x563c5a998a30 msgr2=0x563c5a99e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:27.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 1 -- 172.21.15.12:0/3461698076 shutdown_connections 2024-09-19T06:44:27.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 1 -- 172.21.15.12:0/3461698076 wait complete. 2024-09-19T06:44:27.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.544+0000 7f2e68478740 20 client.26236 trim_cache size 0 max 16384 2024-09-19T06:44:27.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e68478740 1 Processor -- start 2024-09-19T06:44:27.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e68478740 1 -- start start 2024-09-19T06:44:27.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e68478740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e68478740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9be830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e68478740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9bed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9b3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35392/0 (socket says 172.21.15.12:35392) 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e5ffff640 1 -- 172.21.15.12:0/3750039201 learned_addr learned my addr 172.21.15.12:0/3750039201 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e68478740 1 -- 172.21.15.12:0/3750039201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2e601b4150 con 0x563c5a99c4a0 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3750039201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e68478740 1 -- 172.21.15.12:0/3750039201 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2e601b5cc0 con 0x563c5a99cdc0 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.573+0000 7f2e68478740 1 -- 172.21.15.12:0/3750039201 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2e601b4820 con 0x563c5a9a7680 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e5effd640 1 -- 172.21.15.12:0/3750039201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 msgr2=0x563c5a9bed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/3750039201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9bed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3750039201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9bed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e5effd640 1 -- 172.21.15.12:0/3750039201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 msgr2=0x563c5a9b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3750039201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e5effd640 1 -- 172.21.15.12:0/3750039201 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c5a9a7320 con 0x563c5a99cdc0 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/3750039201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9bed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3750039201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9be830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x563c5a9b97d0 tx=0x7f2e54010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f095a4c01eb4be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e457fa640 1 -- 172.21.15.12:0/3750039201 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54004050 con 0x563c5a99cdc0 2024-09-19T06:44:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e457fa640 1 -- 172.21.15.12:0/3750039201 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e540041f0 con 0x563c5a99cdc0 2024-09-19T06:44:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.574+0000 7f2e457fa640 1 -- 172.21.15.12:0/3750039201 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5401d690 con 0x563c5a99cdc0 2024-09-19T06:44:27.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.575+0000 7f2e68478740 1 -- 172.21.15.12:0/3750039201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 msgr2=0x563c5a9be830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:27.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.575+0000 7f2e68478740 1 --2- 172.21.15.12:0/3750039201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9be830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x563c5a9b97d0 tx=0x7f2e54010800 comp rx=0 tx=0).stop 2024-09-19T06:44:27.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.575+0000 7f2e68478740 1 -- 172.21.15.12:0/3750039201 shutdown_connections 2024-09-19T06:44:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.575+0000 7f2e68478740 1 --2- 172.21.15.12:0/3750039201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9bed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.575+0000 7f2e68478740 1 --2- 172.21.15.12:0/3750039201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9be830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.575+0000 7f2e68478740 1 --2- 172.21.15.12:0/3750039201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.575+0000 7f2e68478740 1 -- 172.21.15.12:0/3750039201 >> 172.21.15.12:0/3750039201 conn(0x563c5a998a30 msgr2=0x563c5a9a62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.576+0000 7f2e68478740 1 -- 172.21.15.12:0/3750039201 shutdown_connections 2024-09-19T06:44:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.576+0000 7f2e68478740 1 -- 172.21.15.12:0/3750039201 wait complete. 2024-09-19T06:44:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.576+0000 7f2e68478740 1 -- start start 2024-09-19T06:44:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.577+0000 7f2e68478740 1 Processor -- start 2024-09-19T06:44:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.577+0000 7f2e68478740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.577+0000 7f2e68478740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9a1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.577+0000 7f2e68478740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e68478740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2e601b55f0 con 0x563c5a99c4a0 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e68478740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2e601b4ef0 con 0x563c5a99cdc0 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e68478740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2e601b2130 con 0x563c5a9a7680 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41150/0 (socket says 172.21.15.12:41150) 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5ffff640 1 -- 172.21.15.12:0/3491646957 learned_addr learned my addr 172.21.15.12:0/3491646957 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e68478740 10 client.0 _ll_register_callbacks cb 0x7f2e54009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5ffff640 1 -- 172.21.15.12:0/3491646957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 msgr2=0x563c5a9a1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9a1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5ffff640 1 -- 172.21.15.12:0/3491646957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 msgr2=0x563c5a9afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:27.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5ffff640 1 -- 172.21.15.12:0/3491646957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c5aa20800 con 0x563c5a9a7680 2024-09-19T06:44:27.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9a1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:27.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e5ffff640 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a1850 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2e58004ab0 tx=0x7f2e58005bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5666c49e10530ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:27.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.578+0000 7f2e3effd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:44:27.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.579+0000 7f2e3effd640 1 -- 172.21.15.12:0/3491646957 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58059040 con 0x563c5a9a7680 2024-09-19T06:44:27.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.579+0000 7f2e3effd640 1 -- 172.21.15.12:0/3491646957 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f2e5802fcf0 con 0x563c5a9a7680 2024-09-19T06:44:27.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.579+0000 7f2e68478740 1 -- 172.21.15.12:0/3491646957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e540041f0 con 0x563c5a9a7680 2024-09-19T06:44:27.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.579+0000 7f2e3effd640 1 -- 172.21.15.12:0/3491646957 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2e580305c0 con 0x563c5a9a7680 2024-09-19T06:44:27.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.579+0000 7f2e68478740 10 client.26239 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:27.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.579+0000 7f2e68478740 1 -- 172.21.15.12:0/3491646957 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563c5aa21920 con 0x563c5a9a7680 2024-09-19T06:44:27.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:44:27.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:44:27.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:44:27.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:44:27.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:44:27.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.585 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:27 smithi173 ceph-mon[35349]: pgmap v132: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 40 MiB/s wr, 2.40k op/s 2024-09-19T06:44:27.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.580+0000 7f2e3effd640 1 -- 172.21.15.12:0/3491646957 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e540041f0 con 0x563c5a9a7680 2024-09-19T06:44:27.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.580+0000 7f2e3effd640 1 -- 172.21.15.12:0/3491646957 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f2e58043070 con 0x563c5a9a7680 2024-09-19T06:44:27.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.580+0000 7f2e68478740 10 client.26239 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:27.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.580+0000 7f2e68478740 10 client.26239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:27.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.580+0000 7f2e68478740 20 client.26239 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:27.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.580+0000 7f2e68478740 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c5a9b6c50 0x563c5aa23fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:27.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.580+0000 7f2e68478740 4 client.26239 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:44:27.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.580+0000 7f2e68478740 1 -- 172.21.15.12:0/3491646957 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563c5a909d60 con 0x563c5a9b6c50 2024-09-19T06:44:27.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.581+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c5a9b6c50 0x563c5aa23fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.581+0000 7f2e3effd640 10 client.26239 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.581+0000 7f2e5effd640 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c5a9b6c50 0x563c5aa23fd0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b3cf7f832854bee server_cookie=c1b4c013fc8d18f7 in_seq=0 out_seq=0 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.581+0000 7f2e3effd640 1 -- 172.21.15.12:0/3491646957 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563c5a909d60 con 0x563c5a9b6c50 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.581+0000 7f2e3effd640 10 client.26239 handle_command_reply: tid=0 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.581+0000 7f2e68478740 1 client.26239 shutdown 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.581+0000 7f2e68478740 1 -- 172.21.15.12:0/3491646957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 msgr2=0x563c5a9a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.581+0000 7f2e68478740 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a1850 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2e58004ab0 tx=0x7f2e58005bf0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.581+0000 7f2e68478740 1 -- 172.21.15.12:0/3491646957 shutdown_connections 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.581+0000 7f2e68478740 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c5a9b6c50 0x563c5aa23fd0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.582+0000 7f2e68478740 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c5a9a7680 0x563c5a9a1850 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.582+0000 7f2e3effd640 0 client.26239 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.582+0000 7f2e68478740 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c5a99cdc0 0x563c5a9a1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.582+0000 7f2e68478740 1 --2- 172.21.15.12:0/3491646957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c5a99c4a0 0x563c5a9afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.582+0000 7f2e68478740 1 -- 172.21.15.12:0/3491646957 >> 172.21.15.12:0/3491646957 conn(0x563c5a998a30 msgr2=0x563c5a997350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:27.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.582+0000 7f2e68478740 1 -- 172.21.15.12:0/3491646957 shutdown_connections 2024-09-19T06:44:27.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.582+0000 7f2e68478740 1 -- 172.21.15.12:0/3491646957 wait complete. 2024-09-19T06:44:27.589 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:44:27.589 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:44:27.589 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:44:27.589 INFO:teuthology.orchestra.run.smithi012.stdout: "f0ccf96d-6949-4ad0-acf6-e330e4001cfd": { 2024-09-19T06:44:27.589 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:44:27.589 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "f0ccf96d-6949-4ad0-acf6-e330e4001cfd", 2024-09-19T06:44:27.590 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:44:27.590 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:27.590 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:27.590 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:44:27.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.582+0000 7f2e68478740 20 client.26239 trim_cache size 0 max 16384 2024-09-19T06:44:27.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 -- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2e480a3540 msgr2=0x7f2e480a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:27.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2e480a3540 0x7f2e480a5a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x563c5a999890 tx=0x7f2e500b1040 comp rx=0 tx=0).stop 2024-09-19T06:44:27.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 -- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e60101dd0 msgr2=0x7f2e60198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:27.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e60101dd0 0x7f2e60198390 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005fd0 tx=0x7f2e5000dde0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 -- 172.21.15.12:0/3242797658 shutdown_connections 2024-09-19T06:44:27.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2e480a3540 0x7f2e480a5a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e60106f00 0x7f2e6019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e60102780 0x7f2e601988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 --2- 172.21.15.12:0/3242797658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e60101dd0 0x7f2e60198390 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:27.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 -- 172.21.15.12:0/3242797658 >> 172.21.15.12:0/3242797658 conn(0x7f2e600fd8b0 msgr2=0x7f2e600febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:27.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 -- 172.21.15.12:0/3242797658 shutdown_connections 2024-09-19T06:44:27.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:27.587+0000 7f2e6609f640 1 -- 172.21.15.12:0/3242797658 wait complete. 2024-09-19T06:44:27.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:44:27.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:44:27.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:44:27.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:44:27.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:44:27.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:44:27.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:27 smithi016 ceph-mon[34911]: pgmap v132: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 40 MiB/s wr, 2.40k op/s 2024-09-19T06:44:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.407+0000 7f52b56ea640 1 -- 172.21.15.12:0/3876912825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b0102d30 msgr2=0x7f52b0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.407+0000 7f52b56ea640 1 --2- 172.21.15.12:0/3876912825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b0102d30 0x7f52b0103110 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5298009cd0 tx=0x7f529802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.407+0000 7f52b56ea640 1 -- 172.21.15.12:0/3876912825 shutdown_connections 2024-09-19T06:44:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.407+0000 7f52b56ea640 1 --2- 172.21.15.12:0/3876912825 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52b01082a0 0x7f52b010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.407+0000 7f52b56ea640 1 --2- 172.21.15.12:0/3876912825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52b01036e0 0x7f52b0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.407+0000 7f52b56ea640 1 --2- 172.21.15.12:0/3876912825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b0102d30 0x7f52b0103110 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.407+0000 7f52b56ea640 1 -- 172.21.15.12:0/3876912825 >> 172.21.15.12:0/3876912825 conn(0x7f52b00fc7d0 msgr2=0x7f52b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:28.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.408+0000 7f52b56ea640 1 -- 172.21.15.12:0/3876912825 shutdown_connections 2024-09-19T06:44:28.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.408+0000 7f52b56ea640 1 -- 172.21.15.12:0/3876912825 wait complete. 2024-09-19T06:44:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.409+0000 7f52b56ea640 1 Processor -- start 2024-09-19T06:44:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.409+0000 7f52b56ea640 1 -- start start 2024-09-19T06:44:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.409+0000 7f52b56ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b0102d30 0x7f52b01a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.409+0000 7f52b56ea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52b01036e0 0x7f52b01a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.409+0000 7f52b56ea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52b01082a0 0x7f52b019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.409+0000 7f52b56ea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f52b01120a0 con 0x7f52b0102d30 2024-09-19T06:44:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.409+0000 7f52b56ea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0111f20 con 0x7f52b01036e0 2024-09-19T06:44:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.409+0000 7f52b56ea640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0112220 con 0x7f52b01082a0 2024-09-19T06:44:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.410+0000 7f52ae7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52b01036e0 0x7f52b01a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.410+0000 7f52ae7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52b01036e0 0x7f52b01a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60388/0 (socket says 172.21.15.12:60388) 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.410+0000 7f52ae7fc640 1 -- 172.21.15.12:0/2553181118 learned_addr learned my addr 172.21.15.12:0/2553181118 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.410+0000 7f52ae7fc640 1 -- 172.21.15.12:0/2553181118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52b01082a0 msgr2=0x7f52b019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.410+0000 7f52ae7fc640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52b01082a0 0x7f52b019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.410+0000 7f52ae7fc640 1 -- 172.21.15.12:0/2553181118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b0102d30 msgr2=0x7f52b01a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.410+0000 7f52ae7fc640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b0102d30 0x7f52b01a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.410+0000 7f52ae7fc640 1 -- 172.21.15.12:0/2553181118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b019ad00 con 0x7f52b01036e0 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.411+0000 7f52ae7fc640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52b01036e0 0x7f52b01a0950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f52a000e9f0 tx=0x7f52a000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.411+0000 7f52a7fff640 1 -- 172.21.15.12:0/2553181118 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a000ccc0 con 0x7f52b01036e0 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.411+0000 7f52a7fff640 1 -- 172.21.15.12:0/2553181118 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52a0010910 con 0x7f52b01036e0 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.411+0000 7f52b56ea640 1 -- 172.21.15.12:0/2553181118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b019aff0 con 0x7f52b01036e0 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.411+0000 7f52b56ea640 1 -- 172.21.15.12:0/2553181118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b0108c10 con 0x7f52b01036e0 2024-09-19T06:44:28.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.411+0000 7f52a7fff640 1 -- 172.21.15.12:0/2553181118 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0018920 con 0x7f52b01036e0 2024-09-19T06:44:28.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.413+0000 7f52b56ea640 1 -- 172.21.15.12:0/2553181118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5290005290 con 0x7f52b01036e0 2024-09-19T06:44:28.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.414+0000 7f52a7fff640 1 -- 172.21.15.12:0/2553181118 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f52a0010430 con 0x7f52b01036e0 2024-09-19T06:44:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.415+0000 7f52a7fff640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f529c0a33b0 0x7f529c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.416+0000 7f52aeffd640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f529c0a33b0 0x7f529c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.416+0000 7f52a7fff640 1 -- 172.21.15.12:0/2553181118 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f52a00d0150 con 0x7f52b01036e0 2024-09-19T06:44:28.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.416+0000 7f52aeffd640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f529c0a33b0 0x7f529c0a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f529802ae00 tx=0x7f52980093f0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.424+0000 7f52a7fff640 1 -- 172.21.15.12:0/2553181118 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f52a009cab0 con 0x7f52b01036e0 2024-09-19T06:44:28.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.825+0000 7f52b56ea640 1 -- 172.21.15.12:0/2553181118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5290005850 con 0x7f52b01036e0 2024-09-19T06:44:28.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.826+0000 7f52a7fff640 1 -- 172.21.15.12:0/2553181118 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11972 (secure 0 0 0) 0x7f52a009c3b0 con 0x7f52b01036e0 2024-09-19T06:44:28.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:44:28.829 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"btime":"2024-09-19T06:44:20:228405+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:44:19.565004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:44:28.829 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 35 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.830+0000 7f52a5ffb640 1 -- 172.21.15.12:0/2553181118 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f529c0a33b0 msgr2=0x7f529c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.830+0000 7f52a5ffb640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f529c0a33b0 0x7f529c0a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f529802ae00 tx=0x7f52980093f0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.830+0000 7f52a5ffb640 1 -- 172.21.15.12:0/2553181118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52b01036e0 msgr2=0x7f52b01a0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.830+0000 7f52a5ffb640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52b01036e0 0x7f52b01a0950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f52a000e9f0 tx=0x7f52a000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.830+0000 7f52a5ffb640 1 -- 172.21.15.12:0/2553181118 shutdown_connections 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.830+0000 7f52a5ffb640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f529c0a33b0 0x7f529c0a5870 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f529802ae00 tx=0x7f52980093f0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.830+0000 7f52a5ffb640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52b01082a0 0x7f52b019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.830+0000 7f52a5ffb640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52b01036e0 0x7f52b01a0950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.830+0000 7f52a5ffb640 1 --2- 172.21.15.12:0/2553181118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b0102d30 0x7f52b01a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.830+0000 7f52a5ffb640 1 -- 172.21.15.12:0/2553181118 >> 172.21.15.12:0/2553181118 conn(0x7f52b00fc7d0 msgr2=0x7f52b0101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.831+0000 7f52a5ffb640 1 -- 172.21.15.12:0/2553181118 shutdown_connections 2024-09-19T06:44:28.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:28.831+0000 7f52a5ffb640 1 -- 172.21.15.12:0/2553181118 wait complete. 2024-09-19T06:44:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.892+0000 7f13dd5cf640 1 -- 172.21.15.12:0/3418796910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13d81095d0 msgr2=0x7f13d8109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.892+0000 7f13dd5cf640 1 --2- 172.21.15.12:0/3418796910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13d81095d0 0x7f13d8109a10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f13c801a940 tx=0x7f13c803b450 comp rx=0 tx=0).stop 2024-09-19T06:44:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.893+0000 7f13dd5cf640 1 -- 172.21.15.12:0/3418796910 shutdown_connections 2024-09-19T06:44:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.893+0000 7f13dd5cf640 1 --2- 172.21.15.12:0/3418796910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13d811b140 0x7f13d811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.893+0000 7f13dd5cf640 1 --2- 172.21.15.12:0/3418796910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13d81095d0 0x7f13d8109a10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.893+0000 7f13dd5cf640 1 --2- 172.21.15.12:0/3418796910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d81091f0 0x7f13d8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.893+0000 7f13dd5cf640 1 -- 172.21.15.12:0/3418796910 >> 172.21.15.12:0/3418796910 conn(0x7f13d806ce00 msgr2=0x7f13d806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.896+0000 7f13dd5cf640 1 -- 172.21.15.12:0/3418796910 shutdown_connections 2024-09-19T06:44:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.896+0000 7f13dd5cf640 1 -- 172.21.15.12:0/3418796910 wait complete. 2024-09-19T06:44:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.897+0000 7f13dd5cf640 1 Processor -- start 2024-09-19T06:44:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.897+0000 7f13dd5cf640 1 -- start start 2024-09-19T06:44:28.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.897+0000 7f13dd5cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13d81091f0 0x7f13d811a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.897+0000 7f13dd5cf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13d81095d0 0x7f13d8116860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.897+0000 7f13dd5cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d811b140 0x7f13d8116da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.897+0000 7f13dd5cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13d8113340 con 0x7f13d81091f0 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.897+0000 7f13dd5cf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13d81131c0 con 0x7f13d811b140 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.897+0000 7f13dd5cf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f13d81134c0 con 0x7f13d81095d0 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.898+0000 7f13cffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13d81095d0 0x7f13d8116860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.898+0000 7f13cffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13d81095d0 0x7f13d8116860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41194/0 (socket says 172.21.15.12:41194) 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.898+0000 7f13cffff640 1 -- 172.21.15.12:0/2981298877 learned_addr learned my addr 172.21.15.12:0/2981298877 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.899+0000 7f13cffff640 1 -- 172.21.15.12:0/2981298877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d811b140 msgr2=0x7f13d8116da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.899+0000 7f13cffff640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d811b140 0x7f13d8116da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.899+0000 7f13cffff640 1 -- 172.21.15.12:0/2981298877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13d81091f0 msgr2=0x7f13d811a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.899+0000 7f13cffff640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13d81091f0 0x7f13d811a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.899+0000 7f13cffff640 1 -- 172.21.15.12:0/2981298877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d81174d0 con 0x7f13d81095d0 2024-09-19T06:44:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.899+0000 7f13cffff640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13d81095d0 0x7f13d8116860 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f13c801a910 tx=0x7f13c8004a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.900+0000 7f13d4ff9640 1 -- 172.21.15.12:0/2981298877 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c804f070 con 0x7f13d81095d0 2024-09-19T06:44:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.900+0000 7f13d4ff9640 1 -- 172.21.15.12:0/2981298877 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13c80409f0 con 0x7f13d81095d0 2024-09-19T06:44:28.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.900+0000 7f13d4ff9640 1 -- 172.21.15.12:0/2981298877 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8046030 con 0x7f13d81095d0 2024-09-19T06:44:28.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.902+0000 7f13dd5cf640 1 -- 172.21.15.12:0/2981298877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d807a450 con 0x7f13d81095d0 2024-09-19T06:44:28.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.902+0000 7f13dd5cf640 1 -- 172.21.15.12:0/2981298877 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d807a970 con 0x7f13d81095d0 2024-09-19T06:44:28.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.907+0000 7f13e0446740 1 Processor -- start 2024-09-19T06:44:28.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.907+0000 7f13e0446740 1 -- start start 2024-09-19T06:44:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.908+0000 7f13e0446740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 0x561dffd82ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.908+0000 7f13e0446740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd83410 0x561dffd8d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.908+0000 7f13e0446740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd8dcb0 0x561dffd900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.908+0000 7f13e0446740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dffce72f0 con 0x561dffd8dcb0 2024-09-19T06:44:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.908+0000 7f13e0446740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561dffc8f270 con 0x561dffd82af0 2024-09-19T06:44:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.908+0000 7f13e0446740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561dffce32b0 con 0x561dffd83410 2024-09-19T06:44:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.908+0000 7f13d6ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd83410 0x561dffd8d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.908+0000 7f13d6ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd83410 0x561dffd8d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41206/0 (socket says 172.21.15.12:41206) 2024-09-19T06:44:28.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.908+0000 7f13d6ffd640 1 -- 172.21.15.12:0/553279542 learned_addr learned my addr 172.21.15.12:0/553279542 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:28.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.909+0000 7f13d6ffd640 1 -- 172.21.15.12:0/553279542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 msgr2=0x561dffd82ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:28.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.909+0000 7f13d6ffd640 1 --2- 172.21.15.12:0/553279542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 0x561dffd82ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.909+0000 7f13d6ffd640 1 -- 172.21.15.12:0/553279542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd8dcb0 msgr2=0x561dffd900a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:28.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.909+0000 7f13d6ffd640 1 --2- 172.21.15.12:0/553279542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd8dcb0 0x561dffd900a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.909+0000 7f13d6ffd640 1 -- 172.21.15.12:0/553279542 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dffc8e340 con 0x561dffd83410 2024-09-19T06:44:28.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.909+0000 7f13d6ffd640 1 --2- 172.21.15.12:0/553279542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd83410 0x561dffd8d770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009c40 tx=0x7f13c000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ebc49153bd4887d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.911+0000 7f13d4ff9640 1 -- 172.21.15.12:0/2981298877 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f13c8052070 con 0x7f13d81095d0 2024-09-19T06:44:28.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.912+0000 7f13cd7fa640 1 -- 172.21.15.12:0/553279542 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0005020 con 0x561dffd83410 2024-09-19T06:44:28.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.912+0000 7f13cd7fa640 1 -- 172.21.15.12:0/553279542 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13c00047a0 con 0x561dffd83410 2024-09-19T06:44:28.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.913+0000 7f13e0446740 1 -- 172.21.15.12:0/553279542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd83410 msgr2=0x561dffd8d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.913+0000 7f13e0446740 1 --2- 172.21.15.12:0/553279542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd83410 0x561dffd8d770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009c40 tx=0x7f13c000e720 comp rx=0 tx=0).stop 2024-09-19T06:44:28.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.915+0000 7f13d4ff9640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13c40a3530 0x7f13c40a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.915+0000 7f13d4ff9640 1 -- 172.21.15.12:0/2981298877 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f13c80c9aa0 con 0x7f13d81095d0 2024-09-19T06:44:28.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.917+0000 7f13e0446740 1 -- 172.21.15.12:0/553279542 shutdown_connections 2024-09-19T06:44:28.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.917+0000 7f13e0446740 1 --2- 172.21.15.12:0/553279542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd8dcb0 0x561dffd900a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.917+0000 7f13e0446740 1 --2- 172.21.15.12:0/553279542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd83410 0x561dffd8d770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.917+0000 7f13e0446740 1 --2- 172.21.15.12:0/553279542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 0x561dffd82ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.917+0000 7f13e0446740 1 -- 172.21.15.12:0/553279542 >> 172.21.15.12:0/553279542 conn(0x561dffd7f060 msgr2=0x561dffd7f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.919+0000 7f13e0446740 1 -- 172.21.15.12:0/553279542 shutdown_connections 2024-09-19T06:44:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.919+0000 7f13d77fe640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13c40a3530 0x7f13c40a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.919+0000 7f13e0446740 1 -- 172.21.15.12:0/553279542 wait complete. 2024-09-19T06:44:28.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.920+0000 7f13e0446740 1 -- start start 2024-09-19T06:44:28.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.920+0000 7f13e0446740 1 Processor -- start 2024-09-19T06:44:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.921+0000 7f13d77fe640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13c40a3530 0x7f13c40a59f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13d000aa90 tx=0x7f13d0009250 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.921+0000 7f13e0446740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd82af0 0x561dffd8ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.921+0000 7f13e0446740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd83410 0x561dffd8b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.921+0000 7f13e0446740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd8b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.921+0000 7f13e0446740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dffd90920 con 0x561dffd82af0 2024-09-19T06:44:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.921+0000 7f13e0446740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561dffc70290 con 0x561dffd83410 2024-09-19T06:44:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.921+0000 7f13e0446740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561dffd90aa0 con 0x561dffd8dcb0 2024-09-19T06:44:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.921+0000 7f13e0446740 10 client.0 _ll_register_callbacks cb 0x561dffca1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.922+0000 7f13d77fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd8b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.922+0000 7f13d77fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd8b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41214/0 (socket says 172.21.15.12:41214) 2024-09-19T06:44:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.922+0000 7f13d77fe640 1 -- 172.21.15.12:0/672388115 learned_addr learned my addr 172.21.15.12:0/672388115 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.922+0000 7f13d77fe640 1 -- 172.21.15.12:0/672388115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd83410 msgr2=0x561dffd8b070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.922+0000 7f13d77fe640 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd83410 0x561dffd8b070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.922+0000 7f13d77fe640 1 -- 172.21.15.12:0/672388115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd82af0 msgr2=0x561dffd8ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.922+0000 7f13d77fe640 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd82af0 0x561dffd8ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.922+0000 7f13d77fe640 1 -- 172.21.15.12:0/672388115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dff9fa210 con 0x561dffd8dcb0 2024-09-19T06:44:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.922+0000 7f13d77fe640 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd8b5b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f13d000da80 tx=0x7f13d0004bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42dc2df9ff2f90b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.923+0000 7f13be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:44:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.923+0000 7f13be7fc640 1 -- 172.21.15.12:0/672388115 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0018d90 con 0x561dffd8dcb0 2024-09-19T06:44:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.923+0000 7f13e0446740 1 -- 172.21.15.12:0/672388115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561dffcf4a20 con 0x561dffd8dcb0 2024-09-19T06:44:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.923+0000 7f13be7fc640 1 -- 172.21.15.12:0/672388115 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f13d0023480 con 0x561dffd8dcb0 2024-09-19T06:44:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.923+0000 7f13be7fc640 1 -- 172.21.15.12:0/672388115 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f13d0023680 con 0x561dffd8dcb0 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.923+0000 7f13e0446740 10 client.26254 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.923+0000 7f13e0446740 1 -- 172.21.15.12:0/672388115 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561dffac6620 con 0x561dffd8dcb0 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.924+0000 7f13be7fc640 1 -- 172.21.15.12:0/672388115 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561dffcf4a20 con 0x561dffd8dcb0 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.924+0000 7f13be7fc640 1 -- 172.21.15.12:0/672388115 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f13d001a680 con 0x561dffd8dcb0 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.924+0000 7f13e0446740 10 client.26254 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.924+0000 7f13e0446740 10 client.26254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.924+0000 7f13e0446740 20 client.26254 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.924+0000 7f13e0446740 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561dffd9dde0 0x561dffda01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.924+0000 7f13e0446740 4 client.26254 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.924+0000 7f13e0446740 1 -- 172.21.15.12:0/672388115 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561dffceed70 con 0x561dffd9dde0 2024-09-19T06:44:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.925+0000 7f13d6ffd640 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561dffd9dde0 0x561dffda01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.925+0000 7f13d6ffd640 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561dffd9dde0 0x561dffda01f0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21d53d2865efcb90 server_cookie=6784273f8c4a8948 in_seq=0 out_seq=0 2024-09-19T06:44:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.925+0000 7f13be7fc640 10 client.26254 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13be7fc640 1 -- 172.21.15.12:0/672388115 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561dffceed70 con 0x561dffd9dde0 2024-09-19T06:44:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13be7fc640 10 client.26254 handle_command_reply: tid=0 2024-09-19T06:44:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13e0446740 1 client.26254 shutdown 2024-09-19T06:44:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13e0446740 1 -- 172.21.15.12:0/672388115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 msgr2=0x561dffd8b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13e0446740 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd8b5b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f13d000da80 tx=0x7f13d0004bc0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13e0446740 1 -- 172.21.15.12:0/672388115 shutdown_connections 2024-09-19T06:44:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13e0446740 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561dffd9dde0 0x561dffda01f0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13e0446740 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd8b5b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13e0446740 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd83410 0x561dffd8b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13e0446740 1 --2- 172.21.15.12:0/672388115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd82af0 0x561dffd8ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.926+0000 7f13e0446740 1 -- 172.21.15.12:0/672388115 >> 172.21.15.12:0/672388115 conn(0x561dffd7f060 msgr2=0x561dffd84d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.927+0000 7f13be7fc640 0 client.26254 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.927+0000 7f13e0446740 1 -- 172.21.15.12:0/672388115 shutdown_connections 2024-09-19T06:44:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.927+0000 7f13e0446740 1 -- 172.21.15.12:0/672388115 wait complete. 2024-09-19T06:44:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.928+0000 7f13e0446740 20 client.26254 trim_cache size 0 max 16384 2024-09-19T06:44:28.958 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.956+0000 7f13e0446740 1 Processor -- start 2024-09-19T06:44:28.959 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.956+0000 7f13e0446740 1 -- start start 2024-09-19T06:44:28.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13e0446740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd82af0 0x561dffd9a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13e0446740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd83410 0x561dffd8b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13e0446740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffda5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13e0446740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13d81c73a0 con 0x561dffd82af0 2024-09-19T06:44:28.960 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13e0446740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13d8083530 con 0x561dffd83410 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13e0446740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f13d80850a0 con 0x561dffd8dcb0 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd82af0 0x561dffd9a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd82af0 0x561dffd9a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35450/0 (socket says 172.21.15.12:35450) 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13d6ffd640 1 -- 172.21.15.12:0/1114717397 learned_addr learned my addr 172.21.15.12:0/1114717397 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13d77fe640 1 --2- 172.21.15.12:0/1114717397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffda5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.957+0000 7f13cffff640 1 --2- 172.21.15.12:0/1114717397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd83410 0x561dffd8b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.958+0000 7f13cffff640 1 -- 172.21.15.12:0/1114717397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 msgr2=0x561dffda5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.958+0000 7f13cffff640 1 --2- 172.21.15.12:0/1114717397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffda5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.958+0000 7f13cffff640 1 -- 172.21.15.12:0/1114717397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd82af0 msgr2=0x561dffd9a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.958+0000 7f13cffff640 1 --2- 172.21.15.12:0/1114717397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd82af0 0x561dffd9a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.958+0000 7f13cffff640 1 -- 172.21.15.12:0/1114717397 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dffd89b00 con 0x561dffd83410 2024-09-19T06:44:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.958+0000 7f13cffff640 1 --2- 172.21.15.12:0/1114717397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd83410 0x561dffd8b400 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13c80fe930 tx=0x7f13c801a690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e2d8455041e70c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.959+0000 7f13ccff9640 1 -- 172.21.15.12:0/1114717397 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80e6070 con 0x561dffd83410 2024-09-19T06:44:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.959+0000 7f13ccff9640 1 -- 172.21.15.12:0/1114717397 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13c8042400 con 0x561dffd83410 2024-09-19T06:44:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.959+0000 7f13ccff9640 1 -- 172.21.15.12:0/1114717397 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80d6130 con 0x561dffd83410 2024-09-19T06:44:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.960+0000 7f13e0446740 1 -- 172.21.15.12:0/1114717397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd83410 msgr2=0x561dffd8b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.960+0000 7f13e0446740 1 --2- 172.21.15.12:0/1114717397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd83410 0x561dffd8b400 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13c80fe930 tx=0x7f13c801a690 comp rx=0 tx=0).stop 2024-09-19T06:44:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.960+0000 7f13e0446740 1 -- 172.21.15.12:0/1114717397 shutdown_connections 2024-09-19T06:44:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.960+0000 7f13e0446740 1 --2- 172.21.15.12:0/1114717397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffda5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.960+0000 7f13e0446740 1 --2- 172.21.15.12:0/1114717397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd83410 0x561dffd8b400 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.960+0000 7f13e0446740 1 --2- 172.21.15.12:0/1114717397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd82af0 0x561dffd9a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.960+0000 7f13e0446740 1 -- 172.21.15.12:0/1114717397 >> 172.21.15.12:0/1114717397 conn(0x561dffd7f060 msgr2=0x561dffd8cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.960+0000 7f13e0446740 1 -- 172.21.15.12:0/1114717397 shutdown_connections 2024-09-19T06:44:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.960+0000 7f13e0446740 1 -- 172.21.15.12:0/1114717397 wait complete. 2024-09-19T06:44:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.960+0000 7f13e0446740 1 -- start start 2024-09-19T06:44:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.961+0000 7f13e0446740 1 Processor -- start 2024-09-19T06:44:28.964 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.961+0000 7f13e0446740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 0x561dffd87a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.961+0000 7f13e0446740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd83410 0x561dffd87fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.961+0000 7f13e0446740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd88510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.961+0000 7f13d6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 0x561dffd87a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.961+0000 7f13d77fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd88510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.961+0000 7f13cffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd83410 0x561dffd87fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.961+0000 7f13d6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 0x561dffd87a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60448/0 (socket says 172.21.15.12:60448) 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.962+0000 7f13d77fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd88510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41232/0 (socket says 172.21.15.12:41232) 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.962+0000 7f13cffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd83410 0x561dffd87fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35458/0 (socket says 172.21.15.12:35458) 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.962+0000 7f13e0446740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13d80842d0 con 0x561dffd83410 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.962+0000 7f13e0446740 1 -- 172.21.15.12:0/2873589219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13d8083c00 con 0x561dffd82af0 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.962+0000 7f13d6ffd640 1 -- 172.21.15.12:0/2873589219 learned_addr learned my addr 172.21.15.12:0/2873589219 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:28.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.962+0000 7f13e0446740 1 -- 172.21.15.12:0/2873589219 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f13d80849d0 con 0x561dffd8dcb0 2024-09-19T06:44:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.963+0000 7f13d77fe640 1 -- 172.21.15.12:0/2873589219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 msgr2=0x561dffd87a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.963+0000 7f13d77fe640 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 0x561dffd87a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.963+0000 7f13d77fe640 1 -- 172.21.15.12:0/2873589219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd83410 msgr2=0x561dffd87fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.963+0000 7f13d77fe640 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd83410 0x561dffd87fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.963+0000 7f13d77fe640 1 -- 172.21.15.12:0/2873589219 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dffd83240 con 0x561dffd8dcb0 2024-09-19T06:44:28.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.963+0000 7f13d6ffd640 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 0x561dffd87a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.963+0000 7f13d77fe640 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd88510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13d001aa50 tx=0x7f13d001aef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=389db2810ff16d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.963+0000 7f13be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.963+0000 7f13e0446740 10 client.0 _ll_register_callbacks cb 0x7f13d000d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.963+0000 7f13be7fc640 1 -- 172.21.15.12:0/2873589219 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d001a620 con 0x561dffd8dcb0 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.964+0000 7f13e0446740 1 -- 172.21.15.12:0/2873589219 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561dffc6b900 con 0x561dffd8dcb0 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.964+0000 7f13be7fc640 1 -- 172.21.15.12:0/2873589219 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f13d001a7c0 con 0x561dffd8dcb0 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.964+0000 7f13be7fc640 1 -- 172.21.15.12:0/2873589219 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f13d0044050 con 0x561dffd8dcb0 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.964+0000 7f13e0446740 10 client.26260 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.964+0000 7f13e0446740 1 -- 172.21.15.12:0/2873589219 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=35}) -- 0x561dffe087d0 con 0x561dffd8dcb0 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.965+0000 7f13be7fc640 1 -- 172.21.15.12:0/2873589219 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f13d0023820 con 0x561dffd8dcb0 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.965+0000 7f13e0446740 10 client.26260 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.965+0000 7f13e0446740 10 client.26260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:28.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.965+0000 7f13e0446740 20 client.26260 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.965+0000 7f13e0446740 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561dffe08f40 0x561dffe0b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.965+0000 7f13e0446740 4 client.26260 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:44:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.965+0000 7f13e0446740 1 -- 172.21.15.12:0/2873589219 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561dffcb8820 con 0x561dffe08f40 2024-09-19T06:44:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.965+0000 7f13d6ffd640 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561dffe08f40 0x561dffe0b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.966+0000 7f13be7fc640 10 client.26260 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:28.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.966+0000 7f13d6ffd640 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561dffe08f40 0x561dffe0b400 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4b7de2833d765b6 server_cookie=a7cb471806268e3e in_seq=0 out_seq=0 2024-09-19T06:44:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13be7fc640 1 -- 172.21.15.12:0/2873589219 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561dffcb8820 con 0x561dffe08f40 2024-09-19T06:44:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13be7fc640 10 client.26260 handle_command_reply: tid=0 2024-09-19T06:44:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13e0446740 1 client.26260 shutdown 2024-09-19T06:44:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13e0446740 1 -- 172.21.15.12:0/2873589219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 msgr2=0x561dffd88510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13e0446740 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd88510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13d001aa50 tx=0x7f13d001aef0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13e0446740 1 -- 172.21.15.12:0/2873589219 shutdown_connections 2024-09-19T06:44:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13e0446740 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561dffe08f40 0x561dffe0b400 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13be7fc640 0 client.26260 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:28.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13e0446740 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561dffd8dcb0 0x561dffd88510 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13e0446740 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dffd83410 0x561dffd87fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13e0446740 1 --2- 172.21.15.12:0/2873589219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561dffd82af0 0x561dffd87a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13e0446740 1 -- 172.21.15.12:0/2873589219 >> 172.21.15.12:0/2873589219 conn(0x561dffd7f060 msgr2=0x561dffd84550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:28.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.977+0000 7f13e0446740 1 -- 172.21.15.12:0/2873589219 shutdown_connections 2024-09-19T06:44:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.979+0000 7f13e0446740 1 -- 172.21.15.12:0/2873589219 wait complete. 2024-09-19T06:44:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.979+0000 7f13e0446740 20 client.26260 trim_cache size 0 max 16384 2024-09-19T06:44:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:44:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:44:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:44:28.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:44:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 -- 172.21.15.12:0/2981298877 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13c40a3530 msgr2=0x7f13c40a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13c40a3530 0x7f13c40a59f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13d000aa90 tx=0x7f13d0009250 comp rx=0 tx=0).stop 2024-09-19T06:44:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 -- 172.21.15.12:0/2981298877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13d81095d0 msgr2=0x7f13d8116860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13d81095d0 0x7f13d8116860 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f13c801a910 tx=0x7f13c8004a70 comp rx=0 tx=0).stop 2024-09-19T06:44:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 -- 172.21.15.12:0/2981298877 shutdown_connections 2024-09-19T06:44:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13d811b140 0x7f13d8116da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f13c40a3530 0x7f13c40a59f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f13d81095d0 0x7f13d8116860 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 --2- 172.21.15.12:0/2981298877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13d81091f0 0x7f13d811a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 -- 172.21.15.12:0/2981298877 >> 172.21.15.12:0/2981298877 conn(0x7f13d806ce00 msgr2=0x7f13d80707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 -- 172.21.15.12:0/2981298877 shutdown_connections 2024-09-19T06:44:28.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:28.981+0000 7f13dd5cf640 1 -- 172.21.15.12:0/2981298877 wait complete. 2024-09-19T06:44:29.030 INFO:tasks.cephfs.filesystem:scrub status for tag:f0ccf96d-6949-4ad0-acf6-e330e4001cfd - {'path': '/', 'tag': 'f0ccf96d-6949-4ad0-acf6-e330e4001cfd', 'options': 'recursive,force'} 2024-09-19T06:44:29.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:29 smithi012 ceph-mon[30937]: pgmap v133: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 918 op/s 2024-09-19T06:44:29.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:29 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2553181118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:29.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:29 smithi173 ceph-mon[35349]: pgmap v133: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 918 op/s 2024-09-19T06:44:29.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:29 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2553181118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:29.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:29 smithi016 ceph-mon[34911]: pgmap v133: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 918 op/s 2024-09-19T06:44:29.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:29 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2553181118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:30.312 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T06:44:30.313 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T06:44:30.699 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:30.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 225.0 s, 3670.6 tps, lat 27.222 ms stddev 31.597 2024-09-19T06:44:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.317+0000 7f5af3fd4640 1 -- 172.21.15.12:0/1815824185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aec102570 msgr2=0x7f5aec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.317+0000 7f5af3fd4640 1 --2- 172.21.15.12:0/1815824185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aec102570 0x7f5aec1029b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009860 tx=0x7f5adc02a3d0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.317+0000 7f5af3fd4640 1 -- 172.21.15.12:0/1815824185 shutdown_connections 2024-09-19T06:44:31.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.317+0000 7f5af3fd4640 1 --2- 172.21.15.12:0/1815824185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5aec102ef0 0x7f5aec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.317+0000 7f5af3fd4640 1 --2- 172.21.15.12:0/1815824185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aec102570 0x7f5aec1029b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.317+0000 7f5af3fd4640 1 --2- 172.21.15.12:0/1815824185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5aec100e20 0x7f5aec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.317+0000 7f5af3fd4640 1 -- 172.21.15.12:0/1815824185 >> 172.21.15.12:0/1815824185 conn(0x7f5aec0fc7d0 msgr2=0x7f5aec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:31.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.318+0000 7f5af3fd4640 1 -- 172.21.15.12:0/1815824185 shutdown_connections 2024-09-19T06:44:31.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.318+0000 7f5af3fd4640 1 -- 172.21.15.12:0/1815824185 wait complete. 2024-09-19T06:44:31.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.319+0000 7f5af3fd4640 1 Processor -- start 2024-09-19T06:44:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.320+0000 7f5af3fd4640 1 -- start start 2024-09-19T06:44:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.320+0000 7f5af3fd4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aec100e20 0x7f5aec10d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.320+0000 7f5af3fd4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5aec102570 0x7f5aec10b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.320+0000 7f5af3fd4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5aec102ef0 0x7f5aec10be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.320+0000 7f5af3fd4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec10ef10 con 0x7f5aec100e20 2024-09-19T06:44:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.320+0000 7f5af3fd4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec10ed90 con 0x7f5aec102570 2024-09-19T06:44:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.320+0000 7f5af3fd4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec10f090 con 0x7f5aec102ef0 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af1d70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aec100e20 0x7f5aec10d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af156f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5aec102570 0x7f5aec10b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af1d70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aec100e20 0x7f5aec10d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34442/0 (socket says 172.21.15.12:34442) 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af156f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5aec102570 0x7f5aec10b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:33022/0 (socket says 172.21.15.12:33022) 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af1d70640 1 -- 172.21.15.12:0/3818191813 learned_addr learned my addr 172.21.15.12:0/3818191813 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af2571640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5aec102ef0 0x7f5aec10be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af1d70640 1 -- 172.21.15.12:0/3818191813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5aec102ef0 msgr2=0x7f5aec10be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af1d70640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5aec102ef0 0x7f5aec10be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af1d70640 1 -- 172.21.15.12:0/3818191813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5aec102570 msgr2=0x7f5aec10b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af1d70640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5aec102570 0x7f5aec10b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af1d70640 1 -- 172.21.15.12:0/3818191813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec10c710 con 0x7f5aec100e20 2024-09-19T06:44:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.321+0000 7f5af1d70640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aec100e20 0x7f5aec10d820 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800c920 tx=0x7f5ae800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.322+0000 7f5ae2ffd640 1 -- 172.21.15.12:0/3818191813 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8007c70 con 0x7f5aec100e20 2024-09-19T06:44:31.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.322+0000 7f5ae2ffd640 1 -- 172.21.15.12:0/3818191813 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae8007e10 con 0x7f5aec100e20 2024-09-19T06:44:31.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.323+0000 7f5ae2ffd640 1 -- 172.21.15.12:0/3818191813 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8018870 con 0x7f5aec100e20 2024-09-19T06:44:31.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.323+0000 7f5af3fd4640 1 -- 172.21.15.12:0/3818191813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec1aaff0 con 0x7f5aec100e20 2024-09-19T06:44:31.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.323+0000 7f5af3fd4640 1 -- 172.21.15.12:0/3818191813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aec1ab440 con 0x7f5aec100e20 2024-09-19T06:44:31.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.327+0000 7f5af63ad740 1 Processor -- start 2024-09-19T06:44:31.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.328+0000 7f5af63ad740 1 -- start start 2024-09-19T06:44:31.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.328+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f29760 0x563100f29b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.328+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f2a080 0x563100f34400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af2571640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f29760 0x563100f29b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af2571640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f29760 0x563100f29b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:42636/0 (socket says 172.21.15.12:42636) 2024-09-19T06:44:31.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f36d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af63ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563100e8f2a0 con 0x563100f34940 2024-09-19T06:44:31.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af63ad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563100e36b10 con 0x563100f2a080 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af63ad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563100e8b260 con 0x563100f29760 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af2571640 1 -- 172.21.15.12:0/1737301994 learned_addr learned my addr 172.21.15.12:0/1737301994 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5ae2ffd640 1 -- 172.21.15.12:0/3818191813 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5ae8018a90 con 0x7f5aec100e20 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af2571640 1 -- 172.21.15.12:0/1737301994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f2a080 msgr2=0x563100f34400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af2571640 1 --2- 172.21.15.12:0/1737301994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f2a080 0x563100f34400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af2571640 1 -- 172.21.15.12:0/1737301994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 msgr2=0x563100f36d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af2571640 1 --2- 172.21.15.12:0/1737301994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f36d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.329+0000 7f5af2571640 1 -- 172.21.15.12:0/1737301994 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563100c00b90 con 0x563100f29760 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.330+0000 7f5af2571640 1 --2- 172.21.15.12:0/1737301994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f29760 0x563100f29b40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009f50 tx=0x7f5ae40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a6886e37f40452 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.330+0000 7f5ad7fff640 1 -- 172.21.15.12:0/1737301994 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4004d20 con 0x563100f29760 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.330+0000 7f5ad7fff640 1 -- 172.21.15.12:0/1737301994 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae4004050 con 0x563100f29760 2024-09-19T06:44:31.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.330+0000 7f5ad7fff640 1 -- 172.21.15.12:0/1737301994 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4005280 con 0x563100f29760 2024-09-19T06:44:31.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.331+0000 7f5af63ad740 1 -- 172.21.15.12:0/1737301994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f29760 msgr2=0x563100f29b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.331+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1737301994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f29760 0x563100f29b40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009f50 tx=0x7f5ae40118d0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.331+0000 7f5af63ad740 1 -- 172.21.15.12:0/1737301994 shutdown_connections 2024-09-19T06:44:31.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.331+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1737301994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f36d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.331+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1737301994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f2a080 0x563100f34400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.331+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1737301994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f29760 0x563100f29b40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.331+0000 7f5af63ad740 1 -- 172.21.15.12:0/1737301994 >> 172.21.15.12:0/1737301994 conn(0x563100f25cf0 msgr2=0x563100f260d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:31.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.332+0000 7f5af63ad740 1 -- 172.21.15.12:0/1737301994 shutdown_connections 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.332+0000 7f5af63ad740 1 -- 172.21.15.12:0/1737301994 wait complete. 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.332+0000 7f5ae2ffd640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a3430 0x7f5ad80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.332+0000 7f5ae2ffd640 1 -- 172.21.15.12:0/3818191813 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5ae80cfce0 con 0x7f5aec100e20 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.332+0000 7f5af63ad740 1 -- start start 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.332+0000 7f5af63ad740 1 Processor -- start 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.333+0000 7f5af156f640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a3430 0x7f5ad80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.333+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 0x563100f31810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.333+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f31d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.333+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f32290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.333+0000 7f5af63ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563100f37560 con 0x563100f34940 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.333+0000 7f5af63ad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563100e176e0 con 0x563100f29760 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.333+0000 7f5af63ad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563100f376e0 con 0x563100f2a080 2024-09-19T06:44:31.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.333+0000 7f5af63ad740 10 client.0 _ll_register_callbacks cb 0x563100e3ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:31.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.334+0000 7f5af156f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f31d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.334+0000 7f5af2571640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f32290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.334+0000 7f5af156f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f31d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:42642/0 (socket says 172.21.15.12:42642) 2024-09-19T06:44:31.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.334+0000 7f5af156f640 1 -- 172.21.15.12:0/1368390392 learned_addr learned my addr 172.21.15.12:0/1368390392 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:31.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.334+0000 7f5af2571640 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f32290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34452/0 (socket says 172.21.15.12:34452) 2024-09-19T06:44:31.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.334+0000 7f5af1d70640 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 0x563100f31810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.334+0000 7f5af2571640 1 -- 172.21.15.12:0/1368390392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 msgr2=0x563100f31d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:31.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.334+0000 7f5af2571640 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f31d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.334+0000 7f5af2571640 1 -- 172.21.15.12:0/1368390392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 msgr2=0x563100f31810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:31.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.334+0000 7f5af2571640 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 0x563100f31810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.335+0000 7f5af2571640 1 -- 172.21.15.12:0/1368390392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563100f40a20 con 0x563100f34940 2024-09-19T06:44:31.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.335+0000 7f5af2571640 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f32290 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5ae401b040 tx=0x7f5ae4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc493bce86fde93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.335+0000 7f5af1d70640 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 0x563100f31810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:31.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.335+0000 7f5ad57fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.335+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1368390392 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4029070 con 0x563100f34940 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.336+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1368390392 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5ae400f480 con 0x563100f34940 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.336+0000 7f5af63ad740 1 -- 172.21.15.12:0/1368390392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae4004050 con 0x563100f34940 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.336+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1368390392 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5ae4035050 con 0x563100f34940 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.336+0000 7f5af156f640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a3430 0x7f5ad80a58f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5adc02a8f0 tx=0x7f5adc030e10 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.336+0000 7f5af63ad740 10 client.16716 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.336+0000 7f5af63ad740 1 -- 172.21.15.12:0/1368390392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563100f43390 con 0x563100f34940 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.336+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1368390392 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae4004050 con 0x563100f34940 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.337+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1368390392 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f5ae4023640 con 0x563100f34940 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.337+0000 7f5af63ad740 10 client.16716 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.337+0000 7f5af63ad740 10 client.16716 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.337+0000 7f5af63ad740 20 client.16716 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:31.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.337+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563100f44ba0 0x563100f46fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.337+0000 7f5af63ad740 4 client.16716 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:31.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.337+0000 7f5af63ad740 1 -- 172.21.15.12:0/1368390392 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563100e9c9d0 con 0x563100f44ba0 2024-09-19T06:44:31.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.338+0000 7f5af1d70640 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563100f44ba0 0x563100f46fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.339+0000 7f5ad57fa640 10 client.16716 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:31.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.339+0000 7f5af1d70640 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563100f44ba0 0x563100f46fc0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e03dc0386b3b38a server_cookie=22e3534669538b51 in_seq=0 out_seq=0 2024-09-19T06:44:31.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.340+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1368390392 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563100e9c9d0 con 0x563100f44ba0 2024-09-19T06:44:31.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.340+0000 7f5ad57fa640 10 client.16716 handle_command_reply: tid=0 2024-09-19T06:44:31.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.340+0000 7f5af63ad740 1 client.16716 shutdown 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.341+0000 7f5af63ad740 1 -- 172.21.15.12:0/1368390392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 msgr2=0x563100f32290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.341+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f32290 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5ae401b040 tx=0x7f5ae4004430 comp rx=0 tx=0).stop 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.341+0000 7f5af63ad740 1 -- 172.21.15.12:0/1368390392 shutdown_connections 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.341+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563100f44ba0 0x563100f46fc0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.341+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f32290 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.341+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f31d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.341+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1368390392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 0x563100f31810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.341+0000 7f5ad57fa640 0 client.16716 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.341+0000 7f5af63ad740 1 -- 172.21.15.12:0/1368390392 >> 172.21.15.12:0/1368390392 conn(0x563100f25cf0 msgr2=0x563100f2b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.342+0000 7f5af63ad740 1 -- 172.21.15.12:0/1368390392 shutdown_connections 2024-09-19T06:44:31.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.342+0000 7f5af63ad740 1 -- 172.21.15.12:0/1368390392 wait complete. 2024-09-19T06:44:31.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.342+0000 7f5af63ad740 20 client.16716 trim_cache size 0 max 16384 2024-09-19T06:44:31.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.377+0000 7f5af63ad740 1 Processor -- start 2024-09-19T06:44:31.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.377+0000 7f5af63ad740 1 -- start start 2024-09-19T06:44:31.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.377+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f29760 0x563100f336e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.377+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f300e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.377+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f34940 0x563100f4c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.377+0000 7f5af63ad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1b41b0 con 0x563100f29760 2024-09-19T06:44:31.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.377+0000 7f5af63ad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1b5d20 con 0x563100f34940 2024-09-19T06:44:31.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.377+0000 7f5af63ad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1b4880 con 0x563100f2a080 2024-09-19T06:44:31.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af2571640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f34940 0x563100f4c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af2571640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f34940 0x563100f4c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:33048/0 (socket says 172.21.15.12:33048) 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af2571640 1 -- 172.21.15.12:0/1030136307 learned_addr learned my addr 172.21.15.12:0/1030136307 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af1d70640 1 --2- 172.21.15.12:0/1030136307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f29760 0x563100f336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af156f640 1 --2- 172.21.15.12:0/1030136307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f300e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af2571640 1 -- 172.21.15.12:0/1030136307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 msgr2=0x563100f300e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af2571640 1 --2- 172.21.15.12:0/1030136307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f300e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af2571640 1 -- 172.21.15.12:0/1030136307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f29760 msgr2=0x563100f336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af2571640 1 --2- 172.21.15.12:0/1030136307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f29760 0x563100f336e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af2571640 1 -- 172.21.15.12:0/1030136307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563100f26da0 con 0x563100f34940 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af156f640 1 --2- 172.21.15.12:0/1030136307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f300e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5af2571640 1 --2- 172.21.15.12:0/1030136307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f34940 0x563100f4c890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4011910 tx=0x7f5ae4005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe49766998d84f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.378+0000 7f5ad77fe640 1 -- 172.21.15.12:0/1030136307 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4032030 con 0x563100f34940 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.379+0000 7f5ad77fe640 1 -- 172.21.15.12:0/1030136307 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae40047a0 con 0x563100f34940 2024-09-19T06:44:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.379+0000 7f5ad77fe640 1 -- 172.21.15.12:0/1030136307 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4029030 con 0x563100f34940 2024-09-19T06:44:31.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.380+0000 7f5af63ad740 1 -- 172.21.15.12:0/1030136307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f34940 msgr2=0x563100f4c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.380+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1030136307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f34940 0x563100f4c890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4011910 tx=0x7f5ae4005fd0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.380+0000 7f5af63ad740 1 -- 172.21.15.12:0/1030136307 shutdown_connections 2024-09-19T06:44:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.380+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1030136307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f34940 0x563100f4c890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.380+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1030136307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f300e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.380+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1030136307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f29760 0x563100f336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.380+0000 7f5af63ad740 1 -- 172.21.15.12:0/1030136307 >> 172.21.15.12:0/1030136307 conn(0x563100f25cf0 msgr2=0x563100f2b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.381+0000 7f5af63ad740 1 -- 172.21.15.12:0/1030136307 shutdown_connections 2024-09-19T06:44:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.381+0000 7f5af63ad740 1 -- 172.21.15.12:0/1030136307 wait complete. 2024-09-19T06:44:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.381+0000 7f5af63ad740 1 -- start start 2024-09-19T06:44:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.381+0000 7f5af63ad740 1 Processor -- start 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.382+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 0x563100f38990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.383+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f38ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.383+0000 7f5af63ad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f39450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.383+0000 7f5af1d70640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 0x563100f38990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.383+0000 7f5af1d70640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 0x563100f38990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:33056/0 (socket says 172.21.15.12:33056) 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.383+0000 7f5af156f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f38ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.383+0000 7f5af2571640 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f39450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.383+0000 7f5af1d70640 1 -- 172.21.15.12:0/1335530239 learned_addr learned my addr 172.21.15.12:0/1335530239 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.383+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1b5650 con 0x563100f34940 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.383+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1b4f50 con 0x563100f29760 2024-09-19T06:44:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.383+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1b2190 con 0x563100f2a080 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.384+0000 7f5af63ad740 10 client.0 _ll_register_callbacks cb 0x7f5ae4009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.384+0000 7f5af156f640 1 -- 172.21.15.12:0/1335530239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 msgr2=0x563100f38990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.384+0000 7f5af156f640 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 0x563100f38990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.384+0000 7f5af156f640 1 -- 172.21.15.12:0/1335530239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 msgr2=0x563100f39450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.384+0000 7f5af156f640 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f39450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.384+0000 7f5af156f640 1 -- 172.21.15.12:0/1335530239 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563100faeb50 con 0x563100f2a080 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.385+0000 7f5af156f640 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f38ed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x563100f32c40 tx=0x7f5adc046000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2be657e18f8e7c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.385+0000 7f5ad57fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.385+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1335530239 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc004230 con 0x563100f2a080 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.385+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1335530239 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5adc0043d0 con 0x563100f2a080 2024-09-19T06:44:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.385+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae40047a0 con 0x563100f2a080 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.385+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1335530239 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5adc05b050 con 0x563100f2a080 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.385+0000 7f5af63ad740 10 client.26272 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.385+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563100fafd60 con 0x563100f2a080 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.386+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1335530239 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae40047a0 con 0x563100f2a080 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.386+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1335530239 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f5adc003830 con 0x563100f2a080 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.386+0000 7f5af63ad740 10 client.26272 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.386+0000 7f5af63ad740 10 client.26272 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.386+0000 7f5af63ad740 20 client.26272 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.386+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563100fb05a0 0x563100fb29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.386+0000 7f5af63ad740 4 client.26272 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.386+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x563100e96d20 con 0x563100fb05a0 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.386+0000 7f5af1d70640 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563100fb05a0 0x563100fb29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.386+0000 7f5ad57fa640 10 client.26272 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.387+0000 7f5af1d70640 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563100fb05a0 0x563100fb29c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0adfd325adf6ea4 server_cookie=d0c2d9bb8dc14953 in_seq=0 out_seq=0 2024-09-19T06:44:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5ad57fa640 1 -- 172.21.15.12:0/1335530239 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563100e96d20 con 0x563100fb05a0 2024-09-19T06:44:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5ad57fa640 10 client.26272 handle_command_reply: tid=0 2024-09-19T06:44:31.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 client.26272 shutdown 2024-09-19T06:44:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:31 smithi012 ceph-mon[30937]: pgmap v134: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 17 MiB/s wr, 1.32k op/s 2024-09-19T06:44:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 msgr2=0x563100f38ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f38ed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x563100f32c40 tx=0x7f5adc046000 comp rx=0 tx=0).stop 2024-09-19T06:44:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 shutdown_connections 2024-09-19T06:44:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563100fb05a0 0x563100fb29c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563100f34940 0x563100f39450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563100f2a080 0x563100f38ed0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5ad57fa640 0 client.26272 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 --2- 172.21.15.12:0/1335530239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563100f29760 0x563100f38990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 >> 172.21.15.12:0/1335530239 conn(0x563100f25cf0 msgr2=0x563100f2b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 shutdown_connections 2024-09-19T06:44:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 1 -- 172.21.15.12:0/1335530239 wait complete. 2024-09-19T06:44:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.563+0000 7f5af63ad740 20 client.26272 trim_cache size 0 max 16384 2024-09-19T06:44:31.568 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:44:31.568 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 35, 2024-09-19T06:44:31.568 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:44:31.568 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 18, 2024-09-19T06:44:31.568 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:44:31.568 INFO:teuthology.orchestra.run.smithi012.stdout: "68f2f376": { 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 18, 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 149.8, 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:44:31.569 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:44:31.570 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:44:31.570 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:44:31.570 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:44:31.570 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:31.570 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:31.570 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:31.570 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:31.570 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:31.570 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:44:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 -- 172.21.15.12:0/3818191813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a3430 msgr2=0x7f5ad80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a3430 0x7f5ad80a58f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5adc02a8f0 tx=0x7f5adc030e10 comp rx=0 tx=0).stop 2024-09-19T06:44:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 -- 172.21.15.12:0/3818191813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aec100e20 msgr2=0x7f5aec10d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aec100e20 0x7f5aec10d820 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800c920 tx=0x7f5ae800cde0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 -- 172.21.15.12:0/3818191813 shutdown_connections 2024-09-19T06:44:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a3430 0x7f5ad80a58f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5aec102ef0 0x7f5aec10be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5aec102570 0x7f5aec10b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 --2- 172.21.15.12:0/3818191813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aec100e20 0x7f5aec10d820 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:31.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 -- 172.21.15.12:0/3818191813 >> 172.21.15.12:0/3818191813 conn(0x7f5aec0fc7d0 msgr2=0x7f5aec1067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:31.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 -- 172.21.15.12:0/3818191813 shutdown_connections 2024-09-19T06:44:31.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:31.564+0000 7f5af3fd4640 1 -- 172.21.15.12:0/3818191813 wait complete. 2024-09-19T06:44:31.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:31 smithi173 ceph-mon[35349]: pgmap v134: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 17 MiB/s wr, 1.32k op/s 2024-09-19T06:44:31.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:31 smithi016 ceph-mon[34911]: pgmap v134: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 17 MiB/s wr, 1.32k op/s 2024-09-19T06:44:32.477 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '68f2f376', quiesce took 6.0 seconds. Will release after: 23.8 2024-09-19T06:44:33.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:33 smithi173 ceph-mon[35349]: pgmap v135: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 9.6 MiB/s wr, 777 op/s 2024-09-19T06:44:33.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:33 smithi012 ceph-mon[30937]: pgmap v135: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 9.6 MiB/s wr, 777 op/s 2024-09-19T06:44:33.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:33 smithi016 ceph-mon[34911]: pgmap v135: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 9.6 MiB/s wr, 777 op/s 2024-09-19T06:44:34.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:34 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:44:34.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:34 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:44:34.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:34 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:44:34.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:34 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:44:34.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:34 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:44:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:34 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:44:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:34 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:44:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:34 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:44:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:34 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:44:34.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:34 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:44:34.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:34 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:44:34.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:34 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:44:34.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:34 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:44:34.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:34 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:44:34.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:34 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:44:35.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:35 smithi173 ceph-mon[35349]: pgmap v136: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 9.6 MiB/s wr, 782 op/s 2024-09-19T06:44:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:35 smithi012 ceph-mon[30937]: pgmap v136: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 9.6 MiB/s wr, 782 op/s 2024-09-19T06:44:35.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:35 smithi016 ceph-mon[34911]: pgmap v136: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 9.6 MiB/s wr, 782 op/s 2024-09-19T06:44:35.811 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 230.0 s, 715.6 tps, lat 17.034 ms stddev 19.235 2024-09-19T06:44:37.561 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:37 smithi016 ceph-mon[34911]: pgmap v137: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 12 MiB/s wr, 944 op/s 2024-09-19T06:44:37.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:37 smithi173 ceph-mon[35349]: pgmap v137: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 12 MiB/s wr, 944 op/s 2024-09-19T06:44:37.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:37 smithi012 ceph-mon[30937]: pgmap v137: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 12 MiB/s wr, 944 op/s 2024-09-19T06:44:39.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:39 smithi173 ceph-mon[35349]: pgmap v138: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 6.7 MiB/s wr, 567 op/s 2024-09-19T06:44:39.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:39 smithi012 ceph-mon[30937]: pgmap v138: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 6.7 MiB/s wr, 567 op/s 2024-09-19T06:44:39.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:39 smithi016 ceph-mon[34911]: pgmap v138: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 6.7 MiB/s wr, 567 op/s 2024-09-19T06:44:40.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:44:41.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:41 smithi173 ceph-mon[35349]: pgmap v139: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 6.7 MiB/s wr, 573 op/s 2024-09-19T06:44:41.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:41 smithi012 ceph-mon[30937]: pgmap v139: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 6.7 MiB/s wr, 573 op/s 2024-09-19T06:44:41.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:41 smithi016 ceph-mon[34911]: pgmap v139: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 6.7 MiB/s wr, 573 op/s 2024-09-19T06:44:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.093+0000 7fc6dded0640 1 -- 172.21.15.12:0/3816489254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d8102470 msgr2=0x7fc6d810e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.093+0000 7fc6dded0640 1 --2- 172.21.15.12:0/3816489254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d8102470 0x7fc6d810e9a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009cd0 tx=0x7fc6d002a910 comp rx=0 tx=0).stop 2024-09-19T06:44:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.093+0000 7fc6dded0640 1 -- 172.21.15.12:0/3816489254 shutdown_connections 2024-09-19T06:44:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.093+0000 7fc6dded0640 1 --2- 172.21.15.12:0/3816489254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d8102470 0x7fc6d810e9a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.093+0000 7fc6dded0640 1 --2- 172.21.15.12:0/3816489254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d8101ad0 0x7fc6d8101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.093+0000 7fc6dded0640 1 --2- 172.21.15.12:0/3816489254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6d8107b70 0x7fc6d8107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.093+0000 7fc6dded0640 1 -- 172.21.15.12:0/3816489254 >> 172.21.15.12:0/3816489254 conn(0x7fc6d80fd7d0 msgr2=0x7fc6d80ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.093+0000 7fc6dded0640 1 -- 172.21.15.12:0/3816489254 shutdown_connections 2024-09-19T06:44:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.093+0000 7fc6dded0640 1 -- 172.21.15.12:0/3816489254 wait complete. 2024-09-19T06:44:42.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.093+0000 7fc6dded0640 1 Processor -- start 2024-09-19T06:44:42.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6dded0640 1 -- start start 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6dded0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d8101ad0 0x7fc6d8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6dded0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d8102470 0x7fc6d8198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6dded0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6d8107b70 0x7fc6d819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6dded0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d8111f70 con 0x7fc6d8102470 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6dded0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d8111df0 con 0x7fc6d8107b70 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6dded0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81120f0 con 0x7fc6d8101ad0 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d8102470 0x7fc6d8198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d8102470 0x7fc6d8198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47406/0 (socket says 172.21.15.12:47406) 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6d6ffd640 1 -- 172.21.15.12:0/811124822 learned_addr learned my addr 172.21.15.12:0/811124822 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6d8107b70 0x7fc6d819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6d6ffd640 1 -- 172.21.15.12:0/811124822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d8101ad0 msgr2=0x7fc6d8198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d8101ad0 0x7fc6d8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6d6ffd640 1 -- 172.21.15.12:0/811124822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6d8107b70 msgr2=0x7fc6d819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6d8107b70 0x7fc6d819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6d6ffd640 1 -- 172.21.15.12:0/811124822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d819d310 con 0x7fc6d8102470 2024-09-19T06:44:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.094+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6d8107b70 0x7fc6d819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.095+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d8102470 0x7fc6d8198860 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00b450 tx=0x7fc6cc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.095+0000 7fc6d4ff9640 1 -- 172.21.15.12:0/811124822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc015020 con 0x7fc6d8102470 2024-09-19T06:44:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.095+0000 7fc6d4ff9640 1 -- 172.21.15.12:0/811124822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6cc011d70 con 0x7fc6d8102470 2024-09-19T06:44:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.095+0000 7fc6d4ff9640 1 -- 172.21.15.12:0/811124822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00f340 con 0x7fc6d8102470 2024-09-19T06:44:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.095+0000 7fc6dded0640 1 -- 172.21.15.12:0/811124822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d819d600 con 0x7fc6d8102470 2024-09-19T06:44:42.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.095+0000 7fc6dded0640 1 -- 172.21.15.12:0/811124822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d81a4e90 con 0x7fc6d8102470 2024-09-19T06:44:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.097+0000 7fc6d4ff9640 1 -- 172.21.15.12:0/811124822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc6cc018020 con 0x7fc6d8102470 2024-09-19T06:44:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6e0c68740 1 Processor -- start 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6e0c68740 1 -- start start 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81569b0 0x564ed8156d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81572d0 0x564ed8165b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 0x564ed81684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564ed80bb2f0 con 0x564ed81572d0 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564ed8063270 con 0x564ed81660c0 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564ed80b72b0 con 0x564ed81569b0 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6d77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81572d0 0x564ed8165b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6d4ff9640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6c00a34e0 0x7fc6c00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6d77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81572d0 0x564ed8165b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47418/0 (socket says 172.21.15.12:47418) 2024-09-19T06:44:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6d77fe640 1 -- 172.21.15.12:0/995249936 learned_addr learned my addr 172.21.15.12:0/995249936 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/995249936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81569b0 0x564ed8156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/995249936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 0x564ed81684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6c00a34e0 0x7fc6c00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6d4ff9640 1 -- 172.21.15.12:0/811124822 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc6cc0cf7c0 con 0x7fc6d8102470 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.098+0000 7fc6d77fe640 1 -- 172.21.15.12:0/995249936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81569b0 msgr2=0x564ed8156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.099+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/995249936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81569b0 0x564ed8156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.099+0000 7fc6d77fe640 1 -- 172.21.15.12:0/995249936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 msgr2=0x564ed81684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.099+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/995249936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 0x564ed81684b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.099+0000 7fc6d77fe640 1 -- 172.21.15.12:0/995249936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed8062340 con 0x564ed81572d0 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.099+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/995249936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 0x564ed81684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.099+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/995249936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81572d0 0x564ed8165b80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800aa90 tx=0x7fc6c800af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bed3c78f88f82f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.099+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6c00a34e0 0x7fc6c00a59a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0006010 tx=0x7fc6d00095c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.099+0000 7fc6bdffb640 1 -- 172.21.15.12:0/995249936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800f450 con 0x564ed81572d0 2024-09-19T06:44:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.099+0000 7fc6bdffb640 1 -- 172.21.15.12:0/995249936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c800fad0 con 0x564ed81572d0 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.099+0000 7fc6bdffb640 1 -- 172.21.15.12:0/995249936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800eaf0 con 0x564ed81572d0 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.100+0000 7fc6e0c68740 1 -- 172.21.15.12:0/995249936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81572d0 msgr2=0x564ed8165b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.100+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/995249936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81572d0 0x564ed8165b80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800aa90 tx=0x7fc6c800af50 comp rx=0 tx=0).stop 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.100+0000 7fc6e0c68740 1 -- 172.21.15.12:0/995249936 shutdown_connections 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.100+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/995249936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 0x564ed81684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.100+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/995249936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81572d0 0x564ed8165b80 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.100+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/995249936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81569b0 0x564ed8156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.100+0000 7fc6e0c68740 1 -- 172.21.15.12:0/995249936 >> 172.21.15.12:0/995249936 conn(0x564ed8153060 msgr2=0x564ed8153440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.100+0000 7fc6e0c68740 1 -- 172.21.15.12:0/995249936 shutdown_connections 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.100+0000 7fc6e0c68740 1 -- 172.21.15.12:0/995249936 wait complete. 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.100+0000 7fc6e0c68740 1 -- start start 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6e0c68740 1 Processor -- start 2024-09-19T06:44:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81569b0 0x564ed8163040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 0x564ed8163580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81660c0 0x564ed8163ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564ed8168c90 con 0x564ed81660c0 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564ed8044290 con 0x564ed81569b0 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564ed8168e10 con 0x564ed81572d0 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6e0c68740 10 client.0 _ll_register_callbacks cb 0x564ed8075140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6d7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81660c0 0x564ed8163ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6d7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81660c0 0x564ed8163ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47426/0 (socket says 172.21.15.12:47426) 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6d7fff640 1 -- 172.21.15.12:0/4294565673 learned_addr learned my addr 172.21.15.12:0/4294565673 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81569b0 0x564ed8163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 0x564ed8163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6d7fff640 1 -- 172.21.15.12:0/4294565673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 msgr2=0x564ed8163580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 0x564ed8163580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6d7fff640 1 -- 172.21.15.12:0/4294565673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81569b0 msgr2=0x564ed8163040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81569b0 0x564ed8163040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.101+0000 7fc6d7fff640 1 -- 172.21.15.12:0/4294565673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed7dce210 con 0x564ed81660c0 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81660c0 0x564ed8163ac0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0035000 tx=0x7fc6d002a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c0a243cabac837 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/4294565673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d004e070 con 0x564ed81660c0 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/4294565673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc6d0004240 con 0x564ed81660c0 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6e0c68740 1 -- 172.21.15.12:0/4294565673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c800fad0 con 0x564ed81660c0 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/4294565673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc6d005a050 con 0x564ed81660c0 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6e0c68740 10 client.16734 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6e0c68740 1 -- 172.21.15.12:0/4294565673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564ed7e9a620 con 0x564ed81660c0 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/4294565673 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c800fad0 con 0x564ed81660c0 2024-09-19T06:44:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/4294565673 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fc6d002fbd0 con 0x564ed81660c0 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6e0c68740 10 client.16734 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6e0c68740 10 client.16734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6e0c68740 20 client.16734 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ed8176080 0x564ed81784f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6e0c68740 4 client.16734 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.102+0000 7fc6e0c68740 1 -- 172.21.15.12:0/4294565673 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ed80c8a20 con 0x564ed8176080 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.103+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ed8176080 0x564ed81784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.103+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ed8176080 0x564ed81784f0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc26e128c879aaa server_cookie=55d11df650c92b61 in_seq=0 out_seq=0 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.103+0000 7fc6b6ffd640 10 client.16734 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/4294565673 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ed80c8a20 con 0x564ed8176080 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6b6ffd640 10 client.16734 handle_command_reply: tid=0 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 client.16734 shutdown 2024-09-19T06:44:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 -- 172.21.15.12:0/4294565673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81660c0 msgr2=0x564ed8163ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81660c0 0x564ed8163ac0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0035000 tx=0x7fc6d002a910 comp rx=0 tx=0).stop 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 -- 172.21.15.12:0/4294565673 shutdown_connections 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ed8176080 0x564ed81784f0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81660c0 0x564ed8163ac0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 0x564ed8163580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6b6ffd640 0 client.16734 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/4294565673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81569b0 0x564ed8163040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 -- 172.21.15.12:0/4294565673 >> 172.21.15.12:0/4294565673 conn(0x564ed8153060 msgr2=0x564ed8158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 -- 172.21.15.12:0/4294565673 shutdown_connections 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 1 -- 172.21.15.12:0/4294565673 wait complete. 2024-09-19T06:44:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.104+0000 7fc6e0c68740 20 client.16734 trim_cache size 0 max 16384 2024-09-19T06:44:42.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6e0c68740 1 Processor -- start 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6e0c68740 1 -- start start 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed8164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 0x564ed817de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 0x564ed817e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81ab7d0 con 0x564ed81569b0 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81ad340 con 0x564ed81660c0 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81abea0 con 0x564ed81572d0 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed8164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed8164fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47428/0 (socket says 172.21.15.12:47428) 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d77fe640 1 -- 172.21.15.12:0/2126120767 learned_addr learned my addr 172.21.15.12:0/2126120767 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 0x564ed817e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 0x564ed817de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d77fe640 1 -- 172.21.15.12:0/2126120767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 msgr2=0x564ed817de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 0x564ed817de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d77fe640 1 -- 172.21.15.12:0/2126120767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 msgr2=0x564ed817e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 0x564ed817e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d77fe640 1 -- 172.21.15.12:0/2126120767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed8172aa0 con 0x564ed81569b0 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 0x564ed817de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.119+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 0x564ed817e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed8164fb0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800e660 tx=0x7fc6c8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d878cf4c65238e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6bd7fa640 1 -- 172.21.15.12:0/2126120767 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800e700 con 0x564ed81569b0 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6bd7fa640 1 -- 172.21.15.12:0/2126120767 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c800ed80 con 0x564ed81569b0 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6bd7fa640 1 -- 172.21.15.12:0/2126120767 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800fd70 con 0x564ed81569b0 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6e0c68740 1 -- 172.21.15.12:0/2126120767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 msgr2=0x564ed8164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed8164fb0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800e660 tx=0x7fc6c8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6e0c68740 1 -- 172.21.15.12:0/2126120767 shutdown_connections 2024-09-19T06:44:42.127 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81660c0 0x564ed817e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81572d0 0x564ed817de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/2126120767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed8164fb0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6e0c68740 1 -- 172.21.15.12:0/2126120767 >> 172.21.15.12:0/2126120767 conn(0x564ed8153060 msgr2=0x564ed81648a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6e0c68740 1 -- 172.21.15.12:0/2126120767 shutdown_connections 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.120+0000 7fc6e0c68740 1 -- 172.21.15.12:0/2126120767 wait complete. 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6e0c68740 1 -- start start 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6e0c68740 1 Processor -- start 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed816e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81572d0 0x564ed8169cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6e0c68740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81660c0 0x564ed816a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81acc70 con 0x564ed81569b0 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81ac570 con 0x564ed81572d0 2024-09-19T06:44:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6e0c68740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81a97b0 con 0x564ed81660c0 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6e0c68740 10 client.0 _ll_register_callbacks cb 0x7fc6d0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6d77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed816e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6d77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed816e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47442/0 (socket says 172.21.15.12:47442) 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.121+0000 7fc6d77fe640 1 -- 172.21.15.12:0/487255842 learned_addr learned my addr 172.21.15.12:0/487255842 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81572d0 0x564ed8169cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6d7fff640 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81660c0 0x564ed816a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6d77fe640 1 -- 172.21.15.12:0/487255842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81660c0 msgr2=0x564ed816a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81660c0 0x564ed816a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6d77fe640 1 -- 172.21.15.12:0/487255842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81572d0 msgr2=0x564ed8169cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81572d0 0x564ed8169cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6d77fe640 1 -- 172.21.15.12:0/487255842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed8157100 con 0x564ed81569b0 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6d77fe640 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed816e990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800a480 tx=0x7fc6c800e3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbe8cd2b127ceda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/487255842 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8032070 con 0x564ed81569b0 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/487255842 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc6c800f9b0 con 0x564ed81569b0 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6e0c68740 1 -- 172.21.15.12:0/487255842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c800ed80 con 0x564ed81569b0 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/487255842 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc6c803d050 con 0x564ed81569b0 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6e0c68740 10 client.16740 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6e0c68740 1 -- 172.21.15.12:0/487255842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564ed81e0d50 con 0x564ed81569b0 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.122+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/487255842 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6c800ed80 con 0x564ed81569b0 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.123+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/487255842 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fc6c8005140 con 0x564ed81569b0 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.123+0000 7fc6e0c68740 10 client.16740 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.123+0000 7fc6e0c68740 10 client.16740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.123+0000 7fc6e0c68740 20 client.16740 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.123+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ed81e1220 0x564ed81e3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.123+0000 7fc6e0c68740 4 client.16740 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:44:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.123+0000 7fc6e0c68740 1 -- 172.21.15.12:0/487255842 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ed80c2d70 con 0x564ed81e1220 2024-09-19T06:44:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.123+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ed81e1220 0x564ed81e3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.123+0000 7fc6b6ffd640 10 client.16740 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.123+0000 7fc6d6ffd640 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ed81e1220 0x564ed81e3610 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36b3b72846ad669e server_cookie=1be0d8f99e070484 in_seq=0 out_seq=0 2024-09-19T06:44:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.140+0000 7fc6b6ffd640 1 -- 172.21.15.12:0/487255842 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ed80c2d70 con 0x564ed81e1220 2024-09-19T06:44:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.140+0000 7fc6b6ffd640 10 client.16740 handle_command_reply: tid=0 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.140+0000 7fc6e0c68740 1 client.16740 shutdown 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 1 -- 172.21.15.12:0/487255842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 msgr2=0x564ed816e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed816e990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800a480 tx=0x7fc6c800e3b0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 1 -- 172.21.15.12:0/487255842 shutdown_connections 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ed81e1220 0x564ed81e3610 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ed81660c0 0x564ed816a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ed81572d0 0x564ed8169cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6b6ffd640 0 client.16740 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 1 --2- 172.21.15.12:0/487255842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ed81569b0 0x564ed816e990 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 1 -- 172.21.15.12:0/487255842 >> 172.21.15.12:0/487255842 conn(0x564ed8153060 msgr2=0x564ed81519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 1 -- 172.21.15.12:0/487255842 shutdown_connections 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 1 -- 172.21.15.12:0/487255842 wait complete. 2024-09-19T06:44:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.141+0000 7fc6e0c68740 20 client.16740 trim_cache size 0 max 16384 2024-09-19T06:44:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:44:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:44:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:44:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:44:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 -- 172.21.15.12:0/811124822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6c00a34e0 msgr2=0x7fc6c00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6c00a34e0 0x7fc6c00a59a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0006010 tx=0x7fc6d00095c0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 -- 172.21.15.12:0/811124822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d8102470 msgr2=0x7fc6d8198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d8102470 0x7fc6d8198860 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00b450 tx=0x7fc6cc00b910 comp rx=0 tx=0).stop 2024-09-19T06:44:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 -- 172.21.15.12:0/811124822 shutdown_connections 2024-09-19T06:44:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6d8107b70 0x7fc6d819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6d8102470 0x7fc6d8198860 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6c00a34e0 0x7fc6c00a59a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 --2- 172.21.15.12:0/811124822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d8101ad0 0x7fc6d8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 -- 172.21.15.12:0/811124822 >> 172.21.15.12:0/811124822 conn(0x7fc6d80fd7d0 msgr2=0x7fc6d80fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:42.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 -- 172.21.15.12:0/811124822 shutdown_connections 2024-09-19T06:44:42.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:42.142+0000 7fc6dded0640 1 -- 172.21.15.12:0/811124822 wait complete. 2024-09-19T06:44:43.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:43 smithi173 ceph-mon[35349]: pgmap v140: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.5 MiB/s wr, 172 op/s 2024-09-19T06:44:43.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:43 smithi012 ceph-mon[30937]: pgmap v140: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.5 MiB/s wr, 172 op/s 2024-09-19T06:44:43.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:43 smithi016 ceph-mon[34911]: pgmap v140: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.5 MiB/s wr, 172 op/s 2024-09-19T06:44:45.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:45 smithi173 ceph-mon[35349]: pgmap v141: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.5 MiB/s wr, 174 op/s 2024-09-19T06:44:45.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:45 smithi012 ceph-mon[30937]: pgmap v141: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.5 MiB/s wr, 174 op/s 2024-09-19T06:44:45.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:45 smithi016 ceph-mon[34911]: pgmap v141: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.5 MiB/s wr, 174 op/s 2024-09-19T06:44:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:44:47.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:47 smithi173 ceph-mon[35349]: pgmap v142: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.5 MiB/s wr, 176 op/s 2024-09-19T06:44:47.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:47 smithi012 ceph-mon[30937]: pgmap v142: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.5 MiB/s wr, 176 op/s 2024-09-19T06:44:47.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:47 smithi016 ceph-mon[34911]: pgmap v142: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.5 MiB/s wr, 176 op/s 2024-09-19T06:44:49.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:49 smithi173 ceph-mon[35349]: pgmap v143: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-19T06:44:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:49 smithi012 ceph-mon[30937]: pgmap v143: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-19T06:44:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:49 smithi016 ceph-mon[34911]: pgmap v143: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-19T06:44:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:44:51.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:51 smithi173 ceph-mon[35349]: pgmap v144: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.0 MiB/s wr, 151 op/s 2024-09-19T06:44:51.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:51 smithi012 ceph-mon[30937]: pgmap v144: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.0 MiB/s wr, 151 op/s 2024-09-19T06:44:51.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:51 smithi016 ceph-mon[34911]: pgmap v144: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.0 MiB/s wr, 151 op/s 2024-09-19T06:44:53.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:53 smithi173 ceph-mon[35349]: pgmap v145: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.0 MiB/s wr, 145 op/s 2024-09-19T06:44:53.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:53 smithi012 ceph-mon[30937]: pgmap v145: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.0 MiB/s wr, 145 op/s 2024-09-19T06:44:53.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:53 smithi016 ceph-mon[34911]: pgmap v145: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.0 MiB/s wr, 145 op/s 2024-09-19T06:44:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.241+0000 7fa3d6111640 1 -- 172.21.15.12:0/1035859142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3d01080f0 msgr2=0x7fa3d010ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.241+0000 7fa3d6111640 1 --2- 172.21.15.12:0/1035859142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3d01080f0 0x7fa3d010ea10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009ca0 tx=0x7fa3c802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.242+0000 7fa3d6111640 1 -- 172.21.15.12:0/1035859142 shutdown_connections 2024-09-19T06:44:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.242+0000 7fa3d6111640 1 --2- 172.21.15.12:0/1035859142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3d01080f0 0x7fa3d010ea10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.242+0000 7fa3d6111640 1 --2- 172.21.15.12:0/1035859142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d0101250 0x7fa3d0107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.242+0000 7fa3d6111640 1 --2- 172.21.15.12:0/1035859142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d01008a0 0x7fa3d0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.242+0000 7fa3d6111640 1 -- 172.21.15.12:0/1035859142 >> 172.21.15.12:0/1035859142 conn(0x7fa3d0075ef0 msgr2=0x7fa3d0076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.242+0000 7fa3d6111640 1 -- 172.21.15.12:0/1035859142 shutdown_connections 2024-09-19T06:44:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.242+0000 7fa3d6111640 1 -- 172.21.15.12:0/1035859142 wait complete. 2024-09-19T06:44:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.242+0000 7fa3d6111640 1 Processor -- start 2024-09-19T06:44:55.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3d6111640 1 -- start start 2024-09-19T06:44:55.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3d6111640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3d01008a0 0x7fa3d01982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3d6111640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d01080f0 0x7fa3d01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3d6111640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d019cb60 0x7fa3d019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3d6111640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d0111f70 con 0x7fa3d01008a0 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3d6111640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d0111df0 con 0x7fa3d019cb60 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3d6111640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01120f0 con 0x7fa3d01080f0 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3d01008a0 0x7fa3d01982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3d01008a0 0x7fa3d01982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41662/0 (socket says 172.21.15.12:41662) 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3cf7fe640 1 -- 172.21.15.12:0/2493456512 learned_addr learned my addr 172.21.15.12:0/2493456512 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3cf7fe640 1 -- 172.21.15.12:0/2493456512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d01080f0 msgr2=0x7fa3d01987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d01080f0 0x7fa3d01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3cffff640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d019cb60 0x7fa3d019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d01080f0 0x7fa3d01987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3cf7fe640 1 -- 172.21.15.12:0/2493456512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d019cb60 msgr2=0x7fa3d019d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d019cb60 0x7fa3d019d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3cf7fe640 1 -- 172.21.15.12:0/2493456512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d019d650 con 0x7fa3d01008a0 2024-09-19T06:44:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d01080f0 0x7fa3d01987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.243+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3d01008a0 0x7fa3d01982a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000d950 tx=0x7fa3c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.244+0000 7fa3ccff9640 1 -- 172.21.15.12:0/2493456512 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0017070 con 0x7fa3d01008a0 2024-09-19T06:44:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.244+0000 7fa3ccff9640 1 -- 172.21.15.12:0/2493456512 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3c0009c30 con 0x7fa3d01008a0 2024-09-19T06:44:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.244+0000 7fa3d6111640 1 -- 172.21.15.12:0/2493456512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d019d940 con 0x7fa3d01008a0 2024-09-19T06:44:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.244+0000 7fa3ccff9640 1 -- 172.21.15.12:0/2493456512 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c000f6b0 con 0x7fa3d01008a0 2024-09-19T06:44:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.244+0000 7fa3d6111640 1 -- 172.21.15.12:0/2493456512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d01a5180 con 0x7fa3d01008a0 2024-09-19T06:44:55.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.246+0000 7fa3ccff9640 1 -- 172.21.15.12:0/2493456512 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa3c00109d0 con 0x7fa3d01008a0 2024-09-19T06:44:55.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3d8ea8740 1 Processor -- start 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3d8ea8740 1 -- start start 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea35db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 0x55df8ea44b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea474b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3ccff9640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa3bc0a34e0 0x7fa3bc0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55df8e99a2f0 con 0x55df8ea450c0 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55df8e942270 con 0x55df8ea359d0 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55df8e9962b0 con 0x55df8ea362f0 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea474b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41676/0 (socket says 172.21.15.12:41676) 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3ceffd640 1 -- 172.21.15.12:0/31485087 learned_addr learned my addr 172.21.15.12:0/31485087 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3cffff640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa3bc0a34e0 0x7fa3bc0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3ccff9640 1 -- 172.21.15.12:0/2493456512 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa3c00cfa40 con 0x7fa3d01008a0 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/31485087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 0x55df8ea44b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3cffff640 1 --2- 172.21.15.12:0/31485087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea35db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3ceffd640 1 -- 172.21.15.12:0/31485087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 msgr2=0x55df8ea44b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/31485087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 0x55df8ea44b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3ceffd640 1 -- 172.21.15.12:0/31485087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 msgr2=0x55df8ea35db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/31485087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea35db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.247+0000 7fa3ceffd640 1 -- 172.21.15.12:0/31485087 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df8e941340 con 0x55df8ea450c0 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.248+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/31485087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea474b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009c20 tx=0x7fa3b800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb93132dfb57e97c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.248+0000 7fa3cffff640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa3bc0a34e0 0x7fa3bc0a59a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8005e30 tx=0x7fa3c8005da0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.248+0000 7fa3c5ffb640 1 -- 172.21.15.12:0/31485087 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8016070 con 0x55df8ea450c0 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.248+0000 7fa3c5ffb640 1 -- 172.21.15.12:0/31485087 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3b8009e50 con 0x55df8ea450c0 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.248+0000 7fa3c5ffb640 1 -- 172.21.15.12:0/31485087 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80107d0 con 0x55df8ea450c0 2024-09-19T06:44:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/31485087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 msgr2=0x55df8ea474b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/31485087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea474b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009c20 tx=0x7fa3b800e6c0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/31485087 shutdown_connections 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/31485087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea474b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/31485087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 0x55df8ea44b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/31485087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea35db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/31485087 >> 172.21.15.12:0/31485087 conn(0x55df8ea32060 msgr2=0x55df8ea32440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/31485087 shutdown_connections 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/31485087 wait complete. 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 -- start start 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.249+0000 7fa3d8ea8740 1 Processor -- start 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea359d0 0x55df8ea41fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea362f0 0x55df8ea42510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea450c0 0x55df8ea42a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55df8ea47cf0 con 0x55df8ea359d0 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55df8e923290 con 0x55df8ea362f0 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55df8ea47e70 con 0x55df8ea450c0 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3d8ea8740 10 client.0 _ll_register_callbacks cb 0x55df8e954140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea359d0 0x55df8ea41fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea359d0 0x55df8ea41fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41690/0 (socket says 172.21.15.12:41690) 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3cf7fe640 1 -- 172.21.15.12:0/1039606430 learned_addr learned my addr 172.21.15.12:0/1039606430 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea362f0 0x55df8ea42510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3cffff640 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea450c0 0x55df8ea42a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3cf7fe640 1 -- 172.21.15.12:0/1039606430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea450c0 msgr2=0x55df8ea42a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea450c0 0x55df8ea42a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3cf7fe640 1 -- 172.21.15.12:0/1039606430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea362f0 msgr2=0x55df8ea42510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea362f0 0x55df8ea42510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3cf7fe640 1 -- 172.21.15.12:0/1039606430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df8e6ad210 con 0x55df8ea359d0 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea359d0 0x55df8ea41fd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009610 tx=0x7fa3c0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647e47a02b294393 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.250+0000 7fa3aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1039606430 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0020070 con 0x55df8ea359d0 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1039606430 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa3c00abab0 con 0x55df8ea359d0 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1039606430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3b8009e50 con 0x55df8ea359d0 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1039606430 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa3c00cd530 con 0x55df8ea359d0 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3d8ea8740 10 client.16752 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1039606430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55df8e779620 con 0x55df8ea359d0 2024-09-19T06:44:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1039606430 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3b8009e50 con 0x55df8ea359d0 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1039606430 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fa3c0097990 con 0x55df8ea359d0 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3d8ea8740 10 client.16752 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3d8ea8740 10 client.16752 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3d8ea8740 20 client.16752 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55df8ea550f0 0x55df8ea57520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3d8ea8740 4 client.16752 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.251+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1039606430 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df8e9a7a20 con 0x55df8ea550f0 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.252+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55df8ea550f0 0x55df8ea57520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.252+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55df8ea550f0 0x55df8ea57520 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=158b80539cfe2a63 server_cookie=441608027478e4a9 in_seq=0 out_seq=0 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.252+0000 7fa3aeffd640 10 client.16752 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1039606430 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df8e9a7a20 con 0x55df8ea550f0 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3aeffd640 10 client.16752 handle_command_reply: tid=0 2024-09-19T06:44:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 client.16752 shutdown 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1039606430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea359d0 msgr2=0x55df8ea41fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea359d0 0x55df8ea41fd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009610 tx=0x7fa3c0005f90 comp rx=0 tx=0).stop 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1039606430 shutdown_connections 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55df8ea550f0 0x55df8ea57520 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea450c0 0x55df8ea42a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea362f0 0x55df8ea42510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3aeffd640 0 client.16752 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1039606430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea359d0 0x55df8ea41fd0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1039606430 >> 172.21.15.12:0/1039606430 conn(0x55df8ea32060 msgr2=0x55df8ea37d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1039606430 shutdown_connections 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1039606430 wait complete. 2024-09-19T06:44:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.253+0000 7fa3d8ea8740 20 client.16752 trim_cache size 0 max 16384 2024-09-19T06:44:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.267+0000 7fa3d8ea8740 1 Processor -- start 2024-09-19T06:44:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3d8ea8740 1 -- start start 2024-09-19T06:44:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea310b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea362f0 0x55df8ea5ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea450c0 0x55df8ea5d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01ab6c0 con 0x55df8ea362f0 2024-09-19T06:44:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01ad230 con 0x55df8ea359d0 2024-09-19T06:44:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01abd90 con 0x55df8ea450c0 2024-09-19T06:44:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea362f0 0x55df8ea5ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea362f0 0x55df8ea5ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41694/0 (socket says 172.21.15.12:41694) 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3ceffd640 1 -- 172.21.15.12:0/396253072 learned_addr learned my addr 172.21.15.12:0/396253072 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/396253072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3ceffd640 1 -- 172.21.15.12:0/396253072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea450c0 msgr2=0x55df8ea5d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/396253072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea450c0 0x55df8ea5d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3ceffd640 1 -- 172.21.15.12:0/396253072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 msgr2=0x55df8ea310b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/396253072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea310b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3ceffd640 1 -- 172.21.15.12:0/396253072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df8ea31e90 con 0x55df8ea362f0 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/396253072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea310b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/396253072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea362f0 0x55df8ea5ce00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009c20 tx=0x7fa3b8009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f3750cb746dc8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3c57fa640 1 -- 172.21.15.12:0/396253072 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8016040 con 0x55df8ea362f0 2024-09-19T06:44:55.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.268+0000 7fa3c57fa640 1 -- 172.21.15.12:0/396253072 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3b8011470 con 0x55df8ea362f0 2024-09-19T06:44:55.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3c57fa640 1 -- 172.21.15.12:0/396253072 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8004880 con 0x55df8ea362f0 2024-09-19T06:44:55.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/396253072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea362f0 msgr2=0x55df8ea5ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/396253072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea362f0 0x55df8ea5ce00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009c20 tx=0x7fa3b8009f10 comp rx=0 tx=0).stop 2024-09-19T06:44:55.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/396253072 shutdown_connections 2024-09-19T06:44:55.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/396253072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea450c0 0x55df8ea5d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/396253072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea362f0 0x55df8ea5ce00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/396253072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea310b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/396253072 >> 172.21.15.12:0/396253072 conn(0x55df8ea32060 msgr2=0x55df8ea309a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:55.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/396253072 shutdown_connections 2024-09-19T06:44:55.276 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/396253072 wait complete. 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.269+0000 7fa3d8ea8740 1 -- start start 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3d8ea8740 1 Processor -- start 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 0x55df8ea49630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3d8ea8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea49b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01acb60 con 0x55df8ea450c0 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01ac460 con 0x55df8ea359d0 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3d8ea8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01a96a0 con 0x55df8ea362f0 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3d8ea8740 10 client.0 _ll_register_callbacks cb 0x7fa3c009b5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3cffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea49b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3cffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea49b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41704/0 (socket says 172.21.15.12:41704) 2024-09-19T06:44:55.277 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3cffff640 1 -- 172.21.15.12:0/1300730349 learned_addr learned my addr 172.21.15.12:0/1300730349 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 0x55df8ea49630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3cffff640 1 -- 172.21.15.12:0/1300730349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 msgr2=0x55df8ea49630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3cffff640 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 0x55df8ea49630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3cffff640 1 -- 172.21.15.12:0/1300730349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 msgr2=0x55df8ea490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3cffff640 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3cffff640 1 -- 172.21.15.12:0/1300730349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df8ea3cd50 con 0x55df8ea450c0 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.270+0000 7fa3ceffd640 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 0x55df8ea49630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3cffff640 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea49b90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009ca0 tx=0x7fa3c802f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23721fdc254b7140 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1300730349 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8050070 con 0x55df8ea450c0 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1300730349 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa3c8031860 con 0x55df8ea450c0 2024-09-19T06:44:55.278 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1300730349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3b8011470 con 0x55df8ea450c0 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1300730349 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa3c805c050 con 0x55df8ea450c0 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3d8ea8740 10 client.16758 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1300730349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55df8eac01e0 con 0x55df8ea450c0 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1300730349 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3b8011470 con 0x55df8ea450c0 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1300730349 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fa3c8049050 con 0x55df8ea450c0 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3d8ea8740 10 client.16758 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3d8ea8740 10 client.16758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3d8ea8740 20 client.16758 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55df8eac0960 0x55df8eac2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3d8ea8740 4 client.16758 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.271+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1300730349 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55df8e9a1d70 con 0x55df8eac0960 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.272+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55df8eac0960 0x55df8eac2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.272+0000 7fa3aeffd640 10 client.16758 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:55.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.272+0000 7fa3cf7fe640 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55df8eac0960 0x55df8eac2d80 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=784450b3b90d33a4 server_cookie=a2b98b3f7be672f6 in_seq=0 out_seq=0 2024-09-19T06:44:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3aeffd640 1 -- 172.21.15.12:0/1300730349 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55df8e9a1d70 con 0x55df8eac0960 2024-09-19T06:44:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3aeffd640 10 client.16758 handle_command_reply: tid=0 2024-09-19T06:44:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 client.16758 shutdown 2024-09-19T06:44:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1300730349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 msgr2=0x55df8ea49b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea49b90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009ca0 tx=0x7fa3c802f3d0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1300730349 shutdown_connections 2024-09-19T06:44:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55df8eac0960 0x55df8eac2d80 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55df8ea450c0 0x55df8ea49b90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55df8ea362f0 0x55df8ea49630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 --2- 172.21.15.12:0/1300730349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55df8ea359d0 0x55df8ea490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1300730349 >> 172.21.15.12:0/1300730349 conn(0x55df8ea32060 msgr2=0x55df8ea427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3aeffd640 0 client.16758 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1300730349 shutdown_connections 2024-09-19T06:44:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 1 -- 172.21.15.12:0/1300730349 wait complete. 2024-09-19T06:44:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.286+0000 7fa3d8ea8740 20 client.16758 trim_cache size 0 max 16384 2024-09-19T06:44:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:44:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:44:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:44:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:44:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 -- 172.21.15.12:0/2493456512 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa3bc0a34e0 msgr2=0x7fa3bc0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa3bc0a34e0 0x7fa3bc0a59a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8005e30 tx=0x7fa3c8005da0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 -- 172.21.15.12:0/2493456512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3d01008a0 msgr2=0x7fa3d01982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3d01008a0 0x7fa3d01982a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000d950 tx=0x7fa3c000de10 comp rx=0 tx=0).stop 2024-09-19T06:44:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 -- 172.21.15.12:0/2493456512 shutdown_connections 2024-09-19T06:44:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3d019cb60 0x7fa3d019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa3bc0a34e0 0x7fa3bc0a59a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa3d01080f0 0x7fa3d01987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 --2- 172.21.15.12:0/2493456512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3d01008a0 0x7fa3d01982a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 -- 172.21.15.12:0/2493456512 >> 172.21.15.12:0/2493456512 conn(0x7fa3d0075ef0 msgr2=0x7fa3d00ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 -- 172.21.15.12:0/2493456512 shutdown_connections 2024-09-19T06:44:55.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:44:55.287+0000 7fa3d6111640 1 -- 172.21.15.12:0/2493456512 wait complete. 2024-09-19T06:44:55.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:55 smithi012 ceph-mon[30937]: pgmap v146: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.0 MiB/s wr, 146 op/s 2024-09-19T06:44:55.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:55 smithi016 ceph-mon[34911]: pgmap v146: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.0 MiB/s wr, 146 op/s 2024-09-19T06:44:55.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 250.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:44:55.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:55 smithi173 ceph-mon[35349]: pgmap v146: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.0 MiB/s wr, 146 op/s 2024-09-19T06:44:56.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:44:56.546 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:57.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 -- 172.21.15.12:0/1413201969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c101de0 msgr2=0x7f361c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 --2- 172.21.15.12:0/1413201969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c101de0 0x7f361c1021c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3618009900 tx=0x7f361802a410 comp rx=0 tx=0).stop 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 -- 172.21.15.12:0/1413201969 shutdown_connections 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 --2- 172.21.15.12:0/1413201969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f361c106f10 0x7f361c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 --2- 172.21.15.12:0/1413201969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f361c102790 0x7f361c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 --2- 172.21.15.12:0/1413201969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c101de0 0x7f361c1021c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 -- 172.21.15.12:0/1413201969 >> 172.21.15.12:0/1413201969 conn(0x7f361c0fd8c0 msgr2=0x7f361c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 -- 172.21.15.12:0/1413201969 shutdown_connections 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 -- 172.21.15.12:0/1413201969 wait complete. 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 Processor -- start 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.063+0000 7f3624551640 1 -- start start 2024-09-19T06:44:57.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3624551640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f361c101de0 0x7f361c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3624551640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c102790 0x7f361c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3624551640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f361c106f10 0x7f361c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3624551640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f361c111f90 con 0x7f361c102790 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3624551640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f361c111e10 con 0x7f361c101de0 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3624551640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f361c112110 con 0x7f361c106f10 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3621aec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c102790 0x7f361c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3621aec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c102790 0x7f361c1989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41716/0 (socket says 172.21.15.12:41716) 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3621aec640 1 -- 172.21.15.12:0/1816952407 learned_addr learned my addr 172.21.15.12:0/1816952407 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f36222ed640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f361c101de0 0x7f361c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3622aee640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f361c106f10 0x7f361c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3621aec640 1 -- 172.21.15.12:0/1816952407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f361c106f10 msgr2=0x7f361c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:57.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3621aec640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f361c106f10 0x7f361c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3621aec640 1 -- 172.21.15.12:0/1816952407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f361c101de0 msgr2=0x7f361c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3621aec640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f361c101de0 0x7f361c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3621aec640 1 -- 172.21.15.12:0/1816952407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361c19d430 con 0x7f361c102790 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f36222ed640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f361c101de0 0x7f361c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.064+0000 7f3621aec640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c102790 0x7f361c1989c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f360c00d950 tx=0x7f360c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.065+0000 7f36137fe640 1 -- 172.21.15.12:0/1816952407 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c017070 con 0x7f361c102790 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.065+0000 7f36137fe640 1 -- 172.21.15.12:0/1816952407 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f360c009c30 con 0x7f361c102790 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.065+0000 7f3624551640 1 -- 172.21.15.12:0/1816952407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361c19d720 con 0x7f361c102790 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.065+0000 7f36137fe640 1 -- 172.21.15.12:0/1816952407 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c00f6b0 con 0x7f361c102790 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.065+0000 7f3624551640 1 -- 172.21.15.12:0/1816952407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f361c1a5000 con 0x7f361c102790 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.066+0000 7f3624551640 1 -- 172.21.15.12:0/1816952407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f361c1021c0 con 0x7f361c102790 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.067+0000 7f36137fe640 1 -- 172.21.15.12:0/1816952407 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f360c0109d0 con 0x7f361c102790 2024-09-19T06:44:57.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.068+0000 7f36137fe640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36080a33b0 0x7f36080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:57.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.068+0000 7f36137fe640 1 -- 172.21.15.12:0/1816952407 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f360c0cfa80 con 0x7f361c102790 2024-09-19T06:44:57.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.068+0000 7f36222ed640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36080a33b0 0x7f36080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:57.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.068+0000 7f36222ed640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36080a33b0 0x7f36080a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3618005ab0 tx=0x7f3618005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:57.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.071+0000 7f36137fe640 1 -- 172.21.15.12:0/1816952407 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f360c009de0 con 0x7f361c102790 2024-09-19T06:44:57.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.284+0000 7f3624551640 1 -- 172.21.15.12:0/1816952407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f361c02d7c0 con 0x7f361c102790 2024-09-19T06:44:57.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.285+0000 7f36137fe640 1 -- 172.21.15.12:0/1816952407 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11972 (secure 0 0 0) 0x7f360c09c3e0 con 0x7f361c102790 2024-09-19T06:44:57.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:44:57.287 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"btime":"2024-09-19T06:44:20:228405+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:44:19.565004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:44:57.287 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 35 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.287+0000 7f3624551640 1 -- 172.21.15.12:0/1816952407 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36080a33b0 msgr2=0x7f36080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.287+0000 7f3624551640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36080a33b0 0x7f36080a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3618005ab0 tx=0x7f3618005a20 comp rx=0 tx=0).stop 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.287+0000 7f3624551640 1 -- 172.21.15.12:0/1816952407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c102790 msgr2=0x7f361c1989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.287+0000 7f3624551640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c102790 0x7f361c1989c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f360c00d950 tx=0x7f360c00de10 comp rx=0 tx=0).stop 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.287+0000 7f3624551640 1 -- 172.21.15.12:0/1816952407 shutdown_connections 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.287+0000 7f3624551640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36080a33b0 0x7f36080a5870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.287+0000 7f3624551640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f361c106f10 0x7f361c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.287+0000 7f3624551640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f361c102790 0x7f361c1989c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.287+0000 7f3624551640 1 --2- 172.21.15.12:0/1816952407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f361c101de0 0x7f361c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.287+0000 7f3624551640 1 -- 172.21.15.12:0/1816952407 >> 172.21.15.12:0/1816952407 conn(0x7f361c0fd8c0 msgr2=0x7f361c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:57.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.288+0000 7f3624551640 1 -- 172.21.15.12:0/1816952407 shutdown_connections 2024-09-19T06:44:57.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:57.288+0000 7f3624551640 1 -- 172.21.15.12:0/1816952407 wait complete. 2024-09-19T06:44:57.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:57 smithi012 ceph-mon[30937]: pgmap v147: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 148 op/s 2024-09-19T06:44:57.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:57 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1816952407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:57.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:57 smithi016 ceph-mon[34911]: pgmap v147: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 148 op/s 2024-09-19T06:44:57.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:57 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1816952407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:57.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:57 smithi173 ceph-mon[35349]: pgmap v147: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 148 op/s 2024-09-19T06:44:57.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:57 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1816952407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:44:58.058 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 68f2f376 --release --await' 2024-09-19T06:44:58.058 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 68f2f376 --release --await 2024-09-19T06:44:58.322 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:44:58.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.816+0000 7f04c7c16640 1 -- 172.21.15.12:0/1501388581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c010c170 msgr2=0x7f04c010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.816+0000 7f04c7c16640 1 --2- 172.21.15.12:0/1501388581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c010c170 0x7f04c010e610 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009ca0 tx=0x7f04b802a950 comp rx=0 tx=0).stop 2024-09-19T06:44:58.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.816+0000 7f04c7c16640 1 -- 172.21.15.12:0/1501388581 shutdown_connections 2024-09-19T06:44:58.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.816+0000 7f04c7c16640 1 --2- 172.21.15.12:0/1501388581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c010c170 0x7f04c010e610 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.816+0000 7f04c7c16640 1 --2- 172.21.15.12:0/1501388581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04c0103660 0x7f04c010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.816+0000 7f04c7c16640 1 --2- 172.21.15.12:0/1501388581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04c0102d40 0x7f04c0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.816+0000 7f04c7c16640 1 -- 172.21.15.12:0/1501388581 >> 172.21.15.12:0/1501388581 conn(0x7f04c00fc7a0 msgr2=0x7f04c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.816+0000 7f04c7c16640 1 -- 172.21.15.12:0/1501388581 shutdown_connections 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.816+0000 7f04c7c16640 1 -- 172.21.15.12:0/1501388581 wait complete. 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c7c16640 1 Processor -- start 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c7c16640 1 -- start start 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c7c16640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04c0102d40 0x7f04c01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c7c16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c0103660 0x7f04c0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c7c16640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04c010c170 0x7f04c0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c7c16640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f04c0111f30 con 0x7f04c0103660 2024-09-19T06:44:58.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c7c16640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f04c0111db0 con 0x7f04c010c170 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c7c16640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01120b0 con 0x7f04c0102d40 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c51b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c0103660 0x7f04c0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c51b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c0103660 0x7f04c0100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41732/0 (socket says 172.21.15.12:41732) 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.817+0000 7f04c51b1640 1 -- 172.21.15.12:0/4145492816 learned_addr learned my addr 172.21.15.12:0/4145492816 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c61b3640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04c010c170 0x7f04c0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c59b2640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04c0102d40 0x7f04c01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c51b1640 1 -- 172.21.15.12:0/4145492816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04c0102d40 msgr2=0x7f04c01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c51b1640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04c0102d40 0x7f04c01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c51b1640 1 -- 172.21.15.12:0/4145492816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04c010c170 msgr2=0x7f04c0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c51b1640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04c010c170 0x7f04c0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c51b1640 1 -- 172.21.15.12:0/4145492816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c01a6830 con 0x7f04c0103660 2024-09-19T06:44:58.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c61b3640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04c010c170 0x7f04c0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:44:58.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c59b2640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04c0102d40 0x7f04c01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:58.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c51b1640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c0103660 0x7f04c0100ee0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f04b000d740 tx=0x7f04b000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:58.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04b6ffd640 1 -- 172.21.15.12:0/4145492816 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0017070 con 0x7f04c0103660 2024-09-19T06:44:58.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c7c16640 1 -- 172.21.15.12:0/4145492816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c01a6b20 con 0x7f04c0103660 2024-09-19T06:44:58.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04b6ffd640 1 -- 172.21.15.12:0/4145492816 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04b000de50 con 0x7f04c0103660 2024-09-19T06:44:58.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04b6ffd640 1 -- 172.21.15.12:0/4145492816 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b000f620 con 0x7f04c0103660 2024-09-19T06:44:58.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.818+0000 7f04c7c16640 1 -- 172.21.15.12:0/4145492816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c01a70b0 con 0x7f04c0103660 2024-09-19T06:44:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04b6ffd640 1 -- 172.21.15.12:0/4145492816 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f04b0009c30 con 0x7f04c0103660 2024-09-19T06:44:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c9fef740 1 Processor -- start 2024-09-19T06:44:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c9fef740 1 -- start start 2024-09-19T06:44:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87077e060 0x55c87077e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e980 0x55c870788d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c870789240 0x55c87078b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c9fef740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c8706e3620 con 0x55c870789240 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c9fef740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c87068ae50 con 0x55c87077e980 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c9fef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c8706df5e0 con 0x55c87077e060 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c51b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c870789240 0x55c87078b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c59b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e980 0x55c870788d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04b6ffd640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04ac0a33b0 0x7f04ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.821+0000 7f04c59b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e980 0x55c870788d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:33340/0 (socket says 172.21.15.12:33340) 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04c59b2640 1 -- 172.21.15.12:0/3687510121 learned_addr learned my addr 172.21.15.12:0/3687510121 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04c61b3640 1 --2- 172.21.15.12:0/3687510121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87077e060 0x55c87077e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04c61b3640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04ac0a33b0 0x7f04ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04b6ffd640 1 -- 172.21.15.12:0/4145492816 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f04b00cf9d0 con 0x7f04c0103660 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04c59b2640 1 -- 172.21.15.12:0/3687510121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87077e060 msgr2=0x55c87077e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04c59b2640 1 --2- 172.21.15.12:0/3687510121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87077e060 0x55c87077e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04c59b2640 1 -- 172.21.15.12:0/3687510121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c870789240 msgr2=0x55c87078b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04c59b2640 1 --2- 172.21.15.12:0/3687510121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c870789240 0x55c87078b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04c59b2640 1 -- 172.21.15.12:0/3687510121 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c87067bd40 con 0x55c87077e980 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04c61b3640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04ac0a33b0 0x7f04ac0a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009a60 tx=0x7f04b80095c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.822+0000 7f04c59b2640 1 --2- 172.21.15.12:0/3687510121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e980 0x55c870788d00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00bc20 tx=0x7f04bc00d710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20ba54dacf48fb87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.823+0000 7f04abfff640 1 -- 172.21.15.12:0/3687510121 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc017620 con 0x55c87077e980 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.823+0000 7f04abfff640 1 -- 172.21.15.12:0/3687510121 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04bc017ca0 con 0x55c87077e980 2024-09-19T06:44:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.823+0000 7f04abfff640 1 -- 172.21.15.12:0/3687510121 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00fd60 con 0x55c87077e980 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.823+0000 7f04c9fef740 1 -- 172.21.15.12:0/3687510121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e980 msgr2=0x55c870788d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.823+0000 7f04c9fef740 1 --2- 172.21.15.12:0/3687510121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e980 0x55c870788d00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00bc20 tx=0x7f04bc00d710 comp rx=0 tx=0).stop 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.823+0000 7f04c9fef740 1 -- 172.21.15.12:0/3687510121 shutdown_connections 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.823+0000 7f04c9fef740 1 --2- 172.21.15.12:0/3687510121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c870789240 0x55c87078b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.823+0000 7f04c9fef740 1 --2- 172.21.15.12:0/3687510121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e980 0x55c870788d00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.823+0000 7f04c9fef740 1 --2- 172.21.15.12:0/3687510121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87077e060 0x55c87077e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.823+0000 7f04c9fef740 1 -- 172.21.15.12:0/3687510121 >> 172.21.15.12:0/3687510121 conn(0x55c87077a5f0 msgr2=0x55c87077a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.824+0000 7f04c9fef740 1 -- 172.21.15.12:0/3687510121 shutdown_connections 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.824+0000 7f04c9fef740 1 -- 172.21.15.12:0/3687510121 wait complete. 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.824+0000 7f04c9fef740 1 -- start start 2024-09-19T06:44:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.824+0000 7f04c9fef740 1 Processor -- start 2024-09-19T06:44:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.824+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 0x55c8707860c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.824+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c870786600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.824+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 0x55c870786b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.824+0000 7f04c9fef740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c87078be10 con 0x55c87077e980 2024-09-19T06:44:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.824+0000 7f04c9fef740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c87066bf10 con 0x55c87077e060 2024-09-19T06:44:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.824+0000 7f04c9fef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c87078bf90 con 0x55c870789240 2024-09-19T06:44:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c51b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c870786600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c9fef740 10 client.0 _ll_register_callbacks cb 0x55c87068fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c59b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 0x55c8707860c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c51b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c870786600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41750/0 (socket says 172.21.15.12:41750) 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c51b1640 1 -- 172.21.15.12:0/114309864 learned_addr learned my addr 172.21.15.12:0/114309864 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c61b3640 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 0x55c870786b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c51b1640 1 -- 172.21.15.12:0/114309864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 msgr2=0x55c870786b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c51b1640 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 0x55c870786b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c51b1640 1 -- 172.21.15.12:0/114309864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 msgr2=0x55c8707860c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c51b1640 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 0x55c8707860c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c51b1640 1 -- 172.21.15.12:0/114309864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8703f2580 con 0x55c87077e980 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c59b2640 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 0x55c8707860c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c51b1640 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c870786600 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f04b00cd100 tx=0x7f04b009b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb41b44b40438d98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04a97fa640 1 -- 172.21.15.12:0/114309864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0020040 con 0x55c87077e980 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04a97fa640 1 -- 172.21.15.12:0/114309864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f04b009b080 con 0x55c87077e980 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04c9fef740 1 -- 172.21.15.12:0/114309864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04bc017ca0 con 0x55c87077e980 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.825+0000 7f04a97fa640 1 -- 172.21.15.12:0/114309864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f04b009ffe0 con 0x55c87077e980 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04c9fef740 10 client.16776 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04c9fef740 1 -- 172.21.15.12:0/114309864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c8704bc960 con 0x55c87077e980 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04a97fa640 1 -- 172.21.15.12:0/114309864 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04bc017ca0 con 0x55c87077e980 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04a97fa640 1 -- 172.21.15.12:0/114309864 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f04b0097aa0 con 0x55c87077e980 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04c9fef740 10 client.16776 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04c9fef740 10 client.16776 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04c9fef740 20 client.16776 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04c9fef740 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c870798c90 0x55c87079b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04c9fef740 4 client.16776 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:44:58.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04c9fef740 1 -- 172.21.15.12:0/114309864 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8706f0b90 con 0x55c870798c90 2024-09-19T06:44:58.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.826+0000 7f04c59b2640 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c870798c90 0x55c87079b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.827+0000 7f04c59b2640 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c870798c90 0x55c87079b0a0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c424b9b1fda71d23 server_cookie=f10d8fa61e714161 in_seq=0 out_seq=0 2024-09-19T06:44:58.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.827+0000 7f04a97fa640 10 client.16776 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.827+0000 7f04a97fa640 1 -- 172.21.15.12:0/114309864 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8706f0b90 con 0x55c870798c90 2024-09-19T06:44:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.827+0000 7f04a97fa640 10 client.16776 handle_command_reply: tid=0 2024-09-19T06:44:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.827+0000 7f04c9fef740 1 client.16776 shutdown 2024-09-19T06:44:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.827+0000 7f04c9fef740 1 -- 172.21.15.12:0/114309864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 msgr2=0x55c870786600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.827+0000 7f04c9fef740 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c870786600 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f04b00cd100 tx=0x7f04b009b6c0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.828+0000 7f04c9fef740 1 -- 172.21.15.12:0/114309864 shutdown_connections 2024-09-19T06:44:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.828+0000 7f04c9fef740 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c870798c90 0x55c87079b0a0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.828+0000 7f04c9fef740 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 0x55c870786b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.828+0000 7f04c9fef740 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c870786600 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.828+0000 7f04c9fef740 1 --2- 172.21.15.12:0/114309864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 0x55c8707860c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.828+0000 7f04a97fa640 0 client.16776 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.828+0000 7f04c9fef740 1 -- 172.21.15.12:0/114309864 >> 172.21.15.12:0/114309864 conn(0x55c87077a5f0 msgr2=0x55c8707802d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.828+0000 7f04c9fef740 1 -- 172.21.15.12:0/114309864 shutdown_connections 2024-09-19T06:44:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.828+0000 7f04c9fef740 1 -- 172.21.15.12:0/114309864 wait complete. 2024-09-19T06:44:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.828+0000 7f04c9fef740 20 client.16776 trim_cache size 0 max 16384 2024-09-19T06:44:58.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c9fef740 1 Processor -- start 2024-09-19T06:44:58.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c9fef740 1 -- start start 2024-09-19T06:44:58.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 0x55c8707a0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c8707a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 0x55c870783320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c9fef740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01afc90 con 0x55c87077e980 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c9fef740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01b1800 con 0x55c87077e060 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c9fef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01b0360 con 0x55c870789240 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c51b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c8707a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c51b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c8707a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41764/0 (socket says 172.21.15.12:41764) 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c51b1640 1 -- 172.21.15.12:0/1707080372 learned_addr learned my addr 172.21.15.12:0/1707080372 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c59b2640 1 --2- 172.21.15.12:0/1707080372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 0x55c8707a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c61b3640 1 --2- 172.21.15.12:0/1707080372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 0x55c870783320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c51b1640 1 -- 172.21.15.12:0/1707080372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 msgr2=0x55c870783320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c51b1640 1 --2- 172.21.15.12:0/1707080372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 0x55c870783320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c51b1640 1 -- 172.21.15.12:0/1707080372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 msgr2=0x55c8707a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c51b1640 1 --2- 172.21.15.12:0/1707080372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 0x55c8707a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c51b1640 1 -- 172.21.15.12:0/1707080372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c87077a420 con 0x55c87077e980 2024-09-19T06:44:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.845+0000 7f04c61b3640 1 --2- 172.21.15.12:0/1707080372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 0x55c870783320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:44:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04c51b1640 1 --2- 172.21.15.12:0/1707080372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c8707a0eb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f04b0086010 tx=0x7f04b009bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c469ad74dcbdec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04ab7fe640 1 -- 172.21.15.12:0/1707080372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0020070 con 0x55c87077e980 2024-09-19T06:44:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04ab7fe640 1 -- 172.21.15.12:0/1707080372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04b0097980 con 0x55c87077e980 2024-09-19T06:44:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04ab7fe640 1 -- 172.21.15.12:0/1707080372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b009b2e0 con 0x55c87077e980 2024-09-19T06:44:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04c9fef740 1 -- 172.21.15.12:0/1707080372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 msgr2=0x55c8707a0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04c9fef740 1 --2- 172.21.15.12:0/1707080372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c8707a0eb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f04b0086010 tx=0x7f04b009bdb0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04c9fef740 1 -- 172.21.15.12:0/1707080372 shutdown_connections 2024-09-19T06:44:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04c9fef740 1 --2- 172.21.15.12:0/1707080372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c870789240 0x55c870783320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04c9fef740 1 --2- 172.21.15.12:0/1707080372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c8707a0eb0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04c9fef740 1 --2- 172.21.15.12:0/1707080372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c87077e060 0x55c8707a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04c9fef740 1 -- 172.21.15.12:0/1707080372 >> 172.21.15.12:0/1707080372 conn(0x55c87077a5f0 msgr2=0x55c870784990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04c9fef740 1 -- 172.21.15.12:0/1707080372 shutdown_connections 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.846+0000 7f04c9fef740 1 -- 172.21.15.12:0/1707080372 wait complete. 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.847+0000 7f04c9fef740 1 -- start start 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.847+0000 7f04c9fef740 1 Processor -- start 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.847+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87077e060 0x55c87078d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.847+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c87078dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.847+0000 7f04c9fef740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c870789240 0x55c870802940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.847+0000 7f04c9fef740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01b1130 con 0x55c87077e980 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.847+0000 7f04c9fef740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01b0a30 con 0x55c870789240 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.847+0000 7f04c9fef740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01adc70 con 0x55c87077e060 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.847+0000 7f04c9fef740 10 client.0 _ll_register_callbacks cb 0x7f04b009b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c51b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c87078dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c51b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c87078dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41770/0 (socket says 172.21.15.12:41770) 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c51b1640 1 -- 172.21.15.12:0/2070700905 learned_addr learned my addr 172.21.15.12:0/2070700905 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c59b2640 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87077e060 0x55c87078d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c61b3640 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c870789240 0x55c870802940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c51b1640 1 -- 172.21.15.12:0/2070700905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87077e060 msgr2=0x55c87078d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c51b1640 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87077e060 0x55c87078d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c51b1640 1 -- 172.21.15.12:0/2070700905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c870789240 msgr2=0x55c870802940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c51b1640 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c870789240 0x55c870802940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c51b1640 1 -- 172.21.15.12:0/2070700905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c870802e80 con 0x55c87077e980 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c51b1640 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c87078dc10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f04b0099ee0 tx=0x7f04b009ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b447f6bef027d6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04a97fa640 1 -- 172.21.15.12:0/2070700905 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0020070 con 0x55c87077e980 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04a97fa640 1 -- 172.21.15.12:0/2070700905 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f04b009b280 con 0x55c87077e980 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c9fef740 1 -- 172.21.15.12:0/2070700905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04b0097980 con 0x55c87077e980 2024-09-19T06:44:58.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04a97fa640 1 -- 172.21.15.12:0/2070700905 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f04b009aea0 con 0x55c87077e980 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c9fef740 10 client.16782 fetch_fsmap learned FSMap version 35 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.848+0000 7f04c9fef740 1 -- 172.21.15.12:0/2070700905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c870802e80 con 0x55c87077e980 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.849+0000 7f04a97fa640 1 -- 172.21.15.12:0/2070700905 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04b0097980 con 0x55c87077e980 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.849+0000 7f04a97fa640 1 -- 172.21.15.12:0/2070700905 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f04b00a1170 con 0x55c87077e980 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.849+0000 7f04c9fef740 10 client.16782 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.849+0000 7f04c9fef740 10 client.16782 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.849+0000 7f04c9fef740 20 client.16782 populate_metadata read hostname 'smithi012' 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.849+0000 7f04c9fef740 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c870804400 0x55c870806820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.849+0000 7f04c9fef740 4 client.16782 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "68f2f376", "release": true, "await": true}] 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.849+0000 7f04c9fef740 1 -- 172.21.15.12:0/2070700905 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "68f2f376", "release": true, "await": true}) -- 0x55c8706eb0a0 con 0x55c870804400 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.849+0000 7f04c59b2640 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c870804400 0x55c870806820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.850+0000 7f04c59b2640 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c870804400 0x55c870806820 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc13768b734d08a5 server_cookie=eac295006e821696 in_seq=0 out_seq=0 2024-09-19T06:44:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.850+0000 7f04a97fa640 10 client.16782 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:58.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04a97fa640 1 -- 172.21.15.12:0/2070700905 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c8706eb0a0 con 0x55c870804400 2024-09-19T06:44:58.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04a97fa640 10 client.16782 handle_command_reply: tid=0 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04c9fef740 1 client.16782 shutdown 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04c9fef740 1 -- 172.21.15.12:0/2070700905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 msgr2=0x55c87078dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04c9fef740 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c87078dc10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f04b0099ee0 tx=0x7f04b009ba00 comp rx=0 tx=0).stop 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04c9fef740 1 -- 172.21.15.12:0/2070700905 shutdown_connections 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04c9fef740 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c870804400 0x55c870806820 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04c9fef740 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c870789240 0x55c870802940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04c9fef740 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c87077e980 0x55c87078dc10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04a97fa640 0 client.16782 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04c9fef740 1 --2- 172.21.15.12:0/2070700905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c87077e060 0x55c87078d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.894+0000 7f04c9fef740 1 -- 172.21.15.12:0/2070700905 >> 172.21.15.12:0/2070700905 conn(0x55c87077a5f0 msgr2=0x55c87077fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.895+0000 7f04c9fef740 1 -- 172.21.15.12:0/2070700905 shutdown_connections 2024-09-19T06:44:58.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.895+0000 7f04c9fef740 1 -- 172.21.15.12:0/2070700905 wait complete. 2024-09-19T06:44:58.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.895+0000 7f04c9fef740 20 client.16782 trim_cache size 0 max 16384 2024-09-19T06:44:58.898 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:44:58.898 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 35, 2024-09-19T06:44:58.898 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:44:58.898 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 20, 2024-09-19T06:44:58.898 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:44:58.898 INFO:teuthology.orchestra.run.smithi012.stdout: "68f2f376": { 2024-09-19T06:44:58.898 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 20, 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 149.8, 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:44:58.899 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:44:58.900 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:44:58.900 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:44:58.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:58.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:58.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:58.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:58.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:44:58.900 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:44:58.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 -- 172.21.15.12:0/4145492816 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04ac0a33b0 msgr2=0x7f04ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04ac0a33b0 0x7f04ac0a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009a60 tx=0x7f04b80095c0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 -- 172.21.15.12:0/4145492816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c0103660 msgr2=0x7f04c0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c0103660 0x7f04c0100ee0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f04b000d740 tx=0x7f04b000dc00 comp rx=0 tx=0).stop 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 -- 172.21.15.12:0/4145492816 shutdown_connections 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04c010c170 0x7f04c0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04c0103660 0x7f04c0100ee0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f04ac0a33b0 0x7f04ac0a5870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 --2- 172.21.15.12:0/4145492816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04c0102d40 0x7f04c01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 -- 172.21.15.12:0/4145492816 >> 172.21.15.12:0/4145492816 conn(0x7f04c00fc7a0 msgr2=0x7f04c00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 -- 172.21.15.12:0/4145492816 shutdown_connections 2024-09-19T06:44:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:44:58.897+0000 7f04c7c16640 1 -- 172.21.15.12:0/4145492816 wait complete. 2024-09-19T06:44:59.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:44:59.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:44:59 smithi012 ceph-mon[30937]: pgmap v148: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 MiB/s wr, 141 op/s 2024-09-19T06:44:59.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:44:59 smithi016 ceph-mon[34911]: pgmap v148: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 MiB/s wr, 141 op/s 2024-09-19T06:44:59.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:44:59 smithi173 ceph-mon[35349]: pgmap v148: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 MiB/s wr, 141 op/s 2024-09-19T06:44:59.914 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '68f2f376', total seconds elapsed: 33.4 2024-09-19T06:44:59.914 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T06:44:59.914 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:45:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.721+0000 7f05b8483640 1 -- 172.21.15.12:0/3237773447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b0106f00 msgr2=0x7f05b010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.721+0000 7f05b8483640 1 --2- 172.21.15.12:0/3237773447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b0106f00 0x7f05b010ea80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f05a8007290 tx=0x7f05a8032ce0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.722+0000 7f05b8483640 1 -- 172.21.15.12:0/3237773447 shutdown_connections 2024-09-19T06:45:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.722+0000 7f05b8483640 1 --2- 172.21.15.12:0/3237773447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b0106f00 0x7f05b010ea80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.722+0000 7f05b8483640 1 --2- 172.21.15.12:0/3237773447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102780 0x7f05b01067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.722+0000 7f05b8483640 1 --2- 172.21.15.12:0/3237773447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b0101dd0 0x7f05b01021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.722+0000 7f05b8483640 1 -- 172.21.15.12:0/3237773447 >> 172.21.15.12:0/3237773447 conn(0x7f05b00fd8b0 msgr2=0x7f05b00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.722+0000 7f05b8483640 1 -- 172.21.15.12:0/3237773447 shutdown_connections 2024-09-19T06:45:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.722+0000 7f05b8483640 1 -- 172.21.15.12:0/3237773447 wait complete. 2024-09-19T06:45:00.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.723+0000 7f05b8483640 1 Processor -- start 2024-09-19T06:45:00.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.723+0000 7f05b8483640 1 -- start start 2024-09-19T06:45:00.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.723+0000 7f05b8483640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b0101dd0 0x7f05b01961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.723+0000 7f05b8483640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102780 0x7f05b0196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.723+0000 7f05b8483640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b0106f00 0x7f05b019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b8483640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010fcf0 con 0x7f05b0106f00 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b6a20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b0106f00 0x7f05b019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b621f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b0101dd0 0x7f05b01961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b6a20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b0106f00 0x7f05b019aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49546/0 (socket says 172.21.15.12:49546) 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b6a20640 1 -- 172.21.15.12:0/603182010 learned_addr learned my addr 172.21.15.12:0/603182010 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b8483640 1 -- 172.21.15.12:0/603182010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010fb70 con 0x7f05b0101dd0 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b8483640 1 -- 172.21.15.12:0/603182010 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010fe70 con 0x7f05b0102780 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102780 0x7f05b0196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b6a20640 1 -- 172.21.15.12:0/603182010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102780 msgr2=0x7f05b0196710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b6a20640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102780 0x7f05b0196710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b6a20640 1 -- 172.21.15.12:0/603182010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b0101dd0 msgr2=0x7f05b01961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b6a20640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b0101dd0 0x7f05b01961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b6a20640 1 -- 172.21.15.12:0/603182010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b019b180 con 0x7f05b0106f00 2024-09-19T06:45:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.724+0000 7f05b6a20640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b0106f00 0x7f05b019aaa0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f05a8006010 tx=0x7f05a800b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.725+0000 7f05a77fe640 1 -- 172.21.15.12:0/603182010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a8049020 con 0x7f05b0106f00 2024-09-19T06:45:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.725+0000 7f05b8483640 1 -- 172.21.15.12:0/603182010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b019b410 con 0x7f05b0106f00 2024-09-19T06:45:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.725+0000 7f05a77fe640 1 -- 172.21.15.12:0/603182010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05a8003e50 con 0x7f05b0106f00 2024-09-19T06:45:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.725+0000 7f05a77fe640 1 -- 172.21.15.12:0/603182010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a8034e60 con 0x7f05b0106f00 2024-09-19T06:45:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.725+0000 7f05b8483640 1 -- 172.21.15.12:0/603182010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b01a2d50 con 0x7f05b0106f00 2024-09-19T06:45:00.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.728+0000 7f05a77fe640 1 -- 172.21.15.12:0/603182010 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f05a804c020 con 0x7f05b0106f00 2024-09-19T06:45:00.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05ba85c740 1 Processor -- start 2024-09-19T06:45:00.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05ba85c740 1 -- start start 2024-09-19T06:45:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1ce4a0 0x55746d1ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1cedc0 0x55746d1d9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1d9680 0x55746d1dba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05a77fe640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f059c0a3430 0x7f059c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05ba85c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55746d1342e0 con 0x55746d1ce4a0 2024-09-19T06:45:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05ba85c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55746d0dbce0 con 0x55746d1d9680 2024-09-19T06:45:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05ba85c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55746d1302a0 con 0x55746d1cedc0 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05b5a1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1ce4a0 0x55746d1ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05a77fe640 1 -- 172.21.15.12:0/603182010 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f05a80f8cd0 con 0x7f05b0106f00 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05b5a1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1ce4a0 0x55746d1ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49548/0 (socket says 172.21.15.12:49548) 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.729+0000 7f05b5a1e640 1 -- 172.21.15.12:0/2836222601 learned_addr learned my addr 172.21.15.12:0/2836222601 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.730+0000 7f05b621f640 1 --2- 172.21.15.12:0/2836222601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1cedc0 0x55746d1d9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.730+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/2836222601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1d9680 0x55746d1dba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.730+0000 7f05b621f640 1 -- 172.21.15.12:0/2836222601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1d9680 msgr2=0x55746d1dba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.730+0000 7f05b6a20640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f059c0a3430 0x7f059c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.730+0000 7f05b621f640 1 --2- 172.21.15.12:0/2836222601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1d9680 0x55746d1dba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.730+0000 7f05b621f640 1 -- 172.21.15.12:0/2836222601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1ce4a0 msgr2=0x55746d1ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.730+0000 7f05b621f640 1 --2- 172.21.15.12:0/2836222601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1ce4a0 0x55746d1ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.730+0000 7f05b621f640 1 -- 172.21.15.12:0/2836222601 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746d0c0440 con 0x55746d1cedc0 2024-09-19T06:45:00.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.730+0000 7f05b621f640 1 --2- 172.21.15.12:0/2836222601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1cedc0 0x55746d1d9140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009c20 tx=0x7f05ac011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a60cec3c9cb845f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:00.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.730+0000 7f05a4ff9640 1 -- 172.21.15.12:0/2836222601 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac01e070 con 0x55746d1cedc0 2024-09-19T06:45:00.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.731+0000 7f05b6a20640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f059c0a3430 0x7f059c0a58f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f05a80c4d40 tx=0x7f05a803b9b0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:00.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.731+0000 7f05a4ff9640 1 -- 172.21.15.12:0/2836222601 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05ac009dd0 con 0x55746d1cedc0 2024-09-19T06:45:00.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.731+0000 7f05a4ff9640 1 -- 172.21.15.12:0/2836222601 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac019670 con 0x55746d1cedc0 2024-09-19T06:45:00.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.731+0000 7f05ba85c740 1 -- 172.21.15.12:0/2836222601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1cedc0 msgr2=0x55746d1d9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.731+0000 7f05ba85c740 1 --2- 172.21.15.12:0/2836222601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1cedc0 0x55746d1d9140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009c20 tx=0x7f05ac011810 comp rx=0 tx=0).stop 2024-09-19T06:45:00.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.731+0000 7f05ba85c740 1 -- 172.21.15.12:0/2836222601 shutdown_connections 2024-09-19T06:45:00.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.731+0000 7f05ba85c740 1 --2- 172.21.15.12:0/2836222601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1d9680 0x55746d1dba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.731+0000 7f05ba85c740 1 --2- 172.21.15.12:0/2836222601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1cedc0 0x55746d1d9140 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.731+0000 7f05ba85c740 1 --2- 172.21.15.12:0/2836222601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1ce4a0 0x55746d1ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.731+0000 7f05ba85c740 1 -- 172.21.15.12:0/2836222601 >> 172.21.15.12:0/2836222601 conn(0x55746d1caa30 msgr2=0x55746d1cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:00.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.732+0000 7f05ba85c740 1 -- 172.21.15.12:0/2836222601 shutdown_connections 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.732+0000 7f05ba85c740 1 -- 172.21.15.12:0/2836222601 wait complete. 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.732+0000 7f05ba85c740 1 -- start start 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.732+0000 7f05ba85c740 1 Processor -- start 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1d8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1d67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05ba85c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55746d1dc250 con 0x55746d1d9680 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05ba85c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55746d0ef050 con 0x55746d1cedc0 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05ba85c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55746d1dc3d0 con 0x55746d1ce4a0 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05ba85c740 10 client.0 _ll_register_callbacks cb 0x55746d12f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05b621f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05b5a1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1d67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05b5a1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1d67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49550/0 (socket says 172.21.15.12:49550) 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05b621f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47900/0 (socket says 172.21.15.12:47900) 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05b621f640 1 -- 172.21.15.12:0/1480447209 learned_addr learned my addr 172.21.15.12:0/1480447209 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.733+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1d8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f05b5a1e640 1 -- 172.21.15.12:0/1480447209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 msgr2=0x55746d1d6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f05b5a1e640 1 -- 172.21.15.12:0/1480447209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 msgr2=0x55746d1d67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1d67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f05b5a1e640 1 -- 172.21.15.12:0/1480447209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55746cea53c0 con 0x55746d1ce4a0 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f05b621f640 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1d8fd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f05a0012ac0 tx=0x7f05a000b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1b5fed300046578 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f0599ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f0599ffb640 1 -- 172.21.15.12:0/1480447209 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0004260 con 0x55746d1ce4a0 2024-09-19T06:45:00.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f0599ffb640 1 -- 172.21.15.12:0/1480447209 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f05a0004400 con 0x55746d1ce4a0 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f05ba85c740 1 -- 172.21.15.12:0/1480447209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05ac009dd0 con 0x55746d1ce4a0 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f0599ffb640 1 -- 172.21.15.12:0/1480447209 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f05a000b8e0 con 0x55746d1ce4a0 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f05ba85c740 10 client.26314 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.734+0000 7f05ba85c740 1 -- 172.21.15.12:0/1480447209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55746d1e7c20 con 0x55746d1ce4a0 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.735+0000 7f0599ffb640 1 -- 172.21.15.12:0/1480447209 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05ac009dd0 con 0x55746d1ce4a0 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.735+0000 7f0599ffb640 1 -- 172.21.15.12:0/1480447209 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f05a0027070 con 0x55746d1ce4a0 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.735+0000 7f05ba85c740 10 client.26314 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.735+0000 7f05ba85c740 10 client.26314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.735+0000 7f05ba85c740 20 client.26314 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.735+0000 7f05ba85c740 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55746d1e9030 0x55746d1eb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.735+0000 7f05ba85c740 4 client.26314 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.735+0000 7f05ba85c740 1 -- 172.21.15.12:0/1480447209 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55746d141850 con 0x55746d1e9030 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.735+0000 7f05b621f640 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55746d1e9030 0x55746d1eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.736+0000 7f0599ffb640 10 client.26314 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:00.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.736+0000 7f05b621f640 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55746d1e9030 0x55746d1eb420 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3a506433feacd6a server_cookie=f3bd2908c0b143c1 in_seq=0 out_seq=0 2024-09-19T06:45:00.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f0599ffb640 1 -- 172.21.15.12:0/1480447209 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55746d141850 con 0x55746d1e9030 2024-09-19T06:45:00.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f0599ffb640 10 client.26314 handle_command_reply: tid=0 2024-09-19T06:45:00.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 client.26314 shutdown 2024-09-19T06:45:00.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 -- 172.21.15.12:0/1480447209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 msgr2=0x55746d1d8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1d8fd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f05a0012ac0 tx=0x7f05a000b790 comp rx=0 tx=0).stop 2024-09-19T06:45:00.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 -- 172.21.15.12:0/1480447209 shutdown_connections 2024-09-19T06:45:00.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55746d1e9030 0x55746d1eb420 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1d67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 --2- 172.21.15.12:0/1480447209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1d8fd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 -- 172.21.15.12:0/1480447209 >> 172.21.15.12:0/1480447209 conn(0x55746d1caa30 msgr2=0x55746d1c9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:00.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f0599ffb640 0 client.26314 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:00.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 -- 172.21.15.12:0/1480447209 shutdown_connections 2024-09-19T06:45:00.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 1 -- 172.21.15.12:0/1480447209 wait complete. 2024-09-19T06:45:00.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.737+0000 7f05ba85c740 20 client.26314 trim_cache size 0 max 16384 2024-09-19T06:45:00.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05ba85c740 1 Processor -- start 2024-09-19T06:45:00.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05ba85c740 1 -- start start 2024-09-19T06:45:00.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05ba85c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05b01ab8a0 con 0x55746d1d9680 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05ba85c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f05b01ad410 con 0x55746d1cedc0 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05ba85c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f05b01abf70 con 0x55746d1ce4a0 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05b5a1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05b621f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05b5a1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1f0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49558/0 (socket says 172.21.15.12:49558) 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05b621f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47902/0 (socket says 172.21.15.12:47902) 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05b5a1e640 1 -- 172.21.15.12:0/1655083224 learned_addr learned my addr 172.21.15.12:0/1655083224 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:00.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.760+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/1655083224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.761+0000 7f05b5a1e640 1 -- 172.21.15.12:0/1655083224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 msgr2=0x55746d1e54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.761+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/1655083224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1e54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.761+0000 7f05b5a1e640 1 -- 172.21.15.12:0/1655083224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 msgr2=0x55746d1d5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.761+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/1655083224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.761+0000 7f05b5a1e640 1 -- 172.21.15.12:0/1655083224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746d1d9340 con 0x55746d1d9680 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.761+0000 7f05b621f640 1 --2- 172.21.15.12:0/1655083224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.761+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/1655083224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1f0cf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f05a0003cb0 tx=0x7f05a0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85381399b43f8b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.761+0000 7f059bfff640 1 -- 172.21.15.12:0/1655083224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a002d040 con 0x55746d1d9680 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.761+0000 7f059bfff640 1 -- 172.21.15.12:0/1655083224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05a00044c0 con 0x55746d1d9680 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.761+0000 7f059bfff640 1 -- 172.21.15.12:0/1655083224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0004920 con 0x55746d1d9680 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 -- 172.21.15.12:0/1655083224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 msgr2=0x55746d1f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 --2- 172.21.15.12:0/1655083224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1f0cf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f05a0003cb0 tx=0x7f05a0001e70 comp rx=0 tx=0).stop 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 -- 172.21.15.12:0/1655083224 shutdown_connections 2024-09-19T06:45:00.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 --2- 172.21.15.12:0/1655083224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d1f0cf0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 --2- 172.21.15.12:0/1655083224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1d5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 --2- 172.21.15.12:0/1655083224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1e54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 -- 172.21.15.12:0/1655083224 >> 172.21.15.12:0/1655083224 conn(0x55746d1caa30 msgr2=0x55746d1cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 -- 172.21.15.12:0/1655083224 shutdown_connections 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 -- 172.21.15.12:0/1655083224 wait complete. 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 -- start start 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.762+0000 7f05ba85c740 1 Processor -- start 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1dea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1def70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05ba85c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d251cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05ba85c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05b01acd40 con 0x55746d1d9680 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05ba85c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f05b01ac640 con 0x55746d1cedc0 2024-09-19T06:45:00.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05ba85c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f05b01a9880 con 0x55746d1ce4a0 2024-09-19T06:45:00.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05ba85c740 10 client.0 _ll_register_callbacks cb 0x7f05a000bc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:00.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05b5a1e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1dea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05b621f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05b5a1e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1dea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58500/0 (socket says 172.21.15.12:58500) 2024-09-19T06:45:00.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05b5a1e640 1 -- 172.21.15.12:0/470092131 learned_addr learned my addr 172.21.15.12:0/470092131 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:00.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05b621f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1def70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47906/0 (socket says 172.21.15.12:47906) 2024-09-19T06:45:00.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.763+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d251cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.764+0000 7f05b621f640 1 -- 172.21.15.12:0/470092131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 msgr2=0x55746d1dea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.764+0000 7f05b621f640 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1dea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.764+0000 7f05b621f640 1 -- 172.21.15.12:0/470092131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 msgr2=0x55746d251cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.764+0000 7f05b621f640 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d251cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.765+0000 7f05b621f640 1 -- 172.21.15.12:0/470092131 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55746d252200 con 0x55746d1cedc0 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.765+0000 7f05b621f640 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1def70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f05ac003c30 tx=0x7f05ac011dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c591f1fccb0783a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.765+0000 7f0599ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.765+0000 7f0599ffb640 1 -- 172.21.15.12:0/470092131 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac01e040 con 0x55746d1cedc0 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.766+0000 7f05ba85c740 1 -- 172.21.15.12:0/470092131 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55746d13bd60 con 0x55746d1cedc0 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.766+0000 7f0599ffb640 1 -- 172.21.15.12:0/470092131 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f05ac016040 con 0x55746d1cedc0 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.766+0000 7f0599ffb640 1 -- 172.21.15.12:0/470092131 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f05ac036050 con 0x55746d1cedc0 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.766+0000 7f05ba85c740 10 client.26357 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:00.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.766+0000 7f05ba85c740 1 -- 172.21.15.12:0/470092131 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55746d253420 con 0x55746d1cedc0 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.767+0000 7f0599ffb640 1 -- 172.21.15.12:0/470092131 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55746d13bd60 con 0x55746d1cedc0 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.767+0000 7f0599ffb640 1 -- 172.21.15.12:0/470092131 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f05ac031840 con 0x55746d1cedc0 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.767+0000 7f05ba85c740 10 client.26357 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.767+0000 7f05ba85c740 10 client.26357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.767+0000 7f05ba85c740 20 client.26357 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.767+0000 7f05ba85c740 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55746d2539e0 0x55746d255e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.767+0000 7f05ba85c740 4 client.26357 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.767+0000 7f05ba85c740 1 -- 172.21.15.12:0/470092131 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55746d0b8210 con 0x55746d2539e0 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.767+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55746d2539e0 0x55746d255e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f05b5a1e640 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55746d2539e0 0x55746d255e00 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cc81221b31f1031 server_cookie=f476aba3642614a8 in_seq=0 out_seq=0 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f0599ffb640 10 client.26357 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f0599ffb640 1 -- 172.21.15.12:0/470092131 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55746d0b8210 con 0x55746d2539e0 2024-09-19T06:45:00.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f0599ffb640 10 client.26357 handle_command_reply: tid=0 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f05ba85c740 1 client.26357 shutdown 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f05ba85c740 1 -- 172.21.15.12:0/470092131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 msgr2=0x55746d1def70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f05ba85c740 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1def70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f05ac003c30 tx=0x7f05ac011dc0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f05ba85c740 1 -- 172.21.15.12:0/470092131 shutdown_connections 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f05ba85c740 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55746d2539e0 0x55746d255e00 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f05ba85c740 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55746d1d9680 0x55746d251cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f0599ffb640 0 client.26357 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f05ba85c740 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55746d1cedc0 0x55746d1def70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f05ba85c740 1 --2- 172.21.15.12:0/470092131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55746d1ce4a0 0x55746d1dea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.768+0000 7f05ba85c740 1 -- 172.21.15.12:0/470092131 >> 172.21.15.12:0/470092131 conn(0x55746d1caa30 msgr2=0x55746d1cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.769+0000 7f05ba85c740 1 -- 172.21.15.12:0/470092131 shutdown_connections 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.769+0000 7f05ba85c740 1 -- 172.21.15.12:0/470092131 wait complete. 2024-09-19T06:45:00.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.769+0000 7f05ba85c740 20 client.26357 trim_cache size 0 max 16384 2024-09-19T06:45:00.774 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:45:00.774 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:45:00.774 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:45:00.774 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 -- 172.21.15.12:0/603182010 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f059c0a3430 msgr2=0x7f059c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f059c0a3430 0x7f059c0a58f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f05a80c4d40 tx=0x7f05a803b9b0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 -- 172.21.15.12:0/603182010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b0106f00 msgr2=0x7f05b019aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b0106f00 0x7f05b019aaa0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f05a8006010 tx=0x7f05a800b800 comp rx=0 tx=0).stop 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 -- 172.21.15.12:0/603182010 shutdown_connections 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05b0106f00 0x7f05b019aaa0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f059c0a3430 0x7f059c0a58f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05b0102780 0x7f05b0196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 --2- 172.21.15.12:0/603182010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b0101dd0 0x7f05b01961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 -- 172.21.15.12:0/603182010 >> 172.21.15.12:0/603182010 conn(0x7f05b00fd8b0 msgr2=0x7f05b00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:00.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 -- 172.21.15.12:0/603182010 shutdown_connections 2024-09-19T06:45:00.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:00.770+0000 7f05b8483640 1 -- 172.21.15.12:0/603182010 wait complete. 2024-09-19T06:45:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 255.0 s, 1388.6 tps, lat 422.269 ms stddev 3276.733 2024-09-19T06:45:01.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:01 smithi012 ceph-mon[30937]: pgmap v149: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.3 MiB/s wr, 175 op/s 2024-09-19T06:45:01.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:01 smithi016 ceph-mon[34911]: pgmap v149: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.3 MiB/s wr, 175 op/s 2024-09-19T06:45:01.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:01 smithi173 ceph-mon[35349]: pgmap v149: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.3 MiB/s wr, 175 op/s 2024-09-19T06:45:01.846 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:45:01.846 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:45:01.953 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:02.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.560+0000 7f9492595640 1 -- 172.21.15.12:0/2150590274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c100b20 msgr2=0x7f948c100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.560+0000 7f9492595640 1 --2- 172.21.15.12:0/2150590274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c100b20 0x7f948c100f00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f947c009860 tx=0x7f947c02a3b0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.560+0000 7f9492595640 1 -- 172.21.15.12:0/2150590274 shutdown_connections 2024-09-19T06:45:02.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.560+0000 7f9492595640 1 --2- 172.21.15.12:0/2150590274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c105f30 0x7f948c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.560+0000 7f9492595640 1 --2- 172.21.15.12:0/2150590274 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f948c101440 0x7f948c105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.560+0000 7f9492595640 1 --2- 172.21.15.12:0/2150590274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c100b20 0x7f948c100f00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.560+0000 7f9492595640 1 -- 172.21.15.12:0/2150590274 >> 172.21.15.12:0/2150590274 conn(0x7f948c0fc790 msgr2=0x7f948c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:02.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.561+0000 7f9492595640 1 -- 172.21.15.12:0/2150590274 shutdown_connections 2024-09-19T06:45:02.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.561+0000 7f9492595640 1 -- 172.21.15.12:0/2150590274 wait complete. 2024-09-19T06:45:02.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.562+0000 7f9492595640 1 Processor -- start 2024-09-19T06:45:02.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.563+0000 7f9492595640 1 -- start start 2024-09-19T06:45:02.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.563+0000 7f9492595640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c100b20 0x7f948c073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.563+0000 7f9492595640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c101440 0x7f948c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.563+0000 7f9492595640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f948c105f30 0x7f948c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.563+0000 7f9492595640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f948c118540 con 0x7f948c100b20 2024-09-19T06:45:02.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.563+0000 7f9492595640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f948c1183c0 con 0x7f948c105f30 2024-09-19T06:45:02.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.563+0000 7f9492595640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f948c1186c0 con 0x7f948c101440 2024-09-19T06:45:02.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.564+0000 7f948bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c100b20 0x7f948c073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.564+0000 7f948bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c100b20 0x7f948c073a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49584/0 (socket says 172.21.15.12:49584) 2024-09-19T06:45:02.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.564+0000 7f948bfff640 1 -- 172.21.15.12:0/1253306350 learned_addr learned my addr 172.21.15.12:0/1253306350 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:02.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.564+0000 7f948b7fe640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c101440 0x7f948c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.564+0000 7f948bfff640 1 -- 172.21.15.12:0/1253306350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c101440 msgr2=0x7f948c06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.564+0000 7f948bfff640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c101440 0x7f948c06cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.564+0000 7f948bfff640 1 -- 172.21.15.12:0/1253306350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f948c105f30 msgr2=0x7f948c06cff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:45:02.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.564+0000 7f948bfff640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f948c105f30 0x7f948c06cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.564+0000 7f948bfff640 1 -- 172.21.15.12:0/1253306350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c06d5e0 con 0x7f948c100b20 2024-09-19T06:45:02.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.565+0000 7f948bfff640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c100b20 0x7f948c073a20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f947c035040 tx=0x7f947c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:02.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.565+0000 7f94897fa640 1 -- 172.21.15.12:0/1253306350 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c03f020 con 0x7f948c100b20 2024-09-19T06:45:02.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.565+0000 7f9492595640 1 -- 172.21.15.12:0/1253306350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948c06d870 con 0x7f948c100b20 2024-09-19T06:45:02.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.565+0000 7f9492595640 1 -- 172.21.15.12:0/1253306350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948c071780 con 0x7f948c100b20 2024-09-19T06:45:02.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.565+0000 7f94897fa640 1 -- 172.21.15.12:0/1253306350 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947c033e50 con 0x7f948c100b20 2024-09-19T06:45:02.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.565+0000 7f94897fa640 1 -- 172.21.15.12:0/1253306350 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c037040 con 0x7f948c100b20 2024-09-19T06:45:02.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.568+0000 7f9492595640 1 -- 172.21.15.12:0/1253306350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9478005290 con 0x7f948c100b20 2024-09-19T06:45:02.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.571+0000 7f94897fa640 1 -- 172.21.15.12:0/1253306350 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f947c042020 con 0x7f948c100b20 2024-09-19T06:45:02.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.572+0000 7f94897fa640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94740a3500 0x7f94740a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.573+0000 7f94897fa640 1 -- 172.21.15.12:0/1253306350 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f947c0efa50 con 0x7f948c100b20 2024-09-19T06:45:02.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.573+0000 7f948b7fe640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94740a3500 0x7f94740a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.574+0000 7f948b7fe640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94740a3500 0x7f94740a59c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f948c06e270 tx=0x7f948000a560 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:02.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.580+0000 7f94897fa640 1 -- 172.21.15.12:0/1253306350 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f947c049070 con 0x7f948c100b20 2024-09-19T06:45:02.625 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:02.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.985+0000 7f9492595640 1 -- 172.21.15.12:0/1253306350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9478005580 con 0x7f948c100b20 2024-09-19T06:45:02.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.986+0000 7f94897fa640 1 -- 172.21.15.12:0/1253306350 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11972 (secure 0 0 0) 0x7f947c0bc5c0 con 0x7f948c100b20 2024-09-19T06:45:02.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:45:02.988 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"btime":"2024-09-19T06:44:20:228405+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:44:19.565004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:45:02.988 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 35 2024-09-19T06:45:02.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.989+0000 7f9492595640 1 -- 172.21.15.12:0/1253306350 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94740a3500 msgr2=0x7f94740a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.989+0000 7f9492595640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94740a3500 0x7f94740a59c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f948c06e270 tx=0x7f948000a560 comp rx=0 tx=0).stop 2024-09-19T06:45:02.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.989+0000 7f9492595640 1 -- 172.21.15.12:0/1253306350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c100b20 msgr2=0x7f948c073a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.989+0000 7f9492595640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c100b20 0x7f948c073a20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f947c035040 tx=0x7f947c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.989+0000 7f9492595640 1 -- 172.21.15.12:0/1253306350 shutdown_connections 2024-09-19T06:45:02.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.989+0000 7f9492595640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f948c105f30 0x7f948c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.990+0000 7f9492595640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f94740a3500 0x7f94740a59c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.990+0000 7f9492595640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f948c101440 0x7f948c06cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.990+0000 7f9492595640 1 --2- 172.21.15.12:0/1253306350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f948c100b20 0x7f948c073a20 secure :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f947c035040 tx=0x7f947c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.990+0000 7f9492595640 1 -- 172.21.15.12:0/1253306350 >> 172.21.15.12:0/1253306350 conn(0x7f948c0fc790 msgr2=0x7f948c10f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:02.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.990+0000 7f9492595640 1 -- 172.21.15.12:0/1253306350 shutdown_connections 2024-09-19T06:45:02.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:02.990+0000 7f9492595640 1 -- 172.21.15.12:0/1253306350 wait complete. 2024-09-19T06:45:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.206+0000 7f8df0f11640 1 -- 172.21.15.12:0/3509615033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dec100860 msgr2=0x7f8dec1045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.206+0000 7f8df0f11640 1 --2- 172.21.15.12:0/3509615033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dec100860 0x7f8dec1045a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009be0 tx=0x7f8de402a6c0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.207+0000 7f8df0f11640 1 -- 172.21.15.12:0/3509615033 shutdown_connections 2024-09-19T06:45:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.207+0000 7f8df0f11640 1 --2- 172.21.15.12:0/3509615033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dec100860 0x7f8dec1045a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.207+0000 7f8df0f11640 1 --2- 172.21.15.12:0/3509615033 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8dec107440 0x7f8dec100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.207+0000 7f8df0f11640 1 --2- 172.21.15.12:0/3509615033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8dec106a90 0x7f8dec106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.207+0000 7f8df0f11640 1 -- 172.21.15.12:0/3509615033 >> 172.21.15.12:0/3509615033 conn(0x7f8dec077230 msgr2=0x7f8dec0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.207+0000 7f8df0f11640 1 -- 172.21.15.12:0/3509615033 shutdown_connections 2024-09-19T06:45:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.207+0000 7f8df0f11640 1 -- 172.21.15.12:0/3509615033 wait complete. 2024-09-19T06:45:03.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.208+0000 7f8df0f11640 1 Processor -- start 2024-09-19T06:45:03.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.208+0000 7f8df0f11640 1 -- start start 2024-09-19T06:45:03.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.208+0000 7f8df0f11640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8dec100860 0x7f8dec1a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.208+0000 7f8df0f11640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dec106a90 0x7f8dec1a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.208+0000 7f8df0f11640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8dec19e7e0 0x7f8dec19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8dea59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8dec100860 0x7f8dec1a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8dea59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8dec100860 0x7f8dec1a4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49614/0 (socket says 172.21.15.12:49614) 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8dea59c640 1 -- 172.21.15.12:0/1601281063 learned_addr learned my addr 172.21.15.12:0/1601281063 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec118590 con 0x7f8dec100860 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec118410 con 0x7f8dec106a90 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec118710 con 0x7f8dec19e7e0 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8dead9d640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8dec19e7e0 0x7f8dec19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8de3fff640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dec106a90 0x7f8dec1a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8de3fff640 1 -- 172.21.15.12:0/1601281063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8dec19e7e0 msgr2=0x7f8dec19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8de3fff640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8dec19e7e0 0x7f8dec19ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8de3fff640 1 -- 172.21.15.12:0/1601281063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8dec100860 msgr2=0x7f8dec1a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8de3fff640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8dec100860 0x7f8dec1a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.209+0000 7f8de3fff640 1 -- 172.21.15.12:0/1601281063 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec19f3c0 con 0x7f8dec106a90 2024-09-19T06:45:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.210+0000 7f8de3fff640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dec106a90 0x7f8dec1a4ba0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400e9c0 tx=0x7f8dd400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.210+0000 7f8de37fe640 1 -- 172.21.15.12:0/1601281063 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd400cd80 con 0x7f8dec106a90 2024-09-19T06:45:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.210+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dec19f650 con 0x7f8dec106a90 2024-09-19T06:45:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.210+0000 7f8de37fe640 1 -- 172.21.15.12:0/1601281063 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dd40035f0 con 0x7f8dec106a90 2024-09-19T06:45:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.212+0000 7f8de37fe640 1 -- 172.21.15.12:0/1601281063 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4010690 con 0x7f8dec106a90 2024-09-19T06:45:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.212+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dec107bf0 con 0x7f8dec106a90 2024-09-19T06:45:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.213+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dec101110 con 0x7f8dec106a90 2024-09-19T06:45:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.213+0000 7f8de37fe640 1 -- 172.21.15.12:0/1601281063 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8dd4004000 con 0x7f8dec106a90 2024-09-19T06:45:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.215+0000 7f8de37fe640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8dd80a3290 0x7f8dd80a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.215+0000 7f8dea59c640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8dd80a3290 0x7f8dd80a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.215+0000 7f8de37fe640 1 -- 172.21.15.12:0/1601281063 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f8dd40cf490 con 0x7f8dec106a90 2024-09-19T06:45:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.216+0000 7f8dea59c640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8dd80a3290 0x7f8dd80a5750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0058c0 tx=0x7f8ddc009260 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.219+0000 7f8de37fe640 1 -- 172.21.15.12:0/1601281063 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8dd409bf30 con 0x7f8dec106a90 2024-09-19T06:45:03.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:03 smithi012 ceph-mon[30937]: pgmap v150: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 326 KiB/s wr, 38 op/s 2024-09-19T06:45:03.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:03 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1253306350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:03.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.625+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dec19fd10 con 0x7f8dec106a90 2024-09-19T06:45:03.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:45:03.628 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"btime":"2024-09-19T06:44:20:228405+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:44:19.565004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:45:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 35 2024-09-19T06:45:03.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.626+0000 7f8de37fe640 1 -- 172.21.15.12:0/1601281063 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11972 (secure 0 0 0) 0x7f8dd409b830 con 0x7f8dec106a90 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.630+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8dd80a3290 msgr2=0x7f8dd80a5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8dd80a3290 0x7f8dd80a5750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0058c0 tx=0x7f8ddc009260 comp rx=0 tx=0).stop 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dec106a90 msgr2=0x7f8dec1a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dec106a90 0x7f8dec1a4ba0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400e9c0 tx=0x7f8dd400ee80 comp rx=0 tx=0).stop 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 shutdown_connections 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8dd80a3290 0x7f8dd80a5750 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8dec19e7e0 0x7f8dec19ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dec106a90 0x7f8dec1a4ba0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 --2- 172.21.15.12:0/1601281063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8dec100860 0x7f8dec1a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 >> 172.21.15.12:0/1601281063 conn(0x7f8dec077230 msgr2=0x7f8dec102720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:03.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 shutdown_connections 2024-09-19T06:45:03.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:03.631+0000 7f8df0f11640 1 -- 172.21.15.12:0/1601281063 wait complete. 2024-09-19T06:45:03.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:03 smithi016 ceph-mon[34911]: pgmap v150: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 326 KiB/s wr, 38 op/s 2024-09-19T06:45:03.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:03 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1253306350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:03.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:03 smithi173 ceph-mon[35349]: pgmap v150: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 326 KiB/s wr, 38 op/s 2024-09-19T06:45:03.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:03 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1253306350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:04.002 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T06:45:04.002 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T06:45:04.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:04 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1601281063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:04.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:04 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1601281063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:04.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:04 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1601281063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:05.267 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:45:05.421 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:05.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:05 smithi012 ceph-mon[30937]: pgmap v151: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.2 MiB/s wr, 88 op/s 2024-09-19T06:45:05.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:05 smithi016 ceph-mon[34911]: pgmap v151: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.2 MiB/s wr, 88 op/s 2024-09-19T06:45:05.810 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 260.0 s, 3300.1 tps, lat 30.738 ms stddev 80.876 2024-09-19T06:45:05.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:05 smithi173 ceph-mon[35349]: pgmap v151: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 1.2 MiB/s wr, 88 op/s 2024-09-19T06:45:06.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.070+0000 7efd6307f640 1 -- 172.21.15.12:0/1053111492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c1091f0 msgr2=0x7efd5c1095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.070+0000 7efd6307f640 1 --2- 172.21.15.12:0/1053111492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c1091f0 0x7efd5c1095d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7efd54009ca0 tx=0x7efd54033190 comp rx=0 tx=0).stop 2024-09-19T06:45:06.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.070+0000 7efd6307f640 1 -- 172.21.15.12:0/1053111492 shutdown_connections 2024-09-19T06:45:06.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.070+0000 7efd6307f640 1 --2- 172.21.15.12:0/1053111492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd5c114ab0 0x7efd5c116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.070+0000 7efd6307f640 1 --2- 172.21.15.12:0/1053111492 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5c109b10 0x7efd5c114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.070+0000 7efd6307f640 1 --2- 172.21.15.12:0/1053111492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c1091f0 0x7efd5c1095d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.070+0000 7efd6307f640 1 -- 172.21.15.12:0/1053111492 >> 172.21.15.12:0/1053111492 conn(0x7efd5c06e140 msgr2=0x7efd5c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.072+0000 7efd6307f640 1 -- 172.21.15.12:0/1053111492 shutdown_connections 2024-09-19T06:45:06.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.072+0000 7efd6307f640 1 -- 172.21.15.12:0/1053111492 wait complete. 2024-09-19T06:45:06.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.073+0000 7efd6307f640 1 Processor -- start 2024-09-19T06:45:06.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.074+0000 7efd6307f640 1 -- start start 2024-09-19T06:45:06.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.074+0000 7efd6307f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd5c1091f0 0x7efd5c1a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.074+0000 7efd6307f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c109b10 0x7efd5c1a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.074+0000 7efd6307f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5c114ab0 0x7efd5c19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.074+0000 7efd6307f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1185e0 con 0x7efd5c109b10 2024-09-19T06:45:06.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.074+0000 7efd6307f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c118460 con 0x7efd5c1091f0 2024-09-19T06:45:06.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.074+0000 7efd6307f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c118760 con 0x7efd5c114ab0 2024-09-19T06:45:06.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.074+0000 7efd5bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c109b10 0x7efd5c1a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.074+0000 7efd60e1b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd5c1091f0 0x7efd5c1a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd60e1b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd5c1091f0 0x7efd5c1a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47956/0 (socket says 172.21.15.12:47956) 2024-09-19T06:45:06.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd60e1b640 1 -- 172.21.15.12:0/997177248 learned_addr learned my addr 172.21.15.12:0/997177248 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:06.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd6161c640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5c114ab0 0x7efd5c19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd60e1b640 1 -- 172.21.15.12:0/997177248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5c114ab0 msgr2=0x7efd5c19e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd60e1b640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5c114ab0 0x7efd5c19e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd60e1b640 1 -- 172.21.15.12:0/997177248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c109b10 msgr2=0x7efd5c1a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd60e1b640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c109b10 0x7efd5c1a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd60e1b640 1 -- 172.21.15.12:0/997177248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c19f060 con 0x7efd5c1091f0 2024-09-19T06:45:06.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd6161c640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5c114ab0 0x7efd5c19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:06.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd5bfff640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c109b10 0x7efd5c1a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:06.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.075+0000 7efd60e1b640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd5c1091f0 0x7efd5c1a4770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efd54005e30 tx=0x7efd5403ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.076+0000 7efd59ffb640 1 -- 172.21.15.12:0/997177248 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54040040 con 0x7efd5c1091f0 2024-09-19T06:45:06.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.076+0000 7efd6307f640 1 -- 172.21.15.12:0/997177248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c19f2f0 con 0x7efd5c1091f0 2024-09-19T06:45:06.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.076+0000 7efd6307f640 1 -- 172.21.15.12:0/997177248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c1ab640 con 0x7efd5c1091f0 2024-09-19T06:45:06.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.076+0000 7efd59ffb640 1 -- 172.21.15.12:0/997177248 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd5404b070 con 0x7efd5c1091f0 2024-09-19T06:45:06.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.076+0000 7efd59ffb640 1 -- 172.21.15.12:0/997177248 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54039980 con 0x7efd5c1091f0 2024-09-19T06:45:06.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.080+0000 7efd59ffb640 1 -- 172.21.15.12:0/997177248 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7efd54039b20 con 0x7efd5c1091f0 2024-09-19T06:45:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.081+0000 7efd59ffb640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efd400a3430 0x7efd400a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.081+0000 7efd59ffb640 1 -- 172.21.15.12:0/997177248 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7efd540f9020 con 0x7efd5c1091f0 2024-09-19T06:45:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.082+0000 7efd65458740 1 Processor -- start 2024-09-19T06:45:06.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.082+0000 7efd5bfff640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efd400a3430 0x7efd400a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.083+0000 7efd5bfff640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efd400a3430 0x7efd400a58f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efd5c073300 tx=0x7efd4c00f040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.084+0000 7efd65458740 1 -- start start 2024-09-19T06:45:06.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.084+0000 7efd65458740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d07760 0x55f1b2d07b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.084+0000 7efd65458740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d12400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.084+0000 7efd60e1b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d07760 0x55f1b2d07b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.084+0000 7efd60e1b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d07760 0x55f1b2d07b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49652/0 (socket says 172.21.15.12:49652) 2024-09-19T06:45:06.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.084+0000 7efd60e1b640 1 -- 172.21.15.12:0/1397097129 learned_addr learned my addr 172.21.15.12:0/1397097129 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:06.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.084+0000 7efd65458740 1 --2- 172.21.15.12:0/1397097129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d12940 0x55f1b2d14d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.084+0000 7efd65458740 1 -- 172.21.15.12:0/1397097129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f1b2c6d2a0 con 0x55f1b2d07760 2024-09-19T06:45:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.084+0000 7efd65458740 1 -- 172.21.15.12:0/1397097129 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f1b2c14b10 con 0x55f1b2d08080 2024-09-19T06:45:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.084+0000 7efd65458740 1 -- 172.21.15.12:0/1397097129 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f1b2c69260 con 0x55f1b2d12940 2024-09-19T06:45:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.085+0000 7efd6161c640 1 --2- 172.21.15.12:0/1397097129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d12940 0x55f1b2d14d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.085+0000 7efd60e1b640 1 -- 172.21.15.12:0/1397097129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d12940 msgr2=0x55f1b2d14d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.085+0000 7efd60e1b640 1 --2- 172.21.15.12:0/1397097129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d12940 0x55f1b2d14d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.085+0000 7efd60e1b640 1 -- 172.21.15.12:0/1397097129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 msgr2=0x55f1b2d12400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:45:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.085+0000 7efd60e1b640 1 --2- 172.21.15.12:0/1397097129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d12400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.085+0000 7efd60e1b640 1 -- 172.21.15.12:0/1397097129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b29deb90 con 0x55f1b2d07760 2024-09-19T06:45:06.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.085+0000 7efd60e1b640 1 --2- 172.21.15.12:0/1397097129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d07760 0x55f1b2d07b40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7efd540c1d60 tx=0x7efd540c4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb85634f56642734 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.086+0000 7efd52ffd640 1 -- 172.21.15.12:0/1397097129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540c5390 con 0x55f1b2d07760 2024-09-19T06:45:06.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.086+0000 7efd52ffd640 1 -- 172.21.15.12:0/1397097129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd540c9740 con 0x55f1b2d07760 2024-09-19T06:45:06.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.086+0000 7efd52ffd640 1 -- 172.21.15.12:0/1397097129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540c55f0 con 0x55f1b2d07760 2024-09-19T06:45:06.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.087+0000 7efd65458740 1 -- 172.21.15.12:0/1397097129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d07760 msgr2=0x55f1b2d07b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.087+0000 7efd65458740 1 --2- 172.21.15.12:0/1397097129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d07760 0x55f1b2d07b40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7efd540c1d60 tx=0x7efd540c4f90 comp rx=0 tx=0).stop 2024-09-19T06:45:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.087+0000 7efd65458740 1 -- 172.21.15.12:0/1397097129 shutdown_connections 2024-09-19T06:45:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.087+0000 7efd65458740 1 --2- 172.21.15.12:0/1397097129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d12940 0x55f1b2d14d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.087+0000 7efd65458740 1 --2- 172.21.15.12:0/1397097129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d12400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.087+0000 7efd65458740 1 --2- 172.21.15.12:0/1397097129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d07760 0x55f1b2d07b40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.087+0000 7efd65458740 1 -- 172.21.15.12:0/1397097129 >> 172.21.15.12:0/1397097129 conn(0x55f1b2d03cf0 msgr2=0x55f1b2d040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.087+0000 7efd65458740 1 -- 172.21.15.12:0/1397097129 shutdown_connections 2024-09-19T06:45:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.088+0000 7efd65458740 1 -- 172.21.15.12:0/1397097129 wait complete. 2024-09-19T06:45:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.088+0000 7efd65458740 1 -- start start 2024-09-19T06:45:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.088+0000 7efd65458740 1 Processor -- start 2024-09-19T06:45:06.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.089+0000 7efd65458740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d0f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.089+0000 7efd65458740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d0fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.089+0000 7efd65458740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 0x55f1b2d10290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.089+0000 7efd65458740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f1b2d262e0 con 0x55f1b2d12940 2024-09-19T06:45:06.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.089+0000 7efd65458740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f1b2bf56e0 con 0x55f1b2d08080 2024-09-19T06:45:06.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.089+0000 7efd65458740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f1b2d26460 con 0x55f1b2d07760 2024-09-19T06:45:06.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.089+0000 7efd65458740 10 client.0 _ll_register_callbacks cb 0x55f1b2c19a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:06.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.089+0000 7efd5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d0fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.089+0000 7efd5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d0fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47968/0 (socket says 172.21.15.12:47968) 2024-09-19T06:45:06.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.089+0000 7efd5bfff640 1 -- 172.21.15.12:0/3191441235 learned_addr learned my addr 172.21.15.12:0/3191441235 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.090+0000 7efd60e1b640 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d0f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.090+0000 7efd6161c640 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 0x55f1b2d10290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.090+0000 7efd6161c640 1 -- 172.21.15.12:0/3191441235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 msgr2=0x55f1b2d0f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.090+0000 7efd6161c640 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d0f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.090+0000 7efd6161c640 1 -- 172.21.15.12:0/3191441235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 msgr2=0x55f1b2d0fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.090+0000 7efd6161c640 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d0fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.090+0000 7efd6161c640 1 -- 172.21.15.12:0/3191441235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b2d2f790 con 0x55f1b2d12940 2024-09-19T06:45:06.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.091+0000 7efd6161c640 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 0x55f1b2d10290 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0743f0 tx=0x7efd48011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1672b9b6b232ac94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.091+0000 7efd3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:06.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.092+0000 7efd3ffff640 1 -- 172.21.15.12:0/3191441235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4800fa30 con 0x55f1b2d12940 2024-09-19T06:45:06.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.092+0000 7efd3ffff640 1 -- 172.21.15.12:0/3191441235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7efd4800fbd0 con 0x55f1b2d12940 2024-09-19T06:45:06.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.092+0000 7efd65458740 1 -- 172.21.15.12:0/3191441235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd540c9740 con 0x55f1b2d12940 2024-09-19T06:45:06.094 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:06.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.092+0000 7efd3ffff640 1 -- 172.21.15.12:0/3191441235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efd4800fdd0 con 0x55f1b2d12940 2024-09-19T06:45:06.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.092+0000 7efd65458740 10 client.16824 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:06.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.092+0000 7efd65458740 1 -- 172.21.15.12:0/3191441235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f1b2d32190 con 0x55f1b2d12940 2024-09-19T06:45:06.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.093+0000 7efd3ffff640 1 -- 172.21.15.12:0/3191441235 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd540c9740 con 0x55f1b2d12940 2024-09-19T06:45:06.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.093+0000 7efd3ffff640 1 -- 172.21.15.12:0/3191441235 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7efd480275e0 con 0x55f1b2d12940 2024-09-19T06:45:06.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.093+0000 7efd65458740 10 client.16824 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:06.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.093+0000 7efd65458740 10 client.16824 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:45:06.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.093+0000 7efd65458740 20 client.16824 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:06.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.093+0000 7efd65458740 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f1b2d336f0 0x55f1b2d35b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.094+0000 7efd65458740 4 client.16824 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:06.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.094+0000 7efd65458740 1 -- 172.21.15.12:0/3191441235 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1b2c7a9d0 con 0x55f1b2d336f0 2024-09-19T06:45:06.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.094+0000 7efd60e1b640 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f1b2d336f0 0x55f1b2d35b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.095+0000 7efd60e1b640 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f1b2d336f0 0x55f1b2d35b40 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6875045c13472c7 server_cookie=3a8ff9ea9a823e4d in_seq=0 out_seq=0 2024-09-19T06:45:06.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.096+0000 7efd3ffff640 10 client.16824 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:06.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.096+0000 7efd3ffff640 1 -- 172.21.15.12:0/3191441235 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1b2c7a9d0 con 0x55f1b2d336f0 2024-09-19T06:45:06.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.096+0000 7efd3ffff640 10 client.16824 handle_command_reply: tid=0 2024-09-19T06:45:06.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.096+0000 7efd65458740 1 client.16824 shutdown 2024-09-19T06:45:06.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.099+0000 7efd65458740 1 -- 172.21.15.12:0/3191441235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 msgr2=0x55f1b2d10290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.099+0000 7efd65458740 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 0x55f1b2d10290 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0743f0 tx=0x7efd48011d40 comp rx=0 tx=0).stop 2024-09-19T06:45:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.099+0000 7efd65458740 1 -- 172.21.15.12:0/3191441235 shutdown_connections 2024-09-19T06:45:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.099+0000 7efd65458740 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f1b2d336f0 0x55f1b2d35b40 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.099+0000 7efd65458740 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 0x55f1b2d10290 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.099+0000 7efd65458740 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d0fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.099+0000 7efd65458740 1 --2- 172.21.15.12:0/3191441235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d0f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.099+0000 7efd65458740 1 -- 172.21.15.12:0/3191441235 >> 172.21.15.12:0/3191441235 conn(0x55f1b2d03cf0 msgr2=0x55f1b2d09a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.100+0000 7efd3ffff640 0 client.16824 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:06.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.101+0000 7efd65458740 1 -- 172.21.15.12:0/3191441235 shutdown_connections 2024-09-19T06:45:06.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.101+0000 7efd65458740 1 -- 172.21.15.12:0/3191441235 wait complete. 2024-09-19T06:45:06.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.101+0000 7efd65458740 20 client.16824 trim_cache size 0 max 16384 2024-09-19T06:45:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.133+0000 7efd65458740 1 Processor -- start 2024-09-19T06:45:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.133+0000 7efd65458740 1 -- start start 2024-09-19T06:45:06.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.134+0000 7efd65458740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d0ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.134+0000 7efd65458740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d08080 0x55f1b2d116e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.134+0000 7efd65458740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d12940 0x55f1b2d100e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.134+0000 7efd60e1b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d0ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.134+0000 7efd60e1b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d0ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58592/0 (socket says 172.21.15.12:58592) 2024-09-19T06:45:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.134+0000 7efd6161c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d12940 0x55f1b2d100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.134+0000 7efd6161c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d12940 0x55f1b2d100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47982/0 (socket says 172.21.15.12:47982) 2024-09-19T06:45:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.135+0000 7efd60e1b640 1 -- 172.21.15.12:0/273759312 learned_addr learned my addr 172.21.15.12:0/273759312 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.135+0000 7efd65458740 1 -- 172.21.15.12:0/273759312 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd4400ea40 con 0x55f1b2d08080 2024-09-19T06:45:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.135+0000 7efd65458740 1 -- 172.21.15.12:0/273759312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efd440105b0 con 0x55f1b2d12940 2024-09-19T06:45:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.135+0000 7efd65458740 1 -- 172.21.15.12:0/273759312 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd4400f110 con 0x55f1b2d07760 2024-09-19T06:45:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.135+0000 7efd5bfff640 1 --2- 172.21.15.12:0/273759312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d08080 0x55f1b2d116e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.135+0000 7efd6161c640 1 -- 172.21.15.12:0/273759312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 msgr2=0x55f1b2d0ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.135+0000 7efd6161c640 1 --2- 172.21.15.12:0/273759312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d0ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.135+0000 7efd6161c640 1 -- 172.21.15.12:0/273759312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d08080 msgr2=0x55f1b2d116e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.135+0000 7efd6161c640 1 --2- 172.21.15.12:0/273759312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d08080 0x55f1b2d116e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.135+0000 7efd6161c640 1 -- 172.21.15.12:0/273759312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b2cff260 con 0x55f1b2d12940 2024-09-19T06:45:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.136+0000 7efd6161c640 1 --2- 172.21.15.12:0/273759312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d12940 0x55f1b2d100e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efd4800f610 tx=0x7efd480090e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23be77584c212f66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.136+0000 7efd527fc640 1 -- 172.21.15.12:0/273759312 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48027bf0 con 0x55f1b2d12940 2024-09-19T06:45:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.136+0000 7efd527fc640 1 -- 172.21.15.12:0/273759312 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd48027d90 con 0x55f1b2d12940 2024-09-19T06:45:06.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.136+0000 7efd527fc640 1 -- 172.21.15.12:0/273759312 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48014d20 con 0x55f1b2d12940 2024-09-19T06:45:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.137+0000 7efd65458740 1 -- 172.21.15.12:0/273759312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d12940 msgr2=0x55f1b2d100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.137+0000 7efd65458740 1 --2- 172.21.15.12:0/273759312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d12940 0x55f1b2d100e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efd4800f610 tx=0x7efd480090e0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.137+0000 7efd65458740 1 -- 172.21.15.12:0/273759312 shutdown_connections 2024-09-19T06:45:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.137+0000 7efd65458740 1 --2- 172.21.15.12:0/273759312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d12940 0x55f1b2d100e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.137+0000 7efd65458740 1 --2- 172.21.15.12:0/273759312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d08080 0x55f1b2d116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.137+0000 7efd65458740 1 --2- 172.21.15.12:0/273759312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d0ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.137+0000 7efd65458740 1 -- 172.21.15.12:0/273759312 >> 172.21.15.12:0/273759312 conn(0x55f1b2d03cf0 msgr2=0x55f1b2d02e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.137+0000 7efd65458740 1 -- 172.21.15.12:0/273759312 shutdown_connections 2024-09-19T06:45:06.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.138+0000 7efd65458740 1 -- 172.21.15.12:0/273759312 wait complete. 2024-09-19T06:45:06.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.138+0000 7efd65458740 1 -- start start 2024-09-19T06:45:06.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.138+0000 7efd65458740 1 Processor -- start 2024-09-19T06:45:06.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.139+0000 7efd65458740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d27c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.139+0000 7efd65458740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d28140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.140+0000 7efd65458740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 0x55f1b2d9d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.140+0000 7efd65458740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd4400fee0 con 0x55f1b2d12940 2024-09-19T06:45:06.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.140+0000 7efd5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d28140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.140+0000 7efd6161c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 0x55f1b2d9d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.140+0000 7efd5bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d28140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47996/0 (socket says 172.21.15.12:47996) 2024-09-19T06:45:06.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.140+0000 7efd5bfff640 1 -- 172.21.15.12:0/2238587920 learned_addr learned my addr 172.21.15.12:0/2238587920 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:06.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.140+0000 7efd60e1b640 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d27c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.140+0000 7efd65458740 1 -- 172.21.15.12:0/2238587920 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efd4400f7e0 con 0x55f1b2d08080 2024-09-19T06:45:06.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.140+0000 7efd65458740 1 -- 172.21.15.12:0/2238587920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd4400ca20 con 0x55f1b2d07760 2024-09-19T06:45:06.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.140+0000 7efd65458740 10 client.0 _ll_register_callbacks cb 0x7efd48009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:06.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.141+0000 7efd60e1b640 1 -- 172.21.15.12:0/2238587920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 msgr2=0x55f1b2d28140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.141+0000 7efd60e1b640 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d28140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.141+0000 7efd60e1b640 1 -- 172.21.15.12:0/2238587920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 msgr2=0x55f1b2d9d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.141+0000 7efd60e1b640 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 0x55f1b2d9d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.141+0000 7efd60e1b640 1 -- 172.21.15.12:0/2238587920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b2d0a5d0 con 0x55f1b2d07760 2024-09-19T06:45:06.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.142+0000 7efd60e1b640 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d27c00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd54000f80 tx=0x7efd54033190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f81346a592bcecf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.142+0000 7efd3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:45:06.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.142+0000 7efd3ffff640 1 -- 172.21.15.12:0/2238587920 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540ce000 con 0x55f1b2d07760 2024-09-19T06:45:06.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.142+0000 7efd3ffff640 1 -- 172.21.15.12:0/2238587920 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7efd54003d30 con 0x55f1b2d07760 2024-09-19T06:45:06.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.143+0000 7efd65458740 1 -- 172.21.15.12:0/2238587920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd48027d90 con 0x55f1b2d07760 2024-09-19T06:45:06.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.143+0000 7efd3ffff640 1 -- 172.21.15.12:0/2238587920 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efd540de290 con 0x55f1b2d07760 2024-09-19T06:45:06.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.143+0000 7efd65458740 10 client.26350 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:06.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.143+0000 7efd65458740 1 -- 172.21.15.12:0/2238587920 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f1b2d9ea60 con 0x55f1b2d07760 2024-09-19T06:45:06.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.144+0000 7efd3ffff640 1 -- 172.21.15.12:0/2238587920 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd48027d90 con 0x55f1b2d07760 2024-09-19T06:45:06.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.144+0000 7efd3ffff640 1 -- 172.21.15.12:0/2238587920 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7efd54043030 con 0x55f1b2d07760 2024-09-19T06:45:06.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.144+0000 7efd65458740 10 client.26350 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:06.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.144+0000 7efd65458740 10 client.26350 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:45:06.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.144+0000 7efd65458740 20 client.26350 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:06.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.144+0000 7efd65458740 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f1b2d9ef50 0x55f1b2da1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.144+0000 7efd65458740 4 client.26350 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T06:45:06.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.144+0000 7efd65458740 1 -- 172.21.15.12:0/2238587920 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55f1b2c74d20 con 0x55f1b2d9ef50 2024-09-19T06:45:06.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.144+0000 7efd5bfff640 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f1b2d9ef50 0x55f1b2da1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.145+0000 7efd3ffff640 10 client.26350 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:06.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.145+0000 7efd5bfff640 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f1b2d9ef50 0x55f1b2da1390 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41b1b4336c9579b9 server_cookie=f3e96d61f47690a8 in_seq=0 out_seq=0 2024-09-19T06:45:06.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.320+0000 7efd3ffff640 1 -- 172.21.15.12:0/2238587920 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f1b2c74d20 con 0x55f1b2d9ef50 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.320+0000 7efd3ffff640 10 client.26350 handle_command_reply: tid=0 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 client.26350 shutdown 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 -- 172.21.15.12:0/2238587920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 msgr2=0x55f1b2d27c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d27c00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd54000f80 tx=0x7efd54033190 comp rx=0 tx=0).stop 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 -- 172.21.15.12:0/2238587920 shutdown_connections 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f1b2d9ef50 0x55f1b2da1390 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1b2d12940 0x55f1b2d9d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f1b2d08080 0x55f1b2d28140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 --2- 172.21.15.12:0/2238587920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1b2d07760 0x55f1b2d27c00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd3ffff640 0 client.26350 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 -- 172.21.15.12:0/2238587920 >> 172.21.15.12:0/2238587920 conn(0x55f1b2d03cf0 msgr2=0x55f1b2d02e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 -- 172.21.15.12:0/2238587920 shutdown_connections 2024-09-19T06:45:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 1 -- 172.21.15.12:0/2238587920 wait complete. 2024-09-19T06:45:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.321+0000 7efd65458740 20 client.26350 trim_cache size 0 max 16384 2024-09-19T06:45:06.324 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:45:06.324 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 35, 2024-09-19T06:45:06.324 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:45:06.324 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 22, 2024-09-19T06:45:06.324 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:45:06.324 INFO:teuthology.orchestra.run.smithi012.stdout: "36083eb1": { 2024-09-19T06:45:06.324 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 22, 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 149.8, 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:45:06.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:06.326 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:06.326 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:06.326 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:06.326 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:06.326 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:45:06.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 -- 172.21.15.12:0/997177248 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efd400a3430 msgr2=0x7efd400a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efd400a3430 0x7efd400a58f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efd5c073300 tx=0x7efd4c00f040 comp rx=0 tx=0).stop 2024-09-19T06:45:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 -- 172.21.15.12:0/997177248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd5c1091f0 msgr2=0x7efd5c1a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd5c1091f0 0x7efd5c1a4770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efd54005e30 tx=0x7efd5403ced0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 -- 172.21.15.12:0/997177248 shutdown_connections 2024-09-19T06:45:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7efd400a3430 0x7efd400a58f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd5c114ab0 0x7efd5c19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd5c109b10 0x7efd5c1a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 --2- 172.21.15.12:0/997177248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd5c1091f0 0x7efd5c1a4770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 -- 172.21.15.12:0/997177248 >> 172.21.15.12:0/997177248 conn(0x7efd5c06e140 msgr2=0x7efd5c070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 -- 172.21.15.12:0/997177248 shutdown_connections 2024-09-19T06:45:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.322+0000 7efd6307f640 1 -- 172.21.15.12:0/997177248 wait complete. 2024-09-19T06:45:06.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 -- 172.21.15.12:0/2692866803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f930c101de0 msgr2=0x7f930c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 --2- 172.21.15.12:0/2692866803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f930c101de0 0x7f930c1021c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009900 tx=0x7f92fc02a410 comp rx=0 tx=0).stop 2024-09-19T06:45:06.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 -- 172.21.15.12:0/2692866803 shutdown_connections 2024-09-19T06:45:06.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 --2- 172.21.15.12:0/2692866803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f930c106f10 0x7f930c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 --2- 172.21.15.12:0/2692866803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f930c102790 0x7f930c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 --2- 172.21.15.12:0/2692866803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f930c101de0 0x7f930c1021c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 -- 172.21.15.12:0/2692866803 >> 172.21.15.12:0/2692866803 conn(0x7f930c0fd8c0 msgr2=0x7f930c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 -- 172.21.15.12:0/2692866803 shutdown_connections 2024-09-19T06:45:06.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 -- 172.21.15.12:0/2692866803 wait complete. 2024-09-19T06:45:06.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 Processor -- start 2024-09-19T06:45:06.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.967+0000 7f9311e1c640 1 -- start start 2024-09-19T06:45:06.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f9311e1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f930c101de0 0x7f930c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f9311e1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f930c102790 0x7f930c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f9311e1c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f930c106f10 0x7f930c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f9311e1c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f930c111f90 con 0x7f930c101de0 2024-09-19T06:45:06.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f9311e1c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f930c111e10 con 0x7f930c102790 2024-09-19T06:45:06.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f9311e1c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f930c112110 con 0x7f930c106f10 2024-09-19T06:45:06.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f930c101de0 0x7f930c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f930c101de0 0x7f930c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49692/0 (socket says 172.21.15.12:49692) 2024-09-19T06:45:06.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f930b7fe640 1 -- 172.21.15.12:0/2093891562 learned_addr learned my addr 172.21.15.12:0/2093891562 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:06.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f930b7fe640 1 -- 172.21.15.12:0/2093891562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f930c106f10 msgr2=0x7f930c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f930b7fe640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f930c106f10 0x7f930c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f930b7fe640 1 -- 172.21.15.12:0/2093891562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f930c102790 msgr2=0x7f930c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f930b7fe640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f930c102790 0x7f930c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f930b7fe640 1 -- 172.21.15.12:0/2093891562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c19d440 con 0x7f930c101de0 2024-09-19T06:45:06.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.968+0000 7f930b7fe640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f930c101de0 0x7f930c198490 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f92fc006010 tx=0x7f92fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.969+0000 7f9308ff9640 1 -- 172.21.15.12:0/2093891562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc03f030 con 0x7f930c101de0 2024-09-19T06:45:06.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.969+0000 7f9308ff9640 1 -- 172.21.15.12:0/2093891562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92fc003ce0 con 0x7f930c101de0 2024-09-19T06:45:06.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.969+0000 7f9311e1c640 1 -- 172.21.15.12:0/2093891562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930c19d6d0 con 0x7f930c101de0 2024-09-19T06:45:06.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.969+0000 7f9308ff9640 1 -- 172.21.15.12:0/2093891562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc035070 con 0x7f930c101de0 2024-09-19T06:45:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.969+0000 7f9311e1c640 1 -- 172.21.15.12:0/2093891562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930c1a5010 con 0x7f930c101de0 2024-09-19T06:45:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f93141f5740 1 Processor -- start 2024-09-19T06:45:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f93141f5740 1 -- start start 2024-09-19T06:45:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f9308ff9640 1 -- 172.21.15.12:0/2093891562 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f92fc042030 con 0x7f930c101de0 2024-09-19T06:45:06.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f93141f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732288b40 0x55d732287090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f93141f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7322875d0 0x55d732287a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f93141f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d732294760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f93141f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d7321ed2f0 con 0x55d732292370 2024-09-19T06:45:06.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f93141f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d732194cf0 con 0x55d732288b40 2024-09-19T06:45:06.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f93141f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d7321e92b0 con 0x55d7322875d0 2024-09-19T06:45:06.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f930affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d732294760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f930affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d732294760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49702/0 (socket says 172.21.15.12:49702) 2024-09-19T06:45:06.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f930affd640 1 -- 172.21.15.12:0/140854737 learned_addr learned my addr 172.21.15.12:0/140854737 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:06.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f930bfff640 1 --2- 172.21.15.12:0/140854737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732288b40 0x55d732287090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.972+0000 7f930b7fe640 1 --2- 172.21.15.12:0/140854737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7322875d0 0x55d732287a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f930affd640 1 -- 172.21.15.12:0/140854737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7322875d0 msgr2=0x55d732287a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f930affd640 1 --2- 172.21.15.12:0/140854737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7322875d0 0x55d732287a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f930affd640 1 -- 172.21.15.12:0/140854737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732288b40 msgr2=0x55d732287090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f930affd640 1 --2- 172.21.15.12:0/140854737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732288b40 0x55d732287090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f930affd640 1 -- 172.21.15.12:0/140854737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7321793a0 con 0x55d732292370 2024-09-19T06:45:06.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f930affd640 1 --2- 172.21.15.12:0/140854737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d732294760 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f93000097f0 tx=0x7f9300009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13c688004f36e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f9308ff9640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92f40a33b0 0x7f92f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f92f1ffb640 1 -- 172.21.15.12:0/140854737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300015020 con 0x55d732292370 2024-09-19T06:45:06.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f92f1ffb640 1 -- 172.21.15.12:0/140854737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9300011420 con 0x55d732292370 2024-09-19T06:45:06.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f92f1ffb640 1 -- 172.21.15.12:0/140854737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000105a0 con 0x55d732292370 2024-09-19T06:45:06.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f930bfff640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92f40a33b0 0x7f92f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.973+0000 7f9308ff9640 1 -- 172.21.15.12:0/2093891562 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f92fc0f0510 con 0x7f930c101de0 2024-09-19T06:45:06.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 -- 172.21.15.12:0/140854737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 msgr2=0x55d732294760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:06.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 --2- 172.21.15.12:0/140854737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d732294760 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f93000097f0 tx=0x7f9300009cb0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f930bfff640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92f40a33b0 0x7f92f40a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9304009270 tx=0x7f93040094e0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 -- 172.21.15.12:0/140854737 shutdown_connections 2024-09-19T06:45:06.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 --2- 172.21.15.12:0/140854737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d732294760 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 --2- 172.21.15.12:0/140854737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d7322875d0 0x55d732287a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 --2- 172.21.15.12:0/140854737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732288b40 0x55d732287090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 -- 172.21.15.12:0/140854737 >> 172.21.15.12:0/140854737 conn(0x55d732250310 msgr2=0x55d732283c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:06.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 -- 172.21.15.12:0/140854737 shutdown_connections 2024-09-19T06:45:06.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 -- 172.21.15.12:0/140854737 wait complete. 2024-09-19T06:45:06.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 -- start start 2024-09-19T06:45:06.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.974+0000 7f93141f5740 1 Processor -- start 2024-09-19T06:45:06.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f93141f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7322875d0 0x55d732291cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f93141f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d73228ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f93141f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d73228f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:06.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f93141f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d732295070 con 0x55d732292370 2024-09-19T06:45:06.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f93141f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d7321a8060 con 0x55d7322875d0 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f93141f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d7322951f0 con 0x55d732288b40 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f93141f5740 10 client.0 _ll_register_callbacks cb 0x55d731efb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f930bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d73228f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7322875d0 0x55d732291cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f930bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d73228f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49708/0 (socket says 172.21.15.12:49708) 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f930bfff640 1 -- 172.21.15.12:0/2910070462 learned_addr learned my addr 172.21.15.12:0/2910070462 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f930bfff640 1 -- 172.21.15.12:0/2910070462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 msgr2=0x55d73228ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f930bfff640 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d73228ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f930bfff640 1 -- 172.21.15.12:0/2910070462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7322875d0 msgr2=0x55d732291cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f930bfff640 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7322875d0 0x55d732291cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f930bfff640 1 -- 172.21.15.12:0/2910070462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d731f5e3c0 con 0x55d732292370 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f930bfff640 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d73228f4d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9304012720 tx=0x7f9304009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4156e8ee5f2ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:06.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f92eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f92eaffd640 1 -- 172.21.15.12:0/2910070462 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304023070 con 0x55d732292370 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.975+0000 7f92eaffd640 1 -- 172.21.15.12:0/2910070462 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9304011a30 con 0x55d732292370 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f93141f5740 1 -- 172.21.15.12:0/2910070462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9300011420 con 0x55d732292370 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f92eaffd640 1 -- 172.21.15.12:0/2910070462 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f930402f050 con 0x55d732292370 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f93141f5740 10 client.16842 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f93141f5740 1 -- 172.21.15.12:0/2910070462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d7322a0ae0 con 0x55d732292370 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f92eaffd640 1 -- 172.21.15.12:0/2910070462 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9300011420 con 0x55d732292370 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f92eaffd640 1 -- 172.21.15.12:0/2910070462 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f930400f040 con 0x55d732292370 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f93141f5740 10 client.16842 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f93141f5740 10 client.16842 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:45:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f93141f5740 20 client.16842 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:07.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f93141f5740 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d7322a1f90 0x55d7322a4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:07.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f93141f5740 4 client.16842 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:07.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f93141f5740 1 -- 172.21.15.12:0/2910070462 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7321fa860 con 0x55d7322a1f90 2024-09-19T06:45:07.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.976+0000 7f930b7fe640 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d7322a1f90 0x55d7322a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:07.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.977+0000 7f92eaffd640 10 client.16842 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:45:07.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.977+0000 7f930b7fe640 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d7322a1f90 0x55d7322a4450 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=424e1896212927f8 server_cookie=de632867865a1905 in_seq=0 out_seq=0 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.977+0000 7f92eaffd640 1 -- 172.21.15.12:0/2910070462 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7321fa860 con 0x55d7322a1f90 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.977+0000 7f92eaffd640 10 client.16842 handle_command_reply: tid=0 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.977+0000 7f93141f5740 1 client.16842 shutdown 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 1 -- 172.21.15.12:0/2910070462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 msgr2=0x55d73228f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d73228f4d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9304012720 tx=0x7f9304009200 comp rx=0 tx=0).stop 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 1 -- 172.21.15.12:0/2910070462 shutdown_connections 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d7322a1f90 0x55d7322a4450 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d732292370 0x55d73228f4d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d73228ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 1 --2- 172.21.15.12:0/2910070462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d7322875d0 0x55d732291cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f92eaffd640 0 client.16842 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:45:07.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 1 -- 172.21.15.12:0/2910070462 >> 172.21.15.12:0/2910070462 conn(0x55d732250310 msgr2=0x55d732289960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:07.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 1 -- 172.21.15.12:0/2910070462 shutdown_connections 2024-09-19T06:45:07.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 1 -- 172.21.15.12:0/2910070462 wait complete. 2024-09-19T06:45:07.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.978+0000 7f93141f5740 20 client.16842 trim_cache size 0 max 16384 2024-09-19T06:45:07.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f93141f5740 1 Processor -- start 2024-09-19T06:45:07.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f93141f5740 1 -- start start 2024-09-19T06:45:07.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f93141f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:07.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f93141f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d732293760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:07.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f93141f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 0x55d732293ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:07.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f93141f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1adb50 con 0x55d7322875d0 2024-09-19T06:45:07.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f93141f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1af6c0 con 0x55d732292370 2024-09-19T06:45:07.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f93141f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1ae220 con 0x55d732288b40 2024-09-19T06:45:07.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:07.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49718/0 (socket says 172.21.15.12:49718) 2024-09-19T06:45:07.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f930b7fe640 1 -- 172.21.15.12:0/3304007864 learned_addr learned my addr 172.21.15.12:0/3304007864 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:07.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f930bfff640 1 --2- 172.21.15.12:0/3304007864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 0x55d732293ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:07.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.997+0000 7f930affd640 1 --2- 172.21.15.12:0/3304007864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d732293760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:07.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.998+0000 7f930b7fe640 1 -- 172.21.15.12:0/3304007864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 msgr2=0x55d732293760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:07.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.998+0000 7f930b7fe640 1 --2- 172.21.15.12:0/3304007864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d732293760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.998+0000 7f930b7fe640 1 -- 172.21.15.12:0/3304007864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 msgr2=0x55d732293ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.998+0000 7f930b7fe640 1 --2- 172.21.15.12:0/3304007864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 0x55d732293ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.998+0000 7f930b7fe640 1 -- 172.21.15.12:0/3304007864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d732283ed0 con 0x55d7322875d0 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.998+0000 7f930b7fe640 1 --2- 172.21.15.12:0/3304007864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229e310 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0bc7c0 tx=0x7f92fc0f2a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113956ded2078cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.998+0000 7f92f17fa640 1 -- 172.21.15.12:0/3304007864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc049040 con 0x55d7322875d0 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.998+0000 7f92f17fa640 1 -- 172.21.15.12:0/3304007864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92fc03b580 con 0x55d7322875d0 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.998+0000 7f92f17fa640 1 -- 172.21.15.12:0/3304007864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc0bcf30 con 0x55d7322875d0 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.999+0000 7f93141f5740 1 -- 172.21.15.12:0/3304007864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 msgr2=0x55d73229e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.999+0000 7f93141f5740 1 --2- 172.21.15.12:0/3304007864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229e310 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0bc7c0 tx=0x7f92fc0f2a20 comp rx=0 tx=0).stop 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.999+0000 7f93141f5740 1 -- 172.21.15.12:0/3304007864 shutdown_connections 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.999+0000 7f93141f5740 1 --2- 172.21.15.12:0/3304007864 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 0x55d732293ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.999+0000 7f93141f5740 1 --2- 172.21.15.12:0/3304007864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d732293760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.999+0000 7f93141f5740 1 --2- 172.21.15.12:0/3304007864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229e310 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.999+0000 7f93141f5740 1 -- 172.21.15.12:0/3304007864 >> 172.21.15.12:0/3304007864 conn(0x55d732250310 msgr2=0x55d73228d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.999+0000 7f93141f5740 1 -- 172.21.15.12:0/3304007864 shutdown_connections 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.999+0000 7f93141f5740 1 -- 172.21.15.12:0/3304007864 wait complete. 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:06.999+0000 7f93141f5740 1 -- start start 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f93141f5740 1 Processor -- start 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f93141f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f93141f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d7322a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f93141f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 0x55d7322a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f93141f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1aeff0 con 0x55d7322875d0 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f93141f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1ae8f0 con 0x55d732292370 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f93141f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1abb30 con 0x55d732288b40 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f93141f5740 10 client.0 _ll_register_callbacks cb 0x7f9304016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:07.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f930b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49728/0 (socket says 172.21.15.12:49728) 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f930b7fe640 1 -- 172.21.15.12:0/1921479656 learned_addr learned my addr 172.21.15.12:0/1921479656 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.000+0000 7f930bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 0x55d7322a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f930affd640 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d7322a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f930bfff640 1 -- 172.21.15.12:0/1921479656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 msgr2=0x55d7322a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f930bfff640 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d7322a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f930bfff640 1 -- 172.21.15.12:0/1921479656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 msgr2=0x55d73229abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f930bfff640 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f930bfff640 1 -- 172.21.15.12:0/1921479656 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7322aa4e0 con 0x55d732292370 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f930affd640 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d7322a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f930b7fe640 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:07.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f930bfff640 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 0x55d7322a9cb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9304027570 tx=0x7f93040112d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20bcee08a46bccd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f92eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f92eaffd640 1 -- 172.21.15.12:0/1921479656 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304023070 con 0x55d732292370 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f93141f5740 1 -- 172.21.15.12:0/1921479656 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d7321f4d70 con 0x55d732292370 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.001+0000 7f92eaffd640 1 -- 172.21.15.12:0/1921479656 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f9304003b70 con 0x55d732292370 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f92eaffd640 1 -- 172.21.15.12:0/1921479656 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9304003db0 con 0x55d732292370 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f93141f5740 10 client.26390 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f93141f5740 1 -- 172.21.15.12:0/1921479656 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d73230cdb0 con 0x55d732292370 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f92eaffd640 1 -- 172.21.15.12:0/1921479656 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d7321f4d70 con 0x55d732292370 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f92eaffd640 1 -- 172.21.15.12:0/1921479656 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f9304027ac0 con 0x55d732292370 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f93141f5740 10 client.26390 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f93141f5740 10 client.26390 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f93141f5740 20 client.26390 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:07.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f93141f5740 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d73230d4c0 0x55d73230f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:07.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f93141f5740 4 client.26390 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:45:07.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f93141f5740 1 -- 172.21.15.12:0/1921479656 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d732171170 con 0x55d73230d4c0 2024-09-19T06:45:07.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.002+0000 7f930b7fe640 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d73230d4c0 0x55d73230f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:07.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f930b7fe640 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d73230d4c0 0x55d73230f8e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7c8a8bcee59c745 server_cookie=1ecf265c6882cd7e in_seq=0 out_seq=0 2024-09-19T06:45:07.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f92eaffd640 10 client.26390 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:45:07.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f92eaffd640 1 -- 172.21.15.12:0/1921479656 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d732171170 con 0x55d73230d4c0 2024-09-19T06:45:07.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f92eaffd640 10 client.26390 handle_command_reply: tid=0 2024-09-19T06:45:07.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 client.26390 shutdown 2024-09-19T06:45:07.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 -- 172.21.15.12:0/1921479656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 msgr2=0x55d7322a9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:07.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 0x55d7322a9cb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9304027570 tx=0x7f93040112d0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 -- 172.21.15.12:0/1921479656 shutdown_connections 2024-09-19T06:45:07.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55d73230d4c0 0x55d73230f8e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d732292370 0x55d7322a9cb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d732288b40 0x55d7322a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 --2- 172.21.15.12:0/1921479656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7322875d0 0x55d73229abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 -- 172.21.15.12:0/1921479656 >> 172.21.15.12:0/1921479656 conn(0x55d732250310 msgr2=0x55d732289930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:07.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f92eaffd640 0 client.26390 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:45:07.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 -- 172.21.15.12:0/1921479656 shutdown_connections 2024-09-19T06:45:07.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 1 -- 172.21.15.12:0/1921479656 wait complete. 2024-09-19T06:45:07.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.003+0000 7f93141f5740 20 client.26390 trim_cache size 0 max 16384 2024-09-19T06:45:07.018 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:45:07.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 -- 172.21.15.12:0/2093891562 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92f40a33b0 msgr2=0x7f92f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:07.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92f40a33b0 0x7f92f40a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9304009270 tx=0x7f93040094e0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 -- 172.21.15.12:0/2093891562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f930c101de0 msgr2=0x7f930c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:07.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f930c101de0 0x7f930c198490 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f92fc006010 tx=0x7f92fc0042f0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 -- 172.21.15.12:0/2093891562 shutdown_connections 2024-09-19T06:45:07.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92f40a33b0 0x7f92f40a5870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f930c106f10 0x7f930c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f930c102790 0x7f930c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 --2- 172.21.15.12:0/2093891562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f930c101de0 0x7f930c198490 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:07.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 -- 172.21.15.12:0/2093891562 >> 172.21.15.12:0/2093891562 conn(0x7f930c0fd8c0 msgr2=0x7f930c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 -- 172.21.15.12:0/2093891562 shutdown_connections 2024-09-19T06:45:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:07.004+0000 7f9311e1c640 1 -- 172.21.15.12:0/2093891562 wait complete. 2024-09-19T06:45:07.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:07 smithi012 ceph-mon[30937]: pgmap v152: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 24 MiB/s wr, 1.34k op/s 2024-09-19T06:45:07.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:07 smithi016 ceph-mon[34911]: pgmap v152: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 24 MiB/s wr, 1.34k op/s 2024-09-19T06:45:07.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:45:07.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:07 smithi173 ceph-mon[35349]: pgmap v152: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 24 MiB/s wr, 1.34k op/s 2024-09-19T06:45:08.187 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '36083eb1', quiesce took 8.3 seconds. Will release after: 21.5 2024-09-19T06:45:08.268 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.379+0000 7f21f4b9f640 1 -- 172.21.15.12:0/612660765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f01069e0 msgr2=0x7f21f0106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.379+0000 7f21f4b9f640 1 --2- 172.21.15.12:0/612660765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f01069e0 0x7f21f0106dc0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009930 tx=0x7f21e002a420 comp rx=0 tx=0).stop 2024-09-19T06:45:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.380+0000 7f21f4b9f640 1 -- 172.21.15.12:0/612660765 shutdown_connections 2024-09-19T06:45:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.380+0000 7f21f4b9f640 1 --2- 172.21.15.12:0/612660765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f0101370 0x7f21f010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.380+0000 7f21f4b9f640 1 --2- 172.21.15.12:0/612660765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21f01009d0 0x7f21f0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.380+0000 7f21f4b9f640 1 --2- 172.21.15.12:0/612660765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f01069e0 0x7f21f0106dc0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.380+0000 7f21f4b9f640 1 -- 172.21.15.12:0/612660765 >> 172.21.15.12:0/612660765 conn(0x7f21f00fc6b0 msgr2=0x7f21f00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.380+0000 7f21f4b9f640 1 -- 172.21.15.12:0/612660765 shutdown_connections 2024-09-19T06:45:08.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.380+0000 7f21f4b9f640 1 -- 172.21.15.12:0/612660765 wait complete. 2024-09-19T06:45:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.380+0000 7f21f4b9f640 1 Processor -- start 2024-09-19T06:45:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.380+0000 7f21f4b9f640 1 -- start start 2024-09-19T06:45:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21f4b9f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21f01009d0 0x7f21f0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21f4b9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f0101370 0x7f21f0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21f4b9f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f01069e0 0x7f21f019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21f4b9f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f21f0110e70 con 0x7f21f0101370 2024-09-19T06:45:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21f4b9f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f21f0110cf0 con 0x7f21f01009d0 2024-09-19T06:45:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21f4b9f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f21f0110ff0 con 0x7f21f01069e0 2024-09-19T06:45:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21edd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f0101370 0x7f21f0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21edd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f0101370 0x7f21f0198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49738/0 (socket says 172.21.15.12:49738) 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21edd9b640 1 -- 172.21.15.12:0/4182264064 learned_addr learned my addr 172.21.15.12:0/4182264064 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21ee59c640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21f01009d0 0x7f21f0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21eed9d640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f01069e0 0x7f21f019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21edd9b640 1 -- 172.21.15.12:0/4182264064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f01069e0 msgr2=0x7f21f019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21edd9b640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f01069e0 0x7f21f019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21edd9b640 1 -- 172.21.15.12:0/4182264064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21f01009d0 msgr2=0x7f21f0198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21edd9b640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21f01009d0 0x7f21f0198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21edd9b640 1 -- 172.21.15.12:0/4182264064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f019d320 con 0x7f21f0101370 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.381+0000 7f21edd9b640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f0101370 0x7f21f0198870 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f21d800d950 tx=0x7f21d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.382+0000 7f21e77fe640 1 -- 172.21.15.12:0/4182264064 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8017070 con 0x7f21f0101370 2024-09-19T06:45:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.382+0000 7f21e77fe640 1 -- 172.21.15.12:0/4182264064 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21d8009c30 con 0x7f21f0101370 2024-09-19T06:45:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.382+0000 7f21f4b9f640 1 -- 172.21.15.12:0/4182264064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f019d610 con 0x7f21f0101370 2024-09-19T06:45:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.382+0000 7f21e77fe640 1 -- 172.21.15.12:0/4182264064 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d800f6b0 con 0x7f21f0101370 2024-09-19T06:45:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.382+0000 7f21f4b9f640 1 -- 172.21.15.12:0/4182264064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f01a4ea0 con 0x7f21f0101370 2024-09-19T06:45:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.384+0000 7f21e77fe640 1 -- 172.21.15.12:0/4182264064 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f21d80109d0 con 0x7f21f0101370 2024-09-19T06:45:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.384+0000 7f21f7a1c740 1 Processor -- start 2024-09-19T06:45:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21f7a1c740 1 -- start start 2024-09-19T06:45:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0d9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ea4c03e2f0 con 0x55ea4c0d99f0 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ea4bfe6270 con 0x55ea4c0da310 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ea4c03a2b0 con 0x55ea4c0e90c0 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21eed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0d9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21eed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0d9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49740/0 (socket says 172.21.15.12:49740) 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21eed9d640 1 -- 172.21.15.12:0/321488552 learned_addr learned my addr 172.21.15.12:0/321488552 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21e77fe640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21dc0a3460 0x7f21dc0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21edd9b640 1 --2- 172.21.15.12:0/321488552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21ee59c640 1 --2- 172.21.15.12:0/321488552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21eed9d640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21dc0a3460 0x7f21dc0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21eed9d640 1 -- 172.21.15.12:0/321488552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 msgr2=0x55ea4c0eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21eed9d640 1 --2- 172.21.15.12:0/321488552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0eb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21eed9d640 1 -- 172.21.15.12:0/321488552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 msgr2=0x55ea4c0e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21eed9d640 1 --2- 172.21.15.12:0/321488552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21eed9d640 1 -- 172.21.15.12:0/321488552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4bfe5340 con 0x55ea4c0d99f0 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21ee59c640 1 --2- 172.21.15.12:0/321488552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.385+0000 7f21e77fe640 1 -- 172.21.15.12:0/4182264064 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f21d80cf900 con 0x7f21f0101370 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.386+0000 7f21eed9d640 1 --2- 172.21.15.12:0/321488552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0d9dd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f21e80139d0 tx=0x7f21e8013e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0622863970e4f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.386+0000 7f21e4ff9640 1 -- 172.21.15.12:0/321488552 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e8013050 con 0x55ea4c0d99f0 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.386+0000 7f21e4ff9640 1 -- 172.21.15.12:0/321488552 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21e8022070 con 0x55ea4c0d99f0 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.386+0000 7f21e4ff9640 1 -- 172.21.15.12:0/321488552 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e80126b0 con 0x55ea4c0d99f0 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 -- 172.21.15.12:0/321488552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 msgr2=0x55ea4c0d9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/321488552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0d9dd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f21e80139d0 tx=0x7f21e8013e90 comp rx=0 tx=0).stop 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21eed9d640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21dc0a3460 0x7f21dc0a5920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f21e8021000 tx=0x7f21e801f000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 -- 172.21.15.12:0/321488552 shutdown_connections 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/321488552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/321488552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/321488552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0d9dd0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 -- 172.21.15.12:0/321488552 >> 172.21.15.12:0/321488552 conn(0x55ea4c0d6060 msgr2=0x55ea4c0d6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 -- 172.21.15.12:0/321488552 shutdown_connections 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 -- 172.21.15.12:0/321488552 wait complete. 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 -- start start 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 Processor -- start 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0e6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0e6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ea4c0ebd20 con 0x55ea4c0e90c0 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ea4bfc7290 con 0x55ea4c0da310 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ea4c0ebea0 con 0x55ea4c0d99f0 2024-09-19T06:45:08.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21f7a1c740 10 client.0 _ll_register_callbacks cb 0x55ea4bff8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.387+0000 7f21eed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0e6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21eed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0e6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49754/0 (socket says 172.21.15.12:49754) 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21eed9d640 1 -- 172.21.15.12:0/3016707838 learned_addr learned my addr 172.21.15.12:0/3016707838 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21edd9b640 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21ee59c640 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21eed9d640 1 -- 172.21.15.12:0/3016707838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0d99f0 msgr2=0x55ea4c0e6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21eed9d640 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0e6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21eed9d640 1 -- 172.21.15.12:0/3016707838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 msgr2=0x55ea4c0e6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21eed9d640 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21eed9d640 1 -- 172.21.15.12:0/3016707838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea4bd51210 con 0x55ea4c0e90c0 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21eed9d640 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0e6ab0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f21e8007fd0 tx=0x7f21e8004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59103d738e253fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21d5ffb640 1 -- 172.21.15.12:0/3016707838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e8036060 con 0x55ea4c0e90c0 2024-09-19T06:45:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21d5ffb640 1 -- 172.21.15.12:0/3016707838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f21e8011dc0 con 0x55ea4c0e90c0 2024-09-19T06:45:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21f7a1c740 1 -- 172.21.15.12:0/3016707838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21e8022070 con 0x55ea4c0e90c0 2024-09-19T06:45:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21d5ffb640 1 -- 172.21.15.12:0/3016707838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f21e801d810 con 0x55ea4c0e90c0 2024-09-19T06:45:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21f7a1c740 10 client.16860 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.388+0000 7f21f7a1c740 1 -- 172.21.15.12:0/3016707838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ea4be1d620 con 0x55ea4c0e90c0 2024-09-19T06:45:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21d5ffb640 1 -- 172.21.15.12:0/3016707838 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21e8022070 con 0x55ea4c0e90c0 2024-09-19T06:45:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21d5ffb640 1 -- 172.21.15.12:0/3016707838 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f21e8012d70 con 0x55ea4c0e90c0 2024-09-19T06:45:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21f7a1c740 10 client.16860 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21f7a1c740 10 client.16860 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21f7a1c740 20 client.16860 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ea4c0f90b0 0x55ea4c0fb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21f7a1c740 4 client.16860 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21f7a1c740 1 -- 172.21.15.12:0/3016707838 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea4c04ba20 con 0x55ea4c0f90b0 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21ee59c640 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ea4c0f90b0 0x55ea4c0fb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21ee59c640 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ea4c0f90b0 0x55ea4c0fb4a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf69010bafe69510 server_cookie=53a8d9e1964ebc18 in_seq=0 out_seq=0 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.389+0000 7f21d5ffb640 10 client.16860 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21d5ffb640 1 -- 172.21.15.12:0/3016707838 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea4c04ba20 con 0x55ea4c0f90b0 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21d5ffb640 10 client.16860 handle_command_reply: tid=0 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 client.16860 shutdown 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 -- 172.21.15.12:0/3016707838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0e90c0 msgr2=0x55ea4c0e6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0e6ab0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f21e8007fd0 tx=0x7f21e8004bb0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 -- 172.21.15.12:0/3016707838 shutdown_connections 2024-09-19T06:45:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ea4c0f90b0 0x55ea4c0fb4a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21d5ffb640 0 client.16860 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0e6ab0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/3016707838 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0e6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 -- 172.21.15.12:0/3016707838 >> 172.21.15.12:0/3016707838 conn(0x55ea4c0d6060 msgr2=0x55ea4c0dbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 -- 172.21.15.12:0/3016707838 shutdown_connections 2024-09-19T06:45:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.390+0000 7f21f7a1c740 1 -- 172.21.15.12:0/3016707838 wait complete. 2024-09-19T06:45:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.391+0000 7f21f7a1c740 20 client.16860 trim_cache size 0 max 16384 2024-09-19T06:45:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.405+0000 7f21f7a1c740 1 Processor -- start 2024-09-19T06:45:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.405+0000 7f21f7a1c740 1 -- start start 2024-09-19T06:45:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0da310 0x55ea4c100aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c100fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f21f01ab820 con 0x55ea4c0da310 2024-09-19T06:45:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f21f01ad390 con 0x55ea4c0d99f0 2024-09-19T06:45:08.408 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f21f01abef0 con 0x55ea4c0e90c0 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21edd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0da310 0x55ea4c100aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21edd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0da310 0x55ea4c100aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49756/0 (socket says 172.21.15.12:49756) 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21edd9b640 1 -- 172.21.15.12:0/2838538721 learned_addr learned my addr 172.21.15.12:0/2838538721 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21ee59c640 1 --2- 172.21.15.12:0/2838538721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21edd9b640 1 -- 172.21.15.12:0/2838538721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 msgr2=0x55ea4c100fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21eed9d640 1 --2- 172.21.15.12:0/2838538721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c100fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21edd9b640 1 --2- 172.21.15.12:0/2838538721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c100fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21edd9b640 1 -- 172.21.15.12:0/2838538721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0d99f0 msgr2=0x55ea4c0e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21edd9b640 1 --2- 172.21.15.12:0/2838538721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21edd9b640 1 -- 172.21.15.12:0/2838538721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4c0dafc0 con 0x55ea4c0da310 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.406+0000 7f21edd9b640 1 --2- 172.21.15.12:0/2838538721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0da310 0x55ea4c100aa0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f21d80cd080 tx=0x7f21d8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41474c765ae4c04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21d7fff640 1 -- 172.21.15.12:0/2838538721 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8020070 con 0x55ea4c0da310 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21d7fff640 1 -- 172.21.15.12:0/2838538721 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21d80071c0 con 0x55ea4c0da310 2024-09-19T06:45:08.409 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21d7fff640 1 -- 172.21.15.12:0/2838538721 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d80a4340 con 0x55ea4c0da310 2024-09-19T06:45:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21f7a1c740 1 -- 172.21.15.12:0/2838538721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0da310 msgr2=0x55ea4c100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/2838538721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0da310 0x55ea4c100aa0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f21d80cd080 tx=0x7f21d8007f90 comp rx=0 tx=0).stop 2024-09-19T06:45:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21f7a1c740 1 -- 172.21.15.12:0/2838538721 shutdown_connections 2024-09-19T06:45:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/2838538721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/2838538721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0da310 0x55ea4c100aa0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/2838538721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21f7a1c740 1 -- 172.21.15.12:0/2838538721 >> 172.21.15.12:0/2838538721 conn(0x55ea4c0d6060 msgr2=0x55ea4c0dbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21f7a1c740 1 -- 172.21.15.12:0/2838538721 shutdown_connections 2024-09-19T06:45:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.407+0000 7f21f7a1c740 1 -- 172.21.15.12:0/2838538721 wait complete. 2024-09-19T06:45:08.413 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21f7a1c740 1 -- start start 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21f7a1c740 1 Processor -- start 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21f7a1c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0e3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f21f01accc0 con 0x55ea4c0d99f0 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f21f01ac5c0 con 0x55ea4c0da310 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21f7a1c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f21f01a9800 con 0x55ea4c0e90c0 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21f7a1c740 10 client.0 _ll_register_callbacks cb 0x7f21e80137d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0f1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49758/0 (socket says 172.21.15.12:49758) 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21ee59c640 1 -- 172.21.15.12:0/1143801305 learned_addr learned my addr 172.21.15.12:0/1143801305 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21eed9d640 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0e3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.414 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21edd9b640 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21ee59c640 1 -- 172.21.15.12:0/1143801305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 msgr2=0x55ea4c0e3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21ee59c640 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0e3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21ee59c640 1 -- 172.21.15.12:0/1143801305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 msgr2=0x55ea4c0e2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21ee59c640 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.408+0000 7f21ee59c640 1 -- 172.21.15.12:0/1143801305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea4c0e3a90 con 0x55ea4c0d99f0 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21ee59c640 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0f1800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f21e00096c0 tx=0x7f21e0004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3b69759c244b15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21d5ffb640 1 -- 172.21.15.12:0/1143801305 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e0035040 con 0x55ea4c0d99f0 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21d5ffb640 1 -- 172.21.15.12:0/1143801305 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f21e0005590 con 0x55ea4c0d99f0 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21f7a1c740 1 -- 172.21.15.12:0/1143801305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21d80071c0 con 0x55ea4c0d99f0 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21d5ffb640 1 -- 172.21.15.12:0/1143801305 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f21e00046c0 con 0x55ea4c0d99f0 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21f7a1c740 10 client.16866 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:08.415 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21f7a1c740 1 -- 172.21.15.12:0/1143801305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ea4c163ae0 con 0x55ea4c0d99f0 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21d5ffb640 1 -- 172.21.15.12:0/1143801305 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21d80071c0 con 0x55ea4c0d99f0 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21d5ffb640 1 -- 172.21.15.12:0/1143801305 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f21e0031c80 con 0x55ea4c0d99f0 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21f7a1c740 10 client.16866 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21f7a1c740 10 client.16866 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21f7a1c740 20 client.16866 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ea4c0f90b0 0x55ea4c1661f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21f7a1c740 4 client.16866 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.409+0000 7f21f7a1c740 1 -- 172.21.15.12:0/1143801305 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ea4c045d70 con 0x55ea4c0f90b0 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.410+0000 7f21edd9b640 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ea4c0f90b0 0x55ea4c1661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.410+0000 7f21edd9b640 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ea4c0f90b0 0x55ea4c1661f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ce72e7bc79d538e server_cookie=ed5cbb9b90d2930f in_seq=0 out_seq=0 2024-09-19T06:45:08.416 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.410+0000 7f21d5ffb640 10 client.16866 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21d5ffb640 1 -- 172.21.15.12:0/1143801305 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ea4c045d70 con 0x55ea4c0f90b0 2024-09-19T06:45:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21d5ffb640 10 client.16866 handle_command_reply: tid=0 2024-09-19T06:45:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 client.16866 shutdown 2024-09-19T06:45:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 -- 172.21.15.12:0/1143801305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 msgr2=0x55ea4c0f1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0f1800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f21e00096c0 tx=0x7f21e0004590 comp rx=0 tx=0).stop 2024-09-19T06:45:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 -- 172.21.15.12:0/1143801305 shutdown_connections 2024-09-19T06:45:08.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ea4c0f90b0 0x55ea4c1661f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ea4c0e90c0 0x55ea4c0e3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ea4c0da310 0x55ea4c0e2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21d5ffb640 0 client.16866 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 --2- 172.21.15.12:0/1143801305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ea4c0d99f0 0x55ea4c0f1800 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 -- 172.21.15.12:0/1143801305 >> 172.21.15.12:0/1143801305 conn(0x55ea4c0d6060 msgr2=0x55ea4c0d49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 -- 172.21.15.12:0/1143801305 shutdown_connections 2024-09-19T06:45:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.426+0000 7f21f7a1c740 1 -- 172.21.15.12:0/1143801305 wait complete. 2024-09-19T06:45:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f7a1c740 20 client.16866 trim_cache size 0 max 16384 2024-09-19T06:45:08.429 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:45:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:45:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:45:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:45:08.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 -- 172.21.15.12:0/4182264064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21dc0a3460 msgr2=0x7f21dc0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21dc0a3460 0x7f21dc0a5920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f21e8021000 tx=0x7f21e801f000 comp rx=0 tx=0).stop 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 -- 172.21.15.12:0/4182264064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f0101370 msgr2=0x7f21f0198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f0101370 0x7f21f0198870 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f21d800d950 tx=0x7f21d800de10 comp rx=0 tx=0).stop 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 -- 172.21.15.12:0/4182264064 shutdown_connections 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21dc0a3460 0x7f21dc0a5920 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21f01069e0 0x7f21f019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f0101370 0x7f21f0198870 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 --2- 172.21.15.12:0/4182264064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21f01009d0 0x7f21f0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 -- 172.21.15.12:0/4182264064 >> 172.21.15.12:0/4182264064 conn(0x7f21f00fc6b0 msgr2=0x7f21f01049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 -- 172.21.15.12:0/4182264064 shutdown_connections 2024-09-19T06:45:08.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:08.427+0000 7f21f4b9f640 1 -- 172.21.15.12:0/4182264064 wait complete. 2024-09-19T06:45:08.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.720+0000 7fb685a20640 1 -- 172.21.15.12:0/4139729021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680101420 msgr2=0x7fb68010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.720+0000 7fb685a20640 1 --2- 172.21.15.12:0/4139729021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680101420 0x7fb68010d950 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb678009cd0 tx=0x7fb67802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.720+0000 7fb685a20640 1 -- 172.21.15.12:0/4139729021 shutdown_connections 2024-09-19T06:45:08.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.720+0000 7fb685a20640 1 --2- 172.21.15.12:0/4139729021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680101420 0x7fb68010d950 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.720+0000 7fb685a20640 1 --2- 172.21.15.12:0/4139729021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb680100a80 0x7fb680100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.720+0000 7fb685a20640 1 --2- 172.21.15.12:0/4139729021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb680106a80 0x7fb680106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.720+0000 7fb685a20640 1 -- 172.21.15.12:0/4139729021 >> 172.21.15.12:0/4139729021 conn(0x7fb6800fc7a0 msgr2=0x7fb6800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.720+0000 7fb685a20640 1 -- 172.21.15.12:0/4139729021 shutdown_connections 2024-09-19T06:45:08.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.720+0000 7fb685a20640 1 -- 172.21.15.12:0/4139729021 wait complete. 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb685a20640 1 Processor -- start 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb685a20640 1 -- start start 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb685a20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680100a80 0x7fb680197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb685a20640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb680101420 0x7fb6801977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb685a20640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb680106a80 0x7fb68019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb685a20640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb680110e80 con 0x7fb680100a80 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb685a20640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb680110d00 con 0x7fb680101420 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb685a20640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb680111000 con 0x7fb680106a80 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb67effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680100a80 0x7fb680197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb67effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680100a80 0x7fb680197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49774/0 (socket says 172.21.15.12:49774) 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.721+0000 7fb67effd640 1 -- 172.21.15.12:0/3009002409 learned_addr learned my addr 172.21.15.12:0/3009002409 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:08.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb680106a80 0x7fb68019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb6767fc640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb680101420 0x7fb6801977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb67effd640 1 -- 172.21.15.12:0/3009002409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb680106a80 msgr2=0x7fb68019bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb67effd640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb680106a80 0x7fb68019bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb67effd640 1 -- 172.21.15.12:0/3009002409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb680101420 msgr2=0x7fb6801977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb67effd640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb680101420 0x7fb6801977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb67effd640 1 -- 172.21.15.12:0/3009002409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68019c210 con 0x7fb680100a80 2024-09-19T06:45:08.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb6767fc640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb680101420 0x7fb6801977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:08.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb67effd640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680100a80 0x7fb680197260 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb67000d950 tx=0x7fb67000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb684a1e640 1 -- 172.21.15.12:0/3009002409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670017030 con 0x7fb680100a80 2024-09-19T06:45:08.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb685a20640 1 -- 172.21.15.12:0/3009002409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68019c500 con 0x7fb680100a80 2024-09-19T06:45:08.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb684a1e640 1 -- 172.21.15.12:0/3009002409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb670004020 con 0x7fb680100a80 2024-09-19T06:45:08.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb684a1e640 1 -- 172.21.15.12:0/3009002409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6700047a0 con 0x7fb680100a80 2024-09-19T06:45:08.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.722+0000 7fb685a20640 1 -- 172.21.15.12:0/3009002409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68006a790 con 0x7fb680100a80 2024-09-19T06:45:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.725+0000 7fb687df9740 1 Processor -- start 2024-09-19T06:45:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.725+0000 7fb684a1e640 1 -- 172.21.15.12:0/3009002409 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb6700041d0 con 0x7fb680100a80 2024-09-19T06:45:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.725+0000 7fb687df9740 1 -- start start 2024-09-19T06:45:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.725+0000 7fb687df9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d189090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.725+0000 7fb687df9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d1895d0 0x55ac4d189a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.725+0000 7fb687df9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d194370 0x55ac4d196760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.725+0000 7fb687df9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ac4d0ef2f0 con 0x55ac4d18ab40 2024-09-19T06:45:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.725+0000 7fb687df9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ac4d096cf0 con 0x55ac4d1895d0 2024-09-19T06:45:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.725+0000 7fb687df9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ac4d0eb2b0 con 0x55ac4d194370 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.725+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d189090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d189090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49790/0 (socket says 172.21.15.12:49790) 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67f7fe640 1 -- 172.21.15.12:0/2896619136 learned_addr learned my addr 172.21.15.12:0/2896619136 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb6767fc640 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d194370 0x55ac4d196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67effd640 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d1895d0 0x55ac4d189a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67f7fe640 1 -- 172.21.15.12:0/2896619136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d194370 msgr2=0x55ac4d196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d194370 0x55ac4d196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb684a1e640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb66c0a33b0 0x7fb66c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67f7fe640 1 -- 172.21.15.12:0/2896619136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d1895d0 msgr2=0x55ac4d189a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d1895d0 0x55ac4d189a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67f7fe640 1 -- 172.21.15.12:0/2896619136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac4d07b3a0 con 0x55ac4d18ab40 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67effd640 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d1895d0 0x55ac4d189a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:08.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb6767fc640 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d194370 0x55ac4d196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb684a1e640 1 -- 172.21.15.12:0/3009002409 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fb6700cf6f0 con 0x7fb680100a80 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d189090 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb678035000 tx=0x7fb678031570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c27319a51b81d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.726+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb66c0a33b0 0x7fb66c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb675ffb640 1 -- 172.21.15.12:0/2896619136 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678031bc0 con 0x55ac4d18ab40 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb675ffb640 1 -- 172.21.15.12:0/2896619136 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb678036070 con 0x55ac4d18ab40 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb675ffb640 1 -- 172.21.15.12:0/2896619136 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678030e00 con 0x55ac4d18ab40 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb687df9740 1 -- 172.21.15.12:0/2896619136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 msgr2=0x55ac4d189090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb66c0a33b0 0x7fb66c0a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb678049000 tx=0x7fb67804a000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb687df9740 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d189090 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb678035000 tx=0x7fb678031570 comp rx=0 tx=0).stop 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb687df9740 1 -- 172.21.15.12:0/2896619136 shutdown_connections 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb687df9740 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d194370 0x55ac4d196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb687df9740 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d1895d0 0x55ac4d189a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb687df9740 1 --2- 172.21.15.12:0/2896619136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d189090 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.727+0000 7fb687df9740 1 -- 172.21.15.12:0/2896619136 >> 172.21.15.12:0/2896619136 conn(0x55ac4d152310 msgr2=0x55ac4d185c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.728+0000 7fb687df9740 1 -- 172.21.15.12:0/2896619136 shutdown_connections 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.728+0000 7fb687df9740 1 -- 172.21.15.12:0/2896619136 wait complete. 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.728+0000 7fb687df9740 1 -- start start 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.728+0000 7fb687df9740 1 Processor -- start 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.728+0000 7fb687df9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d193d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.728+0000 7fb687df9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d191010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.728+0000 7fb687df9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d194370 0x55ac4d191600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb687df9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ac4d197070 con 0x55ac4d18ab40 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb687df9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ac4d0aa060 con 0x55ac4d194370 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb687df9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ac4d1971f0 con 0x55ac4d1895d0 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb6767fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d191010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb6767fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d191010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49802/0 (socket says 172.21.15.12:49802) 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb6767fc640 1 -- 172.21.15.12:0/1001403632 learned_addr learned my addr 172.21.15.12:0/1001403632 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb687df9740 10 client.0 _ll_register_callbacks cb 0x55ac4cdfd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d194370 0x55ac4d191600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb67effd640 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d193d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb6767fc640 1 -- 172.21.15.12:0/1001403632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 msgr2=0x55ac4d193d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb6767fc640 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d193d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb6767fc640 1 -- 172.21.15.12:0/1001403632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d194370 msgr2=0x55ac4d191600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb6767fc640 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d194370 0x55ac4d191600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb6767fc640 1 -- 172.21.15.12:0/1001403632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac4ce603c0 con 0x55ac4d18ab40 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb6767fc640 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d191010 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb6680099f0 tx=0x7fb668009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c6c05e9fe4a0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb65effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb65effd640 1 -- 172.21.15.12:0/1001403632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668013a10 con 0x55ac4d18ab40 2024-09-19T06:45:08.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb65effd640 1 -- 172.21.15.12:0/1001403632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fb668013bb0 con 0x55ac4d18ab40 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.729+0000 7fb687df9740 1 -- 172.21.15.12:0/1001403632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb678036070 con 0x55ac4d18ab40 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb65effd640 1 -- 172.21.15.12:0/1001403632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb668025050 con 0x55ac4d18ab40 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb687df9740 10 client.16878 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb687df9740 1 -- 172.21.15.12:0/1001403632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ac4d1a2b50 con 0x55ac4d18ab40 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb65effd640 1 -- 172.21.15.12:0/1001403632 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb678036070 con 0x55ac4d18ab40 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb65effd640 1 -- 172.21.15.12:0/1001403632 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fb668004b50 con 0x55ac4d18ab40 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb687df9740 10 client.16878 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb687df9740 10 client.16878 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb687df9740 20 client.16878 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb687df9740 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ac4d1a40b0 0x55ac4d1a6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb687df9740 4 client.16878 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb687df9740 1 -- 172.21.15.12:0/1001403632 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac4d0fc860 con 0x55ac4d1a40b0 2024-09-19T06:45:08.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.730+0000 7fb67effd640 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ac4d1a40b0 0x55ac4d1a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.731+0000 7fb65effd640 10 client.16878 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:45:08.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.731+0000 7fb67effd640 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ac4d1a40b0 0x55ac4d1a6510 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=77a742182d2d6790 server_cookie=de0f3dd9fd11e348 in_seq=0 out_seq=0 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb65effd640 1 -- 172.21.15.12:0/1001403632 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac4d0fc860 con 0x55ac4d1a40b0 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb65effd640 10 client.16878 handle_command_reply: tid=0 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 client.16878 shutdown 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 -- 172.21.15.12:0/1001403632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 msgr2=0x55ac4d191010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d191010 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb6680099f0 tx=0x7fb668009df0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 -- 172.21.15.12:0/1001403632 shutdown_connections 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ac4d1a40b0 0x55ac4d1a6510 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d194370 0x55ac4d191600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d18ab40 0x55ac4d191010 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 --2- 172.21.15.12:0/1001403632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d193d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 -- 172.21.15.12:0/1001403632 >> 172.21.15.12:0/1001403632 conn(0x55ac4d152310 msgr2=0x55ac4d18b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb65effd640 0 client.16878 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:45:08.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 -- 172.21.15.12:0/1001403632 shutdown_connections 2024-09-19T06:45:08.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 1 -- 172.21.15.12:0/1001403632 wait complete. 2024-09-19T06:45:08.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.732+0000 7fb687df9740 20 client.16878 trim_cache size 0 max 16384 2024-09-19T06:45:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.745+0000 7fb687df9740 1 Processor -- start 2024-09-19T06:45:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.745+0000 7fb687df9740 1 -- start start 2024-09-19T06:45:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.745+0000 7fb687df9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.745+0000 7fb687df9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 0x55ac4d18c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.745+0000 7fb687df9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.745+0000 7fb687df9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801ab840 con 0x55ac4d194370 2024-09-19T06:45:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.745+0000 7fb687df9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801ad3b0 con 0x55ac4d18ab40 2024-09-19T06:45:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.745+0000 7fb687df9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801abf10 con 0x55ac4d1895d0 2024-09-19T06:45:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49812/0 (socket says 172.21.15.12:49812) 2024-09-19T06:45:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb67f7fe640 1 -- 172.21.15.12:0/3207107577 learned_addr learned my addr 172.21.15.12:0/3207107577 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb6767fc640 1 --2- 172.21.15.12:0/3207107577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 0x55ac4d18c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb67effd640 1 --2- 172.21.15.12:0/3207107577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb67f7fe640 1 -- 172.21.15.12:0/3207107577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 msgr2=0x55ac4d1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/3207107577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb67f7fe640 1 -- 172.21.15.12:0/3207107577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 msgr2=0x55ac4d18c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/3207107577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 0x55ac4d18c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb67f7fe640 1 -- 172.21.15.12:0/3207107577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac4d18a780 con 0x55ac4d194370 2024-09-19T06:45:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/3207107577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18c660 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb67802a920 tx=0x7fb678050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdc9ec11b04515d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb6757fa640 1 -- 172.21.15.12:0/3207107577 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678031a20 con 0x55ac4d194370 2024-09-19T06:45:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb6757fa640 1 -- 172.21.15.12:0/3207107577 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb678036050 con 0x55ac4d194370 2024-09-19T06:45:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.746+0000 7fb6757fa640 1 -- 172.21.15.12:0/3207107577 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678030890 con 0x55ac4d194370 2024-09-19T06:45:08.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.747+0000 7fb687df9740 1 -- 172.21.15.12:0/3207107577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 msgr2=0x55ac4d18c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.747+0000 7fb687df9740 1 --2- 172.21.15.12:0/3207107577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18c660 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb67802a920 tx=0x7fb678050000 comp rx=0 tx=0).stop 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.747+0000 7fb687df9740 1 -- 172.21.15.12:0/3207107577 shutdown_connections 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.747+0000 7fb687df9740 1 --2- 172.21.15.12:0/3207107577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18c660 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.747+0000 7fb687df9740 1 --2- 172.21.15.12:0/3207107577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 0x55ac4d18c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.747+0000 7fb687df9740 1 --2- 172.21.15.12:0/3207107577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.747+0000 7fb687df9740 1 -- 172.21.15.12:0/3207107577 >> 172.21.15.12:0/3207107577 conn(0x55ac4d152310 msgr2=0x55ac4d190120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.747+0000 7fb687df9740 1 -- 172.21.15.12:0/3207107577 shutdown_connections 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.747+0000 7fb687df9740 1 -- 172.21.15.12:0/3207107577 wait complete. 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.747+0000 7fb687df9740 1 -- start start 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb687df9740 1 Processor -- start 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb687df9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d19c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb687df9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 0x55ac4d19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb687df9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb687df9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801acce0 con 0x55ac4d194370 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb687df9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801ac5e0 con 0x55ac4d18ab40 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb687df9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801a9820 con 0x55ac4d1895d0 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb687df9740 10 client.0 _ll_register_callbacks cb 0x7fb66800a950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb67f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49822/0 (socket says 172.21.15.12:49822) 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb67f7fe640 1 -- 172.21.15.12:0/2170667982 learned_addr learned my addr 172.21.15.12:0/2170667982 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb6767fc640 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 0x55ac4d19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb67effd640 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb67f7fe640 1 -- 172.21.15.12:0/2170667982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 msgr2=0x55ac4d19c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d19c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb67f7fe640 1 -- 172.21.15.12:0/2170667982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 msgr2=0x55ac4d19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 0x55ac4d19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb67f7fe640 1 -- 172.21.15.12:0/2170667982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac4d18e230 con 0x55ac4d194370 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb67effd640 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d19c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.748+0000 7fb6767fc640 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 0x55ac4d19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb67f7fe640 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18da30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb678005d50 tx=0x7fb678009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f355ab1b2f9c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb65effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb65effd640 1 -- 172.21.15.12:0/2170667982 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678031c30 con 0x55ac4d194370 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb65effd640 1 -- 172.21.15.12:0/2170667982 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fb67804b040 con 0x55ac4d194370 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb687df9740 1 -- 172.21.15.12:0/2170667982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb678036050 con 0x55ac4d194370 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb65effd640 1 -- 172.21.15.12:0/2170667982 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb678004c80 con 0x55ac4d194370 2024-09-19T06:45:08.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb687df9740 10 client.16884 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb687df9740 1 -- 172.21.15.12:0/2170667982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ac4d20e990 con 0x55ac4d194370 2024-09-19T06:45:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb65effd640 1 -- 172.21.15.12:0/2170667982 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb678036050 con 0x55ac4d194370 2024-09-19T06:45:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb65effd640 1 -- 172.21.15.12:0/2170667982 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fb678042040 con 0x55ac4d194370 2024-09-19T06:45:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb687df9740 10 client.16884 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb687df9740 10 client.16884 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:45:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb687df9740 20 client.16884 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.749+0000 7fb687df9740 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ac4d20ec10 0x55ac4d211000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.750+0000 7fb687df9740 4 client.16884 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:45:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.750+0000 7fb687df9740 1 -- 172.21.15.12:0/2170667982 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ac4d0f6d70 con 0x55ac4d20ec10 2024-09-19T06:45:08.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.750+0000 7fb67effd640 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ac4d20ec10 0x55ac4d211000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.750+0000 7fb67effd640 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ac4d20ec10 0x55ac4d211000 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8e7512b716703dc server_cookie=3ab05a153513ca37 in_seq=0 out_seq=0 2024-09-19T06:45:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.750+0000 7fb65effd640 10 client.16884 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:45:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.750+0000 7fb65effd640 1 -- 172.21.15.12:0/2170667982 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ac4d0f6d70 con 0x55ac4d20ec10 2024-09-19T06:45:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.750+0000 7fb65effd640 10 client.16884 handle_command_reply: tid=0 2024-09-19T06:45:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.750+0000 7fb687df9740 1 client.16884 shutdown 2024-09-19T06:45:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.750+0000 7fb687df9740 1 -- 172.21.15.12:0/2170667982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 msgr2=0x55ac4d18da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb687df9740 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18da30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb678005d50 tx=0x7fb678009880 comp rx=0 tx=0).stop 2024-09-19T06:45:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb687df9740 1 -- 172.21.15.12:0/2170667982 shutdown_connections 2024-09-19T06:45:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb687df9740 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55ac4d20ec10 0x55ac4d211000 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb687df9740 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ac4d194370 0x55ac4d18da30 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb687df9740 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ac4d18ab40 0x55ac4d19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb687df9740 1 --2- 172.21.15.12:0/2170667982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac4d1895d0 0x55ac4d19c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb65effd640 0 client.16884 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:45:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb687df9740 1 -- 172.21.15.12:0/2170667982 >> 172.21.15.12:0/2170667982 conn(0x55ac4d152310 msgr2=0x55ac4d192870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb687df9740 1 -- 172.21.15.12:0/2170667982 shutdown_connections 2024-09-19T06:45:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb687df9740 1 -- 172.21.15.12:0/2170667982 wait complete. 2024-09-19T06:45:08.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb687df9740 20 client.16884 trim_cache size 0 max 16384 2024-09-19T06:45:08.758 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:45:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb685a20640 1 -- 172.21.15.12:0/3009002409 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb66c0a33b0 msgr2=0x7fb66c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb685a20640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb66c0a33b0 0x7fb66c0a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb678049000 tx=0x7fb67804a000 comp rx=0 tx=0).stop 2024-09-19T06:45:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb685a20640 1 -- 172.21.15.12:0/3009002409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680100a80 msgr2=0x7fb680197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.751+0000 7fb685a20640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680100a80 0x7fb680197260 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb67000d950 tx=0x7fb67000de10 comp rx=0 tx=0).stop 2024-09-19T06:45:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.752+0000 7fb685a20640 1 -- 172.21.15.12:0/3009002409 shutdown_connections 2024-09-19T06:45:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.752+0000 7fb685a20640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb66c0a33b0 0x7fb66c0a5870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.752+0000 7fb685a20640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb680106a80 0x7fb68019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.752+0000 7fb685a20640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb680101420 0x7fb6801977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.752+0000 7fb685a20640 1 --2- 172.21.15.12:0/3009002409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb680100a80 0x7fb680197260 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:08.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.752+0000 7fb685a20640 1 -- 172.21.15.12:0/3009002409 >> 172.21.15.12:0/3009002409 conn(0x7fb6800fc7a0 msgr2=0x7fb6800fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:08.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.752+0000 7fb685a20640 1 -- 172.21.15.12:0/3009002409 shutdown_connections 2024-09-19T06:45:08.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:08.752+0000 7fb685a20640 1 -- 172.21.15.12:0/3009002409 wait complete. 2024-09-19T06:45:09.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:09 smithi012 ceph-mon[30937]: pgmap v153: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 1.34k op/s 2024-09-19T06:45:09.634 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:09 smithi173 ceph-mon[35349]: pgmap v153: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 1.34k op/s 2024-09-19T06:45:09.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:45:09.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:09 smithi016 ceph-mon[34911]: pgmap v153: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 1.34k op/s 2024-09-19T06:45:09.925 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:10.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.409+0000 7f155a772640 1 -- 172.21.15.12:0/3169359690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15541036c0 msgr2=0x7f155410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.409+0000 7f155a772640 1 --2- 172.21.15.12:0/3169359690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15541036c0 0x7f155410bbb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1548009900 tx=0x7f154802a480 comp rx=0 tx=0).stop 2024-09-19T06:45:10.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.409+0000 7f155a772640 1 -- 172.21.15.12:0/3169359690 shutdown_connections 2024-09-19T06:45:10.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.409+0000 7f155a772640 1 --2- 172.21.15.12:0/3169359690 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f155410c180 0x7f155410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.409+0000 7f155a772640 1 --2- 172.21.15.12:0/3169359690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15541036c0 0x7f155410bbb0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.409+0000 7f155a772640 1 --2- 172.21.15.12:0/3169359690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1554102da0 0x7f1554103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.409+0000 7f155a772640 1 -- 172.21.15.12:0/3169359690 >> 172.21.15.12:0/3169359690 conn(0x7f15540fc7a0 msgr2=0x7f15540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.409+0000 7f155a772640 1 -- 172.21.15.12:0/3169359690 shutdown_connections 2024-09-19T06:45:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.409+0000 7f155a772640 1 -- 172.21.15.12:0/3169359690 wait complete. 2024-09-19T06:45:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.410+0000 7f155a772640 1 Processor -- start 2024-09-19T06:45:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.410+0000 7f155a772640 1 -- start start 2024-09-19T06:45:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f155a772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1554102da0 0x7f1554198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f155a772640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15541036c0 0x7f1554198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f155a772640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f155410c180 0x7f155419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f155a772640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1554112020 con 0x7f1554102da0 2024-09-19T06:45:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f155a772640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1554111ea0 con 0x7f155410c180 2024-09-19T06:45:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f155a772640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f15541121a0 con 0x7f15541036c0 2024-09-19T06:45:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f1553fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1554102da0 0x7f1554198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f1553fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1554102da0 0x7f1554198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49842/0 (socket says 172.21.15.12:49842) 2024-09-19T06:45:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f1553fff640 1 -- 172.21.15.12:0/1437864967 learned_addr learned my addr 172.21.15.12:0/1437864967 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f1558d0f640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f155410c180 0x7f155419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f15537fe640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15541036c0 0x7f1554198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f1553fff640 1 -- 172.21.15.12:0/1437864967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15541036c0 msgr2=0x7f1554198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f1553fff640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15541036c0 0x7f1554198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f1553fff640 1 -- 172.21.15.12:0/1437864967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f155410c180 msgr2=0x7f155419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f1553fff640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f155410c180 0x7f155419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f1553fff640 1 -- 172.21.15.12:0/1437864967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155419d5b0 con 0x7f1554102da0 2024-09-19T06:45:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f1553fff640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1554102da0 0x7f1554198600 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f154400b4a0 tx=0x7f154400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f15517fa640 1 -- 172.21.15.12:0/1437864967 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544014070 con 0x7f1554102da0 2024-09-19T06:45:10.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f155a772640 1 -- 172.21.15.12:0/1437864967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155419d8a0 con 0x7f1554102da0 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f15517fa640 1 -- 172.21.15.12:0/1437864967 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1544010af0 con 0x7f1554102da0 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f15517fa640 1 -- 172.21.15.12:0/1437864967 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544017d10 con 0x7f1554102da0 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.411+0000 7f155a772640 1 -- 172.21.15.12:0/1437864967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15541a5180 con 0x7f1554102da0 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.414+0000 7f15517fa640 1 -- 172.21.15.12:0/1437864967 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1544017070 con 0x7f1554102da0 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.414+0000 7f155cb4b740 1 Processor -- start 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.414+0000 7f155cb4b740 1 -- start start 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.414+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab9695090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.414+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab9695a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.414+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96a4780 0x556ab96a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.414+0000 7f155cb4b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556ab95fb2f0 con 0x556ab9696b40 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.414+0000 7f155cb4b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556ab95a2cf0 con 0x556ab96a4780 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.414+0000 7f155cb4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556ab95f72b0 con 0x556ab96955d0 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1558d0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab9695090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1558d0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab9695090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49850/0 (socket says 172.21.15.12:49850) 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1558d0f640 1 -- 172.21.15.12:0/894309415 learned_addr learned my addr 172.21.15.12:0/894309415 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1553fff640 1 --2- 172.21.15.12:0/894309415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab9695a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f15537fe640 1 --2- 172.21.15.12:0/894309415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96a4780 0x556ab96a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1558d0f640 1 -- 172.21.15.12:0/894309415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 msgr2=0x556ab9695a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1558d0f640 1 --2- 172.21.15.12:0/894309415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab9695a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1558d0f640 1 -- 172.21.15.12:0/894309415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96a4780 msgr2=0x556ab96a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1558d0f640 1 --2- 172.21.15.12:0/894309415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96a4780 0x556ab96a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1558d0f640 1 -- 172.21.15.12:0/894309415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab95873a0 con 0x556ab9696b40 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f15517fa640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f153c0a33b0 0x7f153c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1553fff640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f153c0a33b0 0x7f153c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f1558d0f640 1 --2- 172.21.15.12:0/894309415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab9695090 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f154c00a430 tx=0x7f154c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db4bb0a51f53321 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f15517fa640 1 -- 172.21.15.12:0/1437864967 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f15440cf060 con 0x7f1554102da0 2024-09-19T06:45:10.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f153a7fc640 1 -- 172.21.15.12:0/894309415 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c013790 con 0x556ab9696b40 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f153a7fc640 1 -- 172.21.15.12:0/894309415 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f154c019070 con 0x556ab9696b40 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.415+0000 7f153a7fc640 1 -- 172.21.15.12:0/894309415 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c014e10 con 0x556ab9696b40 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f155cb4b740 1 -- 172.21.15.12:0/894309415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 msgr2=0x556ab9695090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f1553fff640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f153c0a33b0 0x7f153c0a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f15440cc8f0 tx=0x7f1544000bc0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f155cb4b740 1 --2- 172.21.15.12:0/894309415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab9695090 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f154c00a430 tx=0x7f154c009650 comp rx=0 tx=0).stop 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f155cb4b740 1 -- 172.21.15.12:0/894309415 shutdown_connections 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f155cb4b740 1 --2- 172.21.15.12:0/894309415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96a4780 0x556ab96a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f155cb4b740 1 --2- 172.21.15.12:0/894309415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab9695a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f155cb4b740 1 --2- 172.21.15.12:0/894309415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab9695090 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f155cb4b740 1 -- 172.21.15.12:0/894309415 >> 172.21.15.12:0/894309415 conn(0x556ab965e310 msgr2=0x556ab9691c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f155cb4b740 1 -- 172.21.15.12:0/894309415 shutdown_connections 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f155cb4b740 1 -- 172.21.15.12:0/894309415 wait complete. 2024-09-19T06:45:10.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.416+0000 7f155cb4b740 1 -- start start 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f155cb4b740 1 Processor -- start 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab96a4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab9696b40 0x556ab96a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab96a4780 0x556ab96a1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f155cb4b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556ab96a7480 con 0x556ab96a4780 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f155cb4b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556ab95b6060 con 0x556ab9696b40 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f155cb4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556ab96a7600 con 0x556ab96955d0 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f155cb4b740 10 client.0 _ll_register_callbacks cb 0x556ab93098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f1558d0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab96a4780 0x556ab96a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f1558d0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab96a4780 0x556ab96a1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49856/0 (socket says 172.21.15.12:49856) 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f1558d0f640 1 -- 172.21.15.12:0/4096370933 learned_addr learned my addr 172.21.15.12:0/4096370933 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f1558d0f640 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab96a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f15537fe640 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab9696b40 0x556ab96a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f1558d0f640 1 -- 172.21.15.12:0/4096370933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 msgr2=0x556ab96a4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f1558d0f640 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab96a4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f1558d0f640 1 -- 172.21.15.12:0/4096370933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab9696b40 msgr2=0x556ab96a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f1558d0f640 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab9696b40 0x556ab96a13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.417+0000 7f1558d0f640 1 -- 172.21.15.12:0/4096370933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab936c3c0 con 0x556ab96a4780 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f1558d0f640 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab96a4780 0x556ab96a1980 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f154c007090 tx=0x7f154c0149f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41c2d745b6a76c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f15337fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f15337fe640 1 -- 172.21.15.12:0/4096370933 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c014d90 con 0x556ab96a4780 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f15337fe640 1 -- 172.21.15.12:0/4096370933 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f154c013590 con 0x556ab96a4780 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f155cb4b740 1 -- 172.21.15.12:0/4096370933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f154c019070 con 0x556ab96a4780 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f15337fe640 1 -- 172.21.15.12:0/4096370933 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f154c033050 con 0x556ab96a4780 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f155cb4b740 10 client.16896 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f155cb4b740 1 -- 172.21.15.12:0/4096370933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556ab96b2ed0 con 0x556ab96a4780 2024-09-19T06:45:10.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f15337fe640 1 -- 172.21.15.12:0/4096370933 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f154c019070 con 0x556ab96a4780 2024-09-19T06:45:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f15337fe640 1 -- 172.21.15.12:0/4096370933 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f154c01d9e0 con 0x556ab96a4780 2024-09-19T06:45:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f155cb4b740 10 client.16896 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f155cb4b740 10 client.16896 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:45:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f155cb4b740 20 client.16896 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:10.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f155cb4b740 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x556ab96b4220 0x556ab96b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f155cb4b740 4 client.16896 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.418+0000 7f155cb4b740 1 -- 172.21.15.12:0/4096370933 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ab9608860 con 0x556ab96b4220 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.419+0000 7f15537fe640 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x556ab96b4220 0x556ab96b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.419+0000 7f15337fe640 10 client.16896 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.419+0000 7f15537fe640 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x556ab96b4220 0x556ab96b6610 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a5cc527f7b49ce9d server_cookie=4ee6e3cd7551596f in_seq=0 out_seq=0 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f15337fe640 1 -- 172.21.15.12:0/4096370933 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ab9608860 con 0x556ab96b4220 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f15337fe640 10 client.16896 handle_command_reply: tid=0 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 client.16896 shutdown 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 -- 172.21.15.12:0/4096370933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab96a4780 msgr2=0x556ab96a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab96a4780 0x556ab96a1980 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f154c007090 tx=0x7f154c0149f0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 -- 172.21.15.12:0/4096370933 shutdown_connections 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x556ab96b4220 0x556ab96b6610 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab96a4780 0x556ab96a1980 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab9696b40 0x556ab96a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 --2- 172.21.15.12:0/4096370933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab96a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 -- 172.21.15.12:0/4096370933 >> 172.21.15.12:0/4096370933 conn(0x556ab965e310 msgr2=0x556ab9697960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:10.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f15337fe640 0 client.16896 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:45:10.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 -- 172.21.15.12:0/4096370933 shutdown_connections 2024-09-19T06:45:10.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 1 -- 172.21.15.12:0/4096370933 wait complete. 2024-09-19T06:45:10.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.420+0000 7f155cb4b740 20 client.16896 trim_cache size 0 max 16384 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.433+0000 7f155cb4b740 1 Processor -- start 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.433+0000 7f155cb4b740 1 -- start start 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96955d0 0x556ab96b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab969c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96a4780 0x556ab96a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f155cb4b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f15541aba10 con 0x556ab9696b40 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f155cb4b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f15541ad580 con 0x556ab96955d0 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f155cb4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f15541ac0e0 con 0x556ab96a4780 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f15537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab969c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f15537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab969c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49862/0 (socket says 172.21.15.12:49862) 2024-09-19T06:45:10.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f15537fe640 1 -- 172.21.15.12:0/1320683747 learned_addr learned my addr 172.21.15.12:0/1320683747 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f15537fe640 1 -- 172.21.15.12:0/1320683747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96a4780 msgr2=0x556ab96a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f1558d0f640 1 --2- 172.21.15.12:0/1320683747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96955d0 0x556ab96b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f15537fe640 1 --2- 172.21.15.12:0/1320683747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96a4780 0x556ab96a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f15537fe640 1 -- 172.21.15.12:0/1320683747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96955d0 msgr2=0x556ab96b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f15537fe640 1 --2- 172.21.15.12:0/1320683747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96955d0 0x556ab96b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f15537fe640 1 -- 172.21.15.12:0/1320683747 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab9698120 con 0x556ab9696b40 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f1558d0f640 1 --2- 172.21.15.12:0/1320683747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96955d0 0x556ab96b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f15537fe640 1 --2- 172.21.15.12:0/1320683747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab969c720 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1548009900 tx=0x7f1548009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4704bc79f59aaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f1539ffb640 1 -- 172.21.15.12:0/1320683747 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548035040 con 0x556ab9696b40 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.434+0000 7f1539ffb640 1 -- 172.21.15.12:0/1320683747 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1548031a50 con 0x556ab9696b40 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f1539ffb640 1 -- 172.21.15.12:0/1320683747 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15480047a0 con 0x556ab9696b40 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f155cb4b740 1 -- 172.21.15.12:0/1320683747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 msgr2=0x556ab969c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f155cb4b740 1 --2- 172.21.15.12:0/1320683747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab969c720 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1548009900 tx=0x7f1548009560 comp rx=0 tx=0).stop 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f155cb4b740 1 -- 172.21.15.12:0/1320683747 shutdown_connections 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f155cb4b740 1 --2- 172.21.15.12:0/1320683747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96a4780 0x556ab96a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f155cb4b740 1 --2- 172.21.15.12:0/1320683747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab969c720 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f155cb4b740 1 --2- 172.21.15.12:0/1320683747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96955d0 0x556ab96b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f155cb4b740 1 -- 172.21.15.12:0/1320683747 >> 172.21.15.12:0/1320683747 conn(0x556ab965e310 msgr2=0x556ab969fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f155cb4b740 1 -- 172.21.15.12:0/1320683747 shutdown_connections 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f155cb4b740 1 -- 172.21.15.12:0/1320683747 wait complete. 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.435+0000 7f155cb4b740 1 -- start start 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f155cb4b740 1 Processor -- start 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab96ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab96a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f155cb4b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96a4780 0x556ab96a8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f155cb4b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f15541aceb0 con 0x556ab9696b40 2024-09-19T06:45:10.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f155cb4b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f15541ac7b0 con 0x556ab96a4780 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f155cb4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f15541a99f0 con 0x556ab96955d0 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f155cb4b740 10 client.0 _ll_register_callbacks cb 0x7f154c009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f15537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab96a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f15537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab96a81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49868/0 (socket says 172.21.15.12:49868) 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f15537fe640 1 -- 172.21.15.12:0/3513383789 learned_addr learned my addr 172.21.15.12:0/3513383789 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f1558d0f640 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96a4780 0x556ab96a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f1558d0f640 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab96ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f15537fe640 1 -- 172.21.15.12:0/3513383789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 msgr2=0x556ab96ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f15537fe640 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab96ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f15537fe640 1 -- 172.21.15.12:0/3513383789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96a4780 msgr2=0x556ab96a8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f15537fe640 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96a4780 0x556ab96a8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.436+0000 7f15537fe640 1 -- 172.21.15.12:0/3513383789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab96a8d50 con 0x556ab9696b40 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f15537fe640 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab96a81d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f154802a4c0 tx=0x7f1548005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fe7e4a6c314a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f15337fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f15337fe640 1 -- 172.21.15.12:0/3513383789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548035030 con 0x556ab9696b40 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f15337fe640 1 -- 172.21.15.12:0/3513383789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f1548042040 con 0x556ab9696b40 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f155cb4b740 1 -- 172.21.15.12:0/3513383789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1548031a50 con 0x556ab9696b40 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f15337fe640 1 -- 172.21.15.12:0/3513383789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1548005210 con 0x556ab9696b40 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f155cb4b740 10 client.16902 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f155cb4b740 1 -- 172.21.15.12:0/3513383789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556ab971ea80 con 0x556ab9696b40 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f15337fe640 1 -- 172.21.15.12:0/3513383789 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1548031a50 con 0x556ab9696b40 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f15337fe640 1 -- 172.21.15.12:0/3513383789 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f15480035f0 con 0x556ab9696b40 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f155cb4b740 10 client.16902 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f155cb4b740 10 client.16902 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f155cb4b740 20 client.16902 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:10.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f155cb4b740 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x556ab971f1a0 0x556ab97215c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f155cb4b740 4 client.16902 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.437+0000 7f155cb4b740 1 -- 172.21.15.12:0/3513383789 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ab9602d70 con 0x556ab971f1a0 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.438+0000 7f1558d0f640 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x556ab971f1a0 0x556ab97215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.438+0000 7f1558d0f640 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x556ab971f1a0 0x556ab97215c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4977e16c1502bf2d server_cookie=27b968645c0404f3 in_seq=0 out_seq=0 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.438+0000 7f15337fe640 10 client.16902 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.438+0000 7f15337fe640 1 -- 172.21.15.12:0/3513383789 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ab9602d70 con 0x556ab971f1a0 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.438+0000 7f15337fe640 10 client.16902 handle_command_reply: tid=0 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.438+0000 7f155cb4b740 1 client.16902 shutdown 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 1 -- 172.21.15.12:0/3513383789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 msgr2=0x556ab96a81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab96a81d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f154802a4c0 tx=0x7f1548005020 comp rx=0 tx=0).stop 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 1 -- 172.21.15.12:0/3513383789 shutdown_connections 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x556ab971f1a0 0x556ab97215c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ab96a4780 0x556ab96a8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ab9696b40 0x556ab96a81d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 1 --2- 172.21.15.12:0/3513383789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ab96955d0 0x556ab96ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 1 -- 172.21.15.12:0/3513383789 >> 172.21.15.12:0/3513383789 conn(0x556ab965e310 msgr2=0x556ab96a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:10.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f15337fe640 0 client.16902 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:45:10.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 1 -- 172.21.15.12:0/3513383789 shutdown_connections 2024-09-19T06:45:10.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 1 -- 172.21.15.12:0/3513383789 wait complete. 2024-09-19T06:45:10.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155cb4b740 20 client.16902 trim_cache size 0 max 16384 2024-09-19T06:45:10.455 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:45:10.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155a772640 1 -- 172.21.15.12:0/1437864967 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f153c0a33b0 msgr2=0x7f153c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155a772640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f153c0a33b0 0x7f153c0a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f15440cc8f0 tx=0x7f1544000bc0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155a772640 1 -- 172.21.15.12:0/1437864967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1554102da0 msgr2=0x7f1554198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:10.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155a772640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1554102da0 0x7f1554198600 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f154400b4a0 tx=0x7f154400b960 comp rx=0 tx=0).stop 2024-09-19T06:45:10.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155a772640 1 -- 172.21.15.12:0/1437864967 shutdown_connections 2024-09-19T06:45:10.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155a772640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f155410c180 0x7f155419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155a772640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f153c0a33b0 0x7f153c0a5870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155a772640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15541036c0 0x7f1554198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155a772640 1 --2- 172.21.15.12:0/1437864967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1554102da0 0x7f1554198600 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:10.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.439+0000 7f155a772640 1 -- 172.21.15.12:0/1437864967 >> 172.21.15.12:0/1437864967 conn(0x7f15540fc7a0 msgr2=0x7f15540fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:10.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.440+0000 7f155a772640 1 -- 172.21.15.12:0/1437864967 shutdown_connections 2024-09-19T06:45:10.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:10.440+0000 7f155a772640 1 -- 172.21.15.12:0/1437864967 wait complete. 2024-09-19T06:45:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 265.0 s, 283.7 tps, lat 27.599 ms stddev 29.385 2024-09-19T06:45:11.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:45:11.388 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:11.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:11 smithi012 ceph-mon[30937]: pgmap v154: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 1.49k op/s 2024-09-19T06:45:11.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:11 smithi016 ceph-mon[34911]: pgmap v154: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 1.49k op/s 2024-09-19T06:45:11.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:11 smithi173 ceph-mon[35349]: pgmap v154: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 1.49k op/s 2024-09-19T06:45:11.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.965+0000 7f02984b0640 1 -- 172.21.15.12:0/3208039235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0290102570 msgr2=0x7f02901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:11.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.965+0000 7f02984b0640 1 --2- 172.21.15.12:0/3208039235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0290102570 0x7f02901029b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0280009900 tx=0x7f028002a480 comp rx=0 tx=0).stop 2024-09-19T06:45:11.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.965+0000 7f02984b0640 1 -- 172.21.15.12:0/3208039235 shutdown_connections 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.965+0000 7f02984b0640 1 --2- 172.21.15.12:0/3208039235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0290102ef0 0x7f029010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.965+0000 7f02984b0640 1 --2- 172.21.15.12:0/3208039235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0290102570 0x7f02901029b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.965+0000 7f02984b0640 1 --2- 172.21.15.12:0/3208039235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0290100e20 0x7f0290101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.965+0000 7f02984b0640 1 -- 172.21.15.12:0/3208039235 >> 172.21.15.12:0/3208039235 conn(0x7f02900fc7d0 msgr2=0x7f02900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.965+0000 7f02984b0640 1 -- 172.21.15.12:0/3208039235 shutdown_connections 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.965+0000 7f02984b0640 1 -- 172.21.15.12:0/3208039235 wait complete. 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f02984b0640 1 Processor -- start 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f02984b0640 1 -- start start 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f02984b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0290100e20 0x7f02901a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f02984b0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0290102570 0x7f02901a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f02984b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0290102ef0 0x7f029019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f02984b0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f02901120a0 con 0x7f0290102ef0 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f02984b0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0290111f20 con 0x7f0290100e20 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f02984b0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0290112220 con 0x7f0290102570 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f0296a4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0290102ef0 0x7f029019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f0296a4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0290102ef0 0x7f029019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39480/0 (socket says 172.21.15.12:39480) 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f0296a4d640 1 -- 172.21.15.12:0/521518519 learned_addr learned my addr 172.21.15.12:0/521518519 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f0295a4b640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0290102570 0x7f02901a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f029624c640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0290100e20 0x7f02901a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f0296a4d640 1 -- 172.21.15.12:0/521518519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0290102570 msgr2=0x7f02901a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f0296a4d640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0290102570 0x7f02901a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f0296a4d640 1 -- 172.21.15.12:0/521518519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0290100e20 msgr2=0x7f02901a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f0296a4d640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0290100e20 0x7f02901a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.966+0000 7f0296a4d640 1 -- 172.21.15.12:0/521518519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029019ad00 con 0x7f0290102ef0 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.967+0000 7f0296a4d640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0290102ef0 0x7f029019a5d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f028800cce0 tx=0x7f028800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.967+0000 7f02877fe640 1 -- 172.21.15.12:0/521518519 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028800f450 con 0x7f0290102ef0 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.967+0000 7f02984b0640 1 -- 172.21.15.12:0/521518519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029019aff0 con 0x7f0290102ef0 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.967+0000 7f02877fe640 1 -- 172.21.15.12:0/521518519 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f028800fad0 con 0x7f0290102ef0 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.967+0000 7f02877fe640 1 -- 172.21.15.12:0/521518519 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288018b60 con 0x7f0290102ef0 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.967+0000 7f02984b0640 1 -- 172.21.15.12:0/521518519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02901a72e0 con 0x7f0290102ef0 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.969+0000 7f02877fe640 1 -- 172.21.15.12:0/521518519 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f028800fc80 con 0x7f0290102ef0 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.969+0000 7f029a889740 1 Processor -- start 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.969+0000 7f029a889740 1 -- start start 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029a889740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563366870b40 0x56336686f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029a889740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56336686f5d0 0x56336686fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029a889740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x56336687c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029a889740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5633667d52f0 con 0x563366870b40 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029a889740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56336677ccf0 con 0x56336686f5d0 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029a889740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5633667d12b0 con 0x56336687a370 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f0295a4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563366870b40 0x56336686f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f0295a4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563366870b40 0x56336686f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39484/0 (socket says 172.21.15.12:39484) 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f0295a4b640 1 -- 172.21.15.12:0/533831089 learned_addr learned my addr 172.21.15.12:0/533831089 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029624c640 1 --2- 172.21.15.12:0/533831089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56336686f5d0 0x56336686fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f0295a4b640 1 --2- 172.21.15.12:0/533831089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x56336687c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f02877fe640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f027c0a33b0 0x7f027c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029624c640 1 -- 172.21.15.12:0/533831089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 msgr2=0x56336687c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029624c640 1 --2- 172.21.15.12:0/533831089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x56336687c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029624c640 1 -- 172.21.15.12:0/533831089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563366870b40 msgr2=0x56336686f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029624c640 1 --2- 172.21.15.12:0/533831089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563366870b40 0x56336686f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f029624c640 1 -- 172.21.15.12:0/533831089 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633667613a0 con 0x56336686f5d0 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f0296a4d640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f027c0a33b0 0x7f027c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.970+0000 7f0295a4b640 1 --2- 172.21.15.12:0/533831089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563366870b40 0x56336686f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.971+0000 7f02877fe640 1 -- 172.21.15.12:0/521518519 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f02880d0250 con 0x7f0290102ef0 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.971+0000 7f029624c640 1 --2- 172.21.15.12:0/533831089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56336686f5d0 0x56336686fa10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f028c0099a0 tx=0x7f028c009e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa450ee3aead925 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.971+0000 7f0284ff9640 1 -- 172.21.15.12:0/533831089 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c017070 con 0x56336686f5d0 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.971+0000 7f0284ff9640 1 -- 172.21.15.12:0/533831089 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f028c013470 con 0x56336686f5d0 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.971+0000 7f0284ff9640 1 -- 172.21.15.12:0/533831089 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c0125f0 con 0x56336686f5d0 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 -- 172.21.15.12:0/533831089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56336686f5d0 msgr2=0x56336686fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f0296a4d640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f027c0a33b0 0x7f027c0a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f028809c1b0 tx=0x7f0288018400 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 --2- 172.21.15.12:0/533831089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56336686f5d0 0x56336686fa10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f028c0099a0 tx=0x7f028c009e60 comp rx=0 tx=0).stop 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 -- 172.21.15.12:0/533831089 shutdown_connections 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 --2- 172.21.15.12:0/533831089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x56336687c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 --2- 172.21.15.12:0/533831089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56336686f5d0 0x56336686fa10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 --2- 172.21.15.12:0/533831089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563366870b40 0x56336686f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 -- 172.21.15.12:0/533831089 >> 172.21.15.12:0/533831089 conn(0x563366838310 msgr2=0x56336686bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 -- 172.21.15.12:0/533831089 shutdown_connections 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 -- 172.21.15.12:0/533831089 wait complete. 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 -- start start 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.972+0000 7f029a889740 1 Processor -- start 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f029a889740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336686f5d0 0x563366879ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f029a889740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x563366876f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f029a889740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336687a370 0x563366877490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f029a889740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56336687d070 con 0x56336687a370 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f029a889740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563366790060 con 0x563366870b40 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f029a889740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56336687d1f0 con 0x56336686f5d0 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f029a889740 10 client.0 _ll_register_callbacks cb 0x5633664e38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0295a4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336687a370 0x563366877490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0295a4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336687a370 0x563366877490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39500/0 (socket says 172.21.15.12:39500) 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0295a4b640 1 -- 172.21.15.12:0/3056075287 learned_addr learned my addr 172.21.15.12:0/3056075287 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0295a4b640 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336686f5d0 0x563366879ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f029624c640 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x563366876f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0295a4b640 1 -- 172.21.15.12:0/3056075287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336686f5d0 msgr2=0x563366879ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0295a4b640 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336686f5d0 0x563366879ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0295a4b640 1 -- 172.21.15.12:0/3056075287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 msgr2=0x563366876f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0295a4b640 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x563366876f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0295a4b640 1 -- 172.21.15.12:0/3056075287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633665463c0 con 0x56336687a370 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0295a4b640 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336687a370 0x563366877490 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f02800038f0 tx=0x7f02800058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dabd10e5fa62ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.973+0000 7f0279ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f0279ffb640 1 -- 172.21.15.12:0/3056075287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280046040 con 0x56336687a370 2024-09-19T06:45:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f0279ffb640 1 -- 172.21.15.12:0/3056075287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0280031540 con 0x56336687a370 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f029a889740 1 -- 172.21.15.12:0/3056075287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f028c013470 con 0x56336687a370 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f0279ffb640 1 -- 172.21.15.12:0/3056075287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0280052050 con 0x56336687a370 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f029a889740 10 client.16914 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f029a889740 1 -- 172.21.15.12:0/3056075287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563366888a90 con 0x56336687a370 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f0279ffb640 1 -- 172.21.15.12:0/3056075287 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f028c013470 con 0x56336687a370 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f0279ffb640 1 -- 172.21.15.12:0/3056075287 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f028003b730 con 0x56336687a370 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f029a889740 10 client.16914 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f029a889740 10 client.16914 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f029a889740 20 client.16914 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f029a889740 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x563366889ea0 0x56336688c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f029a889740 4 client.16914 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.974+0000 7f029a889740 1 -- 172.21.15.12:0/3056075287 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633667e2860 con 0x563366889ea0 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.975+0000 7f029624c640 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x563366889ea0 0x56336688c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:11.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.975+0000 7f029624c640 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x563366889ea0 0x56336688c2b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cda2ca35be8e099 server_cookie=fe7d4a0dad20693a in_seq=0 out_seq=0 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.975+0000 7f0279ffb640 10 client.16914 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f0279ffb640 1 -- 172.21.15.12:0/3056075287 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633667e2860 con 0x563366889ea0 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f0279ffb640 10 client.16914 handle_command_reply: tid=0 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 client.16914 shutdown 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 -- 172.21.15.12:0/3056075287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336687a370 msgr2=0x563366877490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336687a370 0x563366877490 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f02800038f0 tx=0x7f02800058d0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 -- 172.21.15.12:0/3056075287 shutdown_connections 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x563366889ea0 0x56336688c2b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336687a370 0x563366877490 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x563366876f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 --2- 172.21.15.12:0/3056075287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336686f5d0 0x563366879ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 -- 172.21.15.12:0/3056075287 >> 172.21.15.12:0/3056075287 conn(0x563366838310 msgr2=0x563366871930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:12.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f0279ffb640 0 client.16914 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 -- 172.21.15.12:0/3056075287 shutdown_connections 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 1 -- 172.21.15.12:0/3056075287 wait complete. 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.976+0000 7f029a889740 20 client.16914 trim_cache size 0 max 16384 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.989+0000 7f029a889740 1 Processor -- start 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.989+0000 7f029a889740 1 -- start start 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f029a889740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366886340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f029a889740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x56336686b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f029a889740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x56336687b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f029a889740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f02901afc60 con 0x56336686f5d0 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f029a889740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f02901b17d0 con 0x563366870b40 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f029a889740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f02901b0330 con 0x56336687a370 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f0295a4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366886340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f0295a4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366886340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39506/0 (socket says 172.21.15.12:39506) 2024-09-19T06:45:12.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f0295a4b640 1 -- 172.21.15.12:0/1758037011 learned_addr learned my addr 172.21.15.12:0/1758037011 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:12.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f029624c640 1 --2- 172.21.15.12:0/1758037011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x56336686b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f0295a4b640 1 -- 172.21.15.12:0/1758037011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 msgr2=0x56336687b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:12.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f0295a4b640 1 --2- 172.21.15.12:0/1758037011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x56336687b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f0295a4b640 1 -- 172.21.15.12:0/1758037011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 msgr2=0x56336686b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:12.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f0295a4b640 1 --2- 172.21.15.12:0/1758037011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x56336686b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f0295a4b640 1 -- 172.21.15.12:0/1758037011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563366872ae0 con 0x56336686f5d0 2024-09-19T06:45:12.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f0295a4b640 1 --2- 172.21.15.12:0/1758037011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366886340 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f028003a3e0 tx=0x7f0280005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a8206d17327281 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:12.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.990+0000 7f027bfff640 1 -- 172.21.15.12:0/1758037011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280035040 con 0x56336686f5d0 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f027bfff640 1 -- 172.21.15.12:0/1758037011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0280005500 con 0x56336686f5d0 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f027bfff640 1 -- 172.21.15.12:0/1758037011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280004a00 con 0x56336686f5d0 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f029a889740 1 -- 172.21.15.12:0/1758037011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 msgr2=0x563366886340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f029a889740 1 --2- 172.21.15.12:0/1758037011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366886340 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f028003a3e0 tx=0x7f0280005c00 comp rx=0 tx=0).stop 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f029a889740 1 -- 172.21.15.12:0/1758037011 shutdown_connections 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f029a889740 1 --2- 172.21.15.12:0/1758037011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x56336687b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f029a889740 1 --2- 172.21.15.12:0/1758037011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x56336686b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f029a889740 1 --2- 172.21.15.12:0/1758037011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366886340 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f029a889740 1 -- 172.21.15.12:0/1758037011 >> 172.21.15.12:0/1758037011 conn(0x563366838310 msgr2=0x563366876f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f029a889740 1 -- 172.21.15.12:0/1758037011 shutdown_connections 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.991+0000 7f029a889740 1 -- 172.21.15.12:0/1758037011 wait complete. 2024-09-19T06:45:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f029a889740 1 -- start start 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f029a889740 1 Processor -- start 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f029a889740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366874880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f029a889740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x5633668824b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f029a889740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x5633668829f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f029a889740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f02901b1100 con 0x56336686f5d0 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f029a889740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f02901b0a00 con 0x563366870b40 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f029a889740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f02901adc40 con 0x56336687a370 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f029a889740 10 client.0 _ll_register_callbacks cb 0x7f0280004200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f0295a4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366874880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f0295a4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366874880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39510/0 (socket says 172.21.15.12:39510) 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f0295a4b640 1 -- 172.21.15.12:0/3374544968 learned_addr learned my addr 172.21.15.12:0/3374544968 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f029624c640 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x5633668824b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f0295a4b640 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x5633668829f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f0295a4b640 1 -- 172.21.15.12:0/3374544968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 msgr2=0x5633668829f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f0295a4b640 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x5633668829f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f0295a4b640 1 -- 172.21.15.12:0/3374544968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 msgr2=0x5633668824b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f0295a4b640 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x5633668824b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.992+0000 7f0295a4b640 1 -- 172.21.15.12:0/3374544968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563366883030 con 0x56336686f5d0 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f0295a4b640 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366874880 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0280004550 tx=0x7f028003b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6243503cdc7532 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f0279ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f0279ffb640 1 -- 172.21.15.12:0/3374544968 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280035040 con 0x56336686f5d0 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f0279ffb640 1 -- 172.21.15.12:0/3374544968 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0280031540 con 0x56336686f5d0 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f029a889740 1 -- 172.21.15.12:0/3374544968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0280005500 con 0x56336686f5d0 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f0279ffb640 1 -- 172.21.15.12:0/3374544968 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0280005850 con 0x56336686f5d0 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f029a889740 10 client.16920 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:12.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f029a889740 1 -- 172.21.15.12:0/3374544968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5633668f4b50 con 0x56336686f5d0 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f0279ffb640 1 -- 172.21.15.12:0/3374544968 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0280005500 con 0x56336686f5d0 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f0279ffb640 1 -- 172.21.15.12:0/3374544968 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f028003a570 con 0x56336686f5d0 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f029a889740 10 client.16920 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f029a889740 10 client.16920 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.993+0000 7f029a889740 20 client.16920 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.994+0000 7f029a889740 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5633668f5170 0x5633668f7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.994+0000 7f029a889740 4 client.16920 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.994+0000 7f029a889740 1 -- 172.21.15.12:0/3374544968 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633667dcd70 con 0x5633668f5170 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.994+0000 7f029624c640 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5633668f5170 0x5633668f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.994+0000 7f0279ffb640 10 client.16920 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.994+0000 7f029624c640 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5633668f5170 0x5633668f7590 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eb11ab417dc1c8b1 server_cookie=aee4768cf6b72c58 in_seq=0 out_seq=0 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f0279ffb640 1 -- 172.21.15.12:0/3374544968 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633667dcd70 con 0x5633668f5170 2024-09-19T06:45:12.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f0279ffb640 10 client.16920 handle_command_reply: tid=0 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 client.16920 shutdown 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 -- 172.21.15.12:0/3374544968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 msgr2=0x563366874880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366874880 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0280004550 tx=0x7f028003b890 comp rx=0 tx=0).stop 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 -- 172.21.15.12:0/3374544968 shutdown_connections 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5633668f5170 0x5633668f7590 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56336687a370 0x5633668829f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563366870b40 0x5633668824b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f0279ffb640 0 client.16920 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 --2- 172.21.15.12:0/3374544968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56336686f5d0 0x563366874880 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 -- 172.21.15.12:0/3374544968 >> 172.21.15.12:0/3374544968 conn(0x563366838310 msgr2=0x5633668757e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 -- 172.21.15.12:0/3374544968 shutdown_connections 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 1 -- 172.21.15.12:0/3374544968 wait complete. 2024-09-19T06:45:12.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f029a889740 20 client.16920 trim_cache size 0 max 16384 2024-09-19T06:45:12.011 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:45:12.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f02984b0640 1 -- 172.21.15.12:0/521518519 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f027c0a33b0 msgr2=0x7f027c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f02984b0640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f027c0a33b0 0x7f027c0a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f028809c1b0 tx=0x7f0288018400 comp rx=0 tx=0).stop 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f02984b0640 1 -- 172.21.15.12:0/521518519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0290102ef0 msgr2=0x7f029019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.995+0000 7f02984b0640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0290102ef0 0x7f029019a5d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f028800cce0 tx=0x7f028800a620 comp rx=0 tx=0).stop 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.996+0000 7f02984b0640 1 -- 172.21.15.12:0/521518519 shutdown_connections 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.996+0000 7f02984b0640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0290102ef0 0x7f029019a5d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.996+0000 7f02984b0640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f027c0a33b0 0x7f027c0a5870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.996+0000 7f02984b0640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0290102570 0x7f02901a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.996+0000 7f02984b0640 1 --2- 172.21.15.12:0/521518519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0290100e20 0x7f02901a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.996+0000 7f02984b0640 1 -- 172.21.15.12:0/521518519 >> 172.21.15.12:0/521518519 conn(0x7f02900fc7d0 msgr2=0x7f0290106d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.996+0000 7f02984b0640 1 -- 172.21.15.12:0/521518519 shutdown_connections 2024-09-19T06:45:12.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:11.996+0000 7f02984b0640 1 -- 172.21.15.12:0/521518519 wait complete. 2024-09-19T06:45:12.760 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:45:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:13.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:13 smithi012 ceph-mon[30937]: pgmap v155: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 1.46k op/s 2024-09-19T06:45:13.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.455+0000 7f24d556e640 1 -- 172.21.15.12:0/1180096104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24d0100d00 msgr2=0x7f24d0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:13.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.455+0000 7f24d556e640 1 --2- 172.21.15.12:0/1180096104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24d0100d00 0x7f24d0106840 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009930 tx=0x7f24c402a420 comp rx=0 tx=0).stop 2024-09-19T06:45:13.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.455+0000 7f24d556e640 1 -- 172.21.15.12:0/1180096104 shutdown_connections 2024-09-19T06:45:13.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.455+0000 7f24d556e640 1 --2- 172.21.15.12:0/1180096104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d0106f50 0x7f24d010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.455+0000 7f24d556e640 1 --2- 172.21.15.12:0/1180096104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24d0100d00 0x7f24d0106840 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.455+0000 7f24d556e640 1 --2- 172.21.15.12:0/1180096104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d0100350 0x7f24d0100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.455+0000 7f24d556e640 1 -- 172.21.15.12:0/1180096104 >> 172.21.15.12:0/1180096104 conn(0x7f24d0077210 msgr2=0x7f24d00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.455+0000 7f24d556e640 1 -- 172.21.15.12:0/1180096104 shutdown_connections 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.455+0000 7f24d556e640 1 -- 172.21.15.12:0/1180096104 wait complete. 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.456+0000 7f24d556e640 1 Processor -- start 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.456+0000 7f24d556e640 1 -- start start 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24d556e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d0100350 0x7f24d01012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24d556e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24d0100d00 0x7f24d0101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24d556e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d0106f50 0x7f24d0101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24d556e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f24d0111fa0 con 0x7f24d0100d00 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24d556e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24d0111e20 con 0x7f24d0106f50 2024-09-19T06:45:13.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24d556e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f24d0112120 con 0x7f24d0100350 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24ce7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24d0100d00 0x7f24d0101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24ce7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24d0100d00 0x7f24d0101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39524/0 (socket says 172.21.15.12:39524) 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24ce7fc640 1 -- 172.21.15.12:0/1325442957 learned_addr learned my addr 172.21.15.12:0/1325442957 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24cf7fe640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d0106f50 0x7f24d0101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24ceffd640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d0100350 0x7f24d01012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24ce7fc640 1 -- 172.21.15.12:0/1325442957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d0100350 msgr2=0x7f24d01012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d0100350 0x7f24d01012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24ce7fc640 1 -- 172.21.15.12:0/1325442957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d0106f50 msgr2=0x7f24d0101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d0106f50 0x7f24d0101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24ce7fc640 1 -- 172.21.15.12:0/1325442957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d01a6990 con 0x7f24d0100d00 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24d0100d00 0x7f24d0101810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f24c4005940 tx=0x7f24c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.457+0000 7f24b7fff640 1 -- 172.21.15.12:0/1325442957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c403f030 con 0x7f24d0100d00 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.458+0000 7f24d556e640 1 -- 172.21.15.12:0/1325442957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d01a6c20 con 0x7f24d0100d00 2024-09-19T06:45:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.458+0000 7f24b7fff640 1 -- 172.21.15.12:0/1325442957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24c4003ad0 con 0x7f24d0100d00 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.458+0000 7f24b7fff640 1 -- 172.21.15.12:0/1325442957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4035070 con 0x7f24d0100d00 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.458+0000 7f24d556e640 1 -- 172.21.15.12:0/1325442957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d01a7150 con 0x7f24d0100d00 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.460+0000 7f24b7fff640 1 -- 172.21.15.12:0/1325442957 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f24c4042030 con 0x7f24d0100d00 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.460+0000 7f24d7947740 1 Processor -- start 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.460+0000 7f24d7947740 1 -- start start 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24d7947740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cadbb40 0x556b3cada090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24d7947740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cadaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24d7947740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 0x556b3cae7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24d7947740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556b3ca402f0 con 0x556b3cada5d0 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24d7947740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556b3c9e7cf0 con 0x556b3cae5370 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24d7947740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556b3ca3c2b0 con 0x556b3cadbb40 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24b7fff640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f24b80a33b0 0x7f24b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cadaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cadaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39536/0 (socket says 172.21.15.12:39536) 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ceffd640 1 -- 172.21.15.12:0/3928397979 learned_addr learned my addr 172.21.15.12:0/3928397979 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/3928397979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 0x556b3cae7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24cf7fe640 1 --2- 172.21.15.12:0/3928397979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cadbb40 0x556b3cada090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24cf7fe640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f24b80a33b0 0x7f24b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24b7fff640 1 -- 172.21.15.12:0/1325442957 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f24c40f0480 con 0x7f24d0100d00 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ceffd640 1 -- 172.21.15.12:0/3928397979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cadbb40 msgr2=0x556b3cada090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ceffd640 1 --2- 172.21.15.12:0/3928397979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cadbb40 0x556b3cada090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ceffd640 1 -- 172.21.15.12:0/3928397979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 msgr2=0x556b3cae7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ceffd640 1 --2- 172.21.15.12:0/3928397979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 0x556b3cae7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ceffd640 1 -- 172.21.15.12:0/3928397979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3c9cc3a0 con 0x556b3cada5d0 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/3928397979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 0x556b3cae7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24ceffd640 1 --2- 172.21.15.12:0/3928397979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cadaa10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009c80 tx=0x7f24c00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e02c231f62e15aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.461+0000 7f24cf7fe640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f24b80a33b0 0x7f24b80a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009fd0 tx=0x7f24c8009600 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24b57fa640 1 -- 172.21.15.12:0/3928397979 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0012450 con 0x556b3cada5d0 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24b57fa640 1 -- 172.21.15.12:0/3928397979 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24c0012ad0 con 0x556b3cada5d0 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24b57fa640 1 -- 172.21.15.12:0/3928397979 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c000fbd0 con 0x556b3cada5d0 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24d7947740 1 -- 172.21.15.12:0/3928397979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 msgr2=0x556b3cadaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24d7947740 1 --2- 172.21.15.12:0/3928397979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cadaa10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009c80 tx=0x7f24c00117b0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24d7947740 1 -- 172.21.15.12:0/3928397979 shutdown_connections 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24d7947740 1 --2- 172.21.15.12:0/3928397979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 0x556b3cae7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24d7947740 1 --2- 172.21.15.12:0/3928397979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cadaa10 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24d7947740 1 --2- 172.21.15.12:0/3928397979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cadbb40 0x556b3cada090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24d7947740 1 -- 172.21.15.12:0/3928397979 >> 172.21.15.12:0/3928397979 conn(0x556b3caa3310 msgr2=0x556b3cad6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24d7947740 1 -- 172.21.15.12:0/3928397979 shutdown_connections 2024-09-19T06:45:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.462+0000 7f24d7947740 1 -- 172.21.15.12:0/3928397979 wait complete. 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24d7947740 1 -- start start 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24d7947740 1 Processor -- start 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24d7947740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cae4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24d7947740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cadbb40 0x556b3cae1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24d7947740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cae5370 0x556b3cae24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24d7947740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556b3cae8070 con 0x556b3cada5d0 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24d7947740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556b3c9fb060 con 0x556b3cadbb40 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24d7947740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556b3cae81f0 con 0x556b3cae5370 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24d7947740 10 client.0 _ll_register_callbacks cb 0x556b3c74e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cae4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cae4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39552/0 (socket says 172.21.15.12:39552) 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24ceffd640 1 -- 172.21.15.12:0/277190847 learned_addr learned my addr 172.21.15.12:0/277190847 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cadbb40 0x556b3cae1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.463+0000 7f24cf7fe640 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cae5370 0x556b3cae24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24ceffd640 1 -- 172.21.15.12:0/277190847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cae5370 msgr2=0x556b3cae24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24ceffd640 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cae5370 0x556b3cae24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24ceffd640 1 -- 172.21.15.12:0/277190847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cadbb40 msgr2=0x556b3cae1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24ceffd640 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cadbb40 0x556b3cae1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24ceffd640 1 -- 172.21.15.12:0/277190847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b3c7b13c0 con 0x556b3cada5d0 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24cf7fe640 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cae5370 0x556b3cae24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24ceffd640 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cae4cc0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f24c000f750 tx=0x7f24c0009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e27e231204b31d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24b2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24b2ff5640 1 -- 172.21.15.12:0/277190847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0028020 con 0x556b3cada5d0 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24b2ff5640 1 -- 172.21.15.12:0/277190847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f24c0012650 con 0x556b3cada5d0 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24d7947740 1 -- 172.21.15.12:0/277190847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24c0012ad0 con 0x556b3cada5d0 2024-09-19T06:45:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24b2ff5640 1 -- 172.21.15.12:0/277190847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f24c0033050 con 0x556b3cada5d0 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24d7947740 10 client.16932 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24d7947740 1 -- 172.21.15.12:0/277190847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556b3caf3ab0 con 0x556b3cada5d0 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.464+0000 7f24b2ff5640 1 -- 172.21.15.12:0/277190847 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24c0012ad0 con 0x556b3cada5d0 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.465+0000 7f24b2ff5640 1 -- 172.21.15.12:0/277190847 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f24c00035f0 con 0x556b3cada5d0 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.465+0000 7f24d7947740 10 client.16932 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.465+0000 7f24d7947740 10 client.16932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.465+0000 7f24d7947740 20 client.16932 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.465+0000 7f24d7947740 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556b3caf4f10 0x556b3caf7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.465+0000 7f24d7947740 4 client.16932 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.465+0000 7f24d7947740 1 -- 172.21.15.12:0/277190847 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b3ca4d860 con 0x556b3caf4f10 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.465+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556b3caf4f10 0x556b3caf7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556b3caf4f10 0x556b3caf7300 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c72c7d0b56f7d50 server_cookie=bf7dd4363dfa0cde in_seq=0 out_seq=0 2024-09-19T06:45:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24b2ff5640 10 client.16932 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24b2ff5640 1 -- 172.21.15.12:0/277190847 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b3ca4d860 con 0x556b3caf4f10 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24b2ff5640 10 client.16932 handle_command_reply: tid=0 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24d7947740 1 client.16932 shutdown 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24d7947740 1 -- 172.21.15.12:0/277190847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 msgr2=0x556b3cae4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24d7947740 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cae4cc0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f24c000f750 tx=0x7f24c0009770 comp rx=0 tx=0).stop 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24d7947740 1 -- 172.21.15.12:0/277190847 shutdown_connections 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24d7947740 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556b3caf4f10 0x556b3caf7300 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24d7947740 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cae5370 0x556b3cae24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24d7947740 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cadbb40 0x556b3cae1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24b2ff5640 0 client.16932 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24d7947740 1 --2- 172.21.15.12:0/277190847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cada5d0 0x556b3cae4cc0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24d7947740 1 -- 172.21.15.12:0/277190847 >> 172.21.15.12:0/277190847 conn(0x556b3caa3310 msgr2=0x556b3cadc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.466+0000 7f24d7947740 1 -- 172.21.15.12:0/277190847 shutdown_connections 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.467+0000 7f24d7947740 1 -- 172.21.15.12:0/277190847 wait complete. 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.467+0000 7f24d7947740 20 client.16932 trim_cache size 0 max 16384 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.479+0000 7f24d7947740 1 Processor -- start 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24d7947740 1 -- start start 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24d7947740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 0x556b3cad5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24d7947740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cadbb40 0x556b3cad5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24d7947740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cae5370 0x556b3cadd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24d7947740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f24d01afdc0 con 0x556b3cae5370 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24d7947740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24d01b1930 con 0x556b3cadbb40 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24d7947740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f24d01b0490 con 0x556b3cada5d0 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cae5370 0x556b3cadd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cae5370 0x556b3cadd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39554/0 (socket says 172.21.15.12:39554) 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24cf7fe640 1 -- 172.21.15.12:0/3700795565 learned_addr learned my addr 172.21.15.12:0/3700795565 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/3700795565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cadbb40 0x556b3cad5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24ceffd640 1 --2- 172.21.15.12:0/3700795565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 0x556b3cad5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24cf7fe640 1 -- 172.21.15.12:0/3700795565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 msgr2=0x556b3cad5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24cf7fe640 1 --2- 172.21.15.12:0/3700795565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 0x556b3cad5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24cf7fe640 1 -- 172.21.15.12:0/3700795565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cadbb40 msgr2=0x556b3cad5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24cf7fe640 1 --2- 172.21.15.12:0/3700795565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cadbb40 0x556b3cad5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24cf7fe640 1 -- 172.21.15.12:0/3700795565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3cae47e0 con 0x556b3cae5370 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24ceffd640 1 --2- 172.21.15.12:0/3700795565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 0x556b3cad5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.480+0000 7f24cf7fe640 1 --2- 172.21.15.12:0/3700795565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cae5370 0x556b3cadd120 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f24c8005c40 tx=0x7f24c800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b0e21b6ad6c9de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24b4ff9640 1 -- 172.21.15.12:0/3700795565 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c802d070 con 0x556b3cae5370 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24b4ff9640 1 -- 172.21.15.12:0/3700795565 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24c801e990 con 0x556b3cae5370 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24b4ff9640 1 -- 172.21.15.12:0/3700795565 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c8028850 con 0x556b3cae5370 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24d7947740 1 -- 172.21.15.12:0/3700795565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cae5370 msgr2=0x556b3cadd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24d7947740 1 --2- 172.21.15.12:0/3700795565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cae5370 0x556b3cadd120 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f24c8005c40 tx=0x7f24c800c000 comp rx=0 tx=0).stop 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24d7947740 1 -- 172.21.15.12:0/3700795565 shutdown_connections 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24d7947740 1 --2- 172.21.15.12:0/3700795565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cae5370 0x556b3cadd120 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24d7947740 1 --2- 172.21.15.12:0/3700795565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cadbb40 0x556b3cad5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24d7947740 1 --2- 172.21.15.12:0/3700795565 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 0x556b3cad5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24d7947740 1 -- 172.21.15.12:0/3700795565 >> 172.21.15.12:0/3700795565 conn(0x556b3caa3310 msgr2=0x556b3cad5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24d7947740 1 -- 172.21.15.12:0/3700795565 shutdown_connections 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.481+0000 7f24d7947740 1 -- 172.21.15.12:0/3700795565 wait complete. 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24d7947740 1 -- start start 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24d7947740 1 Processor -- start 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24d7947740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 0x556b3cadeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24d7947740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cadbb40 0x556b3cadf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24d7947740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 0x556b3cadf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24d7947740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f24d01b1260 con 0x556b3cadbb40 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24d7947740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24d01b0b60 con 0x556b3cae5370 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24d7947740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f24d01adda0 con 0x556b3cada5d0 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24d7947740 10 client.0 _ll_register_callbacks cb 0x7f24c8009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24ce7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cadbb40 0x556b3cadf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24ce7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cadbb40 0x556b3cadf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39568/0 (socket says 172.21.15.12:39568) 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24ce7fc640 1 -- 172.21.15.12:0/6354547 learned_addr learned my addr 172.21.15.12:0/6354547 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24cf7fe640 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 0x556b3cadf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24ceffd640 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 0x556b3cadeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24ce7fc640 1 -- 172.21.15.12:0/6354547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 msgr2=0x556b3cadeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 0x556b3cadeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24ce7fc640 1 -- 172.21.15.12:0/6354547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 msgr2=0x556b3cadf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:13.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 0x556b3cadf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24ce7fc640 1 -- 172.21.15.12:0/6354547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b3cb5e930 con 0x556b3cadbb40 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.482+0000 7f24ceffd640 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 0x556b3cadeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.483+0000 7f24ce7fc640 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cadbb40 0x556b3cadf430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f24c40b8ae0 tx=0x7f24c408e400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b07e418ba02d2bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.483+0000 7f24b2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.483+0000 7f24b2ff5640 1 -- 172.21.15.12:0/6354547 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4049040 con 0x556b3cadbb40 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.483+0000 7f24b2ff5640 1 -- 172.21.15.12:0/6354547 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f24c4003c80 con 0x556b3cadbb40 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.483+0000 7f24d7947740 1 -- 172.21.15.12:0/6354547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24c801e990 con 0x556b3cadbb40 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.483+0000 7f24b2ff5640 1 -- 172.21.15.12:0/6354547 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f24c40bbfe0 con 0x556b3cadbb40 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.483+0000 7f24d7947740 10 client.16938 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.483+0000 7f24d7947740 1 -- 172.21.15.12:0/6354547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556b3cb5fb40 con 0x556b3cadbb40 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.483+0000 7f24b2ff5640 1 -- 172.21.15.12:0/6354547 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24c801e990 con 0x556b3cadbb40 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24b2ff5640 1 -- 172.21.15.12:0/6354547 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f24c40edd70 con 0x556b3cadbb40 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24d7947740 10 client.16938 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24d7947740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24d7947740 20 client.16938 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24d7947740 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556b3cb60220 0x556b3cb62640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24d7947740 4 client.16938 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:45:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24d7947740 1 -- 172.21.15.12:0/6354547 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b3ca47d70 con 0x556b3cb60220 2024-09-19T06:45:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24ceffd640 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556b3cb60220 0x556b3cb62640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24ceffd640 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556b3cb60220 0x556b3cb62640 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ea0cea6243c574b server_cookie=d2c2db3822846edd in_seq=0 out_seq=0 2024-09-19T06:45:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24b2ff5640 10 client.16938 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:13.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24b2ff5640 1 -- 172.21.15.12:0/6354547 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b3ca47d70 con 0x556b3cb60220 2024-09-19T06:45:13.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.484+0000 7f24b2ff5640 10 client.16938 handle_command_reply: tid=0 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 client.16938 shutdown 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 -- 172.21.15.12:0/6354547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cadbb40 msgr2=0x556b3cadf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cadbb40 0x556b3cadf430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f24c40b8ae0 tx=0x7f24c408e400 comp rx=0 tx=0).stop 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 -- 172.21.15.12:0/6354547 shutdown_connections 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556b3cb60220 0x556b3cb62640 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556b3cae5370 0x556b3cadf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b3cadbb40 0x556b3cadf430 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 --2- 172.21.15.12:0/6354547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556b3cada5d0 0x556b3cadeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 -- 172.21.15.12:0/6354547 >> 172.21.15.12:0/6354547 conn(0x556b3caa3310 msgr2=0x556b3cae3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24b2ff5640 0 client.16938 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 -- 172.21.15.12:0/6354547 shutdown_connections 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 1 -- 172.21.15.12:0/6354547 wait complete. 2024-09-19T06:45:13.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.485+0000 7f24d7947740 20 client.16938 trim_cache size 0 max 16384 2024-09-19T06:45:13.503 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:45:13.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 -- 172.21.15.12:0/1325442957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f24b80a33b0 msgr2=0x7f24b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:13.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f24b80a33b0 0x7f24b80a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009fd0 tx=0x7f24c8009600 comp rx=0 tx=0).stop 2024-09-19T06:45:13.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 -- 172.21.15.12:0/1325442957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24d0100d00 msgr2=0x7f24d0101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24d0100d00 0x7f24d0101810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f24c4005940 tx=0x7f24c4004270 comp rx=0 tx=0).stop 2024-09-19T06:45:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 -- 172.21.15.12:0/1325442957 shutdown_connections 2024-09-19T06:45:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d0106f50 0x7f24d0101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24d0100d00 0x7f24d0101810 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f24b80a33b0 0x7f24b80a5870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 --2- 172.21.15.12:0/1325442957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d0100350 0x7f24d01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 -- 172.21.15.12:0/1325442957 >> 172.21.15.12:0/1325442957 conn(0x7f24d0077210 msgr2=0x7f24d01052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 -- 172.21.15.12:0/1325442957 shutdown_connections 2024-09-19T06:45:13.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:13.486+0000 7f24d556e640 1 -- 172.21.15.12:0/1325442957 wait complete. 2024-09-19T06:45:13.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:13 smithi016 ceph-mon[34911]: pgmap v155: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 1.46k op/s 2024-09-19T06:45:13.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:13 smithi173 ceph-mon[35349]: pgmap v155: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 1.46k op/s 2024-09-19T06:45:15.285 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:45:15.285 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:45:15.556 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:15.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:15 smithi012 ceph-mon[30937]: pgmap v156: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 26 MiB/s wr, 1.46k op/s 2024-09-19T06:45:15.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:15 smithi016 ceph-mon[34911]: pgmap v156: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 26 MiB/s wr, 1.46k op/s 2024-09-19T06:45:15.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:45:15.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:15 smithi173 ceph-mon[35349]: pgmap v156: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 26 MiB/s wr, 1.46k op/s 2024-09-19T06:45:16.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.109+0000 7f5da5517640 1 -- 172.21.15.12:0/2922856293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5da0102790 msgr2=0x7f5da01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.109+0000 7f5da5517640 1 --2- 172.21.15.12:0/2922856293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5da0102790 0x7f5da01067e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009900 tx=0x7f5d9402a410 comp rx=0 tx=0).stop 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.109+0000 7f5da5517640 1 -- 172.21.15.12:0/2922856293 shutdown_connections 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.109+0000 7f5da5517640 1 --2- 172.21.15.12:0/2922856293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da0106f10 0x7f5da010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.109+0000 7f5da5517640 1 --2- 172.21.15.12:0/2922856293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5da0102790 0x7f5da01067e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.109+0000 7f5da5517640 1 --2- 172.21.15.12:0/2922856293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da0101de0 0x7f5da01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.109+0000 7f5da5517640 1 -- 172.21.15.12:0/2922856293 >> 172.21.15.12:0/2922856293 conn(0x7f5da00fd8c0 msgr2=0x7f5da00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.109+0000 7f5da5517640 1 -- 172.21.15.12:0/2922856293 shutdown_connections 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.109+0000 7f5da5517640 1 -- 172.21.15.12:0/2922856293 wait complete. 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5da5517640 1 Processor -- start 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5da5517640 1 -- start start 2024-09-19T06:45:16.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5da5517640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5da0101de0 0x7f5da00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5da5517640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da0102790 0x7f5da0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5da5517640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da0106f10 0x7f5da0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5da5517640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0112010 con 0x7f5da0101de0 2024-09-19T06:45:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5da5517640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0111e90 con 0x7f5da0102790 2024-09-19T06:45:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5da5517640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0112190 con 0x7f5da0106f10 2024-09-19T06:45:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5da0101de0 0x7f5da00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5da0101de0 0x7f5da00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39584/0 (socket says 172.21.15.12:39584) 2024-09-19T06:45:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.110+0000 7f5d9effd640 1 -- 172.21.15.12:0/2395824064 learned_addr learned my addr 172.21.15.12:0/2395824064 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d9e7fc640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da0102790 0x7f5da0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d9f7fe640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da0106f10 0x7f5da0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d9effd640 1 -- 172.21.15.12:0/2395824064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da0106f10 msgr2=0x7f5da0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d9effd640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da0106f10 0x7f5da0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d9effd640 1 -- 172.21.15.12:0/2395824064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da0102790 msgr2=0x7f5da0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d9effd640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da0102790 0x7f5da0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d9effd640 1 -- 172.21.15.12:0/2395824064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da01a6a70 con 0x7f5da0101de0 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d9f7fe640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da0106f10 0x7f5da0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d9e7fc640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da0102790 0x7f5da0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d9effd640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5da0101de0 0x7f5da00744f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000b4a0 tx=0x7f5d9000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d87fff640 1 -- 172.21.15.12:0/2395824064 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90014070 con 0x7f5da0101de0 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5da5517640 1 -- 172.21.15.12:0/2395824064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da01a6d60 con 0x7f5da0101de0 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d87fff640 1 -- 172.21.15.12:0/2395824064 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d90010af0 con 0x7f5da0101de0 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5d87fff640 1 -- 172.21.15.12:0/2395824064 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90017d10 con 0x7f5da0101de0 2024-09-19T06:45:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.111+0000 7f5da5517640 1 -- 172.21.15.12:0/2395824064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da01a71f0 con 0x7f5da0101de0 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.113+0000 7f5d87fff640 1 -- 172.21.15.12:0/2395824064 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5d90017070 con 0x7f5da0101de0 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5da78f0740 1 Processor -- start 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5da78f0740 1 -- start start 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 0x56394171cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171d480 0x563941727800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x56394172a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5da78f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563941682280 con 0x563941727d40 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5da78f0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563941629b10 con 0x56394171cb60 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5da78f0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56394167e240 con 0x56394171d480 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5d9e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x56394172a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5d9e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x56394172a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39596/0 (socket says 172.21.15.12:39596) 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5d9e7fc640 1 -- 172.21.15.12:0/3832596609 learned_addr learned my addr 172.21.15.12:0/3832596609 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5d9effd640 1 --2- 172.21.15.12:0/3832596609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171d480 0x563941727800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5d87fff640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5d880a33b0 0x7f5d880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.114+0000 7f5d9f7fe640 1 --2- 172.21.15.12:0/3832596609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 0x56394171cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d9e7fc640 1 -- 172.21.15.12:0/3832596609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171d480 msgr2=0x563941727800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d9e7fc640 1 --2- 172.21.15.12:0/3832596609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171d480 0x563941727800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d9e7fc640 1 -- 172.21.15.12:0/3832596609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 msgr2=0x56394171cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d9e7fc640 1 --2- 172.21.15.12:0/3832596609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 0x56394171cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d9e7fc640 1 -- 172.21.15.12:0/3832596609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639416361f0 con 0x563941727d40 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d9effd640 1 --2- 172.21.15.12:0/3832596609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171d480 0x563941727800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d9f7fe640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5d880a33b0 0x7f5d880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d87fff640 1 -- 172.21.15.12:0/2395824064 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5d900cf1a0 con 0x7f5da0101de0 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d9e7fc640 1 --2- 172.21.15.12:0/3832596609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x56394172a130 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5d9402a930 tx=0x7f5d940316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55d06a2874bd9b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d857fa640 1 -- 172.21.15.12:0/3832596609 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9403f070 con 0x563941727d40 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d9f7fe640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5d880a33b0 0x7f5d880a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800c3e0 tx=0x7f5d98004b50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d857fa640 1 -- 172.21.15.12:0/3832596609 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d940035f0 con 0x563941727d40 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.115+0000 7f5d857fa640 1 -- 172.21.15.12:0/3832596609 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94035070 con 0x563941727d40 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 -- 172.21.15.12:0/3832596609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 msgr2=0x56394172a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 --2- 172.21.15.12:0/3832596609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x56394172a130 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5d9402a930 tx=0x7f5d940316e0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 -- 172.21.15.12:0/3832596609 shutdown_connections 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 --2- 172.21.15.12:0/3832596609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x56394172a130 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 --2- 172.21.15.12:0/3832596609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171d480 0x563941727800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 --2- 172.21.15.12:0/3832596609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 0x56394171cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 -- 172.21.15.12:0/3832596609 >> 172.21.15.12:0/3832596609 conn(0x5639417190f0 msgr2=0x5639417194d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 -- 172.21.15.12:0/3832596609 shutdown_connections 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 -- 172.21.15.12:0/3832596609 wait complete. 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 -- start start 2024-09-19T06:45:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.116+0000 7f5da78f0740 1 Processor -- start 2024-09-19T06:45:16.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171cb60 0x563941724bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171d480 0x5639417250f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x563941725630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5da78f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56394172a910 con 0x563941727d40 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5da78f0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56394163cf10 con 0x56394171d480 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5da78f0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56394172aa90 con 0x56394171cb60 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5da78f0740 10 client.0 _ll_register_callbacks cb 0x563941605a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x563941725630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x563941725630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39610/0 (socket says 172.21.15.12:39610) 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9f7fe640 1 -- 172.21.15.12:0/1116203844 learned_addr learned my addr 172.21.15.12:0/1116203844 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171cb60 0x563941724bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9e7fc640 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171d480 0x5639417250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9f7fe640 1 -- 172.21.15.12:0/1116203844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171cb60 msgr2=0x563941724bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9f7fe640 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171cb60 0x563941724bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9f7fe640 1 -- 172.21.15.12:0/1116203844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171d480 msgr2=0x5639417250f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9f7fe640 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171d480 0x5639417250f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9f7fe640 1 -- 172.21.15.12:0/1116203844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639413f36a0 con 0x563941727d40 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171cb60 0x563941724bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d9f7fe640 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x563941725630 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5d98011b80 tx=0x7f5d980072a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49254aeb3a1f3a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.117+0000 7f5d82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1116203844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98010e50 con 0x563941727d40 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1116203844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5d9801e450 con 0x563941727d40 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5da78f0740 1 -- 172.21.15.12:0/1116203844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d940035f0 con 0x563941727d40 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1116203844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5d9802c050 con 0x563941727d40 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5da78f0740 10 client.16950 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5da78f0740 1 -- 172.21.15.12:0/1116203844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5639417364d0 con 0x563941727d40 2024-09-19T06:45:16.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1116203844 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d940035f0 con 0x563941727d40 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1116203844 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f5d98027910 con 0x563941727d40 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5da78f0740 10 client.16950 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5da78f0740 10 client.16950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5da78f0740 20 client.16950 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5639417379e0 0x563941739e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5da78f0740 4 client.16950 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.118+0000 7f5da78f0740 1 -- 172.21.15.12:0/1116203844 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56394168f7f0 con 0x5639417379e0 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.119+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5639417379e0 0x563941739e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.119+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5639417379e0 0x563941739e50 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5630dd97ebb0435 server_cookie=eca2512c7679013a in_seq=0 out_seq=0 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.119+0000 7f5d82ff5640 10 client.16950 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1116203844 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56394168f7f0 con 0x5639417379e0 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5d82ff5640 10 client.16950 handle_command_reply: tid=0 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 client.16950 shutdown 2024-09-19T06:45:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 -- 172.21.15.12:0/1116203844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 msgr2=0x563941725630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x563941725630 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5d98011b80 tx=0x7f5d980072a0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 -- 172.21.15.12:0/1116203844 shutdown_connections 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5639417379e0 0x563941739e50 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563941727d40 0x563941725630 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171d480 0x5639417250f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1116203844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56394171cb60 0x563941724bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5d82ff5640 0 client.16950 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 -- 172.21.15.12:0/1116203844 >> 172.21.15.12:0/1116203844 conn(0x5639417190f0 msgr2=0x56394171edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 -- 172.21.15.12:0/1116203844 shutdown_connections 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 1 -- 172.21.15.12:0/1116203844 wait complete. 2024-09-19T06:45:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.120+0000 7f5da78f0740 20 client.16950 trim_cache size 0 max 16384 2024-09-19T06:45:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5da78f0740 1 Processor -- start 2024-09-19T06:45:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5da78f0740 1 -- start start 2024-09-19T06:45:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171cb60 0x56394173f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171d480 0x56394173fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563941727d40 0x563941721e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5da78f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01afe40 con 0x56394171cb60 2024-09-19T06:45:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5da78f0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01b19b0 con 0x56394171d480 2024-09-19T06:45:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5da78f0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01b0510 con 0x563941727d40 2024-09-19T06:45:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171cb60 0x56394173f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171cb60 0x56394173f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39612/0 (socket says 172.21.15.12:39612) 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5d9effd640 1 -- 172.21.15.12:0/1487965031 learned_addr learned my addr 172.21.15.12:0/1487965031 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5d9effd640 1 -- 172.21.15.12:0/1487965031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563941727d40 msgr2=0x563941721e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1487965031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563941727d40 0x563941721e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5d9effd640 1 -- 172.21.15.12:0/1487965031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171d480 msgr2=0x56394173fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5d9e7fc640 1 --2- 172.21.15.12:0/1487965031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171d480 0x56394173fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1487965031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171d480 0x56394173fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5d9effd640 1 -- 172.21.15.12:0/1487965031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563941718f20 con 0x56394171cb60 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.138+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1487965031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171cb60 0x56394173f720 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009420 tx=0x7f5d900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8098fa64745bdc5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5d84ff9640 1 -- 172.21.15.12:0/1487965031 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9001e040 con 0x56394171cb60 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5d84ff9640 1 -- 172.21.15.12:0/1487965031 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d900997b0 con 0x56394171cb60 2024-09-19T06:45:16.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5d84ff9640 1 -- 172.21.15.12:0/1487965031 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90097cb0 con 0x56394171cb60 2024-09-19T06:45:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5da78f0740 1 -- 172.21.15.12:0/1487965031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171cb60 msgr2=0x56394173f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1487965031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171cb60 0x56394173f720 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009420 tx=0x7f5d900046c0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5da78f0740 1 -- 172.21.15.12:0/1487965031 shutdown_connections 2024-09-19T06:45:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1487965031 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563941727d40 0x563941721e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1487965031 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171d480 0x56394173fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1487965031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171cb60 0x56394173f720 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5da78f0740 1 -- 172.21.15.12:0/1487965031 >> 172.21.15.12:0/1487965031 conn(0x5639417190f0 msgr2=0x56394171edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5da78f0740 1 -- 172.21.15.12:0/1487965031 shutdown_connections 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.139+0000 7f5da78f0740 1 -- 172.21.15.12:0/1487965031 wait complete. 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5da78f0740 1 -- start start 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5da78f0740 1 Processor -- start 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 0x56394172fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171d480 0x563941730430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5da78f0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563941727d40 0x56394172cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5da78f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01b12e0 con 0x56394171d480 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5da78f0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01b0be0 con 0x56394171cb60 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5da78f0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01ade20 con 0x563941727d40 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5da78f0740 10 client.0 _ll_register_callbacks cb 0x7f5d98011830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:16.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5d9e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171d480 0x563941730430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5d9e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171d480 0x563941730430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39626/0 (socket says 172.21.15.12:39626) 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5d9e7fc640 1 -- 172.21.15.12:0/1578785559 learned_addr learned my addr 172.21.15.12:0/1578785559 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5d9f7fe640 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563941727d40 0x56394172cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 0x56394172fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5d9e7fc640 1 -- 172.21.15.12:0/1578785559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563941727d40 msgr2=0x56394172cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5d9e7fc640 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563941727d40 0x56394172cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5d9e7fc640 1 -- 172.21.15.12:0/1578785559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 msgr2=0x56394172fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.140+0000 7f5d9e7fc640 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 0x56394172fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5d9e7fc640 1 -- 172.21.15.12:0/1578785559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56394172d320 con 0x56394171d480 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 0x56394172fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5d9e7fc640 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171d480 0x563941730430 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5d9402a930 tx=0x7f5d94031b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d497fabb393fd742 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5d82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:16.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1578785559 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9404a030 con 0x56394171d480 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5da78f0740 1 -- 172.21.15.12:0/1578785559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d900997b0 con 0x56394171d480 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1578785559 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5d94005020 con 0x56394171d480 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1578785559 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5d94054050 con 0x56394171d480 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5da78f0740 10 client.16956 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5da78f0740 1 -- 172.21.15.12:0/1578785559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5639417a3080 con 0x56394171d480 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1578785559 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d900997b0 con 0x56394171d480 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.141+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1578785559 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f5d940047a0 con 0x56394171d480 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.142+0000 7f5da78f0740 10 client.16956 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.142+0000 7f5da78f0740 10 client.16956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.142+0000 7f5da78f0740 20 client.16956 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.142+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5639417a33d0 0x5639417a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.142+0000 7f5da78f0740 4 client.16956 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:45:16.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.142+0000 7f5da78f0740 1 -- 172.21.15.12:0/1578785559 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563941689d00 con 0x5639417a33d0 2024-09-19T06:45:16.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.142+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5639417a33d0 0x5639417a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:16.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.142+0000 7f5d82ff5640 10 client.16956 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:16.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.142+0000 7f5d9effd640 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5639417a33d0 0x5639417a57c0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b118fe40fb70a63 server_cookie=e1afb7dd27e4f684 in_seq=0 out_seq=0 2024-09-19T06:45:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.143+0000 7f5d82ff5640 1 -- 172.21.15.12:0/1578785559 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563941689d00 con 0x5639417a33d0 2024-09-19T06:45:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.143+0000 7f5d82ff5640 10 client.16956 handle_command_reply: tid=0 2024-09-19T06:45:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.143+0000 7f5da78f0740 1 client.16956 shutdown 2024-09-19T06:45:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 1 -- 172.21.15.12:0/1578785559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171d480 msgr2=0x563941730430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171d480 0x563941730430 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5d9402a930 tx=0x7f5d94031b00 comp rx=0 tx=0).stop 2024-09-19T06:45:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 1 -- 172.21.15.12:0/1578785559 shutdown_connections 2024-09-19T06:45:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5639417a33d0 0x5639417a57c0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563941727d40 0x56394172cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56394171d480 0x563941730430 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 1 --2- 172.21.15.12:0/1578785559 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56394171cb60 0x56394172fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 1 -- 172.21.15.12:0/1578785559 >> 172.21.15.12:0/1578785559 conn(0x5639417190f0 msgr2=0x56394171e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5d82ff5640 0 client.16956 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 1 -- 172.21.15.12:0/1578785559 shutdown_connections 2024-09-19T06:45:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 1 -- 172.21.15.12:0/1578785559 wait complete. 2024-09-19T06:45:16.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da78f0740 20 client.16956 trim_cache size 0 max 16384 2024-09-19T06:45:16.150 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:45:16.150 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:45:16.150 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "2ead9373-98eb-4da2-a971-06e468df20e3", 2024-09-19T06:45:16.151 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:45:16.151 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:45:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da5517640 1 -- 172.21.15.12:0/2395824064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5d880a33b0 msgr2=0x7f5d880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da5517640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5d880a33b0 0x7f5d880a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800c3e0 tx=0x7f5d98004b50 comp rx=0 tx=0).stop 2024-09-19T06:45:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da5517640 1 -- 172.21.15.12:0/2395824064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5da0101de0 msgr2=0x7f5da00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.144+0000 7f5da5517640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5da0101de0 0x7f5da00744f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000b4a0 tx=0x7f5d9000b960 comp rx=0 tx=0).stop 2024-09-19T06:45:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.145+0000 7f5da5517640 1 -- 172.21.15.12:0/2395824064 shutdown_connections 2024-09-19T06:45:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.145+0000 7f5da5517640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5d880a33b0 0x7f5d880a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.145+0000 7f5da5517640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5da0106f10 0x7f5da0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.145+0000 7f5da5517640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da0102790 0x7f5da0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.145+0000 7f5da5517640 1 --2- 172.21.15.12:0/2395824064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5da0101de0 0x7f5da00744f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.145+0000 7f5da5517640 1 -- 172.21.15.12:0/2395824064 >> 172.21.15.12:0/2395824064 conn(0x7f5da00fd8c0 msgr2=0x7f5da00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.145+0000 7f5da5517640 1 -- 172.21.15.12:0/2395824064 shutdown_connections 2024-09-19T06:45:16.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:16.145+0000 7f5da5517640 1 -- 172.21.15.12:0/2395824064 wait complete. 2024-09-19T06:45:16.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:16 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:45:16.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:16 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:16.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:16 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:45:16.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:16 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:16.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:16 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:45:16.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:16 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:16.985 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:45:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:17.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:45:17.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:45:17.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:45:17.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:45:17.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:45:17.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:45:17.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: pgmap v157: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 1.41k op/s 2024-09-19T06:45:17.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:17 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.730+0000 7ffb57d70640 1 -- 172.21.15.12:0/1811298365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb501036e0 msgr2=0x7ffb50107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:17.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.730+0000 7ffb57d70640 1 --2- 172.21.15.12:0/1811298365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb501036e0 0x7ffb50107b90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009930 tx=0x7ffb4002a420 comp rx=0 tx=0).stop 2024-09-19T06:45:17.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.730+0000 7ffb57d70640 1 -- 172.21.15.12:0/1811298365 shutdown_connections 2024-09-19T06:45:17.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.730+0000 7ffb57d70640 1 --2- 172.21.15.12:0/1811298365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb501082a0 0x7ffb5010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.730+0000 7ffb57d70640 1 --2- 172.21.15.12:0/1811298365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb501036e0 0x7ffb50107b90 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.730+0000 7ffb57d70640 1 --2- 172.21.15.12:0/1811298365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb50102d30 0x7ffb50103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.730+0000 7ffb57d70640 1 -- 172.21.15.12:0/1811298365 >> 172.21.15.12:0/1811298365 conn(0x7ffb500fc7d0 msgr2=0x7ffb500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.730+0000 7ffb57d70640 1 -- 172.21.15.12:0/1811298365 shutdown_connections 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.730+0000 7ffb57d70640 1 -- 172.21.15.12:0/1811298365 wait complete. 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb57d70640 1 Processor -- start 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb57d70640 1 -- start start 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb57d70640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb50102d30 0x7ffb50100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb57d70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb501036e0 0x7ffb50100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb57d70640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb501082a0 0x7ffb50101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb57d70640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501120c0 con 0x7ffb501036e0 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb57d70640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50111f40 con 0x7ffb501082a0 2024-09-19T06:45:17.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb57d70640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50112240 con 0x7ffb50102d30 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb5530b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb501036e0 0x7ffb50100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb5530b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb501036e0 0x7ffb50100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39640/0 (socket says 172.21.15.12:39640) 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb5530b640 1 -- 172.21.15.12:0/2407562558 learned_addr learned my addr 172.21.15.12:0/2407562558 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb5630d640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb501082a0 0x7ffb50101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb55b0c640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb50102d30 0x7ffb50100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb5530b640 1 -- 172.21.15.12:0/2407562558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb50102d30 msgr2=0x7ffb50100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb5530b640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb50102d30 0x7ffb50100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb5530b640 1 -- 172.21.15.12:0/2407562558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb501082a0 msgr2=0x7ffb50101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb5530b640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb501082a0 0x7ffb50101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.731+0000 7ffb5530b640 1 -- 172.21.15.12:0/2407562558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb501aaff0 con 0x7ffb501036e0 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.732+0000 7ffb5530b640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb501036e0 0x7ffb50100ed0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ffb40005940 tx=0x7ffb400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.732+0000 7ffb46ffd640 1 -- 172.21.15.12:0/2407562558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4003f030 con 0x7ffb501036e0 2024-09-19T06:45:17.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.732+0000 7ffb46ffd640 1 -- 172.21.15.12:0/2407562558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb40003ce0 con 0x7ffb501036e0 2024-09-19T06:45:17.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.732+0000 7ffb57d70640 1 -- 172.21.15.12:0/2407562558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb501ab1c0 con 0x7ffb501036e0 2024-09-19T06:45:17.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.732+0000 7ffb46ffd640 1 -- 172.21.15.12:0/2407562558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40035070 con 0x7ffb501036e0 2024-09-19T06:45:17.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.732+0000 7ffb57d70640 1 -- 172.21.15.12:0/2407562558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb501ab700 con 0x7ffb501036e0 2024-09-19T06:45:17.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.734+0000 7ffb46ffd640 1 -- 172.21.15.12:0/2407562558 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ffb40042030 con 0x7ffb501036e0 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5a149740 1 Processor -- start 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5a149740 1 -- start start 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb46ffd640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffb3c0a33b0 0x7ffb3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49be4a0 0x55c5f49be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 0x55c5f49c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49c9680 0x55c5f49cba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5a149740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c5f49242e0 con 0x55c5f49be4a0 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5a149740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c5f48cbce0 con 0x55c5f49bedc0 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5a149740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c5f49202a0 con 0x55c5f49c9680 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5630d640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffb3c0a33b0 0x7ffb3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb55b0c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49be4a0 0x55c5f49be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5530b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 0x55c5f49c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb55b0c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49be4a0 0x55c5f49be880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39642/0 (socket says 172.21.15.12:39642) 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb55b0c640 1 -- 172.21.15.12:0/636312577 learned_addr learned my addr 172.21.15.12:0/636312577 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb5630d640 1 --2- 172.21.15.12:0/636312577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49c9680 0x55c5f49cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.735+0000 7ffb46ffd640 1 -- 172.21.15.12:0/2407562558 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ffb400f0300 con 0x7ffb501036e0 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb5530b640 1 -- 172.21.15.12:0/636312577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49c9680 msgr2=0x55c5f49cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb5530b640 1 --2- 172.21.15.12:0/636312577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49c9680 0x55c5f49cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb5530b640 1 -- 172.21.15.12:0/636312577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49be4a0 msgr2=0x55c5f49be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb5530b640 1 --2- 172.21.15.12:0/636312577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49be4a0 0x55c5f49be880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb5530b640 1 -- 172.21.15.12:0/636312577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5f48b0440 con 0x55c5f49bedc0 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb55b0c640 1 --2- 172.21.15.12:0/636312577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49be4a0 0x55c5f49be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb5630d640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffb3c0a33b0 0x7ffb3c0a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800a780 tx=0x7ffb4800ae00 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb5530b640 1 --2- 172.21.15.12:0/636312577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 0x55c5f49c9140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb400ed970 tx=0x7ffb400bc390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b31414070a33877 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb3bfff640 1 -- 172.21.15.12:0/636312577 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40049070 con 0x55c5f49bedc0 2024-09-19T06:45:17.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb3bfff640 1 -- 172.21.15.12:0/636312577 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb4003b460 con 0x55c5f49bedc0 2024-09-19T06:45:17.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.736+0000 7ffb3bfff640 1 -- 172.21.15.12:0/636312577 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb400bc500 con 0x55c5f49bedc0 2024-09-19T06:45:17.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 -- 172.21.15.12:0/636312577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 msgr2=0x55c5f49c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:17.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 --2- 172.21.15.12:0/636312577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 0x55c5f49c9140 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb400ed970 tx=0x7ffb400bc390 comp rx=0 tx=0).stop 2024-09-19T06:45:17.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 -- 172.21.15.12:0/636312577 shutdown_connections 2024-09-19T06:45:17.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 --2- 172.21.15.12:0/636312577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49c9680 0x55c5f49cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 --2- 172.21.15.12:0/636312577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 0x55c5f49c9140 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 --2- 172.21.15.12:0/636312577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49be4a0 0x55c5f49be880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 -- 172.21.15.12:0/636312577 >> 172.21.15.12:0/636312577 conn(0x55c5f49baa30 msgr2=0x55c5f49bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:17.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 -- 172.21.15.12:0/636312577 shutdown_connections 2024-09-19T06:45:17.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 -- 172.21.15.12:0/636312577 wait complete. 2024-09-19T06:45:17.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 -- start start 2024-09-19T06:45:17.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.737+0000 7ffb5a149740 1 Processor -- start 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 0x55c5f49c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49c9680 0x55c5f49c6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5a149740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c5f49cc010 con 0x55c5f49c9680 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5a149740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c5f48df050 con 0x55c5f49bedc0 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5a149740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c5f49cc190 con 0x55c5f49be4a0 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5a149740 10 client.0 _ll_register_callbacks cb 0x55c5f491f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5630d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49c9680 0x55c5f49c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5630d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49c9680 0x55c5f49c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39650/0 (socket says 172.21.15.12:39650) 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5630d640 1 -- 172.21.15.12:0/11234706 learned_addr learned my addr 172.21.15.12:0/11234706 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:17.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb55b0c640 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5530b640 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 0x55c5f49c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5630d640 1 -- 172.21.15.12:0/11234706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 msgr2=0x55c5f49c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5630d640 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5630d640 1 -- 172.21.15.12:0/11234706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 msgr2=0x55c5f49c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5630d640 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 0x55c5f49c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.738+0000 7ffb5630d640 1 -- 172.21.15.12:0/11234706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5f46953c0 con 0x55c5f49c9680 2024-09-19T06:45:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.739+0000 7ffb5630d640 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49c9680 0x55c5f49c6950 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffb480126b0 tx=0x7ffb4800a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14743991e30eb0d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.739+0000 7ffb397fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.739+0000 7ffb397fa640 1 -- 172.21.15.12:0/11234706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48026070 con 0x55c5f49c9680 2024-09-19T06:45:17.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.739+0000 7ffb397fa640 1 -- 172.21.15.12:0/11234706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ffb48020860 con 0x55c5f49c9680 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.739+0000 7ffb5a149740 1 -- 172.21.15.12:0/11234706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c5f4931850 con 0x55c5f49c9680 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.739+0000 7ffb397fa640 1 -- 172.21.15.12:0/11234706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffb48032050 con 0x55c5f49c9680 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.739+0000 7ffb5a149740 10 client.16968 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.739+0000 7ffb5a149740 1 -- 172.21.15.12:0/11234706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c5f49d7990 con 0x55c5f49c9680 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.739+0000 7ffb397fa640 1 -- 172.21.15.12:0/11234706 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c5f4931850 con 0x55c5f49c9680 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.739+0000 7ffb397fa640 1 -- 172.21.15.12:0/11234706 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7ffb4800faa0 con 0x55c5f49c9680 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.740+0000 7ffb5a149740 10 client.16968 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.740+0000 7ffb5a149740 10 client.16968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.740+0000 7ffb5a149740 20 client.16968 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.740+0000 7ffb5a149740 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5f49d8da0 0x55c5f49db1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.740+0000 7ffb5a149740 4 client.16968 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:17.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.740+0000 7ffb5a149740 1 -- 172.21.15.12:0/11234706 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5f492bd60 con 0x55c5f49d8da0 2024-09-19T06:45:17.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.740+0000 7ffb55b0c640 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5f49d8da0 0x55c5f49db1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.740+0000 7ffb55b0c640 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5f49d8da0 0x55c5f49db1d0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5db6404d5997a5a0 server_cookie=2af030e452737d3f in_seq=0 out_seq=0 2024-09-19T06:45:17.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.740+0000 7ffb397fa640 10 client.16968 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:17.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb397fa640 1 -- 172.21.15.12:0/11234706 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5f492bd60 con 0x55c5f49d8da0 2024-09-19T06:45:17.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb397fa640 10 client.16968 handle_command_reply: tid=0 2024-09-19T06:45:17.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 client.16968 shutdown 2024-09-19T06:45:17.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 -- 172.21.15.12:0/11234706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49c9680 msgr2=0x55c5f49c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:17.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49c9680 0x55c5f49c6950 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffb480126b0 tx=0x7ffb4800a4d0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 -- 172.21.15.12:0/11234706 shutdown_connections 2024-09-19T06:45:17.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5f49d8da0 0x55c5f49db1d0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49c9680 0x55c5f49c6950 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49bedc0 0x55c5f49c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 --2- 172.21.15.12:0/11234706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 -- 172.21.15.12:0/11234706 >> 172.21.15.12:0/11234706 conn(0x55c5f49baa30 msgr2=0x55c5f49c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:17.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb397fa640 0 client.16968 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:17.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 -- 172.21.15.12:0/11234706 shutdown_connections 2024-09-19T06:45:17.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 1 -- 172.21.15.12:0/11234706 wait complete. 2024-09-19T06:45:17.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.741+0000 7ffb5a149740 20 client.16968 trim_cache size 0 max 16384 2024-09-19T06:45:17.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:45:17.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:45:17.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:45:17.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:45:17.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:45:17.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:45:17.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: pgmap v157: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 1.41k op/s 2024-09-19T06:45:17.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:17 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.758+0000 7ffb5a149740 1 Processor -- start 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.758+0000 7ffb5a149740 1 -- start start 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49e1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 0x55c5f49c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5a149740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b41d0 con 0x55c5f49bedc0 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5a149740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b5d40 con 0x55c5f49c9680 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5a149740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b48a0 con 0x55c5f49be4a0 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5530b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49e1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5530b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49e1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39656/0 (socket says 172.21.15.12:39656) 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb55b0c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5530b640 1 -- 172.21.15.12:0/4061516821 learned_addr learned my addr 172.21.15.12:0/4061516821 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5630d640 1 --2- 172.21.15.12:0/4061516821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 0x55c5f49c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5530b640 1 -- 172.21.15.12:0/4061516821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 msgr2=0x55c5f49e0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5530b640 1 --2- 172.21.15.12:0/4061516821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49e0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5530b640 1 -- 172.21.15.12:0/4061516821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 msgr2=0x55c5f49c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5530b640 1 --2- 172.21.15.12:0/4061516821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 0x55c5f49c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5530b640 1 -- 172.21.15.12:0/4061516821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5f49c7290 con 0x55c5f49bedc0 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb5530b640 1 --2- 172.21.15.12:0/4061516821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49e1030 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ffb400bc490 tx=0x7ffb400f0200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79388dbffae3fe16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.759+0000 7ffb3b7fe640 1 -- 172.21.15.12:0/4061516821 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40049040 con 0x55c5f49bedc0 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb3b7fe640 1 -- 172.21.15.12:0/4061516821 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb400cedd0 con 0x55c5f49bedc0 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb3b7fe640 1 -- 172.21.15.12:0/4061516821 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb400bc500 con 0x55c5f49bedc0 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb5a149740 1 -- 172.21.15.12:0/4061516821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 msgr2=0x55c5f49e1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb5a149740 1 --2- 172.21.15.12:0/4061516821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49e1030 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ffb400bc490 tx=0x7ffb400f0200 comp rx=0 tx=0).stop 2024-09-19T06:45:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb5a149740 1 -- 172.21.15.12:0/4061516821 shutdown_connections 2024-09-19T06:45:17.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb5a149740 1 --2- 172.21.15.12:0/4061516821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 0x55c5f49c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb5a149740 1 --2- 172.21.15.12:0/4061516821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49e1030 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb5a149740 1 --2- 172.21.15.12:0/4061516821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb5a149740 1 -- 172.21.15.12:0/4061516821 >> 172.21.15.12:0/4061516821 conn(0x55c5f49baa30 msgr2=0x55c5f49c83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:17.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb5a149740 1 -- 172.21.15.12:0/4061516821 shutdown_connections 2024-09-19T06:45:17.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.760+0000 7ffb5a149740 1 -- 172.21.15.12:0/4061516821 wait complete. 2024-09-19T06:45:17.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5a149740 1 -- start start 2024-09-19T06:45:17.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5a149740 1 Processor -- start 2024-09-19T06:45:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5a149740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 0x55c5f49cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5a149740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b5670 con 0x55c5f49bedc0 2024-09-19T06:45:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5a149740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b4f70 con 0x55c5f49c9680 2024-09-19T06:45:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5a149740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501b21b0 con 0x55c5f49be4a0 2024-09-19T06:45:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5a149740 10 client.0 _ll_register_callbacks cb 0x7ffb48011dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5530b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5530b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39660/0 (socket says 172.21.15.12:39660) 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5530b640 1 -- 172.21.15.12:0/1858509944 learned_addr learned my addr 172.21.15.12:0/1858509944 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb5630d640 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 0x55c5f49cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.761+0000 7ffb55b0c640 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5530b640 1 -- 172.21.15.12:0/1858509944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 msgr2=0x55c5f49d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5530b640 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5530b640 1 -- 172.21.15.12:0/1858509944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 msgr2=0x55c5f49cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5530b640 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 0x55c5f49cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5530b640 1 -- 172.21.15.12:0/1858509944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5f49cfb60 con 0x55c5f49bedc0 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5630d640 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 0x55c5f49cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5530b640 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49cee40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ffb400c4c40 tx=0x7ffb400bc3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10003dcebfb2db41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb397fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb397fa640 1 -- 172.21.15.12:0/1858509944 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40049070 con 0x55c5f49bedc0 2024-09-19T06:45:17.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb397fa640 1 -- 172.21.15.12:0/1858509944 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7ffb400edbf0 con 0x55c5f49bedc0 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5a149740 1 -- 172.21.15.12:0/1858509944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb400cedd0 con 0x55c5f49bedc0 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb397fa640 1 -- 172.21.15.12:0/1858509944 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffb400bbe60 con 0x55c5f49bedc0 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5a149740 10 client.16974 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5a149740 1 -- 172.21.15.12:0/1858509944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c5f4a43a90 con 0x55c5f49bedc0 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb397fa640 1 -- 172.21.15.12:0/1858509944 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb400cedd0 con 0x55c5f49bedc0 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb397fa640 1 -- 172.21.15.12:0/1858509944 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7ffb400c4ce0 con 0x55c5f49bedc0 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5a149740 10 client.16974 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5a149740 10 client.16974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5a149740 20 client.16974 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5a149740 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5f4a43e20 0x55c5f4a46210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5a149740 4 client.16974 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:45:17.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.762+0000 7ffb5a149740 1 -- 172.21.15.12:0/1858509944 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c5f48a8210 con 0x55c5f4a43e20 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb55b0c640 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5f4a43e20 0x55c5f4a46210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb397fa640 10 client.16974 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb55b0c640 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5f4a43e20 0x55c5f4a46210 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3caab2dbe2df091f server_cookie=3a981028c03a6641 in_seq=0 out_seq=0 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb397fa640 1 -- 172.21.15.12:0/1858509944 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c5f48a8210 con 0x55c5f4a43e20 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb397fa640 10 client.16974 handle_command_reply: tid=0 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb5a149740 1 client.16974 shutdown 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb5a149740 1 -- 172.21.15.12:0/1858509944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 msgr2=0x55c5f49cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb5a149740 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49cee40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ffb400c4c40 tx=0x7ffb400bc3b0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb5a149740 1 -- 172.21.15.12:0/1858509944 shutdown_connections 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb5a149740 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c5f4a43e20 0x55c5f4a46210 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb5a149740 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c5f49c9680 0x55c5f49cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb397fa640 0 client.16974 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb5a149740 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5f49bedc0 0x55c5f49cee40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb5a149740 1 --2- 172.21.15.12:0/1858509944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c5f49be4a0 0x55c5f49d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.763+0000 7ffb5a149740 1 -- 172.21.15.12:0/1858509944 >> 172.21.15.12:0/1858509944 conn(0x55c5f49baa30 msgr2=0x55c5f49b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:17.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb5a149740 1 -- 172.21.15.12:0/1858509944 shutdown_connections 2024-09-19T06:45:17.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb5a149740 1 -- 172.21.15.12:0/1858509944 wait complete. 2024-09-19T06:45:17.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb5a149740 20 client.16974 trim_cache size 0 max 16384 2024-09-19T06:45:17.771 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:45:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:45:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:45:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: "2ead9373-98eb-4da2-a971-06e468df20e3": { 2024-09-19T06:45:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:45:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "2ead9373-98eb-4da2-a971-06e468df20e3", 2024-09-19T06:45:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:45:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:17.772 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:45:17.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 -- 172.21.15.12:0/2407562558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffb3c0a33b0 msgr2=0x7ffb3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffb3c0a33b0 0x7ffb3c0a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800a780 tx=0x7ffb4800ae00 comp rx=0 tx=0).stop 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 -- 172.21.15.12:0/2407562558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb501036e0 msgr2=0x7ffb50100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb501036e0 0x7ffb50100ed0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ffb40005940 tx=0x7ffb400042f0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 -- 172.21.15.12:0/2407562558 shutdown_connections 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb501082a0 0x7ffb50101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb501036e0 0x7ffb50100ed0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ffb3c0a33b0 0x7ffb3c0a5870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 --2- 172.21.15.12:0/2407562558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb50102d30 0x7ffb50100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 -- 172.21.15.12:0/2407562558 >> 172.21.15.12:0/2407562558 conn(0x7ffb500fc7d0 msgr2=0x7ffb50105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.764+0000 7ffb57d70640 1 -- 172.21.15.12:0/2407562558 shutdown_connections 2024-09-19T06:45:17.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:17.765+0000 7ffb57d70640 1 -- 172.21.15.12:0/2407562558 wait complete. 2024-09-19T06:45:17.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: pgmap v157: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 1.41k op/s 2024-09-19T06:45:17.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:17 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:45:18.567 INFO:tasks.cephfs.filesystem:scrub status for tag:2ead9373-98eb-4da2-a971-06e468df20e3 - {'path': '/', 'tag': '2ead9373-98eb-4da2-a971-06e468df20e3', 'options': 'recursive,force'} 2024-09-19T06:45:19.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:19 smithi016 ceph-mon[34911]: pgmap v158: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2024-09-19T06:45:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:19 smithi173 ceph-mon[35349]: pgmap v158: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2024-09-19T06:45:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:19 smithi012 ceph-mon[30937]: pgmap v158: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2024-09-19T06:45:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:45:21.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.522+0000 7feeca7d6640 1 -- 172.21.15.12:0/3059930807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec4101200 msgr2=0x7feec4104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.522+0000 7feeca7d6640 1 --2- 172.21.15.12:0/3059930807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec4101200 0x7feec4104de0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7feeac009900 tx=0x7feeac02a410 comp rx=0 tx=0).stop 2024-09-19T06:45:21.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.522+0000 7feeca7d6640 1 -- 172.21.15.12:0/3059930807 shutdown_connections 2024-09-19T06:45:21.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.522+0000 7feeca7d6640 1 --2- 172.21.15.12:0/3059930807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feec4105540 0x7feec410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.522+0000 7feeca7d6640 1 --2- 172.21.15.12:0/3059930807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec4101200 0x7feec4104de0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.522+0000 7feeca7d6640 1 --2- 172.21.15.12:0/3059930807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feec4100850 0x7feec4100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.522+0000 7feeca7d6640 1 -- 172.21.15.12:0/3059930807 >> 172.21.15.12:0/3059930807 conn(0x7feec4075db0 msgr2=0x7feec40761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.522+0000 7feeca7d6640 1 -- 172.21.15.12:0/3059930807 shutdown_connections 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.522+0000 7feeca7d6640 1 -- 172.21.15.12:0/3059930807 wait complete. 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feeca7d6640 1 Processor -- start 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feeca7d6640 1 -- start start 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feeca7d6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feec4100850 0x7feec4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feeca7d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec4105540 0x7feec4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feeca7d6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feec419ccf0 0x7feec419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feeca7d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feec410fd20 con 0x7feec4105540 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feeca7d6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feec410fba0 con 0x7feec419ccf0 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feeca7d6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feec410fea0 con 0x7feec4100850 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feebbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec4105540 0x7feec4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feebbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec4105540 0x7feec4198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33322/0 (socket says 172.21.15.12:33322) 2024-09-19T06:45:21.526 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feebbfff640 1 -- 172.21.15.12:0/3266700867 learned_addr learned my addr 172.21.15.12:0/3266700867 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feebbfff640 1 -- 172.21.15.12:0/3266700867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feec4100850 msgr2=0x7feec4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feebbfff640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feec4100850 0x7feec4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feebbfff640 1 -- 172.21.15.12:0/3266700867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feec419ccf0 msgr2=0x7feec419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feec8d73640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feec419ccf0 0x7feec419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feebbfff640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feec419ccf0 0x7feec419d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feebbfff640 1 -- 172.21.15.12:0/3266700867 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec419d7e0 con 0x7feec4105540 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.523+0000 7feebbfff640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec4105540 0x7feec4198970 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7feeac005940 tx=0x7feeac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.524+0000 7feec1ffb640 1 -- 172.21.15.12:0/3266700867 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac03f030 con 0x7feec4105540 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.524+0000 7feeca7d6640 1 -- 172.21.15.12:0/3266700867 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec419da70 con 0x7feec4105540 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.524+0000 7feec1ffb640 1 -- 172.21.15.12:0/3266700867 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeac003ce0 con 0x7feec4105540 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.524+0000 7feec1ffb640 1 -- 172.21.15.12:0/3266700867 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac035070 con 0x7feec4105540 2024-09-19T06:45:21.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.524+0000 7feeca7d6640 1 -- 172.21.15.12:0/3266700867 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec41a51d0 con 0x7feec4105540 2024-09-19T06:45:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.526+0000 7feec1ffb640 1 -- 172.21.15.12:0/3266700867 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7feeac042030 con 0x7feec4105540 2024-09-19T06:45:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.526+0000 7feecd650740 1 Processor -- start 2024-09-19T06:45:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.526+0000 7feecd650740 1 -- start start 2024-09-19T06:45:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feecd650740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feecd650740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60af410 0x55fbc60b9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feecd650740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feecd650740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbc60132f0 con 0x55fbc60aeaf0 2024-09-19T06:45:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feecd650740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fbc5fbb270 con 0x55fbc60b9cb0 2024-09-19T06:45:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feecd650740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fbc600f2b0 con 0x55fbc60af410 2024-09-19T06:45:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec1ffb640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feeb00a3460 0x7feeb00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec8d73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec8d73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33324/0 (socket says 172.21.15.12:33324) 2024-09-19T06:45:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec8d73640 1 -- 172.21.15.12:0/1233153343 learned_addr learned my addr 172.21.15.12:0/1233153343 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec8d73640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feeb00a3460 0x7feeb00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feebbfff640 1 --2- 172.21.15.12:0/1233153343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec3fff640 1 --2- 172.21.15.12:0/1233153343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60af410 0x55fbc60b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec1ffb640 1 -- 172.21.15.12:0/3266700867 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7feeac0f0400 con 0x7feec4105540 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec8d73640 1 -- 172.21.15.12:0/1233153343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60af410 msgr2=0x55fbc60b9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec8d73640 1 --2- 172.21.15.12:0/1233153343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60af410 0x55fbc60b9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec8d73640 1 -- 172.21.15.12:0/1233153343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 msgr2=0x55fbc60bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec8d73640 1 --2- 172.21.15.12:0/1233153343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60bc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec8d73640 1 -- 172.21.15.12:0/1233153343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc5fba340 con 0x55fbc60aeaf0 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.527+0000 7feec8d73640 1 --2- 172.21.15.12:0/1233153343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60aeed0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7feebc014cf0 tx=0x7feebc011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be89ac698708e547 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feec8d73640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feeb00a3460 0x7feeb00a5920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feebc009fd0 tx=0x7feebc016000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feeba7fc640 1 -- 172.21.15.12:0/1233153343 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc009ab0 con 0x55fbc60aeaf0 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feeba7fc640 1 -- 172.21.15.12:0/1233153343 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feebc014640 con 0x55fbc60aeaf0 2024-09-19T06:45:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feeba7fc640 1 -- 172.21.15.12:0/1233153343 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc005020 con 0x55fbc60aeaf0 2024-09-19T06:45:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feecd650740 1 -- 172.21.15.12:0/1233153343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 msgr2=0x55fbc60aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feecd650740 1 --2- 172.21.15.12:0/1233153343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60aeed0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7feebc014cf0 tx=0x7feebc011750 comp rx=0 tx=0).stop 2024-09-19T06:45:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feecd650740 1 -- 172.21.15.12:0/1233153343 shutdown_connections 2024-09-19T06:45:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feecd650740 1 --2- 172.21.15.12:0/1233153343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feecd650740 1 --2- 172.21.15.12:0/1233153343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60af410 0x55fbc60b9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feecd650740 1 --2- 172.21.15.12:0/1233153343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60aeed0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feecd650740 1 -- 172.21.15.12:0/1233153343 >> 172.21.15.12:0/1233153343 conn(0x55fbc60ab060 msgr2=0x55fbc60ab440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feecd650740 1 -- 172.21.15.12:0/1233153343 shutdown_connections 2024-09-19T06:45:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.528+0000 7feecd650740 1 -- 172.21.15.12:0/1233153343 wait complete. 2024-09-19T06:45:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.529+0000 7feecd650740 1 -- start start 2024-09-19T06:45:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.529+0000 7feecd650740 1 Processor -- start 2024-09-19T06:45:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.529+0000 7feecd650740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60aeaf0 0x55fbc60b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.529+0000 7feecd650740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60af410 0x55fbc60b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.529+0000 7feecd650740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.529+0000 7feecd650740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbc60bc880 con 0x55fbc60af410 2024-09-19T06:45:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.529+0000 7feecd650740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fbc5f9c290 con 0x55fbc60b9cb0 2024-09-19T06:45:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.529+0000 7feecd650740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fbc60bca00 con 0x55fbc60aeaf0 2024-09-19T06:45:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.529+0000 7feecd650740 10 client.0 _ll_register_callbacks cb 0x55fbc5fcd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feebbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60af410 0x55fbc60b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feebbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60af410 0x55fbc60b71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33338/0 (socket says 172.21.15.12:33338) 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feec3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60aeaf0 0x55fbc60b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feebbfff640 1 -- 172.21.15.12:0/1996552186 learned_addr learned my addr 172.21.15.12:0/1996552186 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feec8d73640 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feebbfff640 1 -- 172.21.15.12:0/1996552186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60aeaf0 msgr2=0x55fbc60b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feebbfff640 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60aeaf0 0x55fbc60b6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feebbfff640 1 -- 172.21.15.12:0/1996552186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 msgr2=0x55fbc60b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feebbfff640 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feebbfff640 1 -- 172.21.15.12:0/1996552186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc5d26210 con 0x55fbc60af410 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feebbfff640 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60af410 0x55fbc60b71a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7feeac006010 tx=0x7feeac041cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d8f5f50c95dc0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feea37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feea37fe640 1 -- 172.21.15.12:0/1996552186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac0d4020 con 0x55fbc60af410 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feea37fe640 1 -- 172.21.15.12:0/1996552186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7feeac0b8c70 con 0x55fbc60af410 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feecd650740 1 -- 172.21.15.12:0/1996552186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feebc014640 con 0x55fbc60af410 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feea37fe640 1 -- 172.21.15.12:0/1996552186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7feeac049040 con 0x55fbc60af410 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feecd650740 10 client.16986 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feecd650740 1 -- 172.21.15.12:0/1996552186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fbc5df2620 con 0x55fbc60af410 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.530+0000 7feea37fe640 1 -- 172.21.15.12:0/1996552186 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feebc014640 con 0x55fbc60af410 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.531+0000 7feea37fe640 1 -- 172.21.15.12:0/1996552186 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7feeac03bc50 con 0x55fbc60af410 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.531+0000 7feecd650740 10 client.16986 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.531+0000 7feecd650740 10 client.16986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.531+0000 7feecd650740 20 client.16986 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.531+0000 7feecd650740 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fbc60c9ca0 0x55fbc60cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.531+0000 7feecd650740 4 client.16986 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.531+0000 7feecd650740 1 -- 172.21.15.12:0/1996552186 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbc6020a20 con 0x55fbc60c9ca0 2024-09-19T06:45:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.531+0000 7feec3fff640 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fbc60c9ca0 0x55fbc60cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.531+0000 7feea37fe640 10 client.16986 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.531+0000 7feec3fff640 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fbc60c9ca0 0x55fbc60cc090 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=923ca2bdccd0a678 server_cookie=100e0c3fd4549c9f in_seq=0 out_seq=0 2024-09-19T06:45:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.532+0000 7feea37fe640 1 -- 172.21.15.12:0/1996552186 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbc6020a20 con 0x55fbc60c9ca0 2024-09-19T06:45:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.532+0000 7feea37fe640 10 client.16986 handle_command_reply: tid=0 2024-09-19T06:45:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.532+0000 7feecd650740 1 client.16986 shutdown 2024-09-19T06:45:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.532+0000 7feecd650740 1 -- 172.21.15.12:0/1996552186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60af410 msgr2=0x55fbc60b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feecd650740 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60af410 0x55fbc60b71a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7feeac006010 tx=0x7feeac041cd0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feecd650740 1 -- 172.21.15.12:0/1996552186 shutdown_connections 2024-09-19T06:45:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feecd650740 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fbc60c9ca0 0x55fbc60cc090 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feecd650740 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feea37fe640 0 client.16986 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feecd650740 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60af410 0x55fbc60b71a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feecd650740 1 --2- 172.21.15.12:0/1996552186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60aeaf0 0x55fbc60b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feecd650740 1 -- 172.21.15.12:0/1996552186 >> 172.21.15.12:0/1996552186 conn(0x55fbc60ab060 msgr2=0x55fbc60aa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feecd650740 1 -- 172.21.15.12:0/1996552186 shutdown_connections 2024-09-19T06:45:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feecd650740 1 -- 172.21.15.12:0/1996552186 wait complete. 2024-09-19T06:45:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.533+0000 7feecd650740 20 client.16986 trim_cache size 0 max 16384 2024-09-19T06:45:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.547+0000 7feecd650740 1 Processor -- start 2024-09-19T06:45:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.547+0000 7feecd650740 1 -- start start 2024-09-19T06:45:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.547+0000 7feecd650740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.547+0000 7feecd650740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60af410 0x55fbc60b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.547+0000 7feecd650740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.547+0000 7feecd650740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feec41ada10 con 0x55fbc60aeaf0 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.547+0000 7feecd650740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feec41af580 con 0x55fbc60b9cb0 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.547+0000 7feecd650740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feec41ae0e0 con 0x55fbc60af410 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.547+0000 7feec3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.547+0000 7feec3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33340/0 (socket says 172.21.15.12:33340) 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.548+0000 7feec3fff640 1 -- 172.21.15.12:0/2632116355 learned_addr learned my addr 172.21.15.12:0/2632116355 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.548+0000 7feec3fff640 1 -- 172.21.15.12:0/2632116355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60af410 msgr2=0x55fbc60b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.548+0000 7feec3fff640 1 --2- 172.21.15.12:0/2632116355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60af410 0x55fbc60b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.548+0000 7feec3fff640 1 -- 172.21.15.12:0/2632116355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 msgr2=0x55fbc60d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.548+0000 7feec3fff640 1 --2- 172.21.15.12:0/2632116355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.548+0000 7feec3fff640 1 -- 172.21.15.12:0/2632116355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc60cc6e0 con 0x55fbc60aeaf0 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.548+0000 7feec3fff640 1 --2- 172.21.15.12:0/2632116355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60b5ba0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7feeb4005d00 tx=0x7feeb400b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354032bbbe859844 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.548+0000 7feeb9ffb640 1 -- 172.21.15.12:0/2632116355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4004230 con 0x55fbc60aeaf0 2024-09-19T06:45:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.548+0000 7feeb9ffb640 1 -- 172.21.15.12:0/2632116355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeb40043d0 con 0x55fbc60aeaf0 2024-09-19T06:45:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.548+0000 7feeb9ffb640 1 -- 172.21.15.12:0/2632116355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb40035f0 con 0x55fbc60aeaf0 2024-09-19T06:45:21.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 -- 172.21.15.12:0/2632116355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 msgr2=0x55fbc60b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 --2- 172.21.15.12:0/2632116355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60b5ba0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7feeb4005d00 tx=0x7feeb400b490 comp rx=0 tx=0).stop 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 -- 172.21.15.12:0/2632116355 shutdown_connections 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 --2- 172.21.15.12:0/2632116355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60b9cb0 0x55fbc60d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 --2- 172.21.15.12:0/2632116355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60af410 0x55fbc60b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 --2- 172.21.15.12:0/2632116355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60aeaf0 0x55fbc60b5ba0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 -- 172.21.15.12:0/2632116355 >> 172.21.15.12:0/2632116355 conn(0x55fbc60ab060 msgr2=0x55fbc60aa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 -- 172.21.15.12:0/2632116355 shutdown_connections 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 -- 172.21.15.12:0/2632116355 wait complete. 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 -- start start 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 Processor -- start 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60aeaf0 0x55fbc60c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.554 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60af410 0x55fbc60c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60b9cb0 0x55fbc60bec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feec41aeeb0 con 0x55fbc60b9cb0 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feec41ae7b0 con 0x55fbc60af410 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.549+0000 7feecd650740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feec41ab9f0 con 0x55fbc60aeaf0 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feecd650740 10 client.0 _ll_register_callbacks cb 0x7feeac009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feec8d73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60b9cb0 0x55fbc60bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feec3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60aeaf0 0x55fbc60c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feec8d73640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60b9cb0 0x55fbc60bec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33344/0 (socket says 172.21.15.12:33344) 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feec8d73640 1 -- 172.21.15.12:0/1972545846 learned_addr learned my addr 172.21.15.12:0/1972545846 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feebbfff640 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60af410 0x55fbc60c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feec8d73640 1 -- 172.21.15.12:0/1972545846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60aeaf0 msgr2=0x55fbc60c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feec8d73640 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60aeaf0 0x55fbc60c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feec8d73640 1 -- 172.21.15.12:0/1972545846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60af410 msgr2=0x55fbc60c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:21.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feec8d73640 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60af410 0x55fbc60c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feec8d73640 1 -- 172.21.15.12:0/1972545846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc60b7a50 con 0x55fbc60b9cb0 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feec8d73640 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60b9cb0 0x55fbc60bec60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7feebc014cf0 tx=0x7feebc014400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4688d259e7322af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feea37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feea37fe640 1 -- 172.21.15.12:0/1972545846 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc009ab0 con 0x55fbc60b9cb0 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feea37fe640 1 -- 172.21.15.12:0/1972545846 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7feebc00cd50 con 0x55fbc60b9cb0 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feecd650740 1 -- 172.21.15.12:0/1972545846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeb40043d0 con 0x55fbc60b9cb0 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feea37fe640 1 -- 172.21.15.12:0/1972545846 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7feebc014640 con 0x55fbc60b9cb0 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feecd650740 10 client.16992 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.550+0000 7feecd650740 1 -- 172.21.15.12:0/1972545846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fbc60abcf0 con 0x55fbc60b9cb0 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feea37fe640 1 -- 172.21.15.12:0/1972545846 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeb40043d0 con 0x55fbc60b9cb0 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feea37fe640 1 -- 172.21.15.12:0/1972545846 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7feebc01d070 con 0x55fbc60b9cb0 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feecd650740 10 client.16992 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:21.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feecd650740 10 client.16992 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feecd650740 20 client.16992 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feecd650740 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fbc6135440 0x55fbc6137860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feecd650740 4 client.16992 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:45:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feecd650740 1 -- 172.21.15.12:0/1972545846 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fbc601ad70 con 0x55fbc6135440 2024-09-19T06:45:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feec3fff640 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fbc6135440 0x55fbc6137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feea37fe640 10 client.16992 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:21.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.551+0000 7feec3fff640 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fbc6135440 0x55fbc6137860 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12f4220f68001c13 server_cookie=4a60cb9e082e0890 in_seq=0 out_seq=0 2024-09-19T06:45:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feea37fe640 1 -- 172.21.15.12:0/1972545846 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fbc601ad70 con 0x55fbc6135440 2024-09-19T06:45:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feea37fe640 10 client.16992 handle_command_reply: tid=0 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 client.16992 shutdown 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 -- 172.21.15.12:0/1972545846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60b9cb0 msgr2=0x55fbc60bec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60b9cb0 0x55fbc60bec60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7feebc014cf0 tx=0x7feebc014400 comp rx=0 tx=0).stop 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 -- 172.21.15.12:0/1972545846 shutdown_connections 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fbc6135440 0x55fbc6137860 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc60b9cb0 0x55fbc60bec60 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbc60af410 0x55fbc60c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 --2- 172.21.15.12:0/1972545846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbc60aeaf0 0x55fbc60c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feea37fe640 0 client.16992 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 -- 172.21.15.12:0/1972545846 >> 172.21.15.12:0/1972545846 conn(0x55fbc60ab060 msgr2=0x55fbc60b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 -- 172.21.15.12:0/1972545846 shutdown_connections 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 1 -- 172.21.15.12:0/1972545846 wait complete. 2024-09-19T06:45:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.566+0000 7feecd650740 20 client.16992 trim_cache size 0 max 16384 2024-09-19T06:45:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:45:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:45:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:45:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 -- 172.21.15.12:0/3266700867 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feeb00a3460 msgr2=0x7feeb00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feeb00a3460 0x7feeb00a5920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feebc009fd0 tx=0x7feebc016000 comp rx=0 tx=0).stop 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 -- 172.21.15.12:0/3266700867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec4105540 msgr2=0x7feec4198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec4105540 0x7feec4198970 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7feeac005940 tx=0x7feeac0042f0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 -- 172.21.15.12:0/3266700867 shutdown_connections 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feec419ccf0 0x7feec419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec4105540 0x7feec4198970 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feeb00a3460 0x7feeb00a5920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 --2- 172.21.15.12:0/3266700867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feec4100850 0x7feec4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 -- 172.21.15.12:0/3266700867 >> 172.21.15.12:0/3266700867 conn(0x7feec4075db0 msgr2=0x7feec4104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 -- 172.21.15.12:0/3266700867 shutdown_connections 2024-09-19T06:45:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:21.567+0000 7feeca7d6640 1 -- 172.21.15.12:0/3266700867 wait complete. 2024-09-19T06:45:21.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:21 smithi016 ceph-mon[34911]: pgmap v159: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 2.8 MiB/s wr, 346 op/s 2024-09-19T06:45:21.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:21 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:21.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:21 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:21.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:21 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:21.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:21 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:45:21.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:21 smithi173 ceph-mon[35349]: pgmap v159: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 2.8 MiB/s wr, 346 op/s 2024-09-19T06:45:21.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:21 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:21 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:21 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:21.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:21 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:45:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:21 smithi012 ceph-mon[30937]: pgmap v159: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 2.8 MiB/s wr, 346 op/s 2024-09-19T06:45:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:21 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:21 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:21 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:21 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:45:23.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:23 smithi016 ceph-mon[34911]: pgmap v160: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 1.0 MiB/s wr, 194 op/s 2024-09-19T06:45:23.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:23 smithi173 ceph-mon[35349]: pgmap v160: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 1.0 MiB/s wr, 194 op/s 2024-09-19T06:45:23.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:23 smithi012 ceph-mon[30937]: pgmap v160: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 1.0 MiB/s wr, 194 op/s 2024-09-19T06:45:24.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:24 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:45:24.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:24 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:45:24.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:24 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:45:24.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:24 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:45:24.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:24 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:45:24.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:24 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:45:24.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:24 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:45:24.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:24 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:45:24.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:24 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:45:24.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:24 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:45:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:24 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:45:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:24 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:45:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:24 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:45:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:24 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:45:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:24 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:45:25.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:25 smithi016 ceph-mon[34911]: pgmap v161: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.0 MiB/s wr, 196 op/s 2024-09-19T06:45:25.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:25 smithi012 ceph-mon[30937]: pgmap v161: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.0 MiB/s wr, 196 op/s 2024-09-19T06:45:25.811 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:45:25.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:25 smithi173 ceph-mon[35349]: pgmap v161: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.0 MiB/s wr, 196 op/s 2024-09-19T06:45:27.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:27 smithi016 ceph-mon[34911]: pgmap v162: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 1.2 MiB/s wr, 204 op/s 2024-09-19T06:45:27.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:27 smithi173 ceph-mon[35349]: pgmap v162: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 1.2 MiB/s wr, 204 op/s 2024-09-19T06:45:27.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:27 smithi012 ceph-mon[30937]: pgmap v162: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 1.2 MiB/s wr, 204 op/s 2024-09-19T06:45:29.688 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:45:29.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:29 smithi012 ceph-mon[30937]: pgmap v163: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 1.2 MiB/s wr, 199 op/s 2024-09-19T06:45:29.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:29 smithi016 ceph-mon[34911]: pgmap v163: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 1.2 MiB/s wr, 199 op/s 2024-09-19T06:45:29.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:29 smithi173 ceph-mon[35349]: pgmap v163: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 1.2 MiB/s wr, 199 op/s 2024-09-19T06:45:29.965 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 -- 172.21.15.12:0/2293189264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12fc101de0 msgr2=0x7f12fc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 --2- 172.21.15.12:0/2293189264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12fc101de0 0x7f12fc1021c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009900 tx=0x7f12f002a410 comp rx=0 tx=0).stop 2024-09-19T06:45:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 -- 172.21.15.12:0/2293189264 shutdown_connections 2024-09-19T06:45:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 --2- 172.21.15.12:0/2293189264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12fc106f10 0x7f12fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 --2- 172.21.15.12:0/2293189264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12fc102790 0x7f12fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 --2- 172.21.15.12:0/2293189264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12fc101de0 0x7f12fc1021c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 -- 172.21.15.12:0/2293189264 >> 172.21.15.12:0/2293189264 conn(0x7f12fc0fd8c0 msgr2=0x7f12fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:30.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 -- 172.21.15.12:0/2293189264 shutdown_connections 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 -- 172.21.15.12:0/2293189264 wait complete. 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 Processor -- start 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 -- start start 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.450+0000 7f1303162640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12fc101de0 0x7f12fc1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f1303162640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12fc102790 0x7f12fc1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f1303162640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12fc106f10 0x7f12fc19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f1303162640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc111f70 con 0x7f12fc102790 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f1303162640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc111df0 con 0x7f12fc101de0 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f1303162640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc1120f0 con 0x7f12fc106f10 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12fc102790 0x7f12fc1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12fc102790 0x7f12fc1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49586/0 (socket says 172.21.15.12:49586) 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12fbfff640 1 -- 172.21.15.12:0/2984301882 learned_addr learned my addr 172.21.15.12:0/2984301882 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:30.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f1300efe640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12fc101de0 0x7f12fc1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12fbfff640 1 -- 172.21.15.12:0/2984301882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12fc106f10 msgr2=0x7f12fc19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f13016ff640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12fc106f10 0x7f12fc19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12fbfff640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12fc106f10 0x7f12fc19cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12fbfff640 1 -- 172.21.15.12:0/2984301882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12fc101de0 msgr2=0x7f12fc1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12fbfff640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12fc101de0 0x7f12fc1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12fbfff640 1 -- 172.21.15.12:0/2984301882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12fc19d460 con 0x7f12fc102790 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12fbfff640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12fc102790 0x7f12fc1989f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f12e800d770 tx=0x7f12e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12f9ffb640 1 -- 172.21.15.12:0/2984301882 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8017070 con 0x7f12fc102790 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12f9ffb640 1 -- 172.21.15.12:0/2984301882 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12e8005500 con 0x7f12fc102790 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f1303162640 1 -- 172.21.15.12:0/2984301882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12fc19d750 con 0x7f12fc102790 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.451+0000 7f12f9ffb640 1 -- 172.21.15.12:0/2984301882 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8004e00 con 0x7f12fc102790 2024-09-19T06:45:30.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.452+0000 7f1303162640 1 -- 172.21.15.12:0/2984301882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12fc1a5030 con 0x7f12fc102790 2024-09-19T06:45:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.453+0000 7f1303162640 1 -- 172.21.15.12:0/2984301882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12fc1021c0 con 0x7f12fc102790 2024-09-19T06:45:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.454+0000 7f12f9ffb640 1 -- 172.21.15.12:0/2984301882 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f12e8004fa0 con 0x7f12fc102790 2024-09-19T06:45:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.454+0000 7f12f9ffb640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f12ec0a3430 0x7f12ec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.455+0000 7f1300efe640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f12ec0a3430 0x7f12ec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.455+0000 7f12f9ffb640 1 -- 172.21.15.12:0/2984301882 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f12e80cf770 con 0x7f12fc102790 2024-09-19T06:45:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.455+0000 7f1300efe640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f12ec0a3430 0x7f12ec0a58f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009230 tx=0x7f12f00058d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.459+0000 7f12f9ffb640 1 -- 172.21.15.12:0/2984301882 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f12e809c0d0 con 0x7f12fc102790 2024-09-19T06:45:30.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.669+0000 7f1303162640 1 -- 172.21.15.12:0/2984301882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12fc109b60 con 0x7f12fc102790 2024-09-19T06:45:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.670+0000 7f12f9ffb640 1 -- 172.21.15.12:0/2984301882 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11972 (secure 0 0 0) 0x7f12e809b9d0 con 0x7f12fc102790 2024-09-19T06:45:30.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:45:30.672 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"btime":"2024-09-19T06:44:20:228405+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:44:19.565004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:45:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 35 2024-09-19T06:45:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 -- 172.21.15.12:0/2984301882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f12ec0a3430 msgr2=0x7f12ec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f12ec0a3430 0x7f12ec0a58f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009230 tx=0x7f12f00058d0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 -- 172.21.15.12:0/2984301882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12fc102790 msgr2=0x7f12fc1989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12fc102790 0x7f12fc1989f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f12e800d770 tx=0x7f12e800dc30 comp rx=0 tx=0).stop 2024-09-19T06:45:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 -- 172.21.15.12:0/2984301882 shutdown_connections 2024-09-19T06:45:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f12ec0a3430 0x7f12ec0a58f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12fc106f10 0x7f12fc19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12fc102790 0x7f12fc1989f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 --2- 172.21.15.12:0/2984301882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12fc101de0 0x7f12fc1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 -- 172.21.15.12:0/2984301882 >> 172.21.15.12:0/2984301882 conn(0x7f12fc0fd8c0 msgr2=0x7f12fc0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:30.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 -- 172.21.15.12:0/2984301882 shutdown_connections 2024-09-19T06:45:30.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:30.672+0000 7f1303162640 1 -- 172.21.15.12:0/2984301882 wait complete. 2024-09-19T06:45:30.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:45:31.434 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 36083eb1 --release --await' 2024-09-19T06:45:31.434 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 36083eb1 --release --await 2024-09-19T06:45:31.735 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:31.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:31 smithi016 ceph-mon[34911]: pgmap v164: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 1.2 MiB/s wr, 204 op/s 2024-09-19T06:45:31.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:31 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2984301882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:31.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:31 smithi173 ceph-mon[35349]: pgmap v164: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 1.2 MiB/s wr, 204 op/s 2024-09-19T06:45:31.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:31 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2984301882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:31.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:31 smithi012 ceph-mon[30937]: pgmap v164: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 1.2 MiB/s wr, 204 op/s 2024-09-19T06:45:31.856 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:31 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2984301882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.178+0000 7f8664ba7640 1 -- 172.21.15.12:0/2965241383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8660106a90 msgr2=0x7f8660106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.178+0000 7f8664ba7640 1 --2- 172.21.15.12:0/2965241383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8660106a90 0x7f8660106e70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8650009930 tx=0x7f865002a420 comp rx=0 tx=0).stop 2024-09-19T06:45:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.178+0000 7f8664ba7640 1 -- 172.21.15.12:0/2965241383 shutdown_connections 2024-09-19T06:45:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.178+0000 7f8664ba7640 1 --2- 172.21.15.12:0/2965241383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8660101430 0x7f866010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.178+0000 7f8664ba7640 1 --2- 172.21.15.12:0/2965241383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8660100a90 0x7f8660100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.178+0000 7f8664ba7640 1 --2- 172.21.15.12:0/2965241383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8660106a90 0x7f8660106e70 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.178+0000 7f8664ba7640 1 -- 172.21.15.12:0/2965241383 >> 172.21.15.12:0/2965241383 conn(0x7f86600fc7d0 msgr2=0x7f86600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.178+0000 7f8664ba7640 1 -- 172.21.15.12:0/2965241383 shutdown_connections 2024-09-19T06:45:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.178+0000 7f8664ba7640 1 -- 172.21.15.12:0/2965241383 wait complete. 2024-09-19T06:45:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.179+0000 7f8664ba7640 1 Processor -- start 2024-09-19T06:45:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.179+0000 7f8664ba7640 1 -- start start 2024-09-19T06:45:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.179+0000 7f8664ba7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8660100a90 0x7f8660197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.179+0000 7f8664ba7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8660101430 0x7f8660197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.179+0000 7f8664ba7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8660106a90 0x7f866019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f8664ba7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8660110f00 con 0x7f8660100a90 2024-09-19T06:45:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f8664ba7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8660110d80 con 0x7f8660101430 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f8664ba7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8660111080 con 0x7f8660106a90 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8660100a90 0x7f8660197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8660100a90 0x7f8660197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49612/0 (socket says 172.21.15.12:49612) 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865e59c640 1 -- 172.21.15.12:0/807670544 learned_addr learned my addr 172.21.15.12:0/807670544 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865dd9b640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8660101430 0x7f8660197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865ed9d640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8660106a90 0x7f866019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865e59c640 1 -- 172.21.15.12:0/807670544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8660106a90 msgr2=0x7f866019bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865e59c640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8660106a90 0x7f866019bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865e59c640 1 -- 172.21.15.12:0/807670544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8660101430 msgr2=0x7f8660197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865e59c640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8660101430 0x7f8660197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865e59c640 1 -- 172.21.15.12:0/807670544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866019c2d0 con 0x7f8660100a90 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f865e59c640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8660100a90 0x7f8660197320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f865002a940 tx=0x7f8650003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f864f7fe640 1 -- 172.21.15.12:0/807670544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865003f070 con 0x7f8660100a90 2024-09-19T06:45:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f864f7fe640 1 -- 172.21.15.12:0/807670544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8650031c90 con 0x7f8660100a90 2024-09-19T06:45:32.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.180+0000 7f8664ba7640 1 -- 172.21.15.12:0/807670544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f866019c560 con 0x7f8660100a90 2024-09-19T06:45:32.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.181+0000 7f864f7fe640 1 -- 172.21.15.12:0/807670544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650035030 con 0x7f8660100a90 2024-09-19T06:45:32.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.181+0000 7f8664ba7640 1 -- 172.21.15.12:0/807670544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f866006a790 con 0x7f8660100a90 2024-09-19T06:45:32.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.183+0000 7f864f7fe640 1 -- 172.21.15.12:0/807670544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8650042070 con 0x7f8660100a90 2024-09-19T06:45:32.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.183+0000 7f8666f80740 1 Processor -- start 2024-09-19T06:45:32.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.183+0000 7f8666f80740 1 -- start start 2024-09-19T06:45:32.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f8666f80740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb44440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f8666f80740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44980 0x55659eb4ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f8666f80740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 0x55659eb51630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f8666f80740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55659eaa9620 con 0x55659eb44060 2024-09-19T06:45:32.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f8666f80740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55659ea50e50 con 0x55659eb4f240 2024-09-19T06:45:32.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f8666f80740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55659eaa55e0 con 0x55659eb44980 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f864f7fe640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f86480a3430 0x7f86480a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb44440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb44440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49618/0 (socket says 172.21.15.12:49618) 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865ed9d640 1 -- 172.21.15.12:0/3116187419 learned_addr learned my addr 172.21.15.12:0/3116187419 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865ed9d640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f86480a3430 0x7f86480a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f864f7fe640 1 -- 172.21.15.12:0/807670544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f86500f0960 con 0x7f8660100a90 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865e59c640 1 --2- 172.21.15.12:0/3116187419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44980 0x55659eb4ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865dd9b640 1 --2- 172.21.15.12:0/3116187419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 0x55659eb51630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865ed9d640 1 -- 172.21.15.12:0/3116187419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44980 msgr2=0x55659eb4ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865ed9d640 1 --2- 172.21.15.12:0/3116187419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44980 0x55659eb4ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865ed9d640 1 -- 172.21.15.12:0/3116187419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 msgr2=0x55659eb51630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865ed9d640 1 --2- 172.21.15.12:0/3116187419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 0x55659eb51630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865ed9d640 1 -- 172.21.15.12:0/3116187419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55659ea41d40 con 0x55659eb44060 2024-09-19T06:45:32.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.184+0000 7f865ed9d640 1 --2- 172.21.15.12:0/3116187419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb44440 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f865800af30 tx=0x7f8658016700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a40504dffaf7d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:32.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f865ed9d640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f86480a3430 0x7f86480a58f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8658009fd0 tx=0x7f865801a000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:32.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f864cff9640 1 -- 172.21.15.12:0/3116187419 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658026070 con 0x55659eb44060 2024-09-19T06:45:32.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f864cff9640 1 -- 172.21.15.12:0/3116187419 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f865800a590 con 0x55659eb44060 2024-09-19T06:45:32.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f864cff9640 1 -- 172.21.15.12:0/3116187419 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658013040 con 0x55659eb44060 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f8666f80740 1 -- 172.21.15.12:0/3116187419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 msgr2=0x55659eb44440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f8666f80740 1 --2- 172.21.15.12:0/3116187419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb44440 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f865800af30 tx=0x7f8658016700 comp rx=0 tx=0).stop 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f8666f80740 1 -- 172.21.15.12:0/3116187419 shutdown_connections 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f8666f80740 1 --2- 172.21.15.12:0/3116187419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 0x55659eb51630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f8666f80740 1 --2- 172.21.15.12:0/3116187419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44980 0x55659eb4ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f8666f80740 1 --2- 172.21.15.12:0/3116187419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb44440 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.185+0000 7f8666f80740 1 -- 172.21.15.12:0/3116187419 >> 172.21.15.12:0/3116187419 conn(0x55659eb405f0 msgr2=0x55659eb409d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 1 -- 172.21.15.12:0/3116187419 shutdown_connections 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 1 -- 172.21.15.12:0/3116187419 wait complete. 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 1 -- start start 2024-09-19T06:45:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 1 Processor -- start 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 0x55659eb4c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 0x55659eb4c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb4cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55659eb51e10 con 0x55659eb4f240 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55659ea31f10 con 0x55659eb44980 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55659eb51f90 con 0x55659eb44060 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f8666f80740 10 client.0 _ll_register_callbacks cb 0x55659ea55db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.186+0000 7f865ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb4cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb4cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49632/0 (socket says 172.21.15.12:49632) 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865ed9d640 1 -- 172.21.15.12:0/472386436 learned_addr learned my addr 172.21.15.12:0/472386436 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865dd9b640 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 0x55659eb4c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865e59c640 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 0x55659eb4c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865ed9d640 1 -- 172.21.15.12:0/472386436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 msgr2=0x55659eb4c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865ed9d640 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 0x55659eb4c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865ed9d640 1 -- 172.21.15.12:0/472386436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 msgr2=0x55659eb4c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865ed9d640 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 0x55659eb4c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865ed9d640 1 -- 172.21.15.12:0/472386436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55659e7b8580 con 0x55659eb4f240 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865e59c640 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 0x55659eb4c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865dd9b640 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 0x55659eb4c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f865ed9d640 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb4cbe0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8658021af0 tx=0x7f8658009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44380fc56847aa84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f8645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f8645ffb640 1 -- 172.21.15.12:0/472386436 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658030070 con 0x55659eb4f240 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f8645ffb640 1 -- 172.21.15.12:0/472386436 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f865800a880 con 0x55659eb4f240 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f8666f80740 1 -- 172.21.15.12:0/472386436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f865800a590 con 0x55659eb4f240 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f8645ffb640 1 -- 172.21.15.12:0/472386436 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f865803c050 con 0x55659eb4f240 2024-09-19T06:45:32.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f8666f80740 10 client.17010 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.187+0000 7f8666f80740 1 -- 172.21.15.12:0/472386436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55659e882960 con 0x55659eb4f240 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.188+0000 7f8645ffb640 1 -- 172.21.15.12:0/472386436 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f865800a590 con 0x55659eb4f240 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.188+0000 7f8645ffb640 1 -- 172.21.15.12:0/472386436 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f865802b680 con 0x55659eb4f240 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.188+0000 7f8666f80740 10 client.17010 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.188+0000 7f8666f80740 10 client.17010 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.188+0000 7f8666f80740 20 client.17010 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.188+0000 7f8666f80740 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55659eb5ed30 0x55659eb61120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.188+0000 7f8666f80740 4 client.17010 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.188+0000 7f8666f80740 1 -- 172.21.15.12:0/472386436 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55659eab6b90 con 0x55659eb5ed30 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.188+0000 7f865e59c640 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55659eb5ed30 0x55659eb61120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.189+0000 7f8645ffb640 10 client.17010 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.189+0000 7f865e59c640 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55659eb5ed30 0x55659eb61120 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c56f2095efcf885e server_cookie=57f7171a5e409dfd in_seq=0 out_seq=0 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.189+0000 7f8645ffb640 1 -- 172.21.15.12:0/472386436 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55659eab6b90 con 0x55659eb5ed30 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.189+0000 7f8645ffb640 10 client.17010 handle_command_reply: tid=0 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.189+0000 7f8666f80740 1 client.17010 shutdown 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 1 -- 172.21.15.12:0/472386436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 msgr2=0x55659eb4cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb4cbe0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8658021af0 tx=0x7f8658009390 comp rx=0 tx=0).stop 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 1 -- 172.21.15.12:0/472386436 shutdown_connections 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55659eb5ed30 0x55659eb61120 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb4cbe0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 0x55659eb4c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8645ffb640 0 client.17010 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 1 --2- 172.21.15.12:0/472386436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 0x55659eb4c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 1 -- 172.21.15.12:0/472386436 >> 172.21.15.12:0/472386436 conn(0x55659eb405f0 msgr2=0x55659eb462d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 1 -- 172.21.15.12:0/472386436 shutdown_connections 2024-09-19T06:45:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 1 -- 172.21.15.12:0/472386436 wait complete. 2024-09-19T06:45:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.190+0000 7f8666f80740 20 client.17010 trim_cache size 0 max 16384 2024-09-19T06:45:32.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.207+0000 7f8666f80740 1 Processor -- start 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.207+0000 7f8666f80740 1 -- start start 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.207+0000 7f8666f80740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb46ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.207+0000 7f8666f80740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44980 0x55659eb3f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f8666f80740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 0x55659eb667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f8666f80740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f86601afc50 con 0x55659eb44060 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f8666f80740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f86601b17c0 con 0x55659eb4f240 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f8666f80740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f86601b0320 con 0x55659eb44980 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb46ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb46ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49646/0 (socket says 172.21.15.12:49646) 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865e59c640 1 -- 172.21.15.12:0/2998567579 learned_addr learned my addr 172.21.15.12:0/2998567579 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865dd9b640 1 --2- 172.21.15.12:0/2998567579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44980 0x55659eb3f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865e59c640 1 -- 172.21.15.12:0/2998567579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44980 msgr2=0x55659eb3f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865e59c640 1 --2- 172.21.15.12:0/2998567579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44980 0x55659eb3f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865ed9d640 1 --2- 172.21.15.12:0/2998567579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 0x55659eb667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865e59c640 1 -- 172.21.15.12:0/2998567579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 msgr2=0x55659eb667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865e59c640 1 --2- 172.21.15.12:0/2998567579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 0x55659eb667b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865e59c640 1 -- 172.21.15.12:0/2998567579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55659eb416a0 con 0x55659eb44060 2024-09-19T06:45:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865ed9d640 1 --2- 172.21.15.12:0/2998567579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 0x55659eb667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f865e59c640 1 --2- 172.21.15.12:0/2998567579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb46ac0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8650009900 tx=0x7f86500f0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37258e5028b2662 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f8647fff640 1 -- 172.21.15.12:0/2998567579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650049040 con 0x55659eb44060 2024-09-19T06:45:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f8647fff640 1 -- 172.21.15.12:0/2998567579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86500bcb60 con 0x55659eb44060 2024-09-19T06:45:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.208+0000 7f8647fff640 1 -- 172.21.15.12:0/2998567579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86500a5e60 con 0x55659eb44060 2024-09-19T06:45:32.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.209+0000 7f8666f80740 1 -- 172.21.15.12:0/2998567579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 msgr2=0x55659eb46ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.209+0000 7f8666f80740 1 --2- 172.21.15.12:0/2998567579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb46ac0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8650009900 tx=0x7f86500f0040 comp rx=0 tx=0).stop 2024-09-19T06:45:32.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.209+0000 7f8666f80740 1 -- 172.21.15.12:0/2998567579 shutdown_connections 2024-09-19T06:45:32.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.209+0000 7f8666f80740 1 --2- 172.21.15.12:0/2998567579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb4f240 0x55659eb667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.209+0000 7f8666f80740 1 --2- 172.21.15.12:0/2998567579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44980 0x55659eb3f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.209+0000 7f8666f80740 1 --2- 172.21.15.12:0/2998567579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb44060 0x55659eb46ac0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.209+0000 7f8666f80740 1 -- 172.21.15.12:0/2998567579 >> 172.21.15.12:0/2998567579 conn(0x55659eb405f0 msgr2=0x55659eb3ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.209+0000 7f8666f80740 1 -- 172.21.15.12:0/2998567579 shutdown_connections 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.209+0000 7f8666f80740 1 -- 172.21.15.12:0/2998567579 wait complete. 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.209+0000 7f8666f80740 1 -- start start 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f8666f80740 1 Processor -- start 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f8666f80740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 0x55659eb49100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f8666f80740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 0x55659eb49640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f8666f80740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb49b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f8666f80740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f86601b10f0 con 0x55659eb4f240 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f8666f80740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f86601b09f0 con 0x55659eb44980 2024-09-19T06:45:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f8666f80740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f86601adc30 con 0x55659eb44060 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f8666f80740 10 client.0 _ll_register_callbacks cb 0x7f865800ad00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb49b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb49b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49650/0 (socket says 172.21.15.12:49650) 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865ed9d640 1 -- 172.21.15.12:0/1211590079 learned_addr learned my addr 172.21.15.12:0/1211590079 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865e59c640 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 0x55659eb49100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865dd9b640 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 0x55659eb49640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865ed9d640 1 -- 172.21.15.12:0/1211590079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 msgr2=0x55659eb49100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865ed9d640 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 0x55659eb49100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865ed9d640 1 -- 172.21.15.12:0/1211590079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 msgr2=0x55659eb49640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865ed9d640 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 0x55659eb49640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865ed9d640 1 -- 172.21.15.12:0/1211590079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55659eb41280 con 0x55659eb4f240 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865e59c640 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 0x55659eb49100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.210+0000 7f865dd9b640 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 0x55659eb49640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f865ed9d640 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb49b80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f865800bfd0 tx=0x7f86580097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8062a7199a55f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8645ffb640 1 -- 172.21.15.12:0/1211590079 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658044020 con 0x55659eb4f240 2024-09-19T06:45:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8645ffb640 1 -- 172.21.15.12:0/1211590079 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f865800a880 con 0x55659eb4f240 2024-09-19T06:45:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8666f80740 1 -- 172.21.15.12:0/1211590079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86500bcb60 con 0x55659eb4f240 2024-09-19T06:45:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8645ffb640 1 -- 172.21.15.12:0/1211590079 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f865804f050 con 0x55659eb4f240 2024-09-19T06:45:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8666f80740 10 client.17016 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8666f80740 1 -- 172.21.15.12:0/1211590079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55659ebc97a0 con 0x55659eb4f240 2024-09-19T06:45:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8645ffb640 1 -- 172.21.15.12:0/1211590079 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86500bcb60 con 0x55659eb4f240 2024-09-19T06:45:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8645ffb640 1 -- 172.21.15.12:0/1211590079 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f8658021450 con 0x55659eb4f240 2024-09-19T06:45:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8666f80740 10 client.17016 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8666f80740 10 client.17016 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:45:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8666f80740 20 client.17016 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.211+0000 7f8666f80740 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55659eb5ed30 0x55659ebcbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.212+0000 7f8666f80740 4 client.17016 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "36083eb1", "release": true, "await": true}] 2024-09-19T06:45:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.212+0000 7f8666f80740 1 -- 172.21.15.12:0/1211590079 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "36083eb1", "release": true, "await": true}) -- 0x55659eab10a0 con 0x55659eb5ed30 2024-09-19T06:45:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.212+0000 7f865e59c640 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55659eb5ed30 0x55659ebcbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.212+0000 7f865e59c640 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55659eb5ed30 0x55659ebcbec0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e50c15516480a8f server_cookie=cbd0c88440f8e3b5 in_seq=0 out_seq=0 2024-09-19T06:45:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.212+0000 7f8645ffb640 10 client.17016 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:32.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8645ffb640 1 -- 172.21.15.12:0/1211590079 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55659eab10a0 con 0x55659eb5ed30 2024-09-19T06:45:32.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8645ffb640 10 client.17016 handle_command_reply: tid=0 2024-09-19T06:45:32.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8666f80740 1 client.17016 shutdown 2024-09-19T06:45:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8666f80740 1 -- 172.21.15.12:0/1211590079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 msgr2=0x55659eb49b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8666f80740 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb49b80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f865800bfd0 tx=0x7f86580097c0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8666f80740 1 -- 172.21.15.12:0/1211590079 shutdown_connections 2024-09-19T06:45:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8666f80740 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55659eb5ed30 0x55659ebcbec0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8666f80740 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659eb4f240 0x55659eb49b80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8666f80740 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55659eb44980 0x55659eb49640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8666f80740 1 --2- 172.21.15.12:0/1211590079 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55659eb44060 0x55659eb49100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8645ffb640 0 client.17016 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8666f80740 1 -- 172.21.15.12:0/1211590079 >> 172.21.15.12:0/1211590079 conn(0x55659eb405f0 msgr2=0x55659eb3f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.257+0000 7f8666f80740 1 -- 172.21.15.12:0/1211590079 shutdown_connections 2024-09-19T06:45:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.258+0000 7f8666f80740 1 -- 172.21.15.12:0/1211590079 wait complete. 2024-09-19T06:45:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.258+0000 7f8666f80740 20 client.17016 trim_cache size 0 max 16384 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 35, 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 24, 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "36083eb1": { 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 24, 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:45:32.262 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 149.8, 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:45:32.263 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:45:32.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.259+0000 7f8664ba7640 1 -- 172.21.15.12:0/807670544 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f86480a3430 msgr2=0x7f86480a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.259+0000 7f8664ba7640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f86480a3430 0x7f86480a58f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8658009fd0 tx=0x7f865801a000 comp rx=0 tx=0).stop 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.259+0000 7f8664ba7640 1 -- 172.21.15.12:0/807670544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8660100a90 msgr2=0x7f8660197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.260+0000 7f8664ba7640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8660100a90 0x7f8660197320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f865002a940 tx=0x7f8650003c00 comp rx=0 tx=0).stop 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.260+0000 7f8664ba7640 1 -- 172.21.15.12:0/807670544 shutdown_connections 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.260+0000 7f8664ba7640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f86480a3430 0x7f86480a58f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.260+0000 7f8664ba7640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8660106a90 0x7f866019bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.260+0000 7f8664ba7640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8660101430 0x7f8660197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.260+0000 7f8664ba7640 1 --2- 172.21.15.12:0/807670544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8660100a90 0x7f8660197320 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.260+0000 7f8664ba7640 1 -- 172.21.15.12:0/807670544 >> 172.21.15.12:0/807670544 conn(0x7f86600fc7d0 msgr2=0x7f86600fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.262+0000 7f8664ba7640 1 -- 172.21.15.12:0/807670544 shutdown_connections 2024-09-19T06:45:32.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:32.262+0000 7f8664ba7640 1 -- 172.21.15.12:0/807670544 wait complete. 2024-09-19T06:45:33.125 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '36083eb1', total seconds elapsed: 33.2 2024-09-19T06:45:33.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:33 smithi016 ceph-mon[34911]: pgmap v165: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 232 KiB/s wr, 15 op/s 2024-09-19T06:45:33.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:33 smithi173 ceph-mon[35349]: pgmap v165: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 232 KiB/s wr, 15 op/s 2024-09-19T06:45:33.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:33 smithi012 ceph-mon[30937]: pgmap v165: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 232 KiB/s wr, 15 op/s 2024-09-19T06:45:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.699+0000 7fa137726640 1 -- 172.21.15.12:0/4277727979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa130105d90 msgr2=0x7fa13010d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.699+0000 7fa137726640 1 --2- 172.21.15.12:0/4277727979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa130105d90 0x7fa13010d8e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa128009ca0 tx=0x7fa12802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.700+0000 7fa137726640 1 -- 172.21.15.12:0/4277727979 shutdown_connections 2024-09-19T06:45:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.700+0000 7fa137726640 1 --2- 172.21.15.12:0/4277727979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa130105d90 0x7fa13010d8e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.700+0000 7fa137726640 1 --2- 172.21.15.12:0/4277727979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa130102100 0x7fa130105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.700+0000 7fa137726640 1 --2- 172.21.15.12:0/4277727979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa130101750 0x7fa130101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.700+0000 7fa137726640 1 -- 172.21.15.12:0/4277727979 >> 172.21.15.12:0/4277727979 conn(0x7fa1300fba30 msgr2=0x7fa1300fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.700+0000 7fa137726640 1 -- 172.21.15.12:0/4277727979 shutdown_connections 2024-09-19T06:45:34.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.700+0000 7fa137726640 1 -- 172.21.15.12:0/4277727979 wait complete. 2024-09-19T06:45:34.703 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa137726640 1 Processor -- start 2024-09-19T06:45:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa137726640 1 -- start start 2024-09-19T06:45:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa137726640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa130101750 0x7fa130116070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa137726640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa130105d90 0x7fa1301165b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa137726640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1301111d0 0x7fa130111680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa137726640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa13010fce0 con 0x7fa130101750 2024-09-19T06:45:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa137726640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa13010fb60 con 0x7fa130105d90 2024-09-19T06:45:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa137726640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa13010fe60 con 0x7fa1301111d0 2024-09-19T06:45:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa134cc1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa130105d90 0x7fa1301165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa135cc3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1301111d0 0x7fa130111680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa135cc3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1301111d0 0x7fa130111680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:51950/0 (socket says 172.21.15.12:51950) 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa135cc3640 1 -- 172.21.15.12:0/3892490310 learned_addr learned my addr 172.21.15.12:0/3892490310 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa134cc1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa130105d90 0x7fa1301165b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56750/0 (socket says 172.21.15.12:56750) 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.701+0000 7fa1354c2640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa130101750 0x7fa130116070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa135cc3640 1 -- 172.21.15.12:0/3892490310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa130105d90 msgr2=0x7fa1301165b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa135cc3640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa130105d90 0x7fa1301165b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa135cc3640 1 -- 172.21.15.12:0/3892490310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa130101750 msgr2=0x7fa130116070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa135cc3640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa130101750 0x7fa130116070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa135cc3640 1 -- 172.21.15.12:0/3892490310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa130111e90 con 0x7fa1301111d0 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa135cc3640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1301111d0 0x7fa130111680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa128003f40 tx=0x7fa128003f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa1267fc640 1 -- 172.21.15.12:0/3892490310 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128031650 con 0x7fa1301111d0 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa1267fc640 1 -- 172.21.15.12:0/3892490310 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1280317f0 con 0x7fa1301111d0 2024-09-19T06:45:34.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa1267fc640 1 -- 172.21.15.12:0/3892490310 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12802fab0 con 0x7fa1301111d0 2024-09-19T06:45:34.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa137726640 1 -- 172.21.15.12:0/3892490310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13011bd80 con 0x7fa1301111d0 2024-09-19T06:45:34.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.702+0000 7fa137726640 1 -- 172.21.15.12:0/3892490310 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13011c280 con 0x7fa1301111d0 2024-09-19T06:45:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.706+0000 7fa13a4b9740 1 Processor -- start 2024-09-19T06:45:34.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.706+0000 7fa1267fc640 1 -- 172.21.15.12:0/3892490310 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa12802fcd0 con 0x7fa1301111d0 2024-09-19T06:45:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.707+0000 7fa13a4b9740 1 -- start start 2024-09-19T06:45:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90cf410 0x55c9a90d9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90d9cb0 0x55c9a90dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c9a90332f0 con 0x55c9a90ceaf0 2024-09-19T06:45:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c9a8fdb270 con 0x55c9a90d9cb0 2024-09-19T06:45:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c9a902f2b0 con 0x55c9a90cf410 2024-09-19T06:45:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa1267fc640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa11c0a34b0 0x7fa11c0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa134cc1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90d9cb0 0x55c9a90dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa134cc1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa134cc1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49674/0 (socket says 172.21.15.12:49674) 2024-09-19T06:45:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa134cc1640 1 -- 172.21.15.12:0/1632457591 learned_addr learned my addr 172.21.15.12:0/1632457591 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:34.710 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1632457591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90cf410 0x55c9a90d9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa1267fc640 1 -- 172.21.15.12:0/3892490310 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa1280f10d0 con 0x7fa1301111d0 2024-09-19T06:45:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa134cc1640 1 -- 172.21.15.12:0/1632457591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90cf410 msgr2=0x55c9a90d9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1632457591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90cf410 0x55c9a90d9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa134cc1640 1 -- 172.21.15.12:0/1632457591 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90d9cb0 msgr2=0x55c9a90dc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.708+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1632457591 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90d9cb0 0x55c9a90dc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.709+0000 7fa135cc3640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa11c0a34b0 0x7fa11c0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.709+0000 7fa134cc1640 1 -- 172.21.15.12:0/1632457591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9a8fda340 con 0x55c9a90ceaf0 2024-09-19T06:45:34.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.709+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1632457591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90ceed0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa12c010890 tx=0x7fa12c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ac4232e9ab93a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.709+0000 7fa135cc3640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa11c0a34b0 0x7fa11c0a5970 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa128003f10 tx=0x7fa12802a8c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.709+0000 7fa11b7fe640 1 -- 172.21.15.12:0/1632457591 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c016030 con 0x55c9a90ceaf0 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.709+0000 7fa11b7fe640 1 -- 172.21.15.12:0/1632457591 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa12c01e3b0 con 0x55c9a90ceaf0 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.709+0000 7fa11b7fe640 1 -- 172.21.15.12:0/1632457591 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c019040 con 0x55c9a90ceaf0 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.710+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1632457591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 msgr2=0x55c9a90ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.710+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1632457591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90ceed0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa12c010890 tx=0x7fa12c005f90 comp rx=0 tx=0).stop 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.711+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1632457591 shutdown_connections 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.711+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1632457591 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90d9cb0 0x55c9a90dc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.711+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1632457591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90cf410 0x55c9a90d9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.711+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1632457591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90ceed0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.711+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1632457591 >> 172.21.15.12:0/1632457591 conn(0x55c9a90cb060 msgr2=0x55c9a90cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.711+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1632457591 shutdown_connections 2024-09-19T06:45:34.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.711+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1632457591 wait complete. 2024-09-19T06:45:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.712+0000 7fa13a4b9740 1 -- start start 2024-09-19T06:45:34.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.712+0000 7fa13a4b9740 1 Processor -- start 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.712+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.712+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.712+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.712+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c9a90dc880 con 0x55c9a90ceaf0 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c9a8fbc290 con 0x55c9a90cf410 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c9a90dca00 con 0x55c9a90d9cb0 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa13a4b9740 10 client.0 _ll_register_callbacks cb 0x55c9a8fed140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa134cc1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa134cc1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90d6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49684/0 (socket says 172.21.15.12:49684) 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa134cc1640 1 -- 172.21.15.12:0/1335568339 learned_addr learned my addr 172.21.15.12:0/1335568339 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:34.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa1354c2640 1 -- 172.21.15.12:0/1335568339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 msgr2=0x55c9a90d7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa1354c2640 1 -- 172.21.15.12:0/1335568339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 msgr2=0x55c9a90d6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.713+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90d6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.714+0000 7fa1354c2640 1 -- 172.21.15.12:0/1335568339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9a8d46210 con 0x55c9a90cf410 2024-09-19T06:45:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.714+0000 7fa118ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:45:34.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.714+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa12000b910 tx=0x7fa12000bdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8da1e2dec820448 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.715+0000 7fa118ff9640 1 -- 172.21.15.12:0/1335568339 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12001b470 con 0x55c9a90cf410 2024-09-19T06:45:34.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.715+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1335568339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa12c01e3b0 con 0x55c9a90cf410 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.715+0000 7fa118ff9640 1 -- 172.21.15.12:0/1335568339 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa120003d60 con 0x55c9a90cf410 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.715+0000 7fa118ff9640 1 -- 172.21.15.12:0/1335568339 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa12001b470 con 0x55c9a90cf410 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.715+0000 7fa13a4b9740 10 client.26531 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.715+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1335568339 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c9a8e12620 con 0x55c9a90cf410 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.716+0000 7fa118ff9640 1 -- 172.21.15.12:0/1335568339 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa12c01e3b0 con 0x55c9a90cf410 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.716+0000 7fa118ff9640 1 -- 172.21.15.12:0/1335568339 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fa120012600 con 0x55c9a90cf410 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.716+0000 7fa13a4b9740 10 client.26531 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.716+0000 7fa13a4b9740 10 client.26531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.716+0000 7fa13a4b9740 20 client.26531 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.716+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c9a90ea050 0x55c9a90ec4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.716+0000 7fa13a4b9740 4 client.26531 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:34.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.716+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1335568339 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9a9040a20 con 0x55c9a90ea050 2024-09-19T06:45:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.716+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c9a90ea050 0x55c9a90ec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.717+0000 7fa118ff9640 10 client.26531 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.717+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c9a90ea050 0x55c9a90ec4b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bed83175cbd07f0f server_cookie=f22ed9347ab4713b in_seq=0 out_seq=0 2024-09-19T06:45:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.718+0000 7fa118ff9640 1 -- 172.21.15.12:0/1335568339 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9a9040a20 con 0x55c9a90ea050 2024-09-19T06:45:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.718+0000 7fa118ff9640 10 client.26531 handle_command_reply: tid=0 2024-09-19T06:45:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.718+0000 7fa13a4b9740 1 client.26531 shutdown 2024-09-19T06:45:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.719+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1335568339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 msgr2=0x55c9a90d70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.719+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa12000b910 tx=0x7fa12000bdd0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.719+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1335568339 shutdown_connections 2024-09-19T06:45:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.719+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c9a90ea050 0x55c9a90ec4b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.719+0000 7fa118ff9640 0 client.26531 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.719+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.719+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.719+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1335568339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90d6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.719+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1335568339 >> 172.21.15.12:0/1335568339 conn(0x55c9a90cb060 msgr2=0x55c9a90d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.719+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1335568339 shutdown_connections 2024-09-19T06:45:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.720+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1335568339 wait complete. 2024-09-19T06:45:34.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.720+0000 7fa13a4b9740 20 client.26531 trim_cache size 0 max 16384 2024-09-19T06:45:34.755 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.752+0000 7fa13a4b9740 1 Processor -- start 2024-09-19T06:45:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.755+0000 7fa13a4b9740 1 -- start start 2024-09-19T06:45:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.755+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.755+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.755+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.755+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa130072ce0 con 0x55c9a90ceaf0 2024-09-19T06:45:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.755+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa1301c6d30 con 0x55c9a90cf410 2024-09-19T06:45:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.755+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa1300733b0 con 0x55c9a90d9cb0 2024-09-19T06:45:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.756+0000 7fa1354c2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.756+0000 7fa1354c2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56774/0 (socket says 172.21.15.12:56774) 2024-09-19T06:45:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.756+0000 7fa1354c2640 1 -- 172.21.15.12:0/1901485493 learned_addr learned my addr 172.21.15.12:0/1901485493 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.756+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1901485493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.756+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1901485493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.758+0000 7fa1354c2640 1 -- 172.21.15.12:0/1901485493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 msgr2=0x55c9a90d7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.758+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1901485493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.758+0000 7fa1354c2640 1 -- 172.21.15.12:0/1901485493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 msgr2=0x55c9a90d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.758+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1901485493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.758+0000 7fa1354c2640 1 -- 172.21.15.12:0/1901485493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9a90ce920 con 0x55c9a90cf410 2024-09-19T06:45:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.760+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1901485493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa12000e3f0 tx=0x7fa1200042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=229e7b4b1ae7ab7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.763+0000 7fa11affd640 1 -- 172.21.15.12:0/1901485493 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12002a040 con 0x55c9a90cf410 2024-09-19T06:45:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.763+0000 7fa11affd640 1 -- 172.21.15.12:0/1901485493 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa120016070 con 0x55c9a90cf410 2024-09-19T06:45:34.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.764+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1901485493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 msgr2=0x55c9a90d70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.764+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1901485493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa12000e3f0 tx=0x7fa1200042e0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.766 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.766+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1901485493 shutdown_connections 2024-09-19T06:45:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.766+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1901485493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.766+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1901485493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90d70d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.766+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1901485493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.766+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1901485493 >> 172.21.15.12:0/1901485493 conn(0x55c9a90cb060 msgr2=0x55c9a90d8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.769+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1901485493 shutdown_connections 2024-09-19T06:45:34.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.772+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1901485493 wait complete. 2024-09-19T06:45:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.772+0000 7fa13a4b9740 1 -- start start 2024-09-19T06:45:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.773+0000 7fa13a4b9740 1 Processor -- start 2024-09-19T06:45:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.773+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.773+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90e23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.773+0000 7fa13a4b9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.773+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa130074180 con 0x55c9a90ceaf0 2024-09-19T06:45:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.773+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa130073a80 con 0x55c9a90cf410 2024-09-19T06:45:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.773+0000 7fa13a4b9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa130070c60 con 0x55c9a90d9cb0 2024-09-19T06:45:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.773+0000 7fa13a4b9740 10 client.0 _ll_register_callbacks cb 0x7fa120004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.775+0000 7fa1354c2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90e23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.775+0000 7fa1354c2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90e23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56780/0 (socket says 172.21.15.12:56780) 2024-09-19T06:45:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.775+0000 7fa1354c2640 1 -- 172.21.15.12:0/1738216200 learned_addr learned my addr 172.21.15.12:0/1738216200 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.777+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.777+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.778+0000 7fa1354c2640 1 -- 172.21.15.12:0/1738216200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 msgr2=0x55c9a90d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.778+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.778+0000 7fa1354c2640 1 -- 172.21.15.12:0/1738216200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 msgr2=0x55c9a90e1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.778+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90e1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.778+0000 7fa1354c2640 1 -- 172.21.15.12:0/1738216200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9a90d3a50 con 0x55c9a90cf410 2024-09-19T06:45:34.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.780+0000 7fa1354c2640 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90e23c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa120001eb0 tx=0x7fa12000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56106e78c94938db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.780+0000 7fa118ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:45:34.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.781+0000 7fa118ff9640 1 -- 172.21.15.12:0/1738216200 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120005b90 con 0x55c9a90cf410 2024-09-19T06:45:34.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.781+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1738216200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa120016070 con 0x55c9a90cf410 2024-09-19T06:45:34.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.781+0000 7fa118ff9640 1 -- 172.21.15.12:0/1738216200 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa120024ae0 con 0x55c9a90cf410 2024-09-19T06:45:34.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.781+0000 7fa118ff9640 1 -- 172.21.15.12:0/1738216200 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa120012450 con 0x55c9a90cf410 2024-09-19T06:45:34.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.781+0000 7fa13a4b9740 10 client.26537 fetch_fsmap learned FSMap version 35 2024-09-19T06:45:34.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.781+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1738216200 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c9a9154740 con 0x55c9a90cf410 2024-09-19T06:45:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.782+0000 7fa118ff9640 1 -- 172.21.15.12:0/1738216200 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa120016070 con 0x55c9a90cf410 2024-09-19T06:45:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.782+0000 7fa118ff9640 1 -- 172.21.15.12:0/1738216200 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fa120012600 con 0x55c9a90cf410 2024-09-19T06:45:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.782+0000 7fa13a4b9740 10 client.26537 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T06:45:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.783+0000 7fa13a4b9740 10 client.26537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.783+0000 7fa13a4b9740 20 client.26537 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.783+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c9a90ea050 0x55c9a9156d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.783+0000 7fa13a4b9740 4 client.26537 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:45:34.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.783+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1738216200 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9a903ad70 con 0x55c9a90ea050 2024-09-19T06:45:34.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.783+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c9a90ea050 0x55c9a9156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.784+0000 7fa118ff9640 10 client.26537 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:34.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.784+0000 7fa134cc1640 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c9a90ea050 0x55c9a9156d90 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb2e5093cea2da91 server_cookie=c31dc314a1713a0e in_seq=0 out_seq=0 2024-09-19T06:45:34.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.796+0000 7fa118ff9640 1 -- 172.21.15.12:0/1738216200 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c9a903ad70 con 0x55c9a90ea050 2024-09-19T06:45:34.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.797+0000 7fa118ff9640 10 client.26537 handle_command_reply: tid=0 2024-09-19T06:45:34.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.797+0000 7fa13a4b9740 1 client.26537 shutdown 2024-09-19T06:45:34.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1738216200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 msgr2=0x55c9a90e23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90e23c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa120001eb0 tx=0x7fa12000b390 comp rx=0 tx=0).stop 2024-09-19T06:45:34.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1738216200 shutdown_connections 2024-09-19T06:45:34.799 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c9a90ea050 0x55c9a9156d90 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9a90d9cb0 0x55c9a90d33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c9a90cf410 0x55c9a90e23c0 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa120001eb0 tx=0x7fa12000b390 comp rx=0 tx=0).stop 2024-09-19T06:45:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 1 --2- 172.21.15.12:0/1738216200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c9a90ceaf0 0x55c9a90e1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1738216200 >> 172.21.15.12:0/1738216200 conn(0x55c9a90cb060 msgr2=0x55c9a90c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa118ff9640 0 client.26537 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1738216200 shutdown_connections 2024-09-19T06:45:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 1 -- 172.21.15.12:0/1738216200 wait complete. 2024-09-19T06:45:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.798+0000 7fa13a4b9740 20 client.26537 trim_cache size 0 max 16384 2024-09-19T06:45:34.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:45:34.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:45:34.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:45:34.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:45:34.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 -- 172.21.15.12:0/3892490310 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa11c0a34b0 msgr2=0x7fa11c0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa11c0a34b0 0x7fa11c0a5970 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa128003f10 tx=0x7fa12802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 -- 172.21.15.12:0/3892490310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1301111d0 msgr2=0x7fa130111680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1301111d0 0x7fa130111680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa128003f40 tx=0x7fa128003f70 comp rx=0 tx=0).stop 2024-09-19T06:45:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 -- 172.21.15.12:0/3892490310 shutdown_connections 2024-09-19T06:45:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa11c0a34b0 0x7fa11c0a5970 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1301111d0 0x7fa130111680 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa130105d90 0x7fa1301165b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 --2- 172.21.15.12:0/3892490310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa130101750 0x7fa130116070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 -- 172.21.15.12:0/3892490310 >> 172.21.15.12:0/3892490310 conn(0x7fa1300fba30 msgr2=0x7fa1300fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 -- 172.21.15.12:0/3892490310 shutdown_connections 2024-09-19T06:45:34.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:34.799+0000 7fa137726640 1 -- 172.21.15.12:0/3892490310 wait complete. 2024-09-19T06:45:35.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:35 smithi016 ceph-mon[34911]: pgmap v166: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 260 KiB/s wr, 19 op/s 2024-09-19T06:45:35.808 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 290.0 s, 3070.3 tps, lat 193.330 ms stddev 2102.871 2024-09-19T06:45:35.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:35 smithi173 ceph-mon[35349]: pgmap v166: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 260 KiB/s wr, 19 op/s 2024-09-19T06:45:35.893 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:35 smithi012 ceph-mon[30937]: pgmap v166: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 260 KiB/s wr, 19 op/s 2024-09-19T06:45:37.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:37 smithi016 ceph-mon[34911]: pgmap v167: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.1 MiB/s wr, 191 op/s 2024-09-19T06:45:37.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:37 smithi173 ceph-mon[35349]: pgmap v167: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.1 MiB/s wr, 191 op/s 2024-09-19T06:45:37.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:37 smithi012 ceph-mon[30937]: pgmap v167: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 2.1 MiB/s wr, 191 op/s 2024-09-19T06:45:39.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:39 smithi016 ceph-mon[34911]: pgmap v168: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2024-09-19T06:45:39.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:39 smithi173 ceph-mon[35349]: pgmap v168: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2024-09-19T06:45:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:39 smithi012 ceph-mon[30937]: pgmap v168: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 1.9 MiB/s wr, 182 op/s 2024-09-19T06:45:40.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 295.0 s, 5251.7 tps, lat 19.042 ms stddev 22.714 2024-09-19T06:45:41.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:41 smithi016 ceph-mon[34911]: pgmap v169: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.3 MiB/s wr, 546 op/s 2024-09-19T06:45:41.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:41 smithi173 ceph-mon[35349]: pgmap v169: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.3 MiB/s wr, 546 op/s 2024-09-19T06:45:41.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:41 smithi012 ceph-mon[30937]: pgmap v169: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.3 MiB/s wr, 546 op/s 2024-09-19T06:45:43.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:43 smithi016 ceph-mon[34911]: pgmap v170: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.3 MiB/s wr, 541 op/s 2024-09-19T06:45:43.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:43 smithi173 ceph-mon[35349]: pgmap v170: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.3 MiB/s wr, 541 op/s 2024-09-19T06:45:43.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:43 smithi012 ceph-mon[30937]: pgmap v170: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.3 MiB/s wr, 541 op/s 2024-09-19T06:45:44.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:44 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:45:44.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:44 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:45:44.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:44 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:45:45.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:45 smithi016 ceph-mon[34911]: pgmap v171: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.5 MiB/s wr, 621 op/s 2024-09-19T06:45:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 300.0 s, 4774.3 tps, lat 20.790 ms stddev 24.491 2024-09-19T06:45:45.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:45 smithi173 ceph-mon[35349]: pgmap v171: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.5 MiB/s wr, 621 op/s 2024-09-19T06:45:45.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:45 smithi012 ceph-mon[30937]: pgmap v171: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.5 MiB/s wr, 621 op/s 2024-09-19T06:45:47.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:47 smithi016 ceph-mon[34911]: pgmap v172: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 939 op/s 2024-09-19T06:45:47.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:47 smithi173 ceph-mon[35349]: pgmap v172: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 939 op/s 2024-09-19T06:45:47.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:47 smithi012 ceph-mon[30937]: pgmap v172: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 939 op/s 2024-09-19T06:45:47.952 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.951+0000 7fabf1527640 1 -- 172.21.15.12:0/3803913628 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe402f340 con 0x7fabec101370 2024-09-19T06:45:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.952+0000 7fabf478d640 1 -- 172.21.15.12:0/3803913628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec101370 msgr2=0x7fabec10d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.952+0000 7fabf478d640 1 --2- 172.21.15.12:0/3803913628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec101370 0x7fabec10d8a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009cd0 tx=0x7fabe402a930 comp rx=0 tx=0).stop 2024-09-19T06:45:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.955+0000 7fabf478d640 1 -- 172.21.15.12:0/3803913628 shutdown_connections 2024-09-19T06:45:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.955+0000 7fabf478d640 1 --2- 172.21.15.12:0/3803913628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec101370 0x7fabec10d8a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.955+0000 7fabf478d640 1 --2- 172.21.15.12:0/3803913628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabec1009d0 0x7fabec100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.955+0000 7fabf478d640 1 --2- 172.21.15.12:0/3803913628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabec1069e0 0x7fabec106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.955+0000 7fabf478d640 1 -- 172.21.15.12:0/3803913628 >> 172.21.15.12:0/3803913628 conn(0x7fabec0fc6b0 msgr2=0x7fabec0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:47.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.961+0000 7fabf478d640 1 -- 172.21.15.12:0/3803913628 shutdown_connections 2024-09-19T06:45:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.963+0000 7fabf478d640 1 -- 172.21.15.12:0/3803913628 wait complete. 2024-09-19T06:45:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf478d640 1 Processor -- start 2024-09-19T06:45:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf478d640 1 -- start start 2024-09-19T06:45:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf478d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec1009d0 0x7fabec1162d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf478d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabec101370 0x7fabec10c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf478d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabec1069e0 0x7fabec10cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf478d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabec06a9c0 con 0x7fabec1009d0 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf478d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fabec06a840 con 0x7fabec1069e0 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf478d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fabec06ab40 con 0x7fabec101370 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf2529640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec1009d0 0x7fabec1162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf2529640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec1009d0 0x7fabec1162d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54242/0 (socket says 172.21.15.12:54242) 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf2529640 1 -- 172.21.15.12:0/1951081795 learned_addr learned my addr 172.21.15.12:0/1951081795 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.964+0000 7fabf1d28640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabec101370 0x7fabec10c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.965+0000 7fabf2529640 1 -- 172.21.15.12:0/1951081795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabec101370 msgr2=0x7fabec10c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.965+0000 7fabf2529640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabec101370 0x7fabec10c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.965+0000 7fabf2529640 1 -- 172.21.15.12:0/1951081795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabec1069e0 msgr2=0x7fabec10cf00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.965+0000 7fabf2529640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabec1069e0 0x7fabec10cf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.965+0000 7fabf2529640 1 -- 172.21.15.12:0/1951081795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec10d5b0 con 0x7fabec1009d0 2024-09-19T06:45:47.968 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.965+0000 7fabf2529640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec1009d0 0x7fabec1162d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b450 tx=0x7fabe800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.967+0000 7fabe37fe640 1 -- 172.21.15.12:0/1951081795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8015020 con 0x7fabec1009d0 2024-09-19T06:45:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.967+0000 7fabe37fe640 1 -- 172.21.15.12:0/1951081795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe8011d70 con 0x7fabec1009d0 2024-09-19T06:45:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.967+0000 7fabe37fe640 1 -- 172.21.15.12:0/1951081795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe800f340 con 0x7fabec1009d0 2024-09-19T06:45:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.967+0000 7fabf478d640 1 -- 172.21.15.12:0/1951081795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabec06bc10 con 0x7fabec1009d0 2024-09-19T06:45:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.967+0000 7fabf478d640 1 -- 172.21.15.12:0/1951081795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabec06c110 con 0x7fabec1009d0 2024-09-19T06:45:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.973+0000 7fabe37fe640 1 -- 172.21.15.12:0/1951081795 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fabe8018020 con 0x7fabec1009d0 2024-09-19T06:45:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.974+0000 7fabe37fe640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fabd80a3690 0x7fabd80a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.974+0000 7fabe37fe640 1 -- 172.21.15.12:0/1951081795 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fabe80d0780 con 0x7fabec1009d0 2024-09-19T06:45:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.975+0000 7fabf1d28640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fabd80a3690 0x7fabd80a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.975+0000 7fabf7605740 1 Processor -- start 2024-09-19T06:45:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.975+0000 7fabf7605740 1 -- start start 2024-09-19T06:45:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.976+0000 7fabf7605740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fdaf0 0x55a4817fded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.976+0000 7fabf7605740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fe410 0x55a481808770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.976+0000 7fabf7605740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a48180b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.976+0000 7fabf7605740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a4817622f0 con 0x55a481808cb0 2024-09-19T06:45:47.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.976+0000 7fabf7605740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a48170a270 con 0x55a4817fe410 2024-09-19T06:45:47.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.976+0000 7fabf7605740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a48175e2b0 con 0x55a4817fdaf0 2024-09-19T06:45:47.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.976+0000 7fabf1d28640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fabd80a3690 0x7fabd80a5b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fabdc006fd0 tx=0x7fabdc008040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:47.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.977+0000 7fabf1d28640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fe410 0x55a481808770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.977+0000 7fabf1d28640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fe410 0x55a481808770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47632/0 (socket says 172.21.15.12:47632) 2024-09-19T06:45:47.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.977+0000 7fabf1d28640 1 -- 172.21.15.12:0/772372985 learned_addr learned my addr 172.21.15.12:0/772372985 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:47.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.977+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/772372985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a48180b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.977+0000 7fabf2529640 1 --2- 172.21.15.12:0/772372985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fdaf0 0x55a4817fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.977+0000 7fabf2d2a640 1 -- 172.21.15.12:0/772372985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fdaf0 msgr2=0x55a4817fded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.977+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/772372985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fdaf0 0x55a4817fded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.977+0000 7fabf2d2a640 1 -- 172.21.15.12:0/772372985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fe410 msgr2=0x55a481808770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.977+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/772372985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fe410 0x55a481808770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.977+0000 7fabf2d2a640 1 -- 172.21.15.12:0/772372985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a481709340 con 0x55a481808cb0 2024-09-19T06:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.978+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/772372985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a48180b0a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009ca0 tx=0x7fabe40098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c72b8678d90f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.978+0000 7fabe0ff9640 1 -- 172.21.15.12:0/772372985 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4031dc0 con 0x55a481808cb0 2024-09-19T06:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.978+0000 7fabe0ff9640 1 -- 172.21.15.12:0/772372985 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe403f070 con 0x55a481808cb0 2024-09-19T06:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.978+0000 7fabe0ff9640 1 -- 172.21.15.12:0/772372985 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe40042a0 con 0x55a481808cb0 2024-09-19T06:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.979+0000 7fabf7605740 1 -- 172.21.15.12:0/772372985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 msgr2=0x55a48180b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.979+0000 7fabf7605740 1 --2- 172.21.15.12:0/772372985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a48180b0a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009ca0 tx=0x7fabe40098c0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.979+0000 7fabf7605740 1 -- 172.21.15.12:0/772372985 shutdown_connections 2024-09-19T06:45:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.980+0000 7fabf7605740 1 --2- 172.21.15.12:0/772372985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a48180b0a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.980+0000 7fabf7605740 1 --2- 172.21.15.12:0/772372985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fe410 0x55a481808770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.980+0000 7fabf7605740 1 --2- 172.21.15.12:0/772372985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fdaf0 0x55a4817fded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.980+0000 7fabf7605740 1 -- 172.21.15.12:0/772372985 >> 172.21.15.12:0/772372985 conn(0x55a4817fa060 msgr2=0x55a4817fa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.982+0000 7fabf7605740 1 -- 172.21.15.12:0/772372985 shutdown_connections 2024-09-19T06:45:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.982+0000 7fabf7605740 1 -- 172.21.15.12:0/772372985 wait complete. 2024-09-19T06:45:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.983+0000 7fabf7605740 1 -- start start 2024-09-19T06:45:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.983+0000 7fabf7605740 1 Processor -- start 2024-09-19T06:45:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.984+0000 7fabf7605740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481805b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.984+0000 7fabf7605740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a4818060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.984+0000 7fabf7605740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a481806600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.984+0000 7fabf2529640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481805b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.984+0000 7fabf2529640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481805b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47644/0 (socket says 172.21.15.12:47644) 2024-09-19T06:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.985+0000 7fabf1d28640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a4818060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.985+0000 7fabf1d28640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a4818060c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33142/0 (socket says 172.21.15.12:33142) 2024-09-19T06:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.985+0000 7fabf2529640 1 -- 172.21.15.12:0/3451414364 learned_addr learned my addr 172.21.15.12:0/3451414364 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.985+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a48180b880 con 0x55a481808cb0 2024-09-19T06:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.985+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a4816eb290 con 0x55a4817fdaf0 2024-09-19T06:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.985+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a48180ba00 con 0x55a4817fe410 2024-09-19T06:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.985+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a481806600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.985+0000 7fabf7605740 10 client.0 _ll_register_callbacks cb 0x55a48171c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.987+0000 7fabf2d2a640 1 -- 172.21.15.12:0/3451414364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 msgr2=0x55a4818060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.987+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a4818060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.987+0000 7fabf2d2a640 1 -- 172.21.15.12:0/3451414364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 msgr2=0x55a481805b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.987+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481805b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.987+0000 7fabf2d2a640 1 -- 172.21.15.12:0/3451414364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a481475210 con 0x55a481808cb0 2024-09-19T06:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.987+0000 7fabf1d28640 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a4818060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.987+0000 7fabf2529640 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481805b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.988+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a481806600 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009ca0 tx=0x7fabe4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef6803676df5171 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.988+0000 7fabd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.990+0000 7fabd5ffb640 1 -- 172.21.15.12:0/3451414364 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4004240 con 0x55a481808cb0 2024-09-19T06:45:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.990+0000 7fabd5ffb640 1 -- 172.21.15.12:0/3451414364 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fabe40043e0 con 0x55a481808cb0 2024-09-19T06:45:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.990+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabe403f070 con 0x55a481808cb0 2024-09-19T06:45:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.991+0000 7fabd5ffb640 1 -- 172.21.15.12:0/3451414364 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fabe4004600 con 0x55a481808cb0 2024-09-19T06:45:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.991+0000 7fabf7605740 10 client.17046 fetch_fsmap learned FSMap version 36 2024-09-19T06:45:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.991+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a481541620 con 0x55a481808cb0 2024-09-19T06:45:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.992+0000 7fabd5ffb640 1 -- 172.21.15.12:0/3451414364 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe403f070 con 0x55a481808cb0 2024-09-19T06:45:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.992+0000 7fabd5ffb640 1 -- 172.21.15.12:0/3451414364 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fabe40305f0 con 0x55a481808cb0 2024-09-19T06:45:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.992+0000 7fabf7605740 10 client.17046 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T06:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.992+0000 7fabf7605740 10 client.17046 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.992+0000 7fabf7605740 20 client.17046 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.992+0000 7fabf7605740 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a481818af0 0x55a48181aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.992+0000 7fabf7605740 4 client.17046 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.992+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a48176fa20 con 0x55a481818af0 2024-09-19T06:45:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.993+0000 7fabf2529640 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a481818af0 0x55a48181aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.994+0000 7fabd5ffb640 10 client.17046 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:47.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.994+0000 7fabf2529640 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a481818af0 0x55a48181aee0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=916ae9863e69b516 server_cookie=5502208ea947b27c in_seq=0 out_seq=0 2024-09-19T06:45:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.995+0000 7fabd5ffb640 1 -- 172.21.15.12:0/3451414364 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a48176fa20 con 0x55a481818af0 2024-09-19T06:45:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.995+0000 7fabd5ffb640 10 client.17046 handle_command_reply: tid=0 2024-09-19T06:45:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.995+0000 7fabf7605740 1 client.17046 shutdown 2024-09-19T06:45:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.995+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 msgr2=0x55a481806600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:47.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.995+0000 7fabf7605740 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a481806600 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009ca0 tx=0x7fabe4003ba0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.996+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 shutdown_connections 2024-09-19T06:45:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.996+0000 7fabf7605740 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a481818af0 0x55a48181aee0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.996+0000 7fabd5ffb640 0 client.17046 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.996+0000 7fabf7605740 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a481806600 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.996+0000 7fabf7605740 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a4818060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.996+0000 7fabf7605740 1 --2- 172.21.15.12:0/3451414364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481805b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.996+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 >> 172.21.15.12:0/3451414364 conn(0x55a4817fa060 msgr2=0x55a4817ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.997+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 shutdown_connections 2024-09-19T06:45:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.997+0000 7fabf7605740 1 -- 172.21.15.12:0/3451414364 wait complete. 2024-09-19T06:45:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:47.997+0000 7fabf7605740 20 client.17046 trim_cache size 0 max 16384 2024-09-19T06:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.025+0000 7fabf7605740 1 Processor -- start 2024-09-19T06:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.025+0000 7fabf7605740 1 -- start start 2024-09-19T06:45:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.026+0000 7fabf7605740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481800560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.026+0000 7fabf7605740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a481806430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.026+0000 7fabf7605740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a481820510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.026+0000 7fabf7605740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabd000ea80 con 0x55a481808cb0 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.026+0000 7fabf7605740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fabd0010620 con 0x55a4817fdaf0 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.026+0000 7fabf7605740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fabd000f150 con 0x55a4817fe410 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.026+0000 7fabf2529640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481800560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.026+0000 7fabf2529640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481800560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47648/0 (socket says 172.21.15.12:47648) 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.026+0000 7fabf2529640 1 -- 172.21.15.12:0/584050539 learned_addr learned my addr 172.21.15.12:0/584050539 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.026+0000 7fabf1d28640 1 --2- 172.21.15.12:0/584050539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a481806430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.027+0000 7fabf2529640 1 -- 172.21.15.12:0/584050539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 msgr2=0x55a481806430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:48.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.027+0000 7fabf2529640 1 --2- 172.21.15.12:0/584050539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a481806430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.027+0000 7fabf2529640 1 -- 172.21.15.12:0/584050539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 msgr2=0x55a481820510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.027+0000 7fabf2529640 1 --2- 172.21.15.12:0/584050539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a481820510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.027+0000 7fabf2529640 1 -- 172.21.15.12:0/584050539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4817fd870 con 0x55a4817fdaf0 2024-09-19T06:45:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.027+0000 7fabf2529640 1 --2- 172.21.15.12:0/584050539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481800560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fabe809ca20 tx=0x7fabe8013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d779246fc6ad45e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.027+0000 7fabd7fff640 1 -- 172.21.15.12:0/584050539 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe80ce070 con 0x55a4817fdaf0 2024-09-19T06:45:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.027+0000 7fabd7fff640 1 -- 172.21.15.12:0/584050539 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a48176fa20 con 0x55a4817fdaf0 2024-09-19T06:45:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.027+0000 7fabd7fff640 1 -- 172.21.15.12:0/584050539 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8098a40 con 0x55a4817fdaf0 2024-09-19T06:45:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.028+0000 7fabf7605740 1 -- 172.21.15.12:0/584050539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 msgr2=0x55a481800560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.028+0000 7fabf7605740 1 --2- 172.21.15.12:0/584050539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481800560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fabe809ca20 tx=0x7fabe8013040 comp rx=0 tx=0).stop 2024-09-19T06:45:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.029+0000 7fabf7605740 1 -- 172.21.15.12:0/584050539 shutdown_connections 2024-09-19T06:45:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.029+0000 7fabf7605740 1 --2- 172.21.15.12:0/584050539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a481808cb0 0x55a481820510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.029+0000 7fabf7605740 1 --2- 172.21.15.12:0/584050539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a481806430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.029+0000 7fabf7605740 1 --2- 172.21.15.12:0/584050539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a4817fdaf0 0x55a481800560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.029+0000 7fabf7605740 1 -- 172.21.15.12:0/584050539 >> 172.21.15.12:0/584050539 conn(0x55a4817fa060 msgr2=0x55a481807c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.029+0000 7fabf7605740 1 -- 172.21.15.12:0/584050539 shutdown_connections 2024-09-19T06:45:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.030+0000 7fabf7605740 1 -- 172.21.15.12:0/584050539 wait complete. 2024-09-19T06:45:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.030+0000 7fabf7605740 1 -- start start 2024-09-19T06:45:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.030+0000 7fabf7605740 1 Processor -- start 2024-09-19T06:45:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.031+0000 7fabf7605740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4817fdaf0 0x55a481811200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.031+0000 7fabf7605740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a481802740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.031+0000 7fabf7605740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a481808cb0 0x55a481802c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:48.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.031+0000 7fabf7605740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabd000ff20 con 0x55a4817fdaf0 2024-09-19T06:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf7605740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fabd000f820 con 0x55a481808cb0 2024-09-19T06:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf2d2a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a481808cb0 0x55a481802c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf2d2a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a481808cb0 0x55a481802c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47662/0 (socket says 172.21.15.12:47662) 2024-09-19T06:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf2d2a640 1 -- 172.21.15.12:0/355721841 learned_addr learned my addr 172.21.15.12:0/355721841 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf7605740 1 -- 172.21.15.12:0/355721841 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fabd000ca60 con 0x55a4817fe410 2024-09-19T06:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf2529640 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4817fdaf0 0x55a481811200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf7605740 10 client.0 _ll_register_callbacks cb 0x7fabe8098d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf1d28640 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a481802740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf2d2a640 1 -- 172.21.15.12:0/355721841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 msgr2=0x55a481802740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a481802740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf2d2a640 1 -- 172.21.15.12:0/355721841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4817fdaf0 msgr2=0x55a481811200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4817fdaf0 0x55a481811200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf2d2a640 1 -- 172.21.15.12:0/355721841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a481803270 con 0x55a481808cb0 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf2529640 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4817fdaf0 0x55a481811200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.032+0000 7fabf1d28640 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a481802740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.033+0000 7fabf2d2a640 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a481808cb0 0x55a481802c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fabe4002230 tx=0x7fabe40093d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=526f2543b433ab2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.033+0000 7fabd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.033+0000 7fabd5ffb640 1 -- 172.21.15.12:0/355721841 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4005bd0 con 0x55a481808cb0 2024-09-19T06:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.033+0000 7fabd5ffb640 1 -- 172.21.15.12:0/355721841 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fabe4030c30 con 0x55a481808cb0 2024-09-19T06:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.033+0000 7fabf7605740 1 -- 172.21.15.12:0/355721841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a48176fa20 con 0x55a481808cb0 2024-09-19T06:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.034+0000 7fabd5ffb640 1 -- 172.21.15.12:0/355721841 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fabe40319d0 con 0x55a481808cb0 2024-09-19T06:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.034+0000 7fabf7605740 10 client.26549 fetch_fsmap learned FSMap version 36 2024-09-19T06:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.034+0000 7fabf7605740 1 -- 172.21.15.12:0/355721841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=36}) -- 0x55a481883230 con 0x55a481808cb0 2024-09-19T06:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.034+0000 7fabd5ffb640 1 -- 172.21.15.12:0/355721841 <== mon.2 v2:172.21.15.16:3300/0 4 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fabe4004000 con 0x55a481808cb0 2024-09-19T06:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.034+0000 7fabf7605740 10 client.26549 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T06:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.034+0000 7fabf7605740 10 client.26549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.034+0000 7fabf7605740 20 client.26549 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.034+0000 7fabf7605740 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a481818af0 0x55a481885850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.034+0000 7fabf7605740 4 client.26549 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:45:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.034+0000 7fabf7605740 1 -- 172.21.15.12:0/355721841 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a48176fa20 con 0x55a481818af0 2024-09-19T06:45:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.035+0000 7fabf2529640 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a481818af0 0x55a481885850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.035+0000 7fabf2529640 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a481818af0 0x55a481885850 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dca190a973be004c server_cookie=7435c4bb9b389025 in_seq=0 out_seq=0 2024-09-19T06:45:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.035+0000 7fabd5ffb640 10 client.26549 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:48.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.046+0000 7fabd5ffb640 1 -- 172.21.15.12:0/355721841 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a48176fa20 con 0x55a481818af0 2024-09-19T06:45:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.046+0000 7fabd5ffb640 10 client.26549 handle_command_reply: tid=0 2024-09-19T06:45:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.046+0000 7fabf7605740 1 client.26549 shutdown 2024-09-19T06:45:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.048+0000 7fabf7605740 1 -- 172.21.15.12:0/355721841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a481808cb0 msgr2=0x55a481802c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.048+0000 7fabf7605740 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a481808cb0 0x55a481802c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fabe4002230 tx=0x7fabe40093d0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.048+0000 7fabf7605740 1 -- 172.21.15.12:0/355721841 shutdown_connections 2024-09-19T06:45:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.048+0000 7fabf7605740 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a481818af0 0x55a481885850 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.048+0000 7fabf7605740 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a481808cb0 0x55a481802c80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.048+0000 7fabf7605740 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a4817fe410 0x55a481802740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.048+0000 7fabf7605740 1 --2- 172.21.15.12:0/355721841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4817fdaf0 0x55a481811200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.048+0000 7fabd5ffb640 0 client.26549 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.048+0000 7fabf7605740 1 -- 172.21.15.12:0/355721841 >> 172.21.15.12:0/355721841 conn(0x55a4817fa060 msgr2=0x55a4817f89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.050+0000 7fabf7605740 1 -- 172.21.15.12:0/355721841 shutdown_connections 2024-09-19T06:45:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.050+0000 7fabf7605740 1 -- 172.21.15.12:0/355721841 wait complete. 2024-09-19T06:45:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.050+0000 7fabf7605740 20 client.26549 trim_cache size 0 max 16384 2024-09-19T06:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.051+0000 7fabf478d640 1 -- 172.21.15.12:0/1951081795 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fabd80a3690 msgr2=0x7fabd80a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.051+0000 7fabf478d640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fabd80a3690 0x7fabd80a5b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fabdc006fd0 tx=0x7fabdc008040 comp rx=0 tx=0).stop 2024-09-19T06:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.051+0000 7fabf478d640 1 -- 172.21.15.12:0/1951081795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec1009d0 msgr2=0x7fabec1162d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.051+0000 7fabf478d640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec1009d0 0x7fabec1162d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b450 tx=0x7fabe800b910 comp rx=0 tx=0).stop 2024-09-19T06:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.051+0000 7fabf478d640 1 -- 172.21.15.12:0/1951081795 shutdown_connections 2024-09-19T06:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.051+0000 7fabf478d640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabec1069e0 0x7fabec10cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.051+0000 7fabf478d640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fabd80a3690 0x7fabd80a5b50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.051+0000 7fabf478d640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabec101370 0x7fabec10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.051+0000 7fabf478d640 1 --2- 172.21.15.12:0/1951081795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabec1009d0 0x7fabec1162d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.051+0000 7fabf478d640 1 -- 172.21.15.12:0/1951081795 >> 172.21.15.12:0/1951081795 conn(0x7fabec0fc6b0 msgr2=0x7fabec1107a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.052+0000 7fabf478d640 1 -- 172.21.15.12:0/1951081795 shutdown_connections 2024-09-19T06:45:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:45:48.053+0000 7fabf478d640 1 -- 172.21.15.12:0/1951081795 wait complete. 2024-09-19T06:45:48.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:45:49.003 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:49.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.624+0000 7f2172e2a640 1 -- 172.21.15.12:0/1571235668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f216c101470 msgr2=0x7f216c101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.624+0000 7f2172e2a640 1 --2- 172.21.15.12:0/1571235668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f216c101470 0x7f216c101850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2160009860 tx=0x7f216002a340 comp rx=0 tx=0).stop 2024-09-19T06:45:49.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.624+0000 7f2172e2a640 1 -- 172.21.15.12:0/1571235668 shutdown_connections 2024-09-19T06:45:49.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.624+0000 7f2172e2a640 1 --2- 172.21.15.12:0/1571235668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c105de0 0x7f216c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.624+0000 7f2172e2a640 1 --2- 172.21.15.12:0/1571235668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f216c101e20 0x7f216c1056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.624+0000 7f2172e2a640 1 --2- 172.21.15.12:0/1571235668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f216c101470 0x7f216c101850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.624+0000 7f2172e2a640 1 -- 172.21.15.12:0/1571235668 >> 172.21.15.12:0/1571235668 conn(0x7f216c077230 msgr2=0x7f216c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:49.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.624+0000 7f2172e2a640 1 -- 172.21.15.12:0/1571235668 shutdown_connections 2024-09-19T06:45:49.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.624+0000 7f2172e2a640 1 -- 172.21.15.12:0/1571235668 wait complete. 2024-09-19T06:45:49.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.625+0000 7f2172e2a640 1 Processor -- start 2024-09-19T06:45:49.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.626+0000 7f2172e2a640 1 -- start start 2024-09-19T06:45:49.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f2172e2a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f216c101470 0x7f216c10ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f2172e2a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f216c101e20 0x7f216c10d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f2172e2a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c105de0 0x7f216c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f2170bc6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f216c101470 0x7f216c10ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f2170bc6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f216c101470 0x7f216c10ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47672/0 (socket says 172.21.15.12:47672) 2024-09-19T06:45:49.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f2172e2a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f216c1009c0 con 0x7f216c105de0 2024-09-19T06:45:49.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f216bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f216c101e20 0x7f216c10d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f2172e2a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f216c100840 con 0x7f216c101470 2024-09-19T06:45:49.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f2172e2a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f216c100b40 con 0x7f216c101e20 2024-09-19T06:45:49.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f2170bc6640 1 -- 172.21.15.12:0/1925546142 learned_addr learned my addr 172.21.15.12:0/1925546142 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:49.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f21713c7640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c105de0 0x7f216c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f216bfff640 1 -- 172.21.15.12:0/1925546142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f216c101470 msgr2=0x7f216c10ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f216bfff640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f216c101470 0x7f216c10ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f216bfff640 1 -- 172.21.15.12:0/1925546142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c105de0 msgr2=0x7f216c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f216bfff640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c105de0 0x7f216c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.627+0000 7f216bfff640 1 -- 172.21.15.12:0/1925546142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216c19f640 con 0x7f216c101e20 2024-09-19T06:45:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.628+0000 7f216bfff640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f216c101e20 0x7f216c10d200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f215c00e9f0 tx=0x7f215c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.628+0000 7f2169ffb640 1 -- 172.21.15.12:0/1925546142 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c00cd80 con 0x7f216c101e20 2024-09-19T06:45:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.628+0000 7f2169ffb640 1 -- 172.21.15.12:0/1925546142 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f215c0035f0 con 0x7f216c101e20 2024-09-19T06:45:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.628+0000 7f2169ffb640 1 -- 172.21.15.12:0/1925546142 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c010690 con 0x7f216c101e20 2024-09-19T06:45:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.629+0000 7f2172e2a640 1 -- 172.21.15.12:0/1925546142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216c19f930 con 0x7f216c101e20 2024-09-19T06:45:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.629+0000 7f2172e2a640 1 -- 172.21.15.12:0/1925546142 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216c1a7210 con 0x7f216c101e20 2024-09-19T06:45:49.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.633+0000 7f2175203740 1 Processor -- start 2024-09-19T06:45:49.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.633+0000 7f2175203740 1 -- start start 2024-09-19T06:45:49.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2175203740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c044880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2175203740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c04f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2175203740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c051a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2175203740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55977bfaa2e0 con 0x55977c0444a0 2024-09-19T06:45:49.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2175203740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55977bf51ce0 con 0x55977c04f680 2024-09-19T06:45:49.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2175203740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55977bfa62a0 con 0x55977c044dc0 2024-09-19T06:45:49.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2170bc6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c04f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2170bc6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c04f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33204/0 (socket says 172.21.15.12:33204) 2024-09-19T06:45:49.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2170bc6640 1 -- 172.21.15.12:0/2266841081 learned_addr learned my addr 172.21.15.12:0/2266841081 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:49.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f21713c7640 1 --2- 172.21.15.12:0/2266841081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c044880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2169ffb640 1 -- 172.21.15.12:0/1925546142 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f215c003b30 con 0x7f216c101e20 2024-09-19T06:45:49.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2170bc6640 1 -- 172.21.15.12:0/2266841081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 msgr2=0x55977c051a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:45:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2170bc6640 1 --2- 172.21.15.12:0/2266841081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c051a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2170bc6640 1 -- 172.21.15.12:0/2266841081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 msgr2=0x55977c044880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2170bc6640 1 --2- 172.21.15.12:0/2266841081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c044880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.634+0000 7f2170bc6640 1 -- 172.21.15.12:0/2266841081 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55977bf36440 con 0x55977c044dc0 2024-09-19T06:45:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.635+0000 7f2170bc6640 1 --2- 172.21.15.12:0/2266841081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c04f140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2160035040 tx=0x7f2160009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c70f16ca43095110 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.635+0000 7f2152ffd640 1 -- 172.21.15.12:0/2266841081 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160041020 con 0x55977c044dc0 2024-09-19T06:45:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.635+0000 7f2152ffd640 1 -- 172.21.15.12:0/2266841081 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2160030550 con 0x55977c044dc0 2024-09-19T06:45:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.635+0000 7f2152ffd640 1 -- 172.21.15.12:0/2266841081 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160037040 con 0x55977c044dc0 2024-09-19T06:45:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.636+0000 7f2175203740 1 -- 172.21.15.12:0/2266841081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 msgr2=0x55977c04f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.636+0000 7f2175203740 1 --2- 172.21.15.12:0/2266841081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c04f140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2160035040 tx=0x7f2160009520 comp rx=0 tx=0).stop 2024-09-19T06:45:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.636+0000 7f2169ffb640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21540a3500 0x7f21540a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.636+0000 7f2175203740 1 -- 172.21.15.12:0/2266841081 shutdown_connections 2024-09-19T06:45:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.636+0000 7f2175203740 1 --2- 172.21.15.12:0/2266841081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c051a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.637+0000 7f2175203740 1 --2- 172.21.15.12:0/2266841081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c04f140 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.637+0000 7f2175203740 1 --2- 172.21.15.12:0/2266841081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c044880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.637+0000 7f2175203740 1 -- 172.21.15.12:0/2266841081 >> 172.21.15.12:0/2266841081 conn(0x55977c040a30 msgr2=0x55977c040e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.637+0000 7f2169ffb640 1 -- 172.21.15.12:0/1925546142 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f215c0cfed0 con 0x7f216c101e20 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.637+0000 7f21713c7640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21540a3500 0x7f21540a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.637+0000 7f2175203740 1 -- 172.21.15.12:0/2266841081 shutdown_connections 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.637+0000 7f2175203740 1 -- 172.21.15.12:0/2266841081 wait complete. 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.637+0000 7f21713c7640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21540a3500 0x7f21540a59c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2164005fd0 tx=0x7f2164010040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.638+0000 7f2175203740 1 -- start start 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.638+0000 7f2175203740 1 Processor -- start 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2175203740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c04f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2175203740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c044dc0 0x55977c04c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2175203740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c04f680 0x55977c04c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2175203740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55977c052250 con 0x55977c0444a0 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2175203740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55977bf65050 con 0x55977c044dc0 2024-09-19T06:45:49.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2175203740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55977c0523d0 con 0x55977c04f680 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2170bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c04f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2170bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c04f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54334/0 (socket says 172.21.15.12:54334) 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2170bc6640 1 -- 172.21.15.12:0/2377535946 learned_addr learned my addr 172.21.15.12:0/2377535946 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2175203740 10 client.0 _ll_register_callbacks cb 0x55977bfa5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f216bfff640 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c044dc0 0x55977c04c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f21713c7640 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c04f680 0x55977c04c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2170bc6640 1 -- 172.21.15.12:0/2377535946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c04f680 msgr2=0x55977c04c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2170bc6640 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c04f680 0x55977c04c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.639+0000 7f2170bc6640 1 -- 172.21.15.12:0/2377535946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c044dc0 msgr2=0x55977c04c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.640+0000 7f2170bc6640 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c044dc0 0x55977c04c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.640+0000 7f2170bc6640 1 -- 172.21.15.12:0/2377535946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55977bd1b3c0 con 0x55977c0444a0 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.640+0000 7f2170bc6640 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c04f000 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2160005e00 tx=0x7f2160005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a60da1fafc9e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.640+0000 7f214bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:49.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.640+0000 7f214bfff640 1 -- 172.21.15.12:0/2377535946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160041030 con 0x55977c0444a0 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.642+0000 7f214bfff640 1 -- 172.21.15.12:0/2377535946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f216003d480 con 0x55977c0444a0 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.642+0000 7f2175203740 1 -- 172.21.15.12:0/2377535946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2160030550 con 0x55977c0444a0 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.642+0000 7f214bfff640 1 -- 172.21.15.12:0/2377535946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2160056050 con 0x55977c0444a0 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.642+0000 7f2175203740 10 client.17061 fetch_fsmap learned FSMap version 37 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.642+0000 7f2175203740 1 -- 172.21.15.12:0/2377535946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55977c05dcc0 con 0x55977c0444a0 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.643+0000 7f214bfff640 1 -- 172.21.15.12:0/2377535946 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2160030550 con 0x55977c0444a0 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.643+0000 7f214bfff640 1 -- 172.21.15.12:0/2377535946 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f21600329c0 con 0x55977c0444a0 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.644+0000 7f2175203740 10 client.17061 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.644+0000 7f2175203740 10 client.17061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.644+0000 7f2175203740 20 client.17061 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.644+0000 7f2175203740 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55977c05f010 0x55977c061400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.644+0000 7f2175203740 4 client.17061 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:49.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.644+0000 7f2175203740 1 -- 172.21.15.12:0/2377535946 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55977bfb7850 con 0x55977c05f010 2024-09-19T06:45:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.644+0000 7f216bfff640 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55977c05f010 0x55977c061400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.645+0000 7f216bfff640 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55977c05f010 0x55977c061400 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c0139b3b8e43599 server_cookie=d1396e2addfd4088 in_seq=0 out_seq=0 2024-09-19T06:45:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.645+0000 7f214bfff640 10 client.17061 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.645+0000 7f214bfff640 1 -- 172.21.15.12:0/2377535946 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55977bfb7850 con 0x55977c05f010 2024-09-19T06:45:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.645+0000 7f214bfff640 10 client.17061 handle_command_reply: tid=0 2024-09-19T06:45:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.646+0000 7f2175203740 1 client.17061 shutdown 2024-09-19T06:45:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.646+0000 7f2175203740 1 -- 172.21.15.12:0/2377535946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 msgr2=0x55977c04f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.646+0000 7f2175203740 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c04f000 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2160005e00 tx=0x7f2160005850 comp rx=0 tx=0).stop 2024-09-19T06:45:49.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.648+0000 7f2175203740 1 -- 172.21.15.12:0/2377535946 shutdown_connections 2024-09-19T06:45:49.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.648+0000 7f2175203740 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55977c05f010 0x55977c061400 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.648+0000 7f214bfff640 0 client.17061 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:49.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.648+0000 7f2175203740 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c04f680 0x55977c04c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.648+0000 7f2175203740 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c044dc0 0x55977c04c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.648+0000 7f2175203740 1 --2- 172.21.15.12:0/2377535946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c04f000 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.648+0000 7f2175203740 1 -- 172.21.15.12:0/2377535946 >> 172.21.15.12:0/2377535946 conn(0x55977c040a30 msgr2=0x55977c046760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:49.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.648+0000 7f2175203740 1 -- 172.21.15.12:0/2377535946 shutdown_connections 2024-09-19T06:45:49.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.649+0000 7f2175203740 1 -- 172.21.15.12:0/2377535946 wait complete. 2024-09-19T06:45:49.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.649+0000 7f2175203740 20 client.17061 trim_cache size 0 max 16384 2024-09-19T06:45:49.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.685+0000 7f2175203740 1 Processor -- start 2024-09-19T06:45:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.685+0000 7f2175203740 1 -- start start 2024-09-19T06:45:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.686+0000 7f2175203740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c05b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.686+0000 7f2175203740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c0669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.686+0000 7f2175203740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c066ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.686+0000 7f216bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c0669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.686+0000 7f216bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c0669a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33226/0 (socket says 172.21.15.12:33226) 2024-09-19T06:45:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.686+0000 7f2170bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c05b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.686+0000 7f2170bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c05b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54346/0 (socket says 172.21.15.12:54346) 2024-09-19T06:45:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.686+0000 7f2175203740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f216c1afe40 con 0x55977c0444a0 2024-09-19T06:45:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.686+0000 7f2175203740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f216c1b1a70 con 0x55977c04f680 2024-09-19T06:45:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.686+0000 7f2175203740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f216c1b0510 con 0x55977c044dc0 2024-09-19T06:45:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.687+0000 7f216bfff640 1 -- 172.21.15.12:0/2091587208 learned_addr learned my addr 172.21.15.12:0/2091587208 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.687+0000 7f21713c7640 1 --2- 172.21.15.12:0/2091587208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c066ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.688+0000 7f216bfff640 1 -- 172.21.15.12:0/2091587208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 msgr2=0x55977c066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.688+0000 7f216bfff640 1 --2- 172.21.15.12:0/2091587208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c066ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.688+0000 7f216bfff640 1 -- 172.21.15.12:0/2091587208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 msgr2=0x55977c05b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.688+0000 7f216bfff640 1 --2- 172.21.15.12:0/2091587208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c05b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.688+0000 7f216bfff640 1 -- 172.21.15.12:0/2091587208 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55977c04b280 con 0x55977c044dc0 2024-09-19T06:45:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.688+0000 7f2170bc6640 1 --2- 172.21.15.12:0/2091587208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c05b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.689+0000 7f216bfff640 1 --2- 172.21.15.12:0/2091587208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c0669a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f215c0cd600 tx=0x7f215c09f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44c30b7baf4419a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.689+0000 7f21527fc640 1 -- 172.21.15.12:0/2091587208 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c0a04e0 con 0x55977c044dc0 2024-09-19T06:45:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.689+0000 7f21527fc640 1 -- 172.21.15.12:0/2091587208 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f215c0a4da0 con 0x55977c044dc0 2024-09-19T06:45:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.689+0000 7f21527fc640 1 -- 172.21.15.12:0/2091587208 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c0cd820 con 0x55977c044dc0 2024-09-19T06:45:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.690+0000 7f2175203740 1 -- 172.21.15.12:0/2091587208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 msgr2=0x55977c0669a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.690+0000 7f2175203740 1 --2- 172.21.15.12:0/2091587208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c0669a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f215c0cd600 tx=0x7f215c09f040 comp rx=0 tx=0).stop 2024-09-19T06:45:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.691+0000 7f2175203740 1 -- 172.21.15.12:0/2091587208 shutdown_connections 2024-09-19T06:45:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.691+0000 7f2175203740 1 --2- 172.21.15.12:0/2091587208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c066ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.691+0000 7f2175203740 1 --2- 172.21.15.12:0/2091587208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c0669a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.691+0000 7f2175203740 1 --2- 172.21.15.12:0/2091587208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c05b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.691+0000 7f2175203740 1 -- 172.21.15.12:0/2091587208 >> 172.21.15.12:0/2091587208 conn(0x55977c040a30 msgr2=0x55977c047900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.692+0000 7f2175203740 1 -- 172.21.15.12:0/2091587208 shutdown_connections 2024-09-19T06:45:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.692+0000 7f2175203740 1 -- 172.21.15.12:0/2091587208 wait complete. 2024-09-19T06:45:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.692+0000 7f2175203740 1 -- start start 2024-09-19T06:45:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.693+0000 7f2175203740 1 Processor -- start 2024-09-19T06:45:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.693+0000 7f2175203740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c053730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f2175203740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c053c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f2175203740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f2175203740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f216c1b12e0 con 0x55977c0444a0 2024-09-19T06:45:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f2175203740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f216c1b0be0 con 0x55977c04f680 2024-09-19T06:45:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f2175203740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f216c1ade20 con 0x55977c044dc0 2024-09-19T06:45:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f2175203740 10 client.0 _ll_register_callbacks cb 0x7f2164009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f216bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c053c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f2170bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c053730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f2170bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c053730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54362/0 (socket says 172.21.15.12:54362) 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f21713c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.694+0000 7f2170bc6640 1 -- 172.21.15.12:0/4054860233 learned_addr learned my addr 172.21.15.12:0/4054860233 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.695+0000 7f2170bc6640 1 -- 172.21.15.12:0/4054860233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 msgr2=0x55977c053c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.695+0000 7f2170bc6640 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c053c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.695+0000 7f2170bc6640 1 -- 172.21.15.12:0/4054860233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 msgr2=0x55977c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.695+0000 7f2170bc6640 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c0c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.695+0000 7f2170bc6640 1 -- 172.21.15.12:0/4054860233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55977c04f370 con 0x55977c0444a0 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.695+0000 7f2170bc6640 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c053730 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f216002a930 tx=0x7f2160004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aedb9ecaedcc541 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.695+0000 7f214bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.695+0000 7f214bfff640 1 -- 172.21.15.12:0/4054860233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160060060 con 0x55977c0444a0 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.695+0000 7f214bfff640 1 -- 172.21.15.12:0/4054860233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f2160005240 con 0x55977c0444a0 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.695+0000 7f2175203740 1 -- 172.21.15.12:0/4054860233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f215c0a4da0 con 0x55977c0444a0 2024-09-19T06:45:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.696+0000 7f214bfff640 1 -- 172.21.15.12:0/4054860233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2160041070 con 0x55977c0444a0 2024-09-19T06:45:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.696+0000 7f2175203740 10 client.17067 fetch_fsmap learned FSMap version 37 2024-09-19T06:45:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.696+0000 7f2175203740 1 -- 172.21.15.12:0/4054860233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55977c0d25c0 con 0x55977c0444a0 2024-09-19T06:45:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.696+0000 7f214bfff640 1 -- 172.21.15.12:0/4054860233 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f215c0a4da0 con 0x55977c0444a0 2024-09-19T06:45:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.696+0000 7f214bfff640 1 -- 172.21.15.12:0/4054860233 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f2160046bb0 con 0x55977c0444a0 2024-09-19T06:45:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.696+0000 7f2175203740 10 client.17067 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:45:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.696+0000 7f2175203740 10 client.17067 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:45:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.696+0000 7f2175203740 20 client.17067 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.696+0000 7f2175203740 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55977c05f010 0x55977c0d4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.696+0000 7f2175203740 4 client.17067 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:45:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.697+0000 7f2175203740 1 -- 172.21.15.12:0/4054860233 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55977bfb1d60 con 0x55977c05f010 2024-09-19T06:45:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.699+0000 7f216bfff640 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55977c05f010 0x55977c0d4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:49.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f216bfff640 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55977c05f010 0x55977c0d4d30 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8243a54ec527455a server_cookie=d21df3f21080c1f8 in_seq=0 out_seq=0 2024-09-19T06:45:49.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f214bfff640 10 client.17067 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:49.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f214bfff640 1 -- 172.21.15.12:0/4054860233 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55977bfb1d60 con 0x55977c05f010 2024-09-19T06:45:49.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f214bfff640 10 client.17067 handle_command_reply: tid=0 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f2175203740 1 client.17067 shutdown 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f2175203740 1 -- 172.21.15.12:0/4054860233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 msgr2=0x55977c053730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f2175203740 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c053730 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f216002a930 tx=0x7f2160004490 comp rx=0 tx=0).stop 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f2175203740 1 -- 172.21.15.12:0/4054860233 shutdown_connections 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f2175203740 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55977c05f010 0x55977c0d4d30 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f2175203740 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55977c04f680 0x55977c0c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f2175203740 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55977c044dc0 0x55977c053c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.700+0000 7f2175203740 1 --2- 172.21.15.12:0/4054860233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55977c0444a0 0x55977c053730 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.701+0000 7f2175203740 1 -- 172.21.15.12:0/4054860233 >> 172.21.15.12:0/4054860233 conn(0x55977c040a30 msgr2=0x55977c04db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.701+0000 7f214bfff640 0 client.17067 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.701+0000 7f2175203740 1 -- 172.21.15.12:0/4054860233 shutdown_connections 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.701+0000 7f2175203740 1 -- 172.21.15.12:0/4054860233 wait complete. 2024-09-19T06:45:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.701+0000 7f2175203740 20 client.17067 trim_cache size 0 max 16384 2024-09-19T06:45:49.704 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:45:49.704 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:45:49.704 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:45:49.704 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 -- 172.21.15.12:0/1925546142 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21540a3500 msgr2=0x7f21540a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21540a3500 0x7f21540a59c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2164005fd0 tx=0x7f2164010040 comp rx=0 tx=0).stop 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 -- 172.21.15.12:0/1925546142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f216c101e20 msgr2=0x7f216c10d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f216c101e20 0x7f216c10d200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f215c00e9f0 tx=0x7f215c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 -- 172.21.15.12:0/1925546142 shutdown_connections 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f216c105de0 0x7f216c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f21540a3500 0x7f21540a59c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f216c101e20 0x7f216c10d200 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 --2- 172.21.15.12:0/1925546142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f216c101470 0x7f216c10ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 -- 172.21.15.12:0/1925546142 >> 172.21.15.12:0/1925546142 conn(0x7f216c077230 msgr2=0x7f216c1052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 -- 172.21.15.12:0/1925546142 shutdown_connections 2024-09-19T06:45:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:49.703+0000 7f2172e2a640 1 -- 172.21.15.12:0/1925546142 wait complete. 2024-09-19T06:45:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:49 smithi016 ceph-mon[34911]: pgmap v173: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.1 MiB/s wr, 765 op/s 2024-09-19T06:45:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:49 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:45:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:49 smithi173 ceph-mon[35349]: pgmap v173: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.1 MiB/s wr, 765 op/s 2024-09-19T06:45:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:49 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:45:49.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:49 smithi012 ceph-mon[30937]: pgmap v173: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.1 MiB/s wr, 765 op/s 2024-09-19T06:45:49.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:49 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:45:50.559 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:45:50.559 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:45:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 305.0 s, 4511.8 tps, lat 22.277 ms stddev 27.152 2024-09-19T06:45:50.985 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.588+0000 7fd9df59e640 1 -- 172.21.15.12:0/3521099460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e01008d0 msgr2=0x7fd9e0100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:51.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.588+0000 7fd9df59e640 1 --2- 172.21.15.12:0/3521099460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e01008d0 0x7fd9e0100d30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009900 tx=0x7fd9d402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.590+0000 7fd9df59e640 1 -- 172.21.15.12:0/3521099460 shutdown_connections 2024-09-19T06:45:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.590+0000 7fd9df59e640 1 --2- 172.21.15.12:0/3521099460 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e0101270 0x7fd9e0069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.590+0000 7fd9df59e640 1 --2- 172.21.15.12:0/3521099460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e01008d0 0x7fd9e0100d30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.590+0000 7fd9df59e640 1 --2- 172.21.15.12:0/3521099460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e01068d0 0x7fd9e0106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.590+0000 7fd9df59e640 1 -- 172.21.15.12:0/3521099460 >> 172.21.15.12:0/3521099460 conn(0x7fd9e00fc610 msgr2=0x7fd9e00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.590+0000 7fd9df59e640 1 -- 172.21.15.12:0/3521099460 shutdown_connections 2024-09-19T06:45:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.590+0000 7fd9df59e640 1 -- 172.21.15.12:0/3521099460 wait complete. 2024-09-19T06:45:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9df59e640 1 Processor -- start 2024-09-19T06:45:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9df59e640 1 -- start start 2024-09-19T06:45:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9df59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e01008d0 0x7fd9e019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9df59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e0101270 0x7fd9e019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9df59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e01068d0 0x7fd9e019ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9de59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e01008d0 0x7fd9e019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9de59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e01008d0 0x7fd9e019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:55474/0 (socket says 172.21.15.12:55474) 2024-09-19T06:45:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9de59c640 1 -- 172.21.15.12:0/3575174277 learned_addr learned my addr 172.21.15.12:0/3575174277 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0114030 con 0x7fd9e01068d0 2024-09-19T06:45:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0113eb0 con 0x7fd9e0101270 2024-09-19T06:45:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e01141b0 con 0x7fd9e01008d0 2024-09-19T06:45:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.591+0000 7fd9ded9d640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e01068d0 0x7fd9e019ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.592+0000 7fd9de59c640 1 -- 172.21.15.12:0/3575174277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e0101270 msgr2=0x7fd9e019a9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:45:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.592+0000 7fd9de59c640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e0101270 0x7fd9e019a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.592+0000 7fd9de59c640 1 -- 172.21.15.12:0/3575174277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e01068d0 msgr2=0x7fd9e019ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.592+0000 7fd9de59c640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e01068d0 0x7fd9e019ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.592+0000 7fd9de59c640 1 -- 172.21.15.12:0/3575174277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e019f430 con 0x7fd9e01008d0 2024-09-19T06:45:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.592+0000 7fd9de59c640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e01008d0 0x7fd9e019a480 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000eab0 tx=0x7fd9d000ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.593+0000 7fd9cf7fe640 1 -- 172.21.15.12:0/3575174277 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000ce40 con 0x7fd9e01008d0 2024-09-19T06:45:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.593+0000 7fd9cf7fe640 1 -- 172.21.15.12:0/3575174277 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9d0011950 con 0x7fd9e01008d0 2024-09-19T06:45:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.593+0000 7fd9cf7fe640 1 -- 172.21.15.12:0/3575174277 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0010aa0 con 0x7fd9e01008d0 2024-09-19T06:45:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.593+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e019f720 con 0x7fd9e01008d0 2024-09-19T06:45:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.593+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e01a7000 con 0x7fd9e01008d0 2024-09-19T06:45:51.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.595+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e0069f70 con 0x7fd9e01008d0 2024-09-19T06:45:51.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.596+0000 7fd9cf7fe640 1 -- 172.21.15.12:0/3575174277 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd9d0010c80 con 0x7fd9e01008d0 2024-09-19T06:45:51.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.597+0000 7fd9cf7fe640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9c80a35c0 0x7fd9c80a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:51.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.597+0000 7fd9ddd9b640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9c80a35c0 0x7fd9c80a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:51.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.598+0000 7fd9cf7fe640 1 -- 172.21.15.12:0/3575174277 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fd9d00cffc0 con 0x7fd9e01008d0 2024-09-19T06:45:51.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.599+0000 7fd9ddd9b640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9c80a35c0 0x7fd9c80a5a80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4005c20 tx=0x7fd9d4005fd0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:51.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:51.601+0000 7fd9cf7fe640 1 -- 172.21.15.12:0/3575174277 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd9d0016030 con 0x7fd9e01008d0 2024-09-19T06:45:51.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:51 smithi016 ceph-mon[34911]: pgmap v174: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 13 MiB/s wr, 1.12k op/s 2024-09-19T06:45:51.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:51 smithi173 ceph-mon[35349]: pgmap v174: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 13 MiB/s wr, 1.12k op/s 2024-09-19T06:45:51.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:51 smithi012 ceph-mon[30937]: pgmap v174: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 13 MiB/s wr, 1.12k op/s 2024-09-19T06:45:52.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.013+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9e019b7e0 con 0x7fd9e01008d0 2024-09-19T06:45:52.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.014+0000 7fd9cf7fe640 1 -- 172.21.15.12:0/3575174277 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11979 (secure 0 0 0) 0x7fd9e019b7e0 con 0x7fd9e01008d0 2024-09-19T06:45:52.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:45:52.016 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":37,"btime":"2024-09-19T06:45:48:464149+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:45:48.421767+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:45:52.016 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 37 2024-09-19T06:45:52.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.018+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9c80a35c0 msgr2=0x7fd9c80a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:52.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.018+0000 7fd9df59e640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9c80a35c0 0x7fd9c80a5a80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4005c20 tx=0x7fd9d4005fd0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.018+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e01008d0 msgr2=0x7fd9e019a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.018+0000 7fd9df59e640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e01008d0 0x7fd9e019a480 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000eab0 tx=0x7fd9d000ef70 comp rx=0 tx=0).stop 2024-09-19T06:45:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.019+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 shutdown_connections 2024-09-19T06:45:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.019+0000 7fd9df59e640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e01068d0 0x7fd9e019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.019+0000 7fd9df59e640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e0101270 0x7fd9e019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.019+0000 7fd9df59e640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9c80a35c0 0x7fd9c80a5a80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.019+0000 7fd9df59e640 1 --2- 172.21.15.12:0/3575174277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e01008d0 0x7fd9e019a480 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.019+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 >> 172.21.15.12:0/3575174277 conn(0x7fd9e00fc610 msgr2=0x7fd9e010d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.019+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 shutdown_connections 2024-09-19T06:45:52.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:52.019+0000 7fd9df59e640 1 -- 172.21.15.12:0/3575174277 wait complete. 2024-09-19T06:45:52.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:52 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3575174277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:52.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:52 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3575174277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:52.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:52 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3575174277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:45:53.285 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:45:53.709 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:53.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:53 smithi016 ceph-mon[34911]: pgmap v175: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.9 MiB/s wr, 755 op/s 2024-09-19T06:45:53.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:53 smithi173 ceph-mon[35349]: pgmap v175: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.9 MiB/s wr, 755 op/s 2024-09-19T06:45:53.841 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:53 smithi012 ceph-mon[30937]: pgmap v175: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.9 MiB/s wr, 755 op/s 2024-09-19T06:45:54.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.282+0000 7fa521fee640 1 -- 172.21.15.12:0/537074741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c108300 msgr2=0x7fa51c10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.282+0000 7fa521fee640 1 --2- 172.21.15.12:0/537074741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c108300 0x7fa51c10ec70 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa514009cd0 tx=0x7fa51402a8d0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.283+0000 7fa521fee640 1 -- 172.21.15.12:0/537074741 shutdown_connections 2024-09-19T06:45:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.283+0000 7fa521fee640 1 --2- 172.21.15.12:0/537074741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c108300 0x7fa51c10ec70 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.283+0000 7fa521fee640 1 --2- 172.21.15.12:0/537074741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c103780 0x7fa51c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.283+0000 7fa521fee640 1 --2- 172.21.15.12:0/537074741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa51c102dd0 0x7fa51c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.283+0000 7fa521fee640 1 -- 172.21.15.12:0/537074741 >> 172.21.15.12:0/537074741 conn(0x7fa51c0fc7d0 msgr2=0x7fa51c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.283+0000 7fa521fee640 1 -- 172.21.15.12:0/537074741 shutdown_connections 2024-09-19T06:45:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.283+0000 7fa521fee640 1 -- 172.21.15.12:0/537074741 wait complete. 2024-09-19T06:45:54.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.283+0000 7fa521fee640 1 Processor -- start 2024-09-19T06:45:54.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.284+0000 7fa521fee640 1 -- start start 2024-09-19T06:45:54.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.285+0000 7fa521fee640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa51c102dd0 0x7fa51c100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.285+0000 7fa521fee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c103780 0x7fa51c100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.285+0000 7fa521fee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c108300 0x7fa51c1014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.285+0000 7fa51b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa51c102dd0 0x7fa51c100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.285+0000 7fa51b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa51c102dd0 0x7fa51c100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44134/0 (socket says 172.21.15.12:44134) 2024-09-19T06:45:54.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.285+0000 7fa51affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c103780 0x7fa51c100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.285+0000 7fa51b7fe640 1 -- 172.21.15.12:0/1543512292 learned_addr learned my addr 172.21.15.12:0/1543512292 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:54.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1120d0 con 0x7fa51c108300 2024-09-19T06:45:54.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c111f50 con 0x7fa51c102dd0 2024-09-19T06:45:54.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c112250 con 0x7fa51c103780 2024-09-19T06:45:54.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa51bfff640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c108300 0x7fa51c1014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.285+0000 7fa51affd640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c103780 0x7fa51c100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:55500/0 (socket says 172.21.15.12:55500) 2024-09-19T06:45:54.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa51affd640 1 -- 172.21.15.12:0/1543512292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa51c102dd0 msgr2=0x7fa51c100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa51affd640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa51c102dd0 0x7fa51c100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa51affd640 1 -- 172.21.15.12:0/1543512292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c108300 msgr2=0x7fa51c1014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa51affd640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c108300 0x7fa51c1014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa51affd640 1 -- 172.21.15.12:0/1543512292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c1a6850 con 0x7fa51c103780 2024-09-19T06:45:54.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa51c102dd0 0x7fa51c100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:54.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa51affd640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c103780 0x7fa51c100f70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0697d0 tx=0x7fa51000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa518ff9640 1 -- 172.21.15.12:0/1543512292 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51000cc40 con 0x7fa51c103780 2024-09-19T06:45:54.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa518ff9640 1 -- 172.21.15.12:0/1543512292 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa51000cde0 con 0x7fa51c103780 2024-09-19T06:45:54.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51c1a6b40 con 0x7fa51c103780 2024-09-19T06:45:54.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.286+0000 7fa518ff9640 1 -- 172.21.15.12:0/1543512292 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510004a00 con 0x7fa51c103780 2024-09-19T06:45:54.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.287+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51c1a7030 con 0x7fa51c103780 2024-09-19T06:45:54.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.290+0000 7fa5243c7740 1 Processor -- start 2024-09-19T06:45:54.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.291+0000 7fa5243c7740 1 -- start start 2024-09-19T06:45:54.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.291+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcb1b40 0x55e45dcb0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.291+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb05d0 0x55e45dcb0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.291+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcbb370 0x55e45dcbd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.291+0000 7fa5243c7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e45dc162f0 con 0x55e45dcb05d0 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.291+0000 7fa5243c7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e45dbbdcf0 con 0x55e45dcbb370 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.291+0000 7fa5243c7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e45dc122b0 con 0x55e45dcb1b40 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.291+0000 7fa51b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb05d0 0x55e45dcb0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.291+0000 7fa51b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb05d0 0x55e45dcb0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54378/0 (socket says 172.21.15.12:54378) 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.291+0000 7fa51b7fe640 1 -- 172.21.15.12:0/799709740 learned_addr learned my addr 172.21.15.12:0/799709740 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.292+0000 7fa51b7fe640 1 -- 172.21.15.12:0/799709740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcb1b40 msgr2=0x55e45dcb0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.292+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/799709740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcb1b40 0x55e45dcb0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.292+0000 7fa51b7fe640 1 -- 172.21.15.12:0/799709740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcbb370 msgr2=0x55e45dcbd760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.292+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/799709740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcbb370 0x55e45dcbd760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.292+0000 7fa51b7fe640 1 -- 172.21.15.12:0/799709740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45dba23a0 con 0x55e45dcb05d0 2024-09-19T06:45:54.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.293+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/799709740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb05d0 0x55e45dcb0a10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009ce0 tx=0x7fa50c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b972fa29715f523 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.293+0000 7fa518ff9640 1 -- 172.21.15.12:0/1543512292 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa510004ba0 con 0x7fa51c103780 2024-09-19T06:45:54.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.293+0000 7fa501ffb640 1 -- 172.21.15.12:0/799709740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c004030 con 0x55e45dcb05d0 2024-09-19T06:45:54.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.293+0000 7fa501ffb640 1 -- 172.21.15.12:0/799709740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa50c0041d0 con 0x55e45dcb05d0 2024-09-19T06:45:54.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa518ff9640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa5040a3480 0x7fa5040a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa501ffb640 1 -- 172.21.15.12:0/799709740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0127d0 con 0x55e45dcb05d0 2024-09-19T06:45:54.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa518ff9640 1 -- 172.21.15.12:0/1543512292 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa5100cfd20 con 0x7fa51c103780 2024-09-19T06:45:54.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa51bfff640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa5040a3480 0x7fa5040a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa5243c7740 1 -- 172.21.15.12:0/799709740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb05d0 msgr2=0x55e45dcb0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa5243c7740 1 --2- 172.21.15.12:0/799709740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb05d0 0x55e45dcb0a10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009ce0 tx=0x7fa50c010740 comp rx=0 tx=0).stop 2024-09-19T06:45:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa5243c7740 1 -- 172.21.15.12:0/799709740 shutdown_connections 2024-09-19T06:45:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa5243c7740 1 --2- 172.21.15.12:0/799709740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcbb370 0x55e45dcbd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa5243c7740 1 --2- 172.21.15.12:0/799709740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb05d0 0x55e45dcb0a10 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa5243c7740 1 --2- 172.21.15.12:0/799709740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcb1b40 0x55e45dcb0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa5243c7740 1 -- 172.21.15.12:0/799709740 >> 172.21.15.12:0/799709740 conn(0x55e45dc79310 msgr2=0x55e45dcacc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:54.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.294+0000 7fa5243c7740 1 -- 172.21.15.12:0/799709740 shutdown_connections 2024-09-19T06:45:54.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.295+0000 7fa51bfff640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa5040a3480 0x7fa5040a5940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa514005e30 tx=0x7fa5140095a0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.295+0000 7fa5243c7740 1 -- 172.21.15.12:0/799709740 wait complete. 2024-09-19T06:45:54.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.295+0000 7fa5243c7740 1 -- start start 2024-09-19T06:45:54.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.296+0000 7fa5243c7740 1 Processor -- start 2024-09-19T06:45:54.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.297+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcbad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.297+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcb1b40 0x55e45dcb7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.297+0000 7fa51b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcbad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.297+0000 7fa51b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcbad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44144/0 (socket says 172.21.15.12:44144) 2024-09-19T06:45:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.297+0000 7fa51b7fe640 1 -- 172.21.15.12:0/523976589 learned_addr learned my addr 172.21.15.12:0/523976589 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.298+0000 7fa5243c7740 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcbb370 0x55e45dcb85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.298+0000 7fa51affd640 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcb1b40 0x55e45dcb7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.298+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e45dcbe110 con 0x55e45dcbb370 2024-09-19T06:45:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.298+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e45dbd1060 con 0x55e45dcb05d0 2024-09-19T06:45:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.298+0000 7fa51bfff640 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcbb370 0x55e45dcb85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.298+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e45dcbe290 con 0x55e45dcb1b40 2024-09-19T06:45:54.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.299+0000 7fa5243c7740 10 client.0 _ll_register_callbacks cb 0x55e45d9248c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:54.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.299+0000 7fa51b7fe640 1 -- 172.21.15.12:0/523976589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcb1b40 msgr2=0x55e45dcb7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:54.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.299+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcb1b40 0x55e45dcb7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.299+0000 7fa51b7fe640 1 -- 172.21.15.12:0/523976589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcbb370 msgr2=0x55e45dcb85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.299+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcbb370 0x55e45dcb85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.299+0000 7fa51b7fe640 1 -- 172.21.15.12:0/523976589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e45d9873c0 con 0x55e45dcb05d0 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.299+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcbad30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00a000 tx=0x7fa50c005d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfa0d90673908541 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.300+0000 7fa4faffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.300+0000 7fa4faffd640 1 -- 172.21.15.12:0/523976589 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c004380 con 0x55e45dcb05d0 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.300+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa50c0041d0 con 0x55e45dcb05d0 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.300+0000 7fa4faffd640 1 -- 172.21.15.12:0/523976589 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa50c005040 con 0x55e45dcb05d0 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.300+0000 7fa4faffd640 1 -- 172.21.15.12:0/523976589 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa50c005280 con 0x55e45dcb05d0 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.300+0000 7fa5243c7740 10 client.26573 fetch_fsmap learned FSMap version 37 2024-09-19T06:45:54.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.300+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e45dcc9ba0 con 0x55e45dcb05d0 2024-09-19T06:45:54.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.300+0000 7fa4faffd640 1 -- 172.21.15.12:0/523976589 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa50c0041d0 con 0x55e45dcb05d0 2024-09-19T06:45:54.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.301+0000 7fa4faffd640 1 -- 172.21.15.12:0/523976589 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fa50c00f040 con 0x55e45dcb05d0 2024-09-19T06:45:54.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.301+0000 7fa5243c7740 10 client.26573 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:45:54.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.301+0000 7fa5243c7740 10 client.26573 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:45:54.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.301+0000 7fa5243c7740 20 client.26573 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:54.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.301+0000 7fa5243c7740 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e45dccb330 0x55e45dccd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.301+0000 7fa5243c7740 4 client.26573 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:54.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.301+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e45dc23860 con 0x55e45dccb330 2024-09-19T06:45:54.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.301+0000 7fa51affd640 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e45dccb330 0x55e45dccd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.302+0000 7fa51affd640 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e45dccb330 0x55e45dccd740 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=26c652a2b1a0047 server_cookie=6f20935acad3e38a in_seq=0 out_seq=0 2024-09-19T06:45:54.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.302+0000 7fa4faffd640 10 client.26573 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:45:54.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.302+0000 7fa4faffd640 1 -- 172.21.15.12:0/523976589 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e45dc23860 con 0x55e45dccb330 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.302+0000 7fa4faffd640 10 client.26573 handle_command_reply: tid=0 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.303+0000 7fa5243c7740 1 client.26573 shutdown 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.303+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 msgr2=0x55e45dcbad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.303+0000 7fa5243c7740 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcbad30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00a000 tx=0x7fa50c005d90 comp rx=0 tx=0).stop 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.303+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 shutdown_connections 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.303+0000 7fa5243c7740 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e45dccb330 0x55e45dccd740 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.303+0000 7fa5243c7740 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcbb370 0x55e45dcb85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.303+0000 7fa5243c7740 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcb1b40 0x55e45dcb7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.303+0000 7fa5243c7740 1 --2- 172.21.15.12:0/523976589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcbad30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.303+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 >> 172.21.15.12:0/523976589 conn(0x55e45dc79310 msgr2=0x55e45dcb2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.303+0000 7fa4faffd640 0 client.26573 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.304+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 shutdown_connections 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.304+0000 7fa5243c7740 1 -- 172.21.15.12:0/523976589 wait complete. 2024-09-19T06:45:54.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.304+0000 7fa5243c7740 20 client.26573 trim_cache size 0 max 16384 2024-09-19T06:45:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.330+0000 7fa5243c7740 1 Processor -- start 2024-09-19T06:45:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.331+0000 7fa5243c7740 1 -- start start 2024-09-19T06:45:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.331+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.331+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 0x55e45dcc7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.331+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 0x55e45dcb78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.331+0000 7fa5243c7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1afde0 con 0x55e45dcb1b40 2024-09-19T06:45:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.331+0000 7fa5243c7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1b1a10 con 0x55e45dcb05d0 2024-09-19T06:45:54.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.331+0000 7fa5243c7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1b04b0 con 0x55e45dcbb370 2024-09-19T06:45:54.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.332+0000 7fa51affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 0x55e45dcc7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.332+0000 7fa51affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 0x55e45dcc7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54384/0 (socket says 172.21.15.12:54384) 2024-09-19T06:45:54.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.332+0000 7fa51affd640 1 -- 172.21.15.12:0/3288077327 learned_addr learned my addr 172.21.15.12:0/3288077327 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:54.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.334+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/3288077327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.334+0000 7fa51b7fe640 1 -- 172.21.15.12:0/3288077327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 msgr2=0x55e45dcb78a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:45:54.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.334+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/3288077327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 0x55e45dcb78a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.334+0000 7fa51b7fe640 1 -- 172.21.15.12:0/3288077327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 msgr2=0x55e45dcc7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:54.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.334+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/3288077327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 0x55e45dcc7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.334+0000 7fa51b7fe640 1 -- 172.21.15.12:0/3288077327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45dcb6f90 con 0x55e45dcb05d0 2024-09-19T06:45:54.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.335+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/3288077327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcace10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa50c005e00 tx=0x7fa50c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba98dd8029948ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.335+0000 7fa5017fa640 1 -- 172.21.15.12:0/3288077327 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c009610 con 0x55e45dcb05d0 2024-09-19T06:45:54.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.335+0000 7fa5017fa640 1 -- 172.21.15.12:0/3288077327 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa50c005420 con 0x55e45dcb05d0 2024-09-19T06:45:54.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.337+0000 7fa5243c7740 1 -- 172.21.15.12:0/3288077327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 msgr2=0x55e45dcace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.337+0000 7fa5243c7740 1 --2- 172.21.15.12:0/3288077327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcace10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa50c005e00 tx=0x7fa50c005fd0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.342+0000 7fa5243c7740 1 -- 172.21.15.12:0/3288077327 shutdown_connections 2024-09-19T06:45:54.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.342+0000 7fa5243c7740 1 --2- 172.21.15.12:0/3288077327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 0x55e45dcb78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.342+0000 7fa5243c7740 1 --2- 172.21.15.12:0/3288077327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 0x55e45dcc7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.342+0000 7fa5243c7740 1 --2- 172.21.15.12:0/3288077327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcace10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.342+0000 7fa5243c7740 1 -- 172.21.15.12:0/3288077327 >> 172.21.15.12:0/3288077327 conn(0x55e45dc79310 msgr2=0x55e45dcac700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:54.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.347+0000 7fa5243c7740 1 -- 172.21.15.12:0/3288077327 shutdown_connections 2024-09-19T06:45:54.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.347+0000 7fa5243c7740 1 -- 172.21.15.12:0/3288077327 wait complete. 2024-09-19T06:45:54.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.347+0000 7fa5243c7740 1 -- start start 2024-09-19T06:45:54.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.348+0000 7fa5243c7740 1 Processor -- start 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcbe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 0x55e45dcbeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa5243c7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 0x55e45dd33fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa5243c7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1b1280 con 0x55e45dcb1b40 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa5243c7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1b0b80 con 0x55e45dcb05d0 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa5243c7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1addc0 con 0x55e45dcbb370 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa5243c7740 10 client.0 _ll_register_callbacks cb 0x7fa50c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 0x55e45dd33fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa51affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 0x55e45dcbeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa51b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcbe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 0x55e45dd33fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:55548/0 (socket says 172.21.15.12:55548) 2024-09-19T06:45:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.349+0000 7fa51bfff640 1 -- 172.21.15.12:0/1580416525 learned_addr learned my addr 172.21.15.12:0/1580416525 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.350+0000 7fa51bfff640 1 -- 172.21.15.12:0/1580416525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 msgr2=0x55e45dcbe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.350+0000 7fa51bfff640 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcbe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.350+0000 7fa51bfff640 1 -- 172.21.15.12:0/1580416525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 msgr2=0x55e45dcbeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.350+0000 7fa51bfff640 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 0x55e45dcbeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.350+0000 7fa51bfff640 1 -- 172.21.15.12:0/1580416525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e45dcbf340 con 0x55e45dcbb370 2024-09-19T06:45:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.353+0000 7fa51bfff640 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 0x55e45dd33fd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa514009ca0 tx=0x7fa514031000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b02d31f58da3d35e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.353+0000 7fa4faffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:45:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.354+0000 7fa4faffd640 1 -- 172.21.15.12:0/1580416525 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514055060 con 0x55e45dcbb370 2024-09-19T06:45:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.354+0000 7fa4faffd640 1 -- 172.21.15.12:0/1580416525 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fa514003970 con 0x55e45dcbb370 2024-09-19T06:45:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.354+0000 7fa5243c7740 1 -- 172.21.15.12:0/1580416525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa50c005420 con 0x55e45dcbb370 2024-09-19T06:45:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.355+0000 7fa4faffd640 1 -- 172.21.15.12:0/1580416525 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa514003b70 con 0x55e45dcbb370 2024-09-19T06:45:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.356+0000 7fa5243c7740 10 client.26533 fetch_fsmap learned FSMap version 37 2024-09-19T06:45:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.356+0000 7fa5243c7740 1 -- 172.21.15.12:0/1580416525 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e45dd35640 con 0x55e45dcbb370 2024-09-19T06:45:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.356+0000 7fa4faffd640 1 -- 172.21.15.12:0/1580416525 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa50c005420 con 0x55e45dcbb370 2024-09-19T06:45:54.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.357+0000 7fa4faffd640 1 -- 172.21.15.12:0/1580416525 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fa514043040 con 0x55e45dcbb370 2024-09-19T06:45:54.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.358+0000 7fa5243c7740 10 client.26533 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:45:54.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.358+0000 7fa5243c7740 10 client.26533 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:45:54.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.358+0000 7fa5243c7740 20 client.26533 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:54.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.358+0000 7fa5243c7740 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e45dd35d50 0x55e45dd36160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:54.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.358+0000 7fa5243c7740 4 client.26533 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:45:54.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.358+0000 7fa5243c7740 1 -- 172.21.15.12:0/1580416525 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e45dc1dd70 con 0x55e45dd35d50 2024-09-19T06:45:54.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.358+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e45dd35d50 0x55e45dd36160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.361+0000 7fa51b7fe640 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e45dd35d50 0x55e45dd36160 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=313ad04c53981169 server_cookie=516e216864ef7bd5 in_seq=0 out_seq=0 2024-09-19T06:45:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.361+0000 7fa4faffd640 10 client.26533 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:45:54.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.362+0000 7fa4faffd640 1 -- 172.21.15.12:0/1580416525 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e45dc1dd70 con 0x55e45dd35d50 2024-09-19T06:45:54.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.362+0000 7fa4faffd640 10 client.26533 handle_command_reply: tid=0 2024-09-19T06:45:54.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.362+0000 7fa5243c7740 1 client.26533 shutdown 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.362+0000 7fa5243c7740 1 -- 172.21.15.12:0/1580416525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 msgr2=0x55e45dd33fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.362+0000 7fa5243c7740 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 0x55e45dd33fd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa514009ca0 tx=0x7fa514031000 comp rx=0 tx=0).stop 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.363+0000 7fa5243c7740 1 -- 172.21.15.12:0/1580416525 shutdown_connections 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.363+0000 7fa5243c7740 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e45dd35d50 0x55e45dd36160 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.363+0000 7fa5243c7740 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e45dcbb370 0x55e45dd33fd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.363+0000 7fa5243c7740 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e45dcb1b40 0x55e45dcbeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.363+0000 7fa5243c7740 1 --2- 172.21.15.12:0/1580416525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e45dcb05d0 0x55e45dcbe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.363+0000 7fa5243c7740 1 -- 172.21.15.12:0/1580416525 >> 172.21.15.12:0/1580416525 conn(0x55e45dc79310 msgr2=0x55e45dcab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.363+0000 7fa4faffd640 0 client.26533 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.363+0000 7fa5243c7740 1 -- 172.21.15.12:0/1580416525 shutdown_connections 2024-09-19T06:45:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.363+0000 7fa5243c7740 1 -- 172.21.15.12:0/1580416525 wait complete. 2024-09-19T06:45:54.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.366+0000 7fa5243c7740 20 client.26533 trim_cache size 0 max 16384 2024-09-19T06:45:54.368 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:45:54.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.367+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa5040a3480 msgr2=0x7fa5040a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.367+0000 7fa521fee640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa5040a3480 0x7fa5040a5940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa514005e30 tx=0x7fa5140095a0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.367+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c103780 msgr2=0x7fa51c100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:54.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.367+0000 7fa521fee640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c103780 0x7fa51c100f70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0697d0 tx=0x7fa51000ee50 comp rx=0 tx=0).stop 2024-09-19T06:45:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.368+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 shutdown_connections 2024-09-19T06:45:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.368+0000 7fa521fee640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c108300 0x7fa51c1014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.368+0000 7fa521fee640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa5040a3480 0x7fa5040a5940 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.368+0000 7fa521fee640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa51c103780 0x7fa51c100f70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.368+0000 7fa521fee640 1 --2- 172.21.15.12:0/1543512292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa51c102dd0 0x7fa51c100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.368+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 >> 172.21.15.12:0/1543512292 conn(0x7fa51c0fc7d0 msgr2=0x7fa51c0fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.368+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 shutdown_connections 2024-09-19T06:45:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:54.368+0000 7fa521fee640 1 -- 172.21.15.12:0/1543512292 wait complete. 2024-09-19T06:45:55.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:45:55.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:55 smithi012 ceph-mon[30937]: pgmap v176: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 866 op/s 2024-09-19T06:45:55.724 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:55.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:55 smithi016 ceph-mon[34911]: pgmap v176: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 866 op/s 2024-09-19T06:45:55.808 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 310.0 s, 3808.4 tps, lat 26.221 ms stddev 28.240 2024-09-19T06:45:55.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:55 smithi173 ceph-mon[35349]: pgmap v176: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 10 MiB/s wr, 866 op/s 2024-09-19T06:45:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.325+0000 7fad4d29a640 1 -- 172.21.15.12:0/2213590132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48102ef0 msgr2=0x7fad4810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.325+0000 7fad4d29a640 1 --2- 172.21.15.12:0/2213590132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48102ef0 0x7fad4810da40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fad40009ca0 tx=0x7fad4002a950 comp rx=0 tx=0).stop 2024-09-19T06:45:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.325+0000 7fad4d29a640 1 -- 172.21.15.12:0/2213590132 shutdown_connections 2024-09-19T06:45:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.325+0000 7fad4d29a640 1 --2- 172.21.15.12:0/2213590132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48102ef0 0x7fad4810da40 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.325+0000 7fad4d29a640 1 --2- 172.21.15.12:0/2213590132 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad48102570 0x7fad481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.325+0000 7fad4d29a640 1 --2- 172.21.15.12:0/2213590132 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad48100e20 0x7fad48101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.325+0000 7fad4d29a640 1 -- 172.21.15.12:0/2213590132 >> 172.21.15.12:0/2213590132 conn(0x7fad480fc7d0 msgr2=0x7fad480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.325+0000 7fad4d29a640 1 -- 172.21.15.12:0/2213590132 shutdown_connections 2024-09-19T06:45:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.325+0000 7fad4d29a640 1 -- 172.21.15.12:0/2213590132 wait complete. 2024-09-19T06:45:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.326+0000 7fad4d29a640 1 Processor -- start 2024-09-19T06:45:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad4d29a640 1 -- start start 2024-09-19T06:45:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad4d29a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48100e20 0x7fad48107a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad4d29a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad48102570 0x7fad48107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad4d29a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad48102ef0 0x7fad481084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad4d29a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fad4810fee0 con 0x7fad48100e20 2024-09-19T06:45:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad4d29a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fad4810fd60 con 0x7fad48102570 2024-09-19T06:45:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad4d29a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fad48110060 con 0x7fad48102ef0 2024-09-19T06:45:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad467fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad48102570 0x7fad48107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48100e20 0x7fad48107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad467fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad48102570 0x7fad48107f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44162/0 (socket says 172.21.15.12:44162) 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48100e20 0x7fad48107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54418/0 (socket says 172.21.15.12:54418) 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad467fc640 1 -- 172.21.15.12:0/2832813598 learned_addr learned my addr 172.21.15.12:0/2832813598 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.327+0000 7fad477fe640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad48102ef0 0x7fad481084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.328+0000 7fad467fc640 1 -- 172.21.15.12:0/2832813598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad48102ef0 msgr2=0x7fad481084d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.328+0000 7fad467fc640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad48102ef0 0x7fad481084d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.328+0000 7fad467fc640 1 -- 172.21.15.12:0/2832813598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48100e20 msgr2=0x7fad48107a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.328+0000 7fad467fc640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48100e20 0x7fad48107a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.328+0000 7fad467fc640 1 -- 172.21.15.12:0/2832813598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad481aad90 con 0x7fad48102570 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.328+0000 7fad467fc640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad48102570 0x7fad48107f90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00b500 tx=0x7fad3c00b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.328+0000 7fad2ffff640 1 -- 172.21.15.12:0/2832813598 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c014070 con 0x7fad48102570 2024-09-19T06:45:56.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.328+0000 7fad2ffff640 1 -- 172.21.15.12:0/2832813598 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad3c010d50 con 0x7fad48102570 2024-09-19T06:45:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.328+0000 7fad2ffff640 1 -- 172.21.15.12:0/2832813598 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c017360 con 0x7fad48102570 2024-09-19T06:45:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.329+0000 7fad4d29a640 1 -- 172.21.15.12:0/2832813598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad481ab080 con 0x7fad48102570 2024-09-19T06:45:56.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.329+0000 7fad4d29a640 1 -- 172.21.15.12:0/2832813598 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad481ab5f0 con 0x7fad48102570 2024-09-19T06:45:56.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.333+0000 7fad2ffff640 1 -- 172.21.15.12:0/2832813598 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fad3c017070 con 0x7fad48102570 2024-09-19T06:45:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.334+0000 7fad2ffff640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fad300a34b0 0x7fad300a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.334+0000 7fad2ffff640 1 -- 172.21.15.12:0/2832813598 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fad3c0cf2c0 con 0x7fad48102570 2024-09-19T06:45:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.334+0000 7fad4f673740 1 Processor -- start 2024-09-19T06:45:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.334+0000 7fad4f673740 1 -- start start 2024-09-19T06:45:56.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad4f673740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 0x55bbf03a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad4f673740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad4f673740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03be380 0x55bbf03c0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad4f673740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bbf03082f0 con 0x55bbf03be380 2024-09-19T06:45:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 0x55bbf03a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 0x55bbf03a2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:55576/0 (socket says 172.21.15.12:55576) 2024-09-19T06:45:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad46ffd640 1 -- 172.21.15.12:0/3665269611 learned_addr learned my addr 172.21.15.12:0/3665269611 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad467fc640 1 --2- 172.21.15.12:0/3665269611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad477fe640 1 --2- 172.21.15.12:0/3665269611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03be380 0x55bbf03c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad4f673740 1 -- 172.21.15.12:0/3665269611 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bbf02afcf0 con 0x55bbf03a25d0 2024-09-19T06:45:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.335+0000 7fad4f673740 1 -- 172.21.15.12:0/3665269611 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bbf03042b0 con 0x55bbf03a3b40 2024-09-19T06:45:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.336+0000 7fad46ffd640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fad300a34b0 0x7fad300a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.336+0000 7fad467fc640 1 -- 172.21.15.12:0/3665269611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 msgr2=0x55bbf03a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.336+0000 7fad467fc640 1 --2- 172.21.15.12:0/3665269611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 0x55bbf03a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.336+0000 7fad467fc640 1 -- 172.21.15.12:0/3665269611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03be380 msgr2=0x55bbf03c0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.336+0000 7fad467fc640 1 --2- 172.21.15.12:0/3665269611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03be380 0x55bbf03c0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.336+0000 7fad467fc640 1 -- 172.21.15.12:0/3665269611 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbf02943a0 con 0x55bbf03a25d0 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.336+0000 7fad467fc640 1 --2- 172.21.15.12:0/3665269611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03a2a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0cca40 tx=0x7fad3c09b130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=404478ce9d9ddfb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.337+0000 7fad2d7fa640 1 -- 172.21.15.12:0/3665269611 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c01e070 con 0x55bbf03a25d0 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.337+0000 7fad2d7fa640 1 -- 172.21.15.12:0/3665269611 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad3c09fa10 con 0x55bbf03a25d0 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.337+0000 7fad2d7fa640 1 -- 172.21.15.12:0/3665269611 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0a0ba0 con 0x55bbf03a25d0 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.338+0000 7fad4f673740 1 -- 172.21.15.12:0/3665269611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 msgr2=0x55bbf03a2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.338+0000 7fad4f673740 1 --2- 172.21.15.12:0/3665269611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03a2a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0cca40 tx=0x7fad3c09b130 comp rx=0 tx=0).stop 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.338+0000 7fad4f673740 1 -- 172.21.15.12:0/3665269611 shutdown_connections 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.338+0000 7fad4f673740 1 --2- 172.21.15.12:0/3665269611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03be380 0x55bbf03c0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.338+0000 7fad4f673740 1 --2- 172.21.15.12:0/3665269611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03a2a10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.338+0000 7fad4f673740 1 --2- 172.21.15.12:0/3665269611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 0x55bbf03a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.338+0000 7fad4f673740 1 -- 172.21.15.12:0/3665269611 >> 172.21.15.12:0/3665269611 conn(0x55bbf036b310 msgr2=0x55bbf039ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.338+0000 7fad4f673740 1 -- 172.21.15.12:0/3665269611 shutdown_connections 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.338+0000 7fad4f673740 1 -- 172.21.15.12:0/3665269611 wait complete. 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.339+0000 7fad46ffd640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fad300a34b0 0x7fad300a5970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad3800b3c0 tx=0x7fad3800d040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.339+0000 7fad4f673740 1 -- start start 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.339+0000 7fad4f673740 1 Processor -- start 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.339+0000 7fad4f673740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.339+0000 7fad4f673740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 0x55bbf03bb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad4f673740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03be380 0x55bbf03bb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad4f673740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bbf03c1080 con 0x55bbf03be380 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad4f673740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55bbf02c3060 con 0x55bbf03a25d0 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad4f673740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bbf03c1200 con 0x55bbf03a3b40 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad4f673740 10 client.0 _ll_register_callbacks cb 0x55bbf00168c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03bddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44182/0 (socket says 172.21.15.12:44182) 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad46ffd640 1 -- 172.21.15.12:0/85170407 learned_addr learned my addr 172.21.15.12:0/85170407 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad477fe640 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03be380 0x55bbf03bb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad467fc640 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 0x55bbf03bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad46ffd640 1 -- 172.21.15.12:0/85170407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 msgr2=0x55bbf03bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad46ffd640 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 0x55bbf03bb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad46ffd640 1 -- 172.21.15.12:0/85170407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03be380 msgr2=0x55bbf03bb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad46ffd640 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03be380 0x55bbf03bb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad46ffd640 1 -- 172.21.15.12:0/85170407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbf00793c0 con 0x55bbf03a25d0 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad467fc640 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 0x55bbf03bb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad46ffd640 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03bddb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fad3800ba50 tx=0x7fad38004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69ac8ef9d90cb542 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.340+0000 7fad2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.341+0000 7fad2aff5640 1 -- 172.21.15.12:0/85170407 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3801aea0 con 0x55bbf03a25d0 2024-09-19T06:45:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.341+0000 7fad2aff5640 1 -- 172.21.15.12:0/85170407 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fad38011070 con 0x55bbf03a25d0 2024-09-19T06:45:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.341+0000 7fad4f673740 1 -- 172.21.15.12:0/85170407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad3c09fa10 con 0x55bbf03a25d0 2024-09-19T06:45:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.342+0000 7fad2aff5640 1 -- 172.21.15.12:0/85170407 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fad380042c0 con 0x55bbf03a25d0 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.343+0000 7fad4f673740 10 client.26591 fetch_fsmap learned FSMap version 37 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.343+0000 7fad4f673740 1 -- 172.21.15.12:0/85170407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55bbf03ccba0 con 0x55bbf03a25d0 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.343+0000 7fad2aff5640 1 -- 172.21.15.12:0/85170407 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad38004460 con 0x55bbf03a25d0 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.343+0000 7fad2aff5640 1 -- 172.21.15.12:0/85170407 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fad38004890 con 0x55bbf03a25d0 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.344+0000 7fad4f673740 10 client.26591 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.344+0000 7fad4f673740 10 client.26591 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.344+0000 7fad4f673740 20 client.26591 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.344+0000 7fad4f673740 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55bbf03ce060 0x55bbf03d0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.344+0000 7fad4f673740 4 client.26591 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.344+0000 7fad4f673740 1 -- 172.21.15.12:0/85170407 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fad3c09fa10 con 0x55bbf03ce060 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.344+0000 7fad467fc640 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55bbf03ce060 0x55bbf03d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.346+0000 7fad467fc640 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55bbf03ce060 0x55bbf03d0500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=78d192032a4dc3b0 server_cookie=fe7175fd1c30aae9 in_seq=0 out_seq=0 2024-09-19T06:45:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.346+0000 7fad2aff5640 10 client.26591 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:45:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.347+0000 7fad2aff5640 1 -- 172.21.15.12:0/85170407 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fad3c09fa10 con 0x55bbf03ce060 2024-09-19T06:45:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.347+0000 7fad2aff5640 10 client.26591 handle_command_reply: tid=0 2024-09-19T06:45:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.348+0000 7fad4f673740 1 client.26591 shutdown 2024-09-19T06:45:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.348+0000 7fad4f673740 1 -- 172.21.15.12:0/85170407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 msgr2=0x55bbf03bddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.348+0000 7fad4f673740 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03bddb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fad3800ba50 tx=0x7fad38004730 comp rx=0 tx=0).stop 2024-09-19T06:45:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.349+0000 7fad4f673740 1 -- 172.21.15.12:0/85170407 shutdown_connections 2024-09-19T06:45:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.349+0000 7fad4f673740 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55bbf03ce060 0x55bbf03d0500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.349+0000 7fad4f673740 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03be380 0x55bbf03bb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.349+0000 7fad4f673740 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03a3b40 0x55bbf03bb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.349+0000 7fad4f673740 1 --2- 172.21.15.12:0/85170407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03bddb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.349+0000 7fad2aff5640 0 client.26591 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:45:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.349+0000 7fad4f673740 1 -- 172.21.15.12:0/85170407 >> 172.21.15.12:0/85170407 conn(0x55bbf036b310 msgr2=0x55bbf03a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.349+0000 7fad4f673740 1 -- 172.21.15.12:0/85170407 shutdown_connections 2024-09-19T06:45:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.349+0000 7fad4f673740 1 -- 172.21.15.12:0/85170407 wait complete. 2024-09-19T06:45:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.349+0000 7fad4f673740 20 client.26591 trim_cache size 0 max 16384 2024-09-19T06:45:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.371+0000 7fad4f673740 1 Processor -- start 2024-09-19T06:45:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.371+0000 7fad4f673740 1 -- start start 2024-09-19T06:45:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.372+0000 7fad4f673740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a25d0 0x55bbf03d5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.372+0000 7fad4f673740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a3b40 0x55bbf03d6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.372+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a25d0 0x55bbf03d5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.372+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a25d0 0x55bbf03d5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54440/0 (socket says 172.21.15.12:54440) 2024-09-19T06:45:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.372+0000 7fad46ffd640 1 -- 172.21.15.12:0/2768289354 learned_addr learned my addr 172.21.15.12:0/2768289354 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.373+0000 7fad467fc640 1 --2- 172.21.15.12:0/2768289354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a3b40 0x55bbf03d6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.373+0000 7fad4f673740 1 --2- 172.21.15.12:0/2768289354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03be380 0x55bbf03b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.373+0000 7fad4f673740 1 -- 172.21.15.12:0/2768289354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fad481aba30 con 0x55bbf03a25d0 2024-09-19T06:45:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.373+0000 7fad4f673740 1 -- 172.21.15.12:0/2768289354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fad481ad660 con 0x55bbf03a3b40 2024-09-19T06:45:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.373+0000 7fad477fe640 1 --2- 172.21.15.12:0/2768289354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03be380 0x55bbf03b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.373+0000 7fad4f673740 1 -- 172.21.15.12:0/2768289354 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fad481ac100 con 0x55bbf03be380 2024-09-19T06:45:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.374+0000 7fad46ffd640 1 -- 172.21.15.12:0/2768289354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03be380 msgr2=0x55bbf03b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.374+0000 7fad46ffd640 1 --2- 172.21.15.12:0/2768289354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03be380 0x55bbf03b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.374+0000 7fad46ffd640 1 -- 172.21.15.12:0/2768289354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a3b40 msgr2=0x55bbf03d6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.374+0000 7fad46ffd640 1 --2- 172.21.15.12:0/2768289354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a3b40 0x55bbf03d6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.374+0000 7fad46ffd640 1 -- 172.21.15.12:0/2768289354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbf03bc000 con 0x55bbf03a25d0 2024-09-19T06:45:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.374+0000 7fad46ffd640 1 --2- 172.21.15.12:0/2768289354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a25d0 0x55bbf03d5e20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fad3801a730 tx=0x7fad3800b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19db4dcab23608c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.375+0000 7fad2cff9640 1 -- 172.21.15.12:0/2768289354 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38004460 con 0x55bbf03a25d0 2024-09-19T06:45:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.375+0000 7fad2cff9640 1 -- 172.21.15.12:0/2768289354 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad380039c0 con 0x55bbf03a25d0 2024-09-19T06:45:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.375+0000 7fad2cff9640 1 -- 172.21.15.12:0/2768289354 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38005330 con 0x55bbf03a25d0 2024-09-19T06:45:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.376+0000 7fad4f673740 1 -- 172.21.15.12:0/2768289354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a25d0 msgr2=0x55bbf03d5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.376+0000 7fad4f673740 1 --2- 172.21.15.12:0/2768289354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a25d0 0x55bbf03d5e20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fad3801a730 tx=0x7fad3800b3f0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.377+0000 7fad4f673740 1 -- 172.21.15.12:0/2768289354 shutdown_connections 2024-09-19T06:45:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.377+0000 7fad4f673740 1 --2- 172.21.15.12:0/2768289354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03be380 0x55bbf03b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.377+0000 7fad4f673740 1 --2- 172.21.15.12:0/2768289354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a3b40 0x55bbf03d6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.377+0000 7fad4f673740 1 --2- 172.21.15.12:0/2768289354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a25d0 0x55bbf03d5e20 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.377+0000 7fad4f673740 1 -- 172.21.15.12:0/2768289354 >> 172.21.15.12:0/2768289354 conn(0x55bbf036b310 msgr2=0x55bbf03b9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.377+0000 7fad4f673740 1 -- 172.21.15.12:0/2768289354 shutdown_connections 2024-09-19T06:45:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.378+0000 7fad4f673740 1 -- 172.21.15.12:0/2768289354 wait complete. 2024-09-19T06:45:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.378+0000 7fad4f673740 1 -- start start 2024-09-19T06:45:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.378+0000 7fad4f673740 1 Processor -- start 2024-09-19T06:45:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad4f673740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad4f673740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a3b40 0x55bbf03c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad4f673740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03be380 0x55bbf03c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad4f673740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fad481aced0 con 0x55bbf03a3b40 2024-09-19T06:45:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad4f673740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fad481ac7d0 con 0x55bbf03a25d0 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad4f673740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fad48101200 con 0x55bbf03be380 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad4f673740 10 client.0 _ll_register_callbacks cb 0x7fad3800b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad46ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44194/0 (socket says 172.21.15.12:44194) 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad46ffd640 1 -- 172.21.15.12:0/1507956952 learned_addr learned my addr 172.21.15.12:0/1507956952 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad467fc640 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a3b40 0x55bbf03c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad477fe640 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03be380 0x55bbf03c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad46ffd640 1 -- 172.21.15.12:0/1507956952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03be380 msgr2=0x55bbf03c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad46ffd640 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03be380 0x55bbf03c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad46ffd640 1 -- 172.21.15.12:0/1507956952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a3b40 msgr2=0x55bbf03c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad46ffd640 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a3b40 0x55bbf03c2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.379+0000 7fad46ffd640 1 -- 172.21.15.12:0/1507956952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbf0437ff0 con 0x55bbf03a25d0 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.380+0000 7fad46ffd640 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03c24e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fad38005750 tx=0x7fad38005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c2145a3886fc5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.380+0000 7fad2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:45:56.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.381+0000 7fad2aff5640 1 -- 172.21.15.12:0/1507956952 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38003d80 con 0x55bbf03a25d0 2024-09-19T06:45:56.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.381+0000 7fad2aff5640 1 -- 172.21.15.12:0/1507956952 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fad38014040 con 0x55bbf03a25d0 2024-09-19T06:45:56.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.381+0000 7fad4f673740 1 -- 172.21.15.12:0/1507956952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad380039c0 con 0x55bbf03a25d0 2024-09-19T06:45:56.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.381+0000 7fad2aff5640 1 -- 172.21.15.12:0/1507956952 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fad38003f20 con 0x55bbf03a25d0 2024-09-19T06:45:56.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.381+0000 7fad4f673740 10 client.26597 fetch_fsmap learned FSMap version 37 2024-09-19T06:45:56.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.381+0000 7fad4f673740 1 -- 172.21.15.12:0/1507956952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55bbf04392d0 con 0x55bbf03a25d0 2024-09-19T06:45:56.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.382+0000 7fad2aff5640 1 -- 172.21.15.12:0/1507956952 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad380039c0 con 0x55bbf03a25d0 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.382+0000 7fad2aff5640 1 -- 172.21.15.12:0/1507956952 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fad38046070 con 0x55bbf03a25d0 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.382+0000 7fad4f673740 10 client.26597 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.382+0000 7fad4f673740 10 client.26597 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.382+0000 7fad4f673740 20 client.26597 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.382+0000 7fad4f673740 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55bbf04398d0 0x55bbf043bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.382+0000 7fad4f673740 4 client.26597 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.382+0000 7fad4f673740 1 -- 172.21.15.12:0/1507956952 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bbf0315860 con 0x55bbf04398d0 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.382+0000 7fad467fc640 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55bbf04398d0 0x55bbf043bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad467fc640 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55bbf04398d0 0x55bbf043bcc0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3b73adf9e177f88c server_cookie=bb1c2d6b0165af0c in_seq=0 out_seq=0 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad2aff5640 10 client.26597 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad2aff5640 1 -- 172.21.15.12:0/1507956952 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bbf0315860 con 0x55bbf04398d0 2024-09-19T06:45:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad2aff5640 10 client.26597 handle_command_reply: tid=0 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad4f673740 1 client.26597 shutdown 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad4f673740 1 -- 172.21.15.12:0/1507956952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 msgr2=0x55bbf03c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad4f673740 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03c24e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fad38005750 tx=0x7fad38005780 comp rx=0 tx=0).stop 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad4f673740 1 -- 172.21.15.12:0/1507956952 shutdown_connections 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad4f673740 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55bbf04398d0 0x55bbf043bcc0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad4f673740 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bbf03be380 0x55bbf03c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad4f673740 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bbf03a3b40 0x55bbf03c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad4f673740 1 --2- 172.21.15.12:0/1507956952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55bbf03a25d0 0x55bbf03c24e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad4f673740 1 -- 172.21.15.12:0/1507956952 >> 172.21.15.12:0/1507956952 conn(0x55bbf036b310 msgr2=0x55bbf03a41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad2aff5640 0 client.26597 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.383+0000 7fad4f673740 1 -- 172.21.15.12:0/1507956952 shutdown_connections 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.384+0000 7fad4f673740 1 -- 172.21.15.12:0/1507956952 wait complete. 2024-09-19T06:45:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.384+0000 7fad4f673740 20 client.26597 trim_cache size 0 max 16384 2024-09-19T06:45:56.388 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.384+0000 7fad4d29a640 1 -- 172.21.15.12:0/2832813598 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fad300a34b0 msgr2=0x7fad300a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.384+0000 7fad4d29a640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fad300a34b0 0x7fad300a5970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad3800b3c0 tx=0x7fad3800d040 comp rx=0 tx=0).stop 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.384+0000 7fad4d29a640 1 -- 172.21.15.12:0/2832813598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad48102570 msgr2=0x7fad48107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.384+0000 7fad4d29a640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad48102570 0x7fad48107f90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00b500 tx=0x7fad3c00b9c0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.385+0000 7fad4d29a640 1 -- 172.21.15.12:0/2832813598 shutdown_connections 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.385+0000 7fad4d29a640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fad300a34b0 0x7fad300a5970 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.385+0000 7fad4d29a640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad48102ef0 0x7fad481084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.385+0000 7fad4d29a640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad48102570 0x7fad48107f90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.385+0000 7fad4d29a640 1 --2- 172.21.15.12:0/2832813598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad48100e20 0x7fad48107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.385+0000 7fad4d29a640 1 -- 172.21.15.12:0/2832813598 >> 172.21.15.12:0/2832813598 conn(0x7fad480fc7d0 msgr2=0x7fad48106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.385+0000 7fad4d29a640 1 -- 172.21.15.12:0/2832813598 shutdown_connections 2024-09-19T06:45:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:56.385+0000 7fad4d29a640 1 -- 172.21.15.12:0/2832813598 wait complete. 2024-09-19T06:45:57.453 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:45:57.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:57 smithi016 ceph-mon[34911]: pgmap v177: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2024-09-19T06:45:57.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:57 smithi173 ceph-mon[35349]: pgmap v177: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2024-09-19T06:45:57.875 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:45:57.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:57 smithi012 ceph-mon[30937]: pgmap v177: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2024-09-19T06:45:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.511+0000 7fc51676f640 1 -- 172.21.15.12:0/3028301245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100e20 msgr2=0x7fc510101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.511+0000 7fc51676f640 1 --2- 172.21.15.12:0/3028301245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100e20 0x7fc510101200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc500009930 tx=0x7fc50002a4d0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.511+0000 7fc51676f640 1 -- 172.21.15.12:0/3028301245 shutdown_connections 2024-09-19T06:45:58.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.511+0000 7fc51676f640 1 --2- 172.21.15.12:0/3028301245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc510102ef0 0x7fc51010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.511+0000 7fc51676f640 1 --2- 172.21.15.12:0/3028301245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc510102570 0x7fc5101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.511+0000 7fc51676f640 1 --2- 172.21.15.12:0/3028301245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510100e20 0x7fc510101200 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.511+0000 7fc51676f640 1 -- 172.21.15.12:0/3028301245 >> 172.21.15.12:0/3028301245 conn(0x7fc5100fc7d0 msgr2=0x7fc5100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:58.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.512+0000 7fc51676f640 1 -- 172.21.15.12:0/3028301245 shutdown_connections 2024-09-19T06:45:58.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.512+0000 7fc51676f640 1 -- 172.21.15.12:0/3028301245 wait complete. 2024-09-19T06:45:58.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.513+0000 7fc51676f640 1 Processor -- start 2024-09-19T06:45:58.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.513+0000 7fc51676f640 1 -- start start 2024-09-19T06:45:58.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.514+0000 7fc51676f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc510100e20 0x7fc5100739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.514+0000 7fc51676f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc510102570 0x7fc51006ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.514+0000 7fc51676f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510102ef0 0x7fc51006cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.514+0000 7fc50ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc510100e20 0x7fc5100739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.514+0000 7fc50ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc510100e20 0x7fc5100739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54484/0 (socket says 172.21.15.12:54484) 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.514+0000 7fc50ffff640 1 -- 172.21.15.12:0/1283691481 learned_addr learned my addr 172.21.15.12:0/1283691481 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.514+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc51010fec0 con 0x7fc510100e20 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.514+0000 7fc514d0c640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510102ef0 0x7fc51006cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.514+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc51010fd40 con 0x7fc510102ef0 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.514+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc510110040 con 0x7fc510102570 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.515+0000 7fc514d0c640 1 -- 172.21.15.12:0/1283691481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc510102570 msgr2=0x7fc51006ca60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.515+0000 7fc514d0c640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc510102570 0x7fc51006ca60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.515+0000 7fc514d0c640 1 -- 172.21.15.12:0/1283691481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc510100e20 msgr2=0x7fc5100739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.515+0000 7fc514d0c640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc510100e20 0x7fc5100739d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.515+0000 7fc514d0c640 1 -- 172.21.15.12:0/1283691481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51006d530 con 0x7fc510102ef0 2024-09-19T06:45:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.515+0000 7fc50ffff640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc510100e20 0x7fc5100739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.515+0000 7fc514d0c640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510102ef0 0x7fc51006cfa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc508009fd0 tx=0x7fc50800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.517+0000 7fc50d7fa640 1 -- 172.21.15.12:0/1283691481 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50800ce20 con 0x7fc510102ef0 2024-09-19T06:45:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.517+0000 7fc50d7fa640 1 -- 172.21.15.12:0/1283691481 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc508005020 con 0x7fc510102ef0 2024-09-19T06:45:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.517+0000 7fc50d7fa640 1 -- 172.21.15.12:0/1283691481 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc508010720 con 0x7fc510102ef0 2024-09-19T06:45:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.517+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51006d820 con 0x7fc510102ef0 2024-09-19T06:45:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.517+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc510071760 con 0x7fc510102ef0 2024-09-19T06:45:58.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.520+0000 7fc50d7fa640 1 -- 172.21.15.12:0/1283691481 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc508005540 con 0x7fc510102ef0 2024-09-19T06:45:58.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.522+0000 7fc50d7fa640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4f80a3540 0x7fc4f80a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.523+0000 7fc50d7fa640 1 -- 172.21.15.12:0/1283691481 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc5080d0440 con 0x7fc510102ef0 2024-09-19T06:45:58.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.523+0000 7fc518b48740 1 Processor -- start 2024-09-19T06:45:58.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.523+0000 7fc518b48740 1 -- start start 2024-09-19T06:45:58.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.523+0000 7fc518b48740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d598090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.523+0000 7fc518b48740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d5985d0 0x55f27d598a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.523+0000 7fc518b48740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5a3370 0x55f27d5a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.523+0000 7fc518b48740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f27d4fe2f0 con 0x55f27d5a3370 2024-09-19T06:45:58.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.523+0000 7fc518b48740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f27d4a5cf0 con 0x55f27d599b40 2024-09-19T06:45:58.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.523+0000 7fc518b48740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f27d4fa2b0 con 0x55f27d5985d0 2024-09-19T06:45:58.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.523+0000 7fc50ffff640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4f80a3540 0x7fc4f80a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.524+0000 7fc50ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d598090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.524+0000 7fc50ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d598090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44226/0 (socket says 172.21.15.12:44226) 2024-09-19T06:45:58.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.524+0000 7fc50ffff640 1 -- 172.21.15.12:0/2507827780 learned_addr learned my addr 172.21.15.12:0/2507827780 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:58.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.524+0000 7fc514d0c640 1 --2- 172.21.15.12:0/2507827780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5a3370 0x55f27d5a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.524+0000 7fc50ffff640 1 -- 172.21.15.12:0/2507827780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d5985d0 msgr2=0x55f27d598a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:45:58.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.524+0000 7fc50ffff640 1 --2- 172.21.15.12:0/2507827780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d5985d0 0x55f27d598a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.524+0000 7fc50ffff640 1 -- 172.21.15.12:0/2507827780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5a3370 msgr2=0x55f27d5a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:58.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.524+0000 7fc50ffff640 1 --2- 172.21.15.12:0/2507827780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5a3370 0x55f27d5a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.524+0000 7fc50ffff640 1 -- 172.21.15.12:0/2507827780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27d48a3a0 con 0x55f27d599b40 2024-09-19T06:45:58.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.524+0000 7fc514d0c640 1 --2- 172.21.15.12:0/2507827780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5a3370 0x55f27d5a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:45:58.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.525+0000 7fc50ffff640 1 --2- 172.21.15.12:0/2507827780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d598090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc500009900 tx=0x7fc500005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8808bb99cab1a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.525+0000 7fc50ffff640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4f80a3540 0x7fc4f80a5a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc500004650 tx=0x7fc50003a000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.526+0000 7fc4f67fc640 1 -- 172.21.15.12:0/2507827780 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500035040 con 0x55f27d599b40 2024-09-19T06:45:58.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.526+0000 7fc4f67fc640 1 -- 172.21.15.12:0/2507827780 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc50004e070 con 0x55f27d599b40 2024-09-19T06:45:58.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.527+0000 7fc518b48740 1 -- 172.21.15.12:0/2507827780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 msgr2=0x55f27d598090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.527+0000 7fc518b48740 1 --2- 172.21.15.12:0/2507827780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d598090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc500009900 tx=0x7fc500005780 comp rx=0 tx=0).stop 2024-09-19T06:45:58.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.527+0000 7fc518b48740 1 -- 172.21.15.12:0/2507827780 shutdown_connections 2024-09-19T06:45:58.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.527+0000 7fc518b48740 1 --2- 172.21.15.12:0/2507827780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5a3370 0x55f27d5a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.528+0000 7fc518b48740 1 --2- 172.21.15.12:0/2507827780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d5985d0 0x55f27d598a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.528+0000 7fc518b48740 1 --2- 172.21.15.12:0/2507827780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d598090 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.528+0000 7fc518b48740 1 -- 172.21.15.12:0/2507827780 >> 172.21.15.12:0/2507827780 conn(0x55f27d561310 msgr2=0x55f27d594c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:58.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.528+0000 7fc518b48740 1 -- 172.21.15.12:0/2507827780 shutdown_connections 2024-09-19T06:45:58.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.528+0000 7fc518b48740 1 -- 172.21.15.12:0/2507827780 wait complete. 2024-09-19T06:45:58.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.528+0000 7fc518b48740 1 -- start start 2024-09-19T06:45:58.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.529+0000 7fc518b48740 1 Processor -- start 2024-09-19T06:45:58.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.529+0000 7fc518b48740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 0x55f27d5a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.529+0000 7fc518b48740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d599b40 0x55f27d59ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.529+0000 7fc518b48740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d5a3370 0x55f27d5a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.529+0000 7fc518b48740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f27d5a6060 con 0x55f27d5985d0 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.529+0000 7fc518b48740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f27d4b9060 con 0x55f27d5a3370 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.529+0000 7fc518b48740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f27d5a61e0 con 0x55f27d599b40 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.529+0000 7fc518b48740 10 client.0 _ll_register_callbacks cb 0x55f27d20c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.530+0000 7fc50ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 0x55f27d5a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.530+0000 7fc50ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 0x55f27d5a2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54508/0 (socket says 172.21.15.12:54508) 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.530+0000 7fc50ffff640 1 -- 172.21.15.12:0/344674746 learned_addr learned my addr 172.21.15.12:0/344674746 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.530+0000 7fc50ffff640 1 -- 172.21.15.12:0/344674746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d599b40 msgr2=0x55f27d59ff60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.530+0000 7fc50ffff640 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d599b40 0x55f27d59ff60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.530+0000 7fc50ffff640 1 -- 172.21.15.12:0/344674746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d5a3370 msgr2=0x55f27d5a04a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.530+0000 7fc50ffff640 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d5a3370 0x55f27d5a04a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.530+0000 7fc50ffff640 1 -- 172.21.15.12:0/344674746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27d26f3c0 con 0x55f27d5985d0 2024-09-19T06:45:58.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.531+0000 7fc50ffff640 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 0x55f27d5a2cb0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc500009850 tx=0x7fc5000044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4438aff4ba6f0bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.531+0000 7fc4ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:45:58.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.532+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/344674746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500035070 con 0x55f27d5985d0 2024-09-19T06:45:58.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.532+0000 7fc518b48740 1 -- 172.21.15.12:0/344674746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc50004e070 con 0x55f27d5985d0 2024-09-19T06:45:58.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.532+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/344674746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc500032c80 con 0x55f27d5985d0 2024-09-19T06:45:58.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.532+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/344674746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc500060050 con 0x55f27d5985d0 2024-09-19T06:45:58.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.533+0000 7fc518b48740 10 client.17112 fetch_fsmap learned FSMap version 37 2024-09-19T06:45:58.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.533+0000 7fc518b48740 1 -- 172.21.15.12:0/344674746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f27d5b1a10 con 0x55f27d5985d0 2024-09-19T06:45:58.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.534+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/344674746 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc50004e070 con 0x55f27d5985d0 2024-09-19T06:45:58.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.534+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/344674746 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fc500048070 con 0x55f27d5985d0 2024-09-19T06:45:58.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.534+0000 7fc518b48740 10 client.17112 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:45:58.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.534+0000 7fc518b48740 10 client.17112 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:45:58.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.534+0000 7fc518b48740 20 client.17112 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:58.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.534+0000 7fc518b48740 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f27d5b3030 0x55f27d5b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.534+0000 7fc518b48740 4 client.17112 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:45:58.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.534+0000 7fc518b48740 1 -- 172.21.15.12:0/344674746 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f27d50b860 con 0x55f27d5b3030 2024-09-19T06:45:58.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.538+0000 7fc50f7fe640 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f27d5b3030 0x55f27d5b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.550+0000 7fc50f7fe640 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f27d5b3030 0x55f27d5b54d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0bc21dc5bb9684f server_cookie=1c84689fffd07d27 in_seq=0 out_seq=0 2024-09-19T06:45:58.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.550+0000 7fc4ef7fe640 10 client.17112 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:45:58.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.551+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/344674746 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f27d50b860 con 0x55f27d5b3030 2024-09-19T06:45:58.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.551+0000 7fc4ef7fe640 10 client.17112 handle_command_reply: tid=0 2024-09-19T06:45:58.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.551+0000 7fc518b48740 1 client.17112 shutdown 2024-09-19T06:45:58.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.552+0000 7fc518b48740 1 -- 172.21.15.12:0/344674746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 msgr2=0x55f27d5a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.552+0000 7fc518b48740 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 0x55f27d5a2cb0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc500009850 tx=0x7fc5000044e0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.557+0000 7fc518b48740 1 -- 172.21.15.12:0/344674746 shutdown_connections 2024-09-19T06:45:58.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.557+0000 7fc518b48740 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f27d5b3030 0x55f27d5b54d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.557+0000 7fc518b48740 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d5a3370 0x55f27d5a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.557+0000 7fc518b48740 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d599b40 0x55f27d59ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.557+0000 7fc518b48740 1 --2- 172.21.15.12:0/344674746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 0x55f27d5a2cb0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.557+0000 7fc518b48740 1 -- 172.21.15.12:0/344674746 >> 172.21.15.12:0/344674746 conn(0x55f27d561310 msgr2=0x55f27d59a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:58.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.557+0000 7fc4ef7fe640 0 client.17112 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:45:58.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.559+0000 7fc518b48740 1 -- 172.21.15.12:0/344674746 shutdown_connections 2024-09-19T06:45:58.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.559+0000 7fc518b48740 1 -- 172.21.15.12:0/344674746 wait complete. 2024-09-19T06:45:58.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.559+0000 7fc518b48740 20 client.17112 trim_cache size 0 max 16384 2024-09-19T06:45:58.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.587+0000 7fc518b48740 1 Processor -- start 2024-09-19T06:45:58.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.587+0000 7fc518b48740 1 -- start start 2024-09-19T06:45:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.588+0000 7fc518b48740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d561310 0x55f27d5af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.588+0000 7fc518b48740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 0x55f27d5b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.588+0000 7fc518b48740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d599b40 0x55f27d5bade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.588+0000 7fc518b48740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101c51a0 con 0x55f27d5985d0 2024-09-19T06:45:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.588+0000 7fc518b48740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101c6dd0 con 0x55f27d561310 2024-09-19T06:45:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.588+0000 7fc518b48740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101c5870 con 0x55f27d599b40 2024-09-19T06:45:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.588+0000 7fc50ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d561310 0x55f27d5af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.588+0000 7fc50ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d561310 0x55f27d5af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44236/0 (socket says 172.21.15.12:44236) 2024-09-19T06:45:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.588+0000 7fc50ffff640 1 -- 172.21.15.12:0/2083465685 learned_addr learned my addr 172.21.15.12:0/2083465685 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.589+0000 7fc50f7fe640 1 --2- 172.21.15.12:0/2083465685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 0x55f27d5b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.589+0000 7fc514d0c640 1 --2- 172.21.15.12:0/2083465685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d599b40 0x55f27d5bade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.589+0000 7fc50ffff640 1 -- 172.21.15.12:0/2083465685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d599b40 msgr2=0x55f27d5bade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.589+0000 7fc50ffff640 1 --2- 172.21.15.12:0/2083465685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d599b40 0x55f27d5bade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.589+0000 7fc50ffff640 1 -- 172.21.15.12:0/2083465685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 msgr2=0x55f27d5b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:58.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.589+0000 7fc50ffff640 1 --2- 172.21.15.12:0/2083465685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 0x55f27d5b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.589+0000 7fc50ffff640 1 -- 172.21.15.12:0/2083465685 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27d595730 con 0x55f27d561310 2024-09-19T06:45:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.591+0000 7fc50ffff640 1 --2- 172.21.15.12:0/2083465685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d561310 0x55f27d5af350 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5000096c0 tx=0x7fc50002a4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=959678ff3d6eade server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.592+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/2083465685 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500035070 con 0x55f27d561310 2024-09-19T06:45:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.592+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/2083465685 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc50004e040 con 0x55f27d561310 2024-09-19T06:45:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.592+0000 7fc4f5ffb640 1 -- 172.21.15.12:0/2083465685 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000038e0 con 0x55f27d561310 2024-09-19T06:45:58.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.593+0000 7fc518b48740 1 -- 172.21.15.12:0/2083465685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d561310 msgr2=0x55f27d5af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.593+0000 7fc518b48740 1 --2- 172.21.15.12:0/2083465685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d561310 0x55f27d5af350 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5000096c0 tx=0x7fc50002a4d0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.593+0000 7fc518b48740 1 -- 172.21.15.12:0/2083465685 shutdown_connections 2024-09-19T06:45:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.593+0000 7fc518b48740 1 --2- 172.21.15.12:0/2083465685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d599b40 0x55f27d5bade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.593+0000 7fc518b48740 1 --2- 172.21.15.12:0/2083465685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d5985d0 0x55f27d5b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.593+0000 7fc518b48740 1 --2- 172.21.15.12:0/2083465685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d561310 0x55f27d5af350 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.593+0000 7fc518b48740 1 -- 172.21.15.12:0/2083465685 >> 172.21.15.12:0/2083465685 conn(0x55f27d5a0600 msgr2=0x55f27d59e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.593+0000 7fc518b48740 1 -- 172.21.15.12:0/2083465685 shutdown_connections 2024-09-19T06:45:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.593+0000 7fc518b48740 1 -- 172.21.15.12:0/2083465685 wait complete. 2024-09-19T06:45:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.594+0000 7fc518b48740 1 -- start start 2024-09-19T06:45:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.594+0000 7fc518b48740 1 Processor -- start 2024-09-19T06:45:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.598+0000 7fc518b48740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d561310 0x55f27d5a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.598+0000 7fc518b48740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d5985d0 0x55f27d5a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.598+0000 7fc518b48740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d61bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.598+0000 7fc518b48740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101c6640 con 0x55f27d561310 2024-09-19T06:45:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.598+0000 7fc518b48740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101c5f40 con 0x55f27d599b40 2024-09-19T06:45:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc518b48740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101c3180 con 0x55f27d5985d0 2024-09-19T06:45:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc50ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d561310 0x55f27d5a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc50ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d561310 0x55f27d5a6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54526/0 (socket says 172.21.15.12:54526) 2024-09-19T06:45:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc50ffff640 1 -- 172.21.15.12:0/1327673394 learned_addr learned my addr 172.21.15.12:0/1327673394 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:45:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc514d0c640 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d61bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc50f7fe640 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d5985d0 0x55f27d5a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc514d0c640 1 -- 172.21.15.12:0/1327673394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d5985d0 msgr2=0x55f27d5a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc514d0c640 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d5985d0 0x55f27d5a6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc514d0c640 1 -- 172.21.15.12:0/1327673394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d561310 msgr2=0x55f27d5a6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:45:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc514d0c640 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d561310 0x55f27d5a6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc514d0c640 1 -- 172.21.15.12:0/1327673394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27d61c2e0 con 0x55f27d599b40 2024-09-19T06:45:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.599+0000 7fc514d0c640 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d61bda0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc5080cdab0 tx=0x7fc50809c060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df4fdec06c29131 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.600+0000 7fc4ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:45:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.600+0000 7fc518b48740 10 client.0 _ll_register_callbacks cb 0x7fc500009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:45:58.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.600+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/1327673394 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5080a09f0 con 0x55f27d599b40 2024-09-19T06:45:58.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.600+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/1327673394 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc5080a4e20 con 0x55f27d599b40 2024-09-19T06:45:58.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.600+0000 7fc518b48740 1 -- 172.21.15.12:0/1327673394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc50004e040 con 0x55f27d599b40 2024-09-19T06:45:58.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.600+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/1327673394 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc5080a52b0 con 0x55f27d599b40 2024-09-19T06:45:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.603+0000 7fc518b48740 10 client.26612 fetch_fsmap learned FSMap version 37 2024-09-19T06:45:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.603+0000 7fc518b48740 1 -- 172.21.15.12:0/1327673394 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55f27d61d480 con 0x55f27d599b40 2024-09-19T06:45:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.603+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/1327673394 <== mon.2 v2:172.21.15.16:3300/0 4 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fc5080b0b60 con 0x55f27d599b40 2024-09-19T06:45:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.603+0000 7fc518b48740 10 client.26612 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:45:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.603+0000 7fc518b48740 10 client.26612 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:45:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.604+0000 7fc518b48740 20 client.26612 populate_metadata read hostname 'smithi012' 2024-09-19T06:45:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.604+0000 7fc518b48740 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f27d5a3370 0x55f27d61fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.604+0000 7fc518b48740 4 client.26612 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:45:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.604+0000 7fc518b48740 1 -- 172.21.15.12:0/1327673394 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fc50004e040 con 0x55f27d5a3370 2024-09-19T06:45:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.604+0000 7fc50ffff640 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f27d5a3370 0x55f27d61fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.604+0000 7fc4ef7fe640 10 client.26612 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.604+0000 7fc50ffff640 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f27d5a3370 0x55f27d61fc00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fdb9d793710ca188 server_cookie=b2d0404f411e0a17 in_seq=0 out_seq=0 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.605+0000 7fc4ef7fe640 1 -- 172.21.15.12:0/1327673394 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc50004e040 con 0x55f27d5a3370 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.605+0000 7fc4ef7fe640 10 client.26612 handle_command_reply: tid=0 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.605+0000 7fc518b48740 1 client.26612 shutdown 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.605+0000 7fc518b48740 1 -- 172.21.15.12:0/1327673394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 msgr2=0x55f27d61bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.605+0000 7fc518b48740 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d61bda0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc5080cdab0 tx=0x7fc50809c060 comp rx=0 tx=0).stop 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.605+0000 7fc518b48740 1 -- 172.21.15.12:0/1327673394 shutdown_connections 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.605+0000 7fc518b48740 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55f27d5a3370 0x55f27d61fc00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.605+0000 7fc518b48740 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f27d599b40 0x55f27d61bda0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.606+0000 7fc4ef7fe640 0 client.26612 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:45:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.606+0000 7fc518b48740 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f27d5985d0 0x55f27d5a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.606+0000 7fc518b48740 1 --2- 172.21.15.12:0/1327673394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f27d561310 0x55f27d5a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.606+0000 7fc518b48740 1 -- 172.21.15.12:0/1327673394 >> 172.21.15.12:0/1327673394 conn(0x55f27d5a0600 msgr2=0x55f27d59a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:58.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.606+0000 7fc518b48740 1 -- 172.21.15.12:0/1327673394 shutdown_connections 2024-09-19T06:45:58.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.606+0000 7fc518b48740 1 -- 172.21.15.12:0/1327673394 wait complete. 2024-09-19T06:45:58.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.606+0000 7fc518b48740 20 client.26612 trim_cache size 0 max 16384 2024-09-19T06:45:58.609 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:45:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.608+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4f80a3540 msgr2=0x7fc4f80a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.608+0000 7fc51676f640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4f80a3540 0x7fc4f80a5a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc500004650 tx=0x7fc50003a000 comp rx=0 tx=0).stop 2024-09-19T06:45:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.608+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510102ef0 msgr2=0x7fc51006cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.608+0000 7fc51676f640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510102ef0 0x7fc51006cfa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc508009fd0 tx=0x7fc50800ef10 comp rx=0 tx=0).stop 2024-09-19T06:45:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.609+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 shutdown_connections 2024-09-19T06:45:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.609+0000 7fc51676f640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc510102ef0 0x7fc51006cfa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.609+0000 7fc51676f640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4f80a3540 0x7fc4f80a5a00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.609+0000 7fc51676f640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc510102570 0x7fc51006ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.609+0000 7fc51676f640 1 --2- 172.21.15.12:0/1283691481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc510100e20 0x7fc5100739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:58.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.609+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 >> 172.21.15.12:0/1283691481 conn(0x7fc5100fc7d0 msgr2=0x7fc5100fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:58.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.610+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 shutdown_connections 2024-09-19T06:45:58.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:45:58.610+0000 7fc51676f640 1 -- 172.21.15.12:0/1283691481 wait complete. 2024-09-19T06:45:59.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:45:59.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:45:59 smithi016 ceph-mon[34911]: pgmap v178: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.7 MiB/s wr, 686 op/s 2024-09-19T06:45:59.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:45:59 smithi173 ceph-mon[35349]: pgmap v178: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.7 MiB/s wr, 686 op/s 2024-09-19T06:45:59.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:45:59 smithi012 ceph-mon[30937]: pgmap v178: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.7 MiB/s wr, 686 op/s 2024-09-19T06:46:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:00.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.675+0000 7f7667633640 1 -- 172.21.15.12:0/3184089612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100e20 msgr2=0x7f7660101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.675+0000 7f7667633640 1 --2- 172.21.15.12:0/3184089612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100e20 0x7f7660101200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7650009890 tx=0x7f765002a410 comp rx=0 tx=0).stop 2024-09-19T06:46:00.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.675+0000 7f7667633640 1 -- 172.21.15.12:0/3184089612 shutdown_connections 2024-09-19T06:46:00.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.675+0000 7f7667633640 1 --2- 172.21.15.12:0/3184089612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660102ef0 0x7f766010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.675+0000 7f7667633640 1 --2- 172.21.15.12:0/3184089612 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660102570 0x7f76601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.675+0000 7f7667633640 1 --2- 172.21.15.12:0/3184089612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100e20 0x7f7660101200 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.675+0000 7f7667633640 1 -- 172.21.15.12:0/3184089612 >> 172.21.15.12:0/3184089612 conn(0x7f76600fc7d0 msgr2=0x7f76600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:00.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.676+0000 7f7667633640 1 -- 172.21.15.12:0/3184089612 shutdown_connections 2024-09-19T06:46:00.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.676+0000 7f7667633640 1 -- 172.21.15.12:0/3184089612 wait complete. 2024-09-19T06:46:00.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.677+0000 7f7667633640 1 Processor -- start 2024-09-19T06:46:00.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.677+0000 7f7667633640 1 -- start start 2024-09-19T06:46:00.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.678+0000 7f7667633640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100e20 0x7f7660073b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.678+0000 7f7667633640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660102570 0x7f766006dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.678+0000 7f7667633640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660102ef0 0x7f766006e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.678+0000 7f7667633640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f766006c640 con 0x7f7660102570 2024-09-19T06:46:00.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.678+0000 7f7667633640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f766006c4c0 con 0x7f7660102ef0 2024-09-19T06:46:00.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.678+0000 7f7667633640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f766006c7c0 con 0x7f7660100e20 2024-09-19T06:46:00.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.678+0000 7f7665bd0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660102ef0 0x7f766006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.678+0000 7f7665bd0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660102ef0 0x7f766006e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43456/0 (socket says 172.21.15.12:43456) 2024-09-19T06:46:00.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.678+0000 7f7665bd0640 1 -- 172.21.15.12:0/1421435960 learned_addr learned my addr 172.21.15.12:0/1421435960 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:00.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.678+0000 7f76653cf640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100e20 0x7f7660073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f7665bd0640 1 -- 172.21.15.12:0/1421435960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100e20 msgr2=0x7f7660073b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f7665bd0640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100e20 0x7f7660073b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f7665bd0640 1 -- 172.21.15.12:0/1421435960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660102570 msgr2=0x7f766006dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f7665bd0640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660102570 0x7f766006dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f7665bd0640 1 -- 172.21.15.12:0/1421435960 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766006e800 con 0x7f7660102ef0 2024-09-19T06:46:00.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f7665bd0640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660102ef0 0x7f766006e100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f765801ad50 tx=0x7f765801b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f76567fc640 1 -- 172.21.15.12:0/1421435960 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658013030 con 0x7f7660102ef0 2024-09-19T06:46:00.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f7667633640 1 -- 172.21.15.12:0/1421435960 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76601cd210 con 0x7f7660102ef0 2024-09-19T06:46:00.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f76567fc640 1 -- 172.21.15.12:0/1421435960 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7658005020 con 0x7f7660102ef0 2024-09-19T06:46:00.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f76567fc640 1 -- 172.21.15.12:0/1421435960 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765800f6c0 con 0x7f7660102ef0 2024-09-19T06:46:00.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.679+0000 7f7667633640 1 -- 172.21.15.12:0/1421435960 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76601cd670 con 0x7f7660102ef0 2024-09-19T06:46:00.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.687+0000 7f76567fc640 1 -- 172.21.15.12:0/1421435960 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7658016070 con 0x7f7660102ef0 2024-09-19T06:46:00.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.687+0000 7f7669a0c740 1 Processor -- start 2024-09-19T06:46:00.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.687+0000 7f7669a0c740 1 -- start start 2024-09-19T06:46:00.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.688+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abac5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.688+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abac55d0 0x5642abac5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.688+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abad0370 0x5642abad2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.688+0000 7f7669a0c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5642aba2b2f0 con 0x5642abac6b40 2024-09-19T06:46:00.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.688+0000 7f7669a0c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5642ab9d2cf0 con 0x5642abad0370 2024-09-19T06:46:00.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.688+0000 7f76653cf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abac55d0 0x5642abac5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.688+0000 7f76653cf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abac55d0 0x5642abac5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48196/0 (socket says 172.21.15.12:48196) 2024-09-19T06:46:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.688+0000 7f76653cf640 1 -- 172.21.15.12:0/3034485552 learned_addr learned my addr 172.21.15.12:0/3034485552 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.688+0000 7f7664bce640 1 --2- 172.21.15.12:0/3034485552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abad0370 0x5642abad2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.688+0000 7f7669a0c740 1 -- 172.21.15.12:0/3034485552 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5642aba272b0 con 0x5642abac55d0 2024-09-19T06:46:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.689+0000 7f76567fc640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f764c0a34b0 0x7f764c0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.689+0000 7f76653cf640 1 -- 172.21.15.12:0/3034485552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abad0370 msgr2=0x5642abad2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.689+0000 7f76653cf640 1 --2- 172.21.15.12:0/3034485552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abad0370 0x5642abad2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.689+0000 7f76653cf640 1 -- 172.21.15.12:0/3034485552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 msgr2=0x5642abac5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.689+0000 7f76653cf640 1 --2- 172.21.15.12:0/3034485552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abac5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.689+0000 7f76653cf640 1 -- 172.21.15.12:0/3034485552 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642ab9b73a0 con 0x5642abac55d0 2024-09-19T06:46:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.690+0000 7f76653cf640 1 --2- 172.21.15.12:0/3034485552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abac55d0 0x5642abac5a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7650034000 tx=0x7f7650030b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e5f2e0a5c150c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.690+0000 7f76567fc640 1 -- 172.21.15.12:0/1421435960 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f76580d1210 con 0x7f7660102ef0 2024-09-19T06:46:00.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.691+0000 7f7664bce640 1 --2- 172.21.15.12:0/3034485552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abad0370 0x5642abad2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:00.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.691+0000 7f7665bd0640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f764c0a34b0 0x7f764c0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.691+0000 7f764b7fe640 1 -- 172.21.15.12:0/3034485552 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76500305a0 con 0x5642abac55d0 2024-09-19T06:46:00.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.691+0000 7f764b7fe640 1 -- 172.21.15.12:0/3034485552 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7650041070 con 0x5642abac55d0 2024-09-19T06:46:00.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.691+0000 7f764b7fe640 1 -- 172.21.15.12:0/3034485552 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650004ac0 con 0x5642abac55d0 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.692+0000 7f7669a0c740 1 -- 172.21.15.12:0/3034485552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abac55d0 msgr2=0x5642abac5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.692+0000 7f7669a0c740 1 --2- 172.21.15.12:0/3034485552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abac55d0 0x5642abac5a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7650034000 tx=0x7f7650030b60 comp rx=0 tx=0).stop 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.692+0000 7f7665bd0640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f764c0a34b0 0x7f764c0a5970 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f765809d110 tx=0x7f7658099040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.693+0000 7f7669a0c740 1 -- 172.21.15.12:0/3034485552 shutdown_connections 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.693+0000 7f7669a0c740 1 --2- 172.21.15.12:0/3034485552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abad0370 0x5642abad2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.693+0000 7f7669a0c740 1 --2- 172.21.15.12:0/3034485552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abac55d0 0x5642abac5a10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.693+0000 7f7669a0c740 1 --2- 172.21.15.12:0/3034485552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abac5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.693+0000 7f7669a0c740 1 -- 172.21.15.12:0/3034485552 >> 172.21.15.12:0/3034485552 conn(0x5642aba8e310 msgr2=0x5642abac1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.693+0000 7f7669a0c740 1 -- 172.21.15.12:0/3034485552 shutdown_connections 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.693+0000 7f7669a0c740 1 -- 172.21.15.12:0/3034485552 wait complete. 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.693+0000 7f7669a0c740 1 -- start start 2024-09-19T06:46:00.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.694+0000 7f7669a0c740 1 Processor -- start 2024-09-19T06:46:00.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.695+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac55d0 0x5642abacfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.695+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac6b40 0x5642abacd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.695+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abacd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.695+0000 7f7669a0c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5642abad3010 con 0x5642abac55d0 2024-09-19T06:46:00.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.695+0000 7f7669a0c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5642ab9e6060 con 0x5642abac6b40 2024-09-19T06:46:00.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.695+0000 7f76653cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac6b40 0x5642abacd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.695+0000 7f76653cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac6b40 0x5642abacd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43486/0 (socket says 172.21.15.12:43486) 2024-09-19T06:46:00.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.695+0000 7f76653cf640 1 -- 172.21.15.12:0/4135830175 learned_addr learned my addr 172.21.15.12:0/4135830175 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:00.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.695+0000 7f7664bce640 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abacd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.695+0000 7f7664bce640 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac55d0 0x5642abacfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.696+0000 7f7669a0c740 1 -- 172.21.15.12:0/4135830175 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5642abad3190 con 0x5642abad0370 2024-09-19T06:46:00.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.696+0000 7f7669a0c740 10 client.0 _ll_register_callbacks cb 0x5642ab7398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:00.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.696+0000 7f7664bce640 1 -- 172.21.15.12:0/4135830175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac6b40 msgr2=0x5642abacd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:00.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.696+0000 7f7664bce640 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac6b40 0x5642abacd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.696+0000 7f7664bce640 1 -- 172.21.15.12:0/4135830175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac55d0 msgr2=0x5642abacfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:00.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.696+0000 7f7664bce640 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac55d0 0x5642abacfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.697+0000 7f7664bce640 1 -- 172.21.15.12:0/4135830175 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642ab79c3c0 con 0x5642abad0370 2024-09-19T06:46:00.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.697+0000 7f76653cf640 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac6b40 0x5642abacd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.697+0000 7f7664bce640 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abacd600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f766006f380 tx=0x7f765c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9111e3b816e9ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.697+0000 7f7648ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.697+0000 7f7648ff9640 1 -- 172.21.15.12:0/4135830175 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c00a040 con 0x5642abad0370 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.697+0000 7f7669a0c740 1 -- 172.21.15.12:0/4135830175 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7650041070 con 0x5642abad0370 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.697+0000 7f7648ff9640 1 -- 172.21.15.12:0/4135830175 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f765c013410 con 0x5642abad0370 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.697+0000 7f7648ff9640 1 -- 172.21.15.12:0/4135830175 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f765c023050 con 0x5642abad0370 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.697+0000 7f7669a0c740 10 client.26569 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.698+0000 7f7669a0c740 1 -- 172.21.15.12:0/4135830175 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5642abadeae0 con 0x5642abad0370 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.698+0000 7f7648ff9640 1 -- 172.21.15.12:0/4135830175 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7650041070 con 0x5642abad0370 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.698+0000 7f7648ff9640 1 -- 172.21.15.12:0/4135830175 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f765c010070 con 0x5642abad0370 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.698+0000 7f7669a0c740 10 client.26569 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:00.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.698+0000 7f7669a0c740 10 client.26569 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:46:00.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.698+0000 7f7669a0c740 20 client.26569 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:00.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.699+0000 7f7669a0c740 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5642abadff40 0x5642abae2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.699+0000 7f7669a0c740 4 client.26569 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:00.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.699+0000 7f7669a0c740 1 -- 172.21.15.12:0/4135830175 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642aba38860 con 0x5642abadff40 2024-09-19T06:46:00.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.699+0000 7f76653cf640 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5642abadff40 0x5642abae2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.700+0000 7f7648ff9640 10 client.26569 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:46:00.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.700+0000 7f76653cf640 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5642abadff40 0x5642abae2370 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c31458cbcd5525ea server_cookie=e51f3c9cb70f57e5 in_seq=0 out_seq=0 2024-09-19T06:46:00.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.700+0000 7f7648ff9640 1 -- 172.21.15.12:0/4135830175 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642aba38860 con 0x5642abadff40 2024-09-19T06:46:00.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.700+0000 7f7648ff9640 10 client.26569 handle_command_reply: tid=0 2024-09-19T06:46:00.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.700+0000 7f7669a0c740 1 client.26569 shutdown 2024-09-19T06:46:00.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 1 -- 172.21.15.12:0/4135830175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 msgr2=0x5642abacd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abacd600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f766006f380 tx=0x7f765c0091d0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 1 -- 172.21.15.12:0/4135830175 shutdown_connections 2024-09-19T06:46:00.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5642abadff40 0x5642abae2370 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abacd600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac6b40 0x5642abacd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7648ff9640 0 client.26569 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:46:00.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 1 --2- 172.21.15.12:0/4135830175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac55d0 0x5642abacfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 1 -- 172.21.15.12:0/4135830175 >> 172.21.15.12:0/4135830175 conn(0x5642aba8e310 msgr2=0x5642abac7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:00.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 1 -- 172.21.15.12:0/4135830175 shutdown_connections 2024-09-19T06:46:00.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 1 -- 172.21.15.12:0/4135830175 wait complete. 2024-09-19T06:46:00.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.701+0000 7f7669a0c740 20 client.26569 trim_cache size 0 max 16384 2024-09-19T06:46:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.719+0000 7f7669a0c740 1 Processor -- start 2024-09-19T06:46:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.719+0000 7f7669a0c740 1 -- start start 2024-09-19T06:46:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.719+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 0x5642abadc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.719+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abacb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abacbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f7669a0c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f764400e9c0 con 0x5642abac6b40 2024-09-19T06:46:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f7669a0c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f76440105f0 con 0x5642abac55d0 2024-09-19T06:46:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f7669a0c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f764400f090 con 0x5642abad0370 2024-09-19T06:46:00.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f76653cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abacb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f76653cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abacb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52412/0 (socket says 172.21.15.12:52412) 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f76653cf640 1 -- 172.21.15.12:0/2893587169 learned_addr learned my addr 172.21.15.12:0/2893587169 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f7664bce640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 0x5642abadc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f7664bce640 1 --2- 172.21.15.12:0/2893587169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abacbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f76653cf640 1 -- 172.21.15.12:0/2893587169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 msgr2=0x5642abacbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f76653cf640 1 --2- 172.21.15.12:0/2893587169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abacbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f76653cf640 1 -- 172.21.15.12:0/2893587169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 msgr2=0x5642abadc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f76653cf640 1 --2- 172.21.15.12:0/2893587169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 0x5642abadc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f76653cf640 1 -- 172.21.15.12:0/2893587169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642abac2dd0 con 0x5642abac6b40 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f7664bce640 1 --2- 172.21.15.12:0/2893587169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 0x5642abadc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.720+0000 7f76653cf640 1 --2- 172.21.15.12:0/2893587169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abacb8e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f765002a930 tx=0x7f765003f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8920d5b0f0d9b05e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.721+0000 7f764affd640 1 -- 172.21.15.12:0/2893587169 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650004040 con 0x5642abac6b40 2024-09-19T06:46:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.721+0000 7f764affd640 1 -- 172.21.15.12:0/2893587169 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7650041040 con 0x5642abac6b40 2024-09-19T06:46:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.721+0000 7f764affd640 1 -- 172.21.15.12:0/2893587169 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650046470 con 0x5642abac6b40 2024-09-19T06:46:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.722+0000 7f7669a0c740 1 -- 172.21.15.12:0/2893587169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 msgr2=0x5642abacb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.722+0000 7f7669a0c740 1 --2- 172.21.15.12:0/2893587169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abacb8e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f765002a930 tx=0x7f765003f040 comp rx=0 tx=0).stop 2024-09-19T06:46:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.722+0000 7f7669a0c740 1 -- 172.21.15.12:0/2893587169 shutdown_connections 2024-09-19T06:46:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.722+0000 7f7669a0c740 1 --2- 172.21.15.12:0/2893587169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abacbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.722+0000 7f7669a0c740 1 --2- 172.21.15.12:0/2893587169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abacb8e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.722+0000 7f7669a0c740 1 --2- 172.21.15.12:0/2893587169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 0x5642abadc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.722+0000 7f7669a0c740 1 -- 172.21.15.12:0/2893587169 >> 172.21.15.12:0/2893587169 conn(0x5642aba8e310 msgr2=0x5642abaccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.722+0000 7f7669a0c740 1 -- 172.21.15.12:0/2893587169 shutdown_connections 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.722+0000 7f7669a0c740 1 -- 172.21.15.12:0/2893587169 wait complete. 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.723+0000 7f7669a0c740 1 -- start start 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.723+0000 7f7669a0c740 1 Processor -- start 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.723+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 0x5642abad8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.724+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abae7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.724+0000 7f7669a0c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abae7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.724+0000 7f7669a0c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f764400fe60 con 0x5642abac6b40 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.724+0000 7f7669a0c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f764400f760 con 0x5642abac55d0 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.724+0000 7f7669a0c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f764400c9a0 con 0x5642abad0370 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.724+0000 7f7669a0c740 10 client.0 _ll_register_callbacks cb 0x7f765c009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:00.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.724+0000 7f76653cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abae7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.724+0000 7f76653cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abae7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52418/0 (socket says 172.21.15.12:52418) 2024-09-19T06:46:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.724+0000 7f76653cf640 1 -- 172.21.15.12:0/3479886484 learned_addr learned my addr 172.21.15.12:0/3479886484 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.724+0000 7f7664bce640 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 0x5642abad8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.725+0000 7f76653cf640 1 -- 172.21.15.12:0/3479886484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 msgr2=0x5642abae7940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:46:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.725+0000 7f76653cf640 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abae7940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.725+0000 7f76653cf640 1 -- 172.21.15.12:0/3479886484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 msgr2=0x5642abad8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.725+0000 7f76653cf640 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 0x5642abad8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.725+0000 7f76653cf640 1 -- 172.21.15.12:0/3479886484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642abae8170 con 0x5642abac6b40 2024-09-19T06:46:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.725+0000 7f76653cf640 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abae7400 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7650055040 tx=0x7f765002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a5509c880b0e1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:00.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.725+0000 7f7648ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:46:00.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.725+0000 7f7648ff9640 1 -- 172.21.15.12:0/3479886484 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76500037f0 con 0x5642abac6b40 2024-09-19T06:46:00.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.725+0000 7f7648ff9640 1 -- 172.21.15.12:0/3479886484 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f7650004000 con 0x5642abac6b40 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.725+0000 7f7669a0c740 1 -- 172.21.15.12:0/3479886484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7650041040 con 0x5642abac6b40 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.726+0000 7f7648ff9640 1 -- 172.21.15.12:0/3479886484 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f765006a050 con 0x5642abac6b40 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.726+0000 7f7669a0c740 10 client.17130 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.726+0000 7f7669a0c740 1 -- 172.21.15.12:0/3479886484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5642abb4abf0 con 0x5642abac6b40 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.726+0000 7f7648ff9640 1 -- 172.21.15.12:0/3479886484 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7650003990 con 0x5642abac6b40 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.726+0000 7f7648ff9640 1 -- 172.21.15.12:0/3479886484 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f7650046ce0 con 0x5642abac6b40 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.727+0000 7f7669a0c740 10 client.17130 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.727+0000 7f7669a0c740 10 client.17130 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.727+0000 7f7669a0c740 20 client.17130 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.727+0000 7f7669a0c740 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5642abadff40 0x5642abb4cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.727+0000 7f7669a0c740 4 client.17130 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:46:00.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.727+0000 7f7669a0c740 1 -- 172.21.15.12:0/3479886484 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7650041040 con 0x5642abadff40 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.727+0000 7f7664bce640 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5642abadff40 0x5642abb4cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.728+0000 7f7664bce640 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5642abadff40 0x5642abb4cdd0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c2cedd122b05835 server_cookie=b482eeb32e01e27 in_seq=0 out_seq=0 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.728+0000 7f7648ff9640 10 client.17130 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7648ff9640 1 -- 172.21.15.12:0/3479886484 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7650041040 con 0x5642abadff40 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7648ff9640 10 client.17130 handle_command_reply: tid=0 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7669a0c740 1 client.17130 shutdown 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7669a0c740 1 -- 172.21.15.12:0/3479886484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 msgr2=0x5642abae7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7669a0c740 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abae7400 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7650055040 tx=0x7f765002a410 comp rx=0 tx=0).stop 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7669a0c740 1 -- 172.21.15.12:0/3479886484 shutdown_connections 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7669a0c740 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5642abadff40 0x5642abb4cdd0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7669a0c740 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5642abad0370 0x5642abae7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7669a0c740 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642abac6b40 0x5642abae7400 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7669a0c740 1 --2- 172.21.15.12:0/3479886484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5642abac55d0 0x5642abad8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7669a0c740 1 -- 172.21.15.12:0/3479886484 >> 172.21.15.12:0/3479886484 conn(0x5642aba8e310 msgr2=0x5642abacb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:00.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.729+0000 7f7648ff9640 0 client.17130 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:46:00.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.730+0000 7f7669a0c740 1 -- 172.21.15.12:0/3479886484 shutdown_connections 2024-09-19T06:46:00.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.730+0000 7f7669a0c740 1 -- 172.21.15.12:0/3479886484 wait complete. 2024-09-19T06:46:00.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.730+0000 7f7669a0c740 20 client.17130 trim_cache size 0 max 16384 2024-09-19T06:46:00.734 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:46:00.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.730+0000 7f7667633640 1 -- 172.21.15.12:0/1421435960 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f764c0a34b0 msgr2=0x7f764c0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.730+0000 7f7667633640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f764c0a34b0 0x7f764c0a5970 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f765809d110 tx=0x7f7658099040 comp rx=0 tx=0).stop 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.730+0000 7f7667633640 1 -- 172.21.15.12:0/1421435960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660102ef0 msgr2=0x7f766006e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.730+0000 7f7667633640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660102ef0 0x7f766006e100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f765801ad50 tx=0x7f765801b6d0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.731+0000 7f7667633640 1 -- 172.21.15.12:0/1421435960 shutdown_connections 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.731+0000 7f7667633640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7660102ef0 0x7f766006e100 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.731+0000 7f7667633640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7660102570 0x7f766006dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.731+0000 7f7667633640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f764c0a34b0 0x7f764c0a5970 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.731+0000 7f7667633640 1 --2- 172.21.15.12:0/1421435960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7660100e20 0x7f7660073b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.731+0000 7f7667633640 1 -- 172.21.15.12:0/1421435960 >> 172.21.15.12:0/1421435960 conn(0x7f76600fc7d0 msgr2=0x7f7660104840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.731+0000 7f7667633640 1 -- 172.21.15.12:0/1421435960 shutdown_connections 2024-09-19T06:46:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:00.732+0000 7f7667633640 1 -- 172.21.15.12:0/1421435960 wait complete. 2024-09-19T06:46:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 315.0 s, 3886.0 tps, lat 25.686 ms stddev 28.736 2024-09-19T06:46:01.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.171+0000 7f4facf11640 1 -- 172.21.15.12:0/593304321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fa81125a0 msgr2=0x7f4fa8112980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.171+0000 7f4facf11640 1 --2- 172.21.15.12:0/593304321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fa81125a0 0x7f4fa8112980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009930 tx=0x7f4f9802a420 comp rx=0 tx=0).stop 2024-09-19T06:46:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.171+0000 7f4facf11640 1 -- 172.21.15.12:0/593304321 shutdown_connections 2024-09-19T06:46:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.171+0000 7f4facf11640 1 --2- 172.21.15.12:0/593304321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fa810ce80 0x7f4fa8119360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.171+0000 7f4facf11640 1 --2- 172.21.15.12:0/593304321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa810c4e0 0x7f4fa810c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.171+0000 7f4facf11640 1 --2- 172.21.15.12:0/593304321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fa81125a0 0x7f4fa8112980 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.171+0000 7f4facf11640 1 -- 172.21.15.12:0/593304321 >> 172.21.15.12:0/593304321 conn(0x7f4fa806c850 msgr2=0x7f4fa806cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.171+0000 7f4facf11640 1 -- 172.21.15.12:0/593304321 shutdown_connections 2024-09-19T06:46:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.171+0000 7f4facf11640 1 -- 172.21.15.12:0/593304321 wait complete. 2024-09-19T06:46:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.172+0000 7f4facf11640 1 Processor -- start 2024-09-19T06:46:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.172+0000 7f4facf11640 1 -- start start 2024-09-19T06:46:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.172+0000 7f4facf11640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa810c4e0 0x7f4fa81a8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.172+0000 7f4facf11640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fa810ce80 0x7f4fa81a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.172+0000 7f4facf11640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fa81125a0 0x7f4fa81a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.172+0000 7f4facf11640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa811c890 con 0x7f4fa810c4e0 2024-09-19T06:46:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.172+0000 7f4facf11640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa811c710 con 0x7f4fa81125a0 2024-09-19T06:46:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.172+0000 7f4facf11640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa811ca10 con 0x7f4fa810ce80 2024-09-19T06:46:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fa81125a0 0x7f4fa81a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa810c4e0 0x7f4fa81a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fa81125a0 0x7f4fa81a2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43526/0 (socket says 172.21.15.12:43526) 2024-09-19T06:46:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa6d9d640 1 -- 172.21.15.12:0/2255793941 learned_addr learned my addr 172.21.15.12:0/2255793941 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa810c4e0 0x7f4fa81a8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52438/0 (socket says 172.21.15.12:52438) 2024-09-19T06:46:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fa810ce80 0x7f4fa81a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa6d9d640 1 -- 172.21.15.12:0/2255793941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fa810ce80 msgr2=0x7f4fa81a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa6d9d640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fa810ce80 0x7f4fa81a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa6d9d640 1 -- 172.21.15.12:0/2255793941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa810c4e0 msgr2=0x7f4fa81a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa6d9d640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa810c4e0 0x7f4fa81a8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa6d9d640 1 -- 172.21.15.12:0/2255793941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa81a3280 con 0x7f4fa81125a0 2024-09-19T06:46:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fa810ce80 0x7f4fa81a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4fa6d9d640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fa81125a0 0x7f4fa81a2b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000eb10 tx=0x7f4fa000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.173+0000 7f4f977fe640 1 -- 172.21.15.12:0/2255793941 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0004b20 con 0x7f4fa81125a0 2024-09-19T06:46:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.174+0000 7f4facf11640 1 -- 172.21.15.12:0/2255793941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa81a3570 con 0x7f4fa81125a0 2024-09-19T06:46:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.174+0000 7f4f977fe640 1 -- 172.21.15.12:0/2255793941 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fa0004cc0 con 0x7f4fa81125a0 2024-09-19T06:46:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.174+0000 7f4f977fe640 1 -- 172.21.15.12:0/2255793941 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0010760 con 0x7f4fa81125a0 2024-09-19T06:46:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.174+0000 7f4facf11640 1 -- 172.21.15.12:0/2255793941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa81af810 con 0x7f4fa81125a0 2024-09-19T06:46:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.176+0000 7f4f977fe640 1 -- 172.21.15.12:0/2255793941 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4fa0005020 con 0x7f4fa81125a0 2024-09-19T06:46:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.176+0000 7f4fafca8740 1 Processor -- start 2024-09-19T06:46:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fafca8740 1 -- start start 2024-09-19T06:46:01.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea5387770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea538a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4f977fe640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4f900a34e0 0x7f4f900a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fafca8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557ea52e12f0 con 0x557ea537caf0 2024-09-19T06:46:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fafca8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557ea5289270 con 0x557ea5387cb0 2024-09-19T06:46:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fafca8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557ea52dd2b0 con 0x557ea537d410 2024-09-19T06:46:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fa659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea5387770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52442/0 (socket says 172.21.15.12:52442) 2024-09-19T06:46:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/1914583371 learned_addr learned my addr 172.21.15.12:0/1914583371 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/1914583371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea538a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4fa6d9d640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4f900a34e0 0x7f4f900a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.177+0000 7f4f977fe640 1 -- 172.21.15.12:0/2255793941 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4fa00d03c0 con 0x7f4fa81125a0 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.178+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/1914583371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 msgr2=0x557ea5387770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.178+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/1914583371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea5387770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.178+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/1914583371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 msgr2=0x557ea538a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.178+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/1914583371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea538a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.178+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/1914583371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ea5288340 con 0x557ea537caf0 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.178+0000 7f4fa6d9d640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4f900a34e0 0x7f4f900a59a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00cdb40 tx=0x7f4fa000efd0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.178+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/1914583371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537ced0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c011bb0 tx=0x7f4f9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d017439a8e550019 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.178+0000 7f4f94ff9640 1 -- 172.21.15.12:0/1914583371 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00fc50 con 0x557ea537caf0 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.178+0000 7f4f94ff9640 1 -- 172.21.15.12:0/1914583371 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f9c00fdf0 con 0x557ea537caf0 2024-09-19T06:46:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.178+0000 7f4f94ff9640 1 -- 172.21.15.12:0/1914583371 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c003ac0 con 0x557ea537caf0 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.179+0000 7f4fafca8740 1 -- 172.21.15.12:0/1914583371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 msgr2=0x557ea537ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.179+0000 7f4fafca8740 1 --2- 172.21.15.12:0/1914583371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537ced0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c011bb0 tx=0x7f4f9c009b50 comp rx=0 tx=0).stop 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.179+0000 7f4fafca8740 1 -- 172.21.15.12:0/1914583371 shutdown_connections 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.179+0000 7f4fafca8740 1 --2- 172.21.15.12:0/1914583371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea538a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.179+0000 7f4fafca8740 1 --2- 172.21.15.12:0/1914583371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea5387770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.179+0000 7f4fafca8740 1 --2- 172.21.15.12:0/1914583371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537ced0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.179+0000 7f4fafca8740 1 -- 172.21.15.12:0/1914583371 >> 172.21.15.12:0/1914583371 conn(0x557ea5379060 msgr2=0x557ea5379440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.179+0000 7f4fafca8740 1 -- 172.21.15.12:0/1914583371 shutdown_connections 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.179+0000 7f4fafca8740 1 -- 172.21.15.12:0/1914583371 wait complete. 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fafca8740 1 -- start start 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fafca8740 1 Processor -- start 2024-09-19T06:46:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea5384b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea53850a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea53855e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fafca8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557ea538a880 con 0x557ea537caf0 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fafca8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557ea526a290 con 0x557ea5387cb0 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fafca8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557ea538aa00 con 0x557ea537d410 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea5384b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fafca8740 10 client.0 _ll_register_callbacks cb 0x557ea529b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea5384b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52446/0 (socket says 172.21.15.12:52446) 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/2438856865 learned_addr learned my addr 172.21.15.12:0/2438856865 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fa659c640 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea53850a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.180+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea53855e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4fa659c640 1 -- 172.21.15.12:0/2438856865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 msgr2=0x557ea53855e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4fa659c640 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea53855e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4fa659c640 1 -- 172.21.15.12:0/2438856865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 msgr2=0x557ea5384b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4fa659c640 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea5384b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4fa659c640 1 -- 172.21.15.12:0/2438856865 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ea4ff4210 con 0x557ea537d410 2024-09-19T06:46:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea5384b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4fa659c640 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea53850a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f98005940 tx=0x7f4f980317e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63b5e1966504a5e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:46:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2438856865 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98035040 con 0x557ea537d410 2024-09-19T06:46:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2438856865 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4f98004240 con 0x557ea537d410 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4fafca8740 1 -- 172.21.15.12:0/2438856865 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f9c00fdf0 con 0x557ea537d410 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2438856865 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f4f98004440 con 0x557ea537d410 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4fafca8740 10 client.26584 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4fafca8740 1 -- 172.21.15.12:0/2438856865 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557ea50c0620 con 0x557ea537d410 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.181+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2438856865 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f9c00fdf0 con 0x557ea537d410 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.182+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2438856865 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f4f98004bb0 con 0x557ea537d410 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.182+0000 7f4fafca8740 10 client.26584 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.182+0000 7f4fafca8740 10 client.26584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.182+0000 7f4fafca8740 20 client.26584 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.182+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557ea5397c10 0x557ea539a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.182+0000 7f4fafca8740 4 client.26584 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.182+0000 7f4fafca8740 1 -- 172.21.15.12:0/2438856865 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ea52eea20 con 0x557ea5397c10 2024-09-19T06:46:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.182+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557ea5397c10 0x557ea539a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557ea5397c10 0x557ea539a040 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce4275a8216e5e9f server_cookie=5fa2b9e5ea2bd72e in_seq=0 out_seq=0 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4f8dffb640 10 client.26584 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2438856865 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ea52eea20 con 0x557ea5397c10 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4f8dffb640 10 client.26584 handle_command_reply: tid=0 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 client.26584 shutdown 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 -- 172.21.15.12:0/2438856865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 msgr2=0x557ea53850a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea53850a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f98005940 tx=0x7f4f980317e0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 -- 172.21.15.12:0/2438856865 shutdown_connections 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557ea5397c10 0x557ea539a040 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea53855e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea53850a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2438856865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea5384b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4f8dffb640 0 client.26584 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 -- 172.21.15.12:0/2438856865 >> 172.21.15.12:0/2438856865 conn(0x557ea5379060 msgr2=0x557ea537ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 -- 172.21.15.12:0/2438856865 shutdown_connections 2024-09-19T06:46:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.183+0000 7f4fafca8740 1 -- 172.21.15.12:0/2438856865 wait complete. 2024-09-19T06:46:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.184+0000 7f4fafca8740 20 client.26584 trim_cache size 0 max 16384 2024-09-19T06:46:01.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fafca8740 1 Processor -- start 2024-09-19T06:46:01.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fafca8740 1 -- start start 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea5385410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea539f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fafca8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81b8450 con 0x557ea537caf0 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fafca8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81ba080 con 0x557ea5387cb0 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fafca8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81b8b20 con 0x557ea537d410 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52458/0 (socket says 172.21.15.12:52458) 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/4244837298 learned_addr learned my addr 172.21.15.12:0/4244837298 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa659c640 1 --2- 172.21.15.12:0/4244837298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea5385410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/4244837298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea539f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/4244837298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 msgr2=0x557ea5385410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/4244837298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea5385410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/4244837298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 msgr2=0x557ea539f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/4244837298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea539f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/4244837298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ea5378e90 con 0x557ea537caf0 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.198+0000 7f4fa659c640 1 --2- 172.21.15.12:0/4244837298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea5385410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/4244837298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537f560 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009cc0 tx=0x7f4f9c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d758d68835794a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4f8ffff640 1 -- 172.21.15.12:0/4244837298 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00fd90 con 0x557ea537caf0 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4f8ffff640 1 -- 172.21.15.12:0/4244837298 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f9c003790 con 0x557ea537caf0 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4f8ffff640 1 -- 172.21.15.12:0/4244837298 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0303d0 con 0x557ea537caf0 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4fafca8740 1 -- 172.21.15.12:0/4244837298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 msgr2=0x557ea537f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4fafca8740 1 --2- 172.21.15.12:0/4244837298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537f560 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009cc0 tx=0x7f4f9c005fd0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4fafca8740 1 -- 172.21.15.12:0/4244837298 shutdown_connections 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4fafca8740 1 --2- 172.21.15.12:0/4244837298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea5387cb0 0x557ea539f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4fafca8740 1 --2- 172.21.15.12:0/4244837298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537d410 0x557ea5385410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4fafca8740 1 --2- 172.21.15.12:0/4244837298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea537caf0 0x557ea537f560 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4fafca8740 1 -- 172.21.15.12:0/4244837298 >> 172.21.15.12:0/4244837298 conn(0x557ea5379060 msgr2=0x557ea5386be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4fafca8740 1 -- 172.21.15.12:0/4244837298 shutdown_connections 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.199+0000 7f4fafca8740 1 -- 172.21.15.12:0/4244837298 wait complete. 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fafca8740 1 -- start start 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fafca8740 1 Processor -- start 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537caf0 0x557ea5390140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea537d410 0x557ea538b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fafca8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea5387cb0 0x557ea538b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fafca8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81b98f0 con 0x557ea5387cb0 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fafca8740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81b91f0 con 0x557ea537d410 2024-09-19T06:46:01.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fafca8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81b6430 con 0x557ea537caf0 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fafca8740 10 client.0 _ll_register_callbacks cb 0x7f4f98009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea5387cb0 0x557ea538b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fa5d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea5387cb0 0x557ea538b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52468/0 (socket says 172.21.15.12:52468) 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/2573464923 learned_addr learned my addr 172.21.15.12:0/2573464923 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fa659c640 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea537d410 0x557ea538b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537caf0 0x557ea5390140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/2573464923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537caf0 msgr2=0x557ea5390140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537caf0 0x557ea5390140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/2573464923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea537d410 msgr2=0x557ea538b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.200+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea537d410 0x557ea538b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fa5d9b640 1 -- 172.21.15.12:0/2573464923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ea537a110 con 0x557ea5387cb0 2024-09-19T06:46:01.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fa659c640 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea537d410 0x557ea538b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fa5d9b640 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea5387cb0 0x557ea538b9a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00fc20 tx=0x7f4f9c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4626e1d82d0b9d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2573464923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0053e0 con 0x557ea5387cb0 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2573464923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4f9c019070 con 0x557ea5387cb0 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fafca8740 1 -- 172.21.15.12:0/2573464923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f9c003790 con 0x557ea5387cb0 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2573464923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f4f9c003940 con 0x557ea5387cb0 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fafca8740 10 client.17148 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fafca8740 1 -- 172.21.15.12:0/2573464923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557ea5402490 con 0x557ea5387cb0 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2573464923 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f9c003790 con 0x557ea5387cb0 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2573464923 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f4f9c03b040 con 0x557ea5387cb0 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fafca8740 10 client.17148 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fafca8740 10 client.17148 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fafca8740 20 client.17148 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:01.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557ea54029f0 0x557ea5404e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.201+0000 7f4fafca8740 4 client.17148 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:46:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.202+0000 7f4fafca8740 1 -- 172.21.15.12:0/2573464923 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557ea52e8d70 con 0x557ea54029f0 2024-09-19T06:46:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.202+0000 7f4fa659c640 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557ea54029f0 0x557ea5404e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.202+0000 7f4fa659c640 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557ea54029f0 0x557ea5404e10 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f7f508f410719f1 server_cookie=92f2bcdcb0d1cf83 in_seq=0 out_seq=0 2024-09-19T06:46:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.202+0000 7f4f8dffb640 10 client.17148 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.214+0000 7f4f8dffb640 1 -- 172.21.15.12:0/2573464923 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557ea52e8d70 con 0x557ea54029f0 2024-09-19T06:46:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.214+0000 7f4f8dffb640 10 client.17148 handle_command_reply: tid=0 2024-09-19T06:46:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.214+0000 7f4fafca8740 1 client.17148 shutdown 2024-09-19T06:46:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 1 -- 172.21.15.12:0/2573464923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea5387cb0 msgr2=0x557ea538b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea5387cb0 0x557ea538b9a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00fc20 tx=0x7f4f9c005040 comp rx=0 tx=0).stop 2024-09-19T06:46:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 1 -- 172.21.15.12:0/2573464923 shutdown_connections 2024-09-19T06:46:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557ea54029f0 0x557ea5404e10 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557ea5387cb0 0x557ea538b9a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557ea537d410 0x557ea538b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4f8dffb640 0 client.17148 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 1 --2- 172.21.15.12:0/2573464923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557ea537caf0 0x557ea5390140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 1 -- 172.21.15.12:0/2573464923 >> 172.21.15.12:0/2573464923 conn(0x557ea5379060 msgr2=0x557ea53779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 1 -- 172.21.15.12:0/2573464923 shutdown_connections 2024-09-19T06:46:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 1 -- 172.21.15.12:0/2573464923 wait complete. 2024-09-19T06:46:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4fafca8740 20 client.17148 trim_cache size 0 max 16384 2024-09-19T06:46:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:46:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:46:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:46:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:46:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4facf11640 1 -- 172.21.15.12:0/2255793941 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4f900a34e0 msgr2=0x7f4f900a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4facf11640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4f900a34e0 0x7f4f900a59a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00cdb40 tx=0x7f4fa000efd0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4facf11640 1 -- 172.21.15.12:0/2255793941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fa81125a0 msgr2=0x7f4fa81a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.215+0000 7f4facf11640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fa81125a0 0x7f4fa81a2b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000eb10 tx=0x7f4fa000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.216+0000 7f4facf11640 1 -- 172.21.15.12:0/2255793941 shutdown_connections 2024-09-19T06:46:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.216+0000 7f4facf11640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fa81125a0 0x7f4fa81a2b00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.216+0000 7f4facf11640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4f900a34e0 0x7f4f900a59a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.216+0000 7f4facf11640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fa810ce80 0x7f4fa81a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.216+0000 7f4facf11640 1 --2- 172.21.15.12:0/2255793941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa810c4e0 0x7f4fa81a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:01.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.216+0000 7f4facf11640 1 -- 172.21.15.12:0/2255793941 >> 172.21.15.12:0/2255793941 conn(0x7f4fa806c850 msgr2=0x7f4fa810ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:01.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.216+0000 7f4facf11640 1 -- 172.21.15.12:0/2255793941 shutdown_connections 2024-09-19T06:46:01.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:01.216+0000 7f4facf11640 1 -- 172.21.15.12:0/2255793941 wait complete. 2024-09-19T06:46:01.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:46:01.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:01 smithi016 ceph-mon[34911]: pgmap v179: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2024-09-19T06:46:01.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:01 smithi173 ceph-mon[35349]: pgmap v179: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2024-09-19T06:46:01.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:01 smithi012 ceph-mon[30937]: pgmap v179: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2024-09-19T06:46:01.987 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:03.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.784+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/2479168915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d881036c0 msgr2=0x7f0d8810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.784+0000 7f0d8ef1e640 1 --2- 172.21.15.12:0/2479168915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d881036c0 0x7f0d8810bbb0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009900 tx=0x7f0d7402a480 comp rx=0 tx=0).stop 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.784+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/2479168915 shutdown_connections 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.784+0000 7f0d8ef1e640 1 --2- 172.21.15.12:0/2479168915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d8810c180 0x7f0d8810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.784+0000 7f0d8ef1e640 1 --2- 172.21.15.12:0/2479168915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d881036c0 0x7f0d8810bbb0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.784+0000 7f0d8ef1e640 1 --2- 172.21.15.12:0/2479168915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d88102da0 0x7f0d88103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.784+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/2479168915 >> 172.21.15.12:0/2479168915 conn(0x7f0d880fc7a0 msgr2=0x7f0d880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.784+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/2479168915 shutdown_connections 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.784+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/2479168915 wait complete. 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ef1e640 1 Processor -- start 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ef1e640 1 -- start start 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ef1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d88102da0 0x7f0d88198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ef1e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d881036c0 0x7f0d88198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ef1e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d8810c180 0x7f0d8819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ef1e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0d88111f60 con 0x7f0d88102da0 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ef1e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d88111de0 con 0x7f0d8810c180 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ef1e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0d881120e0 con 0x7f0d881036c0 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ccba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d88102da0 0x7f0d88198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ccba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d88102da0 0x7f0d88198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52488/0 (socket says 172.21.15.12:52488) 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ccba640 1 -- 172.21.15.12:0/3136198258 learned_addr learned my addr 172.21.15.12:0/3136198258 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d881036c0 0x7f0d88198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8d4bb640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d8810c180 0x7f0d8819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ccba640 1 -- 172.21.15.12:0/3136198258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d881036c0 msgr2=0x7f0d88198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d881036c0 0x7f0d88198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ccba640 1 -- 172.21.15.12:0/3136198258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d8810c180 msgr2=0x7f0d8819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.785+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d8810c180 0x7f0d8819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.786+0000 7f0d8ccba640 1 -- 172.21.15.12:0/3136198258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8819d3e0 con 0x7f0d88102da0 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.786+0000 7f0d87fff640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d881036c0 0x7f0d88198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.786+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d88102da0 0x7f0d88198430 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00e9f0 tx=0x7f0d7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.786+0000 7f0d85ffb640 1 -- 172.21.15.12:0/3136198258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00cd80 con 0x7f0d88102da0 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.786+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/3136198258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8819d6d0 con 0x7f0d88102da0 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.786+0000 7f0d85ffb640 1 -- 172.21.15.12:0/3136198258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d7c010910 con 0x7f0d88102da0 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.786+0000 7f0d85ffb640 1 -- 172.21.15.12:0/3136198258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0188f0 con 0x7f0d88102da0 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.786+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/3136198258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d881a4fb0 con 0x7f0d88102da0 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d85ffb640 1 -- 172.21.15.12:0/3136198258 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0d7c010ac0 con 0x7f0d88102da0 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d912f7740 1 Processor -- start 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d912f7740 1 -- start start 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59116b40 0x55ec59115090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec591155d0 0x55ec59115a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec59120370 0x55ec59122760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d912f7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ec5907b2f0 con 0x55ec59116b40 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d912f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ec59022cf0 con 0x55ec59120370 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d912f7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ec590772b0 con 0x55ec591155d0 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d85ffb640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d780a33b0 0x7f0d780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec59120370 0x55ec59122760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d8d4bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59116b40 0x55ec59115090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d8ccba640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec591155d0 0x55ec59115a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec59120370 0x55ec59122760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43584/0 (socket says 172.21.15.12:43584) 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d87fff640 1 -- 172.21.15.12:0/1308961398 learned_addr learned my addr 172.21.15.12:0/1308961398 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.789+0000 7f0d8d4bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59116b40 0x55ec59115090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52490/0 (socket says 172.21.15.12:52490) 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d8d4bb640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d780a33b0 0x7f0d780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d85ffb640 1 -- 172.21.15.12:0/3136198258 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0d7c0d0130 con 0x7f0d88102da0 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d8ccba640 1 -- 172.21.15.12:0/1308961398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec59120370 msgr2=0x55ec59122760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:03.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/1308961398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec59120370 0x55ec59122760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d8ccba640 1 -- 172.21.15.12:0/1308961398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59116b40 msgr2=0x55ec59115090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/1308961398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59116b40 0x55ec59115090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d8ccba640 1 -- 172.21.15.12:0/1308961398 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec590073a0 con 0x55ec591155d0 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d87fff640 1 --2- 172.21.15.12:0/1308961398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec59120370 0x55ec59122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/1308961398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec591155d0 0x55ec59115a10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0cd800 tx=0x7f0d7c06f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56a5e0d06dff0d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d8d4bb640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d780a33b0 0x7f0d780a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d80005fd0 tx=0x7f0d80009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d72ffd640 1 -- 172.21.15.12:0/1308961398 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0a5000 con 0x55ec591155d0 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d72ffd640 1 -- 172.21.15.12:0/1308961398 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d7c0670a0 con 0x55ec591155d0 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.790+0000 7f0d72ffd640 1 -- 172.21.15.12:0/1308961398 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c098190 con 0x55ec591155d0 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.791+0000 7f0d912f7740 1 -- 172.21.15.12:0/1308961398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec591155d0 msgr2=0x55ec59115a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.791+0000 7f0d912f7740 1 --2- 172.21.15.12:0/1308961398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec591155d0 0x55ec59115a10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0cd800 tx=0x7f0d7c06f330 comp rx=0 tx=0).stop 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.791+0000 7f0d912f7740 1 -- 172.21.15.12:0/1308961398 shutdown_connections 2024-09-19T06:46:03.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.791+0000 7f0d912f7740 1 --2- 172.21.15.12:0/1308961398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec59120370 0x55ec59122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.791+0000 7f0d912f7740 1 --2- 172.21.15.12:0/1308961398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec591155d0 0x55ec59115a10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.791+0000 7f0d912f7740 1 --2- 172.21.15.12:0/1308961398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59116b40 0x55ec59115090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.791+0000 7f0d912f7740 1 -- 172.21.15.12:0/1308961398 >> 172.21.15.12:0/1308961398 conn(0x55ec590de310 msgr2=0x55ec59111c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.791+0000 7f0d912f7740 1 -- 172.21.15.12:0/1308961398 shutdown_connections 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.791+0000 7f0d912f7740 1 -- 172.21.15.12:0/1308961398 wait complete. 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d912f7740 1 -- start start 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d912f7740 1 Processor -- start 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec5911fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec5911d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec5911d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d912f7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ec59123010 con 0x55ec59120370 2024-09-19T06:46:03.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d912f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ec59036060 con 0x55ec591155d0 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d912f7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ec59123190 con 0x55ec59116b40 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d912f7740 10 client.0 _ll_register_callbacks cb 0x55ec58d898c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d8d4bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec5911d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec5911d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d8ccba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec5911fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d8d4bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec5911d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52500/0 (socket says 172.21.15.12:52500) 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d8d4bb640 1 -- 172.21.15.12:0/640329410 learned_addr learned my addr 172.21.15.12:0/640329410 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.792+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec5911d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48324/0 (socket says 172.21.15.12:48324) 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d8ccba640 1 -- 172.21.15.12:0/640329410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 msgr2=0x55ec5911d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec5911d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d8ccba640 1 -- 172.21.15.12:0/640329410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 msgr2=0x55ec5911d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec5911d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d8ccba640 1 -- 172.21.15.12:0/640329410 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec58dec3c0 con 0x55ec591155d0 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d8d4bb640 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec5911d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec5911fdb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c6a0 tx=0x7f0d7c0cdcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdbc9d52dd0ac966 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d67fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d67fff640 1 -- 172.21.15.12:0/640329410 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0a5000 con 0x55ec591155d0 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d67fff640 1 -- 172.21.15.12:0/640329410 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0d7c09bb10 con 0x55ec591155d0 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d912f7740 1 -- 172.21.15.12:0/640329410 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d7c0670a0 con 0x55ec591155d0 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d67fff640 1 -- 172.21.15.12:0/640329410 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0d7c0b5330 con 0x55ec591155d0 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d912f7740 10 client.26654 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d912f7740 1 -- 172.21.15.12:0/640329410 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ec5912eb00 con 0x55ec591155d0 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.793+0000 7f0d67fff640 1 -- 172.21.15.12:0/640329410 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d7c0670a0 con 0x55ec591155d0 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.794+0000 7f0d67fff640 1 -- 172.21.15.12:0/640329410 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f0d7c09b300 con 0x55ec591155d0 2024-09-19T06:46:03.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.794+0000 7f0d912f7740 10 client.26654 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.794+0000 7f0d912f7740 10 client.26654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.794+0000 7f0d912f7740 20 client.26654 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.794+0000 7f0d912f7740 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ec5912fe50 0x55ec59132240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.794+0000 7f0d912f7740 4 client.26654 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.794+0000 7f0d912f7740 1 -- 172.21.15.12:0/640329410 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec59088860 con 0x55ec5912fe50 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.794+0000 7f0d87fff640 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ec5912fe50 0x55ec59132240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.794+0000 7f0d87fff640 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ec5912fe50 0x55ec59132240 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=142a26dd6612eadd server_cookie=19d185012da09312 in_seq=0 out_seq=0 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.794+0000 7f0d67fff640 10 client.26654 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d67fff640 1 -- 172.21.15.12:0/640329410 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec59088860 con 0x55ec5912fe50 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d67fff640 10 client.26654 handle_command_reply: tid=0 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 client.26654 shutdown 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 -- 172.21.15.12:0/640329410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 msgr2=0x55ec5911fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec5911fdb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c6a0 tx=0x7f0d7c0cdcf0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 -- 172.21.15.12:0/640329410 shutdown_connections 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ec5912fe50 0x55ec59132240 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d67fff640 0 client.26654 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec5911d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec5911d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 --2- 172.21.15.12:0/640329410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec5911fdb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 -- 172.21.15.12:0/640329410 >> 172.21.15.12:0/640329410 conn(0x55ec590de310 msgr2=0x55ec59117960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 -- 172.21.15.12:0/640329410 shutdown_connections 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.795+0000 7f0d912f7740 1 -- 172.21.15.12:0/640329410 wait complete. 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.796+0000 7f0d912f7740 20 client.26654 trim_cache size 0 max 16384 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.811+0000 7f0d912f7740 1 Processor -- start 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.811+0000 7f0d912f7740 1 -- start start 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.811+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec59111e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.811+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec591377e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.811+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec59137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.811+0000 7f0d912f7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0d881ab850 con 0x55ec59120370 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.811+0000 7f0d912f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d881ad480 con 0x55ec591155d0 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.811+0000 7f0d912f7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0d881abf20 con 0x55ec59116b40 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.812+0000 7f0d8ccba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec59111e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.812+0000 7f0d8ccba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec59111e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43596/0 (socket says 172.21.15.12:43596) 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.812+0000 7f0d8ccba640 1 -- 172.21.15.12:0/3383427106 learned_addr learned my addr 172.21.15.12:0/3383427106 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.812+0000 7f0d87fff640 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec591377e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.812+0000 7f0d8ccba640 1 -- 172.21.15.12:0/3383427106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 msgr2=0x55ec591377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.812+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec591377e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.813+0000 7f0d8d4bb640 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec59137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.813+0000 7f0d8ccba640 1 -- 172.21.15.12:0/3383427106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 msgr2=0x55ec59137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.813+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec59137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.813+0000 7f0d8ccba640 1 -- 172.21.15.12:0/3383427106 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec5911db60 con 0x55ec591155d0 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.813+0000 7f0d87fff640 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec591377e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.813+0000 7f0d8d4bb640 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec59137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.813+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec59111e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c09c140 tx=0x7f0d7c09b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6efa23159443decb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.813+0000 7f0d727fc640 1 -- 172.21.15.12:0/3383427106 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0a5000 con 0x55ec591155d0 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.813+0000 7f0d727fc640 1 -- 172.21.15.12:0/3383427106 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d7c067020 con 0x55ec591155d0 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.813+0000 7f0d727fc640 1 -- 172.21.15.12:0/3383427106 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c098500 con 0x55ec591155d0 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.815+0000 7f0d912f7740 1 -- 172.21.15.12:0/3383427106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 msgr2=0x55ec59111e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.815+0000 7f0d912f7740 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec59111e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c09c140 tx=0x7f0d7c09b890 comp rx=0 tx=0).stop 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.816+0000 7f0d912f7740 1 -- 172.21.15.12:0/3383427106 shutdown_connections 2024-09-19T06:46:03.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.816+0000 7f0d912f7740 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec59137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.816+0000 7f0d912f7740 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec591377e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.816+0000 7f0d912f7740 1 --2- 172.21.15.12:0/3383427106 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec59111e10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.816+0000 7f0d912f7740 1 -- 172.21.15.12:0/3383427106 >> 172.21.15.12:0/3383427106 conn(0x55ec590de310 msgr2=0x55ec59111700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.816+0000 7f0d912f7740 1 -- 172.21.15.12:0/3383427106 shutdown_connections 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.816+0000 7f0d912f7740 1 -- 172.21.15.12:0/3383427106 wait complete. 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.817+0000 7f0d912f7740 1 -- start start 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.817+0000 7f0d912f7740 1 Processor -- start 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.818+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec59128c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.818+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec59123f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.818+0000 7f0d912f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec591244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.818+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec59123f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.818+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec59123f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48348/0 (socket says 172.21.15.12:48348) 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.818+0000 7f0d87fff640 1 -- 172.21.15.12:0/3285902424 learned_addr learned my addr 172.21.15.12:0/3285902424 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.819+0000 7f0d8d4bb640 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec591244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.819+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec59128c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.819+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0d881accf0 con 0x55ec59120370 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.819+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d881ac5f0 con 0x55ec591155d0 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.819+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0d881a9830 con 0x55ec59116b40 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.819+0000 7f0d912f7740 10 client.0 _ll_register_callbacks cb 0x7f0d7c0cdf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.820+0000 7f0d8d4bb640 1 -- 172.21.15.12:0/3285902424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 msgr2=0x55ec59123f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.820+0000 7f0d8d4bb640 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec59123f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.820+0000 7f0d8d4bb640 1 -- 172.21.15.12:0/3285902424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 msgr2=0x55ec59128c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.820+0000 7f0d8d4bb640 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec59128c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.820+0000 7f0d8d4bb640 1 -- 172.21.15.12:0/3285902424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec59124d00 con 0x55ec59120370 2024-09-19T06:46:03.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.820+0000 7f0d87fff640 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec59123f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.820+0000 7f0d8d4bb640 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec591244d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000e7e0 tx=0x7f0d80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9381be98083fd4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.821+0000 7f0d67fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.827+0000 7f0d67fff640 1 -- 172.21.15.12:0/3285902424 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80036070 con 0x55ec59120370 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.827+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d7c067020 con 0x55ec59120370 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.827+0000 7f0d67fff640 1 -- 172.21.15.12:0/3285902424 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0d80026e00 con 0x55ec59120370 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.827+0000 7f0d67fff640 1 -- 172.21.15.12:0/3285902424 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0d80041050 con 0x55ec59120370 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.828+0000 7f0d912f7740 10 client.17163 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.828+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ec5919a820 con 0x55ec59120370 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.830+0000 7f0d67fff640 1 -- 172.21.15.12:0/3285902424 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d80032630 con 0x55ec59120370 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.830+0000 7f0d67fff640 1 -- 172.21.15.12:0/3285902424 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f0d8002f070 con 0x55ec59120370 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.830+0000 7f0d912f7740 10 client.17163 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.830+0000 7f0d912f7740 10 client.17163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.830+0000 7f0d912f7740 20 client.17163 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:03.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.830+0000 7f0d912f7740 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ec5912fe50 0x55ec5919d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:03.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.830+0000 7f0d912f7740 4 client.17163 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:46:03.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.830+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0d7c067020 con 0x55ec5912fe50 2024-09-19T06:46:03.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.835+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ec5912fe50 0x55ec5919d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:03.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.839+0000 7f0d8ccba640 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ec5912fe50 0x55ec5919d080 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7394d8a2941c734 server_cookie=4fe746da721da338 in_seq=0 out_seq=0 2024-09-19T06:46:03.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.839+0000 7f0d67fff640 10 client.17163 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:03.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d67fff640 1 -- 172.21.15.12:0/3285902424 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0d7c067020 con 0x55ec5912fe50 2024-09-19T06:46:03.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d67fff640 10 client.17163 handle_command_reply: tid=0 2024-09-19T06:46:03.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d912f7740 1 client.17163 shutdown 2024-09-19T06:46:03.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 msgr2=0x55ec591244d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d912f7740 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec591244d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000e7e0 tx=0x7f0d80004a40 comp rx=0 tx=0).stop 2024-09-19T06:46:03.018 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:46:03.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 shutdown_connections 2024-09-19T06:46:03.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d912f7740 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ec5912fe50 0x55ec5919d080 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d912f7740 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec59120370 0x55ec591244d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d912f7740 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ec59116b40 0x55ec59123f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d912f7740 1 --2- 172.21.15.12:0/3285902424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ec591155d0 0x55ec59128c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.840+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 >> 172.21.15.12:0/3285902424 conn(0x55ec590de310 msgr2=0x55ec59117930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:03.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.841+0000 7f0d67fff640 0 client.17163 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.843+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 shutdown_connections 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.843+0000 7f0d912f7740 1 -- 172.21.15.12:0/3285902424 wait complete. 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.846+0000 7f0d912f7740 20 client.17163 trim_cache size 0 max 16384 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.849+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/3136198258 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d780a33b0 msgr2=0x7f0d780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.849+0000 7f0d8ef1e640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d780a33b0 0x7f0d780a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d80005fd0 tx=0x7f0d80009500 comp rx=0 tx=0).stop 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.849+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/3136198258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d88102da0 msgr2=0x7f0d88198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.849+0000 7f0d8ef1e640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d88102da0 0x7f0d88198430 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00e9f0 tx=0x7f0d7c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.849+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/3136198258 shutdown_connections 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.849+0000 7f0d8ef1e640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d8810c180 0x7f0d8819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.849+0000 7f0d8ef1e640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0d780a33b0 0x7f0d780a5870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.849+0000 7f0d8ef1e640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d881036c0 0x7f0d88198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.849+0000 7f0d8ef1e640 1 --2- 172.21.15.12:0/3136198258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d88102da0 0x7f0d88198430 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.849+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/3136198258 >> 172.21.15.12:0/3136198258 conn(0x7f0d880fc7a0 msgr2=0x7f0d880fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:03.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.850+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/3136198258 shutdown_connections 2024-09-19T06:46:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:02.850+0000 7f0d8ef1e640 1 -- 172.21.15.12:0/3136198258 wait complete. 2024-09-19T06:46:03.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:03 smithi016 ceph-mon[34911]: pgmap v180: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.3 MiB/s wr, 662 op/s 2024-09-19T06:46:03.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:03 smithi012 ceph-mon[30937]: pgmap v180: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.3 MiB/s wr, 662 op/s 2024-09-19T06:46:03.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:03 smithi173 ceph-mon[35349]: pgmap v180: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.3 MiB/s wr, 662 op/s 2024-09-19T06:46:04.827 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:46:04.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:46:05.247 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:05.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:05 smithi012 ceph-mon[30937]: pgmap v181: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 18 MiB/s wr, 960 op/s 2024-09-19T06:46:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 320.0 s, 2194.8 tps, lat 45.401 ms stddev 124.458 2024-09-19T06:46:05.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:05 smithi173 ceph-mon[35349]: pgmap v181: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 18 MiB/s wr, 960 op/s 2024-09-19T06:46:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.843+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/2471337776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc809be10 msgr2=0x7fdbc809c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.843+0000 7fdbd7cf0640 1 --2- 172.21.15.12:0/2471337776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc809be10 0x7fdbc809c1f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc009860 tx=0x7fdbcc02a340 comp rx=0 tx=0).stop 2024-09-19T06:46:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.843+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/2471337776 shutdown_connections 2024-09-19T06:46:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.843+0000 7fdbd7cf0640 1 --2- 172.21.15.12:0/2471337776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc80a0f40 0x7fdbc80a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.843+0000 7fdbd7cf0640 1 --2- 172.21.15.12:0/2471337776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbc809c7c0 0x7fdbc80a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.843+0000 7fdbd7cf0640 1 --2- 172.21.15.12:0/2471337776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc809be10 0x7fdbc809c1f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.843+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/2471337776 >> 172.21.15.12:0/2471337776 conn(0x7fdbc800c2a0 msgr2=0x7fdbc809a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.843+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/2471337776 shutdown_connections 2024-09-19T06:46:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.843+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/2471337776 wait complete. 2024-09-19T06:46:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.844+0000 7fdbd7cf0640 1 Processor -- start 2024-09-19T06:46:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.844+0000 7fdbd7cf0640 1 -- start start 2024-09-19T06:46:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.845+0000 7fdbd7cf0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbc809be10 0x7fdbc8132270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.845+0000 7fdbd7cf0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc809c7c0 0x7fdbc81327b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.845+0000 7fdbd7cf0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc80a0f40 0x7fdbc8136b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.845+0000 7fdbd7cf0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc80abfb0 con 0x7fdbc809c7c0 2024-09-19T06:46:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.845+0000 7fdbd5a8c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbc809be10 0x7fdbc8132270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.845+0000 7fdbd5a8c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbc809be10 0x7fdbc8132270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48372/0 (socket says 172.21.15.12:48372) 2024-09-19T06:46:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.845+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/4243483978 learned_addr learned my addr 172.21.15.12:0/4243483978 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.845+0000 7fdbd7cf0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc80abe30 con 0x7fdbc80a0f40 2024-09-19T06:46:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.845+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/4243483978 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc80ac130 con 0x7fdbc809be10 2024-09-19T06:46:05.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.847+0000 7fdbd528b640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc809c7c0 0x7fdbc81327b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.847+0000 7fdbd628d640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc80a0f40 0x7fdbc8136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.848+0000 7fdbd528b640 1 -- 172.21.15.12:0/4243483978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbc809be10 msgr2=0x7fdbc8132270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.848+0000 7fdbd528b640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbc809be10 0x7fdbc8132270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.848+0000 7fdbd528b640 1 -- 172.21.15.12:0/4243483978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc80a0f40 msgr2=0x7fdbc8136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.848+0000 7fdbd528b640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc80a0f40 0x7fdbc8136b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.848+0000 7fdbd528b640 1 -- 172.21.15.12:0/4243483978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc8137220 con 0x7fdbc809c7c0 2024-09-19T06:46:05.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.848+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbc809be10 0x7fdbc8132270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:05.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.848+0000 7fdbd628d640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc80a0f40 0x7fdbc8136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:05.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.848+0000 7fdbd528b640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc809c7c0 0x7fdbc81327b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0005fd0 tx=0x7fdbc000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.849+0000 7fdbc6ffd640 1 -- 172.21.15.12:0/4243483978 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0009c30 con 0x7fdbc809c7c0 2024-09-19T06:46:05.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.849+0000 7fdbc6ffd640 1 -- 172.21.15.12:0/4243483978 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc0009dd0 con 0x7fdbc809c7c0 2024-09-19T06:46:05.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.849+0000 7fdbc6ffd640 1 -- 172.21.15.12:0/4243483978 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0010460 con 0x7fdbc809c7c0 2024-09-19T06:46:05.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.849+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/4243483978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc8137510 con 0x7fdbc809c7c0 2024-09-19T06:46:05.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.849+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/4243483978 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc813edf0 con 0x7fdbc809c7c0 2024-09-19T06:46:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.853+0000 7fdbc6ffd640 1 -- 172.21.15.12:0/4243483978 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fdbc0003f50 con 0x7fdbc809c7c0 2024-09-19T06:46:05.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.853+0000 7fdbda0c9740 1 Processor -- start 2024-09-19T06:46:05.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.854+0000 7fdbda0c9740 1 -- start start 2024-09-19T06:46:05.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.854+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b914ed40 0x5604b914f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914f660 0x5604b91599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b9159f20 0x5604b915c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbd628d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b914ed40 0x5604b914f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbd628d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b914ed40 0x5604b914f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48378/0 (socket says 172.21.15.12:48378) 2024-09-19T06:46:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbd628d640 1 -- 172.21.15.12:0/1140542526 learned_addr learned my addr 172.21.15.12:0/1140542526 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbd528b640 1 --2- 172.21.15.12:0/1140542526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b9159f20 0x5604b915c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1140542526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5604b90b4280 con 0x5604b914f660 2024-09-19T06:46:05.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/1140542526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914f660 0x5604b91599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbc6ffd640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdbbc0a3480 0x7fdbbc0a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1140542526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5604b905bb10 con 0x5604b9159f20 2024-09-19T06:46:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1140542526 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5604b90b0240 con 0x5604b914ed40 2024-09-19T06:46:05.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.855+0000 7fdbc6ffd640 1 -- 172.21.15.12:0/4243483978 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fdbc00cf920 con 0x7fdbc809c7c0 2024-09-19T06:46:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.857+0000 7fdbd528b640 1 -- 172.21.15.12:0/1140542526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b914ed40 msgr2=0x5604b914f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.857+0000 7fdbd528b640 1 --2- 172.21.15.12:0/1140542526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b914ed40 0x5604b914f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.857+0000 7fdbd528b640 1 -- 172.21.15.12:0/1140542526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914f660 msgr2=0x5604b91599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.857+0000 7fdbd528b640 1 --2- 172.21.15.12:0/1140542526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914f660 0x5604b91599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.857+0000 7fdbd528b640 1 -- 172.21.15.12:0/1140542526 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b90681f0 con 0x5604b9159f20 2024-09-19T06:46:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.858+0000 7fdbd628d640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdbbc0a3480 0x7fdbbc0a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.859+0000 7fdbd528b640 1 --2- 172.21.15.12:0/1140542526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b9159f20 0x5604b915c310 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00ccff0 tx=0x7fdbc009b6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=560c94994fb12ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.859+0000 7fdbbbfff640 1 -- 172.21.15.12:0/1140542526 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0020030 con 0x5604b9159f20 2024-09-19T06:46:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.859+0000 7fdbbbfff640 1 -- 172.21.15.12:0/1140542526 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc009bb80 con 0x5604b9159f20 2024-09-19T06:46:05.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.859+0000 7fdbd628d640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdbbc0a3480 0x7fdbbc0a5940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdbd002dd50 tx=0x7fdbd0068300 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.859+0000 7fdbbbfff640 1 -- 172.21.15.12:0/1140542526 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00860f0 con 0x5604b9159f20 2024-09-19T06:46:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1140542526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b9159f20 msgr2=0x5604b915c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1140542526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b9159f20 0x5604b915c310 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00ccff0 tx=0x7fdbc009b6c0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1140542526 shutdown_connections 2024-09-19T06:46:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1140542526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b9159f20 0x5604b915c310 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1140542526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914f660 0x5604b91599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1140542526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b914ed40 0x5604b914f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1140542526 >> 172.21.15.12:0/1140542526 conn(0x5604b914b2d0 msgr2=0x5604b914b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1140542526 shutdown_connections 2024-09-19T06:46:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1140542526 wait complete. 2024-09-19T06:46:05.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 -- start start 2024-09-19T06:46:05.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.860+0000 7fdbda0c9740 1 Processor -- start 2024-09-19T06:46:05.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.861+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9156d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.861+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b91572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.861+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b91577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.861+0000 7fdbda0c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5604b915cb40 con 0x5604b914ed40 2024-09-19T06:46:05.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.861+0000 7fdbda0c9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5604b906ef10 con 0x5604b914f660 2024-09-19T06:46:05.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.861+0000 7fdbda0c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5604b915ccc0 con 0x5604b9159f20 2024-09-19T06:46:05.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.862+0000 7fdbd5a8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.862+0000 7fdbd5a8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52564/0 (socket says 172.21.15.12:52564) 2024-09-19T06:46:05.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.862+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/1076506135 learned_addr learned my addr 172.21.15.12:0/1076506135 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:05.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.862+0000 7fdbda0c9740 10 client.0 _ll_register_callbacks cb 0x5604b9037a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:05.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.862+0000 7fdbd628d640 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b91577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.862+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/1076506135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 msgr2=0x5604b91577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.862+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b91577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.862+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/1076506135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 msgr2=0x5604b91572b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:46:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.862+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b91572b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.862+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/1076506135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b8e256a0 con 0x5604b914ed40 2024-09-19T06:46:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.863+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9156d70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc02a930 tx=0x7fdbcc030780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e24d1ca0e34b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.863+0000 7fdbb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:46:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.863+0000 7fdbb97fa640 1 -- 172.21.15.12:0/1076506135 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc041020 con 0x5604b914ed40 2024-09-19T06:46:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.863+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1076506135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbc009bb80 con 0x5604b914ed40 2024-09-19T06:46:05.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.863+0000 7fdbb97fa640 1 -- 172.21.15.12:0/1076506135 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fdbcc0037f0 con 0x5604b914ed40 2024-09-19T06:46:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.863+0000 7fdbb97fa640 1 -- 172.21.15.12:0/1076506135 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fdbcc04c050 con 0x5604b914ed40 2024-09-19T06:46:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.863+0000 7fdbda0c9740 10 client.17175 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.863+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1076506135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5604b9168700 con 0x5604b914ed40 2024-09-19T06:46:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.863+0000 7fdbb97fa640 1 -- 172.21.15.12:0/1076506135 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc009bb80 con 0x5604b914ed40 2024-09-19T06:46:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.864+0000 7fdbb97fa640 1 -- 172.21.15.12:0/1076506135 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fdbcc03d8a0 con 0x5604b914ed40 2024-09-19T06:46:05.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.864+0000 7fdbda0c9740 10 client.17175 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.864+0000 7fdbda0c9740 10 client.17175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.864+0000 7fdbda0c9740 20 client.17175 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.864+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604b9169c90 0x5604b916c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.864+0000 7fdbda0c9740 4 client.17175 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.864+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1076506135 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604b90c17f0 con 0x5604b9169c90 2024-09-19T06:46:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.864+0000 7fdbd528b640 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604b9169c90 0x5604b916c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.864+0000 7fdbb97fa640 10 client.17175 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.864+0000 7fdbd528b640 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604b9169c90 0x5604b916c130 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be3ea64e8d39502c server_cookie=f2a6d49483053b76 in_seq=0 out_seq=0 2024-09-19T06:46:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.866+0000 7fdbb97fa640 1 -- 172.21.15.12:0/1076506135 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604b90c17f0 con 0x5604b9169c90 2024-09-19T06:46:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.866+0000 7fdbb97fa640 10 client.17175 handle_command_reply: tid=0 2024-09-19T06:46:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.866+0000 7fdbda0c9740 1 client.17175 shutdown 2024-09-19T06:46:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.867+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1076506135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 msgr2=0x5604b9156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.867+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9156d70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc02a930 tx=0x7fdbcc030780 comp rx=0 tx=0).stop 2024-09-19T06:46:05.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.867+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1076506135 shutdown_connections 2024-09-19T06:46:05.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.867+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604b9169c90 0x5604b916c130 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.867+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b91577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.867+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b91572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.867+0000 7fdbb97fa640 0 client.17175 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.867+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1076506135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9156d70 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.867+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1076506135 >> 172.21.15.12:0/1076506135 conn(0x5604b914b2d0 msgr2=0x5604b9151000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.868+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1076506135 shutdown_connections 2024-09-19T06:46:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.868+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1076506135 wait complete. 2024-09-19T06:46:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.868+0000 7fdbda0c9740 20 client.17175 trim_cache size 0 max 16384 2024-09-19T06:46:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.894+0000 7fdbda0c9740 1 Processor -- start 2024-09-19T06:46:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.894+0000 7fdbda0c9740 1 -- start start 2024-09-19T06:46:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.894+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9171a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.894+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b9171f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.894+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b91507e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd5a8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9171a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd5a8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9171a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52578/0 (socket says 172.21.15.12:52578) 2024-09-19T06:46:05.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/1731508663 learned_addr learned my addr 172.21.15.12:0/1731508663 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:05.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1731508663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc8147ab0 con 0x5604b914ed40 2024-09-19T06:46:05.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1731508663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc81496e0 con 0x5604b914f660 2024-09-19T06:46:05.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1731508663 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc8148180 con 0x5604b9159f20 2024-09-19T06:46:05.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd528b640 1 --2- 172.21.15.12:0/1731508663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b9171f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd628d640 1 --2- 172.21.15.12:0/1731508663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b91507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/1731508663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 msgr2=0x5604b91507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:05.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/1731508663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b91507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/1731508663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 msgr2=0x5604b9171f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:05.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/1731508663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b9171f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/1731508663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b916c7b0 con 0x5604b914ed40 2024-09-19T06:46:05.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd528b640 1 --2- 172.21.15.12:0/1731508663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b9171f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:05.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.895+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/1731508663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9171a00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc006010 tx=0x7fdbcc02a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c68f81d2d5098e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.896+0000 7fdbbb7fe640 1 -- 172.21.15.12:0/1731508663 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc041040 con 0x5604b914ed40 2024-09-19T06:46:05.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.896+0000 7fdbbb7fe640 1 -- 172.21.15.12:0/1731508663 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbcc00b0b0 con 0x5604b914ed40 2024-09-19T06:46:05.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.896+0000 7fdbbb7fe640 1 -- 172.21.15.12:0/1731508663 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc037040 con 0x5604b914ed40 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.897+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1731508663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 msgr2=0x5604b9171a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.897+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1731508663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9171a00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc006010 tx=0x7fdbcc02a340 comp rx=0 tx=0).stop 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.897+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1731508663 shutdown_connections 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.897+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1731508663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b91507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.897+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1731508663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b9171f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.897+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/1731508663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b9171a00 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.897+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1731508663 >> 172.21.15.12:0/1731508663 conn(0x5604b914b2d0 msgr2=0x5604b9155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.898+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1731508663 shutdown_connections 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.898+0000 7fdbda0c9740 1 -- 172.21.15.12:0/1731508663 wait complete. 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.898+0000 7fdbda0c9740 1 -- start start 2024-09-19T06:46:05.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.899+0000 7fdbda0c9740 1 Processor -- start 2024-09-19T06:46:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.899+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b91625c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.899+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b9153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.899+0000 7fdbda0c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b9153f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.899+0000 7fdbda0c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc8148f50 con 0x5604b914ed40 2024-09-19T06:46:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.899+0000 7fdbda0c9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc8148850 con 0x5604b914f660 2024-09-19T06:46:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.899+0000 7fdbda0c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc8145a90 con 0x5604b9159f20 2024-09-19T06:46:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.900+0000 7fdbda0c9740 10 client.0 _ll_register_callbacks cb 0x7fdbcc0044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.900+0000 7fdbd5a8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b91625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.900+0000 7fdbd5a8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b91625c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52590/0 (socket says 172.21.15.12:52590) 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.900+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/3079493456 learned_addr learned my addr 172.21.15.12:0/3079493456 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.901+0000 7fdbd628d640 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b9153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.901+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/3079493456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 msgr2=0x5604b9153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.901+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b9153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.901+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/3079493456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 msgr2=0x5604b9153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.901+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b9153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.901+0000 7fdbd5a8c640 1 -- 172.21.15.12:0/3079493456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b9154790 con 0x5604b914ed40 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.901+0000 7fdbd5a8c640 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b91625c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc005d00 tx=0x7fdbcc032ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f473f5380198bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.901+0000 7fdbb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:46:05.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.901+0000 7fdbb97fa640 1 -- 172.21.15.12:0/3079493456 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc037040 con 0x5604b914ed40 2024-09-19T06:46:05.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.901+0000 7fdbb97fa640 1 -- 172.21.15.12:0/3079493456 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fdbcc03d650 con 0x5604b914ed40 2024-09-19T06:46:05.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbda0c9740 1 -- 172.21.15.12:0/3079493456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbcc00b0b0 con 0x5604b914ed40 2024-09-19T06:46:05.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbb97fa640 1 -- 172.21.15.12:0/3079493456 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fdbcc041040 con 0x5604b914ed40 2024-09-19T06:46:05.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbda0c9740 10 client.17181 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:05.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbda0c9740 1 -- 172.21.15.12:0/3079493456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5604b91d49f0 con 0x5604b914ed40 2024-09-19T06:46:05.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbb97fa640 1 -- 172.21.15.12:0/3079493456 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbcc009450 con 0x5604b914ed40 2024-09-19T06:46:05.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbb97fa640 1 -- 172.21.15.12:0/3079493456 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fdbcc05f070 con 0x5604b914ed40 2024-09-19T06:46:05.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbda0c9740 10 client.17181 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:05.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbda0c9740 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:05.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbda0c9740 20 client.17181 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:05.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604b91d50d0 0x5604b91d74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbda0c9740 4 client.17181 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:46:05.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.902+0000 7fdbda0c9740 1 -- 172.21.15.12:0/3079493456 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fdbcc00b0b0 con 0x5604b91d50d0 2024-09-19T06:46:05.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.903+0000 7fdbd528b640 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604b91d50d0 0x5604b91d74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.904+0000 7fdbb97fa640 10 client.17181 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:05.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.904+0000 7fdbd528b640 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604b91d50d0 0x5604b91d74f0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afefbb8d8848610f server_cookie=1572ece48271bf34 in_seq=0 out_seq=0 2024-09-19T06:46:05.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.905+0000 7fdbb97fa640 1 -- 172.21.15.12:0/3079493456 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fdbcc00b0b0 con 0x5604b91d50d0 2024-09-19T06:46:05.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbb97fa640 10 client.17181 handle_command_reply: tid=0 2024-09-19T06:46:05.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbda0c9740 1 client.17181 shutdown 2024-09-19T06:46:05.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbda0c9740 1 -- 172.21.15.12:0/3079493456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 msgr2=0x5604b91625c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b91625c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc005d00 tx=0x7fdbcc032ab0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbda0c9740 1 -- 172.21.15.12:0/3079493456 shutdown_connections 2024-09-19T06:46:05.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5604b91d50d0 0x5604b91d74f0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5604b9159f20 0x5604b9153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5604b914f660 0x5604b9153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbda0c9740 1 --2- 172.21.15.12:0/3079493456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5604b914ed40 0x5604b91625c0 secure :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc005d00 tx=0x7fdbcc032ab0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbda0c9740 1 -- 172.21.15.12:0/3079493456 >> 172.21.15.12:0/3079493456 conn(0x5604b914b2d0 msgr2=0x5604b9156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.906+0000 7fdbb97fa640 0 client.17181 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.907+0000 7fdbda0c9740 1 -- 172.21.15.12:0/3079493456 shutdown_connections 2024-09-19T06:46:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.907+0000 7fdbda0c9740 1 -- 172.21.15.12:0/3079493456 wait complete. 2024-09-19T06:46:05.909 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:46:05.909 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:46:05.909 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "830ec2fc-23b1-4e25-bea4-3886b5366dcd", 2024-09-19T06:46:05.910 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:46:05.910 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:46:05.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.907+0000 7fdbda0c9740 20 client.17181 trim_cache size 0 max 16384 2024-09-19T06:46:05.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdbbc0a3480 msgr2=0x7fdbbc0a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdbbc0a3480 0x7fdbbc0a5940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdbd002dd50 tx=0x7fdbd0068300 comp rx=0 tx=0).stop 2024-09-19T06:46:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc809c7c0 msgr2=0x7fdbc81327b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc809c7c0 0x7fdbc81327b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0005fd0 tx=0x7fdbc000dde0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/4243483978 shutdown_connections 2024-09-19T06:46:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbc80a0f40 0x7fdbc8136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc809c7c0 0x7fdbc81327b0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdbbc0a3480 0x7fdbbc0a5940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 --2- 172.21.15.12:0/4243483978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbc809be10 0x7fdbc8132270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/4243483978 >> 172.21.15.12:0/4243483978 conn(0x7fdbc800c2a0 msgr2=0x7fdbc80087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/4243483978 shutdown_connections 2024-09-19T06:46:05.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:05.909+0000 7fdbd7cf0640 1 -- 172.21.15.12:0/4243483978 wait complete. 2024-09-19T06:46:06.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:05 smithi016 ceph-mon[34911]: pgmap v181: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 18 MiB/s wr, 960 op/s 2024-09-19T06:46:06.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:46:06.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:06.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:06.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:06.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:06.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:06.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:06.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:06 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:46:06.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:46:06.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:06.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:06.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:06 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:06 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.173 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:07.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:07 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:07.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:07 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:07 smithi012 ceph-mon[30937]: pgmap v182: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 41 MiB/s wr, 1.56k op/s 2024-09-19T06:46:07.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:07 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:07.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:07 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:07 smithi173 ceph-mon[35349]: pgmap v182: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 41 MiB/s wr, 1.56k op/s 2024-09-19T06:46:07.909 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:07 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:07.909 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:07 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:07.909 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:07 smithi016 ceph-mon[34911]: pgmap v182: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 41 MiB/s wr, 1.56k op/s 2024-09-19T06:46:08.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.005+0000 7f89bd59a640 1 -- 172.21.15.12:0/2100453292 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b0035020 con 0x7f89c0101de0 2024-09-19T06:46:08.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.006+0000 7f89c4b9f640 1 -- 172.21.15.12:0/2100453292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c0101de0 msgr2=0x7f89c01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.006+0000 7f89c4b9f640 1 --2- 172.21.15.12:0/2100453292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c0101de0 0x7f89c01021c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009900 tx=0x7f89b002a410 comp rx=0 tx=0).stop 2024-09-19T06:46:08.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.006+0000 7f89c4b9f640 1 -- 172.21.15.12:0/2100453292 shutdown_connections 2024-09-19T06:46:08.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.006+0000 7f89c4b9f640 1 --2- 172.21.15.12:0/2100453292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89c0106f10 0x7f89c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.006+0000 7f89c4b9f640 1 --2- 172.21.15.12:0/2100453292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c0102790 0x7f89c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.006+0000 7f89c4b9f640 1 --2- 172.21.15.12:0/2100453292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c0101de0 0x7f89c01021c0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.006+0000 7f89c4b9f640 1 -- 172.21.15.12:0/2100453292 >> 172.21.15.12:0/2100453292 conn(0x7f89c00fd880 msgr2=0x7f89c00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:08.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.006+0000 7f89c4b9f640 1 -- 172.21.15.12:0/2100453292 shutdown_connections 2024-09-19T06:46:08.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.006+0000 7f89c4b9f640 1 -- 172.21.15.12:0/2100453292 wait complete. 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.007+0000 7f89c4b9f640 1 Processor -- start 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89c4b9f640 1 -- start start 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89c4b9f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c0101de0 0x7f89c00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89c4b9f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89c0102790 0x7f89c0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89c4b9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c0106f10 0x7f89c0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89bdd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89c0102790 0x7f89c0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89c4b9f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89c0111fc0 con 0x7f89c0106f10 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89bdd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89c0102790 0x7f89c0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43672/0 (socket says 172.21.15.12:43672) 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89bdd9b640 1 -- 172.21.15.12:0/1935365931 learned_addr learned my addr 172.21.15.12:0/1935365931 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89c4b9f640 1 -- 172.21.15.12:0/1935365931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89c0111e40 con 0x7f89c0102790 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89c4b9f640 1 -- 172.21.15.12:0/1935365931 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89c0112140 con 0x7f89c0101de0 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.008+0000 7f89bed9d640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c0106f10 0x7f89c0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.009+0000 7f89be59c640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c0101de0 0x7f89c00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.009+0000 7f89bed9d640 1 -- 172.21.15.12:0/1935365931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c0101de0 msgr2=0x7f89c00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.009+0000 7f89bed9d640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c0101de0 0x7f89c00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.009+0000 7f89bed9d640 1 -- 172.21.15.12:0/1935365931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89c0102790 msgr2=0x7f89c0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.009+0000 7f89bed9d640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89c0102790 0x7f89c0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.009+0000 7f89bed9d640 1 -- 172.21.15.12:0/1935365931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c01a6910 con 0x7f89c0106f10 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.009+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89c0102790 0x7f89c0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.009+0000 7f89be59c640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c0101de0 0x7f89c00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.010+0000 7f89bed9d640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c0106f10 0x7f89c0074f70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f89b800ec50 tx=0x7f89b800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.010+0000 7f89af7fe640 1 -- 172.21.15.12:0/1935365931 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8003b70 con 0x7f89c0106f10 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.010+0000 7f89af7fe640 1 -- 172.21.15.12:0/1935365931 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89b8003d10 con 0x7f89c0106f10 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.010+0000 7f89af7fe640 1 -- 172.21.15.12:0/1935365931 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8010890 con 0x7f89c0106f10 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.010+0000 7f89c4b9f640 1 -- 172.21.15.12:0/1935365931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c01a6c00 con 0x7f89c0106f10 2024-09-19T06:46:08.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.010+0000 7f89c4b9f640 1 -- 172.21.15.12:0/1935365931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c01a70f0 con 0x7f89c0106f10 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.014+0000 7f89af7fe640 1 -- 172.21.15.12:0/1935365931 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f89b8010a30 con 0x7f89c0106f10 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.016+0000 7f89af7fe640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89a80a34b0 0x7f89a80a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.017+0000 7f89c6f78740 1 Processor -- start 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.017+0000 7f89af7fe640 1 -- 172.21.15.12:0/1935365931 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f89b80d0320 con 0x7f89c0106f10 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.017+0000 7f89be59c640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89a80a34b0 0x7f89a80a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.017+0000 7f89c6f78740 1 -- start start 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.017+0000 7f89be59c640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89a80a34b0 0x7f89a80a5970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f89b0005ab0 tx=0x7f89b0005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.018+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d44a0 0x560cc62d4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.018+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62df140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.018+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 0x560cc62e1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.018+0000 7f89c6f78740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560cc623a2e0 con 0x560cc62d44a0 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.018+0000 7f89c6f78740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560cc61e1ce0 con 0x560cc62d4dc0 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.018+0000 7f89c6f78740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560cc62362a0 con 0x560cc62df680 2024-09-19T06:46:08.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.018+0000 7f89bdd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62df140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.018+0000 7f89bdd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62df140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43682/0 (socket says 172.21.15.12:43682) 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.018+0000 7f89bdd9b640 1 -- 172.21.15.12:0/3037877863 learned_addr learned my addr 172.21.15.12:0/3037877863 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.018+0000 7f89bed9d640 1 --2- 172.21.15.12:0/3037877863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 0x560cc62e1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.019+0000 7f89bdd9b640 1 -- 172.21.15.12:0/3037877863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 msgr2=0x560cc62e1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.019+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/3037877863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 0x560cc62e1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.019+0000 7f89bdd9b640 1 -- 172.21.15.12:0/3037877863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d44a0 msgr2=0x560cc62d4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.019+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/3037877863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d44a0 0x560cc62d4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.019+0000 7f89bdd9b640 1 -- 172.21.15.12:0/3037877863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc61c6440 con 0x560cc62d4dc0 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.019+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/3037877863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62df140 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f89b4010500 tx=0x7f89b40109c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ebe975b6a8bf423 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.019+0000 7f89acff9640 1 -- 172.21.15.12:0/3037877863 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4005220 con 0x560cc62d4dc0 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.019+0000 7f89acff9640 1 -- 172.21.15.12:0/3037877863 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89b4004c80 con 0x560cc62d4dc0 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.019+0000 7f89acff9640 1 -- 172.21.15.12:0/3037877863 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4011c00 con 0x560cc62d4dc0 2024-09-19T06:46:08.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.020+0000 7f89c6f78740 1 -- 172.21.15.12:0/3037877863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 msgr2=0x560cc62df140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.020+0000 7f89c6f78740 1 --2- 172.21.15.12:0/3037877863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62df140 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f89b4010500 tx=0x7f89b40109c0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.021+0000 7f89c6f78740 1 -- 172.21.15.12:0/3037877863 shutdown_connections 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.021+0000 7f89c6f78740 1 --2- 172.21.15.12:0/3037877863 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 0x560cc62e1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.021+0000 7f89c6f78740 1 --2- 172.21.15.12:0/3037877863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62df140 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.021+0000 7f89c6f78740 1 --2- 172.21.15.12:0/3037877863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d44a0 0x560cc62d4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.021+0000 7f89c6f78740 1 -- 172.21.15.12:0/3037877863 >> 172.21.15.12:0/3037877863 conn(0x560cc62d0a30 msgr2=0x560cc62d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.021+0000 7f89c6f78740 1 -- 172.21.15.12:0/3037877863 shutdown_connections 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.021+0000 7f89c6f78740 1 -- 172.21.15.12:0/3037877863 wait complete. 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.021+0000 7f89c6f78740 1 -- start start 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.021+0000 7f89c6f78740 1 Processor -- start 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.022+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62deff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.022+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 0x560cc62dc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.022+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62df680 0x560cc62dc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.022+0000 7f89c6f78740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560cc62e2250 con 0x560cc62d4dc0 2024-09-19T06:46:08.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.022+0000 7f89c6f78740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560cc61f5050 con 0x560cc62df680 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.022+0000 7f89c6f78740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560cc62e23d0 con 0x560cc62d44a0 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.022+0000 7f89c6f78740 10 client.0 _ll_register_callbacks cb 0x560cc6235160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.024+0000 7f89be59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.024+0000 7f89be59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62deff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48462/0 (socket says 172.21.15.12:48462) 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.024+0000 7f89be59c640 1 -- 172.21.15.12:0/2420631072 learned_addr learned my addr 172.21.15.12:0/2420631072 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.024+0000 7f89bed9d640 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62df680 0x560cc62dc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.024+0000 7f89be59c640 1 -- 172.21.15.12:0/2420631072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62df680 msgr2=0x560cc62dc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.024+0000 7f89be59c640 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62df680 0x560cc62dc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.024+0000 7f89be59c640 1 -- 172.21.15.12:0/2420631072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 msgr2=0x560cc62dc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.022+0000 7f89bdd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 0x560cc62dc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.025+0000 7f89be59c640 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 0x560cc62dc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.025+0000 7f89be59c640 1 -- 172.21.15.12:0/2420631072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cc5fab3c0 con 0x560cc62d44a0 2024-09-19T06:46:08.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.025+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 0x560cc62dc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:08.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.025+0000 7f89be59c640 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62deff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f89b0033000 tx=0x7f89b0004590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced244dd6208a52a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:08.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.025+0000 7f89a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:46:08.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.026+0000 7f89a5ffb640 1 -- 172.21.15.12:0/2420631072 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b004c020 con 0x560cc62d44a0 2024-09-19T06:46:08.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.026+0000 7f89a5ffb640 1 -- 172.21.15.12:0/2420631072 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f89b0005590 con 0x560cc62d44a0 2024-09-19T06:46:08.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.026+0000 7f89c6f78740 1 -- 172.21.15.12:0/2420631072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89b4004c80 con 0x560cc62d44a0 2024-09-19T06:46:08.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.026+0000 7f89a5ffb640 1 -- 172.21.15.12:0/2420631072 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f89b0057050 con 0x560cc62d44a0 2024-09-19T06:46:08.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.026+0000 7f89c6f78740 10 client.26635 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:08.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.026+0000 7f89c6f78740 1 -- 172.21.15.12:0/2420631072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x560cc62edc20 con 0x560cc62d44a0 2024-09-19T06:46:08.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.026+0000 7f89a5ffb640 1 -- 172.21.15.12:0/2420631072 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89b4004c80 con 0x560cc62d44a0 2024-09-19T06:46:08.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.026+0000 7f89a5ffb640 1 -- 172.21.15.12:0/2420631072 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f89b00035f0 con 0x560cc62d44a0 2024-09-19T06:46:08.354 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:46:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:46:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:46:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: "830ec2fc-23b1-4e25-bea4-3886b5366dcd": { 2024-09-19T06:46:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:46:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "830ec2fc-23b1-4e25-bea4-3886b5366dcd", 2024-09-19T06:46:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:46:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:46:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:46:08.354 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.026+0000 7f89c6f78740 10 client.26635 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.027+0000 7f89c6f78740 10 client.26635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.027+0000 7f89c6f78740 20 client.26635 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.027+0000 7f89c6f78740 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560cc62ef1f0 0x560cc62f1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.027+0000 7f89c6f78740 4 client.26635 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.027+0000 7f89c6f78740 1 -- 172.21.15.12:0/2420631072 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cc6247850 con 0x560cc62ef1f0 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.027+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560cc62ef1f0 0x560cc62f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.028+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560cc62ef1f0 0x560cc62f1640 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e73f2c7aac094a3f server_cookie=6d7ca30aed777abb in_seq=0 out_seq=0 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.028+0000 7f89a5ffb640 10 client.26635 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.028+0000 7f89a5ffb640 1 -- 172.21.15.12:0/2420631072 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560cc6247850 con 0x560cc62ef1f0 2024-09-19T06:46:08.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.028+0000 7f89a5ffb640 10 client.26635 handle_command_reply: tid=0 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.028+0000 7f89c6f78740 1 client.26635 shutdown 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 1 -- 172.21.15.12:0/2420631072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 msgr2=0x560cc62deff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62deff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f89b0033000 tx=0x7f89b0004590 comp rx=0 tx=0).stop 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 1 -- 172.21.15.12:0/2420631072 shutdown_connections 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560cc62ef1f0 0x560cc62f1640 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62df680 0x560cc62dc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89a5ffb640 0 client.26635 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 0x560cc62dc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 1 --2- 172.21.15.12:0/2420631072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62deff0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 1 -- 172.21.15.12:0/2420631072 >> 172.21.15.12:0/2420631072 conn(0x560cc62d0a30 msgr2=0x560cc62d6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 1 -- 172.21.15.12:0/2420631072 shutdown_connections 2024-09-19T06:46:08.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 1 -- 172.21.15.12:0/2420631072 wait complete. 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.029+0000 7f89c6f78740 20 client.26635 trim_cache size 0 max 16384 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.059+0000 7f89c6f78740 1 Processor -- start 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.059+0000 7f89c6f78740 1 -- start start 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.060+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d44a0 0x560cc62f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.060+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 0x560cc62f7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.060+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 0x560cc62d9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.060+0000 7f89c6f78740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89c01ab930 con 0x560cc62d4dc0 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.060+0000 7f89c6f78740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89c01ad560 con 0x560cc62d44a0 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.060+0000 7f89c6f78740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89c01ac000 con 0x560cc62df680 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89bed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 0x560cc62d9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89bed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 0x560cc62d9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48474/0 (socket says 172.21.15.12:48474) 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89bed9d640 1 -- 172.21.15.12:0/1636833800 learned_addr learned my addr 172.21.15.12:0/1636833800 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89be59c640 1 --2- 172.21.15.12:0/1636833800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d44a0 0x560cc62f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/1636833800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 0x560cc62f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89bed9d640 1 -- 172.21.15.12:0/1636833800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d44a0 msgr2=0x560cc62f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89bed9d640 1 --2- 172.21.15.12:0/1636833800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d44a0 0x560cc62f6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89bed9d640 1 -- 172.21.15.12:0/1636833800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 msgr2=0x560cc62f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89bed9d640 1 --2- 172.21.15.12:0/1636833800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 0x560cc62f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89bed9d640 1 -- 172.21.15.12:0/1636833800 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cc62da7f0 con 0x560cc62df680 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89bed9d640 1 --2- 172.21.15.12:0/1636833800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 0x560cc62d9500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f89b8098200 tx=0x7f89b809c2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cabefd3056c861fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89a7fff640 1 -- 172.21.15.12:0/1636833800 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8009820 con 0x560cc62df680 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89a7fff640 1 -- 172.21.15.12:0/1636833800 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89b809cc20 con 0x560cc62df680 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.061+0000 7f89a7fff640 1 -- 172.21.15.12:0/1636833800 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8004b40 con 0x560cc62df680 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.062+0000 7f89c6f78740 1 -- 172.21.15.12:0/1636833800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 msgr2=0x560cc62d9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.062+0000 7f89c6f78740 1 --2- 172.21.15.12:0/1636833800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 0x560cc62d9500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f89b8098200 tx=0x7f89b809c2f0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.062+0000 7f89c6f78740 1 -- 172.21.15.12:0/1636833800 shutdown_connections 2024-09-19T06:46:08.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.062+0000 7f89c6f78740 1 --2- 172.21.15.12:0/1636833800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62df680 0x560cc62d9500 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.062+0000 7f89c6f78740 1 --2- 172.21.15.12:0/1636833800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62d4dc0 0x560cc62f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.062+0000 7f89c6f78740 1 --2- 172.21.15.12:0/1636833800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d44a0 0x560cc62f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.062+0000 7f89c6f78740 1 -- 172.21.15.12:0/1636833800 >> 172.21.15.12:0/1636833800 conn(0x560cc62d0a30 msgr2=0x560cc62cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.065+0000 7f89c6f78740 1 -- 172.21.15.12:0/1636833800 shutdown_connections 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.065+0000 7f89c6f78740 1 -- 172.21.15.12:0/1636833800 wait complete. 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.066+0000 7f89c6f78740 1 -- start start 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.066+0000 7f89c6f78740 1 Processor -- start 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.066+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62e4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89c6f78740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62df680 0x560cc62e5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89c6f78740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89c01acdd0 con 0x560cc62df680 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89c6f78740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89c01ac6d0 con 0x560cc62d4dc0 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89c6f78740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89c01a9930 con 0x560cc62d44a0 2024-09-19T06:46:08.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89c6f78740 10 client.0 _ll_register_callbacks cb 0x7f89b003f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89bdd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62e4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89be59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89bdd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62e4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:43700/0 (socket says 172.21.15.12:43700) 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89be59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62e7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48482/0 (socket says 172.21.15.12:48482) 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89bdd9b640 1 -- 172.21.15.12:0/1110382277 learned_addr learned my addr 172.21.15.12:0/1110382277 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89bed9d640 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62df680 0x560cc62e5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89bdd9b640 1 -- 172.21.15.12:0/1110382277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 msgr2=0x560cc62e7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62e7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89bdd9b640 1 -- 172.21.15.12:0/1110382277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62df680 msgr2=0x560cc62e5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62df680 0x560cc62e5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.067+0000 7f89bdd9b640 1 -- 172.21.15.12:0/1110382277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cc62e5870 con 0x560cc62d4dc0 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.068+0000 7f89bdd9b640 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62e4df0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x560cc62d1890 tx=0x7f89b400b650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72e1f7efd7333976 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.068+0000 7f89a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:08.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.068+0000 7f89a5ffb640 1 -- 172.21.15.12:0/1110382277 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b402c020 con 0x560cc62d4dc0 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.068+0000 7f89a5ffb640 1 -- 172.21.15.12:0/1110382277 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f89b4005520 con 0x560cc62d4dc0 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.068+0000 7f89c6f78740 1 -- 172.21.15.12:0/1110382277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89b809cc20 con 0x560cc62d4dc0 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89a5ffb640 1 -- 172.21.15.12:0/1110382277 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f89b4037050 con 0x560cc62d4dc0 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89c6f78740 10 client.26687 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89c6f78740 1 -- 172.21.15.12:0/1110382277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x560cc6359d00 con 0x560cc62d4dc0 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89a5ffb640 1 -- 172.21.15.12:0/1110382277 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89b809cc20 con 0x560cc62d4dc0 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89a5ffb640 1 -- 172.21.15.12:0/1110382277 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f89b4004930 con 0x560cc62d4dc0 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89c6f78740 10 client.26687 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89c6f78740 10 client.26687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89c6f78740 20 client.26687 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89c6f78740 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560cc62ef1f0 0x560cc635c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89c6f78740 4 client.26687 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89c6f78740 1 -- 172.21.15.12:0/1110382277 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560cc6241d60 con 0x560cc62ef1f0 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.069+0000 7f89be59c640 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560cc62ef1f0 0x560cc635c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:08.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89a5ffb640 10 client.26687 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89be59c640 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560cc62ef1f0 0x560cc635c290 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b386c45cdb731f39 server_cookie=3d945ec4b962f669 in_seq=0 out_seq=0 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89a5ffb640 1 -- 172.21.15.12:0/1110382277 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x560cc6241d60 con 0x560cc62ef1f0 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89a5ffb640 10 client.26687 handle_command_reply: tid=0 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89c6f78740 1 client.26687 shutdown 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89c6f78740 1 -- 172.21.15.12:0/1110382277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 msgr2=0x560cc62e4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89c6f78740 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62e4df0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x560cc62d1890 tx=0x7f89b400b650 comp rx=0 tx=0).stop 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89c6f78740 1 -- 172.21.15.12:0/1110382277 shutdown_connections 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89c6f78740 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560cc62ef1f0 0x560cc635c290 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89c6f78740 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560cc62df680 0x560cc62e5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89c6f78740 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560cc62d4dc0 0x560cc62e4df0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89c6f78740 1 --2- 172.21.15.12:0/1110382277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560cc62d44a0 0x560cc62e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89c6f78740 1 -- 172.21.15.12:0/1110382277 >> 172.21.15.12:0/1110382277 conn(0x560cc62d0a30 msgr2=0x560cc62ddb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89a5ffb640 0 client.26687 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:08.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.070+0000 7f89c6f78740 1 -- 172.21.15.12:0/1110382277 shutdown_connections 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.071+0000 7f89c6f78740 1 -- 172.21.15.12:0/1110382277 wait complete. 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.071+0000 7f89c6f78740 20 client.26687 trim_cache size 0 max 16384 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.072+0000 7f89c4b9f640 1 -- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89a80a34b0 msgr2=0x7f89a80a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.072+0000 7f89c4b9f640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89a80a34b0 0x7f89a80a5970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f89b0005ab0 tx=0x7f89b0005a20 comp rx=0 tx=0).stop 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.072+0000 7f89c4b9f640 1 -- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c0106f10 msgr2=0x7f89c0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.072+0000 7f89c4b9f640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c0106f10 0x7f89c0074f70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f89b800ec50 tx=0x7f89b800c6a0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.072+0000 7f89c4b9f640 1 -- 172.21.15.12:0/1935365931 shutdown_connections 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.072+0000 7f89c4b9f640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89c0106f10 0x7f89c0074f70 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.073+0000 7f89c4b9f640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89c0102790 0x7f89c0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.073+0000 7f89c4b9f640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89a80a34b0 0x7f89a80a5970 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.073+0000 7f89c4b9f640 1 --2- 172.21.15.12:0/1935365931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c0101de0 0x7f89c00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.073+0000 7f89c4b9f640 1 -- 172.21.15.12:0/1935365931 >> 172.21.15.12:0/1935365931 conn(0x7f89c00fd880 msgr2=0x7f89c00fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:08.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.073+0000 7f89c4b9f640 1 -- 172.21.15.12:0/1935365931 shutdown_connections 2024-09-19T06:46:08.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:08.073+0000 7f89c4b9f640 1 -- 172.21.15.12:0/1935365931 wait complete. 2024-09-19T06:46:09.254 INFO:tasks.cephfs.filesystem:scrub status for tag:830ec2fc-23b1-4e25-bea4-3886b5366dcd - {'path': '/', 'tag': '830ec2fc-23b1-4e25-bea4-3886b5366dcd', 'options': 'recursive,force'} 2024-09-19T06:46:09.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:09 smithi173 ceph-mon[35349]: pgmap v183: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 39 MiB/s wr, 1.34k op/s 2024-09-19T06:46:09.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:09 smithi012 ceph-mon[30937]: pgmap v183: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 39 MiB/s wr, 1.34k op/s 2024-09-19T06:46:10.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:09 smithi016 ceph-mon[34911]: pgmap v183: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 39 MiB/s wr, 1.34k op/s 2024-09-19T06:46:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 325.0 s, 3248.4 tps, lat 30.949 ms stddev 34.072 2024-09-19T06:46:11.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:11 smithi173 ceph-mon[35349]: pgmap v184: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 43 MiB/s wr, 1.75k op/s 2024-09-19T06:46:11.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:11 smithi012 ceph-mon[30937]: pgmap v184: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 43 MiB/s wr, 1.75k op/s 2024-09-19T06:46:12.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:11 smithi016 ceph-mon[34911]: pgmap v184: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 43 MiB/s wr, 1.75k op/s 2024-09-19T06:46:13.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:13 smithi173 ceph-mon[35349]: pgmap v185: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 39 MiB/s wr, 1.43k op/s 2024-09-19T06:46:13.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:13 smithi012 ceph-mon[30937]: pgmap v185: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 39 MiB/s wr, 1.43k op/s 2024-09-19T06:46:14.009 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:13 smithi016 ceph-mon[34911]: pgmap v185: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 39 MiB/s wr, 1.43k op/s 2024-09-19T06:46:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.341+0000 7f6268465640 1 -- 172.21.15.12:0/3217547799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260101ac0 msgr2=0x7f6260101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.341+0000 7f6268465640 1 --2- 172.21.15.12:0/3217547799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260101ac0 0x7f6260101f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6250009900 tx=0x7f625002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.341+0000 7f6268465640 1 -- 172.21.15.12:0/3217547799 shutdown_connections 2024-09-19T06:46:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.341+0000 7f6268465640 1 --2- 172.21.15.12:0/3217547799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6260102460 0x7f626010e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.341+0000 7f6268465640 1 --2- 172.21.15.12:0/3217547799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260101ac0 0x7f6260101f20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.341+0000 7f6268465640 1 --2- 172.21.15.12:0/3217547799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6260107ad0 0x7f6260107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.341+0000 7f6268465640 1 -- 172.21.15.12:0/3217547799 >> 172.21.15.12:0/3217547799 conn(0x7f62600fd820 msgr2=0x7f62600ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.341+0000 7f6268465640 1 -- 172.21.15.12:0/3217547799 shutdown_connections 2024-09-19T06:46:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.341+0000 7f6268465640 1 -- 172.21.15.12:0/3217547799 wait complete. 2024-09-19T06:46:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.342+0000 7f6268465640 1 Processor -- start 2024-09-19T06:46:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.342+0000 7f6268465640 1 -- start start 2024-09-19T06:46:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.342+0000 7f6268465640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6260101ac0 0x7f626019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.342+0000 7f6268465640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6260102460 0x7f626019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.342+0000 7f6268465640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260107ad0 0x7f626019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.342+0000 7f6268465640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6260114110 con 0x7f6260101ac0 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.342+0000 7f6268465640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6260113f90 con 0x7f6260107ad0 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.342+0000 7f6268465640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6260114290 con 0x7f6260102460 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.342+0000 7f6266201640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6260101ac0 0x7f626019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.343+0000 7f6265a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6260102460 0x7f626019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.343+0000 7f6266a02640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260107ad0 0x7f626019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.343+0000 7f6266a02640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260107ad0 0x7f626019ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44746/0 (socket says 172.21.15.12:44746) 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.343+0000 7f6266a02640 1 -- 172.21.15.12:0/63686787 learned_addr learned my addr 172.21.15.12:0/63686787 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.343+0000 7f6266a02640 1 -- 172.21.15.12:0/63686787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6260102460 msgr2=0x7f626019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.343+0000 7f6266a02640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6260102460 0x7f626019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.343+0000 7f6266a02640 1 -- 172.21.15.12:0/63686787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6260101ac0 msgr2=0x7f626019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.343+0000 7f6266a02640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6260101ac0 0x7f626019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.344+0000 7f6266a02640 1 -- 172.21.15.12:0/63686787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626019f580 con 0x7f6260107ad0 2024-09-19T06:46:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.344+0000 7f6266201640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6260101ac0 0x7f626019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.344+0000 7f6266a02640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260107ad0 0x7f626019ee50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f625800b970 tx=0x7f625800be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.345+0000 7f62577fe640 1 -- 172.21.15.12:0/63686787 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258019070 con 0x7f6260107ad0 2024-09-19T06:46:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.345+0000 7f6268465640 1 -- 172.21.15.12:0/63686787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f626019f870 con 0x7f6260107ad0 2024-09-19T06:46:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.345+0000 7f6268465640 1 -- 172.21.15.12:0/63686787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601a7100 con 0x7f6260107ad0 2024-09-19T06:46:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.345+0000 7f62577fe640 1 -- 172.21.15.12:0/63686787 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f625800cb40 con 0x7f6260107ad0 2024-09-19T06:46:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.345+0000 7f62577fe640 1 -- 172.21.15.12:0/63686787 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258019070 con 0x7f6260107ad0 2024-09-19T06:46:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.348+0000 7f626b204740 1 Processor -- start 2024-09-19T06:46:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.349+0000 7f62577fe640 1 -- 172.21.15.12:0/63686787 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f625801c070 con 0x7f6260107ad0 2024-09-19T06:46:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.349+0000 7f626b204740 1 -- start start 2024-09-19T06:46:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f626b204740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92baf0 0x55e1ca92bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f626b204740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca936770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f626b204740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 0x55e1ca9390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f626b204740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e1ca8902f0 con 0x55e1ca92baf0 2024-09-19T06:46:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f626b204740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e1ca838270 con 0x55e1ca92c410 2024-09-19T06:46:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f626b204740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e1ca88c2b0 con 0x55e1ca936cb0 2024-09-19T06:46:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6266201640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca936770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6265a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92baf0 0x55e1ca92bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6266201640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca936770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44748/0 (socket says 172.21.15.12:44748) 2024-09-19T06:46:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6266201640 1 -- 172.21.15.12:0/736260104 learned_addr learned my addr 172.21.15.12:0/736260104 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6265a00640 1 --2- 172.21.15.12:0/736260104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 0x55e1ca9390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6266201640 1 -- 172.21.15.12:0/736260104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 msgr2=0x55e1ca9390a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6266201640 1 --2- 172.21.15.12:0/736260104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 0x55e1ca9390a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6266201640 1 -- 172.21.15.12:0/736260104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92baf0 msgr2=0x55e1ca92bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6266201640 1 --2- 172.21.15.12:0/736260104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92baf0 0x55e1ca92bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6266201640 1 -- 172.21.15.12:0/736260104 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1ca837340 con 0x55e1ca92c410 2024-09-19T06:46:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6265a00640 1 --2- 172.21.15.12:0/736260104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92baf0 0x55e1ca92bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f6266201640 1 --2- 172.21.15.12:0/736260104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca936770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f625c00f3c0 tx=0x7f625c00f880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4072302b0fd6db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.350+0000 7f62577fe640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f624c0a3870 0x7f624c0a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.351+0000 7f6265a00640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f624c0a3870 0x7f624c0a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.351+0000 7f6254bfe640 1 -- 172.21.15.12:0/736260104 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c01d070 con 0x55e1ca92c410 2024-09-19T06:46:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.351+0000 7f62577fe640 1 -- 172.21.15.12:0/63686787 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f625800c940 con 0x7f6260107ad0 2024-09-19T06:46:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.351+0000 7f6254bfe640 1 -- 172.21.15.12:0/736260104 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f625c010de0 con 0x55e1ca92c410 2024-09-19T06:46:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.351+0000 7f6254bfe640 1 -- 172.21.15.12:0/736260104 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c016340 con 0x55e1ca92c410 2024-09-19T06:46:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.352+0000 7f6265a00640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f624c0a3870 0x7f624c0a5d30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6260107150 tx=0x7f6250040040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.352+0000 7f626b204740 1 -- 172.21.15.12:0/736260104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 msgr2=0x55e1ca936770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.352+0000 7f626b204740 1 --2- 172.21.15.12:0/736260104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca936770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f625c00f3c0 tx=0x7f625c00f880 comp rx=0 tx=0).stop 2024-09-19T06:46:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.354+0000 7f626b204740 1 -- 172.21.15.12:0/736260104 shutdown_connections 2024-09-19T06:46:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.354+0000 7f626b204740 1 --2- 172.21.15.12:0/736260104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 0x55e1ca9390a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.354+0000 7f626b204740 1 --2- 172.21.15.12:0/736260104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca936770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.354+0000 7f626b204740 1 --2- 172.21.15.12:0/736260104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92baf0 0x55e1ca92bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.354+0000 7f626b204740 1 -- 172.21.15.12:0/736260104 >> 172.21.15.12:0/736260104 conn(0x55e1ca928060 msgr2=0x55e1ca928440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.354+0000 7f626b204740 1 -- 172.21.15.12:0/736260104 shutdown_connections 2024-09-19T06:46:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.354+0000 7f626b204740 1 -- 172.21.15.12:0/736260104 wait complete. 2024-09-19T06:46:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.355+0000 7f626b204740 1 -- start start 2024-09-19T06:46:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.355+0000 7f626b204740 1 Processor -- start 2024-09-19T06:46:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.355+0000 7f626b204740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92baf0 0x55e1ca933b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.355+0000 7f626b204740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca934090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.355+0000 7f626b204740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca936cb0 0x55e1ca9345d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f626b204740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e1ca939880 con 0x55e1ca936cb0 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f6265a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca934090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f6265a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca934090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44764/0 (socket says 172.21.15.12:44764) 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f6265a00640 1 -- 172.21.15.12:0/638240802 learned_addr learned my addr 172.21.15.12:0/638240802 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f6266201640 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92baf0 0x55e1ca933b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f6266a02640 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca936cb0 0x55e1ca9345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f626b204740 1 -- 172.21.15.12:0/638240802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e1ca819290 con 0x55e1ca92c410 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f626b204740 1 -- 172.21.15.12:0/638240802 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e1ca939a00 con 0x55e1ca92baf0 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f626b204740 10 client.0 _ll_register_callbacks cb 0x55e1ca84a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f6265a00640 1 -- 172.21.15.12:0/638240802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92baf0 msgr2=0x55e1ca933b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f6265a00640 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92baf0 0x55e1ca933b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f6265a00640 1 -- 172.21.15.12:0/638240802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca936cb0 msgr2=0x55e1ca9345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f6265a00640 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca936cb0 0x55e1ca9345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.356+0000 7f6265a00640 1 -- 172.21.15.12:0/638240802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1ca5a3210 con 0x55e1ca92c410 2024-09-19T06:46:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f6265a00640 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca934090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6250004a20 tx=0x7f6250009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce092310bb98f819 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f6249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f6249ffb640 1 -- 172.21.15.12:0/638240802 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250035020 con 0x55e1ca92c410 2024-09-19T06:46:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f626b204740 1 -- 172.21.15.12:0/638240802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f625c010de0 con 0x55e1ca92c410 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f6249ffb640 1 -- 172.21.15.12:0/638240802 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f62500317f0 con 0x55e1ca92c410 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f6249ffb640 1 -- 172.21.15.12:0/638240802 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f625005c050 con 0x55e1ca92c410 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f626b204740 10 client.26699 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f626b204740 1 -- 172.21.15.12:0/638240802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e1ca66f620 con 0x55e1ca92c410 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f6249ffb640 1 -- 172.21.15.12:0/638240802 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f625c010de0 con 0x55e1ca92c410 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f6249ffb640 1 -- 172.21.15.12:0/638240802 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f625003a040 con 0x55e1ca92c410 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f626b204740 10 client.26699 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.357+0000 7f626b204740 10 client.26699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.358+0000 7f626b204740 20 client.26699 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.358+0000 7f626b204740 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e1ca946d60 0x55e1ca9491c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.358+0000 7f626b204740 4 client.26699 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.358+0000 7f626b204740 1 -- 172.21.15.12:0/638240802 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1ca89da20 con 0x55e1ca946d60 2024-09-19T06:46:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.358+0000 7f6266201640 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e1ca946d60 0x55e1ca9491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.358+0000 7f6266201640 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e1ca946d60 0x55e1ca9491c0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c72f6dd8d8f135c server_cookie=31cc67f8fe4b2f5b in_seq=0 out_seq=0 2024-09-19T06:46:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.358+0000 7f6249ffb640 10 client.26699 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.360+0000 7f6249ffb640 1 -- 172.21.15.12:0/638240802 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1ca89da20 con 0x55e1ca946d60 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.360+0000 7f6249ffb640 10 client.26699 handle_command_reply: tid=0 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.360+0000 7f626b204740 1 client.26699 shutdown 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.360+0000 7f626b204740 1 -- 172.21.15.12:0/638240802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 msgr2=0x55e1ca934090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.360+0000 7f626b204740 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca934090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6250004a20 tx=0x7f6250009560 comp rx=0 tx=0).stop 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.361+0000 7f626b204740 1 -- 172.21.15.12:0/638240802 shutdown_connections 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.361+0000 7f626b204740 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e1ca946d60 0x55e1ca9491c0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.361+0000 7f626b204740 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca936cb0 0x55e1ca9345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.361+0000 7f626b204740 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92c410 0x55e1ca934090 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.361+0000 7f626b204740 1 --2- 172.21.15.12:0/638240802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92baf0 0x55e1ca933b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.361+0000 7f626b204740 1 -- 172.21.15.12:0/638240802 >> 172.21.15.12:0/638240802 conn(0x55e1ca928060 msgr2=0x55e1ca92ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.361+0000 7f6249ffb640 0 client.26699 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.361+0000 7f626b204740 1 -- 172.21.15.12:0/638240802 shutdown_connections 2024-09-19T06:46:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.361+0000 7f626b204740 1 -- 172.21.15.12:0/638240802 wait complete. 2024-09-19T06:46:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.361+0000 7f626b204740 20 client.26699 trim_cache size 0 max 16384 2024-09-19T06:46:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f626b204740 1 Processor -- start 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f626b204740 1 -- start start 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f626b204740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92baf0 0x55e1ca92e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f626b204740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92c410 0x55e1ca935ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f626b204740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 0x55e1ca934400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f626b204740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f624400e9d0 con 0x55e1ca92c410 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f626b204740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6244010600 con 0x55e1ca92baf0 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f626b204740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f624400f0a0 con 0x55e1ca936cb0 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f6266201640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92baf0 0x55e1ca92e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f6265a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92c410 0x55e1ca935ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f6266201640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92baf0 0x55e1ca92e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44776/0 (socket says 172.21.15.12:44776) 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f6265a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92c410 0x55e1ca935ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55312/0 (socket says 172.21.15.12:55312) 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f6266201640 1 -- 172.21.15.12:0/2694559185 learned_addr learned my addr 172.21.15.12:0/2694559185 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.385+0000 7f6266a02640 1 --2- 172.21.15.12:0/2694559185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 0x55e1ca934400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.386+0000 7f6266a02640 1 -- 172.21.15.12:0/2694559185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92baf0 msgr2=0x55e1ca92e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.386+0000 7f6266a02640 1 --2- 172.21.15.12:0/2694559185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92baf0 0x55e1ca92e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.386+0000 7f6266a02640 1 -- 172.21.15.12:0/2694559185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92c410 msgr2=0x55e1ca935ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:14.388 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.386+0000 7f6266a02640 1 --2- 172.21.15.12:0/2694559185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92c410 0x55e1ca935ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.386+0000 7f6266a02640 1 -- 172.21.15.12:0/2694559185 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1ca927e90 con 0x55e1ca936cb0 2024-09-19T06:46:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.386+0000 7f6265a00640 1 --2- 172.21.15.12:0/2694559185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92c410 0x55e1ca935ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-19T06:46:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.387+0000 7f6266a02640 1 --2- 172.21.15.12:0/2694559185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 0x55e1ca934400 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62580cc3b0 tx=0x7f62580bb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=284cad2e62c98794 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.387+0000 7f624bfff640 1 -- 172.21.15.12:0/2694559185 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625809f2f0 con 0x55e1ca936cb0 2024-09-19T06:46:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.387+0000 7f624bfff640 1 -- 172.21.15.12:0/2694559185 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62580a3bb0 con 0x55e1ca936cb0 2024-09-19T06:46:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.387+0000 7f624bfff640 1 -- 172.21.15.12:0/2694559185 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62580a3720 con 0x55e1ca936cb0 2024-09-19T06:46:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.388+0000 7f626b204740 1 -- 172.21.15.12:0/2694559185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 msgr2=0x55e1ca934400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.388+0000 7f626b204740 1 --2- 172.21.15.12:0/2694559185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 0x55e1ca934400 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62580cc3b0 tx=0x7f62580bb040 comp rx=0 tx=0).stop 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.388+0000 7f626b204740 1 -- 172.21.15.12:0/2694559185 shutdown_connections 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.388+0000 7f626b204740 1 --2- 172.21.15.12:0/2694559185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca936cb0 0x55e1ca934400 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.388+0000 7f626b204740 1 --2- 172.21.15.12:0/2694559185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92c410 0x55e1ca935ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.388+0000 7f626b204740 1 --2- 172.21.15.12:0/2694559185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca92baf0 0x55e1ca92e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.388+0000 7f626b204740 1 -- 172.21.15.12:0/2694559185 >> 172.21.15.12:0/2694559185 conn(0x55e1ca928060 msgr2=0x55e1ca9353b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.388+0000 7f626b204740 1 -- 172.21.15.12:0/2694559185 shutdown_connections 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.388+0000 7f626b204740 1 -- 172.21.15.12:0/2694559185 wait complete. 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f626b204740 1 -- start start 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f626b204740 1 Processor -- start 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f626b204740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92baf0 0x55e1ca93f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f626b204740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92c410 0x55e1ca93a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f626b204740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca936cb0 0x55e1ca93ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f626b204740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f624400fe70 con 0x55e1ca92baf0 2024-09-19T06:46:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f626b204740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f624400f770 con 0x55e1ca936cb0 2024-09-19T06:46:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f626b204740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f624400c9b0 con 0x55e1ca92c410 2024-09-19T06:46:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f626b204740 10 client.0 _ll_register_callbacks cb 0x7f6250009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f6266a02640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca936cb0 0x55e1ca93ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f6265a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92c410 0x55e1ca93a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f6266a02640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca936cb0 0x55e1ca93ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:44786/0 (socket says 172.21.15.12:44786) 2024-09-19T06:46:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f6265a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92c410 0x55e1ca93a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:39344/0 (socket says 172.21.15.12:39344) 2024-09-19T06:46:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.389+0000 7f6266a02640 1 -- 172.21.15.12:0/1335475445 learned_addr learned my addr 172.21.15.12:0/1335475445 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f6266a02640 1 -- 172.21.15.12:0/1335475445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92c410 msgr2=0x55e1ca93a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f6266a02640 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92c410 0x55e1ca93a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f6266a02640 1 -- 172.21.15.12:0/1335475445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92baf0 msgr2=0x55e1ca93f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f6266a02640 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92baf0 0x55e1ca93f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f6266a02640 1 -- 172.21.15.12:0/1335475445 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1ca9232d0 con 0x55e1ca936cb0 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f6266a02640 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca936cb0 0x55e1ca93ab50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f625809af30 tx=0x7f6258004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9151ae734de3e87e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f6249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f6249ffb640 1 -- 172.21.15.12:0/1335475445 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258079bd0 con 0x55e1ca936cb0 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f6249ffb640 1 -- 172.21.15.12:0/1335475445 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f62580a3720 con 0x55e1ca936cb0 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f626b204740 1 -- 172.21.15.12:0/1335475445 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62580a3bb0 con 0x55e1ca936cb0 2024-09-19T06:46:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f6249ffb640 1 -- 172.21.15.12:0/1335475445 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f62580a3920 con 0x55e1ca936cb0 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f626b204740 10 client.26705 fetch_fsmap learned FSMap version 37 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.390+0000 7f626b204740 1 -- 172.21.15.12:0/1335475445 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e1ca9b16a0 con 0x55e1ca936cb0 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f6249ffb640 1 -- 172.21.15.12:0/1335475445 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62580a3bb0 con 0x55e1ca936cb0 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f6249ffb640 1 -- 172.21.15.12:0/1335475445 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7f625807f070 con 0x55e1ca936cb0 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f626b204740 10 client.26705 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f626b204740 10 client.26705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f626b204740 20 client.26705 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f626b204740 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e1ca9b1d80 0x55e1ca9b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f626b204740 4 client.26705 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f626b204740 1 -- 172.21.15.12:0/1335475445 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e1ca897d70 con 0x55e1ca9b1d80 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f6266201640 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e1ca9b1d80 0x55e1ca9b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f6249ffb640 10 client.26705 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:14.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.391+0000 7f6266201640 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e1ca9b1d80 0x55e1ca9b41a0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=698176193edca2b1 server_cookie=576de616828324b in_seq=0 out_seq=0 2024-09-19T06:46:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.401+0000 7f6249ffb640 1 -- 172.21.15.12:0/1335475445 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e1ca897d70 con 0x55e1ca9b1d80 2024-09-19T06:46:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.401+0000 7f6249ffb640 10 client.26705 handle_command_reply: tid=0 2024-09-19T06:46:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.401+0000 7f626b204740 1 client.26705 shutdown 2024-09-19T06:46:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 1 -- 172.21.15.12:0/1335475445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca936cb0 msgr2=0x55e1ca93ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca936cb0 0x55e1ca93ab50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f625809af30 tx=0x7f6258004b50 comp rx=0 tx=0).stop 2024-09-19T06:46:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 1 -- 172.21.15.12:0/1335475445 shutdown_connections 2024-09-19T06:46:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e1ca9b1d80 0x55e1ca9b41a0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e1ca936cb0 0x55e1ca93ab50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e1ca92c410 0x55e1ca93a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 1 --2- 172.21.15.12:0/1335475445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e1ca92baf0 0x55e1ca93f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 1 -- 172.21.15.12:0/1335475445 >> 172.21.15.12:0/1335475445 conn(0x55e1ca928060 msgr2=0x55e1ca9271c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f6249ffb640 0 client.26705 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 1 -- 172.21.15.12:0/1335475445 shutdown_connections 2024-09-19T06:46:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 1 -- 172.21.15.12:0/1335475445 wait complete. 2024-09-19T06:46:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.402+0000 7f626b204740 20 client.26705 trim_cache size 0 max 16384 2024-09-19T06:46:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:46:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:46:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:46:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:46:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.403+0000 7f6268465640 1 -- 172.21.15.12:0/63686787 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f624c0a3870 msgr2=0x7f624c0a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.403+0000 7f6268465640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f624c0a3870 0x7f624c0a5d30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6260107150 tx=0x7f6250040040 comp rx=0 tx=0).stop 2024-09-19T06:46:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.403+0000 7f6268465640 1 -- 172.21.15.12:0/63686787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260107ad0 msgr2=0x7f626019ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.403+0000 7f6268465640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260107ad0 0x7f626019ee50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f625800b970 tx=0x7f625800be30 comp rx=0 tx=0).stop 2024-09-19T06:46:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.404+0000 7f6268465640 1 -- 172.21.15.12:0/63686787 shutdown_connections 2024-09-19T06:46:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.404+0000 7f6268465640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260107ad0 0x7f626019ee50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.404+0000 7f6268465640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f624c0a3870 0x7f624c0a5d30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.404+0000 7f6268465640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6260102460 0x7f626019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.404+0000 7f6268465640 1 --2- 172.21.15.12:0/63686787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6260101ac0 0x7f626019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.404+0000 7f6268465640 1 -- 172.21.15.12:0/63686787 >> 172.21.15.12:0/63686787 conn(0x7f62600fd820 msgr2=0x7f62600fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.404+0000 7f6268465640 1 -- 172.21.15.12:0/63686787 shutdown_connections 2024-09-19T06:46:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:14.404+0000 7f6268465640 1 -- 172.21.15.12:0/63686787 wait complete. 2024-09-19T06:46:15.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 330.0 s, 4134.2 tps, lat 24.172 ms stddev 27.438 2024-09-19T06:46:15.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:15 smithi173 ceph-mon[35349]: pgmap v186: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 41 MiB/s wr, 1.57k op/s 2024-09-19T06:46:15.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:15 smithi012 ceph-mon[30937]: pgmap v186: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 41 MiB/s wr, 1.57k op/s 2024-09-19T06:46:16.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:15 smithi016 ceph-mon[34911]: pgmap v186: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 41 MiB/s wr, 1.57k op/s 2024-09-19T06:46:17.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:17 smithi173 ceph-mon[35349]: pgmap v187: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 32 MiB/s wr, 1.46k op/s 2024-09-19T06:46:17.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:17 smithi012 ceph-mon[30937]: pgmap v187: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 32 MiB/s wr, 1.46k op/s 2024-09-19T06:46:18.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:17 smithi016 ceph-mon[34911]: pgmap v187: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 32 MiB/s wr, 1.46k op/s 2024-09-19T06:46:18.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:18 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:46:18.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:18 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:46:18.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:18 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:46:18.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:18 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:46:19.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:18 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:46:19.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:18 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:46:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:19 smithi173 ceph-mon[35349]: pgmap v188: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 7.6 MiB/s wr, 742 op/s 2024-09-19T06:46:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:19 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:46:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:19 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:46:19.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:19 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:46:19.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:19 smithi012 ceph-mon[30937]: pgmap v188: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 7.6 MiB/s wr, 742 op/s 2024-09-19T06:46:19.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:19 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:46:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:19 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:46:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:19 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:46:20.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:19 smithi016 ceph-mon[34911]: pgmap v188: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 7.6 MiB/s wr, 742 op/s 2024-09-19T06:46:20.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:19 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:46:20.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:19 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:46:20.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:19 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:46:20.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 335.0 s, 3334.2 tps, lat 29.936 ms stddev 31.636 2024-09-19T06:46:20.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:20 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:46:20.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:20 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:46:21.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:20 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:46:21.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:21 smithi173 ceph-mon[35349]: pgmap v189: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2024-09-19T06:46:21.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:21 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:21.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:21 smithi012 ceph-mon[30937]: pgmap v189: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2024-09-19T06:46:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:21 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:22.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:21 smithi016 ceph-mon[34911]: pgmap v189: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2024-09-19T06:46:22.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:21 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:22.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:22 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:22.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:22 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:46:22.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:22 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:46:22.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:22 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:22.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:22 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:46:22.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:22 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:46:23.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:22 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:23.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:22 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:46:23.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:22 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:46:24.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:23 smithi016 ceph-mon[34911]: pgmap v190: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.3 MiB/s wr, 668 op/s 2024-09-19T06:46:24.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:23 smithi173 ceph-mon[35349]: pgmap v190: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.3 MiB/s wr, 668 op/s 2024-09-19T06:46:24.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:23 smithi012 ceph-mon[30937]: pgmap v190: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.3 MiB/s wr, 668 op/s 2024-09-19T06:46:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 340.0 s, 3883.2 tps, lat 25.825 ms stddev 29.464 2024-09-19T06:46:25.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:25 smithi012 ceph-mon[30937]: pgmap v191: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.8 MiB/s wr, 734 op/s 2024-09-19T06:46:25.931 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:25 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:46:26.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:25 smithi016 ceph-mon[34911]: pgmap v191: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.8 MiB/s wr, 734 op/s 2024-09-19T06:46:26.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:25 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:46:26.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:25 smithi173 ceph-mon[35349]: pgmap v191: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.8 MiB/s wr, 734 op/s 2024-09-19T06:46:26.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:25 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:46:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.537+0000 7f09a4da1640 1 -- 172.21.15.12:0/3321454570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a0107b80 msgr2=0x7f09a0107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.537+0000 7f09a4da1640 1 --2- 172.21.15.12:0/3321454570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a0107b80 0x7f09a0107f60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0990009860 tx=0x7f099002a340 comp rx=0 tx=0).stop 2024-09-19T06:46:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.537+0000 7f09a4da1640 1 -- 172.21.15.12:0/3321454570 shutdown_connections 2024-09-19T06:46:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.537+0000 7f09a4da1640 1 --2- 172.21.15.12:0/3321454570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a0102480 0x7f09a010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.537+0000 7f09a4da1640 1 --2- 172.21.15.12:0/3321454570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09a0101ae0 0x7f09a0101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.537+0000 7f09a4da1640 1 --2- 172.21.15.12:0/3321454570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a0107b80 0x7f09a0107f60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.537+0000 7f09a4da1640 1 -- 172.21.15.12:0/3321454570 >> 172.21.15.12:0/3321454570 conn(0x7f09a00fd7e0 msgr2=0x7f09a00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.537+0000 7f09a4da1640 1 -- 172.21.15.12:0/3321454570 shutdown_connections 2024-09-19T06:46:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.537+0000 7f09a4da1640 1 -- 172.21.15.12:0/3321454570 wait complete. 2024-09-19T06:46:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.538+0000 7f09a4da1640 1 Processor -- start 2024-09-19T06:46:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.538+0000 7f09a4da1640 1 -- start start 2024-09-19T06:46:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.538+0000 7f09a4da1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09a0101ae0 0x7f09a010e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.538+0000 7f09a4da1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a0102480 0x7f09a010b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.538+0000 7f09a4da1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a0107b80 0x7f09a010baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f099dd9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a0102480 0x7f09a010b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f099dd9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a0102480 0x7f09a010b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:42922/0 (socket says 172.21.15.12:42922) 2024-09-19T06:46:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f099dd9b640 1 -- 172.21.15.12:0/2597074383 learned_addr learned my addr 172.21.15.12:0/2597074383 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f099ed9d640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a0107b80 0x7f09a010baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0075c00 con 0x7f09a0101ae0 2024-09-19T06:46:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0075a80 con 0x7f09a0107b80 2024-09-19T06:46:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f099e59c640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09a0101ae0 0x7f09a010e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0075d80 con 0x7f09a0102480 2024-09-19T06:46:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f099e59c640 1 -- 172.21.15.12:0/2597074383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a0102480 msgr2=0x7f09a010b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f099e59c640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a0102480 0x7f09a010b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f099e59c640 1 -- 172.21.15.12:0/2597074383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a0107b80 msgr2=0x7f09a010baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f099e59c640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a0107b80 0x7f09a010baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.539+0000 7f099e59c640 1 -- 172.21.15.12:0/2597074383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a010c0b0 con 0x7f09a0101ae0 2024-09-19T06:46:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.540+0000 7f099dd9b640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a0102480 0x7f09a010b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.540+0000 7f099ed9d640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a0107b80 0x7f09a010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.540+0000 7f099e59c640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09a0101ae0 0x7f09a010e510 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0990009780 tx=0x7f0990033d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.540+0000 7f098f7fe640 1 -- 172.21.15.12:0/2597074383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990037040 con 0x7f09a0101ae0 2024-09-19T06:46:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.540+0000 7f098f7fe640 1 -- 172.21.15.12:0/2597074383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0990004050 con 0x7f09a0101ae0 2024-09-19T06:46:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.540+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a010c340 con 0x7f09a0101ae0 2024-09-19T06:46:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.541+0000 7f098f7fe640 1 -- 172.21.15.12:0/2597074383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990003ac0 con 0x7f09a0101ae0 2024-09-19T06:46:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.541+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a01ab420 con 0x7f09a0101ae0 2024-09-19T06:46:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.545+0000 7f098f7fe640 1 -- 172.21.15.12:0/2597074383 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0990042020 con 0x7f09a0101ae0 2024-09-19T06:46:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.548+0000 7f09a7c14740 1 Processor -- start 2024-09-19T06:46:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.548+0000 7f098f7fe640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09880a3530 0x7f09880a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.548+0000 7f099ed9d640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09880a3530 0x7f09880a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.548+0000 7f09a7c14740 1 -- start start 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.548+0000 7f098f7fe640 1 -- 172.21.15.12:0/2597074383 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f09900ef0f0 con 0x7f09a0101ae0 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c4caf0 0x55f321c4ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c57770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c57cb0 0x55f321c5a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f09a7c14740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f321bb12f0 con 0x55f321c57cb0 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f09a7c14740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f321b59270 con 0x55f321c4d410 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f09a7c14740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f321bad2b0 con 0x55f321c4caf0 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c57770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c57770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:35224/0 (socket says 172.21.15.12:35224) 2024-09-19T06:46:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099dd9b640 1 -- 172.21.15.12:0/2038342568 learned_addr learned my addr 172.21.15.12:0/2038342568 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099ed9d640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09880a3530 0x7f09880a59f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0998005cc0 tx=0x7f0998008230 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099ed9d640 1 --2- 172.21.15.12:0/2038342568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c57cb0 0x55f321c5a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099e59c640 1 --2- 172.21.15.12:0/2038342568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c4caf0 0x55f321c4ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099dd9b640 1 -- 172.21.15.12:0/2038342568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c4caf0 msgr2=0x55f321c4ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099dd9b640 1 --2- 172.21.15.12:0/2038342568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c4caf0 0x55f321c4ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099dd9b640 1 -- 172.21.15.12:0/2038342568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c57cb0 msgr2=0x55f321c5a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099dd9b640 1 --2- 172.21.15.12:0/2038342568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c57cb0 0x55f321c5a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.549+0000 7f099dd9b640 1 -- 172.21.15.12:0/2038342568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f321b58340 con 0x55f321c4d410 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.550+0000 7f099dd9b640 1 --2- 172.21.15.12:0/2038342568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c57770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0994009c90 tx=0x7f0994010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5733ca44b5a6c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.550+0000 7f098cff9640 1 -- 172.21.15.12:0/2038342568 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099401b480 con 0x55f321c4d410 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.550+0000 7f098cff9640 1 -- 172.21.15.12:0/2038342568 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f099401bb00 con 0x55f321c4d410 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.550+0000 7f098cff9640 1 -- 172.21.15.12:0/2038342568 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994012c40 con 0x55f321c4d410 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.550+0000 7f099ed9d640 1 --2- 172.21.15.12:0/2038342568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c57cb0 0x55f321c5a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.551+0000 7f09a7c14740 1 -- 172.21.15.12:0/2038342568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 msgr2=0x55f321c57770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.551+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2038342568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c57770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0994009c90 tx=0x7f0994010740 comp rx=0 tx=0).stop 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.552+0000 7f09a7c14740 1 -- 172.21.15.12:0/2038342568 shutdown_connections 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.552+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2038342568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c57cb0 0x55f321c5a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.552+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2038342568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c57770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.552+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2038342568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c4caf0 0x55f321c4ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.552+0000 7f09a7c14740 1 -- 172.21.15.12:0/2038342568 >> 172.21.15.12:0/2038342568 conn(0x55f321c49060 msgr2=0x55f321c49440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:27.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.552+0000 7f09a7c14740 1 -- 172.21.15.12:0/2038342568 shutdown_connections 2024-09-19T06:46:27.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.552+0000 7f09a7c14740 1 -- 172.21.15.12:0/2038342568 wait complete. 2024-09-19T06:46:27.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f09a7c14740 1 -- start start 2024-09-19T06:46:27.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f09a7c14740 1 Processor -- start 2024-09-19T06:46:27.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4caf0 0x55f321c54c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c55170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 0x55f321c556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f09a7c14740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f321c5a880 con 0x55f321c4caf0 2024-09-19T06:46:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f09a7c14740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f321b3a290 con 0x55f321c4d410 2024-09-19T06:46:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f09a7c14740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f321c5aa00 con 0x55f321c57cb0 2024-09-19T06:46:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f099e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4caf0 0x55f321c54c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f099dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c55170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f099e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4caf0 0x55f321c54c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47344/0 (socket says 172.21.15.12:47344) 2024-09-19T06:46:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f099e59c640 1 -- 172.21.15.12:0/3324850521 learned_addr learned my addr 172.21.15.12:0/3324850521 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f099dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c55170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:35232/0 (socket says 172.21.15.12:35232) 2024-09-19T06:46:27.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f09a7c14740 10 client.0 _ll_register_callbacks cb 0x55f321b6b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.553+0000 7f099ed9d640 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 0x55f321c556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.554+0000 7f099ed9d640 1 -- 172.21.15.12:0/3324850521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 msgr2=0x55f321c55170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.554+0000 7f099ed9d640 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c55170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.554+0000 7f099ed9d640 1 -- 172.21.15.12:0/3324850521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4caf0 msgr2=0x55f321c54c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.554+0000 7f099ed9d640 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4caf0 0x55f321c54c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.554+0000 7f099ed9d640 1 -- 172.21.15.12:0/3324850521 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3218c4210 con 0x55f321c57cb0 2024-09-19T06:46:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.554+0000 7f099ed9d640 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 0x55f321c556b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f321c4a3e0 tx=0x7f0998004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e1b86e8ca99d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.554+0000 7f0985ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:46:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.554+0000 7f0985ffb640 1 -- 172.21.15.12:0/3324850521 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099800edd0 con 0x55f321c57cb0 2024-09-19T06:46:27.559 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.555+0000 7f0985ffb640 1 -- 172.21.15.12:0/3324850521 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0998004b20 con 0x55f321c57cb0 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.555+0000 7f09a7c14740 1 -- 172.21.15.12:0/3324850521 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f099401bb00 con 0x55f321c57cb0 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.555+0000 7f0985ffb640 1 -- 172.21.15.12:0/3324850521 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0998004d40 con 0x55f321c57cb0 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f09a7c14740 10 client.26662 fetch_fsmap learned FSMap version 39 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f09a7c14740 1 -- 172.21.15.12:0/3324850521 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f321990620 con 0x55f321c57cb0 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f0985ffb640 1 -- 172.21.15.12:0/3324850521 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0998005500 con 0x55f321c57cb0 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f0985ffb640 1 -- 172.21.15.12:0/3324850521 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7f099802b070 con 0x55f321c57cb0 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f09a7c14740 10 client.26662 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f09a7c14740 10 client.26662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f09a7c14740 20 client.26662 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f09a7c14740 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f321c78d60 0x55f321c7b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f09a7c14740 4 client.26662 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f09a7c14740 1 -- 172.21.15.12:0/3324850521 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f099401bb00 con 0x55f321c78d60 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.556+0000 7f099e59c640 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f321c78d60 0x55f321c7b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.557+0000 7f0985ffb640 10 client.26662 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.557+0000 7f099e59c640 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f321c78d60 0x55f321c7b1e0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4d2d660a8a926a8 server_cookie=4aff80beecbe47bd in_seq=0 out_seq=0 2024-09-19T06:46:27.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.557+0000 7f0985ffb640 1 -- 172.21.15.12:0/3324850521 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f099401bb00 con 0x55f321c78d60 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.557+0000 7f0985ffb640 10 client.26662 handle_command_reply: tid=0 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.558+0000 7f09a7c14740 1 client.26662 shutdown 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.558+0000 7f09a7c14740 1 -- 172.21.15.12:0/3324850521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 msgr2=0x55f321c556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.558+0000 7f09a7c14740 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 0x55f321c556b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x55f321c4a3e0 tx=0x7f0998004a40 comp rx=0 tx=0).stop 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.559+0000 7f09a7c14740 1 -- 172.21.15.12:0/3324850521 shutdown_connections 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.559+0000 7f09a7c14740 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f321c78d60 0x55f321c7b1e0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.559+0000 7f0985ffb640 0 client.26662 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.559+0000 7f09a7c14740 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 0x55f321c556b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.559+0000 7f09a7c14740 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c55170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.559+0000 7f09a7c14740 1 --2- 172.21.15.12:0/3324850521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4caf0 0x55f321c54c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.559+0000 7f09a7c14740 1 -- 172.21.15.12:0/3324850521 >> 172.21.15.12:0/3324850521 conn(0x55f321c49060 msgr2=0x55f321c4ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.559+0000 7f09a7c14740 1 -- 172.21.15.12:0/3324850521 shutdown_connections 2024-09-19T06:46:27.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.559+0000 7f09a7c14740 1 -- 172.21.15.12:0/3324850521 wait complete. 2024-09-19T06:46:27.563 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.559+0000 7f09a7c14740 20 client.26662 trim_cache size 0 max 16384 2024-09-19T06:46:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.592+0000 7f09a7c14740 1 Processor -- start 2024-09-19T06:46:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.594+0000 7f09a7c14740 1 -- start start 2024-09-19T06:46:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.595+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4caf0 0x55f321c4f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.595+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c53500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.595+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 0x55f321c554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.595+0000 7f09a7c14740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09a01170e0 con 0x55f321c4caf0 2024-09-19T06:46:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.595+0000 7f09a7c14740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0118d10 con 0x55f321c4d410 2024-09-19T06:46:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.595+0000 7f09a7c14740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09a01177b0 con 0x55f321c57cb0 2024-09-19T06:46:27.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.595+0000 7f099dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c53500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.595+0000 7f099dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c53500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:35238/0 (socket says 172.21.15.12:35238) 2024-09-19T06:46:27.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.595+0000 7f099dd9b640 1 -- 172.21.15.12:0/2706974193 learned_addr learned my addr 172.21.15.12:0/2706974193 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:27.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.595+0000 7f099ed9d640 1 --2- 172.21.15.12:0/2706974193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 0x55f321c554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.596+0000 7f099dd9b640 1 -- 172.21.15.12:0/2706974193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 msgr2=0x55f321c554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:27.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.596+0000 7f099dd9b640 1 --2- 172.21.15.12:0/2706974193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 0x55f321c554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.596+0000 7f099dd9b640 1 -- 172.21.15.12:0/2706974193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4caf0 msgr2=0x55f321c4f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:27.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.596+0000 7f099dd9b640 1 --2- 172.21.15.12:0/2706974193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4caf0 0x55f321c4f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.596+0000 7f099dd9b640 1 -- 172.21.15.12:0/2706974193 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f321c64690 con 0x55f321c4d410 2024-09-19T06:46:27.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.597+0000 7f099dd9b640 1 --2- 172.21.15.12:0/2706974193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c53500 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0994009c90 tx=0x7f0994009460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a08a2d471d3f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.599+0000 7f0987fff640 1 -- 172.21.15.12:0/2706974193 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099402a070 con 0x55f321c4d410 2024-09-19T06:46:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.599+0000 7f0987fff640 1 -- 172.21.15.12:0/2706974193 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0994005510 con 0x55f321c4d410 2024-09-19T06:46:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.599+0000 7f0987fff640 1 -- 172.21.15.12:0/2706974193 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994004680 con 0x55f321c4d410 2024-09-19T06:46:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.604+0000 7f09a7c14740 1 -- 172.21.15.12:0/2706974193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 msgr2=0x55f321c53500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:27.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.604+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2706974193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c53500 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0994009c90 tx=0x7f0994009460 comp rx=0 tx=0).stop 2024-09-19T06:46:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.606+0000 7f09a7c14740 1 -- 172.21.15.12:0/2706974193 shutdown_connections 2024-09-19T06:46:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.606+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2706974193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c57cb0 0x55f321c554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.606+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2706974193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c4d410 0x55f321c53500 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.606+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2706974193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4caf0 0x55f321c4f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.606+0000 7f09a7c14740 1 -- 172.21.15.12:0/2706974193 >> 172.21.15.12:0/2706974193 conn(0x55f321c49060 msgr2=0x55f321c56cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.610+0000 7f09a7c14740 1 -- 172.21.15.12:0/2706974193 shutdown_connections 2024-09-19T06:46:27.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.613+0000 7f09a7c14740 1 -- 172.21.15.12:0/2706974193 wait complete. 2024-09-19T06:46:27.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.614+0000 7f09a7c14740 1 -- start start 2024-09-19T06:46:27.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.614+0000 7f09a7c14740 1 Processor -- start 2024-09-19T06:46:27.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.614+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c4caf0 0x55f321c601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.614+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4d410 0x55f321c51750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.614+0000 7f09a7c14740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c57cb0 0x55f321c51c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.614+0000 7f09a7c14740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0118580 con 0x55f321c4d410 2024-09-19T06:46:27.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.614+0000 7f09a7c14740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0117eb0 con 0x55f321c57cb0 2024-09-19T06:46:27.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.614+0000 7f09a7c14740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09a01150c0 con 0x55f321c4caf0 2024-09-19T06:46:27.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.614+0000 7f09a7c14740 10 client.0 _ll_register_callbacks cb 0x7f0998013070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:27.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.615+0000 7f099dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4d410 0x55f321c51750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.615+0000 7f099dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4d410 0x55f321c51750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47362/0 (socket says 172.21.15.12:47362) 2024-09-19T06:46:27.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.615+0000 7f099dd9b640 1 -- 172.21.15.12:0/2344847834 learned_addr learned my addr 172.21.15.12:0/2344847834 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:27.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.618+0000 7f099e59c640 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c4caf0 0x55f321c601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.618+0000 7f099ed9d640 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c57cb0 0x55f321c51c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.618+0000 7f099dd9b640 1 -- 172.21.15.12:0/2344847834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c4caf0 msgr2=0x55f321c601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:27.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.618+0000 7f099dd9b640 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c4caf0 0x55f321c601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.618+0000 7f099dd9b640 1 -- 172.21.15.12:0/2344847834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c57cb0 msgr2=0x55f321c51c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:27.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.618+0000 7f099dd9b640 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c57cb0 0x55f321c51c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.618+0000 7f099dd9b640 1 -- 172.21.15.12:0/2344847834 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f321c52280 con 0x55f321c4d410 2024-09-19T06:46:27.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.620+0000 7f099dd9b640 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4d410 0x55f321c51750 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0994010780 tx=0x7f0994005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3631de3d2f5b93a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:27.624 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.621+0000 7f0985ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:46:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.622+0000 7f0985ffb640 1 -- 172.21.15.12:0/2344847834 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099402a040 con 0x55f321c4d410 2024-09-19T06:46:27.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.622+0000 7f0985ffb640 1 -- 172.21.15.12:0/2344847834 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0994012810 con 0x55f321c4d410 2024-09-19T06:46:27.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.622+0000 7f09a7c14740 1 -- 172.21.15.12:0/2344847834 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0994005510 con 0x55f321c4d410 2024-09-19T06:46:27.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.624+0000 7f0985ffb640 1 -- 172.21.15.12:0/2344847834 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0994012a10 con 0x55f321c4d410 2024-09-19T06:46:27.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.624+0000 7f09a7c14740 10 client.17217 fetch_fsmap learned FSMap version 39 2024-09-19T06:46:27.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.624+0000 7f09a7c14740 1 -- 172.21.15.12:0/2344847834 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f321ce38b0 con 0x55f321c4d410 2024-09-19T06:46:27.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.625+0000 7f0985ffb640 1 -- 172.21.15.12:0/2344847834 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0994005510 con 0x55f321c4d410 2024-09-19T06:46:27.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.625+0000 7f0985ffb640 1 -- 172.21.15.12:0/2344847834 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7f099402d070 con 0x55f321c4d410 2024-09-19T06:46:27.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.625+0000 7f09a7c14740 10 client.17217 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T06:46:27.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.625+0000 7f09a7c14740 10 client.17217 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.625+0000 7f09a7c14740 20 client.17217 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.625+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f321c78d60 0x55f321ce5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.625+0000 7f09a7c14740 4 client.17217 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:46:27.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.625+0000 7f09a7c14740 1 -- 172.21.15.12:0/2344847834 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f321bbea20 con 0x55f321c78d60 2024-09-19T06:46:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.633+0000 7f099e59c640 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f321c78d60 0x55f321ce5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:27.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.642+0000 7f0985ffb640 10 client.17217 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:27.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.642+0000 7f099e59c640 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f321c78d60 0x55f321ce5f00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee48e3602d6fa04e server_cookie=cbaf36b709a8d751 in_seq=0 out_seq=0 2024-09-19T06:46:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f0985ffb640 1 -- 172.21.15.12:0/2344847834 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f321bbea20 con 0x55f321c78d60 2024-09-19T06:46:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f0985ffb640 10 client.17217 handle_command_reply: tid=0 2024-09-19T06:46:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 client.17217 shutdown 2024-09-19T06:46:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 -- 172.21.15.12:0/2344847834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4d410 msgr2=0x55f321c51750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4d410 0x55f321c51750 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0994010780 tx=0x7f0994005730 comp rx=0 tx=0).stop 2024-09-19T06:46:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 -- 172.21.15.12:0/2344847834 shutdown_connections 2024-09-19T06:46:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f321c78d60 0x55f321ce5f00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f321c57cb0 0x55f321c51c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f321c4d410 0x55f321c51750 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 --2- 172.21.15.12:0/2344847834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f321c4caf0 0x55f321c601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 -- 172.21.15.12:0/2344847834 >> 172.21.15.12:0/2344847834 conn(0x55f321c49060 msgr2=0x55f321c56490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f0985ffb640 0 client.17217 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 -- 172.21.15.12:0/2344847834 shutdown_connections 2024-09-19T06:46:27.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.657+0000 7f09a7c14740 1 -- 172.21.15.12:0/2344847834 wait complete. 2024-09-19T06:46:27.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.658+0000 7f09a7c14740 20 client.17217 trim_cache size 0 max 16384 2024-09-19T06:46:27.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:46:27.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:46:27.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:46:27.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09880a3530 msgr2=0x7f09880a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09880a3530 0x7f09880a59f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0998005cc0 tx=0x7f0998008230 comp rx=0 tx=0).stop 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09a0101ae0 msgr2=0x7f09a010e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09a0101ae0 0x7f09a010e510 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0990009780 tx=0x7f0990033d10 comp rx=0 tx=0).stop 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 shutdown_connections 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a0107b80 0x7f09a010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f09880a3530 0x7f09880a59f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09a0102480 0x7f09a010b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 --2- 172.21.15.12:0/2597074383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09a0101ae0 0x7f09a010e510 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 >> 172.21.15.12:0/2597074383 conn(0x7f09a00fd7e0 msgr2=0x7f09a00fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.660+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 shutdown_connections 2024-09-19T06:46:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:27.661+0000 7f09a4da1640 1 -- 172.21.15.12:0/2597074383 wait complete. 2024-09-19T06:46:28.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:27 smithi016 ceph-mon[34911]: pgmap v192: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.6 MiB/s wr, 821 op/s 2024-09-19T06:46:28.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:27 smithi173 ceph-mon[35349]: pgmap v192: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.6 MiB/s wr, 821 op/s 2024-09-19T06:46:28.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:27 smithi012 ceph-mon[30937]: pgmap v192: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.6 MiB/s wr, 821 op/s 2024-09-19T06:46:30.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:29 smithi016 ceph-mon[34911]: pgmap v193: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.7 MiB/s wr, 635 op/s 2024-09-19T06:46:30.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:29 smithi173 ceph-mon[35349]: pgmap v193: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.7 MiB/s wr, 635 op/s 2024-09-19T06:46:30.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:29 smithi012 ceph-mon[30937]: pgmap v193: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.7 MiB/s wr, 635 op/s 2024-09-19T06:46:30.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 345.0 s, 2986.6 tps, lat 33.343 ms stddev 36.099 2024-09-19T06:46:31.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:30 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:46:31.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:30 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:46:31.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:30 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:46:32.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:31 smithi016 ceph-mon[34911]: pgmap v194: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 969 op/s 2024-09-19T06:46:32.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:31 smithi173 ceph-mon[35349]: pgmap v194: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 969 op/s 2024-09-19T06:46:32.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:31 smithi012 ceph-mon[30937]: pgmap v194: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 969 op/s 2024-09-19T06:46:34.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:33 smithi016 ceph-mon[34911]: pgmap v195: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 632 op/s 2024-09-19T06:46:34.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:33 smithi173 ceph-mon[35349]: pgmap v195: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 632 op/s 2024-09-19T06:46:34.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:33 smithi012 ceph-mon[30937]: pgmap v195: 97 pgs: 97 active+clean; 4.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 632 op/s 2024-09-19T06:46:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 350.0 s, 3998.8 tps, lat 25.102 ms stddev 27.554 2024-09-19T06:46:36.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:35 smithi173 ceph-mon[35349]: pgmap v196: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.9 MiB/s wr, 785 op/s 2024-09-19T06:46:36.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:35 smithi012 ceph-mon[30937]: pgmap v196: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.9 MiB/s wr, 785 op/s 2024-09-19T06:46:36.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:35 smithi016 ceph-mon[34911]: pgmap v196: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.9 MiB/s wr, 785 op/s 2024-09-19T06:46:38.060 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:37 smithi016 ceph-mon[34911]: pgmap v197: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.0 MiB/s wr, 894 op/s 2024-09-19T06:46:38.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:37 smithi173 ceph-mon[35349]: pgmap v197: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.0 MiB/s wr, 894 op/s 2024-09-19T06:46:38.124 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:37 smithi012 ceph-mon[30937]: pgmap v197: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.0 MiB/s wr, 894 op/s 2024-09-19T06:46:39.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:46:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:40.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:39 smithi012 ceph-mon[30937]: pgmap v198: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.6 MiB/s wr, 662 op/s 2024-09-19T06:46:40.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:39 smithi173 ceph-mon[35349]: pgmap v198: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.6 MiB/s wr, 662 op/s 2024-09-19T06:46:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:39 smithi016 ceph-mon[34911]: pgmap v198: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.6 MiB/s wr, 662 op/s 2024-09-19T06:46:40.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.536+0000 7fec7ffff640 1 -- 172.21.15.12:0/2856078831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec8010e060 msgr2=0x7fec8010e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.536+0000 7fec7ffff640 1 --2- 172.21.15.12:0/2856078831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec8010e060 0x7fec8010e440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fec70009930 tx=0x7fec7002a420 comp rx=0 tx=0).stop 2024-09-19T06:46:40.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.539+0000 7fec7ffff640 1 -- 172.21.15.12:0/2856078831 shutdown_connections 2024-09-19T06:46:40.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.539+0000 7fec7ffff640 1 --2- 172.21.15.12:0/2856078831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec80108980 0x7fec80114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.539+0000 7fec7ffff640 1 --2- 172.21.15.12:0/2856078831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec80108020 0x7fec80108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.539+0000 7fec7ffff640 1 --2- 172.21.15.12:0/2856078831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec8010e060 0x7fec8010e440 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.539+0000 7fec7ffff640 1 -- 172.21.15.12:0/2856078831 >> 172.21.15.12:0/2856078831 conn(0x7fec80077980 msgr2=0x7fec80079da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.541+0000 7fec7ffff640 1 -- 172.21.15.12:0/2856078831 shutdown_connections 2024-09-19T06:46:40.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.541+0000 7fec7ffff640 1 -- 172.21.15.12:0/2856078831 wait complete. 2024-09-19T06:46:40.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.542+0000 7fec7ffff640 1 Processor -- start 2024-09-19T06:46:40.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.542+0000 7fec7ffff640 1 -- start start 2024-09-19T06:46:40.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.542+0000 7fec7ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec80108020 0x7fec80073a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.542+0000 7fec7ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec80108980 0x7fec8006ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.543+0000 7fec7ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8010e060 0x7fec8006cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.543+0000 7fec7ffff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fec801183b0 con 0x7fec80108980 2024-09-19T06:46:40.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.543+0000 7fec7ffff640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec80118230 con 0x7fec8010e060 2024-09-19T06:46:40.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.543+0000 7fec7ffff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fec80118530 con 0x7fec80108020 2024-09-19T06:46:40.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.543+0000 7fec7e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec80108980 0x7fec8006ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.543+0000 7fec7e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec80108980 0x7fec8006ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44364/0 (socket says 172.21.15.12:44364) 2024-09-19T06:46:40.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.543+0000 7fec7e7fc640 1 -- 172.21.15.12:0/4247913835 learned_addr learned my addr 172.21.15.12:0/4247913835 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:40.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.543+0000 7fec7f7fe640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8010e060 0x7fec8006cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.543+0000 7fec7effd640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec80108020 0x7fec80073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.544+0000 7fec7e7fc640 1 -- 172.21.15.12:0/4247913835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec80108020 msgr2=0x7fec80073a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.544+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec80108020 0x7fec80073a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.544+0000 7fec7e7fc640 1 -- 172.21.15.12:0/4247913835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8010e060 msgr2=0x7fec8006cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.544+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8010e060 0x7fec8006cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.544+0000 7fec7e7fc640 1 -- 172.21.15.12:0/4247913835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8006d590 con 0x7fec80108980 2024-09-19T06:46:40.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.544+0000 7fec7effd640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec80108020 0x7fec80073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:40.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.545+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec80108980 0x7fec8006ca90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fec7400d950 tx=0x7fec7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.546+0000 7fec848a6640 1 -- 172.21.15.12:0/4247913835 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74017070 con 0x7fec80108980 2024-09-19T06:46:40.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.546+0000 7fec7ffff640 1 -- 172.21.15.12:0/4247913835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8006d880 con 0x7fec80108980 2024-09-19T06:46:40.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.546+0000 7fec7ffff640 1 -- 172.21.15.12:0/4247913835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec80071850 con 0x7fec80108980 2024-09-19T06:46:40.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.546+0000 7fec848a6640 1 -- 172.21.15.12:0/4247913835 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec74009c30 con 0x7fec80108980 2024-09-19T06:46:40.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.546+0000 7fec848a6640 1 -- 172.21.15.12:0/4247913835 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7400f690 con 0x7fec80108980 2024-09-19T06:46:40.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.552+0000 7fec87c81740 1 Processor -- start 2024-09-19T06:46:40.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.553+0000 7fec87c81740 1 -- start start 2024-09-19T06:46:40.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.554+0000 7fec87c81740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77c95a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.554+0000 7fec87c81740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77ca0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.554+0000 7fec87c81740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77ca0850 0x556a77ca2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.554+0000 7fec87c81740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556a77bfb2e0 con 0x556a77c95f90 2024-09-19T06:46:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.554+0000 7fec87c81740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556a77ba2ce0 con 0x556a77c95670 2024-09-19T06:46:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.554+0000 7fec87c81740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556a77bf72a0 con 0x556a77ca0850 2024-09-19T06:46:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.554+0000 7fec848a6640 1 -- 172.21.15.12:0/4247913835 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fec7400f830 con 0x7fec80108980 2024-09-19T06:46:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.554+0000 7fec7effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77ca0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.554+0000 7fec7effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77ca0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44378/0 (socket says 172.21.15.12:44378) 2024-09-19T06:46:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.554+0000 7fec7effd640 1 -- 172.21.15.12:0/2388694495 learned_addr learned my addr 172.21.15.12:0/2388694495 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.555+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/2388694495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77ca0850 0x556a77ca2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.555+0000 7fec7f7fe640 1 --2- 172.21.15.12:0/2388694495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77c95a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.558+0000 7fec7e7fc640 1 -- 172.21.15.12:0/2388694495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 msgr2=0x556a77c95a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.558+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/2388694495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77c95a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.558+0000 7fec7e7fc640 1 -- 172.21.15.12:0/2388694495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 msgr2=0x556a77ca0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.558+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/2388694495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77ca0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.558+0000 7fec7e7fc640 1 -- 172.21.15.12:0/2388694495 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a77b87440 con 0x556a77ca0850 2024-09-19T06:46:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.558+0000 7fec7effd640 1 --2- 172.21.15.12:0/2388694495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77ca0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.558+0000 7fec848a6640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fec680a35c0 0x7fec680a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.558+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/2388694495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77ca0850 0x556a77ca2c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec740ccb30 tx=0x7fec740d7a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf1acaca73870f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.559+0000 7fec848a6640 1 -- 172.21.15.12:0/4247913835 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fec740cf4c0 con 0x7fec80108980 2024-09-19T06:46:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.559+0000 7fec65ffb640 1 -- 172.21.15.12:0/2388694495 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec740e2070 con 0x556a77ca0850 2024-09-19T06:46:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.559+0000 7fec65ffb640 1 -- 172.21.15.12:0/2388694495 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec74096600 con 0x556a77ca0850 2024-09-19T06:46:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.559+0000 7fec65ffb640 1 -- 172.21.15.12:0/2388694495 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7409b600 con 0x556a77ca0850 2024-09-19T06:46:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.560+0000 7fec7f7fe640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fec680a35c0 0x7fec680a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.560+0000 7fec87c81740 1 -- 172.21.15.12:0/2388694495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77ca0850 msgr2=0x556a77ca2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.560+0000 7fec87c81740 1 --2- 172.21.15.12:0/2388694495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77ca0850 0x556a77ca2c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fec740ccb30 tx=0x7fec740d7a30 comp rx=0 tx=0).stop 2024-09-19T06:46:40.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.561+0000 7fec87c81740 1 -- 172.21.15.12:0/2388694495 shutdown_connections 2024-09-19T06:46:40.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.561+0000 7fec87c81740 1 --2- 172.21.15.12:0/2388694495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77ca0850 0x556a77ca2c40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.561+0000 7fec87c81740 1 --2- 172.21.15.12:0/2388694495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77ca0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.561+0000 7fec87c81740 1 --2- 172.21.15.12:0/2388694495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77c95a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.561+0000 7fec87c81740 1 -- 172.21.15.12:0/2388694495 >> 172.21.15.12:0/2388694495 conn(0x556a77c91c00 msgr2=0x556a77c91fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.561+0000 7fec7f7fe640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fec680a35c0 0x7fec680a5a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec78005fd0 tx=0x7fec78009750 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.561+0000 7fec87c81740 1 -- 172.21.15.12:0/2388694495 shutdown_connections 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.561+0000 7fec87c81740 1 -- 172.21.15.12:0/2388694495 wait complete. 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.562+0000 7fec87c81740 1 -- start start 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.562+0000 7fec87c81740 1 Processor -- start 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.562+0000 7fec87c81740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.563+0000 7fec87c81740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 0x556a77c9d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.563+0000 7fec87c81740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77ca0850 0x556a77c9dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.563+0000 7fec87c81740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556a77ca3420 con 0x556a77ca0850 2024-09-19T06:46:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.563+0000 7fec87c81740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556a77bb6050 con 0x556a77c95670 2024-09-19T06:46:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.563+0000 7fec87c81740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556a77ca35a0 con 0x556a77c95f90 2024-09-19T06:46:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.563+0000 7fec87c81740 10 client.0 _ll_register_callbacks cb 0x556a77bf6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.563+0000 7fec7e7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 0x556a77c9d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.563+0000 7fec7e7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 0x556a77c9d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43358/0 (socket says 172.21.15.12:43358) 2024-09-19T06:46:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.563+0000 7fec7e7fc640 1 -- 172.21.15.12:0/3855021534 learned_addr learned my addr 172.21.15.12:0/3855021534 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.563+0000 7fec7effd640 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.564+0000 7fec7f7fe640 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77ca0850 0x556a77c9dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.564+0000 7fec7effd640 1 -- 172.21.15.12:0/3855021534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 msgr2=0x556a77c9d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.564+0000 7fec7effd640 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 0x556a77c9d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.564+0000 7fec7effd640 1 -- 172.21.15.12:0/3855021534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77ca0850 msgr2=0x556a77c9dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.564+0000 7fec7effd640 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77ca0850 0x556a77c9dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.564+0000 7fec7effd640 1 -- 172.21.15.12:0/3855021534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a7796c3c0 con 0x556a77c95670 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.565+0000 7fec7effd640 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca0210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fec70005c40 tx=0x7fec700052e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ebe500465f6220c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.565+0000 7fec5effd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.565+0000 7fec5effd640 1 -- 172.21.15.12:0/3855021534 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70035040 con 0x556a77c95670 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.566+0000 7fec87c81740 1 -- 172.21.15.12:0/3855021534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec74096600 con 0x556a77c95670 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.566+0000 7fec5effd640 1 -- 172.21.15.12:0/3855021534 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fec70004900 con 0x556a77c95670 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.566+0000 7fec5effd640 1 -- 172.21.15.12:0/3855021534 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fec7004d050 con 0x556a77c95670 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.566+0000 7fec87c81740 10 client.26729 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:40.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.566+0000 7fec87c81740 1 -- 172.21.15.12:0/3855021534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x556a77cd0ee0 con 0x556a77c95670 2024-09-19T06:46:40.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.573+0000 7fec5effd640 1 -- 172.21.15.12:0/3855021534 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec74096600 con 0x556a77c95670 2024-09-19T06:46:40.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.573+0000 7fec5effd640 1 -- 172.21.15.12:0/3855021534 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fec70044070 con 0x556a77c95670 2024-09-19T06:46:40.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.574+0000 7fec87c81740 10 client.26729 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.574+0000 7fec87c81740 10 client.26729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.574+0000 7fec87c81740 20 client.26729 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.574+0000 7fec87c81740 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556a77cd2830 0x556a77cd4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.574+0000 7fec87c81740 4 client.26729 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.574+0000 7fec87c81740 1 -- 172.21.15.12:0/3855021534 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a77c08850 con 0x556a77cd2830 2024-09-19T06:46:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.579+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556a77cd2830 0x556a77cd4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.583+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556a77cd2830 0x556a77cd4c90 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e51629668f9e3c1 server_cookie=5a9765f428f0f9b3 in_seq=0 out_seq=0 2024-09-19T06:46:40.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.583+0000 7fec5effd640 10 client.26729 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:40.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.585+0000 7fec5effd640 1 -- 172.21.15.12:0/3855021534 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a77c08850 con 0x556a77cd2830 2024-09-19T06:46:40.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.585+0000 7fec5effd640 10 client.26729 handle_command_reply: tid=0 2024-09-19T06:46:40.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.585+0000 7fec87c81740 1 client.26729 shutdown 2024-09-19T06:46:40.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.590+0000 7fec87c81740 1 -- 172.21.15.12:0/3855021534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 msgr2=0x556a77ca0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.590+0000 7fec87c81740 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca0210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fec70005c40 tx=0x7fec700052e0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.591+0000 7fec87c81740 1 -- 172.21.15.12:0/3855021534 shutdown_connections 2024-09-19T06:46:40.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.591+0000 7fec87c81740 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556a77cd2830 0x556a77cd4c90 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.591+0000 7fec87c81740 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77ca0850 0x556a77c9dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.591+0000 7fec87c81740 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 0x556a77c9d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.591+0000 7fec87c81740 1 --2- 172.21.15.12:0/3855021534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca0210 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.591+0000 7fec87c81740 1 -- 172.21.15.12:0/3855021534 >> 172.21.15.12:0/3855021534 conn(0x556a77c91c00 msgr2=0x556a77c97930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.591+0000 7fec5effd640 0 client.26729 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:40.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.594+0000 7fec87c81740 1 -- 172.21.15.12:0/3855021534 shutdown_connections 2024-09-19T06:46:40.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.594+0000 7fec87c81740 1 -- 172.21.15.12:0/3855021534 wait complete. 2024-09-19T06:46:40.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.594+0000 7fec87c81740 20 client.26729 trim_cache size 0 max 16384 2024-09-19T06:46:40.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.630+0000 7fec87c81740 1 Processor -- start 2024-09-19T06:46:40.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.630+0000 7fec87c81740 1 -- start start 2024-09-19T06:46:40.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.630+0000 7fec87c81740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95670 0x556a77c9d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.631+0000 7fec87c81740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77cac710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.631+0000 7fec87c81740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77ca0850 0x556a77cda5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.631+0000 7fec87c81740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c00eae0 con 0x556a77c95f90 2024-09-19T06:46:40.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.631+0000 7fec87c81740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c010740 con 0x556a77ca0850 2024-09-19T06:46:40.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.631+0000 7fec87c81740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c00f1b0 con 0x556a77c95670 2024-09-19T06:46:40.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.631+0000 7fec7e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77cac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.631+0000 7fec7e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77cac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44392/0 (socket says 172.21.15.12:44392) 2024-09-19T06:46:40.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.631+0000 7fec7e7fc640 1 -- 172.21.15.12:0/2672414449 learned_addr learned my addr 172.21.15.12:0/2672414449 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:40.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.631+0000 7fec7f7fe640 1 --2- 172.21.15.12:0/2672414449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77ca0850 0x556a77cda5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.631+0000 7fec7effd640 1 --2- 172.21.15.12:0/2672414449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95670 0x556a77c9d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.632+0000 7fec7f7fe640 1 -- 172.21.15.12:0/2672414449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95670 msgr2=0x556a77c9d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.632+0000 7fec7f7fe640 1 --2- 172.21.15.12:0/2672414449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95670 0x556a77c9d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.632+0000 7fec7f7fe640 1 -- 172.21.15.12:0/2672414449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 msgr2=0x556a77cac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.632+0000 7fec7f7fe640 1 --2- 172.21.15.12:0/2672414449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77cac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.632+0000 7fec7f7fe640 1 -- 172.21.15.12:0/2672414449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a77c9de20 con 0x556a77ca0850 2024-09-19T06:46:40.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.635+0000 7fec7f7fe640 1 --2- 172.21.15.12:0/2672414449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77ca0850 0x556a77cda5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fec78012cb0 tx=0x7fec78015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf9c08d23bde601 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.637+0000 7fec657fa640 1 -- 172.21.15.12:0/2672414449 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78003970 con 0x556a77ca0850 2024-09-19T06:46:40.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.637+0000 7fec657fa640 1 -- 172.21.15.12:0/2672414449 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec78004020 con 0x556a77ca0850 2024-09-19T06:46:40.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.638+0000 7fec87c81740 1 -- 172.21.15.12:0/2672414449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77ca0850 msgr2=0x556a77cda5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.638+0000 7fec87c81740 1 --2- 172.21.15.12:0/2672414449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77ca0850 0x556a77cda5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fec78012cb0 tx=0x7fec78015000 comp rx=0 tx=0).stop 2024-09-19T06:46:40.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.640+0000 7fec87c81740 1 -- 172.21.15.12:0/2672414449 shutdown_connections 2024-09-19T06:46:40.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.640+0000 7fec87c81740 1 --2- 172.21.15.12:0/2672414449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77ca0850 0x556a77cda5a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.640+0000 7fec87c81740 1 --2- 172.21.15.12:0/2672414449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77c95f90 0x556a77cac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.640+0000 7fec87c81740 1 --2- 172.21.15.12:0/2672414449 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95670 0x556a77c9d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.640+0000 7fec87c81740 1 -- 172.21.15.12:0/2672414449 >> 172.21.15.12:0/2672414449 conn(0x556a77c91c00 msgr2=0x556a77c9cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.641+0000 7fec87c81740 1 -- 172.21.15.12:0/2672414449 shutdown_connections 2024-09-19T06:46:40.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.641+0000 7fec87c81740 1 -- 172.21.15.12:0/2672414449 wait complete. 2024-09-19T06:46:40.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.642+0000 7fec87c81740 1 -- start start 2024-09-19T06:46:40.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.642+0000 7fec87c81740 1 Processor -- start 2024-09-19T06:46:40.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec87c81740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec87c81740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 0x556a77ca4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec87c81740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77ca0850 0x556a77d3b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec87c81740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c00ffb0 con 0x556a77ca0850 2024-09-19T06:46:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec87c81740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c00f8e0 con 0x556a77c95670 2024-09-19T06:46:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec87c81740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c00cac0 con 0x556a77c95f90 2024-09-19T06:46:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec87c81740 10 client.0 _ll_register_callbacks cb 0x7fec70009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec7effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec7effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50466/0 (socket says 172.21.15.12:50466) 2024-09-19T06:46:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec7effd640 1 -- 172.21.15.12:0/1043827246 learned_addr learned my addr 172.21.15.12:0/1043827246 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:40.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.643+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 0x556a77ca4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.644+0000 7fec7effd640 1 -- 172.21.15.12:0/1043827246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 msgr2=0x556a77ca4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.644+0000 7fec7effd640 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 0x556a77ca4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.644+0000 7fec7effd640 1 -- 172.21.15.12:0/1043827246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77ca0850 msgr2=0x556a77d3b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.644+0000 7fec7effd640 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77ca0850 0x556a77d3b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.644+0000 7fec7effd640 1 -- 172.21.15.12:0/1043827246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a77d3bb20 con 0x556a77c95670 2024-09-19T06:46:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.644+0000 7fec7effd640 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca3de0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fec70003da0 tx=0x7fec7002a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a79203da28575eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.644+0000 7fec5effd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.644+0000 7fec5effd640 1 -- 172.21.15.12:0/1043827246 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70035040 con 0x556a77c95670 2024-09-19T06:46:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.644+0000 7fec5effd640 1 -- 172.21.15.12:0/1043827246 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fec700319c0 con 0x556a77c95670 2024-09-19T06:46:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.645+0000 7fec87c81740 1 -- 172.21.15.12:0/1043827246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec78004020 con 0x556a77c95670 2024-09-19T06:46:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.645+0000 7fec5effd640 1 -- 172.21.15.12:0/1043827246 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fec70003890 con 0x556a77c95670 2024-09-19T06:46:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.645+0000 7fec87c81740 10 client.26735 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.645+0000 7fec87c81740 1 -- 172.21.15.12:0/1043827246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x556a77d3ce30 con 0x556a77c95670 2024-09-19T06:46:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.645+0000 7fec5effd640 1 -- 172.21.15.12:0/1043827246 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec78004020 con 0x556a77c95670 2024-09-19T06:46:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.645+0000 7fec5effd640 1 -- 172.21.15.12:0/1043827246 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fec70044040 con 0x556a77c95670 2024-09-19T06:46:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.645+0000 7fec87c81740 10 client.26735 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.645+0000 7fec87c81740 10 client.26735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.645+0000 7fec87c81740 20 client.26735 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.646+0000 7fec87c81740 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556a77d3d670 0x556a77d3fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.646+0000 7fec87c81740 4 client.26735 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:46:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.646+0000 7fec87c81740 1 -- 172.21.15.12:0/1043827246 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556a77c02d60 con 0x556a77d3d670 2024-09-19T06:46:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.646+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556a77d3d670 0x556a77d3fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.647+0000 7fec7e7fc640 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556a77d3d670 0x556a77d3fad0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c453ce6f22dfd2f5 server_cookie=1a801733b4e6adde in_seq=0 out_seq=0 2024-09-19T06:46:40.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.647+0000 7fec5effd640 10 client.26735 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec5effd640 1 -- 172.21.15.12:0/1043827246 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556a77c02d60 con 0x556a77d3d670 2024-09-19T06:46:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec5effd640 10 client.26735 handle_command_reply: tid=0 2024-09-19T06:46:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec87c81740 1 client.26735 shutdown 2024-09-19T06:46:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec87c81740 1 -- 172.21.15.12:0/1043827246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 msgr2=0x556a77ca3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec87c81740 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca3de0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fec70003da0 tx=0x7fec7002a420 comp rx=0 tx=0).stop 2024-09-19T06:46:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec87c81740 1 -- 172.21.15.12:0/1043827246 shutdown_connections 2024-09-19T06:46:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec87c81740 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556a77d3d670 0x556a77d3fad0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec87c81740 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556a77ca0850 0x556a77d3b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec87c81740 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a77c95f90 0x556a77ca4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec87c81740 1 --2- 172.21.15.12:0/1043827246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556a77c95670 0x556a77ca3de0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec87c81740 1 -- 172.21.15.12:0/1043827246 >> 172.21.15.12:0/1043827246 conn(0x556a77c91c00 msgr2=0x556a77c97110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.648+0000 7fec5effd640 0 client.26735 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.649+0000 7fec87c81740 1 -- 172.21.15.12:0/1043827246 shutdown_connections 2024-09-19T06:46:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.649+0000 7fec87c81740 1 -- 172.21.15.12:0/1043827246 wait complete. 2024-09-19T06:46:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.652+0000 7fec87c81740 20 client.26735 trim_cache size 0 max 16384 2024-09-19T06:46:40.653 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:46:40.653 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:46:40.653 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:46:40.654 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:46:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 -- 172.21.15.12:0/4247913835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fec680a35c0 msgr2=0x7fec680a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fec680a35c0 0x7fec680a5a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec78005fd0 tx=0x7fec78009750 comp rx=0 tx=0).stop 2024-09-19T06:46:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 -- 172.21.15.12:0/4247913835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec80108980 msgr2=0x7fec8006ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec80108980 0x7fec8006ca90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fec7400d950 tx=0x7fec7400de10 comp rx=0 tx=0).stop 2024-09-19T06:46:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 -- 172.21.15.12:0/4247913835 shutdown_connections 2024-09-19T06:46:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec8010e060 0x7fec8006cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec80108980 0x7fec8006ca90 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fec680a35c0 0x7fec680a5a80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 --2- 172.21.15.12:0/4247913835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec80108020 0x7fec80073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 -- 172.21.15.12:0/4247913835 >> 172.21.15.12:0/4247913835 conn(0x7fec80077980 msgr2=0x7fec800791e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 -- 172.21.15.12:0/4247913835 shutdown_connections 2024-09-19T06:46:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:40.653+0000 7fec7ffff640 1 -- 172.21.15.12:0/4247913835 wait complete. 2024-09-19T06:46:40.809 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 355.0 s, 4185.6 tps, lat 23.757 ms stddev 28.876 2024-09-19T06:46:40.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.824+0000 7f5021552640 1 -- 172.21.15.12:0/2586797590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f501c074620 msgr2=0x7f501c074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.826 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.825+0000 7f5021552640 1 --2- 172.21.15.12:0/2586797590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f501c074620 0x7f501c074a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f500c009900 tx=0x7f500c02a4b0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.828+0000 7f5021552640 1 -- 172.21.15.12:0/2586797590 shutdown_connections 2024-09-19T06:46:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.828+0000 7f5021552640 1 --2- 172.21.15.12:0/2586797590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f501c10e300 0x7f501c110750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.828+0000 7f5021552640 1 --2- 172.21.15.12:0/2586797590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f501c074f40 0x7f501c10ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.828+0000 7f5021552640 1 --2- 172.21.15.12:0/2586797590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f501c074620 0x7f501c074a00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.828+0000 7f5021552640 1 -- 172.21.15.12:0/2586797590 >> 172.21.15.12:0/2586797590 conn(0x7f501c0fd820 msgr2=0x7f501c0ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.829+0000 7f5021552640 1 -- 172.21.15.12:0/2586797590 shutdown_connections 2024-09-19T06:46:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.829+0000 7f5021552640 1 -- 172.21.15.12:0/2586797590 wait complete. 2024-09-19T06:46:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.830+0000 7f5021552640 1 Processor -- start 2024-09-19T06:46:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.830+0000 7f5021552640 1 -- start start 2024-09-19T06:46:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.831+0000 7f5021552640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f501c074620 0x7f501c073950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.831+0000 7f5021552640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f501c074f40 0x7f501c073e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.831+0000 7f5021552640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f501c10e300 0x7f501c06cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.831+0000 7f5021552640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f501c1141c0 con 0x7f501c074f40 2024-09-19T06:46:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.831+0000 7f5021552640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f501c114040 con 0x7f501c10e300 2024-09-19T06:46:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.831+0000 7f5021552640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f501c114340 con 0x7f501c074620 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.831+0000 7f501affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f501c074620 0x7f501c073950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.831+0000 7f501affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f501c074620 0x7f501c073950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43388/0 (socket says 172.21.15.12:43388) 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.831+0000 7f501affd640 1 -- 172.21.15.12:0/4008945993 learned_addr learned my addr 172.21.15.12:0/4008945993 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.832+0000 7f501affd640 1 -- 172.21.15.12:0/4008945993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f501c10e300 msgr2=0x7f501c06cb60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.832+0000 7f501affd640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f501c10e300 0x7f501c06cb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.832+0000 7f501affd640 1 -- 172.21.15.12:0/4008945993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f501c074f40 msgr2=0x7f501c073e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.832+0000 7f501affd640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f501c074f40 0x7f501c073e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.832+0000 7f501affd640 1 -- 172.21.15.12:0/4008945993 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c06d420 con 0x7f501c074620 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.832+0000 7f501affd640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f501c074620 0x7f501c073950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f500c02aaa0 tx=0x7f500c005230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.833+0000 7f5003fff640 1 -- 172.21.15.12:0/4008945993 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c03f070 con 0x7f501c074620 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.833+0000 7f5003fff640 1 -- 172.21.15.12:0/4008945993 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f500c005630 con 0x7f501c074620 2024-09-19T06:46:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.833+0000 7f5003fff640 1 -- 172.21.15.12:0/4008945993 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c035030 con 0x7f501c074620 2024-09-19T06:46:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.833+0000 7f5021552640 1 -- 172.21.15.12:0/4008945993 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c06d6b0 con 0x7f501c074620 2024-09-19T06:46:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.833+0000 7f5021552640 1 -- 172.21.15.12:0/4008945993 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c0716a0 con 0x7f501c074620 2024-09-19T06:46:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.838+0000 7f50243cb740 1 Processor -- start 2024-09-19T06:46:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.838+0000 7f50243cb740 1 -- start start 2024-09-19T06:46:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.838+0000 7f50243cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 0x55c2fbc50ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.838+0000 7f50243cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 0x55c2fbc5b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.838+0000 7f50243cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc5e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.839+0000 7f50243cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbbb52f0 con 0x55c2fbc50af0 2024-09-19T06:46:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.839+0000 7f50243cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbb5d270 con 0x55c2fbc51410 2024-09-19T06:46:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.839+0000 7f50243cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbbb12b0 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.839+0000 7f501a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc5e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.839+0000 7f501a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc5e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43402/0 (socket says 172.21.15.12:43402) 2024-09-19T06:46:40.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.839+0000 7f501a7fc640 1 -- 172.21.15.12:0/2068452147 learned_addr learned my addr 172.21.15.12:0/2068452147 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:40.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.839+0000 7f501b7fe640 1 --2- 172.21.15.12:0/2068452147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 0x55c2fbc50ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.839+0000 7f501a7fc640 1 -- 172.21.15.12:0/2068452147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 msgr2=0x55c2fbc5b770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:40.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.839+0000 7f501a7fc640 1 --2- 172.21.15.12:0/2068452147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 0x55c2fbc5b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.839+0000 7f501a7fc640 1 -- 172.21.15.12:0/2068452147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 msgr2=0x55c2fbc50ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.840+0000 7f501a7fc640 1 --2- 172.21.15.12:0/2068452147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 0x55c2fbc50ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.840+0000 7f501a7fc640 1 -- 172.21.15.12:0/2068452147 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2fbb5c340 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.840+0000 7f501b7fe640 1 --2- 172.21.15.12:0/2068452147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 0x55c2fbc50ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:40.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.841+0000 7f501a7fc640 1 --2- 172.21.15.12:0/2068452147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc5e0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f50100097b0 tx=0x7f5010009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59342998fa5eb353 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.841+0000 7f5003fff640 1 -- 172.21.15.12:0/4008945993 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f500c042070 con 0x7f501c074620 2024-09-19T06:46:40.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.841+0000 7f50017fa640 1 -- 172.21.15.12:0/2068452147 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010015020 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.841+0000 7f50017fa640 1 -- 172.21.15.12:0/2068452147 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5010011420 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.841+0000 7f50017fa640 1 -- 172.21.15.12:0/2068452147 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50100105e0 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.842+0000 7f5003fff640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50040a35b0 0x7f50040a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.842+0000 7f5003fff640 1 -- 172.21.15.12:0/4008945993 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f500c0f0760 con 0x7f501c074620 2024-09-19T06:46:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.842+0000 7f50243cb740 1 -- 172.21.15.12:0/2068452147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 msgr2=0x55c2fbc5e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.842+0000 7f50243cb740 1 --2- 172.21.15.12:0/2068452147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc5e0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f50100097b0 tx=0x7f5010009c70 comp rx=0 tx=0).stop 2024-09-19T06:46:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.842+0000 7f50243cb740 1 -- 172.21.15.12:0/2068452147 shutdown_connections 2024-09-19T06:46:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.842+0000 7f50243cb740 1 --2- 172.21.15.12:0/2068452147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc5e0a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.842+0000 7f50243cb740 1 --2- 172.21.15.12:0/2068452147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 0x55c2fbc5b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.842+0000 7f50243cb740 1 --2- 172.21.15.12:0/2068452147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 0x55c2fbc50ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.842+0000 7f50243cb740 1 -- 172.21.15.12:0/2068452147 >> 172.21.15.12:0/2068452147 conn(0x55c2fbc4d060 msgr2=0x55c2fbc4d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.843+0000 7f50243cb740 1 -- 172.21.15.12:0/2068452147 shutdown_connections 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.843+0000 7f501b7fe640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50040a35b0 0x7f50040a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.843+0000 7f50243cb740 1 -- 172.21.15.12:0/2068452147 wait complete. 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.843+0000 7f50243cb740 1 -- start start 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.843+0000 7f50243cb740 1 Processor -- start 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f501b7fe640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50040a35b0 0x7f50040a5a70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5014009e80 tx=0x7f5014009410 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f50243cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc58b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f50243cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 0x55c2fbc59090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f50243cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f50243cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbc67090 con 0x55c2fbc51410 2024-09-19T06:46:40.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f50243cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbb3e290 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f50243cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbc67210 con 0x55c2fbc50af0 2024-09-19T06:46:40.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f50243cb740 10 client.0 _ll_register_callbacks cb 0x55c2fbb6f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f501affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc58b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f501affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc58b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43404/0 (socket says 172.21.15.12:43404) 2024-09-19T06:46:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f501affd640 1 -- 172.21.15.12:0/4172987390 learned_addr learned my addr 172.21.15.12:0/4172987390 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f501a7fc640 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 0x55c2fbc59090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.844+0000 7f501b7fe640 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.845+0000 7f501affd640 1 -- 172.21.15.12:0/4172987390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 msgr2=0x55c2fbc595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.845+0000 7f501affd640 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.845+0000 7f501affd640 1 -- 172.21.15.12:0/4172987390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 msgr2=0x55c2fbc59090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.845+0000 7f501affd640 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 0x55c2fbc59090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.845+0000 7f501affd640 1 -- 172.21.15.12:0/4172987390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2fb8c8210 con 0x55c2fbc50af0 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.845+0000 7f501b7fe640 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.845+0000 7f501affd640 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc58b50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f500c0ede30 tx=0x7f500c0bc380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688a9860240adf3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.845+0000 7f4ffeff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.845+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4172987390 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c049040 con 0x55c2fbc50af0 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.846+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4172987390 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f500c0ee050 con 0x55c2fbc50af0 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.846+0000 7f50243cb740 1 -- 172.21.15.12:0/4172987390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5010011420 con 0x55c2fbc50af0 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.846+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4172987390 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f500c0ee250 con 0x55c2fbc50af0 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.846+0000 7f50243cb740 10 client.26698 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.846+0000 7f50243cb740 1 -- 172.21.15.12:0/4172987390 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c2fb994620 con 0x55c2fbc50af0 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.847+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4172987390 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5010011420 con 0x55c2fbc50af0 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.847+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4172987390 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f500c0c5140 con 0x55c2fbc50af0 2024-09-19T06:46:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.847+0000 7f50243cb740 10 client.26698 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.847+0000 7f50243cb740 10 client.26698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.847+0000 7f50243cb740 20 client.26698 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.847+0000 7f50243cb740 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2fbc74530 0x55c2fbc76970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.847+0000 7f50243cb740 4 client.26698 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.847+0000 7f50243cb740 1 -- 172.21.15.12:0/4172987390 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2fbbc2a20 con 0x55c2fbc74530 2024-09-19T06:46:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.847+0000 7f501a7fc640 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2fbc74530 0x55c2fbc76970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.848+0000 7f4ffeff5640 10 client.26698 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.848+0000 7f501a7fc640 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2fbc74530 0x55c2fbc76970 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd58af155d3e1040 server_cookie=e0b889cb63de6e52 in_seq=0 out_seq=0 2024-09-19T06:46:40.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.848+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4172987390 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2fbbc2a20 con 0x55c2fbc74530 2024-09-19T06:46:40.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.848+0000 7f4ffeff5640 10 client.26698 handle_command_reply: tid=0 2024-09-19T06:46:40.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.848+0000 7f50243cb740 1 client.26698 shutdown 2024-09-19T06:46:40.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.849+0000 7f50243cb740 1 -- 172.21.15.12:0/4172987390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 msgr2=0x55c2fbc58b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.849+0000 7f50243cb740 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc58b50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f500c0ede30 tx=0x7f500c0bc380 comp rx=0 tx=0).stop 2024-09-19T06:46:40.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.849+0000 7f50243cb740 1 -- 172.21.15.12:0/4172987390 shutdown_connections 2024-09-19T06:46:40.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.849+0000 7f50243cb740 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2fbc74530 0x55c2fbc76970 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.850+0000 7f50243cb740 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.850+0000 7f50243cb740 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 0x55c2fbc59090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.850+0000 7f50243cb740 1 --2- 172.21.15.12:0/4172987390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc58b50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.850+0000 7f50243cb740 1 -- 172.21.15.12:0/4172987390 >> 172.21.15.12:0/4172987390 conn(0x55c2fbc4d060 msgr2=0x55c2fbc52dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.850+0000 7f4ffeff5640 0 client.26698 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:40.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.850+0000 7f50243cb740 1 -- 172.21.15.12:0/4172987390 shutdown_connections 2024-09-19T06:46:40.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.850+0000 7f50243cb740 1 -- 172.21.15.12:0/4172987390 wait complete. 2024-09-19T06:46:40.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.850+0000 7f50243cb740 20 client.26698 trim_cache size 0 max 16384 2024-09-19T06:46:40.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.880+0000 7f50243cb740 1 Processor -- start 2024-09-19T06:46:40.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f50243cb740 1 -- start start 2024-09-19T06:46:40.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f50243cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 0x55c2fbc59400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f50243cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 0x55c2fbc5aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f50243cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc7c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f50243cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f500800e9d0 con 0x55c2fbc50af0 2024-09-19T06:46:40.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f50243cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5008010630 con 0x55c2fbc51410 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f501a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 0x55c2fbc5aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f50243cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f500800f0a0 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f501a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 0x55c2fbc5aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50500/0 (socket says 172.21.15.12:50500) 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f501a7fc640 1 -- 172.21.15.12:0/102056001 learned_addr learned my addr 172.21.15.12:0/102056001 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f501affd640 1 --2- 172.21.15.12:0/102056001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 0x55c2fbc59400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.881+0000 7f501b7fe640 1 --2- 172.21.15.12:0/102056001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc7c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.882+0000 7f501a7fc640 1 -- 172.21.15.12:0/102056001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 msgr2=0x55c2fbc7c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.882+0000 7f501a7fc640 1 --2- 172.21.15.12:0/102056001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc7c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.882+0000 7f501a7fc640 1 -- 172.21.15.12:0/102056001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 msgr2=0x55c2fbc59400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.882+0000 7f501a7fc640 1 --2- 172.21.15.12:0/102056001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 0x55c2fbc59400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.882+0000 7f501a7fc640 1 -- 172.21.15.12:0/102056001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2fbc66f70 con 0x55c2fbc51410 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.882+0000 7f501a7fc640 1 --2- 172.21.15.12:0/102056001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 0x55c2fbc5aac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55c2fbc53690 tx=0x7f5010009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637b9e7c03d6f222 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.882+0000 7f5000ff9640 1 -- 172.21.15.12:0/102056001 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501002e070 con 0x55c2fbc51410 2024-09-19T06:46:40.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.882+0000 7f5000ff9640 1 -- 172.21.15.12:0/102056001 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5010011420 con 0x55c2fbc51410 2024-09-19T06:46:40.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.882+0000 7f5000ff9640 1 -- 172.21.15.12:0/102056001 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010015040 con 0x55c2fbc51410 2024-09-19T06:46:40.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.883+0000 7f50243cb740 1 -- 172.21.15.12:0/102056001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 msgr2=0x55c2fbc5aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.883+0000 7f50243cb740 1 --2- 172.21.15.12:0/102056001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 0x55c2fbc5aac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55c2fbc53690 tx=0x7f5010009040 comp rx=0 tx=0).stop 2024-09-19T06:46:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.883+0000 7f50243cb740 1 -- 172.21.15.12:0/102056001 shutdown_connections 2024-09-19T06:46:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.883+0000 7f50243cb740 1 --2- 172.21.15.12:0/102056001 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc7c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.883+0000 7f50243cb740 1 --2- 172.21.15.12:0/102056001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc51410 0x55c2fbc5aac0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.884+0000 7f50243cb740 1 --2- 172.21.15.12:0/102056001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc50af0 0x55c2fbc59400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.884+0000 7f50243cb740 1 -- 172.21.15.12:0/102056001 >> 172.21.15.12:0/102056001 conn(0x55c2fbc4d060 msgr2=0x55c2fbc5a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.884+0000 7f50243cb740 1 -- 172.21.15.12:0/102056001 shutdown_connections 2024-09-19T06:46:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.884+0000 7f50243cb740 1 -- 172.21.15.12:0/102056001 wait complete. 2024-09-19T06:46:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.884+0000 7f50243cb740 1 -- start start 2024-09-19T06:46:40.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.885+0000 7f50243cb740 1 Processor -- start 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.887+0000 7f50243cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc6c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.887+0000 7f50243cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 0x55c2fbc6ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.887+0000 7f50243cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc67ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f50243cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f500800fea0 con 0x55c2fbc51410 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f50243cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f500800f7d0 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f50243cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f500800c9b0 con 0x55c2fbc50af0 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f50243cb740 10 client.0 _ll_register_callbacks cb 0x7f500c009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f501a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 0x55c2fbc6ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f501a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 0x55c2fbc6ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44452/0 (socket says 172.21.15.12:44452) 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f501a7fc640 1 -- 172.21.15.12:0/4164114938 learned_addr learned my addr 172.21.15.12:0/4164114938 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:40.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f501affd640 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc6c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f501b7fe640 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc67ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f501b7fe640 1 -- 172.21.15.12:0/4164114938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 msgr2=0x55c2fbc6c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f501b7fe640 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc6c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f501b7fe640 1 -- 172.21.15.12:0/4164114938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 msgr2=0x55c2fbc6ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f501b7fe640 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 0x55c2fbc6ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.888+0000 7f501b7fe640 1 -- 172.21.15.12:0/4164114938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2fbc686d0 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.889+0000 7f501affd640 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc6c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:40.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.889+0000 7f501b7fe640 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc67ea0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f501400bc70 tx=0x7f5014004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1c89e156ce62acd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:40.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.889+0000 7f4ffeff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:40.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.889+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4164114938 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014027020 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.889+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4164114938 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f5014015b30 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.889+0000 7f50243cb740 1 -- 172.21.15.12:0/4164114938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5010011420 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.890+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4164114938 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f5014015d30 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.891+0000 7f50243cb740 10 client.26744 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:40.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.891+0000 7f50243cb740 1 -- 172.21.15.12:0/4164114938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c2fbcdeef0 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.894+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4164114938 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5010011420 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.894+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4164114938 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f5014034020 con 0x55c2fbc5bcb0 2024-09-19T06:46:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.894+0000 7f50243cb740 10 client.26744 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.894+0000 7f50243cb740 10 client.26744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.894+0000 7f50243cb740 20 client.26744 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.895+0000 7f50243cb740 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2fbcdf730 0x55c2fbce1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.895+0000 7f50243cb740 4 client.26744 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:46:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.895+0000 7f50243cb740 1 -- 172.21.15.12:0/4164114938 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2fbbbcd70 con 0x55c2fbcdf730 2024-09-19T06:46:40.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.895+0000 7f501affd640 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2fbcdf730 0x55c2fbce1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.895+0000 7f501affd640 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2fbcdf730 0x55c2fbce1b50 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7d3793f5a2f549b server_cookie=42dbd96753cdd7f3 in_seq=0 out_seq=0 2024-09-19T06:46:40.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.895+0000 7f4ffeff5640 10 client.26744 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:40.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.911+0000 7f4ffeff5640 1 -- 172.21.15.12:0/4164114938 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2fbbbcd70 con 0x55c2fbcdf730 2024-09-19T06:46:40.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.911+0000 7f4ffeff5640 10 client.26744 handle_command_reply: tid=0 2024-09-19T06:46:40.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.911+0000 7f50243cb740 1 client.26744 shutdown 2024-09-19T06:46:40.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.913+0000 7f50243cb740 1 -- 172.21.15.12:0/4164114938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 msgr2=0x55c2fbc67ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.913+0000 7f50243cb740 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc67ea0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f501400bc70 tx=0x7f5014004b50 comp rx=0 tx=0).stop 2024-09-19T06:46:40.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.913+0000 7f50243cb740 1 -- 172.21.15.12:0/4164114938 shutdown_connections 2024-09-19T06:46:40.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.913+0000 7f50243cb740 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2fbcdf730 0x55c2fbce1b50 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.913+0000 7f50243cb740 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2fbc5bcb0 0x55c2fbc67ea0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.913+0000 7f50243cb740 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2fbc51410 0x55c2fbc6ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.913+0000 7f50243cb740 1 --2- 172.21.15.12:0/4164114938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2fbc50af0 0x55c2fbc6c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.913+0000 7f4ffeff5640 0 client.26744 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:40.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.913+0000 7f50243cb740 1 -- 172.21.15.12:0/4164114938 >> 172.21.15.12:0/4164114938 conn(0x55c2fbc4d060 msgr2=0x55c2fbc4c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.913+0000 7f50243cb740 1 -- 172.21.15.12:0/4164114938 shutdown_connections 2024-09-19T06:46:40.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.914+0000 7f50243cb740 1 -- 172.21.15.12:0/4164114938 wait complete. 2024-09-19T06:46:40.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.914+0000 7f50243cb740 20 client.26744 trim_cache size 0 max 16384 2024-09-19T06:46:40.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:46:40.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:46:40.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:46:40.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:46:40.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.916+0000 7f5021552640 1 -- 172.21.15.12:0/4008945993 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50040a35b0 msgr2=0x7f50040a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.916+0000 7f5021552640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50040a35b0 0x7f50040a5a70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5014009e80 tx=0x7f5014009410 comp rx=0 tx=0).stop 2024-09-19T06:46:40.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.916+0000 7f5021552640 1 -- 172.21.15.12:0/4008945993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f501c074620 msgr2=0x7f501c073950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:40.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.916+0000 7f5021552640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f501c074620 0x7f501c073950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f500c02aaa0 tx=0x7f500c005230 comp rx=0 tx=0).stop 2024-09-19T06:46:40.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.916+0000 7f5021552640 1 -- 172.21.15.12:0/4008945993 shutdown_connections 2024-09-19T06:46:40.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.916+0000 7f5021552640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f501c10e300 0x7f501c06cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.916+0000 7f5021552640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f501c074f40 0x7f501c073e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.916+0000 7f5021552640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f50040a35b0 0x7f50040a5a70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.916+0000 7f5021552640 1 --2- 172.21.15.12:0/4008945993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f501c074620 0x7f501c073950 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:40.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.916+0000 7f5021552640 1 -- 172.21.15.12:0/4008945993 >> 172.21.15.12:0/4008945993 conn(0x7f501c0fd820 msgr2=0x7f501c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:40.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.917+0000 7f5021552640 1 -- 172.21.15.12:0/4008945993 shutdown_connections 2024-09-19T06:46:40.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:40.917+0000 7f5021552640 1 -- 172.21.15.12:0/4008945993 wait complete. 2024-09-19T06:46:41.509 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:46:41.509 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:46:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:42.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:41 smithi173 ceph-mon[35349]: pgmap v199: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 996 op/s 2024-09-19T06:46:42.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:41 smithi012 ceph-mon[30937]: pgmap v199: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 996 op/s 2024-09-19T06:46:42.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:41 smithi016 ceph-mon[34911]: pgmap v199: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 996 op/s 2024-09-19T06:46:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.702+0000 7f58855c3640 1 -- 172.21.15.12:0/3306335447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5880109450 msgr2=0x7f5880109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.702+0000 7f58855c3640 1 --2- 172.21.15.12:0/3306335447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5880109450 0x7f5880109830 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5870009860 tx=0x7f587002a380 comp rx=0 tx=0).stop 2024-09-19T06:46:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.702+0000 7f58855c3640 1 -- 172.21.15.12:0/3306335447 shutdown_connections 2024-09-19T06:46:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.702+0000 7f58855c3640 1 --2- 172.21.15.12:0/3306335447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5880074990 0x7f588007b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.702+0000 7f58855c3640 1 --2- 172.21.15.12:0/3306335447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5880109e00 0x7f58800742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.702+0000 7f58855c3640 1 --2- 172.21.15.12:0/3306335447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5880109450 0x7f5880109830 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.702+0000 7f58855c3640 1 -- 172.21.15.12:0/3306335447 >> 172.21.15.12:0/3306335447 conn(0x7f588006e140 msgr2=0x7f588006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.702+0000 7f58855c3640 1 -- 172.21.15.12:0/3306335447 shutdown_connections 2024-09-19T06:46:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.703+0000 7f58855c3640 1 -- 172.21.15.12:0/3306335447 wait complete. 2024-09-19T06:46:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.704+0000 7f58855c3640 1 Processor -- start 2024-09-19T06:46:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.704+0000 7f58855c3640 1 -- start start 2024-09-19T06:46:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.704+0000 7f58855c3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5880074990 0x7f588007b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.704+0000 7f58855c3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5880109450 0x7f58800761c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.704+0000 7f58855c3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5880109e00 0x7f5880076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.704+0000 7f58855c3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f588007e800 con 0x7f5880109450 2024-09-19T06:46:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.704+0000 7f58855c3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f588007e680 con 0x7f5880109e00 2024-09-19T06:46:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.704+0000 7f58855c3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f588007e980 con 0x7f5880074990 2024-09-19T06:46:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.705+0000 7f587e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5880109450 0x7f58800761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.705+0000 7f587e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5880109450 0x7f58800761c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44470/0 (socket says 172.21.15.12:44470) 2024-09-19T06:46:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.705+0000 7f587e7fc640 1 -- 172.21.15.12:0/2489451064 learned_addr learned my addr 172.21.15.12:0/2489451064 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.705+0000 7f587f7fe640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5880109e00 0x7f5880076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.707+0000 7f587effd640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5880074990 0x7f588007b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.707+0000 7f587f7fe640 1 -- 172.21.15.12:0/2489451064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5880074990 msgr2=0x7f588007b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.707+0000 7f587f7fe640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5880074990 0x7f588007b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.707+0000 7f587f7fe640 1 -- 172.21.15.12:0/2489451064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5880109450 msgr2=0x7f58800761c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.707+0000 7f587f7fe640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5880109450 0x7f58800761c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.707+0000 7f587f7fe640 1 -- 172.21.15.12:0/2489451064 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5880076fc0 con 0x7f5880109e00 2024-09-19T06:46:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.708+0000 7f587f7fe640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5880109e00 0x7f5880076700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f587400b410 tx=0x7f587400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:42.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.708+0000 7f5867fff640 1 -- 172.21.15.12:0/2489451064 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874015020 con 0x7f5880109e00 2024-09-19T06:46:42.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.708+0000 7f58855c3640 1 -- 172.21.15.12:0/2489451064 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58801bbfa0 con 0x7f5880109e00 2024-09-19T06:46:42.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.708+0000 7f58855c3640 1 -- 172.21.15.12:0/2489451064 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58801bc4b0 con 0x7f5880109e00 2024-09-19T06:46:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.710+0000 7f5867fff640 1 -- 172.21.15.12:0/2489451064 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5874011d10 con 0x7f5880109e00 2024-09-19T06:46:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.710+0000 7f5867fff640 1 -- 172.21.15.12:0/2489451064 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587400f2e0 con 0x7f5880109e00 2024-09-19T06:46:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.711+0000 7f5865ffb640 1 -- 172.21.15.12:0/2489451064 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f586c005290 con 0x7f5880109e00 2024-09-19T06:46:42.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.724+0000 7f5867fff640 1 -- 172.21.15.12:0/2489451064 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5874018020 con 0x7f5880109e00 2024-09-19T06:46:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.725+0000 7f5867fff640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f58680a34f0 0x7f58680a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:42.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.725+0000 7f5867fff640 1 -- 172.21.15.12:0/2489451064 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f58740cf8d0 con 0x7f5880109e00 2024-09-19T06:46:42.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.726+0000 7f5867fff640 1 -- 172.21.15.12:0/2489451064 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58740fe2b0 con 0x7f5880109e00 2024-09-19T06:46:42.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.727+0000 7f587effd640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f58680a34f0 0x7f58680a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:42.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:42.741+0000 7f587effd640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f58680a34f0 0x7f58680a59b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f587002a970 tx=0x7f587002a880 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:43.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.113+0000 7f5865ffb640 1 -- 172.21.15.12:0/2489451064 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f586c005580 con 0x7f5880109e00 2024-09-19T06:46:43.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:46:43.121 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"btime":"2024-09-19T06:46:29:658066+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:46:29.410528+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:46:43.121 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2024-09-19T06:46:43.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.119+0000 7f5867fff640 1 -- 172.21.15.12:0/2489451064 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11981 (secure 0 0 0) 0x7f587409c2e0 con 0x7f5880109e00 2024-09-19T06:46:43.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.125+0000 7f5865ffb640 1 -- 172.21.15.12:0/2489451064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f58680a34f0 msgr2=0x7f58680a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:43.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.125+0000 7f5865ffb640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f58680a34f0 0x7f58680a59b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f587002a970 tx=0x7f587002a880 comp rx=0 tx=0).stop 2024-09-19T06:46:43.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.125+0000 7f5865ffb640 1 -- 172.21.15.12:0/2489451064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5880109e00 msgr2=0x7f5880076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:43.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.125+0000 7f5865ffb640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5880109e00 0x7f5880076700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f587400b410 tx=0x7f587400b8d0 comp rx=0 tx=0).stop 2024-09-19T06:46:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.128+0000 7f5865ffb640 1 -- 172.21.15.12:0/2489451064 shutdown_connections 2024-09-19T06:46:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.128+0000 7f5865ffb640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5880109e00 0x7f5880076700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.128+0000 7f5865ffb640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5880109450 0x7f58800761c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.128+0000 7f5865ffb640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f58680a34f0 0x7f58680a59b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.128+0000 7f5865ffb640 1 --2- 172.21.15.12:0/2489451064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5880074990 0x7f588007b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.128+0000 7f5865ffb640 1 -- 172.21.15.12:0/2489451064 >> 172.21.15.12:0/2489451064 conn(0x7f588006e140 msgr2=0x7f5880072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.129+0000 7f5865ffb640 1 -- 172.21.15.12:0/2489451064 shutdown_connections 2024-09-19T06:46:43.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:43.129+0000 7f5865ffb640 1 -- 172.21.15.12:0/2489451064 wait complete. 2024-09-19T06:46:43.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:46:44.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:43 smithi173 ceph-mon[35349]: pgmap v200: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 662 op/s 2024-09-19T06:46:44.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:43 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2489451064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:43 smithi012 ceph-mon[30937]: pgmap v200: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 662 op/s 2024-09-19T06:46:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:43 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2489451064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:43 smithi016 ceph-mon[34911]: pgmap v200: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 662 op/s 2024-09-19T06:46:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:43 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2489451064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:46:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:44.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.972+0000 7f4d7621e640 1 -- 172.21.15.12:0/3374434174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70101380 msgr2=0x7f4d7010dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:44.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.972+0000 7f4d7621e640 1 --2- 172.21.15.12:0/3374434174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70101380 0x7f4d7010dfb0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009860 tx=0x7f4d6402a340 comp rx=0 tx=0).stop 2024-09-19T06:46:44.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.974+0000 7f4d7621e640 1 -- 172.21.15.12:0/3374434174 shutdown_connections 2024-09-19T06:46:44.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.974+0000 7f4d7621e640 1 --2- 172.21.15.12:0/3374434174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7010e4f0 0x7f4d70110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.974+0000 7f4d7621e640 1 --2- 172.21.15.12:0/3374434174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d70101380 0x7f4d7010dfb0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.974+0000 7f4d7621e640 1 --2- 172.21.15.12:0/3374434174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d701009d0 0x7f4d70100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.974+0000 7f4d7621e640 1 -- 172.21.15.12:0/3374434174 >> 172.21.15.12:0/3374434174 conn(0x7f4d700fc7d0 msgr2=0x7f4d700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:44.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.975+0000 7f4d7621e640 1 -- 172.21.15.12:0/3374434174 shutdown_connections 2024-09-19T06:46:44.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.975+0000 7f4d7621e640 1 -- 172.21.15.12:0/3374434174 wait complete. 2024-09-19T06:46:44.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.976+0000 7f4d7621e640 1 Processor -- start 2024-09-19T06:46:44.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.976+0000 7f4d7621e640 1 -- start start 2024-09-19T06:46:44.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.976+0000 7f4d7621e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d701009d0 0x7f4d701a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.976+0000 7f4d7621e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7010e4f0 0x7f4d701a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.976+0000 7f4d7621e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d7019a780 0x7f4d7019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.976+0000 7f4d7621e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d70114240 con 0x7f4d7019a780 2024-09-19T06:46:44.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.976+0000 7f4d7621e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701140c0 con 0x7f4d7010e4f0 2024-09-19T06:46:44.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.976+0000 7f4d7621e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701143c0 con 0x7f4d701009d0 2024-09-19T06:46:44.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d701009d0 0x7f4d701a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7010e4f0 0x7f4d701a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d701009d0 0x7f4d701a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43450/0 (socket says 172.21.15.12:43450) 2024-09-19T06:46:44.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/3692998824 learned_addr learned my addr 172.21.15.12:0/3692998824 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:44.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7010e4f0 0x7f4d701a0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50542/0 (socket says 172.21.15.12:50542) 2024-09-19T06:46:44.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6ffff640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d7019a780 0x7f4d7019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6effd640 1 -- 172.21.15.12:0/3692998824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d701009d0 msgr2=0x7f4d701a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:44.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6effd640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d701009d0 0x7f4d701a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6effd640 1 -- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d7019a780 msgr2=0x7f4d7019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:44.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6effd640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d7019a780 0x7f4d7019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6effd640 1 -- 172.21.15.12:0/3692998824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7019b360 con 0x7f4d7010e4f0 2024-09-19T06:46:44.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.977+0000 7f4d6ffff640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d7019a780 0x7f4d7019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:44.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.978+0000 7f4d6effd640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7010e4f0 0x7f4d701a0b40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d64008000 tx=0x7f4d64033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:44.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.979+0000 7f4d6cff9640 1 -- 172.21.15.12:0/3692998824 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64037070 con 0x7f4d7010e4f0 2024-09-19T06:46:44.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.979+0000 7f4d6cff9640 1 -- 172.21.15.12:0/3692998824 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d64038040 con 0x7f4d7010e4f0 2024-09-19T06:46:44.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.979+0000 7f4d6cff9640 1 -- 172.21.15.12:0/3692998824 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64005580 con 0x7f4d7010e4f0 2024-09-19T06:46:44.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.979+0000 7f4d7621e640 1 -- 172.21.15.12:0/3692998824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7019b590 con 0x7f4d7010e4f0 2024-09-19T06:46:44.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.979+0000 7f4d7621e640 1 -- 172.21.15.12:0/3692998824 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d701a7630 con 0x7f4d7010e4f0 2024-09-19T06:46:44.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.985+0000 7f4d6cff9640 1 -- 172.21.15.12:0/3692998824 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4d64043070 con 0x7f4d7010e4f0 2024-09-19T06:46:44.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.985+0000 7f4d785f7740 1 Processor -- start 2024-09-19T06:46:44.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.985+0000 7f4d785f7740 1 -- start start 2024-09-19T06:46:44.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d6cff9640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d580a3430 0x7f4d580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e2350a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d6cff9640 1 -- 172.21.15.12:0/3692998824 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4d640ef1c0 con 0x7f4d7010e4f0 2024-09-19T06:46:44.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d6ffff640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d580a3430 0x7f4d580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d6f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e2350a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d6f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e2350a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50548/0 (socket says 172.21.15.12:50548) 2024-09-19T06:46:44.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/1871740066 learned_addr learned my addr 172.21.15.12:0/1871740066 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:44.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d6effd640 1 --2- 172.21.15.12:0/1871740066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d785f7740 1 --2- 172.21.15.12:0/1871740066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e23515370 0x556e23517760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.986+0000 7f4d785f7740 1 -- 172.21.15.12:0/1871740066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556e234702f0 con 0x556e2350a5d0 2024-09-19T06:46:44.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.987+0000 7f4d785f7740 1 -- 172.21.15.12:0/1871740066 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556e23417cf0 con 0x556e2350bb40 2024-09-19T06:46:44.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.987+0000 7f4d785f7740 1 -- 172.21.15.12:0/1871740066 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556e2346c2b0 con 0x556e23515370 2024-09-19T06:46:44.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.987+0000 7f4d6ffff640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d580a3430 0x7f4d580a58f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4d68005e30 tx=0x7f4d680092c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:44.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.987+0000 7f4d6ffff640 1 --2- 172.21.15.12:0/1871740066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e23515370 0x556e23517760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.988+0000 7f4d6effd640 1 -- 172.21.15.12:0/1871740066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e23515370 msgr2=0x556e23517760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:44.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.988+0000 7f4d6effd640 1 --2- 172.21.15.12:0/1871740066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e23515370 0x556e23517760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.988+0000 7f4d6effd640 1 -- 172.21.15.12:0/1871740066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 msgr2=0x556e2350a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:44.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.988+0000 7f4d6effd640 1 --2- 172.21.15.12:0/1871740066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e2350a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.988+0000 7f4d6effd640 1 -- 172.21.15.12:0/1871740066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e233fc3a0 con 0x556e2350a5d0 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.988+0000 7f4d6effd640 1 --2- 172.21.15.12:0/1871740066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350aa10 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4d640ec940 tx=0x7f4d6402a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d113c06c0b304a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.989+0000 7f4d55ffb640 1 -- 172.21.15.12:0/1871740066 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d640bb4d0 con 0x556e2350a5d0 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.989+0000 7f4d55ffb640 1 -- 172.21.15.12:0/1871740066 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d640bf880 con 0x556e2350a5d0 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.989+0000 7f4d55ffb640 1 -- 172.21.15.12:0/1871740066 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d640b7cd0 con 0x556e2350a5d0 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.990+0000 7f4d785f7740 1 -- 172.21.15.12:0/1871740066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 msgr2=0x556e2350aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.990+0000 7f4d785f7740 1 --2- 172.21.15.12:0/1871740066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350aa10 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4d640ec940 tx=0x7f4d6402a340 comp rx=0 tx=0).stop 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.990+0000 7f4d785f7740 1 -- 172.21.15.12:0/1871740066 shutdown_connections 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.990+0000 7f4d785f7740 1 --2- 172.21.15.12:0/1871740066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e23515370 0x556e23517760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.990+0000 7f4d785f7740 1 --2- 172.21.15.12:0/1871740066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350aa10 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.990+0000 7f4d785f7740 1 --2- 172.21.15.12:0/1871740066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e2350a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.990+0000 7f4d785f7740 1 -- 172.21.15.12:0/1871740066 >> 172.21.15.12:0/1871740066 conn(0x556e234d3310 msgr2=0x556e23506c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.990+0000 7f4d785f7740 1 -- 172.21.15.12:0/1871740066 shutdown_connections 2024-09-19T06:46:44.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.990+0000 7f4d785f7740 1 -- 172.21.15.12:0/1871740066 wait complete. 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.990+0000 7f4d785f7740 1 -- start start 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.991+0000 7f4d785f7740 1 Processor -- start 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.991+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350a5d0 0x556e23512140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.991+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e23512680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.991+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e23515370 0x556e23512bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.991+0000 7f4d6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e23512680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.991+0000 7f4d6ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e23515370 0x556e23512bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.991+0000 7f4d6f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350a5d0 0x556e23512140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d6f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350a5d0 0x556e23512140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43480/0 (socket says 172.21.15.12:43480) 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d6ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e23515370 0x556e23512bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44486/0 (socket says 172.21.15.12:44486) 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e23512680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50550/0 (socket says 172.21.15.12:50550) 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/646828369 learned_addr learned my addr 172.21.15.12:0/646828369 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:44.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556e234702f0 con 0x556e23515370 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556e2342b060 con 0x556e2350bb40 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556e23517e30 con 0x556e2350a5d0 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/646828369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 msgr2=0x556e23512680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d6f7fe640 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e23512680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/646828369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e23515370 msgr2=0x556e23512bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d6f7fe640 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e23515370 0x556e23512bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/646828369 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e231e13c0 con 0x556e2350a5d0 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d785f7740 10 client.0 _ll_register_callbacks cb 0x556e2317e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d640bf880 con 0x556e2350a5d0 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d6f7fe640 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350a5d0 0x556e23512140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4d60012980 tx=0x7f4d60012d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3ec8f62efc495e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.992+0000 7f4d4effd640 10 client.26722 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.993+0000 7f4d4effd640 1 -- 172.21.15.12:0/646828369 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000f920 con 0x556e2350a5d0 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.993+0000 7f4d4effd640 1 -- 172.21.15.12:0/646828369 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4d6000fac0 con 0x556e2350a5d0 2024-09-19T06:46:45.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.993+0000 7f4d4effd640 1 -- 172.21.15.12:0/646828369 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f4d6000fd00 con 0x556e2350a5d0 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.993+0000 7f4d785f7740 10 client.26722 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.993+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=40}) -- 0x556e23523610 con 0x556e2350a5d0 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.994+0000 7f4d4effd640 1 -- 172.21.15.12:0/646828369 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f4d60037470 con 0x556e2350a5d0 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.994+0000 7f4d785f7740 10 client.26722 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.994+0000 7f4d785f7740 10 client.26722 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.994+0000 7f4d785f7740 20 client.26722 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.994+0000 7f4d785f7740 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556e23524aa0 0x556e23526f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.994+0000 7f4d785f7740 4 client.26722 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.994+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e2347d860 con 0x556e23524aa0 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.995+0000 7f4d6effd640 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556e23524aa0 0x556e23526f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:45.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.995+0000 7f4d6effd640 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556e23524aa0 0x556e23526f30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4dcbe0ae50e99457 server_cookie=ee94bc3593518ed3 in_seq=0 out_seq=0 2024-09-19T06:46:45.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.995+0000 7f4d4effd640 10 client.26722 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:46:45.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.996+0000 7f4d4effd640 1 -- 172.21.15.12:0/646828369 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e2347d860 con 0x556e23524aa0 2024-09-19T06:46:45.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.996+0000 7f4d4effd640 10 client.26722 handle_command_reply: tid=0 2024-09-19T06:46:45.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.996+0000 7f4d785f7740 1 client.26722 shutdown 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.996+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350a5d0 msgr2=0x556e23512140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.996+0000 7f4d785f7740 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350a5d0 0x556e23512140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4d60012980 tx=0x7f4d60012d80 comp rx=0 tx=0).stop 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.997+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 shutdown_connections 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.997+0000 7f4d785f7740 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556e23524aa0 0x556e23526f30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.997+0000 7f4d785f7740 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e23515370 0x556e23512bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.997+0000 7f4d785f7740 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e23512680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.997+0000 7f4d785f7740 1 --2- 172.21.15.12:0/646828369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350a5d0 0x556e23512140 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.997+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 >> 172.21.15.12:0/646828369 conn(0x556e234d3310 msgr2=0x556e2350c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.997+0000 7f4d4effd640 0 client.26722 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.997+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 shutdown_connections 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.997+0000 7f4d785f7740 1 -- 172.21.15.12:0/646828369 wait complete. 2024-09-19T06:46:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:44.997+0000 7f4d785f7740 20 client.26722 trim_cache size 0 max 16384 2024-09-19T06:46:45.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.020+0000 7f4d785f7740 1 Processor -- start 2024-09-19T06:46:45.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.020+0000 7f4d785f7740 1 -- start start 2024-09-19T06:46:45.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.020+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:45.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.020+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350bb40 0x556e2350d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.021+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e23515370 0x556e2352c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.021+0000 7f4d785f7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701abeb0 con 0x556e2350a5d0 2024-09-19T06:46:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.021+0000 7f4d785f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701adb10 con 0x556e23515370 2024-09-19T06:46:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.021+0000 7f4d785f7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701ac580 con 0x556e2350bb40 2024-09-19T06:46:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.022+0000 7f4d6f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.022+0000 7f4d6f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44488/0 (socket says 172.21.15.12:44488) 2024-09-19T06:46:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.022+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/1255544208 learned_addr learned my addr 172.21.15.12:0/1255544208 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.023+0000 7f4d6ffff640 1 --2- 172.21.15.12:0/1255544208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e23515370 0x556e2352c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.023+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/1255544208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350bb40 msgr2=0x556e2350d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.023+0000 7f4d6f7fe640 1 --2- 172.21.15.12:0/1255544208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350bb40 0x556e2350d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.023+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/1255544208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e23515370 msgr2=0x556e2352c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.023+0000 7f4d6f7fe640 1 --2- 172.21.15.12:0/1255544208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e23515370 0x556e2352c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.023+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/1255544208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e23506410 con 0x556e2350a5d0 2024-09-19T06:46:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.024+0000 7f4d6f7fe640 1 --2- 172.21.15.12:0/1255544208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350d180 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4d60012620 tx=0x7f4d60014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1468d4358b1230b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.024+0000 7f4d557fa640 1 -- 172.21.15.12:0/1255544208 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000f920 con 0x556e2350a5d0 2024-09-19T06:46:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.025+0000 7f4d557fa640 1 -- 172.21.15.12:0/1255544208 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d640bf880 con 0x556e2350a5d0 2024-09-19T06:46:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.029+0000 7f4d557fa640 1 -- 172.21.15.12:0/1255544208 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60005290 con 0x556e2350a5d0 2024-09-19T06:46:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.030+0000 7f4d785f7740 1 -- 172.21.15.12:0/1255544208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 msgr2=0x556e2350d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.030+0000 7f4d785f7740 1 --2- 172.21.15.12:0/1255544208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350d180 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4d60012620 tx=0x7f4d60014000 comp rx=0 tx=0).stop 2024-09-19T06:46:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.031+0000 7f4d785f7740 1 -- 172.21.15.12:0/1255544208 shutdown_connections 2024-09-19T06:46:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.031+0000 7f4d785f7740 1 --2- 172.21.15.12:0/1255544208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e23515370 0x556e2352c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.031+0000 7f4d785f7740 1 --2- 172.21.15.12:0/1255544208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e2350bb40 0x556e2350d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.031+0000 7f4d785f7740 1 --2- 172.21.15.12:0/1255544208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2350d180 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.031+0000 7f4d785f7740 1 -- 172.21.15.12:0/1255544208 >> 172.21.15.12:0/1255544208 conn(0x556e234d3310 msgr2=0x556e23505d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.034+0000 7f4d785f7740 1 -- 172.21.15.12:0/1255544208 shutdown_connections 2024-09-19T06:46:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.036+0000 7f4d785f7740 1 -- 172.21.15.12:0/1255544208 wait complete. 2024-09-19T06:46:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.036+0000 7f4d785f7740 1 -- start start 2024-09-19T06:46:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.036+0000 7f4d785f7740 1 Processor -- start 2024-09-19T06:46:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.037+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2351a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.037+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e2351a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.037+0000 7f4d785f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e23515370 0x556e2351aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.037+0000 7f4d785f7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701ad380 con 0x556e2350a5d0 2024-09-19T06:46:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.037+0000 7f4d785f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701accb0 con 0x556e2350bb40 2024-09-19T06:46:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.037+0000 7f4d785f7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d701a9e90 con 0x556e23515370 2024-09-19T06:46:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.037+0000 7f4d785f7740 10 client.0 _ll_register_callbacks cb 0x7f4d60009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:45.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.038+0000 7f4d6effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e2351a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:45.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.039+0000 7f4d6ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e23515370 0x556e2351aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.042+0000 7f4d6f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2351a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.042+0000 7f4d6f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2351a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44504/0 (socket says 172.21.15.12:44504) 2024-09-19T06:46:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.042+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/654418100 learned_addr learned my addr 172.21.15.12:0/654418100 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:45.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.045+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/654418100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e23515370 msgr2=0x556e2351aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:45.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.045+0000 7f4d6f7fe640 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e23515370 0x556e2351aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.045+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/654418100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 msgr2=0x556e2351a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:45.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.045+0000 7f4d6f7fe640 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e2351a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.045+0000 7f4d6f7fe640 1 -- 172.21.15.12:0/654418100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e2358da20 con 0x556e2350a5d0 2024-09-19T06:46:45.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.048+0000 7f4d6f7fe640 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2351a040 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4d600097c0 tx=0x7f4d60012d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9beb300eeb95fcd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:45.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.049+0000 7f4d4effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:46:45.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.049+0000 7f4d4effd640 1 -- 172.21.15.12:0/654418100 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60067070 con 0x556e2350a5d0 2024-09-19T06:46:45.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.049+0000 7f4d4effd640 1 -- 172.21.15.12:0/654418100 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f4d60005110 con 0x556e2350a5d0 2024-09-19T06:46:45.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.050+0000 7f4d785f7740 1 -- 172.21.15.12:0/654418100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d640bf880 con 0x556e2350a5d0 2024-09-19T06:46:45.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.051+0000 7f4d4effd640 1 -- 172.21.15.12:0/654418100 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f4d60071050 con 0x556e2350a5d0 2024-09-19T06:46:45.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.051+0000 7f4d785f7740 10 client.17265 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:45.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.051+0000 7f4d785f7740 1 -- 172.21.15.12:0/654418100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x556e2358ed00 con 0x556e2350a5d0 2024-09-19T06:46:45.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.052+0000 7f4d4effd640 1 -- 172.21.15.12:0/654418100 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d640bf880 con 0x556e2350a5d0 2024-09-19T06:46:45.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.052+0000 7f4d4effd640 1 -- 172.21.15.12:0/654418100 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f4d6006c440 con 0x556e2350a5d0 2024-09-19T06:46:45.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.052+0000 7f4d785f7740 10 client.17265 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:45.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.052+0000 7f4d785f7740 10 client.17265 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:46:45.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.052+0000 7f4d785f7740 20 client.17265 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:45.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.052+0000 7f4d785f7740 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556e2358f360 0x556e23591750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:45.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.052+0000 7f4d785f7740 4 client.17265 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:46:45.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.052+0000 7f4d785f7740 1 -- 172.21.15.12:0/654418100 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e23477d70 con 0x556e2358f360 2024-09-19T06:46:45.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.053+0000 7f4d6effd640 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556e2358f360 0x556e23591750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:45.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.054+0000 7f4d6effd640 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556e2358f360 0x556e23591750 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=75bc16a6c7f7c249 server_cookie=a847e0a46cbdd6db in_seq=0 out_seq=0 2024-09-19T06:46:45.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.054+0000 7f4d4effd640 10 client.17265 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:46:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.054+0000 7f4d4effd640 1 -- 172.21.15.12:0/654418100 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e23477d70 con 0x556e2358f360 2024-09-19T06:46:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d4effd640 10 client.17265 handle_command_reply: tid=0 2024-09-19T06:46:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d785f7740 1 client.17265 shutdown 2024-09-19T06:46:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d785f7740 1 -- 172.21.15.12:0/654418100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 msgr2=0x556e2351a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d785f7740 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2351a040 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4d600097c0 tx=0x7f4d60012d80 comp rx=0 tx=0).stop 2024-09-19T06:46:45.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d785f7740 1 -- 172.21.15.12:0/654418100 shutdown_connections 2024-09-19T06:46:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d785f7740 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x556e2358f360 0x556e23591750 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d785f7740 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556e23515370 0x556e2351aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d785f7740 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556e2350bb40 0x556e2351a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d785f7740 1 --2- 172.21.15.12:0/654418100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e2350a5d0 0x556e2351a040 secure :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4d600097c0 tx=0x7f4d60012d80 comp rx=0 tx=0).stop 2024-09-19T06:46:45.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d785f7740 1 -- 172.21.15.12:0/654418100 >> 172.21.15.12:0/654418100 conn(0x556e234d3310 msgr2=0x556e2351ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.055+0000 7f4d4effd640 0 client.17265 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:46:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.056+0000 7f4d785f7740 1 -- 172.21.15.12:0/654418100 shutdown_connections 2024-09-19T06:46:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.056+0000 7f4d785f7740 1 -- 172.21.15.12:0/654418100 wait complete. 2024-09-19T06:46:45.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.056+0000 7f4d785f7740 20 client.17265 trim_cache size 0 max 16384 2024-09-19T06:46:45.058 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:46:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.057+0000 7f4d7621e640 1 -- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d580a3430 msgr2=0x7f4d580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d580a3430 0x7f4d580a58f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4d68005e30 tx=0x7f4d680092c0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 -- 172.21.15.12:0/3692998824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7010e4f0 msgr2=0x7f4d701a0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7010e4f0 0x7f4d701a0b40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4d64008000 tx=0x7f4d64033d90 comp rx=0 tx=0).stop 2024-09-19T06:46:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 -- 172.21.15.12:0/3692998824 shutdown_connections 2024-09-19T06:46:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d7019a780 0x7f4d7019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7010e4f0 0x7f4d701a0b40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4d580a3430 0x7f4d580a58f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 --2- 172.21.15.12:0/3692998824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d701009d0 0x7f4d701a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 -- 172.21.15.12:0/3692998824 >> 172.21.15.12:0/3692998824 conn(0x7f4d700fc7d0 msgr2=0x7f4d700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 -- 172.21.15.12:0/3692998824 shutdown_connections 2024-09-19T06:46:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:45.058+0000 7f4d7621e640 1 -- 172.21.15.12:0/3692998824 wait complete. 2024-09-19T06:46:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 360.0 s, 4091.2 tps, lat 24.619 ms stddev 27.374 2024-09-19T06:46:45.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:45 smithi012 ceph-mon[30937]: pgmap v201: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 906 op/s 2024-09-19T06:46:46.048 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:46:46.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:45 smithi173 ceph-mon[35349]: pgmap v201: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 906 op/s 2024-09-19T06:46:46.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:45 smithi016 ceph-mon[34911]: pgmap v201: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 906 op/s 2024-09-19T06:46:46.520 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:47.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.076+0000 7f395de37640 1 -- 172.21.15.12:0/623347707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f395810c170 msgr2=0x7f395810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.076+0000 7f395de37640 1 --2- 172.21.15.12:0/623347707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f395810c170 0x7f395810e610 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3950009860 tx=0x7f395002a3d0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.076+0000 7f395de37640 1 -- 172.21.15.12:0/623347707 shutdown_connections 2024-09-19T06:46:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.076+0000 7f395de37640 1 --2- 172.21.15.12:0/623347707 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f395810c170 0x7f395810e610 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.076+0000 7f395de37640 1 --2- 172.21.15.12:0/623347707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3958103660 0x7f395810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.076+0000 7f395de37640 1 --2- 172.21.15.12:0/623347707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3958102d40 0x7f3958103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.076+0000 7f395de37640 1 -- 172.21.15.12:0/623347707 >> 172.21.15.12:0/623347707 conn(0x7f39580fc7a0 msgr2=0x7f39580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:47.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.077+0000 7f395de37640 1 -- 172.21.15.12:0/623347707 shutdown_connections 2024-09-19T06:46:47.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.077+0000 7f395de37640 1 -- 172.21.15.12:0/623347707 wait complete. 2024-09-19T06:46:47.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.077+0000 7f395de37640 1 Processor -- start 2024-09-19T06:46:47.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.078+0000 7f395de37640 1 -- start start 2024-09-19T06:46:47.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.078+0000 7f395de37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3958102d40 0x7f395810ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.078+0000 7f395de37640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3958103660 0x7f395810f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.078+0000 7f395de37640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f395810c170 0x7f395810f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.078+0000 7f395de37640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3958114190 con 0x7f3958102d40 2024-09-19T06:46:47.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.078+0000 7f395de37640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3958114010 con 0x7f3958103660 2024-09-19T06:46:47.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.078+0000 7f395de37640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3958114310 con 0x7f395810c170 2024-09-19T06:46:47.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.079+0000 7f394effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3958103660 0x7f395810f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.079+0000 7f394effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3958103660 0x7f395810f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50598/0 (socket says 172.21.15.12:50598) 2024-09-19T06:46:47.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.079+0000 7f394effd640 1 -- 172.21.15.12:0/926031344 learned_addr learned my addr 172.21.15.12:0/926031344 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:47.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.079+0000 7f3957fff640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f395810c170 0x7f395810f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.079+0000 7f39577fe640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3958102d40 0x7f395810ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.079+0000 7f394effd640 1 -- 172.21.15.12:0/926031344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f395810c170 msgr2=0x7f395810f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.079+0000 7f394effd640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f395810c170 0x7f395810f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.079+0000 7f394effd640 1 -- 172.21.15.12:0/926031344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3958102d40 msgr2=0x7f395810ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.079+0000 7f394effd640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3958102d40 0x7f395810ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.079+0000 7f394effd640 1 -- 172.21.15.12:0/926031344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39581aacf0 con 0x7f3958103660 2024-09-19T06:46:47.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.080+0000 7f394effd640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3958103660 0x7f395810f3b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f394000eb70 tx=0x7f394000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:47.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.080+0000 7f39557fa640 1 -- 172.21.15.12:0/926031344 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940010630 con 0x7f3958103660 2024-09-19T06:46:47.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.080+0000 7f39557fa640 1 -- 172.21.15.12:0/926031344 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f394000ee70 con 0x7f3958103660 2024-09-19T06:46:47.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.080+0000 7f395de37640 1 -- 172.21.15.12:0/926031344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39581aafe0 con 0x7f3958103660 2024-09-19T06:46:47.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.081+0000 7f395de37640 1 -- 172.21.15.12:0/926031344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39581ab440 con 0x7f3958103660 2024-09-19T06:46:47.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.081+0000 7f39557fa640 1 -- 172.21.15.12:0/926031344 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940018ad0 con 0x7f3958103660 2024-09-19T06:46:47.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.085+0000 7f39557fa640 1 -- 172.21.15.12:0/926031344 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3940018c70 con 0x7f3958103660 2024-09-19T06:46:47.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.085+0000 7f3960210740 1 Processor -- start 2024-09-19T06:46:47.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.086+0000 7f39557fa640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39380a35c0 0x7f39380a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.086+0000 7f3960210740 1 -- start start 2024-09-19T06:46:47.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.086+0000 7f39557fa640 1 -- 172.21.15.12:0/926031344 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f39400d0180 con 0x7f3958103660 2024-09-19T06:46:47.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.086+0000 7f3960210740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae39090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.086+0000 7f3960210740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae395d0 0x55c3dae39a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.086+0000 7f3960210740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae46760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.086+0000 7f3960210740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c3dad9f2f0 con 0x55c3dae44370 2024-09-19T06:46:47.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.086+0000 7f3960210740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c3dad46cf0 con 0x55c3dae395d0 2024-09-19T06:46:47.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.086+0000 7f3960210740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c3dad9b2b0 con 0x55c3dae3ab40 2024-09-19T06:46:47.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.087+0000 7f3957fff640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39380a35c0 0x7f39380a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.087+0000 7f39577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae39090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.088+0000 7f39577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae39090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43518/0 (socket says 172.21.15.12:43518) 2024-09-19T06:46:47.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.088+0000 7f39577fe640 1 -- 172.21.15.12:0/783102704 learned_addr learned my addr 172.21.15.12:0/783102704 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:47.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.088+0000 7f3957fff640 1 --2- 172.21.15.12:0/783102704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae46760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.088+0000 7f394effd640 1 --2- 172.21.15.12:0/783102704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae395d0 0x55c3dae39a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.089+0000 7f394effd640 1 -- 172.21.15.12:0/783102704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 msgr2=0x55c3dae39090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:47.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.089+0000 7f394effd640 1 --2- 172.21.15.12:0/783102704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae39090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.089+0000 7f394effd640 1 -- 172.21.15.12:0/783102704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 msgr2=0x55c3dae46760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:47.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.089+0000 7f394effd640 1 --2- 172.21.15.12:0/783102704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae46760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.089+0000 7f394effd640 1 -- 172.21.15.12:0/783102704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3dad2b3a0 con 0x55c3dae395d0 2024-09-19T06:46:47.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.089+0000 7f3957fff640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39380a35c0 0x7f39380a5a80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3950009830 tx=0x7f3950030c40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:47.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.089+0000 7f394effd640 1 --2- 172.21.15.12:0/783102704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae395d0 0x55c3dae39a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39400cd7f0 tx=0x7f394009bfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f9fdc1811d7a1ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:47.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.090+0000 7f394dffb640 1 -- 172.21.15.12:0/783102704 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39400a0730 con 0x55c3dae395d0 2024-09-19T06:46:47.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.090+0000 7f394dffb640 1 -- 172.21.15.12:0/783102704 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39400a4ff0 con 0x55c3dae395d0 2024-09-19T06:46:47.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.090+0000 7f394dffb640 1 -- 172.21.15.12:0/783102704 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394009ba30 con 0x55c3dae395d0 2024-09-19T06:46:47.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.091+0000 7f3960210740 1 -- 172.21.15.12:0/783102704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae395d0 msgr2=0x55c3dae39a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.091+0000 7f3960210740 1 --2- 172.21.15.12:0/783102704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae395d0 0x55c3dae39a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39400cd7f0 tx=0x7f394009bfb0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.091+0000 7f3960210740 1 -- 172.21.15.12:0/783102704 shutdown_connections 2024-09-19T06:46:47.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.091+0000 7f3960210740 1 --2- 172.21.15.12:0/783102704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae46760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.091+0000 7f3960210740 1 --2- 172.21.15.12:0/783102704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae395d0 0x55c3dae39a10 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39400cd7f0 tx=0x7f394009bfb0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.091+0000 7f3960210740 1 --2- 172.21.15.12:0/783102704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae39090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.091+0000 7f3960210740 1 -- 172.21.15.12:0/783102704 >> 172.21.15.12:0/783102704 conn(0x55c3dae02310 msgr2=0x55c3dae35c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:47.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.092+0000 7f3960210740 1 -- 172.21.15.12:0/783102704 shutdown_connections 2024-09-19T06:46:47.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.092+0000 7f3960210740 1 -- 172.21.15.12:0/783102704 wait complete. 2024-09-19T06:46:47.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.093+0000 7f3960210740 1 -- start start 2024-09-19T06:46:47.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.093+0000 7f3960210740 1 Processor -- start 2024-09-19T06:46:47.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f3960210740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae41240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f3960210740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae44370 0x55c3dae41780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f3960210740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae41cc0 0x55c3dae61560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f3960210740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c3dae58080 con 0x55c3dae41cc0 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f3960210740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c3dad5a060 con 0x55c3dae44370 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f3960210740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c3dae58200 con 0x55c3dae3ab40 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f3960210740 10 client.0 _ll_register_callbacks cb 0x55c3daaad8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f39577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae41240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f39577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae41240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43528/0 (socket says 172.21.15.12:43528) 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f39577fe640 1 -- 172.21.15.12:0/835902060 learned_addr learned my addr 172.21.15.12:0/835902060 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f3957fff640 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae41cc0 0x55c3dae61560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f39577fe640 1 -- 172.21.15.12:0/835902060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae44370 msgr2=0x55c3dae41780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f39577fe640 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae44370 0x55c3dae41780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f39577fe640 1 -- 172.21.15.12:0/835902060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae41cc0 msgr2=0x55c3dae61560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f39577fe640 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae41cc0 0x55c3dae61560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.094+0000 7f39577fe640 1 -- 172.21.15.12:0/835902060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3dab103c0 con 0x55c3dae3ab40 2024-09-19T06:46:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.095+0000 7f39577fe640 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae41240 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3948009ec0 tx=0x7f3948013ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e75945c70e86bff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.095+0000 7f3946ffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:46:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.095+0000 7f3946ffd640 1 -- 172.21.15.12:0/835902060 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948042060 con 0x55c3dae3ab40 2024-09-19T06:46:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.095+0000 7f3946ffd640 1 -- 172.21.15.12:0/835902060 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f39480118e0 con 0x55c3dae3ab40 2024-09-19T06:46:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.095+0000 7f3960210740 1 -- 172.21.15.12:0/835902060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39400a4ff0 con 0x55c3dae3ab40 2024-09-19T06:46:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.096+0000 7f3946ffd640 1 -- 172.21.15.12:0/835902060 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f3948011ae0 con 0x55c3dae3ab40 2024-09-19T06:46:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.096+0000 7f3960210740 10 client.26737 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:47.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.096+0000 7f3960210740 1 -- 172.21.15.12:0/835902060 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c3dae46d30 con 0x55c3dae3ab40 2024-09-19T06:46:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.097+0000 7f3946ffd640 1 -- 172.21.15.12:0/835902060 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39400a4ff0 con 0x55c3dae3ab40 2024-09-19T06:46:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.097+0000 7f3946ffd640 1 -- 172.21.15.12:0/835902060 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f394800f040 con 0x55c3dae3ab40 2024-09-19T06:46:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.098+0000 7f3960210740 10 client.26737 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.098+0000 7f3960210740 10 client.26737 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:46:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.098+0000 7f3960210740 20 client.26737 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.098+0000 7f3960210740 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c3dae48140 0x55c3dae4a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.098+0000 7f3960210740 4 client.26737 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.098+0000 7f3960210740 1 -- 172.21.15.12:0/835902060 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3dadac860 con 0x55c3dae48140 2024-09-19T06:46:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.098+0000 7f394effd640 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c3dae48140 0x55c3dae4a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.098+0000 7f3946ffd640 10 client.26737 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:46:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.099+0000 7f394effd640 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c3dae48140 0x55c3dae4a600 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=21acf2d2bc408e30 server_cookie=3123b81dfb8b4860 in_seq=0 out_seq=0 2024-09-19T06:46:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.099+0000 7f3946ffd640 1 -- 172.21.15.12:0/835902060 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3dadac860 con 0x55c3dae48140 2024-09-19T06:46:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.099+0000 7f3946ffd640 10 client.26737 handle_command_reply: tid=0 2024-09-19T06:46:47.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.099+0000 7f3960210740 1 client.26737 shutdown 2024-09-19T06:46:47.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.100+0000 7f3960210740 1 -- 172.21.15.12:0/835902060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 msgr2=0x55c3dae41240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.100+0000 7f3960210740 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae41240 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3948009ec0 tx=0x7f3948013ab0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.100+0000 7f3960210740 1 -- 172.21.15.12:0/835902060 shutdown_connections 2024-09-19T06:46:47.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.100+0000 7f3960210740 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c3dae48140 0x55c3dae4a600 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.100+0000 7f3960210740 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae41cc0 0x55c3dae61560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.100+0000 7f3960210740 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae44370 0x55c3dae41780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.100+0000 7f3960210740 1 --2- 172.21.15.12:0/835902060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae3ab40 0x55c3dae41240 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3948009ec0 tx=0x7f3948013ab0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.100+0000 7f3960210740 1 -- 172.21.15.12:0/835902060 >> 172.21.15.12:0/835902060 conn(0x55c3dae02310 msgr2=0x55c3dae3b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:47.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.100+0000 7f3946ffd640 0 client.26737 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:46:47.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.101+0000 7f3960210740 1 -- 172.21.15.12:0/835902060 shutdown_connections 2024-09-19T06:46:47.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.101+0000 7f3960210740 1 -- 172.21.15.12:0/835902060 wait complete. 2024-09-19T06:46:47.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.101+0000 7f3960210740 20 client.26737 trim_cache size 0 max 16384 2024-09-19T06:46:47.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f3960210740 1 Processor -- start 2024-09-19T06:46:47.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f3960210740 1 -- start start 2024-09-19T06:46:47.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f3960210740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 0x55c3dae61350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f3960210740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae61890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f3960210740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 0x55c3dae45760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f3960210740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f393c00ea20 con 0x55c3dae44370 2024-09-19T06:46:47.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f3960210740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f393c010680 con 0x55c3dae41cc0 2024-09-19T06:46:47.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f3960210740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f393c00f0f0 con 0x55c3dae35ed0 2024-09-19T06:46:47.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f394effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae61890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f394effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae61890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44558/0 (socket says 172.21.15.12:44558) 2024-09-19T06:46:47.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.121+0000 7f394effd640 1 -- 172.21.15.12:0/3894974361 learned_addr learned my addr 172.21.15.12:0/3894974361 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:47.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.122+0000 7f3957fff640 1 --2- 172.21.15.12:0/3894974361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 0x55c3dae45760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.122+0000 7f39577fe640 1 --2- 172.21.15.12:0/3894974361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 0x55c3dae61350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.122+0000 7f394effd640 1 -- 172.21.15.12:0/3894974361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 msgr2=0x55c3dae45760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:47.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.122+0000 7f394effd640 1 --2- 172.21.15.12:0/3894974361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 0x55c3dae45760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.122+0000 7f394effd640 1 -- 172.21.15.12:0/3894974361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 msgr2=0x55c3dae61350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.122+0000 7f394effd640 1 --2- 172.21.15.12:0/3894974361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 0x55c3dae61350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.122+0000 7f394effd640 1 -- 172.21.15.12:0/3894974361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3dae41ae0 con 0x55c3dae44370 2024-09-19T06:46:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.122+0000 7f39577fe640 1 --2- 172.21.15.12:0/3894974361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 0x55c3dae61350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.123+0000 7f394effd640 1 --2- 172.21.15.12:0/3894974361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae61890 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f394009c080 tx=0x7f3940014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593052880234d565 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.124+0000 7f394d7fa640 1 -- 172.21.15.12:0/3894974361 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39400a0730 con 0x55c3dae44370 2024-09-19T06:46:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.124+0000 7f394d7fa640 1 -- 172.21.15.12:0/3894974361 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39400a4ff0 con 0x55c3dae44370 2024-09-19T06:46:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.124+0000 7f394d7fa640 1 -- 172.21.15.12:0/3894974361 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394009ba30 con 0x55c3dae44370 2024-09-19T06:46:47.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.125+0000 7f3960210740 1 -- 172.21.15.12:0/3894974361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 msgr2=0x55c3dae61890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.125+0000 7f3960210740 1 --2- 172.21.15.12:0/3894974361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae61890 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f394009c080 tx=0x7f3940014000 comp rx=0 tx=0).stop 2024-09-19T06:46:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.132+0000 7f3960210740 1 -- 172.21.15.12:0/3894974361 shutdown_connections 2024-09-19T06:46:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.132+0000 7f3960210740 1 --2- 172.21.15.12:0/3894974361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 0x55c3dae45760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.132+0000 7f3960210740 1 --2- 172.21.15.12:0/3894974361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae61890 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.132+0000 7f3960210740 1 --2- 172.21.15.12:0/3894974361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 0x55c3dae61350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.132+0000 7f3960210740 1 -- 172.21.15.12:0/3894974361 >> 172.21.15.12:0/3894974361 conn(0x55c3dae02310 msgr2=0x55c3dae3b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:47.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.136+0000 7f3960210740 1 -- 172.21.15.12:0/3894974361 shutdown_connections 2024-09-19T06:46:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.137+0000 7f3960210740 1 -- 172.21.15.12:0/3894974361 wait complete. 2024-09-19T06:46:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.137+0000 7f3960210740 1 -- start start 2024-09-19T06:46:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.137+0000 7f3960210740 1 Processor -- start 2024-09-19T06:46:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.138+0000 7f3960210740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 0x55c3dae44d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.138+0000 7f3960210740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 0x55c3dae45250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.138+0000 7f3960210740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae5c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.138+0000 7f3960210740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f393c00fef0 con 0x55c3dae44370 2024-09-19T06:46:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.138+0000 7f3960210740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f393c00f820 con 0x55c3dae41cc0 2024-09-19T06:46:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.138+0000 7f3960210740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f393c00ca00 con 0x55c3dae35ed0 2024-09-19T06:46:47.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.138+0000 7f3960210740 10 client.0 _ll_register_callbacks cb 0x7f39480096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:47.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.139+0000 7f39577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 0x55c3dae44d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.139+0000 7f39577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 0x55c3dae44d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43532/0 (socket says 172.21.15.12:43532) 2024-09-19T06:46:47.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.139+0000 7f39577fe640 1 -- 172.21.15.12:0/3689339758 learned_addr learned my addr 172.21.15.12:0/3689339758 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:47.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.139+0000 7f3957fff640 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae5c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.139+0000 7f394effd640 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 0x55c3dae45250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.141+0000 7f39577fe640 1 -- 172.21.15.12:0/3689339758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 msgr2=0x55c3dae45250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:47.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.141+0000 7f39577fe640 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 0x55c3dae45250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.141+0000 7f39577fe640 1 -- 172.21.15.12:0/3689339758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 msgr2=0x55c3dae5c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:47.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.141+0000 7f39577fe640 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae5c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.141+0000 7f39577fe640 1 -- 172.21.15.12:0/3689339758 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3dae5ca00 con 0x55c3dae35ed0 2024-09-19T06:46:47.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.142+0000 7f39577fe640 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 0x55c3dae44d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55c3dae42380 tx=0x7f3948011c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee03e40c4ad61765 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:47.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.143+0000 7f3946ffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:46:47.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.144+0000 7f3946ffd640 1 -- 172.21.15.12:0/3689339758 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948011e70 con 0x55c3dae35ed0 2024-09-19T06:46:47.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.144+0000 7f3946ffd640 1 -- 172.21.15.12:0/3689339758 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f394800eb50 con 0x55c3dae35ed0 2024-09-19T06:46:47.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.144+0000 7f3960210740 1 -- 172.21.15.12:0/3689339758 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39400a4ff0 con 0x55c3dae35ed0 2024-09-19T06:46:47.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.154+0000 7f3946ffd640 1 -- 172.21.15.12:0/3689339758 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f39480118f0 con 0x55c3dae35ed0 2024-09-19T06:46:47.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.154+0000 7f3960210740 10 client.26743 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:47.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.154+0000 7f3960210740 1 -- 172.21.15.12:0/3689339758 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c3dae5dca0 con 0x55c3dae35ed0 2024-09-19T06:46:47.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.159+0000 7f3946ffd640 1 -- 172.21.15.12:0/3689339758 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39400a4ff0 con 0x55c3dae35ed0 2024-09-19T06:46:47.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.159+0000 7f3946ffd640 1 -- 172.21.15.12:0/3689339758 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f3948004a10 con 0x55c3dae35ed0 2024-09-19T06:46:47.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.160+0000 7f3960210740 10 client.26743 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:47.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.160+0000 7f3960210740 10 client.26743 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:46:47.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.160+0000 7f3960210740 20 client.26743 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:47.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.160+0000 7f3960210740 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c3daed1440 0x55c3daed3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:47.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.160+0000 7f3960210740 4 client.26743 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:46:47.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.160+0000 7f3960210740 1 -- 172.21.15.12:0/3689339758 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3dada6d70 con 0x55c3daed1440 2024-09-19T06:46:47.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.160+0000 7f394effd640 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c3daed1440 0x55c3daed3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:47.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.162+0000 7f394effd640 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c3daed1440 0x55c3daed3860 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5574e86586b87c18 server_cookie=10deb8ad58e27d9c in_seq=0 out_seq=0 2024-09-19T06:46:47.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.163+0000 7f3946ffd640 10 client.26743 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:46:47.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.163+0000 7f3946ffd640 1 -- 172.21.15.12:0/3689339758 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3dada6d70 con 0x55c3daed1440 2024-09-19T06:46:47.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.163+0000 7f3946ffd640 10 client.26743 handle_command_reply: tid=0 2024-09-19T06:46:47.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.164+0000 7f3960210740 1 client.26743 shutdown 2024-09-19T06:46:47.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.164+0000 7f3960210740 1 -- 172.21.15.12:0/3689339758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 msgr2=0x55c3dae44d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.164+0000 7f3960210740 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 0x55c3dae44d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55c3dae42380 tx=0x7f3948011c80 comp rx=0 tx=0).stop 2024-09-19T06:46:47.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.164+0000 7f3960210740 1 -- 172.21.15.12:0/3689339758 shutdown_connections 2024-09-19T06:46:47.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.164+0000 7f3960210740 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c3daed1440 0x55c3daed3860 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.164+0000 7f3960210740 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3dae44370 0x55c3dae5c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.164+0000 7f3960210740 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c3dae41cc0 0x55c3dae45250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.164+0000 7f3960210740 1 --2- 172.21.15.12:0/3689339758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c3dae35ed0 0x55c3dae44d10 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55c3dae42380 tx=0x7f3948011c80 comp rx=0 tx=0).stop 2024-09-19T06:46:47.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.164+0000 7f3960210740 1 -- 172.21.15.12:0/3689339758 >> 172.21.15.12:0/3689339758 conn(0x55c3dae02310 msgr2=0x55c3dae56b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:47.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.165+0000 7f3946ffd640 0 client.26743 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:46:47.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.165+0000 7f3960210740 1 -- 172.21.15.12:0/3689339758 shutdown_connections 2024-09-19T06:46:47.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.165+0000 7f3960210740 1 -- 172.21.15.12:0/3689339758 wait complete. 2024-09-19T06:46:47.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.166+0000 7f3960210740 20 client.26743 trim_cache size 0 max 16384 2024-09-19T06:46:47.168 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.166+0000 7f395de37640 1 -- 172.21.15.12:0/926031344 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39380a35c0 msgr2=0x7f39380a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.166+0000 7f395de37640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39380a35c0 0x7f39380a5a80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3950009830 tx=0x7f3950030c40 comp rx=0 tx=0).stop 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.166+0000 7f395de37640 1 -- 172.21.15.12:0/926031344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3958103660 msgr2=0x7f395810f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.166+0000 7f395de37640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3958103660 0x7f395810f3b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f394000eb70 tx=0x7f394000c6a0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.167+0000 7f395de37640 1 -- 172.21.15.12:0/926031344 shutdown_connections 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.167+0000 7f395de37640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39380a35c0 0x7f39380a5a80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.167+0000 7f395de37640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f395810c170 0x7f395810f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.167+0000 7f395de37640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3958103660 0x7f395810f3b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.167+0000 7f395de37640 1 --2- 172.21.15.12:0/926031344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3958102d40 0x7f395810ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.167+0000 7f395de37640 1 -- 172.21.15.12:0/926031344 >> 172.21.15.12:0/926031344 conn(0x7f39580fc7a0 msgr2=0x7f39580fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.167+0000 7f395de37640 1 -- 172.21.15.12:0/926031344 shutdown_connections 2024-09-19T06:46:47.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:47.167+0000 7f395de37640 1 -- 172.21.15.12:0/926031344 wait complete. 2024-09-19T06:46:48.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:47 smithi173 ceph-mon[35349]: pgmap v202: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 877 op/s 2024-09-19T06:46:48.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:47 smithi012 ceph-mon[30937]: pgmap v202: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 877 op/s 2024-09-19T06:46:48.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:47 smithi016 ceph-mon[34911]: pgmap v202: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 877 op/s 2024-09-19T06:46:48.314 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:46:48.758 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.343+0000 7f17f8958640 1 -- 172.21.15.12:0/1390402524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17f4109ba0 msgr2=0x7f17f4114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.343+0000 7f17f8958640 1 --2- 172.21.15.12:0/1390402524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17f4109ba0 0x7f17f4114570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009900 tx=0x7f17e802a410 comp rx=0 tx=0).stop 2024-09-19T06:46:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.344+0000 7f17f8958640 1 -- 172.21.15.12:0/1390402524 shutdown_connections 2024-09-19T06:46:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.344+0000 7f17f8958640 1 --2- 172.21.15.12:0/1390402524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f4114ab0 0x7f17f4116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.344+0000 7f17f8958640 1 --2- 172.21.15.12:0/1390402524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17f4109ba0 0x7f17f4114570 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.344+0000 7f17f8958640 1 --2- 172.21.15.12:0/1390402524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f41091f0 0x7f17f41095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.344+0000 7f17f8958640 1 -- 172.21.15.12:0/1390402524 >> 172.21.15.12:0/1390402524 conn(0x7f17f406e800 msgr2=0x7f17f406ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.344+0000 7f17f8958640 1 -- 172.21.15.12:0/1390402524 shutdown_connections 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.344+0000 7f17f8958640 1 -- 172.21.15.12:0/1390402524 wait complete. 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.346+0000 7f17f8958640 1 Processor -- start 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.346+0000 7f17f8958640 1 -- start start 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.346+0000 7f17f8958640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f41091f0 0x7f17f41a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.346+0000 7f17f8958640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17f4109ba0 0x7f17f41a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.346+0000 7f17f8958640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f4114ab0 0x7f17f41a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.346+0000 7f17f8958640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f17f411ca10 con 0x7f17f41091f0 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.346+0000 7f17f8958640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f17f411c890 con 0x7f17f4109ba0 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.346+0000 7f17f8958640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17f411cb90 con 0x7f17f4114ab0 2024-09-19T06:46:49.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17f4109ba0 0x7f17f41a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f41091f0 0x7f17f41a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f2d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f4114ab0 0x7f17f41a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f41091f0 0x7f17f41a2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44580/0 (socket says 172.21.15.12:44580) 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f2d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f4114ab0 0x7f17f41a77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43550/0 (socket says 172.21.15.12:43550) 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17f4109ba0 0x7f17f41a3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50648/0 (socket says 172.21.15.12:50648) 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f259c640 1 -- 172.21.15.12:0/751148567 learned_addr learned my addr 172.21.15.12:0/751148567 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f1d9b640 1 -- 172.21.15.12:0/751148567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f4114ab0 msgr2=0x7f17f41a77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f4114ab0 0x7f17f41a77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f1d9b640 1 -- 172.21.15.12:0/751148567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f41091f0 msgr2=0x7f17f41a2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f41091f0 0x7f17f41a2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.347+0000 7f17f1d9b640 1 -- 172.21.15.12:0/751148567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f41a7e80 con 0x7f17f4109ba0 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.348+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17f4109ba0 0x7f17f41a3410 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17e802a930 tx=0x7f17e8003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.348+0000 7f17e37fe640 1 -- 172.21.15.12:0/751148567 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e803f070 con 0x7f17f4109ba0 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.348+0000 7f17e37fe640 1 -- 172.21.15.12:0/751148567 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17e8031c90 con 0x7f17f4109ba0 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.348+0000 7f17e37fe640 1 -- 172.21.15.12:0/751148567 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8035030 con 0x7f17f4109ba0 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.348+0000 7f17f8958640 1 -- 172.21.15.12:0/751148567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f41a8110 con 0x7f17f4109ba0 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.348+0000 7f17f8958640 1 -- 172.21.15.12:0/751148567 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f41a85a0 con 0x7f17f4109ba0 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.353+0000 7f17fad31740 1 Processor -- start 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.353+0000 7f17e37fe640 1 -- 172.21.15.12:0/751148567 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f17e8042070 con 0x7f17f4109ba0 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.355+0000 7f17e37fe640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f17dc0a3580 0x7f17dc0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.355+0000 7f17e37fe640 1 -- 172.21.15.12:0/751148567 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f17e80f0550 con 0x7f17f4109ba0 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.355+0000 7f17fad31740 1 -- start start 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.355+0000 7f17f2d9d640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f17dc0a3580 0x7f17dc0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.355+0000 7f17fad31740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c175090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.355+0000 7f17fad31740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 0x56437c175a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.355+0000 7f17fad31740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c180370 0x56437c182760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.355+0000 7f17fad31740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56437c0db2f0 con 0x56437c180370 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.355+0000 7f17fad31740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56437c082cf0 con 0x56437c176b40 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.355+0000 7f17fad31740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56437c0d72b0 con 0x56437c1755d0 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f1d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 0x56437c175a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f1d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 0x56437c175a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43556/0 (socket says 172.21.15.12:43556) 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f1d9b640 1 -- 172.21.15.12:0/3545781222 learned_addr learned my addr 172.21.15.12:0/3545781222 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c175090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f2d9d640 1 --2- 172.21.15.12:0/3545781222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c180370 0x56437c182760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f2d9d640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f17dc0a3580 0x7f17dc0a5a40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f17f406bcf0 tx=0x7f17ec018040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f259c640 1 -- 172.21.15.12:0/3545781222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 msgr2=0x56437c175a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f259c640 1 --2- 172.21.15.12:0/3545781222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 0x56437c175a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f259c640 1 -- 172.21.15.12:0/3545781222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c180370 msgr2=0x56437c182760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:49.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f259c640 1 --2- 172.21.15.12:0/3545781222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c180370 0x56437c182760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f259c640 1 -- 172.21.15.12:0/3545781222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437c0673a0 con 0x56437c176b40 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.356+0000 7f17f259c640 1 --2- 172.21.15.12:0/3545781222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c175090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009c30 tx=0x7f17e40117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6b8989a07765741 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.357+0000 7f17e0ff9640 1 -- 172.21.15.12:0/3545781222 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4012450 con 0x56437c176b40 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.357+0000 7f17e0ff9640 1 -- 172.21.15.12:0/3545781222 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17e4012ad0 con 0x56437c176b40 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.357+0000 7f17e0ff9640 1 -- 172.21.15.12:0/3545781222 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4012450 con 0x56437c176b40 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.358+0000 7f17fad31740 1 -- 172.21.15.12:0/3545781222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 msgr2=0x56437c175090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.358+0000 7f17fad31740 1 --2- 172.21.15.12:0/3545781222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c175090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009c30 tx=0x7f17e40117b0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.358+0000 7f17fad31740 1 -- 172.21.15.12:0/3545781222 shutdown_connections 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.358+0000 7f17fad31740 1 --2- 172.21.15.12:0/3545781222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c180370 0x56437c182760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.358+0000 7f17fad31740 1 --2- 172.21.15.12:0/3545781222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 0x56437c175a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.358+0000 7f17fad31740 1 --2- 172.21.15.12:0/3545781222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c175090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.358+0000 7f17fad31740 1 -- 172.21.15.12:0/3545781222 >> 172.21.15.12:0/3545781222 conn(0x56437c13e310 msgr2=0x56437c171c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:49.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.359+0000 7f17fad31740 1 -- 172.21.15.12:0/3545781222 shutdown_connections 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.359+0000 7f17fad31740 1 -- 172.21.15.12:0/3545781222 wait complete. 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.359+0000 7f17fad31740 1 -- start start 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.359+0000 7f17fad31740 1 Processor -- start 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.360+0000 7f17fad31740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 0x56437c17fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.360+0000 7f17fad31740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c17cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.360+0000 7f17fad31740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c180370 0x56437c17d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.360+0000 7f17fad31740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56437c183070 con 0x56437c180370 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.360+0000 7f17fad31740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56437c096060 con 0x56437c176b40 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.360+0000 7f17fad31740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56437c1831f0 con 0x56437c1755d0 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.360+0000 7f17fad31740 10 client.0 _ll_register_callbacks cb 0x56437bde98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c17cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 0x56437c17fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c17cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50662/0 (socket says 172.21.15.12:50662) 2024-09-19T06:46:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f1d9b640 1 -- 172.21.15.12:0/3564795702 learned_addr learned my addr 172.21.15.12:0/3564795702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f2d9d640 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c180370 0x56437c17d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f1d9b640 1 -- 172.21.15.12:0/3564795702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 msgr2=0x56437c17fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 0x56437c17fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f1d9b640 1 -- 172.21.15.12:0/3564795702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c180370 msgr2=0x56437c17d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c180370 0x56437c17d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f1d9b640 1 -- 172.21.15.12:0/3564795702 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56437be4c3c0 con 0x56437c176b40 2024-09-19T06:46:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c17cef0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f17e803b800 tx=0x7f17e80bc5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d73a53650f8c3774 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.361+0000 7f17d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17d9ffb640 1 -- 172.21.15.12:0/3564795702 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8049040 con 0x56437c176b40 2024-09-19T06:46:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17d9ffb640 1 -- 172.21.15.12:0/3564795702 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f17e80ede40 con 0x56437c176b40 2024-09-19T06:46:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17fad31740 1 -- 172.21.15.12:0/3564795702 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17e4012ad0 con 0x56437c176b40 2024-09-19T06:46:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17d9ffb640 1 -- 172.21.15.12:0/3564795702 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f17e80ee040 con 0x56437c176b40 2024-09-19T06:46:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17fad31740 10 client.26789 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17fad31740 1 -- 172.21.15.12:0/3564795702 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x56437c18ea60 con 0x56437c176b40 2024-09-19T06:46:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17d9ffb640 1 -- 172.21.15.12:0/3564795702 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17e80bce50 con 0x56437c176b40 2024-09-19T06:46:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17d9ffb640 1 -- 172.21.15.12:0/3564795702 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f17e80bc9b0 con 0x56437c176b40 2024-09-19T06:46:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17fad31740 10 client.26789 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17fad31740 10 client.26789 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17fad31740 20 client.26789 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17fad31740 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x56437c18fef0 0x56437c192370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17fad31740 4 client.26789 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.362+0000 7f17fad31740 1 -- 172.21.15.12:0/3564795702 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f17e4012ad0 con 0x56437c18fef0 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.363+0000 7f17f259c640 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x56437c18fef0 0x56437c192370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.364+0000 7f17f259c640 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x56437c18fef0 0x56437c192370 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=98ec833f3b89d743 server_cookie=908be8356046dfc7 in_seq=0 out_seq=0 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.364+0000 7f17d9ffb640 10 client.26789 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17d9ffb640 1 -- 172.21.15.12:0/3564795702 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f17e4012ad0 con 0x56437c18fef0 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17d9ffb640 10 client.26789 handle_command_reply: tid=0 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 client.26789 shutdown 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 -- 172.21.15.12:0/3564795702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 msgr2=0x56437c17cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c17cef0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f17e803b800 tx=0x7f17e80bc5e0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 -- 172.21.15.12:0/3564795702 shutdown_connections 2024-09-19T06:46:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x56437c18fef0 0x56437c192370 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c180370 0x56437c17d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c176b40 0x56437c17cef0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 --2- 172.21.15.12:0/3564795702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c1755d0 0x56437c17fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 -- 172.21.15.12:0/3564795702 >> 172.21.15.12:0/3564795702 conn(0x56437c13e310 msgr2=0x56437c177930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17d9ffb640 0 client.26789 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 -- 172.21.15.12:0/3564795702 shutdown_connections 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 1 -- 172.21.15.12:0/3564795702 wait complete. 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.365+0000 7f17fad31740 20 client.26789 trim_cache size 0 max 16384 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.389+0000 7f17fad31740 1 Processor -- start 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.390+0000 7f17fad31740 1 -- start start 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.390+0000 7f17fad31740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c13e310 0x56437c18c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17fad31740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c171700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17fad31740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c176b40 0x56437c178120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17fad31740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f17d400e9c0 con 0x56437c13e310 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17fad31740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4010620 con 0x56437c1755d0 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17f259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c13e310 0x56437c18c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17f1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c171700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17f1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c171700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50678/0 (socket says 172.21.15.12:50678) 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17f1d9b640 1 -- 172.21.15.12:0/2986516555 learned_addr learned my addr 172.21.15.12:0/2986516555 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17fad31740 1 -- 172.21.15.12:0/2986516555 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17d400f090 con 0x56437c176b40 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17f2d9d640 1 --2- 172.21.15.12:0/2986516555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c176b40 0x56437c178120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17f1d9b640 1 -- 172.21.15.12:0/2986516555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c176b40 msgr2=0x56437c178120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/2986516555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c176b40 0x56437c178120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17f1d9b640 1 -- 172.21.15.12:0/2986516555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c13e310 msgr2=0x56437c18c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/2986516555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c13e310 0x56437c18c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.391+0000 7f17f1d9b640 1 -- 172.21.15.12:0/2986516555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437c17e270 con 0x56437c1755d0 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.392+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/2986516555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c171700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17e8003fd0 tx=0x7f17e8031490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c35b7a88483a4fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.392+0000 7f17dbfff640 1 -- 172.21.15.12:0/2986516555 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e80bc0b0 con 0x56437c1755d0 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.392+0000 7f17dbfff640 1 -- 172.21.15.12:0/2986516555 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17e80bce50 con 0x56437c1755d0 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.392+0000 7f17dbfff640 1 -- 172.21.15.12:0/2986516555 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e80c0b00 con 0x56437c1755d0 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.393+0000 7f17fad31740 1 -- 172.21.15.12:0/2986516555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 msgr2=0x56437c171700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.393+0000 7f17fad31740 1 --2- 172.21.15.12:0/2986516555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c171700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17e8003fd0 tx=0x7f17e8031490 comp rx=0 tx=0).stop 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.393+0000 7f17fad31740 1 -- 172.21.15.12:0/2986516555 shutdown_connections 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.393+0000 7f17fad31740 1 --2- 172.21.15.12:0/2986516555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c176b40 0x56437c178120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.394+0000 7f17fad31740 1 --2- 172.21.15.12:0/2986516555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c171700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.394+0000 7f17fad31740 1 --2- 172.21.15.12:0/2986516555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c13e310 0x56437c18c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.394+0000 7f17fad31740 1 -- 172.21.15.12:0/2986516555 >> 172.21.15.12:0/2986516555 conn(0x56437c17d590 msgr2=0x56437c17bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.394+0000 7f17fad31740 1 -- 172.21.15.12:0/2986516555 shutdown_connections 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.394+0000 7f17fad31740 1 -- 172.21.15.12:0/2986516555 wait complete. 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.394+0000 7f17fad31740 1 -- start start 2024-09-19T06:46:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.395+0000 7f17fad31740 1 Processor -- start 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.395+0000 7f17fad31740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c13e310 0x56437c188c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.395+0000 7f17fad31740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c183fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.395+0000 7f17fad31740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c176b40 0x56437c184500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.395+0000 7f17fad31740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f17d400fe90 con 0x56437c176b40 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17fad31740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f17d400f7c0 con 0x56437c1755d0 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17f2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c176b40 0x56437c184500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17f2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c176b40 0x56437c184500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44622/0 (socket says 172.21.15.12:44622) 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17f2d9d640 1 -- 172.21.15.12:0/2728088136 learned_addr learned my addr 172.21.15.12:0/2728088136 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c183fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17f259c640 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c13e310 0x56437c188c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17fad31740 1 -- 172.21.15.12:0/2728088136 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17d400c9a0 con 0x56437c13e310 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17fad31740 10 client.0 _ll_register_callbacks cb 0x7f17e80092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17f2d9d640 1 -- 172.21.15.12:0/2728088136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c13e310 msgr2=0x56437c188c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17f2d9d640 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c13e310 0x56437c188c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17f2d9d640 1 -- 172.21.15.12:0/2728088136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 msgr2=0x56437c183fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17f2d9d640 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c183fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.396+0000 7f17f2d9d640 1 -- 172.21.15.12:0/2728088136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56437c184d30 con 0x56437c176b40 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.397+0000 7f17f1d9b640 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c183fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.397+0000 7f17f259c640 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c13e310 0x56437c188c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.397+0000 7f17f2d9d640 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c176b40 0x56437c184500 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0236e0 tx=0x7f17ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5df11bd98966e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.397+0000 7f17d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.397+0000 7f17d9ffb640 1 -- 172.21.15.12:0/2728088136 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec003970 con 0x56437c176b40 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.398+0000 7f17d9ffb640 1 -- 172.21.15.12:0/2728088136 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f17ec003b10 con 0x56437c176b40 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.398+0000 7f17fad31740 1 -- 172.21.15.12:0/2728088136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17e80bce50 con 0x56437c176b40 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.398+0000 7f17d9ffb640 1 -- 172.21.15.12:0/2728088136 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f17ec003d10 con 0x56437c176b40 2024-09-19T06:46:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.398+0000 7f17fad31740 10 client.17298 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.398+0000 7f17fad31740 1 -- 172.21.15.12:0/2728088136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x56437c1facb0 con 0x56437c176b40 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.399+0000 7f17d9ffb640 1 -- 172.21.15.12:0/2728088136 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17ec004510 con 0x56437c176b40 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.399+0000 7f17d9ffb640 1 -- 172.21.15.12:0/2728088136 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f17ec02f920 con 0x56437c176b40 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.399+0000 7f17fad31740 10 client.17298 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.399+0000 7f17fad31740 10 client.17298 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.399+0000 7f17fad31740 20 client.17298 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.399+0000 7f17fad31740 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x56437c180370 0x56437c1fd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.399+0000 7f17fad31740 4 client.17298 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.399+0000 7f17fad31740 1 -- 172.21.15.12:0/2728088136 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f17e80bce50 con 0x56437c180370 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.399+0000 7f17f259c640 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x56437c180370 0x56437c1fd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.400+0000 7f17f259c640 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x56437c180370 0x56437c1fd480 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aefc8d52d15513ad server_cookie=14957db2f2894582 in_seq=0 out_seq=0 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.400+0000 7f17d9ffb640 10 client.17298 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:46:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.400+0000 7f17d9ffb640 1 -- 172.21.15.12:0/2728088136 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f17e80bce50 con 0x56437c180370 2024-09-19T06:46:49.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.400+0000 7f17d9ffb640 10 client.17298 handle_command_reply: tid=0 2024-09-19T06:46:49.588 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:46:49.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.400+0000 7f17fad31740 1 client.17298 shutdown 2024-09-19T06:46:49.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17fad31740 1 -- 172.21.15.12:0/2728088136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c176b40 msgr2=0x56437c184500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17fad31740 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c176b40 0x56437c184500 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0236e0 tx=0x7f17ec004a40 comp rx=0 tx=0).stop 2024-09-19T06:46:49.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17fad31740 1 -- 172.21.15.12:0/2728088136 shutdown_connections 2024-09-19T06:46:49.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17fad31740 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x56437c180370 0x56437c1fd480 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17fad31740 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437c176b40 0x56437c184500 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17fad31740 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56437c1755d0 0x56437c183fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17fad31740 1 --2- 172.21.15.12:0/2728088136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56437c13e310 0x56437c188c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17fad31740 1 -- 172.21.15.12:0/2728088136 >> 172.21.15.12:0/2728088136 conn(0x56437c17d590 msgr2=0x56437c17e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17d9ffb640 0 client.17298 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17fad31740 1 -- 172.21.15.12:0/2728088136 shutdown_connections 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.401+0000 7f17fad31740 1 -- 172.21.15.12:0/2728088136 wait complete. 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.402+0000 7f17fad31740 20 client.17298 trim_cache size 0 max 16384 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.402+0000 7f17f8958640 1 -- 172.21.15.12:0/751148567 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f17dc0a3580 msgr2=0x7f17dc0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.402+0000 7f17f8958640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f17dc0a3580 0x7f17dc0a5a40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f17f406bcf0 tx=0x7f17ec018040 comp rx=0 tx=0).stop 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.402+0000 7f17f8958640 1 -- 172.21.15.12:0/751148567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17f4109ba0 msgr2=0x7f17f41a3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.402+0000 7f17f8958640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17f4109ba0 0x7f17f41a3410 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17e802a930 tx=0x7f17e8003b20 comp rx=0 tx=0).stop 2024-09-19T06:46:49.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.403+0000 7f17f8958640 1 -- 172.21.15.12:0/751148567 shutdown_connections 2024-09-19T06:46:49.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.403+0000 7f17f8958640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f17dc0a3580 0x7f17dc0a5a40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.403+0000 7f17f8958640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f4114ab0 0x7f17f41a77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.403+0000 7f17f8958640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17f4109ba0 0x7f17f41a3410 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.403+0000 7f17f8958640 1 --2- 172.21.15.12:0/751148567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f41091f0 0x7f17f41a2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:49.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.403+0000 7f17f8958640 1 -- 172.21.15.12:0/751148567 >> 172.21.15.12:0/751148567 conn(0x7f17f406e800 msgr2=0x7f17f4071210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:49.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.403+0000 7f17f8958640 1 -- 172.21.15.12:0/751148567 shutdown_connections 2024-09-19T06:46:49.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:49.403+0000 7f17f8958640 1 -- 172.21.15.12:0/751148567 wait complete. 2024-09-19T06:46:49.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:49 smithi012 ceph-mon[30937]: pgmap v203: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.6 MiB/s wr, 701 op/s 2024-09-19T06:46:50.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:49 smithi173 ceph-mon[35349]: pgmap v203: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.6 MiB/s wr, 701 op/s 2024-09-19T06:46:50.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:49 smithi016 ceph-mon[34911]: pgmap v203: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.6 MiB/s wr, 701 op/s 2024-09-19T06:46:50.532 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:46:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 365.0 s, 4630.8 tps, lat 21.531 ms stddev 24.199 2024-09-19T06:46:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.818+0000 7fc620000640 1 -- 172.21.15.12:0/1457413081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc618074eb0 msgr2=0x7fc618112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.819+0000 7fc620000640 1 --2- 172.21.15.12:0/1457413081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc618074eb0 0x7fc618112660 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc614009900 tx=0x7fc61402a4a0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.820+0000 7fc620000640 1 -- 172.21.15.12:0/1457413081 shutdown_connections 2024-09-19T06:46:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.820+0000 7fc620000640 1 --2- 172.21.15.12:0/1457413081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc618112ba0 0x7fc618114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.820+0000 7fc620000640 1 --2- 172.21.15.12:0/1457413081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc618074eb0 0x7fc618112660 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.820+0000 7fc620000640 1 --2- 172.21.15.12:0/1457413081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc618074590 0x7fc618074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.820+0000 7fc620000640 1 -- 172.21.15.12:0/1457413081 >> 172.21.15.12:0/1457413081 conn(0x7fc6180fd8b0 msgr2=0x7fc6180ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:51.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.824+0000 7fc620000640 1 -- 172.21.15.12:0/1457413081 shutdown_connections 2024-09-19T06:46:51.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.824+0000 7fc620000640 1 -- 172.21.15.12:0/1457413081 wait complete. 2024-09-19T06:46:51.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.826+0000 7fc620000640 1 Processor -- start 2024-09-19T06:46:51.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.827+0000 7fc620000640 1 -- start start 2024-09-19T06:46:51.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.828+0000 7fc620000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc618074590 0x7fc6181a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.828+0000 7fc620000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc618074eb0 0x7fc6181a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.828+0000 7fc620000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc618112ba0 0x7fc61819e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.828+0000 7fc620000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc618118630 con 0x7fc618074590 2024-09-19T06:46:51.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.828+0000 7fc620000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc6181184b0 con 0x7fc618074eb0 2024-09-19T06:46:51.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.828+0000 7fc620000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6181187b0 con 0x7fc618112ba0 2024-09-19T06:46:51.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.828+0000 7fc61dd9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc618074590 0x7fc6181a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.828+0000 7fc61dd9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc618074590 0x7fc6181a47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44560/0 (socket says 172.21.15.12:44560) 2024-09-19T06:46:51.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.828+0000 7fc61dd9c640 1 -- 172.21.15.12:0/753817883 learned_addr learned my addr 172.21.15.12:0/753817883 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.829+0000 7fc61d59b640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc618074eb0 0x7fc6181a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.829+0000 7fc61e59d640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc618112ba0 0x7fc61819e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.831+0000 7fc61d59b640 1 -- 172.21.15.12:0/753817883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc618112ba0 msgr2=0x7fc61819e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.831+0000 7fc61d59b640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc618112ba0 0x7fc61819e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.831+0000 7fc61d59b640 1 -- 172.21.15.12:0/753817883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc618074590 msgr2=0x7fc6181a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.831+0000 7fc61d59b640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc618074590 0x7fc6181a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.831+0000 7fc61d59b640 1 -- 172.21.15.12:0/753817883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61819f0c0 con 0x7fc618074eb0 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.831+0000 7fc61d59b640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc618074eb0 0x7fc6181a4d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc61402aa10 tx=0x7fc614003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.832+0000 7fc60effd640 1 -- 172.21.15.12:0/753817883 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61403f070 con 0x7fc618074eb0 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.832+0000 7fc60effd640 1 -- 172.21.15.12:0/753817883 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc61403b460 con 0x7fc618074eb0 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.832+0000 7fc60effd640 1 -- 172.21.15.12:0/753817883 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614035030 con 0x7fc618074eb0 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.832+0000 7fc620000640 1 -- 172.21.15.12:0/753817883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61819f350 con 0x7fc618074eb0 2024-09-19T06:46:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.832+0000 7fc620000640 1 -- 172.21.15.12:0/753817883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc618105e30 con 0x7fc618074eb0 2024-09-19T06:46:51.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.838+0000 7fc6223d9740 1 Processor -- start 2024-09-19T06:46:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.838+0000 7fc60effd640 1 -- 172.21.15.12:0/753817883 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc614042070 con 0x7fc618074eb0 2024-09-19T06:46:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.839+0000 7fc6223d9740 1 -- start start 2024-09-19T06:46:51.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.839+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe55a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.839+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe55aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.839+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe567760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.839+0000 7fc6223d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561ffe4c02f0 con 0x561ffe55a5d0 2024-09-19T06:46:51.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.839+0000 7fc6223d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561ffe467cf0 con 0x561ffe55bb40 2024-09-19T06:46:51.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.839+0000 7fc6223d9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561ffe4bc2b0 con 0x561ffe565370 2024-09-19T06:46:51.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.840+0000 7fc61e59d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe55a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.840+0000 7fc61e59d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe55a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47136/0 (socket says 172.21.15.12:47136) 2024-09-19T06:46:51.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.840+0000 7fc61e59d640 1 -- 172.21.15.12:0/3560352981 learned_addr learned my addr 172.21.15.12:0/3560352981 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:51.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.840+0000 7fc61e59d640 1 -- 172.21.15.12:0/3560352981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 msgr2=0x561ffe567760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:51.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.840+0000 7fc61e59d640 1 --2- 172.21.15.12:0/3560352981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe567760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.840+0000 7fc61e59d640 1 -- 172.21.15.12:0/3560352981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 msgr2=0x561ffe55aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:51.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.840+0000 7fc61e59d640 1 --2- 172.21.15.12:0/3560352981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe55aa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.840+0000 7fc61e59d640 1 -- 172.21.15.12:0/3560352981 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ffe44c3a0 con 0x561ffe55bb40 2024-09-19T06:46:51.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.840+0000 7fc61e59d640 1 --2- 172.21.15.12:0/3560352981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe55a090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc610009f30 tx=0x7fc61000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b63048d5df3d57ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:51.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.841+0000 7fc603fff640 1 -- 172.21.15.12:0/3560352981 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61001a070 con 0x561ffe55bb40 2024-09-19T06:46:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.841+0000 7fc603fff640 1 -- 172.21.15.12:0/3560352981 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6100158f0 con 0x561ffe55bb40 2024-09-19T06:46:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.841+0000 7fc603fff640 1 -- 172.21.15.12:0/3560352981 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61000a960 con 0x561ffe55bb40 2024-09-19T06:46:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.842+0000 7fc60effd640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6040a35c0 0x7fc6040a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.842+0000 7fc6223d9740 1 -- 172.21.15.12:0/3560352981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 msgr2=0x561ffe55a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.842+0000 7fc6223d9740 1 --2- 172.21.15.12:0/3560352981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe55a090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc610009f30 tx=0x7fc61000c8b0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.843+0000 7fc60effd640 1 -- 172.21.15.12:0/753817883 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc6140f0330 con 0x7fc618074eb0 2024-09-19T06:46:51.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.843+0000 7fc61dd9c640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6040a35c0 0x7fc6040a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.843+0000 7fc6223d9740 1 -- 172.21.15.12:0/3560352981 shutdown_connections 2024-09-19T06:46:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.843+0000 7fc6223d9740 1 --2- 172.21.15.12:0/3560352981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe567760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.843+0000 7fc6223d9740 1 --2- 172.21.15.12:0/3560352981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe55aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.843+0000 7fc6223d9740 1 --2- 172.21.15.12:0/3560352981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe55a090 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.843+0000 7fc6223d9740 1 -- 172.21.15.12:0/3560352981 >> 172.21.15.12:0/3560352981 conn(0x561ffe523310 msgr2=0x561ffe556c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.843+0000 7fc6223d9740 1 -- 172.21.15.12:0/3560352981 shutdown_connections 2024-09-19T06:46:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.844+0000 7fc6223d9740 1 -- 172.21.15.12:0/3560352981 wait complete. 2024-09-19T06:46:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.844+0000 7fc61dd9c640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6040a35c0 0x7fc6040a5a80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x561ffe557ac0 tx=0x7fc60800a380 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.844+0000 7fc6223d9740 1 -- start start 2024-09-19T06:46:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.845+0000 7fc6223d9740 1 Processor -- start 2024-09-19T06:46:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.845+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe564e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.845+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe5620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.845+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe562840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.845+0000 7fc6223d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561ffe568070 con 0x561ffe55a5d0 2024-09-19T06:46:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.845+0000 7fc6223d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561ffe47b060 con 0x561ffe55bb40 2024-09-19T06:46:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.845+0000 7fc6223d9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561ffe5681f0 con 0x561ffe565370 2024-09-19T06:46:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.845+0000 7fc6223d9740 10 client.0 _ll_register_callbacks cb 0x561ffe1ce8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.846+0000 7fc61d59b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe5620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.846+0000 7fc61d59b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe5620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47144/0 (socket says 172.21.15.12:47144) 2024-09-19T06:46:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.846+0000 7fc61d59b640 1 -- 172.21.15.12:0/1724257745 learned_addr learned my addr 172.21.15.12:0/1724257745 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.846+0000 7fc61dd9c640 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe564e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.846+0000 7fc61e59d640 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe562840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.847+0000 7fc61e59d640 1 -- 172.21.15.12:0/1724257745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 msgr2=0x561ffe5620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.847+0000 7fc61e59d640 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe5620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.847+0000 7fc61e59d640 1 -- 172.21.15.12:0/1724257745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 msgr2=0x561ffe564e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.847+0000 7fc61e59d640 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe564e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.847+0000 7fc61e59d640 1 -- 172.21.15.12:0/1724257745 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ffe2313c0 con 0x561ffe565370 2024-09-19T06:46:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.847+0000 7fc61e59d640 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe562840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc610009f30 tx=0x7fc610003c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28c2dfe900e9a176 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.848+0000 7fc6017fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.848+0000 7fc6017fa640 1 -- 172.21.15.12:0/1724257745 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61001a040 con 0x561ffe565370 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.848+0000 7fc6017fa640 1 -- 172.21.15.12:0/1724257745 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc61000a5e0 con 0x561ffe565370 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.848+0000 7fc6223d9740 1 -- 172.21.15.12:0/1724257745 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6100158f0 con 0x561ffe565370 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.849+0000 7fc6017fa640 1 -- 172.21.15.12:0/1724257745 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc61002c050 con 0x561ffe565370 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.850+0000 7fc6223d9740 10 client.26767 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.850+0000 7fc6223d9740 1 -- 172.21.15.12:0/1724257745 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x561ffe573c50 con 0x561ffe565370 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.850+0000 7fc6017fa640 1 -- 172.21.15.12:0/1724257745 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc610023070 con 0x561ffe565370 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.850+0000 7fc6017fa640 1 -- 172.21.15.12:0/1724257745 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fc61001d070 con 0x561ffe565370 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.851+0000 7fc6223d9740 10 client.26767 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.851+0000 7fc6223d9740 10 client.26767 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.851+0000 7fc6223d9740 20 client.26767 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.851+0000 7fc6223d9740 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x561ffe574fa0 0x561ffe577390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.851+0000 7fc6223d9740 4 client.26767 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.851+0000 7fc6223d9740 1 -- 172.21.15.12:0/1724257745 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc6100158f0 con 0x561ffe574fa0 2024-09-19T06:46:51.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.852+0000 7fc61dd9c640 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x561ffe574fa0 0x561ffe577390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.852+0000 7fc61dd9c640 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x561ffe574fa0 0x561ffe577390 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=46bd17b635cc4bc4 server_cookie=f294d337c71e8127 in_seq=0 out_seq=0 2024-09-19T06:46:51.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.852+0000 7fc6017fa640 10 client.26767 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:46:51.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.853+0000 7fc6017fa640 1 -- 172.21.15.12:0/1724257745 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc6100158f0 con 0x561ffe574fa0 2024-09-19T06:46:51.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.853+0000 7fc6017fa640 10 client.26767 handle_command_reply: tid=0 2024-09-19T06:46:51.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.853+0000 7fc6223d9740 1 client.26767 shutdown 2024-09-19T06:46:51.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.854+0000 7fc6223d9740 1 -- 172.21.15.12:0/1724257745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 msgr2=0x561ffe562840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.854+0000 7fc6223d9740 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe562840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc610009f30 tx=0x7fc610003c40 comp rx=0 tx=0).stop 2024-09-19T06:46:51.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.854+0000 7fc6223d9740 1 -- 172.21.15.12:0/1724257745 shutdown_connections 2024-09-19T06:46:51.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.854+0000 7fc6223d9740 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x561ffe574fa0 0x561ffe577390 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.854+0000 7fc6223d9740 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe562840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.854+0000 7fc6223d9740 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe5620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.854+0000 7fc6223d9740 1 --2- 172.21.15.12:0/1724257745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe564e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.854+0000 7fc6223d9740 1 -- 172.21.15.12:0/1724257745 >> 172.21.15.12:0/1724257745 conn(0x561ffe523310 msgr2=0x561ffe55c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:51.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.854+0000 7fc6017fa640 0 client.26767 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:46:51.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.856+0000 7fc6223d9740 1 -- 172.21.15.12:0/1724257745 shutdown_connections 2024-09-19T06:46:51.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.856+0000 7fc6223d9740 1 -- 172.21.15.12:0/1724257745 wait complete. 2024-09-19T06:46:51.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.856+0000 7fc6223d9740 20 client.26767 trim_cache size 0 max 16384 2024-09-19T06:46:51.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.889+0000 7fc6223d9740 1 Processor -- start 2024-09-19T06:46:51.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.889+0000 7fc6223d9740 1 -- start start 2024-09-19T06:46:51.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.889+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe556d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.889+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe561090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.889+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe55d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc6223d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc00eae0 con 0x561ffe55a5d0 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc6223d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc010740 con 0x561ffe55bb40 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc6223d9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc00f1b0 con 0x561ffe565370 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61d59b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe561090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61d59b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe561090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47154/0 (socket says 172.21.15.12:47154) 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61dd9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe556d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61d59b640 1 -- 172.21.15.12:0/959486675 learned_addr learned my addr 172.21.15.12:0/959486675 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61e59d640 1 --2- 172.21.15.12:0/959486675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe55d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61d59b640 1 -- 172.21.15.12:0/959486675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 msgr2=0x561ffe55d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:51.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61d59b640 1 --2- 172.21.15.12:0/959486675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe55d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61d59b640 1 -- 172.21.15.12:0/959486675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 msgr2=0x561ffe556d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:51.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61d59b640 1 --2- 172.21.15.12:0/959486675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe556d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61d59b640 1 -- 172.21.15.12:0/959486675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ffe565170 con 0x561ffe55bb40 2024-09-19T06:46:51.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.890+0000 7fc61d59b640 1 --2- 172.21.15.12:0/959486675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe561090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc6140b8990 tx=0x7fc614005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0bf22e4261e2884 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:51.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.891+0000 7fc6037fe640 1 -- 172.21.15.12:0/959486675 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6140dc040 con 0x561ffe55bb40 2024-09-19T06:46:51.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.891+0000 7fc6037fe640 1 -- 172.21.15.12:0/959486675 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6140bcc30 con 0x561ffe55bb40 2024-09-19T06:46:51.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.891+0000 7fc6037fe640 1 -- 172.21.15.12:0/959486675 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6140edc20 con 0x561ffe55bb40 2024-09-19T06:46:51.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.892+0000 7fc6223d9740 1 -- 172.21.15.12:0/959486675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 msgr2=0x561ffe561090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.892+0000 7fc6223d9740 1 --2- 172.21.15.12:0/959486675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe561090 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc6140b8990 tx=0x7fc614005c00 comp rx=0 tx=0).stop 2024-09-19T06:46:51.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.892+0000 7fc6223d9740 1 -- 172.21.15.12:0/959486675 shutdown_connections 2024-09-19T06:46:51.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.892+0000 7fc6223d9740 1 --2- 172.21.15.12:0/959486675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe55d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.892+0000 7fc6223d9740 1 --2- 172.21.15.12:0/959486675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55bb40 0x561ffe561090 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.892+0000 7fc6223d9740 1 --2- 172.21.15.12:0/959486675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55a5d0 0x561ffe556d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.892+0000 7fc6223d9740 1 -- 172.21.15.12:0/959486675 >> 172.21.15.12:0/959486675 conn(0x561ffe523310 msgr2=0x561ffe560980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.892+0000 7fc6223d9740 1 -- 172.21.15.12:0/959486675 shutdown_connections 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.892+0000 7fc6223d9740 1 -- 172.21.15.12:0/959486675 wait complete. 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.893+0000 7fc6223d9740 1 -- start start 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.893+0000 7fc6223d9740 1 Processor -- start 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55a5d0 0x561ffe577540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55bb40 0x561ffe577a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc6223d9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe5dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc6223d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc00ffb0 con 0x561ffe55bb40 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc6223d9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc00f8e0 con 0x561ffe55a5d0 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc6223d9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc00cac0 con 0x561ffe565370 2024-09-19T06:46:51.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc6223d9740 10 client.0 _ll_register_callbacks cb 0x7fc610018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc61dd9c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55a5d0 0x561ffe577540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc61dd9c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55a5d0 0x561ffe577540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47158/0 (socket says 172.21.15.12:47158) 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc61dd9c640 1 -- 172.21.15.12:0/917382514 learned_addr learned my addr 172.21.15.12:0/917382514 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc61e59d640 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe5dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc61d59b640 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55bb40 0x561ffe577a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc61dd9c640 1 -- 172.21.15.12:0/917382514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 msgr2=0x561ffe5dd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc61dd9c640 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe5dd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc61dd9c640 1 -- 172.21.15.12:0/917382514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55bb40 msgr2=0x561ffe577a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc61dd9c640 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55bb40 0x561ffe577a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.894+0000 7fc61dd9c640 1 -- 172.21.15.12:0/917382514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ffe5ddec0 con 0x561ffe55a5d0 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.895+0000 7fc61dd9c640 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55a5d0 0x561ffe577540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc6080106b0 tx=0x7fc608004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e8d6e2df4452d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:51.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.895+0000 7fc6017fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.896+0000 7fc6017fa640 1 -- 172.21.15.12:0/917382514 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608016070 con 0x561ffe55a5d0 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.896+0000 7fc6223d9740 1 -- 172.21.15.12:0/917382514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6140bcc30 con 0x561ffe55a5d0 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.896+0000 7fc6017fa640 1 -- 172.21.15.12:0/917382514 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fc608005020 con 0x561ffe55a5d0 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6017fa640 1 -- 172.21.15.12:0/917382514 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc608005220 con 0x561ffe55a5d0 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6223d9740 10 client.26810 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6223d9740 1 -- 172.21.15.12:0/917382514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x561ffe5df1e0 con 0x561ffe55a5d0 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6017fa640 1 -- 172.21.15.12:0/917382514 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6140bcc30 con 0x561ffe55a5d0 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6017fa640 1 -- 172.21.15.12:0/917382514 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fc6080365d0 con 0x561ffe55a5d0 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6223d9740 10 client.26810 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6223d9740 10 client.26810 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6223d9740 20 client.26810 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6223d9740 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x561ffe5df8c0 0x561ffe5e1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:51.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6223d9740 4 client.26810 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:46:51.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.897+0000 7fc6223d9740 1 -- 172.21.15.12:0/917382514 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561ffe4cd860 con 0x561ffe5df8c0 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.898+0000 7fc61d59b640 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x561ffe5df8c0 0x561ffe5e1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.899+0000 7fc61d59b640 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x561ffe5df8c0 0x561ffe5e1ce0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9438ad67d920bba5 server_cookie=a65697e564c4cf01 in_seq=0 out_seq=0 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.899+0000 7fc6017fa640 10 client.26810 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.899+0000 7fc6017fa640 1 -- 172.21.15.12:0/917382514 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561ffe4cd860 con 0x561ffe5df8c0 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.899+0000 7fc6017fa640 10 client.26810 handle_command_reply: tid=0 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.899+0000 7fc6223d9740 1 client.26810 shutdown 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.899+0000 7fc6223d9740 1 -- 172.21.15.12:0/917382514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55a5d0 msgr2=0x561ffe577540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.899+0000 7fc6223d9740 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55a5d0 0x561ffe577540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc6080106b0 tx=0x7fc608004730 comp rx=0 tx=0).stop 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.900+0000 7fc6223d9740 1 -- 172.21.15.12:0/917382514 shutdown_connections 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.900+0000 7fc6223d9740 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x561ffe5df8c0 0x561ffe5e1ce0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.900+0000 7fc6223d9740 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561ffe565370 0x561ffe5dd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.900+0000 7fc6223d9740 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ffe55bb40 0x561ffe577a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.900+0000 7fc6017fa640 0 client.26810 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:46:51.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.900+0000 7fc6223d9740 1 --2- 172.21.15.12:0/917382514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561ffe55a5d0 0x561ffe577540 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.900+0000 7fc6223d9740 1 -- 172.21.15.12:0/917382514 >> 172.21.15.12:0/917382514 conn(0x561ffe523310 msgr2=0x561ffe570510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:51.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.900+0000 7fc6223d9740 1 -- 172.21.15.12:0/917382514 shutdown_connections 2024-09-19T06:46:51.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.900+0000 7fc6223d9740 1 -- 172.21.15.12:0/917382514 wait complete. 2024-09-19T06:46:51.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.900+0000 7fc6223d9740 20 client.26810 trim_cache size 0 max 16384 2024-09-19T06:46:51.903 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:46:51.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.901+0000 7fc620000640 1 -- 172.21.15.12:0/753817883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6040a35c0 msgr2=0x7fc6040a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.901+0000 7fc620000640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6040a35c0 0x7fc6040a5a80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x561ffe557ac0 tx=0x7fc60800a380 comp rx=0 tx=0).stop 2024-09-19T06:46:51.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.901+0000 7fc620000640 1 -- 172.21.15.12:0/753817883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc618074eb0 msgr2=0x7fc6181a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:51.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.901+0000 7fc620000640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc618074eb0 0x7fc6181a4d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc61402aa10 tx=0x7fc614003cd0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.901+0000 7fc620000640 1 -- 172.21.15.12:0/753817883 shutdown_connections 2024-09-19T06:46:51.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.901+0000 7fc620000640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc6040a35c0 0x7fc6040a5a80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.901+0000 7fc620000640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc618112ba0 0x7fc61819e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.901+0000 7fc620000640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc618074eb0 0x7fc6181a4d10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.901+0000 7fc620000640 1 --2- 172.21.15.12:0/753817883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc618074590 0x7fc6181a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:51.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.901+0000 7fc620000640 1 -- 172.21.15.12:0/753817883 >> 172.21.15.12:0/753817883 conn(0x7fc6180fd8b0 msgr2=0x7fc6180ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:51.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.902+0000 7fc620000640 1 -- 172.21.15.12:0/753817883 shutdown_connections 2024-09-19T06:46:51.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:51.902+0000 7fc620000640 1 -- 172.21.15.12:0/753817883 wait complete. 2024-09-19T06:46:51.917 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:51 smithi012 ceph-mon[30937]: pgmap v204: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 1.06k op/s 2024-09-19T06:46:52.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:51 smithi173 ceph-mon[35349]: pgmap v204: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 1.06k op/s 2024-09-19T06:46:52.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:51 smithi016 ceph-mon[34911]: pgmap v204: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 1.06k op/s 2024-09-19T06:46:53.010 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:46:53.452 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:53.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:53 smithi012 ceph-mon[30937]: pgmap v205: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.6 MiB/s wr, 728 op/s 2024-09-19T06:46:54.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.061+0000 7f0c6384f640 1 -- 172.21.15.12:0/3122730153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5c112a30 msgr2=0x7f0c5c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.061+0000 7f0c6384f640 1 --2- 172.21.15.12:0/3122730153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5c112a30 0x7f0c5c114e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009ca0 tx=0x7f0c5402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.062+0000 7f0c6384f640 1 -- 172.21.15.12:0/3122730153 shutdown_connections 2024-09-19T06:46:54.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.062+0000 7f0c6384f640 1 --2- 172.21.15.12:0/3122730153 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5c112a30 0x7f0c5c114e20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.062+0000 7f0c6384f640 1 --2- 172.21.15.12:0/3122730153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c077040 0x7f0c5c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.062+0000 7f0c6384f640 1 --2- 172.21.15.12:0/3122730153 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c5c076720 0x7f0c5c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.062+0000 7f0c6384f640 1 -- 172.21.15.12:0/3122730153 >> 172.21.15.12:0/3122730153 conn(0x7f0c5c0ffab0 msgr2=0x7f0c5c101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.062+0000 7f0c6384f640 1 -- 172.21.15.12:0/3122730153 shutdown_connections 2024-09-19T06:46:54.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.063+0000 7f0c6384f640 1 -- 172.21.15.12:0/3122730153 wait complete. 2024-09-19T06:46:54.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.063+0000 7f0c6384f640 1 Processor -- start 2024-09-19T06:46:54.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.064+0000 7f0c6384f640 1 -- start start 2024-09-19T06:46:54.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.064+0000 7f0c6384f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c076720 0x7f0c5c1a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.064+0000 7f0c6384f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c5c077040 0x7f0c5c1a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.064+0000 7f0c6384f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5c112a30 0x7f0c5c19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.064+0000 7f0c6384f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c118580 con 0x7f0c5c076720 2024-09-19T06:46:54.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.064+0000 7f0c6384f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c118400 con 0x7f0c5c077040 2024-09-19T06:46:54.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.064+0000 7f0c6384f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c118700 con 0x7f0c5c112a30 2024-09-19T06:46:54.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.065+0000 7f0c61dec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5c112a30 0x7f0c5c19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.065+0000 7f0c61dec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5c112a30 0x7f0c5c19e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46448/0 (socket says 172.21.15.12:46448) 2024-09-19T06:46:54.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.065+0000 7f0c61dec640 1 -- 172.21.15.12:0/2306508810 learned_addr learned my addr 172.21.15.12:0/2306508810 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:54.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.065+0000 7f0c61dec640 1 -- 172.21.15.12:0/2306508810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c5c077040 msgr2=0x7f0c5c1a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.065+0000 7f0c61dec640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c5c077040 0x7f0c5c1a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.065+0000 7f0c61dec640 1 -- 172.21.15.12:0/2306508810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c076720 msgr2=0x7f0c5c1a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.065+0000 7f0c61dec640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c076720 0x7f0c5c1a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.065+0000 7f0c61dec640 1 -- 172.21.15.12:0/2306508810 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5c19f020 con 0x7f0c5c112a30 2024-09-19T06:46:54.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.066+0000 7f0c61dec640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5c112a30 0x7f0c5c19e8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009bf0 tx=0x7f0c54003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.067+0000 7f0c527fc640 1 -- 172.21.15.12:0/2306508810 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54031650 con 0x7f0c5c112a30 2024-09-19T06:46:54.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.067+0000 7f0c527fc640 1 -- 172.21.15.12:0/2306508810 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c540317f0 con 0x7f0c5c112a30 2024-09-19T06:46:54.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.067+0000 7f0c527fc640 1 -- 172.21.15.12:0/2306508810 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5402f9f0 con 0x7f0c5c112a30 2024-09-19T06:46:54.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.068+0000 7f0c6384f640 1 -- 172.21.15.12:0/2306508810 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5c19f2b0 con 0x7f0c5c112a30 2024-09-19T06:46:54.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.068+0000 7f0c6384f640 1 -- 172.21.15.12:0/2306508810 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c5c1ab600 con 0x7f0c5c112a30 2024-09-19T06:46:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.070+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1396619897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec04101370 msgr2=0x7fec0410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.070+0000 7fec0c7c4640 1 --2- 172.21.15.12:0/1396619897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec04101370 0x7fec0410d8a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7febfc009cd0 tx=0x7febfc02a8f0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.070+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1396619897 shutdown_connections 2024-09-19T06:46:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.070+0000 7fec0c7c4640 1 --2- 172.21.15.12:0/1396619897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec04101370 0x7fec0410d8a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.070+0000 7fec0c7c4640 1 --2- 172.21.15.12:0/1396619897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec041009d0 0x7fec04100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.070+0000 7fec0c7c4640 1 --2- 172.21.15.12:0/1396619897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec041069e0 0x7fec04106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.070+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1396619897 >> 172.21.15.12:0/1396619897 conn(0x7fec040fc6f0 msgr2=0x7fec040feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.072+0000 7f0c65c28740 1 Processor -- start 2024-09-19T06:46:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.073+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1396619897 shutdown_connections 2024-09-19T06:46:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.073+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1396619897 wait complete. 2024-09-19T06:46:54.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.072+0000 7f0c527fc640 1 -- 172.21.15.12:0/2306508810 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0c5402fb90 con 0x7f0c5c112a30 2024-09-19T06:46:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.073+0000 7f0c65c28740 1 -- start start 2024-09-19T06:46:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.073+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b243545b40 0x55b243544090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b243544a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 0x55b243551760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c65c28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b2434aa2f0 con 0x55b2435445d0 2024-09-19T06:46:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c65c28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b243451cf0 con 0x55b24354f370 2024-09-19T06:46:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c65c28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b2434a62b0 con 0x55b243545b40 2024-09-19T06:46:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c60dea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b243545b40 0x55b243544090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c60dea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b243545b40 0x55b243544090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46458/0 (socket says 172.21.15.12:46458) 2024-09-19T06:46:54.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c60dea640 1 -- 172.21.15.12:0/1314094899 learned_addr learned my addr 172.21.15.12:0/1314094899 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.074+0000 7fec0c7c4640 1 Processor -- start 2024-09-19T06:46:54.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c527fc640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c480a35c0 0x7f0c480a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c60dea640 1 --2- 172.21.15.12:0/1314094899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 0x55b243551760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c615eb640 1 --2- 172.21.15.12:0/1314094899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b243544a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c60dea640 1 -- 172.21.15.12:0/1314094899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 msgr2=0x55b243551760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c60dea640 1 --2- 172.21.15.12:0/1314094899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 0x55b243551760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c60dea640 1 -- 172.21.15.12:0/1314094899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 msgr2=0x55b243544a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c60dea640 1 --2- 172.21.15.12:0/1314094899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b243544a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.074+0000 7f0c60dea640 1 -- 172.21.15.12:0/1314094899 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2434363a0 con 0x55b243545b40 2024-09-19T06:46:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.074+0000 7fec0c7c4640 1 -- start start 2024-09-19T06:46:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.075+0000 7fec0c7c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec041009d0 0x7fec0419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.075+0000 7fec0c7c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec04101370 0x7fec0419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.075+0000 7fec0c7c4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec041069e0 0x7fec0419ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.075+0000 7fec0c7c4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fec04110e20 con 0x7fec041009d0 2024-09-19T06:46:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.075+0000 7f0c527fc640 1 -- 172.21.15.12:0/2306508810 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0c540f12f0 con 0x7f0c5c112a30 2024-09-19T06:46:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.075+0000 7f0c60dea640 1 --2- 172.21.15.12:0/1314094899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b243545b40 0x55b243544090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005fd0 tx=0x7f0c4c00b2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6072197e44397e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.075+0000 7fec0c7c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec04110ca0 con 0x7fec04101370 2024-09-19T06:46:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.075+0000 7fec0c7c4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fec04110fa0 con 0x7fec041069e0 2024-09-19T06:46:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.075+0000 7fec0a560640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec041009d0 0x7fec0419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.075+0000 7fec0a560640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec041009d0 0x7fec0419a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44636/0 (socket says 172.21.15.12:44636) 2024-09-19T06:46:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.075+0000 7f0c477fe640 1 -- 172.21.15.12:0/1314094899 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c005220 con 0x55b243545b40 2024-09-19T06:46:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.075+0000 7f0c61dec640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c480a35c0 0x7f0c480a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.075+0000 7fec0a560640 1 -- 172.21.15.12:0/1504582664 learned_addr learned my addr 172.21.15.12:0/1504582664 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:54.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.075+0000 7f0c477fe640 1 -- 172.21.15.12:0/1314094899 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c4c004c80 con 0x55b243545b40 2024-09-19T06:46:54.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.075+0000 7f0c477fe640 1 -- 172.21.15.12:0/1314094899 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0099b0 con 0x55b243545b40 2024-09-19T06:46:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.075+0000 7fec09d5f640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec04101370 0x7fec0419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.076+0000 7fec0ad61640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec041069e0 0x7fec0419ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.076+0000 7fec09d5f640 1 -- 172.21.15.12:0/1504582664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec041069e0 msgr2=0x7fec0419ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.076+0000 7fec09d5f640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec041069e0 0x7fec0419ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.076+0000 7fec09d5f640 1 -- 172.21.15.12:0/1504582664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec041009d0 msgr2=0x7fec0419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.076+0000 7fec09d5f640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec041009d0 0x7fec0419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.077+0000 7f0c65c28740 1 -- 172.21.15.12:0/1314094899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b243545b40 msgr2=0x55b243544090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.077+0000 7f0c65c28740 1 --2- 172.21.15.12:0/1314094899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b243545b40 0x55b243544090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005fd0 tx=0x7f0c4c00b2d0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.077+0000 7fec09d5f640 1 -- 172.21.15.12:0/1504582664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0419f550 con 0x7fec04101370 2024-09-19T06:46:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.077+0000 7fec09d5f640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec04101370 0x7fec0419aaa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec0000b3f0 tx=0x7fec0000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.077+0000 7febfb7fe640 1 -- 172.21.15.12:0/1504582664 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00015020 con 0x7fec04101370 2024-09-19T06:46:54.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.077+0000 7f0c65c28740 1 -- 172.21.15.12:0/1314094899 shutdown_connections 2024-09-19T06:46:54.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.077+0000 7f0c65c28740 1 --2- 172.21.15.12:0/1314094899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 0x55b243551760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.077+0000 7f0c65c28740 1 --2- 172.21.15.12:0/1314094899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b243544a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.077+0000 7f0c65c28740 1 --2- 172.21.15.12:0/1314094899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b243545b40 0x55b243544090 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.077+0000 7f0c65c28740 1 -- 172.21.15.12:0/1314094899 >> 172.21.15.12:0/1314094899 conn(0x55b24350d310 msgr2=0x55b243540c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.078+0000 7febfb7fe640 1 -- 172.21.15.12:0/1504582664 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec00011d10 con 0x7fec04101370 2024-09-19T06:46:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.078+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1504582664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0419f840 con 0x7fec04101370 2024-09-19T06:46:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.078+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1504582664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec041a70d0 con 0x7fec04101370 2024-09-19T06:46:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.078+0000 7febfb7fe640 1 -- 172.21.15.12:0/1504582664 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0000f2e0 con 0x7fec04101370 2024-09-19T06:46:54.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.082+0000 7febfb7fe640 1 -- 172.21.15.12:0/1504582664 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fec00018020 con 0x7fec04101370 2024-09-19T06:46:54.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.082+0000 7f0c61dec640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c480a35c0 0x7f0c480a5a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c54043040 tx=0x7f0c5403e040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.082+0000 7f0c65c28740 1 -- 172.21.15.12:0/1314094899 shutdown_connections 2024-09-19T06:46:54.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.082+0000 7f0c65c28740 1 -- 172.21.15.12:0/1314094899 wait complete. 2024-09-19T06:46:54.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.083+0000 7f0c65c28740 1 -- start start 2024-09-19T06:46:54.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.083+0000 7f0c65c28740 1 Processor -- start 2024-09-19T06:46:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.083+0000 7fec0f63b740 1 Processor -- start 2024-09-19T06:46:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.083+0000 7fec0f63b740 1 -- start start 2024-09-19T06:46:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.083+0000 7febfb7fe640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7febf00a34e0 0x7febf00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233e5af0 0x55a9233e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a9233f0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec0ad61640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7febf00a34e0 0x7febf00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec0f63b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a92334a2f0 con 0x55a9233e5af0 2024-09-19T06:46:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec0f63b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a9232f2270 con 0x55a9233f0cb0 2024-09-19T06:46:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec0f63b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a9233462b0 con 0x55a9233e6410 2024-09-19T06:46:54.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec09d5f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a9233f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec09d5f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a9233f0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46474/0 (socket says 172.21.15.12:46474) 2024-09-19T06:46:54.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b243545b40 0x55b24354c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec09d5f640 1 -- 172.21.15.12:0/3374827738 learned_addr learned my addr 172.21.15.12:0/3374827738 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec0ad61640 1 --2- 172.21.15.12:0/3374827738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec09d5f640 1 -- 172.21.15.12:0/3374827738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 msgr2=0x55a9233f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec09d5f640 1 --2- 172.21.15.12:0/3374827738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec09d5f640 1 -- 172.21.15.12:0/3374827738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233e5af0 msgr2=0x55a9233e5ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:46:54.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec09d5f640 1 --2- 172.21.15.12:0/3374827738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233e5af0 0x55a9233e5ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec09d5f640 1 -- 172.21.15.12:0/3374827738 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9232f1340 con 0x55a9233e6410 2024-09-19T06:46:54.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.084+0000 7fec0ad61640 1 --2- 172.21.15.12:0/3374827738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:54.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.085+0000 7fec09d5f640 1 --2- 172.21.15.12:0/3374827738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a9233f0770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec000a4ea0 tx=0x7fec000108f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=416493a4dea124b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24354f370 0x55b24354c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c615eb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b243545b40 0x55b24354c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c615eb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b243545b40 0x55b24354c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47202/0 (socket says 172.21.15.12:47202) 2024-09-19T06:46:54.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c615eb640 1 -- 172.21.15.12:0/91341089 learned_addr learned my addr 172.21.15.12:0/91341089 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:54.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c65c28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b243552070 con 0x55b2435445d0 2024-09-19T06:46:54.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c65c28740 1 -- 172.21.15.12:0/91341089 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b243465060 con 0x55b243545b40 2024-09-19T06:46:54.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c65c28740 1 -- 172.21.15.12:0/91341089 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b2435521f0 con 0x55b24354f370 2024-09-19T06:46:54.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c65c28740 10 client.0 _ll_register_callbacks cb 0x55b2431b88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:54.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c60dea640 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24354f370 0x55b24354c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.084+0000 7f0c60dea640 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.085+0000 7febf8ff9640 1 -- 172.21.15.12:0/3374827738 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0006f600 con 0x55a9233e6410 2024-09-19T06:46:54.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.085+0000 7f0c615eb640 1 -- 172.21.15.12:0/91341089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24354f370 msgr2=0x55b24354c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.085+0000 7f0c615eb640 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24354f370 0x55b24354c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.085+0000 7f0c615eb640 1 -- 172.21.15.12:0/91341089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 msgr2=0x55b24354ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.085+0000 7f0c615eb640 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.085+0000 7f0c615eb640 1 -- 172.21.15.12:0/91341089 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b24321b3c0 con 0x55b243545b40 2024-09-19T06:46:54.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.085+0000 7f0c60dea640 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:54.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.085+0000 7fec0ad61640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7febf00a34e0 0x7febf00a59a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7febfc0093f0 tx=0x7febfc030990 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.085+0000 7febfb7fe640 1 -- 172.21.15.12:0/1504582664 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fec000cf280 con 0x7fec04101370 2024-09-19T06:46:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.085+0000 7febf8ff9640 1 -- 172.21.15.12:0/3374827738 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec00088740 con 0x55a9233e6410 2024-09-19T06:46:54.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.085+0000 7febf8ff9640 1 -- 172.21.15.12:0/3374827738 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0006e790 con 0x55a9233e6410 2024-09-19T06:46:54.094 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:53 smithi173 ceph-mon[35349]: pgmap v205: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.6 MiB/s wr, 728 op/s 2024-09-19T06:46:54.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.085+0000 7f0c615eb640 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b243545b40 0x55b24354c090 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c58011690 tx=0x7f0c58011b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a8ddc95e4e3344f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.085+0000 7f0c44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:54.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.085+0000 7f0c44ff9640 1 -- 172.21.15.12:0/91341089 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5801f060 con 0x55b243545b40 2024-09-19T06:46:54.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.086+0000 7f0c65c28740 1 -- 172.21.15.12:0/91341089 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c4c004c80 con 0x55b243545b40 2024-09-19T06:46:54.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.086+0000 7f0c44ff9640 1 -- 172.21.15.12:0/91341089 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0c5800fac0 con 0x55b243545b40 2024-09-19T06:46:54.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.086+0000 7f0c44ff9640 1 -- 172.21.15.12:0/91341089 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0c58011e90 con 0x55b243545b40 2024-09-19T06:46:54.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.086+0000 7f0c65c28740 10 client.26822 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:54.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.086+0000 7f0c65c28740 1 -- 172.21.15.12:0/91341089 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55b24355dbe0 con 0x55b243545b40 2024-09-19T06:46:54.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.086+0000 7f0c44ff9640 1 -- 172.21.15.12:0/91341089 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c4c004c80 con 0x55b243545b40 2024-09-19T06:46:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.086+0000 7fec0f63b740 1 -- 172.21.15.12:0/3374827738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 msgr2=0x55a9233f0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.087+0000 7fec0f63b740 1 --2- 172.21.15.12:0/3374827738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a9233f0770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec000a4ea0 tx=0x7fec000108f0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.087+0000 7fec0f63b740 1 -- 172.21.15.12:0/3374827738 shutdown_connections 2024-09-19T06:46:54.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.087+0000 7f0c44ff9640 1 -- 172.21.15.12:0/91341089 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f0c58022430 con 0x55b243545b40 2024-09-19T06:46:54.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.087+0000 7f0c65c28740 10 client.26822 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:54.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.087+0000 7f0c65c28740 10 client.26822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:54.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.087+0000 7f0c65c28740 20 client.26822 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:54.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.087+0000 7f0c65c28740 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b24355f4d0 0x55b243561970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.087+0000 7f0c65c28740 4 client.26822 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:54.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.087+0000 7f0c65c28740 1 -- 172.21.15.12:0/91341089 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2434b7860 con 0x55b24355f4d0 2024-09-19T06:46:54.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.087+0000 7fec0f63b740 1 --2- 172.21.15.12:0/3374827738 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.087+0000 7fec0f63b740 1 --2- 172.21.15.12:0/3374827738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a9233f0770 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.087+0000 7f0c60dea640 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b24355f4d0 0x55b243561970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.087+0000 7fec0f63b740 1 --2- 172.21.15.12:0/3374827738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233e5af0 0x55a9233e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.098 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.087+0000 7fec0f63b740 1 -- 172.21.15.12:0/3374827738 >> 172.21.15.12:0/3374827738 conn(0x55a9233e2060 msgr2=0x55a9233e2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.087+0000 7f0c44ff9640 10 client.26822 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.087+0000 7f0c60dea640 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b24355f4d0 0x55b243561970 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3321a678ffeac1b9 server_cookie=5f01a9a6d04ce753 in_seq=0 out_seq=0 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.088+0000 7f0c44ff9640 1 -- 172.21.15.12:0/91341089 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2434b7860 con 0x55b24355f4d0 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.088+0000 7f0c44ff9640 10 client.26822 handle_command_reply: tid=0 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.088+0000 7f0c65c28740 1 client.26822 shutdown 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 1 -- 172.21.15.12:0/91341089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b243545b40 msgr2=0x55b24354c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b243545b40 0x55b24354c090 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c58011690 tx=0x7f0c58011b50 comp rx=0 tx=0).stop 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 1 -- 172.21.15.12:0/91341089 shutdown_connections 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b24355f4d0 0x55b243561970 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24354f370 0x55b24354c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b243545b40 0x55b24354c090 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0c58011690 tx=0x7f0c58011b50 comp rx=0 tx=0).stop 2024-09-19T06:46:54.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 1 --2- 172.21.15.12:0/91341089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 1 -- 172.21.15.12:0/91341089 >> 172.21.15.12:0/91341089 conn(0x55b24350d310 msgr2=0x55b243546960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c44ff9640 0 client.26822 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:54.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 1 -- 172.21.15.12:0/91341089 shutdown_connections 2024-09-19T06:46:54.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 1 -- 172.21.15.12:0/91341089 wait complete. 2024-09-19T06:46:54.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.089+0000 7f0c65c28740 20 client.26822 trim_cache size 0 max 16384 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.090+0000 7fec0f63b740 1 -- 172.21.15.12:0/3374827738 shutdown_connections 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.090+0000 7fec0f63b740 1 -- 172.21.15.12:0/3374827738 wait complete. 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.091+0000 7fec0f63b740 1 -- start start 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.091+0000 7fec0f63b740 1 Processor -- start 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.091+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e5af0 0x55a9233edba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.091+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233e6410 0x55a9233ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.091+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233ee620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.091+0000 7fec0f63b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a9233f3700 con 0x55a9233e6410 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.091+0000 7fec0f63b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a9232d3290 con 0x55a9233f0cb0 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.091+0000 7fec0f63b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a9233f3880 con 0x55a9233e5af0 2024-09-19T06:46:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.091+0000 7fec0f63b740 10 client.0 _ll_register_callbacks cb 0x55a923304140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec0a560640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e5af0 0x55a9233edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec0ad61640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233ee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec09d5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233e6410 0x55a9233ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec0ad61640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233ee620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47204/0 (socket says 172.21.15.12:47204) 2024-09-19T06:46:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec0ad61640 1 -- 172.21.15.12:0/2747453233 learned_addr learned my addr 172.21.15.12:0/2747453233 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec0ad61640 1 -- 172.21.15.12:0/2747453233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e5af0 msgr2=0x55a9233edba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec0ad61640 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e5af0 0x55a9233edba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec0ad61640 1 -- 172.21.15.12:0/2747453233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233e6410 msgr2=0x55a9233ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec0ad61640 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233e6410 0x55a9233ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec0ad61640 1 -- 172.21.15.12:0/2747453233 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a92305d210 con 0x55a9233f0cb0 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.092+0000 7fec09d5f640 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233e6410 0x55a9233ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.093+0000 7fec0ad61640 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233ee620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7febfc0039c0 tx=0x7febfc0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7c705a1776d157a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.093+0000 7febedffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.093+0000 7febedffb640 1 -- 172.21.15.12:0/2747453233 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc004240 con 0x55a9233f0cb0 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.093+0000 7febedffb640 1 -- 172.21.15.12:0/2747453233 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7febfc0043e0 con 0x55a9233f0cb0 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.093+0000 7fec0f63b740 1 -- 172.21.15.12:0/2747453233 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec00088740 con 0x55a9233f0cb0 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.093+0000 7febedffb640 1 -- 172.21.15.12:0/2747453233 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7febfc0045e0 con 0x55a9233f0cb0 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.093+0000 7fec0f63b740 10 client.26825 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.093+0000 7fec0f63b740 1 -- 172.21.15.12:0/2747453233 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55a923129620 con 0x55a9233f0cb0 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.094+0000 7febedffb640 1 -- 172.21.15.12:0/2747453233 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec00088740 con 0x55a9233f0cb0 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.094+0000 7febedffb640 1 -- 172.21.15.12:0/2747453233 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7febfc058070 con 0x55a9233f0cb0 2024-09-19T06:46:54.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.094+0000 7fec0f63b740 10 client.26825 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.094+0000 7fec0f63b740 10 client.26825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.094+0000 7fec0f63b740 20 client.26825 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.094+0000 7fec0f63b740 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a923409280 0x55a92340b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.094+0000 7fec0f63b740 4 client.26825 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.094+0000 7fec0f63b740 1 -- 172.21.15.12:0/2747453233 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a923357a20 con 0x55a923409280 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.094+0000 7fec0a560640 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a923409280 0x55a92340b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.095+0000 7fec0a560640 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a923409280 0x55a92340b6e0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63dedd7769c19815 server_cookie=15fef02b5098074a in_seq=0 out_seq=0 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.095+0000 7febedffb640 10 client.26825 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.096+0000 7febedffb640 1 -- 172.21.15.12:0/2747453233 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a923357a20 con 0x55a923409280 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.096+0000 7febedffb640 10 client.26825 handle_command_reply: tid=0 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 client.26825 shutdown 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 -- 172.21.15.12:0/2747453233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 msgr2=0x55a9233ee620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233ee620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7febfc0039c0 tx=0x7febfc0095c0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 -- 172.21.15.12:0/2747453233 shutdown_connections 2024-09-19T06:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a923409280 0x55a92340b6e0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233f0cb0 0x55a9233ee620 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233e6410 0x55a9233ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 --2- 172.21.15.12:0/2747453233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e5af0 0x55a9233edba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 -- 172.21.15.12:0/2747453233 >> 172.21.15.12:0/2747453233 conn(0x55a9233e2060 msgr2=0x55a9233e7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7febedffb640 0 client.26825 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 -- 172.21.15.12:0/2747453233 shutdown_connections 2024-09-19T06:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 1 -- 172.21.15.12:0/2747453233 wait complete. 2024-09-19T06:46:54.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.097+0000 7fec0f63b740 20 client.26825 trim_cache size 0 max 16384 2024-09-19T06:46:54.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.114+0000 7f0c65c28740 1 Processor -- start 2024-09-19T06:46:54.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.114+0000 7f0c65c28740 1 -- start start 2024-09-19T06:46:54.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.114+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24350d310 0x55b24355b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.114+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.114+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 0x55b243567280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.114+0000 7f0c65c28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c1b4160 con 0x55b2435445d0 2024-09-19T06:46:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.114+0000 7f0c65c28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c1b5dc0 con 0x55b24354f370 2024-09-19T06:46:54.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.114+0000 7f0c65c28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c1b4830 con 0x55b24350d310 2024-09-19T06:46:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c615eb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c615eb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44656/0 (socket says 172.21.15.12:44656) 2024-09-19T06:46:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c615eb640 1 -- 172.21.15.12:0/3017248243 learned_addr learned my addr 172.21.15.12:0/3017248243 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c60dea640 1 --2- 172.21.15.12:0/3017248243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 0x55b243567280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c60dea640 1 -- 172.21.15.12:0/3017248243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24350d310 msgr2=0x55b24355b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c60dea640 1 --2- 172.21.15.12:0/3017248243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24350d310 0x55b24355b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c60dea640 1 -- 172.21.15.12:0/3017248243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 msgr2=0x55b24354b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c60dea640 1 --2- 172.21.15.12:0/3017248243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c60dea640 1 -- 172.21.15.12:0/3017248243 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b243541950 con 0x55b24354f370 2024-09-19T06:46:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c615eb640 1 --2- 172.21.15.12:0/3017248243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.115+0000 7f0c60dea640 1 --2- 172.21.15.12:0/3017248243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 0x55b243567280 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005d80 tx=0x7f0c4c022040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41c0caeca9bab77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c46ffd640 1 -- 172.21.15.12:0/3017248243 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c004c00 con 0x55b24354f370 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c46ffd640 1 -- 172.21.15.12:0/3017248243 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c4c00b930 con 0x55b24354f370 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c46ffd640 1 -- 172.21.15.12:0/3017248243 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c009b50 con 0x55b24354f370 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c65c28740 1 -- 172.21.15.12:0/3017248243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 msgr2=0x55b243567280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c65c28740 1 --2- 172.21.15.12:0/3017248243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 0x55b243567280 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005d80 tx=0x7f0c4c022040 comp rx=0 tx=0).stop 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c65c28740 1 -- 172.21.15.12:0/3017248243 shutdown_connections 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c65c28740 1 --2- 172.21.15.12:0/3017248243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24354f370 0x55b243567280 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c65c28740 1 --2- 172.21.15.12:0/3017248243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b24354b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c65c28740 1 --2- 172.21.15.12:0/3017248243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24350d310 0x55b24355b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c65c28740 1 -- 172.21.15.12:0/3017248243 >> 172.21.15.12:0/3017248243 conn(0x55b243547ac0 msgr2=0x55b24354a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c65c28740 1 -- 172.21.15.12:0/3017248243 shutdown_connections 2024-09-19T06:46:54.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.116+0000 7f0c65c28740 1 -- 172.21.15.12:0/3017248243 wait complete. 2024-09-19T06:46:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.117+0000 7f0c65c28740 1 -- start start 2024-09-19T06:46:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.117+0000 7f0c65c28740 1 Processor -- start 2024-09-19T06:46:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24350d310 0x55b243557870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b243557db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c65c28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24354f370 0x55b243548cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c65c28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c1b5630 con 0x55b2435445d0 2024-09-19T06:46:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c65c28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c1b4f60 con 0x55b24350d310 2024-09-19T06:46:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c65c28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5c1b2140 con 0x55b24354f370 2024-09-19T06:46:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c615eb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b243557db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c65c28740 10 client.0 _ll_register_callbacks cb 0x7f0c580095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c615eb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b243557db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44668/0 (socket says 172.21.15.12:44668) 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c615eb640 1 -- 172.21.15.12:0/988557760 learned_addr learned my addr 172.21.15.12:0/988557760 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c60dea640 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24350d310 0x55b243557870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c615eb640 1 -- 172.21.15.12:0/988557760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24354f370 msgr2=0x55b243548cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c615eb640 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24354f370 0x55b243548cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c615eb640 1 -- 172.21.15.12:0/988557760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24350d310 msgr2=0x55b243557870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c615eb640 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24350d310 0x55b243557870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.118+0000 7f0c615eb640 1 -- 172.21.15.12:0/988557760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2435494f0 con 0x55b2435445d0 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.119+0000 7f0c615eb640 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b243557db0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0c58022850 tx=0x7f0c58023fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dd9dbcb7c9c864 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.119+0000 7f0c44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.119+0000 7f0c44ff9640 1 -- 172.21.15.12:0/988557760 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58004240 con 0x55b2435445d0 2024-09-19T06:46:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.119+0000 7f0c44ff9640 1 -- 172.21.15.12:0/988557760 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f0c580043e0 con 0x55b2435445d0 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.119+0000 7f0c65c28740 1 -- 172.21.15.12:0/988557760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c4c00b930 con 0x55b2435445d0 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.119+0000 7f0c44ff9640 1 -- 172.21.15.12:0/988557760 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0c58022640 con 0x55b2435445d0 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.119+0000 7f0c65c28740 10 client.17334 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.119+0000 7f0c65c28740 1 -- 172.21.15.12:0/988557760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55b2435c9f40 con 0x55b2435445d0 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.120+0000 7f0c44ff9640 1 -- 172.21.15.12:0/988557760 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c4c00b930 con 0x55b2435445d0 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.120+0000 7f0c44ff9640 1 -- 172.21.15.12:0/988557760 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f0c58039070 con 0x55b2435445d0 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.120+0000 7f0c65c28740 10 client.17334 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.120+0000 7f0c65c28740 10 client.17334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.120+0000 7f0c65c28740 20 client.17334 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.120+0000 7f0c65c28740 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b2435ca7b0 0x55b2435ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.120+0000 7f0c65c28740 4 client.17334 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.120+0000 7f0c65c28740 1 -- 172.21.15.12:0/988557760 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b2434b1d70 con 0x55b2435ca7b0 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.120+0000 7f0c60dea640 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b2435ca7b0 0x55b2435ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c44ff9640 10 client.17334 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c60dea640 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b2435ca7b0 0x55b2435ccbd0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ceaaa6d310d1488 server_cookie=9d49650b85ee84b4 in_seq=0 out_seq=0 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c44ff9640 1 -- 172.21.15.12:0/988557760 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b2434b1d70 con 0x55b2435ca7b0 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c44ff9640 10 client.17334 handle_command_reply: tid=0 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 client.17334 shutdown 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 -- 172.21.15.12:0/988557760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 msgr2=0x55b243557db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b243557db0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0c58022850 tx=0x7f0c58023fe0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 -- 172.21.15.12:0/988557760 shutdown_connections 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b2435ca7b0 0x55b2435ccbd0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b24354f370 0x55b243548cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2435445d0 0x55b243557db0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c44ff9640 0 client.17334 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 --2- 172.21.15.12:0/988557760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b24350d310 0x55b243557870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 -- 172.21.15.12:0/988557760 >> 172.21.15.12:0/988557760 conn(0x55b243547ac0 msgr2=0x55b24354b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 -- 172.21.15.12:0/988557760 shutdown_connections 2024-09-19T06:46:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 1 -- 172.21.15.12:0/988557760 wait complete. 2024-09-19T06:46:54.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.121+0000 7f0c65c28740 20 client.17334 trim_cache size 0 max 16384 2024-09-19T06:46:54.128 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:46:54.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 -- 172.21.15.12:0/2306508810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c480a35c0 msgr2=0x7f0c480a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c480a35c0 0x7f0c480a5a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c54043040 tx=0x7f0c5403e040 comp rx=0 tx=0).stop 2024-09-19T06:46:54.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 -- 172.21.15.12:0/2306508810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5c112a30 msgr2=0x7f0c5c19e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5c112a30 0x7f0c5c19e8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009bf0 tx=0x7f0c54003f10 comp rx=0 tx=0).stop 2024-09-19T06:46:54.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 -- 172.21.15.12:0/2306508810 shutdown_connections 2024-09-19T06:46:54.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0c480a35c0 0x7f0c480a5a80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c5c112a30 0x7f0c5c19e8f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c5c077040 0x7f0c5c1a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 --2- 172.21.15.12:0/2306508810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c076720 0x7f0c5c1a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 -- 172.21.15.12:0/2306508810 >> 172.21.15.12:0/2306508810 conn(0x7f0c5c0ffab0 msgr2=0x7f0c5c101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 -- 172.21.15.12:0/2306508810 shutdown_connections 2024-09-19T06:46:54.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:54.122+0000 7f0c6384f640 1 -- 172.21.15.12:0/2306508810 wait complete. 2024-09-19T06:46:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.123+0000 7fec0f63b740 1 Processor -- start 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.123+0000 7fec0f63b740 1 -- start start 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.123+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e5af0 0x55a9233e8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.123+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a923410ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 0x55a923411530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0f63b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7febe800e9d0 con 0x55a9233f0cb0 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0f63b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7febe8010630 con 0x55a9233e5af0 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0f63b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7febe800f0a0 con 0x55a9233e6410 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0a560640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e5af0 0x55a9233e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0a560640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e5af0 0x55a9233e8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47238/0 (socket says 172.21.15.12:47238) 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0a560640 1 -- 172.21.15.12:0/3775869364 learned_addr learned my addr 172.21.15.12:0/3775869364 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec09d5f640 1 --2- 172.21.15.12:0/3775869364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a923410ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0ad61640 1 --2- 172.21.15.12:0/3775869364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 0x55a923411530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0a560640 1 -- 172.21.15.12:0/3775869364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 msgr2=0x55a923410ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0a560640 1 --2- 172.21.15.12:0/3775869364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a923410ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0a560640 1 -- 172.21.15.12:0/3775869364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 msgr2=0x55a923411530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0a560640 1 --2- 172.21.15.12:0/3775869364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 0x55a923411530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0a560640 1 -- 172.21.15.12:0/3775869364 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9233f33e0 con 0x55a9233e5af0 2024-09-19T06:46:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec09d5f640 1 --2- 172.21.15.12:0/3775869364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a923410ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7fec0a560640 1 --2- 172.21.15.12:0/3775869364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e5af0 0x55a9233e8560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7febf400ad80 tx=0x7febf4012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df6d977daa36ba18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7febeffff640 1 -- 172.21.15.12:0/3775869364 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4021020 con 0x55a9233e5af0 2024-09-19T06:46:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7febeffff640 1 -- 172.21.15.12:0/3775869364 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf40120d0 con 0x55a9233e5af0 2024-09-19T06:46:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.124+0000 7febeffff640 1 -- 172.21.15.12:0/3775869364 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf40108f0 con 0x55a9233e5af0 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.125+0000 7fec0f63b740 1 -- 172.21.15.12:0/3775869364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e5af0 msgr2=0x55a9233e8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.125+0000 7fec0f63b740 1 --2- 172.21.15.12:0/3775869364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e5af0 0x55a9233e8560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7febf400ad80 tx=0x7febf4012820 comp rx=0 tx=0).stop 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.125+0000 7fec0f63b740 1 -- 172.21.15.12:0/3775869364 shutdown_connections 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.125+0000 7fec0f63b740 1 --2- 172.21.15.12:0/3775869364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 0x55a923411530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.125+0000 7fec0f63b740 1 --2- 172.21.15.12:0/3775869364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e6410 0x55a923410ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.125+0000 7fec0f63b740 1 --2- 172.21.15.12:0/3775869364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e5af0 0x55a9233e8560 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.125+0000 7fec0f63b740 1 -- 172.21.15.12:0/3775869364 >> 172.21.15.12:0/3775869364 conn(0x55a9233e2060 msgr2=0x55a9233efc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.125+0000 7fec0f63b740 1 -- 172.21.15.12:0/3775869364 shutdown_connections 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.125+0000 7fec0f63b740 1 -- 172.21.15.12:0/3775869364 wait complete. 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec0f63b740 1 -- start start 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec0f63b740 1 Processor -- start 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e5af0 0x55a923401bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e6410 0x55a9233fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec0f63b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 0x55a9233fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec0f63b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7febe800fea0 con 0x55a9233f0cb0 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec09d5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e6410 0x55a9233fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec09d5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e6410 0x55a9233fcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47242/0 (socket says 172.21.15.12:47242) 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec09d5f640 1 -- 172.21.15.12:0/658703291 learned_addr learned my addr 172.21.15.12:0/658703291 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec0f63b740 1 -- 172.21.15.12:0/658703291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7febe800f7d0 con 0x55a9233e6410 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec0a560640 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e5af0 0x55a923401bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec0f63b740 1 -- 172.21.15.12:0/658703291 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7febe800c9b0 con 0x55a9233e5af0 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.126+0000 7fec0f63b740 10 client.0 _ll_register_callbacks cb 0x7febfc030d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec0ad61640 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 0x55a9233fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec09d5f640 1 -- 172.21.15.12:0/658703291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e5af0 msgr2=0x55a923401bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec09d5f640 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e5af0 0x55a923401bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec09d5f640 1 -- 172.21.15.12:0/658703291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 msgr2=0x55a9233fd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec09d5f640 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 0x55a9233fd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec09d5f640 1 -- 172.21.15.12:0/658703291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9233fdd10 con 0x55a9233e6410 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec0ad61640 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 0x55a9233fd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec09d5f640 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e6410 0x55a9233fcef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fec00099130 tx=0x7fec000ccd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a035cadc565de91e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7febedffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7febedffb640 1 -- 172.21.15.12:0/658703291 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0006e980 con 0x55a9233e6410 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7febedffb640 1 -- 172.21.15.12:0/658703291 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fec00010430 con 0x55a9233e6410 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec0f63b740 1 -- 172.21.15.12:0/658703291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf40120d0 con 0x55a9233e6410 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7febedffb640 1 -- 172.21.15.12:0/658703291 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fec0006ebc0 con 0x55a9233e6410 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec0f63b740 10 client.26837 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.127+0000 7fec0f63b740 1 -- 172.21.15.12:0/658703291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55a923474090 con 0x55a9233e6410 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.128+0000 7febedffb640 1 -- 172.21.15.12:0/658703291 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf40120d0 con 0x55a9233e6410 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.128+0000 7febedffb640 1 -- 172.21.15.12:0/658703291 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fec00011830 con 0x55a9233e6410 2024-09-19T06:46:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.128+0000 7fec0f63b740 10 client.26837 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.128+0000 7fec0f63b740 10 client.26837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.128+0000 7fec0f63b740 20 client.26837 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.128+0000 7fec0f63b740 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a923474650 0x55a923476a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.128+0000 7fec0f63b740 4 client.26837 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:46:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.128+0000 7fec0f63b740 1 -- 172.21.15.12:0/658703291 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a923351d70 con 0x55a923474650 2024-09-19T06:46:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.128+0000 7fec0a560640 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a923474650 0x55a923476a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.128+0000 7febedffb640 10 client.26837 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.129+0000 7fec0a560640 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a923474650 0x55a923476a70 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a1dc8076a13c79 server_cookie=f7ae7ccf625212ad in_seq=0 out_seq=0 2024-09-19T06:46:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.173+0000 7febedffb640 1 -- 172.21.15.12:0/658703291 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a923351d70 con 0x55a923474650 2024-09-19T06:46:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.173+0000 7febedffb640 10 client.26837 handle_command_reply: tid=0 2024-09-19T06:46:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.173+0000 7fec0f63b740 1 client.26837 shutdown 2024-09-19T06:46:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 1 -- 172.21.15.12:0/658703291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e6410 msgr2=0x55a9233fcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e6410 0x55a9233fcef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fec00099130 tx=0x7fec000ccd80 comp rx=0 tx=0).stop 2024-09-19T06:46:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 1 -- 172.21.15.12:0/658703291 shutdown_connections 2024-09-19T06:46:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a923474650 0x55a923476a70 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a9233f0cb0 0x55a9233fd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a9233e6410 0x55a9233fcef0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 1 --2- 172.21.15.12:0/658703291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a9233e5af0 0x55a923401bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 1 -- 172.21.15.12:0/658703291 >> 172.21.15.12:0/658703291 conn(0x55a9233e2060 msgr2=0x55a9233efc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7febedffb640 0 client.26837 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:54.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 1 -- 172.21.15.12:0/658703291 shutdown_connections 2024-09-19T06:46:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 1 -- 172.21.15.12:0/658703291 wait complete. 2024-09-19T06:46:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.174+0000 7fec0f63b740 20 client.26837 trim_cache size 0 max 16384 2024-09-19T06:46:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:46:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:46:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:46:54.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:46:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1504582664 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7febf00a34e0 msgr2=0x7febf00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7febf00a34e0 0x7febf00a59a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7febfc0093f0 tx=0x7febfc030990 comp rx=0 tx=0).stop 2024-09-19T06:46:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1504582664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec04101370 msgr2=0x7fec0419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec04101370 0x7fec0419aaa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec0000b3f0 tx=0x7fec0000b8b0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1504582664 shutdown_connections 2024-09-19T06:46:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7febf00a34e0 0x7febf00a59a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec041069e0 0x7fec0419ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec04101370 0x7fec0419aaa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 --2- 172.21.15.12:0/1504582664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec041009d0 0x7fec0419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1504582664 >> 172.21.15.12:0/1504582664 conn(0x7fec040fc6f0 msgr2=0x7fec0406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1504582664 shutdown_connections 2024-09-19T06:46:54.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:46:54.175+0000 7fec0c7c4640 1 -- 172.21.15.12:0/1504582664 wait complete. 2024-09-19T06:46:54.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:53 smithi016 ceph-mon[34911]: pgmap v205: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.6 MiB/s wr, 728 op/s 2024-09-19T06:46:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 370.0 s, 3358.8 tps, lat 29.777 ms stddev 34.481 2024-09-19T06:46:56.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:55 smithi173 ceph-mon[35349]: pgmap v206: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 945 op/s 2024-09-19T06:46:56.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:55 smithi012 ceph-mon[30937]: pgmap v206: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 945 op/s 2024-09-19T06:46:56.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:55 smithi016 ceph-mon[34911]: pgmap v206: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 945 op/s 2024-09-19T06:46:56.501 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:46:56.502 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:46:56.947 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:57.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.675+0000 7f10cc39a640 1 -- 172.21.15.12:0/1505008635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4101430 msgr2=0x7f10c410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:57.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.675+0000 7f10cc39a640 1 --2- 172.21.15.12:0/1505008635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4101430 0x7f10c410d960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009cd0 tx=0x7f10bc02a910 comp rx=0 tx=0).stop 2024-09-19T06:46:57.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.676+0000 7f10cc39a640 1 -- 172.21.15.12:0/1505008635 shutdown_connections 2024-09-19T06:46:57.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.676+0000 7f10cc39a640 1 --2- 172.21.15.12:0/1505008635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4101430 0x7f10c410d960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.676+0000 7f10cc39a640 1 --2- 172.21.15.12:0/1505008635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c4100a90 0x7f10c4100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.676+0000 7f10cc39a640 1 --2- 172.21.15.12:0/1505008635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10c4106a90 0x7f10c4106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.676+0000 7f10cc39a640 1 -- 172.21.15.12:0/1505008635 >> 172.21.15.12:0/1505008635 conn(0x7f10c40fc7d0 msgr2=0x7f10c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:57.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.676+0000 7f10cc39a640 1 -- 172.21.15.12:0/1505008635 shutdown_connections 2024-09-19T06:46:57.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.676+0000 7f10cc39a640 1 -- 172.21.15.12:0/1505008635 wait complete. 2024-09-19T06:46:57.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.677+0000 7f10cc39a640 1 Processor -- start 2024-09-19T06:46:57.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.677+0000 7f10cc39a640 1 -- start start 2024-09-19T06:46:57.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10cc39a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4100a90 0x7f10c4197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10cc39a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c4101430 0x7f10c41978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10cc39a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10c4106a90 0x7f10c419bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10cc39a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4110f20 con 0x7f10c4101430 2024-09-19T06:46:57.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10cc39a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4110da0 con 0x7f10c4106a90 2024-09-19T06:46:57.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10ca136640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4100a90 0x7f10c4197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10ca136640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4100a90 0x7f10c4197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46554/0 (socket says 172.21.15.12:46554) 2024-09-19T06:46:57.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10ca136640 1 -- 172.21.15.12:0/3768907388 learned_addr learned my addr 172.21.15.12:0/3768907388 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:57.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10cc39a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41110a0 con 0x7f10c4100a90 2024-09-19T06:46:57.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10ca937640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10c4106a90 0x7f10c419bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.678+0000 7f10c9935640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c4101430 0x7f10c41978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.679+0000 7f10ca136640 1 -- 172.21.15.12:0/3768907388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10c4106a90 msgr2=0x7f10c419bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.679+0000 7f10ca136640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10c4106a90 0x7f10c419bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.679+0000 7f10ca136640 1 -- 172.21.15.12:0/3768907388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c4101430 msgr2=0x7f10c41978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.679+0000 7f10ca136640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c4101430 0x7f10c41978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.679+0000 7f10ca136640 1 -- 172.21.15.12:0/3768907388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c419c310 con 0x7f10c4100a90 2024-09-19T06:46:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.679+0000 7f10ca136640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4100a90 0x7f10c4197360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f10c000b450 tx=0x7f10c000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.679+0000 7f10bb7fe640 1 -- 172.21.15.12:0/3768907388 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c000f900 con 0x7f10c4100a90 2024-09-19T06:46:57.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.680+0000 7f10cc39a640 1 -- 172.21.15.12:0/3768907388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c419c600 con 0x7f10c4100a90 2024-09-19T06:46:57.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.680+0000 7f10bb7fe640 1 -- 172.21.15.12:0/3768907388 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c0017420 con 0x7f10c4100a90 2024-09-19T06:46:57.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.680+0000 7f10bb7fe640 1 -- 172.21.15.12:0/3768907388 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c000e680 con 0x7f10c4100a90 2024-09-19T06:46:57.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.680+0000 7f10cc39a640 1 -- 172.21.15.12:0/3768907388 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c406a790 con 0x7f10c4100a90 2024-09-19T06:46:57.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.683+0000 7f10bb7fe640 1 -- 172.21.15.12:0/3768907388 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f10c000e820 con 0x7f10c4100a90 2024-09-19T06:46:57.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.683+0000 7f10ce773740 1 Processor -- start 2024-09-19T06:46:57.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.684+0000 7f10ce773740 1 -- start start 2024-09-19T06:46:57.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10ce773740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfb99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10ce773740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfba340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10ce773740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfcf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10ce773740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cf4df1f280 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10ce773740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55cf4dec6b10 con 0x55cf4dfb9f00 2024-09-19T06:46:57.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10ce773740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55cf4df1b240 con 0x55cf4dfcd3e0 2024-09-19T06:46:57.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10ca937640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfb99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10ca136640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfba340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10c9935640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfcf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10ca937640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfb99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44728/0 (socket says 172.21.15.12:44728) 2024-09-19T06:46:57.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.685+0000 7f10ca937640 1 -- 172.21.15.12:0/4218345653 learned_addr learned my addr 172.21.15.12:0/4218345653 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.686+0000 7f10bb7fe640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10b00a3500 0x7f10b00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.686+0000 7f10ca937640 1 -- 172.21.15.12:0/4218345653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfcd3e0 msgr2=0x55cf4dfcf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.686+0000 7f10ca937640 1 --2- 172.21.15.12:0/4218345653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfcf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.686+0000 7f10ca937640 1 -- 172.21.15.12:0/4218345653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfb9f00 msgr2=0x55cf4dfba340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.686+0000 7f10ca937640 1 --2- 172.21.15.12:0/4218345653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfba340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.686+0000 7f10ca937640 1 -- 172.21.15.12:0/4218345653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf4ded31f0 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.686+0000 7f10c9935640 1 --2- 172.21.15.12:0/4218345653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfcf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.686+0000 7f10ca937640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10b00a3500 0x7f10b00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.686+0000 7f10ca937640 1 --2- 172.21.15.12:0/4218345653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfb99c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009cd0 tx=0x7f10bc009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20236d466b290c7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.687+0000 7f10bb7fe640 1 -- 172.21.15.12:0/3768907388 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f10c00d11b0 con 0x7f10c4100a90 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.687+0000 7f10b8dea640 1 -- 172.21.15.12:0/4218345653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc031da0 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.687+0000 7f10b8dea640 1 -- 172.21.15.12:0/4218345653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10bc036030 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.687+0000 7f10b8dea640 1 -- 172.21.15.12:0/4218345653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc0046c0 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.687+0000 7f10ca937640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10b00a3500 0x7f10b00a59c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f10bc04a000 tx=0x7f10bc04b000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:57.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.688+0000 7f10ce773740 1 -- 172.21.15.12:0/4218345653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfbb0b0 msgr2=0x55cf4dfb99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:57.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.688+0000 7f10ce773740 1 --2- 172.21.15.12:0/4218345653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfb99c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009cd0 tx=0x7f10bc009950 comp rx=0 tx=0).stop 2024-09-19T06:46:57.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.688+0000 7f10ce773740 1 -- 172.21.15.12:0/4218345653 shutdown_connections 2024-09-19T06:46:57.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.688+0000 7f10ce773740 1 --2- 172.21.15.12:0/4218345653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfcf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.688+0000 7f10ce773740 1 --2- 172.21.15.12:0/4218345653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfba340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.688+0000 7f10ce773740 1 --2- 172.21.15.12:0/4218345653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfb99c0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.688+0000 7f10ce773740 1 -- 172.21.15.12:0/4218345653 >> 172.21.15.12:0/4218345653 conn(0x55cf4dfb60f0 msgr2=0x55cf4dfb64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.690+0000 7f10ce773740 1 -- 172.21.15.12:0/4218345653 shutdown_connections 2024-09-19T06:46:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.690+0000 7f10ce773740 1 -- 172.21.15.12:0/4218345653 wait complete. 2024-09-19T06:46:57.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.690+0000 7f10ce773740 1 -- start start 2024-09-19T06:46:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.690+0000 7f10ce773740 1 Processor -- start 2024-09-19T06:46:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.691+0000 7f10ce773740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfbd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.691+0000 7f10ce773740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.691+0000 7f10ce773740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfbe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.691+0000 7f10ce773740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cf4dfd01a0 con 0x55cf4dfcd3e0 2024-09-19T06:46:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.691+0000 7f10ce773740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55cf4ded9f10 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.691+0000 7f10ce773740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55cf4dfd0320 con 0x55cf4dfb9f00 2024-09-19T06:46:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.691+0000 7f10ce773740 10 client.0 _ll_register_callbacks cb 0x55cf4dea2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:57.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.691+0000 7f10c9935640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.691+0000 7f10c9935640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47282/0 (socket says 172.21.15.12:47282) 2024-09-19T06:46:57.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.691+0000 7f10c9935640 1 -- 172.21.15.12:0/1999313717 learned_addr learned my addr 172.21.15.12:0/1999313717 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:57.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.692+0000 7f10ca136640 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfbd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.692+0000 7f10ca937640 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfbe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.692+0000 7f10c9935640 1 -- 172.21.15.12:0/1999313717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 msgr2=0x55cf4dfbd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.692+0000 7f10c9935640 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfbd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.692+0000 7f10c9935640 1 -- 172.21.15.12:0/1999313717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfcd3e0 msgr2=0x55cf4dfbe400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.692+0000 7f10c9935640 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfbe400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.692+0000 7f10c9935640 1 -- 172.21.15.12:0/1999313717 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf4dc906a0 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.692+0000 7f10ca136640 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfbd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.692+0000 7f10c9935640 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbdec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f10b4012730 tx=0x7f10b4012bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e09ae447af9a4bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.692+0000 7f10adffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.693+0000 7f10adffb640 1 -- 172.21.15.12:0/1999313717 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4004030 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.693+0000 7f10adffb640 1 -- 172.21.15.12:0/1999313717 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f10b40041d0 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.693+0000 7f10ce773740 1 -- 172.21.15.12:0/1999313717 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10bc036030 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.693+0000 7f10adffb640 1 -- 172.21.15.12:0/1999313717 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f10b40043d0 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.693+0000 7f10ce773740 10 client.26846 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:57.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.693+0000 7f10ce773740 1 -- 172.21.15.12:0/1999313717 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55cf4dfdbf70 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.693+0000 7f10adffb640 1 -- 172.21.15.12:0/1999313717 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10bc036030 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.694+0000 7f10adffb640 1 -- 172.21.15.12:0/1999313717 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f10b4022070 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.694+0000 7f10ce773740 10 client.26846 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.694+0000 7f10ce773740 10 client.26846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.694+0000 7f10ce773740 20 client.26846 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.694+0000 7f10ce773740 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cf4dfdd4d0 0x55cf4dfdf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.694+0000 7f10ce773740 4 client.26846 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.694+0000 7f10ce773740 1 -- 172.21.15.12:0/1999313717 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf4df2c7f0 con 0x55cf4dfdd4d0 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.694+0000 7f10ca136640 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cf4dfdd4d0 0x55cf4dfdf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.695+0000 7f10adffb640 10 client.26846 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.695+0000 7f10ca136640 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cf4dfdd4d0 0x55cf4dfdf8e0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53ca73e851d6d741 server_cookie=3e918d5d116a7902 in_seq=0 out_seq=0 2024-09-19T06:46:57.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.695+0000 7f10adffb640 1 -- 172.21.15.12:0/1999313717 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf4df2c7f0 con 0x55cf4dfdd4d0 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.695+0000 7f10adffb640 10 client.26846 handle_command_reply: tid=0 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.695+0000 7f10ce773740 1 client.26846 shutdown 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.695+0000 7f10ce773740 1 -- 172.21.15.12:0/1999313717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 msgr2=0x55cf4dfbdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.695+0000 7f10ce773740 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbdec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f10b4012730 tx=0x7f10b4012bf0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.696+0000 7f10ce773740 1 -- 172.21.15.12:0/1999313717 shutdown_connections 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.696+0000 7f10ce773740 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cf4dfdd4d0 0x55cf4dfdf8e0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.696+0000 7f10ce773740 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfbe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.696+0000 7f10ce773740 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbdec0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.696+0000 7f10ce773740 1 --2- 172.21.15.12:0/1999313717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfbd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.696+0000 7f10ce773740 1 -- 172.21.15.12:0/1999313717 >> 172.21.15.12:0/1999313717 conn(0x55cf4dfb60f0 msgr2=0x55cf4dfbbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.696+0000 7f10adffb640 0 client.26846 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.696+0000 7f10ce773740 1 -- 172.21.15.12:0/1999313717 shutdown_connections 2024-09-19T06:46:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.696+0000 7f10ce773740 1 -- 172.21.15.12:0/1999313717 wait complete. 2024-09-19T06:46:57.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.696+0000 7f10ce773740 20 client.26846 trim_cache size 0 max 16384 2024-09-19T06:46:57.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.724+0000 7f10ce773740 1 Processor -- start 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.724+0000 7f10ce773740 1 -- start start 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.724+0000 7f10ce773740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfbb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.724+0000 7f10ce773740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.724+0000 7f10ce773740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfbc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.724+0000 7f10ce773740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41ab990 con 0x55cf4dfb9f00 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.724+0000 7f10ce773740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41ad5f0 con 0x55cf4dfcd3e0 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.724+0000 7f10ce773740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41ac060 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.727+0000 7f10ca937640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfbc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.727+0000 7f10ca937640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfbc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47284/0 (socket says 172.21.15.12:47284) 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.727+0000 7f10ca937640 1 -- 172.21.15.12:0/1174950926 learned_addr learned my addr 172.21.15.12:0/1174950926 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.727+0000 7f10c9935640 1 --2- 172.21.15.12:0/1174950926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.728+0000 7f10c9935640 1 -- 172.21.15.12:0/1174950926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfcd3e0 msgr2=0x55cf4dfbc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.728+0000 7f10c9935640 1 --2- 172.21.15.12:0/1174950926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfbc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.728+0000 7f10c9935640 1 -- 172.21.15.12:0/1174950926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfb9f00 msgr2=0x55cf4dfbb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.728+0000 7f10c9935640 1 --2- 172.21.15.12:0/1174950926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfbb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.728+0000 7f10c9935640 1 -- 172.21.15.12:0/1174950926 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf4dfc0250 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.728+0000 7f10c9935640 1 --2- 172.21.15.12:0/1174950926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbbb40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55cf4dfbef30 tx=0x7f10b400f810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9667d73e1d2b57be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:57.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.732+0000 7f10affff640 1 -- 172.21.15.12:0/1174950926 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4028040 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.732+0000 7f10affff640 1 -- 172.21.15.12:0/1174950926 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10b40035f0 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.732+0000 7f10affff640 1 -- 172.21.15.12:0/1174950926 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b400fe80 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.733+0000 7f10ce773740 1 -- 172.21.15.12:0/1174950926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfbb0b0 msgr2=0x55cf4dfbbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:57.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.733+0000 7f10ce773740 1 --2- 172.21.15.12:0/1174950926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbbb40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x55cf4dfbef30 tx=0x7f10b400f810 comp rx=0 tx=0).stop 2024-09-19T06:46:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.733+0000 7f10ce773740 1 -- 172.21.15.12:0/1174950926 shutdown_connections 2024-09-19T06:46:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.733+0000 7f10ce773740 1 --2- 172.21.15.12:0/1174950926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfbc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.733+0000 7f10ce773740 1 --2- 172.21.15.12:0/1174950926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfbbb40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.733+0000 7f10ce773740 1 --2- 172.21.15.12:0/1174950926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfbb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.733+0000 7f10ce773740 1 -- 172.21.15.12:0/1174950926 >> 172.21.15.12:0/1174950926 conn(0x55cf4dfb60f0 msgr2=0x55cf4dfbc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:57.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.734+0000 7f10ce773740 1 -- 172.21.15.12:0/1174950926 shutdown_connections 2024-09-19T06:46:57.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.738+0000 7f10ce773740 1 -- 172.21.15.12:0/1174950926 wait complete. 2024-09-19T06:46:57.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.738+0000 7f10ce773740 1 -- start start 2024-09-19T06:46:57.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.738+0000 7f10ce773740 1 Processor -- start 2024-09-19T06:46:57.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.738+0000 7f10ce773740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfd5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.739+0000 7f10ce773740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfd5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.739+0000 7f10ce773740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfd0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.739+0000 7f10ce773740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41ace60 con 0x55cf4dfcd3e0 2024-09-19T06:46:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.739+0000 7f10ce773740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41ac790 con 0x55cf4dfbb0b0 2024-09-19T06:46:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.739+0000 7f10ce773740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41a9970 con 0x55cf4dfb9f00 2024-09-19T06:46:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.739+0000 7f10ce773740 10 client.0 _ll_register_callbacks cb 0x7f10b40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.739+0000 7f10c9935640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfd5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.739+0000 7f10ca136640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfd5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.739+0000 7f10ca136640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfd5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46594/0 (socket says 172.21.15.12:46594) 2024-09-19T06:46:57.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.740+0000 7f10ca136640 1 -- 172.21.15.12:0/1009211478 learned_addr learned my addr 172.21.15.12:0/1009211478 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:57.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.740+0000 7f10ca136640 1 -- 172.21.15.12:0/1009211478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 msgr2=0x55cf4dfd5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:57.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.740+0000 7f10ca136640 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfd5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.740+0000 7f10ca136640 1 -- 172.21.15.12:0/1009211478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfcd3e0 msgr2=0x55cf4dfd0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:57.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.740+0000 7f10ca136640 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfd0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.740+0000 7f10ca136640 1 -- 172.21.15.12:0/1009211478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf4dfd0dc0 con 0x55cf4dfb9f00 2024-09-19T06:46:57.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.741+0000 7f10ca136640 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfd5850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f10c0000c00 tx=0x7f10c00d1120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccb8063dd866ea67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:57.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.741+0000 7f10adffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:46:57.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.741+0000 7f10adffb640 1 -- 172.21.15.12:0/1009211478 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c009d5d0 con 0x55cf4dfb9f00 2024-09-19T06:46:57.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.741+0000 7f10adffb640 1 -- 172.21.15.12:0/1009211478 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f10c00175d0 con 0x55cf4dfb9f00 2024-09-19T06:46:57.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.741+0000 7f10ce773740 1 -- 172.21.15.12:0/1009211478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10b40035f0 con 0x55cf4dfb9f00 2024-09-19T06:46:57.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.741+0000 7f10adffb640 1 -- 172.21.15.12:0/1009211478 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f10c00a18d0 con 0x55cf4dfb9f00 2024-09-19T06:46:57.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.745+0000 7f10ce773740 10 client.26821 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:57.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.745+0000 7f10ce773740 1 -- 172.21.15.12:0/1009211478 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55cf4dfc7780 con 0x55cf4dfb9f00 2024-09-19T06:46:57.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.745+0000 7f10adffb640 1 -- 172.21.15.12:0/1009211478 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c00a6190 con 0x55cf4dfb9f00 2024-09-19T06:46:57.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.745+0000 7f10adffb640 1 -- 172.21.15.12:0/1009211478 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f10c00af070 con 0x55cf4dfb9f00 2024-09-19T06:46:57.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.750+0000 7f10ce773740 10 client.26821 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:57.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.750+0000 7f10ce773740 10 client.26821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:57.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.750+0000 7f10ce773740 20 client.26821 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:57.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.750+0000 7f10ce773740 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cf4dfc7ec0 0x55cf4dfc82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:57.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.750+0000 7f10ce773740 4 client.26821 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:46:57.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.750+0000 7f10ce773740 1 -- 172.21.15.12:0/1009211478 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f10b40035f0 con 0x55cf4dfc7ec0 2024-09-19T06:46:57.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.752+0000 7f10c9935640 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cf4dfc7ec0 0x55cf4dfc82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:57.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.754+0000 7f10c9935640 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cf4dfc7ec0 0x55cf4dfc82d0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4546377d74b2906f server_cookie=5c6478001e745704 in_seq=0 out_seq=0 2024-09-19T06:46:57.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.755+0000 7f10adffb640 10 client.26821 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:57.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10adffb640 1 -- 172.21.15.12:0/1009211478 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f10b40035f0 con 0x55cf4dfc7ec0 2024-09-19T06:46:57.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10adffb640 10 client.26821 handle_command_reply: tid=0 2024-09-19T06:46:57.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10ce773740 1 client.26821 shutdown 2024-09-19T06:46:57.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10ce773740 1 -- 172.21.15.12:0/1009211478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 msgr2=0x55cf4dfd5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:57.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10ce773740 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfd5850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f10c0000c00 tx=0x7f10c00d1120 comp rx=0 tx=0).stop 2024-09-19T06:46:57.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10ce773740 1 -- 172.21.15.12:0/1009211478 shutdown_connections 2024-09-19T06:46:57.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10ce773740 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cf4dfc7ec0 0x55cf4dfc82d0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10ce773740 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cf4dfcd3e0 0x55cf4dfd0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10ce773740 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cf4dfbb0b0 0x55cf4dfd5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10ce773740 1 --2- 172.21.15.12:0/1009211478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cf4dfb9f00 0x55cf4dfd5850 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f10c0000c00 tx=0x7f10c00d1120 comp rx=0 tx=0).stop 2024-09-19T06:46:57.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.756+0000 7f10ce773740 1 -- 172.21.15.12:0/1009211478 >> 172.21.15.12:0/1009211478 conn(0x55cf4dfb60f0 msgr2=0x55cf4dfbb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:57.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.757+0000 7f10adffb640 0 client.26821 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:57.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.757+0000 7f10ce773740 1 -- 172.21.15.12:0/1009211478 shutdown_connections 2024-09-19T06:46:57.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.757+0000 7f10ce773740 1 -- 172.21.15.12:0/1009211478 wait complete. 2024-09-19T06:46:57.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.758+0000 7f10ce773740 20 client.26821 trim_cache size 0 max 16384 2024-09-19T06:46:57.762 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:46:57.762 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:46:57.762 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "4906348b-a1da-4467-8a2b-ea4f03b9bccd", 2024-09-19T06:46:57.762 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:46:57.762 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:46:57.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.762+0000 7f10cc39a640 1 -- 172.21.15.12:0/3768907388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10b00a3500 msgr2=0x7f10b00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:57.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.762+0000 7f10cc39a640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10b00a3500 0x7f10b00a59c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f10bc04a000 tx=0x7f10bc04b000 comp rx=0 tx=0).stop 2024-09-19T06:46:57.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.762+0000 7f10cc39a640 1 -- 172.21.15.12:0/3768907388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4100a90 msgr2=0x7f10c4197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:57.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.762+0000 7f10cc39a640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4100a90 0x7f10c4197360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f10c000b450 tx=0x7f10c000b910 comp rx=0 tx=0).stop 2024-09-19T06:46:57.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.762+0000 7f10cc39a640 1 -- 172.21.15.12:0/3768907388 shutdown_connections 2024-09-19T06:46:57.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.762+0000 7f10cc39a640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10c4106a90 0x7f10c419bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.762+0000 7f10cc39a640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c4101430 0x7f10c41978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.762+0000 7f10cc39a640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10b00a3500 0x7f10b00a59c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.762+0000 7f10cc39a640 1 --2- 172.21.15.12:0/3768907388 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10c4100a90 0x7f10c4197360 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:57.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.762+0000 7f10cc39a640 1 -- 172.21.15.12:0/3768907388 >> 172.21.15.12:0/3768907388 conn(0x7f10c40fc7d0 msgr2=0x7f10c40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:57.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.763+0000 7f10cc39a640 1 -- 172.21.15.12:0/3768907388 shutdown_connections 2024-09-19T06:46:57.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:57.763+0000 7f10cc39a640 1 -- 172.21.15.12:0/3768907388 wait complete. 2024-09-19T06:46:58.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:57 smithi173 ceph-mon[35349]: pgmap v207: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 858 op/s 2024-09-19T06:46:58.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:57 smithi012 ceph-mon[30937]: pgmap v207: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 858 op/s 2024-09-19T06:46:58.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:57 smithi016 ceph-mon[34911]: pgmap v207: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 10 MiB/s wr, 858 op/s 2024-09-19T06:46:58.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:46:59.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:46:59.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:59.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:46:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.083 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:58 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:46:59.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:59.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:59.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:59.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:59.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:46:59.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:58 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.204 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:46:59.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:46:59.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:46:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:58 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:46:59.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.780+0000 7f2fa111e640 1 -- 172.21.15.12:0/3857831277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f9c101440 msgr2=0x7f2f9c105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:59.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.780+0000 7f2fa111e640 1 --2- 172.21.15.12:0/3857831277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f9c101440 0x7f2f9c105910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009860 tx=0x7f2f9002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.780+0000 7f2fa111e640 1 -- 172.21.15.12:0/3857831277 shutdown_connections 2024-09-19T06:46:59.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.780+0000 7f2fa111e640 1 --2- 172.21.15.12:0/3857831277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c105f30 0x7f2f9c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.780+0000 7f2fa111e640 1 --2- 172.21.15.12:0/3857831277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f9c101440 0x7f2f9c105910 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.780+0000 7f2fa111e640 1 --2- 172.21.15.12:0/3857831277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f9c100b20 0x7f2f9c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.780+0000 7f2fa111e640 1 -- 172.21.15.12:0/3857831277 >> 172.21.15.12:0/3857831277 conn(0x7f2f9c0fc7d0 msgr2=0x7f2f9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:59.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.780+0000 7f2fa111e640 1 -- 172.21.15.12:0/3857831277 shutdown_connections 2024-09-19T06:46:59.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.781+0000 7f2fa111e640 1 -- 172.21.15.12:0/3857831277 wait complete. 2024-09-19T06:46:59.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.782+0000 7f2fa111e640 1 Processor -- start 2024-09-19T06:46:59.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.782+0000 7f2fa111e640 1 -- start start 2024-09-19T06:46:59.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.782+0000 7f2fa111e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f9c100b20 0x7f2f9c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.782+0000 7f2fa111e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f9c101440 0x7f2f9c19f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.782+0000 7f2fa111e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c105f30 0x7f2f9c1a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.782+0000 7f2fa111e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c118570 con 0x7f2f9c100b20 2024-09-19T06:46:59.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.782+0000 7f2fa111e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1183f0 con 0x7f2f9c101440 2024-09-19T06:46:59.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.782+0000 7f2fa111e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1186f0 con 0x7f2f9c105f30 2024-09-19T06:46:59.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.783+0000 7f2f9b59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c105f30 0x7f2f9c1a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.783+0000 7f2f9b59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c105f30 0x7f2f9c1a34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46608/0 (socket says 172.21.15.12:46608) 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.783+0000 7f2f9b59e640 1 -- 172.21.15.12:0/3120695259 learned_addr learned my addr 172.21.15.12:0/3120695259 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.783+0000 7f2f9ad9d640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f9c100b20 0x7f2f9c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.783+0000 7f2f9b59e640 1 -- 172.21.15.12:0/3120695259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f9c101440 msgr2=0x7f2f9c19f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.783+0000 7f2f9b59e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f9c101440 0x7f2f9c19f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.783+0000 7f2f9b59e640 1 -- 172.21.15.12:0/3120695259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f9c100b20 msgr2=0x7f2f9c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.783+0000 7f2f9b59e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f9c100b20 0x7f2f9c19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.783+0000 7f2f9b59e640 1 -- 172.21.15.12:0/3120695259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c1a3bd0 con 0x7f2f9c105f30 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.783+0000 7f2f9b59e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c105f30 0x7f2f9c1a34d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400b990 tx=0x7f2f9400be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.784+0000 7f2f83fff640 1 -- 172.21.15.12:0/3120695259 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94019070 con 0x7f2f9c105f30 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.784+0000 7f2f83fff640 1 -- 172.21.15.12:0/3120695259 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f9400cba0 con 0x7f2f9c105f30 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.784+0000 7f2f83fff640 1 -- 172.21.15.12:0/3120695259 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f940076e0 con 0x7f2f9c105f30 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.784+0000 7f2fa111e640 1 -- 172.21.15.12:0/3120695259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c1a3ec0 con 0x7f2f9c105f30 2024-09-19T06:46:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.784+0000 7f2fa111e640 1 -- 172.21.15.12:0/3120695259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9c06bc10 con 0x7f2f9c105f30 2024-09-19T06:46:59.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.787+0000 7f2f83fff640 1 -- 172.21.15.12:0/3120695259 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2f9401c070 con 0x7f2f9c105f30 2024-09-19T06:46:59.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.787+0000 7f2fa34f7740 1 Processor -- start 2024-09-19T06:46:59.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.787+0000 7f2fa34f7740 1 -- start start 2024-09-19T06:46:59.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.787+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a30871880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.787+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a3087c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3087c680 0x558a3087ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2fa34f7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a307d72e0 con 0x558a3087c680 2024-09-19T06:46:59.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2fa34f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558a3077ece0 con 0x558a308714a0 2024-09-19T06:46:59.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2fa34f7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558a307d32a0 con 0x558a30871dc0 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a3087c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a30871880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a3087c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46616/0 (socket says 172.21.15.12:46616) 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f83fff640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2f840a3430 0x7f2f840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9ad9d640 1 -- 172.21.15.12:0/325278337 learned_addr learned my addr 172.21.15.12:0/325278337 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/325278337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3087c680 0x558a3087ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f83fff640 1 -- 172.21.15.12:0/3120695259 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f2f940cf340 con 0x7f2f9c105f30 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9ad9d640 1 -- 172.21.15.12:0/325278337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 msgr2=0x558a30871880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9ad9d640 1 --2- 172.21.15.12:0/325278337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a30871880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9ad9d640 1 -- 172.21.15.12:0/325278337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3087c680 msgr2=0x558a3087ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9ad9d640 1 --2- 172.21.15.12:0/325278337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3087c680 0x558a3087ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9ad9d640 1 -- 172.21.15.12:0/325278337 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a30763440 con 0x558a30871dc0 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/325278337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3087c680 0x558a3087ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:59.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.788+0000 7f2f9b59e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2f840a3430 0x7f2f840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.789+0000 7f2f9ad9d640 1 --2- 172.21.15.12:0/325278337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a3087c140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009d20 tx=0x7f2f8c0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b450fab70fb6e40c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:59.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.789+0000 7f2f817fa640 1 -- 172.21.15.12:0/325278337 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c012650 con 0x558a30871dc0 2024-09-19T06:46:59.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.789+0000 7f2f9b59e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2f840a3430 0x7f2f840a58f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2f9409b350 tx=0x7f2f9400e040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:59.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.789+0000 7f2f817fa640 1 -- 172.21.15.12:0/325278337 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f8c009e10 con 0x558a30871dc0 2024-09-19T06:46:59.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.789+0000 7f2f817fa640 1 -- 172.21.15.12:0/325278337 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00fc70 con 0x558a30871dc0 2024-09-19T06:46:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 -- 172.21.15.12:0/325278337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 msgr2=0x558a3087c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/325278337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a3087c140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009d20 tx=0x7f2f8c0117b0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 -- 172.21.15.12:0/325278337 shutdown_connections 2024-09-19T06:46:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/325278337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3087c680 0x558a3087ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/325278337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a3087c140 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/325278337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a30871880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 -- 172.21.15.12:0/325278337 >> 172.21.15.12:0/325278337 conn(0x558a3086da30 msgr2=0x558a3086de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 -- 172.21.15.12:0/325278337 shutdown_connections 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 -- 172.21.15.12:0/325278337 wait complete. 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 -- start start 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.790+0000 7f2fa34f7740 1 Processor -- start 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a308714a0 0x558a3087beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a30871dc0 0x558a30879160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a3087c680 0x558a308796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2fa34f7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a3087f250 con 0x558a308714a0 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2fa34f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558a30792050 con 0x558a30871dc0 2024-09-19T06:46:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2fa34f7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558a3087f3d0 con 0x558a3087c680 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2fa34f7740 10 client.0 _ll_register_callbacks cb 0x558a307d2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a308714a0 0x558a3087beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a30871dc0 0x558a30879160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a308714a0 0x558a3087beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44782/0 (socket says 172.21.15.12:44782) 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9a59c640 1 -- 172.21.15.12:0/114836881 learned_addr learned my addr 172.21.15.12:0/114836881 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a3087c680 0x558a308796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9a59c640 1 -- 172.21.15.12:0/114836881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a3087c680 msgr2=0x558a308796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a3087c680 0x558a308796a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9a59c640 1 -- 172.21.15.12:0/114836881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a30871dc0 msgr2=0x558a30879160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a30871dc0 0x558a30879160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9a59c640 1 -- 172.21.15.12:0/114836881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a305483c0 con 0x558a308714a0 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9ad9d640 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a30871dc0 0x558a30879160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a308714a0 0x558a3087beb0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009860 tx=0x7f2f90005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa3cbebc4b68973 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.791+0000 7f2f7eff5640 1 -- 172.21.15.12:0/114836881 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900305a0 con 0x558a308714a0 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2f7eff5640 1 -- 172.21.15.12:0/114836881 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f2f90030740 con 0x558a308714a0 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2fa34f7740 1 -- 172.21.15.12:0/114836881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f8c009e10 con 0x558a308714a0 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2f7eff5640 1 -- 172.21.15.12:0/114836881 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2f90051050 con 0x558a308714a0 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2fa34f7740 10 client.17361 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2fa34f7740 1 -- 172.21.15.12:0/114836881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558a3088ab00 con 0x558a308714a0 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2f7eff5640 1 -- 172.21.15.12:0/114836881 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f8c009e10 con 0x558a308714a0 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2f7eff5640 1 -- 172.21.15.12:0/114836881 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f2f9002f600 con 0x558a308714a0 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2fa34f7740 10 client.17361 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2fa34f7740 10 client.17361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2fa34f7740 20 client.17361 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a3088c460 0x558a3088e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2fa34f7740 4 client.17361 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.792+0000 7f2fa34f7740 1 -- 172.21.15.12:0/114836881 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a307e4850 con 0x558a3088c460 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.793+0000 7f2f9ad9d640 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a3088c460 0x558a3088e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.793+0000 7f2f9ad9d640 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a3088c460 0x558a3088e8c0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96d967efdb0a41a7 server_cookie=1164d687a0edad29 in_seq=0 out_seq=0 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.793+0000 7f2f7eff5640 10 client.17361 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.794+0000 7f2f7eff5640 1 -- 172.21.15.12:0/114836881 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a307e4850 con 0x558a3088c460 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.794+0000 7f2f7eff5640 10 client.17361 handle_command_reply: tid=0 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.794+0000 7f2fa34f7740 1 client.17361 shutdown 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.795+0000 7f2fa34f7740 1 -- 172.21.15.12:0/114836881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a308714a0 msgr2=0x558a3087beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.795+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a308714a0 0x558a3087beb0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009860 tx=0x7f2f90005c90 comp rx=0 tx=0).stop 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.795+0000 7f2fa34f7740 1 -- 172.21.15.12:0/114836881 shutdown_connections 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.795+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a3088c460 0x558a3088e8c0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.796+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a3087c680 0x558a308796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.796+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a30871dc0 0x558a30879160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.796+0000 7f2f7eff5640 0 client.17361 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:59.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.796+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/114836881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a308714a0 0x558a3087beb0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.796+0000 7f2fa34f7740 1 -- 172.21.15.12:0/114836881 >> 172.21.15.12:0/114836881 conn(0x558a3086da30 msgr2=0x558a30873710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:59.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.796+0000 7f2fa34f7740 1 -- 172.21.15.12:0/114836881 shutdown_connections 2024-09-19T06:46:59.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.796+0000 7f2fa34f7740 1 -- 172.21.15.12:0/114836881 wait complete. 2024-09-19T06:46:59.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.796+0000 7f2fa34f7740 20 client.17361 trim_cache size 0 max 16384 2024-09-19T06:46:59.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.823+0000 7f2fa34f7740 1 Processor -- start 2024-09-19T06:46:59.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.823+0000 7f2fa34f7740 1 -- start start 2024-09-19T06:46:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3086da30 0x558a30879120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a3086ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a308941d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2fa34f7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1bca40 con 0x558a3086da30 2024-09-19T06:46:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2fa34f7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1be6a0 con 0x558a308714a0 2024-09-19T06:46:59.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2fa34f7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1bd110 con 0x558a30871dc0 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2f9ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a3086ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2f9a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a308941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2f9a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3086da30 0x558a30879120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2f9a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a308941d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46628/0 (socket says 172.21.15.12:46628) 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.824+0000 7f2f9a59c640 1 -- 172.21.15.12:0/2006277490 learned_addr learned my addr 172.21.15.12:0/2006277490 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.825+0000 7f2f9a59c640 1 -- 172.21.15.12:0/2006277490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 msgr2=0x558a3086ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.825+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/2006277490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a3086ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.825+0000 7f2f9a59c640 1 -- 172.21.15.12:0/2006277490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3086da30 msgr2=0x558a30879120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.825+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/2006277490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3086da30 0x558a30879120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.825+0000 7f2f9a59c640 1 -- 172.21.15.12:0/2006277490 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a30871bf0 con 0x558a30871dc0 2024-09-19T06:46:59.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.825+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/2006277490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a308941d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x558a30877890 tx=0x7f2f90005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742d3c59baf73f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.830+0000 7f2f80ff9640 1 -- 172.21.15.12:0/2006277490 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9002fe40 con 0x558a30871dc0 2024-09-19T06:46:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.831+0000 7f2f80ff9640 1 -- 172.21.15.12:0/2006277490 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f900096b0 con 0x558a30871dc0 2024-09-19T06:46:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.831+0000 7f2f80ff9640 1 -- 172.21.15.12:0/2006277490 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900038e0 con 0x558a30871dc0 2024-09-19T06:46:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.832+0000 7f2fa34f7740 1 -- 172.21.15.12:0/2006277490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 msgr2=0x558a308941d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.832+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/2006277490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a308941d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x558a30877890 tx=0x7f2f90005a90 comp rx=0 tx=0).stop 2024-09-19T06:46:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.833+0000 7f2fa34f7740 1 -- 172.21.15.12:0/2006277490 shutdown_connections 2024-09-19T06:46:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.833+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/2006277490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a308941d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.833+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/2006277490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a3086ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.833+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/2006277490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3086da30 0x558a30879120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.833+0000 7f2fa34f7740 1 -- 172.21.15.12:0/2006277490 >> 172.21.15.12:0/2006277490 conn(0x558a30879800 msgr2=0x558a3086c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:59.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.834+0000 7f2fa34f7740 1 -- 172.21.15.12:0/2006277490 shutdown_connections 2024-09-19T06:46:59.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.835+0000 7f2fa34f7740 1 -- 172.21.15.12:0/2006277490 wait complete. 2024-09-19T06:46:59.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.835+0000 7f2fa34f7740 1 -- start start 2024-09-19T06:46:59.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.835+0000 7f2fa34f7740 1 Processor -- start 2024-09-19T06:46:59.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.836+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3086da30 0x558a30884aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.837+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a3087fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.837+0000 7f2fa34f7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a30880310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.837+0000 7f2fa34f7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1bdf10 con 0x558a3086da30 2024-09-19T06:46:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.837+0000 7f2f9ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a3087fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.837+0000 7f2f9ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a3087fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47362/0 (socket says 172.21.15.12:47362) 2024-09-19T06:46:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.837+0000 7f2f9ad9d640 1 -- 172.21.15.12:0/3673186218 learned_addr learned my addr 172.21.15.12:0/3673186218 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:46:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.838+0000 7f2fa34f7740 1 -- 172.21.15.12:0/3673186218 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1bd840 con 0x558a308714a0 2024-09-19T06:46:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.838+0000 7f2fa34f7740 1 -- 172.21.15.12:0/3673186218 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c105910 con 0x558a30871dc0 2024-09-19T06:46:59.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.838+0000 7f2fa34f7740 10 client.0 _ll_register_callbacks cb 0x7f2f8c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:46:59.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.844+0000 7f2f9ad9d640 1 -- 172.21.15.12:0/3673186218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 msgr2=0x558a30880310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:46:59.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.844+0000 7f2f9ad9d640 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a30880310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.844+0000 7f2f9ad9d640 1 -- 172.21.15.12:0/3673186218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3086da30 msgr2=0x558a30884aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:46:59.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.844+0000 7f2f9ad9d640 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3086da30 0x558a30884aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.844+0000 7f2f9ad9d640 1 -- 172.21.15.12:0/3673186218 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a30880850 con 0x558a308714a0 2024-09-19T06:46:59.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.845+0000 7f2f9ad9d640 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a3087fdd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009d20 tx=0x7f2f8c0092b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab15278dc75d9414 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:59.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.845+0000 7f2f7eff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:46:59.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.845+0000 7f2f7eff5640 1 -- 172.21.15.12:0/3673186218 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c00fc70 con 0x558a308714a0 2024-09-19T06:46:59.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.845+0000 7f2f7eff5640 1 -- 172.21.15.12:0/3673186218 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7f2f8c0050b0 con 0x558a308714a0 2024-09-19T06:46:59.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.845+0000 7f2fa34f7740 1 -- 172.21.15.12:0/3673186218 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f900096b0 con 0x558a308714a0 2024-09-19T06:46:59.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.846+0000 7f2f7eff5640 1 -- 172.21.15.12:0/3673186218 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2f8c00fe90 con 0x558a308714a0 2024-09-19T06:46:59.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.847+0000 7f2fa34f7740 10 client.26864 fetch_fsmap learned FSMap version 40 2024-09-19T06:46:59.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.847+0000 7f2fa34f7740 1 -- 172.21.15.12:0/3673186218 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558a308f6f10 con 0x558a308714a0 2024-09-19T06:46:59.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.847+0000 7f2f7eff5640 1 -- 172.21.15.12:0/3673186218 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f900096b0 con 0x558a308714a0 2024-09-19T06:46:59.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.847+0000 7f2f7eff5640 1 -- 172.21.15.12:0/3673186218 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f2f8c0035f0 con 0x558a308714a0 2024-09-19T06:46:59.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.847+0000 7f2fa34f7740 10 client.26864 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:46:59.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.847+0000 7f2fa34f7740 10 client.26864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:46:59.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.847+0000 7f2fa34f7740 20 client.26864 populate_metadata read hostname 'smithi012' 2024-09-19T06:46:59.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.847+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a3087c680 0x558a308f9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:59.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.847+0000 7f2fa34f7740 4 client.26864 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:46:59.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.847+0000 7f2fa34f7740 1 -- 172.21.15.12:0/3673186218 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558a307ded60 con 0x558a3087c680 2024-09-19T06:46:59.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.849+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a3087c680 0x558a308f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:59.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.852+0000 7f2f9a59c640 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a3087c680 0x558a308f9490 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccce7335d8a5522e server_cookie=66f9cfd299907c38 in_seq=0 out_seq=0 2024-09-19T06:46:59.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.852+0000 7f2f7eff5640 10 client.26864 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:59.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.852+0000 7f2f7eff5640 1 -- 172.21.15.12:0/3673186218 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558a307ded60 con 0x558a3087c680 2024-09-19T06:46:59.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.852+0000 7f2f7eff5640 10 client.26864 handle_command_reply: tid=0 2024-09-19T06:46:59.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.852+0000 7f2fa34f7740 1 client.26864 shutdown 2024-09-19T06:46:59.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.853+0000 7f2fa34f7740 1 -- 172.21.15.12:0/3673186218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 msgr2=0x558a3087fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:59.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.853+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a3087fdd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009d20 tx=0x7f2f8c0092b0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.853+0000 7f2fa34f7740 1 -- 172.21.15.12:0/3673186218 shutdown_connections 2024-09-19T06:46:59.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.853+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558a3087c680 0x558a308f9490 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.853+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558a30871dc0 0x558a30880310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.853+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558a308714a0 0x558a3087fdd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.853+0000 7f2f7eff5640 0 client.26864 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:46:59.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.853+0000 7f2fa34f7740 1 --2- 172.21.15.12:0/3673186218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a3086da30 0x558a30884aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.853+0000 7f2fa34f7740 1 -- 172.21.15.12:0/3673186218 >> 172.21.15.12:0/3673186218 conn(0x558a30879800 msgr2=0x558a3086cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:59.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.854+0000 7f2fa34f7740 1 -- 172.21.15.12:0/3673186218 shutdown_connections 2024-09-19T06:46:59.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.854+0000 7f2fa34f7740 1 -- 172.21.15.12:0/3673186218 wait complete. 2024-09-19T06:46:59.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.854+0000 7f2fa34f7740 20 client.26864 trim_cache size 0 max 16384 2024-09-19T06:46:59.856 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:46:59.856 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:46:59.856 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:46:59.856 INFO:teuthology.orchestra.run.smithi012.stdout: "4906348b-a1da-4467-8a2b-ea4f03b9bccd": { 2024-09-19T06:46:59.857 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:46:59.857 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "4906348b-a1da-4467-8a2b-ea4f03b9bccd", 2024-09-19T06:46:59.857 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:46:59.857 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:46:59.857 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:46:59.857 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.855+0000 7f2fa111e640 1 -- 172.21.15.12:0/3120695259 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2f840a3430 msgr2=0x7f2f840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.855+0000 7f2fa111e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2f840a3430 0x7f2f840a58f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2f9409b350 tx=0x7f2f9400e040 comp rx=0 tx=0).stop 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.855+0000 7f2fa111e640 1 -- 172.21.15.12:0/3120695259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c105f30 msgr2=0x7f2f9c1a34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.855+0000 7f2fa111e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c105f30 0x7f2f9c1a34d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400b990 tx=0x7f2f9400be50 comp rx=0 tx=0).stop 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.855+0000 7f2fa111e640 1 -- 172.21.15.12:0/3120695259 shutdown_connections 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.855+0000 7f2fa111e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2f840a3430 0x7f2f840a58f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.855+0000 7f2fa111e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f9c105f30 0x7f2f9c1a34d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.855+0000 7f2fa111e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f9c101440 0x7f2f9c19f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.855+0000 7f2fa111e640 1 --2- 172.21.15.12:0/3120695259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f9c100b20 0x7f2f9c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.855+0000 7f2fa111e640 1 -- 172.21.15.12:0/3120695259 >> 172.21.15.12:0/3120695259 conn(0x7f2f9c0fc7d0 msgr2=0x7f2f9c10f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:59.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.856+0000 7f2fa111e640 1 -- 172.21.15.12:0/3120695259 shutdown_connections 2024-09-19T06:46:59.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:46:59.856+0000 7f2fa111e640 1 -- 172.21.15.12:0/3120695259 wait complete. 2024-09-19T06:47:00.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:46:59 smithi173 ceph-mon[35349]: pgmap v208: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.3 MiB/s wr, 734 op/s 2024-09-19T06:47:00.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:46:59 smithi012 ceph-mon[30937]: pgmap v208: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.3 MiB/s wr, 734 op/s 2024-09-19T06:47:00.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:46:59 smithi016 ceph-mon[34911]: pgmap v208: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.3 MiB/s wr, 734 op/s 2024-09-19T06:47:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 375.0 s, 3089.0 tps, lat 32.378 ms stddev 36.406 2024-09-19T06:47:00.895 INFO:tasks.cephfs.filesystem:scrub status for tag:4906348b-a1da-4467-8a2b-ea4f03b9bccd - {'path': '/', 'tag': '4906348b-a1da-4467-8a2b-ea4f03b9bccd', 'options': 'recursive,force'} 2024-09-19T06:47:02.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:01 smithi173 ceph-mon[35349]: pgmap v209: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 21 MiB/s wr, 1.20k op/s 2024-09-19T06:47:02.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:01 smithi012 ceph-mon[30937]: pgmap v209: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 21 MiB/s wr, 1.20k op/s 2024-09-19T06:47:02.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:01 smithi016 ceph-mon[34911]: pgmap v209: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 21 MiB/s wr, 1.20k op/s 2024-09-19T06:47:04.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:03 smithi173 ceph-mon[35349]: pgmap v210: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 17 MiB/s wr, 839 op/s 2024-09-19T06:47:04.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:03 smithi012 ceph-mon[30937]: pgmap v210: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 17 MiB/s wr, 839 op/s 2024-09-19T06:47:04.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:03 smithi016 ceph-mon[34911]: pgmap v210: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 17 MiB/s wr, 839 op/s 2024-09-19T06:47:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 380.0 s, 298.8 tps, lat 317.886 ms stddev 231.688 2024-09-19T06:47:06.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:05 smithi012 ceph-mon[30937]: pgmap v211: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 19 MiB/s wr, 915 op/s 2024-09-19T06:47:06.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:05 smithi016 ceph-mon[34911]: pgmap v211: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 19 MiB/s wr, 915 op/s 2024-09-19T06:47:06.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:05 smithi173 ceph-mon[35349]: pgmap v211: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 19 MiB/s wr, 915 op/s 2024-09-19T06:47:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.276+0000 7fb17f6d0640 1 -- 172.21.15.12:0/3372498526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb178101ad0 msgr2=0x7fb178101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.276+0000 7fb17f6d0640 1 --2- 172.21.15.12:0/3372498526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb178101ad0 0x7fb178101f30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb168009930 tx=0x7fb16802a420 comp rx=0 tx=0).stop 2024-09-19T06:47:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.276+0000 7fb17f6d0640 1 -- 172.21.15.12:0/3372498526 shutdown_connections 2024-09-19T06:47:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.276+0000 7fb17f6d0640 1 --2- 172.21.15.12:0/3372498526 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb178102470 0x7fb17810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.276+0000 7fb17f6d0640 1 --2- 172.21.15.12:0/3372498526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb178101ad0 0x7fb178101f30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.276+0000 7fb17f6d0640 1 --2- 172.21.15.12:0/3372498526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb178107b70 0x7fb178107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.276+0000 7fb17f6d0640 1 -- 172.21.15.12:0/3372498526 >> 172.21.15.12:0/3372498526 conn(0x7fb1780fd7d0 msgr2=0x7fb1780ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.276+0000 7fb17f6d0640 1 -- 172.21.15.12:0/3372498526 shutdown_connections 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.276+0000 7fb17f6d0640 1 -- 172.21.15.12:0/3372498526 wait complete. 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17f6d0640 1 Processor -- start 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17f6d0640 1 -- start start 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17f6d0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb178101ad0 0x7fb178198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17f6d0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb178102470 0x7fb1781988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17f6d0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb178107b70 0x7fb17819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17f6d0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb178111f30 con 0x7fb178101ad0 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17f6d0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb178111db0 con 0x7fb178102470 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17f6d0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781120b0 con 0x7fb178107b70 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17d46c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb178101ad0 0x7fb178198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17dc6d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb178107b70 0x7fb17819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17d46c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb178101ad0 0x7fb178198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38986/0 (socket says 172.21.15.12:38986) 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17d46c640 1 -- 172.21.15.12:0/2305728882 learned_addr learned my addr 172.21.15.12:0/2305728882 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.277+0000 7fb17cc6b640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb178102470 0x7fb1781988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb17dc6d640 1 -- 172.21.15.12:0/2305728882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb178102470 msgr2=0x7fb1781988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb178102470 0x7fb1781988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb17dc6d640 1 -- 172.21.15.12:0/2305728882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb178101ad0 msgr2=0x7fb178198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb178101ad0 0x7fb178198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb17dc6d640 1 -- 172.21.15.12:0/2305728882 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17819d370 con 0x7fb178107b70 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb178107b70 0x7fb17819cc40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb170009fd0 tx=0x7fb17000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb16e7fc640 1 -- 172.21.15.12:0/2305728882 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17000ce20 con 0x7fb178107b70 2024-09-19T06:47:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb17f6d0640 1 -- 172.21.15.12:0/2305728882 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17819d660 con 0x7fb178107b70 2024-09-19T06:47:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb16e7fc640 1 -- 172.21.15.12:0/2305728882 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb170005020 con 0x7fb178107b70 2024-09-19T06:47:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb16e7fc640 1 -- 172.21.15.12:0/2305728882 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170010720 con 0x7fb178107b70 2024-09-19T06:47:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.278+0000 7fb17f6d0640 1 -- 172.21.15.12:0/2305728882 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1781a4ef0 con 0x7fb178107b70 2024-09-19T06:47:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.280+0000 7fb16e7fc640 1 -- 172.21.15.12:0/2305728882 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb170005540 con 0x7fb178107b70 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.281+0000 7fb16e7fc640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1640a3460 0x7fb1640a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.281+0000 7fb18246b740 1 Processor -- start 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17d46c640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1640a3460 0x7fb1640a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb16e7fc640 1 -- 172.21.15.12:0/2305728882 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fb1700d0460 con 0x7fb178107b70 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb18246b740 1 -- start start 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb18246b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb18246b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1b410 0x556ccfc25770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb18246b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb18246b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556ccfb7f2f0 con 0x556ccfc1b410 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb18246b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556ccfb27270 con 0x556ccfc25cb0 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb18246b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556ccfb7b2b0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17d46c640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1640a3460 0x7fb1640a5920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb174005fd0 tx=0x7fb17400b480 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17cc6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1b410 0x556ccfc25770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17d46c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17cc6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1b410 0x556ccfc25770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38998/0 (socket says 172.21.15.12:38998) 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17d46c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40754/0 (socket says 172.21.15.12:40754) 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17cc6b640 1 -- 172.21.15.12:0/3547999008 learned_addr learned my addr 172.21.15.12:0/3547999008 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/3547999008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17d46c640 1 -- 172.21.15.12:0/3547999008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 msgr2=0x556ccfc280a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17d46c640 1 --2- 172.21.15.12:0/3547999008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc280a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17d46c640 1 -- 172.21.15.12:0/3547999008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1b410 msgr2=0x556ccfc25770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.282+0000 7fb17d46c640 1 --2- 172.21.15.12:0/3547999008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1b410 0x556ccfc25770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.283+0000 7fb17d46c640 1 -- 172.21.15.12:0/3547999008 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ccfb26340 con 0x556ccfc1aaf0 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.283+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/3547999008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc280a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.283+0000 7fb17d46c640 1 --2- 172.21.15.12:0/3547999008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1aed0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb1740058c0 tx=0x7fb174013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e484be4e7bc4eabb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.283+0000 7fb1637fe640 1 -- 172.21.15.12:0/3547999008 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17401e620 con 0x556ccfc1aaf0 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.283+0000 7fb1637fe640 1 -- 172.21.15.12:0/3547999008 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb17401eca0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.283+0000 7fb1637fe640 1 -- 172.21.15.12:0/3547999008 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1740253a0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.284+0000 7fb18246b740 1 -- 172.21.15.12:0/3547999008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 msgr2=0x556ccfc1aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.284+0000 7fb18246b740 1 --2- 172.21.15.12:0/3547999008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1aed0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb1740058c0 tx=0x7fb174013000 comp rx=0 tx=0).stop 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.284+0000 7fb18246b740 1 -- 172.21.15.12:0/3547999008 shutdown_connections 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.284+0000 7fb18246b740 1 --2- 172.21.15.12:0/3547999008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc280a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.284+0000 7fb18246b740 1 --2- 172.21.15.12:0/3547999008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1b410 0x556ccfc25770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.284+0000 7fb18246b740 1 --2- 172.21.15.12:0/3547999008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1aed0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.284+0000 7fb18246b740 1 -- 172.21.15.12:0/3547999008 >> 172.21.15.12:0/3547999008 conn(0x556ccfc17060 msgr2=0x556ccfc17440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.284+0000 7fb18246b740 1 -- 172.21.15.12:0/3547999008 shutdown_connections 2024-09-19T06:47:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.284+0000 7fb18246b740 1 -- 172.21.15.12:0/3547999008 wait complete. 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.284+0000 7fb18246b740 1 -- start start 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb18246b740 1 Processor -- start 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb18246b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc22bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb18246b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 0x556ccfc230f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb18246b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc23630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb17d46c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc22bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb17d46c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc22bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39000/0 (socket says 172.21.15.12:39000) 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb17d46c640 1 -- 172.21.15.12:0/2787994319 learned_addr learned my addr 172.21.15.12:0/2787994319 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb17cc6b640 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 0x556ccfc230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556ccfc2cc90 con 0x556ccfc1aaf0 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556ccfb08290 con 0x556ccfc25cb0 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc23630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.285+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556ccfc2ce10 con 0x556ccfc1b410 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb18246b740 10 client.0 _ll_register_callbacks cb 0x556ccfb39140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb17d46c640 1 -- 172.21.15.12:0/2787994319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 msgr2=0x556ccfc230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb17d46c640 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 0x556ccfc230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb17d46c640 1 -- 172.21.15.12:0/2787994319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 msgr2=0x556ccfc23630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb17d46c640 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc23630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb17d46c640 1 -- 172.21.15.12:0/2787994319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ccf892210 con 0x556ccfc1aaf0 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb17cc6b640 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 0x556ccfc230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc23630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb17d46c640 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc22bb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb17400bfd0 tx=0x7fb17401dec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c9800bb0c8a7c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb160ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb160ff9640 1 -- 172.21.15.12:0/2787994319 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174036060 con 0x556ccfc1aaf0 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb17401eca0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb160ff9640 1 -- 172.21.15.12:0/2787994319 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fb17401d5c0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb160ff9640 1 -- 172.21.15.12:0/2787994319 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fb17401e420 con 0x556ccfc1aaf0 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb18246b740 10 client.17376 fetch_fsmap learned FSMap version 40 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.286+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x556ccf95e620 con 0x556ccfc1aaf0 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.287+0000 7fb160ff9640 1 -- 172.21.15.12:0/2787994319 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb17401eca0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.287+0000 7fb160ff9640 1 -- 172.21.15.12:0/2787994319 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fb174039a30 con 0x556ccfc1aaf0 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.287+0000 7fb18246b740 10 client.17376 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.287+0000 7fb18246b740 10 client.17376 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.287+0000 7fb18246b740 20 client.17376 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.287+0000 7fb18246b740 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ccfc3a000 0x556ccfc3c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.287+0000 7fb18246b740 4 client.17376 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.287+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ccfb8ca20 con 0x556ccfc3a000 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.287+0000 7fb17cc6b640 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ccfc3a000 0x556ccfc3c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.288+0000 7fb160ff9640 10 client.17376 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.288+0000 7fb17cc6b640 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ccfc3a000 0x556ccfc3c3f0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa4619493737be9a server_cookie=a076679df9423dcf in_seq=0 out_seq=0 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.288+0000 7fb160ff9640 1 -- 172.21.15.12:0/2787994319 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ccfb8ca20 con 0x556ccfc3a000 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.288+0000 7fb160ff9640 10 client.17376 handle_command_reply: tid=0 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.288+0000 7fb18246b740 1 client.17376 shutdown 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 msgr2=0x556ccfc22bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc22bb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb17400bfd0 tx=0x7fb17401dec0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 shutdown_connections 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ccfc3a000 0x556ccfc3c3f0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb160ff9640 0 client.17376 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc23630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 0x556ccfc230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 1 --2- 172.21.15.12:0/2787994319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc22bb0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 >> 172.21.15.12:0/2787994319 conn(0x556ccfc17060 msgr2=0x556ccfc1cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 shutdown_connections 2024-09-19T06:47:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 1 -- 172.21.15.12:0/2787994319 wait complete. 2024-09-19T06:47:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.289+0000 7fb18246b740 20 client.17376 trim_cache size 0 max 16384 2024-09-19T06:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb18246b740 1 Processor -- start 2024-09-19T06:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb18246b740 1 -- start start 2024-09-19T06:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb18246b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 0x556ccfc41ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb18246b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc1b410 0x556ccfc42020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb18246b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc25cb0 0x556ccfc1fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb18246b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781ab8e0 con 0x556ccfc25cb0 2024-09-19T06:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb18246b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781ad540 con 0x556ccfc1b410 2024-09-19T06:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb18246b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781abfb0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb17dc6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc25cb0 0x556ccfc1fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb17dc6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc25cb0 0x556ccfc1fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39006/0 (socket says 172.21.15.12:39006) 2024-09-19T06:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb17dc6d640 1 -- 172.21.15.12:0/755565096 learned_addr learned my addr 172.21.15.12:0/755565096 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb17d46c640 1 --2- 172.21.15.12:0/755565096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 0x556ccfc41ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.304+0000 7fb17cc6b640 1 --2- 172.21.15.12:0/755565096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc1b410 0x556ccfc42020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.305+0000 7fb17dc6d640 1 -- 172.21.15.12:0/755565096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 msgr2=0x556ccfc41ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.305+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/755565096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 0x556ccfc41ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.305+0000 7fb17dc6d640 1 -- 172.21.15.12:0/755565096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc1b410 msgr2=0x556ccfc42020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.305+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/755565096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc1b410 0x556ccfc42020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.305+0000 7fb17dc6d640 1 -- 172.21.15.12:0/755565096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ccfc112f0 con 0x556ccfc25cb0 2024-09-19T06:47:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.305+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/755565096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc25cb0 0x556ccfc1fe10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb17009c650 tx=0x7fb17009cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c740bc9fb9414d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.305+0000 7fb162ffd640 1 -- 172.21.15.12:0/755565096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1700a5330 con 0x556ccfc25cb0 2024-09-19T06:47:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.305+0000 7fb162ffd640 1 -- 172.21.15.12:0/755565096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1700051d0 con 0x556ccfc25cb0 2024-09-19T06:47:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.305+0000 7fb162ffd640 1 -- 172.21.15.12:0/755565096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1700b0e40 con 0x556ccfc25cb0 2024-09-19T06:47:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 -- 172.21.15.12:0/755565096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc25cb0 msgr2=0x556ccfc1fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 --2- 172.21.15.12:0/755565096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc25cb0 0x556ccfc1fe10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb17009c650 tx=0x7fb17009cdc0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 -- 172.21.15.12:0/755565096 shutdown_connections 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 --2- 172.21.15.12:0/755565096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc25cb0 0x556ccfc1fe10 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 --2- 172.21.15.12:0/755565096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc1b410 0x556ccfc42020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 --2- 172.21.15.12:0/755565096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1aaf0 0x556ccfc41ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 -- 172.21.15.12:0/755565096 >> 172.21.15.12:0/755565096 conn(0x556ccfc17060 msgr2=0x556ccfc24c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 -- 172.21.15.12:0/755565096 shutdown_connections 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 -- 172.21.15.12:0/755565096 wait complete. 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 -- start start 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.306+0000 7fb18246b740 1 Processor -- start 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb18246b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb18246b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 0x556ccfc20010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb18246b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc20550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb18246b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781acdb0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb18246b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781ac6e0 con 0x556ccfc25cb0 2024-09-19T06:47:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb18246b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781a98c0 con 0x556ccfc1b410 2024-09-19T06:47:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb18246b740 10 client.0 _ll_register_callbacks cb 0x7fb1700093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17d46c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17d46c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39018/0 (socket says 172.21.15.12:39018) 2024-09-19T06:47:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17d46c640 1 -- 172.21.15.12:0/625326981 learned_addr learned my addr 172.21.15.12:0/625326981 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17cc6b640 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 0x556ccfc20010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc20550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17d46c640 1 -- 172.21.15.12:0/625326981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 msgr2=0x556ccfc20010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17d46c640 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 0x556ccfc20010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17d46c640 1 -- 172.21.15.12:0/625326981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 msgr2=0x556ccfc20550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17d46c640 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc20550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17d46c640 1 -- 172.21.15.12:0/625326981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ccfca3ab0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17dc6d640 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc20550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb17d46c640 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1fad0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb17401db60 tx=0x7fb174010d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b946d2e0cdd18c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb160ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb160ff9640 1 -- 172.21.15.12:0/625326981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174005250 con 0x556ccfc1aaf0 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb160ff9640 1 -- 172.21.15.12:0/625326981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8643+0+0 (secure 0 0 0) 0x7fb1740053f0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb18246b740 1 -- 172.21.15.12:0/625326981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1700051d0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb160ff9640 1 -- 172.21.15.12:0/625326981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fb17401e5c0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb18246b740 10 client.17382 fetch_fsmap learned FSMap version 40 2024-09-19T06:47:07.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.307+0000 7fb18246b740 1 -- 172.21.15.12:0/625326981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x556ccfca4cc0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb160ff9640 1 -- 172.21.15.12:0/625326981 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1700051d0 con 0x556ccfc1aaf0 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb160ff9640 1 -- 172.21.15.12:0/625326981 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fb174039550 con 0x556ccfc1aaf0 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb18246b740 10 client.17382 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb18246b740 10 client.17382 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb18246b740 20 client.17382 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb18246b740 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ccfca5470 0x556ccfca7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb18246b740 4 client.17382 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb18246b740 1 -- 172.21.15.12:0/625326981 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ccfb86d70 con 0x556ccfca5470 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb17cc6b640 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ccfca5470 0x556ccfca7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb160ff9640 10 client.17382 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:07.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.308+0000 7fb17cc6b640 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ccfca5470 0x556ccfca7890 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c86d56a7e637d1 server_cookie=efafe98f4d61b9fa in_seq=0 out_seq=0 2024-09-19T06:47:07.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.319+0000 7fb160ff9640 1 -- 172.21.15.12:0/625326981 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ccfb86d70 con 0x556ccfca5470 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.319+0000 7fb160ff9640 10 client.17382 handle_command_reply: tid=0 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.319+0000 7fb18246b740 1 client.17382 shutdown 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 1 -- 172.21.15.12:0/625326981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 msgr2=0x556ccfc1fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1fad0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb17401db60 tx=0x7fb174010d40 comp rx=0 tx=0).stop 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 1 -- 172.21.15.12:0/625326981 shutdown_connections 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ccfca5470 0x556ccfca7890 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ccfc25cb0 0x556ccfc20550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb160ff9640 0 client.17382 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ccfc1b410 0x556ccfc20010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 1 --2- 172.21.15.12:0/625326981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ccfc1aaf0 0x556ccfc1fad0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 1 -- 172.21.15.12:0/625326981 >> 172.21.15.12:0/625326981 conn(0x556ccfc17060 msgr2=0x556ccfc159a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 1 -- 172.21.15.12:0/625326981 shutdown_connections 2024-09-19T06:47:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 1 -- 172.21.15.12:0/625326981 wait complete. 2024-09-19T06:47:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.320+0000 7fb18246b740 20 client.17382 trim_cache size 0 max 16384 2024-09-19T06:47:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:47:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:47:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:47:07.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:47:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 -- 172.21.15.12:0/2305728882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1640a3460 msgr2=0x7fb1640a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1640a3460 0x7fb1640a5920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb174005fd0 tx=0x7fb17400b480 comp rx=0 tx=0).stop 2024-09-19T06:47:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 -- 172.21.15.12:0/2305728882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb178107b70 msgr2=0x7fb17819cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb178107b70 0x7fb17819cc40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb170009fd0 tx=0x7fb17000ef10 comp rx=0 tx=0).stop 2024-09-19T06:47:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 -- 172.21.15.12:0/2305728882 shutdown_connections 2024-09-19T06:47:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1640a3460 0x7fb1640a5920 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb178107b70 0x7fb17819cc40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb178102470 0x7fb1781988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 --2- 172.21.15.12:0/2305728882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb178101ad0 0x7fb178198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:07.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 -- 172.21.15.12:0/2305728882 >> 172.21.15.12:0/2305728882 conn(0x7fb1780fd7d0 msgr2=0x7fb1780fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:07.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 -- 172.21.15.12:0/2305728882 shutdown_connections 2024-09-19T06:47:07.325 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:07.321+0000 7fb17f6d0640 1 -- 172.21.15.12:0/2305728882 wait complete. 2024-09-19T06:47:08.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:07 smithi012 ceph-mon[30937]: pgmap v212: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 19 MiB/s wr, 878 op/s 2024-09-19T06:47:08.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:07 smithi016 ceph-mon[34911]: pgmap v212: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 19 MiB/s wr, 878 op/s 2024-09-19T06:47:08.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:07 smithi173 ceph-mon[35349]: pgmap v212: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 19 MiB/s wr, 878 op/s 2024-09-19T06:47:09.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:08 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:47:09.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:08 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:47:09.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:08 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:47:09.233 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:08 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:47:09.233 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:08 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:47:09.233 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:08 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:47:09.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:08 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:47:09.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:08 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:47:09.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:08 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:47:10.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:09 smithi012 ceph-mon[30937]: pgmap v213: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 16 MiB/s wr, 721 op/s 2024-09-19T06:47:10.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:09 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:47:10.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:09 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:47:10.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:09 smithi012 ceph-mon[30937]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:47:10.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:09 smithi016 ceph-mon[34911]: pgmap v213: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 16 MiB/s wr, 721 op/s 2024-09-19T06:47:10.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:09 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:47:10.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:09 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:47:10.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:09 smithi016 ceph-mon[34911]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:47:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:09 smithi173 ceph-mon[35349]: pgmap v213: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 16 MiB/s wr, 721 op/s 2024-09-19T06:47:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:09 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:47:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:09 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:47:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:09 smithi173 ceph-mon[35349]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:47:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 385.0 s, 253.4 tps, lat 403.516 ms stddev 252.961 2024-09-19T06:47:12.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:11 smithi012 ceph-mon[30937]: pgmap v215: 97 pgs: 97 active+clean; 4.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.5 MiB/s wr, 581 op/s 2024-09-19T06:47:12.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:11 smithi016 ceph-mon[34911]: pgmap v215: 97 pgs: 97 active+clean; 4.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.5 MiB/s wr, 581 op/s 2024-09-19T06:47:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:11 smithi173 ceph-mon[35349]: pgmap v215: 97 pgs: 97 active+clean; 4.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.5 MiB/s wr, 581 op/s 2024-09-19T06:47:14.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:13 smithi012 ceph-mon[30937]: pgmap v216: 97 pgs: 97 active+clean; 4.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.5 MiB/s wr, 581 op/s 2024-09-19T06:47:14.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:13 smithi016 ceph-mon[34911]: pgmap v216: 97 pgs: 97 active+clean; 4.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.5 MiB/s wr, 581 op/s 2024-09-19T06:47:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:13 smithi173 ceph-mon[35349]: pgmap v216: 97 pgs: 97 active+clean; 4.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.5 MiB/s wr, 581 op/s 2024-09-19T06:47:15.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 390.0 s, 934.4 tps, lat 109.459 ms stddev 202.775 2024-09-19T06:47:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:15 smithi173 ceph-mon[35349]: pgmap v217: 97 pgs: 97 active+clean; 4.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 690 op/s 2024-09-19T06:47:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:15 smithi173 ceph-mon[35349]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:47:16.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:15 smithi012 ceph-mon[30937]: pgmap v217: 97 pgs: 97 active+clean; 4.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 690 op/s 2024-09-19T06:47:16.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:15 smithi012 ceph-mon[30937]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:47:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:15 smithi016 ceph-mon[34911]: pgmap v217: 97 pgs: 97 active+clean; 4.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 690 op/s 2024-09-19T06:47:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:15 smithi016 ceph-mon[34911]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:47:18.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:17 smithi173 ceph-mon[35349]: pgmap v219: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 MiB/s wr, 1.58k op/s 2024-09-19T06:47:18.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:17 smithi012 ceph-mon[30937]: pgmap v219: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 MiB/s wr, 1.58k op/s 2024-09-19T06:47:18.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:17 smithi016 ceph-mon[34911]: pgmap v219: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 MiB/s wr, 1.58k op/s 2024-09-19T06:47:20.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:19 smithi173 ceph-mon[35349]: pgmap v220: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 33 MiB/s wr, 1.35k op/s 2024-09-19T06:47:20.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:19 smithi012 ceph-mon[30937]: pgmap v220: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 33 MiB/s wr, 1.35k op/s 2024-09-19T06:47:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:19 smithi016 ceph-mon[34911]: pgmap v220: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 33 MiB/s wr, 1.35k op/s 2024-09-19T06:47:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.454+0000 7f5b289c4640 1 -- 172.21.15.12:0/2394977387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b241069e0 msgr2=0x7f5b24106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.454+0000 7f5b289c4640 1 --2- 172.21.15.12:0/2394977387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b241069e0 0x7f5b24106dc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800b950 tx=0x7f5b1802e3c0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.457+0000 7f5b289c4640 1 -- 172.21.15.12:0/2394977387 shutdown_connections 2024-09-19T06:47:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.457+0000 7f5b289c4640 1 --2- 172.21.15.12:0/2394977387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b24101370 0x7f5b2410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.457+0000 7f5b289c4640 1 --2- 172.21.15.12:0/2394977387 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b241009d0 0x7f5b24100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.457+0000 7f5b289c4640 1 --2- 172.21.15.12:0/2394977387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b241069e0 0x7f5b24106dc0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.457+0000 7f5b289c4640 1 -- 172.21.15.12:0/2394977387 >> 172.21.15.12:0/2394977387 conn(0x7f5b240fc6b0 msgr2=0x7f5b240fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.461+0000 7f5b289c4640 1 -- 172.21.15.12:0/2394977387 shutdown_connections 2024-09-19T06:47:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.461+0000 7f5b289c4640 1 -- 172.21.15.12:0/2394977387 wait complete. 2024-09-19T06:47:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.462+0000 7f5b289c4640 1 Processor -- start 2024-09-19T06:47:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.462+0000 7f5b289c4640 1 -- start start 2024-09-19T06:47:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.463+0000 7f5b289c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b241009d0 0x7f5b241a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.463+0000 7f5b289c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b24101370 0x7f5b241a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b289c4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b241069e0 0x7f5b2419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b289c4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2410fd60 con 0x7f5b24101370 2024-09-19T06:47:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b289c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2410fbe0 con 0x7f5b241009d0 2024-09-19T06:47:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b289c4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2410fee0 con 0x7f5b241069e0 2024-09-19T06:47:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b21d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b24101370 0x7f5b241a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b21d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b24101370 0x7f5b241a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56392/0 (socket says 172.21.15.12:56392) 2024-09-19T06:47:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b21d9b640 1 -- 172.21.15.12:0/311593704 learned_addr learned my addr 172.21.15.12:0/311593704 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b2259c640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b241009d0 0x7f5b241a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b21d9b640 1 -- 172.21.15.12:0/311593704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b241069e0 msgr2=0x7f5b2419e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b241069e0 0x7f5b2419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b21d9b640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b241069e0 0x7f5b2419e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b21d9b640 1 -- 172.21.15.12:0/311593704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b241009d0 msgr2=0x7f5b241a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b21d9b640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b241009d0 0x7f5b241a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b21d9b640 1 -- 172.21.15.12:0/311593704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2419ef90 con 0x7f5b24101370 2024-09-19T06:47:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.464+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b241069e0 0x7f5b2419e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.465+0000 7f5b21d9b640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b24101370 0x7f5b241a4b90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400d950 tx=0x7f5b1400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.465+0000 7f5b137fe640 1 -- 172.21.15.12:0/311593704 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14017070 con 0x7f5b24101370 2024-09-19T06:47:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.465+0000 7f5b137fe640 1 -- 172.21.15.12:0/311593704 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b14009c30 con 0x7f5b24101370 2024-09-19T06:47:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.465+0000 7f5b289c4640 1 -- 172.21.15.12:0/311593704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2419f280 con 0x7f5b24101370 2024-09-19T06:47:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.465+0000 7f5b137fe640 1 -- 172.21.15.12:0/311593704 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1400f600 con 0x7f5b24101370 2024-09-19T06:47:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.465+0000 7f5b289c4640 1 -- 172.21.15.12:0/311593704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b241ab4a0 con 0x7f5b24101370 2024-09-19T06:47:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.469+0000 7f5b2b83f740 1 Processor -- start 2024-09-19T06:47:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.470+0000 7f5b2b83f740 1 -- start start 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.470+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc49af0 0x55723dc49ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.470+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc4a410 0x55723dc54770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.470+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc54cb0 0x55723dc570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.470+0000 7f5b2b83f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55723dbae2f0 con 0x55723dc54cb0 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.470+0000 7f5b2b83f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55723db56270 con 0x55723dc49af0 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.470+0000 7f5b2b83f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55723dbaa2b0 con 0x55723dc4a410 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.470+0000 7f5b22d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc49af0 0x55723dc49ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b2259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc4a410 0x55723dc54770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b137fe640 1 -- 172.21.15.12:0/311593704 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5b14010460 con 0x7f5b24101370 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b2259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc4a410 0x55723dc54770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:59170/0 (socket says 172.21.15.12:59170) 2024-09-19T06:47:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b2259c640 1 -- 172.21.15.12:0/1688061530 learned_addr learned my addr 172.21.15.12:0/1688061530 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/1688061530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc49af0 0x55723dc49ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58252/0 (socket says 172.21.15.12:58252) 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b21d9b640 1 --2- 172.21.15.12:0/1688061530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc54cb0 0x55723dc570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b22d9d640 1 -- 172.21.15.12:0/1688061530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc4a410 msgr2=0x55723dc54770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/1688061530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc4a410 0x55723dc54770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b22d9d640 1 -- 172.21.15.12:0/1688061530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc54cb0 msgr2=0x55723dc570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/1688061530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc54cb0 0x55723dc570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b22d9d640 1 -- 172.21.15.12:0/1688061530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723db55340 con 0x55723dc49af0 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b21d9b640 1 --2- 172.21.15.12:0/1688061530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc54cb0 0x55723dc570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/1688061530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc49af0 0x55723dc49ed0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009d80 tx=0x7f5b1c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76962abf1f49da18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.471+0000 7f5b10ff9640 1 -- 172.21.15.12:0/1688061530 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c004b20 con 0x55723dc49af0 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.472+0000 7f5b10ff9640 1 -- 172.21.15.12:0/1688061530 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b1c004cc0 con 0x55723dc49af0 2024-09-19T06:47:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.472+0000 7f5b10ff9640 1 -- 172.21.15.12:0/1688061530 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c011860 con 0x55723dc49af0 2024-09-19T06:47:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.472+0000 7f5b137fe640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5b0c0a3530 0x7f5b0c0a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.472+0000 7f5b2259c640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5b0c0a3530 0x7f5b0c0a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.472+0000 7f5b137fe640 1 -- 172.21.15.12:0/311593704 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f5b140cf990 con 0x7f5b24101370 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.473+0000 7f5b2b83f740 1 -- 172.21.15.12:0/1688061530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc49af0 msgr2=0x55723dc49ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.473+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/1688061530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc49af0 0x55723dc49ed0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009d80 tx=0x7f5b1c00f730 comp rx=0 tx=0).stop 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.473+0000 7f5b2b83f740 1 -- 172.21.15.12:0/1688061530 shutdown_connections 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.473+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/1688061530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc54cb0 0x55723dc570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.473+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/1688061530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc4a410 0x55723dc54770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.473+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/1688061530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc49af0 0x55723dc49ed0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.473+0000 7f5b2b83f740 1 -- 172.21.15.12:0/1688061530 >> 172.21.15.12:0/1688061530 conn(0x55723dc46060 msgr2=0x55723dc46440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.473+0000 7f5b2b83f740 1 -- 172.21.15.12:0/1688061530 shutdown_connections 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.473+0000 7f5b2b83f740 1 -- 172.21.15.12:0/1688061530 wait complete. 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.474+0000 7f5b2b83f740 1 -- start start 2024-09-19T06:47:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.474+0000 7f5b2b83f740 1 Processor -- start 2024-09-19T06:47:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.474+0000 7f5b2259c640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5b0c0a3530 0x7f5b0c0a59f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55723dc46ec0 tx=0x7f5b18005c00 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc49af0 0x55723dc51bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4a410 0x55723dc52100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc54cb0 0x55723dc52640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b2b83f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55723dc57880 con 0x55723dc4a410 2024-09-19T06:47:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b2b83f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55723db37290 con 0x55723dc54cb0 2024-09-19T06:47:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b2b83f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55723dc57a00 con 0x55723dc49af0 2024-09-19T06:47:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b2b83f740 10 client.0 _ll_register_callbacks cb 0x55723db68140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b22d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc54cb0 0x55723dc52640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b21d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4a410 0x55723dc52100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b22d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc54cb0 0x55723dc52640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58256/0 (socket says 172.21.15.12:58256) 2024-09-19T06:47:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b22d9d640 1 -- 172.21.15.12:0/3135847639 learned_addr learned my addr 172.21.15.12:0/3135847639 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b2259c640 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc49af0 0x55723dc51bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b22d9d640 1 -- 172.21.15.12:0/3135847639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc49af0 msgr2=0x55723dc51bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc49af0 0x55723dc51bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b22d9d640 1 -- 172.21.15.12:0/3135847639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4a410 msgr2=0x55723dc52100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4a410 0x55723dc52100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b22d9d640 1 -- 172.21.15.12:0/3135847639 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55723d8c1210 con 0x55723dc54cb0 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.475+0000 7f5b2259c640 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc49af0 0x55723dc51bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.476+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc54cb0 0x55723dc52640 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c005b00 tx=0x7f5b1c004c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a3a613d54a4abf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.476+0000 7f5b09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.476+0000 7f5b09ffb640 1 -- 172.21.15.12:0/3135847639 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c028060 con 0x55723dc54cb0 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.476+0000 7f5b2b83f740 1 -- 172.21.15.12:0/3135847639 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b1c004cc0 con 0x55723dc54cb0 2024-09-19T06:47:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.476+0000 7f5b09ffb640 1 -- 172.21.15.12:0/3135847639 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f5b1c005080 con 0x55723dc54cb0 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.476+0000 7f5b09ffb640 1 -- 172.21.15.12:0/3135847639 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f5b1c02f050 con 0x55723dc54cb0 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.476+0000 7f5b2b83f740 10 client.26894 fetch_fsmap learned FSMap version 40 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.476+0000 7f5b2b83f740 1 -- 172.21.15.12:0/3135847639 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55723d98d620 con 0x55723dc54cb0 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.477+0000 7f5b09ffb640 1 -- 172.21.15.12:0/3135847639 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b1c004cc0 con 0x55723dc54cb0 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.477+0000 7f5b09ffb640 1 -- 172.21.15.12:0/3135847639 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f5b1c019430 con 0x55723dc54cb0 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.477+0000 7f5b2b83f740 10 client.26894 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.477+0000 7f5b2b83f740 10 client.26894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.477+0000 7f5b2b83f740 20 client.26894 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.477+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55723dc64bf0 0x55723dc66fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.477+0000 7f5b2b83f740 4 client.26894 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.477+0000 7f5b2b83f740 1 -- 172.21.15.12:0/3135847639 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55723dbbba20 con 0x55723dc64bf0 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.477+0000 7f5b2259c640 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55723dc64bf0 0x55723dc66fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.478+0000 7f5b2259c640 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55723dc64bf0 0x55723dc66fe0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1330dcfb8d6e59d server_cookie=ebabfba1a17e250f in_seq=0 out_seq=0 2024-09-19T06:47:20.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.478+0000 7f5b09ffb640 10 client.26894 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.478+0000 7f5b09ffb640 1 -- 172.21.15.12:0/3135847639 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55723dbbba20 con 0x55723dc64bf0 2024-09-19T06:47:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.478+0000 7f5b09ffb640 10 client.26894 handle_command_reply: tid=0 2024-09-19T06:47:20.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.478+0000 7f5b2b83f740 1 client.26894 shutdown 2024-09-19T06:47:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b2b83f740 1 -- 172.21.15.12:0/3135847639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc54cb0 msgr2=0x55723dc52640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc54cb0 0x55723dc52640 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c005b00 tx=0x7f5b1c004c10 comp rx=0 tx=0).stop 2024-09-19T06:47:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b2b83f740 1 -- 172.21.15.12:0/3135847639 shutdown_connections 2024-09-19T06:47:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55723dc64bf0 0x55723dc66fe0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc54cb0 0x55723dc52640 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4a410 0x55723dc52100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/3135847639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc49af0 0x55723dc51bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b2b83f740 1 -- 172.21.15.12:0/3135847639 >> 172.21.15.12:0/3135847639 conn(0x55723dc46060 msgr2=0x55723dc4bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:20.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b09ffb640 0 client.26894 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:20.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b2b83f740 1 -- 172.21.15.12:0/3135847639 shutdown_connections 2024-09-19T06:47:20.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.479+0000 7f5b2b83f740 1 -- 172.21.15.12:0/3135847639 wait complete. 2024-09-19T06:47:20.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.480+0000 7f5b2b83f740 20 client.26894 trim_cache size 0 max 16384 2024-09-19T06:47:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.510+0000 7f5b2b83f740 1 Processor -- start 2024-09-19T06:47:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.510+0000 7f5b2b83f740 1 -- start start 2024-09-19T06:47:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.510+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc49af0 0x55723dc4c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.511+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc52440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.511+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc54cb0 0x55723dc53b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.511+0000 7f5b2b83f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241b4280 con 0x55723dc49af0 2024-09-19T06:47:20.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.511+0000 7f5b2b83f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241b5ee0 con 0x55723dc4a410 2024-09-19T06:47:20.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.511+0000 7f5b21d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc52440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.511+0000 7f5b21d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc52440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58262/0 (socket says 172.21.15.12:58262) 2024-09-19T06:47:20.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.511+0000 7f5b21d9b640 1 -- 172.21.15.12:0/236048407 learned_addr learned my addr 172.21.15.12:0/236048407 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:20.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.511+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/236048407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc54cb0 0x55723dc53b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.511+0000 7f5b2b83f740 1 -- 172.21.15.12:0/236048407 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241b4950 con 0x55723dc54cb0 2024-09-19T06:47:20.513 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.511+0000 7f5b2259c640 1 --2- 172.21.15.12:0/236048407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc49af0 0x55723dc4c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.512+0000 7f5b21d9b640 1 -- 172.21.15.12:0/236048407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc54cb0 msgr2=0x55723dc53b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.512+0000 7f5b21d9b640 1 --2- 172.21.15.12:0/236048407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc54cb0 0x55723dc53b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.512+0000 7f5b21d9b640 1 -- 172.21.15.12:0/236048407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc49af0 msgr2=0x55723dc4c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.512+0000 7f5b21d9b640 1 --2- 172.21.15.12:0/236048407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc49af0 0x55723dc4c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.512+0000 7f5b21d9b640 1 -- 172.21.15.12:0/236048407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723dc412d0 con 0x55723dc4a410 2024-09-19T06:47:20.514 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.513+0000 7f5b21d9b640 1 --2- 172.21.15.12:0/236048407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc52440 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5b140985a0 tx=0x7f5b14010ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d539aea4273b79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.514+0000 7f5b0bfff640 1 -- 172.21.15.12:0/236048407 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14020040 con 0x55723dc4a410 2024-09-19T06:47:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.514+0000 7f5b0bfff640 1 -- 172.21.15.12:0/236048407 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b1409ff80 con 0x55723dc4a410 2024-09-19T06:47:20.515 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.514+0000 7f5b0bfff640 1 -- 172.21.15.12:0/236048407 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14086310 con 0x55723dc4a410 2024-09-19T06:47:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.515+0000 7f5b2b83f740 1 -- 172.21.15.12:0/236048407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 msgr2=0x55723dc52440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.515+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/236048407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc52440 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5b140985a0 tx=0x7f5b14010ce0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.515+0000 7f5b2b83f740 1 -- 172.21.15.12:0/236048407 shutdown_connections 2024-09-19T06:47:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.515+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/236048407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc54cb0 0x55723dc53b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.515+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/236048407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc52440 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.516+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/236048407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc49af0 0x55723dc4c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.517 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.516+0000 7f5b2b83f740 1 -- 172.21.15.12:0/236048407 >> 172.21.15.12:0/236048407 conn(0x55723dc46060 msgr2=0x55723dc53420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:20.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.518+0000 7f5b2b83f740 1 -- 172.21.15.12:0/236048407 shutdown_connections 2024-09-19T06:47:20.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.522+0000 7f5b2b83f740 1 -- 172.21.15.12:0/236048407 wait complete. 2024-09-19T06:47:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.523+0000 7f5b2b83f740 1 -- start start 2024-09-19T06:47:20.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.523+0000 7f5b2b83f740 1 Processor -- start 2024-09-19T06:47:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.524+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc5d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.524+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc54cb0 0x55723dc4e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.524+0000 7f5b2b83f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4ea50 0x55723dc4eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.524+0000 7f5b2259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc5d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.524+0000 7f5b2259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc5d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58270/0 (socket says 172.21.15.12:58270) 2024-09-19T06:47:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.524+0000 7f5b2259c640 1 -- 172.21.15.12:0/99610664 learned_addr learned my addr 172.21.15.12:0/99610664 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.524+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241b5750 con 0x55723dc4ea50 2024-09-19T06:47:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.524+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4ea50 0x55723dc4eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.525+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241b5080 con 0x55723dc4a410 2024-09-19T06:47:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.525+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5b241b2280 con 0x55723dc54cb0 2024-09-19T06:47:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.525+0000 7f5b2b83f740 10 client.0 _ll_register_callbacks cb 0x7f5b18005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.525+0000 7f5b22d9d640 1 -- 172.21.15.12:0/99610664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc54cb0 msgr2=0x55723dc4e510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:47:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.525+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc54cb0 0x55723dc4e510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.525+0000 7f5b22d9d640 1 -- 172.21.15.12:0/99610664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 msgr2=0x55723dc5d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.525+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc5d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.525+0000 7f5b22d9d640 1 -- 172.21.15.12:0/99610664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55723dc5d8c0 con 0x55723dc4ea50 2024-09-19T06:47:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.525+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b1409ff80 con 0x55723dc4ea50 2024-09-19T06:47:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.529+0000 7f5b22d9d640 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4ea50 0x55723dc4eed0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00a010 tx=0x7f5b1c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2575ca581a982f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:20.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.529+0000 7f5b09ffb640 10 client.17397 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:20.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.530+0000 7f5b09ffb640 1 -- 172.21.15.12:0/99610664 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c038060 con 0x55723dc4ea50 2024-09-19T06:47:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.530+0000 7f5b09ffb640 1 -- 172.21.15.12:0/99610664 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f5b1c005290 con 0x55723dc4ea50 2024-09-19T06:47:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.530+0000 7f5b09ffb640 1 -- 172.21.15.12:0/99610664 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f5b1c0054d0 con 0x55723dc4ea50 2024-09-19T06:47:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.531+0000 7f5b2b83f740 10 client.17397 fetch_fsmap learned FSMap version 40 2024-09-19T06:47:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.531+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55723dccf560 con 0x55723dc4ea50 2024-09-19T06:47:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.531+0000 7f5b09ffb640 1 -- 172.21.15.12:0/99610664 <== mon.0 v2:172.21.15.12:3300/0 4 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f5b1c024460 con 0x55723dc4ea50 2024-09-19T06:47:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.534+0000 7f5b2b83f740 10 client.17397 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:47:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.534+0000 7f5b2b83f740 10 client.17397 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.534+0000 7f5b2b83f740 20 client.17397 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.534+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55723dccfc40 0x55723dcd20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.534+0000 7f5b2b83f740 4 client.17397 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:47:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.534+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55723dbb5d70 con 0x55723dccfc40 2024-09-19T06:47:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.535+0000 7f5b2259c640 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55723dccfc40 0x55723dcd20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.539+0000 7f5b2259c640 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55723dccfc40 0x55723dcd20c0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39f76abcdd245064 server_cookie=850af6db1180855 in_seq=0 out_seq=0 2024-09-19T06:47:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.540+0000 7f5b09ffb640 10 client.17397 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.595+0000 7f5b09ffb640 1 -- 172.21.15.12:0/99610664 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55723dbb5d70 con 0x55723dccfc40 2024-09-19T06:47:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.595+0000 7f5b09ffb640 10 client.17397 handle_command_reply: tid=0 2024-09-19T06:47:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.595+0000 7f5b2b83f740 1 client.17397 shutdown 2024-09-19T06:47:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.595+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4ea50 msgr2=0x55723dc4eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.595+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4ea50 0x55723dc4eed0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00a010 tx=0x7f5b1c019660 comp rx=0 tx=0).stop 2024-09-19T06:47:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.596+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 shutdown_connections 2024-09-19T06:47:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.596+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55723dccfc40 0x55723dcd20c0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.596+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55723dc4ea50 0x55723dc4eed0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.596+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55723dc54cb0 0x55723dc4e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.596+0000 7f5b2b83f740 1 --2- 172.21.15.12:0/99610664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55723dc4a410 0x55723dc5d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.596+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 >> 172.21.15.12:0/99610664 conn(0x55723dc46060 msgr2=0x55723dc451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.596+0000 7f5b09ffb640 0 client.17397 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.597+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 shutdown_connections 2024-09-19T06:47:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.597+0000 7f5b2b83f740 1 -- 172.21.15.12:0/99610664 wait complete. 2024-09-19T06:47:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:47:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:47:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:47:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:47:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.597+0000 7f5b2b83f740 20 client.17397 trim_cache size 0 max 16384 2024-09-19T06:47:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.598+0000 7f5b289c4640 1 -- 172.21.15.12:0/311593704 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5b0c0a3530 msgr2=0x7f5b0c0a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.598+0000 7f5b289c4640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5b0c0a3530 0x7f5b0c0a59f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55723dc46ec0 tx=0x7f5b18005c00 comp rx=0 tx=0).stop 2024-09-19T06:47:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.599+0000 7f5b289c4640 1 -- 172.21.15.12:0/311593704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b24101370 msgr2=0x7f5b241a4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.599+0000 7f5b289c4640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b24101370 0x7f5b241a4b90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400d950 tx=0x7f5b1400de10 comp rx=0 tx=0).stop 2024-09-19T06:47:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.599+0000 7f5b289c4640 1 -- 172.21.15.12:0/311593704 shutdown_connections 2024-09-19T06:47:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.599+0000 7f5b289c4640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5b0c0a3530 0x7f5b0c0a59f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.599+0000 7f5b289c4640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b241069e0 0x7f5b2419e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.599+0000 7f5b289c4640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b24101370 0x7f5b241a4b90 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.599+0000 7f5b289c4640 1 --2- 172.21.15.12:0/311593704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b241009d0 0x7f5b241a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.599+0000 7f5b289c4640 1 -- 172.21.15.12:0/311593704 >> 172.21.15.12:0/311593704 conn(0x7f5b240fc6b0 msgr2=0x7f5b240fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.599+0000 7f5b289c4640 1 -- 172.21.15.12:0/311593704 shutdown_connections 2024-09-19T06:47:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:20.599+0000 7f5b289c4640 1 -- 172.21.15.12:0/311593704 wait complete. 2024-09-19T06:47:20.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 395.0 s, 3040.6 tps, lat 32.973 ms stddev 36.828 2024-09-19T06:47:22.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:21 smithi173 ceph-mon[35349]: pgmap v221: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 MiB/s wr, 1.65k op/s 2024-09-19T06:47:22.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:21 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:22.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:21 smithi012 ceph-mon[30937]: pgmap v221: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 MiB/s wr, 1.65k op/s 2024-09-19T06:47:22.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:21 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:21 smithi016 ceph-mon[34911]: pgmap v221: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 MiB/s wr, 1.65k op/s 2024-09-19T06:47:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:21 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:23.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:22 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:23.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:22 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:23.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:22 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:47:23.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:22 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:23.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:22 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:23.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:22 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:47:23.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:22 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:23.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:22 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:23.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:22 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:47:23.812 INFO:tasks.quiescer.fs.[cephfs]:Total duration (51.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T06:47:23.812 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T06:47:23.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:24.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:23 smithi173 ceph-mon[35349]: pgmap v222: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 MiB/s wr, 1.65k op/s 2024-09-19T06:47:24.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:23 smithi012 ceph-mon[30937]: pgmap v222: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 MiB/s wr, 1.65k op/s 2024-09-19T06:47:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:23 smithi016 ceph-mon[34911]: pgmap v222: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 MiB/s wr, 1.65k op/s 2024-09-19T06:47:24.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.804+0000 7fecc8132640 1 -- 172.21.15.12:0/516852477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc01036e0 msgr2=0x7fecc0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.804+0000 7fecc8132640 1 --2- 172.21.15.12:0/516852477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc01036e0 0x7fecc0107b90 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009930 tx=0x7fecb002a420 comp rx=0 tx=0).stop 2024-09-19T06:47:24.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.804+0000 7fecc8132640 1 -- 172.21.15.12:0/516852477 shutdown_connections 2024-09-19T06:47:24.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.804+0000 7fecc8132640 1 --2- 172.21.15.12:0/516852477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01082a0 0x7fecc010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.804+0000 7fecc8132640 1 --2- 172.21.15.12:0/516852477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc01036e0 0x7fecc0107b90 secure :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009930 tx=0x7fecb002a420 comp rx=0 tx=0).stop 2024-09-19T06:47:24.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.804+0000 7fecc8132640 1 --2- 172.21.15.12:0/516852477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc0102d30 0x7fecc0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.804+0000 7fecc8132640 1 -- 172.21.15.12:0/516852477 >> 172.21.15.12:0/516852477 conn(0x7fecc00fc7d0 msgr2=0x7fecc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:24.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.805+0000 7fecc8132640 1 -- 172.21.15.12:0/516852477 shutdown_connections 2024-09-19T06:47:24.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.805+0000 7fecc8132640 1 -- 172.21.15.12:0/516852477 wait complete. 2024-09-19T06:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.806+0000 7fecc8132640 1 Processor -- start 2024-09-19T06:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.806+0000 7fecc8132640 1 -- start start 2024-09-19T06:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.806+0000 7fecc8132640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc0102d30 0x7fecc0110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.806+0000 7fecc8132640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01082a0 0x7fecc0110640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.806+0000 7fecc8132640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc0110b80 0x7fecc01aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc8132640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fecc0102920 con 0x7fecc0110b80 2024-09-19T06:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc8132640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fecc01027a0 con 0x7fecc0102d30 2024-09-19T06:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc8132640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fecc0114440 con 0x7fecc01082a0 2024-09-19T06:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc66cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc0110b80 0x7fecc01aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc5ece640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc0102d30 0x7fecc0110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc66cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc0110b80 0x7fecc01aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56452/0 (socket says 172.21.15.12:56452) 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc66cf640 1 -- 172.21.15.12:0/1835739420 learned_addr learned my addr 172.21.15.12:0/1835739420 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc56cd640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01082a0 0x7fecc0110640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc5ece640 1 -- 172.21.15.12:0/1835739420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01082a0 msgr2=0x7fecc0110640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc5ece640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01082a0 0x7fecc0110640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc5ece640 1 -- 172.21.15.12:0/1835739420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc0110b80 msgr2=0x7fecc01aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc5ece640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc0110b80 0x7fecc01aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc5ece640 1 -- 172.21.15.12:0/1835739420 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc01ab500 con 0x7fecc0102d30 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.807+0000 7fecc56cd640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01082a0 0x7fecc0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.808+0000 7fecc5ece640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc0102d30 0x7fecc0110100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00e9f0 tx=0x7fecbc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.808+0000 7fecb6ffd640 1 -- 172.21.15.12:0/1835739420 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00ccc0 con 0x7fecc0102d30 2024-09-19T06:47:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.808+0000 7fecc8132640 1 -- 172.21.15.12:0/1835739420 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc01ab7f0 con 0x7fecc0102d30 2024-09-19T06:47:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.808+0000 7fecb6ffd640 1 -- 172.21.15.12:0/1835739420 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecbc010910 con 0x7fecc0102d30 2024-09-19T06:47:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.808+0000 7fecb6ffd640 1 -- 172.21.15.12:0/1835739420 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc018980 con 0x7fecc0102d30 2024-09-19T06:47:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.808+0000 7fecc8132640 1 -- 172.21.15.12:0/1835739420 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc01abd50 con 0x7fecc0102d30 2024-09-19T06:47:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.809+0000 7fecc8132640 1 -- 172.21.15.12:0/1835739420 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc006a850 con 0x7fecc0102d30 2024-09-19T06:47:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.811+0000 7fecb6ffd640 1 -- 172.21.15.12:0/1835739420 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fecbc010430 con 0x7fecc0102d30 2024-09-19T06:47:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.812+0000 7fecb6ffd640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecac0a34b0 0x7fecac0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:24.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.813+0000 7fecb6ffd640 1 -- 172.21.15.12:0/1835739420 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fecbc0d01f0 con 0x7fecc0102d30 2024-09-19T06:47:24.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.813+0000 7fecc56cd640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecac0a34b0 0x7fecac0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:24.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.813+0000 7fecc56cd640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecac0a34b0 0x7fecac0a5970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fecb0008000 tx=0x7fecb0005a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:24.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:24.818+0000 7fecb6ffd640 1 -- 172.21.15.12:0/1835739420 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fecbc054210 con 0x7fecc0102d30 2024-09-19T06:47:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.184+0000 7fecc8132640 1 -- 172.21.15.12:0/1835739420 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecc010a2b0 con 0x7fecc0102d30 2024-09-19T06:47:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.185+0000 7fecb6ffd640 1 -- 172.21.15.12:0/1835739420 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11981 (secure 0 0 0) 0x7fecbc09cad0 con 0x7fecc0102d30 2024-09-19T06:47:25.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:47:25.187 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"btime":"2024-09-19T06:46:29:658066+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:46:29.410528+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:47:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2024-09-19T06:47:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.190+0000 7fecc8132640 1 -- 172.21.15.12:0/1835739420 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecac0a34b0 msgr2=0x7fecac0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.190+0000 7fecc8132640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecac0a34b0 0x7fecac0a5970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fecb0008000 tx=0x7fecb0005a40 comp rx=0 tx=0).stop 2024-09-19T06:47:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.190+0000 7fecc8132640 1 -- 172.21.15.12:0/1835739420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc0102d30 msgr2=0x7fecc0110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.190+0000 7fecc8132640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc0102d30 0x7fecc0110100 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00e9f0 tx=0x7fecbc00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.190+0000 7fecc8132640 1 -- 172.21.15.12:0/1835739420 shutdown_connections 2024-09-19T06:47:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.190+0000 7fecc8132640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecc0110b80 0x7fecc01aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.190+0000 7fecc8132640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecac0a34b0 0x7fecac0a5970 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fecb0008000 tx=0x7fecb0005a40 comp rx=0 tx=0).stop 2024-09-19T06:47:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.190+0000 7fecc8132640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecc01082a0 0x7fecc0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.190+0000 7fecc8132640 1 --2- 172.21.15.12:0/1835739420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecc0102d30 0x7fecc0110100 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.190+0000 7fecc8132640 1 -- 172.21.15.12:0/1835739420 >> 172.21.15.12:0/1835739420 conn(0x7fecc00fc7d0 msgr2=0x7fecc00fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.191+0000 7fecc8132640 1 -- 172.21.15.12:0/1835739420 shutdown_connections 2024-09-19T06:47:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:25.191+0000 7fecc8132640 1 -- 172.21.15.12:0/1835739420 wait complete. 2024-09-19T06:47:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 400.0 s, 2797.8 tps, lat 35.735 ms stddev 41.057 2024-09-19T06:47:26.038 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T06:47:26.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T06:47:26.073 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:25 smithi012 ceph-mon[30937]: pgmap v223: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 42 MiB/s wr, 1.54k op/s 2024-09-19T06:47:26.073 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:25 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1835739420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:26.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:25 smithi173 ceph-mon[35349]: pgmap v223: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 42 MiB/s wr, 1.54k op/s 2024-09-19T06:47:26.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:25 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1835739420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:25 smithi016 ceph-mon[34911]: pgmap v223: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 42 MiB/s wr, 1.54k op/s 2024-09-19T06:47:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:25 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1835739420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:27.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.057+0000 7f6c6a370640 1 -- 172.21.15.12:0/3410728890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c64107a00 msgr2=0x7f6c64107de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:27.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.057+0000 7f6c6a370640 1 --2- 172.21.15.12:0/3410728890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c64107a00 0x7f6c64107de0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009cd0 tx=0x7f6c5c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.057+0000 7f6c6a370640 1 -- 172.21.15.12:0/3410728890 shutdown_connections 2024-09-19T06:47:27.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.057+0000 7f6c6a370640 1 --2- 172.21.15.12:0/3410728890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c641023a0 0x7f6c6410e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.057+0000 7f6c6a370640 1 --2- 172.21.15.12:0/3410728890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c64101a00 0x7f6c64101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.057+0000 7f6c6a370640 1 --2- 172.21.15.12:0/3410728890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c64107a00 0x7f6c64107de0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.057+0000 7f6c6a370640 1 -- 172.21.15.12:0/3410728890 >> 172.21.15.12:0/3410728890 conn(0x7f6c640fd6e0 msgr2=0x7f6c640ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:27.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.057+0000 7f6c6a370640 1 -- 172.21.15.12:0/3410728890 shutdown_connections 2024-09-19T06:47:27.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.057+0000 7f6c6a370640 1 -- 172.21.15.12:0/3410728890 wait complete. 2024-09-19T06:47:27.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.058+0000 7f6c6a370640 1 Processor -- start 2024-09-19T06:47:27.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.058+0000 7f6c6a370640 1 -- start start 2024-09-19T06:47:27.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c6a370640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c64101a00 0x7f6c64198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c6a370640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c641023a0 0x7f6c64198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c6a370640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c64107a00 0x7f6c6419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c6a370640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64111dc0 con 0x7f6c64101a00 2024-09-19T06:47:27.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c6a370640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64111c40 con 0x7f6c641023a0 2024-09-19T06:47:27.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c64101a00 0x7f6c64198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c6a370640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64111f40 con 0x7f6c64107a00 2024-09-19T06:47:27.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c64101a00 0x7f6c64198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56464/0 (socket says 172.21.15.12:56464) 2024-09-19T06:47:27.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c63fff640 1 -- 172.21.15.12:0/3396335749 learned_addr learned my addr 172.21.15.12:0/3396335749 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c637fe640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c641023a0 0x7f6c64198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c6890d640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c64107a00 0x7f6c6419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c637fe640 1 -- 172.21.15.12:0/3396335749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c64107a00 msgr2=0x7f6c6419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c637fe640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c64107a00 0x7f6c6419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c637fe640 1 -- 172.21.15.12:0/3396335749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c64101a00 msgr2=0x7f6c64198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c637fe640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c64101a00 0x7f6c64198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.059+0000 7f6c637fe640 1 -- 172.21.15.12:0/3396335749 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6419d2c0 con 0x7f6c641023a0 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.060+0000 7f6c637fe640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c641023a0 0x7f6c64198850 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c58012e00 tx=0x7f6c5800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.060+0000 7f6c617fa640 1 -- 172.21.15.12:0/3396335749 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58004020 con 0x7f6c641023a0 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.060+0000 7f6c617fa640 1 -- 172.21.15.12:0/3396335749 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c580041c0 con 0x7f6c641023a0 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.060+0000 7f6c6a370640 1 -- 172.21.15.12:0/3396335749 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6419d5b0 con 0x7f6c641023a0 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.060+0000 7f6c6a370640 1 -- 172.21.15.12:0/3396335749 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c64074420 con 0x7f6c641023a0 2024-09-19T06:47:27.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.060+0000 7f6c617fa640 1 -- 172.21.15.12:0/3396335749 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5801a870 con 0x7f6c641023a0 2024-09-19T06:47:27.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.063+0000 7f6c6c749740 1 Processor -- start 2024-09-19T06:47:27.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.064+0000 7f6c6c749740 1 -- start start 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.064+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 0x55a48bc4cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.064+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4d260 0x55a48bc5fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc60410 0x55a48bc62800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.064+0000 7f6c617fa640 1 -- 172.21.15.12:0/3396335749 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6c58021060 con 0x7f6c641023a0 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c6c749740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a48bbb1160 con 0x55a48bc60410 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c6c749740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a48bb58720 con 0x55a48bc4c940 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c6c749740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a48bbad120 con 0x55a48bc4d260 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c6890d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 0x55a48bc4cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c6890d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 0x55a48bc4cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58324/0 (socket says 172.21.15.12:58324) 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c6890d640 1 -- 172.21.15.12:0/3741012882 learned_addr learned my addr 172.21.15.12:0/3741012882 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:27.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c63fff640 1 --2- 172.21.15.12:0/3741012882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4d260 0x55a48bc5fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c6890d640 1 -- 172.21.15.12:0/3741012882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4d260 msgr2=0x55a48bc5fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:27.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c6890d640 1 --2- 172.21.15.12:0/3741012882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4d260 0x55a48bc5fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.065+0000 7f6c6890d640 1 -- 172.21.15.12:0/3741012882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc60410 msgr2=0x55a48bc62800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:47:27.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.066+0000 7f6c617fa640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6c4c0a34b0 0x7f6c4c0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.066+0000 7f6c637fe640 1 --2- 172.21.15.12:0/3741012882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc60410 0x55a48bc62800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.066+0000 7f6c6890d640 1 --2- 172.21.15.12:0/3741012882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc60410 0x55a48bc62800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.066+0000 7f6c6890d640 1 -- 172.21.15.12:0/3741012882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a48b922ba0 con 0x55a48bc4c940 2024-09-19T06:47:27.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.066+0000 7f6c6890d640 1 --2- 172.21.15.12:0/3741012882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 0x55a48bc4cd20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009c20 tx=0x7f6c54011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66abccae1767e5db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:27.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.067+0000 7f6c617fa640 1 -- 172.21.15.12:0/3396335749 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f6c5801f070 con 0x7f6c641023a0 2024-09-19T06:47:27.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.067+0000 7f6c4a7fc640 1 -- 172.21.15.12:0/3741012882 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5401e070 con 0x55a48bc4c940 2024-09-19T06:47:27.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.067+0000 7f6c4a7fc640 1 -- 172.21.15.12:0/3741012882 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c54019b10 con 0x55a48bc4c940 2024-09-19T06:47:27.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.068+0000 7f6c4a7fc640 1 -- 172.21.15.12:0/3741012882 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5400eae0 con 0x55a48bc4c940 2024-09-19T06:47:27.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.068+0000 7f6c6c749740 1 -- 172.21.15.12:0/3741012882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 msgr2=0x55a48bc4cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:27.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.068+0000 7f6c6c749740 1 --2- 172.21.15.12:0/3741012882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 0x55a48bc4cd20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009c20 tx=0x7f6c54011810 comp rx=0 tx=0).stop 2024-09-19T06:47:27.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.068+0000 7f6c63fff640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6c4c0a34b0 0x7f6c4c0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.068+0000 7f6c6c749740 1 -- 172.21.15.12:0/3741012882 shutdown_connections 2024-09-19T06:47:27.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.068+0000 7f6c6c749740 1 --2- 172.21.15.12:0/3741012882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc60410 0x55a48bc62800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.068+0000 7f6c6c749740 1 --2- 172.21.15.12:0/3741012882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4d260 0x55a48bc5fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.068+0000 7f6c6c749740 1 --2- 172.21.15.12:0/3741012882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 0x55a48bc4cd20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.068+0000 7f6c6c749740 1 -- 172.21.15.12:0/3741012882 >> 172.21.15.12:0/3741012882 conn(0x55a48bc48fb0 msgr2=0x55a48bc49390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:27.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.069+0000 7f6c6c749740 1 -- 172.21.15.12:0/3741012882 shutdown_connections 2024-09-19T06:47:27.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.069+0000 7f6c6c749740 1 -- 172.21.15.12:0/3741012882 wait complete. 2024-09-19T06:47:27.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.069+0000 7f6c6c749740 1 -- start start 2024-09-19T06:47:27.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.069+0000 7f6c63fff640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6c4c0a34b0 0x7f6c4c0a5970 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009a60 tx=0x7f6c5c004a60 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:27.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.070+0000 7f6c6c749740 1 Processor -- start 2024-09-19T06:47:27.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.071+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4c940 0x55a48bc5d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.071+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4d260 0x55a48bc5d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.071+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc60410 0x55a48bc5ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.071+0000 7f6c6c749740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a48bc62fd0 con 0x55a48bc4c940 2024-09-19T06:47:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.071+0000 7f6c6c749740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a48bb39900 con 0x55a48bc4d260 2024-09-19T06:47:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.071+0000 7f6c6c749740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a48bc63150 con 0x55a48bc60410 2024-09-19T06:47:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.071+0000 7f6c6c749740 10 client.0 _ll_register_callbacks cb 0x55a48bb37780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.071+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4d260 0x55a48bc5d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.071+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4d260 0x55a48bc5d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58328/0 (socket says 172.21.15.12:58328) 2024-09-19T06:47:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.071+0000 7f6c637fe640 1 -- 172.21.15.12:0/2737974734 learned_addr learned my addr 172.21.15.12:0/2737974734 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:27.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.072+0000 7f6c637fe640 1 -- 172.21.15.12:0/2737974734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc60410 msgr2=0x55a48bc5ddb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:47:27.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.072+0000 7f6c637fe640 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc60410 0x55a48bc5ddb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.072+0000 7f6c637fe640 1 -- 172.21.15.12:0/2737974734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4c940 msgr2=0x55a48bc5d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:27.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.072+0000 7f6c637fe640 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4c940 0x55a48bc5d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.072+0000 7f6c637fe640 1 -- 172.21.15.12:0/2737974734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a48bb79c50 con 0x55a48bc4d260 2024-09-19T06:47:27.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.073+0000 7f6c637fe640 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4d260 0x55a48bc5d870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c58012dd0 tx=0x7f6c5809efb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcb294cf2dca70f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:27.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.074+0000 7f6c437fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:47:27.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.074+0000 7f6c437fe640 1 -- 172.21.15.12:0/2737974734 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5801e040 con 0x55a48bc4d260 2024-09-19T06:47:27.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.074+0000 7f6c437fe640 1 -- 172.21.15.12:0/2737974734 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f6c58009390 con 0x55a48bc4d260 2024-09-19T06:47:27.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.074+0000 7f6c6c749740 1 -- 172.21.15.12:0/2737974734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c54019b10 con 0x55a48bc4d260 2024-09-19T06:47:27.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.074+0000 7f6c437fe640 1 -- 172.21.15.12:0/2737974734 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6c580a8200 con 0x55a48bc4d260 2024-09-19T06:47:27.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.074+0000 7f6c6c749740 10 client.26918 fetch_fsmap learned FSMap version 40 2024-09-19T06:47:27.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.074+0000 7f6c6c749740 1 -- 172.21.15.12:0/2737974734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55a48bc6edd0 con 0x55a48bc4d260 2024-09-19T06:47:27.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.074+0000 7f6c437fe640 1 -- 172.21.15.12:0/2737974734 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c54019b10 con 0x55a48bc4d260 2024-09-19T06:47:27.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.075+0000 7f6c437fe640 1 -- 172.21.15.12:0/2737974734 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f6c5809e9e0 con 0x55a48bc4d260 2024-09-19T06:47:27.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.075+0000 7f6c6c749740 10 client.26918 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:47:27.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.075+0000 7f6c6c749740 10 client.26918 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:47:27.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.075+0000 7f6c6c749740 20 client.26918 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:27.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.075+0000 7f6c6c749740 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a48bc70520 0x55a48bc72980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.076+0000 7f6c6c749740 4 client.26918 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:27.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.076+0000 7f6c6c749740 1 -- 172.21.15.12:0/2737974734 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a48bbbe890 con 0x55a48bc70520 2024-09-19T06:47:27.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.076+0000 7f6c63fff640 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a48bc70520 0x55a48bc72980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.076+0000 7f6c63fff640 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a48bc70520 0x55a48bc72980 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a1f4e5c72274ede server_cookie=b02d0e607b644b4c in_seq=0 out_seq=0 2024-09-19T06:47:27.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.076+0000 7f6c437fe640 10 client.26918 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.077+0000 7f6c437fe640 1 -- 172.21.15.12:0/2737974734 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a48bbbe890 con 0x55a48bc70520 2024-09-19T06:47:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.077+0000 7f6c437fe640 10 client.26918 handle_command_reply: tid=0 2024-09-19T06:47:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.077+0000 7f6c6c749740 1 client.26918 shutdown 2024-09-19T06:47:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c6c749740 1 -- 172.21.15.12:0/2737974734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4d260 msgr2=0x55a48bc5d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c6c749740 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4d260 0x55a48bc5d870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c58012dd0 tx=0x7f6c5809efb0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c6c749740 1 -- 172.21.15.12:0/2737974734 shutdown_connections 2024-09-19T06:47:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c6c749740 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a48bc70520 0x55a48bc72980 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c6c749740 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc60410 0x55a48bc5ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c6c749740 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4d260 0x55a48bc5d870 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c6c749740 1 --2- 172.21.15.12:0/2737974734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4c940 0x55a48bc5d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c6c749740 1 -- 172.21.15.12:0/2737974734 >> 172.21.15.12:0/2737974734 conn(0x55a48bc48fb0 msgr2=0x55a48bc4ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c437fe640 0 client.26918 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c6c749740 1 -- 172.21.15.12:0/2737974734 shutdown_connections 2024-09-19T06:47:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.079+0000 7f6c6c749740 1 -- 172.21.15.12:0/2737974734 wait complete. 2024-09-19T06:47:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.080+0000 7f6c6c749740 20 client.26918 trim_cache size 0 max 16384 2024-09-19T06:47:27.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c6c749740 1 Processor -- start 2024-09-19T06:47:27.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c6c749740 1 -- start start 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 0x55a48bc5bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 0x55a48bc5dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc60410 0x55a48bc78290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c6c749740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5000ea80 con 0x55a48bc4d260 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c6c749740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500106e0 con 0x55a48bc4c940 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c6c749740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5000f150 con 0x55a48bc60410 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 0x55a48bc5dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 0x55a48bc5dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56488/0 (socket says 172.21.15.12:56488) 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c637fe640 1 -- 172.21.15.12:0/876448666 learned_addr learned my addr 172.21.15.12:0/876448666 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c6890d640 1 --2- 172.21.15.12:0/876448666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc60410 0x55a48bc78290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.114+0000 7f6c63fff640 1 --2- 172.21.15.12:0/876448666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 0x55a48bc5bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.115+0000 7f6c637fe640 1 -- 172.21.15.12:0/876448666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc60410 msgr2=0x55a48bc78290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:27.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.115+0000 7f6c637fe640 1 --2- 172.21.15.12:0/876448666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc60410 0x55a48bc78290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.115+0000 7f6c637fe640 1 -- 172.21.15.12:0/876448666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 msgr2=0x55a48bc5bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:27.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.115+0000 7f6c637fe640 1 --2- 172.21.15.12:0/876448666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 0x55a48bc5bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.115+0000 7f6c637fe640 1 -- 172.21.15.12:0/876448666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a48bc48860 con 0x55a48bc4d260 2024-09-19T06:47:27.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.115+0000 7f6c637fe640 1 --2- 172.21.15.12:0/876448666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 0x55a48bc5dc00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6c5809ed50 tx=0x7f6c5809daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cba71acf6112499 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:27.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.115+0000 7f6c49ffb640 1 -- 172.21.15.12:0/876448666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5801e070 con 0x55a48bc4d260 2024-09-19T06:47:27.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.115+0000 7f6c49ffb640 1 -- 172.21.15.12:0/876448666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c58009370 con 0x55a48bc4d260 2024-09-19T06:47:27.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.115+0000 7f6c49ffb640 1 -- 172.21.15.12:0/876448666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5809e450 con 0x55a48bc4d260 2024-09-19T06:47:27.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.116+0000 7f6c6c749740 1 -- 172.21.15.12:0/876448666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 msgr2=0x55a48bc5dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:27.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.116+0000 7f6c6c749740 1 --2- 172.21.15.12:0/876448666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 0x55a48bc5dc00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6c5809ed50 tx=0x7f6c5809daa0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.116+0000 7f6c6c749740 1 -- 172.21.15.12:0/876448666 shutdown_connections 2024-09-19T06:47:27.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.116+0000 7f6c6c749740 1 --2- 172.21.15.12:0/876448666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc60410 0x55a48bc78290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.116+0000 7f6c6c749740 1 --2- 172.21.15.12:0/876448666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 0x55a48bc5dc00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.116+0000 7f6c6c749740 1 --2- 172.21.15.12:0/876448666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc4c940 0x55a48bc5bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.116+0000 7f6c6c749740 1 -- 172.21.15.12:0/876448666 >> 172.21.15.12:0/876448666 conn(0x55a48bc48fb0 msgr2=0x55a48bc5f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:27.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.116+0000 7f6c6c749740 1 -- 172.21.15.12:0/876448666 shutdown_connections 2024-09-19T06:47:27.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.116+0000 7f6c6c749740 1 -- 172.21.15.12:0/876448666 wait complete. 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.116+0000 7f6c6c749740 1 -- start start 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c6c749740 1 Processor -- start 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4c940 0x55a48bcd69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 0x55a48bc684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c6c749740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc60410 0x55a48bc68a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c6c749740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5000ff50 con 0x55a48bc4d260 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c6c749740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5000f880 con 0x55a48bc60410 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c6c749740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5000ca80 con 0x55a48bc4c940 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c6c749740 10 client.0 _ll_register_callbacks cb 0x7f6c58003f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 0x55a48bc684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4c940 0x55a48bcd69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4c940 0x55a48bcd69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:59280/0 (socket says 172.21.15.12:59280) 2024-09-19T06:47:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c63fff640 1 -- 172.21.15.12:0/1798448582 learned_addr learned my addr 172.21.15.12:0/1798448582 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c6890d640 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc60410 0x55a48bc68a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c63fff640 1 -- 172.21.15.12:0/1798448582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc60410 msgr2=0x55a48bc68a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.117+0000 7f6c63fff640 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc60410 0x55a48bc68a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.118+0000 7f6c63fff640 1 -- 172.21.15.12:0/1798448582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 msgr2=0x55a48bc684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.118+0000 7f6c63fff640 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 0x55a48bc684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.118+0000 7f6c63fff640 1 -- 172.21.15.12:0/1798448582 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a48bc690f0 con 0x55a48bc4c940 2024-09-19T06:47:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.118+0000 7f6c63fff640 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4c940 0x55a48bcd69d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c005e30 tx=0x7f6c5c02a8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faa237a8f5636513 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.119+0000 7f6c437fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.119+0000 7f6c437fe640 1 -- 172.21.15.12:0/1798448582 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c003af0 con 0x55a48bc4c940 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.119+0000 7f6c437fe640 1 -- 172.21.15.12:0/1798448582 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f6c5c003c90 con 0x55a48bc4c940 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.119+0000 7f6c6c749740 1 -- 172.21.15.12:0/1798448582 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c58009370 con 0x55a48bc4c940 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c437fe640 1 -- 172.21.15.12:0/1798448582 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6c5c004040 con 0x55a48bc4c940 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c6c749740 10 client.26884 fetch_fsmap learned FSMap version 40 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c6c749740 1 -- 172.21.15.12:0/1798448582 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55a48bc53740 con 0x55a48bc4c940 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c437fe640 1 -- 172.21.15.12:0/1798448582 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c58009370 con 0x55a48bc4c940 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c437fe640 1 -- 172.21.15.12:0/1798448582 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f6c5c030070 con 0x55a48bc4c940 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c6c749740 10 client.26884 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c6c749740 10 client.26884 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c6c749740 20 client.26884 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c6c749740 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a48bc53ff0 0x55a48bc56410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c6c749740 4 client.26884 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T06:47:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c6c749740 1 -- 172.21.15.12:0/1798448582 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x55a48bbb8be0 con 0x55a48bc53ff0 2024-09-19T06:47:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.120+0000 7f6c637fe640 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a48bc53ff0 0x55a48bc56410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.121+0000 7f6c437fe640 10 client.26884 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.121+0000 7f6c637fe640 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a48bc53ff0 0x55a48bc56410 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c160fed68898ecd server_cookie=3d44040083b62bc9 in_seq=0 out_seq=0 2024-09-19T06:47:27.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c437fe640 1 -- 172.21.15.12:0/1798448582 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a48bbb8be0 con 0x55a48bc53ff0 2024-09-19T06:47:27.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c437fe640 10 client.26884 handle_command_reply: tid=0 2024-09-19T06:47:27.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c6c749740 1 client.26884 shutdown 2024-09-19T06:47:27.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c6c749740 1 -- 172.21.15.12:0/1798448582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4c940 msgr2=0x55a48bcd69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:27.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c6c749740 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4c940 0x55a48bcd69d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c005e30 tx=0x7f6c5c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c6c749740 1 -- 172.21.15.12:0/1798448582 shutdown_connections 2024-09-19T06:47:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c6c749740 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a48bc53ff0 0x55a48bc56410 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c6c749740 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a48bc60410 0x55a48bc68a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c6c749740 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a48bc4d260 0x55a48bc684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c437fe640 0 client.26884 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c6c749740 1 --2- 172.21.15.12:0/1798448582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a48bc4c940 0x55a48bcd69d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.320+0000 7f6c6c749740 1 -- 172.21.15.12:0/1798448582 >> 172.21.15.12:0/1798448582 conn(0x55a48bc48fb0 msgr2=0x55a48bc47830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6c749740 1 -- 172.21.15.12:0/1798448582 shutdown_connections 2024-09-19T06:47:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6c749740 1 -- 172.21.15.12:0/1798448582 wait complete. 2024-09-19T06:47:27.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6c749740 20 client.26884 trim_cache size 0 max 16384 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 40, 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 26, 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: "58f4efdb": { 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 26, 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:47:27.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 145.8, 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:27.325 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:47:27.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6a370640 1 -- 172.21.15.12:0/3396335749 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6c4c0a34b0 msgr2=0x7f6c4c0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:27.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6a370640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6c4c0a34b0 0x7f6c4c0a5970 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009a60 tx=0x7f6c5c004a60 comp rx=0 tx=0).stop 2024-09-19T06:47:27.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6a370640 1 -- 172.21.15.12:0/3396335749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c641023a0 msgr2=0x7f6c64198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:27.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6a370640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c641023a0 0x7f6c64198850 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c58012e00 tx=0x7f6c5800c6a0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6a370640 1 -- 172.21.15.12:0/3396335749 shutdown_connections 2024-09-19T06:47:27.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6a370640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6c4c0a34b0 0x7f6c4c0a5970 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6a370640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c64107a00 0x7f6c6419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6a370640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c641023a0 0x7f6c64198850 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.321+0000 7f6c6a370640 1 --2- 172.21.15.12:0/3396335749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c64101a00 0x7f6c64198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.322+0000 7f6c6a370640 1 -- 172.21.15.12:0/3396335749 >> 172.21.15.12:0/3396335749 conn(0x7f6c640fd6e0 msgr2=0x7f6c640fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.322+0000 7f6c6a370640 1 -- 172.21.15.12:0/3396335749 shutdown_connections 2024-09-19T06:47:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:27.322+0000 7f6c6a370640 1 -- 172.21.15.12:0/3396335749 wait complete. 2024-09-19T06:47:28.077 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:27 smithi012 ceph-mon[30937]: pgmap v224: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 1.02k op/s 2024-09-19T06:47:28.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:27 smithi173 ceph-mon[35349]: pgmap v224: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 1.02k op/s 2024-09-19T06:47:28.108 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '58f4efdb', quiesce took 4.3 seconds. Will release after: 21.45 2024-09-19T06:47:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:27 smithi016 ceph-mon[34911]: pgmap v224: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 MiB/s wr, 1.02k op/s 2024-09-19T06:47:30.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:29 smithi173 ceph-mon[35349]: pgmap v225: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 974 op/s 2024-09-19T06:47:30.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:29 smithi012 ceph-mon[30937]: pgmap v225: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 974 op/s 2024-09-19T06:47:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:29 smithi016 ceph-mon[34911]: pgmap v225: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 974 op/s 2024-09-19T06:47:30.811 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 405.0 s, 527.2 tps, lat 49.750 ms stddev 52.297 2024-09-19T06:47:30.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:47:31.170 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:31.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.630+0000 7ff83f501640 1 -- 172.21.15.12:0/1858050100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff838102790 msgr2=0x7ff8381067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.630+0000 7ff83f501640 1 --2- 172.21.15.12:0/1858050100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff838102790 0x7ff8381067e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff828009900 tx=0x7ff82802a410 comp rx=0 tx=0).stop 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.630+0000 7ff83f501640 1 -- 172.21.15.12:0/1858050100 shutdown_connections 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.630+0000 7ff83f501640 1 --2- 172.21.15.12:0/1858050100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff838106f10 0x7ff83810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.630+0000 7ff83f501640 1 --2- 172.21.15.12:0/1858050100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff838102790 0x7ff8381067e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.630+0000 7ff83f501640 1 --2- 172.21.15.12:0/1858050100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838101de0 0x7ff8381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.630+0000 7ff83f501640 1 -- 172.21.15.12:0/1858050100 >> 172.21.15.12:0/1858050100 conn(0x7ff8380fd8c0 msgr2=0x7ff8380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.630+0000 7ff83f501640 1 -- 172.21.15.12:0/1858050100 shutdown_connections 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.630+0000 7ff83f501640 1 -- 172.21.15.12:0/1858050100 wait complete. 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83f501640 1 Processor -- start 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83f501640 1 -- start start 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83f501640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff838101de0 0x7ff838198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83f501640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838102790 0x7ff838198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83f501640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff838106f10 0x7ff83819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83f501640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff838111f70 con 0x7ff838101de0 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83f501640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff838111df0 con 0x7ff838106f10 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83f501640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381120f0 con 0x7ff838102790 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83d29d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff838101de0 0x7ff838198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83d29d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff838101de0 0x7ff838198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50646/0 (socket says 172.21.15.12:50646) 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83d29d640 1 -- 172.21.15.12:0/4051312085 learned_addr learned my addr 172.21.15.12:0/4051312085 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.631+0000 7ff83da9e640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff838106f10 0x7ff83819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff83ca9c640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838102790 0x7ff838198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff83d29d640 1 -- 172.21.15.12:0/4051312085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838102790 msgr2=0x7ff838198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff83d29d640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838102790 0x7ff838198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff83d29d640 1 -- 172.21.15.12:0/4051312085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff838106f10 msgr2=0x7ff83819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff83d29d640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff838106f10 0x7ff83819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff83d29d640 1 -- 172.21.15.12:0/4051312085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83819d4c0 con 0x7ff838101de0 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff83d29d640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff838101de0 0x7ff838198510 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff83400d770 tx=0x7ff83400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff82e7fc640 1 -- 172.21.15.12:0/4051312085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834017070 con 0x7ff838101de0 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff82e7fc640 1 -- 172.21.15.12:0/4051312085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff834005500 con 0x7ff838101de0 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff83f501640 1 -- 172.21.15.12:0/4051312085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83819d7b0 con 0x7ff838101de0 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff82e7fc640 1 -- 172.21.15.12:0/4051312085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834004e00 con 0x7ff838101de0 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.632+0000 7ff83f501640 1 -- 172.21.15.12:0/4051312085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8381a5090 con 0x7ff838101de0 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.634+0000 7ff82e7fc640 1 -- 172.21.15.12:0/4051312085 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff834004fa0 con 0x7ff838101de0 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff8418da740 1 Processor -- start 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff8418da740 1 -- start start 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff8418da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff8418da740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 0x55e5f56dc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff8418da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff8418da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e5f56372e0 con 0x55e5f56dc680 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff8418da740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e5f55dece0 con 0x55e5f56d1dc0 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff8418da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e5f56332a0 con 0x55e5f56d14a0 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff83ca9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff83ca9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50648/0 (socket says 172.21.15.12:50648) 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff83ca9c640 1 -- 172.21.15.12:0/4126139226 learned_addr learned my addr 172.21.15.12:0/4126139226 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff82e7fc640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff8240a33b0 0x7ff8240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.635+0000 7ff83d29d640 1 --2- 172.21.15.12:0/4126139226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 0x55e5f56dc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff83da9e640 1 --2- 172.21.15.12:0/4126139226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff83da9e640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff8240a33b0 0x7ff8240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff83ca9c640 1 -- 172.21.15.12:0/4126139226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 msgr2=0x55e5f56d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff83ca9c640 1 --2- 172.21.15.12:0/4126139226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56d1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff83ca9c640 1 -- 172.21.15.12:0/4126139226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 msgr2=0x55e5f56dc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff83ca9c640 1 --2- 172.21.15.12:0/4126139226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 0x55e5f56dc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff83ca9c640 1 -- 172.21.15.12:0/4126139226 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5f55c3440 con 0x55e5f56dc680 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff83d29d640 1 --2- 172.21.15.12:0/4126139226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 0x55e5f56dc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff82e7fc640 1 -- 172.21.15.12:0/4051312085 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7ff8340cf8a0 con 0x7ff838101de0 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff83ca9c640 1 --2- 172.21.15.12:0/4126139226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dea70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff82802a930 tx=0x7ff828005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c64e5f8d6f3ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff8237fe640 1 -- 172.21.15.12:0/4126139226 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82803f070 con 0x55e5f56dc680 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff8237fe640 1 -- 172.21.15.12:0/4126139226 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff828004030 con 0x55e5f56dc680 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.636+0000 7ff8237fe640 1 -- 172.21.15.12:0/4126139226 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828035070 con 0x55e5f56dc680 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff83da9e640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff8240a33b0 0x7ff8240a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff830009990 tx=0x7ff8300096a0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 -- 172.21.15.12:0/4126139226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 msgr2=0x55e5f56dea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:31.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 --2- 172.21.15.12:0/4126139226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dea70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff82802a930 tx=0x7ff828005e80 comp rx=0 tx=0).stop 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 -- 172.21.15.12:0/4126139226 shutdown_connections 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 --2- 172.21.15.12:0/4126139226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dea70 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 --2- 172.21.15.12:0/4126139226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 0x55e5f56dc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 --2- 172.21.15.12:0/4126139226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 -- 172.21.15.12:0/4126139226 >> 172.21.15.12:0/4126139226 conn(0x55e5f56cda30 msgr2=0x55e5f56cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 -- 172.21.15.12:0/4126139226 shutdown_connections 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 -- 172.21.15.12:0/4126139226 wait complete. 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 -- start start 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.637+0000 7ff8418da740 1 Processor -- start 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff8418da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56dbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff8418da740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 0x55e5f56d92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff8418da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56d9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff8418da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e5f56df250 con 0x55e5f56dc680 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff8418da740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e5f55f2050 con 0x55e5f56d1dc0 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff8418da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e5f56df3d0 con 0x55e5f56d14a0 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff8418da740 10 client.0 _ll_register_callbacks cb 0x55e5f5632160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83da9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56d9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83da9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56d9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50652/0 (socket says 172.21.15.12:50652) 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83da9e640 1 -- 172.21.15.12:0/4185907748 learned_addr learned my addr 172.21.15.12:0/4185907748 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83ca9c640 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 0x55e5f56d92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83d29d640 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56dbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83da9e640 1 -- 172.21.15.12:0/4185907748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 msgr2=0x55e5f56dbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83da9e640 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56dbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83da9e640 1 -- 172.21.15.12:0/4185907748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 msgr2=0x55e5f56d92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83da9e640 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 0x55e5f56d92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83da9e640 1 -- 172.21.15.12:0/4185907748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5f53a83c0 con 0x55e5f56dc680 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.638+0000 7ff83d29d640 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56dbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff83da9e640 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56d9840 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff830005cc0 tx=0x7ff830004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcb503c26d58dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff820ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff820ff9640 1 -- 172.21.15.12:0/4185907748 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83000fd80 con 0x55e5f56dc680 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff820ff9640 1 -- 172.21.15.12:0/4185907748 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7ff83002a480 con 0x55e5f56dc680 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff8418da740 1 -- 172.21.15.12:0/4185907748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff828004030 con 0x55e5f56dc680 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff820ff9640 1 -- 172.21.15.12:0/4185907748 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff83002a680 con 0x55e5f56dc680 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff8418da740 10 client.17427 fetch_fsmap learned FSMap version 40 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff8418da740 1 -- 172.21.15.12:0/4185907748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e5f56eacf0 con 0x55e5f56dc680 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff820ff9640 1 -- 172.21.15.12:0/4185907748 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff828004030 con 0x55e5f56dc680 2024-09-19T06:47:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff820ff9640 1 -- 172.21.15.12:0/4185907748 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7ff83001c040 con 0x55e5f56dc680 2024-09-19T06:47:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff8418da740 10 client.17427 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:47:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.639+0000 7ff8418da740 10 client.17427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.640+0000 7ff8418da740 20 client.17427 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.640+0000 7ff8418da740 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5f56ec200 0x55e5f56ee630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.640+0000 7ff8418da740 4 client.17427 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.640+0000 7ff8418da740 1 -- 172.21.15.12:0/4185907748 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5f5644850 con 0x55e5f56ec200 2024-09-19T06:47:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.640+0000 7ff83d29d640 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5f56ec200 0x55e5f56ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.640+0000 7ff83d29d640 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5f56ec200 0x55e5f56ee630 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71e72387b40058bf server_cookie=7cb5d43c182c1728 in_seq=0 out_seq=0 2024-09-19T06:47:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.640+0000 7ff820ff9640 10 client.17427 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:31.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff820ff9640 1 -- 172.21.15.12:0/4185907748 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5f5644850 con 0x55e5f56ec200 2024-09-19T06:47:31.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff820ff9640 10 client.17427 handle_command_reply: tid=0 2024-09-19T06:47:31.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 client.17427 shutdown 2024-09-19T06:47:31.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 -- 172.21.15.12:0/4185907748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 msgr2=0x55e5f56d9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:31.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56d9840 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff830005cc0 tx=0x7ff830004a40 comp rx=0 tx=0).stop 2024-09-19T06:47:31.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 -- 172.21.15.12:0/4185907748 shutdown_connections 2024-09-19T06:47:31.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5f56ec200 0x55e5f56ee630 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56d9840 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d1dc0 0x55e5f56d92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 --2- 172.21.15.12:0/4185907748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56dbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 -- 172.21.15.12:0/4185907748 >> 172.21.15.12:0/4185907748 conn(0x55e5f56cda30 msgr2=0x55e5f56d3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff820ff9640 0 client.17427 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 -- 172.21.15.12:0/4185907748 shutdown_connections 2024-09-19T06:47:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 1 -- 172.21.15.12:0/4185907748 wait complete. 2024-09-19T06:47:31.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.641+0000 7ff8418da740 20 client.17427 trim_cache size 0 max 16384 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff8418da740 1 Processor -- start 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff8418da740 1 -- start start 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff8418da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff8418da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56d1dc0 0x55e5f56db230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff8418da740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56dc680 0x55e5f56f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff8418da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381adab0 con 0x55e5f56d1dc0 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff8418da740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381af710 con 0x55e5f56dc680 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff8418da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381ae180 con 0x55e5f56d14a0 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83ca9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56d1dc0 0x55e5f56db230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83ca9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56d1dc0 0x55e5f56db230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50660/0 (socket says 172.21.15.12:50660) 2024-09-19T06:47:31.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83ca9c640 1 -- 172.21.15.12:0/2828211702 learned_addr learned my addr 172.21.15.12:0/2828211702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83d29d640 1 --2- 172.21.15.12:0/2828211702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83ca9c640 1 -- 172.21.15.12:0/2828211702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 msgr2=0x55e5f56e84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83da9e640 1 --2- 172.21.15.12:0/2828211702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56dc680 0x55e5f56f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83ca9c640 1 --2- 172.21.15.12:0/2828211702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56e84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83ca9c640 1 -- 172.21.15.12:0/2828211702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56dc680 msgr2=0x55e5f56f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83ca9c640 1 --2- 172.21.15.12:0/2828211702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56dc680 0x55e5f56f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83ca9c640 1 -- 172.21.15.12:0/2828211702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5f56eab00 con 0x55e5f56d1dc0 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.659+0000 7ff83ca9c640 1 --2- 172.21.15.12:0/2828211702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56d1dc0 0x55e5f56db230 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff8280052c0 tx=0x7ff8280052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f74e3e9086ad054 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff822ffd640 1 -- 172.21.15.12:0/2828211702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828035070 con 0x55e5f56d1dc0 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff822ffd640 1 -- 172.21.15.12:0/2828211702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff82804b070 con 0x55e5f56d1dc0 2024-09-19T06:47:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff822ffd640 1 -- 172.21.15.12:0/2828211702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82803f040 con 0x55e5f56d1dc0 2024-09-19T06:47:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff8418da740 1 -- 172.21.15.12:0/2828211702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56d1dc0 msgr2=0x55e5f56db230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff8418da740 1 --2- 172.21.15.12:0/2828211702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56d1dc0 0x55e5f56db230 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff8280052c0 tx=0x7ff8280052f0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff8418da740 1 -- 172.21.15.12:0/2828211702 shutdown_connections 2024-09-19T06:47:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff8418da740 1 --2- 172.21.15.12:0/2828211702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56dc680 0x55e5f56f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff8418da740 1 --2- 172.21.15.12:0/2828211702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56d1dc0 0x55e5f56db230 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff8418da740 1 --2- 172.21.15.12:0/2828211702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d14a0 0x55e5f56e84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff8418da740 1 -- 172.21.15.12:0/2828211702 >> 172.21.15.12:0/2828211702 conn(0x55e5f56cda30 msgr2=0x55e5f56dab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff8418da740 1 -- 172.21.15.12:0/2828211702 shutdown_connections 2024-09-19T06:47:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.660+0000 7ff8418da740 1 -- 172.21.15.12:0/2828211702 wait complete. 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff8418da740 1 -- start start 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff8418da740 1 Processor -- start 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff8418da740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d14a0 0x55e5f56e46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff8418da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d1dc0 0x55e5f56e4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff8418da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff8418da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381aef80 con 0x55e5f56dc680 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff8418da740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381ae8b0 con 0x55e5f56d14a0 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff8418da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8381abab0 con 0x55e5f56d1dc0 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff8418da740 10 client.0 _ll_register_callbacks cb 0x7ff830005bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff83da9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff83da9e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50670/0 (socket says 172.21.15.12:50670) 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.661+0000 7ff83da9e640 1 -- 172.21.15.12:0/3072769017 learned_addr learned my addr 172.21.15.12:0/3072769017 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff83ca9c640 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d1dc0 0x55e5f56e4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff83d29d640 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d14a0 0x55e5f56e46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff83da9e640 1 -- 172.21.15.12:0/3072769017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d1dc0 msgr2=0x55e5f56e4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff83da9e640 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d1dc0 0x55e5f56e4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff83da9e640 1 -- 172.21.15.12:0/3072769017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d14a0 msgr2=0x55e5f56e46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff83da9e640 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d14a0 0x55e5f56e46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff83da9e640 1 -- 172.21.15.12:0/3072769017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5f56e03b0 con 0x55e5f56dc680 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff83d29d640 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d14a0 0x55e5f56e46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff83da9e640 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dfb80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff830000f80 tx=0x7ff83001f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52c693518af4f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff820ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff820ff9640 1 -- 172.21.15.12:0/3072769017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830009c90 con 0x55e5f56dc680 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff820ff9640 1 -- 172.21.15.12:0/3072769017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7ff83000fd90 con 0x55e5f56dc680 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff8418da740 1 -- 172.21.15.12:0/3072769017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff82804b070 con 0x55e5f56dc680 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff820ff9640 1 -- 172.21.15.12:0/3072769017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff83000f7c0 con 0x55e5f56dc680 2024-09-19T06:47:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff8418da740 10 client.17433 fetch_fsmap learned FSMap version 40 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff8418da740 1 -- 172.21.15.12:0/3072769017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e5f5756980 con 0x55e5f56dc680 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.662+0000 7ff820ff9640 1 -- 172.21.15.12:0/3072769017 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff82804b070 con 0x55e5f56dc680 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.663+0000 7ff820ff9640 1 -- 172.21.15.12:0/3072769017 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7ff83001c040 con 0x55e5f56dc680 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.663+0000 7ff8418da740 10 client.17433 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.663+0000 7ff8418da740 10 client.17433 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.663+0000 7ff8418da740 20 client.17433 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.663+0000 7ff8418da740 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5f5757130 0x55e5f5759550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.663+0000 7ff8418da740 4 client.17433 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.663+0000 7ff8418da740 1 -- 172.21.15.12:0/3072769017 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e5f563ed60 con 0x55e5f5757130 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.663+0000 7ff83d29d640 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5f5757130 0x55e5f5759550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:31.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.663+0000 7ff820ff9640 10 client.17433 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.663+0000 7ff83d29d640 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5f5757130 0x55e5f5759550 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e0bab91e84f74b server_cookie=17ff90f3370cdb28 in_seq=0 out_seq=0 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff820ff9640 1 -- 172.21.15.12:0/3072769017 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e5f563ed60 con 0x55e5f5757130 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff820ff9640 10 client.17433 handle_command_reply: tid=0 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 client.17433 shutdown 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 -- 172.21.15.12:0/3072769017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 msgr2=0x55e5f56dfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dfb80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff830000f80 tx=0x7ff83001f9f0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 -- 172.21.15.12:0/3072769017 shutdown_connections 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5f5757130 0x55e5f5759550 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5f56dc680 0x55e5f56dfb80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5f56d1dc0 0x55e5f56e4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 --2- 172.21.15.12:0/3072769017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5f56d14a0 0x55e5f56e46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 -- 172.21.15.12:0/3072769017 >> 172.21.15.12:0/3072769017 conn(0x55e5f56cda30 msgr2=0x55e5f56d7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff820ff9640 0 client.17433 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:31.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 -- 172.21.15.12:0/3072769017 shutdown_connections 2024-09-19T06:47:31.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 1 -- 172.21.15.12:0/3072769017 wait complete. 2024-09-19T06:47:31.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff8418da740 20 client.17433 trim_cache size 0 max 16384 2024-09-19T06:47:31.672 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:47:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:47:31.672 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:47:31.672 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:47:31.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff83f501640 1 -- 172.21.15.12:0/4051312085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff8240a33b0 msgr2=0x7ff8240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:31.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff83f501640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff8240a33b0 0x7ff8240a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff830009990 tx=0x7ff8300096a0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.664+0000 7ff83f501640 1 -- 172.21.15.12:0/4051312085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff838101de0 msgr2=0x7ff838198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:31.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.665+0000 7ff83f501640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff838101de0 0x7ff838198510 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff83400d770 tx=0x7ff83400dc30 comp rx=0 tx=0).stop 2024-09-19T06:47:31.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.665+0000 7ff83f501640 1 -- 172.21.15.12:0/4051312085 shutdown_connections 2024-09-19T06:47:31.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.665+0000 7ff83f501640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff838106f10 0x7ff83819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.665+0000 7ff83f501640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff8240a33b0 0x7ff8240a5870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.665+0000 7ff83f501640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff838102790 0x7ff838198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.665+0000 7ff83f501640 1 --2- 172.21.15.12:0/4051312085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff838101de0 0x7ff838198510 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:31.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.665+0000 7ff83f501640 1 -- 172.21.15.12:0/4051312085 >> 172.21.15.12:0/4051312085 conn(0x7ff8380fd8c0 msgr2=0x7ff8380fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:31.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.665+0000 7ff83f501640 1 -- 172.21.15.12:0/4051312085 shutdown_connections 2024-09-19T06:47:31.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:31.665+0000 7ff83f501640 1 -- 172.21.15.12:0/4051312085 wait complete. 2024-09-19T06:47:32.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:31 smithi173 ceph-mon[35349]: pgmap v226: 97 pgs: 97 active+clean; 4.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 27 MiB/s wr, 1.15k op/s 2024-09-19T06:47:32.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:31 smithi012 ceph-mon[30937]: pgmap v226: 97 pgs: 97 active+clean; 4.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 27 MiB/s wr, 1.15k op/s 2024-09-19T06:47:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:31 smithi016 ceph-mon[34911]: pgmap v226: 97 pgs: 97 active+clean; 4.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 27 MiB/s wr, 1.15k op/s 2024-09-19T06:47:32.495 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:47:32.496 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.428+0000 7fe27852b640 1 -- 172.21.15.12:0/945408096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe270102d30 msgr2=0x7fe270103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.428+0000 7fe27852b640 1 --2- 172.21.15.12:0/945408096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe270102d30 0x7fe270103110 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009930 tx=0x7fe26c02a420 comp rx=0 tx=0).stop 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.428+0000 7fe27852b640 1 -- 172.21.15.12:0/945408096 shutdown_connections 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 --2- 172.21.15.12:0/945408096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2701082a0 0x7fe27010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 --2- 172.21.15.12:0/945408096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2701036e0 0x7fe270107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 --2- 172.21.15.12:0/945408096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe270102d30 0x7fe270103110 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 -- 172.21.15.12:0/945408096 >> 172.21.15.12:0/945408096 conn(0x7fe2700fc7d0 msgr2=0x7fe2700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 -- 172.21.15.12:0/945408096 shutdown_connections 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 -- 172.21.15.12:0/945408096 wait complete. 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 Processor -- start 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 -- start start 2024-09-19T06:47:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe270102d30 0x7fe270100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2701036e0 0x7fe270100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2701082a0 0x7fe270101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe2701120a0 con 0x7fe2701036e0 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe270111f20 con 0x7fe270102d30 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe27852b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe270112220 con 0x7fe2701082a0 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.429+0000 7fe275ac6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2701036e0 0x7fe270100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe275ac6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2701036e0 0x7fe270100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50686/0 (socket says 172.21.15.12:50686) 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe2762c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe270102d30 0x7fe270100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe275ac6640 1 -- 172.21.15.12:0/966885136 learned_addr learned my addr 172.21.15.12:0/966885136 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe276ac8640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2701082a0 0x7fe270101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe275ac6640 1 -- 172.21.15.12:0/966885136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2701082a0 msgr2=0x7fe270101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe275ac6640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2701082a0 0x7fe270101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe275ac6640 1 -- 172.21.15.12:0/966885136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe270102d30 msgr2=0x7fe270100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe275ac6640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe270102d30 0x7fe270100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe275ac6640 1 -- 172.21.15.12:0/966885136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2701a6a80 con 0x7fe2701036e0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe275ac6640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2701036e0 0x7fe270100ed0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe26000d950 tx=0x7fe26000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe2677fe640 1 -- 172.21.15.12:0/966885136 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260017070 con 0x7fe2701036e0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe27852b640 1 -- 172.21.15.12:0/966885136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2701a6d70 con 0x7fe2701036e0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe2677fe640 1 -- 172.21.15.12:0/966885136 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe260009c30 con 0x7fe2701036e0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe2677fe640 1 -- 172.21.15.12:0/966885136 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2600047a0 con 0x7fe2701036e0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.430+0000 7fe27852b640 1 -- 172.21.15.12:0/966885136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2701a7220 con 0x7fe2701036e0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.431+0000 7fe27852b640 1 -- 172.21.15.12:0/966885136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe270103110 con 0x7fe2701036e0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.432+0000 7fe2677fe640 1 -- 172.21.15.12:0/966885136 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe260004020 con 0x7fe2701036e0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.433+0000 7fe2677fe640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe25c0a33b0 0x7fe25c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.433+0000 7fe2762c7640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe25c0a33b0 0x7fe25c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.433+0000 7fe2677fe640 1 -- 172.21.15.12:0/966885136 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fe2600cf9c0 con 0x7fe2701036e0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.434+0000 7fe2762c7640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe25c0a33b0 0x7fe25c0a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009900 tx=0x7fe26c0058d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.438+0000 7fe2677fe640 1 -- 172.21.15.12:0/966885136 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2600d1e20 con 0x7fe2701036e0 2024-09-19T06:47:33.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.650+0000 7fe27852b640 1 -- 172.21.15.12:0/966885136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe27010a2b0 con 0x7fe2701036e0 2024-09-19T06:47:33.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.651+0000 7fe2677fe640 1 -- 172.21.15.12:0/966885136 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11981 (secure 0 0 0) 0x7fe260020020 con 0x7fe2701036e0 2024-09-19T06:47:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:47:33.653 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"btime":"2024-09-19T06:46:29:658066+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:46:29.410528+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:47:33.653 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2024-09-19T06:47:33.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.653+0000 7fe27852b640 1 -- 172.21.15.12:0/966885136 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe25c0a33b0 msgr2=0x7fe25c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.653+0000 7fe27852b640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe25c0a33b0 0x7fe25c0a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009900 tx=0x7fe26c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.653+0000 7fe27852b640 1 -- 172.21.15.12:0/966885136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2701036e0 msgr2=0x7fe270100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.653+0000 7fe27852b640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2701036e0 0x7fe270100ed0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe26000d950 tx=0x7fe26000de10 comp rx=0 tx=0).stop 2024-09-19T06:47:33.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.653+0000 7fe27852b640 1 -- 172.21.15.12:0/966885136 shutdown_connections 2024-09-19T06:47:33.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.653+0000 7fe27852b640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe25c0a33b0 0x7fe25c0a5870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.653+0000 7fe27852b640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2701082a0 0x7fe270101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.653+0000 7fe27852b640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2701036e0 0x7fe270100ed0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.653+0000 7fe27852b640 1 --2- 172.21.15.12:0/966885136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe270102d30 0x7fe270100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.653+0000 7fe27852b640 1 -- 172.21.15.12:0/966885136 >> 172.21.15.12:0/966885136 conn(0x7fe2700fc7d0 msgr2=0x7fe270105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:33.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.654+0000 7fe27852b640 1 -- 172.21.15.12:0/966885136 shutdown_connections 2024-09-19T06:47:33.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:33.654+0000 7fe27852b640 1 -- 172.21.15.12:0/966885136 wait complete. 2024-09-19T06:47:33.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.700+0000 7f0f3a90a640 1 -- 172.21.15.12:0/63653405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f34101350 msgr2=0x7f0f3410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.700+0000 7f0f3a90a640 1 --2- 172.21.15.12:0/63653405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f34101350 0x7f0f3410d880 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009cd0 tx=0x7f0f2c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.700+0000 7f0f3a90a640 1 -- 172.21.15.12:0/63653405 shutdown_connections 2024-09-19T06:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.700+0000 7f0f3a90a640 1 --2- 172.21.15.12:0/63653405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f34101350 0x7f0f3410d880 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.700+0000 7f0f3a90a640 1 --2- 172.21.15.12:0/63653405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f341009b0 0x7f0f34100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.700+0000 7f0f3a90a640 1 --2- 172.21.15.12:0/63653405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f341069c0 0x7f0f34106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.700+0000 7f0f3a90a640 1 -- 172.21.15.12:0/63653405 >> 172.21.15.12:0/63653405 conn(0x7f0f34077990 msgr2=0x7f0f340fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.700+0000 7f0f3a90a640 1 -- 172.21.15.12:0/63653405 shutdown_connections 2024-09-19T06:47:33.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.700+0000 7f0f3a90a640 1 -- 172.21.15.12:0/63653405 wait complete. 2024-09-19T06:47:33.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.701+0000 7f0f3a90a640 1 Processor -- start 2024-09-19T06:47:33.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.701+0000 7f0f3a90a640 1 -- start start 2024-09-19T06:47:33.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.701+0000 7f0f3a90a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f341009b0 0x7f0f341982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.701+0000 7f0f3a90a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f34101350 0x7f0f34198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.701+0000 7f0f3a90a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f341069c0 0x7f0f3419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.704 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.701+0000 7f0f3a90a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f34110e00 con 0x7f0f34101350 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.701+0000 7f0f3a90a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0f34110c80 con 0x7f0f341009b0 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.701+0000 7f0f3a90a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0f34110f80 con 0x7f0f341069c0 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f34101350 0x7f0f34198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f34101350 0x7f0f34198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50712/0 (socket says 172.21.15.12:50712) 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f337fe640 1 -- 172.21.15.12:0/3803122147 learned_addr learned my addr 172.21.15.12:0/3803122147 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f38ea7640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f341069c0 0x7f0f3419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f33fff640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f341009b0 0x7f0f341982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f337fe640 1 -- 172.21.15.12:0/3803122147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f341069c0 msgr2=0x7f0f3419cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f337fe640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f341069c0 0x7f0f3419cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f337fe640 1 -- 172.21.15.12:0/3803122147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f341009b0 msgr2=0x7f0f341982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f337fe640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f341009b0 0x7f0f341982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f337fe640 1 -- 172.21.15.12:0/3803122147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3419d2e0 con 0x7f0f34101350 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f337fe640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f34101350 0x7f0f34198830 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800d950 tx=0x7f0f2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:33.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f317fa640 1 -- 172.21.15.12:0/3803122147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28017070 con 0x7f0f34101350 2024-09-19T06:47:33.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f3a90a640 1 -- 172.21.15.12:0/3803122147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3419d5d0 con 0x7f0f34101350 2024-09-19T06:47:33.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f317fa640 1 -- 172.21.15.12:0/3803122147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f28009c30 con 0x7f0f34101350 2024-09-19T06:47:33.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f3a90a640 1 -- 172.21.15.12:0/3803122147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f341a4e60 con 0x7f0f34101350 2024-09-19T06:47:33.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.702+0000 7f0f317fa640 1 -- 172.21.15.12:0/3803122147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28020060 con 0x7f0f34101350 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f317fa640 1 -- 172.21.15.12:0/3803122147 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0f280109d0 con 0x7f0f34101350 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f3d6a1740 1 Processor -- start 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f3d6a1740 1 -- start start 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39daf0 0x5594ee39ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3a8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 0x5594ee3ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5594ee3022f0 con 0x5594ee39e410 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5594ee2aa270 con 0x5594ee3a8cb0 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5594ee2fe2b0 con 0x5594ee39daf0 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f33fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f33fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3a8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50720/0 (socket says 172.21.15.12:50720) 2024-09-19T06:47:33.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f33fff640 1 -- 172.21.15.12:0/1334083242 learned_addr learned my addr 172.21.15.12:0/1334083242 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f38ea7640 1 --2- 172.21.15.12:0/1334083242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39daf0 0x5594ee39ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f317fa640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f1c0a3460 0x7f0f1c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f337fe640 1 --2- 172.21.15.12:0/1334083242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 0x5594ee3ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f33fff640 1 -- 172.21.15.12:0/1334083242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39daf0 msgr2=0x5594ee39ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f33fff640 1 --2- 172.21.15.12:0/1334083242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39daf0 0x5594ee39ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f33fff640 1 -- 172.21.15.12:0/1334083242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 msgr2=0x5594ee3ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f33fff640 1 --2- 172.21.15.12:0/1334083242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 0x5594ee3ab0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.705+0000 7f0f33fff640 1 -- 172.21.15.12:0/1334083242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594ee2a9340 con 0x5594ee39e410 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.706+0000 7f0f38ea7640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f1c0a3460 0x7f0f1c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.706+0000 7f0f317fa640 1 -- 172.21.15.12:0/3803122147 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f0f280cfa90 con 0x7f0f34101350 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.706+0000 7f0f33fff640 1 --2- 172.21.15.12:0/1334083242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3a8770 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400bc60 tx=0x7f0f2400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9ec6637b6e177f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.706+0000 7f0f1a7fc640 1 -- 172.21.15.12:0/1334083242 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24015070 con 0x5594ee39e410 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.706+0000 7f0f1a7fc640 1 -- 172.21.15.12:0/1334083242 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f24011920 con 0x5594ee39e410 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.706+0000 7f0f1a7fc640 1 -- 172.21.15.12:0/1334083242 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f240108d0 con 0x5594ee39e410 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/1334083242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 msgr2=0x5594ee3a8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f38ea7640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f1c0a3460 0x7f0f1c0a5920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009a60 tx=0x7f0f2c03e040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/1334083242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3a8770 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400bc60 tx=0x7f0f2400f730 comp rx=0 tx=0).stop 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/1334083242 shutdown_connections 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/1334083242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 0x5594ee3ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/1334083242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3a8770 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/1334083242 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39daf0 0x5594ee39ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/1334083242 >> 172.21.15.12:0/1334083242 conn(0x5594ee39a060 msgr2=0x5594ee39a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/1334083242 shutdown_connections 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/1334083242 wait complete. 2024-09-19T06:47:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 -- start start 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.707+0000 7f0f3d6a1740 1 Processor -- start 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39daf0 0x5594ee3a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee39e410 0x5594ee3a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee3a8cb0 0x5594ee3a6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5594ee3ab880 con 0x5594ee3a8cb0 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5594ee28b290 con 0x5594ee39e410 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5594ee3aba00 con 0x5594ee39daf0 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f3d6a1740 10 client.0 _ll_register_callbacks cb 0x5594ee2bc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f38ea7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee3a8cb0 0x5594ee3a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f38ea7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee3a8cb0 0x5594ee3a6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50736/0 (socket says 172.21.15.12:50736) 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f38ea7640 1 -- 172.21.15.12:0/752373616 learned_addr learned my addr 172.21.15.12:0/752373616 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f33fff640 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39daf0 0x5594ee3a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f337fe640 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee39e410 0x5594ee3a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f38ea7640 1 -- 172.21.15.12:0/752373616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39daf0 msgr2=0x5594ee3a5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f38ea7640 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39daf0 0x5594ee3a5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f38ea7640 1 -- 172.21.15.12:0/752373616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee39e410 msgr2=0x5594ee3a60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f38ea7640 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee39e410 0x5594ee3a60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f38ea7640 1 -- 172.21.15.12:0/752373616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594ee015210 con 0x5594ee3a8cb0 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f38ea7640 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee3a8cb0 0x5594ee3a6600 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c035000 tx=0x7f0f2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af31427ed946f69b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f137fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f137fe640 1 -- 172.21.15.12:0/752373616 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0047d0 con 0x5594ee3a8cb0 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f137fe640 1 -- 172.21.15.12:0/752373616 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f0f2c0305a0 con 0x5594ee3a8cb0 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.708+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/752373616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f24011920 con 0x5594ee3a8cb0 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f137fe640 1 -- 172.21.15.12:0/752373616 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0f2c0307e0 con 0x5594ee3a8cb0 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f3d6a1740 10 client.17451 fetch_fsmap learned FSMap version 40 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/752373616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5594ee0e1620 con 0x5594ee3a8cb0 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f137fe640 1 -- 172.21.15.12:0/752373616 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f24011920 con 0x5594ee3a8cb0 2024-09-19T06:47:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f137fe640 1 -- 172.21.15.12:0/752373616 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f0f2c030070 con 0x5594ee3a8cb0 2024-09-19T06:47:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f3d6a1740 10 client.17451 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:47:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f3d6a1740 10 client.17451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f3d6a1740 20 client.17451 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594ee3b8d50 0x5594ee3bb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f3d6a1740 4 client.17451 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/752373616 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594ee30fa20 con 0x5594ee3b8d50 2024-09-19T06:47:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.709+0000 7f0f33fff640 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594ee3b8d50 0x5594ee3bb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.710+0000 7f0f33fff640 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594ee3b8d50 0x5594ee3bb1d0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e28ea0ecf9978609 server_cookie=fd93eb4cfe2e4180 in_seq=0 out_seq=0 2024-09-19T06:47:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.710+0000 7f0f137fe640 10 client.17451 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:33.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.710+0000 7f0f137fe640 1 -- 172.21.15.12:0/752373616 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594ee30fa20 con 0x5594ee3b8d50 2024-09-19T06:47:33.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.710+0000 7f0f137fe640 10 client.17451 handle_command_reply: tid=0 2024-09-19T06:47:33.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.710+0000 7f0f3d6a1740 1 client.17451 shutdown 2024-09-19T06:47:33.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.710+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/752373616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee3a8cb0 msgr2=0x5594ee3a6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.710+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee3a8cb0 0x5594ee3a6600 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c035000 tx=0x7f0f2c004a40 comp rx=0 tx=0).stop 2024-09-19T06:47:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.711+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/752373616 shutdown_connections 2024-09-19T06:47:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.711+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594ee3b8d50 0x5594ee3bb1d0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.711+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee3a8cb0 0x5594ee3a6600 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.711+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee39e410 0x5594ee3a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.711+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/752373616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39daf0 0x5594ee3a5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.711+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/752373616 >> 172.21.15.12:0/752373616 conn(0x5594ee39a060 msgr2=0x5594ee39fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.711+0000 7f0f137fe640 0 client.17451 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.711+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/752373616 shutdown_connections 2024-09-19T06:47:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.711+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/752373616 wait complete. 2024-09-19T06:47:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.711+0000 7f0f3d6a1740 20 client.17451 trim_cache size 0 max 16384 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f3d6a1740 1 Processor -- start 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f3d6a1740 1 -- start start 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39daf0 0x5594ee3a6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39e410 0x5594ee3c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 0x5594ee3c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341adad0 con 0x5594ee39daf0 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341af730 con 0x5594ee3a8cb0 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341ae1a0 con 0x5594ee39e410 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f33fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39daf0 0x5594ee3a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f33fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39daf0 0x5594ee3a6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50738/0 (socket says 172.21.15.12:50738) 2024-09-19T06:47:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f33fff640 1 -- 172.21.15.12:0/4236274396 learned_addr learned my addr 172.21.15.12:0/4236274396 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f38ea7640 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 0x5594ee3c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f337fe640 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39e410 0x5594ee3c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f33fff640 1 -- 172.21.15.12:0/4236274396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39e410 msgr2=0x5594ee3c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f33fff640 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39e410 0x5594ee3c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f33fff640 1 -- 172.21.15.12:0/4236274396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 msgr2=0x5594ee3c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.725+0000 7f0f33fff640 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 0x5594ee3c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f33fff640 1 -- 172.21.15.12:0/4236274396 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594ee39e240 con 0x5594ee39daf0 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f38ea7640 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 0x5594ee3c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f337fe640 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39e410 0x5594ee3c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f33fff640 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39daf0 0x5594ee3a6430 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0f240104e0 tx=0x7f0f24010470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c6938e80ec5cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f19ffb640 1 -- 172.21.15.12:0/4236274396 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24015050 con 0x5594ee39daf0 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f19ffb640 1 -- 172.21.15.12:0/4236274396 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f2402b070 con 0x5594ee39daf0 2024-09-19T06:47:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f19ffb640 1 -- 172.21.15.12:0/4236274396 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24004970 con 0x5594ee39daf0 2024-09-19T06:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/4236274396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39daf0 msgr2=0x5594ee3a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39daf0 0x5594ee3a6430 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0f240104e0 tx=0x7f0f24010470 comp rx=0 tx=0).stop 2024-09-19T06:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/4236274396 shutdown_connections 2024-09-19T06:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee3a8cb0 0x5594ee3c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee39e410 0x5594ee3c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/4236274396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39daf0 0x5594ee3a6430 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.726+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/4236274396 >> 172.21.15.12:0/4236274396 conn(0x5594ee39a060 msgr2=0x5594ee3a4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.727+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/4236274396 shutdown_connections 2024-09-19T06:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.727+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/4236274396 wait complete. 2024-09-19T06:47:33.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.727+0000 7f0f3d6a1740 1 -- start start 2024-09-19T06:47:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.727+0000 7f0f3d6a1740 1 Processor -- start 2024-09-19T06:47:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.727+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee39daf0 0x5594ee3abe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.727+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3ac350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.727+0000 7f0f3d6a1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee3a8cb0 0x5594ee421aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.727+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341aefa0 con 0x5594ee39e410 2024-09-19T06:47:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.727+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341ae8d0 con 0x5594ee39daf0 2024-09-19T06:47:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.727+0000 7f0f3d6a1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341abad0 con 0x5594ee3a8cb0 2024-09-19T06:47:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f3d6a1740 10 client.0 _ll_register_callbacks cb 0x7f0f2c009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3ac350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50752/0 (socket says 172.21.15.12:50752) 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f337fe640 1 -- 172.21.15.12:0/2182672653 learned_addr learned my addr 172.21.15.12:0/2182672653 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f33fff640 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee39daf0 0x5594ee3abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f38ea7640 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee3a8cb0 0x5594ee421aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f337fe640 1 -- 172.21.15.12:0/2182672653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee3a8cb0 msgr2=0x5594ee421aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f337fe640 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee3a8cb0 0x5594ee421aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f337fe640 1 -- 172.21.15.12:0/2182672653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee39daf0 msgr2=0x5594ee3abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f337fe640 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee39daf0 0x5594ee3abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f337fe640 1 -- 172.21.15.12:0/2182672653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594ee421fe0 con 0x5594ee39e410 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f337fe640 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3ac350 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0f2809b9d0 tx=0x7f0f2809c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d56312c5615c52c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f137fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f137fe640 1 -- 172.21.15.12:0/2182672653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f280a0080 con 0x5594ee39e410 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f137fe640 1 -- 172.21.15.12:0/2182672653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f0f2809b120 con 0x5594ee39e410 2024-09-19T06:47:33.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/2182672653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f2402b070 con 0x5594ee39e410 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f137fe640 1 -- 172.21.15.12:0/2182672653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0f280b9020 con 0x5594ee39e410 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f3d6a1740 10 client.17457 fetch_fsmap learned FSMap version 40 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.728+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/2182672653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5594ee423160 con 0x5594ee39e410 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f137fe640 1 -- 172.21.15.12:0/2182672653 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f2402b070 con 0x5594ee39e410 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f137fe640 1 -- 172.21.15.12:0/2182672653 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f0f28010580 con 0x5594ee39e410 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f3d6a1740 10 client.17457 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f3d6a1740 10 client.17457 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f3d6a1740 20 client.17457 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594ee4239a0 0x5594ee425dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f3d6a1740 4 client.17457 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/2182672653 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5594ee309d70 con 0x5594ee4239a0 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f33fff640 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594ee4239a0 0x5594ee425dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f33fff640 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594ee4239a0 0x5594ee425dc0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1737b676b879fcde server_cookie=7e390c912dede047 in_seq=0 out_seq=0 2024-09-19T06:47:33.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.729+0000 7f0f137fe640 10 client.17457 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f137fe640 1 -- 172.21.15.12:0/2182672653 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5594ee309d70 con 0x5594ee4239a0 2024-09-19T06:47:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f137fe640 10 client.17457 handle_command_reply: tid=0 2024-09-19T06:47:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 client.17457 shutdown 2024-09-19T06:47:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/2182672653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 msgr2=0x5594ee3ac350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3ac350 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0f2809b9d0 tx=0x7f0f2809c490 comp rx=0 tx=0).stop 2024-09-19T06:47:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/2182672653 shutdown_connections 2024-09-19T06:47:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5594ee4239a0 0x5594ee425dc0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5594ee3a8cb0 0x5594ee421aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594ee39e410 0x5594ee3ac350 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f137fe640 0 client.17457 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 --2- 172.21.15.12:0/2182672653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5594ee39daf0 0x5594ee3abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/2182672653 >> 172.21.15.12:0/2182672653 conn(0x5594ee39a060 msgr2=0x5594ee3a73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/2182672653 shutdown_connections 2024-09-19T06:47:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 1 -- 172.21.15.12:0/2182672653 wait complete. 2024-09-19T06:47:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.742+0000 7f0f3d6a1740 20 client.17457 trim_cache size 0 max 16384 2024-09-19T06:47:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:47:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:47:33.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:47:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:47:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 -- 172.21.15.12:0/3803122147 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f1c0a3460 msgr2=0x7f0f1c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f1c0a3460 0x7f0f1c0a5920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009a60 tx=0x7f0f2c03e040 comp rx=0 tx=0).stop 2024-09-19T06:47:33.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 -- 172.21.15.12:0/3803122147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f34101350 msgr2=0x7f0f34198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f34101350 0x7f0f34198830 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800d950 tx=0x7f0f2800de10 comp rx=0 tx=0).stop 2024-09-19T06:47:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 -- 172.21.15.12:0/3803122147 shutdown_connections 2024-09-19T06:47:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0f1c0a3460 0x7f0f1c0a5920 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f341069c0 0x7f0f3419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f34101350 0x7f0f34198830 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 --2- 172.21.15.12:0/3803122147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f341009b0 0x7f0f341982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 -- 172.21.15.12:0/3803122147 >> 172.21.15.12:0/3803122147 conn(0x7f0f34077990 msgr2=0x7f0f34069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 -- 172.21.15.12:0/3803122147 shutdown_connections 2024-09-19T06:47:33.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:33.743+0000 7f0f3a90a640 1 -- 172.21.15.12:0/3803122147 wait complete. 2024-09-19T06:47:34.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:33 smithi173 ceph-mon[35349]: pgmap v227: 97 pgs: 97 active+clean; 4.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 599 op/s 2024-09-19T06:47:34.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:33 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/966885136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:34.111 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:33 smithi012 ceph-mon[30937]: pgmap v227: 97 pgs: 97 active+clean; 4.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 599 op/s 2024-09-19T06:47:34.111 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:33 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/966885136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:34.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:33 smithi016 ceph-mon[34911]: pgmap v227: 97 pgs: 97 active+clean; 4.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 599 op/s 2024-09-19T06:47:34.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:33 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/966885136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:34.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:47:34.747 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:35.085 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:34 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:47:35.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:34 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:47:35.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.282+0000 7f4aac564640 1 -- 172.21.15.12:0/2819168333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa4101de0 msgr2=0x7f4aa41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:35.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.282+0000 7f4aac564640 1 --2- 172.21.15.12:0/2819168333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa4101de0 0x7f4aa41021c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009900 tx=0x7f4aa002a410 comp rx=0 tx=0).stop 2024-09-19T06:47:35.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.282+0000 7f4aac564640 1 -- 172.21.15.12:0/2819168333 shutdown_connections 2024-09-19T06:47:35.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.282+0000 7f4aac564640 1 --2- 172.21.15.12:0/2819168333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4aa4106f10 0x7f4aa410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.282+0000 7f4aac564640 1 --2- 172.21.15.12:0/2819168333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa4102790 0x7f4aa41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.282+0000 7f4aac564640 1 --2- 172.21.15.12:0/2819168333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa4101de0 0x7f4aa41021c0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.282+0000 7f4aac564640 1 -- 172.21.15.12:0/2819168333 >> 172.21.15.12:0/2819168333 conn(0x7f4aa40fd8c0 msgr2=0x7f4aa40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.282+0000 7f4aac564640 1 -- 172.21.15.12:0/2819168333 shutdown_connections 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.282+0000 7f4aac564640 1 -- 172.21.15.12:0/2819168333 wait complete. 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.282+0000 7f4aac564640 1 Processor -- start 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aac564640 1 -- start start 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aac564640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4aa4101de0 0x7f4aa4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aac564640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa4102790 0x7f4aa41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aac564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa4106f10 0x7f4aa419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aac564640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa4111f90 con 0x7f4aa4106f10 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aac564640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa4111e10 con 0x7f4aa4102790 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aac564640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa4112110 con 0x7f4aa4101de0 2024-09-19T06:47:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aaab01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa4106f10 0x7f4aa419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aaab01640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa4106f10 0x7f4aa419cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50768/0 (socket says 172.21.15.12:50768) 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aaab01640 1 -- 172.21.15.12:0/2243836508 learned_addr learned my addr 172.21.15.12:0/2243836508 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aaa300640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4aa4101de0 0x7f4aa4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa4102790 0x7f4aa41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aaab01640 1 -- 172.21.15.12:0/2243836508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4aa4101de0 msgr2=0x7f4aa4198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aaab01640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4aa4101de0 0x7f4aa4198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aaab01640 1 -- 172.21.15.12:0/2243836508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa4102790 msgr2=0x7f4aa41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aaab01640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa4102790 0x7f4aa41989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aaab01640 1 -- 172.21.15.12:0/2243836508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa419d440 con 0x7f4aa4106f10 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.283+0000 7f4aaab01640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa4106f10 0x7f4aa419cd60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00b970 tx=0x7f4a9c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.284+0000 7f4a9b7fe640 1 -- 172.21.15.12:0/2243836508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c019070 con 0x7f4aa4106f10 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.284+0000 7f4a9b7fe640 1 -- 172.21.15.12:0/2243836508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a9c00cb40 con 0x7f4aa4106f10 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.284+0000 7f4aac564640 1 -- 172.21.15.12:0/2243836508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa419d730 con 0x7f4aa4106f10 2024-09-19T06:47:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.284+0000 7f4a9b7fe640 1 -- 172.21.15.12:0/2243836508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c007650 con 0x7f4aa4106f10 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.284+0000 7f4aac564640 1 -- 172.21.15.12:0/2243836508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa41a5010 con 0x7f4aa4106f10 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.286+0000 7f4a9b7fe640 1 -- 172.21.15.12:0/2243836508 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4a9c01c070 con 0x7f4aa4106f10 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.286+0000 7f4aae93d740 1 Processor -- start 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.286+0000 7f4aae93d740 1 -- start start 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f82090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f825d0 0x55c1b6f82a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f91780 0x55c1b6f93b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aae93d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c1b6ee82f0 con 0x55c1b6f83b40 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aae93d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c1b6e8fcf0 con 0x55c1b6f825d0 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aae93d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c1b6ee42b0 con 0x55c1b6f91780 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4a9b7fe640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4a900a3430 0x7f4a900a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aa9aff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f82090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aa9aff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f82090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50784/0 (socket says 172.21.15.12:50784) 2024-09-19T06:47:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aa9aff640 1 -- 172.21.15.12:0/1658554403 learned_addr learned my addr 172.21.15.12:0/1658554403 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aaab01640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4a900a3430 0x7f4a900a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aaa300640 1 --2- 172.21.15.12:0/1658554403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f825d0 0x55c1b6f82a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4a9b7fe640 1 -- 172.21.15.12:0/2243836508 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f4a9c0cf230 con 0x7f4aa4106f10 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/1658554403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f91780 0x55c1b6f93b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aa9aff640 1 -- 172.21.15.12:0/1658554403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f91780 msgr2=0x55c1b6f93b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/1658554403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f91780 0x55c1b6f93b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aa9aff640 1 -- 172.21.15.12:0/1658554403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f825d0 msgr2=0x55c1b6f82a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/1658554403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f825d0 0x55c1b6f82a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aa9aff640 1 -- 172.21.15.12:0/1658554403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1b6e743a0 con 0x55c1b6f83b40 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aaa300640 1 --2- 172.21.15.12:0/1658554403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f825d0 0x55c1b6f82a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.287+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/1658554403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f82090 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4a94005d90 tx=0x7f4a9400c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d3059f40e4d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.288+0000 7f4aaab01640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4a900a3430 0x7f4a900a58f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c097a90 tx=0x7f4a9c004b50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.288+0000 7f4a98ff9640 1 -- 172.21.15.12:0/1658554403 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94005220 con 0x55c1b6f83b40 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.288+0000 7f4a98ff9640 1 -- 172.21.15.12:0/1658554403 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a94016030 con 0x55c1b6f83b40 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.288+0000 7f4a98ff9640 1 -- 172.21.15.12:0/1658554403 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a940128c0 con 0x55c1b6f83b40 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.288+0000 7f4aae93d740 1 -- 172.21.15.12:0/1658554403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 msgr2=0x55c1b6f82090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.288+0000 7f4aae93d740 1 --2- 172.21.15.12:0/1658554403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f82090 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4a94005d90 tx=0x7f4a9400c5e0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 -- 172.21.15.12:0/1658554403 shutdown_connections 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 --2- 172.21.15.12:0/1658554403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f91780 0x55c1b6f93b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 --2- 172.21.15.12:0/1658554403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f825d0 0x55c1b6f82a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 --2- 172.21.15.12:0/1658554403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f82090 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 -- 172.21.15.12:0/1658554403 >> 172.21.15.12:0/1658554403 conn(0x55c1b6f4b310 msgr2=0x55c1b6f7ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 -- 172.21.15.12:0/1658554403 shutdown_connections 2024-09-19T06:47:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 -- 172.21.15.12:0/1658554403 wait complete. 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 -- start start 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 Processor -- start 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f825d0 0x55c1b6f91140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f83b40 0x55c1b6f8e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f91780 0x55c1b6f8e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c1b6f94480 con 0x55c1b6f825d0 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c1b6ea3060 con 0x55c1b6f91780 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c1b6f94600 con 0x55c1b6f83b40 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aae93d740 10 client.0 _ll_register_callbacks cb 0x55c1b6bf68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.289+0000 7f4aa9aff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f825d0 0x55c1b6f91140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aa9aff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f825d0 0x55c1b6f91140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50800/0 (socket says 172.21.15.12:50800) 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aa9aff640 1 -- 172.21.15.12:0/550524802 learned_addr learned my addr 172.21.15.12:0/550524802 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f91780 0x55c1b6f8e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aaa300640 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f83b40 0x55c1b6f8e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aa9aff640 1 -- 172.21.15.12:0/550524802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f83b40 msgr2=0x55c1b6f8e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f83b40 0x55c1b6f8e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aa9aff640 1 -- 172.21.15.12:0/550524802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f91780 msgr2=0x55c1b6f8e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f91780 0x55c1b6f8e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aa9aff640 1 -- 172.21.15.12:0/550524802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1b6c593c0 con 0x55c1b6f825d0 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f825d0 0x55c1b6f91140 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400cfd0 tx=0x7f4a94005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d852e783f472e68a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4a8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4a8dffb640 1 -- 172.21.15.12:0/550524802 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94004220 con 0x55c1b6f825d0 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4a8dffb640 1 -- 172.21.15.12:0/550524802 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f4a940043c0 con 0x55c1b6f825d0 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aae93d740 1 -- 172.21.15.12:0/550524802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a94016030 con 0x55c1b6f825d0 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4a8dffb640 1 -- 172.21.15.12:0/550524802 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f4a94032050 con 0x55c1b6f825d0 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aae93d740 10 client.17469 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.290+0000 7f4aae93d740 1 -- 172.21.15.12:0/550524802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c1b6f9fee0 con 0x55c1b6f825d0 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.291+0000 7f4a8dffb640 1 -- 172.21.15.12:0/550524802 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a94016030 con 0x55c1b6f825d0 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.291+0000 7f4a8dffb640 1 -- 172.21.15.12:0/550524802 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f4a94029070 con 0x55c1b6f825d0 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.291+0000 7f4aae93d740 10 client.17469 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.291+0000 7f4aae93d740 10 client.17469 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.291+0000 7f4aae93d740 20 client.17469 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.291+0000 7f4aae93d740 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55c1b6fa1230 0x55c1b6fa3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.291+0000 7f4aae93d740 4 client.17469 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.291+0000 7f4aae93d740 1 -- 172.21.15.12:0/550524802 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1b6ef5860 con 0x55c1b6fa1230 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.291+0000 7f4aaa300640 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55c1b6fa1230 0x55c1b6fa3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4a8dffb640 10 client.17469 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4aaa300640 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55c1b6fa1230 0x55c1b6fa3620 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ac5f97143df3a5c8 server_cookie=b779874f396194df in_seq=0 out_seq=0 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4a8dffb640 1 -- 172.21.15.12:0/550524802 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1b6ef5860 con 0x55c1b6fa1230 2024-09-19T06:47:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4a8dffb640 10 client.17469 handle_command_reply: tid=0 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4aae93d740 1 client.17469 shutdown 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4aae93d740 1 -- 172.21.15.12:0/550524802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f825d0 msgr2=0x55c1b6f91140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4aae93d740 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f825d0 0x55c1b6f91140 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400cfd0 tx=0x7f4a94005610 comp rx=0 tx=0).stop 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4aae93d740 1 -- 172.21.15.12:0/550524802 shutdown_connections 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4aae93d740 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55c1b6fa1230 0x55c1b6fa3620 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4aae93d740 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f91780 0x55c1b6f8e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4aae93d740 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f83b40 0x55c1b6f8e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4a8dffb640 0 client.17469 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.292+0000 7f4aae93d740 1 --2- 172.21.15.12:0/550524802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f825d0 0x55c1b6f91140 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.293+0000 7f4aae93d740 1 -- 172.21.15.12:0/550524802 >> 172.21.15.12:0/550524802 conn(0x55c1b6f4b310 msgr2=0x55c1b6f84960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.293+0000 7f4aae93d740 1 -- 172.21.15.12:0/550524802 shutdown_connections 2024-09-19T06:47:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.293+0000 7f4aae93d740 1 -- 172.21.15.12:0/550524802 wait complete. 2024-09-19T06:47:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.293+0000 7f4aae93d740 20 client.17469 trim_cache size 0 max 16384 2024-09-19T06:47:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aae93d740 1 Processor -- start 2024-09-19T06:47:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aae93d740 1 -- start start 2024-09-19T06:47:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f825d0 0x55c1b6f9d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f7e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f91780 0x55c1b6fa8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aae93d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa41ab9b0 con 0x55c1b6f83b40 2024-09-19T06:47:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aae93d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa41ad580 con 0x55c1b6f825d0 2024-09-19T06:47:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aae93d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa41ac080 con 0x55c1b6f91780 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aaa300640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f7e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aaa300640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f7e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50810/0 (socket says 172.21.15.12:50810) 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.306+0000 7f4aaa300640 1 -- 172.21.15.12:0/3416901986 learned_addr learned my addr 172.21.15.12:0/3416901986 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.307+0000 7f4aaa300640 1 -- 172.21.15.12:0/3416901986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f91780 msgr2=0x55c1b6fa8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.307+0000 7f4aaa300640 1 --2- 172.21.15.12:0/3416901986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f91780 0x55c1b6fa8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.307+0000 7f4aaa300640 1 -- 172.21.15.12:0/3416901986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f825d0 msgr2=0x55c1b6f9d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.307+0000 7f4aaa300640 1 --2- 172.21.15.12:0/3416901986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f825d0 0x55c1b6f9d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.307+0000 7f4aaa300640 1 -- 172.21.15.12:0/3416901986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1b6f7f960 con 0x55c1b6f83b40 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.307+0000 7f4aaa300640 1 --2- 172.21.15.12:0/3416901986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f7e6e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4aa002a930 tx=0x7f4aa00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a69ee77d7b0b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.307+0000 7f4a8ffff640 1 -- 172.21.15.12:0/3416901986 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0049070 con 0x55c1b6f83b40 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.307+0000 7f4a8ffff640 1 -- 172.21.15.12:0/3416901986 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4aa0031a70 con 0x55c1b6f83b40 2024-09-19T06:47:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.307+0000 7f4a8ffff640 1 -- 172.21.15.12:0/3416901986 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0035040 con 0x55c1b6f83b40 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.308+0000 7f4aae93d740 1 -- 172.21.15.12:0/3416901986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 msgr2=0x55c1b6f7e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.308+0000 7f4aae93d740 1 --2- 172.21.15.12:0/3416901986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f7e6e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4aa002a930 tx=0x7f4aa00058d0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.308+0000 7f4aae93d740 1 -- 172.21.15.12:0/3416901986 shutdown_connections 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.308+0000 7f4aae93d740 1 --2- 172.21.15.12:0/3416901986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f91780 0x55c1b6fa8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.308+0000 7f4aae93d740 1 --2- 172.21.15.12:0/3416901986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f7e6e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.308+0000 7f4aae93d740 1 --2- 172.21.15.12:0/3416901986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f825d0 0x55c1b6f9d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.308+0000 7f4aae93d740 1 -- 172.21.15.12:0/3416901986 >> 172.21.15.12:0/3416901986 conn(0x55c1b6f4b310 msgr2=0x55c1b6f8d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.308+0000 7f4aae93d740 1 -- 172.21.15.12:0/3416901986 shutdown_connections 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.308+0000 7f4aae93d740 1 -- 172.21.15.12:0/3416901986 wait complete. 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aae93d740 1 -- start start 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aae93d740 1 Processor -- start 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f825d0 0x55c1b6f95d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f96250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aae93d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f91780 0x55c1b700ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aae93d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa41ace80 con 0x55c1b6f83b40 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aae93d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa41ac7b0 con 0x55c1b6f91780 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aae93d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa41a99b0 con 0x55c1b6f825d0 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aae93d740 10 client.0 _ll_register_callbacks cb 0x7f4a9400cc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aaa300640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f96250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aaa300640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f96250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50812/0 (socket says 172.21.15.12:50812) 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aaa300640 1 -- 172.21.15.12:0/1565375781 learned_addr learned my addr 172.21.15.12:0/1565375781 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f825d0 0x55c1b6f95d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f91780 0x55c1b700ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aaa300640 1 -- 172.21.15.12:0/1565375781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f825d0 msgr2=0x55c1b6f95d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aaa300640 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f825d0 0x55c1b6f95d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aaa300640 1 -- 172.21.15.12:0/1565375781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f91780 msgr2=0x55c1b700ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aaa300640 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f91780 0x55c1b700ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.309+0000 7f4aaa300640 1 -- 172.21.15.12:0/1565375781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1b6f85120 con 0x55c1b6f83b40 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4aaa300640 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f96250 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009230 tx=0x7f4aa0003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4f62b3ce781681 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4a8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4a8dffb640 1 -- 172.21.15.12:0/1565375781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0035050 con 0x55c1b6f83b40 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4a8dffb640 1 -- 172.21.15.12:0/1565375781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f4aa00035f0 con 0x55c1b6f83b40 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4aae93d740 1 -- 172.21.15.12:0/1565375781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa0031a70 con 0x55c1b6f83b40 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4a8dffb640 1 -- 172.21.15.12:0/1565375781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f4aa0049040 con 0x55c1b6f83b40 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4aae93d740 10 client.17475 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4aae93d740 1 -- 172.21.15.12:0/1565375781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c1b700c180 con 0x55c1b6f83b40 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4a8dffb640 1 -- 172.21.15.12:0/1565375781 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4aa0031a70 con 0x55c1b6f83b40 2024-09-19T06:47:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4a8dffb640 1 -- 172.21.15.12:0/1565375781 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f4aa004ece0 con 0x55c1b6f83b40 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4aae93d740 10 client.17475 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4aae93d740 10 client.17475 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4aae93d740 20 client.17475 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.310+0000 7f4aae93d740 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55c1b700c8d0 0x55c1b700ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.311+0000 7f4aae93d740 4 client.17475 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.311+0000 7f4aae93d740 1 -- 172.21.15.12:0/1565375781 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1b6eefd70 con 0x55c1b700c8d0 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.311+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55c1b700c8d0 0x55c1b700ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.311+0000 7f4aa9aff640 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55c1b700c8d0 0x55c1b700ecf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d839e767222a48b4 server_cookie=c442bcc2e1e57186 in_seq=0 out_seq=0 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.311+0000 7f4a8dffb640 10 client.17475 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.311+0000 7f4a8dffb640 1 -- 172.21.15.12:0/1565375781 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1b6eefd70 con 0x55c1b700c8d0 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.311+0000 7f4a8dffb640 10 client.17475 handle_command_reply: tid=0 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.311+0000 7f4aae93d740 1 client.17475 shutdown 2024-09-19T06:47:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.311+0000 7f4aae93d740 1 -- 172.21.15.12:0/1565375781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 msgr2=0x55c1b6f96250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.311+0000 7f4aae93d740 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f96250 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009230 tx=0x7f4aa0003dc0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aae93d740 1 -- 172.21.15.12:0/1565375781 shutdown_connections 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aae93d740 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55c1b700c8d0 0x55c1b700ecf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4a8dffb640 0 client.17475 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aae93d740 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c1b6f91780 0x55c1b700ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aae93d740 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1b6f83b40 0x55c1b6f96250 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aae93d740 1 --2- 172.21.15.12:0/1565375781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c1b6f825d0 0x55c1b6f95d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aae93d740 1 -- 172.21.15.12:0/1565375781 >> 172.21.15.12:0/1565375781 conn(0x55c1b6f4b310 msgr2=0x55c1b6f8d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aae93d740 1 -- 172.21.15.12:0/1565375781 shutdown_connections 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aae93d740 1 -- 172.21.15.12:0/1565375781 wait complete. 2024-09-19T06:47:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aae93d740 20 client.17475 trim_cache size 0 max 16384 2024-09-19T06:47:35.320 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:47:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 -- 172.21.15.12:0/2243836508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4a900a3430 msgr2=0x7f4a900a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4a900a3430 0x7f4a900a58f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c097a90 tx=0x7f4a9c004b50 comp rx=0 tx=0).stop 2024-09-19T06:47:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 -- 172.21.15.12:0/2243836508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa4106f10 msgr2=0x7f4aa419cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:35.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa4106f10 0x7f4aa419cd60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00b970 tx=0x7f4a9c00be30 comp rx=0 tx=0).stop 2024-09-19T06:47:35.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 -- 172.21.15.12:0/2243836508 shutdown_connections 2024-09-19T06:47:35.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa4106f10 0x7f4aa419cd60 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa4102790 0x7f4aa41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4a900a3430 0x7f4a900a58f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 --2- 172.21.15.12:0/2243836508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4aa4101de0 0x7f4aa4198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:35.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 -- 172.21.15.12:0/2243836508 >> 172.21.15.12:0/2243836508 conn(0x7f4aa40fd8c0 msgr2=0x7f4aa40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:35.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 -- 172.21.15.12:0/2243836508 shutdown_connections 2024-09-19T06:47:35.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:35.312+0000 7f4aac564640 1 -- 172.21.15.12:0/2243836508 wait complete. 2024-09-19T06:47:35.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:34 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:47:35.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:47:36.097 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:35 smithi012 ceph-mon[30937]: pgmap v228: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 14 MiB/s wr, 823 op/s 2024-09-19T06:47:36.124 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:47:36.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:35 smithi016 ceph-mon[34911]: pgmap v228: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 14 MiB/s wr, 823 op/s 2024-09-19T06:47:36.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:35 smithi173 ceph-mon[35349]: pgmap v228: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 14 MiB/s wr, 823 op/s 2024-09-19T06:47:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:36.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.809+0000 7fef9504c640 1 -- 172.21.15.12:0/1156622143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef90100a80 msgr2=0x7fef90100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.809+0000 7fef9504c640 1 --2- 172.21.15.12:0/1156622143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef90100a80 0x7fef90100ee0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fef78009930 tx=0x7fef7802a420 comp rx=0 tx=0).stop 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.809+0000 7fef9504c640 1 -- 172.21.15.12:0/1156622143 shutdown_connections 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.809+0000 7fef9504c640 1 --2- 172.21.15.12:0/1156622143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef90101420 0x7fef9010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.809+0000 7fef9504c640 1 --2- 172.21.15.12:0/1156622143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef90100a80 0x7fef90100ee0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.809+0000 7fef9504c640 1 --2- 172.21.15.12:0/1156622143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef90106a80 0x7fef90106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.809+0000 7fef9504c640 1 -- 172.21.15.12:0/1156622143 >> 172.21.15.12:0/1156622143 conn(0x7fef900fc7a0 msgr2=0x7fef900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.809+0000 7fef9504c640 1 -- 172.21.15.12:0/1156622143 shutdown_connections 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.809+0000 7fef9504c640 1 -- 172.21.15.12:0/1156622143 wait complete. 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef9504c640 1 Processor -- start 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef9504c640 1 -- start start 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef9504c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef90100a80 0x7fef90199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef9504c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef90101420 0x7fef901997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef9504c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef90106a80 0x7fef90199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef9504c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fef90110ed0 con 0x7fef90100a80 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef9504c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef90110d50 con 0x7fef90101420 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef9504c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fef90111050 con 0x7fef90106a80 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef8ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef90100a80 0x7fef90199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef8ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef90100a80 0x7fef90199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50834/0 (socket says 172.21.15.12:50834) 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef8ed9d640 1 -- 172.21.15.12:0/4144383279 learned_addr learned my addr 172.21.15.12:0/4144383279 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef8ed9d640 1 -- 172.21.15.12:0/4144383279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef90106a80 msgr2=0x7fef90199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef90106a80 0x7fef90199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef87fff640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef90101420 0x7fef901997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef8ed9d640 1 -- 172.21.15.12:0/4144383279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef90101420 msgr2=0x7fef901997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef90101420 0x7fef901997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.810+0000 7fef8ed9d640 1 -- 172.21.15.12:0/4144383279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef901a4680 con 0x7fef90100a80 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.811+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef90100a80 0x7fef90199280 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fef8000c920 tx=0x7fef8000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.811+0000 7fef8cd99640 1 -- 172.21.15.12:0/4144383279 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80007c70 con 0x7fef90100a80 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.811+0000 7fef9504c640 1 -- 172.21.15.12:0/4144383279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef901a4970 con 0x7fef90100a80 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.811+0000 7fef8cd99640 1 -- 172.21.15.12:0/4144383279 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef80007e10 con 0x7fef90100a80 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.811+0000 7fef8cd99640 1 -- 172.21.15.12:0/4144383279 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80018890 con 0x7fef90100a80 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.811+0000 7fef9504c640 1 -- 172.21.15.12:0/4144383279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef901a4eb0 con 0x7fef90100a80 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.813+0000 7fef8cd99640 1 -- 172.21.15.12:0/4144383279 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fef80018a70 con 0x7fef90100a80 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.813+0000 7fef97425740 1 Processor -- start 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.813+0000 7fef97425740 1 -- start start 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef97425740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5296090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef97425740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52965d0 0x55cfd5296a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef97425740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 0x55cfd52a7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef97425740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cfd51fc2f0 con 0x55cfd5297b40 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef97425740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55cfd51a3cf0 con 0x55cfd52a5780 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef97425740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55cfd51f82b0 con 0x55cfd52965d0 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8cd99640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fef7c0a33b0 0x7fef7c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8f59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5296090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8f59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5296090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50836/0 (socket says 172.21.15.12:50836) 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8f59e640 1 -- 172.21.15.12:0/3095315798 learned_addr learned my addr 172.21.15.12:0/3095315798 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8f59e640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fef7c0a33b0 0x7fef7c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8cd99640 1 -- 172.21.15.12:0/4144383279 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fef800cff40 con 0x7fef90100a80 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/3095315798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52965d0 0x55cfd5296a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef87fff640 1 --2- 172.21.15.12:0/3095315798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 0x55cfd52a7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8f59e640 1 -- 172.21.15.12:0/3095315798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52965d0 msgr2=0x55cfd5296a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:36.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8f59e640 1 --2- 172.21.15.12:0/3095315798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52965d0 0x55cfd5296a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8f59e640 1 -- 172.21.15.12:0/3095315798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 msgr2=0x55cfd52a7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8f59e640 1 --2- 172.21.15.12:0/3095315798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 0x55cfd52a7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef8f59e640 1 -- 172.21.15.12:0/3095315798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfd51883a0 con 0x55cfd5297b40 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.814+0000 7fef87fff640 1 --2- 172.21.15.12:0/3095315798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 0x55cfd52a7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.815+0000 7fef8f59e640 1 --2- 172.21.15.12:0/3095315798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5296090 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fef88013860 tx=0x7fef88013d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9530e1a6a39bd234 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.815+0000 7fef857fa640 1 -- 172.21.15.12:0/3095315798 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef88020070 con 0x55cfd5297b40 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.815+0000 7fef857fa640 1 -- 172.21.15.12:0/3095315798 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8800d8a0 con 0x55cfd5297b40 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.815+0000 7fef857fa640 1 -- 172.21.15.12:0/3095315798 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8800e5c0 con 0x55cfd5297b40 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 -- 172.21.15.12:0/3095315798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 msgr2=0x55cfd5296090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 --2- 172.21.15.12:0/3095315798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5296090 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fef88013860 tx=0x7fef88013d20 comp rx=0 tx=0).stop 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef8f59e640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fef7c0a33b0 0x7fef7c0a5870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef8801d000 tx=0x7fef88019000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:36.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 -- 172.21.15.12:0/3095315798 shutdown_connections 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 --2- 172.21.15.12:0/3095315798 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 0x55cfd52a7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 --2- 172.21.15.12:0/3095315798 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52965d0 0x55cfd5296a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 --2- 172.21.15.12:0/3095315798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5296090 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 -- 172.21.15.12:0/3095315798 >> 172.21.15.12:0/3095315798 conn(0x55cfd525f310 msgr2=0x55cfd5292c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 -- 172.21.15.12:0/3095315798 shutdown_connections 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 -- 172.21.15.12:0/3095315798 wait complete. 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 -- start start 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 Processor -- start 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd5297b40 0x55cfd52a2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.816+0000 7fef97425740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52a5780 0x55cfd52a2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef97425740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cfd52a8480 con 0x55cfd52965d0 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef97425740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55cfd51b7060 con 0x55cfd5297b40 2024-09-19T06:47:36.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef97425740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55cfd52a8600 con 0x55cfd52a5780 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef97425740 10 client.0 _ll_register_callbacks cb 0x55cfd4f0a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef8ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef8ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50842/0 (socket says 172.21.15.12:50842) 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef8ed9d640 1 -- 172.21.15.12:0/3288888060 learned_addr learned my addr 172.21.15.12:0/3288888060 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef87fff640 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd5297b40 0x55cfd52a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef8f59e640 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52a5780 0x55cfd52a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef8ed9d640 1 -- 172.21.15.12:0/3288888060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52a5780 msgr2=0x55cfd52a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52a5780 0x55cfd52a2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef8ed9d640 1 -- 172.21.15.12:0/3288888060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd5297b40 msgr2=0x55cfd52a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd5297b40 0x55cfd52a2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef8ed9d640 1 -- 172.21.15.12:0/3288888060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfd4f6d3c0 con 0x55cfd52965d0 2024-09-19T06:47:36.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef87fff640 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd5297b40 0x55cfd52a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a50a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fef80007590 tx=0x7fef8009c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7d8913ef6f9c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef767fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef767fc640 1 -- 172.21.15.12:0/3288888060 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8000fb30 con 0x55cfd52965d0 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef767fc640 1 -- 172.21.15.12:0/3288888060 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fef800cd870 con 0x55cfd52965d0 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef97425740 1 -- 172.21.15.12:0/3288888060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef8800d8a0 con 0x55cfd52965d0 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef767fc640 1 -- 172.21.15.12:0/3288888060 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fef800987f0 con 0x55cfd52965d0 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef97425740 10 client.17487 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.817+0000 7fef97425740 1 -- 172.21.15.12:0/3288888060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55cfd52b3e10 con 0x55cfd52965d0 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.818+0000 7fef767fc640 1 -- 172.21.15.12:0/3288888060 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8800d8a0 con 0x55cfd52965d0 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.818+0000 7fef767fc640 1 -- 172.21.15.12:0/3288888060 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7fef8009c3e0 con 0x55cfd52965d0 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.818+0000 7fef97425740 10 client.17487 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.818+0000 7fef97425740 10 client.17487 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:47:36.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.818+0000 7fef97425740 20 client.17487 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.818+0000 7fef97425740 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55cfd52b5220 0x55cfd52b7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.818+0000 7fef97425740 4 client.17487 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.818+0000 7fef97425740 1 -- 172.21.15.12:0/3288888060 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfd5209860 con 0x55cfd52b5220 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.818+0000 7fef87fff640 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55cfd52b5220 0x55cfd52b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef87fff640 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55cfd52b5220 0x55cfd52b7610 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=117df3db0231e1e6 server_cookie=8200b3306fe7acc4 in_seq=0 out_seq=0 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef767fc640 10 client.17487 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef767fc640 1 -- 172.21.15.12:0/3288888060 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cfd5209860 con 0x55cfd52b5220 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef767fc640 10 client.17487 handle_command_reply: tid=0 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef97425740 1 client.17487 shutdown 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef97425740 1 -- 172.21.15.12:0/3288888060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 msgr2=0x55cfd52a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef97425740 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a50a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fef80007590 tx=0x7fef8009c9b0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef97425740 1 -- 172.21.15.12:0/3288888060 shutdown_connections 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef97425740 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55cfd52b5220 0x55cfd52b7610 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef97425740 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52a5780 0x55cfd52a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef97425740 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd5297b40 0x55cfd52a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef97425740 1 --2- 172.21.15.12:0/3288888060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a50a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef767fc640 0 client.17487 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:47:36.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.819+0000 7fef97425740 1 -- 172.21.15.12:0/3288888060 >> 172.21.15.12:0/3288888060 conn(0x55cfd525f310 msgr2=0x55cfd5298960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:36.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.820+0000 7fef97425740 1 -- 172.21.15.12:0/3288888060 shutdown_connections 2024-09-19T06:47:36.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.820+0000 7fef97425740 1 -- 172.21.15.12:0/3288888060 wait complete. 2024-09-19T06:47:36.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.820+0000 7fef97425740 20 client.17487 trim_cache size 0 max 16384 2024-09-19T06:47:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.833+0000 7fef97425740 1 Processor -- start 2024-09-19T06:47:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.833+0000 7fef97425740 1 -- start start 2024-09-19T06:47:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.833+0000 7fef97425740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52965d0 0x55cfd52b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.833+0000 7fef97425740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5298820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.833+0000 7fef97425740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52a5780 0x55cfd5298d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.833+0000 7fef97425740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fef901ab970 con 0x55cfd5297b40 2024-09-19T06:47:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.833+0000 7fef97425740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef901ad540 con 0x55cfd52965d0 2024-09-19T06:47:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.833+0000 7fef97425740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fef901ac040 con 0x55cfd52a5780 2024-09-19T06:47:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef87fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5298820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef87fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5298820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50852/0 (socket says 172.21.15.12:50852) 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef87fff640 1 -- 172.21.15.12:0/322149647 learned_addr learned my addr 172.21.15.12:0/322149647 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/322149647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52965d0 0x55cfd52b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef8f59e640 1 --2- 172.21.15.12:0/322149647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52a5780 0x55cfd5298d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef87fff640 1 -- 172.21.15.12:0/322149647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52a5780 msgr2=0x55cfd5298d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef87fff640 1 --2- 172.21.15.12:0/322149647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52a5780 0x55cfd5298d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef87fff640 1 -- 172.21.15.12:0/322149647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52965d0 msgr2=0x55cfd52b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef87fff640 1 --2- 172.21.15.12:0/322149647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52965d0 0x55cfd52b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef87fff640 1 -- 172.21.15.12:0/322149647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfd52a08a0 con 0x55cfd5297b40 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef87fff640 1 --2- 172.21.15.12:0/322149647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5298820 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fef7802a9e0 tx=0x7fef78005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e908eb99ed27a9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef84ff9640 1 -- 172.21.15.12:0/322149647 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78035040 con 0x55cfd5297b40 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef84ff9640 1 -- 172.21.15.12:0/322149647 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef78005520 con 0x55cfd5297b40 2024-09-19T06:47:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.834+0000 7fef84ff9640 1 -- 172.21.15.12:0/322149647 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78031810 con 0x55cfd5297b40 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.835+0000 7fef97425740 1 -- 172.21.15.12:0/322149647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 msgr2=0x55cfd5298820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.835+0000 7fef97425740 1 --2- 172.21.15.12:0/322149647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5298820 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fef7802a9e0 tx=0x7fef78005de0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.835+0000 7fef97425740 1 -- 172.21.15.12:0/322149647 shutdown_connections 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.835+0000 7fef97425740 1 --2- 172.21.15.12:0/322149647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd52a5780 0x55cfd5298d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.835+0000 7fef97425740 1 --2- 172.21.15.12:0/322149647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd5297b40 0x55cfd5298820 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.835+0000 7fef97425740 1 --2- 172.21.15.12:0/322149647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52965d0 0x55cfd52b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.835+0000 7fef97425740 1 -- 172.21.15.12:0/322149647 >> 172.21.15.12:0/322149647 conn(0x55cfd525f310 msgr2=0x55cfd5298110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.835+0000 7fef97425740 1 -- 172.21.15.12:0/322149647 shutdown_connections 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.835+0000 7fef97425740 1 -- 172.21.15.12:0/322149647 wait complete. 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef97425740 1 -- start start 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef97425740 1 Processor -- start 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef97425740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef97425740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd5297b40 0x55cfd52a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef97425740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 0x55cfd52aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef97425740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fef901ace40 con 0x55cfd52965d0 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef97425740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef901ac770 con 0x55cfd52a5780 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef97425740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fef901a9970 con 0x55cfd5297b40 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef97425740 10 client.0 _ll_register_callbacks cb 0x7fef8000cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef8ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef8ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50856/0 (socket says 172.21.15.12:50856) 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef8ed9d640 1 -- 172.21.15.12:0/2229999868 learned_addr learned my addr 172.21.15.12:0/2229999868 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef8f59e640 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 0x55cfd52aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.836+0000 7fef87fff640 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd5297b40 0x55cfd52a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.837+0000 7fef8ed9d640 1 -- 172.21.15.12:0/2229999868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd5297b40 msgr2=0x55cfd52a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.837+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd5297b40 0x55cfd52a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.837+0000 7fef8ed9d640 1 -- 172.21.15.12:0/2229999868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 msgr2=0x55cfd52aa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.837+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 0x55cfd52aa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.837+0000 7fef8ed9d640 1 -- 172.21.15.12:0/2229999868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfd531f070 con 0x55cfd52965d0 2024-09-19T06:47:36.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.837+0000 7fef8ed9d640 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a9750 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fef80098b50 tx=0x7fef8009c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335e19e1807297ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:36.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.837+0000 7fef767fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:36.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.837+0000 7fef767fc640 1 -- 172.21.15.12:0/2229999868 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8009bae0 con 0x55cfd52965d0 2024-09-19T06:47:36.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.837+0000 7fef767fc640 1 -- 172.21.15.12:0/2229999868 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fef800cd870 con 0x55cfd52965d0 2024-09-19T06:47:36.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.837+0000 7fef97425740 1 -- 172.21.15.12:0/2229999868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef78005520 con 0x55cfd52965d0 2024-09-19T06:47:36.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef767fc640 1 -- 172.21.15.12:0/2229999868 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fef800a4960 con 0x55cfd52965d0 2024-09-19T06:47:36.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef97425740 10 client.17493 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:36.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef97425740 1 -- 172.21.15.12:0/2229999868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55cfd5320330 con 0x55cfd52965d0 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef767fc640 1 -- 172.21.15.12:0/2229999868 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef78005520 con 0x55cfd52965d0 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef767fc640 1 -- 172.21.15.12:0/2229999868 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7fef8009b040 con 0x55cfd52965d0 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef97425740 10 client.17493 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef97425740 10 client.17493 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef97425740 20 client.17493 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef97425740 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55cfd53208c0 0x55cfd5322cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef97425740 4 client.17493 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef97425740 1 -- 172.21.15.12:0/2229999868 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cfd5203d70 con 0x55cfd53208c0 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.838+0000 7fef87fff640 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55cfd53208c0 0x55cfd5322cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef87fff640 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55cfd53208c0 0x55cfd5322cb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=307c65eeac1f3779 server_cookie=b70a139710f2b797 in_seq=0 out_seq=0 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef767fc640 10 client.17493 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef767fc640 1 -- 172.21.15.12:0/2229999868 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cfd5203d70 con 0x55cfd53208c0 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef767fc640 10 client.17493 handle_command_reply: tid=0 2024-09-19T06:47:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 client.17493 shutdown 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 -- 172.21.15.12:0/2229999868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 msgr2=0x55cfd52a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a9750 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fef80098b50 tx=0x7fef8009c240 comp rx=0 tx=0).stop 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 -- 172.21.15.12:0/2229999868 shutdown_connections 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55cfd53208c0 0x55cfd5322cb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cfd52a5780 0x55cfd52aa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cfd5297b40 0x55cfd52a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 --2- 172.21.15.12:0/2229999868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cfd52965d0 0x55cfd52a9750 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef767fc640 0 client.17493 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 -- 172.21.15.12:0/2229999868 >> 172.21.15.12:0/2229999868 conn(0x55cfd525f310 msgr2=0x55cfd5298930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 -- 172.21.15.12:0/2229999868 shutdown_connections 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.839+0000 7fef97425740 1 -- 172.21.15.12:0/2229999868 wait complete. 2024-09-19T06:47:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef97425740 20 client.17493 trim_cache size 0 max 16384 2024-09-19T06:47:36.847 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:47:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 -- 172.21.15.12:0/4144383279 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fef7c0a33b0 msgr2=0x7fef7c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fef7c0a33b0 0x7fef7c0a5870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef8801d000 tx=0x7fef88019000 comp rx=0 tx=0).stop 2024-09-19T06:47:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 -- 172.21.15.12:0/4144383279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef90100a80 msgr2=0x7fef90199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef90100a80 0x7fef90199280 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fef8000c920 tx=0x7fef8000cde0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 -- 172.21.15.12:0/4144383279 shutdown_connections 2024-09-19T06:47:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fef7c0a33b0 0x7fef7c0a5870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef90106a80 0x7fef90199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef90101420 0x7fef901997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 --2- 172.21.15.12:0/4144383279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef90100a80 0x7fef90199280 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 -- 172.21.15.12:0/4144383279 >> 172.21.15.12:0/4144383279 conn(0x7fef900fc7a0 msgr2=0x7fef900fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 -- 172.21.15.12:0/4144383279 shutdown_connections 2024-09-19T06:47:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:36.840+0000 7fef9504c640 1 -- 172.21.15.12:0/4144383279 wait complete. 2024-09-19T06:47:37.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:47:38.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:37 smithi012 ceph-mon[30937]: pgmap v229: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 1.58k op/s 2024-09-19T06:47:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:38.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:37 smithi016 ceph-mon[34911]: pgmap v229: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 1.58k op/s 2024-09-19T06:47:38.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:37 smithi173 ceph-mon[35349]: pgmap v229: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 1.58k op/s 2024-09-19T06:47:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.643+0000 7f336946e640 1 -- 172.21.15.12:0/328924182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336410c170 msgr2=0x7f336410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.643+0000 7f336946e640 1 --2- 172.21.15.12:0/328924182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336410c170 0x7f336410e610 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f335c009900 tx=0x7f335c02a480 comp rx=0 tx=0).stop 2024-09-19T06:47:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.643+0000 7f336946e640 1 -- 172.21.15.12:0/328924182 shutdown_connections 2024-09-19T06:47:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.643+0000 7f336946e640 1 --2- 172.21.15.12:0/328924182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336410c170 0x7f336410e610 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.643+0000 7f336946e640 1 --2- 172.21.15.12:0/328924182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3364103660 0x7f336410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.643+0000 7f336946e640 1 --2- 172.21.15.12:0/328924182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364102d40 0x7f3364103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.643+0000 7f336946e640 1 -- 172.21.15.12:0/328924182 >> 172.21.15.12:0/328924182 conn(0x7f33640fc7a0 msgr2=0x7f33640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.643+0000 7f336946e640 1 -- 172.21.15.12:0/328924182 shutdown_connections 2024-09-19T06:47:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.643+0000 7f336946e640 1 -- 172.21.15.12:0/328924182 wait complete. 2024-09-19T06:47:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.643+0000 7f336946e640 1 Processor -- start 2024-09-19T06:47:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f336946e640 1 -- start start 2024-09-19T06:47:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f336946e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3364102d40 0x7f3364198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f336946e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364103660 0x7f3364198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f336946e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336410c170 0x7f336419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f336946e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3364111f70 con 0x7f3364102d40 2024-09-19T06:47:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f336946e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3364111df0 con 0x7f3364103660 2024-09-19T06:47:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f336946e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33641120f0 con 0x7f336410c170 2024-09-19T06:47:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f3362ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3364102d40 0x7f3364198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f3362ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3364102d40 0x7f3364198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50870/0 (socket says 172.21.15.12:50870) 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f3362ffd640 1 -- 172.21.15.12:0/3688088094 learned_addr learned my addr 172.21.15.12:0/3688088094 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f33627fc640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364103660 0x7f3364198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f33637fe640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336410c170 0x7f336419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f3362ffd640 1 -- 172.21.15.12:0/3688088094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336410c170 msgr2=0x7f336419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f3362ffd640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336410c170 0x7f336419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f3362ffd640 1 -- 172.21.15.12:0/3688088094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364103660 msgr2=0x7f3364198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f3362ffd640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364103660 0x7f3364198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f3362ffd640 1 -- 172.21.15.12:0/3688088094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336419d2e0 con 0x7f3364102d40 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.644+0000 7f33637fe640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336410c170 0x7f336419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.645+0000 7f3362ffd640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3364102d40 0x7f3364198330 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f335400eab0 tx=0x7f335400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.645+0000 7f334bfff640 1 -- 172.21.15.12:0/3688088094 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335400ce40 con 0x7f3364102d40 2024-09-19T06:47:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.645+0000 7f334bfff640 1 -- 172.21.15.12:0/3688088094 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3354011950 con 0x7f3364102d40 2024-09-19T06:47:38.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.645+0000 7f336946e640 1 -- 172.21.15.12:0/3688088094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336419d5d0 con 0x7f3364102d40 2024-09-19T06:47:38.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.645+0000 7f334bfff640 1 -- 172.21.15.12:0/3688088094 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354010ae0 con 0x7f3364102d40 2024-09-19T06:47:38.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.645+0000 7f336946e640 1 -- 172.21.15.12:0/3688088094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33641a4eb0 con 0x7f3364102d40 2024-09-19T06:47:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.647+0000 7f334bfff640 1 -- 172.21.15.12:0/3688088094 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3354011b00 con 0x7f3364102d40 2024-09-19T06:47:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.647+0000 7f336b847740 1 Processor -- start 2024-09-19T06:47:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.647+0000 7f336b847740 1 -- start start 2024-09-19T06:47:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f336b847740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591ba0b40 0x562591b9f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f336b847740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591b9f5d0 0x562591b9fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f336b847740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 0x562591bac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f336b847740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562591b052f0 con 0x562591ba0b40 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f336b847740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562591aaccf0 con 0x562591b9f5d0 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f336b847740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562591b012b0 con 0x562591baa370 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33637fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591ba0b40 0x562591b9f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33637fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591ba0b40 0x562591b9f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50882/0 (socket says 172.21.15.12:50882) 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33637fe640 1 -- 172.21.15.12:0/2878891603 learned_addr learned my addr 172.21.15.12:0/2878891603 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f3362ffd640 1 --2- 172.21.15.12:0/2878891603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591b9f5d0 0x562591b9fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33627fc640 1 --2- 172.21.15.12:0/2878891603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 0x562591bac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f334bfff640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f334c0a33b0 0x7f334c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33637fe640 1 -- 172.21.15.12:0/2878891603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 msgr2=0x562591bac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33637fe640 1 --2- 172.21.15.12:0/2878891603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 0x562591bac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33637fe640 1 -- 172.21.15.12:0/2878891603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591b9f5d0 msgr2=0x562591b9fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33637fe640 1 --2- 172.21.15.12:0/2878891603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591b9f5d0 0x562591b9fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33637fe640 1 -- 172.21.15.12:0/2878891603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562591a913a0 con 0x562591ba0b40 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f334bfff640 1 -- 172.21.15.12:0/3688088094 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f33540d04f0 con 0x7f3364102d40 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33637fe640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f334c0a33b0 0x7f334c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.648+0000 7f33637fe640 1 --2- 172.21.15.12:0/2878891603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591ba0b40 0x562591b9f090 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f335c005c40 tx=0x7f335c032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d367b5532f48fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.649+0000 7f33497fa640 1 -- 172.21.15.12:0/2878891603 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c03f040 con 0x562591ba0b40 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.649+0000 7f33497fa640 1 -- 172.21.15.12:0/2878891603 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c005040 con 0x562591ba0b40 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.649+0000 7f33497fa640 1 -- 172.21.15.12:0/2878891603 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c035070 con 0x562591ba0b40 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.649+0000 7f336b847740 1 -- 172.21.15.12:0/2878891603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591ba0b40 msgr2=0x562591b9f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.649+0000 7f33637fe640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f334c0a33b0 0x7f334c0a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f335c032fd0 tx=0x7f335c004d40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.649+0000 7f336b847740 1 --2- 172.21.15.12:0/2878891603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591ba0b40 0x562591b9f090 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f335c005c40 tx=0x7f335c032cb0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 -- 172.21.15.12:0/2878891603 shutdown_connections 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 --2- 172.21.15.12:0/2878891603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 0x562591bac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 --2- 172.21.15.12:0/2878891603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591b9f5d0 0x562591b9fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 --2- 172.21.15.12:0/2878891603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591ba0b40 0x562591b9f090 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 -- 172.21.15.12:0/2878891603 >> 172.21.15.12:0/2878891603 conn(0x562591b68310 msgr2=0x562591b9bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 -- 172.21.15.12:0/2878891603 shutdown_connections 2024-09-19T06:47:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 -- 172.21.15.12:0/2878891603 wait complete. 2024-09-19T06:47:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 -- start start 2024-09-19T06:47:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 Processor -- start 2024-09-19T06:47:38.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591ba0b40 0x562591ba6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.650+0000 7f336b847740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 0x562591ba75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f336b847740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562591bad070 con 0x562591b9f5d0 2024-09-19T06:47:38.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f336b847740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562591ac0060 con 0x562591ba0b40 2024-09-19T06:47:38.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f336b847740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562591bad1f0 con 0x562591baa370 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f336b847740 10 client.0 _ll_register_callbacks cb 0x5625918138c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3362ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3362ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50890/0 (socket says 172.21.15.12:50890) 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3362ffd640 1 -- 172.21.15.12:0/1965615095 learned_addr learned my addr 172.21.15.12:0/1965615095 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f33627fc640 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591ba0b40 0x562591ba6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f33637fe640 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 0x562591ba75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3362ffd640 1 -- 172.21.15.12:0/1965615095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 msgr2=0x562591ba75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3362ffd640 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 0x562591ba75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3362ffd640 1 -- 172.21.15.12:0/1965615095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591ba0b40 msgr2=0x562591ba6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3362ffd640 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591ba0b40 0x562591ba6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3362ffd640 1 -- 172.21.15.12:0/1965615095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625918763c0 con 0x562591b9f5d0 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f33637fe640 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 0x562591ba75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3362ffd640 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba9d30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3354098b30 tx=0x7f335409c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b94fc52564e19e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3346ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3346ff5640 1 -- 172.21.15.12:0/1965615095 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540cdfc0 con 0x562591b9f5d0 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f3346ff5640 1 -- 172.21.15.12:0/1965615095 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f335409c930 con 0x562591b9f5d0 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.651+0000 7f336b847740 1 -- 172.21.15.12:0/1965615095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f335c005040 con 0x562591b9f5d0 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f3346ff5640 1 -- 172.21.15.12:0/1965615095 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f335409c6d0 con 0x562591b9f5d0 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f336b847740 10 client.17505 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f336b847740 1 -- 172.21.15.12:0/1965615095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x562591bb8ad0 con 0x562591b9f5d0 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f3346ff5640 1 -- 172.21.15.12:0/1965615095 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c005040 con 0x562591b9f5d0 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f3346ff5640 1 -- 172.21.15.12:0/1965615095 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f335400f040 con 0x562591b9f5d0 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f336b847740 10 client.17505 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f336b847740 10 client.17505 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f336b847740 20 client.17505 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f336b847740 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x562591bb9f30 0x562591bbc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f336b847740 4 client.17505 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f336b847740 1 -- 172.21.15.12:0/1965615095 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562591b12860 con 0x562591bb9f30 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.652+0000 7f33627fc640 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x562591bb9f30 0x562591bbc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.653+0000 7f33627fc640 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x562591bb9f30 0x562591bbc3b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=103a14f8e985cd46 server_cookie=5e0a4ef0f5618bb9 in_seq=0 out_seq=0 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.653+0000 7f3346ff5640 10 client.17505 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f3346ff5640 1 -- 172.21.15.12:0/1965615095 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562591b12860 con 0x562591bb9f30 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f3346ff5640 10 client.17505 handle_command_reply: tid=0 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 client.17505 shutdown 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 -- 172.21.15.12:0/1965615095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 msgr2=0x562591ba9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba9d30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3354098b30 tx=0x7f335409c2d0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 -- 172.21.15.12:0/1965615095 shutdown_connections 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x562591bb9f30 0x562591bbc3b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f3346ff5640 0 client.17505 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:47:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591baa370 0x562591ba75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591ba0b40 0x562591ba6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 --2- 172.21.15.12:0/1965615095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba9d30 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 -- 172.21.15.12:0/1965615095 >> 172.21.15.12:0/1965615095 conn(0x562591b68310 msgr2=0x562591ba1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:38.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 -- 172.21.15.12:0/1965615095 shutdown_connections 2024-09-19T06:47:38.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 1 -- 172.21.15.12:0/1965615095 wait complete. 2024-09-19T06:47:38.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.654+0000 7f336b847740 20 client.17505 trim_cache size 0 max 16384 2024-09-19T06:47:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.667+0000 7f336b847740 1 Processor -- start 2024-09-19T06:47:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.667+0000 7f336b847740 1 -- start start 2024-09-19T06:47:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.667+0000 7f336b847740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591b9abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.667+0000 7f336b847740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 0x562591ba2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.667+0000 7f336b847740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 0x562591ba2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.667+0000 7f336b847740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33641ada80 con 0x562591b9f5d0 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.667+0000 7f336b847740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33641af650 con 0x562591baa370 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.667+0000 7f336b847740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33641ae150 con 0x562591ba0b40 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3362ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591b9abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3362ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591b9abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50902/0 (socket says 172.21.15.12:50902) 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3362ffd640 1 -- 172.21.15.12:0/1364218869 learned_addr learned my addr 172.21.15.12:0/1364218869 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f33627fc640 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 0x562591ba2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f33637fe640 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 0x562591ba2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3362ffd640 1 -- 172.21.15.12:0/1364218869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 msgr2=0x562591ba2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3362ffd640 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 0x562591ba2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3362ffd640 1 -- 172.21.15.12:0/1364218869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 msgr2=0x562591ba2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3362ffd640 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 0x562591ba2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3362ffd640 1 -- 172.21.15.12:0/1364218869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562591ba03a0 con 0x562591b9f5d0 2024-09-19T06:47:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f33637fe640 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 0x562591ba2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f33627fc640 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 0x562591ba2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3362ffd640 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591b9abf0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f335409c890 tx=0x7f3354011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7658949d89e0b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3348ff9640 1 -- 172.21.15.12:0/1364218869 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540a0a80 con 0x562591b9f5d0 2024-09-19T06:47:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3348ff9640 1 -- 172.21.15.12:0/1364218869 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33540a5340 con 0x562591b9f5d0 2024-09-19T06:47:38.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.668+0000 7f3348ff9640 1 -- 172.21.15.12:0/1364218869 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335409cb30 con 0x562591b9f5d0 2024-09-19T06:47:38.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 -- 172.21.15.12:0/1364218869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 msgr2=0x562591b9abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591b9abf0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f335409c890 tx=0x7f3354011ee0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 -- 172.21.15.12:0/1364218869 shutdown_connections 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 0x562591ba2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 0x562591ba2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 --2- 172.21.15.12:0/1364218869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591b9abf0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 -- 172.21.15.12:0/1364218869 >> 172.21.15.12:0/1364218869 conn(0x562591b68310 msgr2=0x562591b9a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 -- 172.21.15.12:0/1364218869 shutdown_connections 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 -- 172.21.15.12:0/1364218869 wait complete. 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 -- start start 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 Processor -- start 2024-09-19T06:47:38.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.669+0000 7f336b847740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f336b847740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 0x562591ba4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f336b847740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 0x562591ba4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f336b847740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33641aef50 con 0x562591b9f5d0 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f336b847740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33641ae880 con 0x562591baa370 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f336b847740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33641aba80 con 0x562591ba0b40 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f336b847740 10 client.0 _ll_register_callbacks cb 0x7f335409c4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3362ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3362ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50908/0 (socket says 172.21.15.12:50908) 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3362ffd640 1 -- 172.21.15.12:0/3267733309 learned_addr learned my addr 172.21.15.12:0/3267733309 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f33627fc640 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 0x562591ba4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f33637fe640 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 0x562591ba4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3362ffd640 1 -- 172.21.15.12:0/3267733309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 msgr2=0x562591ba4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3362ffd640 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 0x562591ba4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3362ffd640 1 -- 172.21.15.12:0/3267733309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 msgr2=0x562591ba4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3362ffd640 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 0x562591ba4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3362ffd640 1 -- 172.21.15.12:0/3267733309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562591c23c00 con 0x562591b9f5d0 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3362ffd640 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba3f00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f335409c3d0 tx=0x7f335409c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc5260413725e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3346ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3346ff5640 1 -- 172.21.15.12:0/3267733309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540ba030 con 0x562591b9f5d0 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f3346ff5640 1 -- 172.21.15.12:0/3267733309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f3354011470 con 0x562591b9f5d0 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.670+0000 7f336b847740 1 -- 172.21.15.12:0/3267733309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33540a5340 con 0x562591b9f5d0 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f3346ff5640 1 -- 172.21.15.12:0/3267733309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3354098970 con 0x562591b9f5d0 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f336b847740 10 client.17511 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f336b847740 1 -- 172.21.15.12:0/3267733309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x562591c24d50 con 0x562591b9f5d0 2024-09-19T06:47:38.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f3346ff5640 1 -- 172.21.15.12:0/3267733309 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33540a5340 con 0x562591b9f5d0 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f3346ff5640 1 -- 172.21.15.12:0/3267733309 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f33540673a0 con 0x562591b9f5d0 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f336b847740 10 client.17511 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f336b847740 10 client.17511 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f336b847740 20 client.17511 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f336b847740 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x562591bb9f30 0x562591c271c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f336b847740 4 client.17511 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f336b847740 1 -- 172.21.15.12:0/3267733309 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562591b0cd70 con 0x562591bb9f30 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.671+0000 7f33627fc640 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x562591bb9f30 0x562591c271c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f3346ff5640 10 client.17511 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f33627fc640 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x562591bb9f30 0x562591c271c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ea36cf49c0055e8 server_cookie=7a8bdce87e7a9aa7 in_seq=0 out_seq=0 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f3346ff5640 1 -- 172.21.15.12:0/3267733309 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562591b0cd70 con 0x562591bb9f30 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f3346ff5640 10 client.17511 handle_command_reply: tid=0 2024-09-19T06:47:38.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 client.17511 shutdown 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 -- 172.21.15.12:0/3267733309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 msgr2=0x562591ba3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba3f00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f335409c3d0 tx=0x7f335409c2d0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 -- 172.21.15.12:0/3267733309 shutdown_connections 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x562591bb9f30 0x562591c271c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562591baa370 0x562591ba4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562591ba0b40 0x562591ba4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f3346ff5640 0 client.17511 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 --2- 172.21.15.12:0/3267733309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562591b9f5d0 0x562591ba3f00 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 -- 172.21.15.12:0/3267733309 >> 172.21.15.12:0/3267733309 conn(0x562591b68310 msgr2=0x562591b9ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 -- 172.21.15.12:0/3267733309 shutdown_connections 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 1 -- 172.21.15.12:0/3267733309 wait complete. 2024-09-19T06:47:38.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.672+0000 7f336b847740 20 client.17511 trim_cache size 0 max 16384 2024-09-19T06:47:38.680 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:47:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 -- 172.21.15.12:0/3688088094 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f334c0a33b0 msgr2=0x7f334c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f334c0a33b0 0x7f334c0a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f335c032fd0 tx=0x7f335c004d40 comp rx=0 tx=0).stop 2024-09-19T06:47:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 -- 172.21.15.12:0/3688088094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3364102d40 msgr2=0x7f3364198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3364102d40 0x7f3364198330 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f335400eab0 tx=0x7f335400ef70 comp rx=0 tx=0).stop 2024-09-19T06:47:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 -- 172.21.15.12:0/3688088094 shutdown_connections 2024-09-19T06:47:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f334c0a33b0 0x7f334c0a5870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f336410c170 0x7f336419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364103660 0x7f3364198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 --2- 172.21.15.12:0/3688088094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3364102d40 0x7f3364198330 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 -- 172.21.15.12:0/3688088094 >> 172.21.15.12:0/3688088094 conn(0x7f33640fc7a0 msgr2=0x7f33640fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 -- 172.21.15.12:0/3688088094 shutdown_connections 2024-09-19T06:47:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:38.673+0000 7f336946e640 1 -- 172.21.15.12:0/3688088094 wait complete. 2024-09-19T06:47:39.454 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:47:39.711 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:40.101 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:39 smithi012 ceph-mon[30937]: pgmap v230: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2024-09-19T06:47:40.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:39 smithi173 ceph-mon[35349]: pgmap v230: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2024-09-19T06:47:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.183+0000 7fc77f615640 1 -- 172.21.15.12:0/3134797151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc778102d40 msgr2=0x7fc778103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.183+0000 7fc77f615640 1 --2- 172.21.15.12:0/3134797151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc778102d40 0x7fc778103120 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc774009900 tx=0x7fc77402a480 comp rx=0 tx=0).stop 2024-09-19T06:47:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.183+0000 7fc77f615640 1 -- 172.21.15.12:0/3134797151 shutdown_connections 2024-09-19T06:47:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.183+0000 7fc77f615640 1 --2- 172.21.15.12:0/3134797151 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc77810c170 0x7fc77810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.183+0000 7fc77f615640 1 --2- 172.21.15.12:0/3134797151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc778103660 0x7fc77810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.183+0000 7fc77f615640 1 --2- 172.21.15.12:0/3134797151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc778102d40 0x7fc778103120 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.183+0000 7fc77f615640 1 -- 172.21.15.12:0/3134797151 >> 172.21.15.12:0/3134797151 conn(0x7fc7780fc7a0 msgr2=0x7fc7780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.184+0000 7fc77f615640 1 -- 172.21.15.12:0/3134797151 shutdown_connections 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.184+0000 7fc77f615640 1 -- 172.21.15.12:0/3134797151 wait complete. 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.184+0000 7fc77f615640 1 Processor -- start 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.184+0000 7fc77f615640 1 -- start start 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.184+0000 7fc77f615640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc778102d40 0x7fc7781984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.184+0000 7fc77f615640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc778103660 0x7fc7781989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77f615640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc77810c170 0x7fc77819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77f615640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc778112000 con 0x7fc77810c170 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77f615640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc778111e80 con 0x7fc778102d40 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77f615640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc778112180 con 0x7fc778103660 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77dbb2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc77810c170 0x7fc77819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77dbb2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc77810c170 0x7fc77819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50926/0 (socket says 172.21.15.12:50926) 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77dbb2640 1 -- 172.21.15.12:0/2213220835 learned_addr learned my addr 172.21.15.12:0/2213220835 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc778102d40 0x7fc7781984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc778103660 0x7fc7781989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77dbb2640 1 -- 172.21.15.12:0/2213220835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc778103660 msgr2=0x7fc7781989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77dbb2640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc778103660 0x7fc7781989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77dbb2640 1 -- 172.21.15.12:0/2213220835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc778102d40 msgr2=0x7fc7781984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77dbb2640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc778102d40 0x7fc7781984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77dbb2640 1 -- 172.21.15.12:0/2213220835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77819d450 con 0x7fc77810c170 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77dbb2640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc77810c170 0x7fc77819cd70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc77000cce0 tx=0x7fc77000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc76e7fc640 1 -- 172.21.15.12:0/2213220835 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77000f450 con 0x7fc77810c170 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc76e7fc640 1 -- 172.21.15.12:0/2213220835 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc77000fad0 con 0x7fc77810c170 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77f615640 1 -- 172.21.15.12:0/2213220835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77819d740 con 0x7fc77810c170 2024-09-19T06:47:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc76e7fc640 1 -- 172.21.15.12:0/2213220835 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc770018c10 con 0x7fc77810c170 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.185+0000 7fc77f615640 1 -- 172.21.15.12:0/2213220835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7781a5020 con 0x7fc77810c170 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc76e7fc640 1 -- 172.21.15.12:0/2213220835 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc77000f5f0 con 0x7fc77810c170 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc7819ee740 1 Processor -- start 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc7819ee740 1 -- start start 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af54a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af54aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 0x5577af557760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc7819ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5577af4b02f0 con 0x5577af54a5d0 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc7819ee740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5577af457cf0 con 0x5577af555370 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc7819ee740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5577af4ac2b0 con 0x5577af54bb40 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc77d3b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af54aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc77d3b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af54aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50932/0 (socket says 172.21.15.12:50932) 2024-09-19T06:47:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.188+0000 7fc77d3b1640 1 -- 172.21.15.12:0/1901100099 learned_addr learned my addr 172.21.15.12:0/1901100099 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc76e7fc640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7640a3430 0x7fc7640a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/1901100099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af54a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/1901100099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 0x5577af557760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77dbb2640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7640a3430 0x7fc7640a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77d3b1640 1 -- 172.21.15.12:0/1901100099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 msgr2=0x5577af54a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/1901100099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af54a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77d3b1640 1 -- 172.21.15.12:0/1901100099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 msgr2=0x5577af557760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc76e7fc640 1 -- 172.21.15.12:0/2213220835 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fc7700d0360 con 0x7fc77810c170 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/1901100099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 0x5577af557760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77d3b1640 1 -- 172.21.15.12:0/1901100099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577af43c3a0 con 0x5577af54a5d0 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/1901100099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 0x5577af557760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/1901100099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af54aa10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc774009230 tx=0x7fc774004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8c98f13ceba086 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc77dbb2640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7640a3430 0x7fc7640a58f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc7700ce010 tx=0x7fc77006c1c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc7637fe640 1 -- 172.21.15.12:0/1901100099 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc774040070 con 0x5577af54a5d0 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc7637fe640 1 -- 172.21.15.12:0/1901100099 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7740047a0 con 0x5577af54a5d0 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.189+0000 7fc7637fe640 1 -- 172.21.15.12:0/1901100099 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc774035040 con 0x5577af54a5d0 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.190+0000 7fc7819ee740 1 -- 172.21.15.12:0/1901100099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 msgr2=0x5577af54aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.190+0000 7fc7819ee740 1 --2- 172.21.15.12:0/1901100099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af54aa10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc774009230 tx=0x7fc774004310 comp rx=0 tx=0).stop 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.190+0000 7fc7819ee740 1 -- 172.21.15.12:0/1901100099 shutdown_connections 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.190+0000 7fc7819ee740 1 --2- 172.21.15.12:0/1901100099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 0x5577af557760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.190+0000 7fc7819ee740 1 --2- 172.21.15.12:0/1901100099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af54aa10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.190+0000 7fc7819ee740 1 --2- 172.21.15.12:0/1901100099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af54a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.190+0000 7fc7819ee740 1 -- 172.21.15.12:0/1901100099 >> 172.21.15.12:0/1901100099 conn(0x5577af513310 msgr2=0x5577af546c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.190+0000 7fc7819ee740 1 -- 172.21.15.12:0/1901100099 shutdown_connections 2024-09-19T06:47:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.190+0000 7fc7819ee740 1 -- 172.21.15.12:0/1901100099 wait complete. 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.190+0000 7fc7819ee740 1 -- start start 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc7819ee740 1 Processor -- start 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54a5d0 0x5577af554d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af552030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af555370 0x5577af552640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc7819ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5577af558010 con 0x5577af555370 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc7819ee740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5577af46b060 con 0x5577af54a5d0 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc7819ee740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5577af558190 con 0x5577af54bb40 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc7819ee740 10 client.0 _ll_register_callbacks cb 0x5577af1be8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc77cbb0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af555370 0x5577af552640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc77cbb0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af555370 0x5577af552640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50946/0 (socket says 172.21.15.12:50946) 2024-09-19T06:47:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc77cbb0640 1 -- 172.21.15.12:0/1209223568 learned_addr learned my addr 172.21.15.12:0/1209223568 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54a5d0 0x5577af554d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af552030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc77cbb0640 1 -- 172.21.15.12:0/1209223568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 msgr2=0x5577af552030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af552030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc77cbb0640 1 -- 172.21.15.12:0/1209223568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54a5d0 msgr2=0x5577af554d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54a5d0 0x5577af554d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.191+0000 7fc77cbb0640 1 -- 172.21.15.12:0/1209223568 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577af2213c0 con 0x5577af555370 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af555370 0x5577af552640 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc76801aae0 tx=0x7fc7680047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b047900f93a616 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc760ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc760ff9640 1 -- 172.21.15.12:0/1209223568 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76801a110 con 0x5577af555370 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc7819ee740 1 -- 172.21.15.12:0/1209223568 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7740047a0 con 0x5577af555370 2024-09-19T06:47:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc760ff9640 1 -- 172.21.15.12:0/1209223568 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fc768013c30 con 0x5577af555370 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc760ff9640 1 -- 172.21.15.12:0/1209223568 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc768029050 con 0x5577af555370 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc7819ee740 10 client.17523 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc7819ee740 1 -- 172.21.15.12:0/1209223568 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5577af563b90 con 0x5577af555370 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc760ff9640 1 -- 172.21.15.12:0/1209223568 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7740047a0 con 0x5577af555370 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc760ff9640 1 -- 172.21.15.12:0/1209223568 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7fc768018cc0 con 0x5577af555370 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc7819ee740 10 client.17523 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc7819ee740 10 client.17523 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.192+0000 7fc7819ee740 20 client.17523 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.193+0000 7fc7819ee740 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5577af564fa0 0x5577af5673d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.193+0000 7fc7819ee740 4 client.17523 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.193+0000 7fc7819ee740 1 -- 172.21.15.12:0/1209223568 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577af4bd860 con 0x5577af564fa0 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.193+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5577af564fa0 0x5577af5673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.193+0000 7fc760ff9640 10 client.17523 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:47:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.193+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5577af564fa0 0x5577af5673d0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d1a6b040e66acb8 server_cookie=62b5f2d923deeb39 in_seq=0 out_seq=0 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc760ff9640 1 -- 172.21.15.12:0/1209223568 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577af4bd860 con 0x5577af564fa0 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc760ff9640 10 client.17523 handle_command_reply: tid=0 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc7819ee740 1 client.17523 shutdown 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc7819ee740 1 -- 172.21.15.12:0/1209223568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af555370 msgr2=0x5577af552640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc7819ee740 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af555370 0x5577af552640 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc76801aae0 tx=0x7fc7680047d0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc7819ee740 1 -- 172.21.15.12:0/1209223568 shutdown_connections 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc7819ee740 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5577af564fa0 0x5577af5673d0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc7819ee740 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af555370 0x5577af552640 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc7819ee740 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af552030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc7819ee740 1 --2- 172.21.15.12:0/1209223568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54a5d0 0x5577af554d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc760ff9640 0 client.17523 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.194+0000 7fc7819ee740 1 -- 172.21.15.12:0/1209223568 >> 172.21.15.12:0/1209223568 conn(0x5577af513310 msgr2=0x5577af54c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.195+0000 7fc7819ee740 1 -- 172.21.15.12:0/1209223568 shutdown_connections 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.195+0000 7fc7819ee740 1 -- 172.21.15.12:0/1209223568 wait complete. 2024-09-19T06:47:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.195+0000 7fc7819ee740 20 client.17523 trim_cache size 0 max 16384 2024-09-19T06:47:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.208+0000 7fc7819ee740 1 Processor -- start 2024-09-19T06:47:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.208+0000 7fc7819ee740 1 -- start start 2024-09-19T06:47:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.208+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af553fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.208+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af54d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.208+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 0x5577af54d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.208+0000 7fc7819ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc7781adb10 con 0x5577af54a5d0 2024-09-19T06:47:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.208+0000 7fc7819ee740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc7781af6e0 con 0x5577af555370 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.208+0000 7fc7819ee740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc7781ae1e0 con 0x5577af54bb40 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77cbb0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af553fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77cbb0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af553fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50956/0 (socket says 172.21.15.12:50956) 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77cbb0640 1 -- 172.21.15.12:0/318717604 learned_addr learned my addr 172.21.15.12:0/318717604 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/318717604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af54d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/318717604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 0x5577af54d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77cbb0640 1 -- 172.21.15.12:0/318717604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 msgr2=0x5577af54d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/318717604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af54d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77cbb0640 1 -- 172.21.15.12:0/318717604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 msgr2=0x5577af54d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/318717604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 0x5577af54d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77cbb0640 1 -- 172.21.15.12:0/318717604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577af567a50 con 0x5577af54a5d0 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/318717604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af553fa0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc76801d040 tx=0x7fc768009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdc69b077cc8ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc762ffd640 1 -- 172.21.15.12:0/318717604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768013e30 con 0x5577af54a5d0 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc762ffd640 1 -- 172.21.15.12:0/318717604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc768033070 con 0x5577af54a5d0 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.209+0000 7fc762ffd640 1 -- 172.21.15.12:0/318717604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768018450 con 0x5577af54a5d0 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.210+0000 7fc7819ee740 1 -- 172.21.15.12:0/318717604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 msgr2=0x5577af553fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.210+0000 7fc7819ee740 1 --2- 172.21.15.12:0/318717604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af553fa0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc76801d040 tx=0x7fc768009a50 comp rx=0 tx=0).stop 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.210+0000 7fc7819ee740 1 -- 172.21.15.12:0/318717604 shutdown_connections 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.210+0000 7fc7819ee740 1 --2- 172.21.15.12:0/318717604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af555370 0x5577af54d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.210+0000 7fc7819ee740 1 --2- 172.21.15.12:0/318717604 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af54bb40 0x5577af54d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.210+0000 7fc7819ee740 1 --2- 172.21.15.12:0/318717604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af553fa0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.210+0000 7fc7819ee740 1 -- 172.21.15.12:0/318717604 >> 172.21.15.12:0/318717604 conn(0x5577af513310 msgr2=0x5577af553890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.210+0000 7fc7819ee740 1 -- 172.21.15.12:0/318717604 shutdown_connections 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.210+0000 7fc7819ee740 1 -- 172.21.15.12:0/318717604 wait complete. 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc7819ee740 1 -- start start 2024-09-19T06:47:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc7819ee740 1 Processor -- start 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af55da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54bb40 0x5577af54ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc7819ee740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af555370 0x5577af54f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc7819ee740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc7781aefe0 con 0x5577af54a5d0 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc7819ee740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc7781ae910 con 0x5577af54bb40 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc7819ee740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc7781abb10 con 0x5577af555370 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc7819ee740 10 client.0 _ll_register_callbacks cb 0x7fc768009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc77cbb0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af55da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc77cbb0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af55da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50960/0 (socket says 172.21.15.12:50960) 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.211+0000 7fc77cbb0640 1 -- 172.21.15.12:0/748265709 learned_addr learned my addr 172.21.15.12:0/748265709 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc77cbb0640 1 -- 172.21.15.12:0/748265709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af555370 msgr2=0x5577af54f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af555370 0x5577af54f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc77cbb0640 1 -- 172.21.15.12:0/748265709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54bb40 msgr2=0x5577af54ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54bb40 0x5577af54ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54bb40 0x5577af54ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc77cbb0640 1 -- 172.21.15.12:0/748265709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577af54f940 con 0x5577af54a5d0 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54bb40 0x5577af54ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc77cbb0640 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af55da60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc768004700 tx=0x7fc768009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f74a1470659636 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc760ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc760ff9640 1 -- 172.21.15.12:0/748265709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76803b070 con 0x5577af54a5d0 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc760ff9640 1 -- 172.21.15.12:0/748265709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fc768013e30 con 0x5577af54a5d0 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc7819ee740 1 -- 172.21.15.12:0/748265709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc768033070 con 0x5577af54a5d0 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc760ff9640 1 -- 172.21.15.12:0/748265709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc768047050 con 0x5577af54a5d0 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc7819ee740 10 client.17529 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc7819ee740 1 -- 172.21.15.12:0/748265709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5577af5cfba0 con 0x5577af54a5d0 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc760ff9640 1 -- 172.21.15.12:0/748265709 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc768033070 con 0x5577af54a5d0 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.212+0000 7fc760ff9640 1 -- 172.21.15.12:0/748265709 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7fc768018a20 con 0x5577af54a5d0 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc7819ee740 10 client.17529 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc7819ee740 10 client.17529 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc7819ee740 20 client.17529 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc7819ee740 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5577af5d0240 0x5577af5d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc7819ee740 4 client.17529 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc7819ee740 1 -- 172.21.15.12:0/748265709 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577af4b7d70 con 0x5577af5d0240 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5577af5d0240 0x5577af5d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc760ff9640 10 client.17529 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc77d3b1640 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5577af5d0240 0x5577af5d2660 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f610d09ebba17980 server_cookie=e0e4f19aa9d39efb in_seq=0 out_seq=0 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc760ff9640 1 -- 172.21.15.12:0/748265709 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577af4b7d70 con 0x5577af5d0240 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc760ff9640 10 client.17529 handle_command_reply: tid=0 2024-09-19T06:47:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.213+0000 7fc7819ee740 1 client.17529 shutdown 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 1 -- 172.21.15.12:0/748265709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 msgr2=0x5577af55da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af55da60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc768004700 tx=0x7fc768009eb0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 1 -- 172.21.15.12:0/748265709 shutdown_connections 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5577af5d0240 0x5577af5d2660 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5577af555370 0x5577af54f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5577af54bb40 0x5577af54ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 1 --2- 172.21.15.12:0/748265709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577af54a5d0 0x5577af55da60 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 1 -- 172.21.15.12:0/748265709 >> 172.21.15.12:0/748265709 conn(0x5577af513310 msgr2=0x5577af5602a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc760ff9640 0 client.17529 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 1 -- 172.21.15.12:0/748265709 shutdown_connections 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 1 -- 172.21.15.12:0/748265709 wait complete. 2024-09-19T06:47:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc7819ee740 20 client.17529 trim_cache size 0 max 16384 2024-09-19T06:47:40.223 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:47:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc77f615640 1 -- 172.21.15.12:0/2213220835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7640a3430 msgr2=0x7fc7640a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc77f615640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7640a3430 0x7fc7640a58f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc7700ce010 tx=0x7fc77006c1c0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc77f615640 1 -- 172.21.15.12:0/2213220835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc77810c170 msgr2=0x7fc77819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc77f615640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc77810c170 0x7fc77819cd70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc77000cce0 tx=0x7fc77000a620 comp rx=0 tx=0).stop 2024-09-19T06:47:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc77f615640 1 -- 172.21.15.12:0/2213220835 shutdown_connections 2024-09-19T06:47:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc77f615640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc77810c170 0x7fc77819cd70 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc77f615640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7640a3430 0x7fc7640a58f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc77f615640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc778103660 0x7fc7781989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc77f615640 1 --2- 172.21.15.12:0/2213220835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc778102d40 0x7fc7781984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.214+0000 7fc77f615640 1 -- 172.21.15.12:0/2213220835 >> 172.21.15.12:0/2213220835 conn(0x7fc7780fc7a0 msgr2=0x7fc7780fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.215+0000 7fc77f615640 1 -- 172.21.15.12:0/2213220835 shutdown_connections 2024-09-19T06:47:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:40.215+0000 7fc77f615640 1 -- 172.21.15.12:0/2213220835 wait complete. 2024-09-19T06:47:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:39 smithi016 ceph-mon[34911]: pgmap v230: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2024-09-19T06:47:40.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 415.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:47:40.837 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:47:41.097 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.559+0000 7f363283a640 1 -- 172.21.15.12:0/1872637389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c102da0 msgr2=0x7f362c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.559+0000 7f363283a640 1 --2- 172.21.15.12:0/1872637389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c102da0 0x7f362c103180 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f361c009900 tx=0x7f361c02a480 comp rx=0 tx=0).stop 2024-09-19T06:47:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.559+0000 7f363283a640 1 -- 172.21.15.12:0/1872637389 shutdown_connections 2024-09-19T06:47:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.559+0000 7f363283a640 1 --2- 172.21.15.12:0/1872637389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f362c10c180 0x7f362c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.559+0000 7f363283a640 1 --2- 172.21.15.12:0/1872637389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f362c1036c0 0x7f362c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.559+0000 7f363283a640 1 --2- 172.21.15.12:0/1872637389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c102da0 0x7f362c103180 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.559+0000 7f363283a640 1 -- 172.21.15.12:0/1872637389 >> 172.21.15.12:0/1872637389 conn(0x7f362c0fc7a0 msgr2=0x7f362c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.559+0000 7f363283a640 1 -- 172.21.15.12:0/1872637389 shutdown_connections 2024-09-19T06:47:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.559+0000 7f363283a640 1 -- 172.21.15.12:0/1872637389 wait complete. 2024-09-19T06:47:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f363283a640 1 Processor -- start 2024-09-19T06:47:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f363283a640 1 -- start start 2024-09-19T06:47:41.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f363283a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c102da0 0x7f362c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f363283a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f362c1036c0 0x7f362c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f363283a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f362c10c180 0x7f362c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f363283a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f362c111f60 con 0x7f362c102da0 2024-09-19T06:47:41.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f363283a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f362c111de0 con 0x7f362c10c180 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f363283a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f362c1120e0 con 0x7f362c1036c0 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f362bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c102da0 0x7f362c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f362bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c102da0 0x7f362c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41556/0 (socket says 172.21.15.12:41556) 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.560+0000 7f362bfff640 1 -- 172.21.15.12:0/2343626783 learned_addr learned my addr 172.21.15.12:0/2343626783 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f362b7fe640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f362c1036c0 0x7f362c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f3630dd7640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f362c10c180 0x7f362c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f362bfff640 1 -- 172.21.15.12:0/2343626783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f362c1036c0 msgr2=0x7f362c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f362bfff640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f362c1036c0 0x7f362c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f362bfff640 1 -- 172.21.15.12:0/2343626783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f362c10c180 msgr2=0x7f362c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f362bfff640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f362c10c180 0x7f362c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f362bfff640 1 -- 172.21.15.12:0/2343626783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c19d3b0 con 0x7f362c102da0 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f362bfff640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c102da0 0x7f362c198400 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f361c006010 tx=0x7f361c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f36297fa640 1 -- 172.21.15.12:0/2343626783 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c03f030 con 0x7f362c102da0 2024-09-19T06:47:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f363283a640 1 -- 172.21.15.12:0/2343626783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f362c19d640 con 0x7f362c102da0 2024-09-19T06:47:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f36297fa640 1 -- 172.21.15.12:0/2343626783 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f361c003ce0 con 0x7f362c102da0 2024-09-19T06:47:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f36297fa640 1 -- 172.21.15.12:0/2343626783 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c035070 con 0x7f362c102da0 2024-09-19T06:47:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.561+0000 7f363283a640 1 -- 172.21.15.12:0/2343626783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f362c1a4f80 con 0x7f362c102da0 2024-09-19T06:47:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.564+0000 7f36297fa640 1 -- 172.21.15.12:0/2343626783 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f361c042030 con 0x7f362c102da0 2024-09-19T06:47:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.564+0000 7f3634c13740 1 Processor -- start 2024-09-19T06:47:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.564+0000 7f3634c13740 1 -- start start 2024-09-19T06:47:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.564+0000 7f3634c13740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f934090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.564+0000 7f3634c13740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f9345d0 0x56072f934a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3634c13740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f93f370 0x56072f941760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3634c13740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56072f89a2f0 con 0x56072f9345d0 2024-09-19T06:47:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3634c13740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56072f841cf0 con 0x56072f935b40 2024-09-19T06:47:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3634c13740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56072f8962b0 con 0x56072f93f370 2024-09-19T06:47:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f362bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f9345d0 0x56072f934a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3630dd7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f934090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f362bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f9345d0 0x56072f934a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41558/0 (socket says 172.21.15.12:41558) 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f362bfff640 1 -- 172.21.15.12:0/616422691 learned_addr learned my addr 172.21.15.12:0/616422691 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f36297fa640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36140a33b0 0x7f36140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f362b7fe640 1 --2- 172.21.15.12:0/616422691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f93f370 0x56072f941760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3630dd7640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36140a33b0 0x7f36140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3630dd7640 1 -- 172.21.15.12:0/616422691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f93f370 msgr2=0x56072f941760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3630dd7640 1 --2- 172.21.15.12:0/616422691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f93f370 0x56072f941760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3630dd7640 1 -- 172.21.15.12:0/616422691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f9345d0 msgr2=0x56072f934a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3630dd7640 1 --2- 172.21.15.12:0/616422691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f9345d0 0x56072f934a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f36297fa640 1 -- 172.21.15.12:0/2343626783 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f361c0f0180 con 0x7f362c102da0 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.565+0000 7f3630dd7640 1 -- 172.21.15.12:0/616422691 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072f8263a0 con 0x56072f935b40 2024-09-19T06:47:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.566+0000 7f3630dd7640 1 --2- 172.21.15.12:0/616422691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f934090 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f36240149a0 tx=0x7f3624014e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cefae92c39e714c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.566+0000 7f3630dd7640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36140a33b0 0x7f36140a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f362401c000 tx=0x7f362401e000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.566+0000 7f36127fc640 1 -- 172.21.15.12:0/616422691 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624023070 con 0x56072f935b40 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.566+0000 7f36127fc640 1 -- 172.21.15.12:0/616422691 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3624014030 con 0x56072f935b40 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.566+0000 7f36127fc640 1 -- 172.21.15.12:0/616422691 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36240138e0 con 0x56072f935b40 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.566+0000 7f3634c13740 1 -- 172.21.15.12:0/616422691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 msgr2=0x56072f934090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.566+0000 7f3634c13740 1 --2- 172.21.15.12:0/616422691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f934090 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f36240149a0 tx=0x7f3624014e60 comp rx=0 tx=0).stop 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 -- 172.21.15.12:0/616422691 shutdown_connections 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 --2- 172.21.15.12:0/616422691 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f93f370 0x56072f941760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 --2- 172.21.15.12:0/616422691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f9345d0 0x56072f934a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 --2- 172.21.15.12:0/616422691 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f934090 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 -- 172.21.15.12:0/616422691 >> 172.21.15.12:0/616422691 conn(0x56072f8fd310 msgr2=0x56072f930c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 -- 172.21.15.12:0/616422691 shutdown_connections 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 -- 172.21.15.12:0/616422691 wait complete. 2024-09-19T06:47:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 -- start start 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 Processor -- start 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f9345d0 0x56072f93ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f935b40 0x56072f93c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f93c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56072f942070 con 0x56072f93f370 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56072f855060 con 0x56072f9345d0 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.567+0000 7f3634c13740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56072f9421f0 con 0x56072f935b40 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3634c13740 10 client.0 _ll_register_callbacks cb 0x56072f5a88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3630dd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f93c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3630dd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f93c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41572/0 (socket says 172.21.15.12:41572) 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3630dd7640 1 -- 172.21.15.12:0/2761189572 learned_addr learned my addr 172.21.15.12:0/2761189572 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f362bfff640 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f9345d0 0x56072f93ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f362b7fe640 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f935b40 0x56072f93c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3630dd7640 1 -- 172.21.15.12:0/2761189572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f935b40 msgr2=0x56072f93c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3630dd7640 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f935b40 0x56072f93c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3630dd7640 1 -- 172.21.15.12:0/2761189572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f9345d0 msgr2=0x56072f93ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3630dd7640 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f9345d0 0x56072f93ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3630dd7640 1 -- 172.21.15.12:0/2761189572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072f60b3c0 con 0x56072f93f370 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3630dd7640 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f93c5d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f362400ed10 tx=0x7f3624009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aba1d2f56be1813 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f360b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f360b7fe640 1 -- 172.21.15.12:0/2761189572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624023040 con 0x56072f93f370 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f360b7fe640 1 -- 172.21.15.12:0/2761189572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f3624012c90 con 0x56072f93f370 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.568+0000 7f3634c13740 1 -- 172.21.15.12:0/2761189572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3624014030 con 0x56072f93f370 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f360b7fe640 1 -- 172.21.15.12:0/2761189572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3624012e90 con 0x56072f93f370 2024-09-19T06:47:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f3634c13740 10 client.17541 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f3634c13740 1 -- 172.21.15.12:0/2761189572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56072f94daf0 con 0x56072f93f370 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f360b7fe640 1 -- 172.21.15.12:0/2761189572 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3624014030 con 0x56072f93f370 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f360b7fe640 1 -- 172.21.15.12:0/2761189572 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f3624030070 con 0x56072f93f370 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f3634c13740 10 client.17541 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f3634c13740 10 client.17541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f3634c13740 20 client.17541 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f3634c13740 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56072f94ef50 0x56072f951340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f3634c13740 4 client.17541 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f3634c13740 1 -- 172.21.15.12:0/2761189572 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56072f8a7860 con 0x56072f94ef50 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.569+0000 7f362bfff640 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56072f94ef50 0x56072f951340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.570+0000 7f362bfff640 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56072f94ef50 0x56072f951340 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d491b54c0208064 server_cookie=6ffb02e2d10ab9ba in_seq=0 out_seq=0 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.570+0000 7f360b7fe640 10 client.17541 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f360b7fe640 1 -- 172.21.15.12:0/2761189572 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56072f8a7860 con 0x56072f94ef50 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f360b7fe640 10 client.17541 handle_command_reply: tid=0 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 client.17541 shutdown 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 -- 172.21.15.12:0/2761189572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 msgr2=0x56072f93c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f93c5d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f362400ed10 tx=0x7f3624009670 comp rx=0 tx=0).stop 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 -- 172.21.15.12:0/2761189572 shutdown_connections 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56072f94ef50 0x56072f951340 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f93c5d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f935b40 0x56072f93c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f360b7fe640 0 client.17541 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 --2- 172.21.15.12:0/2761189572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f9345d0 0x56072f93ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 -- 172.21.15.12:0/2761189572 >> 172.21.15.12:0/2761189572 conn(0x56072f8fd310 msgr2=0x56072f936930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 -- 172.21.15.12:0/2761189572 shutdown_connections 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 1 -- 172.21.15.12:0/2761189572 wait complete. 2024-09-19T06:47:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.571+0000 7f3634c13740 20 client.17541 trim_cache size 0 max 16384 2024-09-19T06:47:41.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.584+0000 7f3634c13740 1 Processor -- start 2024-09-19T06:47:41.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.584+0000 7f3634c13740 1 -- start start 2024-09-19T06:47:41.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.584+0000 7f3634c13740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f9345d0 0x56072f94b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.584+0000 7f3634c13740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f93df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.584+0000 7f3634c13740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f956b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.584+0000 7f3634c13740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f362c1adb70 con 0x56072f93f370 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.584+0000 7f3634c13740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f362c1af740 con 0x56072f935b40 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.584+0000 7f3634c13740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f362c1ae240 con 0x56072f9345d0 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3630dd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f956b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3630dd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f956b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41588/0 (socket says 172.21.15.12:41588) 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f362b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f93df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3630dd7640 1 -- 172.21.15.12:0/1367029416 learned_addr learned my addr 172.21.15.12:0/1367029416 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f362bfff640 1 --2- 172.21.15.12:0/1367029416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f9345d0 0x56072f94b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3630dd7640 1 -- 172.21.15.12:0/1367029416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f9345d0 msgr2=0x56072f94b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3630dd7640 1 --2- 172.21.15.12:0/1367029416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f9345d0 0x56072f94b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3630dd7640 1 -- 172.21.15.12:0/1367029416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 msgr2=0x56072f93df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3630dd7640 1 --2- 172.21.15.12:0/1367029416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f93df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3630dd7640 1 -- 172.21.15.12:0/1367029416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072f93a550 con 0x56072f93f370 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3630dd7640 1 --2- 172.21.15.12:0/1367029416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f956b10 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f3624006010 tx=0x7f362400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd6620aa827d0be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3611ffb640 1 -- 172.21.15.12:0/1367029416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36240277f0 con 0x56072f93f370 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3611ffb640 1 -- 172.21.15.12:0/1367029416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3624003e50 con 0x56072f93f370 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.585+0000 7f3611ffb640 1 -- 172.21.15.12:0/1367029416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624027ba0 con 0x56072f93f370 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.586+0000 7f3634c13740 1 -- 172.21.15.12:0/1367029416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 msgr2=0x56072f956b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.586+0000 7f3634c13740 1 --2- 172.21.15.12:0/1367029416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f956b10 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f3624006010 tx=0x7f362400ef70 comp rx=0 tx=0).stop 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.586+0000 7f3634c13740 1 -- 172.21.15.12:0/1367029416 shutdown_connections 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.586+0000 7f3634c13740 1 --2- 172.21.15.12:0/1367029416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f956b10 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.586+0000 7f3634c13740 1 --2- 172.21.15.12:0/1367029416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f93df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.586+0000 7f3634c13740 1 --2- 172.21.15.12:0/1367029416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f9345d0 0x56072f94b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.586+0000 7f3634c13740 1 -- 172.21.15.12:0/1367029416 >> 172.21.15.12:0/1367029416 conn(0x56072f8fd310 msgr2=0x56072f93d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.586+0000 7f3634c13740 1 -- 172.21.15.12:0/1367029416 shutdown_connections 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.586+0000 7f3634c13740 1 -- 172.21.15.12:0/1367029416 wait complete. 2024-09-19T06:47:41.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.586+0000 7f3634c13740 1 -- start start 2024-09-19T06:47:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3634c13740 1 Processor -- start 2024-09-19T06:47:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3634c13740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f9345d0 0x56072f943d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3634c13740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f944290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3634c13740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f9b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3634c13740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f362c1af040 con 0x56072f93f370 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3634c13740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f362c1ae970 con 0x56072f935b40 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3634c13740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f362c1abb70 con 0x56072f9345d0 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3634c13740 10 client.0 _ll_register_callbacks cb 0x7f3624021070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3630dd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f9b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3630dd7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f9b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41596/0 (socket says 172.21.15.12:41596) 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3630dd7640 1 -- 172.21.15.12:0/1703246982 learned_addr learned my addr 172.21.15.12:0/1703246982 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f362b7fe640 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f944290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f362bfff640 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f9345d0 0x56072f943d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3630dd7640 1 -- 172.21.15.12:0/1703246982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f9345d0 msgr2=0x56072f943d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3630dd7640 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f9345d0 0x56072f943d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3630dd7640 1 -- 172.21.15.12:0/1703246982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 msgr2=0x56072f944290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3630dd7640 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f944290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f3630dd7640 1 -- 172.21.15.12:0/1703246982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072f9b2160 con 0x56072f93f370 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.587+0000 7f362b7fe640 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f944290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f3630dd7640 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f9b1aa0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f36240149a0 tx=0x7f3624009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816642a93bae1020 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f360b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f360b7fe640 1 -- 172.21.15.12:0/1703246982 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624012c90 con 0x56072f93f370 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f360b7fe640 1 -- 172.21.15.12:0/1703246982 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f3624012e30 con 0x56072f93f370 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f3634c13740 1 -- 172.21.15.12:0/1703246982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3624003e50 con 0x56072f93f370 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f360b7fe640 1 -- 172.21.15.12:0/1703246982 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3624003970 con 0x56072f93f370 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f3634c13740 10 client.17547 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f3634c13740 1 -- 172.21.15.12:0/1703246982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56072f9ba660 con 0x56072f93f370 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f360b7fe640 1 -- 172.21.15.12:0/1703246982 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3624003e50 con 0x56072f93f370 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f360b7fe640 1 -- 172.21.15.12:0/1703246982 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f3624049030 con 0x56072f93f370 2024-09-19T06:47:41.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f3634c13740 10 client.17547 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f3634c13740 10 client.17547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f3634c13740 20 client.17547 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f3634c13740 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56072f9bab80 0x56072f9bcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f3634c13740 4 client.17547 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.588+0000 7f3634c13740 1 -- 172.21.15.12:0/1703246982 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56072f8a1d70 con 0x56072f9bab80 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.589+0000 7f362bfff640 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56072f9bab80 0x56072f9bcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.589+0000 7f362bfff640 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56072f9bab80 0x56072f9bcf70 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1800df68e293a9a0 server_cookie=886318c7225555f7 in_seq=0 out_seq=0 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.589+0000 7f360b7fe640 10 client.17547 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.589+0000 7f360b7fe640 1 -- 172.21.15.12:0/1703246982 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56072f8a1d70 con 0x56072f9bab80 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.589+0000 7f360b7fe640 10 client.17547 handle_command_reply: tid=0 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.589+0000 7f3634c13740 1 client.17547 shutdown 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 1 -- 172.21.15.12:0/1703246982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 msgr2=0x56072f9b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f9b1aa0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f36240149a0 tx=0x7f3624009430 comp rx=0 tx=0).stop 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 1 -- 172.21.15.12:0/1703246982 shutdown_connections 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56072f9bab80 0x56072f9bcf70 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56072f93f370 0x56072f9b1aa0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f360b7fe640 0 client.17547 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56072f935b40 0x56072f944290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 1 --2- 172.21.15.12:0/1703246982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56072f9345d0 0x56072f943d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 1 -- 172.21.15.12:0/1703246982 >> 172.21.15.12:0/1703246982 conn(0x56072f8fd310 msgr2=0x56072f93e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 1 -- 172.21.15.12:0/1703246982 shutdown_connections 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 1 -- 172.21.15.12:0/1703246982 wait complete. 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.590+0000 7f3634c13740 20 client.17547 trim_cache size 0 max 16384 2024-09-19T06:47:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:47:41.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 -- 172.21.15.12:0/2343626783 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36140a33b0 msgr2=0x7f36140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36140a33b0 0x7f36140a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f362401c000 tx=0x7f362401e000 comp rx=0 tx=0).stop 2024-09-19T06:47:41.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 -- 172.21.15.12:0/2343626783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c102da0 msgr2=0x7f362c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c102da0 0x7f362c198400 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f361c006010 tx=0x7f361c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 -- 172.21.15.12:0/2343626783 shutdown_connections 2024-09-19T06:47:41.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f362c10c180 0x7f362c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36140a33b0 0x7f36140a5870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f362c1036c0 0x7f362c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 --2- 172.21.15.12:0/2343626783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c102da0 0x7f362c198400 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 -- 172.21.15.12:0/2343626783 >> 172.21.15.12:0/2343626783 conn(0x7f362c0fc7a0 msgr2=0x7f362c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:41.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 -- 172.21.15.12:0/2343626783 shutdown_connections 2024-09-19T06:47:41.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:41.591+0000 7f363283a640 1 -- 172.21.15.12:0/2343626783 wait complete. 2024-09-19T06:47:42.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:41 smithi012 ceph-mon[30937]: pgmap v231: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 1.31k op/s 2024-09-19T06:47:42.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:41 smithi016 ceph-mon[34911]: pgmap v231: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 1.31k op/s 2024-09-19T06:47:42.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:41 smithi173 ceph-mon[35349]: pgmap v231: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 1.31k op/s 2024-09-19T06:47:43.414 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:47:43.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:44.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:43 smithi012 ceph-mon[30937]: pgmap v232: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-19T06:47:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:43 smithi016 ceph-mon[34911]: pgmap v232: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.283+0000 7f7e57d5b640 1 -- 172.21.15.12:0/2955185077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e50101de0 msgr2=0x7f7e501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.283+0000 7f7e57d5b640 1 --2- 172.21.15.12:0/2955185077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e50101de0 0x7f7e501021c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009900 tx=0x7f7e4c02a410 comp rx=0 tx=0).stop 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.283+0000 7f7e57d5b640 1 -- 172.21.15.12:0/2955185077 shutdown_connections 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.283+0000 7f7e57d5b640 1 --2- 172.21.15.12:0/2955185077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e50106f10 0x7f7e5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.283+0000 7f7e57d5b640 1 --2- 172.21.15.12:0/2955185077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e50102790 0x7f7e501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.283+0000 7f7e57d5b640 1 --2- 172.21.15.12:0/2955185077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e50101de0 0x7f7e501021c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.283+0000 7f7e57d5b640 1 -- 172.21.15.12:0/2955185077 >> 172.21.15.12:0/2955185077 conn(0x7f7e500fd8c0 msgr2=0x7f7e500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.283+0000 7f7e57d5b640 1 -- 172.21.15.12:0/2955185077 shutdown_connections 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.283+0000 7f7e57d5b640 1 -- 172.21.15.12:0/2955185077 wait complete. 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e57d5b640 1 Processor -- start 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e57d5b640 1 -- start start 2024-09-19T06:47:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e57d5b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e50101de0 0x7f7e50198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e57d5b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e50102790 0x7f7e50198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e57d5b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e50106f10 0x7f7e5019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e57d5b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e50111f70 con 0x7f7e50102790 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e57d5b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7e50111df0 con 0x7f7e50101de0 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e57d5b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7e501120f0 con 0x7f7e50106f10 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e552f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e50102790 0x7f7e50198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e552f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e50102790 0x7f7e50198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41620/0 (socket says 172.21.15.12:41620) 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e552f6640 1 -- 172.21.15.12:0/3595026294 learned_addr learned my addr 172.21.15.12:0/3595026294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.284+0000 7f7e55af7640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e50101de0 0x7f7e50198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e552f6640 1 -- 172.21.15.12:0/3595026294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e50106f10 msgr2=0x7f7e5019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e552f6640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e50106f10 0x7f7e5019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e552f6640 1 -- 172.21.15.12:0/3595026294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e50101de0 msgr2=0x7f7e50198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e552f6640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e50101de0 0x7f7e50198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e552f6640 1 -- 172.21.15.12:0/3595026294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5019d3d0 con 0x7f7e50102790 2024-09-19T06:47:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e55af7640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e50101de0 0x7f7e50198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e552f6640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e50102790 0x7f7e50198960 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000e9f0 tx=0x7f7e4000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e46ffd640 1 -- 172.21.15.12:0/3595026294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000cd80 con 0x7f7e50102790 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e46ffd640 1 -- 172.21.15.12:0/3595026294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e40010910 con 0x7f7e50102790 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e57d5b640 1 -- 172.21.15.12:0/3595026294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5019d6c0 con 0x7f7e50102790 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e46ffd640 1 -- 172.21.15.12:0/3595026294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40018990 con 0x7f7e50102790 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.285+0000 7f7e57d5b640 1 -- 172.21.15.12:0/3595026294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e501a4fa0 con 0x7f7e50102790 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.288+0000 7f7e46ffd640 1 -- 172.21.15.12:0/3595026294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7e40010ac0 con 0x7f7e50102790 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.288+0000 7f7e5a134740 1 Processor -- start 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e5a134740 1 -- start start 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 0x55f56cd8ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd8f480 0x55f56cd99800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd99d40 0x55f56cd9c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e5a134740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f56ccf4280 con 0x55f56cd99d40 2024-09-19T06:47:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e5a134740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f56cc9bb10 con 0x55f56cd8f480 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e5a134740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f56ccf0240 con 0x55f56cd8eb60 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e552f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd99d40 0x55f56cd9c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e552f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd99d40 0x55f56cd9c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41636/0 (socket says 172.21.15.12:41636) 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e552f6640 1 -- 172.21.15.12:0/54997694 learned_addr learned my addr 172.21.15.12:0/54997694 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e46ffd640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e3c0a33b0 0x7f7e3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e55af7640 1 --2- 172.21.15.12:0/54997694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd8f480 0x55f56cd99800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e562f8640 1 --2- 172.21.15.12:0/54997694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 0x55f56cd8ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.289+0000 7f7e562f8640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e3c0a33b0 0x7f7e3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e46ffd640 1 -- 172.21.15.12:0/3595026294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f7e400d0190 con 0x7f7e50102790 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e552f6640 1 -- 172.21.15.12:0/54997694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 msgr2=0x55f56cd8ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e552f6640 1 --2- 172.21.15.12:0/54997694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 0x55f56cd8ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e552f6640 1 -- 172.21.15.12:0/54997694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd8f480 msgr2=0x55f56cd99800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e552f6640 1 --2- 172.21.15.12:0/54997694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd8f480 0x55f56cd99800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e552f6640 1 -- 172.21.15.12:0/54997694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56cca81f0 con 0x55f56cd99d40 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e562f8640 1 --2- 172.21.15.12:0/54997694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 0x55f56cd8ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e552f6640 1 --2- 172.21.15.12:0/54997694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd99d40 0x55f56cd9c130 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7e400cd880 tx=0x7f7e40018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea4daa1178af9fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e3bfff640 1 -- 172.21.15.12:0/54997694 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400a50e0 con 0x55f56cd99d40 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e3bfff640 1 -- 172.21.15.12:0/54997694 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e4009c470 con 0x55f56cd99d40 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e3bfff640 1 -- 172.21.15.12:0/54997694 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400d3c40 con 0x55f56cd99d40 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.290+0000 7f7e562f8640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e3c0a33b0 0x7f7e3c0a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7e48005fd0 tx=0x7f7e48004a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 -- 172.21.15.12:0/54997694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd99d40 msgr2=0x55f56cd9c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 --2- 172.21.15.12:0/54997694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd99d40 0x55f56cd9c130 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7e400cd880 tx=0x7f7e40018420 comp rx=0 tx=0).stop 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 -- 172.21.15.12:0/54997694 shutdown_connections 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 --2- 172.21.15.12:0/54997694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd99d40 0x55f56cd9c130 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 --2- 172.21.15.12:0/54997694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd8f480 0x55f56cd99800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 --2- 172.21.15.12:0/54997694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 0x55f56cd8ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 -- 172.21.15.12:0/54997694 >> 172.21.15.12:0/54997694 conn(0x55f56cd8b0f0 msgr2=0x55f56cd8b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 -- 172.21.15.12:0/54997694 shutdown_connections 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 -- 172.21.15.12:0/54997694 wait complete. 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 -- start start 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.291+0000 7f7e5a134740 1 Processor -- start 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd96c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8f480 0x55f56cd97160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cd976a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e5a134740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f56cd9c910 con 0x55f56cd8eb60 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e5a134740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f56ccaef10 con 0x55f56cd99d40 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e5a134740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f56cd9ca90 con 0x55f56cd8f480 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e5a134740 10 client.0 _ll_register_callbacks cb 0x55f56cc77a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e55af7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd96c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e55af7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd96c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41652/0 (socket says 172.21.15.12:41652) 2024-09-19T06:47:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e55af7640 1 -- 172.21.15.12:0/3209212345 learned_addr learned my addr 172.21.15.12:0/3209212345 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e562f8640 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cd976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e552f6640 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8f480 0x55f56cd97160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e55af7640 1 -- 172.21.15.12:0/3209212345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8f480 msgr2=0x55f56cd97160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e55af7640 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8f480 0x55f56cd97160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e55af7640 1 -- 172.21.15.12:0/3209212345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 msgr2=0x55f56cd976a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e55af7640 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cd976a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e55af7640 1 -- 172.21.15.12:0/3209212345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56ca656a0 con 0x55f56cd8eb60 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e55af7640 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd96c20 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009900 tx=0x7f7e4c031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4648b07e0354cd1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.292+0000 7f7e397fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e397fa640 1 -- 172.21.15.12:0/3209212345 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c035040 con 0x55f56cd8eb60 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e397fa640 1 -- 172.21.15.12:0/3209212345 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f7e4c004240 con 0x55f56cd8eb60 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e5a134740 1 -- 172.21.15.12:0/3209212345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e4009c470 con 0x55f56cd8eb60 2024-09-19T06:47:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e397fa640 1 -- 172.21.15.12:0/3209212345 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f7e4c004440 con 0x55f56cd8eb60 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e5a134740 10 client.17559 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e5a134740 1 -- 172.21.15.12:0/3209212345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55f56cda8560 con 0x55f56cd8eb60 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e397fa640 1 -- 172.21.15.12:0/3209212345 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e4009c470 con 0x55f56cd8eb60 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e397fa640 1 -- 172.21.15.12:0/3209212345 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f7e4c004990 con 0x55f56cd8eb60 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e5a134740 10 client.17559 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e5a134740 10 client.17559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e5a134740 20 client.17559 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f56cda9a20 0x55f56cdabe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e5a134740 4 client.17559 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.293+0000 7f7e5a134740 1 -- 172.21.15.12:0/3209212345 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f56cd017f0 con 0x55f56cda9a20 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.294+0000 7f7e552f6640 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f56cda9a20 0x55f56cdabe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.294+0000 7f7e552f6640 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f56cda9a20 0x55f56cdabe50 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c81f4e6c5e314cfb server_cookie=779a18d66d56b6 in_seq=0 out_seq=0 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.294+0000 7f7e397fa640 10 client.17559 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e397fa640 1 -- 172.21.15.12:0/3209212345 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f56cd017f0 con 0x55f56cda9a20 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e397fa640 10 client.17559 handle_command_reply: tid=0 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 client.17559 shutdown 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 -- 172.21.15.12:0/3209212345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 msgr2=0x55f56cd96c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd96c20 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009900 tx=0x7f7e4c031860 comp rx=0 tx=0).stop 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 -- 172.21.15.12:0/3209212345 shutdown_connections 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f56cda9a20 0x55f56cdabe50 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cd976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8f480 0x55f56cd97160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e397fa640 0 client.17559 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3209212345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd96c20 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 -- 172.21.15.12:0/3209212345 >> 172.21.15.12:0/3209212345 conn(0x55f56cd8b0f0 msgr2=0x55f56cd8a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 -- 172.21.15.12:0/3209212345 shutdown_connections 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 1 -- 172.21.15.12:0/3209212345 wait complete. 2024-09-19T06:47:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.295+0000 7f7e5a134740 20 client.17559 trim_cache size 0 max 16384 2024-09-19T06:47:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e5a134740 1 Processor -- start 2024-09-19T06:47:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e5a134740 1 -- start start 2024-09-19T06:47:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd98a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8f480 0x55f56cdb1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cdb1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e5a134740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e501adb90 con 0x55f56cd8eb60 2024-09-19T06:47:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e5a134740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7e501af760 con 0x55f56cd99d40 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e5a134740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7e501ae260 con 0x55f56cd8f480 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e55af7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd98a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e55af7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd98a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41668/0 (socket says 172.21.15.12:41668) 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e55af7640 1 -- 172.21.15.12:0/2915270518 learned_addr learned my addr 172.21.15.12:0/2915270518 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.313+0000 7f7e552f6640 1 --2- 172.21.15.12:0/2915270518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8f480 0x55f56cdb1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e562f8640 1 --2- 172.21.15.12:0/2915270518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cdb1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e55af7640 1 -- 172.21.15.12:0/2915270518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8f480 msgr2=0x55f56cdb1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e55af7640 1 --2- 172.21.15.12:0/2915270518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8f480 0x55f56cdb1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e55af7640 1 -- 172.21.15.12:0/2915270518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 msgr2=0x55f56cdb1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e55af7640 1 --2- 172.21.15.12:0/2915270518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cdb1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e55af7640 1 -- 172.21.15.12:0/2915270518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56cd8ab90 con 0x55f56cd8eb60 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e562f8640 1 --2- 172.21.15.12:0/2915270518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cdb1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e55af7640 1 --2- 172.21.15.12:0/2915270518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd98a80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c001eb0 tx=0x7f7e4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8a391bfb2f3b9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e3b7fe640 1 -- 172.21.15.12:0/2915270518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c035070 con 0x55f56cd8eb60 2024-09-19T06:47:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e3b7fe640 1 -- 172.21.15.12:0/2915270518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e4c031950 con 0x55f56cd8eb60 2024-09-19T06:47:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.314+0000 7f7e3b7fe640 1 -- 172.21.15.12:0/2915270518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c005230 con 0x55f56cd8eb60 2024-09-19T06:47:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 -- 172.21.15.12:0/2915270518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 msgr2=0x55f56cd98a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 --2- 172.21.15.12:0/2915270518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd98a80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c001eb0 tx=0x7f7e4c009780 comp rx=0 tx=0).stop 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 -- 172.21.15.12:0/2915270518 shutdown_connections 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 --2- 172.21.15.12:0/2915270518 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cdb1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 --2- 172.21.15.12:0/2915270518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8f480 0x55f56cdb1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 --2- 172.21.15.12:0/2915270518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8eb60 0x55f56cd98a80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 -- 172.21.15.12:0/2915270518 >> 172.21.15.12:0/2915270518 conn(0x55f56cd8b0f0 msgr2=0x55f56cd98370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 -- 172.21.15.12:0/2915270518 shutdown_connections 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 -- 172.21.15.12:0/2915270518 wait complete. 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 -- start start 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.315+0000 7f7e5a134740 1 Processor -- start 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 0x55f56cd9d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8f480 0x55f56cd9df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e5a134740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cd9e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e5a134740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e501af060 con 0x55f56cd8f480 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e5a134740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7e501ae990 con 0x55f56cd99d40 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e5a134740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7e501abb90 con 0x55f56cd8eb60 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e5a134740 10 client.0 _ll_register_callbacks cb 0x7f7e40005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e552f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8f480 0x55f56cd9df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e552f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8f480 0x55f56cd9df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41674/0 (socket says 172.21.15.12:41674) 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e552f6640 1 -- 172.21.15.12:0/3757740251 learned_addr learned my addr 172.21.15.12:0/3757740251 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e55af7640 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 0x55f56cd9d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e562f8640 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cd9e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e552f6640 1 -- 172.21.15.12:0/3757740251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 msgr2=0x55f56cd9d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e552f6640 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 0x55f56cd9d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e552f6640 1 -- 172.21.15.12:0/3757740251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 msgr2=0x55f56cd9e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e552f6640 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cd9e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e552f6640 1 -- 172.21.15.12:0/3757740251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56ce136f0 con 0x55f56cd8f480 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e552f6640 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8f480 0x55f56cd9df10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000cfd0 tx=0x7f7e4009bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7115e5bde4e65f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.316+0000 7f7e397fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e397fa640 1 -- 172.21.15.12:0/3757740251 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4009c470 con 0x55f56cd8f480 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e5a134740 1 -- 172.21.15.12:0/3757740251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e4c031950 con 0x55f56cd8f480 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e397fa640 1 -- 172.21.15.12:0/3757740251 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f7e400cdb60 con 0x55f56cd8f480 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e397fa640 1 -- 172.21.15.12:0/3757740251 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f7e400d38a0 con 0x55f56cd8f480 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e5a134740 10 client.17565 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e5a134740 1 -- 172.21.15.12:0/3757740251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55f56ce14920 con 0x55f56cd8f480 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e397fa640 1 -- 172.21.15.12:0/3757740251 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e4c031950 con 0x55f56cd8f480 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e397fa640 1 -- 172.21.15.12:0/3757740251 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f7e400a4c50 con 0x55f56cd8f480 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e5a134740 10 client.17565 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e5a134740 10 client.17565 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:44.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e5a134740 20 client.17565 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:44.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f56ce14c50 0x55f56ce17070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:44.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e5a134740 4 client.17565 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:47:44.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e5a134740 1 -- 172.21.15.12:0/3757740251 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f56ccfbd00 con 0x55f56ce14c50 2024-09-19T06:47:44.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.317+0000 7f7e55af7640 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f56ce14c50 0x55f56ce17070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:44.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.318+0000 7f7e397fa640 10 client.17565 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:44.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.318+0000 7f7e55af7640 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f56ce14c50 0x55f56ce17070 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3975c8fde213708 server_cookie=c923ca5cf4e974b1 in_seq=0 out_seq=0 2024-09-19T06:47:44.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e397fa640 1 -- 172.21.15.12:0/3757740251 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f56ccfbd00 con 0x55f56ce14c50 2024-09-19T06:47:44.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e397fa640 10 client.17565 handle_command_reply: tid=0 2024-09-19T06:47:44.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 client.17565 shutdown 2024-09-19T06:47:44.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 -- 172.21.15.12:0/3757740251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8f480 msgr2=0x55f56cd9df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:44.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8f480 0x55f56cd9df10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000cfd0 tx=0x7f7e4009bdd0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 -- 172.21.15.12:0/3757740251 shutdown_connections 2024-09-19T06:47:44.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f56ce14c50 0x55f56ce17070 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f56cd99d40 0x55f56cd9e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f56cd8f480 0x55f56cd9df10 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 --2- 172.21.15.12:0/3757740251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f56cd8eb60 0x55f56cd9d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e397fa640 0 client.17565 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:44.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 -- 172.21.15.12:0/3757740251 >> 172.21.15.12:0/3757740251 conn(0x55f56cd8b0f0 msgr2=0x55f56cd8a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:44.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 -- 172.21.15.12:0/3757740251 shutdown_connections 2024-09-19T06:47:44.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 1 -- 172.21.15.12:0/3757740251 wait complete. 2024-09-19T06:47:44.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.319+0000 7f7e5a134740 20 client.17565 trim_cache size 0 max 16384 2024-09-19T06:47:44.325 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:47:44.326 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:47:44.326 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "d04ad9f1-5419-4ee0-8b7f-597c83878b27", 2024-09-19T06:47:44.326 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:47:44.326 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:47:44.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 -- 172.21.15.12:0/3595026294 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e3c0a33b0 msgr2=0x7f7e3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:44.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e3c0a33b0 0x7f7e3c0a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7e48005fd0 tx=0x7f7e48004a40 comp rx=0 tx=0).stop 2024-09-19T06:47:44.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 -- 172.21.15.12:0/3595026294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e50102790 msgr2=0x7f7e50198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:44.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e50102790 0x7f7e50198960 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000e9f0 tx=0x7f7e4000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 -- 172.21.15.12:0/3595026294 shutdown_connections 2024-09-19T06:47:44.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e3c0a33b0 0x7f7e3c0a5870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e50106f10 0x7f7e5019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e50102790 0x7f7e50198960 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 --2- 172.21.15.12:0/3595026294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e50101de0 0x7f7e50198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:44.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 -- 172.21.15.12:0/3595026294 >> 172.21.15.12:0/3595026294 conn(0x7f7e500fd8c0 msgr2=0x7f7e500fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:44.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 -- 172.21.15.12:0/3595026294 shutdown_connections 2024-09-19T06:47:44.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:44.320+0000 7f7e57d5b640 1 -- 172.21.15.12:0/3595026294 wait complete. 2024-09-19T06:47:44.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:43 smithi173 ceph-mon[35349]: pgmap v232: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-19T06:47:44.758 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: 2024-09-19T06:47:44.350+0000 7f466df5b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [...a,head] /volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans/ auth{1=1,2=1,3=1,4=1} v1808 ap=3 f(v14 m2024-09-19T06:46:53.366740+0000 7=7+0) n(v28 rc2024-09-19T06:46:53.367740+0000 b1679360 8=7+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:3768 nref=3)) caps={15252=pAsLsXsFs/pAsLsXsFsx@43} mcw={2=AsLsXsFs,4=AsLsXsFs} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55a161e61180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v310>,<0x10000000005/data v119>,<0x100000001fb/postgres v23>,<0x100000001fa/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 v38>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v1808>,<0x10000000005/data v629>,<0x100000001fb/postgres v361>,<0x100000001fa/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 v388>,<0x10000000001/sv_1 v394>,<0x10000000000/qa v408>,<0x1/volumes v349>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:46:31.553919+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:46:53.367740+0000 b1679360 8=7+1)","memory_value.dirstat":"f(v14 m2024-09-19T06:46:53.366740+0000 7=7+0)","memory_value.rstat":"n(v28 rc2024-09-19T06:46:53.367740+0000 b1679360 8=7+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-19T06:47:45.086 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:47:45.108 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.109 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:44 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:47:45.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:47:45.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:44 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:47:45.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:47:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:47:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:47:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:47:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:47:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:47:45.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:47:45.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:44 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:45.340 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 420.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:47:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.818+0000 7fcbeac7b640 1 -- 172.21.15.12:0/1382170206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbe4106f10 msgr2=0x7fcbe410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.818+0000 7fcbeac7b640 1 --2- 172.21.15.12:0/1382170206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbe4106f10 0x7fcbe410ea90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009ca0 tx=0x7fcbdc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.818+0000 7fcbeac7b640 1 -- 172.21.15.12:0/1382170206 shutdown_connections 2024-09-19T06:47:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.818+0000 7fcbeac7b640 1 --2- 172.21.15.12:0/1382170206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbe4106f10 0x7fcbe410ea90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.818+0000 7fcbeac7b640 1 --2- 172.21.15.12:0/1382170206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbe4102790 0x7fcbe41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.818+0000 7fcbeac7b640 1 --2- 172.21.15.12:0/1382170206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbe4101de0 0x7fcbe41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.818+0000 7fcbeac7b640 1 -- 172.21.15.12:0/1382170206 >> 172.21.15.12:0/1382170206 conn(0x7fcbe40fd8c0 msgr2=0x7fcbe40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.818+0000 7fcbeac7b640 1 -- 172.21.15.12:0/1382170206 shutdown_connections 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.818+0000 7fcbeac7b640 1 -- 172.21.15.12:0/1382170206 wait complete. 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbeac7b640 1 Processor -- start 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbeac7b640 1 -- start start 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbeac7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbe4101de0 0x7fcbe419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbeac7b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbe4102790 0x7fcbe419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbeac7b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbe4106f10 0x7fcbe419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbeac7b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe4111fb0 con 0x7fcbe4101de0 2024-09-19T06:47:45.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbeac7b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe4111e30 con 0x7fcbe4106f10 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbeac7b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe4112130 con 0x7fcbe4102790 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbe8a17640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbe4101de0 0x7fcbe419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbe8a17640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbe4101de0 0x7fcbe419a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41706/0 (socket says 172.21.15.12:41706) 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.819+0000 7fcbe8a17640 1 -- 172.21.15.12:0/3315216950 learned_addr learned my addr 172.21.15.12:0/3315216950 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe9218640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbe4106f10 0x7fcbe419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe3fff640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbe4102790 0x7fcbe419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe8a17640 1 -- 172.21.15.12:0/3315216950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbe4102790 msgr2=0x7fcbe419ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbe4102790 0x7fcbe419ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe8a17640 1 -- 172.21.15.12:0/3315216950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbe4106f10 msgr2=0x7fcbe419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbe4106f10 0x7fcbe419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe8a17640 1 -- 172.21.15.12:0/3315216950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe419f680 con 0x7fcbe4101de0 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbe4101de0 0x7fcbe419a6d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800d770 tx=0x7fcbd800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe1ffb640 1 -- 172.21.15.12:0/3315216950 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8017070 con 0x7fcbe4101de0 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe1ffb640 1 -- 172.21.15.12:0/3315216950 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbd8005500 con 0x7fcbe4101de0 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbeac7b640 1 -- 172.21.15.12:0/3315216950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe419f970 con 0x7fcbe4101de0 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbe1ffb640 1 -- 172.21.15.12:0/3315216950 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8004e00 con 0x7fcbe4101de0 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.820+0000 7fcbeac7b640 1 -- 172.21.15.12:0/3315216950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe41a7250 con 0x7fcbe4101de0 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.822+0000 7fcbe1ffb640 1 -- 172.21.15.12:0/3315216950 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcbd8004fa0 con 0x7fcbe4101de0 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbed054740 1 Processor -- start 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbed054740 1 -- start start 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbed054740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 0x557f3d60c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbed054740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d617140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbed054740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d619a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbed054740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f3d5722e0 con 0x557f3d60cdc0 2024-09-19T06:47:45.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbed054740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557f3d519ce0 con 0x557f3d60c4a0 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbed054740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557f3d56e2a0 con 0x557f3d617680 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbe8a17640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d617140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbe8a17640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d617140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41720/0 (socket says 172.21.15.12:41720) 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbe8a17640 1 -- 172.21.15.12:0/1497440716 learned_addr learned my addr 172.21.15.12:0/1497440716 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbe9218640 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 0x557f3d60c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbe1ffb640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbd40a3430 0x7fcbd40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.823+0000 7fcbe3fff640 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d619a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe8a17640 1 -- 172.21.15.12:0/1497440716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 msgr2=0x557f3d619a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d619a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe8a17640 1 -- 172.21.15.12:0/1497440716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 msgr2=0x557f3d60c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 0x557f3d60c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe8a17640 1 -- 172.21.15.12:0/1497440716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3d4fe440 con 0x557f3d60cdc0 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe3fff640 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d619a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe9218640 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 0x557f3d60c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe9218640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbd40a3430 0x7fcbd40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe1ffb640 1 -- 172.21.15.12:0/3315216950 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fcbd80cf8a0 con 0x7fcbe4101de0 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d617140 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80cce30 tx=0x7fcbd8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a6f941ddd2e718 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbe9218640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbd40a3430 0x7fcbd40a58f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009430 tx=0x7fcbdc0095c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbceffd640 1 -- 172.21.15.12:0/1497440716 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd809b5c0 con 0x557f3d60cdc0 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbceffd640 1 -- 172.21.15.12:0/1497440716 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbd80046c0 con 0x557f3d60cdc0 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.824+0000 7fcbceffd640 1 -- 172.21.15.12:0/1497440716 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8019310 con 0x557f3d60cdc0 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 -- 172.21.15.12:0/1497440716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 msgr2=0x557f3d617140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d617140 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80cce30 tx=0x7fcbd8022000 comp rx=0 tx=0).stop 2024-09-19T06:47:45.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 -- 172.21.15.12:0/1497440716 shutdown_connections 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d619a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d617140 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 --2- 172.21.15.12:0/1497440716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 0x557f3d60c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 -- 172.21.15.12:0/1497440716 >> 172.21.15.12:0/1497440716 conn(0x557f3d608a30 msgr2=0x557f3d608e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 -- 172.21.15.12:0/1497440716 shutdown_connections 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 -- 172.21.15.12:0/1497440716 wait complete. 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 -- start start 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.825+0000 7fcbed054740 1 Processor -- start 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbed054740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d60c4a0 0x557f3d616fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbed054740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60cdc0 0x557f3d614280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbed054740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d617680 0x557f3d6147e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbed054740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f3d61a250 con 0x557f3d617680 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbed054740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557f3d52d050 con 0x557f3d60cdc0 2024-09-19T06:47:45.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbed054740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557f3d61a3d0 con 0x557f3d60c4a0 2024-09-19T06:47:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbed054740 10 client.0 _ll_register_callbacks cb 0x557f3d56d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe9218640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d617680 0x557f3d6147e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe9218640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d617680 0x557f3d6147e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41734/0 (socket says 172.21.15.12:41734) 2024-09-19T06:47:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe9218640 1 -- 172.21.15.12:0/793458070 learned_addr learned my addr 172.21.15.12:0/793458070 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d60c4a0 0x557f3d616fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe3fff640 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60cdc0 0x557f3d614280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe9218640 1 -- 172.21.15.12:0/793458070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d60c4a0 msgr2=0x557f3d616fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe9218640 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d60c4a0 0x557f3d616fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe9218640 1 -- 172.21.15.12:0/793458070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60cdc0 msgr2=0x557f3d614280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe9218640 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60cdc0 0x557f3d614280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe9218640 1 -- 172.21.15.12:0/793458070 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f3d2e33c0 con 0x557f3d617680 2024-09-19T06:47:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.826+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d60c4a0 0x557f3d616fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbe9218640 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d617680 0x557f3d6147e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc035000 tx=0x7fcbdc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccc64072a478f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbc3fff640 1 -- 172.21.15.12:0/793458070 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc031e10 con 0x557f3d617680 2024-09-19T06:47:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbc3fff640 1 -- 172.21.15.12:0/793458070 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fcbdc0045c0 con 0x557f3d617680 2024-09-19T06:47:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbed054740 1 -- 172.21.15.12:0/793458070 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f3d57f850 con 0x557f3d617680 2024-09-19T06:47:45.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbc3fff640 1 -- 172.21.15.12:0/793458070 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fcbdc059050 con 0x557f3d617680 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbed054740 10 client.17577 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbed054740 1 -- 172.21.15.12:0/793458070 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x557f3d625c20 con 0x557f3d617680 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbc3fff640 1 -- 172.21.15.12:0/793458070 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557f3d57f850 con 0x557f3d617680 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbc3fff640 1 -- 172.21.15.12:0/793458070 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7fcbdc0305e0 con 0x557f3d617680 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbed054740 10 client.17577 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbed054740 10 client.17577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbed054740 20 client.17577 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbed054740 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f3d627100 0x557f3d629560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbed054740 4 client.17577 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.827+0000 7fcbed054740 1 -- 172.21.15.12:0/793458070 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f3d579d60 con 0x557f3d627100 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.828+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f3d627100 0x557f3d629560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.828+0000 7fcbc3fff640 10 client.17577 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.828+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f3d627100 0x557f3d629560 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49151afbecea1268 server_cookie=8f59dda06c65907b in_seq=0 out_seq=0 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbc3fff640 1 -- 172.21.15.12:0/793458070 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f3d579d60 con 0x557f3d627100 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbc3fff640 10 client.17577 handle_command_reply: tid=0 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 client.17577 shutdown 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 -- 172.21.15.12:0/793458070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d617680 msgr2=0x557f3d6147e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d617680 0x557f3d6147e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc035000 tx=0x7fcbdc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 -- 172.21.15.12:0/793458070 shutdown_connections 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f3d627100 0x557f3d629560 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d617680 0x557f3d6147e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60cdc0 0x557f3d614280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbc3fff640 0 client.17577 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 --2- 172.21.15.12:0/793458070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d60c4a0 0x557f3d616fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 -- 172.21.15.12:0/793458070 >> 172.21.15.12:0/793458070 conn(0x557f3d608a30 msgr2=0x557f3d60e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 -- 172.21.15.12:0/793458070 shutdown_connections 2024-09-19T06:47:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 1 -- 172.21.15.12:0/793458070 wait complete. 2024-09-19T06:47:45.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.829+0000 7fcbed054740 20 client.17577 trim_cache size 0 max 16384 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.847+0000 7fcbed054740 1 Processor -- start 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.847+0000 7fcbed054740 1 -- start start 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.847+0000 7fcbed054740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60c4a0 0x557f3d6161f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.847+0000 7fcbed054740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60cdc0 0x557f3d62ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.847+0000 7fcbed054740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d62f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.847+0000 7fcbed054740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41afd20 con 0x557f3d60c4a0 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.847+0000 7fcbed054740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41b18f0 con 0x557f3d60cdc0 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.847+0000 7fcbed054740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41b03f0 con 0x557f3d617680 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe8a17640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60c4a0 0x557f3d6161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe8a17640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60c4a0 0x557f3d6161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41742/0 (socket says 172.21.15.12:41742) 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe8a17640 1 -- 172.21.15.12:0/2880552907 learned_addr learned my addr 172.21.15.12:0/2880552907 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:45.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe3fff640 1 --2- 172.21.15.12:0/2880552907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60cdc0 0x557f3d62ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe9218640 1 --2- 172.21.15.12:0/2880552907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d62f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe8a17640 1 -- 172.21.15.12:0/2880552907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 msgr2=0x557f3d62f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/2880552907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d62f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe8a17640 1 -- 172.21.15.12:0/2880552907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60cdc0 msgr2=0x557f3d62ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/2880552907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60cdc0 0x557f3d62ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe8a17640 1 -- 172.21.15.12:0/2880552907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3d61a130 con 0x557f3d60c4a0 2024-09-19T06:47:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/2880552907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60c4a0 0x557f3d6161f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8021000 tx=0x7fcbd809b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb6a9989b98cce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbce7fc640 1 -- 172.21.15.12:0/2880552907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80b4070 con 0x557f3d60c4a0 2024-09-19T06:47:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbce7fc640 1 -- 172.21.15.12:0/2880552907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbd809ba80 con 0x557f3d60c4a0 2024-09-19T06:47:45.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.848+0000 7fcbce7fc640 1 -- 172.21.15.12:0/2880552907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8016170 con 0x557f3d60c4a0 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.849+0000 7fcbed054740 1 -- 172.21.15.12:0/2880552907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60c4a0 msgr2=0x557f3d6161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.849+0000 7fcbed054740 1 --2- 172.21.15.12:0/2880552907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60c4a0 0x557f3d6161f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8021000 tx=0x7fcbd809b6e0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.849+0000 7fcbed054740 1 -- 172.21.15.12:0/2880552907 shutdown_connections 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.849+0000 7fcbed054740 1 --2- 172.21.15.12:0/2880552907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d62f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.849+0000 7fcbed054740 1 --2- 172.21.15.12:0/2880552907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60cdc0 0x557f3d62ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.849+0000 7fcbed054740 1 --2- 172.21.15.12:0/2880552907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60c4a0 0x557f3d6161f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.849+0000 7fcbed054740 1 -- 172.21.15.12:0/2880552907 >> 172.21.15.12:0/2880552907 conn(0x557f3d608a30 msgr2=0x557f3d615ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.849+0000 7fcbed054740 1 -- 172.21.15.12:0/2880552907 shutdown_connections 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.849+0000 7fcbed054740 1 -- 172.21.15.12:0/2880552907 wait complete. 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.849+0000 7fcbed054740 1 -- start start 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbed054740 1 Processor -- start 2024-09-19T06:47:45.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbed054740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 0x557f3d61fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbed054740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d61ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbed054740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d61d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbed054740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41b11f0 con 0x557f3d60cdc0 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbed054740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41b0b20 con 0x557f3d60c4a0 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbed054740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe41add20 con 0x557f3d617680 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbed054740 10 client.0 _ll_register_callbacks cb 0x7fcbdc009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbe3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d61ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbe3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d61ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41754/0 (socket says 172.21.15.12:41754) 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbe3fff640 1 -- 172.21.15.12:0/3994196437 learned_addr learned my addr 172.21.15.12:0/3994196437 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 0x557f3d61fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.850+0000 7fcbe9218640 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d61d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.851+0000 7fcbe3fff640 1 -- 172.21.15.12:0/3994196437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 msgr2=0x557f3d61d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.851+0000 7fcbe3fff640 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d61d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.851+0000 7fcbe3fff640 1 -- 172.21.15.12:0/3994196437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 msgr2=0x557f3d61fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:45.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.851+0000 7fcbe3fff640 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 0x557f3d61fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.851+0000 7fcbe3fff640 1 -- 172.21.15.12:0/3994196437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f3d61da50 con 0x557f3d60cdc0 2024-09-19T06:47:45.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.851+0000 7fcbe3fff640 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d61ced0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x557f3d609db0 tx=0x7fcbd0013820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08f151e212d268e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:45.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.851+0000 7fcbc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.854+0000 7fcbc3fff640 1 -- 172.21.15.12:0/3994196437 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd00156f0 con 0x557f3d60cdc0 2024-09-19T06:47:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.854+0000 7fcbc3fff640 1 -- 172.21.15.12:0/3994196437 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7fcbd0015890 con 0x557f3d60cdc0 2024-09-19T06:47:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.854+0000 7fcbed054740 1 -- 172.21.15.12:0/3994196437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbd809ba80 con 0x557f3d60cdc0 2024-09-19T06:47:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.854+0000 7fcbc3fff640 1 -- 172.21.15.12:0/3994196437 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fcbd0015a90 con 0x557f3d60cdc0 2024-09-19T06:47:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.854+0000 7fcbed054740 10 client.17583 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.854+0000 7fcbed054740 1 -- 172.21.15.12:0/3994196437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x557f3d691d00 con 0x557f3d60cdc0 2024-09-19T06:47:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbc3fff640 1 -- 172.21.15.12:0/3994196437 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbd809ba80 con 0x557f3d60cdc0 2024-09-19T06:47:45.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbc3fff640 1 -- 172.21.15.12:0/3994196437 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7fcbd0026400 con 0x557f3d60cdc0 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbed054740 10 client.17583 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbed054740 10 client.17583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbed054740 20 client.17583 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbed054740 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f3d692510 0x557f3d694930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbed054740 4 client.17583 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbed054740 1 -- 172.21.15.12:0/3994196437 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557f3d4f6210 con 0x557f3d692510 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f3d692510 0x557f3d694930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbe8a17640 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f3d692510 0x557f3d694930 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f067ee66ad0d25dc server_cookie=c0a42a48311a66e7 in_seq=0 out_seq=0 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.855+0000 7fcbc3fff640 10 client.17583 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbc3fff640 1 -- 172.21.15.12:0/3994196437 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557f3d4f6210 con 0x557f3d692510 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbc3fff640 10 client.17583 handle_command_reply: tid=0 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 client.17583 shutdown 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 -- 172.21.15.12:0/3994196437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 msgr2=0x557f3d61ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d61ced0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x557f3d609db0 tx=0x7fcbd0013820 comp rx=0 tx=0).stop 2024-09-19T06:47:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 -- 172.21.15.12:0/3994196437 shutdown_connections 2024-09-19T06:47:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f3d692510 0x557f3d694930 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f3d617680 0x557f3d61d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f3d60cdc0 0x557f3d61ced0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 --2- 172.21.15.12:0/3994196437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f3d60c4a0 0x557f3d61fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 -- 172.21.15.12:0/3994196437 >> 172.21.15.12:0/3994196437 conn(0x557f3d608a30 msgr2=0x557f3d607350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbc3fff640 0 client.17583 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 -- 172.21.15.12:0/3994196437 shutdown_connections 2024-09-19T06:47:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 1 -- 172.21.15.12:0/3994196437 wait complete. 2024-09-19T06:47:45.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.856+0000 7fcbed054740 20 client.17583 trim_cache size 0 max 16384 2024-09-19T06:47:45.861 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:47:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:47:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:47:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "d04ad9f1-5419-4ee0-8b7f-597c83878b27": { 2024-09-19T06:47:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:47:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "d04ad9f1-5419-4ee0-8b7f-597c83878b27", 2024-09-19T06:47:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:47:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:45.861 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:47:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 -- 172.21.15.12:0/3315216950 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbd40a3430 msgr2=0x7fcbd40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbd40a3430 0x7fcbd40a58f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009430 tx=0x7fcbdc0095c0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 -- 172.21.15.12:0/3315216950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbe4101de0 msgr2=0x7fcbe419a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbe4101de0 0x7fcbe419a6d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800d770 tx=0x7fcbd800dc30 comp rx=0 tx=0).stop 2024-09-19T06:47:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 -- 172.21.15.12:0/3315216950 shutdown_connections 2024-09-19T06:47:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbe4106f10 0x7fcbe419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbd40a3430 0x7fcbd40a58f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbe4102790 0x7fcbe419ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 --2- 172.21.15.12:0/3315216950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbe4101de0 0x7fcbe419a6d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 -- 172.21.15.12:0/3315216950 >> 172.21.15.12:0/3315216950 conn(0x7fcbe40fd8c0 msgr2=0x7fcbe40ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 -- 172.21.15.12:0/3315216950 shutdown_connections 2024-09-19T06:47:45.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:45.857+0000 7fcbeac7b640 1 -- 172.21.15.12:0/3315216950 wait complete. 2024-09-19T06:47:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:45 smithi012 ceph-mon[30937]: pgmap v233: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-19T06:47:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:45 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:47:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:45 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:47:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:45 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:46.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:45 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:46.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:45 smithi016 ceph-mon[34911]: pgmap v233: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-19T06:47:46.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:45 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:47:46.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:45 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:47:46.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:45 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:46.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:45 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:46.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:45 smithi173 ceph-mon[35349]: pgmap v233: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2024-09-19T06:47:46.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:45 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:47:46.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:45 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:47:46.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:45 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:46.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:45 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:47:46.673 INFO:tasks.cephfs.filesystem:scrub status for tag:d04ad9f1-5419-4ee0-8b7f-597c83878b27 - {'path': '/', 'tag': 'd04ad9f1-5419-4ee0-8b7f-597c83878b27', 'options': 'recursive,force'} 2024-09-19T06:47:46.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.838+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1794350407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eec10c0f0 msgr2=0x7f1eec10e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.838+0000 7f1ef17bd640 1 --2- 172.21.15.12:0/1794350407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eec10c0f0 0x7f1eec10e590 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009ca0 tx=0x7f1ee402a950 comp rx=0 tx=0).stop 2024-09-19T06:47:46.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.838+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1794350407 shutdown_connections 2024-09-19T06:47:46.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.838+0000 7f1ef17bd640 1 --2- 172.21.15.12:0/1794350407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eec10c0f0 0x7f1eec10e590 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.838+0000 7f1ef17bd640 1 --2- 172.21.15.12:0/1794350407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eec103640 0x7f1eec10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.838+0000 7f1ef17bd640 1 --2- 172.21.15.12:0/1794350407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eec102d20 0x7f1eec103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.838+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1794350407 >> 172.21.15.12:0/1794350407 conn(0x7f1eec0fc6b0 msgr2=0x7f1eec0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.838+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1794350407 shutdown_connections 2024-09-19T06:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.838+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1794350407 wait complete. 2024-09-19T06:47:46.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1ef17bd640 1 Processor -- start 2024-09-19T06:47:46.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1ef17bd640 1 -- start start 2024-09-19T06:47:46.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1ef17bd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eec102d20 0x7f1eec198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1ef17bd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eec103640 0x7f1eec198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1ef17bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eec10c0f0 0x7f1eec19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1ef17bd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec111f30 con 0x7f1eec10c0f0 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1ef17bd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec111db0 con 0x7f1eec102d20 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1ef17bd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec1120b0 con 0x7f1eec103640 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eec10c0f0 0x7f1eec19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1eeb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eec10c0f0 0x7f1eec19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41778/0 (socket says 172.21.15.12:41778) 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1eeb7fe640 1 -- 172.21.15.12:0/1934481975 learned_addr learned my addr 172.21.15.12:0/1934481975 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eec102d20 0x7f1eec198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.839+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eec103640 0x7f1eec198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1eeb7fe640 1 -- 172.21.15.12:0/1934481975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eec103640 msgr2=0x7f1eec198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1eeb7fe640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eec103640 0x7f1eec198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1eeb7fe640 1 -- 172.21.15.12:0/1934481975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eec102d20 msgr2=0x7f1eec198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1eeb7fe640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eec102d20 0x7f1eec198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1eeb7fe640 1 -- 172.21.15.12:0/1934481975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eec19d330 con 0x7f1eec10c0f0 2024-09-19T06:47:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eec102d20 0x7f1eec198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1eeb7fe640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eec10c0f0 0x7f1eec19cc00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1ee402ae70 tx=0x7f1ee402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1ed3fff640 1 -- 172.21.15.12:0/1934481975 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4034040 con 0x7f1eec10c0f0 2024-09-19T06:47:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1ed3fff640 1 -- 172.21.15.12:0/1934481975 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ee4030920 con 0x7f1eec10c0f0 2024-09-19T06:47:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1934481975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eec19d5c0 con 0x7f1eec10c0f0 2024-09-19T06:47:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1ed3fff640 1 -- 172.21.15.12:0/1934481975 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4045480 con 0x7f1eec10c0f0 2024-09-19T06:47:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.840+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1934481975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eec1a4eb0 con 0x7f1eec10c0f0 2024-09-19T06:47:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.842+0000 7f1ed3fff640 1 -- 172.21.15.12:0/1934481975 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1ee4037020 con 0x7f1eec10c0f0 2024-09-19T06:47:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.842+0000 7f1ef4634740 1 Processor -- start 2024-09-19T06:47:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1ef4634740 1 -- start start 2024-09-19T06:47:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 0x55674c129ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c134770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 0x55674c1370a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1ef4634740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55674c08e2f0 con 0x55674c12a410 2024-09-19T06:47:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1ef4634740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55674c036270 con 0x55674c134cb0 2024-09-19T06:47:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1ef4634740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55674c08a2b0 con 0x55674c129af0 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eeaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c134770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eeaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c134770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41790/0 (socket says 172.21.15.12:41790) 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eeaffd640 1 -- 172.21.15.12:0/2783499770 learned_addr learned my addr 172.21.15.12:0/2783499770 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1ed3fff640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1ed40a34e0 0x7f1ed40a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/2783499770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 0x55674c1370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/2783499770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 0x55674c129ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eeb7fe640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1ed40a34e0 0x7f1ed40a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eeaffd640 1 -- 172.21.15.12:0/2783499770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 msgr2=0x55674c129ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/2783499770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 0x55674c129ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eeaffd640 1 -- 172.21.15.12:0/2783499770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 msgr2=0x55674c1370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/2783499770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 0x55674c1370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eeaffd640 1 -- 172.21.15.12:0/2783499770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55674c035340 con 0x55674c12a410 2024-09-19T06:47:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/2783499770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 0x55674c129ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.843+0000 7f1ed3fff640 1 -- 172.21.15.12:0/1934481975 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f1ee40f0c50 con 0x7f1eec10c0f0 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.844+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/2783499770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c134770 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1edc007850 tx=0x7f1edc007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b22ac2a7620d774 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.844+0000 7f1ed17fa640 1 -- 172.21.15.12:0/2783499770 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00d950 con 0x55674c12a410 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.844+0000 7f1ed17fa640 1 -- 172.21.15.12:0/2783499770 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1edc018070 con 0x55674c12a410 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.844+0000 7f1ed17fa640 1 -- 172.21.15.12:0/2783499770 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc0123e0 con 0x55674c12a410 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.844+0000 7f1ef4634740 1 -- 172.21.15.12:0/2783499770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 msgr2=0x55674c134770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.844+0000 7f1ef4634740 1 --2- 172.21.15.12:0/2783499770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c134770 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1edc007850 tx=0x7f1edc007d10 comp rx=0 tx=0).stop 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.844+0000 7f1eeb7fe640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1ed40a34e0 0x7f1ed40a59a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40ee4c0 tx=0x7f1ee408ed20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 -- 172.21.15.12:0/2783499770 shutdown_connections 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 --2- 172.21.15.12:0/2783499770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 0x55674c1370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 --2- 172.21.15.12:0/2783499770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c134770 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 --2- 172.21.15.12:0/2783499770 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 0x55674c129ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 -- 172.21.15.12:0/2783499770 >> 172.21.15.12:0/2783499770 conn(0x55674c126060 msgr2=0x55674c126440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 -- 172.21.15.12:0/2783499770 shutdown_connections 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 -- 172.21.15.12:0/2783499770 wait complete. 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 -- start start 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 Processor -- start 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c129af0 0x55674c131b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c12a410 0x55674c1320d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 0x55674c132610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55674c137880 con 0x55674c129af0 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55674c017290 con 0x55674c134cb0 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55674c137a00 con 0x55674c12a410 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1ef4634740 10 client.0 _ll_register_callbacks cb 0x55674c048140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1eea7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c129af0 0x55674c131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1eea7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c129af0 0x55674c131b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41802/0 (socket says 172.21.15.12:41802) 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1eea7fc640 1 -- 172.21.15.12:0/3164074527 learned_addr learned my addr 172.21.15.12:0/3164074527 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.845+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c12a410 0x55674c1320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eea7fc640 1 -- 172.21.15.12:0/3164074527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c12a410 msgr2=0x55674c1320d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c12a410 0x55674c1320d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eea7fc640 1 -- 172.21.15.12:0/3164074527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 msgr2=0x55674c132610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 0x55674c132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eea7fc640 1 -- 172.21.15.12:0/3164074527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55674bda1210 con 0x55674c129af0 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c129af0 0x55674c131b90 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000ce10 tx=0x7f1ee000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03f6f71c85ffcdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eceff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eceff5640 1 -- 172.21.15.12:0/3164074527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0004220 con 0x55674c129af0 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eceff5640 1 -- 172.21.15.12:0/3164074527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f1ee00043c0 con 0x55674c129af0 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1ef4634740 1 -- 172.21.15.12:0/3164074527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1edc018070 con 0x55674c129af0 2024-09-19T06:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eceff5640 1 -- 172.21.15.12:0/3164074527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1ee00118c0 con 0x55674c129af0 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1ef4634740 10 client.17595 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1ef4634740 1 -- 172.21.15.12:0/3164074527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55674be6d620 con 0x55674c129af0 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.846+0000 7f1eceff5640 1 -- 172.21.15.12:0/3164074527 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1edc018070 con 0x55674c129af0 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.847+0000 7f1eceff5640 1 -- 172.21.15.12:0/3164074527 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f1ee0012450 con 0x55674c129af0 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.847+0000 7f1ef4634740 10 client.17595 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.847+0000 7f1ef4634740 10 client.17595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.847+0000 7f1ef4634740 20 client.17595 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.847+0000 7f1ef4634740 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55674c144c80 0x55674c147070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.847+0000 7f1ef4634740 4 client.17595 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.847+0000 7f1ef4634740 1 -- 172.21.15.12:0/3164074527 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55674c09ba20 con 0x55674c144c80 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.847+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55674c144c80 0x55674c147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.847+0000 7f1eceff5640 10 client.17595 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.847+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55674c144c80 0x55674c147070 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1330374d386a1c6 server_cookie=462e25d566b43d27 in_seq=0 out_seq=0 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1eceff5640 1 -- 172.21.15.12:0/3164074527 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55674c09ba20 con 0x55674c144c80 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1eceff5640 10 client.17595 handle_command_reply: tid=0 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 client.17595 shutdown 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 -- 172.21.15.12:0/3164074527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c129af0 msgr2=0x55674c131b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c129af0 0x55674c131b90 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000ce10 tx=0x7f1ee000cf00 comp rx=0 tx=0).stop 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 -- 172.21.15.12:0/3164074527 shutdown_connections 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55674c144c80 0x55674c147070 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 0x55674c132610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c12a410 0x55674c1320d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 --2- 172.21.15.12:0/3164074527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c129af0 0x55674c131b90 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1eceff5640 0 client.17595 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 -- 172.21.15.12:0/3164074527 >> 172.21.15.12:0/3164074527 conn(0x55674c126060 msgr2=0x55674c12bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 -- 172.21.15.12:0/3164074527 shutdown_connections 2024-09-19T06:47:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 1 -- 172.21.15.12:0/3164074527 wait complete. 2024-09-19T06:47:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.848+0000 7f1ef4634740 20 client.17595 trim_cache size 0 max 16384 2024-09-19T06:47:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.863+0000 7f1ef4634740 1 Processor -- start 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.863+0000 7f1ef4634740 1 -- start start 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 0x55674c12c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c1320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 0x55674c132600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1ef4634740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec1ada90 con 0x55674c12a410 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1ef4634740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec1af660 con 0x55674c134cb0 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1ef4634740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec1ae160 con 0x55674c129af0 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1eeaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c1320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1eeaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c1320c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41810/0 (socket says 172.21.15.12:41810) 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1eeaffd640 1 -- 172.21.15.12:0/335257408 learned_addr learned my addr 172.21.15.12:0/335257408 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/335257408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 0x55674c12c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1eeaffd640 1 -- 172.21.15.12:0/335257408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 msgr2=0x55674c12c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/335257408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 0x55674c12c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1eeaffd640 1 -- 172.21.15.12:0/335257408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 msgr2=0x55674c132600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/335257408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 0x55674c132600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1eeaffd640 1 -- 172.21.15.12:0/335257408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55674c1212d0 con 0x55674c12a410 2024-09-19T06:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/335257408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c1320c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0077a0 tx=0x7f1edc00f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9872668a1b8ca9ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1ed0ff9640 1 -- 172.21.15.12:0/335257408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00db50 con 0x55674c12a410 2024-09-19T06:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1ed0ff9640 1 -- 172.21.15.12:0/335257408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1edc02c070 con 0x55674c12a410 2024-09-19T06:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.864+0000 7f1ed0ff9640 1 -- 172.21.15.12:0/335257408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc026bf0 con 0x55674c12a410 2024-09-19T06:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.865+0000 7f1ef4634740 1 -- 172.21.15.12:0/335257408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 msgr2=0x55674c1320c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.865+0000 7f1ef4634740 1 --2- 172.21.15.12:0/335257408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c1320c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0077a0 tx=0x7f1edc00f040 comp rx=0 tx=0).stop 2024-09-19T06:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.865+0000 7f1ef4634740 1 -- 172.21.15.12:0/335257408 shutdown_connections 2024-09-19T06:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.865+0000 7f1ef4634740 1 --2- 172.21.15.12:0/335257408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c134cb0 0x55674c132600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.865+0000 7f1ef4634740 1 --2- 172.21.15.12:0/335257408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c12a410 0x55674c1320c0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.865+0000 7f1ef4634740 1 --2- 172.21.15.12:0/335257408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c129af0 0x55674c12c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.865+0000 7f1ef4634740 1 -- 172.21.15.12:0/335257408 >> 172.21.15.12:0/335257408 conn(0x55674c126060 msgr2=0x55674c133c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.865+0000 7f1ef4634740 1 -- 172.21.15.12:0/335257408 shutdown_connections 2024-09-19T06:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.865+0000 7f1ef4634740 1 -- 172.21.15.12:0/335257408 wait complete. 2024-09-19T06:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.865+0000 7f1ef4634740 1 -- start start 2024-09-19T06:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1ef4634740 1 Processor -- start 2024-09-19T06:47:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c129af0 0x55674c13d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c12a410 0x55674c13d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1ef4634740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c134cb0 0x55674c138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1ef4634740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec1aef60 con 0x55674c134cb0 2024-09-19T06:47:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1ef4634740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec1ae890 con 0x55674c129af0 2024-09-19T06:47:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1ef4634740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec1aba90 con 0x55674c12a410 2024-09-19T06:47:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1ef4634740 10 client.0 _ll_register_callbacks cb 0x7f1ee000c7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eea7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c134cb0 0x55674c138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eea7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c134cb0 0x55674c138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41826/0 (socket says 172.21.15.12:41826) 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eea7fc640 1 -- 172.21.15.12:0/2698269784 learned_addr learned my addr 172.21.15.12:0/2698269784 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c129af0 0x55674c13d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eea7fc640 1 -- 172.21.15.12:0/2698269784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c12a410 msgr2=0x55674c13d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c12a410 0x55674c13d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eea7fc640 1 -- 172.21.15.12:0/2698269784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c129af0 msgr2=0x55674c13d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c129af0 0x55674c13d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eea7fc640 1 -- 172.21.15.12:0/2698269784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55674c138e40 con 0x55674c134cb0 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eea7fc640 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c134cb0 0x55674c138610 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00059f0 tx=0x7f1ee0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90509808f51aed2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.866+0000 7f1eceff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1eceff5640 1 -- 172.21.15.12:0/2698269784 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0012e60 con 0x55674c134cb0 2024-09-19T06:47:46.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1eceff5640 1 -- 172.21.15.12:0/2698269784 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f1ee0005020 con 0x55674c134cb0 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1ef4634740 1 -- 172.21.15.12:0/2698269784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1edc02c070 con 0x55674c134cb0 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1eceff5640 1 -- 172.21.15.12:0/2698269784 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1ee0011e70 con 0x55674c134cb0 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1ef4634740 10 client.17601 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1ef4634740 1 -- 172.21.15.12:0/2698269784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55674c1af600 con 0x55674c134cb0 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1eceff5640 1 -- 172.21.15.12:0/2698269784 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1edc02c070 con 0x55674c134cb0 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1eceff5640 1 -- 172.21.15.12:0/2698269784 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f1ee002d040 con 0x55674c134cb0 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1ef4634740 10 client.17601 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1ef4634740 10 client.17601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1ef4634740 20 client.17601 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1ef4634740 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55674c1afd90 0x55674c1b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1ef4634740 4 client.17601 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:47:46.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1ef4634740 1 -- 172.21.15.12:0/2698269784 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55674c095d70 con 0x55674c1afd90 2024-09-19T06:47:46.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.867+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55674c1afd90 0x55674c1b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:46.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.868+0000 7f1eeaffd640 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55674c1afd90 0x55674c1b21f0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68370e444c389ecc server_cookie=a042d85a880b8b3d in_seq=0 out_seq=0 2024-09-19T06:47:46.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.868+0000 7f1eceff5640 10 client.17601 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1eceff5640 1 -- 172.21.15.12:0/2698269784 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55674c095d70 con 0x55674c1afd90 2024-09-19T06:47:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1eceff5640 10 client.17601 handle_command_reply: tid=0 2024-09-19T06:47:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1ef4634740 1 client.17601 shutdown 2024-09-19T06:47:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1ef4634740 1 -- 172.21.15.12:0/2698269784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c134cb0 msgr2=0x55674c138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1ef4634740 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c134cb0 0x55674c138610 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00059f0 tx=0x7f1ee0011810 comp rx=0 tx=0).stop 2024-09-19T06:47:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1ef4634740 1 -- 172.21.15.12:0/2698269784 shutdown_connections 2024-09-19T06:47:46.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1ef4634740 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55674c1afd90 0x55674c1b21f0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1ef4634740 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55674c134cb0 0x55674c138610 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1ef4634740 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55674c12a410 0x55674c13d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1ef4634740 1 --2- 172.21.15.12:0/2698269784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55674c129af0 0x55674c13d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1ef4634740 1 -- 172.21.15.12:0/2698269784 >> 172.21.15.12:0/2698269784 conn(0x55674c126060 msgr2=0x55674c1249a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:46.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1eceff5640 0 client.17601 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:46.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.882+0000 7f1ef4634740 1 -- 172.21.15.12:0/2698269784 shutdown_connections 2024-09-19T06:47:46.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef4634740 1 -- 172.21.15.12:0/2698269784 wait complete. 2024-09-19T06:47:46.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef4634740 20 client.17601 trim_cache size 0 max 16384 2024-09-19T06:47:46.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:47:46.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:47:46.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:47:46.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:47:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1934481975 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1ed40a34e0 msgr2=0x7f1ed40a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1ed40a34e0 0x7f1ed40a59a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40ee4c0 tx=0x7f1ee408ed20 comp rx=0 tx=0).stop 2024-09-19T06:47:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1934481975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eec10c0f0 msgr2=0x7f1eec19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eec10c0f0 0x7f1eec19cc00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1ee402ae70 tx=0x7f1ee402f5d0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1934481975 shutdown_connections 2024-09-19T06:47:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1eec10c0f0 0x7f1eec19cc00 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1ed40a34e0 0x7f1ed40a59a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1eec103640 0x7f1eec198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 --2- 172.21.15.12:0/1934481975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eec102d20 0x7f1eec198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1934481975 >> 172.21.15.12:0/1934481975 conn(0x7f1eec0fc6b0 msgr2=0x7f1eec0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1934481975 shutdown_connections 2024-09-19T06:47:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:46.883+0000 7f1ef17bd640 1 -- 172.21.15.12:0/1934481975 wait complete. 2024-09-19T06:47:48.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:47 smithi012 ceph-mon[30937]: pgmap v234: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 949 op/s 2024-09-19T06:47:48.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:47 smithi016 ceph-mon[34911]: pgmap v234: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 949 op/s 2024-09-19T06:47:48.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:47 smithi173 ceph-mon[35349]: pgmap v234: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 949 op/s 2024-09-19T06:47:49.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:49.831 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:50.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:49 smithi012 ceph-mon[30937]: pgmap v235: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 115 op/s 2024-09-19T06:47:50.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:49 smithi016 ceph-mon[34911]: pgmap v235: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 115 op/s 2024-09-19T06:47:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.294+0000 7f628214e640 1 -- 172.21.15.12:0/4230895174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f627c1027a0 msgr2=0x7f627c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.294+0000 7f628214e640 1 --2- 172.21.15.12:0/4230895174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f627c1027a0 0x7f627c1067f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f626c009900 tx=0x7f626c02a410 comp rx=0 tx=0).stop 2024-09-19T06:47:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.294+0000 7f628214e640 1 -- 172.21.15.12:0/4230895174 shutdown_connections 2024-09-19T06:47:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.294+0000 7f628214e640 1 --2- 172.21.15.12:0/4230895174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627c106f20 0x7f627c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.294+0000 7f628214e640 1 --2- 172.21.15.12:0/4230895174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f627c1027a0 0x7f627c1067f0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.294+0000 7f628214e640 1 --2- 172.21.15.12:0/4230895174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c101df0 0x7f627c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.294+0000 7f628214e640 1 -- 172.21.15.12:0/4230895174 >> 172.21.15.12:0/4230895174 conn(0x7f627c0fd8b0 msgr2=0x7f627c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.295+0000 7f628214e640 1 -- 172.21.15.12:0/4230895174 shutdown_connections 2024-09-19T06:47:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.295+0000 7f628214e640 1 -- 172.21.15.12:0/4230895174 wait complete. 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.295+0000 7f628214e640 1 Processor -- start 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.295+0000 7f628214e640 1 -- start start 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f628214e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f627c101df0 0x7f627c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f628214e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c1027a0 0x7f627c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f628214e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627c106f20 0x7f627c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f628214e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f627c111f80 con 0x7f627c101df0 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f628214e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f627c111e00 con 0x7f627c1027a0 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f628214e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f627c112100 con 0x7f627c106f20 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f627c101df0 0x7f627c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f627c101df0 0x7f627c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41832/0 (socket says 172.21.15.12:41832) 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627b7fe640 1 -- 172.21.15.12:0/300682301 learned_addr learned my addr 172.21.15.12:0/300682301 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627affd640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c1027a0 0x7f627c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627bfff640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627c106f20 0x7f627c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627b7fe640 1 -- 172.21.15.12:0/300682301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627c106f20 msgr2=0x7f627c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627b7fe640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627c106f20 0x7f627c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627b7fe640 1 -- 172.21.15.12:0/300682301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c1027a0 msgr2=0x7f627c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627b7fe640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c1027a0 0x7f627c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627b7fe640 1 -- 172.21.15.12:0/300682301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c19d3b0 con 0x7f627c101df0 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627bfff640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627c106f20 0x7f627c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f627b7fe640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f627c101df0 0x7f627c198400 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f626400c920 tx=0x7f626400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f6278ff9640 1 -- 172.21.15.12:0/300682301 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264007c70 con 0x7f627c101df0 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f628214e640 1 -- 172.21.15.12:0/300682301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627c19d6a0 con 0x7f627c101df0 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f6278ff9640 1 -- 172.21.15.12:0/300682301 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6264007e10 con 0x7f627c101df0 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.296+0000 7f6278ff9640 1 -- 172.21.15.12:0/300682301 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6264018890 con 0x7f627c101df0 2024-09-19T06:47:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.297+0000 7f628214e640 1 -- 172.21.15.12:0/300682301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627c1a4f80 con 0x7f627c101df0 2024-09-19T06:47:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.298+0000 7f628214e640 1 -- 172.21.15.12:0/300682301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627c1021d0 con 0x7f627c101df0 2024-09-19T06:47:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.299+0000 7f6278ff9640 1 -- 172.21.15.12:0/300682301 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6264018a70 con 0x7f627c101df0 2024-09-19T06:47:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.300+0000 7f6278ff9640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62680a33b0 0x7f62680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.300+0000 7f627affd640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62680a33b0 0x7f62680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.300+0000 7f6278ff9640 1 -- 172.21.15.12:0/300682301 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f62640cffc0 con 0x7f627c101df0 2024-09-19T06:47:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.300+0000 7f627affd640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62680a33b0 0x7f62680a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f627c0fdcf0 tx=0x7f626c005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:50.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.304+0000 7f6278ff9640 1 -- 172.21.15.12:0/300682301 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6264014030 con 0x7f627c101df0 2024-09-19T06:47:50.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:49 smithi173 ceph-mon[35349]: pgmap v235: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.5 MiB/s wr, 115 op/s 2024-09-19T06:47:50.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.519+0000 7f628214e640 1 -- 172.21.15.12:0/300682301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f627c10a160 con 0x7f627c101df0 2024-09-19T06:47:50.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.519+0000 7f6278ff9640 1 -- 172.21.15.12:0/300682301 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11975 (secure 0 0 0) 0x7f626400de20 con 0x7f627c101df0 2024-09-19T06:47:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:47:50.521 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":41,"btime":"2024-09-19T06:47:33:822619+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:47:33.423317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:47:50.522 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 41 2024-09-19T06:47:50.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.522+0000 7f628214e640 1 -- 172.21.15.12:0/300682301 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62680a33b0 msgr2=0x7f62680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.522+0000 7f628214e640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62680a33b0 0x7f62680a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f627c0fdcf0 tx=0x7f626c005a20 comp rx=0 tx=0).stop 2024-09-19T06:47:50.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.522+0000 7f628214e640 1 -- 172.21.15.12:0/300682301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f627c101df0 msgr2=0x7f627c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:50.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.522+0000 7f628214e640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f627c101df0 0x7f627c198400 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f626400c920 tx=0x7f626400cde0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.522+0000 7f628214e640 1 -- 172.21.15.12:0/300682301 shutdown_connections 2024-09-19T06:47:50.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.522+0000 7f628214e640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62680a33b0 0x7f62680a5870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.522+0000 7f628214e640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f627c106f20 0x7f627c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.522+0000 7f628214e640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c1027a0 0x7f627c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.522+0000 7f628214e640 1 --2- 172.21.15.12:0/300682301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f627c101df0 0x7f627c198400 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:50.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.522+0000 7f628214e640 1 -- 172.21.15.12:0/300682301 >> 172.21.15.12:0/300682301 conn(0x7f627c0fd8b0 msgr2=0x7f627c0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:50.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.523+0000 7f628214e640 1 -- 172.21.15.12:0/300682301 shutdown_connections 2024-09-19T06:47:50.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:50.523+0000 7f628214e640 1 -- 172.21.15.12:0/300682301 wait complete. 2024-09-19T06:47:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:47:51.125 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:50 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/300682301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:51.158 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 58f4efdb --release --await' 2024-09-19T06:47:51.158 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 58f4efdb --release --await 2024-09-19T06:47:51.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:50 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/300682301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:51.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:50 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/300682301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:51.419 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:51.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.934+0000 7f59fe1ea640 1 -- 172.21.15.12:0/728629796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f8102d40 msgr2=0x7f59f8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.934+0000 7f59fe1ea640 1 --2- 172.21.15.12:0/728629796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f8102d40 0x7f59f8103120 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009900 tx=0x7f59e802a480 comp rx=0 tx=0).stop 2024-09-19T06:47:51.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.934+0000 7f59fe1ea640 1 -- 172.21.15.12:0/728629796 shutdown_connections 2024-09-19T06:47:51.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.934+0000 7f59fe1ea640 1 --2- 172.21.15.12:0/728629796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59f810c170 0x7f59f810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.934+0000 7f59fe1ea640 1 --2- 172.21.15.12:0/728629796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59f8103660 0x7f59f810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.934+0000 7f59fe1ea640 1 --2- 172.21.15.12:0/728629796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f8102d40 0x7f59f8103120 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.934+0000 7f59fe1ea640 1 -- 172.21.15.12:0/728629796 >> 172.21.15.12:0/728629796 conn(0x7f59f80fc7a0 msgr2=0x7f59f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.935+0000 7f59fe1ea640 1 -- 172.21.15.12:0/728629796 shutdown_connections 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.935+0000 7f59fe1ea640 1 -- 172.21.15.12:0/728629796 wait complete. 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.935+0000 7f59fe1ea640 1 Processor -- start 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.935+0000 7f59fe1ea640 1 -- start start 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59fe1ea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59f8102d40 0x7f59f8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59fe1ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f8103660 0x7f59f81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59fe1ea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59f810c170 0x7f59f819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59fe1ea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8111fb0 con 0x7f59f8103660 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59fe1ea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8111e30 con 0x7f59f810c170 2024-09-19T06:47:51.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59fe1ea640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8112130 con 0x7f59f8102d40 2024-09-19T06:47:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f8103660 0x7f59f81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f8103660 0x7f59f81989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51064/0 (socket says 172.21.15.12:51064) 2024-09-19T06:47:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f6ffd640 1 -- 172.21.15.12:0/2124837836 learned_addr learned my addr 172.21.15.12:0/2124837836 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f7fff640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59f810c170 0x7f59f819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f6ffd640 1 -- 172.21.15.12:0/2124837836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59f8102d40 msgr2=0x7f59f8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59f8102d40 0x7f59f8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f6ffd640 1 -- 172.21.15.12:0/2124837836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59f810c170 msgr2=0x7f59f819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59f810c170 0x7f59f819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f6ffd640 1 -- 172.21.15.12:0/2124837836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f819d420 con 0x7f59f8103660 2024-09-19T06:47:51.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f8103660 0x7f59f81989b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00d740 tx=0x7f59ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f4ff9640 1 -- 172.21.15.12:0/2124837836 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec017070 con 0x7f59f8103660 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f4ff9640 1 -- 172.21.15.12:0/2124837836 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59ec00de50 con 0x7f59f8103660 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59fe1ea640 1 -- 172.21.15.12:0/2124837836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f819d710 con 0x7f59f8103660 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59f4ff9640 1 -- 172.21.15.12:0/2124837836 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00f620 con 0x7f59f8103660 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.936+0000 7f59fe1ea640 1 -- 172.21.15.12:0/2124837836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f81a4ff0 con 0x7f59f8103660 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f59f4ff9640 1 -- 172.21.15.12:0/2124837836 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f59ec009c30 con 0x7f59f8103660 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f5a005c3740 1 Processor -- start 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f5a005c3740 1 -- start start 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c060 0x55888905c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c980 0x558889066d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889069630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f5a005c3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558888fc1620 con 0x558889067240 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f5a005c3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558888f68e50 con 0x55888905c980 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f5a005c3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558888fbd5e0 con 0x55888905c060 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f59f6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f59f6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889069630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51076/0 (socket says 172.21.15.12:51076) 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.939+0000 7f59f6ffd640 1 -- 172.21.15.12:0/1722177961 learned_addr learned my addr 172.21.15.12:0/1722177961 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1722177961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c980 0x558889066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f7fff640 1 --2- 172.21.15.12:0/1722177961 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c060 0x55888905c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f4ff9640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59e00a3430 0x7f59e00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f77fe640 1 -- 172.21.15.12:0/1722177961 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c060 msgr2=0x55888905c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1722177961 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c060 0x55888905c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f77fe640 1 -- 172.21.15.12:0/1722177961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 msgr2=0x558889069630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1722177961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889069630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f77fe640 1 -- 172.21.15.12:0/1722177961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558888f59d40 con 0x55888905c980 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/1722177961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889069630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f7fff640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59e00a3430 0x7f59e00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f4ff9640 1 -- 172.21.15.12:0/2124837836 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f59ec0cf9a0 con 0x7f59f8103660 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1722177961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c980 0x558889066d00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009900 tx=0x7f59e8005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7079ec766740b95f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59ddffb640 1 -- 172.21.15.12:0/1722177961 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8040020 con 0x55888905c980 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59ddffb640 1 -- 172.21.15.12:0/1722177961 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59e8004040 con 0x55888905c980 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.940+0000 7f59ddffb640 1 -- 172.21.15.12:0/1722177961 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8035040 con 0x55888905c980 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f5a005c3740 1 -- 172.21.15.12:0/1722177961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c980 msgr2=0x558889066d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1722177961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c980 0x558889066d00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009900 tx=0x7f59e8005d50 comp rx=0 tx=0).stop 2024-09-19T06:47:51.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f59f7fff640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59e00a3430 0x7f59e00a58f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009fd0 tx=0x7f59f0004b50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f5a005c3740 1 -- 172.21.15.12:0/1722177961 shutdown_connections 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1722177961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889069630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1722177961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c980 0x558889066d00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1722177961 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c060 0x55888905c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f5a005c3740 1 -- 172.21.15.12:0/1722177961 >> 172.21.15.12:0/1722177961 conn(0x5588890585f0 msgr2=0x5588890589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f5a005c3740 1 -- 172.21.15.12:0/1722177961 shutdown_connections 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f5a005c3740 1 -- 172.21.15.12:0/1722177961 wait complete. 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.941+0000 7f5a005c3740 1 -- start start 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f5a005c3740 1 Processor -- start 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c060 0x558889064120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x558889064660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f5a005c3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558889069e10 con 0x558889067240 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f5a005c3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558888f49f10 con 0x55888905c060 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f5a005c3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558889069f90 con 0x55888905c980 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f5a005c3740 10 client.0 _ll_register_callbacks cb 0x558888f6ddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889064ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51088/0 (socket says 172.21.15.12:51088) 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f7fff640 1 -- 172.21.15.12:0/1213239005 learned_addr learned my addr 172.21.15.12:0/1213239005 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x558889064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c060 0x558889064120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f7fff640 1 -- 172.21.15.12:0/1213239005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 msgr2=0x558889064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f7fff640 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x558889064660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f7fff640 1 -- 172.21.15.12:0/1213239005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c060 msgr2=0x558889064120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f7fff640 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c060 0x558889064120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f7fff640 1 -- 172.21.15.12:0/1213239005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558888cd0580 con 0x558889067240 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x558889064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.942+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c060 0x558889064120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f59f7fff640 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889064ba0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f59f0016e20 tx=0x7f59f000d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bd419cbf4b1912 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f59d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f59d6ffd640 1 -- 172.21.15.12:0/1213239005 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0027060 con 0x558889067240 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f59d6ffd640 1 -- 172.21.15.12:0/1213239005 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f59f0022610 con 0x558889067240 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f5a005c3740 1 -- 172.21.15.12:0/1213239005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59e8004040 con 0x558889067240 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f59d6ffd640 1 -- 172.21.15.12:0/1213239005 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f59f002e050 con 0x558889067240 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f5a005c3740 10 client.17619 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f5a005c3740 1 -- 172.21.15.12:0/1213239005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x558888d9a960 con 0x558889067240 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f59d6ffd640 1 -- 172.21.15.12:0/1213239005 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59e8004040 con 0x558889067240 2024-09-19T06:47:51.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f59d6ffd640 1 -- 172.21.15.12:0/1213239005 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f59f0021950 con 0x558889067240 2024-09-19T06:47:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f5a005c3740 10 client.17619 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f5a005c3740 10 client.17619 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:47:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f5a005c3740 20 client.17619 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558889076e60 0x5588890792f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f5a005c3740 4 client.17619 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.943+0000 7f5a005c3740 1 -- 172.21.15.12:0/1213239005 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558888fceb90 con 0x558889076e60 2024-09-19T06:47:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.944+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558889076e60 0x5588890792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.944+0000 7f59d6ffd640 10 client.17619 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:51.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.944+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558889076e60 0x5588890792f0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41b6961ced9943bd server_cookie=96ae80585a20c930 in_seq=0 out_seq=0 2024-09-19T06:47:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f59d6ffd640 1 -- 172.21.15.12:0/1213239005 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558888fceb90 con 0x558889076e60 2024-09-19T06:47:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f59d6ffd640 10 client.17619 handle_command_reply: tid=0 2024-09-19T06:47:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 client.17619 shutdown 2024-09-19T06:47:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 -- 172.21.15.12:0/1213239005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 msgr2=0x558889064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889064ba0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f59f0016e20 tx=0x7f59f000d040 comp rx=0 tx=0).stop 2024-09-19T06:47:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 -- 172.21.15.12:0/1213239005 shutdown_connections 2024-09-19T06:47:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558889076e60 0x5588890792f0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558889067240 0x558889064ba0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f59d6ffd640 0 client.17619 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:51.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x558889064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1213239005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55888905c060 0x558889064120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 -- 172.21.15.12:0/1213239005 >> 172.21.15.12:0/1213239005 conn(0x5588890585f0 msgr2=0x55888905e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:51.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 -- 172.21.15.12:0/1213239005 shutdown_connections 2024-09-19T06:47:51.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 1 -- 172.21.15.12:0/1213239005 wait complete. 2024-09-19T06:47:51.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.945+0000 7f5a005c3740 20 client.17619 trim_cache size 0 max 16384 2024-09-19T06:47:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.962+0000 7f5a005c3740 1 Processor -- start 2024-09-19T06:47:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.962+0000 7f5a005c3740 1 -- start start 2024-09-19T06:47:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.962+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x55888906f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.962+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x55888906fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 0x55888907ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f5a005c3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81adb20 con 0x55888905c060 2024-09-19T06:47:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f5a005c3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81af6f0 con 0x558889067240 2024-09-19T06:47:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f5a005c3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81ae1f0 con 0x55888905c980 2024-09-19T06:47:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x55888906f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x55888906f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51102/0 (socket says 172.21.15.12:51102) 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f77fe640 1 -- 172.21.15.12:0/1756503194 learned_addr learned my addr 172.21.15.12:0/1756503194 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f7fff640 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 0x55888907ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x55888906fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f77fe640 1 -- 172.21.15.12:0/1756503194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 msgr2=0x55888906fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x55888906fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f77fe640 1 -- 172.21.15.12:0/1756503194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 msgr2=0x55888907ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 0x55888907ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f77fe640 1 -- 172.21.15.12:0/1756503194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558889069990 con 0x55888905c060 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f7fff640 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 0x55888907ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x55888906fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59f77fe640 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x55888906f5c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f59e80057c0 tx=0x7f59e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb95b685d5b02257 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59dd7fa640 1 -- 172.21.15.12:0/1756503194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8040070 con 0x55888905c060 2024-09-19T06:47:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59dd7fa640 1 -- 172.21.15.12:0/1756503194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59e803e040 con 0x55888905c060 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.963+0000 7f59dd7fa640 1 -- 172.21.15.12:0/1756503194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8035040 con 0x55888905c060 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.964+0000 7f5a005c3740 1 -- 172.21.15.12:0/1756503194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 msgr2=0x55888906f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.964+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x55888906f5c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f59e80057c0 tx=0x7f59e8009260 comp rx=0 tx=0).stop 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.964+0000 7f5a005c3740 1 -- 172.21.15.12:0/1756503194 shutdown_connections 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.964+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 0x55888907ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.964+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x55888906fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.964+0000 7f5a005c3740 1 --2- 172.21.15.12:0/1756503194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x55888906f5c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.964+0000 7f5a005c3740 1 -- 172.21.15.12:0/1756503194 >> 172.21.15.12:0/1756503194 conn(0x5588890585f0 msgr2=0x5588890629f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.964+0000 7f5a005c3740 1 -- 172.21.15.12:0/1756503194 shutdown_connections 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.964+0000 7f5a005c3740 1 -- 172.21.15.12:0/1756503194 wait complete. 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.964+0000 7f5a005c3740 1 -- start start 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f5a005c3740 1 Processor -- start 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x5588890d9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x5588890da270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f5a005c3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 0x5588890ddc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f5a005c3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81aeff0 con 0x55888905c060 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f5a005c3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81ae920 con 0x558889067240 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f5a005c3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f59f81abb20 con 0x55888905c980 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x5588890d9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f5a005c3740 10 client.0 _ll_register_callbacks cb 0x7f59f0016a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x5588890d9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51104/0 (socket says 172.21.15.12:51104) 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f77fe640 1 -- 172.21.15.12:0/3328036376 learned_addr learned my addr 172.21.15.12:0/3328036376 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f7fff640 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 0x5588890ddc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x5588890da270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f77fe640 1 -- 172.21.15.12:0/3328036376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 msgr2=0x5588890da270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f77fe640 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x5588890da270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f77fe640 1 -- 172.21.15.12:0/3328036376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 msgr2=0x5588890ddc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f77fe640 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 0x5588890ddc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f77fe640 1 -- 172.21.15.12:0/3328036376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588890de310 con 0x55888905c060 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f7fff640 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 0x5588890ddc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.965+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x5588890da270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f59f77fe640 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x5588890d9d30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009900 tx=0x7f59e8004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b6eb628353c6d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f59d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f59d6ffd640 1 -- 172.21.15.12:0/3328036376 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8035030 con 0x55888905c060 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f59d6ffd640 1 -- 172.21.15.12:0/3328036376 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f59e8005040 con 0x55888905c060 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f5a005c3740 1 -- 172.21.15.12:0/3328036376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59e803e040 con 0x55888905c060 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f59d6ffd640 1 -- 172.21.15.12:0/3328036376 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f59e8040040 con 0x55888905c060 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f5a005c3740 10 client.17625 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f5a005c3740 1 -- 172.21.15.12:0/3328036376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5588890e6850 con 0x55888905c060 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f59d6ffd640 1 -- 172.21.15.12:0/3328036376 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59e803e040 con 0x55888905c060 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f59d6ffd640 1 -- 172.21.15.12:0/3328036376 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f59e80318f0 con 0x55888905c060 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f5a005c3740 10 client.17625 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f5a005c3740 10 client.17625 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f5a005c3740 20 client.17625 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f5a005c3740 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5588890e6b20 0x5588890e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f5a005c3740 4 client.17625 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "58f4efdb", "release": true, "await": true}] 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.966+0000 7f5a005c3740 1 -- 172.21.15.12:0/3328036376 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "58f4efdb", "release": true, "await": true}) -- 0x558888fc90a0 con 0x5588890e6b20 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.967+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5588890e6b20 0x5588890e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.967+0000 7f59f6ffd640 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5588890e6b20 0x5588890e8f10 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd82b039a7f76e59 server_cookie=2bc7b735da7c47d1 in_seq=0 out_seq=0 2024-09-19T06:47:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:51.967+0000 7f59d6ffd640 10 client.17625 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f59d6ffd640 1 -- 172.21.15.12:0/3328036376 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558888fc90a0 con 0x5588890e6b20 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f59d6ffd640 10 client.17625 handle_command_reply: tid=0 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 client.17625 shutdown 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 -- 172.21.15.12:0/3328036376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 msgr2=0x5588890d9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x5588890d9d30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009900 tx=0x7f59e8004540 comp rx=0 tx=0).stop 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 -- 172.21.15.12:0/3328036376 shutdown_connections 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5588890e6b20 0x5588890e8f10 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558889067240 0x5588890ddc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55888905c980 0x5588890da270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 --2- 172.21.15.12:0/3328036376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55888905c060 0x5588890d9d30 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:52.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 -- 172.21.15.12:0/3328036376 >> 172.21.15.12:0/3328036376 conn(0x5588890585f0 msgr2=0x558889056f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:52.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f59d6ffd640 0 client.17625 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:52.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 -- 172.21.15.12:0/3328036376 shutdown_connections 2024-09-19T06:47:52.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.005+0000 7f5a005c3740 1 -- 172.21.15.12:0/3328036376 wait complete. 2024-09-19T06:47:52.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.006+0000 7f5a005c3740 20 client.17625 trim_cache size 0 max 16384 2024-09-19T06:47:52.008 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:47:52.008 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 41, 2024-09-19T06:47:52.008 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 28, 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "58f4efdb": { 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 28, 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 145.8, 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:47:52.009 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:47:52.010 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:47:52.010 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:47:52.010 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:47:52.010 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:47:52.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:52.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:52.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:52.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:52.010 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:52.010 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.006+0000 7f59fe1ea640 1 -- 172.21.15.12:0/2124837836 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59e00a3430 msgr2=0x7f59e00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.006+0000 7f59fe1ea640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59e00a3430 0x7f59e00a58f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009fd0 tx=0x7f59f0004b50 comp rx=0 tx=0).stop 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.006+0000 7f59fe1ea640 1 -- 172.21.15.12:0/2124837836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f8103660 msgr2=0x7f59f81989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.006+0000 7f59fe1ea640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f8103660 0x7f59f81989b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00d740 tx=0x7f59ec00dc00 comp rx=0 tx=0).stop 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.006+0000 7f59fe1ea640 1 -- 172.21.15.12:0/2124837836 shutdown_connections 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.007+0000 7f59fe1ea640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59f810c170 0x7f59f819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.007+0000 7f59fe1ea640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f8103660 0x7f59f81989b0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.007+0000 7f59fe1ea640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59e00a3430 0x7f59e00a58f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.007+0000 7f59fe1ea640 1 --2- 172.21.15.12:0/2124837836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59f8102d40 0x7f59f8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.007+0000 7f59fe1ea640 1 -- 172.21.15.12:0/2124837836 >> 172.21.15.12:0/2124837836 conn(0x7f59f80fc7a0 msgr2=0x7f59f80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:52.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.007+0000 7f59fe1ea640 1 -- 172.21.15.12:0/2124837836 shutdown_connections 2024-09-19T06:47:52.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:52.007+0000 7f59fe1ea640 1 -- 172.21.15.12:0/2124837836 wait complete. 2024-09-19T06:47:52.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:51 smithi012 ceph-mon[30937]: pgmap v236: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-09-19T06:47:52.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:51 smithi016 ceph-mon[34911]: pgmap v236: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-09-19T06:47:52.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:51 smithi173 ceph-mon[35349]: pgmap v236: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-09-19T06:47:52.762 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '58f4efdb', total seconds elapsed: 28.9 2024-09-19T06:47:52.762 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T06:47:52.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:47:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:53.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.736+0000 7f37ea285640 1 -- 172.21.15.12:0/868652542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e4109450 msgr2=0x7f37e4110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:53.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.736+0000 7f37ea285640 1 --2- 172.21.15.12:0/868652542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e4109450 0x7f37e4110250 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009860 tx=0x7f37d402a380 comp rx=0 tx=0).stop 2024-09-19T06:47:53.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.737+0000 7f37ea285640 1 -- 172.21.15.12:0/868652542 shutdown_connections 2024-09-19T06:47:53.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.737+0000 7f37ea285640 1 --2- 172.21.15.12:0/868652542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37e411b140 0x7f37e411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.737+0000 7f37ea285640 1 --2- 172.21.15.12:0/868652542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e4109830 0x7f37e4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.737+0000 7f37ea285640 1 --2- 172.21.15.12:0/868652542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e4109450 0x7f37e4110250 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.737+0000 7f37ea285640 1 -- 172.21.15.12:0/868652542 >> 172.21.15.12:0/868652542 conn(0x7f37e406e140 msgr2=0x7f37e406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.742+0000 7f37ea285640 1 -- 172.21.15.12:0/868652542 shutdown_connections 2024-09-19T06:47:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.742+0000 7f37ea285640 1 -- 172.21.15.12:0/868652542 wait complete. 2024-09-19T06:47:53.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.743+0000 7f37ea285640 1 Processor -- start 2024-09-19T06:47:53.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.743+0000 7f37ea285640 1 -- start start 2024-09-19T06:47:53.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.743+0000 7f37ea285640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e4109830 0x7f37e4118a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.743+0000 7f37ea285640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e411b140 0x7f37e41109f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.743+0000 7f37ea285640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37e4110f30 0x7f37e41113e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.743+0000 7f37ea285640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f37e4120df0 con 0x7f37e411b140 2024-09-19T06:47:53.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.743+0000 7f37ea285640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f37e4120c70 con 0x7f37e4109830 2024-09-19T06:47:53.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.743+0000 7f37ea285640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f37e4120f70 con 0x7f37e4110f30 2024-09-19T06:47:53.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.744+0000 7f37e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e4109830 0x7f37e4118a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.744+0000 7f37e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e4109830 0x7f37e4118a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46824/0 (socket says 172.21.15.12:46824) 2024-09-19T06:47:53.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.744+0000 7f37e3fff640 1 -- 172.21.15.12:0/14739948 learned_addr learned my addr 172.21.15.12:0/14739948 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:53.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.744+0000 7f37e8822640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37e4110f30 0x7f37e41113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.745+0000 7f37e3fff640 1 -- 172.21.15.12:0/14739948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37e4110f30 msgr2=0x7f37e41113e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:53.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.745+0000 7f37e3fff640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37e4110f30 0x7f37e41113e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.745+0000 7f37e3fff640 1 -- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e411b140 msgr2=0x7f37e41109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:53.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.745+0000 7f37e37fe640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e411b140 0x7f37e41109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.745+0000 7f37e3fff640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e411b140 0x7f37e41109f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:53.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.745+0000 7f37e3fff640 1 -- 172.21.15.12:0/14739948 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e41bc330 con 0x7f37e4109830 2024-09-19T06:47:53.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.745+0000 7f37e37fe640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e411b140 0x7f37e41109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:53.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.746+0000 7f37e3fff640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e4109830 0x7f37e4118a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f37d4035040 tx=0x7f37d4030f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:53.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.747+0000 7f37e17fa640 1 -- 172.21.15.12:0/14739948 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4037040 con 0x7f37e4109830 2024-09-19T06:47:53.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.747+0000 7f37e17fa640 1 -- 172.21.15.12:0/14739948 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37d4033de0 con 0x7f37e4109830 2024-09-19T06:47:53.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.748+0000 7f37e17fa640 1 -- 172.21.15.12:0/14739948 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4004a80 con 0x7f37e4109830 2024-09-19T06:47:53.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.748+0000 7f37ea285640 1 -- 172.21.15.12:0/14739948 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e41bc5c0 con 0x7f37e4109830 2024-09-19T06:47:53.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.748+0000 7f37ea285640 1 -- 172.21.15.12:0/14739948 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e41bc9f0 con 0x7f37e4109830 2024-09-19T06:47:53.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.751+0000 7f37ea285640 1 -- 172.21.15.12:0/14739948 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e4073b00 con 0x7f37e4109830 2024-09-19T06:47:53.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.752+0000 7f37e17fa640 1 -- 172.21.15.12:0/14739948 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f37d40306d0 con 0x7f37e4109830 2024-09-19T06:47:53.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.753+0000 7f37e17fa640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37cc0a3420 0x7f37cc0a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:53.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.754+0000 7f37e17fa640 1 -- 172.21.15.12:0/14739948 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f37d40eef40 con 0x7f37e4109830 2024-09-19T06:47:53.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.755+0000 7f37e37fe640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37cc0a3420 0x7f37cc0a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:53.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.756+0000 7f37e37fe640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37cc0a3420 0x7f37cc0a58e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f37e41121b0 tx=0x7f37d8005d30 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:53.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:53.759+0000 7f37e17fa640 1 -- 172.21.15.12:0/14739948 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37d40bba20 con 0x7f37e4109830 2024-09-19T06:47:54.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:53 smithi012 ceph-mon[30937]: pgmap v237: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 27 KiB/s wr, 99 op/s 2024-09-19T06:47:54.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.137+0000 7f37ea285640 1 -- 172.21.15.12:0/14739948 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37e410b3a0 con 0x7f37e4109830 2024-09-19T06:47:54.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.141+0000 7f37e17fa640 1 -- 172.21.15.12:0/14739948 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11975 (secure 0 0 0) 0x7f37d40bb320 con 0x7f37e4109830 2024-09-19T06:47:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:47:54.144 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":41,"btime":"2024-09-19T06:47:33:822619+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:47:33.423317+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:47:54.144 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 41 2024-09-19T06:47:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 -- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37cc0a3420 msgr2=0x7f37cc0a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37cc0a3420 0x7f37cc0a58e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f37e41121b0 tx=0x7f37d8005d30 comp rx=0 tx=0).stop 2024-09-19T06:47:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 -- 172.21.15.12:0/14739948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e4109830 msgr2=0x7f37e4118a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e4109830 0x7f37e4118a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f37d4035040 tx=0x7f37d4030f30 comp rx=0 tx=0).stop 2024-09-19T06:47:54.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 -- 172.21.15.12:0/14739948 shutdown_connections 2024-09-19T06:47:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37cc0a3420 0x7f37cc0a58e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37e4110f30 0x7f37e41113e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37e411b140 0x7f37e41109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 --2- 172.21.15.12:0/14739948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e4109830 0x7f37e4118a20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 -- 172.21.15.12:0/14739948 >> 172.21.15.12:0/14739948 conn(0x7f37e406e140 msgr2=0x7f37e411c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 -- 172.21.15.12:0/14739948 shutdown_connections 2024-09-19T06:47:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:54.147+0000 7f37ea285640 1 -- 172.21.15.12:0/14739948 wait complete. 2024-09-19T06:47:54.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:53 smithi016 ceph-mon[34911]: pgmap v237: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 27 KiB/s wr, 99 op/s 2024-09-19T06:47:54.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:53 smithi173 ceph-mon[35349]: pgmap v237: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 27 KiB/s wr, 99 op/s 2024-09-19T06:47:54.895 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T06:47:54.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T06:47:55.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:54 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/14739948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:55.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:54 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/14739948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:55.320 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:47:55.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:54 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/14739948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:47:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 430.0 s, 2471.5 tps, lat 232.523 ms stddev 2236.269 2024-09-19T06:47:56.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:55 smithi012 ceph-mon[30937]: pgmap v238: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 823 KiB/s wr, 134 op/s 2024-09-19T06:47:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.100+0000 7f623e78f640 1 -- 172.21.15.12:0/1584966907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6238105f30 msgr2=0x7f62381063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.100+0000 7f623e78f640 1 --2- 172.21.15.12:0/1584966907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6238105f30 0x7f62381063c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f623001acb0 tx=0x7f623003b970 comp rx=0 tx=0).stop 2024-09-19T06:47:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.100+0000 7f623e78f640 1 -- 172.21.15.12:0/1584966907 shutdown_connections 2024-09-19T06:47:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.100+0000 7f623e78f640 1 --2- 172.21.15.12:0/1584966907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6238105f30 0x7f62381063c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.100+0000 7f623e78f640 1 --2- 172.21.15.12:0/1584966907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6238101440 0x7f6238105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.100+0000 7f623e78f640 1 --2- 172.21.15.12:0/1584966907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6238100b20 0x7f6238100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.100+0000 7f623e78f640 1 -- 172.21.15.12:0/1584966907 >> 172.21.15.12:0/1584966907 conn(0x7f62380fc7d0 msgr2=0x7f62380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.100+0000 7f623e78f640 1 -- 172.21.15.12:0/1584966907 shutdown_connections 2024-09-19T06:47:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.101+0000 7f623e78f640 1 -- 172.21.15.12:0/1584966907 wait complete. 2024-09-19T06:47:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.101+0000 7f623e78f640 1 Processor -- start 2024-09-19T06:47:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f623e78f640 1 -- start start 2024-09-19T06:47:56.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f623e78f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6238100b20 0x7f6238072ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f623e78f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6238101440 0x7f62380731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f623e78f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6238105f30 0x7f623810d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f623e78f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62381097c0 con 0x7f6238100b20 2024-09-19T06:47:56.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f623e78f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6238109640 con 0x7f6238101440 2024-09-19T06:47:56.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f623e78f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6238109940 con 0x7f6238105f30 2024-09-19T06:47:56.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f6237fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6238100b20 0x7f6238072ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f6237fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6238100b20 0x7f6238072ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51148/0 (socket says 172.21.15.12:51148) 2024-09-19T06:47:56.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f6237fff640 1 -- 172.21.15.12:0/3375116131 learned_addr learned my addr 172.21.15.12:0/3375116131 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:56.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.102+0000 7f623cd2c640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6238105f30 0x7f623810d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.103+0000 7f62377fe640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6238101440 0x7f62380731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.103+0000 7f623cd2c640 1 -- 172.21.15.12:0/3375116131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6238101440 msgr2=0x7f62380731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.103+0000 7f623cd2c640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6238101440 0x7f62380731e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.103+0000 7f623cd2c640 1 -- 172.21.15.12:0/3375116131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6238100b20 msgr2=0x7f6238072ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.103+0000 7f623cd2c640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6238100b20 0x7f6238072ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.103+0000 7f623cd2c640 1 -- 172.21.15.12:0/3375116131 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623810d630 con 0x7f6238105f30 2024-09-19T06:47:56.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.103+0000 7f62377fe640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6238101440 0x7f62380731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:56.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.104+0000 7f623cd2c640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6238105f30 0x7f623810d0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f623003bee0 tx=0x7f6230040730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.104+0000 7f62357fa640 1 -- 172.21.15.12:0/3375116131 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230045070 con 0x7f6238105f30 2024-09-19T06:47:56.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.104+0000 7f62357fa640 1 -- 172.21.15.12:0/3375116131 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6230003e50 con 0x7f6238105f30 2024-09-19T06:47:56.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.104+0000 7f62357fa640 1 -- 172.21.15.12:0/3375116131 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230004420 con 0x7f6238105f30 2024-09-19T06:47:56.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.105+0000 7f623e78f640 1 -- 172.21.15.12:0/3375116131 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623810d8c0 con 0x7f6238105f30 2024-09-19T06:47:56.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.105+0000 7f623e78f640 1 -- 172.21.15.12:0/3375116131 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f623810ddb0 con 0x7f6238105f30 2024-09-19T06:47:56.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.110+0000 7f6240b68740 1 Processor -- start 2024-09-19T06:47:56.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.111+0000 7f62357fa640 1 -- 172.21.15.12:0/3375116131 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6230048020 con 0x7f6238105f30 2024-09-19T06:47:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.112+0000 7f62357fa640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62200a3540 0x7f62200a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.112+0000 7f62357fa640 1 -- 172.21.15.12:0/3375116131 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f62300cbde0 con 0x7f6238105f30 2024-09-19T06:47:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.112+0000 7f6240b68740 1 -- start start 2024-09-19T06:47:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6240b68740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c8624c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6240b68740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8625170 0x5590c862f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6240b68740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8631e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6240b68740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5590c8589160 con 0x5590c8625170 2024-09-19T06:47:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6240b68740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5590c8530720 con 0x5590c8624850 2024-09-19T06:47:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6240b68740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5590c8585120 con 0x5590c862fa30 2024-09-19T06:47:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6237fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c8624c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6237fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c8624c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46844/0 (socket says 172.21.15.12:46844) 2024-09-19T06:47:56.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6237fff640 1 -- 172.21.15.12:0/1751856130 learned_addr learned my addr 172.21.15.12:0/1751856130 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:56.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f623cd2c640 1 --2- 172.21.15.12:0/1751856130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8631e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6237fff640 1 -- 172.21.15.12:0/1751856130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 msgr2=0x5590c8631e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6237fff640 1 --2- 172.21.15.12:0/1751856130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8631e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6237fff640 1 -- 172.21.15.12:0/1751856130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8625170 msgr2=0x5590c862f4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:47:56.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6237fff640 1 --2- 172.21.15.12:0/1751856130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8625170 0x5590c862f4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.113+0000 7f6237fff640 1 -- 172.21.15.12:0/1751856130 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c82faba0 con 0x5590c8624850 2024-09-19T06:47:56.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.114+0000 7f6237fff640 1 --2- 172.21.15.12:0/1751856130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c8624c30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f622800b7e0 tx=0x7f622800bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f1298aeff82111c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.114+0000 7f62377fe640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62200a3540 0x7f62200a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.114+0000 7f621e7fc640 1 -- 172.21.15.12:0/1751856130 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228003dd0 con 0x5590c8624850 2024-09-19T06:47:56.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.114+0000 7f621e7fc640 1 -- 172.21.15.12:0/1751856130 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6228015070 con 0x5590c8624850 2024-09-19T06:47:56.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.114+0000 7f621e7fc640 1 -- 172.21.15.12:0/1751856130 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62280107a0 con 0x5590c8624850 2024-09-19T06:47:56.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.115+0000 7f6240b68740 1 -- 172.21.15.12:0/1751856130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 msgr2=0x5590c8624c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.115+0000 7f6240b68740 1 --2- 172.21.15.12:0/1751856130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c8624c30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f622800b7e0 tx=0x7f622800bca0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.115+0000 7f6240b68740 1 -- 172.21.15.12:0/1751856130 shutdown_connections 2024-09-19T06:47:56.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.115+0000 7f6240b68740 1 --2- 172.21.15.12:0/1751856130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8631e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.115+0000 7f6240b68740 1 --2- 172.21.15.12:0/1751856130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8625170 0x5590c862f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.115+0000 7f6240b68740 1 --2- 172.21.15.12:0/1751856130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c8624c30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.115+0000 7f6240b68740 1 -- 172.21.15.12:0/1751856130 >> 172.21.15.12:0/1751856130 conn(0x5590c8620de0 msgr2=0x5590c86211c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.116+0000 7f6240b68740 1 -- 172.21.15.12:0/1751856130 shutdown_connections 2024-09-19T06:47:56.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.116+0000 7f6240b68740 1 -- 172.21.15.12:0/1751856130 wait complete. 2024-09-19T06:47:56.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.116+0000 7f62377fe640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62200a3540 0x7f62200a5a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5590c8621c40 tx=0x7f622c005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.116+0000 7f6240b68740 1 -- start start 2024-09-19T06:47:56.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.117+0000 7f6240b68740 1 Processor -- start 2024-09-19T06:47:56.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.117+0000 7f6240b68740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8624850 0x5590c862c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.117+0000 7f6240b68740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8625170 0x5590c862ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.117+0000 7f6240b68740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c862d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.117+0000 7f6240b68740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5590c8632600 con 0x5590c8624850 2024-09-19T06:47:56.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.117+0000 7f6240b68740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5590c8511900 con 0x5590c8625170 2024-09-19T06:47:56.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.117+0000 7f6240b68740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5590c8632780 con 0x5590c862fa30 2024-09-19T06:47:56.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.117+0000 7f6240b68740 10 client.0 _ll_register_callbacks cb 0x5590c850f780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:56.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.118+0000 7f623cd2c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c862d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.118+0000 7f623cd2c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c862d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46908/0 (socket says 172.21.15.12:46908) 2024-09-19T06:47:56.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.118+0000 7f623cd2c640 1 -- 172.21.15.12:0/568938564 learned_addr learned my addr 172.21.15.12:0/568938564 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:56.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.118+0000 7f623cd2c640 1 -- 172.21.15.12:0/568938564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8625170 msgr2=0x5590c862ce80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.118+0000 7f623cd2c640 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8625170 0x5590c862ce80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.118+0000 7f623cd2c640 1 -- 172.21.15.12:0/568938564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8624850 msgr2=0x5590c862c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.118+0000 7f623cd2c640 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8624850 0x5590c862c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.118+0000 7f623cd2c640 1 -- 172.21.15.12:0/568938564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c8551c50 con 0x5590c862fa30 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.119+0000 7f623cd2c640 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c862d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f62300cb190 tx=0x7f62300d5400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=649b8ceaae146aba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.119+0000 7f62177fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.119+0000 7f62177fe640 1 -- 172.21.15.12:0/568938564 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62300ca770 con 0x5590c862fa30 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.119+0000 7f62177fe640 1 -- 172.21.15.12:0/568938564 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f62300ff320 con 0x5590c862fa30 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.119+0000 7f6240b68740 1 -- 172.21.15.12:0/568938564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6228015070 con 0x5590c862fa30 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.119+0000 7f62177fe640 1 -- 172.21.15.12:0/568938564 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f62300ca910 con 0x5590c862fa30 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.119+0000 7f6240b68740 10 client.27049 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:56.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.119+0000 7f6240b68740 1 -- 172.21.15.12:0/568938564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5590c8632660 con 0x5590c862fa30 2024-09-19T06:47:56.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.121+0000 7f62177fe640 1 -- 172.21.15.12:0/568938564 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6228015070 con 0x5590c862fa30 2024-09-19T06:47:56.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.121+0000 7f62177fe640 1 -- 172.21.15.12:0/568938564 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f62300ca3b0 con 0x5590c862fa30 2024-09-19T06:47:56.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.121+0000 7f6240b68740 10 client.27049 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:56.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.121+0000 7f6240b68740 10 client.27049 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:47:56.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.121+0000 7f6240b68740 20 client.27049 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:56.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.121+0000 7f6240b68740 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590c863f9c0 0x5590c8641e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.121+0000 7f6240b68740 4 client.27049 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:47:56.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.121+0000 7f6240b68740 1 -- 172.21.15.12:0/568938564 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590c8596890 con 0x5590c863f9c0 2024-09-19T06:47:56.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.122+0000 7f6237fff640 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590c863f9c0 0x5590c8641e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.122+0000 7f6237fff640 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590c863f9c0 0x5590c8641e80 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62485fd071f4cf2e server_cookie=44c8ddacab80a684 in_seq=0 out_seq=0 2024-09-19T06:47:56.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.122+0000 7f62177fe640 10 client.27049 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:56.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.123+0000 7f62177fe640 1 -- 172.21.15.12:0/568938564 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590c8596890 con 0x5590c863f9c0 2024-09-19T06:47:56.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.123+0000 7f62177fe640 10 client.27049 handle_command_reply: tid=0 2024-09-19T06:47:56.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.123+0000 7f6240b68740 1 client.27049 shutdown 2024-09-19T06:47:56.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.123+0000 7f6240b68740 1 -- 172.21.15.12:0/568938564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 msgr2=0x5590c862d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.123+0000 7f6240b68740 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c862d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f62300cb190 tx=0x7f62300d5400 comp rx=0 tx=0).stop 2024-09-19T06:47:56.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.124+0000 7f6240b68740 1 -- 172.21.15.12:0/568938564 shutdown_connections 2024-09-19T06:47:56.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.124+0000 7f6240b68740 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590c863f9c0 0x5590c8641e80 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.124+0000 7f6240b68740 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c862d3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.124+0000 7f6240b68740 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8625170 0x5590c862ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.124+0000 7f62177fe640 0 client.27049 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:56.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.124+0000 7f6240b68740 1 --2- 172.21.15.12:0/568938564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8624850 0x5590c862c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.124+0000 7f6240b68740 1 -- 172.21.15.12:0/568938564 >> 172.21.15.12:0/568938564 conn(0x5590c8620de0 msgr2=0x5590c8626b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.124+0000 7f6240b68740 1 -- 172.21.15.12:0/568938564 shutdown_connections 2024-09-19T06:47:56.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.124+0000 7f6240b68740 1 -- 172.21.15.12:0/568938564 wait complete. 2024-09-19T06:47:56.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.124+0000 7f6240b68740 20 client.27049 trim_cache size 0 max 16384 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6240b68740 1 Processor -- start 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6240b68740 1 -- start start 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6240b68740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c86272b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6240b68740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8625170 0x5590c8647790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6240b68740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8647cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6240b68740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62381b4110 con 0x5590c8625170 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6240b68740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f62381b5ce0 con 0x5590c8624850 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6240b68740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f62381b47e0 con 0x5590c862fa30 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6237fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c86272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6237fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c86272b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46862/0 (socket says 172.21.15.12:46862) 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f6237fff640 1 -- 172.21.15.12:0/2539126527 learned_addr learned my addr 172.21.15.12:0/2539126527 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f623cd2c640 1 --2- 172.21.15.12:0/2539126527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8647cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.154+0000 7f62377fe640 1 --2- 172.21.15.12:0/2539126527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8625170 0x5590c8647790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.155+0000 7f6237fff640 1 -- 172.21.15.12:0/2539126527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 msgr2=0x5590c8647cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.155+0000 7f6237fff640 1 --2- 172.21.15.12:0/2539126527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8647cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.155+0000 7f6237fff640 1 -- 172.21.15.12:0/2539126527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8625170 msgr2=0x5590c8647790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.155+0000 7f6237fff640 1 --2- 172.21.15.12:0/2539126527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8625170 0x5590c8647790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.155+0000 7f6237fff640 1 -- 172.21.15.12:0/2539126527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c862b8f0 con 0x5590c8624850 2024-09-19T06:47:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.155+0000 7f6237fff640 1 --2- 172.21.15.12:0/2539126527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c86272b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6228006010 tx=0x7f6228010440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=803276e0616d4bca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.155+0000 7f621dffb640 1 -- 172.21.15.12:0/2539126527 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228003d70 con 0x5590c8624850 2024-09-19T06:47:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.155+0000 7f621dffb640 1 -- 172.21.15.12:0/2539126527 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6228015050 con 0x5590c8624850 2024-09-19T06:47:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.155+0000 7f621dffb640 1 -- 172.21.15.12:0/2539126527 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228011860 con 0x5590c8624850 2024-09-19T06:47:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.156+0000 7f6240b68740 1 -- 172.21.15.12:0/2539126527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 msgr2=0x5590c86272b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.156+0000 7f6240b68740 1 --2- 172.21.15.12:0/2539126527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c86272b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6228006010 tx=0x7f6228010440 comp rx=0 tx=0).stop 2024-09-19T06:47:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.156+0000 7f6240b68740 1 -- 172.21.15.12:0/2539126527 shutdown_connections 2024-09-19T06:47:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.156+0000 7f6240b68740 1 --2- 172.21.15.12:0/2539126527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8647cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.156+0000 7f6240b68740 1 --2- 172.21.15.12:0/2539126527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8625170 0x5590c8647790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.156+0000 7f6240b68740 1 --2- 172.21.15.12:0/2539126527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8624850 0x5590c86272b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.156+0000 7f6240b68740 1 -- 172.21.15.12:0/2539126527 >> 172.21.15.12:0/2539126527 conn(0x5590c8620de0 msgr2=0x5590c862e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.157+0000 7f6240b68740 1 -- 172.21.15.12:0/2539126527 shutdown_connections 2024-09-19T06:47:56.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.157+0000 7f6240b68740 1 -- 172.21.15.12:0/2539126527 wait complete. 2024-09-19T06:47:56.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.158+0000 7f6240b68740 1 -- start start 2024-09-19T06:47:56.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.158+0000 7f6240b68740 1 Processor -- start 2024-09-19T06:47:56.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f6240b68740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8624850 0x5590c8633890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f6240b68740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8625170 0x5590c8633dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f6240b68740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8634310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f6237fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8624850 0x5590c8633890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f62377fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8625170 0x5590c8633dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f6237fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8624850 0x5590c8633890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51180/0 (socket says 172.21.15.12:51180) 2024-09-19T06:47:56.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f6237fff640 1 -- 172.21.15.12:0/4186124721 learned_addr learned my addr 172.21.15.12:0/4186124721 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:56.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f623cd2c640 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8634310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f6240b68740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f62381b55e0 con 0x5590c8624850 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f6240b68740 1 -- 172.21.15.12:0/4186124721 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f62381b4f10 con 0x5590c8625170 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.159+0000 7f6240b68740 1 -- 172.21.15.12:0/4186124721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f62381b2110 con 0x5590c862fa30 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f6240b68740 10 client.0 _ll_register_callbacks cb 0x7f6230098df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f62377fe640 1 -- 172.21.15.12:0/4186124721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 msgr2=0x5590c8634310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f62377fe640 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8634310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f62377fe640 1 -- 172.21.15.12:0/4186124721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8624850 msgr2=0x5590c8633890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f62377fe640 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8624850 0x5590c8633890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f62377fe640 1 -- 172.21.15.12:0/4186124721 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c86a98d0 con 0x5590c8625170 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f623cd2c640 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8634310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f62377fe640 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8625170 0x5590c8633dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5590c861b4f0 tx=0x7f622c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e45934afa7dae09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:56.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f62177fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f62177fe640 1 -- 172.21.15.12:0/4186124721 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c020630 con 0x5590c8625170 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f6240b68740 1 -- 172.21.15.12:0/4186124721 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6228015050 con 0x5590c8625170 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.160+0000 7f62177fe640 1 -- 172.21.15.12:0/4186124721 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f622c0207d0 con 0x5590c8625170 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f62177fe640 1 -- 172.21.15.12:0/4186124721 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f622c010e60 con 0x5590c8625170 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f6240b68740 10 client.27089 fetch_fsmap learned FSMap version 41 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f6240b68740 1 -- 172.21.15.12:0/4186124721 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5590c86aac00 con 0x5590c8625170 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f62177fe640 1 -- 172.21.15.12:0/4186124721 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6228015050 con 0x5590c8625170 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f62177fe640 1 -- 172.21.15.12:0/4186124721 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f622c00f040 con 0x5590c8625170 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f6240b68740 10 client.27089 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f6240b68740 10 client.27089 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f6240b68740 20 client.27089 populate_metadata read hostname 'smithi012' 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f6240b68740 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590c86ab3d0 0x5590c86ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f6240b68740 4 client.27089 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T06:47:56.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f6240b68740 1 -- 172.21.15.12:0/4186124721 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x5590c8590be0 con 0x5590c86ab3d0 2024-09-19T06:47:56.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.161+0000 7f6237fff640 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590c86ab3d0 0x5590c86ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:56.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.162+0000 7f6237fff640 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590c86ab3d0 0x5590c86ad7f0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a81184348bb9ce43 server_cookie=1eec013c34dab25c in_seq=0 out_seq=0 2024-09-19T06:47:56.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.162+0000 7f62177fe640 10 client.27089 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:56.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:55 smithi016 ceph-mon[34911]: pgmap v238: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 823 KiB/s wr, 134 op/s 2024-09-19T06:47:56.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:55 smithi173 ceph-mon[35349]: pgmap v238: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 823 KiB/s wr, 134 op/s 2024-09-19T06:47:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.347+0000 7f62177fe640 1 -- 172.21.15.12:0/4186124721 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5590c8590be0 con 0x5590c86ab3d0 2024-09-19T06:47:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.347+0000 7f62177fe640 10 client.27089 handle_command_reply: tid=0 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.347+0000 7f6240b68740 1 client.27089 shutdown 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 1 -- 172.21.15.12:0/4186124721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8625170 msgr2=0x5590c8633dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8625170 0x5590c8633dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5590c861b4f0 tx=0x7f622c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 1 -- 172.21.15.12:0/4186124721 shutdown_connections 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590c86ab3d0 0x5590c86ad7f0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590c862fa30 0x5590c8634310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590c8625170 0x5590c8633dd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f62177fe640 0 client.27089 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 1 --2- 172.21.15.12:0/4186124721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590c8624850 0x5590c8633890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 1 -- 172.21.15.12:0/4186124721 >> 172.21.15.12:0/4186124721 conn(0x5590c8620de0 msgr2=0x5590c862c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 1 -- 172.21.15.12:0/4186124721 shutdown_connections 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 1 -- 172.21.15.12:0/4186124721 wait complete. 2024-09-19T06:47:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.348+0000 7f6240b68740 20 client.27089 trim_cache size 0 max 16384 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 41, 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 30, 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout: "e0b77255": { 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 30, 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:47:56.351 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 145.8, 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:56.352 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:56.353 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:47:56.353 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:47:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 -- 172.21.15.12:0/3375116131 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62200a3540 msgr2=0x7f62200a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62200a3540 0x7f62200a5a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5590c8621c40 tx=0x7f622c005f90 comp rx=0 tx=0).stop 2024-09-19T06:47:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 -- 172.21.15.12:0/3375116131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6238105f30 msgr2=0x7f623810d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6238105f30 0x7f623810d0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f623003bee0 tx=0x7f6230040730 comp rx=0 tx=0).stop 2024-09-19T06:47:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 -- 172.21.15.12:0/3375116131 shutdown_connections 2024-09-19T06:47:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f62200a3540 0x7f62200a5a00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6238105f30 0x7f623810d0f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6238101440 0x7f62380731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 --2- 172.21.15.12:0/3375116131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6238100b20 0x7f6238072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 -- 172.21.15.12:0/3375116131 >> 172.21.15.12:0/3375116131 conn(0x7f62380fc7d0 msgr2=0x7f62380fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 -- 172.21.15.12:0/3375116131 shutdown_connections 2024-09-19T06:47:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:47:56.349+0000 7f623e78f640 1 -- 172.21.15.12:0/3375116131 wait complete. 2024-09-19T06:47:57.043 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e0b77255', quiesce took 4.3 seconds. Will release after: 21.45 2024-09-19T06:47:58.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:57 smithi012 ceph-mon[30937]: pgmap v239: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 3.1 MiB/s wr, 258 op/s 2024-09-19T06:47:58.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:57 smithi016 ceph-mon[34911]: pgmap v239: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 3.1 MiB/s wr, 258 op/s 2024-09-19T06:47:58.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:57 smithi173 ceph-mon[35349]: pgmap v239: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 3.1 MiB/s wr, 258 op/s 2024-09-19T06:47:59.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:58 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:47:59.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:58 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:47:59.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:58 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:47:59.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:58 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:47:59.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:58 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:47:59.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:58 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:47:59.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:58 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:47:59.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:58 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:47:59.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:58 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:47:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.985+0000 7f6544b6d640 1 -- 172.21.15.12:0/768893068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540101ae0 msgr2=0x7f6540101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.985+0000 7f6544b6d640 1 --2- 172.21.15.12:0/768893068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540101ae0 0x7f6540101f40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6534009930 tx=0x7f653402a420 comp rx=0 tx=0).stop 2024-09-19T06:47:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.985+0000 7f6544b6d640 1 -- 172.21.15.12:0/768893068 shutdown_connections 2024-09-19T06:47:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.985+0000 7f6544b6d640 1 --2- 172.21.15.12:0/768893068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6540102480 0x7f654010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.985+0000 7f6544b6d640 1 --2- 172.21.15.12:0/768893068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540101ae0 0x7f6540101f40 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.985+0000 7f6544b6d640 1 --2- 172.21.15.12:0/768893068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6540107b80 0x7f6540107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.985+0000 7f6544b6d640 1 -- 172.21.15.12:0/768893068 >> 172.21.15.12:0/768893068 conn(0x7f65400fd7e0 msgr2=0x7f65400ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.985+0000 7f6544b6d640 1 -- 172.21.15.12:0/768893068 shutdown_connections 2024-09-19T06:47:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.985+0000 7f6544b6d640 1 -- 172.21.15.12:0/768893068 wait complete. 2024-09-19T06:47:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.986+0000 7f6544b6d640 1 Processor -- start 2024-09-19T06:47:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.986+0000 7f6544b6d640 1 -- start start 2024-09-19T06:47:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.986+0000 7f6544b6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540101ae0 0x7f6540198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.986+0000 7f6544b6d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6540102480 0x7f65401988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.986+0000 7f6544b6d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6540107b80 0x7f654019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.986+0000 7f6544b6d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6540111f30 con 0x7f6540101ae0 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.986+0000 7f6544b6d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6540111db0 con 0x7f6540102480 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.986+0000 7f6544b6d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f65401120b0 con 0x7f6540107b80 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.986+0000 7f653e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540101ae0 0x7f6540198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540101ae0 0x7f6540198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51210/0 (socket says 172.21.15.12:51210) 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653e59c640 1 -- 172.21.15.12:0/3964331397 learned_addr learned my addr 172.21.15.12:0/3964331397 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653dd9b640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6540102480 0x7f65401988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653ed9d640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6540107b80 0x7f654019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653e59c640 1 -- 172.21.15.12:0/3964331397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6540107b80 msgr2=0x7f654019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653e59c640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6540107b80 0x7f654019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653e59c640 1 -- 172.21.15.12:0/3964331397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6540102480 msgr2=0x7f65401988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653e59c640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6540102480 0x7f65401988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653e59c640 1 -- 172.21.15.12:0/3964331397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654019d350 con 0x7f6540101ae0 2024-09-19T06:47:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653dd9b640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6540102480 0x7f65401988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:47:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f653e59c640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540101ae0 0x7f6540198360 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f653000d950 tx=0x7f653000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f652f7fe640 1 -- 172.21.15.12:0/3964331397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530017030 con 0x7f6540101ae0 2024-09-19T06:47:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f6544b6d640 1 -- 172.21.15.12:0/3964331397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f654019d640 con 0x7f6540101ae0 2024-09-19T06:47:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f652f7fe640 1 -- 172.21.15.12:0/3964331397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6530004020 con 0x7f6540101ae0 2024-09-19T06:47:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f652f7fe640 1 -- 172.21.15.12:0/3964331397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65300047a0 con 0x7f6540101ae0 2024-09-19T06:47:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.987+0000 7f6544b6d640 1 -- 172.21.15.12:0/3964331397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65401a4ed0 con 0x7f6540101ae0 2024-09-19T06:47:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.990+0000 7f652f7fe640 1 -- 172.21.15.12:0/3964331397 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f65300041d0 con 0x7f6540101ae0 2024-09-19T06:47:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.990+0000 7f65479e4740 1 Processor -- start 2024-09-19T06:47:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.990+0000 7f65479e4740 1 -- start start 2024-09-19T06:47:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.990+0000 7f65479e4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e2f00 0x5636102e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.990+0000 7f65479e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x5636102edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.990+0000 7f65479e4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.990+0000 7f65479e4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5636102432f0 con 0x5636102ee0c0 2024-09-19T06:47:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.990+0000 7f65479e4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5636101eb270 con 0x5636102e2f00 2024-09-19T06:47:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.990+0000 7f65479e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56361023f2b0 con 0x5636102e3820 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.990+0000 7f653dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51220/0 (socket says 172.21.15.12:51220) 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653dd9b640 1 -- 172.21.15.12:0/2504256321 learned_addr learned my addr 172.21.15.12:0/2504256321 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653ed9d640 1 --2- 172.21.15.12:0/2504256321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e2f00 0x5636102e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653e59c640 1 --2- 172.21.15.12:0/2504256321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x5636102edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f652f7fe640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f65280a3460 0x7f65280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653dd9b640 1 -- 172.21.15.12:0/2504256321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 msgr2=0x5636102edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653ed9d640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f65280a3460 0x7f65280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653dd9b640 1 --2- 172.21.15.12:0/2504256321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x5636102edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653dd9b640 1 -- 172.21.15.12:0/2504256321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e2f00 msgr2=0x5636102e32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653dd9b640 1 --2- 172.21.15.12:0/2504256321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e2f00 0x5636102e32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653dd9b640 1 -- 172.21.15.12:0/2504256321 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636101ea340 con 0x5636102ee0c0 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f652f7fe640 1 -- 172.21.15.12:0/3964331397 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f65300cf810 con 0x7f6540101ae0 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653dd9b640 1 --2- 172.21.15.12:0/2504256321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f04b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6534006010 tx=0x7f6534009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b63cf3a5de730ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.991+0000 7f653ed9d640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f65280a3460 0x7f65280a5920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6538005fd0 tx=0x7f6538004ab0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.992+0000 7f652cff9640 1 -- 172.21.15.12:0/2504256321 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653403f070 con 0x5636102ee0c0 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.992+0000 7f652cff9640 1 -- 172.21.15.12:0/2504256321 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65340317b0 con 0x5636102ee0c0 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.992+0000 7f652cff9640 1 -- 172.21.15.12:0/2504256321 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534035070 con 0x5636102ee0c0 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.992+0000 7f65479e4740 1 -- 172.21.15.12:0/2504256321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 msgr2=0x5636102f04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.992+0000 7f65479e4740 1 --2- 172.21.15.12:0/2504256321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f04b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6534006010 tx=0x7f6534009680 comp rx=0 tx=0).stop 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.992+0000 7f65479e4740 1 -- 172.21.15.12:0/2504256321 shutdown_connections 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.992+0000 7f65479e4740 1 --2- 172.21.15.12:0/2504256321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f04b0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.992+0000 7f65479e4740 1 --2- 172.21.15.12:0/2504256321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x5636102edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.992+0000 7f65479e4740 1 --2- 172.21.15.12:0/2504256321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e2f00 0x5636102e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:59.996 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.992+0000 7f65479e4740 1 -- 172.21.15.12:0/2504256321 >> 172.21.15.12:0/2504256321 conn(0x5636102df470 msgr2=0x5636102df850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 1 -- 172.21.15.12:0/2504256321 shutdown_connections 2024-09-19T06:47:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 1 -- 172.21.15.12:0/2504256321 wait complete. 2024-09-19T06:47:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 1 -- start start 2024-09-19T06:47:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 1 Processor -- start 2024-09-19T06:48:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e3820 0x5636102eb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102ee0c0 0x5636102eb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5636102f0c90 con 0x5636102e2f00 2024-09-19T06:48:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5636101cc290 con 0x5636102e3820 2024-09-19T06:48:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5636102f0e10 con 0x5636102ee0c0 2024-09-19T06:48:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f65479e4740 10 client.0 _ll_register_callbacks cb 0x5636101fd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f653e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f653e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102eaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51230/0 (socket says 172.21.15.12:51230) 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.993+0000 7f653e59c640 1 -- 172.21.15.12:0/1524024155 learned_addr learned my addr 172.21.15.12:0/1524024155 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f653dd9b640 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e3820 0x5636102eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f653ed9d640 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102ee0c0 0x5636102eb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f653e59c640 1 -- 172.21.15.12:0/1524024155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102ee0c0 msgr2=0x5636102eb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f653e59c640 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102ee0c0 0x5636102eb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f653e59c640 1 -- 172.21.15.12:0/1524024155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e3820 msgr2=0x5636102eb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f653e59c640 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e3820 0x5636102eb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f653e59c640 1 -- 172.21.15.12:0/1524024155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56360ff56210 con 0x5636102e2f00 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f653ed9d640 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102ee0c0 0x5636102eb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f653e59c640 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102eaf00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6530098420 tx=0x7f6530005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd203b02a98c4d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f6525ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:00.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f6525ffb640 1 -- 172.21.15.12:0/1524024155 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653009b3b0 con 0x5636102e2f00 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f6525ffb640 1 -- 172.21.15.12:0/1524024155 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f65300980c0 con 0x5636102e2f00 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f65479e4740 1 -- 172.21.15.12:0/1524024155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65340317b0 con 0x5636102e2f00 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f6525ffb640 1 -- 172.21.15.12:0/1524024155 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f653009c150 con 0x5636102e2f00 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f65479e4740 10 client.17652 fetch_fsmap learned FSMap version 41 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f65479e4740 1 -- 172.21.15.12:0/1524024155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x563610022620 con 0x5636102e2f00 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.994+0000 7f6525ffb640 1 -- 172.21.15.12:0/1524024155 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65340317b0 con 0x5636102e2f00 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.995+0000 7f6525ffb640 1 -- 172.21.15.12:0/1524024155 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f65300977a0 con 0x5636102e2f00 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.995+0000 7f65479e4740 10 client.17652 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.995+0000 7f65479e4740 10 client.17652 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.995+0000 7f65479e4740 20 client.17652 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.995+0000 7f65479e4740 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5636102fdfc0 0x5636103003b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.995+0000 7f65479e4740 4 client.17652 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.995+0000 7f65479e4740 1 -- 172.21.15.12:0/1524024155 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563610250a20 con 0x5636102fdfc0 2024-09-19T06:48:00.002 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.995+0000 7f653dd9b640 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5636102fdfc0 0x5636103003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.995+0000 7f653dd9b640 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5636102fdfc0 0x5636103003b0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=666e00b06627f42f server_cookie=e0da68c742c3d74d in_seq=0 out_seq=0 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.995+0000 7f6525ffb640 10 client.17652 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f6525ffb640 1 -- 172.21.15.12:0/1524024155 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563610250a20 con 0x5636102fdfc0 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f6525ffb640 10 client.17652 handle_command_reply: tid=0 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 client.17652 shutdown 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 -- 172.21.15.12:0/1524024155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 msgr2=0x5636102eaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102eaf00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6530098420 tx=0x7f6530005da0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 -- 172.21.15.12:0/1524024155 shutdown_connections 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5636102fdfc0 0x5636103003b0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102ee0c0 0x5636102eb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e3820 0x5636102eb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f6525ffb640 0 client.17652 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 --2- 172.21.15.12:0/1524024155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102eaf00 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 -- 172.21.15.12:0/1524024155 >> 172.21.15.12:0/1524024155 conn(0x5636102df470 msgr2=0x5636102e5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 -- 172.21.15.12:0/1524024155 shutdown_connections 2024-09-19T06:48:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 1 -- 172.21.15.12:0/1524024155 wait complete. 2024-09-19T06:48:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:47:59.996+0000 7f65479e4740 20 client.17652 trim_cache size 0 max 16384 2024-09-19T06:48:00.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f65479e4740 1 Processor -- start 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f65479e4740 1 -- start start 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f65479e4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102ece70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f65479e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x563610305c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f65479e4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102ee0c0 0x563610306190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f65479e4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65401ab910 con 0x5636102e2f00 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f65479e4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f65401ad4e0 con 0x5636102ee0c0 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f65479e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f65401abfe0 con 0x5636102e3820 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f653e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f653e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102ece70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51232/0 (socket says 172.21.15.12:51232) 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.011+0000 7f653e59c640 1 -- 172.21.15.12:0/725223332 learned_addr learned my addr 172.21.15.12:0/725223332 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f653dd9b640 1 --2- 172.21.15.12:0/725223332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x563610305c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f653e59c640 1 -- 172.21.15.12:0/725223332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 msgr2=0x563610305c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f653e59c640 1 --2- 172.21.15.12:0/725223332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x563610305c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f653e59c640 1 -- 172.21.15.12:0/725223332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102ee0c0 msgr2=0x563610306190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f653ed9d640 1 --2- 172.21.15.12:0/725223332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102ee0c0 0x563610306190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f653e59c640 1 --2- 172.21.15.12:0/725223332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102ee0c0 0x563610306190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f653e59c640 1 -- 172.21.15.12:0/725223332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636102e3650 con 0x5636102e2f00 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f653ed9d640 1 --2- 172.21.15.12:0/725223332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102ee0c0 0x563610306190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f653e59c640 1 --2- 172.21.15.12:0/725223332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102ece70 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f653009b750 tx=0x7f6530000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6fed4d28ca5549 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f6527fff640 1 -- 172.21.15.12:0/725223332 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530065070 con 0x5636102e2f00 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f6527fff640 1 -- 172.21.15.12:0/725223332 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f653000e350 con 0x5636102e2f00 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.012+0000 7f6527fff640 1 -- 172.21.15.12:0/725223332 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65300b8070 con 0x5636102e2f00 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 -- 172.21.15.12:0/725223332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 msgr2=0x5636102ece70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 --2- 172.21.15.12:0/725223332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102ece70 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f653009b750 tx=0x7f6530000bc0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 -- 172.21.15.12:0/725223332 shutdown_connections 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 --2- 172.21.15.12:0/725223332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102ee0c0 0x563610306190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 --2- 172.21.15.12:0/725223332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x563610305c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 --2- 172.21.15.12:0/725223332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102e2f00 0x5636102ece70 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 -- 172.21.15.12:0/725223332 >> 172.21.15.12:0/725223332 conn(0x5636102df470 msgr2=0x5636102ec760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 -- 172.21.15.12:0/725223332 shutdown_connections 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 -- 172.21.15.12:0/725223332 wait complete. 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 -- start start 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 Processor -- start 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e2f00 0x5636102f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x5636102f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65401acde0 con 0x5636102ee0c0 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f65401ac710 con 0x5636102e2f00 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f65401a9910 con 0x5636102e3820 2024-09-19T06:48:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.013+0000 7f65479e4740 10 client.0 _ll_register_callbacks cb 0x7f6530005cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51238/0 (socket says 172.21.15.12:51238) 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653ed9d640 1 -- 172.21.15.12:0/1371743099 learned_addr learned my addr 172.21.15.12:0/1371743099 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653dd9b640 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x5636102f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653e59c640 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e2f00 0x5636102f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653ed9d640 1 -- 172.21.15.12:0/1371743099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 msgr2=0x5636102f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653ed9d640 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x5636102f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653ed9d640 1 -- 172.21.15.12:0/1371743099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e2f00 msgr2=0x5636102f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653ed9d640 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e2f00 0x5636102f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653ed9d640 1 -- 172.21.15.12:0/1371743099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636102f23d0 con 0x5636102ee0c0 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f653ed9d640 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f1e10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6538013290 tx=0x7f6538004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2f4233de8c8e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f6525ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f6525ffb640 1 -- 172.21.15.12:0/1371743099 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538025020 con 0x5636102ee0c0 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f6525ffb640 1 -- 172.21.15.12:0/1371743099 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8687+0+0 (secure 0 0 0) 0x7f6538021880 con 0x5636102ee0c0 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f65479e4740 1 -- 172.21.15.12:0/1371743099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f653000e350 con 0x5636102ee0c0 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f6525ffb640 1 -- 172.21.15.12:0/1371743099 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f6538019040 con 0x5636102ee0c0 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f65479e4740 10 client.17658 fetch_fsmap learned FSMap version 41 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.014+0000 7f65479e4740 1 -- 172.21.15.12:0/1371743099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5636103689d0 con 0x5636102ee0c0 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f6525ffb640 1 -- 172.21.15.12:0/1371743099 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f653000e350 con 0x5636102ee0c0 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f6525ffb640 1 -- 172.21.15.12:0/1371743099 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7f653801c070 con 0x5636102ee0c0 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f65479e4740 10 client.17658 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f65479e4740 10 client.17658 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f65479e4740 20 client.17658 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f65479e4740 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5636103691d0 0x56361036b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f65479e4740 4 client.17658 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:48:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f65479e4740 1 -- 172.21.15.12:0/1371743099 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56361024ad70 con 0x5636103691d0 2024-09-19T06:48:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f653e59c640 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5636103691d0 0x56361036b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f6525ffb640 10 client.17658 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.015+0000 7f653e59c640 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5636103691d0 0x56361036b5f0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4554d35872e1c41 server_cookie=dba231d0fc63cb31 in_seq=0 out_seq=0 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f6525ffb640 1 -- 172.21.15.12:0/1371743099 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56361024ad70 con 0x5636103691d0 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f6525ffb640 10 client.17658 handle_command_reply: tid=0 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 client.17658 shutdown 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 -- 172.21.15.12:0/1371743099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 msgr2=0x5636102f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f1e10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6538013290 tx=0x7f6538004a40 comp rx=0 tx=0).stop 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 -- 172.21.15.12:0/1371743099 shutdown_connections 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5636103691d0 0x56361036b5f0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5636102ee0c0 0x5636102f1e10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5636102e3820 0x5636102f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f6525ffb640 0 client.17658 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 --2- 172.21.15.12:0/1371743099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5636102e2f00 0x5636102f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 -- 172.21.15.12:0/1371743099 >> 172.21.15.12:0/1371743099 conn(0x5636102df470 msgr2=0x5636102eb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 -- 172.21.15.12:0/1371743099 shutdown_connections 2024-09-19T06:48:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 1 -- 172.21.15.12:0/1371743099 wait complete. 2024-09-19T06:48:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.029+0000 7f65479e4740 20 client.17658 trim_cache size 0 max 16384 2024-09-19T06:48:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:48:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:48:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:48:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:48:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 -- 172.21.15.12:0/3964331397 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f65280a3460 msgr2=0x7f65280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f65280a3460 0x7f65280a5920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6538005fd0 tx=0x7f6538004ab0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 -- 172.21.15.12:0/3964331397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540101ae0 msgr2=0x7f6540198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540101ae0 0x7f6540198360 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f653000d950 tx=0x7f653000de10 comp rx=0 tx=0).stop 2024-09-19T06:48:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 -- 172.21.15.12:0/3964331397 shutdown_connections 2024-09-19T06:48:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f65280a3460 0x7f65280a5920 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6540107b80 0x7f654019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6540102480 0x7f65401988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 --2- 172.21.15.12:0/3964331397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6540101ae0 0x7f6540198360 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 -- 172.21.15.12:0/3964331397 >> 172.21.15.12:0/3964331397 conn(0x7f65400fd7e0 msgr2=0x7f65400fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 -- 172.21.15.12:0/3964331397 shutdown_connections 2024-09-19T06:48:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:00.030+0000 7f6544b6d640 1 -- 172.21.15.12:0/3964331397 wait complete. 2024-09-19T06:48:00.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:59 smithi016 ceph-mon[34911]: pgmap v240: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-09-19T06:48:00.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:59 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:48:00.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:47:59 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:48:00.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:59 smithi173 ceph-mon[35349]: pgmap v240: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-09-19T06:48:00.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:59 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:48:00.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:47:59 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:48:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:59 smithi012 ceph-mon[30937]: pgmap v240: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-09-19T06:48:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:59 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:48:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:47:59 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:48:00.811 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 435.0 s, 266.8 tps, lat 26.718 ms stddev 29.080 2024-09-19T06:48:02.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:01 smithi016 ceph-mon[34911]: pgmap v241: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 9.6 MiB/s wr, 832 op/s 2024-09-19T06:48:02.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:01 smithi173 ceph-mon[35349]: pgmap v241: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 9.6 MiB/s wr, 832 op/s 2024-09-19T06:48:02.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:01 smithi012 ceph-mon[30937]: pgmap v241: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 9.6 MiB/s wr, 832 op/s 2024-09-19T06:48:04.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:03 smithi016 ceph-mon[34911]: pgmap v242: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 9.6 MiB/s wr, 773 op/s 2024-09-19T06:48:04.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:03 smithi173 ceph-mon[35349]: pgmap v242: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 9.6 MiB/s wr, 773 op/s 2024-09-19T06:48:04.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:03 smithi012 ceph-mon[30937]: pgmap v242: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 9.6 MiB/s wr, 773 op/s 2024-09-19T06:48:05.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 440.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:48:06.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:05 smithi016 ceph-mon[34911]: pgmap v243: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 9.6 MiB/s wr, 777 op/s 2024-09-19T06:48:06.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:05 smithi173 ceph-mon[35349]: pgmap v243: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 9.6 MiB/s wr, 777 op/s 2024-09-19T06:48:06.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:05 smithi012 ceph-mon[30937]: pgmap v243: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 9.6 MiB/s wr, 777 op/s 2024-09-19T06:48:08.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:07 smithi012 ceph-mon[30937]: pgmap v244: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 8.8 MiB/s wr, 763 op/s 2024-09-19T06:48:08.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:07 smithi016 ceph-mon[34911]: pgmap v244: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 8.8 MiB/s wr, 763 op/s 2024-09-19T06:48:08.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:07 smithi173 ceph-mon[35349]: pgmap v244: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 8.8 MiB/s wr, 763 op/s 2024-09-19T06:48:10.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:09 smithi016 ceph-mon[34911]: pgmap v245: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 6.6 MiB/s wr, 640 op/s 2024-09-19T06:48:10.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:09 smithi016 ceph-mon[34911]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:48:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:09 smithi173 ceph-mon[35349]: pgmap v245: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 6.6 MiB/s wr, 640 op/s 2024-09-19T06:48:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:09 smithi173 ceph-mon[35349]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:48:10.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:09 smithi012 ceph-mon[30937]: pgmap v245: 97 pgs: 97 active+clean; 4.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 6.6 MiB/s wr, 640 op/s 2024-09-19T06:48:10.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:09 smithi012 ceph-mon[30937]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:48:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 445.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:48:12.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:11 smithi016 ceph-mon[34911]: pgmap v247: 97 pgs: 97 active+clean; 4.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 86 KiB/s wr, 37 op/s 2024-09-19T06:48:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:11 smithi173 ceph-mon[35349]: pgmap v247: 97 pgs: 97 active+clean; 4.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 86 KiB/s wr, 37 op/s 2024-09-19T06:48:12.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:11 smithi012 ceph-mon[30937]: pgmap v247: 97 pgs: 97 active+clean; 4.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 86 KiB/s wr, 37 op/s 2024-09-19T06:48:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.131+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/1827721940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2a41069c0 msgr2=0x7fe2a4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.131+0000 7fe2ab7c4640 1 --2- 172.21.15.12:0/1827721940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2a41069c0 0x7fe2a4106da0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009930 tx=0x7fe2a002a420 comp rx=0 tx=0).stop 2024-09-19T06:48:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.131+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/1827721940 shutdown_connections 2024-09-19T06:48:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.131+0000 7fe2ab7c4640 1 --2- 172.21.15.12:0/1827721940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2a4101350 0x7fe2a410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.131+0000 7fe2ab7c4640 1 --2- 172.21.15.12:0/1827721940 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2a41009b0 0x7fe2a4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.131+0000 7fe2ab7c4640 1 --2- 172.21.15.12:0/1827721940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2a41069c0 0x7fe2a4106da0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.131+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/1827721940 >> 172.21.15.12:0/1827721940 conn(0x7fe2a4077990 msgr2=0x7fe2a40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.131+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/1827721940 shutdown_connections 2024-09-19T06:48:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.131+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/1827721940 wait complete. 2024-09-19T06:48:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2ab7c4640 1 Processor -- start 2024-09-19T06:48:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2ab7c4640 1 -- start start 2024-09-19T06:48:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2ab7c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2a41009b0 0x7fe2a4198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2ab7c4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2a4101350 0x7fe2a4198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2ab7c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2a41069c0 0x7fe2a419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2ab7c4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a4110dc0 con 0x7fe2a41009b0 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2ab7c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a4110c40 con 0x7fe2a41069c0 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2ab7c4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a4110f40 con 0x7fe2a4101350 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2a9560640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2a41009b0 0x7fe2a4198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2a9560640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2a41009b0 0x7fe2a4198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39594/0 (socket says 172.21.15.12:39594) 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2a9560640 1 -- 172.21.15.12:0/48428669 learned_addr learned my addr 172.21.15.12:0/48428669 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2a9d61640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2a41069c0 0x7fe2a419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2a8d5f640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2a4101350 0x7fe2a4198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2a9560640 1 -- 172.21.15.12:0/48428669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2a4101350 msgr2=0x7fe2a4198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2a9560640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2a4101350 0x7fe2a4198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2a9560640 1 -- 172.21.15.12:0/48428669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2a41069c0 msgr2=0x7fe2a419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2a9560640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2a41069c0 0x7fe2a419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.132+0000 7fe2a9560640 1 -- 172.21.15.12:0/48428669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a419d200 con 0x7fe2a41009b0 2024-09-19T06:48:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.133+0000 7fe2a9560640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2a41009b0 0x7fe2a4198210 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009a50 tx=0x7fe2a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.133+0000 7fe29a7fc640 1 -- 172.21.15.12:0/48428669 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a003f030 con 0x7fe2a41009b0 2024-09-19T06:48:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.133+0000 7fe29a7fc640 1 -- 172.21.15.12:0/48428669 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2a0003ce0 con 0x7fe2a41009b0 2024-09-19T06:48:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.133+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/48428669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a419d490 con 0x7fe2a41009b0 2024-09-19T06:48:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.133+0000 7fe29a7fc640 1 -- 172.21.15.12:0/48428669 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0035070 con 0x7fe2a41009b0 2024-09-19T06:48:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.133+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/48428669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a41a4d80 con 0x7fe2a41009b0 2024-09-19T06:48:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.135+0000 7fe29a7fc640 1 -- 172.21.15.12:0/48428669 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe2a0042030 con 0x7fe2a41009b0 2024-09-19T06:48:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2ae63f740 1 Processor -- start 2024-09-19T06:48:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2ae63f740 1 -- start start 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe29a7fc640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2900a3460 0x7fe2900a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519160af0 0x55a519160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 0x55a51916b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a51916bcb0 0x55a51916e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a5190c52f0 con 0x55a519160af0 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a51906d270 con 0x55a51916bcb0 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a5190c12b0 con 0x55a519161410 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2a9560640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519160af0 0x55a519160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2a9d61640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2900a3460 0x7fe2900a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2a9560640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519160af0 0x55a519160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39606/0 (socket says 172.21.15.12:39606) 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe2a9560640 1 -- 172.21.15.12:0/237394443 learned_addr learned my addr 172.21.15.12:0/237394443 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.136+0000 7fe29a7fc640 1 -- 172.21.15.12:0/48428669 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8731+0+0 (secure 0 0 0) 0x7fe2a00f0370 con 0x7fe2a41009b0 2024-09-19T06:48:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe2a8d5f640 1 --2- 172.21.15.12:0/237394443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 0x55a51916b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe2a9d61640 1 --2- 172.21.15.12:0/237394443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a51916bcb0 0x55a51916e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe2a9560640 1 -- 172.21.15.12:0/237394443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 msgr2=0x55a51916b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe2a9560640 1 --2- 172.21.15.12:0/237394443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 0x55a51916b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe2a9560640 1 -- 172.21.15.12:0/237394443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a51916bcb0 msgr2=0x55a51916e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe2a9560640 1 --2- 172.21.15.12:0/237394443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a51916bcb0 0x55a51916e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe2a9560640 1 -- 172.21.15.12:0/237394443 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a51906c340 con 0x55a519160af0 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe2a8d5f640 1 --2- 172.21.15.12:0/237394443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 0x55a51916b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe2a9560640 1 --2- 172.21.15.12:0/237394443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519160af0 0x55a519160ed0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00b8f50 tx=0x7fe2a0030fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2258168080fae92c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe2a9d61640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2900a3460 0x7fe2900a5920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55a51915e3e0 tx=0x7fe29c007940 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe28f7fe640 1 -- 172.21.15.12:0/237394443 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0049070 con 0x55a519160af0 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe28f7fe640 1 -- 172.21.15.12:0/237394443 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2a00bcc80 con 0x55a519160af0 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.137+0000 7fe28f7fe640 1 -- 172.21.15.12:0/237394443 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a003bd00 con 0x55a519160af0 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 -- 172.21.15.12:0/237394443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519160af0 msgr2=0x55a519160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/237394443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519160af0 0x55a519160ed0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00b8f50 tx=0x7fe2a0030fc0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 -- 172.21.15.12:0/237394443 shutdown_connections 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/237394443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a51916bcb0 0x55a51916e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/237394443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 0x55a51916b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/237394443 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519160af0 0x55a519160ed0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 -- 172.21.15.12:0/237394443 >> 172.21.15.12:0/237394443 conn(0x55a51915d060 msgr2=0x55a51915d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 -- 172.21.15.12:0/237394443 shutdown_connections 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 -- 172.21.15.12:0/237394443 wait complete. 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 -- start start 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.138+0000 7fe2ae63f740 1 Processor -- start 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519160af0 0x55a519168bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a5191690f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a51916bcb0 0x55a519169630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a51916e640 con 0x55a519161410 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a51904e290 con 0x55a51916bcb0 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a51916e7c0 con 0x55a519160af0 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2ae63f740 10 client.0 _ll_register_callbacks cb 0x55a51907f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2a8d5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a5191690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2a8d5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a5191690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39622/0 (socket says 172.21.15.12:39622) 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2a8d5f640 1 -- 172.21.15.12:0/386802623 learned_addr learned my addr 172.21.15.12:0/386802623 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2a9560640 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519160af0 0x55a519168bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2a9d61640 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a51916bcb0 0x55a519169630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2a8d5f640 1 -- 172.21.15.12:0/386802623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519160af0 msgr2=0x55a519168bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2a8d5f640 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519160af0 0x55a519168bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2a8d5f640 1 -- 172.21.15.12:0/386802623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a51916bcb0 msgr2=0x55a519169630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2a8d5f640 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a51916bcb0 0x55a519169630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.139+0000 7fe2a8d5f640 1 -- 172.21.15.12:0/386802623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a518dd8210 con 0x55a519161410 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe2a8d5f640 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a5191690f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe29400f460 tx=0x7fe29400f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e2393320ac6a86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe28cff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe28cff9640 1 -- 172.21.15.12:0/386802623 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294004440 con 0x55a519161410 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe28cff9640 1 -- 172.21.15.12:0/386802623 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8731+0+0 (secure 0 0 0) 0x7fe2940035f0 con 0x55a519161410 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe2ae63f740 1 -- 172.21.15.12:0/386802623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2a00bcc80 con 0x55a519161410 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe28cff9640 1 -- 172.21.15.12:0/386802623 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe294005020 con 0x55a519161410 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe2ae63f740 10 client.17670 fetch_fsmap learned FSMap version 41 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe2ae63f740 1 -- 172.21.15.12:0/386802623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a518ea4620 con 0x55a519161410 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe28cff9640 1 -- 172.21.15.12:0/386802623 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2a00bcc80 con 0x55a519161410 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe28cff9640 1 -- 172.21.15.12:0/386802623 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7fe29401f070 con 0x55a519161410 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe2ae63f740 10 client.17670 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:48:13.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe2ae63f740 10 client.17670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe2ae63f740 20 client.17670 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a51917ba30 0x55a51917de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe2ae63f740 4 client.17670 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.140+0000 7fe2ae63f740 1 -- 172.21.15.12:0/386802623 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5190d2a20 con 0x55a51917ba30 2024-09-19T06:48:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.141+0000 7fe2a9560640 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a51917ba30 0x55a51917de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.141+0000 7fe28cff9640 10 client.17670 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.141+0000 7fe2a9560640 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a51917ba30 0x55a51917de20 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6659055fa37d1d55 server_cookie=ebe6d63a505d5ee0 in_seq=0 out_seq=0 2024-09-19T06:48:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe28cff9640 1 -- 172.21.15.12:0/386802623 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5190d2a20 con 0x55a51917ba30 2024-09-19T06:48:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe28cff9640 10 client.17670 handle_command_reply: tid=0 2024-09-19T06:48:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 client.17670 shutdown 2024-09-19T06:48:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 -- 172.21.15.12:0/386802623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 msgr2=0x55a5191690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a5191690f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe29400f460 tx=0x7fe29400f920 comp rx=0 tx=0).stop 2024-09-19T06:48:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 -- 172.21.15.12:0/386802623 shutdown_connections 2024-09-19T06:48:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a51917ba30 0x55a51917de20 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a51916bcb0 0x55a519169630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a5191690f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/386802623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519160af0 0x55a519168bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 -- 172.21.15.12:0/386802623 >> 172.21.15.12:0/386802623 conn(0x55a51915d060 msgr2=0x55a519162dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe28cff9640 0 client.17670 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 -- 172.21.15.12:0/386802623 shutdown_connections 2024-09-19T06:48:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 1 -- 172.21.15.12:0/386802623 wait complete. 2024-09-19T06:48:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.142+0000 7fe2ae63f740 20 client.17670 trim_cache size 0 max 16384 2024-09-19T06:48:13.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.157+0000 7fe2ae63f740 1 Processor -- start 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.157+0000 7fe2ae63f740 1 -- start start 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.157+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a519160af0 0x55a519169460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.157+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 0x55a519183730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.157+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a51916bcb0 0x55a519183c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.157+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41adaa0 con 0x55a51916bcb0 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.157+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41af670 con 0x55a519160af0 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.157+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41ae170 con 0x55a519161410 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a9d61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a51916bcb0 0x55a519183c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a9d61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a51916bcb0 0x55a519183c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39632/0 (socket says 172.21.15.12:39632) 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a9d61640 1 -- 172.21.15.12:0/463114736 learned_addr learned my addr 172.21.15.12:0/463114736 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a9560640 1 --2- 172.21.15.12:0/463114736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a519160af0 0x55a519169460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a8d5f640 1 --2- 172.21.15.12:0/463114736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 0x55a519183730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a9d61640 1 -- 172.21.15.12:0/463114736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 msgr2=0x55a519183730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a9d61640 1 --2- 172.21.15.12:0/463114736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 0x55a519183730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a9d61640 1 -- 172.21.15.12:0/463114736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a519160af0 msgr2=0x55a519169460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a9d61640 1 --2- 172.21.15.12:0/463114736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a519160af0 0x55a519169460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a9d61640 1 -- 172.21.15.12:0/463114736 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a519160870 con 0x55a51916bcb0 2024-09-19T06:48:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe2a9d61640 1 --2- 172.21.15.12:0/463114736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a51916bcb0 0x55a519183c70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0127a0 tx=0x7fe29c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb098cb3d3c6499c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe28effd640 1 -- 172.21.15.12:0/463114736 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00eb30 con 0x55a51916bcb0 2024-09-19T06:48:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe28effd640 1 -- 172.21.15.12:0/463114736 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe29c027070 con 0x55a51916bcb0 2024-09-19T06:48:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.158+0000 7fe28effd640 1 -- 172.21.15.12:0/463114736 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c021610 con 0x55a51916bcb0 2024-09-19T06:48:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 -- 172.21.15.12:0/463114736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a51916bcb0 msgr2=0x55a519183c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/463114736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a51916bcb0 0x55a519183c70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0127a0 tx=0x7fe29c00f000 comp rx=0 tx=0).stop 2024-09-19T06:48:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 -- 172.21.15.12:0/463114736 shutdown_connections 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/463114736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a51916bcb0 0x55a519183c70 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/463114736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a519161410 0x55a519183730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/463114736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a519160af0 0x55a519169460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 -- 172.21.15.12:0/463114736 >> 172.21.15.12:0/463114736 conn(0x55a51915d060 msgr2=0x55a51916ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 -- 172.21.15.12:0/463114736 shutdown_connections 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 -- 172.21.15.12:0/463114736 wait complete. 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 -- start start 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.159+0000 7fe2ae63f740 1 Processor -- start 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a519160af0 0x55a519174130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a519165860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2ae63f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a51916bcb0 0x55a519165da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41aef70 con 0x55a519161410 2024-09-19T06:48:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41ae8a0 con 0x55a519160af0 2024-09-19T06:48:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2ae63f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a41abaa0 con 0x55a51916bcb0 2024-09-19T06:48:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2ae63f740 10 client.0 _ll_register_callbacks cb 0x7fe29400a3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a8d5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a519165860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a8d5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a519165860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39638/0 (socket says 172.21.15.12:39638) 2024-09-19T06:48:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a8d5f640 1 -- 172.21.15.12:0/3763453355 learned_addr learned my addr 172.21.15.12:0/3763453355 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a9d61640 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a51916bcb0 0x55a519165da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a9560640 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a519160af0 0x55a519174130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a8d5f640 1 -- 172.21.15.12:0/3763453355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a51916bcb0 msgr2=0x55a519165da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a8d5f640 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a51916bcb0 0x55a519165da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a8d5f640 1 -- 172.21.15.12:0/3763453355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a519160af0 msgr2=0x55a519174130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a8d5f640 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a519160af0 0x55a519174130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a8d5f640 1 -- 172.21.15.12:0/3763453355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5191665a0 con 0x55a519161410 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe2a8d5f640 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a519165860 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x55a519168420 tx=0x7fe29400a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2685d32f9f5e25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.160+0000 7fe28cff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe28cff9640 1 -- 172.21.15.12:0/3763453355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294025040 con 0x55a519161410 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe28cff9640 1 -- 172.21.15.12:0/3763453355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8731+0+0 (secure 0 0 0) 0x7fe29400a660 con 0x55a519161410 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe2ae63f740 1 -- 172.21.15.12:0/3763453355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe29c027070 con 0x55a519161410 2024-09-19T06:48:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe28cff9640 1 -- 172.21.15.12:0/3763453355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe29403a050 con 0x55a519161410 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe2ae63f740 10 client.17676 fetch_fsmap learned FSMap version 41 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe2ae63f740 1 -- 172.21.15.12:0/3763453355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a5191e66c0 con 0x55a519161410 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe28cff9640 1 -- 172.21.15.12:0/3763453355 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe29c027070 con 0x55a519161410 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe28cff9640 1 -- 172.21.15.12:0/3763453355 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8374+0+0 (secure 0 0 0) 0x7fe29401f040 con 0x55a519161410 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe2ae63f740 10 client.17676 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe2ae63f740 10 client.17676 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe2ae63f740 20 client.17676 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a5191e6ef0 0x55a5191e9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe2ae63f740 4 client.17676 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.161+0000 7fe2ae63f740 1 -- 172.21.15.12:0/3763453355 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a5190ccd70 con 0x55a5191e6ef0 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.162+0000 7fe2a9560640 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a5191e6ef0 0x55a5191e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.162+0000 7fe2a9560640 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a5191e6ef0 0x55a5191e9310 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2d69cd4044c95ea server_cookie=784269153efa2451 in_seq=0 out_seq=0 2024-09-19T06:48:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.162+0000 7fe28cff9640 10 client.17676 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:13.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.176+0000 7fe28cff9640 1 -- 172.21.15.12:0/3763453355 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a5190ccd70 con 0x55a5191e6ef0 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.176+0000 7fe28cff9640 10 client.17676 handle_command_reply: tid=0 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.176+0000 7fe2ae63f740 1 client.17676 shutdown 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 1 -- 172.21.15.12:0/3763453355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 msgr2=0x55a519165860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a519165860 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x55a519168420 tx=0x7fe29400a9b0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 1 -- 172.21.15.12:0/3763453355 shutdown_connections 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55a5191e6ef0 0x55a5191e9310 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a51916bcb0 0x55a519165da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe28cff9640 0 client.17676 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a519161410 0x55a519165860 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 1 --2- 172.21.15.12:0/3763453355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a519160af0 0x55a519174130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 1 -- 172.21.15.12:0/3763453355 >> 172.21.15.12:0/3763453355 conn(0x55a51915d060 msgr2=0x55a51915b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 1 -- 172.21.15.12:0/3763453355 shutdown_connections 2024-09-19T06:48:13.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 1 -- 172.21.15.12:0/3763453355 wait complete. 2024-09-19T06:48:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ae63f740 20 client.17676 trim_cache size 0 max 16384 2024-09-19T06:48:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:48:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:48:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:48:13.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:48:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/48428669 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2900a3460 msgr2=0x7fe2900a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ab7c4640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2900a3460 0x7fe2900a5920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55a51915e3e0 tx=0x7fe29c007940 comp rx=0 tx=0).stop 2024-09-19T06:48:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/48428669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2a41009b0 msgr2=0x7fe2a4198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ab7c4640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2a41009b0 0x7fe2a4198210 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009a50 tx=0x7fe2a0004270 comp rx=0 tx=0).stop 2024-09-19T06:48:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/48428669 shutdown_connections 2024-09-19T06:48:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ab7c4640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2a41069c0 0x7fe2a419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ab7c4640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2900a3460 0x7fe2900a5920 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.177+0000 7fe2ab7c4640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2a4101350 0x7fe2a4198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.178+0000 7fe2ab7c4640 1 --2- 172.21.15.12:0/48428669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2a41009b0 0x7fe2a4198210 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.178+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/48428669 >> 172.21.15.12:0/48428669 conn(0x7fe2a4077990 msgr2=0x7fe2a40699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.178+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/48428669 shutdown_connections 2024-09-19T06:48:13.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:13.178+0000 7fe2ab7c4640 1 -- 172.21.15.12:0/48428669 wait complete. 2024-09-19T06:48:14.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:13 smithi016 ceph-mon[34911]: pgmap v248: 97 pgs: 97 active+clean; 4.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 86 KiB/s wr, 37 op/s 2024-09-19T06:48:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:13 smithi173 ceph-mon[35349]: pgmap v248: 97 pgs: 97 active+clean; 4.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 86 KiB/s wr, 37 op/s 2024-09-19T06:48:14.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:13 smithi012 ceph-mon[30937]: pgmap v248: 97 pgs: 97 active+clean; 4.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 86 KiB/s wr, 37 op/s 2024-09-19T06:48:15.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:48:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:15 smithi173 ceph-mon[35349]: pgmap v249: 97 pgs: 97 active+clean; 4.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 60 KiB/s wr, 34 op/s 2024-09-19T06:48:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:15 smithi173 ceph-mon[35349]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:48:16.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:15 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:48:16.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:15 smithi012 ceph-mon[30937]: pgmap v249: 97 pgs: 97 active+clean; 4.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 60 KiB/s wr, 34 op/s 2024-09-19T06:48:16.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:15 smithi012 ceph-mon[30937]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:48:16.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:15 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:48:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:15 smithi016 ceph-mon[34911]: pgmap v249: 97 pgs: 97 active+clean; 4.3 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 60 KiB/s wr, 34 op/s 2024-09-19T06:48:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:15 smithi016 ceph-mon[34911]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:48:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:15 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:48:16.674 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:48:16.948 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.433+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/4092929897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a18101dd0 msgr2=0x7f7a181021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.433+0000 7f7a1cfc4640 1 --2- 172.21.15.12:0/4092929897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a18101dd0 0x7f7a181021b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009900 tx=0x7f7a0802a410 comp rx=0 tx=0).stop 2024-09-19T06:48:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.433+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/4092929897 shutdown_connections 2024-09-19T06:48:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.433+0000 7f7a1cfc4640 1 --2- 172.21.15.12:0/4092929897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a18106f00 0x7f7a1810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.433+0000 7f7a1cfc4640 1 --2- 172.21.15.12:0/4092929897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a18102780 0x7f7a181067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.433+0000 7f7a1cfc4640 1 --2- 172.21.15.12:0/4092929897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a18101dd0 0x7f7a181021b0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.433+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/4092929897 >> 172.21.15.12:0/4092929897 conn(0x7f7a180fd890 msgr2=0x7f7a180ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.433+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/4092929897 shutdown_connections 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.433+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/4092929897 wait complete. 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a1cfc4640 1 Processor -- start 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a1cfc4640 1 -- start start 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a1cfc4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a18101dd0 0x7f7a180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a1cfc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a18102780 0x7f7a18074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a1cfc4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a18106f00 0x7f7a18074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a1cfc4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a18111f80 con 0x7f7a18102780 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a1cfc4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7a18111e00 con 0x7f7a18106f00 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a1cfc4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7a18112100 con 0x7f7a18101dd0 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a18102780 0x7f7a18074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a18102780 0x7f7a18074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39650/0 (socket says 172.21.15.12:39650) 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a0ffff640 1 -- 172.21.15.12:0/451592902 learned_addr learned my addr 172.21.15.12:0/451592902 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a1659c640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a18101dd0 0x7f7a180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.434+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a18106f00 0x7f7a18074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a0ffff640 1 -- 172.21.15.12:0/451592902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a18101dd0 msgr2=0x7f7a180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a18101dd0 0x7f7a180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a0ffff640 1 -- 172.21.15.12:0/451592902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a18106f00 msgr2=0x7f7a18074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a18106f00 0x7f7a18074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a0ffff640 1 -- 172.21.15.12:0/451592902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a181a6920 con 0x7f7a18102780 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a18102780 0x7f7a18074a30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000b4a0 tx=0x7f7a0000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a0f7fe640 1 -- 172.21.15.12:0/451592902 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00014070 con 0x7f7a18102780 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/451592902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a181a6c10 con 0x7f7a18102780 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a0f7fe640 1 -- 172.21.15.12:0/451592902 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a00010af0 con 0x7f7a18102780 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a0f7fe640 1 -- 172.21.15.12:0/451592902 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00017d10 con 0x7f7a18102780 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.435+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/451592902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a181a71a0 con 0x7f7a18102780 2024-09-19T06:48:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.437+0000 7f7a0f7fe640 1 -- 172.21.15.12:0/451592902 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7a00017070 con 0x7f7a18102780 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.438+0000 7f7a1f39d740 1 Processor -- start 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.438+0000 7f7a1f39d740 1 -- start start 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.438+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b615880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.438+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b615dc0 0x56145b620140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.438+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b620680 0x56145b622a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.438+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56145b57b2e0 con 0x56145b6154a0 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.438+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56145b522ce0 con 0x56145b615dc0 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.438+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56145b5772a0 con 0x56145b620680 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.438+0000 7f7a16d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b615880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a0f7fe640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a040a33b0 0x7f7a040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a16d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b615880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39652/0 (socket says 172.21.15.12:39652) 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a16d9d640 1 -- 172.21.15.12:0/1969465535 learned_addr learned my addr 172.21.15.12:0/1969465535 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a1659c640 1 --2- 172.21.15.12:0/1969465535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b615dc0 0x56145b620140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/1969465535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b620680 0x56145b622a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a040a33b0 0x7f7a040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a0f7fe640 1 -- 172.21.15.12:0/451592902 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f7a000cf080 con 0x7f7a18102780 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a16d9d640 1 -- 172.21.15.12:0/1969465535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b620680 msgr2=0x56145b622a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/1969465535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b620680 0x56145b622a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a16d9d640 1 -- 172.21.15.12:0/1969465535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b615dc0 msgr2=0x56145b620140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/1969465535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b615dc0 0x56145b620140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a16d9d640 1 -- 172.21.15.12:0/1969465535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56145b507440 con 0x56145b6154a0 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/1969465535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b615880 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7a10012910 tx=0x7f7a10012dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813023d57a42aaa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a040a33b0 0x7f7a040a5870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7a10010740 tx=0x7f7a1001c000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a0cff9640 1 -- 172.21.15.12:0/1969465535 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10004d20 con 0x56145b6154a0 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a0cff9640 1 -- 172.21.15.12:0/1969465535 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a10020030 con 0x56145b6154a0 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.439+0000 7f7a0cff9640 1 -- 172.21.15.12:0/1969465535 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1001c950 con 0x56145b6154a0 2024-09-19T06:48:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.440+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1969465535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 msgr2=0x56145b615880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.440+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/1969465535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b615880 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7a10012910 tx=0x7f7a10012dd0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.440+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1969465535 shutdown_connections 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.440+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/1969465535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b620680 0x56145b622a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.440+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/1969465535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b615dc0 0x56145b620140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.440+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/1969465535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b615880 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.440+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1969465535 >> 172.21.15.12:0/1969465535 conn(0x56145b611a30 msgr2=0x56145b611e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.440+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1969465535 shutdown_connections 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.440+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1969465535 wait complete. 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1f39d740 1 -- start start 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1f39d740 1 Processor -- start 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b61ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b615dc0 0x56145b61d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 0x56145b61d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56145b623250 con 0x56145b6154a0 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56145b536050 con 0x56145b620680 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56145b6233d0 con 0x56145b615dc0 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1f39d740 10 client.0 _ll_register_callbacks cb 0x56145b576160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b61ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b61ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39662/0 (socket says 172.21.15.12:39662) 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1659c640 1 -- 172.21.15.12:0/3322616723 learned_addr learned my addr 172.21.15.12:0/3322616723 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 0x56145b61d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b615dc0 0x56145b61d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1659c640 1 -- 172.21.15.12:0/3322616723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b615dc0 msgr2=0x56145b61d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1659c640 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b615dc0 0x56145b61d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1659c640 1 -- 172.21.15.12:0/3322616723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 msgr2=0x56145b61d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1659c640 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 0x56145b61d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.441+0000 7f7a1659c640 1 -- 172.21.15.12:0/3322616723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56145b2ec3c0 con 0x56145b6154a0 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 0x56145b61d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f7a1659c640 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b61ffd0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009900 tx=0x7f7a08031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5002c2d00a7e18cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f79fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f79fdffb640 1 -- 172.21.15.12:0/3322616723 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08035040 con 0x56145b6154a0 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f79fdffb640 1 -- 172.21.15.12:0/3322616723 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f7a08004380 con 0x56145b6154a0 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f7a1f39d740 1 -- 172.21.15.12:0/3322616723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a10020030 con 0x56145b6154a0 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f79fdffb640 1 -- 172.21.15.12:0/3322616723 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7a08005020 con 0x56145b6154a0 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f7a1f39d740 10 client.17688 fetch_fsmap learned FSMap version 42 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f7a1f39d740 1 -- 172.21.15.12:0/3322616723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56145b62ec20 con 0x56145b6154a0 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f79fdffb640 1 -- 172.21.15.12:0/3322616723 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a10020030 con 0x56145b6154a0 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.442+0000 7f79fdffb640 1 -- 172.21.15.12:0/3322616723 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 42) ==== 8370+0+0 (secure 0 0 0) 0x7f7a080035f0 con 0x56145b6154a0 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.443+0000 7f7a1f39d740 10 client.17688 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T06:48:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.443+0000 7f7a1f39d740 10 client.17688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.443+0000 7f7a1f39d740 20 client.17688 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.443+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56145b6300e0 0x56145b632530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.443+0000 7f7a1f39d740 4 client.17688 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.443+0000 7f7a1f39d740 1 -- 172.21.15.12:0/3322616723 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56145b588850 con 0x56145b6300e0 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.443+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56145b6300e0 0x56145b632530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.443+0000 7f79fdffb640 10 client.17688 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.443+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56145b6300e0 0x56145b632530 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4db3ed4d88729734 server_cookie=c9ed957b722ec7d1 in_seq=0 out_seq=0 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f79fdffb640 1 -- 172.21.15.12:0/3322616723 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56145b588850 con 0x56145b6300e0 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f79fdffb640 10 client.17688 handle_command_reply: tid=0 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 client.17688 shutdown 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 -- 172.21.15.12:0/3322616723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 msgr2=0x56145b61ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b61ffd0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009900 tx=0x7f7a08031a60 comp rx=0 tx=0).stop 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 -- 172.21.15.12:0/3322616723 shutdown_connections 2024-09-19T06:48:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56145b6300e0 0x56145b632530 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 0x56145b61d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b615dc0 0x56145b61d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/3322616723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b6154a0 0x56145b61ffd0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 -- 172.21.15.12:0/3322616723 >> 172.21.15.12:0/3322616723 conn(0x56145b611a30 msgr2=0x56145b617760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f79fdffb640 0 client.17688 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 -- 172.21.15.12:0/3322616723 shutdown_connections 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 1 -- 172.21.15.12:0/3322616723 wait complete. 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.444+0000 7f7a1f39d740 20 client.17688 trim_cache size 0 max 16384 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a1f39d740 1 Processor -- start 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a1f39d740 1 -- start start 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b6154a0 0x56145b61bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b615dc0 0x56145b637e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b620680 0x56145b638340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181afd80 con 0x56145b620680 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181b1920 con 0x56145b615dc0 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181b0450 con 0x56145b6154a0 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a16d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b620680 0x56145b638340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a16d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b620680 0x56145b638340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39674/0 (socket says 172.21.15.12:39674) 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a16d9d640 1 -- 172.21.15.12:0/2103220874 learned_addr learned my addr 172.21.15.12:0/2103220874 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/2103220874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b615dc0 0x56145b637e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a16d9d640 1 -- 172.21.15.12:0/2103220874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b6154a0 msgr2=0x56145b61bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/2103220874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b6154a0 0x56145b61bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a16d9d640 1 -- 172.21.15.12:0/2103220874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b615dc0 msgr2=0x56145b637e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/2103220874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b615dc0 0x56145b637e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a16d9d640 1 -- 172.21.15.12:0/2103220874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56145b61c230 con 0x56145b620680 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.462+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/2103220874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b620680 0x56145b638340 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7a10020000 tx=0x7f7a1001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7ed1064ba222a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f79fffff640 1 -- 172.21.15.12:0/2103220874 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10035070 con 0x56145b620680 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f79fffff640 1 -- 172.21.15.12:0/2103220874 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a10003e50 con 0x56145b620680 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f79fffff640 1 -- 172.21.15.12:0/2103220874 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1001b720 con 0x56145b620680 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f7a1f39d740 1 -- 172.21.15.12:0/2103220874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b620680 msgr2=0x56145b638340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/2103220874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b620680 0x56145b638340 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7a10020000 tx=0x7f7a1001e040 comp rx=0 tx=0).stop 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f7a1f39d740 1 -- 172.21.15.12:0/2103220874 shutdown_connections 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/2103220874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b620680 0x56145b638340 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/2103220874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b615dc0 0x56145b637e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/2103220874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b6154a0 0x56145b61bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f7a1f39d740 1 -- 172.21.15.12:0/2103220874 >> 172.21.15.12:0/2103220874 conn(0x56145b611a30 msgr2=0x56145b610b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f7a1f39d740 1 -- 172.21.15.12:0/2103220874 shutdown_connections 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.463+0000 7f7a1f39d740 1 -- 172.21.15.12:0/2103220874 wait complete. 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a1f39d740 1 -- start start 2024-09-19T06:48:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a1f39d740 1 Processor -- start 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b6154a0 0x56145b626570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b615dc0 0x56145b626ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a1f39d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 0x56145b626ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181b1220 con 0x56145b615dc0 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181b0b50 con 0x56145b620680 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a1f39d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181add80 con 0x56145b6154a0 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a1f39d740 10 client.0 _ll_register_callbacks cb 0x7f7a08009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b615dc0 0x56145b626ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b615dc0 0x56145b626ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39680/0 (socket says 172.21.15.12:39680) 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a0ffff640 1 -- 172.21.15.12:0/1791926587 learned_addr learned my addr 172.21.15.12:0/1791926587 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a16d9d640 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 0x56145b626ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a1659c640 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b6154a0 0x56145b626570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a0ffff640 1 -- 172.21.15.12:0/1791926587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b6154a0 msgr2=0x56145b626570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b6154a0 0x56145b626570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a0ffff640 1 -- 172.21.15.12:0/1791926587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 msgr2=0x56145b626ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 0x56145b626ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.464+0000 7f7a0ffff640 1 -- 172.21.15.12:0/1791926587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56145b699f80 con 0x56145b615dc0 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f7a0ffff640 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b615dc0 0x56145b626ab0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009420 tx=0x7f7a0006a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f879e42c330ccd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f79fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f79fdffb640 1 -- 172.21.15.12:0/1791926587 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0001e040 con 0x56145b615dc0 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f79fdffb640 1 -- 172.21.15.12:0/1791926587 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f7a000979e0 con 0x56145b615dc0 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1791926587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a10003e50 con 0x56145b615dc0 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f79fdffb640 1 -- 172.21.15.12:0/1791926587 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7a000b4360 con 0x56145b615dc0 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f7a1f39d740 10 client.17694 fetch_fsmap learned FSMap version 42 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1791926587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56145b69b2b0 con 0x56145b615dc0 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f79fdffb640 1 -- 172.21.15.12:0/1791926587 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a10003e50 con 0x56145b615dc0 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f79fdffb640 1 -- 172.21.15.12:0/1791926587 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 42) ==== 8370+0+0 (secure 0 0 0) 0x7f7a000cc950 con 0x56145b615dc0 2024-09-19T06:48:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f7a1f39d740 10 client.17694 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T06:48:17.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f7a1f39d740 10 client.17694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:17.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f7a1f39d740 20 client.17694 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:17.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56145b69ba90 0x56145b69deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:17.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f7a1f39d740 4 client.17694 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:48:17.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.465+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1791926587 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56145b582d60 con 0x56145b69ba90 2024-09-19T06:48:17.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f7a1659c640 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56145b69ba90 0x56145b69deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:17.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f7a1659c640 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56145b69ba90 0x56145b69deb0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa75c53929fb422b server_cookie=3245826619d29a59 in_seq=0 out_seq=0 2024-09-19T06:48:17.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f79fdffb640 10 client.17694 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:17.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f79fdffb640 1 -- 172.21.15.12:0/1791926587 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56145b582d60 con 0x56145b69ba90 2024-09-19T06:48:17.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f79fdffb640 10 client.17694 handle_command_reply: tid=0 2024-09-19T06:48:17.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f7a1f39d740 1 client.17694 shutdown 2024-09-19T06:48:17.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1791926587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b615dc0 msgr2=0x56145b626ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b615dc0 0x56145b626ab0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009420 tx=0x7f7a0006a060 comp rx=0 tx=0).stop 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1791926587 shutdown_connections 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56145b69ba90 0x56145b69deb0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f79fdffb640 0 client.17694 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56145b620680 0x56145b626ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56145b615dc0 0x56145b626ab0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.466+0000 7f7a1f39d740 1 --2- 172.21.15.12:0/1791926587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56145b6154a0 0x56145b626570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1791926587 >> 172.21.15.12:0/1791926587 conn(0x56145b611a30 msgr2=0x56145b610b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1791926587 shutdown_connections 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1f39d740 1 -- 172.21.15.12:0/1791926587 wait complete. 2024-09-19T06:48:17.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1f39d740 20 client.17694 trim_cache size 0 max 16384 2024-09-19T06:48:17.484 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:48:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:48:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:48:17.484 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:48:17.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/451592902 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a040a33b0 msgr2=0x7f7a040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a040a33b0 0x7f7a040a5870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7a10010740 tx=0x7f7a1001c000 comp rx=0 tx=0).stop 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/451592902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a18102780 msgr2=0x7f7a18074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a18102780 0x7f7a18074a30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000b4a0 tx=0x7f7a0000b960 comp rx=0 tx=0).stop 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/451592902 shutdown_connections 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a18106f00 0x7f7a18074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a18102780 0x7f7a18074a30 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a040a33b0 0x7f7a040a5870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 --2- 172.21.15.12:0/451592902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a18101dd0 0x7f7a180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/451592902 >> 172.21.15.12:0/451592902 conn(0x7f7a180fd890 msgr2=0x7f7a180fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/451592902 shutdown_connections 2024-09-19T06:48:17.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:17.467+0000 7f7a1cfc4640 1 -- 172.21.15.12:0/451592902 wait complete. 2024-09-19T06:48:18.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:17 smithi173 ceph-mon[35349]: pgmap v251: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 21 op/s 2024-09-19T06:48:18.089 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:17 smithi012 ceph-mon[30937]: pgmap v251: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 21 op/s 2024-09-19T06:48:18.249 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:48:18.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:48:18.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:17 smithi016 ceph-mon[34911]: pgmap v251: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 21 op/s 2024-09-19T06:48:18.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:48:18.507 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.979+0000 7f875eeb8640 1 -- 172.21.15.12:0/3967338525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f875810c170 msgr2=0x7f875810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.979+0000 7f875eeb8640 1 --2- 172.21.15.12:0/3967338525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f875810c170 0x7f875810e610 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8750009ca0 tx=0x7f875002a950 comp rx=0 tx=0).stop 2024-09-19T06:48:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.979+0000 7f875eeb8640 1 -- 172.21.15.12:0/3967338525 shutdown_connections 2024-09-19T06:48:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.979+0000 7f875eeb8640 1 --2- 172.21.15.12:0/3967338525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f875810c170 0x7f875810e610 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.979+0000 7f875eeb8640 1 --2- 172.21.15.12:0/3967338525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8758103660 0x7f875810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.979+0000 7f875eeb8640 1 --2- 172.21.15.12:0/3967338525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8758102d40 0x7f8758103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.979+0000 7f875eeb8640 1 -- 172.21.15.12:0/3967338525 >> 172.21.15.12:0/3967338525 conn(0x7f87580fc7a0 msgr2=0x7f87580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:19.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.979+0000 7f875eeb8640 1 -- 172.21.15.12:0/3967338525 shutdown_connections 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.979+0000 7f875eeb8640 1 -- 172.21.15.12:0/3967338525 wait complete. 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f875eeb8640 1 Processor -- start 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f875eeb8640 1 -- start start 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f875eeb8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8758102d40 0x7f87581009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f875eeb8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8758103660 0x7f8758100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f875eeb8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f875810c170 0x7f8758101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f875eeb8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8758111f70 con 0x7f8758103660 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f875eeb8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8758111df0 con 0x7f875810c170 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f875eeb8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f87581120f0 con 0x7f8758102d40 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f8757fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8758103660 0x7f8758100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f8757fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8758103660 0x7f8758100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39698/0 (socket says 172.21.15.12:39698) 2024-09-19T06:48:19.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f8757fff640 1 -- 172.21.15.12:0/799140987 learned_addr learned my addr 172.21.15.12:0/799140987 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f875cc54640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8758102d40 0x7f87581009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.980+0000 7f875d455640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f875810c170 0x7f8758101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f8757fff640 1 -- 172.21.15.12:0/799140987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8758102d40 msgr2=0x7f87581009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f8757fff640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8758102d40 0x7f87581009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f8757fff640 1 -- 172.21.15.12:0/799140987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f875810c170 msgr2=0x7f8758101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f8757fff640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f875810c170 0x7f8758101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f8757fff640 1 -- 172.21.15.12:0/799140987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87581a6910 con 0x7f8758103660 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f875d455640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f875810c170 0x7f8758101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f8757fff640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8758103660 0x7f8758100ee0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f874400d740 tx=0x7f874400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f8755ffb640 1 -- 172.21.15.12:0/799140987 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744017070 con 0x7f8758103660 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f8755ffb640 1 -- 172.21.15.12:0/799140987 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f874400de50 con 0x7f8758103660 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f875eeb8640 1 -- 172.21.15.12:0/799140987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87581a6c00 con 0x7f8758103660 2024-09-19T06:48:19.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f8755ffb640 1 -- 172.21.15.12:0/799140987 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874400f620 con 0x7f8758103660 2024-09-19T06:48:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.981+0000 7f875eeb8640 1 -- 172.21.15.12:0/799140987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87581a7140 con 0x7f8758103660 2024-09-19T06:48:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.982+0000 7f875eeb8640 1 -- 172.21.15.12:0/799140987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8758103120 con 0x7f8758103660 2024-09-19T06:48:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.983+0000 7f8755ffb640 1 -- 172.21.15.12:0/799140987 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8744009c30 con 0x7f8758103660 2024-09-19T06:48:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.984+0000 7f8755ffb640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87480a33b0 0x7f87480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.984+0000 7f875cc54640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87480a33b0 0x7f87480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.985+0000 7f8755ffb640 1 -- 172.21.15.12:0/799140987 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f87440cf970 con 0x7f8758103660 2024-09-19T06:48:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.985+0000 7f875cc54640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87480a33b0 0x7f87480a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f874c00bbe0 tx=0x7f874c00b390 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:18.989+0000 7f8755ffb640 1 -- 172.21.15.12:0/799140987 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f874409c250 con 0x7f8758103660 2024-09-19T06:48:19.044 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:19.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.213+0000 7f875eeb8640 1 -- 172.21.15.12:0/799140987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8758107210 con 0x7f8758103660 2024-09-19T06:48:19.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.214+0000 7f8755ffb640 1 -- 172.21.15.12:0/799140987 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11973 (secure 0 0 0) 0x7f874409bb50 con 0x7f8758103660 2024-09-19T06:48:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:48:19.216 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 42 2024-09-19T06:48:19.216 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":42,"btime":"2024-09-19T06:48:14:920762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:48:14.412719+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 -- 172.21.15.12:0/799140987 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87480a33b0 msgr2=0x7f87480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87480a33b0 0x7f87480a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f874c00bbe0 tx=0x7f874c00b390 comp rx=0 tx=0).stop 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 -- 172.21.15.12:0/799140987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8758103660 msgr2=0x7f8758100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8758103660 0x7f8758100ee0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f874400d740 tx=0x7f874400dc00 comp rx=0 tx=0).stop 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 -- 172.21.15.12:0/799140987 shutdown_connections 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f875810c170 0x7f8758101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8758103660 0x7f8758100ee0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87480a33b0 0x7f87480a5870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 --2- 172.21.15.12:0/799140987 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8758102d40 0x7f87581009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 -- 172.21.15.12:0/799140987 >> 172.21.15.12:0/799140987 conn(0x7f87580fc7a0 msgr2=0x7f87580fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 -- 172.21.15.12:0/799140987 shutdown_connections 2024-09-19T06:48:19.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:19.216+0000 7f875eeb8640 1 -- 172.21.15.12:0/799140987 wait complete. 2024-09-19T06:48:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:19 smithi012 ceph-mon[30937]: pgmap v252: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 18 op/s 2024-09-19T06:48:19.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:19 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/799140987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:20.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:48:20.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:19 smithi173 ceph-mon[35349]: pgmap v252: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 18 op/s 2024-09-19T06:48:20.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:19 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/799140987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:19 smithi016 ceph-mon[34911]: pgmap v252: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 18 op/s 2024-09-19T06:48:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:19 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/799140987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:20.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 -- 172.21.15.12:0/3005775937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b94102ef0 msgr2=0x7f3b9410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:20.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 --2- 172.21.15.12:0/3005775937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b94102ef0 0x7f3b9410da40 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009ca0 tx=0x7f3b8c02a950 comp rx=0 tx=0).stop 2024-09-19T06:48:20.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 -- 172.21.15.12:0/3005775937 shutdown_connections 2024-09-19T06:48:20.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 --2- 172.21.15.12:0/3005775937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b94102ef0 0x7f3b9410da40 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 --2- 172.21.15.12:0/3005775937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b94102570 0x7f3b941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 --2- 172.21.15.12:0/3005775937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b94100e20 0x7f3b94101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 -- 172.21.15.12:0/3005775937 >> 172.21.15.12:0/3005775937 conn(0x7f3b940fc7d0 msgr2=0x7f3b940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:20.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 -- 172.21.15.12:0/3005775937 shutdown_connections 2024-09-19T06:48:20.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 -- 172.21.15.12:0/3005775937 wait complete. 2024-09-19T06:48:20.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 Processor -- start 2024-09-19T06:48:20.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.309+0000 7f3b98d04640 1 -- start start 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b98d04640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b94100e20 0x7f3b941983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b98d04640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b94102570 0x7f3b94198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b98d04640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b94102ef0 0x7f3b9419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b98d04640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94110f80 con 0x7f3b94102ef0 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b98d04640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94110e00 con 0x7f3b94102570 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b98d04640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94111100 con 0x7f3b94100e20 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b92d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b94102ef0 0x7f3b9419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b92d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b94102ef0 0x7f3b9419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39710/0 (socket says 172.21.15.12:39710) 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b92d9d640 1 -- 172.21.15.12:0/2666677732 learned_addr learned my addr 172.21.15.12:0/2666677732 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b9259c640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b94100e20 0x7f3b941983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b8bfff640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b94102570 0x7f3b94198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:20.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b92d9d640 1 -- 172.21.15.12:0/2666677732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b94100e20 msgr2=0x7f3b941983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b92d9d640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b94100e20 0x7f3b941983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b92d9d640 1 -- 172.21.15.12:0/2666677732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b94102570 msgr2=0x7f3b94198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b92d9d640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b94102570 0x7f3b94198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b92d9d640 1 -- 172.21.15.12:0/2666677732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9419d380 con 0x7f3b94102ef0 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b8bfff640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b94102570 0x7f3b94198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.310+0000 7f3b92d9d640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b94102ef0 0x7f3b9419cca0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c006010 tx=0x7f3b8c02f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.311+0000 7f3b8b7fe640 1 -- 172.21.15.12:0/2666677732 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c034040 con 0x7f3b94102ef0 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.311+0000 7f3b8b7fe640 1 -- 172.21.15.12:0/2666677732 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b8c003e00 con 0x7f3b94102ef0 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.311+0000 7f3b98d04640 1 -- 172.21.15.12:0/2666677732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9419d610 con 0x7f3b94102ef0 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.311+0000 7f3b8b7fe640 1 -- 172.21.15.12:0/2666677732 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c045480 con 0x7f3b94102ef0 2024-09-19T06:48:20.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.311+0000 7f3b98d04640 1 -- 172.21.15.12:0/2666677732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b941a4f50 con 0x7f3b94102ef0 2024-09-19T06:48:20.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.312+0000 7f3b98d04640 1 -- 172.21.15.12:0/2666677732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b94101200 con 0x7f3b94102ef0 2024-09-19T06:48:20.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.313+0000 7f3b8b7fe640 1 -- 172.21.15.12:0/2666677732 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3b8c037020 con 0x7f3b94102ef0 2024-09-19T06:48:20.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.314+0000 7f3b8b7fe640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3b800a3430 0x7f3b800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:20.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.314+0000 7f3b9259c640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3b800a3430 0x7f3b800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:20.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.314+0000 7f3b8b7fe640 1 -- 172.21.15.12:0/2666677732 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f3b8c0f0e10 con 0x7f3b94102ef0 2024-09-19T06:48:20.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.315+0000 7f3b9259c640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3b800a3430 0x7f3b800a58f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3b84005e10 tx=0x7f3b84005da0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:20.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.318+0000 7f3b8b7fe640 1 -- 172.21.15.12:0/2666677732 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b8c0443e0 con 0x7f3b94102ef0 2024-09-19T06:48:20.379 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:20.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.535+0000 7f3b98d04640 1 -- 172.21.15.12:0/2666677732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b94199730 con 0x7f3b94102ef0 2024-09-19T06:48:20.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.536+0000 7f3b8b7fe640 1 -- 172.21.15.12:0/2666677732 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11973 (secure 0 0 0) 0x7f3b94199730 con 0x7f3b94102ef0 2024-09-19T06:48:20.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:48:20.538 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":42,"btime":"2024-09-19T06:48:14:920762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:48:14.412719+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:48:20.538 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 42 2024-09-19T06:48:20.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.538+0000 7f3b98d04640 1 -- 172.21.15.12:0/2666677732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3b800a3430 msgr2=0x7f3b800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:20.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.538+0000 7f3b98d04640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3b800a3430 0x7f3b800a58f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3b84005e10 tx=0x7f3b84005da0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.538+0000 7f3b98d04640 1 -- 172.21.15.12:0/2666677732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b94102ef0 msgr2=0x7f3b9419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:20.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.538+0000 7f3b98d04640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b94102ef0 0x7f3b9419cca0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c006010 tx=0x7f3b8c02f6f0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.539+0000 7f3b98d04640 1 -- 172.21.15.12:0/2666677732 shutdown_connections 2024-09-19T06:48:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.539+0000 7f3b98d04640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b94102ef0 0x7f3b9419cca0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.539+0000 7f3b98d04640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b94102570 0x7f3b94198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.539+0000 7f3b98d04640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3b800a3430 0x7f3b800a58f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.539+0000 7f3b98d04640 1 --2- 172.21.15.12:0/2666677732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b94100e20 0x7f3b941983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.539+0000 7f3b98d04640 1 -- 172.21.15.12:0/2666677732 >> 172.21.15.12:0/2666677732 conn(0x7f3b940fc7d0 msgr2=0x7f3b9406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:20.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.539+0000 7f3b98d04640 1 -- 172.21.15.12:0/2666677732 shutdown_connections 2024-09-19T06:48:20.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:20.539+0000 7f3b98d04640 1 -- 172.21.15.12:0/2666677732 wait complete. 2024-09-19T06:48:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:48:20.942 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:20 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2666677732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:21.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:20 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2666677732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:21.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:20 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2666677732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:48:21.287 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id e0b77255 --release --await' 2024-09-19T06:48:21.287 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id e0b77255 --release --await 2024-09-19T06:48:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.482+0000 7f1489732640 1 -- 172.21.15.12:0/1025938550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1484105560 msgr2=0x7f148410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.482+0000 7f1489732640 1 --2- 172.21.15.12:0/1025938550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1484105560 0x7f148410d0e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f147c009ca0 tx=0x7f147c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.483+0000 7f1489732640 1 -- 172.21.15.12:0/1025938550 shutdown_connections 2024-09-19T06:48:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.483+0000 7f1489732640 1 --2- 172.21.15.12:0/1025938550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1484105560 0x7f148410d0e0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.483+0000 7f1489732640 1 --2- 172.21.15.12:0/1025938550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1484100de0 0x7f1484104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.483+0000 7f1489732640 1 --2- 172.21.15.12:0/1025938550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1484100430 0x7f1484100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.483+0000 7f1489732640 1 -- 172.21.15.12:0/1025938550 >> 172.21.15.12:0/1025938550 conn(0x7f1484077230 msgr2=0x7f14840fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.483+0000 7f1489732640 1 -- 172.21.15.12:0/1025938550 shutdown_connections 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.483+0000 7f1489732640 1 -- 172.21.15.12:0/1025938550 wait complete. 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.483+0000 7f1489732640 1 Processor -- start 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f1489732640 1 -- start start 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f1489732640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1484100430 0x7f14841983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f1489732640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1484100de0 0x7f1484198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f1489732640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1484105560 0x7f148419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f1489732640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1484110e40 con 0x7f1484105560 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f1489732640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1484110cc0 con 0x7f1484100de0 2024-09-19T06:48:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f1489732640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1484110fc0 con 0x7f1484100430 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f14837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1484105560 0x7f148419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f14837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1484105560 0x7f148419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36050/0 (socket says 172.21.15.12:36050) 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f14837fe640 1 -- 172.21.15.12:0/2916796571 learned_addr learned my addr 172.21.15.12:0/2916796571 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f14827fc640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1484100de0 0x7f1484198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f14837fe640 1 -- 172.21.15.12:0/2916796571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1484100430 msgr2=0x7f14841983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f14837fe640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1484100430 0x7f14841983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f14837fe640 1 -- 172.21.15.12:0/2916796571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1484100de0 msgr2=0x7f1484198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f14837fe640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1484100de0 0x7f1484198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.484+0000 7f14837fe640 1 -- 172.21.15.12:0/2916796571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148419d380 con 0x7f1484105560 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.485+0000 7f14837fe640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1484105560 0x7f148419cca0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f147c030fd0 tx=0x7f147c031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.485+0000 7f146bfff640 1 -- 172.21.15.12:0/2916796571 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c003c30 con 0x7f1484105560 2024-09-19T06:48:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.485+0000 7f146bfff640 1 -- 172.21.15.12:0/2916796571 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f147c003dd0 con 0x7f1484105560 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.485+0000 7f1489732640 1 -- 172.21.15.12:0/2916796571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148419d610 con 0x7f1484105560 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.485+0000 7f146bfff640 1 -- 172.21.15.12:0/2916796571 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c03a420 con 0x7f1484105560 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.485+0000 7f1489732640 1 -- 172.21.15.12:0/2916796571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14841a4f50 con 0x7f1484105560 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.487+0000 7f146bfff640 1 -- 172.21.15.12:0/2916796571 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f147c004050 con 0x7f1484105560 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.487+0000 7f148bb0b740 1 Processor -- start 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.487+0000 7f148bb0b740 1 -- start start 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb820bb40 0x55fbb820a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820a5d0 0x55fbb820aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb8215370 0x55fbb8217760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f148bb0b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbb81702f0 con 0x55fbb820a5d0 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f148bb0b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fbb8117cf0 con 0x55fbb820bb40 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f148bb0b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fbb816c2b0 con 0x55fbb8215370 2024-09-19T06:48:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f1482ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820a5d0 0x55fbb820aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f1482ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820a5d0 0x55fbb820aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36052/0 (socket says 172.21.15.12:36052) 2024-09-19T06:48:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f1482ffd640 1 -- 172.21.15.12:0/3402567465 learned_addr learned my addr 172.21.15.12:0/3402567465 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f14827fc640 1 --2- 172.21.15.12:0/3402567465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb820bb40 0x55fbb820a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f14827fc640 1 --2- 172.21.15.12:0/3402567465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb8215370 0x55fbb8217760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f146bfff640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f146c0a3430 0x7f146c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f1482ffd640 1 -- 172.21.15.12:0/3402567465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb8215370 msgr2=0x55fbb8217760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f1482ffd640 1 --2- 172.21.15.12:0/3402567465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb8215370 0x55fbb8217760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f1482ffd640 1 -- 172.21.15.12:0/3402567465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb820bb40 msgr2=0x55fbb820a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f1482ffd640 1 --2- 172.21.15.12:0/3402567465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb820bb40 0x55fbb820a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f1482ffd640 1 -- 172.21.15.12:0/3402567465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbb80fc3a0 con 0x55fbb820a5d0 2024-09-19T06:48:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f146bfff640 1 -- 172.21.15.12:0/2916796571 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f147c0f1160 con 0x7f1484105560 2024-09-19T06:48:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f14837fe640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f146c0a3430 0x7f146c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.488+0000 7f1482ffd640 1 --2- 172.21.15.12:0/3402567465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820a5d0 0x55fbb820aa10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f147400aa90 tx=0x7f147400af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7f4ec5801da09d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.489+0000 7f14697fa640 1 -- 172.21.15.12:0/3402567465 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147400f450 con 0x55fbb820a5d0 2024-09-19T06:48:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.489+0000 7f14697fa640 1 -- 172.21.15.12:0/3402567465 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f147400fad0 con 0x55fbb820a5d0 2024-09-19T06:48:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.489+0000 7f14697fa640 1 -- 172.21.15.12:0/3402567465 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474018b60 con 0x55fbb820a5d0 2024-09-19T06:48:21.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.489+0000 7f14837fe640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f146c0a3430 0x7f146c0a58f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f147c031fd0 tx=0x7f147c0095c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.489+0000 7f148bb0b740 1 -- 172.21.15.12:0/3402567465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820a5d0 msgr2=0x55fbb820aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.489+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3402567465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820a5d0 0x55fbb820aa10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f147400aa90 tx=0x7f147400af50 comp rx=0 tx=0).stop 2024-09-19T06:48:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 -- 172.21.15.12:0/3402567465 shutdown_connections 2024-09-19T06:48:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3402567465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb8215370 0x55fbb8217760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3402567465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820a5d0 0x55fbb820aa10 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3402567465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb820bb40 0x55fbb820a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 -- 172.21.15.12:0/3402567465 >> 172.21.15.12:0/3402567465 conn(0x55fbb81d3310 msgr2=0x55fbb8206c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 -- 172.21.15.12:0/3402567465 shutdown_connections 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 -- 172.21.15.12:0/3402567465 wait complete. 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 -- start start 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 Processor -- start 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb8214d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8212030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 0x55fbb8212640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbb8218070 con 0x55fbb820bb40 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fbb812b060 con 0x55fbb8215370 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fbb82181f0 con 0x55fbb820a5d0 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f148bb0b740 10 client.0 _ll_register_callbacks cb 0x55fbb7e7e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:21.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.490+0000 7f1482ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8212030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1482ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8212030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36060/0 (socket says 172.21.15.12:36060) 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1482ffd640 1 -- 172.21.15.12:0/3515043906 learned_addr learned my addr 172.21.15.12:0/3515043906 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f14827fc640 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb8214d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f14827fc640 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 0x55fbb8212640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1482ffd640 1 -- 172.21.15.12:0/3515043906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 msgr2=0x55fbb8214d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1482ffd640 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb8214d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1482ffd640 1 -- 172.21.15.12:0/3515043906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 msgr2=0x55fbb8212640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1482ffd640 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 0x55fbb8212640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1482ffd640 1 -- 172.21.15.12:0/3515043906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbb7ee13c0 con 0x55fbb820bb40 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f14827fc640 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 0x55fbb8212640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1482ffd640 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8212030 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f14740058a0 tx=0x7f1474018780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98adf0e324cb7cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1466ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:21.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1466ff5640 1 -- 172.21.15.12:0/3515043906 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147400fc80 con 0x55fbb820bb40 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f148bb0b740 1 -- 172.21.15.12:0/3515043906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f147400fad0 con 0x55fbb820bb40 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1466ff5640 1 -- 172.21.15.12:0/3515043906 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f1474004020 con 0x55fbb820bb40 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f1466ff5640 1 -- 172.21.15.12:0/3515043906 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1474004220 con 0x55fbb820bb40 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f148bb0b740 10 client.17718 fetch_fsmap learned FSMap version 42 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.491+0000 7f148bb0b740 1 -- 172.21.15.12:0/3515043906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fbb8223b40 con 0x55fbb820bb40 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.492+0000 7f1466ff5640 1 -- 172.21.15.12:0/3515043906 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f147400fad0 con 0x55fbb820bb40 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.492+0000 7f1466ff5640 1 -- 172.21.15.12:0/3515043906 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 42) ==== 8370+0+0 (secure 0 0 0) 0x7f14740035f0 con 0x55fbb820bb40 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.492+0000 7f148bb0b740 10 client.17718 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.492+0000 7f148bb0b740 10 client.17718 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.492+0000 7f148bb0b740 20 client.17718 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.492+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55fbb8225380 0x55fbb82277c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.492+0000 7f148bb0b740 4 client.17718 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.492+0000 7f148bb0b740 1 -- 172.21.15.12:0/3515043906 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbb817d860 con 0x55fbb8225380 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.492+0000 7f14827fc640 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55fbb8225380 0x55fbb82277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.493+0000 7f14827fc640 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55fbb8225380 0x55fbb82277c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4c2ecd4cf8971400 server_cookie=a503d220a7a5e0f in_seq=0 out_seq=0 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.493+0000 7f1466ff5640 10 client.17718 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f1466ff5640 1 -- 172.21.15.12:0/3515043906 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbb817d860 con 0x55fbb8225380 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f1466ff5640 10 client.17718 handle_command_reply: tid=0 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 client.17718 shutdown 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 -- 172.21.15.12:0/3515043906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 msgr2=0x55fbb8212030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8212030 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f14740058a0 tx=0x7f1474018780 comp rx=0 tx=0).stop 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 -- 172.21.15.12:0/3515043906 shutdown_connections 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55fbb8225380 0x55fbb82277c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 0x55fbb8212640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8212030 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3515043906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb8214d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f1466ff5640 0 client.17718 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:48:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 -- 172.21.15.12:0/3515043906 >> 172.21.15.12:0/3515043906 conn(0x55fbb81d3310 msgr2=0x55fbb820c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 -- 172.21.15.12:0/3515043906 shutdown_connections 2024-09-19T06:48:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 1 -- 172.21.15.12:0/3515043906 wait complete. 2024-09-19T06:48:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.494+0000 7f148bb0b740 20 client.17718 trim_cache size 0 max 16384 2024-09-19T06:48:21.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f148bb0b740 1 Processor -- start 2024-09-19T06:48:21.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f148bb0b740 1 -- start start 2024-09-19T06:48:21.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb8221310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8211010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 0x55fbb822d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f148bb0b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f14841ab870 con 0x55fbb820bb40 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f148bb0b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f14841ad410 con 0x55fbb8215370 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f148bb0b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14841abf40 con 0x55fbb820a5d0 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f1482ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8211010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f1482ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8211010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36062/0 (socket says 172.21.15.12:36062) 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f1482ffd640 1 -- 172.21.15.12:0/3889435519 learned_addr learned my addr 172.21.15.12:0/3889435519 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f14827fc640 1 --2- 172.21.15.12:0/3889435519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 0x55fbb822d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.508+0000 7f14827fc640 1 --2- 172.21.15.12:0/3889435519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb8221310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.509+0000 7f1482ffd640 1 -- 172.21.15.12:0/3889435519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 msgr2=0x55fbb8221310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.509+0000 7f1482ffd640 1 --2- 172.21.15.12:0/3889435519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb8221310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.509+0000 7f1482ffd640 1 -- 172.21.15.12:0/3889435519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 msgr2=0x55fbb822d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.509+0000 7f1482ffd640 1 --2- 172.21.15.12:0/3889435519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 0x55fbb822d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.509+0000 7f1482ffd640 1 -- 172.21.15.12:0/3889435519 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbb8210580 con 0x55fbb820bb40 2024-09-19T06:48:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.509+0000 7f14827fc640 1 --2- 172.21.15.12:0/3889435519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb8221310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.509+0000 7f1482ffd640 1 --2- 172.21.15.12:0/3889435519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8211010 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f14740039c0 tx=0x7f147400a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85046b41b65fa67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.509+0000 7f1468ff9640 1 -- 172.21.15.12:0/3889435519 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474005b10 con 0x55fbb820bb40 2024-09-19T06:48:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.509+0000 7f1468ff9640 1 -- 172.21.15.12:0/3889435519 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14740043c0 con 0x55fbb820bb40 2024-09-19T06:48:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.509+0000 7f1468ff9640 1 -- 172.21.15.12:0/3889435519 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474003e90 con 0x55fbb820bb40 2024-09-19T06:48:21.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.510+0000 7f148bb0b740 1 -- 172.21.15.12:0/3889435519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 msgr2=0x55fbb8211010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:21.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.510+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3889435519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8211010 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f14740039c0 tx=0x7f147400a300 comp rx=0 tx=0).stop 2024-09-19T06:48:21.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.510+0000 7f148bb0b740 1 -- 172.21.15.12:0/3889435519 shutdown_connections 2024-09-19T06:48:21.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.510+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3889435519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb8215370 0x55fbb822d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.510+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3889435519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb820bb40 0x55fbb8211010 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.510+0000 7f148bb0b740 1 --2- 172.21.15.12:0/3889435519 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb8221310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.510+0000 7f148bb0b740 1 -- 172.21.15.12:0/3889435519 >> 172.21.15.12:0/3889435519 conn(0x55fbb81d3310 msgr2=0x55fbb8210900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.510+0000 7f148bb0b740 1 -- 172.21.15.12:0/3889435519 shutdown_connections 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.510+0000 7f148bb0b740 1 -- 172.21.15.12:0/3889435519 wait complete. 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.510+0000 7f148bb0b740 1 -- start start 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f148bb0b740 1 Processor -- start 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb821d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb820bb40 0x55fbb821d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f148bb0b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb8215370 0x55fbb820e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f148bb0b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f14841acd10 con 0x55fbb8215370 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f148bb0b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f14841ac640 con 0x55fbb820bb40 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f148bb0b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14841a9870 con 0x55fbb820a5d0 2024-09-19T06:48:21.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f148bb0b740 10 client.0 _ll_register_callbacks cb 0x7f147800ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f14827fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb8215370 0x55fbb820e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f14827fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb8215370 0x55fbb820e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36078/0 (socket says 172.21.15.12:36078) 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f14827fc640 1 -- 172.21.15.12:0/2484040400 learned_addr learned my addr 172.21.15.12:0/2484040400 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f1482ffd640 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb820bb40 0x55fbb821d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.511+0000 7f14827fc640 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb821d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f14827fc640 1 -- 172.21.15.12:0/2484040400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 msgr2=0x55fbb821d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f14827fc640 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb821d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f14827fc640 1 -- 172.21.15.12:0/2484040400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb820bb40 msgr2=0x55fbb821d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f14827fc640 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb820bb40 0x55fbb821d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f14827fc640 1 -- 172.21.15.12:0/2484040400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbb820eba0 con 0x55fbb8215370 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f14827fc640 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb8215370 0x55fbb820e660 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f14841048c0 tx=0x7f14740186c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63edfd06ab472620 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f1466ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f1466ff5640 1 -- 172.21.15.12:0/2484040400 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1478004020 con 0x55fbb8215370 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f1466ff5640 1 -- 172.21.15.12:0/2484040400 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f14780041c0 con 0x55fbb8215370 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f148bb0b740 1 -- 172.21.15.12:0/2484040400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14740043c0 con 0x55fbb8215370 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.512+0000 7f1466ff5640 1 -- 172.21.15.12:0/2484040400 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f14780043c0 con 0x55fbb8215370 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.513+0000 7f148bb0b740 10 client.17724 fetch_fsmap learned FSMap version 42 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.513+0000 7f148bb0b740 1 -- 172.21.15.12:0/2484040400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fbb8298020 con 0x55fbb8215370 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.513+0000 7f1466ff5640 1 -- 172.21.15.12:0/2484040400 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14740043c0 con 0x55fbb8215370 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.513+0000 7f1466ff5640 1 -- 172.21.15.12:0/2484040400 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 42) ==== 8370+0+0 (secure 0 0 0) 0x7f14780038c0 con 0x55fbb8215370 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.513+0000 7f148bb0b740 10 client.17724 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.513+0000 7f148bb0b740 10 client.17724 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.513+0000 7f148bb0b740 20 client.17724 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:21.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.513+0000 7f148bb0b740 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55fbb8298750 0x55fbb829ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.513+0000 7f148bb0b740 4 client.17724 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.513+0000 7f148bb0b740 1 -- 172.21.15.12:0/2484040400 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fbb8177d70 con 0x55fbb8298750 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.514+0000 7f1482ffd640 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55fbb8298750 0x55fbb829ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.514+0000 7f1466ff5640 10 client.17724 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.514+0000 7f1482ffd640 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55fbb8298750 0x55fbb829ab70 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aea3ef795ef125f3 server_cookie=d28b7ab63c2044b6 in_seq=0 out_seq=0 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.514+0000 7f1466ff5640 1 -- 172.21.15.12:0/2484040400 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fbb8177d70 con 0x55fbb8298750 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.514+0000 7f1466ff5640 10 client.17724 handle_command_reply: tid=0 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.514+0000 7f148bb0b740 1 client.17724 shutdown 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.514+0000 7f148bb0b740 1 -- 172.21.15.12:0/2484040400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb8215370 msgr2=0x55fbb820e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.514+0000 7f148bb0b740 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb8215370 0x55fbb820e660 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f14841048c0 tx=0x7f14740186c0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.515+0000 7f148bb0b740 1 -- 172.21.15.12:0/2484040400 shutdown_connections 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.515+0000 7f148bb0b740 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55fbb8298750 0x55fbb829ab70 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.515+0000 7f148bb0b740 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbb8215370 0x55fbb820e660 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.515+0000 7f148bb0b740 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fbb820bb40 0x55fbb821d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.515+0000 7f148bb0b740 1 --2- 172.21.15.12:0/2484040400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fbb820a5d0 0x55fbb821d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.515+0000 7f148bb0b740 1 -- 172.21.15.12:0/2484040400 >> 172.21.15.12:0/2484040400 conn(0x55fbb81d3310 msgr2=0x55fbb8211120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:21.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.515+0000 7f1466ff5640 0 client.17724 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:48:21.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.515+0000 7f148bb0b740 1 -- 172.21.15.12:0/2484040400 shutdown_connections 2024-09-19T06:48:21.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.515+0000 7f148bb0b740 1 -- 172.21.15.12:0/2484040400 wait complete. 2024-09-19T06:48:21.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.515+0000 7f148bb0b740 20 client.17724 trim_cache size 0 max 16384 2024-09-19T06:48:21.522 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:48:21.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 -- 172.21.15.12:0/2916796571 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f146c0a3430 msgr2=0x7f146c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:21.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f146c0a3430 0x7f146c0a58f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f147c031fd0 tx=0x7f147c0095c0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 -- 172.21.15.12:0/2916796571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1484105560 msgr2=0x7f148419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:21.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1484105560 0x7f148419cca0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f147c030fd0 tx=0x7f147c031000 comp rx=0 tx=0).stop 2024-09-19T06:48:21.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 -- 172.21.15.12:0/2916796571 shutdown_connections 2024-09-19T06:48:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1484105560 0x7f148419cca0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1484100de0 0x7f1484198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f146c0a3430 0x7f146c0a58f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 --2- 172.21.15.12:0/2916796571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1484100430 0x7f14841983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 -- 172.21.15.12:0/2916796571 >> 172.21.15.12:0/2916796571 conn(0x7f1484077230 msgr2=0x7f1484103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 -- 172.21.15.12:0/2916796571 shutdown_connections 2024-09-19T06:48:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:21.516+0000 7f1489732640 1 -- 172.21.15.12:0/2916796571 wait complete. 2024-09-19T06:48:22.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:21 smithi173 ceph-mon[35349]: pgmap v253: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:48:22.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:21 smithi012 ceph-mon[30937]: pgmap v253: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:48:22.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:48:22.197 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:21 smithi016 ceph-mon[34911]: pgmap v253: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:48:22.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.662+0000 7f3be4ec6640 1 -- 172.21.15.12:0/292191222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be0101de0 msgr2=0x7f3be01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:22.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.662+0000 7f3be4ec6640 1 --2- 172.21.15.12:0/292191222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be0101de0 0x7f3be01021c0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009900 tx=0x7f3bd002a410 comp rx=0 tx=0).stop 2024-09-19T06:48:22.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.662+0000 7f3be4ec6640 1 -- 172.21.15.12:0/292191222 shutdown_connections 2024-09-19T06:48:22.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.662+0000 7f3be4ec6640 1 --2- 172.21.15.12:0/292191222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3be0106f10 0x7f3be010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.662+0000 7f3be4ec6640 1 --2- 172.21.15.12:0/292191222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3be0102790 0x7f3be01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.662+0000 7f3be4ec6640 1 --2- 172.21.15.12:0/292191222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be0101de0 0x7f3be01021c0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.662+0000 7f3be4ec6640 1 -- 172.21.15.12:0/292191222 >> 172.21.15.12:0/292191222 conn(0x7f3be00fd880 msgr2=0x7f3be00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:22.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.662+0000 7f3be4ec6640 1 -- 172.21.15.12:0/292191222 shutdown_connections 2024-09-19T06:48:22.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.662+0000 7f3be4ec6640 1 -- 172.21.15.12:0/292191222 wait complete. 2024-09-19T06:48:22.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.663+0000 7f3be4ec6640 1 Processor -- start 2024-09-19T06:48:22.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.663+0000 7f3be4ec6640 1 -- start start 2024-09-19T06:48:22.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3be4ec6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be0101de0 0x7f3be0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3be4ec6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3be0102790 0x7f3be0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3be4ec6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3be0106f10 0x7f3be019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3be4ec6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3be0111f80 con 0x7f3be0101de0 2024-09-19T06:48:22.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3be4ec6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3be0111e00 con 0x7f3be0102790 2024-09-19T06:48:22.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3be4ec6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3be0112100 con 0x7f3be0106f10 2024-09-19T06:48:22.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3bde59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be0101de0 0x7f3be0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3bde59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be0101de0 0x7f3be0198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36094/0 (socket says 172.21.15.12:36094) 2024-09-19T06:48:22.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3bde59c640 1 -- 172.21.15.12:0/1329295155 learned_addr learned my addr 172.21.15.12:0/1329295155 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3bddd9b640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3be0102790 0x7f3be0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.664+0000 7f3bded9d640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3be0106f10 0x7f3be019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.665+0000 7f3bde59c640 1 -- 172.21.15.12:0/1329295155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3be0106f10 msgr2=0x7f3be019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.665+0000 7f3bde59c640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3be0106f10 0x7f3be019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.665+0000 7f3bde59c640 1 -- 172.21.15.12:0/1329295155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3be0102790 msgr2=0x7f3be0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.665+0000 7f3bde59c640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3be0102790 0x7f3be0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.665+0000 7f3bde59c640 1 -- 172.21.15.12:0/1329295155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be019d3f0 con 0x7f3be0101de0 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.665+0000 7f3bddd9b640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3be0102790 0x7f3be0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.665+0000 7f3bde59c640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be0101de0 0x7f3be0198440 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0004770 tx=0x7f3bd0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.665+0000 7f3bcf7fe640 1 -- 172.21.15.12:0/1329295155 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd003f070 con 0x7f3be0101de0 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.665+0000 7f3bcf7fe640 1 -- 172.21.15.12:0/1329295155 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bd0031ca0 con 0x7f3be0101de0 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.665+0000 7f3bcf7fe640 1 -- 172.21.15.12:0/1329295155 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0035030 con 0x7f3be0101de0 2024-09-19T06:48:22.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.666+0000 7f3be4ec6640 1 -- 172.21.15.12:0/1329295155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be019d680 con 0x7f3be0101de0 2024-09-19T06:48:22.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.666+0000 7f3be4ec6640 1 -- 172.21.15.12:0/1329295155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be019db10 con 0x7f3be0101de0 2024-09-19T06:48:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.669+0000 7f3bcf7fe640 1 -- 172.21.15.12:0/1329295155 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3bd0042070 con 0x7f3be0101de0 2024-09-19T06:48:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3be729f740 1 Processor -- start 2024-09-19T06:48:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3be729f740 1 -- start start 2024-09-19T06:48:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3be729f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519060 0x558998519440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3be729f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519980 0x558998523d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3be729f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998526630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3be729f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55899847e620 con 0x558998519060 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3be729f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558998425e50 con 0x558998524240 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3be729f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55899847a5e0 con 0x558998519980 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3bde59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519980 0x558998523d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3bddd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998526630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3bded9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519060 0x558998519440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3bded9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519060 0x558998519440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36096/0 (socket says 172.21.15.12:36096) 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3bde59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519980 0x558998523d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48912/0 (socket says 172.21.15.12:48912) 2024-09-19T06:48:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.670+0000 7f3bded9d640 1 -- 172.21.15.12:0/2347317137 learned_addr learned my addr 172.21.15.12:0/2347317137 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bded9d640 1 -- 172.21.15.12:0/2347317137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519980 msgr2=0x558998523d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bded9d640 1 --2- 172.21.15.12:0/2347317137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519980 0x558998523d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bded9d640 1 -- 172.21.15.12:0/2347317137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 msgr2=0x558998526630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bded9d640 1 --2- 172.21.15.12:0/2347317137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998526630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bded9d640 1 -- 172.21.15.12:0/2347317137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558998416d40 con 0x558998519060 2024-09-19T06:48:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bcf7fe640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3bc80a3430 0x7f3bc80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bded9d640 1 --2- 172.21.15.12:0/2347317137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519060 0x558998519440 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009f70 tx=0x7f3bd8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10c35146cb49ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bde59c640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3bc80a3430 0x7f3bc80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bcf7fe640 1 -- 172.21.15.12:0/1329295155 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f3bd00f0480 con 0x7f3be0101de0 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bccff9640 1 -- 172.21.15.12:0/2347317137 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8016070 con 0x558998519060 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bccff9640 1 -- 172.21.15.12:0/2347317137 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bd8004d20 con 0x558998519060 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.671+0000 7f3bccff9640 1 -- 172.21.15.12:0/2347317137 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8012910 con 0x558998519060 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.672+0000 7f3be729f740 1 -- 172.21.15.12:0/2347317137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519060 msgr2=0x558998519440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.672+0000 7f3be729f740 1 --2- 172.21.15.12:0/2347317137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519060 0x558998519440 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009f70 tx=0x7f3bd8010800 comp rx=0 tx=0).stop 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.672+0000 7f3bde59c640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3bc80a3430 0x7f3bc80a58f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00edbe0 tx=0x7f3bd00f6060 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.672+0000 7f3be729f740 1 -- 172.21.15.12:0/2347317137 shutdown_connections 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.672+0000 7f3be729f740 1 --2- 172.21.15.12:0/2347317137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998526630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.672+0000 7f3be729f740 1 --2- 172.21.15.12:0/2347317137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519980 0x558998523d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.672+0000 7f3be729f740 1 --2- 172.21.15.12:0/2347317137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519060 0x558998519440 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.672+0000 7f3be729f740 1 -- 172.21.15.12:0/2347317137 >> 172.21.15.12:0/2347317137 conn(0x5589985155f0 msgr2=0x5589985159d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:22.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.673+0000 7f3be729f740 1 -- 172.21.15.12:0/2347317137 shutdown_connections 2024-09-19T06:48:22.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.673+0000 7f3be729f740 1 -- 172.21.15.12:0/2347317137 wait complete. 2024-09-19T06:48:22.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.673+0000 7f3be729f740 1 -- start start 2024-09-19T06:48:22.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.673+0000 7f3be729f740 1 Processor -- start 2024-09-19T06:48:22.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3be729f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998521210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3be729f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998521750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3be729f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998521c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3be729f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55899852b130 con 0x558998519980 2024-09-19T06:48:22.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3be729f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558998406f10 con 0x558998524240 2024-09-19T06:48:22.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3be729f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55899852b2b0 con 0x558998519060 2024-09-19T06:48:22.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3be729f740 10 client.0 _ll_register_callbacks cb 0x55899842adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:22.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bded9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998521210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bded9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998521210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48916/0 (socket says 172.21.15.12:48916) 2024-09-19T06:48:22.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bded9d640 1 -- 172.21.15.12:0/87520119 learned_addr learned my addr 172.21.15.12:0/87520119 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:22.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bded9d640 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998521c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bded9d640 1 -- 172.21.15.12:0/87520119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 msgr2=0x558998521c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:22.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bded9d640 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998521c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bded9d640 1 -- 172.21.15.12:0/87520119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 msgr2=0x558998521750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:22.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bddd9b640 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998521750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bded9d640 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998521750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bded9d640 1 -- 172.21.15.12:0/87520119 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55899818d580 con 0x558998519060 2024-09-19T06:48:22.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.674+0000 7f3bddd9b640 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998521750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:22.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.675+0000 7f3bded9d640 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998521210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8005f40 tx=0x7f3bd8012620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77e0201f573b2ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:22.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.675+0000 7f3bc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:48:22.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.675+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/87520119 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8016070 con 0x558998519060 2024-09-19T06:48:22.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.675+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/87520119 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f3bd8012a40 con 0x558998519060 2024-09-19T06:48:22.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.675+0000 7f3be729f740 1 -- 172.21.15.12:0/87520119 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bd8004d20 con 0x558998519060 2024-09-19T06:48:22.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.675+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/87520119 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3bd8003970 con 0x558998519060 2024-09-19T06:48:22.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.675+0000 7f3be729f740 10 client.27118 fetch_fsmap learned FSMap version 42 2024-09-19T06:48:22.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.675+0000 7f3be729f740 1 -- 172.21.15.12:0/87520119 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558998257960 con 0x558998519060 2024-09-19T06:48:22.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.675+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/87520119 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bd8004d20 con 0x558998519060 2024-09-19T06:48:22.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.676+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/87520119 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 42) ==== 8370+0+0 (secure 0 0 0) 0x7f3bd800f040 con 0x558998519060 2024-09-19T06:48:22.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.676+0000 7f3be729f740 10 client.27118 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T06:48:22.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.676+0000 7f3be729f740 10 client.27118 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:48:22.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.676+0000 7f3be729f740 20 client.27118 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:22.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.676+0000 7f3be729f740 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5589985381a0 0x55899853a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.676+0000 7f3be729f740 4 client.27118 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:22.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.676+0000 7f3be729f740 1 -- 172.21.15.12:0/87520119 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55899848bb90 con 0x5589985381a0 2024-09-19T06:48:22.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.676+0000 7f3bddd9b640 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5589985381a0 0x55899853a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.677+0000 7f3bc5ffb640 10 client.27118 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:22.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.677+0000 7f3bddd9b640 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5589985381a0 0x55899853a590 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd9af4a9da012af1 server_cookie=e26025f0a339ca0 in_seq=0 out_seq=0 2024-09-19T06:48:22.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.677+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/87520119 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55899848bb90 con 0x5589985381a0 2024-09-19T06:48:22.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.677+0000 7f3bc5ffb640 10 client.27118 handle_command_reply: tid=0 2024-09-19T06:48:22.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3be729f740 1 client.27118 shutdown 2024-09-19T06:48:22.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3be729f740 1 -- 172.21.15.12:0/87520119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 msgr2=0x558998521210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:22.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3be729f740 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998521210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8005f40 tx=0x7f3bd8012620 comp rx=0 tx=0).stop 2024-09-19T06:48:22.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3be729f740 1 -- 172.21.15.12:0/87520119 shutdown_connections 2024-09-19T06:48:22.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3be729f740 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5589985381a0 0x55899853a590 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3be729f740 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998521c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3be729f740 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998521750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3be729f740 1 --2- 172.21.15.12:0/87520119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998521210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3bc5ffb640 0 client.27118 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:22.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3be729f740 1 -- 172.21.15.12:0/87520119 >> 172.21.15.12:0/87520119 conn(0x5589985155f0 msgr2=0x55899851b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:22.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.678+0000 7f3be729f740 1 -- 172.21.15.12:0/87520119 shutdown_connections 2024-09-19T06:48:22.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.679+0000 7f3be729f740 1 -- 172.21.15.12:0/87520119 wait complete. 2024-09-19T06:48:22.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.679+0000 7f3be729f740 20 client.27118 trim_cache size 0 max 16384 2024-09-19T06:48:22.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.698+0000 7f3be729f740 1 Processor -- start 2024-09-19T06:48:22.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.698+0000 7f3be729f740 1 -- start start 2024-09-19T06:48:22.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.698+0000 7f3be729f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998520170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.698+0000 7f3be729f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x55899853fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.698+0000 7f3be729f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x5589985402e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.698+0000 7f3be729f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3be01aba40 con 0x558998519980 2024-09-19T06:48:22.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.698+0000 7f3be729f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3be01ad5e0 con 0x558998524240 2024-09-19T06:48:22.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.698+0000 7f3be729f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3be01ac110 con 0x558998519060 2024-09-19T06:48:22.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bded9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998520170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bded9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998520170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48924/0 (socket says 172.21.15.12:48924) 2024-09-19T06:48:22.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bded9d640 1 -- 172.21.15.12:0/2538133942 learned_addr learned my addr 172.21.15.12:0/2538133942 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:22.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bded9d640 1 --2- 172.21.15.12:0/2538133942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x5589985402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bddd9b640 1 --2- 172.21.15.12:0/2538133942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x55899853fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bded9d640 1 -- 172.21.15.12:0/2538133942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 msgr2=0x5589985402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:22.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bded9d640 1 --2- 172.21.15.12:0/2538133942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x5589985402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bded9d640 1 -- 172.21.15.12:0/2538133942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 msgr2=0x55899853fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:22.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bded9d640 1 --2- 172.21.15.12:0/2538133942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x55899853fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bded9d640 1 -- 172.21.15.12:0/2538133942 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55899851f780 con 0x558998519060 2024-09-19T06:48:22.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.699+0000 7f3bded9d640 1 --2- 172.21.15.12:0/2538133942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998520170 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009a80 tx=0x7f3bd80096f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4342fc3b387065a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:22.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.700+0000 7f3bc7fff640 1 -- 172.21.15.12:0/2538133942 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8016070 con 0x558998519060 2024-09-19T06:48:22.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.700+0000 7f3bc7fff640 1 -- 172.21.15.12:0/2538133942 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bd801f070 con 0x558998519060 2024-09-19T06:48:22.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.700+0000 7f3bc7fff640 1 -- 172.21.15.12:0/2538133942 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8004c70 con 0x558998519060 2024-09-19T06:48:22.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.701+0000 7f3be729f740 1 -- 172.21.15.12:0/2538133942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 msgr2=0x558998520170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:22.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.701+0000 7f3be729f740 1 --2- 172.21.15.12:0/2538133942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998520170 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009a80 tx=0x7f3bd80096f0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.701+0000 7f3be729f740 1 -- 172.21.15.12:0/2538133942 shutdown_connections 2024-09-19T06:48:22.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.701+0000 7f3be729f740 1 --2- 172.21.15.12:0/2538133942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x5589985402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.701+0000 7f3be729f740 1 --2- 172.21.15.12:0/2538133942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x55899853fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.701+0000 7f3be729f740 1 --2- 172.21.15.12:0/2538133942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998520170 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.701+0000 7f3be729f740 1 -- 172.21.15.12:0/2538133942 >> 172.21.15.12:0/2538133942 conn(0x5589985155f0 msgr2=0x5589985219f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:22.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.702+0000 7f3be729f740 1 -- 172.21.15.12:0/2538133942 shutdown_connections 2024-09-19T06:48:22.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.702+0000 7f3be729f740 1 -- 172.21.15.12:0/2538133942 wait complete. 2024-09-19T06:48:22.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.702+0000 7f3be729f740 1 -- start start 2024-09-19T06:48:22.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.702+0000 7f3be729f740 1 Processor -- start 2024-09-19T06:48:22.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.702+0000 7f3be729f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998530500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3be729f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998530a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3bddd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998530a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3be729f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998528be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3be729f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3be01acee0 con 0x558998519980 2024-09-19T06:48:22.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3be729f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3be01ac810 con 0x558998524240 2024-09-19T06:48:22.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3be729f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3be01a9a40 con 0x558998519060 2024-09-19T06:48:22.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3bddd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998530a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36124/0 (socket says 172.21.15.12:36124) 2024-09-19T06:48:22.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3bddd9b640 1 -- 172.21.15.12:0/1567281943 learned_addr learned my addr 172.21.15.12:0/1567281943 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:22.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3be729f740 10 client.0 _ll_register_callbacks cb 0x7f3bd8009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:22.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3bded9d640 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998530500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3bddd9b640 1 -- 172.21.15.12:0/1567281943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 msgr2=0x558998530500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:22.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3bddd9b640 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998530500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3bddd9b640 1 -- 172.21.15.12:0/1567281943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 msgr2=0x558998528be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:22.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3bddd9b640 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998528be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.703+0000 7f3bddd9b640 1 -- 172.21.15.12:0/1567281943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55899851f000 con 0x558998519980 2024-09-19T06:48:22.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.704+0000 7f3bddd9b640 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998530a40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400baf0 tx=0x7f3bd40129c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55204d30a2d77f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:22.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.704+0000 7f3bc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:22.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.704+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/1567281943 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd402d070 con 0x558998519980 2024-09-19T06:48:22.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.704+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/1567281943 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f3bd4029cf0 con 0x558998519980 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.704+0000 7f3be729f740 1 -- 172.21.15.12:0/1567281943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bd801f070 con 0x558998519980 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.704+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/1567281943 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3bd4037050 con 0x558998519980 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.704+0000 7f3be729f740 10 client.17739 fetch_fsmap learned FSMap version 42 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.704+0000 7f3be729f740 1 -- 172.21.15.12:0/1567281943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55899859f130 con 0x558998519980 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.705+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/1567281943 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bd801f070 con 0x558998519980 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.705+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/1567281943 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 42) ==== 8370+0+0 (secure 0 0 0) 0x7f3bd4003c30 con 0x558998519980 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.705+0000 7f3be729f740 10 client.17739 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.705+0000 7f3be729f740 10 client.17739 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.705+0000 7f3be729f740 20 client.17739 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.705+0000 7f3be729f740 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55899859f960 0x5589985a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.705+0000 7f3be729f740 4 client.17739 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e0b77255", "release": true, "await": true}] 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.705+0000 7f3be729f740 1 -- 172.21.15.12:0/1567281943 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e0b77255", "release": true, "await": true}) -- 0x5589984860a0 con 0x55899859f960 2024-09-19T06:48:22.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.705+0000 7f3bded9d640 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55899859f960 0x5589985a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:22.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.706+0000 7f3bded9d640 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55899859f960 0x5589985a1d80 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7ae8d74cadb40f5 server_cookie=94c57c290fa142ff in_seq=0 out_seq=0 2024-09-19T06:48:22.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.706+0000 7f3bc5ffb640 10 client.17739 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:22.712 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:22.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.743+0000 7f3bc5ffb640 1 -- 172.21.15.12:0/1567281943 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5589984860a0 con 0x55899859f960 2024-09-19T06:48:22.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.743+0000 7f3bc5ffb640 10 client.17739 handle_command_reply: tid=0 2024-09-19T06:48:22.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.743+0000 7f3be729f740 1 client.17739 shutdown 2024-09-19T06:48:22.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.747+0000 7f3be729f740 1 -- 172.21.15.12:0/1567281943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 msgr2=0x558998530a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:22.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.747+0000 7f3be729f740 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998530a40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400baf0 tx=0x7f3bd40129c0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.747+0000 7f3be729f740 1 -- 172.21.15.12:0/1567281943 shutdown_connections 2024-09-19T06:48:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.747+0000 7f3be729f740 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55899859f960 0x5589985a1d80 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.747+0000 7f3be729f740 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558998524240 0x558998528be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.747+0000 7f3be729f740 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558998519980 0x558998530a40 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.747+0000 7f3bc5ffb640 0 client.17739 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.748+0000 7f3be729f740 1 --2- 172.21.15.12:0/1567281943 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558998519060 0x558998530500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.748+0000 7f3be729f740 1 -- 172.21.15.12:0/1567281943 >> 172.21.15.12:0/1567281943 conn(0x5589985155f0 msgr2=0x558998513f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:22.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.748+0000 7f3be729f740 1 -- 172.21.15.12:0/1567281943 shutdown_connections 2024-09-19T06:48:22.754 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:48:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 42, 2024-09-19T06:48:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:48:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 32, 2024-09-19T06:48:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:48:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "e0b77255": { 2024-09-19T06:48:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 32, 2024-09-19T06:48:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:48:22.754 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 145.8, 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:48:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:48:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:48:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:48:22.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:48:22.756 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:48:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.749+0000 7f3be729f740 1 -- 172.21.15.12:0/1567281943 wait complete. 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.749+0000 7f3be729f740 20 client.17739 trim_cache size 0 max 16384 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.752+0000 7f3be4ec6640 1 -- 172.21.15.12:0/1329295155 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3bc80a3430 msgr2=0x7f3bc80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.752+0000 7f3be4ec6640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3bc80a3430 0x7f3bc80a58f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00edbe0 tx=0x7f3bd00f6060 comp rx=0 tx=0).stop 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.752+0000 7f3be4ec6640 1 -- 172.21.15.12:0/1329295155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be0101de0 msgr2=0x7f3be0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.752+0000 7f3be4ec6640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be0101de0 0x7f3be0198440 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0004770 tx=0x7f3bd0003c10 comp rx=0 tx=0).stop 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.753+0000 7f3be4ec6640 1 -- 172.21.15.12:0/1329295155 shutdown_connections 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.753+0000 7f3be4ec6640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3bc80a3430 0x7f3bc80a58f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.753+0000 7f3be4ec6640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3be0106f10 0x7f3be019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.753+0000 7f3be4ec6640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3be0102790 0x7f3be0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.753+0000 7f3be4ec6640 1 --2- 172.21.15.12:0/1329295155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be0101de0 0x7f3be0198440 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.753+0000 7f3be4ec6640 1 -- 172.21.15.12:0/1329295155 >> 172.21.15.12:0/1329295155 conn(0x7f3be00fd880 msgr2=0x7f3be00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.754+0000 7f3be4ec6640 1 -- 172.21.15.12:0/1329295155 shutdown_connections 2024-09-19T06:48:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:22.754+0000 7f3be4ec6640 1 -- 172.21.15.12:0/1329295155 wait complete. 2024-09-19T06:48:23.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:22 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:23.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:22 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:23.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:22 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:23.650 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e0b77255', total seconds elapsed: 30.9 2024-09-19T06:48:24.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:23 smithi012 ceph-mon[30937]: pgmap v254: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:48:24.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:23 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:24.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:23 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:24.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:23 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:48:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:23 smithi016 ceph-mon[34911]: pgmap v254: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:48:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:23 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:23 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:23 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:48:24.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.300+0000 7f25e4da6640 1 -- 172.21.15.12:0/3577289797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0106b80 msgr2=0x7f25e0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:24.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.300+0000 7f25e4da6640 1 --2- 172.21.15.12:0/3577289797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0106b80 0x7f25e0106f60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009930 tx=0x7f25d002a420 comp rx=0 tx=0).stop 2024-09-19T06:48:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.300+0000 7f25e4da6640 1 -- 172.21.15.12:0/3577289797 shutdown_connections 2024-09-19T06:48:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.300+0000 7f25e4da6640 1 --2- 172.21.15.12:0/3577289797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25e0100500 0x7f25e010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.300+0000 7f25e4da6640 1 --2- 172.21.15.12:0/3577289797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e00ffb60 0x7f25e00fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.300+0000 7f25e4da6640 1 --2- 172.21.15.12:0/3577289797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0106b80 0x7f25e0106f60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.300+0000 7f25e4da6640 1 -- 172.21.15.12:0/3577289797 >> 172.21.15.12:0/3577289797 conn(0x7f25e00fba90 msgr2=0x7f25e00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.302+0000 7f25e4da6640 1 -- 172.21.15.12:0/3577289797 shutdown_connections 2024-09-19T06:48:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.302+0000 7f25e4da6640 1 -- 172.21.15.12:0/3577289797 wait complete. 2024-09-19T06:48:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.303+0000 7f25e4da6640 1 Processor -- start 2024-09-19T06:48:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.303+0000 7f25e4da6640 1 -- start start 2024-09-19T06:48:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.304+0000 7f25e4da6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e00ffb60 0x7f25e019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.304+0000 7f25e4da6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0100500 0x7f25e019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.304+0000 7f25e4da6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25e0106b80 0x7f25e019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.304+0000 7f25e4da6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0111ff0 con 0x7f25e0106b80 2024-09-19T06:48:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.304+0000 7f25e4da6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0111e70 con 0x7f25e0100500 2024-09-19T06:48:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.304+0000 7f25de59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e00ffb60 0x7f25e019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.304+0000 7f25de59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e00ffb60 0x7f25e019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48948/0 (socket says 172.21.15.12:48948) 2024-09-19T06:48:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.304+0000 7f25de59c640 1 -- 172.21.15.12:0/2916181340 learned_addr learned my addr 172.21.15.12:0/2916181340 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.304+0000 7f25e4da6640 1 -- 172.21.15.12:0/2916181340 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0112170 con 0x7f25e00ffb60 2024-09-19T06:48:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.305+0000 7f25ded9d640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25e0106b80 0x7f25e019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.305+0000 7f25ddd9b640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0100500 0x7f25e019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.305+0000 7f25de59c640 1 -- 172.21.15.12:0/2916181340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0100500 msgr2=0x7f25e019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.305+0000 7f25de59c640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0100500 0x7f25e019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.305+0000 7f25de59c640 1 -- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25e0106b80 msgr2=0x7f25e019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.305+0000 7f25de59c640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25e0106b80 0x7f25e019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.305+0000 7f25de59c640 1 -- 172.21.15.12:0/2916181340 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e019f5a0 con 0x7f25e00ffb60 2024-09-19T06:48:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.305+0000 7f25ddd9b640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0100500 0x7f25e019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.305+0000 7f25ded9d640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25e0106b80 0x7f25e019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:24.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.306+0000 7f25de59c640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e00ffb60 0x7f25e019a5f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f25d002a940 tx=0x7f25d0003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:24.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.306+0000 7f25cf7fe640 1 -- 172.21.15.12:0/2916181340 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d003f070 con 0x7f25e00ffb60 2024-09-19T06:48:24.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.306+0000 7f25e4da6640 1 -- 172.21.15.12:0/2916181340 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e019f830 con 0x7f25e00ffb60 2024-09-19T06:48:24.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.306+0000 7f25cf7fe640 1 -- 172.21.15.12:0/2916181340 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25d0031c90 con 0x7f25e00ffb60 2024-09-19T06:48:24.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.306+0000 7f25cf7fe640 1 -- 172.21.15.12:0/2916181340 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0035030 con 0x7f25e00ffb60 2024-09-19T06:48:24.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.306+0000 7f25e4da6640 1 -- 172.21.15.12:0/2916181340 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01a7170 con 0x7f25e00ffb60 2024-09-19T06:48:24.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.310+0000 7f25cf7fe640 1 -- 172.21.15.12:0/2916181340 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f25d0042070 con 0x7f25e00ffb60 2024-09-19T06:48:24.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.311+0000 7f25e717f740 1 Processor -- start 2024-09-19T06:48:24.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.311+0000 7f25e717f740 1 -- start start 2024-09-19T06:48:24.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.312+0000 7f25e717f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.312+0000 7f25e717f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.312+0000 7f25e717f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a3ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.312+0000 7f25e717f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5645069902f0 con 0x564506a3db80 2024-09-19T06:48:24.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.312+0000 7f25e717f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564506937cf0 con 0x564506a2a5d0 2024-09-19T06:48:24.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.312+0000 7f25e717f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56450698c2b0 con 0x564506a2bb40 2024-09-19T06:48:24.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.312+0000 7f25de59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.312+0000 7f25de59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:36238/0 (socket says 172.21.15.12:36238) 2024-09-19T06:48:24.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.312+0000 7f25de59c640 1 -- 172.21.15.12:0/1814648580 learned_addr learned my addr 172.21.15.12:0/1814648580 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:24.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25ded9d640 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25ddd9b640 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a3ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25de59c640 1 -- 172.21.15.12:0/1814648580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 msgr2=0x564506a2a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25de59c640 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a2a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25de59c640 1 -- 172.21.15.12:0/1814648580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 msgr2=0x564506a3ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25de59c640 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a3ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25de59c640 1 -- 172.21.15.12:0/1814648580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56450691c3a0 con 0x564506a2a5d0 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25ded9d640 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a2a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25ddd9b640 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a3ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25cf7fe640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f25c80a34b0 0x7f25c80a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25de59c640 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2aa10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f25d00edb60 tx=0x7f25d00f6750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b88f4902ac1f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25ded9d640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f25c80a34b0 0x7f25c80a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.313+0000 7f25ccff9640 1 -- 172.21.15.12:0/1814648580 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d00b8a50 con 0x564506a2a5d0 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.314+0000 7f25ccff9640 1 -- 172.21.15.12:0/1814648580 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25d00fd030 con 0x564506a2a5d0 2024-09-19T06:48:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.314+0000 7f25ccff9640 1 -- 172.21.15.12:0/1814648580 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d00bbf30 con 0x564506a2a5d0 2024-09-19T06:48:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.314+0000 7f25cf7fe640 1 -- 172.21.15.12:0/2916181340 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f25d00f05d0 con 0x7f25e00ffb60 2024-09-19T06:48:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.315+0000 7f25e717f740 1 -- 172.21.15.12:0/1814648580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 msgr2=0x564506a2aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.315+0000 7f25e717f740 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2aa10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f25d00edb60 tx=0x7f25d00f6750 comp rx=0 tx=0).stop 2024-09-19T06:48:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.315+0000 7f25ded9d640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f25c80a34b0 0x7f25c80a5970 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f25d80099a0 tx=0x7f25d8009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.316+0000 7f25e717f740 1 -- 172.21.15.12:0/1814648580 shutdown_connections 2024-09-19T06:48:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.316+0000 7f25e717f740 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a3ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.316+0000 7f25e717f740 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2aa10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.316+0000 7f25e717f740 1 --2- 172.21.15.12:0/1814648580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a2a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.316+0000 7f25e717f740 1 -- 172.21.15.12:0/1814648580 >> 172.21.15.12:0/1814648580 conn(0x5645069f3310 msgr2=0x564506a26c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.316+0000 7f25e717f740 1 -- 172.21.15.12:0/1814648580 shutdown_connections 2024-09-19T06:48:24.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.316+0000 7f25e717f740 1 -- 172.21.15.12:0/1814648580 wait complete. 2024-09-19T06:48:24.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.317+0000 7f25e717f740 1 -- start start 2024-09-19T06:48:24.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.317+0000 7f25e717f740 1 Processor -- start 2024-09-19T06:48:24.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.317+0000 7f25e717f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a2a5d0 0x564506a3d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.317+0000 7f25e717f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a3a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.317+0000 7f25e717f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a3db80 0x564506a3acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.317+0000 7f25e717f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564506a40640 con 0x564506a2a5d0 2024-09-19T06:48:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.317+0000 7f25e717f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56450694b060 con 0x564506a3db80 2024-09-19T06:48:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.317+0000 7f25e717f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564506a407c0 con 0x564506a2bb40 2024-09-19T06:48:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.317+0000 7f25e717f740 10 client.0 _ll_register_callbacks cb 0x56450669e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.318+0000 7f25ddd9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a3a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.318+0000 7f25de59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a2a5d0 0x564506a3d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.318+0000 7f25de59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a2a5d0 0x564506a3d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36140/0 (socket says 172.21.15.12:36140) 2024-09-19T06:48:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.318+0000 7f25de59c640 1 -- 172.21.15.12:0/2541832339 learned_addr learned my addr 172.21.15.12:0/2541832339 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25ddd9b640 1 -- 172.21.15.12:0/2541832339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a3db80 msgr2=0x564506a3acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25ddd9b640 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a3db80 0x564506a3acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25ddd9b640 1 -- 172.21.15.12:0/2541832339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a2a5d0 msgr2=0x564506a3d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25ddd9b640 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a2a5d0 0x564506a3d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25ddd9b640 1 -- 172.21.15.12:0/2541832339 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645067013c0 con 0x564506a2bb40 2024-09-19T06:48:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25de59c640 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a2a5d0 0x564506a3d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25ddd9b640 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a3a780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f25e00fe570 tx=0x7f25d400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7edb668ef1214a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:48:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25c5ffb640 1 -- 172.21.15.12:0/2541832339 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4011850 con 0x564506a2bb40 2024-09-19T06:48:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25e717f740 1 -- 172.21.15.12:0/2541832339 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25d00fd030 con 0x564506a2bb40 2024-09-19T06:48:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.319+0000 7f25c5ffb640 1 -- 172.21.15.12:0/2541832339 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f25d40119f0 con 0x564506a2bb40 2024-09-19T06:48:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.320+0000 7f25c5ffb640 1 -- 172.21.15.12:0/2541832339 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f25d4011bf0 con 0x564506a2bb40 2024-09-19T06:48:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.320+0000 7f25e717f740 10 client.27133 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.320+0000 7f25e717f740 1 -- 172.21.15.12:0/2541832339 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x564506a2f7d0 con 0x564506a2bb40 2024-09-19T06:48:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.320+0000 7f25c5ffb640 1 -- 172.21.15.12:0/2541832339 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25d00fd030 con 0x564506a2bb40 2024-09-19T06:48:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.321+0000 7f25c5ffb640 1 -- 172.21.15.12:0/2541832339 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7f25d40183d0 con 0x564506a2bb40 2024-09-19T06:48:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.321+0000 7f25e717f740 10 client.27133 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.321+0000 7f25e717f740 10 client.27133 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:48:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.321+0000 7f25e717f740 20 client.27133 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.321+0000 7f25e717f740 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x564506a30be0 0x564506a33040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.321+0000 7f25e717f740 4 client.27133 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.321+0000 7f25e717f740 1 -- 172.21.15.12:0/2541832339 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56450699d860 con 0x564506a30be0 2024-09-19T06:48:24.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.322+0000 7f25de59c640 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x564506a30be0 0x564506a33040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.322+0000 7f25de59c640 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x564506a30be0 0x564506a33040 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7553e8a55a4fb0ef server_cookie=1ad1f8ab32f2013d in_seq=0 out_seq=0 2024-09-19T06:48:24.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.322+0000 7f25c5ffb640 10 client.27133 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:48:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25c5ffb640 1 -- 172.21.15.12:0/2541832339 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56450699d860 con 0x564506a30be0 2024-09-19T06:48:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25c5ffb640 10 client.27133 handle_command_reply: tid=0 2024-09-19T06:48:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 client.27133 shutdown 2024-09-19T06:48:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 -- 172.21.15.12:0/2541832339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 msgr2=0x564506a3a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a3a780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f25e00fe570 tx=0x7f25d400f730 comp rx=0 tx=0).stop 2024-09-19T06:48:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 -- 172.21.15.12:0/2541832339 shutdown_connections 2024-09-19T06:48:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x564506a30be0 0x564506a33040 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a3db80 0x564506a3acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a3a780 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 --2- 172.21.15.12:0/2541832339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a2a5d0 0x564506a3d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 -- 172.21.15.12:0/2541832339 >> 172.21.15.12:0/2541832339 conn(0x5645069f3310 msgr2=0x564506a2c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25c5ffb640 0 client.27133 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:48:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 -- 172.21.15.12:0/2541832339 shutdown_connections 2024-09-19T06:48:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 1 -- 172.21.15.12:0/2541832339 wait complete. 2024-09-19T06:48:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.323+0000 7f25e717f740 20 client.27133 trim_cache size 0 max 16384 2024-09-19T06:48:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:23 smithi173 ceph-mon[35349]: pgmap v254: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:48:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:23 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:23 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:23 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:48:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.344+0000 7f25e717f740 1 Processor -- start 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25e717f740 1 -- start start 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25e717f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25e717f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a36000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25e717f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a5faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25e717f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01aba10 con 0x564506a3db80 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25e717f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01ad580 con 0x564506a2a5d0 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25e717f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01ac0e0 con 0x564506a2bb40 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25ded9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a5faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25ddd9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a36000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25de59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25ddd9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a36000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48968/0 (socket says 172.21.15.12:48968) 2024-09-19T06:48:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25de59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:36262/0 (socket says 172.21.15.12:36262) 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25ded9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a5faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36144/0 (socket says 172.21.15.12:36144) 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25ddd9b640 1 -- 172.21.15.12:0/973730584 learned_addr learned my addr 172.21.15.12:0/973730584 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25de59c640 1 -- 172.21.15.12:0/973730584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 msgr2=0x564506a36000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25de59c640 1 --2- 172.21.15.12:0/973730584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a36000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25de59c640 1 -- 172.21.15.12:0/973730584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 msgr2=0x564506a5faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25de59c640 1 --2- 172.21.15.12:0/973730584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a5faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.345+0000 7f25de59c640 1 -- 172.21.15.12:0/973730584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564506a38cf0 con 0x564506a2a5d0 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.346+0000 7f25ded9d640 1 --2- 172.21.15.12:0/973730584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a5faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.346+0000 7f25de59c640 1 --2- 172.21.15.12:0/973730584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2d120 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009900 tx=0x7f25d0005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a5d1046fe3bc8b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.346+0000 7f25c7fff640 1 -- 172.21.15.12:0/973730584 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0049070 con 0x564506a2a5d0 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.346+0000 7f25c7fff640 1 -- 172.21.15.12:0/973730584 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25d00fd070 con 0x564506a2a5d0 2024-09-19T06:48:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.346+0000 7f25c7fff640 1 -- 172.21.15.12:0/973730584 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d00bc110 con 0x564506a2a5d0 2024-09-19T06:48:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.347+0000 7f25e717f740 1 -- 172.21.15.12:0/973730584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 msgr2=0x564506a2d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.347+0000 7f25e717f740 1 --2- 172.21.15.12:0/973730584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2d120 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009900 tx=0x7f25d0005dc0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.347+0000 7f25e717f740 1 -- 172.21.15.12:0/973730584 shutdown_connections 2024-09-19T06:48:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.347+0000 7f25e717f740 1 --2- 172.21.15.12:0/973730584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a5faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.347+0000 7f25e717f740 1 --2- 172.21.15.12:0/973730584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2bb40 0x564506a36000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.347+0000 7f25e717f740 1 --2- 172.21.15.12:0/973730584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2a5d0 0x564506a2d120 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.347+0000 7f25e717f740 1 -- 172.21.15.12:0/973730584 >> 172.21.15.12:0/973730584 conn(0x5645069f3310 msgr2=0x564506a358f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.348+0000 7f25e717f740 1 -- 172.21.15.12:0/973730584 shutdown_connections 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.348+0000 7f25e717f740 1 -- 172.21.15.12:0/973730584 wait complete. 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.348+0000 7f25e717f740 1 -- start start 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.348+0000 7f25e717f740 1 Processor -- start 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25e717f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2a5d0 0x564506a45dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25e717f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2bb40 0x564506a46300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25e717f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a373d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25e717f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01aceb0 con 0x564506a3db80 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25e717f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01ac7e0 con 0x564506a2bb40 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25e717f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01a9a30 con 0x564506a2a5d0 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25e717f740 10 client.0 _ll_register_callbacks cb 0x7f25d400d360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25ddd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2bb40 0x564506a46300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25ddd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2bb40 0x564506a46300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:36268/0 (socket says 172.21.15.12:36268) 2024-09-19T06:48:24.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25ddd9b640 1 -- 172.21.15.12:0/3981499037 learned_addr learned my addr 172.21.15.12:0/3981499037 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25ded9d640 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25de59c640 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2a5d0 0x564506a45dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25ddd9b640 1 -- 172.21.15.12:0/3981499037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2a5d0 msgr2=0x564506a45dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25ddd9b640 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2a5d0 0x564506a45dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25ddd9b640 1 -- 172.21.15.12:0/3981499037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 msgr2=0x564506a373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25ddd9b640 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a373d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.349+0000 7f25ddd9b640 1 -- 172.21.15.12:0/3981499037 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564506a37c00 con 0x564506a2bb40 2024-09-19T06:48:24.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.350+0000 7f25ddd9b640 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2bb40 0x564506a46300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f25d4006010 tx=0x7f25d4012fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4896815effb65384 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.350+0000 7f25c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.350+0000 7f25c5ffb640 1 -- 172.21.15.12:0/3981499037 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4018a60 con 0x564506a2bb40 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.350+0000 7f25c5ffb640 1 -- 172.21.15.12:0/3981499037 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f25d4018c00 con 0x564506a2bb40 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.351+0000 7f25e717f740 1 -- 172.21.15.12:0/3981499037 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25d00fd070 con 0x564506a2bb40 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.351+0000 7f25c5ffb640 1 -- 172.21.15.12:0/3981499037 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f25d4038050 con 0x564506a2bb40 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.351+0000 7f25e717f740 10 client.27176 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.351+0000 7f25e717f740 1 -- 172.21.15.12:0/3981499037 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x564506ac0830 con 0x564506a2bb40 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.352+0000 7f25c5ffb640 1 -- 172.21.15.12:0/3981499037 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25d4018e00 con 0x564506a2bb40 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.352+0000 7f25c5ffb640 1 -- 172.21.15.12:0/3981499037 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7f25d4004a20 con 0x564506a2bb40 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.352+0000 7f25e717f740 10 client.27176 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.352+0000 7f25e717f740 10 client.27176 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.352+0000 7f25e717f740 20 client.27176 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.352+0000 7f25e717f740 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x564506ac0fe0 0x564506ac3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:24.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.352+0000 7f25e717f740 4 client.27176 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:48:24.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.352+0000 7f25e717f740 1 -- 172.21.15.12:0/3981499037 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f25d00fd070 con 0x564506ac0fe0 2024-09-19T06:48:24.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.353+0000 7f25de59c640 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x564506ac0fe0 0x564506ac3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:24.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25de59c640 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x564506ac0fe0 0x564506ac3400 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=270983ed274314d9 server_cookie=4e9932459d036fcf in_seq=0 out_seq=0 2024-09-19T06:48:24.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25c5ffb640 10 client.27176 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:48:24.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25c5ffb640 1 -- 172.21.15.12:0/3981499037 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f25d00fd070 con 0x564506ac0fe0 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25c5ffb640 10 client.27176 handle_command_reply: tid=0 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25e717f740 1 client.27176 shutdown 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25e717f740 1 -- 172.21.15.12:0/3981499037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2bb40 msgr2=0x564506a46300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25e717f740 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2bb40 0x564506a46300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f25d4006010 tx=0x7f25d4012fd0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25e717f740 1 -- 172.21.15.12:0/3981499037 shutdown_connections 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25e717f740 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x564506ac0fe0 0x564506ac3400 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25e717f740 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564506a3db80 0x564506a373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25e717f740 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564506a2bb40 0x564506a46300 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25e717f740 1 --2- 172.21.15.12:0/3981499037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564506a2a5d0 0x564506a45dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25c5ffb640 0 client.27176 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.354+0000 7f25e717f740 1 -- 172.21.15.12:0/3981499037 >> 172.21.15.12:0/3981499037 conn(0x5645069f3310 msgr2=0x564506a254e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.355+0000 7f25e717f740 1 -- 172.21.15.12:0/3981499037 shutdown_connections 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.355+0000 7f25e717f740 1 -- 172.21.15.12:0/3981499037 wait complete. 2024-09-19T06:48:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.355+0000 7f25e717f740 20 client.27176 trim_cache size 0 max 16384 2024-09-19T06:48:24.360 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:48:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.355+0000 7f25e4da6640 1 -- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f25c80a34b0 msgr2=0x7f25c80a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.355+0000 7f25e4da6640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f25c80a34b0 0x7f25c80a5970 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f25d80099a0 tx=0x7f25d8009500 comp rx=0 tx=0).stop 2024-09-19T06:48:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.355+0000 7f25e4da6640 1 -- 172.21.15.12:0/2916181340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e00ffb60 msgr2=0x7f25e019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.356+0000 7f25e4da6640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e00ffb60 0x7f25e019a5f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f25d002a940 tx=0x7f25d0003b90 comp rx=0 tx=0).stop 2024-09-19T06:48:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.357+0000 7f25e4da6640 1 -- 172.21.15.12:0/2916181340 shutdown_connections 2024-09-19T06:48:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.357+0000 7f25e4da6640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25e0106b80 0x7f25e019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.357+0000 7f25e4da6640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25e0100500 0x7f25e019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.357+0000 7f25e4da6640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f25c80a34b0 0x7f25c80a5970 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.357+0000 7f25e4da6640 1 --2- 172.21.15.12:0/2916181340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e00ffb60 0x7f25e019a5f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.357+0000 7f25e4da6640 1 -- 172.21.15.12:0/2916181340 >> 172.21.15.12:0/2916181340 conn(0x7f25e00fba90 msgr2=0x7f25e010cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.357+0000 7f25e4da6640 1 -- 172.21.15.12:0/2916181340 shutdown_connections 2024-09-19T06:48:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:24.357+0000 7f25e4da6640 1 -- 172.21.15.12:0/2916181340 wait complete. 2024-09-19T06:48:25.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:48:25.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:25 smithi173 ceph-mon[35349]: pgmap v255: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 705 KiB/s wr, 97 op/s 2024-09-19T06:48:25.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:25 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:48:25.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:25 smithi012 ceph-mon[30937]: pgmap v255: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 705 KiB/s wr, 97 op/s 2024-09-19T06:48:25.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:25 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:48:25.672 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:25.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:25 smithi016 ceph-mon[34911]: pgmap v255: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 705 KiB/s wr, 97 op/s 2024-09-19T06:48:25.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:25 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:48:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 460.0 s, 1667.8 tps, lat 355.705 ms stddev 2918.945 2024-09-19T06:48:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.303+0000 7f54320e6640 1 -- 172.21.15.12:0/3562468186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c10e450 msgr2=0x7f542c110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.303+0000 7f54320e6640 1 --2- 172.21.15.12:0/3562468186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c10e450 0x7f542c110840 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5424009ca0 tx=0x7f542402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.303+0000 7f54320e6640 1 -- 172.21.15.12:0/3562468186 shutdown_connections 2024-09-19T06:48:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.303+0000 7f54320e6640 1 --2- 172.21.15.12:0/3562468186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c10e450 0x7f542c110840 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.303+0000 7f54320e6640 1 --2- 172.21.15.12:0/3562468186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f542c1011c0 0x7f542c10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.303+0000 7f54320e6640 1 --2- 172.21.15.12:0/3562468186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542c1008a0 0x7f542c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.303+0000 7f54320e6640 1 -- 172.21.15.12:0/3562468186 >> 172.21.15.12:0/3562468186 conn(0x7f542c0fc6b0 msgr2=0x7f542c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.303+0000 7f54320e6640 1 -- 172.21.15.12:0/3562468186 shutdown_connections 2024-09-19T06:48:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.303+0000 7f54320e6640 1 -- 172.21.15.12:0/3562468186 wait complete. 2024-09-19T06:48:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.304+0000 7f54320e6640 1 Processor -- start 2024-09-19T06:48:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.304+0000 7f54320e6640 1 -- start start 2024-09-19T06:48:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.304+0000 7f54320e6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542c1008a0 0x7f542c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.304+0000 7f54320e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c1011c0 0x7f542c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.304+0000 7f54320e6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f542c10e450 0x7f542c19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f54320e6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f542c1140a0 con 0x7f542c1011c0 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c1011c0 0x7f542c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f54320e6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f542c113f20 con 0x7f542c10e450 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f54320e6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f542c114220 con 0x7f542c1008a0 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c1011c0 0x7f542c19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36180/0 (socket says 172.21.15.12:36180) 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542affd640 1 -- 172.21.15.12:0/2350616622 learned_addr learned my addr 172.21.15.12:0/2350616622 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542bfff640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f542c10e450 0x7f542c19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542b7fe640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542c1008a0 0x7f542c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542affd640 1 -- 172.21.15.12:0/2350616622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542c1008a0 msgr2=0x7f542c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542affd640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542c1008a0 0x7f542c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542affd640 1 -- 172.21.15.12:0/2350616622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f542c10e450 msgr2=0x7f542c19edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542affd640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f542c10e450 0x7f542c19edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542affd640 1 -- 172.21.15.12:0/2350616622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c19f520 con 0x7f542c1011c0 2024-09-19T06:48:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f542affd640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c1011c0 0x7f542c19aa70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f542000ea60 tx=0x7f542000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f5428ff9640 1 -- 172.21.15.12:0/2350616622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542000cde0 con 0x7f542c1011c0 2024-09-19T06:48:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f5428ff9640 1 -- 172.21.15.12:0/2350616622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54200035f0 con 0x7f542c1011c0 2024-09-19T06:48:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.305+0000 7f54320e6640 1 -- 172.21.15.12:0/2350616622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542c19f810 con 0x7f542c1011c0 2024-09-19T06:48:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.306+0000 7f5428ff9640 1 -- 172.21.15.12:0/2350616622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5420010670 con 0x7f542c1011c0 2024-09-19T06:48:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.306+0000 7f54320e6640 1 -- 172.21.15.12:0/2350616622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f542c1a70a0 con 0x7f542c1011c0 2024-09-19T06:48:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.309+0000 7f5434e7e740 1 Processor -- start 2024-09-19T06:48:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.309+0000 7f5434e7e740 1 -- start start 2024-09-19T06:48:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f196300 0x56113f1966e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f1a14c0 0x56113f1a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f5434e7e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56113f0f22f0 con 0x56113f196300 2024-09-19T06:48:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f5434e7e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56113f09a270 con 0x56113f196c20 2024-09-19T06:48:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f5434e7e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56113f0ee2b0 con 0x56113f1a14c0 2024-09-19T06:48:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f542b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f5428ff9640 1 -- 172.21.15.12:0/2350616622 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f54200037a0 con 0x7f542c1011c0 2024-09-19T06:48:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f542b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:36284/0 (socket says 172.21.15.12:36284) 2024-09-19T06:48:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f542b7fe640 1 -- 172.21.15.12:0/438019247 learned_addr learned my addr 172.21.15.12:0/438019247 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f542b7fe640 1 -- 172.21.15.12:0/438019247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f1a14c0 msgr2=0x56113f1a38b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:48:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f542b7fe640 1 --2- 172.21.15.12:0/438019247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f1a14c0 0x56113f1a38b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f542b7fe640 1 -- 172.21.15.12:0/438019247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f196300 msgr2=0x56113f1966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f542b7fe640 1 --2- 172.21.15.12:0/438019247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f196300 0x56113f1966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.310+0000 7f542b7fe640 1 -- 172.21.15.12:0/438019247 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113f099340 con 0x56113f196c20 2024-09-19T06:48:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.311+0000 7f542b7fe640 1 --2- 172.21.15.12:0/438019247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a0f80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f541c00bd10 tx=0x7f541c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c50bc4a9fb24462 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.311+0000 7f5411ffb640 1 -- 172.21.15.12:0/438019247 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c004030 con 0x56113f196c20 2024-09-19T06:48:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.311+0000 7f5411ffb640 1 -- 172.21.15.12:0/438019247 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f541c0041d0 con 0x56113f196c20 2024-09-19T06:48:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.311+0000 7f5411ffb640 1 -- 172.21.15.12:0/438019247 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c0117e0 con 0x56113f196c20 2024-09-19T06:48:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.311+0000 7f5428ff9640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54140a34e0 0x7f54140a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.312+0000 7f5428ff9640 1 -- 172.21.15.12:0/2350616622 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f54200d0000 con 0x7f542c1011c0 2024-09-19T06:48:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.312+0000 7f542bfff640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54140a34e0 0x7f54140a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.312+0000 7f5434e7e740 1 -- 172.21.15.12:0/438019247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 msgr2=0x56113f1a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.312+0000 7f5434e7e740 1 --2- 172.21.15.12:0/438019247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a0f80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f541c00bd10 tx=0x7f541c0107a0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.313+0000 7f5434e7e740 1 -- 172.21.15.12:0/438019247 shutdown_connections 2024-09-19T06:48:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.313+0000 7f5434e7e740 1 --2- 172.21.15.12:0/438019247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f1a14c0 0x56113f1a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.313+0000 7f5434e7e740 1 --2- 172.21.15.12:0/438019247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a0f80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.313+0000 7f5434e7e740 1 --2- 172.21.15.12:0/438019247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f196300 0x56113f1966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.313+0000 7f5434e7e740 1 -- 172.21.15.12:0/438019247 >> 172.21.15.12:0/438019247 conn(0x56113f192870 msgr2=0x56113f192c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.313+0000 7f5434e7e740 1 -- 172.21.15.12:0/438019247 shutdown_connections 2024-09-19T06:48:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.313+0000 7f542bfff640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54140a34e0 0x7f54140a59a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5424006010 tx=0x7f5424009360 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.313+0000 7f5434e7e740 1 -- 172.21.15.12:0/438019247 wait complete. 2024-09-19T06:48:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.314+0000 7f5434e7e740 1 -- start start 2024-09-19T06:48:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.314+0000 7f5434e7e740 1 Processor -- start 2024-09-19T06:48:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.314+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196300 0x56113f19e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.314+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f19ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.314+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f1a14c0 0x56113f19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f5434e7e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56113f1a4090 con 0x56113f1a14c0 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f5434e7e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56113f07b290 con 0x56113f196300 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f5434e7e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56113f1a4210 con 0x56113f196c20 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f19ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f5434e7e740 10 client.0 _ll_register_callbacks cb 0x56113f0ac140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f19ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49016/0 (socket says 172.21.15.12:49016) 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542affd640 1 -- 172.21.15.12:0/932419488 learned_addr learned my addr 172.21.15.12:0/932419488 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542b7fe640 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196300 0x56113f19e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542bfff640 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f1a14c0 0x56113f19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542b7fe640 1 -- 172.21.15.12:0/932419488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 msgr2=0x56113f19ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542b7fe640 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f19ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542b7fe640 1 -- 172.21.15.12:0/932419488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f1a14c0 msgr2=0x56113f19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542b7fe640 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f1a14c0 0x56113f19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542b7fe640 1 -- 172.21.15.12:0/932419488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56113ee05210 con 0x56113f196300 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542affd640 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f19ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f542b7fe640 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196300 0x56113f19e4f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f541c00b620 tx=0x7f541c00be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccf2243e268d96a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.315+0000 7f540affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.316+0000 7f540affd640 1 -- 172.21.15.12:0/932419488 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c0035f0 con 0x56113f196300 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.316+0000 7f5434e7e740 1 -- 172.21.15.12:0/932419488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f541c0041d0 con 0x56113f196300 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.316+0000 7f540affd640 1 -- 172.21.15.12:0/932419488 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f541c003790 con 0x56113f196300 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.316+0000 7f540affd640 1 -- 172.21.15.12:0/932419488 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f541c0039b0 con 0x56113f196300 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.316+0000 7f5434e7e740 10 client.27188 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.316+0000 7f5434e7e740 1 -- 172.21.15.12:0/932419488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56113eed1620 con 0x56113f196300 2024-09-19T06:48:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.317+0000 7f540affd640 1 -- 172.21.15.12:0/932419488 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f541c0041d0 con 0x56113f196300 2024-09-19T06:48:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.317+0000 7f540affd640 1 -- 172.21.15.12:0/932419488 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7f541c0049c0 con 0x56113f196300 2024-09-19T06:48:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.317+0000 7f5434e7e740 10 client.27188 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.317+0000 7f5434e7e740 10 client.27188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.317+0000 7f5434e7e740 20 client.27188 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.317+0000 7f5434e7e740 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56113f1b1490 0x56113f1b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.317+0000 7f5434e7e740 4 client.27188 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.317+0000 7f5434e7e740 1 -- 172.21.15.12:0/932419488 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56113f0ffa20 con 0x56113f1b1490 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.317+0000 7f542affd640 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56113f1b1490 0x56113f1b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.318+0000 7f540affd640 10 client.27188 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.318+0000 7f542affd640 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56113f1b1490 0x56113f1b3880 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9057df3930a31114 server_cookie=5dd410f123f9e127 in_seq=0 out_seq=0 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f540affd640 1 -- 172.21.15.12:0/932419488 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56113f0ffa20 con 0x56113f1b1490 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f540affd640 10 client.27188 handle_command_reply: tid=0 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f5434e7e740 1 client.27188 shutdown 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f5434e7e740 1 -- 172.21.15.12:0/932419488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196300 msgr2=0x56113f19e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f5434e7e740 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196300 0x56113f19e4f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f541c00b620 tx=0x7f541c00be70 comp rx=0 tx=0).stop 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f5434e7e740 1 -- 172.21.15.12:0/932419488 shutdown_connections 2024-09-19T06:48:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f5434e7e740 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56113f1b1490 0x56113f1b3880 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f5434e7e740 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f1a14c0 0x56113f19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f5434e7e740 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f19ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f5434e7e740 1 --2- 172.21.15.12:0/932419488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196300 0x56113f19e4f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f5434e7e740 1 -- 172.21.15.12:0/932419488 >> 172.21.15.12:0/932419488 conn(0x56113f192870 msgr2=0x56113f1891c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.319+0000 7f540affd640 0 client.27188 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.320+0000 7f5434e7e740 1 -- 172.21.15.12:0/932419488 shutdown_connections 2024-09-19T06:48:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.320+0000 7f5434e7e740 1 -- 172.21.15.12:0/932419488 wait complete. 2024-09-19T06:48:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.320+0000 7f5434e7e740 20 client.27188 trim_cache size 0 max 16384 2024-09-19T06:48:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.359+0000 7f5434e7e740 1 Processor -- start 2024-09-19T06:48:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.360+0000 7f5434e7e740 1 -- start start 2024-09-19T06:48:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.360+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f196300 0x56113f198d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.360+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f1b8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.360+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f1a14c0 0x56113f1b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.360+0000 7f5434e7e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f542c0702f0 con 0x56113f196300 2024-09-19T06:48:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.360+0000 7f5434e7e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f542c071e60 con 0x56113f1a14c0 2024-09-19T06:48:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.360+0000 7f5434e7e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f542c0709c0 con 0x56113f196c20 2024-09-19T06:48:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.361+0000 7f542affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f1b8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.361+0000 7f542affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f1b8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49034/0 (socket says 172.21.15.12:49034) 2024-09-19T06:48:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.361+0000 7f542affd640 1 -- 172.21.15.12:0/2303591553 learned_addr learned my addr 172.21.15.12:0/2303591553 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.361+0000 7f542b7fe640 1 --2- 172.21.15.12:0/2303591553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f196300 0x56113f198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.361+0000 7f542affd640 1 -- 172.21.15.12:0/2303591553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f1a14c0 msgr2=0x56113f1b9420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:48:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.361+0000 7f542affd640 1 --2- 172.21.15.12:0/2303591553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f1a14c0 0x56113f1b9420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.361+0000 7f542affd640 1 -- 172.21.15.12:0/2303591553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f196300 msgr2=0x56113f198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.361+0000 7f542affd640 1 --2- 172.21.15.12:0/2303591553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f196300 0x56113f198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.361+0000 7f542affd640 1 -- 172.21.15.12:0/2303591553 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113f1adf10 con 0x56113f196c20 2024-09-19T06:48:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.362+0000 7f542affd640 1 --2- 172.21.15.12:0/2303591553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f1b8ee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f542000ea30 tx=0x7f542000ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742470fab85ad8ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.362+0000 7f54117fa640 1 -- 172.21.15.12:0/2303591553 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54200b5070 con 0x56113f196c20 2024-09-19T06:48:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.362+0000 7f54117fa640 1 -- 172.21.15.12:0/2303591553 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54200a0590 con 0x56113f196c20 2024-09-19T06:48:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.362+0000 7f54117fa640 1 -- 172.21.15.12:0/2303591553 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54200cd8d0 con 0x56113f196c20 2024-09-19T06:48:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.363+0000 7f5434e7e740 1 -- 172.21.15.12:0/2303591553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 msgr2=0x56113f1b8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.363+0000 7f5434e7e740 1 --2- 172.21.15.12:0/2303591553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f1b8ee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f542000ea30 tx=0x7f542000ef90 comp rx=0 tx=0).stop 2024-09-19T06:48:26.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.365+0000 7f5434e7e740 1 -- 172.21.15.12:0/2303591553 shutdown_connections 2024-09-19T06:48:26.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.365+0000 7f5434e7e740 1 --2- 172.21.15.12:0/2303591553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f1a14c0 0x56113f1b9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.365+0000 7f5434e7e740 1 --2- 172.21.15.12:0/2303591553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196c20 0x56113f1b8ee0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.365+0000 7f5434e7e740 1 --2- 172.21.15.12:0/2303591553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f196300 0x56113f198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.365+0000 7f5434e7e740 1 -- 172.21.15.12:0/2303591553 >> 172.21.15.12:0/2303591553 conn(0x56113f192870 msgr2=0x56113f19d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.367+0000 7f5434e7e740 1 -- 172.21.15.12:0/2303591553 shutdown_connections 2024-09-19T06:48:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.367+0000 7f5434e7e740 1 -- 172.21.15.12:0/2303591553 wait complete. 2024-09-19T06:48:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.367+0000 7f5434e7e740 1 -- start start 2024-09-19T06:48:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f5434e7e740 1 Processor -- start 2024-09-19T06:48:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196300 0x56113f19c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f5434e7e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f1a14c0 0x56113f1a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f5434e7e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f542c071790 con 0x56113f1a14c0 2024-09-19T06:48:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f5434e7e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f542c0710c0 con 0x56113f196c20 2024-09-19T06:48:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f5434e7e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f542c06e310 con 0x56113f196300 2024-09-19T06:48:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f5434e7e740 10 client.0 _ll_register_callbacks cb 0x7f541c00bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f542affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f542affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:36302/0 (socket says 172.21.15.12:36302) 2024-09-19T06:48:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f542affd640 1 -- 172.21.15.12:0/2618892580 learned_addr learned my addr 172.21.15.12:0/2618892580 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.368+0000 7f542b7fe640 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196300 0x56113f19c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.369+0000 7f542bfff640 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f1a14c0 0x56113f1a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.369+0000 7f542affd640 1 -- 172.21.15.12:0/2618892580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196300 msgr2=0x56113f19c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.369+0000 7f542affd640 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196300 0x56113f19c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.369+0000 7f542affd640 1 -- 172.21.15.12:0/2618892580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f1a14c0 msgr2=0x56113f1a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.369+0000 7f542affd640 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f1a14c0 0x56113f1a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.369+0000 7f542affd640 1 -- 172.21.15.12:0/2618892580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56113f19a7c0 con 0x56113f196c20 2024-09-19T06:48:26.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.372+0000 7f542affd640 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a94a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5420098bb0 tx=0x7f542009bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ebcd32e62a834e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.373+0000 7f540affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:48:26.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.373+0000 7f540affd640 1 -- 172.21.15.12:0/2618892580 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54200b5040 con 0x56113f196c20 2024-09-19T06:48:26.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.373+0000 7f540affd640 1 -- 172.21.15.12:0/2618892580 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f5420098850 con 0x56113f196c20 2024-09-19T06:48:26.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.373+0000 7f5434e7e740 1 -- 172.21.15.12:0/2618892580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54200a0590 con 0x56113f196c20 2024-09-19T06:48:26.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.374+0000 7f540affd640 1 -- 172.21.15.12:0/2618892580 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f54200a4e50 con 0x56113f196c20 2024-09-19T06:48:26.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.374+0000 7f5434e7e740 10 client.27191 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:26.377 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.374+0000 7f5434e7e740 1 -- 172.21.15.12:0/2618892580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56113f21b240 con 0x56113f196c20 2024-09-19T06:48:26.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.375+0000 7f540affd640 1 -- 172.21.15.12:0/2618892580 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54200a0590 con 0x56113f196c20 2024-09-19T06:48:26.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.375+0000 7f540affd640 1 -- 172.21.15.12:0/2618892580 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7f54200a49c0 con 0x56113f196c20 2024-09-19T06:48:26.378 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.375+0000 7f5434e7e740 10 client.27191 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.375+0000 7f5434e7e740 10 client.27191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.375+0000 7f5434e7e740 20 client.27191 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.375+0000 7f5434e7e740 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56113f21b8d0 0x56113f21dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.375+0000 7f5434e7e740 4 client.27191 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:48:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.375+0000 7f5434e7e740 1 -- 172.21.15.12:0/2618892580 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56113f0f9d70 con 0x56113f21b8d0 2024-09-19T06:48:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.375+0000 7f542b7fe640 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56113f21b8d0 0x56113f21dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.376+0000 7f540affd640 10 client.27191 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.376+0000 7f542b7fe640 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56113f21b8d0 0x56113f21dcf0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50d8da41565ff4f6 server_cookie=791c28ff6b205cd4 in_seq=0 out_seq=0 2024-09-19T06:48:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.389+0000 7f540affd640 1 -- 172.21.15.12:0/2618892580 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56113f0f9d70 con 0x56113f21b8d0 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.389+0000 7f540affd640 10 client.27191 handle_command_reply: tid=0 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.389+0000 7f5434e7e740 1 client.27191 shutdown 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.389+0000 7f5434e7e740 1 -- 172.21.15.12:0/2618892580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 msgr2=0x56113f1a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.389+0000 7f5434e7e740 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a94a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5420098bb0 tx=0x7f542009bbb0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.390+0000 7f5434e7e740 1 -- 172.21.15.12:0/2618892580 shutdown_connections 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.390+0000 7f5434e7e740 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56113f21b8d0 0x56113f21dcf0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.390+0000 7f5434e7e740 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113f1a14c0 0x56113f1a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.390+0000 7f5434e7e740 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56113f196c20 0x56113f1a94a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.390+0000 7f5434e7e740 1 --2- 172.21.15.12:0/2618892580 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56113f196300 0x56113f19c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.390+0000 7f5434e7e740 1 -- 172.21.15.12:0/2618892580 >> 172.21.15.12:0/2618892580 conn(0x56113f192870 msgr2=0x56113f1889a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.390+0000 7f540affd640 0 client.27191 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.390+0000 7f5434e7e740 1 -- 172.21.15.12:0/2618892580 shutdown_connections 2024-09-19T06:48:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.390+0000 7f5434e7e740 1 -- 172.21.15.12:0/2618892580 wait complete. 2024-09-19T06:48:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.390+0000 7f5434e7e740 20 client.27191 trim_cache size 0 max 16384 2024-09-19T06:48:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:48:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:48:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:48:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:48:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 -- 172.21.15.12:0/2350616622 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54140a34e0 msgr2=0x7f54140a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54140a34e0 0x7f54140a59a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5424006010 tx=0x7f5424009360 comp rx=0 tx=0).stop 2024-09-19T06:48:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 -- 172.21.15.12:0/2350616622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c1011c0 msgr2=0x7f542c19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c1011c0 0x7f542c19aa70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f542000ea60 tx=0x7f542000ef20 comp rx=0 tx=0).stop 2024-09-19T06:48:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 -- 172.21.15.12:0/2350616622 shutdown_connections 2024-09-19T06:48:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f542c10e450 0x7f542c19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f542c1011c0 0x7f542c19aa70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f54140a34e0 0x7f54140a59a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 --2- 172.21.15.12:0/2350616622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f542c1008a0 0x7f542c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 -- 172.21.15.12:0/2350616622 >> 172.21.15.12:0/2350616622 conn(0x7f542c0fc6b0 msgr2=0x7f542c0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 -- 172.21.15.12:0/2350616622 shutdown_connections 2024-09-19T06:48:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:26.391+0000 7f54320e6640 1 -- 172.21.15.12:0/2350616622 wait complete. 2024-09-19T06:48:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.444+0000 7f6f2aee6640 1 -- 172.21.15.12:0/3715097696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24074620 msgr2=0x7f6f24074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.444+0000 7f6f2aee6640 1 --2- 172.21.15.12:0/3715097696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24074620 0x7f6f24074a00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009be0 tx=0x7f6f1c02a750 comp rx=0 tx=0).stop 2024-09-19T06:48:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.444+0000 7f6f2aee6640 1 -- 172.21.15.12:0/3715097696 shutdown_connections 2024-09-19T06:48:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.444+0000 7f6f2aee6640 1 --2- 172.21.15.12:0/3715097696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f2410e3c0 0x7f6f24110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.444+0000 7f6f2aee6640 1 --2- 172.21.15.12:0/3715097696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f24074f40 0x7f6f2410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.444+0000 7f6f2aee6640 1 --2- 172.21.15.12:0/3715097696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24074620 0x7f6f24074a00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.444+0000 7f6f2aee6640 1 -- 172.21.15.12:0/3715097696 >> 172.21.15.12:0/3715097696 conn(0x7f6f240fd8c0 msgr2=0x7f6f240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.444+0000 7f6f2aee6640 1 -- 172.21.15.12:0/3715097696 shutdown_connections 2024-09-19T06:48:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.444+0000 7f6f2aee6640 1 -- 172.21.15.12:0/3715097696 wait complete. 2024-09-19T06:48:26.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f2aee6640 1 Processor -- start 2024-09-19T06:48:26.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f2aee6640 1 -- start start 2024-09-19T06:48:26.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f2aee6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24074620 0x7f6f2410ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f2aee6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24074f40 0x7f6f2410ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f2aee6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2410e3c0 0x7f6f2410b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f23fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24074f40 0x7f6f2410ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f28c82640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24074620 0x7f6f2410ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f28c82640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24074620 0x7f6f2410ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49060/0 (socket says 172.21.15.12:49060) 2024-09-19T06:48:26.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f2aee6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24114150 con 0x7f6f2410e3c0 2024-09-19T06:48:26.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f2aee6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24113fd0 con 0x7f6f24074f40 2024-09-19T06:48:26.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f2aee6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241142d0 con 0x7f6f24074620 2024-09-19T06:48:26.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.445+0000 7f6f28c82640 1 -- 172.21.15.12:0/607455165 learned_addr learned my addr 172.21.15.12:0/607455165 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:26.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.446+0000 7f6f29483640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2410e3c0 0x7f6f2410b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.446+0000 7f6f28c82640 1 -- 172.21.15.12:0/607455165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24074f40 msgr2=0x7f6f2410ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.446+0000 7f6f28c82640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24074f40 0x7f6f2410ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.446+0000 7f6f28c82640 1 -- 172.21.15.12:0/607455165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2410e3c0 msgr2=0x7f6f2410b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.446+0000 7f6f28c82640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2410e3c0 0x7f6f2410b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.447+0000 7f6f28c82640 1 -- 172.21.15.12:0/607455165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f241a0670 con 0x7f6f24074620 2024-09-19T06:48:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.448+0000 7f6f28c82640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24074620 0x7f6f2410ddb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c034040 tx=0x7f6f1c0305b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.449+0000 7f6f21ffb640 1 -- 172.21.15.12:0/607455165 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c041020 con 0x7f6f24074620 2024-09-19T06:48:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.449+0000 7f6f21ffb640 1 -- 172.21.15.12:0/607455165 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f1c003e50 con 0x7f6f24074620 2024-09-19T06:48:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.449+0000 7f6f21ffb640 1 -- 172.21.15.12:0/607455165 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c036040 con 0x7f6f24074620 2024-09-19T06:48:26.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.449+0000 7f6f2aee6640 1 -- 172.21.15.12:0/607455165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f241a0900 con 0x7f6f24074620 2024-09-19T06:48:26.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.449+0000 7f6f2aee6640 1 -- 172.21.15.12:0/607455165 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f241a0de0 con 0x7f6f24074620 2024-09-19T06:48:26.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.452+0000 7f6f21ffb640 1 -- 172.21.15.12:0/607455165 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6f1c044020 con 0x7f6f24074620 2024-09-19T06:48:26.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.452+0000 7f6f2d2bf740 1 Processor -- start 2024-09-19T06:48:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.452+0000 7f6f2d2bf740 1 -- start start 2024-09-19T06:48:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.452+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.452+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedca5d0 0x564daedcaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.452+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.452+0000 7f6f2d2bf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564daed302f0 con 0x564daedd5370 2024-09-19T06:48:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.452+0000 7f6f2d2bf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564daecd7cf0 con 0x564daedca5d0 2024-09-19T06:48:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.452+0000 7f6f2d2bf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564daed2c2b0 con 0x564daedcbb40 2024-09-19T06:48:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f29483640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f21ffb640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f0c0a3500 0x7f6f0c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f29483640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49062/0 (socket says 172.21.15.12:49062) 2024-09-19T06:48:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f29483640 1 -- 172.21.15.12:0/153524697 learned_addr learned my addr 172.21.15.12:0/153524697 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f23fff640 1 --2- 172.21.15.12:0/153524697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f28c82640 1 --2- 172.21.15.12:0/153524697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedca5d0 0x564daedcaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f21ffb640 1 -- 172.21.15.12:0/607455165 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f6f1c0f0900 con 0x7f6f24074620 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f29483640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f0c0a3500 0x7f6f0c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f28c82640 1 -- 172.21.15.12:0/153524697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 msgr2=0x564daedca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f28c82640 1 --2- 172.21.15.12:0/153524697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f28c82640 1 -- 172.21.15.12:0/153524697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 msgr2=0x564daedd7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f28c82640 1 --2- 172.21.15.12:0/153524697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f28c82640 1 -- 172.21.15.12:0/153524697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564daecbc3a0 con 0x564daedca5d0 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.453+0000 7f6f28c82640 1 --2- 172.21.15.12:0/153524697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedca5d0 0x564daedcaa10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0edfb0 tx=0x7f6f1c0b1fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f7955da30030931 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.454+0000 7f6f0affd640 1 -- 172.21.15.12:0/153524697 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0bd240 con 0x564daedca5d0 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.454+0000 7f6f0affd640 1 -- 172.21.15.12:0/153524697 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f1c0bcb40 con 0x564daedca5d0 2024-09-19T06:48:26.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.454+0000 7f6f0affd640 1 -- 172.21.15.12:0/153524697 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0316f0 con 0x564daedca5d0 2024-09-19T06:48:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.454+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/153524697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedca5d0 msgr2=0x564daedcaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.454+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/153524697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedca5d0 0x564daedcaa10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0edfb0 tx=0x7f6f1c0b1fd0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.454+0000 7f6f29483640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f0c0a3500 0x7f6f0c0a59c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f14004650 tx=0x7f6f14004730 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.455+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/153524697 shutdown_connections 2024-09-19T06:48:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.455+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/153524697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.455+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/153524697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedca5d0 0x564daedcaa10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.455+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/153524697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.455+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/153524697 >> 172.21.15.12:0/153524697 conn(0x564daed93310 msgr2=0x564daedc6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.455+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/153524697 shutdown_connections 2024-09-19T06:48:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.455+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/153524697 wait complete. 2024-09-19T06:48:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.455+0000 7f6f2d2bf740 1 -- start start 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.455+0000 7f6f2d2bf740 1 Processor -- start 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedd22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 0x564daede1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f2d2bf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564daedd7e30 con 0x564daedd5370 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f2d2bf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564daeceb060 con 0x564daedd2d40 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f2d2bf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564daedd7fb0 con 0x564daedcbb40 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f2d2bf740 10 client.0 _ll_register_callbacks cb 0x564daea3e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f23fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f28c82640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedd22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f29483640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 0x564daede1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f23fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36270/0 (socket says 172.21.15.12:36270) 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.456+0000 7f6f23fff640 1 -- 172.21.15.12:0/1352261584 learned_addr learned my addr 172.21.15.12:0/1352261584 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f29483640 1 -- 172.21.15.12:0/1352261584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 msgr2=0x564daedd22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f29483640 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedd22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f29483640 1 -- 172.21.15.12:0/1352261584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 msgr2=0x564daedd2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f29483640 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f29483640 1 -- 172.21.15.12:0/1352261584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564daeaa13c0 con 0x564daedd2d40 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f23fff640 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f29483640 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 0x564daede1220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6f140126d0 tx=0x7f6f140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deaf8d67341e4b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f03fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:48:26.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f03fff640 1 -- 172.21.15.12:0/1352261584 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14025020 con 0x564daedd2d40 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/1352261584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f1c0bcb40 con 0x564daedd2d40 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.457+0000 7f6f03fff640 1 -- 172.21.15.12:0/1352261584 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f6f14021890 con 0x564daedd2d40 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f03fff640 1 -- 172.21.15.12:0/1352261584 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f6f14030050 con 0x564daedd2d40 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f2d2bf740 10 client.27203 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/1352261584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x564daede3f40 con 0x564daedd2d40 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f03fff640 1 -- 172.21.15.12:0/1352261584 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f14010420 con 0x564daedd2d40 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f03fff640 1 -- 172.21.15.12:0/1352261584 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7f6f1401e070 con 0x564daedd2d40 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f2d2bf740 10 client.27203 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f2d2bf740 10 client.27203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f2d2bf740 20 client.27203 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564daede5890 0x564daede7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f2d2bf740 4 client.27203 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/1352261584 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6f1c0bcb40 con 0x564daede5890 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.458+0000 7f6f28c82640 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564daede5890 0x564daede7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.459+0000 7f6f28c82640 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564daede5890 0x564daede7d10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=76d569ce0ed6c1af server_cookie=6c3712eaf69b702d in_seq=0 out_seq=0 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.459+0000 7f6f03fff640 10 client.27203 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f03fff640 1 -- 172.21.15.12:0/1352261584 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f6f1c0bcb40 con 0x564daede5890 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f03fff640 10 client.27203 handle_command_reply: tid=0 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f2d2bf740 1 client.27203 shutdown 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/1352261584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 msgr2=0x564daede1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 0x564daede1220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6f140126d0 tx=0x7f6f140046c0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/1352261584 shutdown_connections 2024-09-19T06:48:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564daede5890 0x564daede7d10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 0x564daede1220 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f03fff640 0 client.27203 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:48:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/1352261584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedd22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.460+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/1352261584 >> 172.21.15.12:0/1352261584 conn(0x564daed93310 msgr2=0x564daedcc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.461+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/1352261584 shutdown_connections 2024-09-19T06:48:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.461+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/1352261584 wait complete. 2024-09-19T06:48:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.461+0000 7f6f2d2bf740 20 client.27203 trim_cache size 0 max 16384 2024-09-19T06:48:26.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.487+0000 7f6f2d2bf740 1 Processor -- start 2024-09-19T06:48:26.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.487+0000 7f6f2d2bf740 1 -- start start 2024-09-19T06:48:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.488+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedd1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.488+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 0x564daedd26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.488+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.488+0000 7f6f2d2bf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241bc9a0 con 0x564daedd5370 2024-09-19T06:48:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.488+0000 7f6f2d2bf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241be510 con 0x564daedd2d40 2024-09-19T06:48:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.488+0000 7f6f2d2bf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241bd070 con 0x564daedcbb40 2024-09-19T06:48:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.488+0000 7f6f29483640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f28c82640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedd1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f29483640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36274/0 (socket says 172.21.15.12:36274) 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f29483640 1 -- 172.21.15.12:0/3443425659 learned_addr learned my addr 172.21.15.12:0/3443425659 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f23fff640 1 --2- 172.21.15.12:0/3443425659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 0x564daedd26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f28c82640 1 -- 172.21.15.12:0/3443425659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 msgr2=0x564daedd26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f28c82640 1 --2- 172.21.15.12:0/3443425659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 0x564daedd26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f28c82640 1 -- 172.21.15.12:0/3443425659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 msgr2=0x564daedd4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f28c82640 1 --2- 172.21.15.12:0/3443425659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f28c82640 1 -- 172.21.15.12:0/3443425659 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564daedc7dd0 con 0x564daedcbb40 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f28c82640 1 --2- 172.21.15.12:0/3443425659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedd1200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x564daedc7ac0 tx=0x7f6f1c02a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35be442665e0210e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.489+0000 7f6f0a7fc640 1 -- 172.21.15.12:0/3443425659 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0bc680 con 0x564daedcbb40 2024-09-19T06:48:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.490+0000 7f6f0a7fc640 1 -- 172.21.15.12:0/3443425659 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f1c0bd240 con 0x564daedcbb40 2024-09-19T06:48:26.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.490+0000 7f6f0a7fc640 1 -- 172.21.15.12:0/3443425659 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0316f0 con 0x564daedcbb40 2024-09-19T06:48:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.491+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/3443425659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 msgr2=0x564daedd1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.491+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/3443425659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedd1200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x564daedc7ac0 tx=0x7f6f1c02a750 comp rx=0 tx=0).stop 2024-09-19T06:48:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.491+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/3443425659 shutdown_connections 2024-09-19T06:48:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.491+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/3443425659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedd4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.491+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/3443425659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedd2d40 0x564daedd26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.491+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/3443425659 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedcbb40 0x564daedd1200 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.491+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/3443425659 >> 172.21.15.12:0/3443425659 conn(0x564daed93310 msgr2=0x564daedd3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.491+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/3443425659 shutdown_connections 2024-09-19T06:48:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.491+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/3443425659 wait complete. 2024-09-19T06:48:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.492+0000 7f6f2d2bf740 1 -- start start 2024-09-19T06:48:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.492+0000 7f6f2d2bf740 1 Processor -- start 2024-09-19T06:48:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.492+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedcbb40 0x564daeddd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.493+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedd2d40 0x564daeddd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.493+0000 7f6f28c82640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedcbb40 0x564daeddd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.493+0000 7f6f28c82640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedcbb40 0x564daeddd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:36358/0 (socket says 172.21.15.12:36358) 2024-09-19T06:48:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.493+0000 7f6f2d2bf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedcf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.493+0000 7f6f23fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedd2d40 0x564daeddd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.493+0000 7f6f23fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedd2d40 0x564daeddd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49102/0 (socket says 172.21.15.12:49102) 2024-09-19T06:48:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.494+0000 7f6f28c82640 1 -- 172.21.15.12:0/2829246050 learned_addr learned my addr 172.21.15.12:0/2829246050 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.494+0000 7f6f29483640 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedcf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.494+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241bde40 con 0x564daedd5370 2024-09-19T06:48:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.494+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241bd770 con 0x564daedcbb40 2024-09-19T06:48:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.494+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241ba9a0 con 0x564daedd2d40 2024-09-19T06:48:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.495+0000 7f6f23fff640 1 -- 172.21.15.12:0/2829246050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedcbb40 msgr2=0x564daeddd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.495+0000 7f6f23fff640 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedcbb40 0x564daeddd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.495+0000 7f6f23fff640 1 -- 172.21.15.12:0/2829246050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 msgr2=0x564daedcf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.495+0000 7f6f23fff640 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedcf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.495+0000 7f6f23fff640 1 -- 172.21.15.12:0/2829246050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564daedcfa80 con 0x564daedd2d40 2024-09-19T06:48:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.495+0000 7f6f2d2bf740 10 client.0 _ll_register_callbacks cb 0x7f6f1400bd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.495+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f1c0bd240 con 0x564daedd2d40 2024-09-19T06:48:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.496+0000 7f6f23fff640 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedd2d40 0x564daeddd740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6f18004650 tx=0x7f6f18003d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16cd1f010e28d254 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.496+0000 7f6f03fff640 10 client.27172 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.497+0000 7f6f03fff640 1 -- 172.21.15.12:0/2829246050 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18022060 con 0x564daedd2d40 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.497+0000 7f6f03fff640 1 -- 172.21.15.12:0/2829246050 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f6f18012d10 con 0x564daedd2d40 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.497+0000 7f6f03fff640 1 -- 172.21.15.12:0/2829246050 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f6f18011440 con 0x564daedd2d40 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.497+0000 7f6f2d2bf740 10 client.27172 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.497+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=43}) -- 0x564daedd5cf0 con 0x564daedd2d40 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.498+0000 7f6f03fff640 1 -- 172.21.15.12:0/2829246050 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7f6f1801c070 con 0x564daedd2d40 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.498+0000 7f6f2d2bf740 10 client.27172 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.498+0000 7f6f2d2bf740 10 client.27172 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.498+0000 7f6f2d2bf740 20 client.27172 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.498+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564daedd62b0 0x564daee52600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.498+0000 7f6f2d2bf740 4 client.27172 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:48:26.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.498+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564daed3d860 con 0x564daedd62b0 2024-09-19T06:48:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.498+0000 7f6f28c82640 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564daedd62b0 0x564daee52600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.499+0000 7f6f03fff640 10 client.27172 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:48:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.499+0000 7f6f28c82640 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564daedd62b0 0x564daee52600 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3fe830ca4a5031d server_cookie=64f1b45fdd2cb1e4 in_seq=0 out_seq=0 2024-09-19T06:48:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.499+0000 7f6f03fff640 1 -- 172.21.15.12:0/2829246050 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564daed3d860 con 0x564daedd62b0 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.499+0000 7f6f03fff640 10 client.27172 handle_command_reply: tid=0 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.499+0000 7f6f2d2bf740 1 client.27172 shutdown 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.499+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedd2d40 msgr2=0x564daeddd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.499+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedd2d40 0x564daeddd740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6f18004650 tx=0x7f6f18003d00 comp rx=0 tx=0).stop 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.499+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 shutdown_connections 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.499+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564daedd62b0 0x564daee52600 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.500+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564daedd5370 0x564daedcf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.500+0000 7f6f03fff640 0 client.27172 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.500+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564daedd2d40 0x564daeddd740 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.500+0000 7f6f2d2bf740 1 --2- 172.21.15.12:0/2829246050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564daedcbb40 0x564daeddd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.500+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 >> 172.21.15.12:0/2829246050 conn(0x564daed93310 msgr2=0x564daedd4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.500+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 shutdown_connections 2024-09-19T06:48:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.500+0000 7f6f2d2bf740 1 -- 172.21.15.12:0/2829246050 wait complete. 2024-09-19T06:48:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.500+0000 7f6f2d2bf740 20 client.27172 trim_cache size 0 max 16384 2024-09-19T06:48:26.505 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:48:26.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.501+0000 7f6f2aee6640 1 -- 172.21.15.12:0/607455165 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f0c0a3500 msgr2=0x7f6f0c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.501+0000 7f6f2aee6640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f0c0a3500 0x7f6f0c0a59c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f14004650 tx=0x7f6f14004730 comp rx=0 tx=0).stop 2024-09-19T06:48:26.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.501+0000 7f6f2aee6640 1 -- 172.21.15.12:0/607455165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24074620 msgr2=0x7f6f2410ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:26.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.501+0000 7f6f2aee6640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24074620 0x7f6f2410ddb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c034040 tx=0x7f6f1c0305b0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.501+0000 7f6f2aee6640 1 -- 172.21.15.12:0/607455165 shutdown_connections 2024-09-19T06:48:26.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.501+0000 7f6f2aee6640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f2410e3c0 0x7f6f2410b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.501+0000 7f6f2aee6640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f24074f40 0x7f6f2410ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.501+0000 7f6f2aee6640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6f0c0a3500 0x7f6f0c0a59c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.501+0000 7f6f2aee6640 1 --2- 172.21.15.12:0/607455165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f24074620 0x7f6f2410ddb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:26.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.502+0000 7f6f2aee6640 1 -- 172.21.15.12:0/607455165 >> 172.21.15.12:0/607455165 conn(0x7f6f240fd8c0 msgr2=0x7f6f240fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:26.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.502+0000 7f6f2aee6640 1 -- 172.21.15.12:0/607455165 shutdown_connections 2024-09-19T06:48:26.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:26.502+0000 7f6f2aee6640 1 -- 172.21.15.12:0/607455165 wait complete. 2024-09-19T06:48:27.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:48:27.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:27 smithi173 ceph-mon[35349]: pgmap v256: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.7 MiB/s wr, 376 op/s 2024-09-19T06:48:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:27 smithi012 ceph-mon[30937]: pgmap v256: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.7 MiB/s wr, 376 op/s 2024-09-19T06:48:27.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:27 smithi016 ceph-mon[34911]: pgmap v256: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.7 MiB/s wr, 376 op/s 2024-09-19T06:48:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:28.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.487+0000 7ff3326e9640 1 -- 172.21.15.12:0/3735348269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff32c102370 msgr2=0x7ff32c10e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:28.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.487+0000 7ff3326e9640 1 --2- 172.21.15.12:0/3735348269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff32c102370 0x7ff32c10e8a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff32801ace0 tx=0x7ff32803b990 comp rx=0 tx=0).stop 2024-09-19T06:48:28.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.488+0000 7ff3326e9640 1 -- 172.21.15.12:0/3735348269 shutdown_connections 2024-09-19T06:48:28.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.488+0000 7ff3326e9640 1 --2- 172.21.15.12:0/3735348269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff32c102370 0x7ff32c10e8a0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.488+0000 7ff3326e9640 1 --2- 172.21.15.12:0/3735348269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c1019d0 0x7ff32c101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.488+0000 7ff3326e9640 1 --2- 172.21.15.12:0/3735348269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff32c1079d0 0x7ff32c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.488+0000 7ff3326e9640 1 -- 172.21.15.12:0/3735348269 >> 172.21.15.12:0/3735348269 conn(0x7ff32c0fd710 msgr2=0x7ff32c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:28.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.491+0000 7ff3326e9640 1 -- 172.21.15.12:0/3735348269 shutdown_connections 2024-09-19T06:48:28.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.491+0000 7ff3326e9640 1 -- 172.21.15.12:0/3735348269 wait complete. 2024-09-19T06:48:28.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.492+0000 7ff3326e9640 1 Processor -- start 2024-09-19T06:48:28.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.492+0000 7ff3326e9640 1 -- start start 2024-09-19T06:48:28.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.492+0000 7ff3326e9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff32c1019d0 0x7ff32c074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.492+0000 7ff3326e9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff32c102370 0x7ff32c074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.492+0000 7ff3326e9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c1079d0 0x7ff32c06e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.492+0000 7ff3326e9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c06cf80 con 0x7ff32c1019d0 2024-09-19T06:48:28.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.492+0000 7ff3326e9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c06ce00 con 0x7ff32c102370 2024-09-19T06:48:28.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.492+0000 7ff3326e9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c06d100 con 0x7ff32c1079d0 2024-09-19T06:48:28.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.493+0000 7ff3316e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff32c1019d0 0x7ff32c074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.493+0000 7ff3316e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff32c1019d0 0x7ff32c074520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36322/0 (socket says 172.21.15.12:36322) 2024-09-19T06:48:28.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.493+0000 7ff3316e7640 1 -- 172.21.15.12:0/469696538 learned_addr learned my addr 172.21.15.12:0/469696538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:28.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.493+0000 7ff330ee6640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff32c102370 0x7ff32c074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.493+0000 7ff331ee8640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c1079d0 0x7ff32c06e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.494+0000 7ff331ee8640 1 -- 172.21.15.12:0/469696538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff32c102370 msgr2=0x7ff32c074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:28.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.494+0000 7ff331ee8640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff32c102370 0x7ff32c074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.494+0000 7ff331ee8640 1 -- 172.21.15.12:0/469696538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff32c1019d0 msgr2=0x7ff32c074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:28.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.494+0000 7ff331ee8640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff32c1019d0 0x7ff32c074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.494+0000 7ff331ee8640 1 -- 172.21.15.12:0/469696538 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c06ef80 con 0x7ff32c1079d0 2024-09-19T06:48:28.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.494+0000 7ff331ee8640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c1079d0 0x7ff32c06e6c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff32803bf80 tx=0x7ff328003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:28.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.495+0000 7ff3227fc640 1 -- 172.21.15.12:0/469696538 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328045030 con 0x7ff32c1079d0 2024-09-19T06:48:28.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.495+0000 7ff3227fc640 1 -- 172.21.15.12:0/469696538 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff328042e50 con 0x7ff32c1079d0 2024-09-19T06:48:28.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.495+0000 7ff3227fc640 1 -- 172.21.15.12:0/469696538 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3280045a0 con 0x7ff32c1079d0 2024-09-19T06:48:28.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.495+0000 7ff3326e9640 1 -- 172.21.15.12:0/469696538 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c06f210 con 0x7ff32c1079d0 2024-09-19T06:48:28.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.495+0000 7ff3326e9640 1 -- 172.21.15.12:0/469696538 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c1ab3b0 con 0x7ff32c1079d0 2024-09-19T06:48:28.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.500+0000 7ff335d24740 1 Processor -- start 2024-09-19T06:48:28.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.502+0000 7ff3227fc640 1 -- 172.21.15.12:0/469696538 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff328048020 con 0x7ff32c1079d0 2024-09-19T06:48:28.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.502+0000 7ff335d24740 1 -- start start 2024-09-19T06:48:28.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.502+0000 7ff335d24740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b751d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.502+0000 7ff335d24740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 0x5651b751dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.502+0000 7ff335d24740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 0x5651b752a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.502+0000 7ff335d24740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5651b74832f0 con 0x5651b7528520 2024-09-19T06:48:28.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff335d24740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5651b742acf0 con 0x5651b751d780 2024-09-19T06:48:28.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff335d24740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5651b747f2b0 con 0x5651b751ecf0 2024-09-19T06:48:28.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff330ee6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 0x5651b752a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff330ee6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 0x5651b752a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36326/0 (socket says 172.21.15.12:36326) 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff330ee6640 1 -- 172.21.15.12:0/998109268 learned_addr learned my addr 172.21.15.12:0/998109268 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff3316e7640 1 --2- 172.21.15.12:0/998109268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 0x5651b751dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff330ee6640 1 --2- 172.21.15.12:0/998109268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b751d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff3227fc640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff3180a3480 0x7ff3180a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff3316e7640 1 -- 172.21.15.12:0/998109268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 msgr2=0x5651b751d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff3316e7640 1 --2- 172.21.15.12:0/998109268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b751d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff3316e7640 1 -- 172.21.15.12:0/998109268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 msgr2=0x5651b752a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff3316e7640 1 --2- 172.21.15.12:0/998109268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 0x5651b752a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff3316e7640 1 -- 172.21.15.12:0/998109268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b740f3a0 con 0x5651b751d780 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.503+0000 7ff331ee8640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff3180a3480 0x7ff3180a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.504+0000 7ff3227fc640 1 -- 172.21.15.12:0/469696538 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7ff3281017c0 con 0x7ff32c1079d0 2024-09-19T06:48:28.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.504+0000 7ff3316e7640 1 --2- 172.21.15.12:0/998109268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 0x5651b751dbc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff324009a50 tx=0x7ff324009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b2b9da90c4b6826 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:28.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.504+0000 7ff331ee8640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff3180a3480 0x7ff3180a5940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff3280c9f10 tx=0x7ff3280984a0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.504+0000 7ff3177fe640 1 -- 172.21.15.12:0/998109268 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324017070 con 0x5651b751d780 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.504+0000 7ff3177fe640 1 -- 172.21.15.12:0/998109268 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff324013470 con 0x5651b751d780 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.505+0000 7ff335d24740 1 -- 172.21.15.12:0/998109268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 msgr2=0x5651b751dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.505+0000 7ff335d24740 1 --2- 172.21.15.12:0/998109268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 0x5651b751dbc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff324009a50 tx=0x7ff324009f10 comp rx=0 tx=0).stop 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.506+0000 7ff335d24740 1 -- 172.21.15.12:0/998109268 shutdown_connections 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.506+0000 7ff335d24740 1 --2- 172.21.15.12:0/998109268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 0x5651b752a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.506+0000 7ff335d24740 1 --2- 172.21.15.12:0/998109268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 0x5651b751dbc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.506+0000 7ff335d24740 1 --2- 172.21.15.12:0/998109268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b751d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.506+0000 7ff335d24740 1 -- 172.21.15.12:0/998109268 >> 172.21.15.12:0/998109268 conn(0x5651b74e6310 msgr2=0x5651b7519e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.506+0000 7ff335d24740 1 -- 172.21.15.12:0/998109268 shutdown_connections 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.506+0000 7ff335d24740 1 -- 172.21.15.12:0/998109268 wait complete. 2024-09-19T06:48:28.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.507+0000 7ff335d24740 1 -- start start 2024-09-19T06:48:28.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.507+0000 7ff335d24740 1 Processor -- start 2024-09-19T06:48:28.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.507+0000 7ff335d24740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 0x5651b7527f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.507+0000 7ff335d24740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b75251b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff335d24740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 0x5651b7525780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff335d24740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5651b752b270 con 0x5651b7528520 2024-09-19T06:48:28.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff335d24740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5651b743e060 con 0x5651b751d780 2024-09-19T06:48:28.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff335d24740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5651b752b3f0 con 0x5651b751ecf0 2024-09-19T06:48:28.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff335d24740 10 client.0 _ll_register_callbacks cb 0x5651b71918c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:28.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff3316e7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b75251b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff3316e7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b75251b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49128/0 (socket says 172.21.15.12:49128) 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff3316e7640 1 -- 172.21.15.12:0/2646861365 learned_addr learned my addr 172.21.15.12:0/2646861365 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff330ee6640 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 0x5651b7527f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff330ee6640 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 0x5651b7525780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff3316e7640 1 -- 172.21.15.12:0/2646861365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 msgr2=0x5651b7527f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff3316e7640 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 0x5651b7527f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff3316e7640 1 -- 172.21.15.12:0/2646861365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 msgr2=0x5651b7525780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff3316e7640 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 0x5651b7525780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff3316e7640 1 -- 172.21.15.12:0/2646861365 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651b71f43c0 con 0x5651b751ecf0 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff330ee6640 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 0x5651b7525780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff3316e7640 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b75251b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff324004810 tx=0x7ff324006ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cdc122854ea553d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.508+0000 7ff314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:48:28.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff314ff9640 1 -- 172.21.15.12:0/2646861365 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324017040 con 0x5651b751ecf0 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff335d24740 1 -- 172.21.15.12:0/2646861365 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5651b7490860 con 0x5651b751ecf0 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff314ff9640 1 -- 172.21.15.12:0/2646861365 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7ff324012ce0 con 0x5651b751ecf0 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff314ff9640 1 -- 172.21.15.12:0/2646861365 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ff324013470 con 0x5651b751ecf0 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff335d24740 10 client.27184 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff335d24740 1 -- 172.21.15.12:0/2646861365 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5651b7536e30 con 0x5651b751ecf0 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff314ff9640 1 -- 172.21.15.12:0/2646861365 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5651b7490860 con 0x5651b751ecf0 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff314ff9640 1 -- 172.21.15.12:0/2646861365 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7ff324023020 con 0x5651b751ecf0 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff335d24740 10 client.27184 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff335d24740 10 client.27184 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff335d24740 20 client.27184 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff335d24740 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5651b7538570 0x5651b753a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff335d24740 4 client.27184 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:28.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.509+0000 7ff335d24740 1 -- 172.21.15.12:0/2646861365 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651b748ad70 con 0x5651b7538570 2024-09-19T06:48:28.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.510+0000 7ff330ee6640 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5651b7538570 0x5651b753a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.511+0000 7ff330ee6640 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5651b7538570 0x5651b753a9b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=49df66f8ac463fb4 server_cookie=d7b6bcd4dd770254 in_seq=0 out_seq=0 2024-09-19T06:48:28.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.511+0000 7ff314ff9640 10 client.27184 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:48:28.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.511+0000 7ff314ff9640 1 -- 172.21.15.12:0/2646861365 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651b748ad70 con 0x5651b7538570 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff314ff9640 10 client.27184 handle_command_reply: tid=0 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff335d24740 1 client.27184 shutdown 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff335d24740 1 -- 172.21.15.12:0/2646861365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 msgr2=0x5651b75251b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff335d24740 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b75251b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff324004810 tx=0x7ff324006ac0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff335d24740 1 -- 172.21.15.12:0/2646861365 shutdown_connections 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff335d24740 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5651b7538570 0x5651b753a9b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff335d24740 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b7528520 0x5651b7525780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff335d24740 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b75251b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff335d24740 1 --2- 172.21.15.12:0/2646861365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b751d780 0x5651b7527f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff335d24740 1 -- 172.21.15.12:0/2646861365 >> 172.21.15.12:0/2646861365 conn(0x5651b74e6310 msgr2=0x5651b751fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.512+0000 7ff314ff9640 0 client.27184 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:48:28.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.513+0000 7ff335d24740 1 -- 172.21.15.12:0/2646861365 shutdown_connections 2024-09-19T06:48:28.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.513+0000 7ff335d24740 1 -- 172.21.15.12:0/2646861365 wait complete. 2024-09-19T06:48:28.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.513+0000 7ff335d24740 20 client.27184 trim_cache size 0 max 16384 2024-09-19T06:48:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.533+0000 7ff335d24740 1 Processor -- start 2024-09-19T06:48:28.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.533+0000 7ff335d24740 1 -- start start 2024-09-19T06:48:28.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.533+0000 7ff335d24740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751d780 0x5651b75345c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff335d24740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b7514b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff335d24740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b7528520 0x5651b7529910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff335d24740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b3f90 con 0x5651b751d780 2024-09-19T06:48:28.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff335d24740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b5b00 con 0x5651b7528520 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff335d24740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b4660 con 0x5651b751ecf0 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff3316e7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b7514b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff3316e7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b7514b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49134/0 (socket says 172.21.15.12:49134) 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff3316e7640 1 -- 172.21.15.12:0/2613859529 learned_addr learned my addr 172.21.15.12:0/2613859529 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff330ee6640 1 --2- 172.21.15.12:0/2613859529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751d780 0x5651b75345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff330ee6640 1 --2- 172.21.15.12:0/2613859529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b7528520 0x5651b7529910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff3316e7640 1 -- 172.21.15.12:0/2613859529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b7528520 msgr2=0x5651b7529910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff3316e7640 1 --2- 172.21.15.12:0/2613859529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b7528520 0x5651b7529910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff3316e7640 1 -- 172.21.15.12:0/2613859529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751d780 msgr2=0x5651b75345c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff3316e7640 1 --2- 172.21.15.12:0/2613859529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751d780 0x5651b75345c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.534+0000 7ff3316e7640 1 -- 172.21.15.12:0/2613859529 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b7527b20 con 0x5651b751ecf0 2024-09-19T06:48:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.535+0000 7ff3316e7640 1 --2- 172.21.15.12:0/2613859529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b7514b90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff324004700 tx=0x7ff324007fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea533ecdd5371265 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.535+0000 7ff316ffd640 1 -- 172.21.15.12:0/2613859529 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32401c450 con 0x5651b751ecf0 2024-09-19T06:48:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.535+0000 7ff316ffd640 1 -- 172.21.15.12:0/2613859529 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff32401c5f0 con 0x5651b751ecf0 2024-09-19T06:48:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.535+0000 7ff316ffd640 1 -- 172.21.15.12:0/2613859529 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324025440 con 0x5651b751ecf0 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.536+0000 7ff335d24740 1 -- 172.21.15.12:0/2613859529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 msgr2=0x5651b7514b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.536+0000 7ff335d24740 1 --2- 172.21.15.12:0/2613859529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b7514b90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff324004700 tx=0x7ff324007fb0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.536+0000 7ff335d24740 1 -- 172.21.15.12:0/2613859529 shutdown_connections 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.536+0000 7ff335d24740 1 --2- 172.21.15.12:0/2613859529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b7528520 0x5651b7529910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.536+0000 7ff335d24740 1 --2- 172.21.15.12:0/2613859529 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751ecf0 0x5651b7514b90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.536+0000 7ff335d24740 1 --2- 172.21.15.12:0/2613859529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751d780 0x5651b75345c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.536+0000 7ff335d24740 1 -- 172.21.15.12:0/2613859529 >> 172.21.15.12:0/2613859529 conn(0x5651b74e6310 msgr2=0x5651b7523a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.537+0000 7ff335d24740 1 -- 172.21.15.12:0/2613859529 shutdown_connections 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.537+0000 7ff335d24740 1 -- 172.21.15.12:0/2613859529 wait complete. 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.537+0000 7ff335d24740 1 -- start start 2024-09-19T06:48:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.537+0000 7ff335d24740 1 Processor -- start 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff335d24740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751d780 0x5651b753f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff335d24740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751ecf0 0x5651b753f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff335d24740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b7528520 0x5651b753fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff330ee6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751d780 0x5651b753f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff330ee6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751d780 0x5651b753f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49144/0 (socket says 172.21.15.12:49144) 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff330ee6640 1 -- 172.21.15.12:0/581848367 learned_addr learned my addr 172.21.15.12:0/581848367 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b5430 con 0x5651b751ecf0 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b4d60 con 0x5651b7528520 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b1f90 con 0x5651b751d780 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff330ee6640 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b7528520 0x5651b753fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff335d24740 10 client.0 _ll_register_callbacks cb 0x7ff31c0097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff3316e7640 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751ecf0 0x5651b753f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff330ee6640 1 -- 172.21.15.12:0/581848367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b7528520 msgr2=0x5651b753fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff330ee6640 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b7528520 0x5651b753fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff330ee6640 1 -- 172.21.15.12:0/581848367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751ecf0 msgr2=0x5651b753f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff330ee6640 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751ecf0 0x5651b753f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff330ee6640 1 -- 172.21.15.12:0/581848367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651b752f970 con 0x5651b751d780 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.538+0000 7ff3316e7640 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751ecf0 0x5651b753f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.539+0000 7ff330ee6640 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751d780 0x5651b753f270 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff31c005fd0 tx=0x7ff31c012040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b255e39f0050ed14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.539+0000 7ff314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.539+0000 7ff314ff9640 1 -- 172.21.15.12:0/581848367 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c026040 con 0x5651b751d780 2024-09-19T06:48:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.540+0000 7ff314ff9640 1 -- 172.21.15.12:0/581848367 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7ff31c020b40 con 0x5651b751d780 2024-09-19T06:48:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.540+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff32401c5f0 con 0x5651b751d780 2024-09-19T06:48:28.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff314ff9640 1 -- 172.21.15.12:0/581848367 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ff31c005020 con 0x5651b751d780 2024-09-19T06:48:28.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff335d24740 10 client.27190 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:28.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5651b7530cb0 con 0x5651b751d780 2024-09-19T06:48:28.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff314ff9640 1 -- 172.21.15.12:0/581848367 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff31c0047a0 con 0x5651b751d780 2024-09-19T06:48:28.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff314ff9640 1 -- 172.21.15.12:0/581848367 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7ff31c029050 con 0x5651b751d780 2024-09-19T06:48:28.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff335d24740 10 client.27190 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:28.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff335d24740 10 client.27190 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:48:28.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff335d24740 20 client.27190 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff335d24740 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5651b75a3250 0x5651b75a5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff335d24740 4 client.27190 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.541+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff32401c5f0 con 0x5651b75a3250 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.542+0000 7ff3316e7640 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5651b75a3250 0x5651b75a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.542+0000 7ff314ff9640 10 client.27190 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.542+0000 7ff3316e7640 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5651b75a3250 0x5651b75a5640 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a9b36b57dde877 server_cookie=439d24f97559a893 in_seq=0 out_seq=0 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.542+0000 7ff314ff9640 1 -- 172.21.15.12:0/581848367 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff32401c5f0 con 0x5651b75a3250 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.542+0000 7ff314ff9640 10 client.27190 handle_command_reply: tid=0 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.542+0000 7ff335d24740 1 client.27190 shutdown 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751d780 msgr2=0x5651b753f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751d780 0x5651b753f270 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff31c005fd0 tx=0x7ff31c012040 comp rx=0 tx=0).stop 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 shutdown_connections 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5651b75a3250 0x5651b75a5640 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651b7528520 0x5651b753fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651b751ecf0 0x5651b753f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 1 --2- 172.21.15.12:0/581848367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5651b751d780 0x5651b753f270 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 >> 172.21.15.12:0/581848367 conn(0x5651b74e6310 msgr2=0x5651b7526a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff314ff9640 0 client.27190 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 shutdown_connections 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 1 -- 172.21.15.12:0/581848367 wait complete. 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.543+0000 7ff335d24740 20 client.27190 trim_cache size 0 max 16384 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:48:28.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.544+0000 7ff3326e9640 1 -- 172.21.15.12:0/469696538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff3180a3480 msgr2=0x7ff3180a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:28.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.544+0000 7ff3326e9640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff3180a3480 0x7ff3180a5940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff3280c9f10 tx=0x7ff3280984a0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.544+0000 7ff3326e9640 1 -- 172.21.15.12:0/469696538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c1079d0 msgr2=0x7ff32c06e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:28.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.544+0000 7ff3326e9640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c1079d0 0x7ff32c06e6c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff32803bf80 tx=0x7ff328003ba0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.545+0000 7ff3326e9640 1 -- 172.21.15.12:0/469696538 shutdown_connections 2024-09-19T06:48:28.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.545+0000 7ff3326e9640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff3180a3480 0x7ff3180a5940 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.545+0000 7ff3326e9640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff32c1079d0 0x7ff32c06e6c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.545+0000 7ff3326e9640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff32c102370 0x7ff32c074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.545+0000 7ff3326e9640 1 --2- 172.21.15.12:0/469696538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff32c1019d0 0x7ff32c074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:28.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.545+0000 7ff3326e9640 1 -- 172.21.15.12:0/469696538 >> 172.21.15.12:0/469696538 conn(0x7ff32c0fd710 msgr2=0x7ff32c0fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:28.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.545+0000 7ff3326e9640 1 -- 172.21.15.12:0/469696538 shutdown_connections 2024-09-19T06:48:28.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:28.545+0000 7ff3326e9640 1 -- 172.21.15.12:0/469696538 wait complete. 2024-09-19T06:48:29.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:29 smithi173 ceph-mon[35349]: pgmap v257: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 3.5 MiB/s wr, 359 op/s 2024-09-19T06:48:29.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:29 smithi012 ceph-mon[30937]: pgmap v257: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 3.5 MiB/s wr, 359 op/s 2024-09-19T06:48:29.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:29 smithi016 ceph-mon[34911]: pgmap v257: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 3.5 MiB/s wr, 359 op/s 2024-09-19T06:48:29.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:48:30.157 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.715+0000 7fabb12f2640 1 -- 172.21.15.12:0/972387531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabac10e450 msgr2=0x7fabac110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.715+0000 7fabb12f2640 1 --2- 172.21.15.12:0/972387531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabac10e450 0x7fabac110840 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7faba4009ca0 tx=0x7faba402a950 comp rx=0 tx=0).stop 2024-09-19T06:48:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.715+0000 7fabb12f2640 1 -- 172.21.15.12:0/972387531 shutdown_connections 2024-09-19T06:48:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.715+0000 7fabb12f2640 1 --2- 172.21.15.12:0/972387531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabac10e450 0x7fabac110840 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.715+0000 7fabb12f2640 1 --2- 172.21.15.12:0/972387531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac074e30 0x7fabac10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.715+0000 7fabb12f2640 1 --2- 172.21.15.12:0/972387531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabac074510 0x7fabac0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.715+0000 7fabb12f2640 1 -- 172.21.15.12:0/972387531 >> 172.21.15.12:0/972387531 conn(0x7fabac0fd8f0 msgr2=0x7fabac0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.715+0000 7fabb12f2640 1 -- 172.21.15.12:0/972387531 shutdown_connections 2024-09-19T06:48:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.715+0000 7fabb12f2640 1 -- 172.21.15.12:0/972387531 wait complete. 2024-09-19T06:48:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.716+0000 7fabb12f2640 1 Processor -- start 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.716+0000 7fabb12f2640 1 -- start start 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.716+0000 7fabb12f2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac074510 0x7fabac19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.716+0000 7fabb12f2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabac074e30 0x7fabac19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.716+0000 7fabb12f2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabac10e450 0x7fabac19f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.716+0000 7fabb12f2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabac114170 con 0x7fabac074e30 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.716+0000 7fabb12f2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fabac113ff0 con 0x7fabac074510 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.716+0000 7fabb12f2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fabac1142f0 con 0x7fabac10e450 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabaaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac074510 0x7fabac19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabaaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac074510 0x7fabac19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38564/0 (socket says 172.21.15.12:38564) 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabaa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabac074e30 0x7fabac19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabab7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabac10e450 0x7fabac19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabaaffd640 1 -- 172.21.15.12:0/243862876 learned_addr learned my addr 172.21.15.12:0/243862876 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:30.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabab7fe640 1 -- 172.21.15.12:0/243862876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac074510 msgr2=0x7fabac19a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabab7fe640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac074510 0x7fabac19a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabab7fe640 1 -- 172.21.15.12:0/243862876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabac074e30 msgr2=0x7fabac19ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabab7fe640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabac074e30 0x7fabac19ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabab7fe640 1 -- 172.21.15.12:0/243862876 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac19f6e0 con 0x7fabac10e450 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabaaffd640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac074510 0x7fabac19a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fabab7fe640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabac10e450 0x7fabac19f000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faba402ae70 tx=0x7faba402f630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.717+0000 7fab93fff640 1 -- 172.21.15.12:0/243862876 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4034040 con 0x7fabac10e450 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.718+0000 7fabb12f2640 1 -- 172.21.15.12:0/243862876 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabac19f970 con 0x7fabac10e450 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.718+0000 7fab93fff640 1 -- 172.21.15.12:0/243862876 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faba4030920 con 0x7fabac10e450 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.718+0000 7fab93fff640 1 -- 172.21.15.12:0/243862876 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4004720 con 0x7fabac10e450 2024-09-19T06:48:30.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.718+0000 7fabb12f2640 1 -- 172.21.15.12:0/243862876 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabac1a72b0 con 0x7fabac10e450 2024-09-19T06:48:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.721+0000 7fab93fff640 1 -- 172.21.15.12:0/243862876 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7faba4037020 con 0x7fabac10e450 2024-09-19T06:48:30.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.722+0000 7fab93fff640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab940a33b0 0x7fab940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.722+0000 7fabaaffd640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab940a33b0 0x7fab940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.722+0000 7fab93fff640 1 -- 172.21.15.12:0/243862876 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7faba40f0b40 con 0x7fabac10e450 2024-09-19T06:48:30.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.723+0000 7fabaaffd640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab940a33b0 0x7fab940a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0104e0 tx=0x7fab9c00b410 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.723+0000 7fabb36cb740 1 Processor -- start 2024-09-19T06:48:30.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.723+0000 7fabb36cb740 1 -- start start 2024-09-19T06:48:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18ccb40 0x5621f18cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18cb5d0 0x5621f18cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 0x5621f18d8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabb36cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5621f18312f0 con 0x5621f18d6370 2024-09-19T06:48:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabb36cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5621f17d8cf0 con 0x5621f18ccb40 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabb36cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5621f182d2b0 con 0x5621f18cb5d0 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 0x5621f18d8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabaaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18ccb40 0x5621f18cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 0x5621f18d8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46982/0 (socket says 172.21.15.12:46982) 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabaa7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18cb5d0 0x5621f18cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabab7fe640 1 -- 172.21.15.12:0/2178769811 learned_addr learned my addr 172.21.15.12:0/2178769811 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabaaffd640 1 -- 172.21.15.12:0/2178769811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18cb5d0 msgr2=0x5621f18cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabaaffd640 1 --2- 172.21.15.12:0/2178769811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18cb5d0 0x5621f18cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabaaffd640 1 -- 172.21.15.12:0/2178769811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 msgr2=0x5621f18d8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabaaffd640 1 --2- 172.21.15.12:0/2178769811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 0x5621f18d8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.724+0000 7fabaaffd640 1 -- 172.21.15.12:0/2178769811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621f17bd3a0 con 0x5621f18ccb40 2024-09-19T06:48:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.725+0000 7fabaaffd640 1 --2- 172.21.15.12:0/2178769811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18ccb40 0x5621f18cb090 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00be70 tx=0x7fab9c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=830e0e3f135cad2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.725+0000 7fab917fa640 1 -- 172.21.15.12:0/2178769811 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c01c8c0 con 0x5621f18ccb40 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.725+0000 7fab917fa640 1 -- 172.21.15.12:0/2178769811 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab9c027480 con 0x5621f18ccb40 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.725+0000 7fab917fa640 1 -- 172.21.15.12:0/2178769811 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c01e680 con 0x5621f18ccb40 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 -- 172.21.15.12:0/2178769811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18ccb40 msgr2=0x5621f18cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 --2- 172.21.15.12:0/2178769811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18ccb40 0x5621f18cb090 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00be70 tx=0x7fab9c013000 comp rx=0 tx=0).stop 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 -- 172.21.15.12:0/2178769811 shutdown_connections 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 --2- 172.21.15.12:0/2178769811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 0x5621f18d8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 --2- 172.21.15.12:0/2178769811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18cb5d0 0x5621f18cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 --2- 172.21.15.12:0/2178769811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18ccb40 0x5621f18cb090 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 -- 172.21.15.12:0/2178769811 >> 172.21.15.12:0/2178769811 conn(0x5621f1894310 msgr2=0x5621f18c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 -- 172.21.15.12:0/2178769811 shutdown_connections 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 -- 172.21.15.12:0/2178769811 wait complete. 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 -- start start 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.726+0000 7fabb36cb740 1 Processor -- start 2024-09-19T06:48:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 0x5621f18d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabb36cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5621f18d9070 con 0x5621f18cb5d0 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabb36cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5621f17ec060 con 0x5621f18d6370 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabaa7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabaa7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:47298/0 (socket says 172.21.15.12:47298) 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabaa7fc640 1 -- 172.21.15.12:0/2681973343 learned_addr learned my addr 172.21.15.12:0/2681973343 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabab7fe640 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 0x5621f18d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabb36cb740 1 -- 172.21.15.12:0/2681973343 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5621f18d91f0 con 0x5621f18ccb40 2024-09-19T06:48:30.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.727+0000 7fabb36cb740 10 client.0 _ll_register_callbacks cb 0x5621f153f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:30.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.728+0000 7fabaaffd640 1 -- 172.21.15.12:0/2681973343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 msgr2=0x5621f18d3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.728+0000 7fabaaffd640 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.728+0000 7fabaaffd640 1 -- 172.21.15.12:0/2681973343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 msgr2=0x5621f18d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.728+0000 7fabaaffd640 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 0x5621f18d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.728+0000 7fabaaffd640 1 -- 172.21.15.12:0/2681973343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621f15a23c0 con 0x5621f18cb5d0 2024-09-19T06:48:30.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.728+0000 7fabab7fe640 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 0x5621f18d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:30.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.728+0000 7fabaa7fc640 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:30.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.728+0000 7fabaaffd640 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d5d50 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fab9c01c710 tx=0x7fab9c027860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0c53a77661a089 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.729+0000 7fab8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:30.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.730+0000 7fab8eff5640 1 -- 172.21.15.12:0/2681973343 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c038060 con 0x5621f18cb5d0 2024-09-19T06:48:30.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.730+0000 7fab8eff5640 1 -- 172.21.15.12:0/2681973343 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7fab9c011d70 con 0x5621f18cb5d0 2024-09-19T06:48:30.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.730+0000 7fabb36cb740 1 -- 172.21.15.12:0/2681973343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab9c027480 con 0x5621f18cb5d0 2024-09-19T06:48:30.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fab8eff5640 1 -- 172.21.15.12:0/2681973343 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fab9c0279d0 con 0x5621f18cb5d0 2024-09-19T06:48:30.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fabb36cb740 10 client.17814 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:30.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fabb36cb740 1 -- 172.21.15.12:0/2681973343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5621f18e4ad0 con 0x5621f18cb5d0 2024-09-19T06:48:30.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fab8eff5640 1 -- 172.21.15.12:0/2681973343 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab9c01cda0 con 0x5621f18cb5d0 2024-09-19T06:48:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fab8eff5640 1 -- 172.21.15.12:0/2681973343 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7fab9c0339b0 con 0x5621f18cb5d0 2024-09-19T06:48:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fabb36cb740 10 client.17814 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fabb36cb740 10 client.17814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fabb36cb740 20 client.17814 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fabb36cb740 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5621f18e5ed0 0x5621f18e82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fabb36cb740 4 client.17814 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.731+0000 7fabb36cb740 1 -- 172.21.15.12:0/2681973343 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fab9c027480 con 0x5621f18e5ed0 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.732+0000 7fabaa7fc640 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5621f18e5ed0 0x5621f18e82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.732+0000 7fabaa7fc640 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5621f18e5ed0 0x5621f18e82c0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f3ed52c2f41d341 server_cookie=805d033db38db77d in_seq=0 out_seq=0 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.732+0000 7fab8eff5640 10 client.17814 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fab8eff5640 1 -- 172.21.15.12:0/2681973343 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fab9c027480 con 0x5621f18e5ed0 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fab8eff5640 10 client.17814 handle_command_reply: tid=0 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fabb36cb740 1 client.17814 shutdown 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fabb36cb740 1 -- 172.21.15.12:0/2681973343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 msgr2=0x5621f18d5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fabb36cb740 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d5d50 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fab9c01c710 tx=0x7fab9c027860 comp rx=0 tx=0).stop 2024-09-19T06:48:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fabb36cb740 1 -- 172.21.15.12:0/2681973343 shutdown_connections 2024-09-19T06:48:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fabb36cb740 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5621f18e5ed0 0x5621f18e82c0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fabb36cb740 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 0x5621f18d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fabb36cb740 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fabb36cb740 1 --2- 172.21.15.12:0/2681973343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d5d50 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fab8eff5640 0 client.17814 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.733+0000 7fabb36cb740 1 -- 172.21.15.12:0/2681973343 >> 172.21.15.12:0/2681973343 conn(0x5621f1894310 msgr2=0x5621f18cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.734+0000 7fabb36cb740 1 -- 172.21.15.12:0/2681973343 shutdown_connections 2024-09-19T06:48:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.734+0000 7fabb36cb740 1 -- 172.21.15.12:0/2681973343 wait complete. 2024-09-19T06:48:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.734+0000 7fabb36cb740 20 client.17814 trim_cache size 0 max 16384 2024-09-19T06:48:30.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.754+0000 7fabb36cb740 1 Processor -- start 2024-09-19T06:48:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.754+0000 7fabb36cb740 1 -- start start 2024-09-19T06:48:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18cb5d0 0x5621f18e2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 0x5621f18ed950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabb36cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabac1afe40 con 0x5621f18d6370 2024-09-19T06:48:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabb36cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fabac1b19b0 con 0x5621f18cb5d0 2024-09-19T06:48:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabb36cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fabac1b0510 con 0x5621f18ccb40 2024-09-19T06:48:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 0x5621f18ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabaaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18cb5d0 0x5621f18e2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 0x5621f18ed950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47000/0 (socket says 172.21.15.12:47000) 2024-09-19T06:48:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabab7fe640 1 -- 172.21.15.12:0/1480022971 learned_addr learned my addr 172.21.15.12:0/1480022971 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabaa7fc640 1 --2- 172.21.15.12:0/1480022971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabaaffd640 1 -- 172.21.15.12:0/1480022971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 msgr2=0x5621f18d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabaaffd640 1 --2- 172.21.15.12:0/1480022971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabaaffd640 1 -- 172.21.15.12:0/1480022971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 msgr2=0x5621f18ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabaaffd640 1 --2- 172.21.15.12:0/1480022971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 0x5621f18ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabaaffd640 1 -- 172.21.15.12:0/1480022971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621f18c8960 con 0x5621f18cb5d0 2024-09-19T06:48:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.755+0000 7fabaaffd640 1 --2- 172.21.15.12:0/1480022971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18cb5d0 0x5621f18e2310 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00be70 tx=0x7fab9c01e4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76223680a7c985b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.756+0000 7fab90ff9640 1 -- 172.21.15.12:0/1480022971 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c038040 con 0x5621f18cb5d0 2024-09-19T06:48:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.756+0000 7fab90ff9640 1 -- 172.21.15.12:0/1480022971 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab9c005850 con 0x5621f18cb5d0 2024-09-19T06:48:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.756+0000 7fab90ff9640 1 -- 172.21.15.12:0/1480022971 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c042080 con 0x5621f18cb5d0 2024-09-19T06:48:30.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.756+0000 7fabb36cb740 1 -- 172.21.15.12:0/1480022971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18cb5d0 msgr2=0x5621f18e2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.756+0000 7fabb36cb740 1 --2- 172.21.15.12:0/1480022971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18cb5d0 0x5621f18e2310 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00be70 tx=0x7fab9c01e4a0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.756+0000 7fabb36cb740 1 -- 172.21.15.12:0/1480022971 shutdown_connections 2024-09-19T06:48:30.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.756+0000 7fabb36cb740 1 --2- 172.21.15.12:0/1480022971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18d6370 0x5621f18ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.756+0000 7fabb36cb740 1 --2- 172.21.15.12:0/1480022971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.756+0000 7fabb36cb740 1 --2- 172.21.15.12:0/1480022971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18cb5d0 0x5621f18e2310 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.756+0000 7fabb36cb740 1 -- 172.21.15.12:0/1480022971 >> 172.21.15.12:0/1480022971 conn(0x5621f1894310 msgr2=0x5621f18d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.757+0000 7fabb36cb740 1 -- 172.21.15.12:0/1480022971 shutdown_connections 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.757+0000 7fabb36cb740 1 -- 172.21.15.12:0/1480022971 wait complete. 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.757+0000 7fabb36cb740 1 -- start start 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.757+0000 7fabb36cb740 1 Processor -- start 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.757+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.757+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabb36cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 0x5621f194e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabb36cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabac1b12e0 con 0x5621f18cb5d0 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabb36cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fabac1b0c10 con 0x5621f18d6370 2024-09-19T06:48:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabb36cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fabac1ade40 con 0x5621f18ccb40 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabb36cb740 10 client.0 _ll_register_callbacks cb 0x7fab9c028f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47010/0 (socket says 172.21.15.12:47010) 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaaffd640 1 -- 172.21.15.12:0/601361594 learned_addr learned my addr 172.21.15.12:0/601361594 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabab7fe640 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 0x5621f194e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaa7fc640 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaaffd640 1 -- 172.21.15.12:0/601361594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 msgr2=0x5621f18d9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaaffd640 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaaffd640 1 -- 172.21.15.12:0/601361594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 msgr2=0x5621f194e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaaffd640 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 0x5621f194e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaaffd640 1 -- 172.21.15.12:0/601361594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621f18ce120 con 0x5621f18cb5d0 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaa7fc640 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabab7fe640 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 0x5621f194e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabaaffd640 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d9540 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fab9c011f80 tx=0x7fab9c004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7019612ae410d2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fab8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fab8eff5640 1 -- 172.21.15.12:0/601361594 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c042070 con 0x5621f18cb5d0 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fab8eff5640 1 -- 172.21.15.12:0/601361594 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7fab9c01e9f0 con 0x5621f18cb5d0 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.758+0000 7fabb36cb740 1 -- 172.21.15.12:0/601361594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab9c005850 con 0x5621f18cb5d0 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fab8eff5640 1 -- 172.21.15.12:0/601361594 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fab9c038070 con 0x5621f18cb5d0 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fabb36cb740 10 client.17820 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fabb36cb740 1 -- 172.21.15.12:0/601361594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5621f194fe00 con 0x5621f18cb5d0 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fab8eff5640 1 -- 172.21.15.12:0/601361594 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab9c005850 con 0x5621f18cb5d0 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fab8eff5640 1 -- 172.21.15.12:0/601361594 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7fab9c033420 con 0x5621f18cb5d0 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fabb36cb740 10 client.17820 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fabb36cb740 10 client.17820 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fabb36cb740 20 client.17820 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fabb36cb740 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5621f1950460 0x5621f1952880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fabb36cb740 4 client.17820 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:48:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.759+0000 7fabb36cb740 1 -- 172.21.15.12:0/601361594 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5621f183e860 con 0x5621f1950460 2024-09-19T06:48:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.760+0000 7fabaa7fc640 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5621f1950460 0x5621f1952880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.760+0000 7fabaa7fc640 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5621f1950460 0x5621f1952880 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b153ebe33410298 server_cookie=217c62dad48b084e in_seq=0 out_seq=0 2024-09-19T06:48:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.760+0000 7fab8eff5640 10 client.17820 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:30.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.763+0000 7fab8eff5640 1 -- 172.21.15.12:0/601361594 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5621f183e860 con 0x5621f1950460 2024-09-19T06:48:30.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.763+0000 7fab8eff5640 10 client.17820 handle_command_reply: tid=0 2024-09-19T06:48:30.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 client.17820 shutdown 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 -- 172.21.15.12:0/601361594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 msgr2=0x5621f18d9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d9540 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fab9c011f80 tx=0x7fab9c004680 comp rx=0 tx=0).stop 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 -- 172.21.15.12:0/601361594 shutdown_connections 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5621f1950460 0x5621f1952880 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5621f18d6370 0x5621f194e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fab8eff5640 0 client.17820 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5621f18ccb40 0x5621f18d9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 --2- 172.21.15.12:0/601361594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5621f18cb5d0 0x5621f18d9540 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 -- 172.21.15.12:0/601361594 >> 172.21.15.12:0/601361594 conn(0x5621f1894310 msgr2=0x5621f18d4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 -- 172.21.15.12:0/601361594 shutdown_connections 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 1 -- 172.21.15.12:0/601361594 wait complete. 2024-09-19T06:48:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.764+0000 7fabb36cb740 20 client.17820 trim_cache size 0 max 16384 2024-09-19T06:48:30.769 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:48:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 -- 172.21.15.12:0/243862876 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab940a33b0 msgr2=0x7fab940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab940a33b0 0x7fab940a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0104e0 tx=0x7fab9c00b410 comp rx=0 tx=0).stop 2024-09-19T06:48:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 -- 172.21.15.12:0/243862876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabac10e450 msgr2=0x7fabac19f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabac10e450 0x7fabac19f000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faba402ae70 tx=0x7faba402f630 comp rx=0 tx=0).stop 2024-09-19T06:48:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 -- 172.21.15.12:0/243862876 shutdown_connections 2024-09-19T06:48:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fab940a33b0 0x7fab940a5870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabac10e450 0x7fabac19f000 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabac074e30 0x7fabac19ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 --2- 172.21.15.12:0/243862876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac074510 0x7fabac19a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 -- 172.21.15.12:0/243862876 >> 172.21.15.12:0/243862876 conn(0x7fabac0fd8f0 msgr2=0x7fabac0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 -- 172.21.15.12:0/243862876 shutdown_connections 2024-09-19T06:48:30.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:30.765+0000 7fabb12f2640 1 -- 172.21.15.12:0/243862876 wait complete. 2024-09-19T06:48:30.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 465.0 s, 2010.8 tps, lat 49.372 ms stddev 54.595 2024-09-19T06:48:31.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:31 smithi173 ceph-mon[35349]: pgmap v258: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.9 MiB/s wr, 777 op/s 2024-09-19T06:48:31.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:31 smithi012 ceph-mon[30937]: pgmap v258: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.9 MiB/s wr, 777 op/s 2024-09-19T06:48:31.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:31 smithi016 ceph-mon[34911]: pgmap v258: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.9 MiB/s wr, 777 op/s 2024-09-19T06:48:33.064 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:48:33.064 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:48:33.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:33 smithi012 ceph-mon[30937]: pgmap v259: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 772 op/s 2024-09-19T06:48:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:33.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:33 smithi173 ceph-mon[35349]: pgmap v259: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 772 op/s 2024-09-19T06:48:33.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:33 smithi016 ceph-mon[34911]: pgmap v259: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 772 op/s 2024-09-19T06:48:34.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.076+0000 7f15dbfff640 1 -- 172.21.15.12:0/6061605 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc030e30 con 0x7f15e4101430 2024-09-19T06:48:34.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.077+0000 7f15eb840640 1 -- 172.21.15.12:0/6061605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e4101430 msgr2=0x7f15e410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:34.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.077+0000 7f15eb840640 1 --2- 172.21.15.12:0/6061605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e4101430 0x7f15e410d960 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009c10 tx=0x7f15dc02a6e0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.077+0000 7f15eb840640 1 -- 172.21.15.12:0/6061605 shutdown_connections 2024-09-19T06:48:34.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.077+0000 7f15eb840640 1 --2- 172.21.15.12:0/6061605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e4101430 0x7f15e410d960 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.077+0000 7f15eb840640 1 --2- 172.21.15.12:0/6061605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4100a90 0x7f15e4100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.078+0000 7f15eb840640 1 --2- 172.21.15.12:0/6061605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15e4106a90 0x7f15e4106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.078+0000 7f15eb840640 1 -- 172.21.15.12:0/6061605 >> 172.21.15.12:0/6061605 conn(0x7f15e40fc7d0 msgr2=0x7f15e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:34.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.079+0000 7f15eb840640 1 -- 172.21.15.12:0/6061605 shutdown_connections 2024-09-19T06:48:34.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.079+0000 7f15eb840640 1 -- 172.21.15.12:0/6061605 wait complete. 2024-09-19T06:48:34.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.080+0000 7f15eb840640 1 Processor -- start 2024-09-19T06:48:34.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.080+0000 7f15eb840640 1 -- start start 2024-09-19T06:48:34.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.081+0000 7f15eb840640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15e4100a90 0x7f15e410b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.081+0000 7f15eb840640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e4101430 0x7f15e410b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.081+0000 7f15e95dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15e4100a90 0x7f15e410b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.081+0000 7f15e95dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15e4100a90 0x7f15e410b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38634/0 (socket says 172.21.15.12:38634) 2024-09-19T06:48:34.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.081+0000 7f15e95dc640 1 -- 172.21.15.12:0/201045721 learned_addr learned my addr 172.21.15.12:0/201045721 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:34.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.081+0000 7f15eb840640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4106a90 0x7f15e41a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e4101430 0x7f15e410b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f15e410f9f0 con 0x7f15e4101430 2024-09-19T06:48:34.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f15e410f870 con 0x7f15e4100a90 2024-09-19T06:48:34.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f15e410fb70 con 0x7f15e4106a90 2024-09-19T06:48:34.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15e9ddd640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4106a90 0x7f15e41a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15e95dc640 1 -- 172.21.15.12:0/201045721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4106a90 msgr2=0x7f15e41a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:34.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15e95dc640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4106a90 0x7f15e41a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15e95dc640 1 -- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e4101430 msgr2=0x7f15e410b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:34.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15e95dc640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e4101430 0x7f15e410b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15e95dc640 1 -- 172.21.15.12:0/201045721 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e41a4a20 con 0x7f15e4100a90 2024-09-19T06:48:34.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15e9ddd640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4106a90 0x7f15e41a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:34.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.082+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e4101430 0x7f15e410b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:34.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.083+0000 7f15e95dc640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15e4100a90 0x7f15e410b340 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f15e000c920 tx=0x7f15e000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:34.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.083+0000 7f15da7fc640 1 -- 172.21.15.12:0/201045721 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0007c70 con 0x7f15e4100a90 2024-09-19T06:48:34.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.083+0000 7f15da7fc640 1 -- 172.21.15.12:0/201045721 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15e0007e10 con 0x7f15e4100a90 2024-09-19T06:48:34.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.083+0000 7f15da7fc640 1 -- 172.21.15.12:0/201045721 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0007c70 con 0x7f15e4100a90 2024-09-19T06:48:34.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.084+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e41a4d10 con 0x7f15e4100a90 2024-09-19T06:48:34.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.084+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e41ab3d0 con 0x7f15e4100a90 2024-09-19T06:48:34.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.088+0000 7f15edc19740 1 Processor -- start 2024-09-19T06:48:34.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.088+0000 7f15da7fc640 1 -- 172.21.15.12:0/201045721 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f15e000f450 con 0x7f15e4100a90 2024-09-19T06:48:34.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.088+0000 7f15edc19740 1 -- start start 2024-09-19T06:48:34.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.089+0000 7f15edc19740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 0x55fa63f3df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.089+0000 7f15edc19740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3e480 0x55fa63f48800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.089+0000 7f15edc19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 0x55fa63f4b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.089+0000 7f15edc19740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fa63ea3280 con 0x55fa63f3db60 2024-09-19T06:48:34.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.089+0000 7f15edc19740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fa63e4ab10 con 0x55fa63f48d40 2024-09-19T06:48:34.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.089+0000 7f15edc19740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fa63e9f240 con 0x55fa63f3e480 2024-09-19T06:48:34.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.089+0000 7f15da7fc640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15d00a37b0 0x7f15d00a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e8ddb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 0x55fa63f4b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e8ddb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 0x55fa63f4b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38646/0 (socket says 172.21.15.12:38646) 2024-09-19T06:48:34.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e8ddb640 1 -- 172.21.15.12:0/963015293 learned_addr learned my addr 172.21.15.12:0/963015293 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:34.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e9ddd640 1 --2- 172.21.15.12:0/963015293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 0x55fa63f3df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15da7fc640 1 -- 172.21.15.12:0/201045721 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f15e0007a70 con 0x7f15e4100a90 2024-09-19T06:48:34.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e8ddb640 1 -- 172.21.15.12:0/963015293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3e480 msgr2=0x55fa63f48800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:48:34.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/963015293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3e480 0x55fa63f48800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e8ddb640 1 -- 172.21.15.12:0/963015293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 msgr2=0x55fa63f3df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:34.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/963015293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 0x55fa63f3df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e8ddb640 1 -- 172.21.15.12:0/963015293 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa63e571f0 con 0x55fa63f48d40 2024-09-19T06:48:34.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e9ddd640 1 --2- 172.21.15.12:0/963015293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 0x55fa63f3df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:34.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.090+0000 7f15e9ddd640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15d00a37b0 0x7f15d00a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.091+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/963015293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 0x55fa63f4b130 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f15d40114f0 tx=0x7f15d40119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eea0e4414f749cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:34.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.091+0000 7f15cf7fe640 1 -- 172.21.15.12:0/963015293 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d401e070 con 0x55fa63f48d40 2024-09-19T06:48:34.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.091+0000 7f15cf7fe640 1 -- 172.21.15.12:0/963015293 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d40035f0 con 0x55fa63f48d40 2024-09-19T06:48:34.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.091+0000 7f15cf7fe640 1 -- 172.21.15.12:0/963015293 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d400f820 con 0x55fa63f48d40 2024-09-19T06:48:34.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.091+0000 7f15e9ddd640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15d00a37b0 0x7f15d00a5c70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f15dc004af0 tx=0x7f15dc005fd0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:34.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.092+0000 7f15edc19740 1 -- 172.21.15.12:0/963015293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 msgr2=0x55fa63f4b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:34.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.092+0000 7f15edc19740 1 --2- 172.21.15.12:0/963015293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 0x55fa63f4b130 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f15d40114f0 tx=0x7f15d40119b0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.092+0000 7f15edc19740 1 -- 172.21.15.12:0/963015293 shutdown_connections 2024-09-19T06:48:34.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.092+0000 7f15edc19740 1 --2- 172.21.15.12:0/963015293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 0x55fa63f4b130 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.092+0000 7f15edc19740 1 --2- 172.21.15.12:0/963015293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3e480 0x55fa63f48800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.092+0000 7f15edc19740 1 --2- 172.21.15.12:0/963015293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 0x55fa63f3df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.092+0000 7f15edc19740 1 -- 172.21.15.12:0/963015293 >> 172.21.15.12:0/963015293 conn(0x55fa63f3a0f0 msgr2=0x55fa63f3a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:34.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.093+0000 7f15edc19740 1 -- 172.21.15.12:0/963015293 shutdown_connections 2024-09-19T06:48:34.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.093+0000 7f15edc19740 1 -- 172.21.15.12:0/963015293 wait complete. 2024-09-19T06:48:34.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.093+0000 7f15edc19740 1 -- start start 2024-09-19T06:48:34.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.093+0000 7f15edc19740 1 Processor -- start 2024-09-19T06:48:34.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15edc19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3db60 0x55fa63f45d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15edc19740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 0x55fa63f46240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15edc19740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 0x55fa63f46780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15edc19740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fa63f4b910 con 0x55fa63f3e480 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15edc19740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fa63e5df10 con 0x55fa63f3db60 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15edc19740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fa63f4ba90 con 0x55fa63f48d40 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15edc19740 10 client.0 _ll_register_callbacks cb 0x55fa63e26a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15e95dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3db60 0x55fa63f45d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15e95dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3db60 0x55fa63f45d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38650/0 (socket says 172.21.15.12:38650) 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15e95dc640 1 -- 172.21.15.12:0/456076982 learned_addr learned my addr 172.21.15.12:0/456076982 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15e9ddd640 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 0x55fa63f46780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 0x55fa63f46240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15e95dc640 1 -- 172.21.15.12:0/456076982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 msgr2=0x55fa63f46780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.094+0000 7f15e95dc640 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 0x55fa63f46780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15e95dc640 1 -- 172.21.15.12:0/456076982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 msgr2=0x55fa63f46240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15e95dc640 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 0x55fa63f46240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15e95dc640 1 -- 172.21.15.12:0/456076982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa63c146a0 con 0x55fa63f3db60 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 0x55fa63f46240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15e9ddd640 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 0x55fa63f46780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15e95dc640 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3db60 0x55fa63f45d00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f15e009b2e0 tx=0x7f15e009bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32db504bed7cd16f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15ccff9640 1 -- 172.21.15.12:0/456076982 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e00b3020 con 0x55fa63f3db60 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15edc19740 1 -- 172.21.15.12:0/456076982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15d40035f0 con 0x55fa63f3db60 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15ccff9640 1 -- 172.21.15.12:0/456076982 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f15e00b4220 con 0x55fa63f3db60 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15ccff9640 1 -- 172.21.15.12:0/456076982 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f15e00a3fc0 con 0x55fa63f3db60 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15edc19740 10 client.27251 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.095+0000 7f15edc19740 1 -- 172.21.15.12:0/456076982 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55fa63f57700 con 0x55fa63f3db60 2024-09-19T06:48:34.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.096+0000 7f15ccff9640 1 -- 172.21.15.12:0/456076982 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d40035f0 con 0x55fa63f3db60 2024-09-19T06:48:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.096+0000 7f15ccff9640 1 -- 172.21.15.12:0/456076982 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7f15e009f170 con 0x55fa63f3db60 2024-09-19T06:48:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.096+0000 7f15edc19740 10 client.27251 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.096+0000 7f15edc19740 10 client.27251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.096+0000 7f15edc19740 20 client.27251 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.096+0000 7f15edc19740 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa63f58fd0 0x55fa63f5b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.096+0000 7f15edc19740 4 client.27251 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.096+0000 7f15edc19740 1 -- 172.21.15.12:0/456076982 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa63eb07f0 con 0x55fa63f58fd0 2024-09-19T06:48:34.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.096+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa63f58fd0 0x55fa63f5b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.097+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa63f58fd0 0x55fa63f5b430 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=171742ee93f9bdc7 server_cookie=49111d3ee0eb02c2 in_seq=0 out_seq=0 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.098+0000 7f15ccff9640 10 client.27251 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.099+0000 7f15ccff9640 1 -- 172.21.15.12:0/456076982 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa63eb07f0 con 0x55fa63f58fd0 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.099+0000 7f15ccff9640 10 client.27251 handle_command_reply: tid=0 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.099+0000 7f15edc19740 1 client.27251 shutdown 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.099+0000 7f15edc19740 1 -- 172.21.15.12:0/456076982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3db60 msgr2=0x55fa63f45d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.099+0000 7f15edc19740 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3db60 0x55fa63f45d00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f15e009b2e0 tx=0x7f15e009bb10 comp rx=0 tx=0).stop 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.100+0000 7f15edc19740 1 -- 172.21.15.12:0/456076982 shutdown_connections 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.100+0000 7f15edc19740 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa63f58fd0 0x55fa63f5b430 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.100+0000 7f15edc19740 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 0x55fa63f46780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.100+0000 7f15edc19740 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 0x55fa63f46240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.100+0000 7f15edc19740 1 --2- 172.21.15.12:0/456076982 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3db60 0x55fa63f45d00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.100+0000 7f15edc19740 1 -- 172.21.15.12:0/456076982 >> 172.21.15.12:0/456076982 conn(0x55fa63f3a0f0 msgr2=0x55fa63f3fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:34.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.100+0000 7f15ccff9640 0 client.27251 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:34.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.100+0000 7f15edc19740 1 -- 172.21.15.12:0/456076982 shutdown_connections 2024-09-19T06:48:34.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.100+0000 7f15edc19740 1 -- 172.21.15.12:0/456076982 wait complete. 2024-09-19T06:48:34.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.100+0000 7f15edc19740 20 client.27251 trim_cache size 0 max 16384 2024-09-19T06:48:34.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.128+0000 7f15edc19740 1 Processor -- start 2024-09-19T06:48:34.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.129+0000 7f15edc19740 1 -- start start 2024-09-19T06:48:34.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.129+0000 7f15edc19740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3db60 0x55fa63f3fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.129+0000 7f15edc19740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 0x55fa63f60d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.129+0000 7f15edc19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 0x55fa63f61280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.129+0000 7f15edc19740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b4150 con 0x55fa63f3e480 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.129+0000 7f15edc19740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b5cc0 con 0x55fa63f48d40 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.129+0000 7f15edc19740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b4820 con 0x55fa63f3db60 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.129+0000 7f15e95dc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3db60 0x55fa63f3fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.130+0000 7f15e8ddb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 0x55fa63f60d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.130+0000 7f15e8ddb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 0x55fa63f60d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47064/0 (socket says 172.21.15.12:47064) 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.130+0000 7f15e8ddb640 1 -- 172.21.15.12:0/3571334902 learned_addr learned my addr 172.21.15.12:0/3571334902 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.130+0000 7f15e95dc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3db60 0x55fa63f3fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:47330/0 (socket says 172.21.15.12:47330) 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.130+0000 7f15e9ddd640 1 --2- 172.21.15.12:0/3571334902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 0x55fa63f61280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.130+0000 7f15e95dc640 1 -- 172.21.15.12:0/3571334902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 msgr2=0x55fa63f61280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.130+0000 7f15e95dc640 1 --2- 172.21.15.12:0/3571334902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 0x55fa63f61280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.130+0000 7f15e95dc640 1 -- 172.21.15.12:0/3571334902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 msgr2=0x55fa63f60d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:34.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.130+0000 7f15e95dc640 1 --2- 172.21.15.12:0/3571334902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 0x55fa63f60d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.130+0000 7f15e95dc640 1 -- 172.21.15.12:0/3571334902 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa63f3b260 con 0x55fa63f3db60 2024-09-19T06:48:34.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.131+0000 7f15e95dc640 1 --2- 172.21.15.12:0/3571334902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3db60 0x55fa63f3fcc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f15e000c8f0 tx=0x7f15e009ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16a900ed0853e467 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:34.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.131+0000 7f15ceffd640 1 -- 172.21.15.12:0/3571334902 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e00b3070 con 0x55fa63f3db60 2024-09-19T06:48:34.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.131+0000 7f15ceffd640 1 -- 172.21.15.12:0/3571334902 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15e009a7a0 con 0x55fa63f3db60 2024-09-19T06:48:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.132+0000 7f15ceffd640 1 -- 172.21.15.12:0/3571334902 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e00bb290 con 0x55fa63f3db60 2024-09-19T06:48:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.132+0000 7f15edc19740 1 -- 172.21.15.12:0/3571334902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3db60 msgr2=0x55fa63f3fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.132+0000 7f15edc19740 1 --2- 172.21.15.12:0/3571334902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3db60 0x55fa63f3fcc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f15e000c8f0 tx=0x7f15e009ad30 comp rx=0 tx=0).stop 2024-09-19T06:48:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.132+0000 7f15edc19740 1 -- 172.21.15.12:0/3571334902 shutdown_connections 2024-09-19T06:48:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.132+0000 7f15edc19740 1 --2- 172.21.15.12:0/3571334902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f48d40 0x55fa63f61280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.132+0000 7f15edc19740 1 --2- 172.21.15.12:0/3571334902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3e480 0x55fa63f60d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.132+0000 7f15edc19740 1 --2- 172.21.15.12:0/3571334902 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f3db60 0x55fa63f3fcc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.132+0000 7f15edc19740 1 -- 172.21.15.12:0/3571334902 >> 172.21.15.12:0/3571334902 conn(0x55fa63f3a0f0 msgr2=0x55fa63f3f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:34.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.133+0000 7f15edc19740 1 -- 172.21.15.12:0/3571334902 shutdown_connections 2024-09-19T06:48:34.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.133+0000 7f15edc19740 1 -- 172.21.15.12:0/3571334902 wait complete. 2024-09-19T06:48:34.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.134+0000 7f15edc19740 1 -- start start 2024-09-19T06:48:34.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.134+0000 7f15edc19740 1 Processor -- start 2024-09-19T06:48:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.134+0000 7f15edc19740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 0x55fa63f512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.134+0000 7f15edc19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3e480 0x55fa63f4c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.134+0000 7f15edc19740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 0x55fa63f4cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.134+0000 7f15edc19740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b55f0 con 0x55fa63f3db60 2024-09-19T06:48:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.134+0000 7f15edc19740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b4f20 con 0x55fa63f3e480 2024-09-19T06:48:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.134+0000 7f15edc19740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f15e41b2150 con 0x55fa63f48d40 2024-09-19T06:48:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.134+0000 7f15edc19740 10 client.0 _ll_register_callbacks cb 0x7f15e00975f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.135+0000 7f15e95dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 0x55fa63f512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.135+0000 7f15e9ddd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 0x55fa63f4cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.135+0000 7f15e8ddb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3e480 0x55fa63f4c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.135+0000 7f15e9ddd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 0x55fa63f4cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:47344/0 (socket says 172.21.15.12:47344) 2024-09-19T06:48:34.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.135+0000 7f15e8ddb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3e480 0x55fa63f4c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38674/0 (socket says 172.21.15.12:38674) 2024-09-19T06:48:34.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.135+0000 7f15e9ddd640 1 -- 172.21.15.12:0/587238060 learned_addr learned my addr 172.21.15.12:0/587238060 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:34.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.135+0000 7f15e8ddb640 1 -- 172.21.15.12:0/587238060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 msgr2=0x55fa63f4cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:34.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.135+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 0x55fa63f4cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.135+0000 7f15e8ddb640 1 -- 172.21.15.12:0/587238060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 msgr2=0x55fa63f512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.135+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 0x55fa63f512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.136+0000 7f15e8ddb640 1 -- 172.21.15.12:0/587238060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa63f4d190 con 0x55fa63f3e480 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.136+0000 7f15e8ddb640 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3e480 0x55fa63f4c610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009730 tx=0x7f15d40096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8df2a109b08cc664 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.136+0000 7f15ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.136+0000 7f15ccff9640 1 -- 172.21.15.12:0/587238060 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d401e070 con 0x55fa63f3e480 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.136+0000 7f15ccff9640 1 -- 172.21.15.12:0/587238060 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f15d4005050 con 0x55fa63f3e480 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.136+0000 7f15edc19740 1 -- 172.21.15.12:0/587238060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15e009a7a0 con 0x55fa63f3e480 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.137+0000 7f15ccff9640 1 -- 172.21.15.12:0/587238060 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f15d4005270 con 0x55fa63f3e480 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.137+0000 7f15edc19740 10 client.27257 fetch_fsmap learned FSMap version 43 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.137+0000 7f15edc19740 1 -- 172.21.15.12:0/587238060 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55fa63fc3ba0 con 0x55fa63f3e480 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.137+0000 7f15ccff9640 1 -- 172.21.15.12:0/587238060 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15e009a7a0 con 0x55fa63f3e480 2024-09-19T06:48:34.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.137+0000 7f15ccff9640 1 -- 172.21.15.12:0/587238060 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 43) ==== 8366+0+0 (secure 0 0 0) 0x7f15d400f5c0 con 0x55fa63f3e480 2024-09-19T06:48:34.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.138+0000 7f15edc19740 10 client.27257 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T06:48:34.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.138+0000 7f15edc19740 10 client.27257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:34.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.138+0000 7f15edc19740 20 client.27257 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:34.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.138+0000 7f15edc19740 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa63fc40e0 0x55fa63fc64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:34.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.138+0000 7f15edc19740 4 client.27257 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:48:34.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.138+0000 7f15edc19740 1 -- 172.21.15.12:0/587238060 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fa63eaad00 con 0x55fa63fc40e0 2024-09-19T06:48:34.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.138+0000 7f15e95dc640 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa63fc40e0 0x55fa63fc64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.139+0000 7f15e95dc640 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa63fc40e0 0x55fa63fc64d0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc7203c170e541a server_cookie=5af8cad79bb88e5a in_seq=0 out_seq=0 2024-09-19T06:48:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.139+0000 7f15ccff9640 10 client.27257 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.140+0000 7f15ccff9640 1 -- 172.21.15.12:0/587238060 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fa63eaad00 con 0x55fa63fc40e0 2024-09-19T06:48:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.140+0000 7f15ccff9640 10 client.27257 handle_command_reply: tid=0 2024-09-19T06:48:34.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.140+0000 7f15edc19740 1 client.27257 shutdown 2024-09-19T06:48:34.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.141+0000 7f15edc19740 1 -- 172.21.15.12:0/587238060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3e480 msgr2=0x55fa63f4c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:34.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.141+0000 7f15edc19740 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3e480 0x55fa63f4c610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15d4009730 tx=0x7f15d40096c0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.141+0000 7f15edc19740 1 -- 172.21.15.12:0/587238060 shutdown_connections 2024-09-19T06:48:34.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.141+0000 7f15edc19740 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa63fc40e0 0x55fa63fc64d0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.141+0000 7f15edc19740 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa63f48d40 0x55fa63f4cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.141+0000 7f15edc19740 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa63f3e480 0x55fa63f4c610 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.141+0000 7f15edc19740 1 --2- 172.21.15.12:0/587238060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa63f3db60 0x55fa63f512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.141+0000 7f15edc19740 1 -- 172.21.15.12:0/587238060 >> 172.21.15.12:0/587238060 conn(0x55fa63f3a0f0 msgr2=0x55fa63f47b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:34.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.141+0000 7f15ccff9640 0 client.27257 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:34.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.142+0000 7f15edc19740 1 -- 172.21.15.12:0/587238060 shutdown_connections 2024-09-19T06:48:34.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.142+0000 7f15edc19740 1 -- 172.21.15.12:0/587238060 wait complete. 2024-09-19T06:48:34.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.142+0000 7f15edc19740 20 client.27257 trim_cache size 0 max 16384 2024-09-19T06:48:34.146 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:48:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:48:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "9c35509e-95ba-47b2-8021-9f09a796bb4f", 2024-09-19T06:48:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:48:34.146 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:48:34.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15d00a37b0 msgr2=0x7f15d00a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:34.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15d00a37b0 0x7f15d00a5c70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f15dc004af0 tx=0x7f15dc005fd0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15e4100a90 msgr2=0x7f15e410b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:34.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15e4100a90 0x7f15e410b340 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f15e000c920 tx=0x7f15e000cde0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 shutdown_connections 2024-09-19T06:48:34.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f15d00a37b0 0x7f15d00a5c70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15e4106a90 0x7f15e41a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15e4101430 0x7f15e410b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 --2- 172.21.15.12:0/201045721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15e4100a90 0x7f15e410b340 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:34.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 >> 172.21.15.12:0/201045721 conn(0x7f15e40fc7d0 msgr2=0x7f15e40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:34.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 shutdown_connections 2024-09-19T06:48:34.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:34.143+0000 7f15eb840640 1 -- 172.21.15.12:0/201045721 wait complete. 2024-09-19T06:48:34.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:34 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:48:34.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:34 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:48:34.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:34 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:48:35.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:48:35.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:48:35.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: pgmap v260: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.7 MiB/s wr, 837 op/s 2024-09-19T06:48:35.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:35 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:48:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:48:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:48:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:48:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:48:35.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: pgmap v260: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.7 MiB/s wr, 837 op/s 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:35 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.721 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:48:35.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:48:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:48:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:48:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:48:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:48:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:48:35.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:48:35.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:48:35.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: pgmap v260: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 9.7 MiB/s wr, 837 op/s 2024-09-19T06:48:35.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.761 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:35 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:48:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 470.0 s, 3092.4 tps, lat 32.625 ms stddev 39.647 2024-09-19T06:48:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 -- 172.21.15.12:0/2804612420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24c100e20 msgr2=0x7fe24c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 --2- 172.21.15.12:0/2804612420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24c100e20 0x7fe24c101200 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009900 tx=0x7fe23c02a480 comp rx=0 tx=0).stop 2024-09-19T06:48:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 -- 172.21.15.12:0/2804612420 shutdown_connections 2024-09-19T06:48:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 --2- 172.21.15.12:0/2804612420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c102ef0 0x7fe24c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 --2- 172.21.15.12:0/2804612420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe24c102570 0x7fe24c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 --2- 172.21.15.12:0/2804612420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24c100e20 0x7fe24c101200 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 -- 172.21.15.12:0/2804612420 >> 172.21.15.12:0/2804612420 conn(0x7fe24c0fc7d0 msgr2=0x7fe24c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 -- 172.21.15.12:0/2804612420 shutdown_connections 2024-09-19T06:48:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 -- 172.21.15.12:0/2804612420 wait complete. 2024-09-19T06:48:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 Processor -- start 2024-09-19T06:48:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.274+0000 7fe2527d1640 1 -- start start 2024-09-19T06:48:36.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.275+0000 7fe2527d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c100e20 0x7fe24c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.275+0000 7fe2527d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24c102570 0x7fe24c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.275+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c100e20 0x7fe24c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.275+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c100e20 0x7fe24c1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38688/0 (socket says 172.21.15.12:38688) 2024-09-19T06:48:36.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24c102570 0x7fe24c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24c102570 0x7fe24c198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47086/0 (socket says 172.21.15.12:47086) 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe24bfff640 1 -- 172.21.15.12:0/1871169305 learned_addr learned my addr 172.21.15.12:0/1871169305 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe2527d1640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe24c102ef0 0x7fe24c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c112100 con 0x7fe24c102570 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c111f80 con 0x7fe24c100e20 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c112280 con 0x7fe24c102ef0 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe24bfff640 1 -- 172.21.15.12:0/1871169305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe24c102ef0 msgr2=0x7fe24c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe24bfff640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe24c102ef0 0x7fe24c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe24bfff640 1 -- 172.21.15.12:0/1871169305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24c102570 msgr2=0x7fe24c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe24bfff640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24c102570 0x7fe24c198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.276+0000 7fe24bfff640 1 -- 172.21.15.12:0/1871169305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c19d560 con 0x7fe24c100e20 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.277+0000 7fe24bfff640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c100e20 0x7fe24c1985b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe23c02aa70 tx=0x7fe23c0045a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.277+0000 7fe2497fa640 1 -- 172.21.15.12:0/1871169305 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c035030 con 0x7fe24c100e20 2024-09-19T06:48:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.277+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24c19d7f0 con 0x7fe24c100e20 2024-09-19T06:48:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.277+0000 7fe2497fa640 1 -- 172.21.15.12:0/1871169305 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe23c041070 con 0x7fe24c100e20 2024-09-19T06:48:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.277+0000 7fe2497fa640 1 -- 172.21.15.12:0/1871169305 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c046470 con 0x7fe24c100e20 2024-09-19T06:48:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.277+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24c10fbc0 con 0x7fe24c100e20 2024-09-19T06:48:36.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.279+0000 7fe2497fa640 1 -- 172.21.15.12:0/1871169305 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe23c03d960 con 0x7fe24c100e20 2024-09-19T06:48:36.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.280+0000 7fe254baa740 1 Processor -- start 2024-09-19T06:48:36.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.281+0000 7fe254baa740 1 -- start start 2024-09-19T06:48:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.282+0000 7fe254baa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d9554a0 0x56237d955880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.282+0000 7fe254baa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d960140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.282+0000 7fe254baa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d960680 0x56237d962a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.282+0000 7fe254baa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56237d8bb2e0 con 0x56237d9554a0 2024-09-19T06:48:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.282+0000 7fe254baa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56237d862ce0 con 0x56237d960680 2024-09-19T06:48:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.282+0000 7fe254baa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56237d8b72a0 con 0x56237d955dc0 2024-09-19T06:48:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d960140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d960680 0x56237d962a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe250d6e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d9554a0 0x56237d955880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d960140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:47358/0 (socket says 172.21.15.12:47358) 2024-09-19T06:48:36.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d960680 0x56237d962a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38696/0 (socket says 172.21.15.12:38696) 2024-09-19T06:48:36.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe250d6e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d9554a0 0x56237d955880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47098/0 (socket says 172.21.15.12:47098) 2024-09-19T06:48:36.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24bfff640 1 -- 172.21.15.12:0/919309570 learned_addr learned my addr 172.21.15.12:0/919309570 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:36.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe2497fa640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2340a33b0 0x7fe2340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24b7fe640 1 -- 172.21.15.12:0/919309570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 msgr2=0x56237d960140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:36.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24b7fe640 1 --2- 172.21.15.12:0/919309570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d960140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24b7fe640 1 -- 172.21.15.12:0/919309570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d9554a0 msgr2=0x56237d955880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:36.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24b7fe640 1 --2- 172.21.15.12:0/919309570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d9554a0 0x56237d955880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24b7fe640 1 -- 172.21.15.12:0/919309570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56237d847440 con 0x56237d960680 2024-09-19T06:48:36.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24bfff640 1 --2- 172.21.15.12:0/919309570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d960140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:36.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe250d6e640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2340a33b0 0x7fe2340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe2497fa640 1 -- 172.21.15.12:0/1871169305 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7fe23c0f4690 con 0x7fe24c100e20 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.283+0000 7fe24b7fe640 1 --2- 172.21.15.12:0/919309570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d960680 0x56237d962a70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe240009bd0 tx=0x7fe240011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f58c9eedefffd7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe250d6e640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2340a33b0 0x7fe2340a5870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe244005fd0 tx=0x7fe244004a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe2327fc640 1 -- 172.21.15.12:0/919309570 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240004310 con 0x56237d960680 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe2327fc640 1 -- 172.21.15.12:0/919309570 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2400044b0 con 0x56237d960680 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe2327fc640 1 -- 172.21.15.12:0/919309570 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240003850 con 0x56237d960680 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe254baa740 1 -- 172.21.15.12:0/919309570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d960680 msgr2=0x56237d962a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe254baa740 1 --2- 172.21.15.12:0/919309570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d960680 0x56237d962a70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe240009bd0 tx=0x7fe240011440 comp rx=0 tx=0).stop 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe254baa740 1 -- 172.21.15.12:0/919309570 shutdown_connections 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe254baa740 1 --2- 172.21.15.12:0/919309570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d960680 0x56237d962a70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe254baa740 1 --2- 172.21.15.12:0/919309570 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d960140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe254baa740 1 --2- 172.21.15.12:0/919309570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d9554a0 0x56237d955880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.284+0000 7fe254baa740 1 -- 172.21.15.12:0/919309570 >> 172.21.15.12:0/919309570 conn(0x56237d951a30 msgr2=0x56237d951e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:36.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.285+0000 7fe254baa740 1 -- 172.21.15.12:0/919309570 shutdown_connections 2024-09-19T06:48:36.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.285+0000 7fe254baa740 1 -- 172.21.15.12:0/919309570 wait complete. 2024-09-19T06:48:36.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.285+0000 7fe254baa740 1 -- start start 2024-09-19T06:48:36.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.285+0000 7fe254baa740 1 Processor -- start 2024-09-19T06:48:36.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.286+0000 7fe254baa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d95fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.286+0000 7fe254baa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d955dc0 0x56237d95d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.286+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d95fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.286+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d95fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38700/0 (socket says 172.21.15.12:38700) 2024-09-19T06:48:36.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.286+0000 7fe24bfff640 1 -- 172.21.15.12:0/2177458804 learned_addr learned my addr 172.21.15.12:0/2177458804 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:36.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.286+0000 7fe254baa740 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d960680 0x56237d95d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.286+0000 7fe24b7fe640 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d955dc0 0x56237d95d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56237d9632f0 con 0x56237d955dc0 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56237d876050 con 0x56237d9554a0 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56237d963470 con 0x56237d960680 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe250d6e640 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d960680 0x56237d95d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe254baa740 10 client.0 _ll_register_callbacks cb 0x56237d8b6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe24bfff640 1 -- 172.21.15.12:0/2177458804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d960680 msgr2=0x56237d95d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe24bfff640 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d960680 0x56237d95d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe24bfff640 1 -- 172.21.15.12:0/2177458804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d955dc0 msgr2=0x56237d95d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe24bfff640 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d955dc0 0x56237d95d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe24bfff640 1 -- 172.21.15.12:0/2177458804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56237d62c3c0 con 0x56237d9554a0 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe24bfff640 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d95fec0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0bce40 tx=0x7fe23c004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20406e0ccaf0d97e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.287+0000 7fe22b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:48:36.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.288+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2177458804 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0c07b0 con 0x56237d9554a0 2024-09-19T06:48:36.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.288+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2400044b0 con 0x56237d9554a0 2024-09-19T06:48:36.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.288+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2177458804 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7fe23c0f1fc0 con 0x56237d9554a0 2024-09-19T06:48:36.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.288+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2177458804 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe23c0c0340 con 0x56237d9554a0 2024-09-19T06:48:36.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.288+0000 7fe254baa740 10 client.27269 fetch_fsmap learned FSMap version 44 2024-09-19T06:48:36.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.288+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56237d96ebe0 con 0x56237d9554a0 2024-09-19T06:48:36.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.306+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2177458804 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe23c0c10e0 con 0x56237d9554a0 2024-09-19T06:48:36.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.306+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2177458804 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fe23c0a9ce0 con 0x56237d9554a0 2024-09-19T06:48:36.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.306+0000 7fe254baa740 10 client.27269 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:48:36.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.306+0000 7fe254baa740 10 client.27269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:36.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.306+0000 7fe254baa740 20 client.27269 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:36.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.306+0000 7fe254baa740 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56237d9702c0 0x56237d972730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.306+0000 7fe254baa740 4 client.27269 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:36.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.306+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe2400044b0 con 0x56237d9702c0 2024-09-19T06:48:36.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.307+0000 7fe24b7fe640 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56237d9702c0 0x56237d972730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.312+0000 7fe24b7fe640 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56237d9702c0 0x56237d972730 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a4cf4aa5b734b99 server_cookie=bc18d77f1579a66 in_seq=0 out_seq=0 2024-09-19T06:48:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.316+0000 7fe22b7fe640 10 client.27269 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.320+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2177458804 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe2400044b0 con 0x56237d9702c0 2024-09-19T06:48:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.320+0000 7fe22b7fe640 10 client.27269 handle_command_reply: tid=0 2024-09-19T06:48:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.320+0000 7fe254baa740 1 client.27269 shutdown 2024-09-19T06:48:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.323+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 msgr2=0x56237d95fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.323+0000 7fe254baa740 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d95fec0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0bce40 tx=0x7fe23c004610 comp rx=0 tx=0).stop 2024-09-19T06:48:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.327+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 shutdown_connections 2024-09-19T06:48:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.327+0000 7fe254baa740 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56237d9702c0 0x56237d972730 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.327+0000 7fe254baa740 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d960680 0x56237d95d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.327+0000 7fe254baa740 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d955dc0 0x56237d95d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.327+0000 7fe254baa740 1 --2- 172.21.15.12:0/2177458804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d95fec0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.327+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 >> 172.21.15.12:0/2177458804 conn(0x56237d951a30 msgr2=0x56237d957710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.327+0000 7fe22b7fe640 0 client.27269 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:36.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.330+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 shutdown_connections 2024-09-19T06:48:36.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.330+0000 7fe254baa740 1 -- 172.21.15.12:0/2177458804 wait complete. 2024-09-19T06:48:36.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.331+0000 7fe254baa740 20 client.27269 trim_cache size 0 max 16384 2024-09-19T06:48:36.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.362+0000 7fe254baa740 1 Processor -- start 2024-09-19T06:48:36.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.362+0000 7fe254baa740 1 -- start start 2024-09-19T06:48:36.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe254baa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d950a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe254baa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d977fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe254baa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 0x56237d978510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe254baa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c1ab920 con 0x56237d960680 2024-09-19T06:48:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe254baa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c1ad460 con 0x56237d9554a0 2024-09-19T06:48:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe254baa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c1abff0 con 0x56237d955dc0 2024-09-19T06:48:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d950a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d977fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe24b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d977fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:47376/0 (socket says 172.21.15.12:47376) 2024-09-19T06:48:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe24b7fe640 1 -- 172.21.15.12:0/2420524869 learned_addr learned my addr 172.21.15.12:0/2420524869 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.363+0000 7fe250d6e640 1 --2- 172.21.15.12:0/2420524869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 0x56237d978510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.364+0000 7fe250d6e640 1 -- 172.21.15.12:0/2420524869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 msgr2=0x56237d977fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.364+0000 7fe250d6e640 1 --2- 172.21.15.12:0/2420524869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d977fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.364+0000 7fe250d6e640 1 -- 172.21.15.12:0/2420524869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 msgr2=0x56237d950a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.364+0000 7fe250d6e640 1 --2- 172.21.15.12:0/2420524869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d950a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.364+0000 7fe250d6e640 1 -- 172.21.15.12:0/2420524869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56237d951860 con 0x56237d960680 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.364+0000 7fe24bfff640 1 --2- 172.21.15.12:0/2420524869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d950a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.364+0000 7fe250d6e640 1 --2- 172.21.15.12:0/2420524869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 0x56237d978510 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe244004990 tx=0x7fe244015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c46a811d46f3074 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.364+0000 7fe231ffb640 1 -- 172.21.15.12:0/2420524869 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24401e4f0 con 0x56237d960680 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.364+0000 7fe231ffb640 1 -- 172.21.15.12:0/2420524869 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe24401eb70 con 0x56237d960680 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.364+0000 7fe231ffb640 1 -- 172.21.15.12:0/2420524869 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244012c00 con 0x56237d960680 2024-09-19T06:48:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.365+0000 7fe254baa740 1 -- 172.21.15.12:0/2420524869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 msgr2=0x56237d978510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.365+0000 7fe254baa740 1 --2- 172.21.15.12:0/2420524869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 0x56237d978510 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe244004990 tx=0x7fe244015000 comp rx=0 tx=0).stop 2024-09-19T06:48:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.366+0000 7fe254baa740 1 -- 172.21.15.12:0/2420524869 shutdown_connections 2024-09-19T06:48:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.366+0000 7fe254baa740 1 --2- 172.21.15.12:0/2420524869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 0x56237d978510 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.366+0000 7fe254baa740 1 --2- 172.21.15.12:0/2420524869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d955dc0 0x56237d977fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.366+0000 7fe254baa740 1 --2- 172.21.15.12:0/2420524869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d9554a0 0x56237d950a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.366+0000 7fe254baa740 1 -- 172.21.15.12:0/2420524869 >> 172.21.15.12:0/2420524869 conn(0x56237d951a30 msgr2=0x56237d950350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.366+0000 7fe254baa740 1 -- 172.21.15.12:0/2420524869 shutdown_connections 2024-09-19T06:48:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.366+0000 7fe254baa740 1 -- 172.21.15.12:0/2420524869 wait complete. 2024-09-19T06:48:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.366+0000 7fe254baa740 1 -- start start 2024-09-19T06:48:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.366+0000 7fe254baa740 1 Processor -- start 2024-09-19T06:48:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe254baa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d9554a0 0x56237d964470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe254baa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d955dc0 0x56237d9649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe254baa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 0x56237d964ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d9554a0 0x56237d964470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d9554a0 0x56237d964470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:47388/0 (socket says 172.21.15.12:47388) 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe24bfff640 1 -- 172.21.15.12:0/2074001866 learned_addr learned my addr 172.21.15.12:0/2074001866 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c1acd90 con 0x56237d960680 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe24b7fe640 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d955dc0 0x56237d9649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe250d6e640 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 0x56237d964ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c1ac6c0 con 0x56237d955dc0 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c1a9920 con 0x56237d9554a0 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe254baa740 10 client.0 _ll_register_callbacks cb 0x7fe23c003ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe24bfff640 1 -- 172.21.15.12:0/2074001866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d955dc0 msgr2=0x56237d9649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.367+0000 7fe24bfff640 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d955dc0 0x56237d9649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.368+0000 7fe24bfff640 1 -- 172.21.15.12:0/2074001866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 msgr2=0x56237d964ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.368+0000 7fe24bfff640 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 0x56237d964ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.368+0000 7fe24bfff640 1 -- 172.21.15.12:0/2074001866 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56237d9e27b0 con 0x56237d9554a0 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.368+0000 7fe24bfff640 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d9554a0 0x56237d964470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0c0970 tx=0x7fe23c031770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e56e4bbd42a7591b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.368+0000 7fe22b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.368+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2074001866 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0c0520 con 0x56237d9554a0 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.368+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2074001866 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7fe23c0fa1e0 con 0x56237d9554a0 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.368+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe24401eb70 con 0x56237d9554a0 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2074001866 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe23c0c10e0 con 0x56237d9554a0 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe254baa740 10 client.27235 fetch_fsmap learned FSMap version 44 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56237d9e3a50 con 0x56237d9554a0 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2074001866 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe23c0f2110 con 0x56237d9554a0 2024-09-19T06:48:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2074001866 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fe23c0a9ce0 con 0x56237d9554a0 2024-09-19T06:48:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe254baa740 10 client.27235 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:48:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe254baa740 10 client.27235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe254baa740 20 client.27235 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe254baa740 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56237d9e3ee0 0x56237d9e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe254baa740 4 client.27235 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:48:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.369+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fe24401eb70 con 0x56237d9e3ee0 2024-09-19T06:48:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.370+0000 7fe24b7fe640 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56237d9e3ee0 0x56237d9e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.370+0000 7fe24b7fe640 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56237d9e3ee0 0x56237d9e62d0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a9729fd0a2ffda7 server_cookie=70bedec8432ebb5a in_seq=0 out_seq=0 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.370+0000 7fe22b7fe640 10 client.27235 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe22b7fe640 1 -- 172.21.15.12:0/2074001866 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fe24401eb70 con 0x56237d9e3ee0 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe22b7fe640 10 client.27235 handle_command_reply: tid=0 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe254baa740 1 client.27235 shutdown 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d9554a0 msgr2=0x56237d964470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe254baa740 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d9554a0 0x56237d964470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0c0970 tx=0x7fe23c031770 comp rx=0 tx=0).stop 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 shutdown_connections 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe254baa740 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56237d9e3ee0 0x56237d9e62d0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe22b7fe640 0 client.27235 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe254baa740 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56237d960680 0x56237d964ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe254baa740 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56237d955dc0 0x56237d9649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe254baa740 1 --2- 172.21.15.12:0/2074001866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56237d9554a0 0x56237d964470 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.371+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 >> 172.21.15.12:0/2074001866 conn(0x56237d951a30 msgr2=0x56237d950b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.372+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 shutdown_connections 2024-09-19T06:48:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.372+0000 7fe254baa740 1 -- 172.21.15.12:0/2074001866 wait complete. 2024-09-19T06:48:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.372+0000 7fe254baa740 20 client.27235 trim_cache size 0 max 16384 2024-09-19T06:48:36.378 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:48:36.378 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:48:36.378 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:48:36.378 INFO:teuthology.orchestra.run.smithi012.stdout: "9c35509e-95ba-47b2-8021-9f09a796bb4f": { 2024-09-19T06:48:36.378 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:48:36.379 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "9c35509e-95ba-47b2-8021-9f09a796bb4f", 2024-09-19T06:48:36.379 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:48:36.379 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:48:36.379 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:48:36.379 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:48:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.372+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2340a33b0 msgr2=0x7fe2340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.372+0000 7fe2527d1640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2340a33b0 0x7fe2340a5870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe244005fd0 tx=0x7fe244004a40 comp rx=0 tx=0).stop 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.372+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c100e20 msgr2=0x7fe24c1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.372+0000 7fe2527d1640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c100e20 0x7fe24c1985b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe23c02aa70 tx=0x7fe23c0045a0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.373+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 shutdown_connections 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.373+0000 7fe2527d1640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe2340a33b0 0x7fe2340a5870 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.373+0000 7fe2527d1640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe24c102ef0 0x7fe24c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.373+0000 7fe2527d1640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe24c102570 0x7fe24c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.373+0000 7fe2527d1640 1 --2- 172.21.15.12:0/1871169305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c100e20 0x7fe24c1985b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.373+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 >> 172.21.15.12:0/1871169305 conn(0x7fe24c0fc7d0 msgr2=0x7fe24c0fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.373+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 shutdown_connections 2024-09-19T06:48:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:48:36.373+0000 7fe2527d1640 1 -- 172.21.15.12:0/1871169305 wait complete. 2024-09-19T06:48:36.419 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:36 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:48:36.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:36 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:48:36.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:36 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:48:37.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:37 smithi012 ceph-mon[30937]: pgmap v261: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2024-09-19T06:48:37.653 INFO:tasks.cephfs.filesystem:scrub status for tag:9c35509e-95ba-47b2-8021-9f09a796bb4f - {'path': '/', 'tag': '9c35509e-95ba-47b2-8021-9f09a796bb4f', 'options': 'recursive,force'} 2024-09-19T06:48:37.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:37 smithi016 ceph-mon[34911]: pgmap v261: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2024-09-19T06:48:37.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:37 smithi173 ceph-mon[35349]: pgmap v261: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2024-09-19T06:48:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.535+0000 7ff2294dd640 1 -- 172.21.15.12:0/1489841212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff22411b140 msgr2=0x7ff22411d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.535+0000 7ff2294dd640 1 --2- 172.21.15.12:0/1489841212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff22411b140 0x7ff22411d530 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009ca0 tx=0x7ff21c02a8d0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.535+0000 7ff2294dd640 1 -- 172.21.15.12:0/1489841212 shutdown_connections 2024-09-19T06:48:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.535+0000 7ff2294dd640 1 --2- 172.21.15.12:0/1489841212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff22411b140 0x7ff22411d530 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.535+0000 7ff2294dd640 1 --2- 172.21.15.12:0/1489841212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2241095d0 0x7ff224109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.535+0000 7ff2294dd640 1 --2- 172.21.15.12:0/1489841212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2241091f0 0x7ff224110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.535+0000 7ff2294dd640 1 -- 172.21.15.12:0/1489841212 >> 172.21.15.12:0/1489841212 conn(0x7ff22406ce00 msgr2=0x7ff22406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.535+0000 7ff2294dd640 1 -- 172.21.15.12:0/1489841212 shutdown_connections 2024-09-19T06:48:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.536+0000 7ff2294dd640 1 -- 172.21.15.12:0/1489841212 wait complete. 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.536+0000 7ff2294dd640 1 Processor -- start 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2294dd640 1 -- start start 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2294dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2241091f0 0x7ff2241a7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2294dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2241095d0 0x7ff2241a7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2294dd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff22411b140 0x7ff2241ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2294dd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff224120d00 con 0x7ff2241091f0 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2294dd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff224120b80 con 0x7ff22411b140 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2294dd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff224120e80 con 0x7ff2241095d0 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2237fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff22411b140 0x7ff2241ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2237fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff22411b140 0x7ff2241ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38732/0 (socket says 172.21.15.12:38732) 2024-09-19T06:48:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2237fe640 1 -- 172.21.15.12:0/3128122577 learned_addr learned my addr 172.21.15.12:0/3128122577 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff222ffd640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2241091f0 0x7ff2241a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.537+0000 7ff2227fc640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2241095d0 0x7ff2241a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff2237fe640 1 -- 172.21.15.12:0/3128122577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2241095d0 msgr2=0x7ff2241a7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff2237fe640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2241095d0 0x7ff2241a7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff2237fe640 1 -- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2241091f0 msgr2=0x7ff2241a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff2237fe640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2241091f0 0x7ff2241a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff2237fe640 1 -- 172.21.15.12:0/3128122577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2241ac000 con 0x7ff22411b140 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff222ffd640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2241091f0 0x7ff2241a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff2237fe640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff22411b140 0x7ff2241ab8d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff21c030fe0 tx=0x7ff21c003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff20bfff640 1 -- 172.21.15.12:0/3128122577 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c003c90 con 0x7ff22411b140 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff2294dd640 1 -- 172.21.15.12:0/3128122577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2241ac290 con 0x7ff22411b140 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff2294dd640 1 -- 172.21.15.12:0/3128122577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2241b3b80 con 0x7ff22411b140 2024-09-19T06:48:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff20bfff640 1 -- 172.21.15.12:0/3128122577 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff21c003e30 con 0x7ff22411b140 2024-09-19T06:48:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.538+0000 7ff20bfff640 1 -- 172.21.15.12:0/3128122577 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c03b410 con 0x7ff22411b140 2024-09-19T06:48:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.542+0000 7ff22c274740 1 Processor -- start 2024-09-19T06:48:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.543+0000 7ff20bfff640 1 -- 172.21.15.12:0/3128122577 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff21c004040 con 0x7ff22411b140 2024-09-19T06:48:39.544 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.543+0000 7ff22c274740 1 -- start start 2024-09-19T06:48:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff22c274740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff22c274740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901a2410 0x5648901ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff22c274740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 0x5648901af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff22c274740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5648901062f0 con 0x5648901a1af0 2024-09-19T06:48:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff22c274740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5648900ae270 con 0x5648901accb0 2024-09-19T06:48:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff22c274740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5648901022b0 con 0x5648901a2410 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff2227fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff2227fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901a1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47148/0 (socket says 172.21.15.12:47148) 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff222ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901a2410 0x5648901ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff2227fc640 1 -- 172.21.15.12:0/3886613862 learned_addr learned my addr 172.21.15.12:0/3886613862 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff2227fc640 1 --2- 172.21.15.12:0/3886613862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 0x5648901af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.544+0000 7ff20bfff640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff20c0a3530 0x7ff20c0a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.545+0000 7ff222ffd640 1 -- 172.21.15.12:0/3886613862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 msgr2=0x5648901af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.545+0000 7ff222ffd640 1 --2- 172.21.15.12:0/3886613862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 0x5648901af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.545+0000 7ff222ffd640 1 -- 172.21.15.12:0/3886613862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 msgr2=0x5648901a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.545+0000 7ff222ffd640 1 --2- 172.21.15.12:0/3886613862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.545+0000 7ff222ffd640 1 -- 172.21.15.12:0/3886613862 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648900ad340 con 0x5648901a2410 2024-09-19T06:48:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.545+0000 7ff2237fe640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff20c0a3530 0x7ff20c0a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.545+0000 7ff222ffd640 1 --2- 172.21.15.12:0/3886613862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901a2410 0x5648901ac770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff21400b7d0 tx=0x7ff21400bc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=634d9c4beb6b7e6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:39.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.545+0000 7ff20bfff640 1 -- 172.21.15.12:0/3128122577 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7ff21c0f1260 con 0x7ff22411b140 2024-09-19T06:48:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.546+0000 7ff2097fa640 1 -- 172.21.15.12:0/3886613862 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21400d950 con 0x5648901a2410 2024-09-19T06:48:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.546+0000 7ff2097fa640 1 -- 172.21.15.12:0/3886613862 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff214018070 con 0x5648901a2410 2024-09-19T06:48:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.546+0000 7ff2097fa640 1 -- 172.21.15.12:0/3886613862 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2140123e0 con 0x5648901a2410 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.546+0000 7ff2237fe640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff20c0a3530 0x7ff20c0a59f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0bd540 tx=0x7ff21c0e8380 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 -- 172.21.15.12:0/3886613862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901a2410 msgr2=0x5648901ac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 --2- 172.21.15.12:0/3886613862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901a2410 0x5648901ac770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff21400b7d0 tx=0x7ff21400bc90 comp rx=0 tx=0).stop 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 -- 172.21.15.12:0/3886613862 shutdown_connections 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 --2- 172.21.15.12:0/3886613862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 0x5648901af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 --2- 172.21.15.12:0/3886613862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901a2410 0x5648901ac770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 --2- 172.21.15.12:0/3886613862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 -- 172.21.15.12:0/3886613862 >> 172.21.15.12:0/3886613862 conn(0x56489019e060 msgr2=0x56489019e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 -- 172.21.15.12:0/3886613862 shutdown_connections 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 -- 172.21.15.12:0/3886613862 wait complete. 2024-09-19T06:48:39.550 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 -- start start 2024-09-19T06:48:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.547+0000 7ff22c274740 1 Processor -- start 2024-09-19T06:48:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff22c274740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff22c274740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901a2410 0x5648901aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff22c274740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 0x5648901aa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff22c274740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5648901af880 con 0x5648901a1af0 2024-09-19T06:48:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff22c274740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56489008f290 con 0x5648901accb0 2024-09-19T06:48:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff22c274740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5648901afa00 con 0x5648901a2410 2024-09-19T06:48:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff22c274740 10 client.0 _ll_register_callbacks cb 0x5648900c0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff2227fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 0x5648901aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.551 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff2227fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff2227fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47156/0 (socket says 172.21.15.12:47156) 2024-09-19T06:48:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.548+0000 7ff2227fc640 1 -- 172.21.15.12:0/1859115042 learned_addr learned my addr 172.21.15.12:0/1859115042 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.549+0000 7ff2227fc640 1 -- 172.21.15.12:0/1859115042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901a2410 msgr2=0x5648901aa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.549+0000 7ff2227fc640 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901a2410 0x5648901aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.549+0000 7ff2227fc640 1 -- 172.21.15.12:0/1859115042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 msgr2=0x5648901a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.549+0000 7ff2227fc640 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901a9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.549+0000 7ff2227fc640 1 -- 172.21.15.12:0/1859115042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56488fe19210 con 0x5648901accb0 2024-09-19T06:48:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.549+0000 7ff2227fc640 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 0x5648901aa620 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff218011db0 tx=0x7ff218004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2516533b250be965 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.549+0000 7ff206ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:48:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.550+0000 7ff206ff5640 1 -- 172.21.15.12:0/1859115042 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21800fe60 con 0x5648901accb0 2024-09-19T06:48:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.550+0000 7ff206ff5640 1 -- 172.21.15.12:0/1859115042 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7ff218005020 con 0x5648901accb0 2024-09-19T06:48:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.550+0000 7ff22c274740 1 -- 172.21.15.12:0/1859115042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff214018070 con 0x5648901accb0 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.550+0000 7ff206ff5640 1 -- 172.21.15.12:0/1859115042 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff218005220 con 0x5648901accb0 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.550+0000 7ff22c274740 10 client.27284 fetch_fsmap learned FSMap version 44 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.550+0000 7ff22c274740 1 -- 172.21.15.12:0/1859115042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56488fee5620 con 0x5648901accb0 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.550+0000 7ff206ff5640 1 -- 172.21.15.12:0/1859115042 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff214018070 con 0x5648901accb0 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.551+0000 7ff206ff5640 1 -- 172.21.15.12:0/1859115042 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7ff2180203f0 con 0x5648901accb0 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.551+0000 7ff22c274740 10 client.27284 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.551+0000 7ff22c274740 10 client.27284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.551+0000 7ff22c274740 20 client.27284 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.551+0000 7ff22c274740 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5648901cdd90 0x5648901d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.551+0000 7ff22c274740 4 client.27284 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.551+0000 7ff22c274740 1 -- 172.21.15.12:0/1859115042 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564890113a20 con 0x5648901cdd90 2024-09-19T06:48:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.551+0000 7ff222ffd640 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5648901cdd90 0x5648901d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.552+0000 7ff222ffd640 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5648901cdd90 0x5648901d0230 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8989a60331f700f server_cookie=87c92e49b2d95492 in_seq=0 out_seq=0 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.552+0000 7ff206ff5640 10 client.27284 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.552+0000 7ff206ff5640 1 -- 172.21.15.12:0/1859115042 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564890113a20 con 0x5648901cdd90 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.552+0000 7ff206ff5640 10 client.27284 handle_command_reply: tid=0 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.552+0000 7ff22c274740 1 client.27284 shutdown 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 1 -- 172.21.15.12:0/1859115042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 msgr2=0x5648901aa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 0x5648901aa620 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff218011db0 tx=0x7ff218004730 comp rx=0 tx=0).stop 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 1 -- 172.21.15.12:0/1859115042 shutdown_connections 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5648901cdd90 0x5648901d0230 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901accb0 0x5648901aa620 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901a2410 0x5648901aa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 1 --2- 172.21.15.12:0/1859115042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff206ff5640 0 client.27284 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 1 -- 172.21.15.12:0/1859115042 >> 172.21.15.12:0/1859115042 conn(0x56489019e060 msgr2=0x5648901a3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 1 -- 172.21.15.12:0/1859115042 shutdown_connections 2024-09-19T06:48:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 1 -- 172.21.15.12:0/1859115042 wait complete. 2024-09-19T06:48:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.553+0000 7ff22c274740 20 client.27284 trim_cache size 0 max 16384 2024-09-19T06:48:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.573+0000 7ff22c274740 1 Processor -- start 2024-09-19T06:48:39.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.574+0000 7ff22c274740 1 -- start start 2024-09-19T06:48:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.574+0000 7ff22c274740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.574+0000 7ff22c274740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a2410 0x5648901aa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.574+0000 7ff22c274740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 0x5648901d5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.574+0000 7ff22c274740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff21000ea80 con 0x5648901a1af0 2024-09-19T06:48:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.574+0000 7ff22c274740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff2100105c0 con 0x5648901a2410 2024-09-19T06:48:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.574+0000 7ff22c274740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff21000f150 con 0x5648901accb0 2024-09-19T06:48:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff222ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a2410 0x5648901aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff222ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a2410 0x5648901aa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38776/0 (socket says 172.21.15.12:38776) 2024-09-19T06:48:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff222ffd640 1 -- 172.21.15.12:0/3714219475 learned_addr learned my addr 172.21.15.12:0/3714219475 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff2227fc640 1 --2- 172.21.15.12:0/3714219475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 0x5648901d5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff2227fc640 1 --2- 172.21.15.12:0/3714219475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff222ffd640 1 -- 172.21.15.12:0/3714219475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 msgr2=0x5648901d5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff222ffd640 1 --2- 172.21.15.12:0/3714219475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 0x5648901d5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff222ffd640 1 -- 172.21.15.12:0/3714219475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 msgr2=0x5648901abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff222ffd640 1 --2- 172.21.15.12:0/3714219475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff222ffd640 1 -- 172.21.15.12:0/3714219475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648901d08b0 con 0x5648901a2410 2024-09-19T06:48:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff2227fc640 1 --2- 172.21.15.12:0/3714219475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 0x5648901d5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:48:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.575+0000 7ff222ffd640 1 --2- 172.21.15.12:0/3714219475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a2410 0x5648901aa450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff214013b10 tx=0x7ff214013b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea4970d94dfd6c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.576+0000 7ff208ff9640 1 -- 172.21.15.12:0/3714219475 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214013680 con 0x5648901a2410 2024-09-19T06:48:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.576+0000 7ff208ff9640 1 -- 172.21.15.12:0/3714219475 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff214022030 con 0x5648901a2410 2024-09-19T06:48:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.576+0000 7ff208ff9640 1 -- 172.21.15.12:0/3714219475 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2140045b0 con 0x5648901a2410 2024-09-19T06:48:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.576+0000 7ff22c274740 1 -- 172.21.15.12:0/3714219475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a2410 msgr2=0x5648901aa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.576+0000 7ff22c274740 1 --2- 172.21.15.12:0/3714219475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a2410 0x5648901aa450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff214013b10 tx=0x7ff214013b40 comp rx=0 tx=0).stop 2024-09-19T06:48:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.576+0000 7ff22c274740 1 -- 172.21.15.12:0/3714219475 shutdown_connections 2024-09-19T06:48:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.576+0000 7ff22c274740 1 --2- 172.21.15.12:0/3714219475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 0x5648901d5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.576+0000 7ff22c274740 1 --2- 172.21.15.12:0/3714219475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a2410 0x5648901aa450 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.576+0000 7ff22c274740 1 --2- 172.21.15.12:0/3714219475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a1af0 0x5648901abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.576+0000 7ff22c274740 1 -- 172.21.15.12:0/3714219475 >> 172.21.15.12:0/3714219475 conn(0x56489019e060 msgr2=0x56489019d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.577+0000 7ff22c274740 1 -- 172.21.15.12:0/3714219475 shutdown_connections 2024-09-19T06:48:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.577+0000 7ff22c274740 1 -- 172.21.15.12:0/3714219475 wait complete. 2024-09-19T06:48:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff22c274740 1 -- start start 2024-09-19T06:48:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff22c274740 1 Processor -- start 2024-09-19T06:48:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff22c274740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a1af0 0x5648901a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff22c274740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a2410 0x5648901a7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff22c274740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 0x5648901a7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff22c274740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff21000fef0 con 0x5648901a2410 2024-09-19T06:48:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff22c274740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff21000f820 con 0x5648901a1af0 2024-09-19T06:48:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff22c274740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff21000ca80 con 0x5648901accb0 2024-09-19T06:48:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff22c274740 10 client.0 _ll_register_callbacks cb 0x7ff21800ada0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff222ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a2410 0x5648901a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff222ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a2410 0x5648901a7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47166/0 (socket says 172.21.15.12:47166) 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff222ffd640 1 -- 172.21.15.12:0/1763524112 learned_addr learned my addr 172.21.15.12:0/1763524112 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff2227fc640 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a1af0 0x5648901a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.578+0000 7ff2227fc640 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 0x5648901a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff222ffd640 1 -- 172.21.15.12:0/1763524112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 msgr2=0x5648901a7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff222ffd640 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 0x5648901a7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff222ffd640 1 -- 172.21.15.12:0/1763524112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a1af0 msgr2=0x5648901a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff222ffd640 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a1af0 0x5648901a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff222ffd640 1 -- 172.21.15.12:0/1763524112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648901a1920 con 0x5648901a2410 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff2227fc640 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a1af0 0x5648901a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff222ffd640 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a2410 0x5648901a7130 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff214006fd0 tx=0x7ff214006a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c201436339dc7b1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff206ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff206ff5640 1 -- 172.21.15.12:0/1763524112 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21402d070 con 0x5648901a2410 2024-09-19T06:48:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff206ff5640 1 -- 172.21.15.12:0/1763524112 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7ff2140044f0 con 0x5648901a2410 2024-09-19T06:48:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff22c274740 1 -- 172.21.15.12:0/1763524112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff214022030 con 0x5648901a2410 2024-09-19T06:48:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff206ff5640 1 -- 172.21.15.12:0/1763524112 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff214039050 con 0x5648901a2410 2024-09-19T06:48:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff22c274740 10 client.17868 fetch_fsmap learned FSMap version 44 2024-09-19T06:48:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff22c274740 1 -- 172.21.15.12:0/1763524112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x564890238bc0 con 0x5648901a2410 2024-09-19T06:48:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.579+0000 7ff206ff5640 1 -- 172.21.15.12:0/1763524112 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff214022030 con 0x5648901a2410 2024-09-19T06:48:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.580+0000 7ff206ff5640 1 -- 172.21.15.12:0/1763524112 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7ff214003720 con 0x5648901a2410 2024-09-19T06:48:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.580+0000 7ff22c274740 10 client.17868 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:48:39.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.580+0000 7ff22c274740 10 client.17868 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.580+0000 7ff22c274740 20 client.17868 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.580+0000 7ff22c274740 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564890239010 0x56489023b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.580+0000 7ff22c274740 4 client.17868 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:48:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.580+0000 7ff22c274740 1 -- 172.21.15.12:0/1763524112 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56489010dd70 con 0x564890239010 2024-09-19T06:48:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.580+0000 7ff2227fc640 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564890239010 0x56489023b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:39.586 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:39 smithi173 ceph-mon[35349]: pgmap v262: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.6 MiB/s wr, 780 op/s 2024-09-19T06:48:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.582+0000 7ff2227fc640 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564890239010 0x56489023b430 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdad314f944f52f1 server_cookie=9d572c5d96e95a1c in_seq=0 out_seq=0 2024-09-19T06:48:39.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.582+0000 7ff206ff5640 10 client.17868 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.591+0000 7ff206ff5640 1 -- 172.21.15.12:0/1763524112 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56489010dd70 con 0x564890239010 2024-09-19T06:48:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.591+0000 7ff206ff5640 10 client.17868 handle_command_reply: tid=0 2024-09-19T06:48:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff22c274740 1 client.17868 shutdown 2024-09-19T06:48:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff22c274740 1 -- 172.21.15.12:0/1763524112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a2410 msgr2=0x5648901a7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff22c274740 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a2410 0x5648901a7130 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff214006fd0 tx=0x7ff214006a80 comp rx=0 tx=0).stop 2024-09-19T06:48:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff22c274740 1 -- 172.21.15.12:0/1763524112 shutdown_connections 2024-09-19T06:48:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff22c274740 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564890239010 0x56489023b430 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff22c274740 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648901accb0 0x5648901a7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff22c274740 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5648901a2410 0x5648901a7130 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff22c274740 1 --2- 172.21.15.12:0/1763524112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5648901a1af0 0x5648901a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff206ff5640 0 client.17868 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff22c274740 1 -- 172.21.15.12:0/1763524112 >> 172.21.15.12:0/1763524112 conn(0x56489019e060 msgr2=0x5648901b7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.592+0000 7ff22c274740 1 -- 172.21.15.12:0/1763524112 shutdown_connections 2024-09-19T06:48:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff22c274740 1 -- 172.21.15.12:0/1763524112 wait complete. 2024-09-19T06:48:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff22c274740 20 client.17868 trim_cache size 0 max 16384 2024-09-19T06:48:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:48:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:48:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:48:39.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:48:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 -- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff20c0a3530 msgr2=0x7ff20c0a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff20c0a3530 0x7ff20c0a59f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0bd540 tx=0x7ff21c0e8380 comp rx=0 tx=0).stop 2024-09-19T06:48:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 -- 172.21.15.12:0/3128122577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff22411b140 msgr2=0x7ff2241ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff22411b140 0x7ff2241ab8d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff21c030fe0 tx=0x7ff21c003970 comp rx=0 tx=0).stop 2024-09-19T06:48:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 -- 172.21.15.12:0/3128122577 shutdown_connections 2024-09-19T06:48:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff22411b140 0x7ff2241ab8d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff20c0a3530 0x7ff20c0a59f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2241095d0 0x7ff2241a7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 --2- 172.21.15.12:0/3128122577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2241091f0 0x7ff2241a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 -- 172.21.15.12:0/3128122577 >> 172.21.15.12:0/3128122577 conn(0x7ff22406ce00 msgr2=0x7ff22411b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 -- 172.21.15.12:0/3128122577 shutdown_connections 2024-09-19T06:48:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:39.593+0000 7ff2294dd640 1 -- 172.21.15.12:0/3128122577 wait complete. 2024-09-19T06:48:39.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:39 smithi012 ceph-mon[30937]: pgmap v262: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.6 MiB/s wr, 780 op/s 2024-09-19T06:48:39.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:39 smithi016 ceph-mon[34911]: pgmap v262: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.6 MiB/s wr, 780 op/s 2024-09-19T06:48:40.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 475.0 s, 2319.0 tps, lat 42.646 ms stddev 72.507 2024-09-19T06:48:41.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:41 smithi173 ceph-mon[35349]: pgmap v263: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 26 MiB/s wr, 2.13k op/s 2024-09-19T06:48:41.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:41 smithi012 ceph-mon[30937]: pgmap v263: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 26 MiB/s wr, 2.13k op/s 2024-09-19T06:48:41.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:41 smithi016 ceph-mon[34911]: pgmap v263: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 26 MiB/s wr, 2.13k op/s 2024-09-19T06:48:43.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:43 smithi012 ceph-mon[30937]: pgmap v264: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 21 MiB/s wr, 1.71k op/s 2024-09-19T06:48:43.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:43 smithi016 ceph-mon[34911]: pgmap v264: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 21 MiB/s wr, 1.71k op/s 2024-09-19T06:48:43.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:43 smithi173 ceph-mon[35349]: pgmap v264: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 21 MiB/s wr, 1.71k op/s 2024-09-19T06:48:45.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:45 smithi012 ceph-mon[30937]: pgmap v265: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 21 MiB/s wr, 1.77k op/s 2024-09-19T06:48:45.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:45 smithi016 ceph-mon[34911]: pgmap v265: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 21 MiB/s wr, 1.77k op/s 2024-09-19T06:48:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 480.0 s, 2842.4 tps, lat 35.582 ms stddev 42.211 2024-09-19T06:48:45.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:45 smithi173 ceph-mon[35349]: pgmap v265: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 21 MiB/s wr, 1.77k op/s 2024-09-19T06:48:47.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:47 smithi012 ceph-mon[30937]: pgmap v266: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 24 MiB/s wr, 1.95k op/s 2024-09-19T06:48:47.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:47 smithi016 ceph-mon[34911]: pgmap v266: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 24 MiB/s wr, 1.95k op/s 2024-09-19T06:48:47.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:47 smithi173 ceph-mon[35349]: pgmap v266: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 24 MiB/s wr, 1.95k op/s 2024-09-19T06:48:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:49 smithi012 ceph-mon[30937]: pgmap v267: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 MiB/s wr, 1.65k op/s 2024-09-19T06:48:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:49 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:48:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:49 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:48:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:49 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:48:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:49 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:48:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:49 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:48:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:49 smithi016 ceph-mon[34911]: pgmap v267: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 MiB/s wr, 1.65k op/s 2024-09-19T06:48:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:49 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:48:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:49 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:48:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:49 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:48:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:49 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:48:49.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:49 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:48:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:49 smithi173 ceph-mon[35349]: pgmap v267: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 MiB/s wr, 1.65k op/s 2024-09-19T06:48:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:49 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:48:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:49 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:48:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:49 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:48:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:49 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:48:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:49 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:48:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 485.0 s, 3883.6 tps, lat 25.696 ms stddev 29.801 2024-09-19T06:48:52.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:51 smithi173 ceph-mon[35349]: pgmap v268: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 25 MiB/s wr, 1.96k op/s 2024-09-19T06:48:52.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:51 smithi012 ceph-mon[30937]: pgmap v268: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 25 MiB/s wr, 1.96k op/s 2024-09-19T06:48:52.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:51 smithi016 ceph-mon[34911]: pgmap v268: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 25 MiB/s wr, 1.96k op/s 2024-09-19T06:48:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.722+0000 7f2067c7b640 1 -- 172.21.15.12:0/3001549089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2060100480 msgr2=0x7f206010e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.723+0000 7f2067c7b640 1 --2- 172.21.15.12:0/3001549089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2060100480 0x7f206010e9a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2058009930 tx=0x7f205802a420 comp rx=0 tx=0).stop 2024-09-19T06:48:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.723+0000 7f2067c7b640 1 -- 172.21.15.12:0/3001549089 shutdown_connections 2024-09-19T06:48:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.723+0000 7f2067c7b640 1 --2- 172.21.15.12:0/3001549089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2060100480 0x7f206010e9a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.723+0000 7f2067c7b640 1 --2- 172.21.15.12:0/3001549089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20600ffae0 0x7f20600fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.723+0000 7f2067c7b640 1 --2- 172.21.15.12:0/3001549089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2060106b10 0x7f2060106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.723+0000 7f2067c7b640 1 -- 172.21.15.12:0/3001549089 >> 172.21.15.12:0/3001549089 conn(0x7f20600fba30 msgr2=0x7f20600fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.723+0000 7f2067c7b640 1 -- 172.21.15.12:0/3001549089 shutdown_connections 2024-09-19T06:48:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.723+0000 7f2067c7b640 1 -- 172.21.15.12:0/3001549089 wait complete. 2024-09-19T06:48:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2067c7b640 1 Processor -- start 2024-09-19T06:48:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2067c7b640 1 -- start start 2024-09-19T06:48:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2067c7b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20600ffae0 0x7f20601982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2067c7b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2060100480 0x7f2060198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2067c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2060106b10 0x7f206019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2067c7b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2060111f20 con 0x7f2060106b10 2024-09-19T06:48:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2067c7b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2060111da0 con 0x7f2060100480 2024-09-19T06:48:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2067c7b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20601120a0 con 0x7f20600ffae0 2024-09-19T06:48:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2066218640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2060106b10 0x7f206019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2066218640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2060106b10 0x7f206019cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57144/0 (socket says 172.21.15.12:57144) 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2065a17640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20600ffae0 0x7f20601982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2066218640 1 -- 172.21.15.12:0/2504814029 learned_addr learned my addr 172.21.15.12:0/2504814029 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2065216640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2060100480 0x7f2060198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2066218640 1 -- 172.21.15.12:0/2504814029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20600ffae0 msgr2=0x7f20601982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2066218640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20600ffae0 0x7f20601982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2066218640 1 -- 172.21.15.12:0/2504814029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2060100480 msgr2=0x7f2060198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.724+0000 7f2066218640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2060100480 0x7f2060198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.725+0000 7f2066218640 1 -- 172.21.15.12:0/2504814029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206019d2e0 con 0x7f2060106b10 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.725+0000 7f2065a17640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20600ffae0 0x7f20601982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.725+0000 7f2066218640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2060106b10 0x7f206019cbb0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f2058005ab0 tx=0x7f2058031b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.725+0000 7f2056ffd640 1 -- 172.21.15.12:0/2504814029 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205803f030 con 0x7f2060106b10 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.725+0000 7f2067c7b640 1 -- 172.21.15.12:0/2504814029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206019d570 con 0x7f2060106b10 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.725+0000 7f2056ffd640 1 -- 172.21.15.12:0/2504814029 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20580043d0 con 0x7f2060106b10 2024-09-19T06:48:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.725+0000 7f2067c7b640 1 -- 172.21.15.12:0/2504814029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20601a4e60 con 0x7f2060106b10 2024-09-19T06:48:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.725+0000 7f2056ffd640 1 -- 172.21.15.12:0/2504814029 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058049060 con 0x7f2060106b10 2024-09-19T06:48:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.729+0000 7f2056ffd640 1 -- 172.21.15.12:0/2504814029 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2058042030 con 0x7f2060106b10 2024-09-19T06:48:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.730+0000 7f2056ffd640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f204c0a34e0 0x7f204c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.730+0000 7f2065a17640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f204c0a34e0 0x7f204c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.730+0000 7f2056ffd640 1 -- 172.21.15.12:0/2504814029 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f20580efda0 con 0x7f2060106b10 2024-09-19T06:48:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.730+0000 7f206aa18740 1 Processor -- start 2024-09-19T06:48:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f206aa18740 1 -- start start 2024-09-19T06:48:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f2065a17640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f204c0a34e0 0x7f204c0a59a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f205c0099a0 tx=0x7f205c009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f206aa18740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bbded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f206aa18740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f206aa18740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bcb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f206aa18740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562fa6b222f0 con 0x562fa6bbe410 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f206aa18740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562fa6aca270 con 0x562fa6bc8cb0 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f206aa18740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562fa6b1e2b0 con 0x562fa6bbdaf0 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f2065216640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f2065a17640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bbded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f2065216640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57148/0 (socket says 172.21.15.12:57148) 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f2065216640 1 -- 172.21.15.12:0/2215223466 learned_addr learned my addr 172.21.15.12:0/2215223466 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.731+0000 7f2066218640 1 --2- 172.21.15.12:0/2215223466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bcb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f2065216640 1 -- 172.21.15.12:0/2215223466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 msgr2=0x562fa6bbded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f2065216640 1 --2- 172.21.15.12:0/2215223466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bbded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f2065216640 1 -- 172.21.15.12:0/2215223466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 msgr2=0x562fa6bcb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f2065216640 1 --2- 172.21.15.12:0/2215223466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bcb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f2065216640 1 -- 172.21.15.12:0/2215223466 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa6ac9340 con 0x562fa6bbe410 2024-09-19T06:48:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f2065a17640 1 --2- 172.21.15.12:0/2215223466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bbded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f2066218640 1 --2- 172.21.15.12:0/2215223466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bcb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f2065216640 1 --2- 172.21.15.12:0/2215223466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc8770 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2050009c90 tx=0x7f2050011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73fc58ffa8a845f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f204bfff640 1 -- 172.21.15.12:0/2215223466 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205001e070 con 0x562fa6bbe410 2024-09-19T06:48:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f204bfff640 1 -- 172.21.15.12:0/2215223466 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2050019b10 con 0x562fa6bbe410 2024-09-19T06:48:52.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.732+0000 7f204bfff640 1 -- 172.21.15.12:0/2215223466 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205000ea70 con 0x562fa6bbe410 2024-09-19T06:48:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.733+0000 7f206aa18740 1 -- 172.21.15.12:0/2215223466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 msgr2=0x562fa6bc8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.733+0000 7f206aa18740 1 --2- 172.21.15.12:0/2215223466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc8770 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2050009c90 tx=0x7f2050011810 comp rx=0 tx=0).stop 2024-09-19T06:48:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.733+0000 7f206aa18740 1 -- 172.21.15.12:0/2215223466 shutdown_connections 2024-09-19T06:48:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.733+0000 7f206aa18740 1 --2- 172.21.15.12:0/2215223466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bcb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.733+0000 7f206aa18740 1 --2- 172.21.15.12:0/2215223466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc8770 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.733+0000 7f206aa18740 1 --2- 172.21.15.12:0/2215223466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bbded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.733+0000 7f206aa18740 1 -- 172.21.15.12:0/2215223466 >> 172.21.15.12:0/2215223466 conn(0x562fa6bba060 msgr2=0x562fa6bba440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.733+0000 7f206aa18740 1 -- 172.21.15.12:0/2215223466 shutdown_connections 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.733+0000 7f206aa18740 1 -- 172.21.15.12:0/2215223466 wait complete. 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.734+0000 7f206aa18740 1 -- start start 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.734+0000 7f206aa18740 1 Processor -- start 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.734+0000 7f206aa18740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.734+0000 7f206aa18740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.734+0000 7f206aa18740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bc6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.734+0000 7f206aa18740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562fa6bcb880 con 0x562fa6bbe410 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.734+0000 7f206aa18740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562fa6aab290 con 0x562fa6bc8cb0 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.734+0000 7f206aa18740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562fa6bcba00 con 0x562fa6bbdaf0 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.734+0000 7f206aa18740 10 client.0 _ll_register_callbacks cb 0x562fa6adc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.734+0000 7f2065a17640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2065216640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2065216640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57156/0 (socket says 172.21.15.12:57156) 2024-09-19T06:48:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2065a17640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58520/0 (socket says 172.21.15.12:58520) 2024-09-19T06:48:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2065216640 1 -- 172.21.15.12:0/2635598750 learned_addr learned my addr 172.21.15.12:0/2635598750 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2066218640 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bc6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2065216640 1 -- 172.21.15.12:0/2635598750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 msgr2=0x562fa6bc5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2065216640 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2065216640 1 -- 172.21.15.12:0/2635598750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 msgr2=0x562fa6bc6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2065216640 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bc6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2065216640 1 -- 172.21.15.12:0/2635598750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fa6835210 con 0x562fa6bbe410 2024-09-19T06:48:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f2065216640 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc6150 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f205000e570 tx=0x7f2050009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56265abb87858baa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f20497fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f20497fa640 1 -- 172.21.15.12:0/2635598750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205001e050 con 0x562fa6bbe410 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f20497fa640 1 -- 172.21.15.12:0/2635598750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f2050005450 con 0x562fa6bbe410 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f206aa18740 1 -- 172.21.15.12:0/2635598750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2050019b10 con 0x562fa6bbe410 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f20497fa640 1 -- 172.21.15.12:0/2635598750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2050033050 con 0x562fa6bbe410 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f206aa18740 10 client.17880 fetch_fsmap learned FSMap version 44 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.735+0000 7f206aa18740 1 -- 172.21.15.12:0/2635598750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x562fa6901620 con 0x562fa6bbe410 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.736+0000 7f20497fa640 1 -- 172.21.15.12:0/2635598750 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2050019b10 con 0x562fa6bbe410 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.736+0000 7f20497fa640 1 -- 172.21.15.12:0/2635598750 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f20500049c0 con 0x562fa6bbe410 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.736+0000 7f206aa18740 10 client.17880 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.736+0000 7f206aa18740 10 client.17880 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.736+0000 7f206aa18740 20 client.17880 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.736+0000 7f206aa18740 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fa6bd8c70 0x562fa6bdb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.736+0000 7f206aa18740 4 client.17880 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:48:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.736+0000 7f206aa18740 1 -- 172.21.15.12:0/2635598750 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fa6b2fa20 con 0x562fa6bd8c70 2024-09-19T06:48:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.736+0000 7f2065a17640 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fa6bd8c70 0x562fa6bdb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.738+0000 7f2065a17640 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fa6bd8c70 0x562fa6bdb060 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7085276829a957b9 server_cookie=b14bc90387c7a890 in_seq=0 out_seq=0 2024-09-19T06:48:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.738+0000 7f20497fa640 10 client.17880 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.739+0000 7f20497fa640 1 -- 172.21.15.12:0/2635598750 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fa6b2fa20 con 0x562fa6bd8c70 2024-09-19T06:48:52.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.739+0000 7f20497fa640 10 client.17880 handle_command_reply: tid=0 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.739+0000 7f206aa18740 1 client.17880 shutdown 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.739+0000 7f206aa18740 1 -- 172.21.15.12:0/2635598750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 msgr2=0x562fa6bc6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.739+0000 7f206aa18740 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc6150 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f205000e570 tx=0x7f2050009f00 comp rx=0 tx=0).stop 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.740+0000 7f206aa18740 1 -- 172.21.15.12:0/2635598750 shutdown_connections 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.740+0000 7f206aa18740 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fa6bd8c70 0x562fa6bdb060 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.740+0000 7f206aa18740 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bc6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.740+0000 7f20497fa640 0 client.17880 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.740+0000 7f206aa18740 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc6150 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.740+0000 7f206aa18740 1 --2- 172.21.15.12:0/2635598750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.740+0000 7f206aa18740 1 -- 172.21.15.12:0/2635598750 >> 172.21.15.12:0/2635598750 conn(0x562fa6bba060 msgr2=0x562fa6bb91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.740+0000 7f206aa18740 1 -- 172.21.15.12:0/2635598750 shutdown_connections 2024-09-19T06:48:52.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.740+0000 7f206aa18740 1 -- 172.21.15.12:0/2635598750 wait complete. 2024-09-19T06:48:52.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.740+0000 7f206aa18740 20 client.17880 trim_cache size 0 max 16384 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f206aa18740 1 Processor -- start 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f206aa18740 1 -- start start 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f206aa18740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f206aa18740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f206aa18740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bc8cb0 0x562fa6be07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f206aa18740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20601ab7f0 con 0x562fa6bbe410 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f206aa18740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20601ad330 con 0x562fa6bbdaf0 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f206aa18740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20601abec0 con 0x562fa6bc8cb0 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f2065a17640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f2065a17640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:59688/0 (socket says 172.21.15.12:59688) 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f2065a17640 1 -- 172.21.15.12:0/2870105448 learned_addr learned my addr 172.21.15.12:0/2870105448 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.765+0000 7f2066218640 1 --2- 172.21.15.12:0/2870105448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bc8cb0 0x562fa6be07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.766+0000 7f2065216640 1 --2- 172.21.15.12:0/2870105448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.766+0000 7f2065a17640 1 -- 172.21.15.12:0/2870105448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bc8cb0 msgr2=0x562fa6be07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.766+0000 7f2065a17640 1 --2- 172.21.15.12:0/2870105448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bc8cb0 0x562fa6be07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.766+0000 7f2065a17640 1 -- 172.21.15.12:0/2870105448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 msgr2=0x562fa6bc64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.766+0000 7f2065a17640 1 --2- 172.21.15.12:0/2870105448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.766+0000 7f2065a17640 1 -- 172.21.15.12:0/2870105448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa6bbd920 con 0x562fa6bbdaf0 2024-09-19T06:48:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.766+0000 7f2065a17640 1 --2- 172.21.15.12:0/2870105448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc7f40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f205c00f860 tx=0x7f205c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6b9a35e50455d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.766+0000 7f204b7fe640 1 -- 172.21.15.12:0/2870105448 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c00fea0 con 0x562fa6bbdaf0 2024-09-19T06:48:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.766+0000 7f204b7fe640 1 -- 172.21.15.12:0/2870105448 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f205c028420 con 0x562fa6bbdaf0 2024-09-19T06:48:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.766+0000 7f204b7fe640 1 -- 172.21.15.12:0/2870105448 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c01b640 con 0x562fa6bbdaf0 2024-09-19T06:48:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.767+0000 7f206aa18740 1 -- 172.21.15.12:0/2870105448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bbdaf0 msgr2=0x562fa6bc7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.767+0000 7f206aa18740 1 --2- 172.21.15.12:0/2870105448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc7f40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f205c00f860 tx=0x7f205c018000 comp rx=0 tx=0).stop 2024-09-19T06:48:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.767+0000 7f206aa18740 1 -- 172.21.15.12:0/2870105448 shutdown_connections 2024-09-19T06:48:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.767+0000 7f206aa18740 1 --2- 172.21.15.12:0/2870105448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bc8cb0 0x562fa6be07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.767+0000 7f206aa18740 1 --2- 172.21.15.12:0/2870105448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bc64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.767+0000 7f206aa18740 1 --2- 172.21.15.12:0/2870105448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bbdaf0 0x562fa6bc7f40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.767+0000 7f206aa18740 1 -- 172.21.15.12:0/2870105448 >> 172.21.15.12:0/2870105448 conn(0x562fa6bba060 msgr2=0x562fa6bc4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.768+0000 7f206aa18740 1 -- 172.21.15.12:0/2870105448 shutdown_connections 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.768+0000 7f206aa18740 1 -- 172.21.15.12:0/2870105448 wait complete. 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.768+0000 7f206aa18740 1 -- start start 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.768+0000 7f206aa18740 1 Processor -- start 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f206aa18740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bd0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f206aa18740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bd14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f206aa18740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bcc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f206aa18740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20601acc60 con 0x562fa6bbe410 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2065216640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bd14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2065216640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bd14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57168/0 (socket says 172.21.15.12:57168) 2024-09-19T06:48:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2065216640 1 -- 172.21.15.12:0/30654448 learned_addr learned my addr 172.21.15.12:0/30654448 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f206aa18740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20601ac590 con 0x562fa6bc8cb0 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f206aa18740 1 -- 172.21.15.12:0/30654448 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20601a9810 con 0x562fa6bbdaf0 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2066218640 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bcc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2065a17640 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bd0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f206aa18740 10 client.0 _ll_register_callbacks cb 0x7f205001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2066218640 1 -- 172.21.15.12:0/30654448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 msgr2=0x562fa6bd0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2066218640 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bd0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2066218640 1 -- 172.21.15.12:0/30654448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 msgr2=0x562fa6bd14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2066218640 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bd14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2066218640 1 -- 172.21.15.12:0/30654448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fa6bccc00 con 0x562fa6bc8cb0 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2065216640 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bd14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.769+0000 7f2065a17640 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bd0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f2066218640 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bcc400 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f20580ed3f0 tx=0x7f20580bc950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97560380c2aa6d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f20497fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f20497fa640 1 -- 172.21.15.12:0/30654448 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058035040 con 0x562fa6bc8cb0 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f20497fa640 1 -- 172.21.15.12:0/30654448 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f20580ed670 con 0x562fa6bc8cb0 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f206aa18740 1 -- 172.21.15.12:0/30654448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f205c028420 con 0x562fa6bc8cb0 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f20497fa640 1 -- 172.21.15.12:0/30654448 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f20580ed870 con 0x562fa6bc8cb0 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f206aa18740 10 client.27308 fetch_fsmap learned FSMap version 44 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f206aa18740 1 -- 172.21.15.12:0/30654448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x562fa6c433b0 con 0x562fa6bc8cb0 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f20497fa640 1 -- 172.21.15.12:0/30654448 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f205c028420 con 0x562fa6bc8cb0 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f20497fa640 1 -- 172.21.15.12:0/30654448 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f20580a7040 con 0x562fa6bc8cb0 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f206aa18740 10 client.27308 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f206aa18740 10 client.27308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:48:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f206aa18740 20 client.27308 populate_metadata read hostname 'smithi012' 2024-09-19T06:48:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f206aa18740 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fa6bd8c70 0x562fa6c45ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f206aa18740 4 client.27308 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:48:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.770+0000 7f206aa18740 1 -- 172.21.15.12:0/30654448 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562fa6b29d70 con 0x562fa6bd8c70 2024-09-19T06:48:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.771+0000 7f2065a17640 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fa6bd8c70 0x562fa6c45ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.771+0000 7f20497fa640 10 client.27308 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.771+0000 7f2065a17640 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fa6bd8c70 0x562fa6c45ae0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=587aeab479a39708 server_cookie=fea231de1a6b1d25 in_seq=0 out_seq=0 2024-09-19T06:48:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.780+0000 7f20497fa640 1 -- 172.21.15.12:0/30654448 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562fa6b29d70 con 0x562fa6bd8c70 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.780+0000 7f20497fa640 10 client.27308 handle_command_reply: tid=0 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 client.27308 shutdown 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 -- 172.21.15.12:0/30654448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 msgr2=0x562fa6bcc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bcc400 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f20580ed3f0 tx=0x7f20580bc950 comp rx=0 tx=0).stop 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 -- 172.21.15.12:0/30654448 shutdown_connections 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fa6bd8c70 0x562fa6c45ae0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fa6bc8cb0 0x562fa6bcc400 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fa6bbe410 0x562fa6bd14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f20497fa640 0 client.27308 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 --2- 172.21.15.12:0/30654448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fa6bbdaf0 0x562fa6bd0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 -- 172.21.15.12:0/30654448 >> 172.21.15.12:0/30654448 conn(0x562fa6bba060 msgr2=0x562fa6bbf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 -- 172.21.15.12:0/30654448 shutdown_connections 2024-09-19T06:48:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 1 -- 172.21.15.12:0/30654448 wait complete. 2024-09-19T06:48:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.781+0000 7f206aa18740 20 client.27308 trim_cache size 0 max 16384 2024-09-19T06:48:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:48:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:48:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:48:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:48:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 -- 172.21.15.12:0/2504814029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f204c0a34e0 msgr2=0x7f204c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f204c0a34e0 0x7f204c0a59a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f205c0099a0 tx=0x7f205c009500 comp rx=0 tx=0).stop 2024-09-19T06:48:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 -- 172.21.15.12:0/2504814029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2060106b10 msgr2=0x7f206019cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2060106b10 0x7f206019cbb0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f2058005ab0 tx=0x7f2058031b50 comp rx=0 tx=0).stop 2024-09-19T06:48:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 -- 172.21.15.12:0/2504814029 shutdown_connections 2024-09-19T06:48:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2060106b10 0x7f206019cbb0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2060100480 0x7f2060198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f204c0a34e0 0x7f204c0a59a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 --2- 172.21.15.12:0/2504814029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20600ffae0 0x7f20601982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 -- 172.21.15.12:0/2504814029 >> 172.21.15.12:0/2504814029 conn(0x7f20600fba30 msgr2=0x7f20600fc060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 -- 172.21.15.12:0/2504814029 shutdown_connections 2024-09-19T06:48:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:48:52.782+0000 7f2067c7b640 1 -- 172.21.15.12:0/2504814029 wait complete. 2024-09-19T06:48:54.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:53 smithi173 ceph-mon[35349]: pgmap v269: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 609 op/s 2024-09-19T06:48:54.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:53 smithi012 ceph-mon[30937]: pgmap v269: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 609 op/s 2024-09-19T06:48:54.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:53 smithi016 ceph-mon[34911]: pgmap v269: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 609 op/s 2024-09-19T06:48:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 490.0 s, 2966.8 tps, lat 33.648 ms stddev 37.629 2024-09-19T06:48:56.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:55 smithi173 ceph-mon[35349]: pgmap v270: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 743 op/s 2024-09-19T06:48:56.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:55 smithi012 ceph-mon[30937]: pgmap v270: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 743 op/s 2024-09-19T06:48:56.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:55 smithi016 ceph-mon[34911]: pgmap v270: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 743 op/s 2024-09-19T06:48:58.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:57 smithi012 ceph-mon[30937]: pgmap v271: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 857 op/s 2024-09-19T06:48:58.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:57 smithi016 ceph-mon[34911]: pgmap v271: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 857 op/s 2024-09-19T06:48:58.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:57 smithi173 ceph-mon[35349]: pgmap v271: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 857 op/s 2024-09-19T06:49:00.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:48:59 smithi012 ceph-mon[30937]: pgmap v272: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 616 op/s 2024-09-19T06:49:00.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:48:59 smithi016 ceph-mon[34911]: pgmap v272: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 616 op/s 2024-09-19T06:49:00.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:48:59 smithi173 ceph-mon[35349]: pgmap v272: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 616 op/s 2024-09-19T06:49:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 495.0 s, 3851.8 tps, lat 25.867 ms stddev 30.455 2024-09-19T06:49:02.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:01 smithi012 ceph-mon[30937]: pgmap v273: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-09-19T06:49:02.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:01 smithi016 ceph-mon[34911]: pgmap v273: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-09-19T06:49:02.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:01 smithi173 ceph-mon[35349]: pgmap v273: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-09-19T06:49:04.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:03 smithi012 ceph-mon[30937]: pgmap v274: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.6 MiB/s wr, 738 op/s 2024-09-19T06:49:04.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:03 smithi016 ceph-mon[34911]: pgmap v274: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.6 MiB/s wr, 738 op/s 2024-09-19T06:49:04.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:03 smithi173 ceph-mon[35349]: pgmap v274: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.6 MiB/s wr, 738 op/s 2024-09-19T06:49:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 500.0 s, 471.8 tps, lat 207.579 ms stddev 192.900 2024-09-19T06:49:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.886+0000 7f763f423640 1 -- 172.21.15.12:0/294501776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7638106a00 msgr2=0x7f7638106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.886+0000 7f763f423640 1 --2- 172.21.15.12:0/294501776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7638106a00 0x7f7638106de0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7634009930 tx=0x7f763402a420 comp rx=0 tx=0).stop 2024-09-19T06:49:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.886+0000 7f763f423640 1 -- 172.21.15.12:0/294501776 shutdown_connections 2024-09-19T06:49:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.886+0000 7f763f423640 1 --2- 172.21.15.12:0/294501776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7638101390 0x7f763810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.886+0000 7f763f423640 1 --2- 172.21.15.12:0/294501776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76381009f0 0x7f7638100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.886+0000 7f763f423640 1 --2- 172.21.15.12:0/294501776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7638106a00 0x7f7638106de0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.886+0000 7f763f423640 1 -- 172.21.15.12:0/294501776 >> 172.21.15.12:0/294501776 conn(0x7f76380fc6b0 msgr2=0x7f76380fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.886+0000 7f763f423640 1 -- 172.21.15.12:0/294501776 shutdown_connections 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.886+0000 7f763f423640 1 -- 172.21.15.12:0/294501776 wait complete. 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763f423640 1 Processor -- start 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763f423640 1 -- start start 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763f423640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76381009f0 0x7f7638199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763f423640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7638101390 0x7f7638199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763f423640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7638106a00 0x7f76381a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763f423640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7638110e90 con 0x7f7638101390 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763f423640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7638110d10 con 0x7f76381009f0 2024-09-19T06:49:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763f423640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7638111010 con 0x7f7638106a00 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763c9be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7638101390 0x7f7638199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763d1bf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76381009f0 0x7f7638199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763c9be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7638101390 0x7f7638199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42596/0 (socket says 172.21.15.12:42596) 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763d1bf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76381009f0 0x7f7638199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45366/0 (socket says 172.21.15.12:45366) 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763c9be640 1 -- 172.21.15.12:0/1258176709 learned_addr learned my addr 172.21.15.12:0/1258176709 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763d9c0640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7638106a00 0x7f76381a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763c9be640 1 -- 172.21.15.12:0/1258176709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7638106a00 msgr2=0x7f76381a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763c9be640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7638106a00 0x7f76381a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763c9be640 1 -- 172.21.15.12:0/1258176709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76381009f0 msgr2=0x7f7638199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763c9be640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76381009f0 0x7f7638199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763c9be640 1 -- 172.21.15.12:0/1258176709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76381a47c0 con 0x7f7638101390 2024-09-19T06:49:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.887+0000 7f763d1bf640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76381009f0 0x7f7638199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.888+0000 7f763c9be640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7638101390 0x7f7638199740 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f762800e9f0 tx=0x7f762800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.888+0000 7f762e7fc640 1 -- 172.21.15.12:0/1258176709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762800cd80 con 0x7f7638101390 2024-09-19T06:49:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.888+0000 7f762e7fc640 1 -- 172.21.15.12:0/1258176709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7628005500 con 0x7f7638101390 2024-09-19T06:49:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.888+0000 7f763f423640 1 -- 172.21.15.12:0/1258176709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76381a4990 con 0x7f7638101390 2024-09-19T06:49:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.888+0000 7f762e7fc640 1 -- 172.21.15.12:0/1258176709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628010690 con 0x7f7638101390 2024-09-19T06:49:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.888+0000 7f763f423640 1 -- 172.21.15.12:0/1258176709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76381a4eb0 con 0x7f7638101390 2024-09-19T06:49:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.890+0000 7f76421ba740 1 Processor -- start 2024-09-19T06:49:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.890+0000 7f762e7fc640 1 -- 172.21.15.12:0/1258176709 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f76280046c0 con 0x7f7638101390 2024-09-19T06:49:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f76421ba740 1 -- start start 2024-09-19T06:49:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f76421ba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed716bc0 0x5571ed716fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f76421ba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed712ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f76421ba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 0x5571ed71eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f76421ba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5571ed66d2f0 con 0x5571ed716bc0 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f76421ba740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5571ed615270 con 0x5571ed713020 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f76421ba740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5571ed6692b0 con 0x5571ed712680 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763d9c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed716bc0 0x5571ed716fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763c9be640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 0x5571ed71eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763d1bf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed712ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763d9c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed716bc0 0x5571ed716fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42602/0 (socket says 172.21.15.12:42602) 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763d9c0640 1 -- 172.21.15.12:0/842509185 learned_addr learned my addr 172.21.15.12:0/842509185 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763d1bf640 1 -- 172.21.15.12:0/842509185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 msgr2=0x5571ed71eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763d1bf640 1 --2- 172.21.15.12:0/842509185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 0x5571ed71eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763d1bf640 1 -- 172.21.15.12:0/842509185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed716bc0 msgr2=0x5571ed716fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763d1bf640 1 --2- 172.21.15.12:0/842509185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed716bc0 0x5571ed716fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763d1bf640 1 -- 172.21.15.12:0/842509185 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ed614340 con 0x5571ed712680 2024-09-19T06:49:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f763d9c0640 1 --2- 172.21.15.12:0/842509185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed716bc0 0x5571ed716fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.891+0000 7f762e7fc640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76240a34e0 0x7f76240a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.892+0000 7f763d9c0640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76240a34e0 0x7f76240a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.892+0000 7f762e7fc640 1 -- 172.21.15.12:0/1258176709 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f76280d01f0 con 0x7f7638101390 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.892+0000 7f763d1bf640 1 --2- 172.21.15.12:0/842509185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed712ae0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f763402a940 tx=0x7f7634000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f501bbf8b7f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.892+0000 7f76237fe640 1 -- 172.21.15.12:0/842509185 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634035040 con 0x5571ed712680 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.892+0000 7f76237fe640 1 -- 172.21.15.12:0/842509185 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7634004760 con 0x5571ed712680 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.892+0000 7f76237fe640 1 -- 172.21.15.12:0/842509185 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76340038e0 con 0x5571ed712680 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 -- 172.21.15.12:0/842509185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 msgr2=0x5571ed712ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f763d9c0640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76240a34e0 0x7f76240a59a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f76300117b0 tx=0x7f7630009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 --2- 172.21.15.12:0/842509185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed712ae0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f763402a940 tx=0x7f7634000bc0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 -- 172.21.15.12:0/842509185 shutdown_connections 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 --2- 172.21.15.12:0/842509185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 0x5571ed71eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 --2- 172.21.15.12:0/842509185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed712ae0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 --2- 172.21.15.12:0/842509185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed716bc0 0x5571ed716fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 -- 172.21.15.12:0/842509185 >> 172.21.15.12:0/842509185 conn(0x5571ed704b10 msgr2=0x5571ed704ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 -- 172.21.15.12:0/842509185 shutdown_connections 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 -- 172.21.15.12:0/842509185 wait complete. 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 -- start start 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.893+0000 7f76421ba740 1 Processor -- start 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f76421ba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed71be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f76421ba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed713020 0x5571ed71c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f76421ba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed716bc0 0x5571ed71c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763d1bf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed71be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763c9be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed713020 0x5571ed71c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763d1bf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed71be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:37712/0 (socket says 172.21.15.12:37712) 2024-09-19T06:49:05.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763c9be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed713020 0x5571ed71c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42610/0 (socket says 172.21.15.12:42610) 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763d1bf640 1 -- 172.21.15.12:0/1978463209 learned_addr learned my addr 172.21.15.12:0/1978463209 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763d9c0640 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed716bc0 0x5571ed71c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5571ed71f060 con 0x5571ed713020 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5571ed5f6290 con 0x5571ed716bc0 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5571ed71f1e0 con 0x5571ed712680 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763d1bf640 1 -- 172.21.15.12:0/1978463209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed716bc0 msgr2=0x5571ed71c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763d1bf640 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed716bc0 0x5571ed71c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763d1bf640 1 -- 172.21.15.12:0/1978463209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed713020 msgr2=0x5571ed71c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763d1bf640 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed713020 0x5571ed71c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763d1bf640 1 -- 172.21.15.12:0/1978463209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ed380210 con 0x5571ed712680 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f763c9be640 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed713020 0x5571ed71c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.894+0000 7f76421ba740 10 client.0 _ll_register_callbacks cb 0x5571ed627140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7634004760 con 0x5571ed712680 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f763d1bf640 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed71be80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7634003870 tx=0x7f7634004560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5b88a5d1628f12f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f7620ff9640 10 client.27274 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f7620ff9640 1 -- 172.21.15.12:0/1978463209 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634035050 con 0x5571ed712680 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f7620ff9640 1 -- 172.21.15.12:0/1978463209 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f7634003c60 con 0x5571ed712680 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f7620ff9640 1 -- 172.21.15.12:0/1978463209 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f7634003ea0 con 0x5571ed712680 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f76421ba740 10 client.27274 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=44}) -- 0x5571ed44c620 con 0x5571ed712680 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f7620ff9640 1 -- 172.21.15.12:0/1978463209 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f763404e470 con 0x5571ed712680 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f76421ba740 10 client.27274 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f76421ba740 10 client.27274 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f76421ba740 20 client.27274 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f76421ba740 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5571ed72bee0 0x5571ed72e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f76421ba740 4 client.27274 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.895+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571ed67aa20 con 0x5571ed72bee0 2024-09-19T06:49:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.896+0000 7f763c9be640 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5571ed72bee0 0x5571ed72e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.896+0000 7f7620ff9640 10 client.27274 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.896+0000 7f763c9be640 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5571ed72bee0 0x5571ed72e2d0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f67ac9fc14f3f1f server_cookie=3b64836b9a4f0171 in_seq=0 out_seq=0 2024-09-19T06:49:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f7620ff9640 1 -- 172.21.15.12:0/1978463209 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571ed67aa20 con 0x5571ed72bee0 2024-09-19T06:49:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f7620ff9640 10 client.27274 handle_command_reply: tid=0 2024-09-19T06:49:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 client.27274 shutdown 2024-09-19T06:49:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 msgr2=0x5571ed71be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed71be80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7634003870 tx=0x7f7634004560 comp rx=0 tx=0).stop 2024-09-19T06:49:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 shutdown_connections 2024-09-19T06:49:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5571ed72bee0 0x5571ed72e2d0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed716bc0 0x5571ed71c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed713020 0x5571ed71c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 --2- 172.21.15.12:0/1978463209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed712680 0x5571ed71be80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 >> 172.21.15.12:0/1978463209 conn(0x5571ed704b10 msgr2=0x5571ed711e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f7620ff9640 0 client.27274 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 shutdown_connections 2024-09-19T06:49:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 1 -- 172.21.15.12:0/1978463209 wait complete. 2024-09-19T06:49:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.897+0000 7f76421ba740 20 client.27274 trim_cache size 0 max 16384 2024-09-19T06:49:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f76421ba740 1 Processor -- start 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f76421ba740 1 -- start start 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f76421ba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed7199f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f76421ba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed713020 0x5571ed71a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f76421ba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed716bc0 0x5571ed71ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f76421ba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f76381ab7d0 con 0x5571ed712680 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f76421ba740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f76381ad310 con 0x5571ed716bc0 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f76421ba740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f76381abea0 con 0x5571ed713020 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f763d1bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed7199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f763d1bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed7199f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42616/0 (socket says 172.21.15.12:42616) 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f763d1bf640 1 -- 172.21.15.12:0/2096488906 learned_addr learned my addr 172.21.15.12:0/2096488906 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f763d9c0640 1 --2- 172.21.15.12:0/2096488906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed716bc0 0x5571ed71ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.913+0000 7f763c9be640 1 --2- 172.21.15.12:0/2096488906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed713020 0x5571ed71a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.914+0000 7f763d1bf640 1 -- 172.21.15.12:0/2096488906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed713020 msgr2=0x5571ed71a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.914+0000 7f763d1bf640 1 --2- 172.21.15.12:0/2096488906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed713020 0x5571ed71a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.914+0000 7f763d1bf640 1 -- 172.21.15.12:0/2096488906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed716bc0 msgr2=0x5571ed71ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.914+0000 7f763d1bf640 1 --2- 172.21.15.12:0/2096488906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed716bc0 0x5571ed71ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.914+0000 7f763d1bf640 1 -- 172.21.15.12:0/2096488906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ed71ce50 con 0x5571ed712680 2024-09-19T06:49:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.914+0000 7f763d1bf640 1 --2- 172.21.15.12:0/2096488906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed7199f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7634009800 tx=0x7f7634049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9a856df4f2a056 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.914+0000 7f7622ffd640 1 -- 172.21.15.12:0/2096488906 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634035040 con 0x5571ed712680 2024-09-19T06:49:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.914+0000 7f7622ffd640 1 -- 172.21.15.12:0/2096488906 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7634004760 con 0x5571ed712680 2024-09-19T06:49:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.914+0000 7f7622ffd640 1 -- 172.21.15.12:0/2096488906 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634031b10 con 0x5571ed712680 2024-09-19T06:49:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.915+0000 7f76421ba740 1 -- 172.21.15.12:0/2096488906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 msgr2=0x5571ed7199f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.915+0000 7f76421ba740 1 --2- 172.21.15.12:0/2096488906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed7199f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7634009800 tx=0x7f7634049000 comp rx=0 tx=0).stop 2024-09-19T06:49:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.915+0000 7f76421ba740 1 -- 172.21.15.12:0/2096488906 shutdown_connections 2024-09-19T06:49:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.915+0000 7f76421ba740 1 --2- 172.21.15.12:0/2096488906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed716bc0 0x5571ed71ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.915+0000 7f76421ba740 1 --2- 172.21.15.12:0/2096488906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed713020 0x5571ed71a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.915+0000 7f76421ba740 1 --2- 172.21.15.12:0/2096488906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed7199f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.915+0000 7f76421ba740 1 -- 172.21.15.12:0/2096488906 >> 172.21.15.12:0/2096488906 conn(0x5571ed704b10 msgr2=0x5571ed714fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.915+0000 7f76421ba740 1 -- 172.21.15.12:0/2096488906 shutdown_connections 2024-09-19T06:49:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.915+0000 7f76421ba740 1 -- 172.21.15.12:0/2096488906 wait complete. 2024-09-19T06:49:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.916+0000 7f76421ba740 1 -- start start 2024-09-19T06:49:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.916+0000 7f76421ba740 1 Processor -- start 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.916+0000 7f76421ba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed733c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.916+0000 7f76421ba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 0x5571ed7341c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.916+0000 7f76421ba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed716bc0 0x5571ed724590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.916+0000 7f76421ba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f76381acc40 con 0x5571ed712680 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.916+0000 7f76421ba740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f76381ac570 con 0x5571ed713020 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.916+0000 7f76421ba740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f76381a9820 con 0x5571ed716bc0 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.916+0000 7f76421ba740 10 client.0 _ll_register_callbacks cb 0x7f76300099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763d1bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed733c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763c9be640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 0x5571ed7341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763d1bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed733c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42618/0 (socket says 172.21.15.12:42618) 2024-09-19T06:49:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763d9c0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed716bc0 0x5571ed724590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763d1bf640 1 -- 172.21.15.12:0/3982382400 learned_addr learned my addr 172.21.15.12:0/3982382400 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763c9be640 1 -- 172.21.15.12:0/3982382400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed716bc0 msgr2=0x5571ed724590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763c9be640 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed716bc0 0x5571ed724590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763c9be640 1 -- 172.21.15.12:0/3982382400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 msgr2=0x5571ed733c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763c9be640 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed733c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763c9be640 1 -- 172.21.15.12:0/3982382400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ed724dc0 con 0x5571ed713020 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763d1bf640 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed733c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f763c9be640 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 0x5571ed7341c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76280cd8a0 tx=0x7f76280d3d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6b40adff19f93f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f7620ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f7620ff9640 1 -- 172.21.15.12:0/3982382400 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76280986d0 con 0x5571ed713020 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.917+0000 7f76421ba740 1 -- 172.21.15.12:0/3982382400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7634004760 con 0x5571ed713020 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f7620ff9640 1 -- 172.21.15.12:0/3982382400 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f7628098aa0 con 0x5571ed713020 2024-09-19T06:49:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f7620ff9640 1 -- 172.21.15.12:0/3982382400 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f762809bd90 con 0x5571ed713020 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f76421ba740 10 client.27326 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f76421ba740 1 -- 172.21.15.12:0/3982382400 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5571ed714350 con 0x5571ed713020 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f7620ff9640 1 -- 172.21.15.12:0/3982382400 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7634004760 con 0x5571ed713020 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f7620ff9640 1 -- 172.21.15.12:0/3982382400 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f76280abe80 con 0x5571ed713020 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f76421ba740 10 client.27326 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f76421ba740 10 client.27326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f76421ba740 20 client.27326 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f76421ba740 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5571ed796ee0 0x5571ed7992d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f76421ba740 4 client.27326 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f76421ba740 1 -- 172.21.15.12:0/3982382400 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5571ed674d70 con 0x5571ed796ee0 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.918+0000 7f763d1bf640 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5571ed796ee0 0x5571ed7992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:05.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.919+0000 7f7620ff9640 10 client.27326 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.919+0000 7f763d1bf640 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5571ed796ee0 0x5571ed7992d0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8dff9d64d9a6a74 server_cookie=a04c3fd9dab972fc in_seq=0 out_seq=0 2024-09-19T06:49:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f7620ff9640 1 -- 172.21.15.12:0/3982382400 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5571ed674d70 con 0x5571ed796ee0 2024-09-19T06:49:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f7620ff9640 10 client.27326 handle_command_reply: tid=0 2024-09-19T06:49:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f76421ba740 1 client.27326 shutdown 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f76421ba740 1 -- 172.21.15.12:0/3982382400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 msgr2=0x5571ed7341c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f76421ba740 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 0x5571ed7341c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76280cd8a0 tx=0x7f76280d3d40 comp rx=0 tx=0).stop 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f76421ba740 1 -- 172.21.15.12:0/3982382400 shutdown_connections 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f76421ba740 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5571ed796ee0 0x5571ed7992d0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f76421ba740 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571ed716bc0 0x5571ed724590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f76421ba740 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5571ed713020 0x5571ed7341c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f76421ba740 1 --2- 172.21.15.12:0/3982382400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571ed712680 0x5571ed733c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f7620ff9640 0 client.27326 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.930+0000 7f76421ba740 1 -- 172.21.15.12:0/3982382400 >> 172.21.15.12:0/3982382400 conn(0x5571ed704b10 msgr2=0x5571ed71a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f76421ba740 1 -- 172.21.15.12:0/3982382400 shutdown_connections 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f76421ba740 1 -- 172.21.15.12:0/3982382400 wait complete. 2024-09-19T06:49:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f76421ba740 20 client.27326 trim_cache size 0 max 16384 2024-09-19T06:49:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:49:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:49:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:49:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:49:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 -- 172.21.15.12:0/1258176709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76240a34e0 msgr2=0x7f76240a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76240a34e0 0x7f76240a59a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f76300117b0 tx=0x7f7630009500 comp rx=0 tx=0).stop 2024-09-19T06:49:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 -- 172.21.15.12:0/1258176709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7638101390 msgr2=0x7f7638199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7638101390 0x7f7638199740 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f762800e9f0 tx=0x7f762800edf0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 -- 172.21.15.12:0/1258176709 shutdown_connections 2024-09-19T06:49:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76240a34e0 0x7f76240a59a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7638106a00 0x7f76381a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7638101390 0x7f7638199740 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 --2- 172.21.15.12:0/1258176709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76381009f0 0x7f7638199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 -- 172.21.15.12:0/1258176709 >> 172.21.15.12:0/1258176709 conn(0x7f76380fc6b0 msgr2=0x7f76380fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 -- 172.21.15.12:0/1258176709 shutdown_connections 2024-09-19T06:49:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:05.931+0000 7f763f423640 1 -- 172.21.15.12:0/1258176709 wait complete. 2024-09-19T06:49:06.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:05 smithi012 ceph-mon[30937]: pgmap v275: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.9 MiB/s wr, 780 op/s 2024-09-19T06:49:06.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:05 smithi016 ceph-mon[34911]: pgmap v275: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.9 MiB/s wr, 780 op/s 2024-09-19T06:49:06.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:05 smithi173 ceph-mon[35349]: pgmap v275: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.9 MiB/s wr, 780 op/s 2024-09-19T06:49:07.653 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:49:07.947 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:08.074 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:07 smithi012 ceph-mon[30937]: pgmap v276: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.2 MiB/s wr, 868 op/s 2024-09-19T06:49:08.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:07 smithi016 ceph-mon[34911]: pgmap v276: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.2 MiB/s wr, 868 op/s 2024-09-19T06:49:08.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:07 smithi173 ceph-mon[35349]: pgmap v276: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.2 MiB/s wr, 868 op/s 2024-09-19T06:49:08.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.558+0000 7f5e849f3640 1 -- 172.21.15.12:0/1613394349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e80102d30 msgr2=0x7f5e80103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:08.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.558+0000 7f5e849f3640 1 --2- 172.21.15.12:0/1613394349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e80102d30 0x7f5e80103110 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009cd0 tx=0x7f5e7802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.558+0000 7f5e849f3640 1 -- 172.21.15.12:0/1613394349 shutdown_connections 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.558+0000 7f5e849f3640 1 --2- 172.21.15.12:0/1613394349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e801082a0 0x7f5e8010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.558+0000 7f5e849f3640 1 --2- 172.21.15.12:0/1613394349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e801036e0 0x7f5e80107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.558+0000 7f5e849f3640 1 --2- 172.21.15.12:0/1613394349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e80102d30 0x7f5e80103110 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.558+0000 7f5e849f3640 1 -- 172.21.15.12:0/1613394349 >> 172.21.15.12:0/1613394349 conn(0x7f5e800fc7d0 msgr2=0x7f5e800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.558+0000 7f5e849f3640 1 -- 172.21.15.12:0/1613394349 shutdown_connections 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.558+0000 7f5e849f3640 1 -- 172.21.15.12:0/1613394349 wait complete. 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.559+0000 7f5e849f3640 1 Processor -- start 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.559+0000 7f5e849f3640 1 -- start start 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.559+0000 7f5e849f3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e80102d30 0x7f5e80100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.559+0000 7f5e849f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e801036e0 0x7f5e80100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.559+0000 7f5e849f3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e801082a0 0x7f5e80101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.559+0000 7f5e849f3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e801120a0 con 0x7f5e801036e0 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.559+0000 7f5e849f3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80111f20 con 0x7f5e80102d30 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.559+0000 7f5e849f3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80112220 con 0x7f5e801082a0 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.559+0000 7f5e7dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e801036e0 0x7f5e80100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e80102d30 0x7f5e80100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e801036e0 0x7f5e80100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42638/0 (socket says 172.21.15.12:42638) 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7dd9b640 1 -- 172.21.15.12:0/2942393957 learned_addr learned my addr 172.21.15.12:0/2942393957 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e80102d30 0x7f5e80100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45408/0 (socket says 172.21.15.12:45408) 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e801082a0 0x7f5e80101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7e59c640 1 -- 172.21.15.12:0/2942393957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e801082a0 msgr2=0x7f5e80101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e801082a0 0x7f5e80101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7e59c640 1 -- 172.21.15.12:0/2942393957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e801036e0 msgr2=0x7f5e80100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e801036e0 0x7f5e80100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7e59c640 1 -- 172.21.15.12:0/2942393957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e801a6a60 con 0x7f5e80102d30 2024-09-19T06:49:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e801082a0 0x7f5e80101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7dd9b640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e801036e0 0x7f5e80100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e80102d30 0x7f5e80100990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5e78000f80 tx=0x7f5e78031e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e777fe640 1 -- 172.21.15.12:0/2942393957 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78003e40 con 0x7f5e80102d30 2024-09-19T06:49:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e777fe640 1 -- 172.21.15.12:0/2942393957 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e78004520 con 0x7f5e80102d30 2024-09-19T06:49:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.560+0000 7f5e849f3640 1 -- 172.21.15.12:0/2942393957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e801a6cf0 con 0x7f5e80102d30 2024-09-19T06:49:08.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.561+0000 7f5e777fe640 1 -- 172.21.15.12:0/2942393957 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e78030d10 con 0x7f5e80102d30 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.561+0000 7f5e849f3640 1 -- 172.21.15.12:0/2942393957 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e801a71d0 con 0x7f5e80102d30 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.563+0000 7f5e777fe640 1 -- 172.21.15.12:0/2942393957 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5e780046d0 con 0x7f5e80102d30 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.563+0000 7f5e86dcc740 1 Processor -- start 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e86dcc740 1 -- start start 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a2f5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 0x56047a300140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 0x56047a302a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e86dcc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56047a25b2e0 con 0x56047a300680 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e86dcc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56047a202ce0 con 0x56047a2f5dc0 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e86dcc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56047a2572a0 con 0x56047a2f54a0 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e7ed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a2f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e7ed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a2f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:37750/0 (socket says 172.21.15.12:37750) 2024-09-19T06:49:08.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e7ed9d640 1 -- 172.21.15.12:0/990869833 learned_addr learned my addr 172.21.15.12:0/990869833 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 0x56047a300140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e7dd9b640 1 --2- 172.21.15.12:0/990869833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 0x56047a302a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.564+0000 7f5e777fe640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e6c0a33b0 0x7f5e6c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e7ed9d640 1 -- 172.21.15.12:0/990869833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 msgr2=0x56047a300140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/990869833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 0x56047a300140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e7ed9d640 1 -- 172.21.15.12:0/990869833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 msgr2=0x56047a302a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/990869833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 0x56047a302a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e7ed9d640 1 -- 172.21.15.12:0/990869833 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047a1e7440 con 0x56047a2f54a0 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e7dd9b640 1 --2- 172.21.15.12:0/990869833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 0x56047a302a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e777fe640 1 -- 172.21.15.12:0/2942393957 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f5e7802e030 con 0x7f5e80102d30 2024-09-19T06:49:08.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e6c0a33b0 0x7f5e6c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/990869833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a2f5880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5e70011540 tx=0x7f5e70011940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bce98a359d3e6494 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e74ff9640 1 -- 172.21.15.12:0/990869833 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70017050 con 0x56047a2f54a0 2024-09-19T06:49:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e74ff9640 1 -- 172.21.15.12:0/990869833 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e7001bc20 con 0x56047a2f54a0 2024-09-19T06:49:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e74ff9640 1 -- 172.21.15.12:0/990869833 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e700269a0 con 0x56047a2f54a0 2024-09-19T06:49:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.565+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e6c0a33b0 0x7f5e6c0a5870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e70023000 tx=0x7f5e70024000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.566+0000 7f5e86dcc740 1 -- 172.21.15.12:0/990869833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 msgr2=0x56047a2f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:08.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.566+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/990869833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a2f5880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5e70011540 tx=0x7f5e70011940 comp rx=0 tx=0).stop 2024-09-19T06:49:08.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.566+0000 7f5e86dcc740 1 -- 172.21.15.12:0/990869833 shutdown_connections 2024-09-19T06:49:08.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.567+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/990869833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 0x56047a302a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.567+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/990869833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 0x56047a300140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.567+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/990869833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a2f5880 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.567+0000 7f5e86dcc740 1 -- 172.21.15.12:0/990869833 >> 172.21.15.12:0/990869833 conn(0x56047a2f1a30 msgr2=0x56047a2f1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:08.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.567+0000 7f5e86dcc740 1 -- 172.21.15.12:0/990869833 shutdown_connections 2024-09-19T06:49:08.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.567+0000 7f5e86dcc740 1 -- 172.21.15.12:0/990869833 wait complete. 2024-09-19T06:49:08.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.567+0000 7f5e86dcc740 1 -- start start 2024-09-19T06:49:08.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.567+0000 7f5e86dcc740 1 Processor -- start 2024-09-19T06:49:08.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a2fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 0x56047a2fd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 0x56047a2fd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e7dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 0x56047a2fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e7ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 0x56047a2fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e7dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 0x56047a2fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45426/0 (socket says 172.21.15.12:45426) 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e7dd9b640 1 -- 172.21.15.12:0/2211264413 learned_addr learned my addr 172.21.15.12:0/2211264413 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56047a303250 con 0x56047a300680 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56047a216050 con 0x56047a2f5dc0 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56047a3033d0 con 0x56047a2f54a0 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e86dcc740 10 client.0 _ll_register_callbacks cb 0x56047a256160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a2fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e7dd9b640 1 -- 172.21.15.12:0/2211264413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 msgr2=0x56047a2fffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e7dd9b640 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a2fffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e7dd9b640 1 -- 172.21.15.12:0/2211264413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 msgr2=0x56047a2fd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e7dd9b640 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 0x56047a2fd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.568+0000 7f5e7dd9b640 1 -- 172.21.15.12:0/2211264413 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560479fcc3c0 con 0x56047a2f5dc0 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.569+0000 7f5e7dd9b640 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 0x56047a2fd260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5e68012d20 tx=0x7f5e6800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=402339df10cd1fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.569+0000 7f5e65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.569+0000 7f5e65ffb640 1 -- 172.21.15.12:0/2211264413 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e680120d0 con 0x56047a2f5dc0 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.569+0000 7f5e65ffb640 1 -- 172.21.15.12:0/2211264413 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f5e68004020 con 0x56047a2f5dc0 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.569+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e7001bc20 con 0x56047a2f5dc0 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.569+0000 7f5e65ffb640 1 -- 172.21.15.12:0/2211264413 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5e68012270 con 0x56047a2f5dc0 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.569+0000 7f5e86dcc740 10 client.27338 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:08.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.569+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56047a30ec20 con 0x56047a2f5dc0 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.569+0000 7f5e65ffb640 1 -- 172.21.15.12:0/2211264413 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e68004220 con 0x56047a2f5dc0 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.569+0000 7f5e65ffb640 1 -- 172.21.15.12:0/2211264413 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f5e6801c500 con 0x56047a2f5dc0 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.570+0000 7f5e86dcc740 10 client.27338 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.570+0000 7f5e86dcc740 10 client.27338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.570+0000 7f5e86dcc740 20 client.27338 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.570+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56047a310130 0x56047a3125b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.570+0000 7f5e86dcc740 4 client.27338 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.570+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5e7001bc20 con 0x56047a310130 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.571+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56047a310130 0x56047a3125b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.571+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56047a310130 0x56047a3125b0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7719e053ab4796b2 server_cookie=3a0c8bfd3344b3a in_seq=0 out_seq=0 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.571+0000 7f5e65ffb640 10 client.27338 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e65ffb640 1 -- 172.21.15.12:0/2211264413 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5e7001bc20 con 0x56047a310130 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e65ffb640 10 client.27338 handle_command_reply: tid=0 2024-09-19T06:49:08.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 client.27338 shutdown 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 msgr2=0x56047a2fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 0x56047a2fd260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5e68012d20 tx=0x7f5e6800f790 comp rx=0 tx=0).stop 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 shutdown_connections 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56047a310130 0x56047a3125b0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a300680 0x56047a2fd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f5dc0 0x56047a2fd260 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/2211264413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a2fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 >> 172.21.15.12:0/2211264413 conn(0x56047a2f1a30 msgr2=0x56047a2f7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e65ffb640 0 client.27338 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 shutdown_connections 2024-09-19T06:49:08.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.572+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2211264413 wait complete. 2024-09-19T06:49:08.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.573+0000 7f5e86dcc740 20 client.27338 trim_cache size 0 max 16384 2024-09-19T06:49:08.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e86dcc740 1 Processor -- start 2024-09-19T06:49:08.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e86dcc740 1 -- start start 2024-09-19T06:49:08.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f54a0 0x56047a30c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 0x56047a317e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a300680 0x56047a3183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e86dcc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e801afdc0 con 0x56047a2f5dc0 2024-09-19T06:49:08.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e86dcc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5e801b1900 con 0x56047a2f54a0 2024-09-19T06:49:08.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e86dcc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5e801b0490 con 0x56047a300680 2024-09-19T06:49:08.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f54a0 0x56047a30c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e7dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 0x56047a317e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f54a0 0x56047a30c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45430/0 (socket says 172.21.15.12:45430) 2024-09-19T06:49:08.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e7e59c640 1 -- 172.21.15.12:0/2048782661 learned_addr learned my addr 172.21.15.12:0/2048782661 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:08.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.595+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/2048782661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a300680 0x56047a3183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.596+0000 7f5e7e59c640 1 -- 172.21.15.12:0/2048782661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a300680 msgr2=0x56047a3183c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:08.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.596+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/2048782661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a300680 0x56047a3183c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.596+0000 7f5e7e59c640 1 -- 172.21.15.12:0/2048782661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 msgr2=0x56047a317e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:08.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.596+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/2048782661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 0x56047a317e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.596+0000 7f5e7e59c640 1 -- 172.21.15.12:0/2048782661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56047a3002e0 con 0x56047a2f54a0 2024-09-19T06:49:08.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.596+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/2048782661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f54a0 0x56047a30c4b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5e78032f10 tx=0x7f5e7803d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21caa0a474c7015d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:08.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.596+0000 7f5e67fff640 1 -- 172.21.15.12:0/2048782661 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780dd040 con 0x56047a2f54a0 2024-09-19T06:49:08.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.596+0000 7f5e67fff640 1 -- 172.21.15.12:0/2048782661 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e78036040 con 0x56047a2f54a0 2024-09-19T06:49:08.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.596+0000 7f5e67fff640 1 -- 172.21.15.12:0/2048782661 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780305a0 con 0x56047a2f54a0 2024-09-19T06:49:08.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.597+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2048782661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f54a0 msgr2=0x56047a30c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.597+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/2048782661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f54a0 0x56047a30c4b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5e78032f10 tx=0x7f5e7803d040 comp rx=0 tx=0).stop 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.597+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2048782661 shutdown_connections 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.597+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/2048782661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a300680 0x56047a3183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.597+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/2048782661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 0x56047a317e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.597+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/2048782661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a2f54a0 0x56047a30c4b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.597+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2048782661 >> 172.21.15.12:0/2048782661 conn(0x56047a2f1a30 msgr2=0x56047a2f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.598+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2048782661 shutdown_connections 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.598+0000 7f5e86dcc740 1 -- 172.21.15.12:0/2048782661 wait complete. 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.598+0000 7f5e86dcc740 1 -- start start 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.598+0000 7f5e86dcc740 1 Processor -- start 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a308bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 0x56047a303ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e86dcc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a300680 0x56047a304430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e86dcc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e801b1230 con 0x56047a2f5dc0 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e86dcc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5e801b0b60 con 0x56047a300680 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e86dcc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5e801addc0 con 0x56047a2f54a0 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e86dcc740 10 client.0 _ll_register_callbacks cb 0x7f5e68009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a308bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a300680 0x56047a304430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 0x56047a303ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a308bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:37780/0 (socket says 172.21.15.12:37780) 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 0x56047a303ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42678/0 (socket says 172.21.15.12:42678) 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7e59c640 1 -- 172.21.15.12:0/4080608670 learned_addr learned my addr 172.21.15.12:0/4080608670 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7ed9d640 1 -- 172.21.15.12:0/4080608670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 msgr2=0x56047a308bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a308bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7ed9d640 1 -- 172.21.15.12:0/4080608670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 msgr2=0x56047a303ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 0x56047a303ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.599+0000 7f5e7ed9d640 1 -- 172.21.15.12:0/4080608670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56047a304a70 con 0x56047a300680 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.600+0000 7f5e7ed9d640 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a300680 0x56047a304430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x56047a2f29d0 tx=0x7f5e70004710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e1a52accbec264 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.600+0000 7f5e65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.600+0000 7f5e65ffb640 1 -- 172.21.15.12:0/4080608670 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70035020 con 0x56047a300680 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.600+0000 7f5e65ffb640 1 -- 172.21.15.12:0/4080608670 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8687+0+0 (secure 0 0 0) 0x7f5e70026850 con 0x56047a300680 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.600+0000 7f5e86dcc740 1 -- 172.21.15.12:0/4080608670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e78036040 con 0x56047a300680 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.600+0000 7f5e65ffb640 1 -- 172.21.15.12:0/4080608670 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5e70017020 con 0x56047a300680 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.600+0000 7f5e86dcc740 10 client.27344 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.600+0000 7f5e86dcc740 1 -- 172.21.15.12:0/4080608670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56047a37acb0 con 0x56047a300680 2024-09-19T06:49:08.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.600+0000 7f5e65ffb640 1 -- 172.21.15.12:0/4080608670 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e70009d10 con 0x56047a300680 2024-09-19T06:49:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.600+0000 7f5e65ffb640 1 -- 172.21.15.12:0/4080608670 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f5e700316e0 con 0x56047a300680 2024-09-19T06:49:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e86dcc740 10 client.27344 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e86dcc740 10 client.27344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e86dcc740 20 client.27344 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56047a37b310 0x56047a37d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e86dcc740 4 client.27344 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:49:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e86dcc740 1 -- 172.21.15.12:0/4080608670 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f5e78036040 con 0x56047a37b310 2024-09-19T06:49:08.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56047a37b310 0x56047a37d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e65ffb640 10 client.27344 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e7e59c640 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56047a37b310 0x56047a37d730 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca5e25472c4d7b97 server_cookie=de28f60e2dc40010 in_seq=0 out_seq=0 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e65ffb640 1 -- 172.21.15.12:0/4080608670 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f5e78036040 con 0x56047a37b310 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e65ffb640 10 client.27344 handle_command_reply: tid=0 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.601+0000 7f5e86dcc740 1 client.27344 shutdown 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 1 -- 172.21.15.12:0/4080608670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a300680 msgr2=0x56047a304430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a300680 0x56047a304430 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x56047a2f29d0 tx=0x7f5e70004710 comp rx=0 tx=0).stop 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 1 -- 172.21.15.12:0/4080608670 shutdown_connections 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56047a37b310 0x56047a37d730 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56047a300680 0x56047a304430 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56047a2f5dc0 0x56047a303ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 1 --2- 172.21.15.12:0/4080608670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56047a2f54a0 0x56047a308bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e65ffb640 0 client.27344 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:08.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 1 -- 172.21.15.12:0/4080608670 >> 172.21.15.12:0/4080608670 conn(0x56047a2f1a30 msgr2=0x56047a2feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:08.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 1 -- 172.21.15.12:0/4080608670 shutdown_connections 2024-09-19T06:49:08.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 1 -- 172.21.15.12:0/4080608670 wait complete. 2024-09-19T06:49:08.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.602+0000 7f5e86dcc740 20 client.27344 trim_cache size 0 max 16384 2024-09-19T06:49:08.609 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:49:08.610 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:49:08.610 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:49:08.610 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:49:08.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 -- 172.21.15.12:0/2942393957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e6c0a33b0 msgr2=0x7f5e6c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:08.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e6c0a33b0 0x7f5e6c0a5870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e70023000 tx=0x7f5e70024000 comp rx=0 tx=0).stop 2024-09-19T06:49:08.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 -- 172.21.15.12:0/2942393957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e80102d30 msgr2=0x7f5e80100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:08.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e80102d30 0x7f5e80100990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5e78000f80 tx=0x7f5e78031e40 comp rx=0 tx=0).stop 2024-09-19T06:49:08.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 -- 172.21.15.12:0/2942393957 shutdown_connections 2024-09-19T06:49:08.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5e6c0a33b0 0x7f5e6c0a5870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e801082a0 0x7f5e80101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e801036e0 0x7f5e80100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 --2- 172.21.15.12:0/2942393957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e80102d30 0x7f5e80100990 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:08.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 -- 172.21.15.12:0/2942393957 >> 172.21.15.12:0/2942393957 conn(0x7f5e800fc7d0 msgr2=0x7f5e80105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:08.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 -- 172.21.15.12:0/2942393957 shutdown_connections 2024-09-19T06:49:08.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:08.603+0000 7f5e849f3640 1 -- 172.21.15.12:0/2942393957 wait complete. 2024-09-19T06:49:09.827 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:49:09.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:49:10.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:09 smithi012 ceph-mon[30937]: pgmap v277: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.5 MiB/s wr, 692 op/s 2024-09-19T06:49:10.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:09 smithi012 ceph-mon[30937]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:49:10.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:09 smithi016 ceph-mon[34911]: pgmap v277: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.5 MiB/s wr, 692 op/s 2024-09-19T06:49:10.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:09 smithi016 ceph-mon[34911]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:49:10.286 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:09 smithi173 ceph-mon[35349]: pgmap v277: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.5 MiB/s wr, 692 op/s 2024-09-19T06:49:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:09 smithi173 ceph-mon[35349]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:49:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 505.0 s, 228.8 tps, lat 392.627 ms stddev 264.602 2024-09-19T06:49:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.063+0000 7fdb2f978640 1 -- 172.21.15.12:0/298780390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb28108290 msgr2=0x7fdb2810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.063+0000 7fdb2f978640 1 --2- 172.21.15.12:0/298780390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb28108290 0x7fdb2810ec30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009cd0 tx=0x7fdb2002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.063+0000 7fdb2f978640 1 -- 172.21.15.12:0/298780390 shutdown_connections 2024-09-19T06:49:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.063+0000 7fdb2f978640 1 --2- 172.21.15.12:0/298780390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb28108290 0x7fdb2810ec30 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.063+0000 7fdb2f978640 1 --2- 172.21.15.12:0/298780390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb28103740 0x7fdb28107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.063+0000 7fdb2f978640 1 --2- 172.21.15.12:0/298780390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb28102d90 0x7fdb28103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.063+0000 7fdb2f978640 1 -- 172.21.15.12:0/298780390 >> 172.21.15.12:0/298780390 conn(0x7fdb280fc7d0 msgr2=0x7fdb280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.063+0000 7fdb2f978640 1 -- 172.21.15.12:0/298780390 shutdown_connections 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.063+0000 7fdb2f978640 1 -- 172.21.15.12:0/298780390 wait complete. 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2f978640 1 Processor -- start 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2f978640 1 -- start start 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2f978640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb28102d90 0x7fdb28198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2f978640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb28103740 0x7fdb28198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2f978640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb28108290 0x7fdb2819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2f978640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdb28112090 con 0x7fdb28103740 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2f978640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdb28111f10 con 0x7fdb28102d90 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2f978640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdb28112210 con 0x7fdb28108290 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2cf13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb28103740 0x7fdb28198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2cf13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb28103740 0x7fdb28198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51512/0 (socket says 172.21.15.12:51512) 2024-09-19T06:49:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2cf13640 1 -- 172.21.15.12:0/2733817933 learned_addr learned my addr 172.21.15.12:0/2733817933 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2df15640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb28108290 0x7fdb2819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2d714640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb28102d90 0x7fdb28198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2df15640 1 -- 172.21.15.12:0/2733817933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb28102d90 msgr2=0x7fdb28198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.064+0000 7fdb2df15640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb28102d90 0x7fdb28198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.065+0000 7fdb2df15640 1 -- 172.21.15.12:0/2733817933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb28103740 msgr2=0x7fdb28198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.065+0000 7fdb2df15640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb28103740 0x7fdb28198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.065+0000 7fdb2df15640 1 -- 172.21.15.12:0/2733817933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2819d500 con 0x7fdb28108290 2024-09-19T06:49:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.065+0000 7fdb2d714640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb28102d90 0x7fdb28198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.065+0000 7fdb2df15640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb28108290 0x7fdb2819ce20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009bf0 tx=0x7fdb20003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.065+0000 7fdb1e7fc640 1 -- 172.21.15.12:0/2733817933 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20004040 con 0x7fdb28108290 2024-09-19T06:49:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.065+0000 7fdb2f978640 1 -- 172.21.15.12:0/2733817933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2819d790 con 0x7fdb28108290 2024-09-19T06:49:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.065+0000 7fdb1e7fc640 1 -- 172.21.15.12:0/2733817933 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb200046c0 con 0x7fdb28108290 2024-09-19T06:49:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.065+0000 7fdb1e7fc640 1 -- 172.21.15.12:0/2733817933 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20046480 con 0x7fdb28108290 2024-09-19T06:49:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.065+0000 7fdb2f978640 1 -- 172.21.15.12:0/2733817933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb28100920 con 0x7fdb28108290 2024-09-19T06:49:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.066+0000 7fdb2f978640 1 -- 172.21.15.12:0/2733817933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb28103170 con 0x7fdb28108290 2024-09-19T06:49:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.068+0000 7fdb1e7fc640 1 -- 172.21.15.12:0/2733817933 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fdb20030630 con 0x7fdb28108290 2024-09-19T06:49:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.068+0000 7fdb1e7fc640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb140a3400 0x7fdb140a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.069+0000 7fdb2d714640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb140a3400 0x7fdb140a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.069+0000 7fdb1e7fc640 1 -- 172.21.15.12:0/2733817933 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8731+0+0 (secure 0 0 0) 0x7fdb2002e030 con 0x7fdb28108290 2024-09-19T06:49:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.069+0000 7fdb2d714640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb140a3400 0x7fdb140a58c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdb240096a0 tx=0x7fdb24012040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:11.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.071+0000 7fdb1e7fc640 1 -- 172.21.15.12:0/2733817933 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb2004b060 con 0x7fdb28108290 2024-09-19T06:49:11.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.419+0000 7fdb2f978640 1 -- 172.21.15.12:0/2733817933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb2810a2a0 con 0x7fdb28108290 2024-09-19T06:49:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.421+0000 7fdb1e7fc640 1 -- 172.21.15.12:0/2733817933 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11971 (secure 0 0 0) 0x7fdb200be080 con 0x7fdb28108290 2024-09-19T06:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"btime":"2024-09-19T06:48:35:302779+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:48:34.412947+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:49:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 44 2024-09-19T06:49:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.428+0000 7fdb2f978640 1 -- 172.21.15.12:0/2733817933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb140a3400 msgr2=0x7fdb140a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.428+0000 7fdb2f978640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb140a3400 0x7fdb140a58c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdb240096a0 tx=0x7fdb24012040 comp rx=0 tx=0).stop 2024-09-19T06:49:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.428+0000 7fdb2f978640 1 -- 172.21.15.12:0/2733817933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb28108290 msgr2=0x7fdb2819ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:11.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.428+0000 7fdb2f978640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb28108290 0x7fdb2819ce20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009bf0 tx=0x7fdb20003970 comp rx=0 tx=0).stop 2024-09-19T06:49:11.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.429+0000 7fdb2f978640 1 -- 172.21.15.12:0/2733817933 shutdown_connections 2024-09-19T06:49:11.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.429+0000 7fdb2f978640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb140a3400 0x7fdb140a58c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.429+0000 7fdb2f978640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb28108290 0x7fdb2819ce20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.429+0000 7fdb2f978640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb28103740 0x7fdb28198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.429+0000 7fdb2f978640 1 --2- 172.21.15.12:0/2733817933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb28102d90 0x7fdb28198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:11.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.429+0000 7fdb2f978640 1 -- 172.21.15.12:0/2733817933 >> 172.21.15.12:0/2733817933 conn(0x7fdb280fc7d0 msgr2=0x7fdb28106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:11.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.431+0000 7fdb2f978640 1 -- 172.21.15.12:0/2733817933 shutdown_connections 2024-09-19T06:49:11.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:11.431+0000 7fdb2f978640 1 -- 172.21.15.12:0/2733817933 wait complete. 2024-09-19T06:49:12.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:11 smithi012 ceph-mon[30937]: pgmap v279: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 4.1 MiB/s wr, 525 op/s 2024-09-19T06:49:12.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:11 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2733817933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:49:12.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:11 smithi173 ceph-mon[35349]: pgmap v279: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 4.1 MiB/s wr, 525 op/s 2024-09-19T06:49:12.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:11 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2733817933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:49:12.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:11 smithi016 ceph-mon[34911]: pgmap v279: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 4.1 MiB/s wr, 525 op/s 2024-09-19T06:49:12.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:11 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2733817933' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:49:12.316 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:49:12.687 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:13.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.266+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/2720501856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9a410e7b0 msgr2=0x7fb9a4115130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.266+0000 7fb9ab2ba640 1 --2- 172.21.15.12:0/2720501856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9a410e7b0 0x7fb9a4115130 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009be0 tx=0x7fb99c02a6d0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.266+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/2720501856 shutdown_connections 2024-09-19T06:49:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.266+0000 7fb9ab2ba640 1 --2- 172.21.15.12:0/2720501856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9a410e7b0 0x7fb9a4115130 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.266+0000 7fb9ab2ba640 1 --2- 172.21.15.12:0/2720501856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a4109c40 0x7fb9a410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.266+0000 7fb9ab2ba640 1 --2- 172.21.15.12:0/2720501856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a4109290 0x7fb9a4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.266+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/2720501856 >> 172.21.15.12:0/2720501856 conn(0x7fb9a4077c10 msgr2=0x7fb9a407a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:13.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.267+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/2720501856 shutdown_connections 2024-09-19T06:49:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.267+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/2720501856 wait complete. 2024-09-19T06:49:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.267+0000 7fb9ab2ba640 1 Processor -- start 2024-09-19T06:49:13.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.267+0000 7fb9ab2ba640 1 -- start start 2024-09-19T06:49:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9ab2ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a4109290 0x7fb9a41a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9ab2ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9a4109c40 0x7fb9a41a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9ab2ba640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a410e7b0 0x7fb9a419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9ab2ba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a41185c0 con 0x7fb9a4109290 2024-09-19T06:49:13.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9ab2ba640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a4118440 con 0x7fb9a4109c40 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9ab2ba640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a4118740 con 0x7fb9a410e7b0 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9a8855640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9a4109c40 0x7fb9a41a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9a9857640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a410e7b0 0x7fb9a419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9a9857640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a410e7b0 0x7fb9a419e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:53976/0 (socket says 172.21.15.12:53976) 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9a9857640 1 -- 172.21.15.12:0/1442085107 learned_addr learned my addr 172.21.15.12:0/1442085107 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9a9857640 1 -- 172.21.15.12:0/1442085107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9a4109c40 msgr2=0x7fb9a41a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9a9857640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9a4109c40 0x7fb9a41a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9a9857640 1 -- 172.21.15.12:0/1442085107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a4109290 msgr2=0x7fb9a41a46b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9a9857640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a4109290 0x7fb9a41a46b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.268+0000 7fb9a9857640 1 -- 172.21.15.12:0/1442085107 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a419efd0 con 0x7fb9a410e7b0 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.269+0000 7fb9a9857640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a410e7b0 0x7fb9a419e830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009b30 tx=0x7fb99c0305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:13.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.269+0000 7fb9967fc640 1 -- 172.21.15.12:0/1442085107 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c041020 con 0x7fb9a410e7b0 2024-09-19T06:49:13.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.269+0000 7fb9967fc640 1 -- 172.21.15.12:0/1442085107 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb99c003e50 con 0x7fb9a410e7b0 2024-09-19T06:49:13.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.269+0000 7fb9967fc640 1 -- 172.21.15.12:0/1442085107 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c036040 con 0x7fb9a410e7b0 2024-09-19T06:49:13.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.269+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/1442085107 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a419f260 con 0x7fb9a410e7b0 2024-09-19T06:49:13.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.270+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/1442085107 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a41ab510 con 0x7fb9a410e7b0 2024-09-19T06:49:13.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.273+0000 7fb9967fc640 1 -- 172.21.15.12:0/1442085107 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb99c044020 con 0x7fb9a410e7b0 2024-09-19T06:49:13.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.274+0000 7fb9ad693740 1 Processor -- start 2024-09-19T06:49:13.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.274+0000 7fb9ad693740 1 -- start start 2024-09-19T06:49:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50abb40 0x5593a50aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50aa5d0 0x5593a50aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50b5370 0x5593a50b7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9ad693740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5593a50102f0 con 0x5593a50abb40 2024-09-19T06:49:13.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9ad693740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5593a4fb7cf0 con 0x5593a50b5370 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9ad693740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5593a500c2b0 con 0x5593a50aa5d0 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9967fc640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9900a3580 0x7fb9900a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a9056640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50aa5d0 0x5593a50aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a9056640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50aa5d0 0x5593a50aaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:53980/0 (socket says 172.21.15.12:53980) 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a9056640 1 -- 172.21.15.12:0/3990035026 learned_addr learned my addr 172.21.15.12:0/3990035026 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a8855640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50b5370 0x5593a50b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a8855640 1 --2- 172.21.15.12:0/3990035026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50abb40 0x5593a50aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a9857640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9900a3580 0x7fb9900a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9967fc640 1 -- 172.21.15.12:0/1442085107 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8731+0+0 (secure 0 0 0) 0x7fb99c0f0a20 con 0x7fb9a410e7b0 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a8855640 1 -- 172.21.15.12:0/3990035026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50aa5d0 msgr2=0x5593a50aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a8855640 1 --2- 172.21.15.12:0/3990035026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50aa5d0 0x5593a50aaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a8855640 1 -- 172.21.15.12:0/3990035026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50abb40 msgr2=0x5593a50aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:13.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a8855640 1 --2- 172.21.15.12:0/3990035026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50abb40 0x5593a50aa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a8855640 1 -- 172.21.15.12:0/3990035026 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593a4f9c3a0 con 0x5593a50b5370 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.275+0000 7fb9a9056640 1 --2- 172.21.15.12:0/3990035026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50aa5d0 0x5593a50aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.276+0000 7fb9a8855640 1 --2- 172.21.15.12:0/3990035026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50b5370 0x5593a50b7760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb9a407b1e0 tx=0x7fb9980096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1f4b81aaaf6917b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.276+0000 7fb98f7fe640 1 -- 172.21.15.12:0/3990035026 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998004050 con 0x5593a50b5370 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.276+0000 7fb98f7fe640 1 -- 172.21.15.12:0/3990035026 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb998005500 con 0x5593a50b5370 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.276+0000 7fb98f7fe640 1 -- 172.21.15.12:0/3990035026 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998004c40 con 0x5593a50b5370 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.277+0000 7fb9ad693740 1 -- 172.21.15.12:0/3990035026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50b5370 msgr2=0x5593a50b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.277+0000 7fb9ad693740 1 --2- 172.21.15.12:0/3990035026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50b5370 0x5593a50b7760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb9a407b1e0 tx=0x7fb9980096c0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.277+0000 7fb9a9857640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9900a3580 0x7fb9900a5a40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0bc9e0 tx=0x7fb99c0b2170 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.277+0000 7fb9ad693740 1 -- 172.21.15.12:0/3990035026 shutdown_connections 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.277+0000 7fb9ad693740 1 --2- 172.21.15.12:0/3990035026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50b5370 0x5593a50b7760 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.277+0000 7fb9ad693740 1 --2- 172.21.15.12:0/3990035026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50aa5d0 0x5593a50aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.277+0000 7fb9ad693740 1 --2- 172.21.15.12:0/3990035026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50abb40 0x5593a50aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.277+0000 7fb9ad693740 1 -- 172.21.15.12:0/3990035026 >> 172.21.15.12:0/3990035026 conn(0x5593a5073310 msgr2=0x5593a50a6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:13.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.277+0000 7fb9ad693740 1 -- 172.21.15.12:0/3990035026 shutdown_connections 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.277+0000 7fb9ad693740 1 -- 172.21.15.12:0/3990035026 wait complete. 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.278+0000 7fb9ad693740 1 -- start start 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.278+0000 7fb9ad693740 1 Processor -- start 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.278+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50aa5d0 0x5593a50b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.278+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50abb40 0x5593a50b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.278+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50b5370 0x5593a50b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9ad693740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5593a50b8110 con 0x5593a50aa5d0 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9ad693740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5593a4fcb060 con 0x5593a50abb40 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9ad693740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5593a50b8290 con 0x5593a50b5370 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9ad693740 10 client.0 _ll_register_callbacks cb 0x5593a4d1e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a8855640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50aa5d0 0x5593a50b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a9056640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50abb40 0x5593a50b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a9056640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50abb40 0x5593a50b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:48952/0 (socket says 172.21.15.12:48952) 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a9056640 1 -- 172.21.15.12:0/2840978956 learned_addr learned my addr 172.21.15.12:0/2840978956 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a8855640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50aa5d0 0x5593a50b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51526/0 (socket says 172.21.15.12:51526) 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a8855640 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50b5370 0x5593a50b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a9056640 1 -- 172.21.15.12:0/2840978956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50b5370 msgr2=0x5593a50b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a9056640 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50b5370 0x5593a50b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a9056640 1 -- 172.21.15.12:0/2840978956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50aa5d0 msgr2=0x5593a50b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a9056640 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50aa5d0 0x5593a50b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a9056640 1 -- 172.21.15.12:0/2840978956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593a4d813c0 con 0x5593a50abb40 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.279+0000 7fb9a9056640 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50abb40 0x5593a50b2050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00116c0 tx=0x7fb9a0011b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=487b6ac59b513e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.280+0000 7fb98cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.280+0000 7fb98cff9640 1 -- 172.21.15.12:0/2840978956 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0004460 con 0x5593a50abb40 2024-09-19T06:49:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.280+0000 7fb9ad693740 1 -- 172.21.15.12:0/2840978956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb998005500 con 0x5593a50abb40 2024-09-19T06:49:13.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.280+0000 7fb98cff9640 1 -- 172.21.15.12:0/2840978956 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8731+0+0 (secure 0 0 0) 0x7fb9a000f920 con 0x5593a50abb40 2024-09-19T06:49:13.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.280+0000 7fb98cff9640 1 -- 172.21.15.12:0/2840978956 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb9a000fb20 con 0x5593a50abb40 2024-09-19T06:49:13.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.280+0000 7fb9ad693740 10 client.27362 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:13.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.280+0000 7fb9ad693740 1 -- 172.21.15.12:0/2840978956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5593a50c3c90 con 0x5593a50abb40 2024-09-19T06:49:13.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.281+0000 7fb98cff9640 1 -- 172.21.15.12:0/2840978956 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb998005500 con 0x5593a50abb40 2024-09-19T06:49:13.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.281+0000 7fb98cff9640 1 -- 172.21.15.12:0/2840978956 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fb9a0018070 con 0x5593a50abb40 2024-09-19T06:49:13.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.281+0000 7fb9ad693740 10 client.27362 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:13.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.281+0000 7fb9ad693740 10 client.27362 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:49:13.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.281+0000 7fb9ad693740 20 client.27362 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:13.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.281+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5593a50c5540 0x5593a50c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.281+0000 7fb9ad693740 4 client.27362 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:13.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.281+0000 7fb9ad693740 1 -- 172.21.15.12:0/2840978956 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593a501d860 con 0x5593a50c5540 2024-09-19T06:49:13.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.283+0000 7fb9a8855640 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5593a50c5540 0x5593a50c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.284+0000 7fb9a8855640 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5593a50c5540 0x5593a50c79a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=71b5964b4a67d135 server_cookie=5854bd5ae565ae82 in_seq=0 out_seq=0 2024-09-19T06:49:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.284+0000 7fb98cff9640 10 client.27362 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:49:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb98cff9640 1 -- 172.21.15.12:0/2840978956 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593a501d860 con 0x5593a50c5540 2024-09-19T06:49:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb98cff9640 10 client.27362 handle_command_reply: tid=0 2024-09-19T06:49:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb9ad693740 1 client.27362 shutdown 2024-09-19T06:49:13.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb9ad693740 1 -- 172.21.15.12:0/2840978956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50abb40 msgr2=0x5593a50b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:13.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50abb40 0x5593a50b2050 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00116c0 tx=0x7fb9a0011b80 comp rx=0 tx=0).stop 2024-09-19T06:49:13.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb9ad693740 1 -- 172.21.15.12:0/2840978956 shutdown_connections 2024-09-19T06:49:13.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5593a50c5540 0x5593a50c79a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50b5370 0x5593a50b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50abb40 0x5593a50b2050 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00116c0 tx=0x7fb9a0011b80 comp rx=0 tx=0).stop 2024-09-19T06:49:13.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2840978956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50aa5d0 0x5593a50b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb9ad693740 1 -- 172.21.15.12:0/2840978956 >> 172.21.15.12:0/2840978956 conn(0x5593a5073310 msgr2=0x5593a50ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:13.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb98cff9640 0 client.27362 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:49:13.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.285+0000 7fb9ad693740 1 -- 172.21.15.12:0/2840978956 shutdown_connections 2024-09-19T06:49:13.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.286+0000 7fb9ad693740 1 -- 172.21.15.12:0/2840978956 wait complete. 2024-09-19T06:49:13.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.286+0000 7fb9ad693740 20 client.27362 trim_cache size 0 max 16384 2024-09-19T06:49:13.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9ad693740 1 Processor -- start 2024-09-19T06:49:13.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9ad693740 1 -- start start 2024-09-19T06:49:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 0x5593a50b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50b5370 0x5593a50c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50a6f20 0x5593a50ad120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9ad693740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a41b42b0 con 0x5593a50a6f20 2024-09-19T06:49:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9ad693740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a41b5df0 con 0x5593a50aa5d0 2024-09-19T06:49:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9ad693740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a41b4980 con 0x5593a50b5370 2024-09-19T06:49:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9a8855640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 0x5593a50b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9a8855640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 0x5593a50b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:48960/0 (socket says 172.21.15.12:48960) 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9a8855640 1 -- 172.21.15.12:0/2332232921 learned_addr learned my addr 172.21.15.12:0/2332232921 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.307+0000 7fb9a8855640 1 --2- 172.21.15.12:0/2332232921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50a6f20 0x5593a50ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.308+0000 7fb9a8855640 1 -- 172.21.15.12:0/2332232921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50b5370 msgr2=0x5593a50c13b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.308+0000 7fb9a8855640 1 --2- 172.21.15.12:0/2332232921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50b5370 0x5593a50c13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.308+0000 7fb9a8855640 1 -- 172.21.15.12:0/2332232921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50a6f20 msgr2=0x5593a50ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.308+0000 7fb9a8855640 1 --2- 172.21.15.12:0/2332232921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50a6f20 0x5593a50ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.308+0000 7fb9a8855640 1 -- 172.21.15.12:0/2332232921 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593a50b4950 con 0x5593a50aa5d0 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.308+0000 7fb9a8855640 1 --2- 172.21.15.12:0/2332232921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 0x5593a50b2020 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb998004630 tx=0x7fb998009a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c666b217e6d51ef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.308+0000 7fb98effd640 1 -- 172.21.15.12:0/2332232921 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99802e4c0 con 0x5593a50aa5d0 2024-09-19T06:49:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.309+0000 7fb98effd640 1 -- 172.21.15.12:0/2332232921 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb998044020 con 0x5593a50aa5d0 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.309+0000 7fb98effd640 1 -- 172.21.15.12:0/2332232921 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99800f7e0 con 0x5593a50aa5d0 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.310+0000 7fb9ad693740 1 -- 172.21.15.12:0/2332232921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 msgr2=0x5593a50b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.310+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2332232921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 0x5593a50b2020 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb998004630 tx=0x7fb998009a30 comp rx=0 tx=0).stop 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.310+0000 7fb9ad693740 1 -- 172.21.15.12:0/2332232921 shutdown_connections 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.310+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2332232921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50a6f20 0x5593a50ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.310+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2332232921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50b5370 0x5593a50c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.310+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2332232921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 0x5593a50b2020 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.310+0000 7fb9ad693740 1 -- 172.21.15.12:0/2332232921 >> 172.21.15.12:0/2332232921 conn(0x5593a5073310 msgr2=0x5593a50b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.311+0000 7fb9ad693740 1 -- 172.21.15.12:0/2332232921 shutdown_connections 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.311+0000 7fb9ad693740 1 -- 172.21.15.12:0/2332232921 wait complete. 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.312+0000 7fb9ad693740 1 -- start start 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.312+0000 7fb9ad693740 1 Processor -- start 2024-09-19T06:49:13.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.313+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50a6f20 0x5593a50bd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.313+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 0x5593a50bda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.313+0000 7fb9ad693740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50b5370 0x5593a50ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.313+0000 7fb9ad693740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a41b5720 con 0x5593a50b5370 2024-09-19T06:49:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.313+0000 7fb9ad693740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a41b5050 con 0x5593a50aa5d0 2024-09-19T06:49:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.313+0000 7fb9ad693740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a41b22b0 con 0x5593a50a6f20 2024-09-19T06:49:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.314+0000 7fb9ad693740 10 client.0 _ll_register_callbacks cb 0x7fb9a00096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.314+0000 7fb9a8855640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50b5370 0x5593a50ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.314+0000 7fb9a8855640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50b5370 0x5593a50ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51540/0 (socket says 172.21.15.12:51540) 2024-09-19T06:49:13.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.314+0000 7fb9a8855640 1 -- 172.21.15.12:0/2517788316 learned_addr learned my addr 172.21.15.12:0/2517788316 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:13.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.315+0000 7fb9a8855640 1 -- 172.21.15.12:0/2517788316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50a6f20 msgr2=0x5593a50bd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:13.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.315+0000 7fb9a8855640 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50a6f20 0x5593a50bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.315+0000 7fb9a8855640 1 -- 172.21.15.12:0/2517788316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 msgr2=0x5593a50bda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:13.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.315+0000 7fb9a8855640 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 0x5593a50bda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.315+0000 7fb9a8855640 1 -- 172.21.15.12:0/2517788316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593a50ae9e0 con 0x5593a50b5370 2024-09-19T06:49:13.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.317+0000 7fb9a8855640 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50b5370 0x5593a50ae4a0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb9980048b0 tx=0x7fb9980096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b806ef863e95da56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:13.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.317+0000 7fb98cff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:49:13.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.318+0000 7fb98cff9640 1 -- 172.21.15.12:0/2517788316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99804d020 con 0x5593a50b5370 2024-09-19T06:49:13.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.318+0000 7fb9ad693740 1 -- 172.21.15.12:0/2517788316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb998044020 con 0x5593a50b5370 2024-09-19T06:49:13.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.318+0000 7fb98cff9640 1 -- 172.21.15.12:0/2517788316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8731+0+0 (secure 0 0 0) 0x7fb99802ee80 con 0x5593a50b5370 2024-09-19T06:49:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.319+0000 7fb98cff9640 1 -- 172.21.15.12:0/2517788316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb998055050 con 0x5593a50b5370 2024-09-19T06:49:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.319+0000 7fb9ad693740 10 client.17943 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.319+0000 7fb9ad693740 1 -- 172.21.15.12:0/2517788316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5593a512f930 con 0x5593a50b5370 2024-09-19T06:49:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.319+0000 7fb98cff9640 1 -- 172.21.15.12:0/2517788316 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb99800fd30 con 0x5593a50b5370 2024-09-19T06:49:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.320+0000 7fb98cff9640 1 -- 172.21.15.12:0/2517788316 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fb998029070 con 0x5593a50b5370 2024-09-19T06:49:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.320+0000 7fb9ad693740 10 client.17943 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.320+0000 7fb9ad693740 10 client.17943 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:49:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.320+0000 7fb9ad693740 20 client.17943 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.320+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5593a512ffd0 0x5593a51323f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.320+0000 7fb9ad693740 4 client.17943 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:49:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.320+0000 7fb9ad693740 1 -- 172.21.15.12:0/2517788316 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb998044020 con 0x5593a512ffd0 2024-09-19T06:49:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.321+0000 7fb9a9056640 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5593a512ffd0 0x5593a51323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:13.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.322+0000 7fb98cff9640 10 client.17943 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:49:13.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.323+0000 7fb9a9056640 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5593a512ffd0 0x5593a51323f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1cce0db144922902 server_cookie=f484e48eaf64d6e in_seq=0 out_seq=0 2024-09-19T06:49:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.328+0000 7fb98cff9640 1 -- 172.21.15.12:0/2517788316 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb998044020 con 0x5593a512ffd0 2024-09-19T06:49:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.328+0000 7fb98cff9640 10 client.17943 handle_command_reply: tid=0 2024-09-19T06:49:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.328+0000 7fb9ad693740 1 client.17943 shutdown 2024-09-19T06:49:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.329+0000 7fb9ad693740 1 -- 172.21.15.12:0/2517788316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50b5370 msgr2=0x5593a50ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.329+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50b5370 0x5593a50ae4a0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb9980048b0 tx=0x7fb9980096d0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.329+0000 7fb9ad693740 1 -- 172.21.15.12:0/2517788316 shutdown_connections 2024-09-19T06:49:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.329+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5593a512ffd0 0x5593a51323f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.329+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593a50b5370 0x5593a50ae4a0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.329+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593a50aa5d0 0x5593a50bda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.329+0000 7fb9ad693740 1 --2- 172.21.15.12:0/2517788316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593a50a6f20 0x5593a50bd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.329+0000 7fb98cff9640 0 client.17943 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:49:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.329+0000 7fb9ad693740 1 -- 172.21.15.12:0/2517788316 >> 172.21.15.12:0/2517788316 conn(0x5593a5073310 msgr2=0x5593a50b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.330+0000 7fb9ad693740 1 -- 172.21.15.12:0/2517788316 shutdown_connections 2024-09-19T06:49:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.330+0000 7fb9ad693740 1 -- 172.21.15.12:0/2517788316 wait complete. 2024-09-19T06:49:13.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.330+0000 7fb9ad693740 20 client.17943 trim_cache size 0 max 16384 2024-09-19T06:49:13.336 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:49:13.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/1442085107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9900a3580 msgr2=0x7fb9900a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:13.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9900a3580 0x7fb9900a5a40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0bc9e0 tx=0x7fb99c0b2170 comp rx=0 tx=0).stop 2024-09-19T06:49:13.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/1442085107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a410e7b0 msgr2=0x7fb9a419e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:13.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a410e7b0 0x7fb9a419e830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009b30 tx=0x7fb99c0305d0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/1442085107 shutdown_connections 2024-09-19T06:49:13.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9900a3580 0x7fb9900a5a40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a410e7b0 0x7fb9a419e830 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9a4109c40 0x7fb9a41a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 --2- 172.21.15.12:0/1442085107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a4109290 0x7fb9a41a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:13.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/1442085107 >> 172.21.15.12:0/1442085107 conn(0x7fb9a4077c10 msgr2=0x7fb9a410c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:13.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/1442085107 shutdown_connections 2024-09-19T06:49:13.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:13.336+0000 7fb9ab2ba640 1 -- 172.21.15.12:0/1442085107 wait complete. 2024-09-19T06:49:14.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:13 smithi012 ceph-mon[30937]: pgmap v280: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 4.1 MiB/s wr, 525 op/s 2024-09-19T06:49:14.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:13 smithi016 ceph-mon[34911]: pgmap v280: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 4.1 MiB/s wr, 525 op/s 2024-09-19T06:49:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:13 smithi173 ceph-mon[35349]: pgmap v280: 97 pgs: 97 active+clean; 4.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 4.1 MiB/s wr, 525 op/s 2024-09-19T06:49:14.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:49:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:15.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.782+0000 7f0e537b3640 1 -- 172.21.15.12:0/1611331147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e4c109ba0 msgr2=0x7f0e4c114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:15.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.782+0000 7f0e537b3640 1 --2- 172.21.15.12:0/1611331147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e4c109ba0 0x7f0e4c114570 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009900 tx=0x7f0e3c02a410 comp rx=0 tx=0).stop 2024-09-19T06:49:15.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.782+0000 7f0e537b3640 1 -- 172.21.15.12:0/1611331147 shutdown_connections 2024-09-19T06:49:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.782+0000 7f0e537b3640 1 --2- 172.21.15.12:0/1611331147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e4c114ab0 0x7f0e4c116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.782+0000 7f0e537b3640 1 --2- 172.21.15.12:0/1611331147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e4c109ba0 0x7f0e4c114570 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.782+0000 7f0e537b3640 1 --2- 172.21.15.12:0/1611331147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e4c1091f0 0x7f0e4c1095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.782+0000 7f0e537b3640 1 -- 172.21.15.12:0/1611331147 >> 172.21.15.12:0/1611331147 conn(0x7f0e4c06e2d0 msgr2=0x7f0e4c06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.782+0000 7f0e537b3640 1 -- 172.21.15.12:0/1611331147 shutdown_connections 2024-09-19T06:49:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.782+0000 7f0e537b3640 1 -- 172.21.15.12:0/1611331147 wait complete. 2024-09-19T06:49:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.783+0000 7f0e537b3640 1 Processor -- start 2024-09-19T06:49:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.783+0000 7f0e537b3640 1 -- start start 2024-09-19T06:49:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.783+0000 7f0e537b3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e4c1091f0 0x7f0e4c114190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.783+0000 7f0e537b3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e4c109ba0 0x7f0e4c111290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.783+0000 7f0e537b3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e4c114ab0 0x7f0e4c1117d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e537b3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c10bb60 con 0x7f0e4c114ab0 2024-09-19T06:49:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e537b3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c10b9e0 con 0x7f0e4c109ba0 2024-09-19T06:49:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e537b3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c10bce0 con 0x7f0e4c1091f0 2024-09-19T06:49:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e51d50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e4c114ab0 0x7f0e4c1117d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e51d50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e4c114ab0 0x7f0e4c1117d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51568/0 (socket says 172.21.15.12:51568) 2024-09-19T06:49:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e51d50640 1 -- 172.21.15.12:0/1581024989 learned_addr learned my addr 172.21.15.12:0/1581024989 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e5154f640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e4c1091f0 0x7f0e4c114190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e50d4e640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e4c109ba0 0x7f0e4c111290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e5154f640 1 -- 172.21.15.12:0/1581024989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e4c109ba0 msgr2=0x7f0e4c111290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e5154f640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e4c109ba0 0x7f0e4c111290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e5154f640 1 -- 172.21.15.12:0/1581024989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e4c114ab0 msgr2=0x7f0e4c1117d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e5154f640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e4c114ab0 0x7f0e4c1117d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e5154f640 1 -- 172.21.15.12:0/1581024989 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4c111f00 con 0x7f0e4c1091f0 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.784+0000 7f0e50d4e640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e4c109ba0 0x7f0e4c111290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.785+0000 7f0e5154f640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e4c1091f0 0x7f0e4c114190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e9f0 tx=0x7f0e4800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.785+0000 7f0e427fc640 1 -- 172.21.15.12:0/1581024989 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800ccc0 con 0x7f0e4c1091f0 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.785+0000 7f0e427fc640 1 -- 172.21.15.12:0/1581024989 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e48010910 con 0x7f0e4c1091f0 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.785+0000 7f0e427fc640 1 -- 172.21.15.12:0/1581024989 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e48018960 con 0x7f0e4c1091f0 2024-09-19T06:49:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.786+0000 7f0e537b3640 1 -- 172.21.15.12:0/1581024989 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4c1b38d0 con 0x7f0e4c1091f0 2024-09-19T06:49:15.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.786+0000 7f0e537b3640 1 -- 172.21.15.12:0/1581024989 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e4c1b3d30 con 0x7f0e4c1091f0 2024-09-19T06:49:15.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.788+0000 7f0e427fc640 1 -- 172.21.15.12:0/1581024989 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0e48010ac0 con 0x7f0e4c1091f0 2024-09-19T06:49:15.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.789+0000 7f0e55b8c740 1 Processor -- start 2024-09-19T06:49:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.790+0000 7f0e427fc640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e380a3480 0x7f0e380a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.790+0000 7f0e55b8c740 1 -- start start 2024-09-19T06:49:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.790+0000 7f0e427fc640 1 -- 172.21.15.12:0/1581024989 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f0e480d01c0 con 0x7f0e4c1091f0 2024-09-19T06:49:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.790+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779226090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.790+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c779226a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.790+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c779233760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.790+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c77918c2f0 con 0x55c779231370 2024-09-19T06:49:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.790+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c779133cf0 con 0x55c779227b40 2024-09-19T06:49:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.790+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c7791882b0 con 0x55c7792265d0 2024-09-19T06:49:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e51d50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c779233760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e50d4e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c779226a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e5154f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779226090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e51d50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c779233760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51580/0 (socket says 172.21.15.12:51580) 2024-09-19T06:49:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e50d4e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c779226a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54030/0 (socket says 172.21.15.12:54030) 2024-09-19T06:49:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e51d50640 1 -- 172.21.15.12:0/2109312199 learned_addr learned my addr 172.21.15.12:0/2109312199 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e51d50640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e380a3480 0x7f0e380a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e5154f640 1 -- 172.21.15.12:0/2109312199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 msgr2=0x55c779226a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e5154f640 1 --2- 172.21.15.12:0/2109312199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c779226a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e5154f640 1 -- 172.21.15.12:0/2109312199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 msgr2=0x55c779233760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e5154f640 1 --2- 172.21.15.12:0/2109312199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c779233760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e5154f640 1 -- 172.21.15.12:0/2109312199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7791183a0 con 0x55c779227b40 2024-09-19T06:49:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e5154f640 1 --2- 172.21.15.12:0/2109312199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779226090 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0e480cd810 tx=0x7f0e4809caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc16bf21426abc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e51d50640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e380a3480 0x7f0e380a5940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009a40 tx=0x7f0e44009d00 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e377fe640 1 -- 172.21.15.12:0/2109312199 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e480a5010 con 0x55c779227b40 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e377fe640 1 -- 172.21.15.12:0/2109312199 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e480cda90 con 0x55c779227b40 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.791+0000 7f0e377fe640 1 -- 172.21.15.12:0/2109312199 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e48018b00 con 0x55c779227b40 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.792+0000 7f0e55b8c740 1 -- 172.21.15.12:0/2109312199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 msgr2=0x55c779226090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.792+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/2109312199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779226090 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0e480cd810 tx=0x7f0e4809caa0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.792+0000 7f0e55b8c740 1 -- 172.21.15.12:0/2109312199 shutdown_connections 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.792+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/2109312199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c779233760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.792+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/2109312199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c779226a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.792+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/2109312199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779226090 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.792+0000 7f0e55b8c740 1 -- 172.21.15.12:0/2109312199 >> 172.21.15.12:0/2109312199 conn(0x55c7791ef310 msgr2=0x55c779222c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.793+0000 7f0e55b8c740 1 -- 172.21.15.12:0/2109312199 shutdown_connections 2024-09-19T06:49:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.793+0000 7f0e55b8c740 1 -- 172.21.15.12:0/2109312199 wait complete. 2024-09-19T06:49:15.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.793+0000 7f0e55b8c740 1 -- start start 2024-09-19T06:49:15.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.793+0000 7f0e55b8c740 1 Processor -- start 2024-09-19T06:49:15.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c77922e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c77922e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c77922ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c779233fb0 con 0x55c779231370 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c779147060 con 0x55c779227b40 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c779234130 con 0x55c7792265d0 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e55b8c740 10 client.0 _ll_register_callbacks cb 0x55c778e9a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e50d4e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c77922e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e50d4e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c77922e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49002/0 (socket says 172.21.15.12:49002) 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e50d4e640 1 -- 172.21.15.12:0/336799599 learned_addr learned my addr 172.21.15.12:0/336799599 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e5154f640 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c77922e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.795+0000 7f0e51d50640 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c77922ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e5154f640 1 -- 172.21.15.12:0/336799599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 msgr2=0x55c77922e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e5154f640 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c77922e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e5154f640 1 -- 172.21.15.12:0/336799599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 msgr2=0x55c77922ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e5154f640 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c77922ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e5154f640 1 -- 172.21.15.12:0/336799599 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c778efd3c0 con 0x55c7792265d0 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e50d4e640 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c77922e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e5154f640 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c77922e150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0e480cd810 tx=0x7f0e48009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973f2b5d8b75c836 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e34ff9640 1 -- 172.21.15.12:0/336799599 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e480a5010 con 0x55c7792265d0 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e34ff9640 1 -- 172.21.15.12:0/336799599 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f0e48010640 con 0x55c7792265d0 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e55b8c740 1 -- 172.21.15.12:0/336799599 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e480cda90 con 0x55c7792265d0 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e34ff9640 1 -- 172.21.15.12:0/336799599 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0e480b5150 con 0x55c7792265d0 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e55b8c740 10 client.27328 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e55b8c740 1 -- 172.21.15.12:0/336799599 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c779233fb0 con 0x55c7792265d0 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.796+0000 7f0e34ff9640 1 -- 172.21.15.12:0/336799599 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e480cda90 con 0x55c7792265d0 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.797+0000 7f0e34ff9640 1 -- 172.21.15.12:0/336799599 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f0e4809b260 con 0x55c7792265d0 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.797+0000 7f0e55b8c740 10 client.27328 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:15.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.797+0000 7f0e55b8c740 10 client.27328 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:49:15.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.797+0000 7f0e55b8c740 20 client.27328 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:15.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.797+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c779240d20 0x55c779243110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.797+0000 7f0e55b8c740 4 client.27328 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:15.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.797+0000 7f0e55b8c740 1 -- 172.21.15.12:0/336799599 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c779199860 con 0x55c779240d20 2024-09-19T06:49:15.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.797+0000 7f0e50d4e640 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c779240d20 0x55c779243110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.798+0000 7f0e50d4e640 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c779240d20 0x55c779243110 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=496761859ecad2fb server_cookie=f73e2d5a49323b68 in_seq=0 out_seq=0 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.798+0000 7f0e34ff9640 10 client.27328 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e34ff9640 1 -- 172.21.15.12:0/336799599 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c779199860 con 0x55c779240d20 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e34ff9640 10 client.27328 handle_command_reply: tid=0 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 client.27328 shutdown 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 -- 172.21.15.12:0/336799599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 msgr2=0x55c77922e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c77922e150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0e480cd810 tx=0x7f0e48009700 comp rx=0 tx=0).stop 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 -- 172.21.15.12:0/336799599 shutdown_connections 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c779240d20 0x55c779243110 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c77922ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e34ff9640 0 client.27328 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:49:15.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c77922e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/336799599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c77922e150 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 -- 172.21.15.12:0/336799599 >> 172.21.15.12:0/336799599 conn(0x55c7791ef310 msgr2=0x55c7792289c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:15.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 -- 172.21.15.12:0/336799599 shutdown_connections 2024-09-19T06:49:15.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 1 -- 172.21.15.12:0/336799599 wait complete. 2024-09-19T06:49:15.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.799+0000 7f0e55b8c740 20 client.27328 trim_cache size 0 max 16384 2024-09-19T06:49:15.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 510.0 s, 2400.6 tps, lat 46.784 ms stddev 92.722 2024-09-19T06:49:15.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.824+0000 7f0e55b8c740 1 Processor -- start 2024-09-19T06:49:15.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.824+0000 7f0e55b8c740 1 -- start start 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.824+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7792265d0 0x55c779221500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.824+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779229120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.824+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c779231370 0x55c779229660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.824+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1bc9f0 con 0x55c7792265d0 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.824+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1be530 con 0x55c779227b40 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.824+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1bd0c0 con 0x55c779231370 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.824+0000 7f0e5154f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7792265d0 0x55c779221500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.825+0000 7f0e51d50640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c779231370 0x55c779229660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.825+0000 7f0e5154f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7792265d0 0x55c779221500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51600/0 (socket says 172.21.15.12:51600) 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.825+0000 7f0e5154f640 1 -- 172.21.15.12:0/1588120817 learned_addr learned my addr 172.21.15.12:0/1588120817 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.825+0000 7f0e50d4e640 1 --2- 172.21.15.12:0/1588120817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779229120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.825+0000 7f0e51d50640 1 -- 172.21.15.12:0/1588120817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 msgr2=0x55c779229120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:15.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.825+0000 7f0e51d50640 1 --2- 172.21.15.12:0/1588120817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779229120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.825+0000 7f0e51d50640 1 -- 172.21.15.12:0/1588120817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7792265d0 msgr2=0x55c779221500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:15.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.825+0000 7f0e51d50640 1 --2- 172.21.15.12:0/1588120817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7792265d0 0x55c779221500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.825+0000 7f0e51d50640 1 -- 172.21.15.12:0/1588120817 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7792223b0 con 0x55c779231370 2024-09-19T06:49:15.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.825+0000 7f0e51d50640 1 --2- 172.21.15.12:0/1588120817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c779231370 0x55c779229660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55c779227070 tx=0x7f0e44016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4ee9663a3ef8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:15.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.826+0000 7f0e36ffd640 1 -- 172.21.15.12:0/1588120817 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e44004b20 con 0x55c779231370 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.826+0000 7f0e36ffd640 1 -- 172.21.15.12:0/1588120817 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e44003e50 con 0x55c779231370 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.826+0000 7f0e36ffd640 1 -- 172.21.15.12:0/1588120817 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e44012a80 con 0x55c779231370 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.827+0000 7f0e55b8c740 1 -- 172.21.15.12:0/1588120817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c779231370 msgr2=0x55c779229660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.827+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/1588120817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c779231370 0x55c779229660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55c779227070 tx=0x7f0e44016000 comp rx=0 tx=0).stop 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.827+0000 7f0e55b8c740 1 -- 172.21.15.12:0/1588120817 shutdown_connections 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.827+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/1588120817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c779231370 0x55c779229660 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.827+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/1588120817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779229120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.827+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/1588120817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7792265d0 0x55c779221500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.827+0000 7f0e55b8c740 1 -- 172.21.15.12:0/1588120817 >> 172.21.15.12:0/1588120817 conn(0x55c7791ef310 msgr2=0x55c7792301d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.827+0000 7f0e55b8c740 1 -- 172.21.15.12:0/1588120817 shutdown_connections 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.827+0000 7f0e55b8c740 1 -- 172.21.15.12:0/1588120817 wait complete. 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e55b8c740 1 -- start start 2024-09-19T06:49:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e55b8c740 1 Processor -- start 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c7792396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779239be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e55b8c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c77922ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1bde60 con 0x55c779231370 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1bd790 con 0x55c779227b40 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e55b8c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4c1ba9f0 con 0x55c7792265d0 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e55b8c740 10 client.0 _ll_register_callbacks cb 0x7f0e44013500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e50d4e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779239be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e5154f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c7792396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e50d4e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779239be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49012/0 (socket says 172.21.15.12:49012) 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e50d4e640 1 -- 172.21.15.12:0/124277427 learned_addr learned my addr 172.21.15.12:0/124277427 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.828+0000 7f0e5154f640 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c7792396a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54040/0 (socket says 172.21.15.12:54040) 2024-09-19T06:49:15.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.829+0000 7f0e51d50640 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c77922ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.829+0000 7f0e50d4e640 1 -- 172.21.15.12:0/124277427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 msgr2=0x55c7792396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:15.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.829+0000 7f0e50d4e640 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c7792396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.829+0000 7f0e50d4e640 1 -- 172.21.15.12:0/124277427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 msgr2=0x55c77922ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:15.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.829+0000 7f0e50d4e640 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c77922ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.829+0000 7f0e50d4e640 1 -- 172.21.15.12:0/124277427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c77922b3c0 con 0x55c779227b40 2024-09-19T06:49:15.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.829+0000 7f0e5154f640 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c7792396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:15.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.829+0000 7f0e50d4e640 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779239be0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c006010 tx=0x7f0e3c005150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e495e509c78bcdda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:15.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.829+0000 7f0e34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:15.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.830+0000 7f0e34ff9640 1 -- 172.21.15.12:0/124277427 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c035040 con 0x55c779227b40 2024-09-19T06:49:15.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.830+0000 7f0e34ff9640 1 -- 172.21.15.12:0/124277427 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f0e3c0046c0 con 0x55c779227b40 2024-09-19T06:49:15.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.830+0000 7f0e55b8c740 1 -- 172.21.15.12:0/124277427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e44003e50 con 0x55c779227b40 2024-09-19T06:49:15.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.835+0000 7f0e34ff9640 1 -- 172.21.15.12:0/124277427 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0e3c0048c0 con 0x55c779227b40 2024-09-19T06:49:15.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.835+0000 7f0e55b8c740 10 client.27383 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:15.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.836+0000 7f0e55b8c740 1 -- 172.21.15.12:0/124277427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c7792ab330 con 0x55c779227b40 2024-09-19T06:49:15.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.836+0000 7f0e34ff9640 1 -- 172.21.15.12:0/124277427 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e44003e50 con 0x55c779227b40 2024-09-19T06:49:15.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.836+0000 7f0e34ff9640 1 -- 172.21.15.12:0/124277427 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f0e3c04c070 con 0x55c779227b40 2024-09-19T06:49:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.836+0000 7f0e55b8c740 10 client.27383 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.836+0000 7f0e55b8c740 10 client.27383 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:49:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.836+0000 7f0e55b8c740 20 client.27383 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.836+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c779240d20 0x55c7792adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.836+0000 7f0e55b8c740 4 client.27383 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:49:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.836+0000 7f0e55b8c740 1 -- 172.21.15.12:0/124277427 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c779193d70 con 0x55c779240d20 2024-09-19T06:49:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.836+0000 7f0e5154f640 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c779240d20 0x55c7792adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:15.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e5154f640 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c779240d20 0x55c7792adaa0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=584ff44af1205fdd server_cookie=c4a261266eaa22d1 in_seq=0 out_seq=0 2024-09-19T06:49:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e34ff9640 10 client.27383 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:49:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e34ff9640 1 -- 172.21.15.12:0/124277427 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c779193d70 con 0x55c779240d20 2024-09-19T06:49:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e34ff9640 10 client.27383 handle_command_reply: tid=0 2024-09-19T06:49:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e55b8c740 1 client.27383 shutdown 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e55b8c740 1 -- 172.21.15.12:0/124277427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 msgr2=0x55c779239be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779239be0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c006010 tx=0x7f0e3c005150 comp rx=0 tx=0).stop 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e55b8c740 1 -- 172.21.15.12:0/124277427 shutdown_connections 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55c779240d20 0x55c7792adaa0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c779231370 0x55c77922ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c779227b40 0x55c779239be0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e55b8c740 1 --2- 172.21.15.12:0/124277427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c7792265d0 0x55c7792396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.837+0000 7f0e55b8c740 1 -- 172.21.15.12:0/124277427 >> 172.21.15.12:0/124277427 conn(0x55c7791ef310 msgr2=0x55c77923c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.838+0000 7f0e34ff9640 0 client.27383 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.838+0000 7f0e55b8c740 1 -- 172.21.15.12:0/124277427 shutdown_connections 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.838+0000 7f0e55b8c740 1 -- 172.21.15.12:0/124277427 wait complete. 2024-09-19T06:49:15.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.838+0000 7f0e55b8c740 20 client.27383 trim_cache size 0 max 16384 2024-09-19T06:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:49:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.838+0000 7f0e537b3640 1 -- 172.21.15.12:0/1581024989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e380a3480 msgr2=0x7f0e380a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.838+0000 7f0e537b3640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e380a3480 0x7f0e380a5940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009a40 tx=0x7f0e44009d00 comp rx=0 tx=0).stop 2024-09-19T06:49:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.838+0000 7f0e537b3640 1 -- 172.21.15.12:0/1581024989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e4c1091f0 msgr2=0x7f0e4c114190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.838+0000 7f0e537b3640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e4c1091f0 0x7f0e4c114190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e9f0 tx=0x7f0e4800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.839+0000 7f0e537b3640 1 -- 172.21.15.12:0/1581024989 shutdown_connections 2024-09-19T06:49:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.839+0000 7f0e537b3640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e4c114ab0 0x7f0e4c1117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.839+0000 7f0e537b3640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e4c109ba0 0x7f0e4c111290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.839+0000 7f0e537b3640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e380a3480 0x7f0e380a5940 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.839+0000 7f0e537b3640 1 --2- 172.21.15.12:0/1581024989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e4c1091f0 0x7f0e4c114190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.839+0000 7f0e537b3640 1 -- 172.21.15.12:0/1581024989 >> 172.21.15.12:0/1581024989 conn(0x7f0e4c06e2d0 msgr2=0x7f0e4c0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.840+0000 7f0e537b3640 1 -- 172.21.15.12:0/1581024989 shutdown_connections 2024-09-19T06:49:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:15.840+0000 7f0e537b3640 1 -- 172.21.15.12:0/1581024989 wait complete. 2024-09-19T06:49:16.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:15 smithi012 ceph-mon[30937]: pgmap v281: 97 pgs: 97 active+clean; 4.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-09-19T06:49:16.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:15 smithi012 ceph-mon[30937]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:49:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:15 smithi016 ceph-mon[34911]: pgmap v281: 97 pgs: 97 active+clean; 4.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-09-19T06:49:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:15 smithi016 ceph-mon[34911]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:49:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:15 smithi173 ceph-mon[35349]: pgmap v281: 97 pgs: 97 active+clean; 4.3 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-09-19T06:49:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:15 smithi173 ceph-mon[35349]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:49:16.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:49:17.299 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:17.994 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:17 smithi012 ceph-mon[30937]: pgmap v283: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 MiB/s wr, 2.18k op/s 2024-09-19T06:49:18.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.016+0000 7f3e1f371640 1 -- 172.21.15.12:0/2201094815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e18105ec0 msgr2=0x7f3e18106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.016+0000 7f3e1f371640 1 --2- 172.21.15.12:0/2201094815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e18105ec0 0x7f3e18106340 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009c10 tx=0x7f3e1002a720 comp rx=0 tx=0).stop 2024-09-19T06:49:18.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.017+0000 7f3e1f371640 1 -- 172.21.15.12:0/2201094815 shutdown_connections 2024-09-19T06:49:18.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.017+0000 7f3e1f371640 1 --2- 172.21.15.12:0/2201094815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e18105ec0 0x7f3e18106340 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.017+0000 7f3e1f371640 1 --2- 172.21.15.12:0/2201094815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e181011e0 0x7f3e18105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.017+0000 7f3e1f371640 1 --2- 172.21.15.12:0/2201094815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e181008c0 0x7f3e18100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.017+0000 7f3e1f371640 1 -- 172.21.15.12:0/2201094815 >> 172.21.15.12:0/2201094815 conn(0x7f3e180fc7d0 msgr2=0x7f3e180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.019+0000 7f3e1f371640 1 -- 172.21.15.12:0/2201094815 shutdown_connections 2024-09-19T06:49:18.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.021+0000 7f3e1f371640 1 -- 172.21.15.12:0/2201094815 wait complete. 2024-09-19T06:49:18.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.022+0000 7f3e1f371640 1 Processor -- start 2024-09-19T06:49:18.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.022+0000 7f3e1f371640 1 -- start start 2024-09-19T06:49:18.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.022+0000 7f3e1f371640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e181008c0 0x7f3e180739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.022+0000 7f3e1f371640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e18105ec0 0x7f3e18071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.022+0000 7f3e1f371640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18072040 0x7f3e180724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.022+0000 7f3e1d10d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e181008c0 0x7f3e180739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.023+0000 7f3e1d10d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e181008c0 0x7f3e180739f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54064/0 (socket says 172.21.15.12:54064) 2024-09-19T06:49:18.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.023+0000 7f3e1d10d640 1 -- 172.21.15.12:0/1295096052 learned_addr learned my addr 172.21.15.12:0/1295096052 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:18.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.023+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18109890 con 0x7f3e18105ec0 2024-09-19T06:49:18.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.023+0000 7f3e1d90e640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18072040 0x7f3e180724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.023+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18109710 con 0x7f3e18072040 2024-09-19T06:49:18.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.023+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18109a10 con 0x7f3e181008c0 2024-09-19T06:49:18.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.026+0000 7f3e1d10d640 1 -- 172.21.15.12:0/1295096052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18072040 msgr2=0x7f3e180724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.026+0000 7f3e1d10d640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18072040 0x7f3e180724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.026+0000 7f3e1d10d640 1 -- 172.21.15.12:0/1295096052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e18105ec0 msgr2=0x7f3e18071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.026+0000 7f3e1d10d640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e18105ec0 0x7f3e18071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.026+0000 7f3e1d10d640 1 -- 172.21.15.12:0/1295096052 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e181151f0 con 0x7f3e181008c0 2024-09-19T06:49:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.026+0000 7f3e1d10d640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e181008c0 0x7f3e180739f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e1401fa60 tx=0x7f3e1401ff20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.027+0000 7f3e0e7fc640 1 -- 172.21.15.12:0/1295096052 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1401dc50 con 0x7f3e181008c0 2024-09-19T06:49:18.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.028+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e181154e0 con 0x7f3e181008c0 2024-09-19T06:49:18.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.028+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e181abc40 con 0x7f3e181008c0 2024-09-19T06:49:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.028+0000 7f3e0e7fc640 1 -- 172.21.15.12:0/1295096052 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e1401ddf0 con 0x7f3e181008c0 2024-09-19T06:49:18.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.028+0000 7f3e0e7fc640 1 -- 172.21.15.12:0/1295096052 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e140216a0 con 0x7f3e181008c0 2024-09-19T06:49:18.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.036+0000 7f3e0e7fc640 1 -- 172.21.15.12:0/1295096052 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3e14021840 con 0x7f3e181008c0 2024-09-19T06:49:18.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.037+0000 7f3e0e7fc640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e040a3540 0x7f3e040a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.037+0000 7f3e0e7fc640 1 -- 172.21.15.12:0/1295096052 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f3e140e1fc0 con 0x7f3e181008c0 2024-09-19T06:49:18.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.037+0000 7f3e2174a740 1 Processor -- start 2024-09-19T06:49:18.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.037+0000 7f3e2174a740 1 -- start start 2024-09-19T06:49:18.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.038+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c46b40 0x558503c45090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.038+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c45a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.038+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c50370 0x558503c52760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.038+0000 7f3e2174a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558503bab2f0 con 0x558503c455d0 2024-09-19T06:49:18.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.038+0000 7f3e2174a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558503b52cf0 con 0x558503c46b40 2024-09-19T06:49:18.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.038+0000 7f3e2174a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558503ba72b0 con 0x558503c50370 2024-09-19T06:49:18.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.038+0000 7f3e1d90e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c50370 0x558503c52760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.038+0000 7f3e1d90e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c50370 0x558503c52760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54076/0 (socket says 172.21.15.12:54076) 2024-09-19T06:49:18.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.038+0000 7f3e1d90e640 1 -- 172.21.15.12:0/2134694198 learned_addr learned my addr 172.21.15.12:0/2134694198 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:18.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.039+0000 7f3e1c90c640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e040a3540 0x7f3e040a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.039+0000 7f3e1d90e640 1 -- 172.21.15.12:0/2134694198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c46b40 msgr2=0x558503c45090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:18.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.039+0000 7f3e1d90e640 1 --2- 172.21.15.12:0/2134694198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c46b40 0x558503c45090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.039+0000 7f3e1d90e640 1 -- 172.21.15.12:0/2134694198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 msgr2=0x558503c45a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:18.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.039+0000 7f3e1d90e640 1 --2- 172.21.15.12:0/2134694198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c45a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.039+0000 7f3e1d90e640 1 -- 172.21.15.12:0/2134694198 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558503b373a0 con 0x558503c50370 2024-09-19T06:49:18.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.040+0000 7f3e1d90e640 1 --2- 172.21.15.12:0/2134694198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c50370 0x558503c52760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3e1002ad10 tx=0x7f3e10030660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c39a1900655b1d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.040+0000 7f3e037fe640 1 -- 172.21.15.12:0/2134694198 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10036040 con 0x558503c50370 2024-09-19T06:49:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.040+0000 7f3e037fe640 1 -- 172.21.15.12:0/2134694198 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e10030e60 con 0x558503c50370 2024-09-19T06:49:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.041+0000 7f3e2174a740 1 -- 172.21.15.12:0/2134694198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c50370 msgr2=0x558503c52760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.041+0000 7f3e2174a740 1 --2- 172.21.15.12:0/2134694198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c50370 0x558503c52760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3e1002ad10 tx=0x7f3e10030660 comp rx=0 tx=0).stop 2024-09-19T06:49:18.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.042+0000 7f3e2174a740 1 -- 172.21.15.12:0/2134694198 shutdown_connections 2024-09-19T06:49:18.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.042+0000 7f3e2174a740 1 --2- 172.21.15.12:0/2134694198 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c50370 0x558503c52760 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.042+0000 7f3e2174a740 1 --2- 172.21.15.12:0/2134694198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c45a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.042+0000 7f3e2174a740 1 --2- 172.21.15.12:0/2134694198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c46b40 0x558503c45090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.042+0000 7f3e2174a740 1 -- 172.21.15.12:0/2134694198 >> 172.21.15.12:0/2134694198 conn(0x558503c0e310 msgr2=0x558503c41c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.044+0000 7f3e1c90c640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e040a3540 0x7f3e040a5a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x558503c42ac0 tx=0x7f3e08009170 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.047+0000 7f3e2174a740 1 -- 172.21.15.12:0/2134694198 shutdown_connections 2024-09-19T06:49:18.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.048+0000 7f3e2174a740 1 -- 172.21.15.12:0/2134694198 wait complete. 2024-09-19T06:49:18.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.048+0000 7f3e2174a740 1 -- start start 2024-09-19T06:49:18.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.048+0000 7f3e2174a740 1 Processor -- start 2024-09-19T06:49:18.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.049+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c4fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.049+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 0x558503c4cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.049+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c50370 0x558503c4d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.049+0000 7f3e2174a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558503c530b0 con 0x558503c455d0 2024-09-19T06:49:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.049+0000 7f3e2174a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x558503b66060 con 0x558503c50370 2024-09-19T06:49:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.049+0000 7f3e2174a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558503c53230 con 0x558503c46b40 2024-09-19T06:49:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.049+0000 7f3e2174a740 10 client.0 _ll_register_callbacks cb 0x5585038b98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.049+0000 7f3e1c90c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 0x558503c4cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.049+0000 7f3e1c90c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 0x558503c4cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54090/0 (socket says 172.21.15.12:54090) 2024-09-19T06:49:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.049+0000 7f3e1c90c640 1 -- 172.21.15.12:0/2101142673 learned_addr learned my addr 172.21.15.12:0/2101142673 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:18.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.051+0000 7f3e1d90e640 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c50370 0x558503c4d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.052+0000 7f3e1d10d640 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c4fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.052+0000 7f3e1d90e640 1 -- 172.21.15.12:0/2101142673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 msgr2=0x558503c4cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:18.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.052+0000 7f3e1d90e640 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 0x558503c4cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.052+0000 7f3e1d90e640 1 -- 172.21.15.12:0/2101142673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 msgr2=0x558503c4fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:18.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.052+0000 7f3e1d90e640 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c4fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.052+0000 7f3e1d90e640 1 -- 172.21.15.12:0/2101142673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55850391c3c0 con 0x558503c50370 2024-09-19T06:49:18.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.053+0000 7f3e1d90e640 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c50370 0x558503c4d460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x558503c46070 tx=0x7f3e1002a720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=416b7a7968be9bad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.054+0000 7f3e00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:18.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.054+0000 7f3e00ff9640 1 -- 172.21.15.12:0/2101142673 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10036070 con 0x558503c50370 2024-09-19T06:49:18.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.054+0000 7f3e00ff9640 1 -- 172.21.15.12:0/2101142673 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f3e10003970 con 0x558503c50370 2024-09-19T06:49:18.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.054+0000 7f3e2174a740 1 -- 172.21.15.12:0/2101142673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e10030e60 con 0x558503c50370 2024-09-19T06:49:18.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.058+0000 7f3e00ff9640 1 -- 172.21.15.12:0/2101142673 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3e10055050 con 0x558503c50370 2024-09-19T06:49:18.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.058+0000 7f3e2174a740 10 client.27389 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:18.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.058+0000 7f3e2174a740 1 -- 172.21.15.12:0/2101142673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x558503c5eb40 con 0x558503c50370 2024-09-19T06:49:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.059+0000 7f3e00ff9640 1 -- 172.21.15.12:0/2101142673 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e10030e60 con 0x558503c50370 2024-09-19T06:49:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.059+0000 7f3e00ff9640 1 -- 172.21.15.12:0/2101142673 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f3e1003d460 con 0x558503c50370 2024-09-19T06:49:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.059+0000 7f3e2174a740 10 client.27389 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.059+0000 7f3e2174a740 10 client.27389 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:49:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.059+0000 7f3e2174a740 20 client.27389 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.059+0000 7f3e2174a740 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x558503c5fe90 0x558503c62280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.059+0000 7f3e2174a740 4 client.27389 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:18.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.059+0000 7f3e2174a740 1 -- 172.21.15.12:0/2101142673 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558503bb8860 con 0x558503c5fe90 2024-09-19T06:49:18.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.059+0000 7f3e1d10d640 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x558503c5fe90 0x558503c62280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.065+0000 7f3e1d10d640 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x558503c5fe90 0x558503c62280 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=940718c76bbda38d server_cookie=3467e03a4dc57977 in_seq=0 out_seq=0 2024-09-19T06:49:18.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.065+0000 7f3e00ff9640 10 client.27389 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:49:18.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.067+0000 7f3e00ff9640 1 -- 172.21.15.12:0/2101142673 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558503bb8860 con 0x558503c5fe90 2024-09-19T06:49:18.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.068+0000 7f3e00ff9640 10 client.27389 handle_command_reply: tid=0 2024-09-19T06:49:18.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.068+0000 7f3e2174a740 1 client.27389 shutdown 2024-09-19T06:49:18.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.068+0000 7f3e2174a740 1 -- 172.21.15.12:0/2101142673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c50370 msgr2=0x558503c4d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.068+0000 7f3e2174a740 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c50370 0x558503c4d460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x558503c46070 tx=0x7f3e1002a720 comp rx=0 tx=0).stop 2024-09-19T06:49:18.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.068+0000 7f3e2174a740 1 -- 172.21.15.12:0/2101142673 shutdown_connections 2024-09-19T06:49:18.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.068+0000 7f3e2174a740 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x558503c5fe90 0x558503c62280 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.068+0000 7f3e2174a740 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c50370 0x558503c4d460 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.068+0000 7f3e2174a740 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 0x558503c4cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.068+0000 7f3e2174a740 1 --2- 172.21.15.12:0/2101142673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c4fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.068+0000 7f3e2174a740 1 -- 172.21.15.12:0/2101142673 >> 172.21.15.12:0/2101142673 conn(0x558503c0e310 msgr2=0x558503c47930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.069+0000 7f3e00ff9640 0 client.27389 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:49:18.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.069+0000 7f3e2174a740 1 -- 172.21.15.12:0/2101142673 shutdown_connections 2024-09-19T06:49:18.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.069+0000 7f3e2174a740 1 -- 172.21.15.12:0/2101142673 wait complete. 2024-09-19T06:49:18.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.069+0000 7f3e2174a740 20 client.27389 trim_cache size 0 max 16384 2024-09-19T06:49:18.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.083+0000 7f3e2174a740 1 Processor -- start 2024-09-19T06:49:18.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.083+0000 7f3e2174a740 1 -- start start 2024-09-19T06:49:18.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.083+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 0x558503c5c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.083+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c61ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.083+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 0x558503c67910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e2174a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc00eb70 con 0x558503c455d0 2024-09-19T06:49:18.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e2174a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc0106b0 con 0x558503c0e310 2024-09-19T06:49:18.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e2174a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc00f240 con 0x558503c46b40 2024-09-19T06:49:18.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1c90c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c61ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1d90e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 0x558503c67910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1c90c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c61ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51664/0 (socket says 172.21.15.12:51664) 2024-09-19T06:49:18.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1d10d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 0x558503c5c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1c90c640 1 -- 172.21.15.12:0/259117716 learned_addr learned my addr 172.21.15.12:0/259117716 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:18.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1c90c640 1 -- 172.21.15.12:0/259117716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 msgr2=0x558503c67910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1c90c640 1 --2- 172.21.15.12:0/259117716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 0x558503c67910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1c90c640 1 -- 172.21.15.12:0/259117716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 msgr2=0x558503c5c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1c90c640 1 --2- 172.21.15.12:0/259117716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 0x558503c5c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1c90c640 1 -- 172.21.15.12:0/259117716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558503c48120 con 0x558503c455d0 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1d90e640 1 --2- 172.21.15.12:0/259117716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 0x558503c67910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1d10d640 1 --2- 172.21.15.12:0/259117716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 0x558503c5c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.084+0000 7f3e1c90c640 1 --2- 172.21.15.12:0/259117716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c61ea0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f3e08006c30 tx=0x7f3e0800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bedfe5d3c1d2b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.085+0000 7f3e02ffd640 1 -- 172.21.15.12:0/259117716 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800f070 con 0x558503c455d0 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.085+0000 7f3e02ffd640 1 -- 172.21.15.12:0/259117716 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e08026070 con 0x558503c455d0 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.085+0000 7f3e02ffd640 1 -- 172.21.15.12:0/259117716 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08014640 con 0x558503c455d0 2024-09-19T06:49:18.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.085+0000 7f3e2174a740 1 -- 172.21.15.12:0/259117716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 msgr2=0x558503c61ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.085+0000 7f3e2174a740 1 --2- 172.21.15.12:0/259117716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c61ea0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f3e08006c30 tx=0x7f3e0800f000 comp rx=0 tx=0).stop 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.085+0000 7f3e2174a740 1 -- 172.21.15.12:0/259117716 shutdown_connections 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.085+0000 7f3e2174a740 1 --2- 172.21.15.12:0/259117716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c46b40 0x558503c67910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.085+0000 7f3e2174a740 1 --2- 172.21.15.12:0/259117716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c455d0 0x558503c61ea0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.085+0000 7f3e2174a740 1 --2- 172.21.15.12:0/259117716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 0x558503c5c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.085+0000 7f3e2174a740 1 -- 172.21.15.12:0/259117716 >> 172.21.15.12:0/259117716 conn(0x558503c4d5c0 msgr2=0x558503c4b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 1 -- 172.21.15.12:0/259117716 shutdown_connections 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 1 -- 172.21.15.12:0/259117716 wait complete. 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 1 -- start start 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 1 Processor -- start 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 0x558503c49f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c455d0 0x558503c4a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c46b40 0x558503c4a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc00ffe0 con 0x558503c46b40 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc00f910 con 0x558503c0e310 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc00cb70 con 0x558503c455d0 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.086+0000 7f3e2174a740 10 client.0 _ll_register_callbacks cb 0x7f3e10009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1c90c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c455d0 0x558503c4a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1c90c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c455d0 0x558503c4a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54110/0 (socket says 172.21.15.12:54110) 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1c90c640 1 -- 172.21.15.12:0/1087903426 learned_addr learned my addr 172.21.15.12:0/1087903426 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1d90e640 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c46b40 0x558503c4a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1d10d640 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 0x558503c49f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1c90c640 1 -- 172.21.15.12:0/1087903426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 msgr2=0x558503c49f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1c90c640 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 0x558503c49f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1c90c640 1 -- 172.21.15.12:0/1087903426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c46b40 msgr2=0x558503c4a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1c90c640 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c46b40 0x558503c4a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1c90c640 1 -- 172.21.15.12:0/1087903426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558503cc9910 con 0x558503c455d0 2024-09-19T06:49:18.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e1c90c640 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c455d0 0x558503c4a4b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009430 tx=0x7f3e08021690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7d26f02b1a5178e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:49:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e00ff9640 1 -- 172.21.15.12:0/1087903426 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08021880 con 0x558503c455d0 2024-09-19T06:49:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.087+0000 7f3e00ff9640 1 -- 172.21.15.12:0/1087903426 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f3e08005dc0 con 0x558503c455d0 2024-09-19T06:49:18.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e2174a740 1 -- 172.21.15.12:0/1087903426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e08026070 con 0x558503c455d0 2024-09-19T06:49:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e00ff9640 1 -- 172.21.15.12:0/1087903426 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3e08006040 con 0x558503c455d0 2024-09-19T06:49:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e2174a740 10 client.27352 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e2174a740 1 -- 172.21.15.12:0/1087903426 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x558503ccabd0 con 0x558503c455d0 2024-09-19T06:49:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e00ff9640 1 -- 172.21.15.12:0/1087903426 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e080066c0 con 0x558503c455d0 2024-09-19T06:49:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e00ff9640 1 -- 172.21.15.12:0/1087903426 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f3e080396d0 con 0x558503c455d0 2024-09-19T06:49:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e2174a740 10 client.27352 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:18.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e2174a740 10 client.27352 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e2174a740 20 client.27352 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e2174a740 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x558503c50370 0x558503ccd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e2174a740 4 client.27352 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e2174a740 1 -- 172.21.15.12:0/1087903426 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3e08026070 con 0x558503c50370 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.088+0000 7f3e1d10d640 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x558503c50370 0x558503ccd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e00ff9640 10 client.27352 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e1d10d640 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x558503c50370 0x558503ccd280 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d02619b02a2be2df server_cookie=78d6a7dfc5f5eaf2 in_seq=0 out_seq=0 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e00ff9640 1 -- 172.21.15.12:0/1087903426 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3e08026070 con 0x558503c50370 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e00ff9640 10 client.27352 handle_command_reply: tid=0 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e2174a740 1 client.27352 shutdown 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e2174a740 1 -- 172.21.15.12:0/1087903426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c455d0 msgr2=0x558503c4a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e2174a740 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c455d0 0x558503c4a4b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009430 tx=0x7f3e08021690 comp rx=0 tx=0).stop 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e2174a740 1 -- 172.21.15.12:0/1087903426 shutdown_connections 2024-09-19T06:49:18.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e2174a740 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x558503c50370 0x558503ccd280 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e2174a740 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558503c46b40 0x558503c4a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e2174a740 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558503c455d0 0x558503c4a4b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e2174a740 1 --2- 172.21.15.12:0/1087903426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x558503c0e310 0x558503c49f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e2174a740 1 -- 172.21.15.12:0/1087903426 >> 172.21.15.12:0/1087903426 conn(0x558503c4d5c0 msgr2=0x558503c404e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.089+0000 7f3e00ff9640 0 client.27352 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:49:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.090+0000 7f3e2174a740 1 -- 172.21.15.12:0/1087903426 shutdown_connections 2024-09-19T06:49:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.090+0000 7f3e2174a740 1 -- 172.21.15.12:0/1087903426 wait complete. 2024-09-19T06:49:18.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.090+0000 7f3e2174a740 20 client.27352 trim_cache size 0 max 16384 2024-09-19T06:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:49:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.090+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e040a3540 msgr2=0x7f3e040a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.090+0000 7f3e1f371640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e040a3540 0x7f3e040a5a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x558503c42ac0 tx=0x7f3e08009170 comp rx=0 tx=0).stop 2024-09-19T06:49:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.090+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e181008c0 msgr2=0x7f3e180739f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.090+0000 7f3e1f371640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e181008c0 0x7f3e180739f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e1401fa60 tx=0x7f3e1401ff20 comp rx=0 tx=0).stop 2024-09-19T06:49:18.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.090+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 shutdown_connections 2024-09-19T06:49:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.090+0000 7f3e1f371640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18072040 0x7f3e180724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.090+0000 7f3e1f371640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e18105ec0 0x7f3e18071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.091+0000 7f3e1f371640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e040a3540 0x7f3e040a5a00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.091+0000 7f3e1f371640 1 --2- 172.21.15.12:0/1295096052 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e181008c0 0x7f3e180739f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.091+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 >> 172.21.15.12:0/1295096052 conn(0x7f3e180fc7d0 msgr2=0x7f3e180fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.091+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 shutdown_connections 2024-09-19T06:49:18.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:18.091+0000 7f3e1f371640 1 -- 172.21.15.12:0/1295096052 wait complete. 2024-09-19T06:49:18.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:17 smithi016 ceph-mon[34911]: pgmap v283: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 MiB/s wr, 2.18k op/s 2024-09-19T06:49:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:17 smithi173 ceph-mon[35349]: pgmap v283: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 MiB/s wr, 2.18k op/s 2024-09-19T06:49:19.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:49:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.082+0000 7f3a9092c640 1 -- 172.21.15.12:0/3284040418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c11b140 msgr2=0x7f3a8c11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.082+0000 7f3a9092c640 1 --2- 172.21.15.12:0/3284040418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c11b140 0x7f3a8c11d530 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009ca0 tx=0x7f3a8402a8f0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.082+0000 7f3a9092c640 1 -- 172.21.15.12:0/3284040418 shutdown_connections 2024-09-19T06:49:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.082+0000 7f3a9092c640 1 --2- 172.21.15.12:0/3284040418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c11b140 0x7f3a8c11d530 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.082+0000 7f3a9092c640 1 --2- 172.21.15.12:0/3284040418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a8c1095d0 0x7f3a8c109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.082+0000 7f3a9092c640 1 --2- 172.21.15.12:0/3284040418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a8c1091f0 0x7f3a8c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.082+0000 7f3a9092c640 1 -- 172.21.15.12:0/3284040418 >> 172.21.15.12:0/3284040418 conn(0x7f3a8c06ce00 msgr2=0x7f3a8c06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.083+0000 7f3a9092c640 1 -- 172.21.15.12:0/3284040418 shutdown_connections 2024-09-19T06:49:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.083+0000 7f3a9092c640 1 -- 172.21.15.12:0/3284040418 wait complete. 2024-09-19T06:49:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.084+0000 7f3a9092c640 1 Processor -- start 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.084+0000 7f3a9092c640 1 -- start start 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.084+0000 7f3a9092c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a8c1091f0 0x7f3a8c11a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.084+0000 7f3a9092c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c1095d0 0x7f3a8c1148e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.084+0000 7f3a9092c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a8c11b140 0x7f3a8c114e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.084+0000 7f3a9092c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c111370 con 0x7f3a8c1095d0 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.084+0000 7f3a9092c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1111f0 con 0x7f3a8c11b140 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.084+0000 7f3a9092c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c1114f0 con 0x7f3a8c1091f0 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.084+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a8c1091f0 0x7f3a8c11a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a89d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c1095d0 0x7f3a8c1148e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a8ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a8c11b140 0x7f3a8c114e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a8c1091f0 0x7f3a8c11a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54116/0 (socket says 172.21.15.12:54116) 2024-09-19T06:49:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a8a59c640 1 -- 172.21.15.12:0/965216027 learned_addr learned my addr 172.21.15.12:0/965216027 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a8a59c640 1 -- 172.21.15.12:0/965216027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a8c11b140 msgr2=0x7f3a8c114e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a8a59c640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a8c11b140 0x7f3a8c114e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a8a59c640 1 -- 172.21.15.12:0/965216027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c1095d0 msgr2=0x7f3a8c1148e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a8a59c640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c1095d0 0x7f3a8c1148e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a8a59c640 1 -- 172.21.15.12:0/965216027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c115550 con 0x7f3a8c1091f0 2024-09-19T06:49:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a8ad9d640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a8c11b140 0x7f3a8c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a8a59c640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a8c1091f0 0x7f3a8c11a870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00b450 tx=0x7f3a7c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.085+0000 7f3a7b7fe640 1 -- 172.21.15.12:0/965216027 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c015020 con 0x7f3a8c1091f0 2024-09-19T06:49:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.086+0000 7f3a7b7fe640 1 -- 172.21.15.12:0/965216027 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a7c011d10 con 0x7f3a8c1091f0 2024-09-19T06:49:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.086+0000 7f3a9092c640 1 -- 172.21.15.12:0/965216027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8c1bc0a0 con 0x7f3a8c1091f0 2024-09-19T06:49:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.086+0000 7f3a9092c640 1 -- 172.21.15.12:0/965216027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8c1bc560 con 0x7f3a8c1091f0 2024-09-19T06:49:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.086+0000 7f3a7b7fe640 1 -- 172.21.15.12:0/965216027 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00f2e0 con 0x7f3a8c1091f0 2024-09-19T06:49:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.090+0000 7f3a936c1740 1 Processor -- start 2024-09-19T06:49:19.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.090+0000 7f3a7b7fe640 1 -- 172.21.15.12:0/965216027 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3a7c018020 con 0x7f3a8c1091f0 2024-09-19T06:49:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.090+0000 7f3a936c1740 1 -- start start 2024-09-19T06:49:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.091+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a71ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.091+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a72410 0x561449a7c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.091+0000 7f3a7b7fe640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a740a3610 0x7f3a740a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a7b7fe640 1 -- 172.21.15.12:0/965216027 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f3a7c0cf2e0 con 0x7f3a8c1091f0 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a7ccb0 0x561449a7f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a936c1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5614499d62f0 con 0x561449a71af0 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a936c1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56144997e270 con 0x561449a7ccb0 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a936c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5614499d22b0 con 0x561449a72410 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a8ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a71ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a8ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a71ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51724/0 (socket says 172.21.15.12:51724) 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a8ad9d640 1 -- 172.21.15.12:0/269839117 learned_addr learned my addr 172.21.15.12:0/269839117 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/269839117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a7ccb0 0x561449a7f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a89d9b640 1 -- 172.21.15.12:0/269839117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a72410 msgr2=0x561449a7c770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:49:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/269839117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a72410 0x561449a7c770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a89d9b640 1 -- 172.21.15.12:0/269839117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 msgr2=0x561449a71ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/269839117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a71ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.095 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.092+0000 7f3a89d9b640 1 -- 172.21.15.12:0/269839117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56144997d340 con 0x561449a7ccb0 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.093+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/269839117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a7ccb0 0x561449a7f0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c116130 tx=0x7f3a80009e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec8ce4faf9ea6655 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.093+0000 7f3a78ff9640 1 -- 172.21.15.12:0/269839117 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80017070 con 0x561449a7ccb0 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.093+0000 7f3a78ff9640 1 -- 172.21.15.12:0/269839117 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a80013470 con 0x561449a7ccb0 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.093+0000 7f3a78ff9640 1 -- 172.21.15.12:0/269839117 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80012630 con 0x561449a7ccb0 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.094+0000 7f3a8ad9d640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a740a3610 0x7f3a740a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.094+0000 7f3a936c1740 1 -- 172.21.15.12:0/269839117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a7ccb0 msgr2=0x561449a7f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.094+0000 7f3a936c1740 1 --2- 172.21.15.12:0/269839117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a7ccb0 0x561449a7f0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c116130 tx=0x7f3a80009e10 comp rx=0 tx=0).stop 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.094+0000 7f3a936c1740 1 -- 172.21.15.12:0/269839117 shutdown_connections 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.094+0000 7f3a936c1740 1 --2- 172.21.15.12:0/269839117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a7ccb0 0x561449a7f0a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.094+0000 7f3a936c1740 1 --2- 172.21.15.12:0/269839117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a72410 0x561449a7c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.096 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.094+0000 7f3a936c1740 1 --2- 172.21.15.12:0/269839117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a71ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.094+0000 7f3a936c1740 1 -- 172.21.15.12:0/269839117 >> 172.21.15.12:0/269839117 conn(0x561449a6e060 msgr2=0x561449a6e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.094+0000 7f3a936c1740 1 -- 172.21.15.12:0/269839117 shutdown_connections 2024-09-19T06:49:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.095+0000 7f3a936c1740 1 -- 172.21.15.12:0/269839117 wait complete. 2024-09-19T06:49:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.095+0000 7f3a8ad9d640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a740a3610 0x7f3a740a5ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009a60 tx=0x7f3a84040040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.095+0000 7f3a936c1740 1 -- start start 2024-09-19T06:49:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.095+0000 7f3a936c1740 1 Processor -- start 2024-09-19T06:49:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a79af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 0x561449a7a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a7ccb0 0x561449a7a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a936c1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561449a7f920 con 0x561449a71af0 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a936c1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56144995f290 con 0x561449a72410 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a936c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561449a7faa0 con 0x561449a7ccb0 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a936c1740 10 client.0 _ll_register_callbacks cb 0x561449990140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a79af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a79af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51740/0 (socket says 172.21.15.12:51740) 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a8a59c640 1 -- 172.21.15.12:0/351288939 learned_addr learned my addr 172.21.15.12:0/351288939 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 0x561449a7a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a8ad9d640 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a7ccb0 0x561449a7a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a8a59c640 1 -- 172.21.15.12:0/351288939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a7ccb0 msgr2=0x561449a7a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a8a59c640 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a7ccb0 0x561449a7a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a8a59c640 1 -- 172.21.15.12:0/351288939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 msgr2=0x561449a7a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a8a59c640 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 0x561449a7a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.096+0000 7f3a8a59c640 1 -- 172.21.15.12:0/351288939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614496e9210 con 0x561449a71af0 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a8a59c640 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a79af0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0ccf90 tx=0x7f3a7c09b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16ec20df754053d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a71ffb640 1 -- 172.21.15.12:0/351288939 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c09af90 con 0x561449a71af0 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a71ffb640 1 -- 172.21.15.12:0/351288939 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f3a7c0ccc10 con 0x561449a71af0 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a936c1740 1 -- 172.21.15.12:0/351288939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a80013470 con 0x561449a71af0 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a71ffb640 1 -- 172.21.15.12:0/351288939 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3a7c09bd30 con 0x561449a71af0 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a936c1740 10 client.17985 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a936c1740 1 -- 172.21.15.12:0/351288939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5614497b5620 con 0x561449a71af0 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a71ffb640 1 -- 172.21.15.12:0/351288939 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a7c09b630 con 0x561449a71af0 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a71ffb640 1 -- 172.21.15.12:0/351288939 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f3a7c0afbe0 con 0x561449a71af0 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.097+0000 7f3a936c1740 10 client.17985 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.098+0000 7f3a936c1740 10 client.17985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.098+0000 7f3a936c1740 20 client.17985 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.098+0000 7f3a936c1740 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561449a8ccc0 0x561449a8f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.098+0000 7f3a936c1740 4 client.17985 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.098+0000 7f3a936c1740 1 -- 172.21.15.12:0/351288939 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3a80013470 con 0x561449a8ccc0 2024-09-19T06:49:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.098+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561449a8ccc0 0x561449a8f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.099+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561449a8ccc0 0x561449a8f0d0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28e3d267668675a9 server_cookie=d6cc7349b61b9e36 in_seq=0 out_seq=0 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.099+0000 7f3a71ffb640 10 client.17985 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.099+0000 7f3a71ffb640 1 -- 172.21.15.12:0/351288939 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3a80013470 con 0x561449a8ccc0 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.099+0000 7f3a71ffb640 10 client.17985 handle_command_reply: tid=0 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.099+0000 7f3a936c1740 1 client.17985 shutdown 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 1 -- 172.21.15.12:0/351288939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 msgr2=0x561449a79af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a79af0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0ccf90 tx=0x7f3a7c09b400 comp rx=0 tx=0).stop 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 1 -- 172.21.15.12:0/351288939 shutdown_connections 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561449a8ccc0 0x561449a8f0d0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a7ccb0 0x561449a7a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 0x561449a7a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 1 --2- 172.21.15.12:0/351288939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a71af0 0x561449a79af0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 1 -- 172.21.15.12:0/351288939 >> 172.21.15.12:0/351288939 conn(0x561449a6e060 msgr2=0x561449a73dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a71ffb640 0 client.17985 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 1 -- 172.21.15.12:0/351288939 shutdown_connections 2024-09-19T06:49:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 1 -- 172.21.15.12:0/351288939 wait complete. 2024-09-19T06:49:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.100+0000 7f3a936c1740 20 client.17985 trim_cache size 0 max 16384 2024-09-19T06:49:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.119+0000 7f3a936c1740 1 Processor -- start 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.119+0000 7f3a936c1740 1 -- start start 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.119+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 0x561449a6d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.119+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 0x561449a7a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.119+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a7ccb0 0x561449a949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.119+0000 7f3a936c1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c00ea40 con 0x561449a7ccb0 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.119+0000 7f3a936c1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c010580 con 0x561449a72410 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.119+0000 7f3a936c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c00f110 con 0x561449a71af0 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a89d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 0x561449a7a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 0x561449a6d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a8ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a7ccb0 0x561449a949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a89d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 0x561449a7a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49106/0 (socket says 172.21.15.12:49106) 2024-09-19T06:49:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a89d9b640 1 -- 172.21.15.12:0/3012950569 learned_addr learned my addr 172.21.15.12:0/3012950569 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a89d9b640 1 -- 172.21.15.12:0/3012950569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 msgr2=0x561449a6d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/3012950569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 0x561449a6d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a89d9b640 1 -- 172.21.15.12:0/3012950569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a7ccb0 msgr2=0x561449a949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/3012950569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a7ccb0 0x561449a949e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a89d9b640 1 -- 172.21.15.12:0/3012950569 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561449a72240 con 0x561449a72410 2024-09-19T06:49:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/3012950569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 0x561449a7a3a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009740 tx=0x7f3a80008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2ad2c4ee3be525e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a73fff640 1 -- 172.21.15.12:0/3012950569 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80017040 con 0x561449a72410 2024-09-19T06:49:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a73fff640 1 -- 172.21.15.12:0/3012950569 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a80004520 con 0x561449a72410 2024-09-19T06:49:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.120+0000 7f3a73fff640 1 -- 172.21.15.12:0/3012950569 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a800136d0 con 0x561449a72410 2024-09-19T06:49:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.121+0000 7f3a936c1740 1 -- 172.21.15.12:0/3012950569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 msgr2=0x561449a7a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.121+0000 7f3a936c1740 1 --2- 172.21.15.12:0/3012950569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 0x561449a7a3a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009740 tx=0x7f3a80008040 comp rx=0 tx=0).stop 2024-09-19T06:49:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.121+0000 7f3a936c1740 1 -- 172.21.15.12:0/3012950569 shutdown_connections 2024-09-19T06:49:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.121+0000 7f3a936c1740 1 --2- 172.21.15.12:0/3012950569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a7ccb0 0x561449a949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.121+0000 7f3a936c1740 1 --2- 172.21.15.12:0/3012950569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a72410 0x561449a7a3a0 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009740 tx=0x7f3a80008040 comp rx=0 tx=0).stop 2024-09-19T06:49:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.122+0000 7f3a936c1740 1 --2- 172.21.15.12:0/3012950569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 0x561449a6d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.122+0000 7f3a936c1740 1 -- 172.21.15.12:0/3012950569 >> 172.21.15.12:0/3012950569 conn(0x561449a6e060 msgr2=0x561449a6c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.122+0000 7f3a936c1740 1 -- 172.21.15.12:0/3012950569 shutdown_connections 2024-09-19T06:49:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.122+0000 7f3a936c1740 1 -- 172.21.15.12:0/3012950569 wait complete. 2024-09-19T06:49:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.123+0000 7f3a936c1740 1 -- start start 2024-09-19T06:49:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.123+0000 7f3a936c1740 1 Processor -- start 2024-09-19T06:49:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.124+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 0x561449a80c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.124+0000 7f3a936c1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a7ccb0 0x561449a81180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.124+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 0x561449a80c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.124+0000 7f3a8a59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 0x561449a80c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54158/0 (socket says 172.21.15.12:54158) 2024-09-19T06:49:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.124+0000 7f3a8a59c640 1 -- 172.21.15.12:0/4156976544 learned_addr learned my addr 172.21.15.12:0/4156976544 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.124+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a7ccb0 0x561449a81180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.124+0000 7f3a936c1740 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a816c0 0x561449af69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.124+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c00feb0 con 0x561449a7ccb0 2024-09-19T06:49:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.124+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c00f7e0 con 0x561449a816c0 2024-09-19T06:49:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.124+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c00ca40 con 0x561449a71af0 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a8ad9d640 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a816c0 0x561449af69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a936c1740 10 client.0 _ll_register_callbacks cb 0x7f3a7c0046e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a8a59c640 1 -- 172.21.15.12:0/4156976544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a816c0 msgr2=0x561449af69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a8a59c640 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a816c0 0x561449af69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a8a59c640 1 -- 172.21.15.12:0/4156976544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a7ccb0 msgr2=0x561449a81180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a8a59c640 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a7ccb0 0x561449a81180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a8a59c640 1 -- 172.21.15.12:0/4156976544 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561449af6f70 con 0x561449a71af0 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a8ad9d640 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a816c0 0x561449af69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a80004520 con 0x561449a71af0 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a8a59c640 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 0x561449a80c40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c09ab20 tx=0x7f3a7c0107d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=413b9ce0dc8383e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a71ffb640 10 client.27364 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:49:19.129 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a71ffb640 1 -- 172.21.15.12:0/4156976544 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c09af90 con 0x561449a71af0 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a71ffb640 1 -- 172.21.15.12:0/4156976544 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f3a7c0afb50 con 0x561449a71af0 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a71ffb640 1 -- 172.21.15.12:0/4156976544 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3a7c09b630 con 0x561449a71af0 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a936c1740 10 client.27364 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.125+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=44}) -- 0x561449af8180 con 0x561449a71af0 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.126+0000 7f3a71ffb640 1 -- 172.21.15.12:0/4156976544 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f3a7c097450 con 0x561449a71af0 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.126+0000 7f3a936c1740 10 client.27364 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.126+0000 7f3a936c1740 10 client.27364 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.126+0000 7f3a936c1740 20 client.27364 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.126+0000 7f3a936c1740 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561449af8560 0x561449afa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.126+0000 7f3a936c1740 4 client.27364 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.126+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5614499e3a20 con 0x561449af8560 2024-09-19T06:49:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.126+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561449af8560 0x561449afa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.128+0000 7f3a89d9b640 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561449af8560 0x561449afa9a0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f63b1d1e6d00d506 server_cookie=bacf1291f65ee103 in_seq=0 out_seq=0 2024-09-19T06:49:19.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.128+0000 7f3a71ffb640 10 client.27364 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.143+0000 7f3a71ffb640 1 -- 172.21.15.12:0/4156976544 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5614499e3a20 con 0x561449af8560 2024-09-19T06:49:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.143+0000 7f3a71ffb640 10 client.27364 handle_command_reply: tid=0 2024-09-19T06:49:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.143+0000 7f3a936c1740 1 client.27364 shutdown 2024-09-19T06:49:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.143+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 msgr2=0x561449a80c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.143+0000 7f3a936c1740 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 0x561449a80c40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c09ab20 tx=0x7f3a7c0107d0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.143+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 shutdown_connections 2024-09-19T06:49:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.143+0000 7f3a936c1740 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561449af8560 0x561449afa9a0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.143+0000 7f3a936c1740 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561449a816c0 0x561449af69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.143+0000 7f3a71ffb640 0 client.27364 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.144+0000 7f3a936c1740 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561449a7ccb0 0x561449a81180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.144+0000 7f3a936c1740 1 --2- 172.21.15.12:0/4156976544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561449a71af0 0x561449a80c40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.144+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 >> 172.21.15.12:0/4156976544 conn(0x561449a6e060 msgr2=0x561449a73d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.144+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 shutdown_connections 2024-09-19T06:49:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.144+0000 7f3a936c1740 1 -- 172.21.15.12:0/4156976544 wait complete. 2024-09-19T06:49:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.144+0000 7f3a936c1740 20 client.27364 trim_cache size 0 max 16384 2024-09-19T06:49:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:49:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:49:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:49:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:49:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 -- 172.21.15.12:0/965216027 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a740a3610 msgr2=0x7f3a740a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a740a3610 0x7f3a740a5ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009a60 tx=0x7f3a84040040 comp rx=0 tx=0).stop 2024-09-19T06:49:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 -- 172.21.15.12:0/965216027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a8c1091f0 msgr2=0x7f3a8c11a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a8c1091f0 0x7f3a8c11a870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00b450 tx=0x7f3a7c00b910 comp rx=0 tx=0).stop 2024-09-19T06:49:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 -- 172.21.15.12:0/965216027 shutdown_connections 2024-09-19T06:49:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a8c11b140 0x7f3a8c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a8c1095d0 0x7f3a8c1148e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3a740a3610 0x7f3a740a5ad0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 --2- 172.21.15.12:0/965216027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a8c1091f0 0x7f3a8c11a870 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 -- 172.21.15.12:0/965216027 >> 172.21.15.12:0/965216027 conn(0x7f3a8c06ce00 msgr2=0x7f3a8c070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 -- 172.21.15.12:0/965216027 shutdown_connections 2024-09-19T06:49:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:19.145+0000 7f3a9092c640 1 -- 172.21.15.12:0/965216027 wait complete. 2024-09-19T06:49:19.438 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:20.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.004+0000 7f730b033640 1 -- 172.21.15.12:0/2853269467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f730410bfc0 msgr2=0x7f730410e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:20.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.004+0000 7f730b033640 1 --2- 172.21.15.12:0/2853269467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f730410bfc0 0x7f730410e460 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009be0 tx=0x7f72fc02a750 comp rx=0 tx=0).stop 2024-09-19T06:49:20.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.004+0000 7f730b033640 1 -- 172.21.15.12:0/2853269467 shutdown_connections 2024-09-19T06:49:20.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.004+0000 7f730b033640 1 --2- 172.21.15.12:0/2853269467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f730410bfc0 0x7f730410e460 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.004+0000 7f730b033640 1 --2- 172.21.15.12:0/2853269467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73041034b0 0x7f730410b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.004+0000 7f730b033640 1 --2- 172.21.15.12:0/2853269467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7304102b90 0x7f7304102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.004+0000 7f730b033640 1 -- 172.21.15.12:0/2853269467 >> 172.21.15.12:0/2853269467 conn(0x7f73040fc610 msgr2=0x7f73040fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:20.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.005+0000 7f730b033640 1 -- 172.21.15.12:0/2853269467 shutdown_connections 2024-09-19T06:49:20.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.005+0000 7f730b033640 1 -- 172.21.15.12:0/2853269467 wait complete. 2024-09-19T06:49:20.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.005+0000 7f730b033640 1 Processor -- start 2024-09-19T06:49:20.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730b033640 1 -- start start 2024-09-19T06:49:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730b033640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7304102b90 0x7f730419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730b033640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73041034b0 0x7f730419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730b033640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f730410bfc0 0x7f730419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730b033640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7304114000 con 0x7f73041034b0 2024-09-19T06:49:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730b033640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7304113e80 con 0x7f730410bfc0 2024-09-19T06:49:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730b033640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7304114180 con 0x7f7304102b90 2024-09-19T06:49:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730a832640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f730410bfc0 0x7f730419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730a832640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f730410bfc0 0x7f730419ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49116/0 (socket says 172.21.15.12:49116) 2024-09-19T06:49:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730a832640 1 -- 172.21.15.12:0/2932888230 learned_addr learned my addr 172.21.15.12:0/2932888230 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.006+0000 7f730a031640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7304102b90 0x7f730419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f730a832640 1 -- 172.21.15.12:0/2932888230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7304102b90 msgr2=0x7f730419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f730a832640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7304102b90 0x7f730419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f730a832640 1 -- 172.21.15.12:0/2932888230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73041034b0 msgr2=0x7f730419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f730a832640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73041034b0 0x7f730419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f730a832640 1 -- 172.21.15.12:0/2932888230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730419f400 con 0x7f730410bfc0 2024-09-19T06:49:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f730a031640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7304102b90 0x7f730419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f730a832640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f730410bfc0 0x7f730419ed20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009b30 tx=0x7f72fc0305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f72fb7fe640 1 -- 172.21.15.12:0/2932888230 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc041020 con 0x7f730410bfc0 2024-09-19T06:49:20.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f72fb7fe640 1 -- 172.21.15.12:0/2932888230 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72fc003e50 con 0x7f730410bfc0 2024-09-19T06:49:20.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f72fb7fe640 1 -- 172.21.15.12:0/2932888230 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc036040 con 0x7f730410bfc0 2024-09-19T06:49:20.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f730b033640 1 -- 172.21.15.12:0/2932888230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730419f690 con 0x7f730410bfc0 2024-09-19T06:49:20.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.007+0000 7f730b033640 1 -- 172.21.15.12:0/2932888230 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730419fb20 con 0x7f730410bfc0 2024-09-19T06:49:20.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.011+0000 7f72fb7fe640 1 -- 172.21.15.12:0/2932888230 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f72fc044020 con 0x7f730410bfc0 2024-09-19T06:49:20.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.011+0000 7f730e66e740 1 Processor -- start 2024-09-19T06:49:20.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.011+0000 7f730e66e740 1 -- start start 2024-09-19T06:49:20.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.011+0000 7f730e66e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1416cf0 0x55c2e1415240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.011+0000 7f730e66e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1415780 0x55c2e1415bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.011+0000 7f730e66e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1420520 0x55c2e1422910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.011+0000 7f730e66e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c2e137b2f0 con 0x55c2e1415780 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.011+0000 7f730e66e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c2e1322cf0 con 0x55c2e1420520 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.011+0000 7f730e66e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c2e13772b0 con 0x55c2e1416cf0 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.012+0000 7f7309830640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1416cf0 0x55c2e1415240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.012+0000 7f7309830640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1416cf0 0x55c2e1415240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54186/0 (socket says 172.21.15.12:54186) 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.012+0000 7f7309830640 1 -- 172.21.15.12:0/818084171 learned_addr learned my addr 172.21.15.12:0/818084171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.012+0000 7f7309830640 1 --2- 172.21.15.12:0/818084171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1420520 0x55c2e1422910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.012+0000 7f7309830640 1 -- 172.21.15.12:0/818084171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1420520 msgr2=0x55c2e1422910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.012+0000 7f7309830640 1 --2- 172.21.15.12:0/818084171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1420520 0x55c2e1422910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.012+0000 7f7309830640 1 -- 172.21.15.12:0/818084171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1415780 msgr2=0x55c2e1415bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.012+0000 7f7309830640 1 --2- 172.21.15.12:0/818084171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1415780 0x55c2e1415bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.012+0000 7f7309830640 1 -- 172.21.15.12:0/818084171 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e13073a0 con 0x55c2e1416cf0 2024-09-19T06:49:20.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.013+0000 7f72fb7fe640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72f00a3430 0x7f72f00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.013+0000 7f72fb7fe640 1 -- 172.21.15.12:0/2932888230 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f72fc0f0b90 con 0x7f730410bfc0 2024-09-19T06:49:20.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.014+0000 7f730a031640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72f00a3430 0x7f72f00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.015+0000 7f730a031640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72f00a3430 0x7f72f00a58f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55c2e1412c70 tx=0x7f7300005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:20.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.016+0000 7f7309830640 1 --2- 172.21.15.12:0/818084171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1416cf0 0x55c2e1415240 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55c2e1416220 tx=0x7f72f4009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cafed09592682c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:20.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.016+0000 7f72f8dea640 1 -- 172.21.15.12:0/818084171 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4013db0 con 0x55c2e1416cf0 2024-09-19T06:49:20.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.016+0000 7f72f8dea640 1 -- 172.21.15.12:0/818084171 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f400e6c0 con 0x55c2e1416cf0 2024-09-19T06:49:20.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.016+0000 7f72f8dea640 1 -- 172.21.15.12:0/818084171 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4003850 con 0x55c2e1416cf0 2024-09-19T06:49:20.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 -- 172.21.15.12:0/818084171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1416cf0 msgr2=0x55c2e1415240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:20.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 --2- 172.21.15.12:0/818084171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1416cf0 0x55c2e1415240 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55c2e1416220 tx=0x7f72f4009640 comp rx=0 tx=0).stop 2024-09-19T06:49:20.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 -- 172.21.15.12:0/818084171 shutdown_connections 2024-09-19T06:49:20.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 --2- 172.21.15.12:0/818084171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1420520 0x55c2e1422910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 --2- 172.21.15.12:0/818084171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1415780 0x55c2e1415bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 --2- 172.21.15.12:0/818084171 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1416cf0 0x55c2e1415240 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 -- 172.21.15.12:0/818084171 >> 172.21.15.12:0/818084171 conn(0x55c2e13de310 msgr2=0x55c2e1411e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:20.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 -- 172.21.15.12:0/818084171 shutdown_connections 2024-09-19T06:49:20.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 -- 172.21.15.12:0/818084171 wait complete. 2024-09-19T06:49:20.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 -- start start 2024-09-19T06:49:20.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.017+0000 7f730e66e740 1 Processor -- start 2024-09-19T06:49:20.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730e66e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1415780 0x55c2e141ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730e66e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 0x55c2e141d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730e66e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1420520 0x55c2e141d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730e66e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c2e14341d0 con 0x55c2e1416cf0 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730e66e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c2e1336060 con 0x55c2e1415780 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730e66e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c2e1434350 con 0x55c2e1420520 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730e66e740 10 client.0 _ll_register_callbacks cb 0x55c2e10898c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f7309830640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 0x55c2e141d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f7309830640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 0x55c2e141d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51794/0 (socket says 172.21.15.12:51794) 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f7309830640 1 -- 172.21.15.12:0/2341741714 learned_addr learned my addr 172.21.15.12:0/2341741714 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730a031640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1415780 0x55c2e141ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730a832640 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1420520 0x55c2e141d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730a031640 1 -- 172.21.15.12:0/2341741714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1420520 msgr2=0x55c2e141d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:20.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730a031640 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1420520 0x55c2e141d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730a031640 1 -- 172.21.15.12:0/2341741714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 msgr2=0x55c2e141d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730a031640 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 0x55c2e141d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.018+0000 7f730a031640 1 -- 172.21.15.12:0/2341741714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e10ec3c0 con 0x55c2e1415780 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f730a031640 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1415780 0x55c2e141ff90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7300011870 tx=0x7f7300004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a19e6c3ccbca68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f72edffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f72edffb640 1 -- 172.21.15.12:0/2341741714 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730000fad0 con 0x55c2e1415780 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f72edffb640 1 -- 172.21.15.12:0/2341741714 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f730000fc70 con 0x55c2e1415780 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f730e66e740 1 -- 172.21.15.12:0/2341741714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f400e6c0 con 0x55c2e1415780 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f72edffb640 1 -- 172.21.15.12:0/2341741714 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f730000fe70 con 0x55c2e1415780 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f730e66e740 10 client.27419 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f730e66e740 1 -- 172.21.15.12:0/2341741714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c2e14485a0 con 0x55c2e1415780 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f72edffb640 1 -- 172.21.15.12:0/2341741714 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f400e6c0 con 0x55c2e1415780 2024-09-19T06:49:20.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f72edffb640 1 -- 172.21.15.12:0/2341741714 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f7300027700 con 0x55c2e1415780 2024-09-19T06:49:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f730e66e740 10 client.27419 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f730e66e740 10 client.27419 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:49:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f730e66e740 20 client.27419 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f730e66e740 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c2e1449a60 0x55c2e144be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f730e66e740 4 client.27419 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.019+0000 7f730e66e740 1 -- 172.21.15.12:0/2341741714 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2e1388860 con 0x55c2e1449a60 2024-09-19T06:49:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.020+0000 7f7309830640 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c2e1449a60 0x55c2e144be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.020+0000 7f72edffb640 10 client.27419 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:49:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.020+0000 7f7309830640 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c2e1449a60 0x55c2e144be90 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a92b57a894654aec server_cookie=d7ecb4de8afd91ca in_seq=0 out_seq=0 2024-09-19T06:49:20.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f72edffb640 1 -- 172.21.15.12:0/2341741714 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2e1388860 con 0x55c2e1449a60 2024-09-19T06:49:20.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f72edffb640 10 client.27419 handle_command_reply: tid=0 2024-09-19T06:49:20.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 client.27419 shutdown 2024-09-19T06:49:20.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 -- 172.21.15.12:0/2341741714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1415780 msgr2=0x55c2e141ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:20.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1415780 0x55c2e141ff90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7300011870 tx=0x7f7300004730 comp rx=0 tx=0).stop 2024-09-19T06:49:20.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 -- 172.21.15.12:0/2341741714 shutdown_connections 2024-09-19T06:49:20.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c2e1449a60 0x55c2e144be90 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f72edffb640 0 client.27419 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:49:20.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1420520 0x55c2e141d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 0x55c2e141d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 --2- 172.21.15.12:0/2341741714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1415780 0x55c2e141ff90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 -- 172.21.15.12:0/2341741714 >> 172.21.15.12:0/2341741714 conn(0x55c2e13de310 msgr2=0x55c2e1417ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:20.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 -- 172.21.15.12:0/2341741714 shutdown_connections 2024-09-19T06:49:20.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 1 -- 172.21.15.12:0/2341741714 wait complete. 2024-09-19T06:49:20.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.021+0000 7f730e66e740 20 client.27419 trim_cache size 0 max 16384 2024-09-19T06:49:20.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.040+0000 7f730e66e740 1 Processor -- start 2024-09-19T06:49:20.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.040+0000 7f730e66e740 1 -- start start 2024-09-19T06:49:20.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.040+0000 7f730e66e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 0x55c2e1411f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.040+0000 7f730e66e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 0x55c2e1445d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.040+0000 7f730e66e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1420520 0x55c2e141c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.040+0000 7f730e66e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f73040702f0 con 0x55c2e1416cf0 2024-09-19T06:49:20.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.040+0000 7f730e66e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7304071e30 con 0x55c2e1420520 2024-09-19T06:49:20.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.040+0000 7f730e66e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f73040709c0 con 0x55c2e1415780 2024-09-19T06:49:20.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.040+0000 7f730a031640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 0x55c2e1411f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f7309830640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 0x55c2e1445d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f730a031640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 0x55c2e1411f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54206/0 (socket says 172.21.15.12:54206) 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f730a031640 1 -- 172.21.15.12:0/1559169429 learned_addr learned my addr 172.21.15.12:0/1559169429 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f730a832640 1 --2- 172.21.15.12:0/1559169429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1420520 0x55c2e141c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f7309830640 1 -- 172.21.15.12:0/1559169429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 msgr2=0x55c2e1411f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f7309830640 1 --2- 172.21.15.12:0/1559169429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 0x55c2e1411f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f7309830640 1 -- 172.21.15.12:0/1559169429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1420520 msgr2=0x55c2e141c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f7309830640 1 --2- 172.21.15.12:0/1559169429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1420520 0x55c2e141c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f7309830640 1 -- 172.21.15.12:0/1559169429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e14182d0 con 0x55c2e1416cf0 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f730a031640 1 --2- 172.21.15.12:0/1559169429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 0x55c2e1411f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.041+0000 7f7309830640 1 --2- 172.21.15.12:0/1559169429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 0x55c2e1445d30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x55c2e141cad0 tx=0x7f72f40095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723c614beb3fc164 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.042+0000 7f72effff640 1 -- 172.21.15.12:0/1559169429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4004040 con 0x55c2e1416cf0 2024-09-19T06:49:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.042+0000 7f72effff640 1 -- 172.21.15.12:0/1559169429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f4009bb0 con 0x55c2e1416cf0 2024-09-19T06:49:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.042+0000 7f72effff640 1 -- 172.21.15.12:0/1559169429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f400e920 con 0x55c2e1416cf0 2024-09-19T06:49:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.042+0000 7f730e66e740 1 -- 172.21.15.12:0/1559169429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 msgr2=0x55c2e1445d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.042+0000 7f730e66e740 1 --2- 172.21.15.12:0/1559169429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 0x55c2e1445d30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x55c2e141cad0 tx=0x7f72f40095d0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.042+0000 7f730e66e740 1 -- 172.21.15.12:0/1559169429 shutdown_connections 2024-09-19T06:49:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.042+0000 7f730e66e740 1 --2- 172.21.15.12:0/1559169429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1420520 0x55c2e141c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.042+0000 7f730e66e740 1 --2- 172.21.15.12:0/1559169429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1416cf0 0x55c2e1445d30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.042+0000 7f730e66e740 1 --2- 172.21.15.12:0/1559169429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 0x55c2e1411f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.042+0000 7f730e66e740 1 -- 172.21.15.12:0/1559169429 >> 172.21.15.12:0/1559169429 conn(0x55c2e13de310 msgr2=0x55c2e141bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.043+0000 7f730e66e740 1 -- 172.21.15.12:0/1559169429 shutdown_connections 2024-09-19T06:49:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.043+0000 7f730e66e740 1 -- 172.21.15.12:0/1559169429 wait complete. 2024-09-19T06:49:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.043+0000 7f730e66e740 1 -- start start 2024-09-19T06:49:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.043+0000 7f730e66e740 1 Processor -- start 2024-09-19T06:49:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.043+0000 7f730e66e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 0x55c2e1442040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.043+0000 7f730e66e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1416cf0 0x55c2e1442580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.043+0000 7f730e66e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1420520 0x55c2e143d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.043+0000 7f730e66e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7304071760 con 0x55c2e1420520 2024-09-19T06:49:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.043+0000 7f730e66e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7304071090 con 0x55c2e1416cf0 2024-09-19T06:49:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f730a832640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1420520 0x55c2e143d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f730a832640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1420520 0x55c2e143d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51818/0 (socket says 172.21.15.12:51818) 2024-09-19T06:49:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f730a832640 1 -- 172.21.15.12:0/477941930 learned_addr learned my addr 172.21.15.12:0/477941930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.043+0000 7f730e66e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f730406e2f0 con 0x55c2e1415780 2024-09-19T06:49:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f730e66e740 10 client.0 _ll_register_callbacks cb 0x7f7300009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f7309830640 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1416cf0 0x55c2e1442580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f730a832640 1 -- 172.21.15.12:0/477941930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 msgr2=0x55c2e1442040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f730a832640 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 0x55c2e1442040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f730a832640 1 -- 172.21.15.12:0/477941930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1416cf0 msgr2=0x55c2e1442580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f730a832640 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1416cf0 0x55c2e1442580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f730a832640 1 -- 172.21.15.12:0/477941930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e143dc20 con 0x55c2e1420520 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f730a832640 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1420520 0x55c2e143d420 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f72fc006010 tx=0x7f72fc0bc790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9b57050c6f581d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.044+0000 7f72edffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.045+0000 7f72edffb640 1 -- 172.21.15.12:0/477941930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0c59e0 con 0x55c2e1420520 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.045+0000 7f72edffb640 1 -- 172.21.15.12:0/477941930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f72fc0bcfd0 con 0x55c2e1420520 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.045+0000 7f730e66e740 1 -- 172.21.15.12:0/477941930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c2e1382d70 con 0x55c2e1420520 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.045+0000 7f72edffb640 1 -- 172.21.15.12:0/477941930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f72fc0bd1d0 con 0x55c2e1420520 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.045+0000 7f730e66e740 10 client.18003 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.045+0000 7f730e66e740 1 -- 172.21.15.12:0/477941930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c2e14b42e0 con 0x55c2e1420520 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.045+0000 7f72edffb640 1 -- 172.21.15.12:0/477941930 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c2e1382d70 con 0x55c2e1420520 2024-09-19T06:49:20.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.046+0000 7f72edffb640 1 -- 172.21.15.12:0/477941930 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f72fc004c40 con 0x55c2e1420520 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.046+0000 7f730e66e740 10 client.18003 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.046+0000 7f730e66e740 10 client.18003 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.046+0000 7f730e66e740 20 client.18003 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.046+0000 7f730e66e740 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c2e14b4a50 0x55c2e14b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.046+0000 7f730e66e740 4 client.18003 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.046+0000 7f730e66e740 1 -- 172.21.15.12:0/477941930 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2e12ff170 con 0x55c2e14b4a50 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.046+0000 7f730a031640 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c2e14b4a50 0x55c2e14b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.046+0000 7f730a031640 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c2e14b4a50 0x55c2e14b6ea0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82f397a80107206e server_cookie=d2f60e7b648ccb15 in_seq=0 out_seq=0 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.046+0000 7f72edffb640 10 client.18003 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f72edffb640 1 -- 172.21.15.12:0/477941930 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2e12ff170 con 0x55c2e14b4a50 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f72edffb640 10 client.18003 handle_command_reply: tid=0 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 client.18003 shutdown 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 -- 172.21.15.12:0/477941930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1420520 msgr2=0x55c2e143d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:20.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1420520 0x55c2e143d420 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f72fc006010 tx=0x7f72fc0bc790 comp rx=0 tx=0).stop 2024-09-19T06:49:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 -- 172.21.15.12:0/477941930 shutdown_connections 2024-09-19T06:49:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c2e14b4a50 0x55c2e14b6ea0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f72edffb640 0 client.18003 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:49:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2e1420520 0x55c2e143d420 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2e1416cf0 0x55c2e1442580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 --2- 172.21.15.12:0/477941930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2e1415780 0x55c2e1442040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 -- 172.21.15.12:0/477941930 >> 172.21.15.12:0/477941930 conn(0x55c2e13de310 msgr2=0x55c2e141c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 -- 172.21.15.12:0/477941930 shutdown_connections 2024-09-19T06:49:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 1 -- 172.21.15.12:0/477941930 wait complete. 2024-09-19T06:49:20.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.047+0000 7f730e66e740 20 client.18003 trim_cache size 0 max 16384 2024-09-19T06:49:20.054 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:49:20.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 -- 172.21.15.12:0/2932888230 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72f00a3430 msgr2=0x7f72f00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:20.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72f00a3430 0x7f72f00a58f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55c2e1412c70 tx=0x7f7300005f90 comp rx=0 tx=0).stop 2024-09-19T06:49:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 -- 172.21.15.12:0/2932888230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f730410bfc0 msgr2=0x7f730419ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f730410bfc0 0x7f730419ed20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009b30 tx=0x7f72fc0305d0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 -- 172.21.15.12:0/2932888230 shutdown_connections 2024-09-19T06:49:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f730410bfc0 0x7f730419ed20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73041034b0 0x7f730419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f72f00a3430 0x7f72f00a58f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 --2- 172.21.15.12:0/2932888230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7304102b90 0x7f730419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 -- 172.21.15.12:0/2932888230 >> 172.21.15.12:0/2932888230 conn(0x7f73040fc610 msgr2=0x7f73040fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 -- 172.21.15.12:0/2932888230 shutdown_connections 2024-09-19T06:49:20.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:20.048+0000 7f730b033640 1 -- 172.21.15.12:0/2932888230 wait complete. 2024-09-19T06:49:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:19 smithi012 ceph-mon[30937]: pgmap v284: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 MiB/s wr, 1.85k op/s 2024-09-19T06:49:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:19 smithi016 ceph-mon[34911]: pgmap v284: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 MiB/s wr, 1.85k op/s 2024-09-19T06:49:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:19 smithi173 ceph-mon[35349]: pgmap v284: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 MiB/s wr, 1.85k op/s 2024-09-19T06:49:20.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 515.0 s, 2345.2 tps, lat 42.326 ms stddev 48.799 2024-09-19T06:49:21.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:49:21.381 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:22.059 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:21 smithi012 ceph-mon[30937]: pgmap v285: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 35 MiB/s wr, 1.87k op/s 2024-09-19T06:49:22.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.074+0000 7f383d974640 1 -- 172.21.15.12:0/840350699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38381027a0 msgr2=0x7f38381067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.074+0000 7f383d974640 1 --2- 172.21.15.12:0/840350699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38381027a0 0x7f38381067f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f382c009900 tx=0x7f382c02a410 comp rx=0 tx=0).stop 2024-09-19T06:49:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.074+0000 7f383d974640 1 -- 172.21.15.12:0/840350699 shutdown_connections 2024-09-19T06:49:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.074+0000 7f383d974640 1 --2- 172.21.15.12:0/840350699 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3838106f20 0x7f383810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.074+0000 7f383d974640 1 --2- 172.21.15.12:0/840350699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38381027a0 0x7f38381067f0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.074+0000 7f383d974640 1 --2- 172.21.15.12:0/840350699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3838101df0 0x7f38381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.074+0000 7f383d974640 1 -- 172.21.15.12:0/840350699 >> 172.21.15.12:0/840350699 conn(0x7f38380fd8f0 msgr2=0x7f38380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.074+0000 7f383d974640 1 -- 172.21.15.12:0/840350699 shutdown_connections 2024-09-19T06:49:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.074+0000 7f383d974640 1 -- 172.21.15.12:0/840350699 wait complete. 2024-09-19T06:49:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.075+0000 7f383d974640 1 Processor -- start 2024-09-19T06:49:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.075+0000 7f383d974640 1 -- start start 2024-09-19T06:49:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f383d974640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3838101df0 0x7f3838196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f383d974640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38381027a0 0x7f38381967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f383d974640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3838106f20 0x7f383819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3838101df0 0x7f3838196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f38367fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38381027a0 0x7f38381967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3838101df0 0x7f3838196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49346/0 (socket says 172.21.15.12:49346) 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f38367fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38381027a0 0x7f38381967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37718/0 (socket says 172.21.15.12:37718) 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f3836ffd640 1 -- 172.21.15.12:0/1829327939 learned_addr learned my addr 172.21.15.12:0/1829327939 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f383810fde0 con 0x7f38381027a0 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f383810fc60 con 0x7f3838106f20 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f383810ff60 con 0x7f3838101df0 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f38377fe640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3838106f20 0x7f383819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f3836ffd640 1 -- 172.21.15.12:0/1829327939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3838106f20 msgr2=0x7f383819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:22.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f3836ffd640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3838106f20 0x7f383819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f3836ffd640 1 -- 172.21.15.12:0/1829327939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38381027a0 msgr2=0x7f38381967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f3836ffd640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38381027a0 0x7f38381967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.076+0000 7f3836ffd640 1 -- 172.21.15.12:0/1829327939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383819b210 con 0x7f3838101df0 2024-09-19T06:49:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.077+0000 7f3836ffd640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3838101df0 0x7f3838196260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f382800e9f0 tx=0x7f382800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.077+0000 7f383c972640 1 -- 172.21.15.12:0/1829327939 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382800cd80 con 0x7f3838101df0 2024-09-19T06:49:22.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.077+0000 7f383c972640 1 -- 172.21.15.12:0/1829327939 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3828010910 con 0x7f3838101df0 2024-09-19T06:49:22.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.077+0000 7f383c972640 1 -- 172.21.15.12:0/1829327939 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828018990 con 0x7f3838101df0 2024-09-19T06:49:22.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.077+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383819b500 con 0x7f3838101df0 2024-09-19T06:49:22.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.077+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38381a2de0 con 0x7f3838101df0 2024-09-19T06:49:22.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.080+0000 7f383c972640 1 -- 172.21.15.12:0/1829327939 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3828018b30 con 0x7f3838101df0 2024-09-19T06:49:22.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f383fd4d740 1 Processor -- start 2024-09-19T06:49:22.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f383fd4d740 1 -- start start 2024-09-19T06:49:22.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298ad370 0x5616298af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f383fd4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5616298082f0 con 0x5616298a25d0 2024-09-19T06:49:22.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f383fd4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5616297afcf0 con 0x5616298a3b40 2024-09-19T06:49:22.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f383fd4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5616298042b0 con 0x5616298ad370 2024-09-19T06:49:22.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298a2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37734/0 (socket says 172.21.15.12:37734) 2024-09-19T06:49:22.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f3836ffd640 1 -- 172.21.15.12:0/652993045 learned_addr learned my addr 172.21.15.12:0/652993045 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:22.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f38367fc640 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298ad370 0x5616298af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.081+0000 7f38377fe640 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.082+0000 7f38367fc640 1 -- 172.21.15.12:0/652993045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 msgr2=0x5616298a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:22.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.082+0000 7f38367fc640 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.082+0000 7f38367fc640 1 -- 172.21.15.12:0/652993045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 msgr2=0x5616298a2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:22.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.082+0000 7f38367fc640 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298a2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.082+0000 7f38367fc640 1 -- 172.21.15.12:0/652993045 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616297943a0 con 0x5616298ad370 2024-09-19T06:49:22.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.082+0000 7f38377fe640 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:22.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.082+0000 7f3836ffd640 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:22.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.082+0000 7f38367fc640 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298ad370 0x5616298af760 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f382c02aa00 tx=0x7f382c005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a207347085ef390 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:22.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.082+0000 7f383c972640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38200a7840 0x7f38200a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.083+0000 7f381dffb640 1 -- 172.21.15.12:0/652993045 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c035040 con 0x5616298ad370 2024-09-19T06:49:22.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.083+0000 7f381dffb640 1 -- 172.21.15.12:0/652993045 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f382c004400 con 0x5616298ad370 2024-09-19T06:49:22.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.083+0000 7f381dffb640 1 -- 172.21.15.12:0/652993045 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c0035f0 con 0x5616298ad370 2024-09-19T06:49:22.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.083+0000 7f38377fe640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38200a7840 0x7f38200a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.084+0000 7f383fd4d740 1 -- 172.21.15.12:0/652993045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298ad370 msgr2=0x5616298af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:22.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.084+0000 7f383fd4d740 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298ad370 0x5616298af760 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f382c02aa00 tx=0x7f382c005de0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.084+0000 7f383c972640 1 -- 172.21.15.12:0/1829327939 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f38280d00b0 con 0x7f3838101df0 2024-09-19T06:49:22.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.085+0000 7f383fd4d740 1 -- 172.21.15.12:0/652993045 shutdown_connections 2024-09-19T06:49:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.085+0000 7f383fd4d740 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298ad370 0x5616298af760 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.085+0000 7f383fd4d740 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.085+0000 7f383fd4d740 1 --2- 172.21.15.12:0/652993045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.085+0000 7f383fd4d740 1 -- 172.21.15.12:0/652993045 >> 172.21.15.12:0/652993045 conn(0x56162986b310 msgr2=0x56162989ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.085+0000 7f38377fe640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38200a7840 0x7f38200a9d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3830009fd0 tx=0x7f3830009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.085+0000 7f383fd4d740 1 -- 172.21.15.12:0/652993045 shutdown_connections 2024-09-19T06:49:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.085+0000 7f383fd4d740 1 -- 172.21.15.12:0/652993045 wait complete. 2024-09-19T06:49:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.086+0000 7f383fd4d740 1 -- start start 2024-09-19T06:49:22.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.086+0000 7f383fd4d740 1 Processor -- start 2024-09-19T06:49:22.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.086+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.086+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298aa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.086+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 0x5616298aa810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f383fd4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5616298b0010 con 0x5616298ad370 2024-09-19T06:49:22.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f383fd4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5616297c3060 con 0x5616298a3b40 2024-09-19T06:49:22.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f383fd4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5616298b0190 con 0x5616298a25d0 2024-09-19T06:49:22.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f383fd4d740 10 client.0 _ll_register_callbacks cb 0x5616295168c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:22.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f38377fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 0x5616298aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298acdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49374/0 (socket says 172.21.15.12:49374) 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f3836ffd640 1 -- 172.21.15.12:0/1341552152 learned_addr learned my addr 172.21.15.12:0/1341552152 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f38367fc640 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f3836ffd640 1 -- 172.21.15.12:0/1341552152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 msgr2=0x5616298aa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f3836ffd640 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298aa080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f3836ffd640 1 -- 172.21.15.12:0/1341552152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 msgr2=0x5616298aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f3836ffd640 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 0x5616298aa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f3836ffd640 1 -- 172.21.15.12:0/1341552152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616295793c0 con 0x5616298a25d0 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.087+0000 7f3836ffd640 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298acdd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f382809c330 tx=0x7f3828009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d990899ada358776 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.088+0000 7f3816ffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.088+0000 7f3816ffd640 1 -- 172.21.15.12:0/1341552152 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382809c170 con 0x5616298a25d0 2024-09-19T06:49:22.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.088+0000 7f3816ffd640 1 -- 172.21.15.12:0/1341552152 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f38280d20d0 con 0x5616298a25d0 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.088+0000 7f383fd4d740 1 -- 172.21.15.12:0/1341552152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f382c004400 con 0x5616298a25d0 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.088+0000 7f3816ffd640 1 -- 172.21.15.12:0/1341552152 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f382809bd00 con 0x5616298a25d0 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.088+0000 7f383fd4d740 10 client.27391 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.088+0000 7f383fd4d740 1 -- 172.21.15.12:0/1341552152 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5616298bbb30 con 0x5616298a25d0 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.088+0000 7f3816ffd640 1 -- 172.21.15.12:0/1341552152 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f382809c3a0 con 0x5616298a25d0 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.088+0000 7f3816ffd640 1 -- 172.21.15.12:0/1341552152 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f38280bc0e0 con 0x5616298a25d0 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.088+0000 7f383fd4d740 10 client.27391 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.089+0000 7f383fd4d740 10 client.27391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.089+0000 7f383fd4d740 20 client.27391 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.089+0000 7f383fd4d740 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616298bcff0 0x5616298bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.089+0000 7f383fd4d740 4 client.27391 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.089+0000 7f383fd4d740 1 -- 172.21.15.12:0/1341552152 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f382c004400 con 0x5616298bcff0 2024-09-19T06:49:22.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.089+0000 7f38367fc640 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616298bcff0 0x5616298bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.089+0000 7f38367fc640 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616298bcff0 0x5616298bf3e0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d54ef9591287a1b server_cookie=1064e7665f94a999 in_seq=0 out_seq=0 2024-09-19T06:49:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.089+0000 7f3816ffd640 10 client.27391 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f3816ffd640 1 -- 172.21.15.12:0/1341552152 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f382c004400 con 0x5616298bcff0 2024-09-19T06:49:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f3816ffd640 10 client.27391 handle_command_reply: tid=0 2024-09-19T06:49:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f383fd4d740 1 client.27391 shutdown 2024-09-19T06:49:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f383fd4d740 1 -- 172.21.15.12:0/1341552152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 msgr2=0x5616298acdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f383fd4d740 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298acdd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f382809c330 tx=0x7f3828009310 comp rx=0 tx=0).stop 2024-09-19T06:49:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f383fd4d740 1 -- 172.21.15.12:0/1341552152 shutdown_connections 2024-09-19T06:49:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f383fd4d740 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616298bcff0 0x5616298bf3e0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f3816ffd640 0 client.27391 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f383fd4d740 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 0x5616298aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f383fd4d740 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298aa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f383fd4d740 1 --2- 172.21.15.12:0/1341552152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298acdd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.090+0000 7f383fd4d740 1 -- 172.21.15.12:0/1341552152 >> 172.21.15.12:0/1341552152 conn(0x56162986b310 msgr2=0x5616298a4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.091+0000 7f383fd4d740 1 -- 172.21.15.12:0/1341552152 shutdown_connections 2024-09-19T06:49:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.091+0000 7f383fd4d740 1 -- 172.21.15.12:0/1341552152 wait complete. 2024-09-19T06:49:22.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.091+0000 7f383fd4d740 20 client.27391 trim_cache size 0 max 16384 2024-09-19T06:49:22.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.110+0000 7f383fd4d740 1 Processor -- start 2024-09-19T06:49:22.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.110+0000 7f383fd4d740 1 -- start start 2024-09-19T06:49:22.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.110+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298aa050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.110+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a3b40 0x5616298a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.110+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298ad370 0x5616298c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.110+0000 7f383fd4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38381aba40 con 0x5616298a25d0 2024-09-19T06:49:22.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.110+0000 7f383fd4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38381ad580 con 0x5616298ad370 2024-09-19T06:49:22.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.110+0000 7f383fd4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f38381ac110 con 0x5616298a3b40 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.111+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.111+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37760/0 (socket says 172.21.15.12:37760) 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.111+0000 7f3836ffd640 1 -- 172.21.15.12:0/1068044490 learned_addr learned my addr 172.21.15.12:0/1068044490 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.111+0000 7f38377fe640 1 --2- 172.21.15.12:0/1068044490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298ad370 0x5616298c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.111+0000 7f38367fc640 1 --2- 172.21.15.12:0/1068044490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a3b40 0x5616298a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.111+0000 7f38377fe640 1 -- 172.21.15.12:0/1068044490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a3b40 msgr2=0x5616298a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.112+0000 7f38377fe640 1 --2- 172.21.15.12:0/1068044490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a3b40 0x5616298a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.112+0000 7f38377fe640 1 -- 172.21.15.12:0/1068044490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 msgr2=0x5616298aa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.112+0000 7f38377fe640 1 --2- 172.21.15.12:0/1068044490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298aa050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.112+0000 7f38377fe640 1 -- 172.21.15.12:0/1068044490 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616298a3760 con 0x5616298ad370 2024-09-19T06:49:22.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.112+0000 7f38367fc640 1 --2- 172.21.15.12:0/1068044490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a3b40 0x5616298a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.112+0000 7f38377fe640 1 --2- 172.21.15.12:0/1068044490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298ad370 0x5616298c4b40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3830011420 tx=0x7f3830019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a96a1879c333fa96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.112+0000 7f381d7fa640 1 -- 172.21.15.12:0/1068044490 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830003970 con 0x5616298ad370 2024-09-19T06:49:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.113+0000 7f381d7fa640 1 -- 172.21.15.12:0/1068044490 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3830004020 con 0x5616298ad370 2024-09-19T06:49:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.113+0000 7f381d7fa640 1 -- 172.21.15.12:0/1068044490 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38300107d0 con 0x5616298ad370 2024-09-19T06:49:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.114+0000 7f383fd4d740 1 -- 172.21.15.12:0/1068044490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298ad370 msgr2=0x5616298c4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.114+0000 7f383fd4d740 1 --2- 172.21.15.12:0/1068044490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298ad370 0x5616298c4b40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3830011420 tx=0x7f3830019000 comp rx=0 tx=0).stop 2024-09-19T06:49:22.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.114+0000 7f383fd4d740 1 -- 172.21.15.12:0/1068044490 shutdown_connections 2024-09-19T06:49:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.114+0000 7f383fd4d740 1 --2- 172.21.15.12:0/1068044490 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298ad370 0x5616298c4b40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.114+0000 7f383fd4d740 1 --2- 172.21.15.12:0/1068044490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a3b40 0x5616298a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.114+0000 7f383fd4d740 1 --2- 172.21.15.12:0/1068044490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298a25d0 0x5616298aa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.114+0000 7f383fd4d740 1 -- 172.21.15.12:0/1068044490 >> 172.21.15.12:0/1068044490 conn(0x56162986b310 msgr2=0x5616298a9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.114+0000 7f383fd4d740 1 -- 172.21.15.12:0/1068044490 shutdown_connections 2024-09-19T06:49:22.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.115+0000 7f383fd4d740 1 -- 172.21.15.12:0/1068044490 wait complete. 2024-09-19T06:49:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.115+0000 7f383fd4d740 1 -- start start 2024-09-19T06:49:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.115+0000 7f383fd4d740 1 Processor -- start 2024-09-19T06:49:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f383fd4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 0x5616298a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f383fd4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38381aceb0 con 0x5616298ad370 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f383fd4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38381ac7e0 con 0x5616298a3b40 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f383fd4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f38381a9a40 con 0x5616298a25d0 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f383fd4d740 10 client.0 _ll_register_callbacks cb 0x7f382800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f38377fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 0x5616298a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f38377fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 0x5616298a7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37770/0 (socket says 172.21.15.12:37770) 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f3836ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49392/0 (socket says 172.21.15.12:49392) 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f38377fe640 1 -- 172.21.15.12:0/3068811527 learned_addr learned my addr 172.21.15.12:0/3068811527 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f38367fc640 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f38367fc640 1 -- 172.21.15.12:0/3068811527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 msgr2=0x5616298a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:22.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f38367fc640 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298a7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f38367fc640 1 -- 172.21.15.12:0/3068811527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 msgr2=0x5616298a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:22.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f38367fc640 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 0x5616298a7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.116+0000 7f38367fc640 1 -- 172.21.15.12:0/3068811527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56162992f3d0 con 0x5616298a3b40 2024-09-19T06:49:22.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.117+0000 7f38367fc640 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298a76d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f382c009850 tx=0x7f382c004550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcc4655a10a56a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:22.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.117+0000 7f3816ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:22.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.117+0000 7f3816ffd640 1 -- 172.21.15.12:0/3068811527 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c035040 con 0x5616298a3b40 2024-09-19T06:49:22.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.117+0000 7f383fd4d740 1 -- 172.21.15.12:0/3068811527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3830004020 con 0x5616298a3b40 2024-09-19T06:49:22.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.117+0000 7f3816ffd640 1 -- 172.21.15.12:0/3068811527 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f382c0035f0 con 0x5616298a3b40 2024-09-19T06:49:22.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.117+0000 7f3816ffd640 1 -- 172.21.15.12:0/3068811527 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f382c0037f0 con 0x5616298a3b40 2024-09-19T06:49:22.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.117+0000 7f383fd4d740 10 client.27443 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:22.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.117+0000 7f383fd4d740 1 -- 172.21.15.12:0/3068811527 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x561629930710 con 0x5616298a3b40 2024-09-19T06:49:22.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.117+0000 7f3816ffd640 1 -- 172.21.15.12:0/3068811527 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3830004020 con 0x5616298a3b40 2024-09-19T06:49:22.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.118+0000 7f3816ffd640 1 -- 172.21.15.12:0/3068811527 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f382c031bc0 con 0x5616298a3b40 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.118+0000 7f383fd4d740 10 client.27443 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.118+0000 7f383fd4d740 10 client.27443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.118+0000 7f383fd4d740 20 client.27443 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.118+0000 7f383fd4d740 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561629930a50 0x561629932e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.118+0000 7f383fd4d740 4 client.27443 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.118+0000 7f383fd4d740 1 -- 172.21.15.12:0/3068811527 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561629815860 con 0x561629930a50 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.118+0000 7f3836ffd640 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561629930a50 0x561629932e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f3836ffd640 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561629930a50 0x561629932e40 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c87b0d8d6b84b189 server_cookie=c8058e3c29672f01 in_seq=0 out_seq=0 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f3816ffd640 10 client.27443 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f3816ffd640 1 -- 172.21.15.12:0/3068811527 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561629815860 con 0x561629930a50 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f3816ffd640 10 client.27443 handle_command_reply: tid=0 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 client.27443 shutdown 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 -- 172.21.15.12:0/3068811527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 msgr2=0x5616298a76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:22.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298a76d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f382c009850 tx=0x7f382c004550 comp rx=0 tx=0).stop 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 -- 172.21.15.12:0/3068811527 shutdown_connections 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561629930a50 0x561629932e40 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616298ad370 0x5616298a7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616298a3b40 0x5616298a76d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 --2- 172.21.15.12:0/3068811527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298a25d0 0x5616298a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f3816ffd640 0 client.27443 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 -- 172.21.15.12:0/3068811527 >> 172.21.15.12:0/3068811527 conn(0x56162986b310 msgr2=0x5616298a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 -- 172.21.15.12:0/3068811527 shutdown_connections 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 1 -- 172.21.15.12:0/3068811527 wait complete. 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.119+0000 7f383fd4d740 20 client.27443 trim_cache size 0 max 16384 2024-09-19T06:49:22.123 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:49:22.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38200a7840 msgr2=0x7f38200a9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:22.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38200a7840 0x7f38200a9d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3830009fd0 tx=0x7f3830009500 comp rx=0 tx=0).stop 2024-09-19T06:49:22.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3838101df0 msgr2=0x7f3838196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:22.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3838101df0 0x7f3838196260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f382800e9f0 tx=0x7f382800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 shutdown_connections 2024-09-19T06:49:22.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3838106f20 0x7f383819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38381027a0 0x7f38381967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38200a7840 0x7f38200a9d00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 --2- 172.21.15.12:0/1829327939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3838101df0 0x7f3838196260 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:22.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 >> 172.21.15.12:0/1829327939 conn(0x7f38380fd8f0 msgr2=0x7f38380febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:22.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 shutdown_connections 2024-09-19T06:49:22.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:22.120+0000 7f383d974640 1 -- 172.21.15.12:0/1829327939 wait complete. 2024-09-19T06:49:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:21 smithi016 ceph-mon[34911]: pgmap v285: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 35 MiB/s wr, 1.87k op/s 2024-09-19T06:49:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:21 smithi173 ceph-mon[35349]: pgmap v285: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 35 MiB/s wr, 1.87k op/s 2024-09-19T06:49:24.052 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:49:24.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:49:24.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:23 smithi012 ceph-mon[30937]: pgmap v286: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 35 MiB/s wr, 1.87k op/s 2024-09-19T06:49:24.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:23 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:49:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:23 smithi016 ceph-mon[34911]: pgmap v286: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 35 MiB/s wr, 1.87k op/s 2024-09-19T06:49:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:23 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:49:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:23 smithi173 ceph-mon[35349]: pgmap v286: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 35 MiB/s wr, 1.87k op/s 2024-09-19T06:49:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:23 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:49:24.489 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:24 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:49:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:24 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:49:24.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:24 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:49:25.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:24 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:49:25.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:24 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:49:25.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:24 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:49:25.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.103+0000 7fb16f0f3640 1 -- 172.21.15.12:0/1612778988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb168100e30 msgr2=0x7fb168104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.103+0000 7fb16f0f3640 1 --2- 172.21.15.12:0/1612778988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb168100e30 0x7fb168104e80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb154009900 tx=0x7fb15402a410 comp rx=0 tx=0).stop 2024-09-19T06:49:25.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.103+0000 7fb16f0f3640 1 -- 172.21.15.12:0/1612778988 shutdown_connections 2024-09-19T06:49:25.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.103+0000 7fb16f0f3640 1 --2- 172.21.15.12:0/1612778988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1681055b0 0x7fb16810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.103+0000 7fb16f0f3640 1 --2- 172.21.15.12:0/1612778988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb168100e30 0x7fb168104e80 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.103+0000 7fb16f0f3640 1 --2- 172.21.15.12:0/1612778988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb168100480 0x7fb168100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.103+0000 7fb16f0f3640 1 -- 172.21.15.12:0/1612778988 >> 172.21.15.12:0/1612778988 conn(0x7fb168077210 msgr2=0x7fb1680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.103+0000 7fb16f0f3640 1 -- 172.21.15.12:0/1612778988 shutdown_connections 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.103+0000 7fb16f0f3640 1 -- 172.21.15.12:0/1612778988 wait complete. 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb16f0f3640 1 Processor -- start 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb16f0f3640 1 -- start start 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb16f0f3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb168100480 0x7fb16819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb16f0f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb168100e30 0x7fb16819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb16f0f3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1681055b0 0x7fb16819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb16f0f3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb16810fde0 con 0x7fb168100e30 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb16f0f3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb16810fc60 con 0x7fb168100480 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb16f0f3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb16810ff60 con 0x7fb1681055b0 2024-09-19T06:49:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb167fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb168100e30 0x7fb16819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb167fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb168100e30 0x7fb16819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37794/0 (socket says 172.21.15.12:37794) 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb167fff640 1 -- 172.21.15.12:0/2221035918 learned_addr learned my addr 172.21.15.12:0/2221035918 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb16d690640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1681055b0 0x7fb16819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb168100480 0x7fb16819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb167fff640 1 -- 172.21.15.12:0/2221035918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1681055b0 msgr2=0x7fb16819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.104+0000 7fb167fff640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1681055b0 0x7fb16819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.105+0000 7fb167fff640 1 -- 172.21.15.12:0/2221035918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb168100480 msgr2=0x7fb16819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.105+0000 7fb167fff640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb168100480 0x7fb16819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.105+0000 7fb167fff640 1 -- 172.21.15.12:0/2221035918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16819f600 con 0x7fb168100e30 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.105+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb168100480 0x7fb16819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.105+0000 7fb167fff640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb168100e30 0x7fb16819ab90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb154004770 tx=0x7fb154003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.105+0000 7fb165ffb640 1 -- 172.21.15.12:0/2221035918 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15403f070 con 0x7fb168100e30 2024-09-19T06:49:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.105+0000 7fb165ffb640 1 -- 172.21.15.12:0/2221035918 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb154031ca0 con 0x7fb168100e30 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.105+0000 7fb165ffb640 1 -- 172.21.15.12:0/2221035918 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154035030 con 0x7fb168100e30 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.105+0000 7fb16f0f3640 1 -- 172.21.15.12:0/2221035918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16819f890 con 0x7fb168100e30 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.105+0000 7fb16f0f3640 1 -- 172.21.15.12:0/2221035918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1681a71d0 con 0x7fb168100e30 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.108+0000 7fb1714cc740 1 Processor -- start 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.108+0000 7fb165ffb640 1 -- 172.21.15.12:0/2221035918 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb154042070 con 0x7fb168100e30 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.108+0000 7fb1714cc740 1 -- start start 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 0x5647a0157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0158380 0x5647a016b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a016b550 0x5647a016d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb1714cc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5647a00bd280 con 0x5647a0158380 2024-09-19T06:49:25.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb1714cc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5647a0064b10 con 0x5647a0157a60 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb1714cc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5647a00b9240 con 0x5647a016b550 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb16ce8f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0158380 0x5647a016b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb167fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a016b550 0x5647a016d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb16ce8f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0158380 0x5647a016b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37796/0 (socket says 172.21.15.12:37796) 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb16d690640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 0x5647a0157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.109+0000 7fb16ce8f640 1 -- 172.21.15.12:0/2370316296 learned_addr learned my addr 172.21.15.12:0/2370316296 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.110+0000 7fb16ce8f640 1 -- 172.21.15.12:0/2370316296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a016b550 msgr2=0x5647a016d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.110+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/2370316296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a016b550 0x5647a016d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.110+0000 7fb16ce8f640 1 -- 172.21.15.12:0/2370316296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 msgr2=0x5647a0157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.110+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/2370316296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 0x5647a0157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.110+0000 7fb16ce8f640 1 -- 172.21.15.12:0/2370316296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a00711f0 con 0x5647a0158380 2024-09-19T06:49:25.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.110+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/2370316296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0158380 0x5647a016b010 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cf00 tx=0x7fb15c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd328a420d5fd4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.111+0000 7fb152ffd640 1 -- 172.21.15.12:0/2370316296 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c005220 con 0x5647a0158380 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.111+0000 7fb152ffd640 1 -- 172.21.15.12:0/2370316296 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c004c80 con 0x5647a0158380 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.111+0000 7fb152ffd640 1 -- 172.21.15.12:0/2370316296 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0108f0 con 0x5647a0158380 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.111+0000 7fb165ffb640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1580a33b0 0x7fb1580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.111+0000 7fb16d690640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1580a33b0 0x7fb1580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.111+0000 7fb165ffb640 1 -- 172.21.15.12:0/2221035918 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7fb1540f0310 con 0x7fb168100e30 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.112+0000 7fb1714cc740 1 -- 172.21.15.12:0/2370316296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0158380 msgr2=0x5647a016b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.112+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2370316296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0158380 0x5647a016b010 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cf00 tx=0x7fb15c00e720 comp rx=0 tx=0).stop 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.112+0000 7fb16d690640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1580a33b0 0x7fb1580a5870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb16000a400 tx=0x7fb16000a7c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.112+0000 7fb1714cc740 1 -- 172.21.15.12:0/2370316296 shutdown_connections 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.112+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2370316296 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a016b550 0x5647a016d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.112+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2370316296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0158380 0x5647a016b010 secure :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cf00 tx=0x7fb15c00e720 comp rx=0 tx=0).stop 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.112+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2370316296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 0x5647a0157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.112+0000 7fb1714cc740 1 -- 172.21.15.12:0/2370316296 >> 172.21.15.12:0/2370316296 conn(0x5647a01540f0 msgr2=0x5647a01544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.114+0000 7fb1714cc740 1 -- 172.21.15.12:0/2370316296 shutdown_connections 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.114+0000 7fb1714cc740 1 -- 172.21.15.12:0/2370316296 wait complete. 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.114+0000 7fb1714cc740 1 -- start start 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb1714cc740 1 Processor -- start 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a0157a60 0x5647a0168670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a016b550 0x5647a0168bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a01690f0 0x5647a0177630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb1714cc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5647a016e180 con 0x5647a01690f0 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb1714cc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5647a0077f10 con 0x5647a016b550 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb1714cc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5647a016e300 con 0x5647a0157a60 2024-09-19T06:49:25.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb16ce8f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a0157a60 0x5647a0168670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb16ce8f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a0157a60 0x5647a0168670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:49440/0 (socket says 172.21.15.12:49440) 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb16ce8f640 1 -- 172.21.15.12:0/2119919681 learned_addr learned my addr 172.21.15.12:0/2119919681 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.115+0000 7fb1714cc740 10 client.0 _ll_register_callbacks cb 0x5647a0040a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.116+0000 7fb167fff640 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a016b550 0x5647a0168bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.116+0000 7fb16d690640 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a01690f0 0x5647a0177630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.116+0000 7fb167fff640 1 -- 172.21.15.12:0/2119919681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a0157a60 msgr2=0x5647a0168670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.116+0000 7fb167fff640 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a0157a60 0x5647a0168670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.116+0000 7fb167fff640 1 -- 172.21.15.12:0/2119919681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a01690f0 msgr2=0x5647a0177630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.116+0000 7fb167fff640 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a01690f0 0x5647a0177630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.116+0000 7fb167fff640 1 -- 172.21.15.12:0/2119919681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56479fe2e6a0 con 0x5647a016b550 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.116+0000 7fb167fff640 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a016b550 0x5647a0168bb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb1540ed960 tx=0x7fb154009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6194dbfbe19af589 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.116+0000 7fb147fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.117+0000 7fb147fff640 1 -- 172.21.15.12:0/2119919681 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154049050 con 0x5647a016b550 2024-09-19T06:49:25.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.117+0000 7fb1714cc740 1 -- 172.21.15.12:0/2119919681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb15c004c80 con 0x5647a016b550 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.117+0000 7fb147fff640 1 -- 172.21.15.12:0/2119919681 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7fb15403b5f0 con 0x5647a016b550 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.117+0000 7fb147fff640 1 -- 172.21.15.12:0/2119919681 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb1540bbe50 con 0x5647a016b550 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.117+0000 7fb1714cc740 10 client.27452 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.117+0000 7fb1714cc740 1 -- 172.21.15.12:0/2119919681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5647a017a450 con 0x5647a016b550 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.118+0000 7fb147fff640 1 -- 172.21.15.12:0/2119919681 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c004c80 con 0x5647a016b550 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.119+0000 7fb147fff640 1 -- 172.21.15.12:0/2119919681 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fb1540edbe0 con 0x5647a016b550 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.119+0000 7fb1714cc740 10 client.27452 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.119+0000 7fb1714cc740 10 client.27452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.119+0000 7fb1714cc740 20 client.27452 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.119+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5647a017bb30 0x5647a017dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.119+0000 7fb1714cc740 4 client.27452 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.119+0000 7fb1714cc740 1 -- 172.21.15.12:0/2119919681 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647a00ca7f0 con 0x5647a017bb30 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.120+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5647a017bb30 0x5647a017dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.120+0000 7fb147fff640 10 client.27452 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.120+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5647a017bb30 0x5647a017dfb0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88d4cc03f1eb5d0e server_cookie=afe371d1baffdcaa in_seq=0 out_seq=0 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.121+0000 7fb147fff640 1 -- 172.21.15.12:0/2119919681 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647a00ca7f0 con 0x5647a017bb30 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.121+0000 7fb147fff640 10 client.27452 handle_command_reply: tid=0 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.121+0000 7fb1714cc740 1 client.27452 shutdown 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb1714cc740 1 -- 172.21.15.12:0/2119919681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a016b550 msgr2=0x5647a0168bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a016b550 0x5647a0168bb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb1540ed960 tx=0x7fb154009620 comp rx=0 tx=0).stop 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb1714cc740 1 -- 172.21.15.12:0/2119919681 shutdown_connections 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5647a017bb30 0x5647a017dfb0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a01690f0 0x5647a0177630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a016b550 0x5647a0168bb0 secure :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb1540ed960 tx=0x7fb154009620 comp rx=0 tx=0).stop 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2119919681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a0157a60 0x5647a0168670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb1714cc740 1 -- 172.21.15.12:0/2119919681 >> 172.21.15.12:0/2119919681 conn(0x5647a01540f0 msgr2=0x5647a0159e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb147fff640 0 client.27452 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb1714cc740 1 -- 172.21.15.12:0/2119919681 shutdown_connections 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.122+0000 7fb1714cc740 1 -- 172.21.15.12:0/2119919681 wait complete. 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.123+0000 7fb1714cc740 20 client.27452 trim_cache size 0 max 16384 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.156+0000 7fb1714cc740 1 Processor -- start 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.156+0000 7fb1714cc740 1 -- start start 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.156+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0157a60 0x5647a0177420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a01690f0 0x5647a0153160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0183880 0x5647a0183d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb1714cc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681abaf0 con 0x5647a0157a60 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb1714cc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681ad630 con 0x5647a0183880 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb1714cc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681ac1c0 con 0x5647a01690f0 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb16ce8f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0157a60 0x5647a0177420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb16ce8f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0157a60 0x5647a0177420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37824/0 (socket says 172.21.15.12:37824) 2024-09-19T06:49:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb16ce8f640 1 -- 172.21.15.12:0/2840650767 learned_addr learned my addr 172.21.15.12:0/2840650767 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb167fff640 1 --2- 172.21.15.12:0/2840650767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a01690f0 0x5647a0153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb16d690640 1 --2- 172.21.15.12:0/2840650767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0183880 0x5647a0183d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb16ce8f640 1 -- 172.21.15.12:0/2840650767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a01690f0 msgr2=0x5647a0153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/2840650767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a01690f0 0x5647a0153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb16ce8f640 1 -- 172.21.15.12:0/2840650767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0183880 msgr2=0x5647a0183d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/2840650767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0183880 0x5647a0183d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.157+0000 7fb16ce8f640 1 -- 172.21.15.12:0/2840650767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a0167620 con 0x5647a0157a60 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.158+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/2840650767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0157a60 0x5647a0177420 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cf00 tx=0x7fb15c010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d420a9510818ce7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.158+0000 7fb1527fc640 1 -- 172.21.15.12:0/2840650767 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c010820 con 0x5647a0157a60 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.158+0000 7fb1527fc640 1 -- 172.21.15.12:0/2840650767 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c028430 con 0x5647a0157a60 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.158+0000 7fb1527fc640 1 -- 172.21.15.12:0/2840650767 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0266a0 con 0x5647a0157a60 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.160+0000 7fb1714cc740 1 -- 172.21.15.12:0/2840650767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0157a60 msgr2=0x5647a0177420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.160+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2840650767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0157a60 0x5647a0177420 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cf00 tx=0x7fb15c010430 comp rx=0 tx=0).stop 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.160+0000 7fb1714cc740 1 -- 172.21.15.12:0/2840650767 shutdown_connections 2024-09-19T06:49:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.160+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2840650767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0183880 0x5647a0183d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.160+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2840650767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a01690f0 0x5647a0153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.160+0000 7fb1714cc740 1 --2- 172.21.15.12:0/2840650767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0157a60 0x5647a0177420 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.160+0000 7fb1714cc740 1 -- 172.21.15.12:0/2840650767 >> 172.21.15.12:0/2840650767 conn(0x5647a01540f0 msgr2=0x5647a0152a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.160+0000 7fb1714cc740 1 -- 172.21.15.12:0/2840650767 shutdown_connections 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.160+0000 7fb1714cc740 1 -- 172.21.15.12:0/2840650767 wait complete. 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.160+0000 7fb1714cc740 1 -- start start 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.161+0000 7fb1714cc740 1 Processor -- start 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.162+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 0x5647a016f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.162+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a01690f0 0x5647a016fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.162+0000 7fb1714cc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0183880 0x5647a01e5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.162+0000 7fb1714cc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681acf60 con 0x5647a0183880 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.162+0000 7fb1714cc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681ac890 con 0x5647a0157a60 2024-09-19T06:49:25.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.162+0000 7fb16ce8f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 0x5647a016f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.163+0000 7fb16ce8f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 0x5647a016f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37090/0 (socket says 172.21.15.12:37090) 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.163+0000 7fb16ce8f640 1 -- 172.21.15.12:0/4271447809 learned_addr learned my addr 172.21.15.12:0/4271447809 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.164+0000 7fb167fff640 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a01690f0 0x5647a016fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.168+0000 7fb16d690640 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0183880 0x5647a01e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.162+0000 7fb1714cc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681a9af0 con 0x5647a01690f0 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.168+0000 7fb1714cc740 10 client.0 _ll_register_callbacks cb 0x7fb1540f38f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.172+0000 7fb16ce8f640 1 -- 172.21.15.12:0/4271447809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a01690f0 msgr2=0x5647a016fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.172+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a01690f0 0x5647a016fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.172+0000 7fb16ce8f640 1 -- 172.21.15.12:0/4271447809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0183880 msgr2=0x5647a01e5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.172+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0183880 0x5647a01e5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.172+0000 7fb16ce8f640 1 -- 172.21.15.12:0/4271447809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647a01703f0 con 0x5647a0157a60 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.177+0000 7fb16d690640 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0183880 0x5647a01e5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.181+0000 7fb16ce8f640 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 0x5647a016f620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00ced0 tx=0x7fb15c00e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=182e08558b9283ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.181+0000 7fb147fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.187+0000 7fb147fff640 1 -- 172.21.15.12:0/4271447809 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c038070 con 0x5647a0157a60 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.187+0000 7fb147fff640 1 -- 172.21.15.12:0/4271447809 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7fb15c010820 con 0x5647a0157a60 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.189+0000 7fb1714cc740 1 -- 172.21.15.12:0/4271447809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb15c028430 con 0x5647a0157a60 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.192+0000 7fb147fff640 1 -- 172.21.15.12:0/4271447809 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb15c042050 con 0x5647a0157a60 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.195+0000 7fb1714cc740 10 client.27458 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.195+0000 7fb1714cc740 1 -- 172.21.15.12:0/4271447809 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5647a01e6ea0 con 0x5647a0157a60 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.201+0000 7fb147fff640 1 -- 172.21.15.12:0/4271447809 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c028430 con 0x5647a0157a60 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.201+0000 7fb147fff640 1 -- 172.21.15.12:0/4271447809 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fb15c03d440 con 0x5647a0157a60 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.202+0000 7fb1714cc740 10 client.27458 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.202+0000 7fb1714cc740 10 client.27458 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.202+0000 7fb1714cc740 20 client.27458 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.202+0000 7fb1714cc740 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5647a01e7410 0x5647a01e9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.202+0000 7fb1714cc740 4 client.27458 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.202+0000 7fb1714cc740 1 -- 172.21.15.12:0/4271447809 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5647a00c4d00 con 0x5647a01e7410 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.204+0000 7fb167fff640 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5647a01e7410 0x5647a01e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.207+0000 7fb167fff640 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5647a01e7410 0x5647a01e9800 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e41a4f01661822e server_cookie=c5721299f2818989 in_seq=0 out_seq=0 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.207+0000 7fb147fff640 10 client.27458 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.211+0000 7fb147fff640 1 -- 172.21.15.12:0/4271447809 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5647a00c4d00 con 0x5647a01e7410 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.211+0000 7fb147fff640 10 client.27458 handle_command_reply: tid=0 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.211+0000 7fb1714cc740 1 client.27458 shutdown 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb1714cc740 1 -- 172.21.15.12:0/4271447809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 msgr2=0x5647a016f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb1714cc740 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 0x5647a016f620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00ced0 tx=0x7fb15c00e720 comp rx=0 tx=0).stop 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb1714cc740 1 -- 172.21.15.12:0/4271447809 shutdown_connections 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb1714cc740 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5647a01e7410 0x5647a01e9800 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb1714cc740 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5647a0183880 0x5647a01e5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb1714cc740 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5647a01690f0 0x5647a016fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb1714cc740 1 --2- 172.21.15.12:0/4271447809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5647a0157a60 0x5647a016f620 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.296 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:49:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:49:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "47f9d360-9bc9-4071-93fa-f3b9d68f20e8", 2024-09-19T06:49:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:49:25.296 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb1714cc740 1 -- 172.21.15.12:0/4271447809 >> 172.21.15.12:0/4271447809 conn(0x5647a01540f0 msgr2=0x5647a0182870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb147fff640 0 client.27458 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb1714cc740 1 -- 172.21.15.12:0/4271447809 shutdown_connections 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.212+0000 7fb1714cc740 1 -- 172.21.15.12:0/4271447809 wait complete. 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.213+0000 7fb1714cc740 20 client.27458 trim_cache size 0 max 16384 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.214+0000 7fb16f0f3640 1 -- 172.21.15.12:0/2221035918 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1580a33b0 msgr2=0x7fb1580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.214+0000 7fb16f0f3640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1580a33b0 0x7fb1580a5870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb16000a400 tx=0x7fb16000a7c0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.215+0000 7fb16f0f3640 1 -- 172.21.15.12:0/2221035918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb168100e30 msgr2=0x7fb16819ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.215+0000 7fb16f0f3640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb168100e30 0x7fb16819ab90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb154004770 tx=0x7fb154003c10 comp rx=0 tx=0).stop 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.215+0000 7fb16f0f3640 1 -- 172.21.15.12:0/2221035918 shutdown_connections 2024-09-19T06:49:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.215+0000 7fb16f0f3640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb1580a33b0 0x7fb1580a5870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.215+0000 7fb16f0f3640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1681055b0 0x7fb16819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.215+0000 7fb16f0f3640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb168100e30 0x7fb16819ab90 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.215+0000 7fb16f0f3640 1 --2- 172.21.15.12:0/2221035918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb168100480 0x7fb16819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.215+0000 7fb16f0f3640 1 -- 172.21.15.12:0/2221035918 >> 172.21.15.12:0/2221035918 conn(0x7fb168077210 msgr2=0x7fb168103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.215+0000 7fb16f0f3640 1 -- 172.21.15.12:0/2221035918 shutdown_connections 2024-09-19T06:49:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:25.215+0000 7fb16f0f3640 1 -- 172.21.15.12:0/2221035918 wait complete. 2024-09-19T06:49:25.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:24 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:49:25.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:24 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:49:25.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:24 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:49:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 520.0 s, 2696.6 tps, lat 37.553 ms stddev 45.624 2024-09-19T06:49:26.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:25 smithi012 ceph-mon[30937]: pgmap v287: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 1.58k op/s 2024-09-19T06:49:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:25 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:49:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:25 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:25 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:49:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:25 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:49:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:25 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:49:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:25 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:26.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:25 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:26.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:49:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:25 smithi016 ceph-mon[34911]: pgmap v287: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 1.58k op/s 2024-09-19T06:49:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:25 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:49:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:25 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:25 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:49:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:25 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:49:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:25 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:49:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:25 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:25 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:25 smithi173 ceph-mon[35349]: pgmap v287: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 1.58k op/s 2024-09-19T06:49:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:25 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:49:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:25 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:25 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:49:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:25 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:49:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:25 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:49:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:25 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:25 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:26.600 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:27.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:26 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:49:27.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:26 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:27.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:26 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:49:27.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:26 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:27.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.323+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3739177213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8077040 msgr2=0x7f29b81124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.323+0000 7f29bd1ac640 1 --2- 172.21.15.12:0/3739177213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8077040 0x7f29b81124f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f29ac01a910 tx=0x7f29ac03b470 comp rx=0 tx=0).stop 2024-09-19T06:49:27.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.324+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3739177213 shutdown_connections 2024-09-19T06:49:27.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.324+0000 7f29bd1ac640 1 --2- 172.21.15.12:0/3739177213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b8112a30 0x7f29b8114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.324+0000 7f29bd1ac640 1 --2- 172.21.15.12:0/3739177213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8077040 0x7f29b81124f0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.324+0000 7f29bd1ac640 1 --2- 172.21.15.12:0/3739177213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29b8076720 0x7f29b8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.324+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3739177213 >> 172.21.15.12:0/3739177213 conn(0x7f29b80ffa70 msgr2=0x7f29b8101e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:27.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.325+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3739177213 shutdown_connections 2024-09-19T06:49:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.325+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3739177213 wait complete. 2024-09-19T06:49:27.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.326+0000 7f29bd1ac640 1 Processor -- start 2024-09-19T06:49:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29bd1ac640 1 -- start start 2024-09-19T06:49:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29bd1ac640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b8076720 0x7f29b810ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29bd1ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8077040 0x7f29b810b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29bd1ac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29b8112a30 0x7f29b8073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29bd1ac640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8106780 con 0x7f29b8077040 2024-09-19T06:49:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29bd1ac640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8106600 con 0x7f29b8112a30 2024-09-19T06:49:27.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29bd1ac640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8106900 con 0x7f29b8076720 2024-09-19T06:49:27.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29b659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8077040 0x7f29b810b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29b659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8077040 0x7f29b810b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37858/0 (socket says 172.21.15.12:37858) 2024-09-19T06:49:27.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29b659c640 1 -- 172.21.15.12:0/3090468539 learned_addr learned my addr 172.21.15.12:0/3090468539 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:27.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.327+0000 7f29b759e640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29b8112a30 0x7f29b8073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.328+0000 7f29b6d9d640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b8076720 0x7f29b810ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.328+0000 7f29b659c640 1 -- 172.21.15.12:0/3090468539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b8076720 msgr2=0x7f29b810ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.328+0000 7f29b659c640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b8076720 0x7f29b810ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.328+0000 7f29b659c640 1 -- 172.21.15.12:0/3090468539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29b8112a30 msgr2=0x7f29b8073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.328+0000 7f29b659c640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29b8112a30 0x7f29b8073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.328+0000 7f29b659c640 1 -- 172.21.15.12:0/3090468539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b8073830 con 0x7f29b8077040 2024-09-19T06:49:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.328+0000 7f29b659c640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8077040 0x7f29b810b0b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f29ac040830 tx=0x7f29ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.329+0000 7f299ffff640 1 -- 172.21.15.12:0/3090468539 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac04f070 con 0x7f29b8077040 2024-09-19T06:49:27.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.329+0000 7f299ffff640 1 -- 172.21.15.12:0/3090468539 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29ac042400 con 0x7f29b8077040 2024-09-19T06:49:27.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.329+0000 7f299ffff640 1 -- 172.21.15.12:0/3090468539 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac046030 con 0x7f29b8077040 2024-09-19T06:49:27.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.329+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3090468539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b8073ac0 con 0x7f29b8077040 2024-09-19T06:49:27.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.329+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3090468539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b81ab920 con 0x7f29b8077040 2024-09-19T06:49:27.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:26 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:49:27.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:26 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:27.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.332+0000 7f299ffff640 1 -- 172.21.15.12:0/3090468539 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f29ac052070 con 0x7f29b8077040 2024-09-19T06:49:27.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.332+0000 7f29bf585740 1 Processor -- start 2024-09-19T06:49:27.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.332+0000 7f29bf585740 1 -- start start 2024-09-19T06:49:27.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29bf585740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 0x564c8de75880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29bf585740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de80140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29bf585740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de80680 0x564c8de82a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29bf585740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564c8dddb2e0 con 0x564c8de75dc0 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29bf585740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564c8dd82ce0 con 0x564c8de80680 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29bf585740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564c8ddd72a0 con 0x564c8de754a0 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de80140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de80140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37860/0 (socket says 172.21.15.12:37860) 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b759e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 0x564c8de75880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b6d9d640 1 -- 172.21.15.12:0/797919936 learned_addr learned my addr 172.21.15.12:0/797919936 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f299ffff640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29a00a3470 0x7f29a00a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b659c640 1 --2- 172.21.15.12:0/797919936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de80680 0x564c8de82a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b759e640 1 -- 172.21.15.12:0/797919936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de80680 msgr2=0x564c8de82a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b759e640 1 --2- 172.21.15.12:0/797919936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de80680 0x564c8de82a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b759e640 1 -- 172.21.15.12:0/797919936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 msgr2=0x564c8de80140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:27.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b759e640 1 --2- 172.21.15.12:0/797919936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de80140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b759e640 1 -- 172.21.15.12:0/797919936 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c8dd67440 con 0x564c8de754a0 2024-09-19T06:49:27.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b6d9d640 1 --2- 172.21.15.12:0/797919936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de80140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:27.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.333+0000 7f29b759e640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29a00a3470 0x7f29a00a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.334+0000 7f299ffff640 1 -- 172.21.15.12:0/3090468539 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f29ac101160 con 0x7f29b8077040 2024-09-19T06:49:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.334+0000 7f29b759e640 1 --2- 172.21.15.12:0/797919936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 0x564c8de75880 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f29b806b430 tx=0x7f29b000a910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c13bee8286630fec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.334+0000 7f299d7fa640 1 -- 172.21.15.12:0/797919936 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b00178b0 con 0x564c8de754a0 2024-09-19T06:49:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.334+0000 7f299d7fa640 1 -- 172.21.15.12:0/797919936 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29b0023440 con 0x564c8de754a0 2024-09-19T06:49:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.335+0000 7f299d7fa640 1 -- 172.21.15.12:0/797919936 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0018600 con 0x564c8de754a0 2024-09-19T06:49:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.335+0000 7f29bf585740 1 -- 172.21.15.12:0/797919936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 msgr2=0x564c8de75880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.335+0000 7f29bf585740 1 --2- 172.21.15.12:0/797919936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 0x564c8de75880 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f29b806b430 tx=0x7f29b000a910 comp rx=0 tx=0).stop 2024-09-19T06:49:27.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.336+0000 7f29b759e640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29a00a3470 0x7f29a00a5930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f29b0020000 tx=0x7f29b001d000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.336+0000 7f29bf585740 1 -- 172.21.15.12:0/797919936 shutdown_connections 2024-09-19T06:49:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.336+0000 7f29bf585740 1 --2- 172.21.15.12:0/797919936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de80680 0x564c8de82a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.336+0000 7f29bf585740 1 --2- 172.21.15.12:0/797919936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de80140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.336+0000 7f29bf585740 1 --2- 172.21.15.12:0/797919936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 0x564c8de75880 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.336+0000 7f29bf585740 1 -- 172.21.15.12:0/797919936 >> 172.21.15.12:0/797919936 conn(0x564c8de71a30 msgr2=0x564c8de71e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.337+0000 7f29bf585740 1 -- 172.21.15.12:0/797919936 shutdown_connections 2024-09-19T06:49:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.337+0000 7f29bf585740 1 -- 172.21.15.12:0/797919936 wait complete. 2024-09-19T06:49:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.338+0000 7f29bf585740 1 -- start start 2024-09-19T06:49:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.338+0000 7f29bf585740 1 Processor -- start 2024-09-19T06:49:27.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.338+0000 7f29bf585740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 0x564c8de7fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29bf585740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de7d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29bf585740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de80680 0x564c8de7d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29b6d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 0x564c8de7fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29b659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de7d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29b659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de7d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37872/0 (socket says 172.21.15.12:37872) 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29b659c640 1 -- 172.21.15.12:0/3851486929 learned_addr learned my addr 172.21.15.12:0/3851486929 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564c8de832f0 con 0x564c8de75dc0 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29b759e640 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de80680 0x564c8de7d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564c8dd96050 con 0x564c8de80680 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564c8de83470 con 0x564c8de754a0 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29bf585740 10 client.0 _ll_register_callbacks cb 0x564c8ddd6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29b659c640 1 -- 172.21.15.12:0/3851486929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 msgr2=0x564c8de7fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29b659c640 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 0x564c8de7fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29b659c640 1 -- 172.21.15.12:0/3851486929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de80680 msgr2=0x564c8de7d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29b659c640 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de80680 0x564c8de7d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.339+0000 7f29b659c640 1 -- 172.21.15.12:0/3851486929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c8db4c3c0 con 0x564c8de75dc0 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.340+0000 7f29b659c640 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de7d140 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f29ac01a2b0 tx=0x7f29ac09c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeabf4cefc00436 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.340+0000 7f299aff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:49:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.340+0000 7f299aff5640 1 -- 172.21.15.12:0/3851486929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac09f020 con 0x564c8de75dc0 2024-09-19T06:49:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.340+0000 7f299aff5640 1 -- 172.21.15.12:0/3851486929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f29ac042960 con 0x564c8de75dc0 2024-09-19T06:49:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.340+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29b0023440 con 0x564c8de75dc0 2024-09-19T06:49:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.340+0000 7f299aff5640 1 -- 172.21.15.12:0/3851486929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f29ac059070 con 0x564c8de75dc0 2024-09-19T06:49:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.340+0000 7f29bf585740 10 client.18048 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.340+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x564c8de8ebd0 con 0x564c8de75dc0 2024-09-19T06:49:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.341+0000 7f299aff5640 1 -- 172.21.15.12:0/3851486929 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29b0023440 con 0x564c8de75dc0 2024-09-19T06:49:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.341+0000 7f299aff5640 1 -- 172.21.15.12:0/3851486929 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f29ac0425b0 con 0x564c8de75dc0 2024-09-19T06:49:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.341+0000 7f29bf585740 10 client.18048 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.341+0000 7f29bf585740 10 client.18048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.341+0000 7f29bf585740 20 client.18048 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.341+0000 7f29bf585740 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564c8de90070 0x564c8de92500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.341+0000 7f29bf585740 4 client.18048 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.341+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c8dde8850 con 0x564c8de90070 2024-09-19T06:49:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.341+0000 7f29b6d9d640 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564c8de90070 0x564c8de92500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.342+0000 7f299aff5640 10 client.18048 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.342+0000 7f29b6d9d640 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564c8de90070 0x564c8de92500 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc164437037e2f6 server_cookie=470e7e7374e6f75f in_seq=0 out_seq=0 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.342+0000 7f299aff5640 1 -- 172.21.15.12:0/3851486929 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c8dde8850 con 0x564c8de90070 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.342+0000 7f299aff5640 10 client.18048 handle_command_reply: tid=0 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.342+0000 7f29bf585740 1 client.18048 shutdown 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 msgr2=0x564c8de7d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de7d140 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f29ac01a2b0 tx=0x7f29ac09c130 comp rx=0 tx=0).stop 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 shutdown_connections 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564c8de90070 0x564c8de92500 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de80680 0x564c8de7d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de7d140 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 1 --2- 172.21.15.12:0/3851486929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de754a0 0x564c8de7fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 >> 172.21.15.12:0/3851486929 conn(0x564c8de71a30 msgr2=0x564c8de77710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f299aff5640 0 client.18048 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 shutdown_connections 2024-09-19T06:49:27.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 1 -- 172.21.15.12:0/3851486929 wait complete. 2024-09-19T06:49:27.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.343+0000 7f29bf585740 20 client.18048 trim_cache size 0 max 16384 2024-09-19T06:49:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.371+0000 7f29bf585740 1 Processor -- start 2024-09-19T06:49:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.371+0000 7f29bf585740 1 -- start start 2024-09-19T06:49:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.371+0000 7f29bf585740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de97e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.371+0000 7f29bf585740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de98350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.371+0000 7f29bf585740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de80680 0x564c8de7a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.371+0000 7f29bf585740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81b4370 con 0x564c8de75dc0 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.371+0000 7f29bf585740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81b5eb0 con 0x564c8de754a0 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.371+0000 7f29bf585740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81b4a40 con 0x564c8de80680 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.372+0000 7f29b6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de97e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.372+0000 7f29b659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de98350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.372+0000 7f29b6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de97e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37126/0 (socket says 172.21.15.12:37126) 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.372+0000 7f29b6d9d640 1 -- 172.21.15.12:0/3495602608 learned_addr learned my addr 172.21.15.12:0/3495602608 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.372+0000 7f29b759e640 1 --2- 172.21.15.12:0/3495602608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de80680 0x564c8de7a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.372+0000 7f29b6d9d640 1 -- 172.21.15.12:0/3495602608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de80680 msgr2=0x564c8de7a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.372+0000 7f29b6d9d640 1 --2- 172.21.15.12:0/3495602608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de80680 0x564c8de7a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.372+0000 7f29b6d9d640 1 -- 172.21.15.12:0/3495602608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 msgr2=0x564c8de98350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.372+0000 7f29b6d9d640 1 --2- 172.21.15.12:0/3495602608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de98350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.372+0000 7f29b6d9d640 1 -- 172.21.15.12:0/3495602608 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c8de75220 con 0x564c8de754a0 2024-09-19T06:49:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.373+0000 7f29b6d9d640 1 --2- 172.21.15.12:0/3495602608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de97e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f29a8006e90 tx=0x7f29a8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b2eb2bfe0f9a1b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.373+0000 7f299cff9640 1 -- 172.21.15.12:0/3495602608 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8027070 con 0x564c8de754a0 2024-09-19T06:49:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.373+0000 7f299cff9640 1 -- 172.21.15.12:0/3495602608 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29a800bc90 con 0x564c8de754a0 2024-09-19T06:49:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.373+0000 7f299cff9640 1 -- 172.21.15.12:0/3495602608 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a801a660 con 0x564c8de754a0 2024-09-19T06:49:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.374+0000 7f29bf585740 1 -- 172.21.15.12:0/3495602608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 msgr2=0x564c8de97e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.374+0000 7f29bf585740 1 --2- 172.21.15.12:0/3495602608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de97e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f29a8006e90 tx=0x7f29a8008040 comp rx=0 tx=0).stop 2024-09-19T06:49:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.374+0000 7f29bf585740 1 -- 172.21.15.12:0/3495602608 shutdown_connections 2024-09-19T06:49:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.374+0000 7f29bf585740 1 --2- 172.21.15.12:0/3495602608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de80680 0x564c8de7a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.374+0000 7f29bf585740 1 --2- 172.21.15.12:0/3495602608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de75dc0 0x564c8de98350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.375+0000 7f29bf585740 1 --2- 172.21.15.12:0/3495602608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de97e10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.375+0000 7f29bf585740 1 -- 172.21.15.12:0/3495602608 >> 172.21.15.12:0/3495602608 conn(0x564c8de71a30 msgr2=0x564c8de7f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.375+0000 7f29bf585740 1 -- 172.21.15.12:0/3495602608 shutdown_connections 2024-09-19T06:49:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.375+0000 7f29bf585740 1 -- 172.21.15.12:0/3495602608 wait complete. 2024-09-19T06:49:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.376+0000 7f29bf585740 1 -- start start 2024-09-19T06:49:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.376+0000 7f29bf585740 1 Processor -- start 2024-09-19T06:49:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.376+0000 7f29bf585740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de86c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.376+0000 7f29bf585740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de75dc0 0x564c8de871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.376+0000 7f29bf585740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de80680 0x564c8def9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29bf585740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81b57e0 con 0x564c8de80680 2024-09-19T06:49:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29bf585740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81b5110 con 0x564c8de754a0 2024-09-19T06:49:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29bf585740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81b2370 con 0x564c8de75dc0 2024-09-19T06:49:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de86c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de75dc0 0x564c8de871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de86c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37138/0 (socket says 172.21.15.12:37138) 2024-09-19T06:49:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b6d9d640 1 -- 172.21.15.12:0/3423950463 learned_addr learned my addr 172.21.15.12:0/3423950463 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29bf585740 10 client.0 _ll_register_callbacks cb 0x7f29ac053fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b759e640 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de80680 0x564c8def9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b6d9d640 1 -- 172.21.15.12:0/3423950463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de75dc0 msgr2=0x564c8de871c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b6d9d640 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de75dc0 0x564c8de871c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b6d9d640 1 -- 172.21.15.12:0/3423950463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de80680 msgr2=0x564c8def9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b6d9d640 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de80680 0x564c8def9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b6d9d640 1 -- 172.21.15.12:0/3423950463 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c8defa3b0 con 0x564c8de754a0 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.377+0000 7f29b659c640 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de75dc0 0x564c8de871c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.378+0000 7f29b6d9d640 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de86c80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f29a8025040 tx=0x7f29a8022650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cebc3d6b95db281f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.378+0000 7f299aff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.378+0000 7f299aff5640 1 -- 172.21.15.12:0/3423950463 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8032060 con 0x564c8de754a0 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.378+0000 7f299aff5640 1 -- 172.21.15.12:0/3423950463 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f29a8022b50 con 0x564c8de754a0 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.378+0000 7f29bf585740 1 -- 172.21.15.12:0/3423950463 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29a800bc90 con 0x564c8de754a0 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.378+0000 7f299aff5640 1 -- 172.21.15.12:0/3423950463 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f29a8039050 con 0x564c8de754a0 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.378+0000 7f29bf585740 10 client.27473 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.378+0000 7f29bf585740 1 -- 172.21.15.12:0/3423950463 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x564c8defb660 con 0x564c8de754a0 2024-09-19T06:49:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.378+0000 7f299aff5640 1 -- 172.21.15.12:0/3423950463 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29a800bc90 con 0x564c8de754a0 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.378+0000 7f299aff5640 1 -- 172.21.15.12:0/3423950463 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f29a802c3e0 con 0x564c8de754a0 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.379+0000 7f29bf585740 10 client.27473 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.379+0000 7f29bf585740 10 client.27473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.379+0000 7f29bf585740 20 client.27473 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.379+0000 7f29bf585740 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564c8defbc50 0x564c8defe070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.379+0000 7f29bf585740 4 client.27473 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.379+0000 7f29bf585740 1 -- 172.21.15.12:0/3423950463 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c8dde2d60 con 0x564c8defbc50 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.379+0000 7f29b659c640 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564c8defbc50 0x564c8defe070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.379+0000 7f29b659c640 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564c8defbc50 0x564c8defe070 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8117720d5025eeb7 server_cookie=23ef791dee33c32f in_seq=0 out_seq=0 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.379+0000 7f299aff5640 10 client.27473 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f299aff5640 1 -- 172.21.15.12:0/3423950463 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564c8dde2d60 con 0x564c8defbc50 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f299aff5640 10 client.27473 handle_command_reply: tid=0 2024-09-19T06:49:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f29bf585740 1 client.27473 shutdown 2024-09-19T06:49:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f29bf585740 1 -- 172.21.15.12:0/3423950463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 msgr2=0x564c8de86c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f29bf585740 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de86c80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f29a8025040 tx=0x7f29a8022650 comp rx=0 tx=0).stop 2024-09-19T06:49:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f29bf585740 1 -- 172.21.15.12:0/3423950463 shutdown_connections 2024-09-19T06:49:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f29bf585740 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564c8defbc50 0x564c8defe070 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f299aff5640 0 client.27473 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f29bf585740 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564c8de80680 0x564c8def9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f29bf585740 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564c8de75dc0 0x564c8de871c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f29bf585740 1 --2- 172.21.15.12:0/3423950463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564c8de754a0 0x564c8de86c80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.380+0000 7f29bf585740 1 -- 172.21.15.12:0/3423950463 >> 172.21.15.12:0/3423950463 conn(0x564c8de71a30 msgr2=0x564c8de70370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.381+0000 7f29bf585740 1 -- 172.21.15.12:0/3423950463 shutdown_connections 2024-09-19T06:49:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.381+0000 7f29bf585740 1 -- 172.21.15.12:0/3423950463 wait complete. 2024-09-19T06:49:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.381+0000 7f29bf585740 20 client.27473 trim_cache size 0 max 16384 2024-09-19T06:49:27.385 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:49:27.385 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:49:27.385 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:49:27.386 INFO:teuthology.orchestra.run.smithi012.stdout: "47f9d360-9bc9-4071-93fa-f3b9d68f20e8": { 2024-09-19T06:49:27.386 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:49:27.386 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "47f9d360-9bc9-4071-93fa-f3b9d68f20e8", 2024-09-19T06:49:27.386 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:49:27.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:49:27.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:49:27.386 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.383+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3090468539 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29a00a3470 msgr2=0x7f29a00a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.383+0000 7f29bd1ac640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29a00a3470 0x7f29a00a5930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f29b0020000 tx=0x7f29b001d000 comp rx=0 tx=0).stop 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.384+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3090468539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8077040 msgr2=0x7f29b810b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.384+0000 7f29bd1ac640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8077040 0x7f29b810b0b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f29ac040830 tx=0x7f29ac0046c0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.384+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3090468539 shutdown_connections 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.384+0000 7f29bd1ac640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29b8112a30 0x7f29b8073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.384+0000 7f29bd1ac640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b8077040 0x7f29b810b0b0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.384+0000 7f29bd1ac640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29a00a3470 0x7f29a00a5930 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.384+0000 7f29bd1ac640 1 --2- 172.21.15.12:0/3090468539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b8076720 0x7f29b810ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.384+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3090468539 >> 172.21.15.12:0/3090468539 conn(0x7f29b80ffa70 msgr2=0x7f29b81130d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:27.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.384+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3090468539 shutdown_connections 2024-09-19T06:49:27.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:27.384+0000 7f29bd1ac640 1 -- 172.21.15.12:0/3090468539 wait complete. 2024-09-19T06:49:28.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:27 smithi012 ceph-mon[30937]: pgmap v288: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.7 MiB/s wr, 592 op/s 2024-09-19T06:49:28.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:27 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:49:28.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:27 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:28.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:27 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:27 smithi016 ceph-mon[34911]: pgmap v288: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.7 MiB/s wr, 592 op/s 2024-09-19T06:49:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:27 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:49:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:27 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:27 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:28.300 INFO:tasks.cephfs.filesystem:scrub status for tag:47f9d360-9bc9-4071-93fa-f3b9d68f20e8 - {'path': '/', 'tag': '47f9d360-9bc9-4071-93fa-f3b9d68f20e8', 'options': 'recursive,force'} 2024-09-19T06:49:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:27 smithi173 ceph-mon[35349]: pgmap v288: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.7 MiB/s wr, 592 op/s 2024-09-19T06:49:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:27 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:49:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:27 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:27 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:49:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:29 smithi016 ceph-mon[34911]: pgmap v289: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 565 op/s 2024-09-19T06:49:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:29 smithi173 ceph-mon[35349]: pgmap v289: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 565 op/s 2024-09-19T06:49:30.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:29 smithi012 ceph-mon[30937]: pgmap v289: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 565 op/s 2024-09-19T06:49:30.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 525.0 s, 2878.8 tps, lat 34.663 ms stddev 40.524 2024-09-19T06:49:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:31 smithi016 ceph-mon[34911]: pgmap v290: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 11 MiB/s wr, 1.06k op/s 2024-09-19T06:49:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.284+0000 7f2aea99f640 1 -- 172.21.15.12:0/827484161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ae4108020 msgr2=0x7f2ae4108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.284+0000 7f2aea99f640 1 --2- 172.21.15.12:0/827484161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ae4108020 0x7f2ae4108460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009900 tx=0x7f2ad402a410 comp rx=0 tx=0).stop 2024-09-19T06:49:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.285+0000 7f2aea99f640 1 -- 172.21.15.12:0/827484161 shutdown_connections 2024-09-19T06:49:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.285+0000 7f2aea99f640 1 --2- 172.21.15.12:0/827484161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ae41089a0 0x7f2ae4114d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.285+0000 7f2aea99f640 1 --2- 172.21.15.12:0/827484161 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ae4108020 0x7f2ae4108460 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.285+0000 7f2aea99f640 1 --2- 172.21.15.12:0/827484161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae410df80 0x7f2ae410e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.285+0000 7f2aea99f640 1 -- 172.21.15.12:0/827484161 >> 172.21.15.12:0/827484161 conn(0x7f2ae4077860 msgr2=0x7f2ae4079c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.286+0000 7f2aea99f640 1 -- 172.21.15.12:0/827484161 shutdown_connections 2024-09-19T06:49:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.286+0000 7f2aea99f640 1 -- 172.21.15.12:0/827484161 wait complete. 2024-09-19T06:49:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.287+0000 7f2aea99f640 1 Processor -- start 2024-09-19T06:49:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.287+0000 7f2aea99f640 1 -- start start 2024-09-19T06:49:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.287+0000 7f2aea99f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ae4108020 0x7f2ae419e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.287+0000 7f2aea99f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ae41089a0 0x7f2ae419ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.287+0000 7f2aea99f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae410df80 0x7f2ae41a3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.287+0000 7f2aea99f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae41182c0 con 0x7f2ae410df80 2024-09-19T06:49:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.287+0000 7f2aea99f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae4118140 con 0x7f2ae4108020 2024-09-19T06:49:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2aea99f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae4118440 con 0x7f2ae41089a0 2024-09-19T06:49:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae999d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ae4108020 0x7f2ae419e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae999d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ae4108020 0x7f2ae419e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:51872/0 (socket says 172.21.15.12:51872) 2024-09-19T06:49:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae999d640 1 -- 172.21.15.12:0/1229393810 learned_addr learned my addr 172.21.15.12:0/1229393810 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2aea19e640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae410df80 0x7f2ae41a3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae919c640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ae41089a0 0x7f2ae419ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae999d640 1 -- 172.21.15.12:0/1229393810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ae41089a0 msgr2=0x7f2ae419ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae999d640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ae41089a0 0x7f2ae419ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae999d640 1 -- 172.21.15.12:0/1229393810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae410df80 msgr2=0x7f2ae41a3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae999d640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae410df80 0x7f2ae41a3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae999d640 1 -- 172.21.15.12:0/1229393810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae41a3740 con 0x7f2ae4108020 2024-09-19T06:49:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae919c640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ae41089a0 0x7f2ae419ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:49:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2ae999d640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ae4108020 0x7f2ae419e750 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000d950 tx=0x7f2ae000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2adaffd640 1 -- 172.21.15.12:0/1229393810 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0017070 con 0x7f2ae4108020 2024-09-19T06:49:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2aea99f640 1 -- 172.21.15.12:0/1229393810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae41a3a30 con 0x7f2ae4108020 2024-09-19T06:49:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.288+0000 7f2aea99f640 1 -- 172.21.15.12:0/1229393810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae41ab2c0 con 0x7f2ae4108020 2024-09-19T06:49:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.289+0000 7f2adaffd640 1 -- 172.21.15.12:0/1229393810 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae0009c30 con 0x7f2ae4108020 2024-09-19T06:49:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.289+0000 7f2adaffd640 1 -- 172.21.15.12:0/1229393810 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000f6b0 con 0x7f2ae4108020 2024-09-19T06:49:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.292+0000 7f2adaffd640 1 -- 172.21.15.12:0/1229393810 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2ae000f850 con 0x7f2ae4108020 2024-09-19T06:49:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.292+0000 7f2aeea72740 1 Processor -- start 2024-09-19T06:49:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.293+0000 7f2aeea72740 1 -- start start 2024-09-19T06:49:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.293+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb2980cc0 0x562fb29810a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.293+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb29815e0 0x562fb298b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.293+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 0x562fb298e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.293+0000 7f2aeea72740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562fb28e52f0 con 0x562fb29815e0 2024-09-19T06:49:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.293+0000 7f2aeea72740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562fb288d270 con 0x562fb298be80 2024-09-19T06:49:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.293+0000 7f2aeea72740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562fb28e12b0 con 0x562fb2980cc0 2024-09-19T06:49:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2aea19e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb2980cc0 0x562fb29810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2ae919c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 0x562fb298e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2aea19e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb2980cc0 0x562fb29810a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54596/0 (socket says 172.21.15.12:54596) 2024-09-19T06:49:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2aea19e640 1 -- 172.21.15.12:0/3512919018 learned_addr learned my addr 172.21.15.12:0/3512919018 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2ae999d640 1 --2- 172.21.15.12:0/3512919018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb29815e0 0x562fb298b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2aea19e640 1 -- 172.21.15.12:0/3512919018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 msgr2=0x562fb298e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2aea19e640 1 --2- 172.21.15.12:0/3512919018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 0x562fb298e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2aea19e640 1 -- 172.21.15.12:0/3512919018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb29815e0 msgr2=0x562fb298b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2aea19e640 1 --2- 172.21.15.12:0/3512919018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb29815e0 0x562fb298b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2aea19e640 1 -- 172.21.15.12:0/3512919018 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fb288c340 con 0x562fb2980cc0 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2ae919c640 1 --2- 172.21.15.12:0/3512919018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 0x562fb298e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.294+0000 7f2aea19e640 1 --2- 172.21.15.12:0/3512919018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb2980cc0 0x562fb29810a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00ae90 tx=0x7f2adc00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb44784b4b5c87ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.295+0000 7f2acffff640 1 -- 172.21.15.12:0/3512919018 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc003b70 con 0x562fb2980cc0 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.295+0000 7f2adaffd640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2ad00a3430 0x7f2ad00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.295+0000 7f2acffff640 1 -- 172.21.15.12:0/3512919018 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2adc003d10 con 0x562fb2980cc0 2024-09-19T06:49:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.295+0000 7f2ae999d640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2ad00a3430 0x7f2ad00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.295+0000 7f2acffff640 1 -- 172.21.15.12:0/3512919018 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc010c70 con 0x562fb2980cc0 2024-09-19T06:49:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.295+0000 7f2adaffd640 1 -- 172.21.15.12:0/1229393810 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f2ae00cfc30 con 0x7f2ae4108020 2024-09-19T06:49:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.296+0000 7f2aeea72740 1 -- 172.21.15.12:0/3512919018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb2980cc0 msgr2=0x562fb29810a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.296+0000 7f2aeea72740 1 --2- 172.21.15.12:0/3512919018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb2980cc0 0x562fb29810a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00ae90 tx=0x7f2adc00f790 comp rx=0 tx=0).stop 2024-09-19T06:49:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.296+0000 7f2ae999d640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2ad00a3430 0x7f2ad00a58f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00cd390 tx=0x7f2ae00bc040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.297+0000 7f2aeea72740 1 -- 172.21.15.12:0/3512919018 shutdown_connections 2024-09-19T06:49:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.297+0000 7f2aeea72740 1 --2- 172.21.15.12:0/3512919018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 0x562fb298e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.297+0000 7f2aeea72740 1 --2- 172.21.15.12:0/3512919018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb29815e0 0x562fb298b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.297+0000 7f2aeea72740 1 --2- 172.21.15.12:0/3512919018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb2980cc0 0x562fb29810a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.297+0000 7f2aeea72740 1 -- 172.21.15.12:0/3512919018 >> 172.21.15.12:0/3512919018 conn(0x562fb297d230 msgr2=0x562fb297d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.297+0000 7f2aeea72740 1 -- 172.21.15.12:0/3512919018 shutdown_connections 2024-09-19T06:49:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.297+0000 7f2aeea72740 1 -- 172.21.15.12:0/3512919018 wait complete. 2024-09-19T06:49:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.298+0000 7f2aeea72740 1 -- start start 2024-09-19T06:49:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.298+0000 7f2aeea72740 1 Processor -- start 2024-09-19T06:49:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2988cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb29815e0 0x562fb2989200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 0x562fb2989740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aeea72740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562fb298eaa0 con 0x562fb2980cc0 2024-09-19T06:49:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aeea72740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562fb286e290 con 0x562fb298be80 2024-09-19T06:49:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aeea72740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562fb298ec20 con 0x562fb29815e0 2024-09-19T06:49:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aeea72740 10 client.0 _ll_register_callbacks cb 0x562fb289f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aea19e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2988cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aea19e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2988cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43112/0 (socket says 172.21.15.12:43112) 2024-09-19T06:49:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aea19e640 1 -- 172.21.15.12:0/2901818578 learned_addr learned my addr 172.21.15.12:0/2901818578 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2ae919c640 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb29815e0 0x562fb2989200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.299+0000 7f2aea19e640 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 0x562fb2989740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2ae919c640 1 -- 172.21.15.12:0/2901818578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 msgr2=0x562fb2989740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2ae919c640 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 0x562fb2989740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2ae919c640 1 -- 172.21.15.12:0/2901818578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 msgr2=0x562fb2988cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2ae919c640 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2988cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2ae919c640 1 -- 172.21.15.12:0/2901818578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fb25f8210 con 0x562fb29815e0 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2ae919c640 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb29815e0 0x562fb2989200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4000c00 tx=0x7f2ad4005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a5e04eb5bb29d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2acd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2acd7fa640 1 -- 172.21.15.12:0/2901818578 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4035040 con 0x562fb29815e0 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2aeea72740 1 -- 172.21.15.12:0/2901818578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2adc003d10 con 0x562fb29815e0 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2acd7fa640 1 -- 172.21.15.12:0/2901818578 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f2ad40046c0 con 0x562fb29815e0 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2acd7fa640 1 -- 172.21.15.12:0/2901818578 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2ad40048c0 con 0x562fb29815e0 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2aeea72740 10 client.27436 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.300+0000 7f2aeea72740 1 -- 172.21.15.12:0/2901818578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x562fb26c4620 con 0x562fb29815e0 2024-09-19T06:49:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.301+0000 7f2acd7fa640 1 -- 172.21.15.12:0/2901818578 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2adc003d10 con 0x562fb29815e0 2024-09-19T06:49:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.301+0000 7f2acd7fa640 1 -- 172.21.15.12:0/2901818578 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f2ad4003ce0 con 0x562fb29815e0 2024-09-19T06:49:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.301+0000 7f2aeea72740 10 client.27436 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.301+0000 7f2aeea72740 10 client.27436 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.301+0000 7f2aeea72740 20 client.27436 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.301+0000 7f2aeea72740 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fb299bda0 0x562fb299e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.301+0000 7f2aeea72740 4 client.27436 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.301+0000 7f2aeea72740 1 -- 172.21.15.12:0/2901818578 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fb28f2a20 con 0x562fb299bda0 2024-09-19T06:49:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.302+0000 7f2aea19e640 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fb299bda0 0x562fb299e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.303+0000 7f2aea19e640 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fb299bda0 0x562fb299e1e0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3065ccbe155a9bc server_cookie=3b52d49608baf582 in_seq=0 out_seq=0 2024-09-19T06:49:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.303+0000 7f2acd7fa640 10 client.27436 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.304+0000 7f2acd7fa640 1 -- 172.21.15.12:0/2901818578 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fb28f2a20 con 0x562fb299bda0 2024-09-19T06:49:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.304+0000 7f2acd7fa640 10 client.27436 handle_command_reply: tid=0 2024-09-19T06:49:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.304+0000 7f2aeea72740 1 client.27436 shutdown 2024-09-19T06:49:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 1 -- 172.21.15.12:0/2901818578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb29815e0 msgr2=0x562fb2989200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb29815e0 0x562fb2989200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4000c00 tx=0x7f2ad4005040 comp rx=0 tx=0).stop 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 1 -- 172.21.15.12:0/2901818578 shutdown_connections 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fb299bda0 0x562fb299e1e0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb298be80 0x562fb2989740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb29815e0 0x562fb2989200 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 1 --2- 172.21.15.12:0/2901818578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2988cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 1 -- 172.21.15.12:0/2901818578 >> 172.21.15.12:0/2901818578 conn(0x562fb297d230 msgr2=0x562fb2982f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2acd7fa640 0 client.27436 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 1 -- 172.21.15.12:0/2901818578 shutdown_connections 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 1 -- 172.21.15.12:0/2901818578 wait complete. 2024-09-19T06:49:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.305+0000 7f2aeea72740 20 client.27436 trim_cache size 0 max 16384 2024-09-19T06:49:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aeea72740 1 Processor -- start 2024-09-19T06:49:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aeea72740 1 -- start start 2024-09-19T06:49:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2989570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb29815e0 0x562fb29a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb298be80 0x562fb29a4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aeea72740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac800ea60 con 0x562fb2980cc0 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aeea72740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac80105a0 con 0x562fb29815e0 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aeea72740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac800f130 con 0x562fb298be80 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aea19e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2989570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2ae919c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb29815e0 0x562fb29a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aea19e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2989570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43116/0 (socket says 172.21.15.12:43116) 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aea19e640 1 -- 172.21.15.12:0/675184305 learned_addr learned my addr 172.21.15.12:0/675184305 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.327+0000 7f2aea19e640 1 --2- 172.21.15.12:0/675184305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb298be80 0x562fb29a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.328+0000 7f2ae919c640 1 -- 172.21.15.12:0/675184305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb298be80 msgr2=0x562fb29a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.328+0000 7f2ae919c640 1 --2- 172.21.15.12:0/675184305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb298be80 0x562fb29a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.328+0000 7f2ae919c640 1 -- 172.21.15.12:0/675184305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 msgr2=0x562fb2989570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.328+0000 7f2ae919c640 1 --2- 172.21.15.12:0/675184305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2989570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.328+0000 7f2ae919c640 1 -- 172.21.15.12:0/675184305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fb299e860 con 0x562fb29815e0 2024-09-19T06:49:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.328+0000 7f2aea19e640 1 --2- 172.21.15.12:0/675184305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2989570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.328+0000 7f2ae919c640 1 --2- 172.21.15.12:0/675184305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb29815e0 0x562fb29a3af0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009900 tx=0x7f2ad40041c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e7713a6dd7bdcd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.328+0000 7f2acf7fe640 1 -- 172.21.15.12:0/675184305 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4035070 con 0x562fb29815e0 2024-09-19T06:49:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.328+0000 7f2acf7fe640 1 -- 172.21.15.12:0/675184305 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad4005480 con 0x562fb29815e0 2024-09-19T06:49:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.328+0000 7f2acf7fe640 1 -- 172.21.15.12:0/675184305 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40039b0 con 0x562fb29815e0 2024-09-19T06:49:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.329+0000 7f2aeea72740 1 -- 172.21.15.12:0/675184305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb29815e0 msgr2=0x562fb29a3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.329+0000 7f2aeea72740 1 --2- 172.21.15.12:0/675184305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb29815e0 0x562fb29a3af0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009900 tx=0x7f2ad40041c0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.330+0000 7f2aeea72740 1 -- 172.21.15.12:0/675184305 shutdown_connections 2024-09-19T06:49:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.330+0000 7f2aeea72740 1 --2- 172.21.15.12:0/675184305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb298be80 0x562fb29a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.330+0000 7f2aeea72740 1 --2- 172.21.15.12:0/675184305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb29815e0 0x562fb29a3af0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.330+0000 7f2aeea72740 1 --2- 172.21.15.12:0/675184305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb2980cc0 0x562fb2989570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.330+0000 7f2aeea72740 1 -- 172.21.15.12:0/675184305 >> 172.21.15.12:0/675184305 conn(0x562fb297d230 msgr2=0x562fb297c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.331+0000 7f2aeea72740 1 -- 172.21.15.12:0/675184305 shutdown_connections 2024-09-19T06:49:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.331+0000 7f2aeea72740 1 -- 172.21.15.12:0/675184305 wait complete. 2024-09-19T06:49:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.331+0000 7f2aeea72740 1 -- start start 2024-09-19T06:49:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.331+0000 7f2aeea72740 1 Processor -- start 2024-09-19T06:49:32.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:31 smithi173 ceph-mon[35349]: pgmap v290: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 11 MiB/s wr, 1.06k op/s 2024-09-19T06:49:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb2980cc0 0x562fb29940e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb29815e0 0x562fb2994620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aeea72740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb298be80 0x562fb298eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aeea72740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac800fed0 con 0x562fb29815e0 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aeea72740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac800f800 con 0x562fb2980cc0 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aeea72740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac800ca60 con 0x562fb298be80 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aea19e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb2980cc0 0x562fb29940e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aea19e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb2980cc0 0x562fb29940e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:51906/0 (socket says 172.21.15.12:51906) 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aea19e640 1 -- 172.21.15.12:0/688491349 learned_addr learned my addr 172.21.15.12:0/688491349 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aeea72740 10 client.0 _ll_register_callbacks cb 0x7f2ad4004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2ae919c640 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb29815e0 0x562fb2994620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aea19e640 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb298be80 0x562fb298eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aea19e640 1 -- 172.21.15.12:0/688491349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb298be80 msgr2=0x562fb298eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aea19e640 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb298be80 0x562fb298eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aea19e640 1 -- 172.21.15.12:0/688491349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb29815e0 msgr2=0x562fb2994620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aea19e640 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb29815e0 0x562fb2994620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.332+0000 7f2aea19e640 1 -- 172.21.15.12:0/688491349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fb297d060 con 0x562fb2980cc0 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.333+0000 7f2aea19e640 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb2980cc0 0x562fb29940e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00ae60 tx=0x7f2adc01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=270cf5c0eb817825 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.333+0000 7f2acd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.333+0000 7f2acd7fa640 1 -- 172.21.15.12:0/688491349 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc033460 con 0x562fb2980cc0 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.333+0000 7f2aeea72740 1 -- 172.21.15.12:0/688491349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad4005480 con 0x562fb2980cc0 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.333+0000 7f2acd7fa640 1 -- 172.21.15.12:0/688491349 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f2adc01d040 con 0x562fb2980cc0 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.333+0000 7f2acd7fa640 1 -- 172.21.15.12:0/688491349 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2adc033600 con 0x562fb2980cc0 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.333+0000 7f2aeea72740 10 client.27488 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.333+0000 7f2aeea72740 1 -- 172.21.15.12:0/688491349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x562fb2a07310 con 0x562fb2980cc0 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.333+0000 7f2acd7fa640 1 -- 172.21.15.12:0/688491349 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad4005480 con 0x562fb2980cc0 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.333+0000 7f2acd7fa640 1 -- 172.21.15.12:0/688491349 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f2adc018990 con 0x562fb2980cc0 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.334+0000 7f2aeea72740 10 client.27488 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.334+0000 7f2aeea72740 10 client.27488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.334+0000 7f2aeea72740 20 client.27488 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.334+0000 7f2aeea72740 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fb2a077f0 0x562fb2a09be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.334+0000 7f2aeea72740 4 client.27488 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:49:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.334+0000 7f2aeea72740 1 -- 172.21.15.12:0/688491349 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562fb28ecd70 con 0x562fb2a077f0 2024-09-19T06:49:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.334+0000 7f2ae919c640 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fb2a077f0 0x562fb2a09be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.336+0000 7f2acd7fa640 10 client.27488 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.336+0000 7f2ae919c640 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fb2a077f0 0x562fb2a09be0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c73a287659abdb1 server_cookie=34cfe7f727cd2bde in_seq=0 out_seq=0 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2acd7fa640 1 -- 172.21.15.12:0/688491349 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562fb28ecd70 con 0x562fb2a077f0 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2acd7fa640 10 client.27488 handle_command_reply: tid=0 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 client.27488 shutdown 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 -- 172.21.15.12:0/688491349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb2980cc0 msgr2=0x562fb29940e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb2980cc0 0x562fb29940e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00ae60 tx=0x7f2adc01a040 comp rx=0 tx=0).stop 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 -- 172.21.15.12:0/688491349 shutdown_connections 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562fb2a077f0 0x562fb2a09be0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562fb298be80 0x562fb298eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562fb29815e0 0x562fb2994620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2acd7fa640 0 client.27488 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 --2- 172.21.15.12:0/688491349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562fb2980cc0 0x562fb29940e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 -- 172.21.15.12:0/688491349 >> 172.21.15.12:0/688491349 conn(0x562fb297d230 msgr2=0x562fb2996d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 -- 172.21.15.12:0/688491349 shutdown_connections 2024-09-19T06:49:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.348+0000 7f2aeea72740 1 -- 172.21.15.12:0/688491349 wait complete. 2024-09-19T06:49:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aeea72740 20 client.27488 trim_cache size 0 max 16384 2024-09-19T06:49:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:49:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:49:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:49:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:49:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 -- 172.21.15.12:0/1229393810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2ad00a3430 msgr2=0x7f2ad00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2ad00a3430 0x7f2ad00a58f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00cd390 tx=0x7f2ae00bc040 comp rx=0 tx=0).stop 2024-09-19T06:49:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 -- 172.21.15.12:0/1229393810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ae4108020 msgr2=0x7f2ae419e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ae4108020 0x7f2ae419e750 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000d950 tx=0x7f2ae000de10 comp rx=0 tx=0).stop 2024-09-19T06:49:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 -- 172.21.15.12:0/1229393810 shutdown_connections 2024-09-19T06:49:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae410df80 0x7f2ae41a3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2ad00a3430 0x7f2ad00a58f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2ae41089a0 0x7f2ae419ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 --2- 172.21.15.12:0/1229393810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ae4108020 0x7f2ae419e750 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 -- 172.21.15.12:0/1229393810 >> 172.21.15.12:0/1229393810 conn(0x7f2ae4077860 msgr2=0x7f2ae4079010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 -- 172.21.15.12:0/1229393810 shutdown_connections 2024-09-19T06:49:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:32.349+0000 7f2aea99f640 1 -- 172.21.15.12:0/1229393810 wait complete. 2024-09-19T06:49:32.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:31 smithi012 ceph-mon[30937]: pgmap v290: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 11 MiB/s wr, 1.06k op/s 2024-09-19T06:49:34.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:33 smithi016 ceph-mon[34911]: pgmap v291: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 7.2 MiB/s wr, 778 op/s 2024-09-19T06:49:34.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:33 smithi173 ceph-mon[35349]: pgmap v291: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 7.2 MiB/s wr, 778 op/s 2024-09-19T06:49:34.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:33 smithi012 ceph-mon[30937]: pgmap v291: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 7.2 MiB/s wr, 778 op/s 2024-09-19T06:49:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 530.0 s, 3790.4 tps, lat 26.416 ms stddev 31.859 2024-09-19T06:49:36.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:35 smithi016 ceph-mon[34911]: pgmap v292: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 8.2 MiB/s wr, 867 op/s 2024-09-19T06:49:36.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:35 smithi173 ceph-mon[35349]: pgmap v292: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 8.2 MiB/s wr, 867 op/s 2024-09-19T06:49:36.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:35 smithi012 ceph-mon[30937]: pgmap v292: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 8.2 MiB/s wr, 867 op/s 2024-09-19T06:49:38.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:37 smithi016 ceph-mon[34911]: pgmap v293: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 9.5 MiB/s wr, 1.01k op/s 2024-09-19T06:49:38.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:37 smithi173 ceph-mon[35349]: pgmap v293: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 9.5 MiB/s wr, 1.01k op/s 2024-09-19T06:49:38.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:37 smithi012 ceph-mon[30937]: pgmap v293: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 9.5 MiB/s wr, 1.01k op/s 2024-09-19T06:49:39.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:38 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:49:39.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:38 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:49:39.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:38 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:49:39.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:38 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:49:39.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:38 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:49:39.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:38 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:49:39.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:38 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:49:39.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:38 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:49:39.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:38 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:49:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:39 smithi016 ceph-mon[34911]: pgmap v294: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 7.6 MiB/s wr, 812 op/s 2024-09-19T06:49:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:39 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:49:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:39 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:49:40.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:39 smithi173 ceph-mon[35349]: pgmap v294: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 7.6 MiB/s wr, 812 op/s 2024-09-19T06:49:40.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:39 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:49:40.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:39 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:49:40.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:39 smithi012 ceph-mon[30937]: pgmap v294: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 7.6 MiB/s wr, 812 op/s 2024-09-19T06:49:40.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:39 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:49:40.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:39 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:49:40.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 535.0 s, 3065.4 tps, lat 32.237 ms stddev 36.690 2024-09-19T06:49:42.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:41 smithi016 ceph-mon[34911]: pgmap v295: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 11 MiB/s wr, 1.14k op/s 2024-09-19T06:49:42.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:41 smithi173 ceph-mon[35349]: pgmap v295: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 11 MiB/s wr, 1.14k op/s 2024-09-19T06:49:42.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:41 smithi012 ceph-mon[30937]: pgmap v295: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 11 MiB/s wr, 1.14k op/s 2024-09-19T06:49:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:43 smithi016 ceph-mon[34911]: pgmap v296: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.6 MiB/s wr, 640 op/s 2024-09-19T06:49:44.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:43 smithi173 ceph-mon[35349]: pgmap v296: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.6 MiB/s wr, 640 op/s 2024-09-19T06:49:44.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:43 smithi012 ceph-mon[30937]: pgmap v296: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.6 MiB/s wr, 640 op/s 2024-09-19T06:49:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.485+0000 7f89b620e640 1 -- 172.21.15.12:0/268482949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89b0105f10 msgr2=0x7f89b01063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.485+0000 7f89b620e640 1 --2- 172.21.15.12:0/268482949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89b0105f10 0x7f89b01063c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009890 tx=0x7f89a002a360 comp rx=0 tx=0).stop 2024-09-19T06:49:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.485+0000 7f89b620e640 1 -- 172.21.15.12:0/268482949 shutdown_connections 2024-09-19T06:49:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.485+0000 7f89b620e640 1 --2- 172.21.15.12:0/268482949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89b0105f10 0x7f89b01063c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.485+0000 7f89b620e640 1 --2- 172.21.15.12:0/268482949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89b01013b0 0x7f89b0105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.485+0000 7f89b620e640 1 --2- 172.21.15.12:0/268482949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89b0100a90 0x7f89b0100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.485+0000 7f89b620e640 1 -- 172.21.15.12:0/268482949 >> 172.21.15.12:0/268482949 conn(0x7f89b00fc6b0 msgr2=0x7f89b00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.485+0000 7f89b620e640 1 -- 172.21.15.12:0/268482949 shutdown_connections 2024-09-19T06:49:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.485+0000 7f89b620e640 1 -- 172.21.15.12:0/268482949 wait complete. 2024-09-19T06:49:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.486+0000 7f89b620e640 1 Processor -- start 2024-09-19T06:49:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.486+0000 7f89b620e640 1 -- start start 2024-09-19T06:49:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89b620e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89b0100a90 0x7f89b0114c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89b620e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89b01013b0 0x7f89b0110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89b620e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89b0105f10 0x7f89b0111260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89b620e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89b01097d0 con 0x7f89b01013b0 2024-09-19T06:49:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89b620e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89b0109650 con 0x7f89b0105f10 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89b620e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89b0109950 con 0x7f89b0100a90 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89af7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89b0100a90 0x7f89b0114c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89aeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89b01013b0 0x7f89b0110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89affff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89b0105f10 0x7f89b0111260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89af7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89b0100a90 0x7f89b0114c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43792/0 (socket says 172.21.15.12:43792) 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89af7fe640 1 -- 172.21.15.12:0/3376404796 learned_addr learned my addr 172.21.15.12:0/3376404796 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89aeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89b01013b0 0x7f89b0110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59268/0 (socket says 172.21.15.12:59268) 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89affff640 1 -- 172.21.15.12:0/3376404796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89b0100a90 msgr2=0x7f89b0114c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89affff640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89b0100a90 0x7f89b0114c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89affff640 1 -- 172.21.15.12:0/3376404796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89b01013b0 msgr2=0x7f89b0110d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89affff640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89b01013b0 0x7f89b0110d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.487+0000 7f89affff640 1 -- 172.21.15.12:0/3376404796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b0111820 con 0x7f89b0105f10 2024-09-19T06:49:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.488+0000 7f89affff640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89b0105f10 0x7f89b0111260 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f89a002a880 tx=0x7f89a0033ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.488+0000 7f89acff9640 1 -- 172.21.15.12:0/3376404796 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a003f020 con 0x7f89b0105f10 2024-09-19T06:49:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.488+0000 7f89acff9640 1 -- 172.21.15.12:0/3376404796 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89a0030580 con 0x7f89b0105f10 2024-09-19T06:49:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.488+0000 7f89b620e640 1 -- 172.21.15.12:0/3376404796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b0111ab0 con 0x7f89b0105f10 2024-09-19T06:49:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.488+0000 7f89acff9640 1 -- 172.21.15.12:0/3376404796 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0037040 con 0x7f89b0105f10 2024-09-19T06:49:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.488+0000 7f89b620e640 1 -- 172.21.15.12:0/3376404796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b01a2b40 con 0x7f89b0105f10 2024-09-19T06:49:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.490+0000 7f89acff9640 1 -- 172.21.15.12:0/3376404796 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f89a0042020 con 0x7f89b0105f10 2024-09-19T06:49:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.490+0000 7f89b9085740 1 Processor -- start 2024-09-19T06:49:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.491+0000 7f89acff9640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89980a3460 0x7f89980a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.492+0000 7f89acff9640 1 -- 172.21.15.12:0/3376404796 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f89a00ef8f0 con 0x7f89b0105f10 2024-09-19T06:49:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89b9085740 1 -- start start 2024-09-19T06:49:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89aeffd640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89980a3460 0x7f89980a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89b9085740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 0x557b1a101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89b9085740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 0x557b1a10c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89b9085740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a10f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89b9085740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557b1a0662f0 con 0x557b1a10ccb0 2024-09-19T06:49:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89b9085740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557b1a00e270 con 0x557b1a101af0 2024-09-19T06:49:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89b9085740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557b1a0622b0 con 0x557b1a102410 2024-09-19T06:49:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89affff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a10f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89affff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a10f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59278/0 (socket says 172.21.15.12:59278) 2024-09-19T06:49:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89affff640 1 -- 172.21.15.12:0/514601434 learned_addr learned my addr 172.21.15.12:0/514601434 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89af7fe640 1 --2- 172.21.15.12:0/514601434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 0x557b1a101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.493+0000 7f89aeffd640 1 --2- 172.21.15.12:0/514601434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 0x557b1a10c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.494+0000 7f89affff640 1 -- 172.21.15.12:0/514601434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 msgr2=0x557b1a10c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.494+0000 7f89affff640 1 --2- 172.21.15.12:0/514601434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 0x557b1a10c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.494+0000 7f89affff640 1 -- 172.21.15.12:0/514601434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 msgr2=0x557b1a101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.494+0000 7f89affff640 1 --2- 172.21.15.12:0/514601434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 0x557b1a101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.494+0000 7f89affff640 1 -- 172.21.15.12:0/514601434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b1a00d340 con 0x557b1a10ccb0 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.494+0000 7f89aeffd640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89980a3460 0x7f89980a5920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f89b01124e0 tx=0x7f89a4011810 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.494+0000 7f89affff640 1 --2- 172.21.15.12:0/514601434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a10f0a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f89a00ed110 tx=0x7f89a0005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95ee1b122eddd25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.494+0000 7f8995ffb640 1 -- 172.21.15.12:0/514601434 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a00bfff0 con 0x557b1a10ccb0 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.494+0000 7f8995ffb640 1 -- 172.21.15.12:0/514601434 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89a00c48b0 con 0x557b1a10ccb0 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.495+0000 7f8995ffb640 1 -- 172.21.15.12:0/514601434 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0003d70 con 0x557b1a10ccb0 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.495+0000 7f89b9085740 1 -- 172.21.15.12:0/514601434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 msgr2=0x557b1a10f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.495+0000 7f89b9085740 1 --2- 172.21.15.12:0/514601434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a10f0a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f89a00ed110 tx=0x7f89a0005d20 comp rx=0 tx=0).stop 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.495+0000 7f89b9085740 1 -- 172.21.15.12:0/514601434 shutdown_connections 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.495+0000 7f89b9085740 1 --2- 172.21.15.12:0/514601434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a10f0a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.495+0000 7f89b9085740 1 --2- 172.21.15.12:0/514601434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 0x557b1a10c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.495+0000 7f89b9085740 1 --2- 172.21.15.12:0/514601434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 0x557b1a101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.495+0000 7f89b9085740 1 -- 172.21.15.12:0/514601434 >> 172.21.15.12:0/514601434 conn(0x557b1a0fe060 msgr2=0x557b1a0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.495+0000 7f89b9085740 1 -- 172.21.15.12:0/514601434 shutdown_connections 2024-09-19T06:49:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.495+0000 7f89b9085740 1 -- 172.21.15.12:0/514601434 wait complete. 2024-09-19T06:49:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.496+0000 7f89b9085740 1 -- start start 2024-09-19T06:49:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.496+0000 7f89b9085740 1 Processor -- start 2024-09-19T06:49:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.496+0000 7f89b9085740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a101af0 0x557b1a109b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.496+0000 7f89b9085740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 0x557b1a10a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.496+0000 7f89b9085740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a10ccb0 0x557b1a10a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.496+0000 7f89b9085740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557b1a10f640 con 0x557b1a101af0 2024-09-19T06:49:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89b9085740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557b19fef290 con 0x557b1a10ccb0 2024-09-19T06:49:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89b9085740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557b1a10f7c0 con 0x557b1a102410 2024-09-19T06:49:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89af7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a101af0 0x557b1a109b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89aeffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 0x557b1a10a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89b9085740 10 client.0 _ll_register_callbacks cb 0x557b1a020140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89aeffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 0x557b1a10a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43814/0 (socket says 172.21.15.12:43814) 2024-09-19T06:49:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89aeffd640 1 -- 172.21.15.12:0/1682645581 learned_addr learned my addr 172.21.15.12:0/1682645581 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89affff640 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a10ccb0 0x557b1a10a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89aeffd640 1 -- 172.21.15.12:0/1682645581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a10ccb0 msgr2=0x557b1a10a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89aeffd640 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a10ccb0 0x557b1a10a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89aeffd640 1 -- 172.21.15.12:0/1682645581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a101af0 msgr2=0x557b1a109b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89aeffd640 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a101af0 0x557b1a109b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89aeffd640 1 -- 172.21.15.12:0/1682645581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b19d79210 con 0x557b1a102410 2024-09-19T06:49:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f89aeffd640 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 0x557b1a10a0d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f89a401ec20 tx=0x7f89a4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4489fce26c857d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.497+0000 7f898effd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.498+0000 7f898effd640 1 -- 172.21.15.12:0/1682645581 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4027640 con 0x557b1a102410 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.498+0000 7f898effd640 1 -- 172.21.15.12:0/1682645581 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f89a40277e0 con 0x557b1a102410 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.498+0000 7f89b9085740 1 -- 172.21.15.12:0/1682645581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89a00c48b0 con 0x557b1a102410 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.498+0000 7f898effd640 1 -- 172.21.15.12:0/1682645581 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f89a40279e0 con 0x557b1a102410 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.498+0000 7f89b9085740 10 client.27454 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.498+0000 7f89b9085740 1 -- 172.21.15.12:0/1682645581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x557b19e45620 con 0x557b1a102410 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.499+0000 7f898effd640 1 -- 172.21.15.12:0/1682645581 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89a00c48b0 con 0x557b1a102410 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.499+0000 7f898effd640 1 -- 172.21.15.12:0/1682645581 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f89a4025020 con 0x557b1a102410 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.499+0000 7f89b9085740 10 client.27454 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.499+0000 7f89b9085740 10 client.27454 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.499+0000 7f89b9085740 20 client.27454 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.499+0000 7f89b9085740 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557b1a11c950 0x557b1a11ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.499+0000 7f89b9085740 4 client.27454 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.499+0000 7f89b9085740 1 -- 172.21.15.12:0/1682645581 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b1a073a20 con 0x557b1a11c950 2024-09-19T06:49:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.499+0000 7f89af7fe640 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557b1a11c950 0x557b1a11ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.500+0000 7f898effd640 10 client.27454 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.500+0000 7f89af7fe640 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557b1a11c950 0x557b1a11ed40 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc718f00b503f9d7 server_cookie=2e45f7bfae014e9e in_seq=0 out_seq=0 2024-09-19T06:49:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.500+0000 7f898effd640 1 -- 172.21.15.12:0/1682645581 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b1a073a20 con 0x557b1a11c950 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.500+0000 7f898effd640 10 client.27454 handle_command_reply: tid=0 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.500+0000 7f89b9085740 1 client.27454 shutdown 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f89b9085740 1 -- 172.21.15.12:0/1682645581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 msgr2=0x557b1a10a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f89b9085740 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 0x557b1a10a0d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f89a401ec20 tx=0x7f89a4004730 comp rx=0 tx=0).stop 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f89b9085740 1 -- 172.21.15.12:0/1682645581 shutdown_connections 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f89b9085740 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557b1a11c950 0x557b1a11ed40 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f898effd640 0 client.27454 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f89b9085740 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a10ccb0 0x557b1a10a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f89b9085740 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a102410 0x557b1a10a0d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f89b9085740 1 --2- 172.21.15.12:0/1682645581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a101af0 0x557b1a109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f89b9085740 1 -- 172.21.15.12:0/1682645581 >> 172.21.15.12:0/1682645581 conn(0x557b1a0fe060 msgr2=0x557b1a103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f89b9085740 1 -- 172.21.15.12:0/1682645581 shutdown_connections 2024-09-19T06:49:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.501+0000 7f89b9085740 1 -- 172.21.15.12:0/1682645581 wait complete. 2024-09-19T06:49:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.503+0000 7f89b9085740 20 client.27454 trim_cache size 0 max 16384 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.525+0000 7f89b9085740 1 Processor -- start 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.525+0000 7f89b9085740 1 -- start start 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.525+0000 7f89b9085740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a101af0 0x557b1a10a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.525+0000 7f89b9085740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a102410 0x557b1a124650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.525+0000 7f89b9085740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a124b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.525+0000 7f89b9085740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89b01ab890 con 0x557b1a10ccb0 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.525+0000 7f89b9085740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89b01ad3d0 con 0x557b1a102410 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.525+0000 7f89b9085740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89b01abf60 con 0x557b1a101af0 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89aeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a102410 0x557b1a124650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89aeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a102410 0x557b1a124650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41246/0 (socket says 172.21.15.12:41246) 2024-09-19T06:49:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89aeffd640 1 -- 172.21.15.12:0/2324257266 learned_addr learned my addr 172.21.15.12:0/2324257266 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89affff640 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a124b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89af7fe640 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a101af0 0x557b1a10a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89aeffd640 1 -- 172.21.15.12:0/2324257266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a101af0 msgr2=0x557b1a10a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89aeffd640 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a101af0 0x557b1a10a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89aeffd640 1 -- 172.21.15.12:0/2324257266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 msgr2=0x557b1a124b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89aeffd640 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a124b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89aeffd640 1 -- 172.21.15.12:0/2324257266 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b1a0fde90 con 0x557b1a102410 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89af7fe640 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a101af0 0x557b1a10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89affff640 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a124b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89aeffd640 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a102410 0x557b1a124650 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f89a401ebf0 tx=0x7f89a4005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c814c7fa79a5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.526+0000 7f89957fa640 1 -- 172.21.15.12:0/2324257266 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a400f540 con 0x557b1a102410 2024-09-19T06:49:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.527+0000 7f89957fa640 1 -- 172.21.15.12:0/2324257266 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89a4033020 con 0x557b1a102410 2024-09-19T06:49:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.527+0000 7f89957fa640 1 -- 172.21.15.12:0/2324257266 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a40042d0 con 0x557b1a102410 2024-09-19T06:49:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.528+0000 7f89b9085740 1 -- 172.21.15.12:0/2324257266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a102410 msgr2=0x557b1a124650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.528+0000 7f89b9085740 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a102410 0x557b1a124650 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f89a401ebf0 tx=0x7f89a4005db0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.528+0000 7f89b9085740 1 -- 172.21.15.12:0/2324257266 shutdown_connections 2024-09-19T06:49:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.528+0000 7f89b9085740 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a124b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.528+0000 7f89b9085740 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a102410 0x557b1a124650 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f89a401ebf0 tx=0x7f89a4005db0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.528+0000 7f89b9085740 1 --2- 172.21.15.12:0/2324257266 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a101af0 0x557b1a10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.528+0000 7f89b9085740 1 -- 172.21.15.12:0/2324257266 >> 172.21.15.12:0/2324257266 conn(0x557b1a0fe060 msgr2=0x557b1a10bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.530+0000 7f89b9085740 1 -- 172.21.15.12:0/2324257266 shutdown_connections 2024-09-19T06:49:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.530+0000 7f89b9085740 1 -- 172.21.15.12:0/2324257266 wait complete. 2024-09-19T06:49:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.530+0000 7f89b9085740 1 -- start start 2024-09-19T06:49:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89b9085740 1 Processor -- start 2024-09-19T06:49:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89b9085740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 0x557b1a110830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89b9085740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a110d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89b9085740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a11c950 0x557b1a1112b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89b9085740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f89b01acd00 con 0x557b1a10ccb0 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89b9085740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f89b01ac630 con 0x557b1a101af0 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89b9085740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89b01a9890 con 0x557b1a11c950 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89aeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a110d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89aeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a110d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59302/0 (socket says 172.21.15.12:59302) 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89aeffd640 1 -- 172.21.15.12:0/3783012642 learned_addr learned my addr 172.21.15.12:0/3783012642 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89af7fe640 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 0x557b1a110830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89b9085740 10 client.0 _ll_register_callbacks cb 0x7f89a4009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.531+0000 7f89affff640 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a11c950 0x557b1a1112b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.532+0000 7f89aeffd640 1 -- 172.21.15.12:0/3783012642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a11c950 msgr2=0x557b1a1112b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.532+0000 7f89aeffd640 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a11c950 0x557b1a1112b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.532+0000 7f89aeffd640 1 -- 172.21.15.12:0/3783012642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 msgr2=0x557b1a110830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.532+0000 7f89aeffd640 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 0x557b1a110830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.532+0000 7f89aeffd640 1 -- 172.21.15.12:0/3783012642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b1a0f92d0 con 0x557b1a10ccb0 2024-09-19T06:49:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.532+0000 7f89affff640 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a11c950 0x557b1a1112b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.532+0000 7f89af7fe640 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 0x557b1a110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.532+0000 7f89aeffd640 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a110d70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f89a4035040 tx=0x7f89a400f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf571a0ce19b0e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.532+0000 7f898effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:49:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.533+0000 7f898effd640 1 -- 172.21.15.12:0/3783012642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a403c070 con 0x557b1a10ccb0 2024-09-19T06:49:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.533+0000 7f898effd640 1 -- 172.21.15.12:0/3783012642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f89a4005070 con 0x557b1a10ccb0 2024-09-19T06:49:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.533+0000 7f89b9085740 1 -- 172.21.15.12:0/3783012642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89a4033020 con 0x557b1a10ccb0 2024-09-19T06:49:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.533+0000 7f898effd640 1 -- 172.21.15.12:0/3783012642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f89a4048050 con 0x557b1a10ccb0 2024-09-19T06:49:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.533+0000 7f89b9085740 10 client.18090 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.533+0000 7f89b9085740 1 -- 172.21.15.12:0/3783012642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x557b1a104940 con 0x557b1a10ccb0 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.534+0000 7f898effd640 1 -- 172.21.15.12:0/3783012642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89a4033020 con 0x557b1a10ccb0 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.534+0000 7f898effd640 1 -- 172.21.15.12:0/3783012642 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f89a4025050 con 0x557b1a10ccb0 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.534+0000 7f89b9085740 10 client.18090 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.534+0000 7f89b9085740 10 client.18090 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.534+0000 7f89b9085740 20 client.18090 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.534+0000 7f89b9085740 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557b1a187ce0 0x557b1a18a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.534+0000 7f89b9085740 4 client.18090 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.534+0000 7f89b9085740 1 -- 172.21.15.12:0/3783012642 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b1a06dd70 con 0x557b1a187ce0 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.534+0000 7f89af7fe640 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557b1a187ce0 0x557b1a18a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.535+0000 7f89af7fe640 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557b1a187ce0 0x557b1a18a100 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d673558b022047b server_cookie=6956b87ed37bc45c in_seq=0 out_seq=0 2024-09-19T06:49:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.535+0000 7f898effd640 10 client.18090 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f898effd640 1 -- 172.21.15.12:0/3783012642 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b1a06dd70 con 0x557b1a187ce0 2024-09-19T06:49:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f898effd640 10 client.18090 handle_command_reply: tid=0 2024-09-19T06:49:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 client.18090 shutdown 2024-09-19T06:49:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 -- 172.21.15.12:0/3783012642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 msgr2=0x557b1a110d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a110d70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f89a4035040 tx=0x7f89a400f6f0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 -- 172.21.15.12:0/3783012642 shutdown_connections 2024-09-19T06:49:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557b1a187ce0 0x557b1a18a100 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557b1a11c950 0x557b1a1112b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f898effd640 0 client.18090 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b1a10ccb0 0x557b1a110d70 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 --2- 172.21.15.12:0/3783012642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557b1a101af0 0x557b1a110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 -- 172.21.15.12:0/3783012642 >> 172.21.15.12:0/3783012642 conn(0x557b1a0fe060 msgr2=0x557b1a0fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 -- 172.21.15.12:0/3783012642 shutdown_connections 2024-09-19T06:49:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.544+0000 7f89b9085740 1 -- 172.21.15.12:0/3783012642 wait complete. 2024-09-19T06:49:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b9085740 20 client.18090 trim_cache size 0 max 16384 2024-09-19T06:49:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:49:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:49:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:49:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:49:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b620e640 1 -- 172.21.15.12:0/3376404796 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89980a3460 msgr2=0x7f89980a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b620e640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89980a3460 0x7f89980a5920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f89b01124e0 tx=0x7f89a4011810 comp rx=0 tx=0).stop 2024-09-19T06:49:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b620e640 1 -- 172.21.15.12:0/3376404796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89b0105f10 msgr2=0x7f89b0111260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b620e640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89b0105f10 0x7f89b0111260 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f89a002a880 tx=0x7f89a0033ae0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b620e640 1 -- 172.21.15.12:0/3376404796 shutdown_connections 2024-09-19T06:49:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b620e640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89b0105f10 0x7f89b0111260 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b620e640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89b01013b0 0x7f89b0110d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b620e640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f89980a3460 0x7f89980a5920 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b620e640 1 --2- 172.21.15.12:0/3376404796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89b0100a90 0x7f89b0114c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.545+0000 7f89b620e640 1 -- 172.21.15.12:0/3376404796 >> 172.21.15.12:0/3376404796 conn(0x7f89b00fc6b0 msgr2=0x7f89b0103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.546+0000 7f89b620e640 1 -- 172.21.15.12:0/3376404796 shutdown_connections 2024-09-19T06:49:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:45.546+0000 7f89b620e640 1 -- 172.21.15.12:0/3376404796 wait complete. 2024-09-19T06:49:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 540.0 s, 1675.8 tps, lat 59.943 ms stddev 103.394 2024-09-19T06:49:46.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:45 smithi016 ceph-mon[34911]: pgmap v297: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 907 op/s 2024-09-19T06:49:46.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:45 smithi173 ceph-mon[35349]: pgmap v297: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 907 op/s 2024-09-19T06:49:46.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:45 smithi012 ceph-mon[30937]: pgmap v297: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 907 op/s 2024-09-19T06:49:48.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:47 smithi016 ceph-mon[34911]: pgmap v298: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 1.71k op/s 2024-09-19T06:49:48.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:47 smithi173 ceph-mon[35349]: pgmap v298: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 1.71k op/s 2024-09-19T06:49:48.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:47 smithi012 ceph-mon[30937]: pgmap v298: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 1.71k op/s 2024-09-19T06:49:50.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:49 smithi016 ceph-mon[34911]: pgmap v299: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 MiB/s wr, 1.48k op/s 2024-09-19T06:49:50.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:49 smithi173 ceph-mon[35349]: pgmap v299: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 MiB/s wr, 1.48k op/s 2024-09-19T06:49:50.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:49 smithi012 ceph-mon[30937]: pgmap v299: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 MiB/s wr, 1.48k op/s 2024-09-19T06:49:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 545.0 s, 2132.2 tps, lat 47.054 ms stddev 49.102 2024-09-19T06:49:52.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:51 smithi016 ceph-mon[34911]: pgmap v300: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 MiB/s wr, 1.76k op/s 2024-09-19T06:49:52.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:51 smithi173 ceph-mon[35349]: pgmap v300: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 MiB/s wr, 1.76k op/s 2024-09-19T06:49:52.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:51 smithi012 ceph-mon[30937]: pgmap v300: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 MiB/s wr, 1.76k op/s 2024-09-19T06:49:54.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:53 smithi016 ceph-mon[34911]: pgmap v301: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 1.44k op/s 2024-09-19T06:49:54.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:53 smithi173 ceph-mon[35349]: pgmap v301: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 1.44k op/s 2024-09-19T06:49:54.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:53 smithi012 ceph-mon[30937]: pgmap v301: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 1.44k op/s 2024-09-19T06:49:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 550.0 s, 2827.2 tps, lat 35.440 ms stddev 40.375 2024-09-19T06:49:56.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:55 smithi016 ceph-mon[34911]: pgmap v302: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 1.48k op/s 2024-09-19T06:49:56.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:55 smithi173 ceph-mon[35349]: pgmap v302: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 1.48k op/s 2024-09-19T06:49:56.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:55 smithi012 ceph-mon[30937]: pgmap v302: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 34 MiB/s wr, 1.48k op/s 2024-09-19T06:49:57.956 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:57 smithi012 ceph-mon[30937]: pgmap v303: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 MiB/s wr, 1.45k op/s 2024-09-19T06:49:58.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:57 smithi016 ceph-mon[34911]: pgmap v303: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 MiB/s wr, 1.45k op/s 2024-09-19T06:49:58.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:49:58.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:57 smithi173 ceph-mon[35349]: pgmap v303: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 29 MiB/s wr, 1.45k op/s 2024-09-19T06:49:58.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.715+0000 7f4c69d8f640 1 -- 172.21.15.12:0/1630603475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c0b7570 msgr2=0x7f4c5c0b9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:58.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.715+0000 7f4c69d8f640 1 --2- 172.21.15.12:0/1630603475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c0b7570 0x7f4c5c0b9960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4c64067960 tx=0x7f4c6408e4d0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.718+0000 7f4c69d8f640 1 -- 172.21.15.12:0/1630603475 shutdown_connections 2024-09-19T06:49:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.718+0000 7f4c69d8f640 1 --2- 172.21.15.12:0/1630603475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c0b7570 0x7f4c5c0b9960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.718+0000 7f4c69d8f640 1 --2- 172.21.15.12:0/1630603475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c5c0a5170 0x7f4c5c0b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.718+0000 7f4c69d8f640 1 --2- 172.21.15.12:0/1630603475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0a4850 0x7f4c5c0a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.718+0000 7f4c69d8f640 1 -- 172.21.15.12:0/1630603475 >> 172.21.15.12:0/1630603475 conn(0x7f4c5c01a140 msgr2=0x7f4c5c01a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.718+0000 7f4c69d8f640 1 -- 172.21.15.12:0/1630603475 shutdown_connections 2024-09-19T06:49:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.718+0000 7f4c69d8f640 1 -- 172.21.15.12:0/1630603475 wait complete. 2024-09-19T06:49:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.719+0000 7f4c69d8f640 1 Processor -- start 2024-09-19T06:49:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.719+0000 7f4c69d8f640 1 -- start start 2024-09-19T06:49:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.720+0000 7f4c69d8f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0a4850 0x7f4c5c0b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.720+0000 7f4c69d8f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c5c0a5170 0x7f4c5c0ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.720+0000 7f4c69d8f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c0b7570 0x7f4c5c0aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.720+0000 7f4c69d8f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c0bd050 con 0x7f4c5c0a4850 2024-09-19T06:49:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.720+0000 7f4c69d8f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c0bced0 con 0x7f4c5c0a5170 2024-09-19T06:49:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.720+0000 7f4c69d8f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c0bd1d0 con 0x7f4c5c0b7570 2024-09-19T06:49:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.721+0000 7f4c637fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0a4850 0x7f4c5c0b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.721+0000 7f4c637fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0a4850 0x7f4c5c0b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56594/0 (socket says 172.21.15.12:56594) 2024-09-19T06:49:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.721+0000 7f4c637fe640 1 -- 172.21.15.12:0/3314990162 learned_addr learned my addr 172.21.15.12:0/3314990162 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.722+0000 7f4c63fff640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c0b7570 0x7f4c5c0aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.722+0000 7f4c637fe640 1 -- 172.21.15.12:0/3314990162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c0b7570 msgr2=0x7f4c5c0aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.722+0000 7f4c637fe640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c0b7570 0x7f4c5c0aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.722+0000 7f4c637fe640 1 -- 172.21.15.12:0/3314990162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c5c0a5170 msgr2=0x7f4c5c0ae680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:49:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.722+0000 7f4c637fe640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c5c0a5170 0x7f4c5c0ae680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.722+0000 7f4c637fe640 1 -- 172.21.15.12:0/3314990162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c0af1d0 con 0x7f4c5c0a4850 2024-09-19T06:49:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.724+0000 7f4c637fe640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0a4850 0x7f4c5c0b5600 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800b4a0 tx=0x7f4c5800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.727+0000 7f4c60ff9640 1 -- 172.21.15.12:0/3314990162 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c58014070 con 0x7f4c5c0a4850 2024-09-19T06:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.728+0000 7f4c69d8f640 1 -- 172.21.15.12:0/3314990162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5c0af4c0 con 0x7f4c5c0a4850 2024-09-19T06:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.728+0000 7f4c69d8f640 1 -- 172.21.15.12:0/3314990162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c5c0b34a0 con 0x7f4c5c0a4850 2024-09-19T06:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.731+0000 7f4c60ff9640 1 -- 172.21.15.12:0/3314990162 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c58010af0 con 0x7f4c5c0a4850 2024-09-19T06:49:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.731+0000 7f4c60ff9640 1 -- 172.21.15.12:0/3314990162 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c58017d10 con 0x7f4c5c0a4850 2024-09-19T06:49:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.732+0000 7f4c6cbff740 1 Processor -- start 2024-09-19T06:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.733+0000 7f4c6cbff740 1 -- start start 2024-09-19T06:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.734+0000 7f4c6cbff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x5599215410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.734+0000 7f4c6cbff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599215415e0 0x55992154b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.734+0000 7f4c6cbff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55992154be80 0x55992154e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.734+0000 7f4c6cbff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5599214a52f0 con 0x5599215415e0 2024-09-19T06:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.734+0000 7f4c6cbff740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55992144d270 con 0x559921540cc0 2024-09-19T06:49:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.734+0000 7f4c6cbff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5599214a12b0 con 0x55992154be80 2024-09-19T06:49:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.735+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x5599215410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.735+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x5599215410a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:40330/0 (socket says 172.21.15.12:40330) 2024-09-19T06:49:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.735+0000 7f4c63fff640 1 -- 172.21.15.12:0/3730495273 learned_addr learned my addr 172.21.15.12:0/3730495273 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:58.737 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:49:58.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.736+0000 7f4c63fff640 1 -- 172.21.15.12:0/3730495273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55992154be80 msgr2=0x55992154e270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:49:58.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.736+0000 7f4c63fff640 1 --2- 172.21.15.12:0/3730495273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55992154be80 0x55992154e270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.736+0000 7f4c63fff640 1 -- 172.21.15.12:0/3730495273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599215415e0 msgr2=0x55992154b940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:49:58.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.736+0000 7f4c63fff640 1 --2- 172.21.15.12:0/3730495273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599215415e0 0x55992154b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.736+0000 7f4c63fff640 1 -- 172.21.15.12:0/3730495273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55992144c340 con 0x559921540cc0 2024-09-19T06:49:58.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.736+0000 7f4c63fff640 1 --2- 172.21.15.12:0/3730495273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x5599215410a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4c64065a40 tx=0x7f4c64068340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea9b45214556cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:58.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.737+0000 7f4c4dffb640 1 -- 172.21.15.12:0/3730495273 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640a8070 con 0x559921540cc0 2024-09-19T06:49:58.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.737+0000 7f4c60ff9640 1 -- 172.21.15.12:0/3314990162 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4c58017070 con 0x7f4c5c0a4850 2024-09-19T06:49:58.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.738+0000 7f4c4dffb640 1 -- 172.21.15.12:0/3730495273 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c6409c040 con 0x559921540cc0 2024-09-19T06:49:58.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.738+0000 7f4c4dffb640 1 -- 172.21.15.12:0/3730495273 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64062890 con 0x559921540cc0 2024-09-19T06:49:58.739 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.739+0000 7f4c60ff9640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a35d0 0x7f4c540a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.739+0000 7f4c6cbff740 1 -- 172.21.15.12:0/3730495273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 msgr2=0x5599215410a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.739+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/3730495273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x5599215410a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4c64065a40 tx=0x7f4c64068340 comp rx=0 tx=0).stop 2024-09-19T06:49:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.739+0000 7f4c637fe640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a35d0 0x7f4c540a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.739+0000 7f4c6cbff740 1 -- 172.21.15.12:0/3730495273 shutdown_connections 2024-09-19T06:49:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.739+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/3730495273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55992154be80 0x55992154e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.739+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/3730495273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599215415e0 0x55992154b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.739+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/3730495273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x5599215410a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.739+0000 7f4c6cbff740 1 -- 172.21.15.12:0/3730495273 >> 172.21.15.12:0/3730495273 conn(0x55992153d230 msgr2=0x55992153d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:58.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.740+0000 7f4c60ff9640 1 -- 172.21.15.12:0/3314990162 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f4c580cefd0 con 0x7f4c5c0a4850 2024-09-19T06:49:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.741+0000 7f4c6cbff740 1 -- 172.21.15.12:0/3730495273 shutdown_connections 2024-09-19T06:49:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.741+0000 7f4c637fe640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a35d0 0x7f4c540a5a90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55992153e090 tx=0x7f4c58096e30 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.741+0000 7f4c6cbff740 1 -- 172.21.15.12:0/3730495273 wait complete. 2024-09-19T06:49:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.742+0000 7f4c6cbff740 1 -- start start 2024-09-19T06:49:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.742+0000 7f4c6cbff740 1 Processor -- start 2024-09-19T06:49:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c6cbff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 0x559921548dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c6cbff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x559921549310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c6cbff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 0x559921549850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c6cbff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55992154ea50 con 0x559921540cc0 2024-09-19T06:49:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c6cbff740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55992142e290 con 0x55992154be80 2024-09-19T06:49:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c6cbff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55992154ebd0 con 0x5599215415e0 2024-09-19T06:49:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c6cbff740 10 client.0 _ll_register_callbacks cb 0x55992145f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 0x559921548dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 0x559921548dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56604/0 (socket says 172.21.15.12:56604) 2024-09-19T06:49:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c63fff640 1 -- 172.21.15.12:0/2827430037 learned_addr learned my addr 172.21.15.12:0/2827430037 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 0x559921549850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c63fff640 1 -- 172.21.15.12:0/2827430037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 msgr2=0x559921549310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:49:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x559921549310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c63fff640 1 -- 172.21.15.12:0/2827430037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 msgr2=0x559921548dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 0x559921548dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c63fff640 1 -- 172.21.15.12:0/2827430037 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599211b8210 con 0x55992154be80 2024-09-19T06:49:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c63fff640 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 0x559921549850 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4c640506f0 tx=0x7f4c64068160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b1165bf7a1e48c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.743+0000 7f4c42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c42ffd640 1 -- 172.21.15.12:0/2827430037 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640a8070 con 0x55992154be80 2024-09-19T06:49:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c42ffd640 1 -- 172.21.15.12:0/2827430037 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f4c64095850 con 0x55992154be80 2024-09-19T06:49:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c6cbff740 1 -- 172.21.15.12:0/2827430037 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c6409c040 con 0x55992154be80 2024-09-19T06:49:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c42ffd640 1 -- 172.21.15.12:0/2827430037 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f4c64062630 con 0x55992154be80 2024-09-19T06:49:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c6cbff740 10 client.27512 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c6cbff740 1 -- 172.21.15.12:0/2827430037 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559921284620 con 0x55992154be80 2024-09-19T06:49:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c42ffd640 1 -- 172.21.15.12:0/2827430037 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c6409c040 con 0x55992154be80 2024-09-19T06:49:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c42ffd640 1 -- 172.21.15.12:0/2827430037 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f4c6406a440 con 0x55992154be80 2024-09-19T06:49:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c6cbff740 10 client.27512 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c6cbff740 10 client.27512 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c6cbff740 20 client.27512 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55992155bd50 0x55992155e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c6cbff740 4 client.27512 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.744+0000 7f4c6cbff740 1 -- 172.21.15.12:0/2827430037 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599214b2a20 con 0x55992155bd50 2024-09-19T06:49:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.745+0000 7f4c62ffd640 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55992155bd50 0x55992155e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.745+0000 7f4c42ffd640 10 client.27512 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.745+0000 7f4c62ffd640 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55992155bd50 0x55992155e140 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b4e684804075a79 server_cookie=e24843ee63aa270a in_seq=0 out_seq=0 2024-09-19T06:49:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.747+0000 7f4c42ffd640 1 -- 172.21.15.12:0/2827430037 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599214b2a20 con 0x55992155bd50 2024-09-19T06:49:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.747+0000 7f4c42ffd640 10 client.27512 handle_command_reply: tid=0 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.747+0000 7f4c6cbff740 1 client.27512 shutdown 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 1 -- 172.21.15.12:0/2827430037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 msgr2=0x559921549850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 0x559921549850 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4c640506f0 tx=0x7f4c64068160 comp rx=0 tx=0).stop 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 1 -- 172.21.15.12:0/2827430037 shutdown_connections 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55992155bd50 0x55992155e140 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 0x559921549850 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x559921549310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/2827430037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 0x559921548dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 1 -- 172.21.15.12:0/2827430037 >> 172.21.15.12:0/2827430037 conn(0x55992153d230 msgr2=0x559921542f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c42ffd640 0 client.27512 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 1 -- 172.21.15.12:0/2827430037 shutdown_connections 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 1 -- 172.21.15.12:0/2827430037 wait complete. 2024-09-19T06:49:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.748+0000 7f4c6cbff740 20 client.27512 trim_cache size 0 max 16384 2024-09-19T06:49:58.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.777+0000 7f4c6cbff740 1 Processor -- start 2024-09-19T06:49:58.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.777+0000 7f4c6cbff740 1 -- start start 2024-09-19T06:49:58.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.777+0000 7f4c6cbff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 0x559921549680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.778+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 0x559921549680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.778+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 0x559921549680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56614/0 (socket says 172.21.15.12:56614) 2024-09-19T06:49:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.778+0000 7f4c63fff640 1 -- 172.21.15.12:0/1674266676 learned_addr learned my addr 172.21.15.12:0/1674266676 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.778+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x55992154ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.778+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 0x559921560d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.778+0000 7f4c6cbff740 1 -- 172.21.15.12:0/1674266676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4800ea60 con 0x559921540cc0 2024-09-19T06:49:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.778+0000 7f4c62ffd640 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x55992154ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.778+0000 7f4c6cbff740 1 -- 172.21.15.12:0/1674266676 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c480105a0 con 0x55992154be80 2024-09-19T06:49:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.778+0000 7f4c6cbff740 1 -- 172.21.15.12:0/1674266676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4800f130 con 0x5599215415e0 2024-09-19T06:49:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.779+0000 7f4c63fff640 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 0x559921560d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.780+0000 7f4c62ffd640 1 -- 172.21.15.12:0/1674266676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 msgr2=0x559921560d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.780+0000 7f4c62ffd640 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 0x559921560d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.780+0000 7f4c62ffd640 1 -- 172.21.15.12:0/1674266676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 msgr2=0x559921549680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.780+0000 7f4c62ffd640 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 0x559921549680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.780+0000 7f4c62ffd640 1 -- 172.21.15.12:0/1674266676 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55992154b960 con 0x5599215415e0 2024-09-19T06:49:58.782 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.782+0000 7f4c62ffd640 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x55992154ad40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x559921548640 tx=0x7f4c50009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffbcd2c50c73d60d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.782+0000 7f4c4d7fa640 1 -- 172.21.15.12:0/1674266676 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50022070 con 0x5599215415e0 2024-09-19T06:49:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.782+0000 7f4c4d7fa640 1 -- 172.21.15.12:0/1674266676 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c50012cd0 con 0x5599215415e0 2024-09-19T06:49:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.782+0000 7f4c4d7fa640 1 -- 172.21.15.12:0/1674266676 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5001dd10 con 0x5599215415e0 2024-09-19T06:49:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.783+0000 7f4c6cbff740 1 -- 172.21.15.12:0/1674266676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 msgr2=0x55992154ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.783+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x55992154ad40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x559921548640 tx=0x7f4c50009bf0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.783+0000 7f4c6cbff740 1 -- 172.21.15.12:0/1674266676 shutdown_connections 2024-09-19T06:49:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.783+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55992154be80 0x559921560d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.783+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x55992154ad40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.783+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/1674266676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559921540cc0 0x559921549680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.783+0000 7f4c6cbff740 1 -- 172.21.15.12:0/1674266676 >> 172.21.15.12:0/1674266676 conn(0x55992153d230 msgr2=0x55992154a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.783+0000 7f4c6cbff740 1 -- 172.21.15.12:0/1674266676 shutdown_connections 2024-09-19T06:49:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.783+0000 7f4c6cbff740 1 -- 172.21.15.12:0/1674266676 wait complete. 2024-09-19T06:49:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.784+0000 7f4c6cbff740 1 -- start start 2024-09-19T06:49:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.784+0000 7f4c6cbff740 1 Processor -- start 2024-09-19T06:49:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.785+0000 7f4c6cbff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x55992155e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.785+0000 7f4c6cbff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x55992155e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.785+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x55992155e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.785+0000 7f4c63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x55992155e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:40364/0 (socket says 172.21.15.12:40364) 2024-09-19T06:49:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.785+0000 7f4c6cbff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55992154be80 0x5599215c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.785+0000 7f4c6cbff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4800fed0 con 0x55992154be80 2024-09-19T06:49:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.785+0000 7f4c6cbff740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4800f800 con 0x559921540cc0 2024-09-19T06:49:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c6cbff740 1 -- 172.21.15.12:0/140603682 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4800ca60 con 0x5599215415e0 2024-09-19T06:49:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c63fff640 1 -- 172.21.15.12:0/140603682 learned_addr learned my addr 172.21.15.12:0/140603682 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c6cbff740 10 client.0 _ll_register_callbacks cb 0x7f4c64050f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c62ffd640 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x55992155e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c63fff640 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55992154be80 0x5599215c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c62ffd640 1 -- 172.21.15.12:0/140603682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 msgr2=0x55992155e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c62ffd640 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x55992155e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c62ffd640 1 -- 172.21.15.12:0/140603682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55992154be80 msgr2=0x5599215c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c62ffd640 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55992154be80 0x5599215c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c62ffd640 1 -- 172.21.15.12:0/140603682 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599215c4cc0 con 0x5599215415e0 2024-09-19T06:49:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c63fff640 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x55992155e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c62ffd640 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x55992155e860 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55992142e3e0 tx=0x7f4c50012a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3c68ca69160a139 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.786+0000 7f4c42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:49:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c42ffd640 1 -- 172.21.15.12:0/140603682 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5002a020 con 0x5599215415e0 2024-09-19T06:49:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c42ffd640 1 -- 172.21.15.12:0/140603682 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f4c5001db90 con 0x5599215415e0 2024-09-19T06:49:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c6cbff740 1 -- 172.21.15.12:0/140603682 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c50012cd0 con 0x5599215415e0 2024-09-19T06:49:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c42ffd640 1 -- 172.21.15.12:0/140603682 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f4c50035050 con 0x5599215415e0 2024-09-19T06:49:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c6cbff740 10 client.27469 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c6cbff740 1 -- 172.21.15.12:0/140603682 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5599215c5fd0 con 0x5599215415e0 2024-09-19T06:49:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c42ffd640 1 -- 172.21.15.12:0/140603682 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c50012e80 con 0x5599215415e0 2024-09-19T06:49:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c42ffd640 1 -- 172.21.15.12:0/140603682 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f4c50026ac0 con 0x5599215415e0 2024-09-19T06:49:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c6cbff740 10 client.27469 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c6cbff740 10 client.27469 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c6cbff740 20 client.27469 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5599215c6640 0x5599215c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c6cbff740 4 client.27469 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:49:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.787+0000 7f4c6cbff740 1 -- 172.21.15.12:0/140603682 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f4c50012cd0 con 0x5599215c6640 2024-09-19T06:49:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.788+0000 7f4c63fff640 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5599215c6640 0x5599215c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.788+0000 7f4c63fff640 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5599215c6640 0x5599215c8a60 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=992668f1ecd09497 server_cookie=2af49b4016274fdc in_seq=0 out_seq=0 2024-09-19T06:49:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.788+0000 7f4c42ffd640 10 client.27469 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.797+0000 7f4c42ffd640 1 -- 172.21.15.12:0/140603682 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f4c50012cd0 con 0x5599215c6640 2024-09-19T06:49:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.797+0000 7f4c42ffd640 10 client.27469 handle_command_reply: tid=0 2024-09-19T06:49:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.797+0000 7f4c6cbff740 1 client.27469 shutdown 2024-09-19T06:49:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c6cbff740 1 -- 172.21.15.12:0/140603682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 msgr2=0x55992155e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x55992155e860 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55992142e3e0 tx=0x7f4c50012a20 comp rx=0 tx=0).stop 2024-09-19T06:49:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c6cbff740 1 -- 172.21.15.12:0/140603682 shutdown_connections 2024-09-19T06:49:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5599215c6640 0x5599215c8a60 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c42ffd640 0 client.27469 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55992154be80 0x5599215c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5599215415e0 0x55992155e860 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c6cbff740 1 --2- 172.21.15.12:0/140603682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559921540cc0 0x55992155e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c6cbff740 1 -- 172.21.15.12:0/140603682 >> 172.21.15.12:0/140603682 conn(0x55992153d230 msgr2=0x559921556ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c6cbff740 1 -- 172.21.15.12:0/140603682 shutdown_connections 2024-09-19T06:49:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.798+0000 7f4c6cbff740 1 -- 172.21.15.12:0/140603682 wait complete. 2024-09-19T06:49:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c6cbff740 20 client.27469 trim_cache size 0 max 16384 2024-09-19T06:49:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:49:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:49:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:49:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:49:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 -- 172.21.15.12:0/3314990162 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a35d0 msgr2=0x7f4c540a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a35d0 0x7f4c540a5a90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55992153e090 tx=0x7f4c58096e30 comp rx=0 tx=0).stop 2024-09-19T06:49:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 -- 172.21.15.12:0/3314990162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0a4850 msgr2=0x7f4c5c0b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0a4850 0x7f4c5c0b5600 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800b4a0 tx=0x7f4c5800b960 comp rx=0 tx=0).stop 2024-09-19T06:49:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 -- 172.21.15.12:0/3314990162 shutdown_connections 2024-09-19T06:49:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c540a35d0 0x7f4c540a5a90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5c0b7570 0x7f4c5c0aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c5c0a5170 0x7f4c5c0ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 --2- 172.21.15.12:0/3314990162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c5c0a4850 0x7f4c5c0b5600 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 -- 172.21.15.12:0/3314990162 >> 172.21.15.12:0/3314990162 conn(0x7f4c5c01a140 msgr2=0x7f4c5c0a1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 -- 172.21.15.12:0/3314990162 shutdown_connections 2024-09-19T06:49:58.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:49:58.799+0000 7f4c69d8f640 1 -- 172.21.15.12:0/3314990162 wait complete. 2024-09-19T06:49:59.294 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T06:49:59.295 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T06:49:59.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:49:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.366+0000 7f2325ae2640 1 -- 172.21.15.12:0/3284313437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23200ffd90 msgr2=0x7f2320100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.366+0000 7f2325ae2640 1 --2- 172.21.15.12:0/3284313437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23200ffd90 0x7f2320100170 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2310009900 tx=0x7f231002a420 comp rx=0 tx=0).stop 2024-09-19T06:49:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.366+0000 7f2325ae2640 1 -- 172.21.15.12:0/3284313437 shutdown_connections 2024-09-19T06:49:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.366+0000 7f2325ae2640 1 --2- 172.21.15.12:0/3284313437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320104f30 0x7f23201053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.366+0000 7f2325ae2640 1 --2- 172.21.15.12:0/3284313437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23201006b0 0x7f23201049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.366+0000 7f2325ae2640 1 --2- 172.21.15.12:0/3284313437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23200ffd90 0x7f2320100170 secure :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2310009900 tx=0x7f231002a420 comp rx=0 tx=0).stop 2024-09-19T06:49:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.366+0000 7f2325ae2640 1 -- 172.21.15.12:0/3284313437 >> 172.21.15.12:0/3284313437 conn(0x7f23200fba90 msgr2=0x7f23200fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.369+0000 7f2325ae2640 1 -- 172.21.15.12:0/3284313437 shutdown_connections 2024-09-19T06:49:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.369+0000 7f2325ae2640 1 -- 172.21.15.12:0/3284313437 wait complete. 2024-09-19T06:49:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.369+0000 7f2325ae2640 1 Processor -- start 2024-09-19T06:49:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.370+0000 7f2325ae2640 1 -- start start 2024-09-19T06:49:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.370+0000 7f2325ae2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23201006b0 0x7f2320118070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.370+0000 7f2325ae2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320104f30 0x7f2320111100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.370+0000 7f2325ae2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2320111640 0x7f2320111af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.370+0000 7f2325ae2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2320109db0 con 0x7f23201006b0 2024-09-19T06:49:59.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.370+0000 7f2325ae2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2320109c30 con 0x7f2320104f30 2024-09-19T06:49:59.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.370+0000 7f2325ae2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23201187d0 con 0x7f2320111640 2024-09-19T06:49:59.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.371+0000 7f231ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2320111640 0x7f2320111af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.371+0000 7f231ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2320111640 0x7f2320111af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58514/0 (socket says 172.21.15.12:58514) 2024-09-19T06:49:59.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.371+0000 7f231f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23201006b0 0x7f2320118070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.371+0000 7f231ffff640 1 -- 172.21.15.12:0/3193406970 learned_addr learned my addr 172.21.15.12:0/3193406970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:59.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.371+0000 7f231effd640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320104f30 0x7f2320111100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.372+0000 7f231ffff640 1 -- 172.21.15.12:0/3193406970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320104f30 msgr2=0x7f2320111100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:59.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.372+0000 7f231ffff640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320104f30 0x7f2320111100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.372+0000 7f231ffff640 1 -- 172.21.15.12:0/3193406970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23201006b0 msgr2=0x7f2320118070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:59.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.372+0000 7f231ffff640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23201006b0 0x7f2320118070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.372+0000 7f231ffff640 1 -- 172.21.15.12:0/3193406970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2320115d90 con 0x7f2320111640 2024-09-19T06:49:59.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.372+0000 7f231ffff640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2320111640 0x7f2320111af0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f231400c970 tx=0x7f231400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.373+0000 7f231cff9640 1 -- 172.21.15.12:0/3193406970 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314007bb0 con 0x7f2320111640 2024-09-19T06:49:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.373+0000 7f231cff9640 1 -- 172.21.15.12:0/3193406970 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2314007d50 con 0x7f2320111640 2024-09-19T06:49:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.374+0000 7f231cff9640 1 -- 172.21.15.12:0/3193406970 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231400f450 con 0x7f2320111640 2024-09-19T06:49:59.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.374+0000 7f2325ae2640 1 -- 172.21.15.12:0/3193406970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2320116080 con 0x7f2320111640 2024-09-19T06:49:59.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.374+0000 7f2325ae2640 1 -- 172.21.15.12:0/3193406970 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2320116540 con 0x7f2320111640 2024-09-19T06:49:59.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.380+0000 7f2327ebb740 1 Processor -- start 2024-09-19T06:49:59.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.383+0000 7f231cff9640 1 -- 172.21.15.12:0/3193406970 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2314004ec0 con 0x7f2320111640 2024-09-19T06:49:59.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.384+0000 7f2327ebb740 1 -- start start 2024-09-19T06:49:59.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.384+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x55838799c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.384+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55838799cdc0 0x5583879a7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.384+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5583879a7680 0x5583879a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.384+0000 7f2327ebb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5583879022e0 con 0x55838799cdc0 2024-09-19T06:49:59.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.384+0000 7f2327ebb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5583878a9ce0 con 0x5583879a7680 2024-09-19T06:49:59.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.384+0000 7f2327ebb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5583878fe2a0 con 0x55838799c4a0 2024-09-19T06:49:59.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.384+0000 7f231effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x55838799c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.385+0000 7f231effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x55838799c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58524/0 (socket says 172.21.15.12:58524) 2024-09-19T06:49:59.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.385+0000 7f231effd640 1 -- 172.21.15.12:0/4225035418 learned_addr learned my addr 172.21.15.12:0/4225035418 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:59.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.385+0000 7f231cff9640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f23080a34b0 0x7f23080a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.385+0000 7f231cff9640 1 -- 172.21.15.12:0/3193406970 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f23140cfbd0 con 0x7f2320111640 2024-09-19T06:49:59.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.386+0000 7f231effd640 1 --2- 172.21.15.12:0/4225035418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5583879a7680 0x5583879a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.386+0000 7f231effd640 1 -- 172.21.15.12:0/4225035418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5583879a7680 msgr2=0x5583879a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:59.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.386+0000 7f231effd640 1 --2- 172.21.15.12:0/4225035418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5583879a7680 0x5583879a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.386+0000 7f231effd640 1 -- 172.21.15.12:0/4225035418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55838799cdc0 msgr2=0x5583879a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:59.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.386+0000 7f231effd640 1 --2- 172.21.15.12:0/4225035418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55838799cdc0 0x5583879a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.386+0000 7f231effd640 1 -- 172.21.15.12:0/4225035418 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55838788e440 con 0x55838799c4a0 2024-09-19T06:49:59.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.387+0000 7f231effd640 1 --2- 172.21.15.12:0/4225035418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x55838799c880 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f231800a740 tx=0x7f23180096d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c6e11182a91f067 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:59.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.387+0000 7f2305ffb640 1 -- 172.21.15.12:0/4225035418 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231800e640 con 0x55838799c4a0 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.387+0000 7f231ffff640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f23080a34b0 0x7f23080a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.387+0000 7f2305ffb640 1 -- 172.21.15.12:0/4225035418 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f231800ecc0 con 0x55838799c4a0 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.387+0000 7f2305ffb640 1 -- 172.21.15.12:0/4225035418 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231800e640 con 0x55838799c4a0 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.388+0000 7f2327ebb740 1 -- 172.21.15.12:0/4225035418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 msgr2=0x55838799c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.388+0000 7f231ffff640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f23080a34b0 0x7f23080a5970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f231400c940 tx=0x7f231409bd10 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.388+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4225035418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x55838799c880 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f231800a740 tx=0x7f23180096d0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.389+0000 7f2327ebb740 1 -- 172.21.15.12:0/4225035418 shutdown_connections 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.389+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4225035418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5583879a7680 0x5583879a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.389+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4225035418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55838799cdc0 0x5583879a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.389+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4225035418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x55838799c880 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.389+0000 7f2327ebb740 1 -- 172.21.15.12:0/4225035418 >> 172.21.15.12:0/4225035418 conn(0x558387998a30 msgr2=0x558387998e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:59.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.389+0000 7f2327ebb740 1 -- 172.21.15.12:0/4225035418 shutdown_connections 2024-09-19T06:49:59.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.389+0000 7f2327ebb740 1 -- 172.21.15.12:0/4225035418 wait complete. 2024-09-19T06:49:59.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.389+0000 7f2327ebb740 1 -- start start 2024-09-19T06:49:59.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.390+0000 7f2327ebb740 1 Processor -- start 2024-09-19T06:49:59.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.391+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.391+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x5583879a4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.391+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583879a7680 0x5583879a4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.391+0000 7f2327ebb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5583879aa250 con 0x5583879a7680 2024-09-19T06:49:59.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.391+0000 7f2327ebb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5583878bd050 con 0x55838799cdc0 2024-09-19T06:49:59.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.391+0000 7f2327ebb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5583879aa3d0 con 0x55838799c4a0 2024-09-19T06:49:59.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.391+0000 7f2327ebb740 10 client.0 _ll_register_callbacks cb 0x5583878fd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.392+0000 7f231effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.392+0000 7f231effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58540/0 (socket says 172.21.15.12:58540) 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.392+0000 7f231effd640 1 -- 172.21.15.12:0/4277053741 learned_addr learned my addr 172.21.15.12:0/4277053741 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.392+0000 7f231effd640 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583879a7680 0x5583879a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.392+0000 7f231effd640 1 -- 172.21.15.12:0/4277053741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 msgr2=0x5583879a4320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.392+0000 7f231effd640 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x5583879a4320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.392+0000 7f231effd640 1 -- 172.21.15.12:0/4277053741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583879a7680 msgr2=0x5583879a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.392+0000 7f231effd640 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583879a7680 0x5583879a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.392+0000 7f231effd640 1 -- 172.21.15.12:0/4277053741 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583876733c0 con 0x55838799c4a0 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.393+0000 7f231effd640 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a7070 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f231800e090 tx=0x7f2318019740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2c1cbe4f75e7775 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:59.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.393+0000 7f22feffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:49:59.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.393+0000 7f22feffd640 1 -- 172.21.15.12:0/4277053741 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231802d060 con 0x55838799c4a0 2024-09-19T06:49:59.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.394+0000 7f22feffd640 1 -- 172.21.15.12:0/4277053741 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f231800ea70 con 0x55838799c4a0 2024-09-19T06:49:59.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.394+0000 7f2327ebb740 1 -- 172.21.15.12:0/4277053741 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f231800ecc0 con 0x55838799c4a0 2024-09-19T06:49:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.394+0000 7f22feffd640 1 -- 172.21.15.12:0/4277053741 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f231801f040 con 0x55838799c4a0 2024-09-19T06:49:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.394+0000 7f2327ebb740 10 client.27481 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.395+0000 7f2327ebb740 1 -- 172.21.15.12:0/4277053741 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5583879b5cb0 con 0x55838799c4a0 2024-09-19T06:49:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.395+0000 7f22feffd640 1 -- 172.21.15.12:0/4277053741 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f231800ecc0 con 0x55838799c4a0 2024-09-19T06:49:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.396+0000 7f22feffd640 1 -- 172.21.15.12:0/4277053741 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f2318025070 con 0x55838799c4a0 2024-09-19T06:49:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.396+0000 7f2327ebb740 10 client.27481 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.396+0000 7f2327ebb740 10 client.27481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.396+0000 7f2327ebb740 20 client.27481 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.396+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5583879b73f0 0x5583879b9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.396+0000 7f2327ebb740 4 client.27481 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:49:59.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.396+0000 7f2327ebb740 1 -- 172.21.15.12:0/4277053741 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55838790f850 con 0x5583879b73f0 2024-09-19T06:49:59.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.396+0000 7f231f7fe640 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5583879b73f0 0x5583879b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.401+0000 7f231f7fe640 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5583879b73f0 0x5583879b9840 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c69a5143e0346437 server_cookie=7d85efb1d2612874 in_seq=0 out_seq=0 2024-09-19T06:49:59.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.401+0000 7f22feffd640 10 client.27481 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:59.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.401+0000 7f22feffd640 1 -- 172.21.15.12:0/4277053741 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55838790f850 con 0x5583879b73f0 2024-09-19T06:49:59.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.401+0000 7f22feffd640 10 client.27481 handle_command_reply: tid=0 2024-09-19T06:49:59.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 client.27481 shutdown 2024-09-19T06:49:59.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 -- 172.21.15.12:0/4277053741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 msgr2=0x5583879a7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:59.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a7070 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f231800e090 tx=0x7f2318019740 comp rx=0 tx=0).stop 2024-09-19T06:49:59.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 -- 172.21.15.12:0/4277053741 shutdown_connections 2024-09-19T06:49:59.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5583879b73f0 0x5583879b9840 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583879a7680 0x5583879a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x5583879a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4277053741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a7070 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 -- 172.21.15.12:0/4277053741 >> 172.21.15.12:0/4277053741 conn(0x558387998a30 msgr2=0x55838799e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:59.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f22feffd640 0 client.27481 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:59.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 -- 172.21.15.12:0/4277053741 shutdown_connections 2024-09-19T06:49:59.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.402+0000 7f2327ebb740 1 -- 172.21.15.12:0/4277053741 wait complete. 2024-09-19T06:49:59.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.403+0000 7f2327ebb740 20 client.27481 trim_cache size 0 max 16384 2024-09-19T06:49:59.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.429+0000 7f2327ebb740 1 Processor -- start 2024-09-19T06:49:59.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.429+0000 7f2327ebb740 1 -- start start 2024-09-19T06:49:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.430+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.430+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x558387997a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.430+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583879a7680 0x5583879bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.430+0000 7f2327ebb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23201bcd70 con 0x5583879a7680 2024-09-19T06:49:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.430+0000 7f2327ebb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f23201be8b0 con 0x55838799cdc0 2024-09-19T06:49:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.430+0000 7f2327ebb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23201bd440 con 0x55838799c4a0 2024-09-19T06:49:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.430+0000 7f231effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.430+0000 7f231effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58548/0 (socket says 172.21.15.12:58548) 2024-09-19T06:49:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.430+0000 7f231effd640 1 -- 172.21.15.12:0/4131956205 learned_addr learned my addr 172.21.15.12:0/4131956205 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:59.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f231effd640 1 --2- 172.21.15.12:0/4131956205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583879a7680 0x5583879bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f231f7fe640 1 --2- 172.21.15.12:0/4131956205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x558387997a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f231effd640 1 -- 172.21.15.12:0/4131956205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 msgr2=0x558387997a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f231effd640 1 --2- 172.21.15.12:0/4131956205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x558387997a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f231effd640 1 -- 172.21.15.12:0/4131956205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583879a7680 msgr2=0x5583879bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f231effd640 1 --2- 172.21.15.12:0/4131956205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583879a7680 0x5583879bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f231effd640 1 -- 172.21.15.12:0/4131956205 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583879a32d0 con 0x55838799c4a0 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f231f7fe640 1 --2- 172.21.15.12:0/4131956205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x558387997a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f231effd640 1 --2- 172.21.15.12:0/4131956205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a2bf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f23180198d0 tx=0x7f2318000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c928d0f008d3b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f23057fa640 1 -- 172.21.15.12:0/4131956205 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231802d030 con 0x55838799c4a0 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f23057fa640 1 -- 172.21.15.12:0/4131956205 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f231800ed30 con 0x55838799c4a0 2024-09-19T06:49:59.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.431+0000 7f23057fa640 1 -- 172.21.15.12:0/4131956205 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318027800 con 0x55838799c4a0 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.433+0000 7f2327ebb740 1 -- 172.21.15.12:0/4131956205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 msgr2=0x5583879a2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.433+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4131956205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a2bf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f23180198d0 tx=0x7f2318000f40 comp rx=0 tx=0).stop 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.433+0000 7f2327ebb740 1 -- 172.21.15.12:0/4131956205 shutdown_connections 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.433+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4131956205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583879a7680 0x5583879bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.433+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4131956205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x558387997a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.433+0000 7f2327ebb740 1 --2- 172.21.15.12:0/4131956205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55838799c4a0 0x5583879a2bf0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.433+0000 7f2327ebb740 1 -- 172.21.15.12:0/4131956205 >> 172.21.15.12:0/4131956205 conn(0x558387998a30 msgr2=0x558387997350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.433+0000 7f2327ebb740 1 -- 172.21.15.12:0/4131956205 shutdown_connections 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.433+0000 7f2327ebb740 1 -- 172.21.15.12:0/4131956205 wait complete. 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.434+0000 7f2327ebb740 1 -- start start 2024-09-19T06:49:59.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.434+0000 7f2327ebb740 1 Processor -- start 2024-09-19T06:49:59.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.435+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55838799c4a0 0x5583879aca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.435+0000 7f2327ebb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x5583879acf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.435+0000 7f231effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55838799c4a0 0x5583879aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.435+0000 7f231effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55838799c4a0 0x5583879aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56670/0 (socket says 172.21.15.12:56670) 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.435+0000 7f231effd640 1 -- 172.21.15.12:0/3237391522 learned_addr learned my addr 172.21.15.12:0/3237391522 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.435+0000 7f231f7fe640 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x5583879acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.435+0000 7f2327ebb740 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583879a7680 0x558387a200b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.435+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23201be1e0 con 0x55838799c4a0 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.435+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f23201bdb10 con 0x55838799cdc0 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.436+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23201bad70 con 0x5583879a7680 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.436+0000 7f2327ebb740 10 client.0 _ll_register_callbacks cb 0x7f231800a620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.436+0000 7f231f7fe640 1 -- 172.21.15.12:0/3237391522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583879a7680 msgr2=0x558387a200b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.436+0000 7f231f7fe640 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583879a7680 0x558387a200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.436+0000 7f231f7fe640 1 -- 172.21.15.12:0/3237391522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55838799c4a0 msgr2=0x5583879aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:49:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.436+0000 7f231f7fe640 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55838799c4a0 0x5583879aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.436+0000 7f231f7fe640 1 -- 172.21.15.12:0/3237391522 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55838799cbf0 con 0x55838799cdc0 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.436+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558387909d60 con 0x55838799cdc0 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.436+0000 7f231f7fe640 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x5583879acf50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2310008000 tx=0x7f2310004310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=590a165f665eb809 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.436+0000 7f22feffd640 10 client.27530 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.437+0000 7f22feffd640 1 -- 172.21.15.12:0/3237391522 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310000e60 con 0x55838799cdc0 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.437+0000 7f22feffd640 1 -- 172.21.15.12:0/3237391522 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f23100035f0 con 0x55838799cdc0 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.437+0000 7f22feffd640 1 -- 172.21.15.12:0/3237391522 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2310035040 con 0x55838799cdc0 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.437+0000 7f2327ebb740 10 client.27530 fetch_fsmap learned FSMap version 44 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.437+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=44}) -- 0x558387a214f0 con 0x55838799cdc0 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.438+0000 7f22feffd640 1 -- 172.21.15.12:0/3237391522 <== mon.2 v2:172.21.15.16:3300/0 4 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f2310003830 con 0x55838799cdc0 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.438+0000 7f2327ebb740 10 client.27530 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.438+0000 7f2327ebb740 10 client.27530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:49:59.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.438+0000 7f2327ebb740 20 client.27530 populate_metadata read hostname 'smithi012' 2024-09-19T06:49:59.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.438+0000 7f2327ebb740 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558387a21bb0 0x558387a23fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:59.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.438+0000 7f2327ebb740 4 client.27530 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:49:59.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.438+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558387886210 con 0x558387a21bb0 2024-09-19T06:49:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.440+0000 7f231effd640 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558387a21bb0 0x558387a23fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.441+0000 7f22feffd640 10 client.27530 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.441+0000 7f231effd640 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558387a21bb0 0x558387a23fd0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f24ed74b62f9a902 server_cookie=636699d53c6224c6 in_seq=0 out_seq=0 2024-09-19T06:49:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.441+0000 7f22feffd640 1 -- 172.21.15.12:0/3237391522 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558387886210 con 0x558387a21bb0 2024-09-19T06:49:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f22feffd640 10 client.27530 handle_command_reply: tid=0 2024-09-19T06:49:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f2327ebb740 1 client.27530 shutdown 2024-09-19T06:49:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 msgr2=0x5583879acf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f2327ebb740 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x5583879acf50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2310008000 tx=0x7f2310004310 comp rx=0 tx=0).stop 2024-09-19T06:49:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 shutdown_connections 2024-09-19T06:49:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f2327ebb740 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558387a21bb0 0x558387a23fd0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f2327ebb740 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5583879a7680 0x558387a200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f22feffd640 0 client.27530 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:49:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f2327ebb740 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55838799cdc0 0x5583879acf50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f2327ebb740 1 --2- 172.21.15.12:0/3237391522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55838799c4a0 0x5583879aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.442+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 >> 172.21.15.12:0/3237391522 conn(0x558387998a30 msgr2=0x558387997350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.443+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 shutdown_connections 2024-09-19T06:49:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.443+0000 7f2327ebb740 1 -- 172.21.15.12:0/3237391522 wait complete. 2024-09-19T06:49:59.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.443+0000 7f2327ebb740 20 client.27530 trim_cache size 0 max 16384 2024-09-19T06:49:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:49:59.445 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:49:59.445 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:49:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:49:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 -- 172.21.15.12:0/3193406970 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f23080a34b0 msgr2=0x7f23080a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f23080a34b0 0x7f23080a5970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f231400c940 tx=0x7f231409bd10 comp rx=0 tx=0).stop 2024-09-19T06:49:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 -- 172.21.15.12:0/3193406970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2320111640 msgr2=0x7f2320111af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2320111640 0x7f2320111af0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f231400c970 tx=0x7f231400ce30 comp rx=0 tx=0).stop 2024-09-19T06:49:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 -- 172.21.15.12:0/3193406970 shutdown_connections 2024-09-19T06:49:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f23080a34b0 0x7f23080a5970 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2320111640 0x7f2320111af0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2320104f30 0x7f2320111100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 --2- 172.21.15.12:0/3193406970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23201006b0 0x7f2320118070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:59.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 -- 172.21.15.12:0/3193406970 >> 172.21.15.12:0/3193406970 conn(0x7f23200fba90 msgr2=0x7f23200fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:59.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 -- 172.21.15.12:0/3193406970 shutdown_connections 2024-09-19T06:49:59.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:49:59.444+0000 7f2325ae2640 1 -- 172.21.15.12:0/3193406970 wait complete. 2024-09-19T06:50:00.257 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:49:59 smithi012 ceph-mon[30937]: pgmap v304: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.2 MiB/s wr, 553 op/s 2024-09-19T06:50:00.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:49:59 smithi016 ceph-mon[34911]: pgmap v304: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.2 MiB/s wr, 553 op/s 2024-09-19T06:50:00.290 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:50:00.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:50:00.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:49:59 smithi173 ceph-mon[35349]: pgmap v304: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.2 MiB/s wr, 553 op/s 2024-09-19T06:50:00.387 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:00.809 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 555.0 s, 2374.8 tps, lat 37.687 ms stddev 44.568 2024-09-19T06:50:01.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.001+0000 7f77aa09c640 1 -- 172.21.15.12:0/4290551823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77a4109e00 msgr2=0x7f77a40742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:01.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.001+0000 7f77aa09c640 1 --2- 172.21.15.12:0/4290551823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77a4109e00 0x7f77a40742d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f779c00afd0 tx=0x7f779c02b430 comp rx=0 tx=0).stop 2024-09-19T06:50:01.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.002+0000 7f77aa09c640 1 -- 172.21.15.12:0/4290551823 shutdown_connections 2024-09-19T06:50:01.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.002+0000 7f77aa09c640 1 --2- 172.21.15.12:0/4290551823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77a4074990 0x7f77a407b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:01.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.002+0000 7f77aa09c640 1 --2- 172.21.15.12:0/4290551823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77a4109e00 0x7f77a40742d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:01.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.002+0000 7f77aa09c640 1 --2- 172.21.15.12:0/4290551823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77a4109450 0x7f77a4109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:01.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.002+0000 7f77aa09c640 1 -- 172.21.15.12:0/4290551823 >> 172.21.15.12:0/4290551823 conn(0x7f77a406e140 msgr2=0x7f77a406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:01.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.002+0000 7f77aa09c640 1 -- 172.21.15.12:0/4290551823 shutdown_connections 2024-09-19T06:50:01.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.002+0000 7f77aa09c640 1 -- 172.21.15.12:0/4290551823 wait complete. 2024-09-19T06:50:01.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.003+0000 7f77aa09c640 1 Processor -- start 2024-09-19T06:50:01.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.003+0000 7f77aa09c640 1 -- start start 2024-09-19T06:50:01.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.003+0000 7f77aa09c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77a4074990 0x7f77a4084c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:01.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.004+0000 7f77aa09c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77a4109450 0x7f77a4079480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:01.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.004+0000 7f77aa09c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77a40799c0 0x7f77a4079e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:01.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.004+0000 7f77aa09c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f77a407e7c0 con 0x7f77a4109450 2024-09-19T06:50:01.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.004+0000 7f77aa09c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f77a407e640 con 0x7f77a4074990 2024-09-19T06:50:01.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.004+0000 7f77aa09c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f77a407e940 con 0x7f77a40799c0 2024-09-19T06:50:01.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.004+0000 7f77a37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77a4074990 0x7f77a4084c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:01.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.004+0000 7f77a37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77a4074990 0x7f77a4084c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47874/0 (socket says 172.21.15.12:47874) 2024-09-19T06:50:01.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.004+0000 7f77a37fe640 1 -- 172.21.15.12:0/2745176338 learned_addr learned my addr 172.21.15.12:0/2745176338 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:01.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.004+0000 7f77a3fff640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77a40799c0 0x7f77a4079e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:01.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.005+0000 7f77a3fff640 1 -- 172.21.15.12:0/2745176338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77a4074990 msgr2=0x7f77a4084c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:01.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.005+0000 7f77a3fff640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77a4074990 0x7f77a4084c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.005+0000 7f77a3fff640 1 -- 172.21.15.12:0/2745176338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77a4109450 msgr2=0x7f77a4079480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.005+0000 7f77a3fff640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77a4109450 0x7f77a4079480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.005+0000 7f77a3fff640 1 -- 172.21.15.12:0/2745176338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a41b7f80 con 0x7f77a40799c0 2024-09-19T06:50:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.007+0000 7f77a3fff640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77a40799c0 0x7f77a4079e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f779800d680 tx=0x7f779800db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.007+0000 7f77a0ff9640 1 -- 172.21.15.12:0/2745176338 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798017070 con 0x7f77a40799c0 2024-09-19T06:50:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.007+0000 7f77aa09c640 1 -- 172.21.15.12:0/2745176338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a41b8270 con 0x7f77a40799c0 2024-09-19T06:50:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.007+0000 7f77aa09c640 1 -- 172.21.15.12:0/2745176338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a41b87b0 con 0x7f77a40799c0 2024-09-19T06:50:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.008+0000 7f77a0ff9640 1 -- 172.21.15.12:0/2745176338 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7798009820 con 0x7f77a40799c0 2024-09-19T06:50:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.008+0000 7f77a0ff9640 1 -- 172.21.15.12:0/2745176338 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798004d00 con 0x7f77a40799c0 2024-09-19T06:50:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.010+0000 7f77aa09c640 1 -- 172.21.15.12:0/2745176338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7790005290 con 0x7f77a40799c0 2024-09-19T06:50:01.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.013+0000 7f77a0ff9640 1 -- 172.21.15.12:0/2745176338 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7798005220 con 0x7f77a40799c0 2024-09-19T06:50:01.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.014+0000 7f77a0ff9640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f778c0a34f0 0x7f778c0a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:01.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.014+0000 7f77a0ff9640 1 -- 172.21.15.12:0/2745176338 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f77980cfb00 con 0x7f77a40799c0 2024-09-19T06:50:01.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.016+0000 7f77a37fe640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f778c0a34f0 0x7f778c0a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:01.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.024+0000 7f77a0ff9640 1 -- 172.21.15.12:0/2745176338 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f779809c460 con 0x7f77a40799c0 2024-09-19T06:50:01.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.024+0000 7f77a37fe640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f778c0a34f0 0x7f778c0a59b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7794009950 tx=0x7f7794008040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:01.107 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:01.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:00 smithi012 ceph-mon[30937]: overall HEALTH_OK 2024-09-19T06:50:01.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:00 smithi016 ceph-mon[34911]: overall HEALTH_OK 2024-09-19T06:50:01.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:00 smithi173 ceph-mon[35349]: overall HEALTH_OK 2024-09-19T06:50:01.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.489+0000 7f77aa09c640 1 -- 172.21.15.12:0/2745176338 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7790005580 con 0x7f77a40799c0 2024-09-19T06:50:01.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.490+0000 7f77a0ff9640 1 -- 172.21.15.12:0/2745176338 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11971 (secure 0 0 0) 0x7f779809bd60 con 0x7f77a40799c0 2024-09-19T06:50:01.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:50:01.492 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"btime":"2024-09-19T06:48:35:302779+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:48:34.412947+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:50:01.492 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 44 2024-09-19T06:50:01.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.493+0000 7f77aa09c640 1 -- 172.21.15.12:0/2745176338 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f778c0a34f0 msgr2=0x7f778c0a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.493+0000 7f77aa09c640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f778c0a34f0 0x7f778c0a59b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7794009950 tx=0x7f7794008040 comp rx=0 tx=0).stop 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.493+0000 7f77aa09c640 1 -- 172.21.15.12:0/2745176338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77a40799c0 msgr2=0x7f77a4079e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.493+0000 7f77aa09c640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77a40799c0 0x7f77a4079e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f779800d680 tx=0x7f779800db40 comp rx=0 tx=0).stop 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.493+0000 7f77aa09c640 1 -- 172.21.15.12:0/2745176338 shutdown_connections 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.493+0000 7f77aa09c640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f778c0a34f0 0x7f778c0a59b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.493+0000 7f77aa09c640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77a40799c0 0x7f77a4079e40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.493+0000 7f77aa09c640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77a4109450 0x7f77a4079480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.493+0000 7f77aa09c640 1 --2- 172.21.15.12:0/2745176338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77a4074990 0x7f77a4084c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.493+0000 7f77aa09c640 1 -- 172.21.15.12:0/2745176338 >> 172.21.15.12:0/2745176338 conn(0x7f77a406e140 msgr2=0x7f77a410c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.494+0000 7f77aa09c640 1 -- 172.21.15.12:0/2745176338 shutdown_connections 2024-09-19T06:50:01.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:01.494+0000 7f77aa09c640 1 -- 172.21.15.12:0/2745176338 wait complete. 2024-09-19T06:50:02.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.010+0000 7f75ea546640 1 -- 172.21.15.12:0/3697989286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e4102d90 msgr2=0x7f75e4103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:02.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.010+0000 7f75ea546640 1 --2- 172.21.15.12:0/3697989286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e4102d90 0x7f75e4103170 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009900 tx=0x7f75d402a4d0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.010+0000 7f75ea546640 1 -- 172.21.15.12:0/3697989286 shutdown_connections 2024-09-19T06:50:02.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.010+0000 7f75ea546640 1 --2- 172.21.15.12:0/3697989286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75e410c170 0x7f75e410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.010+0000 7f75ea546640 1 --2- 172.21.15.12:0/3697989286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75e41036b0 0x7f75e410bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.010+0000 7f75ea546640 1 --2- 172.21.15.12:0/3697989286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e4102d90 0x7f75e4103170 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.010+0000 7f75ea546640 1 -- 172.21.15.12:0/3697989286 >> 172.21.15.12:0/3697989286 conn(0x7f75e40fc7d0 msgr2=0x7f75e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:02.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.010+0000 7f75ea546640 1 -- 172.21.15.12:0/3697989286 shutdown_connections 2024-09-19T06:50:02.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.010+0000 7f75ea546640 1 -- 172.21.15.12:0/3697989286 wait complete. 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75ea546640 1 Processor -- start 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75ea546640 1 -- start start 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75ea546640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75e4102d90 0x7f75e410bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75ea546640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75e41036b0 0x7f75e4108b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75ea546640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e410c170 0x7f75e4109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75ea546640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f75e41142c0 con 0x7f75e410c170 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75ea546640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f75e4114140 con 0x7f75e4102d90 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75ea546640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f75e4114440 con 0x7f75e41036b0 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75e4102d90 0x7f75e410bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75e37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75e41036b0 0x7f75e4108b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75e4102d90 0x7f75e410bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47890/0 (socket says 172.21.15.12:47890) 2024-09-19T06:50:02.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.011+0000 7f75e3fff640 1 -- 172.21.15.12:0/3457775810 learned_addr learned my addr 172.21.15.12:0/3457775810 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e8ae3640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e410c170 0x7f75e4109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e3fff640 1 -- 172.21.15.12:0/3457775810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75e41036b0 msgr2=0x7f75e4108b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e3fff640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75e41036b0 0x7f75e4108b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e3fff640 1 -- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e410c170 msgr2=0x7f75e4109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e3fff640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e410c170 0x7f75e4109100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e3fff640 1 -- 172.21.15.12:0/3457775810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e41ab000 con 0x7f75e4102d90 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e8ae3640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e410c170 0x7f75e4109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e3fff640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75e4102d90 0x7f75e410bab0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009a20 tx=0x7f75d4003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e17fa640 1 -- 172.21.15.12:0/3457775810 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d403f070 con 0x7f75e4102d90 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e17fa640 1 -- 172.21.15.12:0/3457775810 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d4031ca0 con 0x7f75e4102d90 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75e17fa640 1 -- 172.21.15.12:0/3457775810 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d4035030 con 0x7f75e4102d90 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.012+0000 7f75ea546640 1 -- 172.21.15.12:0/3457775810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e41ab1d0 con 0x7f75e4102d90 2024-09-19T06:50:02.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.013+0000 7f75ea546640 1 -- 172.21.15.12:0/3457775810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e41ab570 con 0x7f75e4102d90 2024-09-19T06:50:02.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.014+0000 7f75ea546640 1 -- 172.21.15.12:0/3457775810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e406b030 con 0x7f75e4102d90 2024-09-19T06:50:02.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.015+0000 7f75e17fa640 1 -- 172.21.15.12:0/3457775810 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f75d4042070 con 0x7f75e4102d90 2024-09-19T06:50:02.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.016+0000 7f75e17fa640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75cc0a3430 0x7f75cc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:02.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.016+0000 7f75e37fe640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75cc0a3430 0x7f75cc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:02.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.016+0000 7f75e17fa640 1 -- 172.21.15.12:0/3457775810 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f75d40f0610 con 0x7f75e4102d90 2024-09-19T06:50:02.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.017+0000 7f75e37fe640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75cc0a3430 0x7f75cc0a58f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f75e410a320 tx=0x7f75d80090e0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:02.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.020+0000 7f75e17fa640 1 -- 172.21.15.12:0/3457775810 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f75d40bcef0 con 0x7f75e4102d90 2024-09-19T06:50:02.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:01 smithi016 ceph-mon[34911]: pgmap v305: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 962 op/s 2024-09-19T06:50:02.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:01 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2745176338' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:02.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:01 smithi173 ceph-mon[35349]: pgmap v305: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 962 op/s 2024-09-19T06:50:02.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:01 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2745176338' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.364+0000 7f75ea546640 1 -- 172.21.15.12:0/3457775810 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75e410a090 con 0x7f75e4102d90 2024-09-19T06:50:02.365 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:01 smithi012 ceph-mon[30937]: pgmap v305: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.3 MiB/s wr, 962 op/s 2024-09-19T06:50:02.365 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:01 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2745176338' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:02.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.369+0000 7f75e17fa640 1 -- 172.21.15.12:0/3457775810 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11971 (secure 0 0 0) 0x7f75d40bc7f0 con 0x7f75e4102d90 2024-09-19T06:50:02.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:50:02.370 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"btime":"2024-09-19T06:48:35:302779+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:48:34.412947+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:50:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 44 2024-09-19T06:50:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.372+0000 7f75ea546640 1 -- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75cc0a3430 msgr2=0x7f75cc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.372+0000 7f75ea546640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75cc0a3430 0x7f75cc0a58f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f75e410a320 tx=0x7f75d80090e0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.372+0000 7f75ea546640 1 -- 172.21.15.12:0/3457775810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75e4102d90 msgr2=0x7f75e410bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.372+0000 7f75ea546640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75e4102d90 0x7f75e410bab0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009a20 tx=0x7f75d4003c10 comp rx=0 tx=0).stop 2024-09-19T06:50:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.373+0000 7f75ea546640 1 -- 172.21.15.12:0/3457775810 shutdown_connections 2024-09-19T06:50:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.373+0000 7f75ea546640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75e410c170 0x7f75e4109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.373+0000 7f75ea546640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75cc0a3430 0x7f75cc0a58f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.373+0000 7f75ea546640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75e41036b0 0x7f75e4108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.373+0000 7f75ea546640 1 --2- 172.21.15.12:0/3457775810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75e4102d90 0x7f75e410bab0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.373+0000 7f75ea546640 1 -- 172.21.15.12:0/3457775810 >> 172.21.15.12:0/3457775810 conn(0x7f75e40fc7d0 msgr2=0x7f75e40fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.373+0000 7f75ea546640 1 -- 172.21.15.12:0/3457775810 shutdown_connections 2024-09-19T06:50:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:02.373+0000 7f75ea546640 1 -- 172.21.15.12:0/3457775810 wait complete. 2024-09-19T06:50:02.603 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T06:50:02.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T06:50:03.251 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:02 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3457775810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:03.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:50:03.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:02 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3457775810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:03.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:02 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3457775810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:03.450 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:04.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.241+0000 7f580448b640 1 -- 172.21.15.12:0/154919921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57fc102d30 msgr2=0x7f57fc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.241+0000 7f580448b640 1 --2- 172.21.15.12:0/154919921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57fc102d30 0x7f57fc103110 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009930 tx=0x7f57f802e830 comp rx=0 tx=0).stop 2024-09-19T06:50:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.241+0000 7f580448b640 1 -- 172.21.15.12:0/154919921 shutdown_connections 2024-09-19T06:50:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.241+0000 7f580448b640 1 --2- 172.21.15.12:0/154919921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57fc1082a0 0x7f57fc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.241+0000 7f580448b640 1 --2- 172.21.15.12:0/154919921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc1036e0 0x7f57fc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.241+0000 7f580448b640 1 --2- 172.21.15.12:0/154919921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57fc102d30 0x7f57fc103110 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.241+0000 7f580448b640 1 -- 172.21.15.12:0/154919921 >> 172.21.15.12:0/154919921 conn(0x7f57fc0fc7d0 msgr2=0x7f57fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.241+0000 7f580448b640 1 -- 172.21.15.12:0/154919921 shutdown_connections 2024-09-19T06:50:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.241+0000 7f580448b640 1 -- 172.21.15.12:0/154919921 wait complete. 2024-09-19T06:50:04.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.242+0000 7f580448b640 1 Processor -- start 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.242+0000 7f580448b640 1 -- start start 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f580448b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57fc102d30 0x7f57fc1a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f580448b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc1036e0 0x7f57fc1a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f580448b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57fc1082a0 0x7f57fc19e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f580448b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc10ff00 con 0x7f57fc102d30 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f580448b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc10fd80 con 0x7f57fc1082a0 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f580448b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc110080 con 0x7f57fc1036e0 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f5802227640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57fc102d30 0x7f57fc1a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f5802227640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57fc102d30 0x7f57fc1a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52314/0 (socket says 172.21.15.12:52314) 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f5802227640 1 -- 172.21.15.12:0/1322513854 learned_addr learned my addr 172.21.15.12:0/1322513854 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f5802a28640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57fc1082a0 0x7f57fc19e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f5801a26640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc1036e0 0x7f57fc1a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f5802a28640 1 -- 172.21.15.12:0/1322513854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc1036e0 msgr2=0x7f57fc1a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f5802a28640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc1036e0 0x7f57fc1a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.243+0000 7f5802a28640 1 -- 172.21.15.12:0/1322513854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57fc102d30 msgr2=0x7f57fc1a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.244+0000 7f5802a28640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57fc102d30 0x7f57fc1a4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.244+0000 7f5802a28640 1 -- 172.21.15.12:0/1322513854 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc19f110 con 0x7f57fc1082a0 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.244+0000 7f5802227640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57fc102d30 0x7f57fc1a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.244+0000 7f5802a28640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57fc1082a0 0x7f57fc19e9e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009fd0 tx=0x7f57f400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.244+0000 7f57f37fe640 1 -- 172.21.15.12:0/1322513854 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f400ce20 con 0x7f57fc1082a0 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.244+0000 7f57f37fe640 1 -- 172.21.15.12:0/1322513854 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57f4005020 con 0x7f57fc1082a0 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.244+0000 7f580448b640 1 -- 172.21.15.12:0/1322513854 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57fc19f400 con 0x7f57fc1082a0 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.244+0000 7f57f37fe640 1 -- 172.21.15.12:0/1322513854 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4010720 con 0x7f57fc1082a0 2024-09-19T06:50:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.244+0000 7f580448b640 1 -- 172.21.15.12:0/1322513854 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57fc1ab6f0 con 0x7f57fc1082a0 2024-09-19T06:50:04.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.247+0000 7f57f37fe640 1 -- 172.21.15.12:0/1322513854 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f57f4005540 con 0x7f57fc1082a0 2024-09-19T06:50:04.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.247+0000 7f5806864740 1 Processor -- start 2024-09-19T06:50:04.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.247+0000 7f5806864740 1 -- start start 2024-09-19T06:50:04.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5806864740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bc760 0x55eb566bcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5806864740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bd080 0x55eb566c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5806864740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566c7940 0x55eb566c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5806864740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eb566222a0 con 0x55eb566c7940 2024-09-19T06:50:04.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5806864740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55eb565c9b10 con 0x55eb566bd080 2024-09-19T06:50:04.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5806864740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eb5661e260 con 0x55eb566bc760 2024-09-19T06:50:04.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f57f37fe640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f57e80a34b0 0x7f57e80a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5801a26640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bc760 0x55eb566bcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5801a26640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bc760 0x55eb566bcb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:42752/0 (socket says 172.21.15.12:42752) 2024-09-19T06:50:04.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5801a26640 1 -- 172.21.15.12:0/2961477723 learned_addr learned my addr 172.21.15.12:0/2961477723 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:04.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f57f37fe640 1 -- 172.21.15.12:0/1322513854 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f57f40d0430 con 0x7f57fc1082a0 2024-09-19T06:50:04.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5801a26640 1 -- 172.21.15.12:0/2961477723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bd080 msgr2=0x55eb566c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:04.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5801a26640 1 --2- 172.21.15.12:0/2961477723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bd080 0x55eb566c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5801a26640 1 -- 172.21.15.12:0/2961477723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566c7940 msgr2=0x55eb566c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:04.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5801a26640 1 --2- 172.21.15.12:0/2961477723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566c7940 0x55eb566c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.248+0000 7f5801a26640 1 -- 172.21.15.12:0/2961477723 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb56393b90 con 0x55eb566bc760 2024-09-19T06:50:04.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.249+0000 7f5801a26640 1 --2- 172.21.15.12:0/2961477723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bc760 0x55eb566bcb40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f57ec005d00 tx=0x7f57ec0127c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a7b978166427358 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:04.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.249+0000 7f57f0ff9640 1 -- 172.21.15.12:0/2961477723 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec005020 con 0x55eb566bc760 2024-09-19T06:50:04.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.249+0000 7f57f0ff9640 1 -- 172.21.15.12:0/2961477723 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ec0047a0 con 0x55eb566bc760 2024-09-19T06:50:04.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.250+0000 7f5802a28640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f57e80a34b0 0x7f57e80a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f57f0ff9640 1 -- 172.21.15.12:0/2961477723 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec005020 con 0x55eb566bc760 2024-09-19T06:50:04.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 -- 172.21.15.12:0/2961477723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bc760 msgr2=0x55eb566bcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:04.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 --2- 172.21.15.12:0/2961477723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bc760 0x55eb566bcb40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f57ec005d00 tx=0x7f57ec0127c0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5802a28640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f57e80a34b0 0x7f57e80a5970 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f57f401a040 tx=0x7f57f40054b0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 -- 172.21.15.12:0/2961477723 shutdown_connections 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 --2- 172.21.15.12:0/2961477723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566c7940 0x55eb566c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 --2- 172.21.15.12:0/2961477723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bd080 0x55eb566c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 --2- 172.21.15.12:0/2961477723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bc760 0x55eb566bcb40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 -- 172.21.15.12:0/2961477723 >> 172.21.15.12:0/2961477723 conn(0x55eb566b8cf0 msgr2=0x55eb566b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 -- 172.21.15.12:0/2961477723 shutdown_connections 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 -- 172.21.15.12:0/2961477723 wait complete. 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 -- start start 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.251+0000 7f5806864740 1 Processor -- start 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5806864740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bc760 0x55eb566c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5806864740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 0x55eb566c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5806864740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566c7940 0x55eb566c5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5806864740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eb566ca560 con 0x55eb566c7940 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5806864740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55eb565aa6e0 con 0x55eb566bc760 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5806864740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eb566ca6e0 con 0x55eb566bd080 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5806864740 10 client.0 _ll_register_callbacks cb 0x55eb565cea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5801a26640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bc760 0x55eb566c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5802227640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 0x55eb566c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5802227640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 0x55eb566c4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:42758/0 (socket says 172.21.15.12:42758) 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5802227640 1 -- 172.21.15.12:0/1608829942 learned_addr learned my addr 172.21.15.12:0/1608829942 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5801a26640 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566c7940 0x55eb566c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5802227640 1 -- 172.21.15.12:0/1608829942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bc760 msgr2=0x55eb566c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5802227640 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bc760 0x55eb566c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5802227640 1 -- 172.21.15.12:0/1608829942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566c7940 msgr2=0x55eb566c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:04.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5802227640 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566c7940 0x55eb566c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.252+0000 7f5802227640 1 -- 172.21.15.12:0/1608829942 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb566d3a20 con 0x55eb566bd080 2024-09-19T06:50:04.259 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:04 smithi012 ceph-mon[30937]: pgmap v306: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-19T06:50:04.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:04 smithi016 ceph-mon[34911]: pgmap v306: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-19T06:50:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.253+0000 7f5802227640 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 0x55eb566c4d10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f57f8039040 tx=0x7f57f8037e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=309acb1242a9e001 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.253+0000 7f57e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:50:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.253+0000 7f57e5ffb640 1 -- 172.21.15.12:0/1608829942 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8046020 con 0x55eb566bd080 2024-09-19T06:50:04.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.253+0000 7f57e5ffb640 1 -- 172.21.15.12:0/1608829942 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f57f8004040 con 0x55eb566bd080 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.253+0000 7f5806864740 1 -- 172.21.15.12:0/1608829942 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ec0047a0 con 0x55eb566bd080 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.253+0000 7f57e5ffb640 1 -- 172.21.15.12:0/1608829942 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f57f8051050 con 0x55eb566bd080 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.253+0000 7f5806864740 10 client.27505 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.253+0000 7f5806864740 1 -- 172.21.15.12:0/1608829942 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55eb566d63b0 con 0x55eb566bd080 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.253+0000 7f57e5ffb640 1 -- 172.21.15.12:0/1608829942 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ec0047a0 con 0x55eb566bd080 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.254+0000 7f57e5ffb640 1 -- 172.21.15.12:0/1608829942 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f57f8004aa0 con 0x55eb566bd080 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.254+0000 7f5806864740 10 client.27505 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.254+0000 7f5806864740 10 client.27505 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.254+0000 7f5806864740 20 client.27505 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.254+0000 7f5806864740 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eb566d7910 0x55eb566d9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.254+0000 7f5806864740 4 client.27505 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.254+0000 7f5806864740 1 -- 172.21.15.12:0/1608829942 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb5662f9d0 con 0x55eb566d7910 2024-09-19T06:50:04.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.254+0000 7f5801a26640 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eb566d7910 0x55eb566d9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.254+0000 7f57e5ffb640 10 client.27505 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.254+0000 7f5801a26640 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eb566d7910 0x55eb566d9d30 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2793b4ca0671477 server_cookie=c57d47f1b20abb5f in_seq=0 out_seq=0 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f57e5ffb640 1 -- 172.21.15.12:0/1608829942 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb5662f9d0 con 0x55eb566d7910 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f57e5ffb640 10 client.27505 handle_command_reply: tid=0 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f5806864740 1 client.27505 shutdown 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f5806864740 1 -- 172.21.15.12:0/1608829942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 msgr2=0x55eb566c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f5806864740 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 0x55eb566c4d10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f57f8039040 tx=0x7f57f8037e30 comp rx=0 tx=0).stop 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f5806864740 1 -- 172.21.15.12:0/1608829942 shutdown_connections 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f5806864740 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eb566d7910 0x55eb566d9d30 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f5806864740 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566c7940 0x55eb566c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f5806864740 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 0x55eb566c4d10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f57e5ffb640 0 client.27505 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:04.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f5806864740 1 --2- 172.21.15.12:0/1608829942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bc760 0x55eb566c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.255+0000 7f5806864740 1 -- 172.21.15.12:0/1608829942 >> 172.21.15.12:0/1608829942 conn(0x55eb566b8cf0 msgr2=0x55eb566b7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:04.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.256+0000 7f5806864740 1 -- 172.21.15.12:0/1608829942 shutdown_connections 2024-09-19T06:50:04.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.256+0000 7f5806864740 1 -- 172.21.15.12:0/1608829942 wait complete. 2024-09-19T06:50:04.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.256+0000 7f5806864740 20 client.27505 trim_cache size 0 max 16384 2024-09-19T06:50:04.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5806864740 1 Processor -- start 2024-09-19T06:50:04.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5806864740 1 -- start start 2024-09-19T06:50:04.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5806864740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5806864740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bd080 0x55eb566c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5806864740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566c7940 0x55eb566df5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5806864740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b40f0 con 0x55eb566bc760 2024-09-19T06:50:04.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5806864740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b5c30 con 0x55eb566bd080 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5806864740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b47c0 con 0x55eb566c7940 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5801a26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5801a26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566c66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52346/0 (socket says 172.21.15.12:52346) 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5801a26640 1 -- 172.21.15.12:0/318460415 learned_addr learned my addr 172.21.15.12:0/318460415 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.285+0000 7f5802227640 1 --2- 172.21.15.12:0/318460415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bd080 0x55eb566c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.286+0000 7f5801a26640 1 --2- 172.21.15.12:0/318460415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566c7940 0x55eb566df5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.286+0000 7f5801a26640 1 -- 172.21.15.12:0/318460415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566c7940 msgr2=0x55eb566df5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.286+0000 7f5801a26640 1 --2- 172.21.15.12:0/318460415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566c7940 0x55eb566df5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.286+0000 7f5801a26640 1 -- 172.21.15.12:0/318460415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bd080 msgr2=0x55eb566c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.286+0000 7f5801a26640 1 --2- 172.21.15.12:0/318460415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bd080 0x55eb566c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.286+0000 7f5801a26640 1 -- 172.21.15.12:0/318460415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb566b8b20 con 0x55eb566bc760 2024-09-19T06:50:04.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.286+0000 7f5801a26640 1 --2- 172.21.15.12:0/318460415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566c66a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f57ec013fd0 tx=0x7f57ec00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3dad22f970c9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:04.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.286+0000 7f57e7fff640 1 -- 172.21.15.12:0/318460415 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0047a0 con 0x55eb566bc760 2024-09-19T06:50:04.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.286+0000 7f57e7fff640 1 -- 172.21.15.12:0/318460415 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ec020040 con 0x55eb566bc760 2024-09-19T06:50:04.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.286+0000 7f57e7fff640 1 -- 172.21.15.12:0/318460415 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec005460 con 0x55eb566bc760 2024-09-19T06:50:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.287+0000 7f5806864740 1 -- 172.21.15.12:0/318460415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 msgr2=0x55eb566c66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.287+0000 7f5806864740 1 --2- 172.21.15.12:0/318460415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566c66a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f57ec013fd0 tx=0x7f57ec00b670 comp rx=0 tx=0).stop 2024-09-19T06:50:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.287+0000 7f5806864740 1 -- 172.21.15.12:0/318460415 shutdown_connections 2024-09-19T06:50:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.287+0000 7f5806864740 1 --2- 172.21.15.12:0/318460415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566c7940 0x55eb566df5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.288+0000 7f5806864740 1 --2- 172.21.15.12:0/318460415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566bd080 0x55eb566c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.288+0000 7f5806864740 1 --2- 172.21.15.12:0/318460415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566c66a0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.288+0000 7f5806864740 1 -- 172.21.15.12:0/318460415 >> 172.21.15.12:0/318460415 conn(0x55eb566b8cf0 msgr2=0x55eb566b7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.289+0000 7f5806864740 1 -- 172.21.15.12:0/318460415 shutdown_connections 2024-09-19T06:50:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.289+0000 7f5806864740 1 -- 172.21.15.12:0/318460415 wait complete. 2024-09-19T06:50:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.289+0000 7f5806864740 1 -- start start 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.289+0000 7f5806864740 1 Processor -- start 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5806864740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5806864740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 0x55eb566cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5806864740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566c7940 0x55eb5673b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5806864740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b5560 con 0x55eb566bc760 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5806864740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b4e90 con 0x55eb566c7940 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5806864740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1b20f0 con 0x55eb566bd080 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5801a26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5801a26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52362/0 (socket says 172.21.15.12:52362) 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5801a26640 1 -- 172.21.15.12:0/4277606396 learned_addr learned my addr 172.21.15.12:0/4277606396 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5801a26640 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566c7940 0x55eb5673b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.290+0000 7f5802227640 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 0x55eb566cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f5806864740 10 client.0 _ll_register_callbacks cb 0x7f57f8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f5801a26640 1 -- 172.21.15.12:0/4277606396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 msgr2=0x55eb566cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f5801a26640 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 0x55eb566cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f5801a26640 1 -- 172.21.15.12:0/4277606396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 msgr2=0x55eb566cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f5801a26640 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f5801a26640 1 -- 172.21.15.12:0/4277606396 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb566b9da0 con 0x55eb566c7940 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f5801a26640 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566c7940 0x55eb5673b5d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f57ec005d00 tx=0x7f57ec0127c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab8eba59a0cdcb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f57e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f57e5ffb640 1 -- 172.21.15.12:0/4277606396 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec004d20 con 0x55eb566c7940 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f57e5ffb640 1 -- 172.21.15.12:0/4277606396 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f57ec0053f0 con 0x55eb566c7940 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f5806864740 1 -- 172.21.15.12:0/4277606396 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ec020040 con 0x55eb566c7940 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f57e5ffb640 1 -- 172.21.15.12:0/4277606396 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f57ec0055f0 con 0x55eb566c7940 2024-09-19T06:50:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.291+0000 7f5806864740 10 client.27554 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.292+0000 7f5806864740 1 -- 172.21.15.12:0/4277606396 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55eb56742da0 con 0x55eb566c7940 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.292+0000 7f57e5ffb640 1 -- 172.21.15.12:0/4277606396 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ec020040 con 0x55eb566c7940 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.292+0000 7f57e5ffb640 1 -- 172.21.15.12:0/4277606396 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f57ec019070 con 0x55eb566c7940 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.292+0000 7f5806864740 10 client.27554 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.292+0000 7f5806864740 10 client.27554 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.292+0000 7f5806864740 20 client.27554 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.292+0000 7f5806864740 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eb567432d0 0x55eb567456f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.292+0000 7f5806864740 4 client.27554 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.292+0000 7f5806864740 1 -- 172.21.15.12:0/4277606396 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55eb56629d20 con 0x55eb567432d0 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.292+0000 7f5802227640 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eb567432d0 0x55eb567456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.293+0000 7f57e5ffb640 10 client.27554 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.293+0000 7f5802227640 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eb567432d0 0x55eb567456f0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=864cfdd9b82a02ac server_cookie=817583fb8e842989 in_seq=0 out_seq=0 2024-09-19T06:50:04.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:04 smithi173 ceph-mon[35349]: pgmap v306: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-19T06:50:04.355 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f57e5ffb640 1 -- 172.21.15.12:0/4277606396 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55eb56629d20 con 0x55eb567432d0 2024-09-19T06:50:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f57e5ffb640 10 client.27554 handle_command_reply: tid=0 2024-09-19T06:50:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 client.27554 shutdown 2024-09-19T06:50:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 -- 172.21.15.12:0/4277606396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566c7940 msgr2=0x55eb5673b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566c7940 0x55eb5673b5d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f57ec005d00 tx=0x7f57ec0127c0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 -- 172.21.15.12:0/4277606396 shutdown_connections 2024-09-19T06:50:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eb567432d0 0x55eb567456f0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eb566c7940 0x55eb5673b5d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb566bd080 0x55eb566cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 --2- 172.21.15.12:0/4277606396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb566bc760 0x55eb566cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f57e5ffb640 0 client.27554 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:04.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 -- 172.21.15.12:0/4277606396 >> 172.21.15.12:0/4277606396 conn(0x55eb566b8cf0 msgr2=0x55eb566be1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:04.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 -- 172.21.15.12:0/4277606396 shutdown_connections 2024-09-19T06:50:04.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 1 -- 172.21.15.12:0/4277606396 wait complete. 2024-09-19T06:50:04.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.444+0000 7f5806864740 20 client.27554 trim_cache size 0 max 16384 2024-09-19T06:50:04.447 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:50:04.447 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 44, 2024-09-19T06:50:04.447 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:50:04.448 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 34, 2024-09-19T06:50:04.448 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:50:04.448 INFO:teuthology.orchestra.run.smithi012.stdout: "82920f6e": { 2024-09-19T06:50:04.448 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 34, 2024-09-19T06:50:04.448 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:50:04.448 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:50:04.448 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 150.0, 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:04.449 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:04.450 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:04.450 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:04.450 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:04.450 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 -- 172.21.15.12:0/1322513854 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f57e80a34b0 msgr2=0x7f57e80a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f57e80a34b0 0x7f57e80a5970 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f57f401a040 tx=0x7f57f40054b0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 -- 172.21.15.12:0/1322513854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57fc1082a0 msgr2=0x7f57fc19e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57fc1082a0 0x7f57fc19e9e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009fd0 tx=0x7f57f400ef10 comp rx=0 tx=0).stop 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 -- 172.21.15.12:0/1322513854 shutdown_connections 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57fc1082a0 0x7f57fc19e9e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f57e80a34b0 0x7f57e80a5970 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc1036e0 0x7f57fc1a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 --2- 172.21.15.12:0/1322513854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57fc102d30 0x7f57fc1a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 -- 172.21.15.12:0/1322513854 >> 172.21.15.12:0/1322513854 conn(0x7f57fc0fc7d0 msgr2=0x7f57fc105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:04.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 -- 172.21.15.12:0/1322513854 shutdown_connections 2024-09-19T06:50:04.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:04.445+0000 7f580448b640 1 -- 172.21.15.12:0/1322513854 wait complete. 2024-09-19T06:50:05.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.047+0000 7fb557259640 1 -- 172.21.15.12:0/2847524816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb550106f10 msgr2=0x7fb55010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:05.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.047+0000 7fb557259640 1 --2- 172.21.15.12:0/2847524816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb550106f10 0x7fb55010ea90 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fb548009ca0 tx=0x7fb54802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 -- 172.21.15.12:0/2847524816 shutdown_connections 2024-09-19T06:50:05.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 --2- 172.21.15.12:0/2847524816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb550106f10 0x7fb55010ea90 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 --2- 172.21.15.12:0/2847524816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb550102790 0x7fb5501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 --2- 172.21.15.12:0/2847524816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb550101de0 0x7fb5501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 -- 172.21.15.12:0/2847524816 >> 172.21.15.12:0/2847524816 conn(0x7fb5500fd8c0 msgr2=0x7fb5500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:05.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 -- 172.21.15.12:0/2847524816 shutdown_connections 2024-09-19T06:50:05.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 -- 172.21.15.12:0/2847524816 wait complete. 2024-09-19T06:50:05.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 Processor -- start 2024-09-19T06:50:05.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 -- start start 2024-09-19T06:50:05.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb550101de0 0x7fb550198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.048+0000 7fb557259640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb550102790 0x7fb550198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb557259640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb550106f10 0x7fb55019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb557259640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb550111f70 con 0x7fb550102790 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb557259640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb550111df0 con 0x7fb550101de0 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb557259640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501120f0 con 0x7fb550106f10 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb547fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb550102790 0x7fb550198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb547fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb550102790 0x7fb550198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52382/0 (socket says 172.21.15.12:52382) 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb547fff640 1 -- 172.21.15.12:0/1044347191 learned_addr learned my addr 172.21.15.12:0/1044347191 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb554ff5640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb550101de0 0x7fb550198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb5557f6640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb550106f10 0x7fb55019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb547fff640 1 -- 172.21.15.12:0/1044347191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb550106f10 msgr2=0x7fb55019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb547fff640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb550106f10 0x7fb55019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb547fff640 1 -- 172.21.15.12:0/1044347191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb550101de0 msgr2=0x7fb550198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb547fff640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb550101de0 0x7fb550198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb547fff640 1 -- 172.21.15.12:0/1044347191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55019d2e0 con 0x7fb550102790 2024-09-19T06:50:05.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb554ff5640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb550101de0 0x7fb550198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:05.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb547fff640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb550102790 0x7fb550198870 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb54000d770 tx=0x7fb54000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:05.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb545ffb640 1 -- 172.21.15.12:0/1044347191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540017070 con 0x7fb550102790 2024-09-19T06:50:05.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb545ffb640 1 -- 172.21.15.12:0/1044347191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb540005500 con 0x7fb550102790 2024-09-19T06:50:05.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.049+0000 7fb557259640 1 -- 172.21.15.12:0/1044347191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55019d5d0 con 0x7fb550102790 2024-09-19T06:50:05.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.050+0000 7fb545ffb640 1 -- 172.21.15.12:0/1044347191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540004e00 con 0x7fb550102790 2024-09-19T06:50:05.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.050+0000 7fb557259640 1 -- 172.21.15.12:0/1044347191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5501a4eb0 con 0x7fb550102790 2024-09-19T06:50:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.052+0000 7fb545ffb640 1 -- 172.21.15.12:0/1044347191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb540004fa0 con 0x7fb550102790 2024-09-19T06:50:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.052+0000 7fb559632740 1 Processor -- start 2024-09-19T06:50:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.052+0000 7fb559632740 1 -- start start 2024-09-19T06:50:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb559632740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab907090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb559632740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab907a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb559632740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab914760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb559632740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5645ab86d2f0 con 0x5645ab912370 2024-09-19T06:50:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb559632740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5645ab814cf0 con 0x5645ab9075d0 2024-09-19T06:50:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb559632740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5645ab8692b0 con 0x5645ab908b40 2024-09-19T06:50:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb545ffb640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb5380a3430 0x7fb5380a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb547fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab914760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb547fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab914760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52386/0 (socket says 172.21.15.12:52386) 2024-09-19T06:50:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb547fff640 1 -- 172.21.15.12:0/3745103083 learned_addr learned my addr 172.21.15.12:0/3745103083 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb554ff5640 1 --2- 172.21.15.12:0/3745103083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab907a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb5557f6640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb5380a3430 0x7fb5380a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb545ffb640 1 -- 172.21.15.12:0/1044347191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7fb5400cf780 con 0x7fb550102790 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb5557f6640 1 --2- 172.21.15.12:0/3745103083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab907090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb547fff640 1 -- 172.21.15.12:0/3745103083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 msgr2=0x5645ab907090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb547fff640 1 --2- 172.21.15.12:0/3745103083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab907090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb547fff640 1 -- 172.21.15.12:0/3745103083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 msgr2=0x5645ab907a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb547fff640 1 --2- 172.21.15.12:0/3745103083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab907a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb547fff640 1 -- 172.21.15.12:0/3745103083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645ab7f93a0 con 0x5645ab912370 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.053+0000 7fb5557f6640 1 --2- 172.21.15.12:0/3745103083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab907090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.054+0000 7fb547fff640 1 --2- 172.21.15.12:0/3745103083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab914760 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb5400ccd10 tx=0x7fb5400048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14a6e9b36210308 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.054+0000 7fb536ffd640 1 -- 172.21.15.12:0/3745103083 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540020070 con 0x5645ab912370 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.054+0000 7fb536ffd640 1 -- 172.21.15.12:0/3745103083 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb540086080 con 0x5645ab912370 2024-09-19T06:50:05.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.054+0000 7fb5557f6640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb5380a3430 0x7fb5380a58f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb548004af0 tx=0x7fb54803e040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:05.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.054+0000 7fb536ffd640 1 -- 172.21.15.12:0/3745103083 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540099d30 con 0x5645ab912370 2024-09-19T06:50:05.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.054+0000 7fb559632740 1 -- 172.21.15.12:0/3745103083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 msgr2=0x5645ab914760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:05.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.054+0000 7fb559632740 1 --2- 172.21.15.12:0/3745103083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab914760 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb5400ccd10 tx=0x7fb5400048a0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.055+0000 7fb559632740 1 -- 172.21.15.12:0/3745103083 shutdown_connections 2024-09-19T06:50:05.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.055+0000 7fb559632740 1 --2- 172.21.15.12:0/3745103083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab914760 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.055+0000 7fb559632740 1 --2- 172.21.15.12:0/3745103083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab907a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.055+0000 7fb559632740 1 --2- 172.21.15.12:0/3745103083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab907090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.055+0000 7fb559632740 1 -- 172.21.15.12:0/3745103083 >> 172.21.15.12:0/3745103083 conn(0x5645ab8d0310 msgr2=0x5645ab903c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:05.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.055+0000 7fb559632740 1 -- 172.21.15.12:0/3745103083 shutdown_connections 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.055+0000 7fb559632740 1 -- 172.21.15.12:0/3745103083 wait complete. 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.055+0000 7fb559632740 1 -- start start 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.055+0000 7fb559632740 1 Processor -- start 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb559632740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab911d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb559632740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab90f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb559632740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb559632740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5645ab915010 con 0x5645ab912370 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb559632740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5645ab828060 con 0x5645ab9075d0 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb559632740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5645ab915190 con 0x5645ab908b40 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb559632740 10 client.0 _ll_register_callbacks cb 0x5645ab57b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb5557f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb5557f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52402/0 (socket says 172.21.15.12:52402) 2024-09-19T06:50:05.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb5557f6640 1 -- 172.21.15.12:0/3206769210 learned_addr learned my addr 172.21.15.12:0/3206769210 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb554ff5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab911d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb547fff640 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab90f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb5557f6640 1 -- 172.21.15.12:0/3206769210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 msgr2=0x5645ab90f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb5557f6640 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab90f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb5557f6640 1 -- 172.21.15.12:0/3206769210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 msgr2=0x5645ab911d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb5557f6640 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab911d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb5557f6640 1 -- 172.21.15.12:0/3206769210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645ab5de3c0 con 0x5645ab912370 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb554ff5640 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab911d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb547fff640 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab90f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb5557f6640 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90f640 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb548035000 tx=0x7fb54802f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c483825099b636d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.056+0000 7fb52ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb52ffff640 1 -- 172.21.15.12:0/3206769210 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548055060 con 0x5645ab912370 2024-09-19T06:50:05.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb52ffff640 1 -- 172.21.15.12:0/3206769210 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7fb548042050 con 0x5645ab912370 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb559632740 1 -- 172.21.15.12:0/3206769210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb540086080 con 0x5645ab912370 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb52ffff640 1 -- 172.21.15.12:0/3206769210 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb54805c050 con 0x5645ab912370 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb559632740 10 client.18144 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb559632740 1 -- 172.21.15.12:0/3206769210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5645ab920a50 con 0x5645ab912370 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb52ffff640 1 -- 172.21.15.12:0/3206769210 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb540086080 con 0x5645ab912370 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb52ffff640 1 -- 172.21.15.12:0/3206769210 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fb548044070 con 0x5645ab912370 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb559632740 10 client.18144 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb559632740 10 client.18144 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb559632740 20 client.18144 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb559632740 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5645ab921f10 0x5645ab924340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb559632740 4 client.18144 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.057+0000 7fb559632740 1 -- 172.21.15.12:0/3206769210 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645ab87a860 con 0x5645ab921f10 2024-09-19T06:50:05.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.058+0000 7fb554ff5640 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5645ab921f10 0x5645ab924340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.058+0000 7fb554ff5640 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5645ab921f10 0x5645ab924340 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=669252d286af59ce server_cookie=5afa6704ef1aba5d in_seq=0 out_seq=0 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.058+0000 7fb52ffff640 10 client.18144 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb52ffff640 1 -- 172.21.15.12:0/3206769210 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5645ab87a860 con 0x5645ab921f10 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb52ffff640 10 client.18144 handle_command_reply: tid=0 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 client.18144 shutdown 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 -- 172.21.15.12:0/3206769210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 msgr2=0x5645ab90f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90f640 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb548035000 tx=0x7fb54802f310 comp rx=0 tx=0).stop 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 -- 172.21.15.12:0/3206769210 shutdown_connections 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5645ab921f10 0x5645ab924340 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90f640 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab90f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 --2- 172.21.15.12:0/3206769210 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab911d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 -- 172.21.15.12:0/3206769210 >> 172.21.15.12:0/3206769210 conn(0x5645ab8d0310 msgr2=0x5645ab909990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:05.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb52ffff640 0 client.18144 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:50:05.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 -- 172.21.15.12:0/3206769210 shutdown_connections 2024-09-19T06:50:05.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 1 -- 172.21.15.12:0/3206769210 wait complete. 2024-09-19T06:50:05.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.059+0000 7fb559632740 20 client.18144 trim_cache size 0 max 16384 2024-09-19T06:50:05.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.072+0000 7fb559632740 1 Processor -- start 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.072+0000 7fb559632740 1 -- start start 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.072+0000 7fb559632740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab9075d0 0x5645ab903e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.072+0000 7fb559632740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab908b40 0x5645ab91e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.072+0000 7fb559632740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab912370 0x5645ab90a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.072+0000 7fb559632740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501adae0 con 0x5645ab9075d0 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.072+0000 7fb559632740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501af620 con 0x5645ab908b40 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.072+0000 7fb559632740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501ae1b0 con 0x5645ab912370 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb554ff5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab9075d0 0x5645ab903e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb554ff5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab9075d0 0x5645ab903e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52416/0 (socket says 172.21.15.12:52416) 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb554ff5640 1 -- 172.21.15.12:0/3470229475 learned_addr learned my addr 172.21.15.12:0/3470229475 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb547fff640 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab908b40 0x5645ab91e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb5557f6640 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab912370 0x5645ab90a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb554ff5640 1 -- 172.21.15.12:0/3470229475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab912370 msgr2=0x5645ab90a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb554ff5640 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab912370 0x5645ab90a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb554ff5640 1 -- 172.21.15.12:0/3470229475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab908b40 msgr2=0x5645ab91e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb554ff5640 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab908b40 0x5645ab91e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb554ff5640 1 -- 172.21.15.12:0/3470229475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645ab8fef90 con 0x5645ab9075d0 2024-09-19T06:50:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb547fff640 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab908b40 0x5645ab91e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb5557f6640 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab912370 0x5645ab90a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb554ff5640 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab9075d0 0x5645ab903e10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x5645ab904ac0 tx=0x7fb54c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504d98b16b9250c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb5367fc640 1 -- 172.21.15.12:0/3470229475 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c022030 con 0x5645ab9075d0 2024-09-19T06:50:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb5367fc640 1 -- 172.21.15.12:0/3470229475 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb54c005020 con 0x5645ab9075d0 2024-09-19T06:50:05.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.073+0000 7fb5367fc640 1 -- 172.21.15.12:0/3470229475 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c004b20 con 0x5645ab9075d0 2024-09-19T06:50:05.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.074+0000 7fb559632740 1 -- 172.21.15.12:0/3470229475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab9075d0 msgr2=0x5645ab903e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:05.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.074+0000 7fb559632740 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab9075d0 0x5645ab903e10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x5645ab904ac0 tx=0x7fb54c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.074+0000 7fb559632740 1 -- 172.21.15.12:0/3470229475 shutdown_connections 2024-09-19T06:50:05.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.074+0000 7fb559632740 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab912370 0x5645ab90a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.074+0000 7fb559632740 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab908b40 0x5645ab91e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.074+0000 7fb559632740 1 --2- 172.21.15.12:0/3470229475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab9075d0 0x5645ab903e10 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.074+0000 7fb559632740 1 -- 172.21.15.12:0/3470229475 >> 172.21.15.12:0/3470229475 conn(0x5645ab8d0310 msgr2=0x5645ab903700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:05.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.074+0000 7fb559632740 1 -- 172.21.15.12:0/3470229475 shutdown_connections 2024-09-19T06:50:05.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.074+0000 7fb559632740 1 -- 172.21.15.12:0/3470229475 wait complete. 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.074+0000 7fb559632740 1 -- start start 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb559632740 1 Processor -- start 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb559632740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab91a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb559632740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab91ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb559632740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb559632740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501aef50 con 0x5645ab912370 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb559632740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501ae880 con 0x5645ab9075d0 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb559632740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501abae0 con 0x5645ab908b40 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb559632740 10 client.0 _ll_register_callbacks cb 0x7fb5480315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb5557f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb5557f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52430/0 (socket says 172.21.15.12:52430) 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb5557f6640 1 -- 172.21.15.12:0/968436536 learned_addr learned my addr 172.21.15.12:0/968436536 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:05.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb554ff5640 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab91a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb547fff640 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab91ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb5557f6640 1 -- 172.21.15.12:0/968436536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 msgr2=0x5645ab91ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb5557f6640 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab91ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb5557f6640 1 -- 172.21.15.12:0/968436536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 msgr2=0x5645ab91a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.075+0000 7fb5557f6640 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab91a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb5557f6640 1 -- 172.21.15.12:0/968436536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645ab90c060 con 0x5645ab912370 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb5557f6640 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90b860 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb54802a900 tx=0x7fb548050cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c2ec57534b7dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb52ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb52ffff640 1 -- 172.21.15.12:0/968436536 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548055040 con 0x5645ab912370 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb52ffff640 1 -- 172.21.15.12:0/968436536 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7fb548042040 con 0x5645ab912370 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb559632740 1 -- 172.21.15.12:0/968436536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb54c005020 con 0x5645ab912370 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb52ffff640 1 -- 172.21.15.12:0/968436536 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb548068050 con 0x5645ab912370 2024-09-19T06:50:05.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb559632740 10 client.18150 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb559632740 1 -- 172.21.15.12:0/968436536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5645ab98c6e0 con 0x5645ab912370 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb52ffff640 1 -- 172.21.15.12:0/968436536 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb54c005020 con 0x5645ab912370 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.076+0000 7fb52ffff640 1 -- 172.21.15.12:0/968436536 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fb548044040 con 0x5645ab912370 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb559632740 10 client.18150 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb559632740 10 client.18150 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb559632740 20 client.18150 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb559632740 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5645ab98cda0 0x5645ab98f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb559632740 4 client.18150 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb559632740 1 -- 172.21.15.12:0/968436536 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5645ab874d70 con 0x5645ab98cda0 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb554ff5640 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5645ab98cda0 0x5645ab98f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb52ffff640 10 client.18150 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb554ff5640 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5645ab98cda0 0x5645ab98f190 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=695cf80c07cf8bca server_cookie=379daf92446d7432 in_seq=0 out_seq=0 2024-09-19T06:50:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb52ffff640 1 -- 172.21.15.12:0/968436536 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5645ab874d70 con 0x5645ab98cda0 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb52ffff640 10 client.18150 handle_command_reply: tid=0 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb559632740 1 client.18150 shutdown 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb559632740 1 -- 172.21.15.12:0/968436536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 msgr2=0x5645ab90b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.077+0000 7fb559632740 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90b860 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb54802a900 tx=0x7fb548050cb0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.078+0000 7fb559632740 1 -- 172.21.15.12:0/968436536 shutdown_connections 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.078+0000 7fb559632740 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5645ab98cda0 0x5645ab98f190 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.078+0000 7fb559632740 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5645ab912370 0x5645ab90b860 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.078+0000 7fb559632740 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5645ab908b40 0x5645ab91ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.078+0000 7fb559632740 1 --2- 172.21.15.12:0/968436536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5645ab9075d0 0x5645ab91a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.078+0000 7fb559632740 1 -- 172.21.15.12:0/968436536 >> 172.21.15.12:0/968436536 conn(0x5645ab8d0310 msgr2=0x5645ab910890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.078+0000 7fb52ffff640 0 client.18150 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.078+0000 7fb559632740 1 -- 172.21.15.12:0/968436536 shutdown_connections 2024-09-19T06:50:05.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.078+0000 7fb559632740 1 -- 172.21.15.12:0/968436536 wait complete. 2024-09-19T06:50:05.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.078+0000 7fb559632740 20 client.18150 trim_cache size 0 max 16384 2024-09-19T06:50:05.085 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 -- 172.21.15.12:0/1044347191 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb5380a3430 msgr2=0x7fb5380a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb5380a3430 0x7fb5380a58f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb548004af0 tx=0x7fb54803e040 comp rx=0 tx=0).stop 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 -- 172.21.15.12:0/1044347191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb550102790 msgr2=0x7fb550198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb550102790 0x7fb550198870 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb54000d770 tx=0x7fb54000dc30 comp rx=0 tx=0).stop 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 -- 172.21.15.12:0/1044347191 shutdown_connections 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb5380a3430 0x7fb5380a58f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb550106f10 0x7fb55019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb550102790 0x7fb550198870 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 --2- 172.21.15.12:0/1044347191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb550101de0 0x7fb550198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 -- 172.21.15.12:0/1044347191 >> 172.21.15.12:0/1044347191 conn(0x7fb5500fd8c0 msgr2=0x7fb5500febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 -- 172.21.15.12:0/1044347191 shutdown_connections 2024-09-19T06:50:05.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:05.079+0000 7fb557259640 1 -- 172.21.15.12:0/1044347191 wait complete. 2024-09-19T06:50:05.808 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 560.0 s, 910.2 tps, lat 88.168 ms stddev 198.525 2024-09-19T06:50:06.123 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:06 smithi012 ceph-mon[30937]: pgmap v307: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 946 op/s 2024-09-19T06:50:06.154 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:50:06.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:06 smithi016 ceph-mon[34911]: pgmap v307: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 946 op/s 2024-09-19T06:50:06.294 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '82920f6e', quiesce took 7.0 seconds. Will release after: 23.0 2024-09-19T06:50:06.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:06 smithi173 ceph-mon[35349]: pgmap v307: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 946 op/s 2024-09-19T06:50:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.867+0000 7f8495f7a640 1 -- 172.21.15.12:0/820774853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84901082a0 msgr2=0x7f849010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.867+0000 7f8495f7a640 1 --2- 172.21.15.12:0/820774853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84901082a0 0x7f849010ec40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8488009930 tx=0x7f848802a440 comp rx=0 tx=0).stop 2024-09-19T06:50:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.867+0000 7f8495f7a640 1 -- 172.21.15.12:0/820774853 shutdown_connections 2024-09-19T06:50:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.867+0000 7f8495f7a640 1 --2- 172.21.15.12:0/820774853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84901082a0 0x7f849010ec40 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.867+0000 7f8495f7a640 1 --2- 172.21.15.12:0/820774853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84901036e0 0x7f8490107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.867+0000 7f8495f7a640 1 --2- 172.21.15.12:0/820774853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8490102d30 0x7f8490103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.867+0000 7f8495f7a640 1 -- 172.21.15.12:0/820774853 >> 172.21.15.12:0/820774853 conn(0x7f84900fc7d0 msgr2=0x7f84900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.867+0000 7f8495f7a640 1 -- 172.21.15.12:0/820774853 shutdown_connections 2024-09-19T06:50:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.867+0000 7f8495f7a640 1 -- 172.21.15.12:0/820774853 wait complete. 2024-09-19T06:50:06.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.867+0000 7f8495f7a640 1 Processor -- start 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f8495f7a640 1 -- start start 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f8495f7a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8490102d30 0x7f8490198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f8495f7a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84901036e0 0x7f8490198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f8495f7a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84901082a0 0x7f849019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f8495f7a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f84901120a0 con 0x7f84901082a0 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f8495f7a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8490111f20 con 0x7f84901036e0 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f8495f7a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8490112220 con 0x7f8490102d30 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84901082a0 0x7f849019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84901036e0 0x7f8490198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84901082a0 0x7f849019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52444/0 (socket says 172.21.15.12:52444) 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848ffff640 1 -- 172.21.15.12:0/4260242636 learned_addr learned my addr 172.21.15.12:0/4260242636 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848f7fe640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8490102d30 0x7f8490198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848ffff640 1 -- 172.21.15.12:0/4260242636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8490102d30 msgr2=0x7f8490198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848ffff640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8490102d30 0x7f8490198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848ffff640 1 -- 172.21.15.12:0/4260242636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84901036e0 msgr2=0x7f8490198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848ffff640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84901036e0 0x7f8490198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848ffff640 1 -- 172.21.15.12:0/4260242636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849019d3b0 con 0x7f84901082a0 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.868+0000 7f848f7fe640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8490102d30 0x7f8490198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.869+0000 7f848ffff640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84901082a0 0x7f849019ccd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8488005ab0 tx=0x7f84880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.869+0000 7f848cff9640 1 -- 172.21.15.12:0/4260242636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848803f030 con 0x7f84901082a0 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.869+0000 7f8495f7a640 1 -- 172.21.15.12:0/4260242636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849019d640 con 0x7f84901082a0 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.869+0000 7f848cff9640 1 -- 172.21.15.12:0/4260242636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8488003ce0 con 0x7f84901082a0 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.869+0000 7f848cff9640 1 -- 172.21.15.12:0/4260242636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488035070 con 0x7f84901082a0 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.869+0000 7f8495f7a640 1 -- 172.21.15.12:0/4260242636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84901a4f80 con 0x7f84901082a0 2024-09-19T06:50:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.871+0000 7f848cff9640 1 -- 172.21.15.12:0/4260242636 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8488042030 con 0x7f84901082a0 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.871+0000 7f8498353740 1 Processor -- start 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f8498353740 1 -- start start 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848cff9640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84780a33b0 0x7f84780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f8498353740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c29b40 0x563048c28090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f8498353740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c28a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f8498353740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c33370 0x563048c35760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f8498353740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563048b8e2f0 con 0x563048c285d0 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f8498353740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563048b35cf0 con 0x563048c33370 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f8498353740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563048b8a2b0 con 0x563048c29b40 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848cff9640 1 -- 172.21.15.12:0/4260242636 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f84880f0740 con 0x7f84901082a0 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848effd640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84780a33b0 0x7f84780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c28a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c28a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52450/0 (socket says 172.21.15.12:52450) 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848effd640 1 -- 172.21.15.12:0/1449710123 learned_addr learned my addr 172.21.15.12:0/1449710123 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848ffff640 1 --2- 172.21.15.12:0/1449710123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c33370 0x563048c35760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848f7fe640 1 --2- 172.21.15.12:0/1449710123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c29b40 0x563048c28090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848effd640 1 -- 172.21.15.12:0/1449710123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c29b40 msgr2=0x563048c28090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848effd640 1 --2- 172.21.15.12:0/1449710123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c29b40 0x563048c28090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848effd640 1 -- 172.21.15.12:0/1449710123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c33370 msgr2=0x563048c35760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848effd640 1 --2- 172.21.15.12:0/1449710123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c33370 0x563048c35760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.872+0000 7f848effd640 1 -- 172.21.15.12:0/1449710123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563048b1a3a0 con 0x563048c285d0 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.873+0000 7f848effd640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84780a33b0 0x7f84780a5870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f84840118d0 tx=0x7f848400aa90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.873+0000 7f848effd640 1 --2- 172.21.15.12:0/1449710123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c28a10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8484005bc0 tx=0x7f848401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc46967b4b6c24a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.873+0000 7f8475ffb640 1 -- 172.21.15.12:0/1449710123 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484023070 con 0x563048c285d0 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.873+0000 7f8475ffb640 1 -- 172.21.15.12:0/1449710123 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f848400fe50 con 0x563048c285d0 2024-09-19T06:50:06.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.873+0000 7f8475ffb640 1 -- 172.21.15.12:0/1449710123 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848401fcf0 con 0x563048c285d0 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.873+0000 7f8498353740 1 -- 172.21.15.12:0/1449710123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 msgr2=0x563048c28a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.873+0000 7f8498353740 1 --2- 172.21.15.12:0/1449710123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c28a10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8484005bc0 tx=0x7f848401b000 comp rx=0 tx=0).stop 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 -- 172.21.15.12:0/1449710123 shutdown_connections 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 --2- 172.21.15.12:0/1449710123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c33370 0x563048c35760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 --2- 172.21.15.12:0/1449710123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c28a10 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 --2- 172.21.15.12:0/1449710123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c29b40 0x563048c28090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 -- 172.21.15.12:0/1449710123 >> 172.21.15.12:0/1449710123 conn(0x563048bf1310 msgr2=0x563048c24c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 -- 172.21.15.12:0/1449710123 shutdown_connections 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 -- 172.21.15.12:0/1449710123 wait complete. 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 -- start start 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 Processor -- start 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c285d0 0x563048c32d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c29b40 0x563048c30020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c30610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563048c36010 con 0x563048c33370 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563048b49060 con 0x563048c285d0 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.874+0000 7f8498353740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563048c36190 con 0x563048c29b40 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f8498353740 10 client.0 _ll_register_callbacks cb 0x56304889c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c30610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c30610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52452/0 (socket says 172.21.15.12:52452) 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848ffff640 1 -- 172.21.15.12:0/3750362882 learned_addr learned my addr 172.21.15.12:0/3750362882 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848f7fe640 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c285d0 0x563048c32d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848effd640 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c29b40 0x563048c30020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848ffff640 1 -- 172.21.15.12:0/3750362882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c29b40 msgr2=0x563048c30020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848ffff640 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c29b40 0x563048c30020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848ffff640 1 -- 172.21.15.12:0/3750362882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c285d0 msgr2=0x563048c32d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848ffff640 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c285d0 0x563048c32d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848ffff640 1 -- 172.21.15.12:0/3750362882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630488ff3c0 con 0x563048c33370 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f848ffff640 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c30610 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f84880b92f0 tx=0x7f84880bc6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221bcf0c96fde566 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f846effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f846effd640 1 -- 172.21.15.12:0/3750362882 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488049070 con 0x563048c33370 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f846effd640 1 -- 172.21.15.12:0/3750362882 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f8488003800 con 0x563048c33370 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.875+0000 7f8498353740 1 -- 172.21.15.12:0/3750362882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f848400fe50 con 0x563048c33370 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f846effd640 1 -- 172.21.15.12:0/3750362882 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f84880bd020 con 0x563048c33370 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f8498353740 10 client.18162 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f8498353740 1 -- 172.21.15.12:0/3750362882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x563048c41b00 con 0x563048c33370 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f846effd640 1 -- 172.21.15.12:0/3750362882 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f848400fe50 con 0x563048c33370 2024-09-19T06:50:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f846effd640 1 -- 172.21.15.12:0/3750362882 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f8488039c90 con 0x563048c33370 2024-09-19T06:50:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f8498353740 10 client.18162 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f8498353740 10 client.18162 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:50:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f8498353740 20 client.18162 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f8498353740 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x563048c42f60 0x563048c45370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f8498353740 4 client.18162 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f8498353740 1 -- 172.21.15.12:0/3750362882 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563048b9b860 con 0x563048c42f60 2024-09-19T06:50:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.876+0000 7f848f7fe640 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x563048c42f60 0x563048c45370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.877+0000 7f846effd640 10 client.18162 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:50:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.877+0000 7f848f7fe640 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x563048c42f60 0x563048c45370 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8d53c859b9c012e1 server_cookie=e19a0a6889de3541 in_seq=0 out_seq=0 2024-09-19T06:50:06.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.877+0000 7f846effd640 1 -- 172.21.15.12:0/3750362882 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563048b9b860 con 0x563048c42f60 2024-09-19T06:50:06.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.877+0000 7f846effd640 10 client.18162 handle_command_reply: tid=0 2024-09-19T06:50:06.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.877+0000 7f8498353740 1 client.18162 shutdown 2024-09-19T06:50:06.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 1 -- 172.21.15.12:0/3750362882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 msgr2=0x563048c30610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c30610 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f84880b92f0 tx=0x7f84880bc6f0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 1 -- 172.21.15.12:0/3750362882 shutdown_connections 2024-09-19T06:50:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x563048c42f60 0x563048c45370 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c30610 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c29b40 0x563048c30020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 1 --2- 172.21.15.12:0/3750362882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c285d0 0x563048c32d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 1 -- 172.21.15.12:0/3750362882 >> 172.21.15.12:0/3750362882 conn(0x563048bf1310 msgr2=0x563048c2a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f846effd640 0 client.18162 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:50:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 1 -- 172.21.15.12:0/3750362882 shutdown_connections 2024-09-19T06:50:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 1 -- 172.21.15.12:0/3750362882 wait complete. 2024-09-19T06:50:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.878+0000 7f8498353740 20 client.18162 trim_cache size 0 max 16384 2024-09-19T06:50:06.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f8498353740 1 Processor -- start 2024-09-19T06:50:06.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f8498353740 1 -- start start 2024-09-19T06:50:06.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f8498353740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c24e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f8498353740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 0x563048c3f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f8498353740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c33370 0x563048c4ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f8498353740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f84901ada00 con 0x563048c285d0 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f8498353740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f84901af540 con 0x563048c29b40 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f8498353740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84901ae0d0 con 0x563048c33370 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f848f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c24e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f848f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c24e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52460/0 (socket says 172.21.15.12:52460) 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.891+0000 7f848f7fe640 1 -- 172.21.15.12:0/3248425781 learned_addr learned my addr 172.21.15.12:0/3248425781 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f848effd640 1 --2- 172.21.15.12:0/3248425781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 0x563048c3f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f848ffff640 1 --2- 172.21.15.12:0/3248425781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c33370 0x563048c4ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f848f7fe640 1 -- 172.21.15.12:0/3248425781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c33370 msgr2=0x563048c4ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f848f7fe640 1 --2- 172.21.15.12:0/3248425781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c33370 0x563048c4ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f848f7fe640 1 -- 172.21.15.12:0/3248425781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 msgr2=0x563048c3f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f848f7fe640 1 --2- 172.21.15.12:0/3248425781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 0x563048c3f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f848f7fe640 1 -- 172.21.15.12:0/3248425781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563048c36100 con 0x563048c285d0 2024-09-19T06:50:06.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f848effd640 1 --2- 172.21.15.12:0/3248425781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 0x563048c3f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:06.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f848f7fe640 1 --2- 172.21.15.12:0/3248425781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c24e10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8480004a80 tx=0x7f8480013980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f339ff7afc8e9d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f84757fa640 1 -- 172.21.15.12:0/3248425781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480003b70 con 0x563048c285d0 2024-09-19T06:50:06.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f84757fa640 1 -- 172.21.15.12:0/3248425781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84800133e0 con 0x563048c285d0 2024-09-19T06:50:06.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.892+0000 7f84757fa640 1 -- 172.21.15.12:0/3248425781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480011990 con 0x563048c285d0 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 -- 172.21.15.12:0/3248425781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 msgr2=0x563048c24e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 --2- 172.21.15.12:0/3248425781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c24e10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8480004a80 tx=0x7f8480013980 comp rx=0 tx=0).stop 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 -- 172.21.15.12:0/3248425781 shutdown_connections 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 --2- 172.21.15.12:0/3248425781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c33370 0x563048c4ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 --2- 172.21.15.12:0/3248425781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 0x563048c3f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 --2- 172.21.15.12:0/3248425781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c285d0 0x563048c24e10 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 -- 172.21.15.12:0/3248425781 >> 172.21.15.12:0/3248425781 conn(0x563048bf1310 msgr2=0x563048c24700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 -- 172.21.15.12:0/3248425781 shutdown_connections 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 -- 172.21.15.12:0/3248425781 wait complete. 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 -- start start 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.893+0000 7f8498353740 1 Processor -- start 2024-09-19T06:50:06.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f8498353740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c285d0 0x563048c37230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f8498353740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 0x563048c37770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f8498353740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c37cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f8498353740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f84901aee70 con 0x563048c33370 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f8498353740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f84901ae7a0 con 0x563048c29b40 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f8498353740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84901aba00 con 0x563048c285d0 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f8498353740 10 client.0 _ll_register_callbacks cb 0x7f8488003e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c37cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c285d0 0x563048c37230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c37cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52468/0 (socket says 172.21.15.12:52468) 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848ffff640 1 -- 172.21.15.12:0/3318028917 learned_addr learned my addr 172.21.15.12:0/3318028917 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848effd640 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 0x563048c37770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848ffff640 1 -- 172.21.15.12:0/3318028917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c285d0 msgr2=0x563048c37230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848ffff640 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c285d0 0x563048c37230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848ffff640 1 -- 172.21.15.12:0/3318028917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 msgr2=0x563048c37770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848ffff640 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 0x563048c37770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848ffff640 1 -- 172.21.15.12:0/3318028917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563048cacca0 con 0x563048c33370 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f848ffff640 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c37cb0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f84880bc620 tx=0x7f8488005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691a20694024cd67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f846effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.894+0000 7f846effd640 1 -- 172.21.15.12:0/3318028917 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488049070 con 0x563048c33370 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f846effd640 1 -- 172.21.15.12:0/3318028917 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f84880c5300 con 0x563048c33370 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f8498353740 1 -- 172.21.15.12:0/3318028917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84800133e0 con 0x563048c33370 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f846effd640 1 -- 172.21.15.12:0/3318028917 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8488004460 con 0x563048c33370 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f8498353740 10 client.18168 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f8498353740 1 -- 172.21.15.12:0/3318028917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x563048cadf60 con 0x563048c33370 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f846effd640 1 -- 172.21.15.12:0/3318028917 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84800133e0 con 0x563048c33370 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f846effd640 1 -- 172.21.15.12:0/3318028917 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f84880ee010 con 0x563048c33370 2024-09-19T06:50:06.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f8498353740 10 client.18168 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f8498353740 10 client.18168 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f8498353740 20 client.18168 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f8498353740 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x563048cae4f0 0x563048cb08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f8498353740 4 client.18168 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f8498353740 1 -- 172.21.15.12:0/3318028917 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563048b95d70 con 0x563048cae4f0 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.895+0000 7f848f7fe640 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x563048cae4f0 0x563048cb08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f846effd640 10 client.18168 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f848f7fe640 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x563048cae4f0 0x563048cb08e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a03bb1f3dd53bc6f server_cookie=dced63c7d6b1a2eb in_seq=0 out_seq=0 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f846effd640 1 -- 172.21.15.12:0/3318028917 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563048b95d70 con 0x563048cae4f0 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f846effd640 10 client.18168 handle_command_reply: tid=0 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 client.18168 shutdown 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 -- 172.21.15.12:0/3318028917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 msgr2=0x563048c37cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c37cb0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f84880bc620 tx=0x7f8488005900 comp rx=0 tx=0).stop 2024-09-19T06:50:06.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 -- 172.21.15.12:0/3318028917 shutdown_connections 2024-09-19T06:50:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x563048cae4f0 0x563048cb08e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563048c33370 0x563048c37cb0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563048c29b40 0x563048c37770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f846effd640 0 client.18168 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:50:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 --2- 172.21.15.12:0/3318028917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563048c285d0 0x563048c37230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 -- 172.21.15.12:0/3318028917 >> 172.21.15.12:0/3318028917 conn(0x563048bf1310 msgr2=0x563048c31880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 -- 172.21.15.12:0/3318028917 shutdown_connections 2024-09-19T06:50:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.896+0000 7f8498353740 1 -- 172.21.15.12:0/3318028917 wait complete. 2024-09-19T06:50:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8498353740 20 client.18168 trim_cache size 0 max 16384 2024-09-19T06:50:06.902 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:50:06.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 -- 172.21.15.12:0/4260242636 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84780a33b0 msgr2=0x7f84780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84780a33b0 0x7f84780a5870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f84840118d0 tx=0x7f848400aa90 comp rx=0 tx=0).stop 2024-09-19T06:50:06.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 -- 172.21.15.12:0/4260242636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84901082a0 msgr2=0x7f849019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:06.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84901082a0 0x7f849019ccd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8488005ab0 tx=0x7f84880042f0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 -- 172.21.15.12:0/4260242636 shutdown_connections 2024-09-19T06:50:06.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84901082a0 0x7f849019ccd0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84901036e0 0x7f8490198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84780a33b0 0x7f84780a5870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 --2- 172.21.15.12:0/4260242636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8490102d30 0x7f8490198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:06.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 -- 172.21.15.12:0/4260242636 >> 172.21.15.12:0/4260242636 conn(0x7f84900fc7d0 msgr2=0x7f84900fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:06.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 -- 172.21.15.12:0/4260242636 shutdown_connections 2024-09-19T06:50:06.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:06.897+0000 7f8495f7a640 1 -- 172.21.15.12:0/4260242636 wait complete. 2024-09-19T06:50:07.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:50:07.906 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:08.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:08 smithi012 ceph-mon[30937]: pgmap v308: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 23 MiB/s wr, 1.92k op/s 2024-09-19T06:50:08.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:08 smithi173 ceph-mon[35349]: pgmap v308: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 23 MiB/s wr, 1.92k op/s 2024-09-19T06:50:08.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:08 smithi016 ceph-mon[34911]: pgmap v308: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 23 MiB/s wr, 1.92k op/s 2024-09-19T06:50:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.760+0000 7fa00f1f8640 1 -- 172.21.15.12:0/3023590711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa00810c180 msgr2=0x7fa00810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.760+0000 7fa00f1f8640 1 --2- 172.21.15.12:0/3023590711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa00810c180 0x7fa00810e600 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa000009ca0 tx=0x7fa00002a950 comp rx=0 tx=0).stop 2024-09-19T06:50:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.760+0000 7fa00f1f8640 1 -- 172.21.15.12:0/3023590711 shutdown_connections 2024-09-19T06:50:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.760+0000 7fa00f1f8640 1 --2- 172.21.15.12:0/3023590711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa00810c180 0x7fa00810e600 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.760+0000 7fa00f1f8640 1 --2- 172.21.15.12:0/3023590711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0081036c0 0x7fa00810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.760+0000 7fa00f1f8640 1 --2- 172.21.15.12:0/3023590711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa008102da0 0x7fa008103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.760+0000 7fa00f1f8640 1 -- 172.21.15.12:0/3023590711 >> 172.21.15.12:0/3023590711 conn(0x7fa0080fc7a0 msgr2=0x7fa0080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.760+0000 7fa00f1f8640 1 -- 172.21.15.12:0/3023590711 shutdown_connections 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.760+0000 7fa00f1f8640 1 -- 172.21.15.12:0/3023590711 wait complete. 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.761+0000 7fa00f1f8640 1 Processor -- start 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.761+0000 7fa00f1f8640 1 -- start start 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.761+0000 7fa00f1f8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa008102da0 0x7fa0081983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.761+0000 7fa00f1f8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0081036c0 0x7fa0081988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.761+0000 7fa00f1f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00810c180 0x7fa00819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.761+0000 7fa00f1f8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa008111f60 con 0x7fa0081036c0 2024-09-19T06:50:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.761+0000 7fa00f1f8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa008111de0 con 0x7fa00810c180 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.761+0000 7fa00f1f8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081120e0 con 0x7fa008102da0 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa007fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0081036c0 0x7fa0081988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa007fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0081036c0 0x7fa0081988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52480/0 (socket says 172.21.15.12:52480) 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa007fff640 1 -- 172.21.15.12:0/371639176 learned_addr learned my addr 172.21.15.12:0/371639176 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa00cf94640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa008102da0 0x7fa0081983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa00d795640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00810c180 0x7fa00819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa007fff640 1 -- 172.21.15.12:0/371639176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa008102da0 msgr2=0x7fa0081983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa007fff640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa008102da0 0x7fa0081983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa007fff640 1 -- 172.21.15.12:0/371639176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00810c180 msgr2=0x7fa00819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa007fff640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00810c180 0x7fa00819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa007fff640 1 -- 172.21.15.12:0/371639176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00819d350 con 0x7fa0081036c0 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa007fff640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0081036c0 0x7fa0081988e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400d950 tx=0x7f9ff400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa005ffb640 1 -- 172.21.15.12:0/371639176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4017030 con 0x7fa0081036c0 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa005ffb640 1 -- 172.21.15.12:0/371639176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ff4004020 con 0x7fa0081036c0 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa00f1f8640 1 -- 172.21.15.12:0/371639176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00819d640 con 0x7fa0081036c0 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.762+0000 7fa005ffb640 1 -- 172.21.15.12:0/371639176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40047a0 con 0x7fa0081036c0 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.763+0000 7fa00f1f8640 1 -- 172.21.15.12:0/371639176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0081a4f20 con 0x7fa0081036c0 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.765+0000 7fa005ffb640 1 -- 172.21.15.12:0/371639176 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9ff40041d0 con 0x7fa0081036c0 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.765+0000 7fa0115d1740 1 Processor -- start 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.765+0000 7fa0115d1740 1 -- start start 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.765+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b57b40 0x55dfd6b56090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.765+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b56a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.765+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b65780 0x55dfd6b67b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.765+0000 7fa0115d1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6abc2f0 con 0x55dfd6b57b40 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.765+0000 7fa0115d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6a63cf0 con 0x55dfd6b565d0 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.765+0000 7fa0115d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6ab82b0 con 0x55dfd6b65780 2024-09-19T06:50:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00d795640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b57b40 0x55dfd6b56090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa005ffb640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9ff80a33b0 0x7f9ff80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00d795640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b57b40 0x55dfd6b56090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52496/0 (socket says 172.21.15.12:52496) 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00d795640 1 -- 172.21.15.12:0/2741259423 learned_addr learned my addr 172.21.15.12:0/2741259423 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00cf94640 1 --2- 172.21.15.12:0/2741259423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b56a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa007fff640 1 --2- 172.21.15.12:0/2741259423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b65780 0x55dfd6b67b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00d795640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9ff80a33b0 0x7f9ff80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa005ffb640 1 -- 172.21.15.12:0/371639176 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7f9ff40cf690 con 0x7fa0081036c0 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00d795640 1 -- 172.21.15.12:0/2741259423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b65780 msgr2=0x55dfd6b67b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00d795640 1 --2- 172.21.15.12:0/2741259423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b65780 0x55dfd6b67b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00d795640 1 -- 172.21.15.12:0/2741259423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 msgr2=0x55dfd6b56a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00d795640 1 --2- 172.21.15.12:0/2741259423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b56a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00d795640 1 -- 172.21.15.12:0/2741259423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd6a483a0 con 0x55dfd6b57b40 2024-09-19T06:50:08.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00cf94640 1 --2- 172.21.15.12:0/2741259423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b56a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:08.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7fa00d795640 1 --2- 172.21.15.12:0/2741259423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b57b40 0x55dfd6b56090 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fa000004ad0 tx=0x7fa00002f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7421b517516b1ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:08.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.766+0000 7f9ff2ffd640 1 -- 172.21.15.12:0/2741259423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000043050 con 0x55dfd6b57b40 2024-09-19T06:50:08.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7f9ff2ffd640 1 -- 172.21.15.12:0/2741259423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa000044040 con 0x55dfd6b57b40 2024-09-19T06:50:08.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7f9ff2ffd640 1 -- 172.21.15.12:0/2741259423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00004d020 con 0x55dfd6b57b40 2024-09-19T06:50:08.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7fa0115d1740 1 -- 172.21.15.12:0/2741259423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b57b40 msgr2=0x55dfd6b56090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:08.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7fa0115d1740 1 --2- 172.21.15.12:0/2741259423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b57b40 0x55dfd6b56090 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fa000004ad0 tx=0x7fa00002f3a0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7fa00d795640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9ff80a33b0 0x7f9ff80a5870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa00004e000 tx=0x7fa00004c000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:08.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7fa0115d1740 1 -- 172.21.15.12:0/2741259423 shutdown_connections 2024-09-19T06:50:08.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7fa0115d1740 1 --2- 172.21.15.12:0/2741259423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b65780 0x55dfd6b67b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7fa0115d1740 1 --2- 172.21.15.12:0/2741259423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b56a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7fa0115d1740 1 --2- 172.21.15.12:0/2741259423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b57b40 0x55dfd6b56090 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7fa0115d1740 1 -- 172.21.15.12:0/2741259423 >> 172.21.15.12:0/2741259423 conn(0x55dfd6b1f310 msgr2=0x55dfd6b52c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:08.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7fa0115d1740 1 -- 172.21.15.12:0/2741259423 shutdown_connections 2024-09-19T06:50:08.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.767+0000 7fa0115d1740 1 -- 172.21.15.12:0/2741259423 wait complete. 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa0115d1740 1 -- start start 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa0115d1740 1 Processor -- start 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b65170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 0x55dfd6b62420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b62a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa0115d1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6b68480 con 0x55dfd6b65780 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa0115d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6a77060 con 0x55dfd6b565d0 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa0115d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dfd6b68600 con 0x55dfd6b57b40 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa0115d1740 10 client.0 _ll_register_callbacks cb 0x55dfd67ca8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa00d795640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b62a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa00d795640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b62a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52502/0 (socket says 172.21.15.12:52502) 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa00d795640 1 -- 172.21.15.12:0/4252087753 learned_addr learned my addr 172.21.15.12:0/4252087753 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa00cf94640 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b65170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa007fff640 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 0x55dfd6b62420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.768+0000 7fa00d795640 1 -- 172.21.15.12:0/4252087753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 msgr2=0x55dfd6b62420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7fa00d795640 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 0x55dfd6b62420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7fa00d795640 1 -- 172.21.15.12:0/4252087753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 msgr2=0x55dfd6b65170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7fa00d795640 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b65170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7fa00d795640 1 -- 172.21.15.12:0/4252087753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd682d3c0 con 0x55dfd6b65780 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7fa007fff640 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 0x55dfd6b62420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7fa00cf94640 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b65170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7fa00d795640 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b62a10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fa000005fb0 tx=0x7fa000004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9737fc395ed2b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7f9fe7fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:08.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7f9fe7fff640 1 -- 172.21.15.12:0/4252087753 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00004d030 con 0x55dfd6b65780 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7f9fe7fff640 1 -- 172.21.15.12:0/4252087753 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7fa00002f710 con 0x55dfd6b65780 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7fa0115d1740 1 -- 172.21.15.12:0/4252087753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa000044040 con 0x55dfd6b65780 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7f9fe7fff640 1 -- 172.21.15.12:0/4252087753 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fa000034040 con 0x55dfd6b65780 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7fa0115d1740 10 client.18180 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7fa0115d1740 1 -- 172.21.15.12:0/4252087753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55dfd6b73f20 con 0x55dfd6b65780 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7f9fe7fff640 1 -- 172.21.15.12:0/4252087753 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa000044040 con 0x55dfd6b65780 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.769+0000 7f9fe7fff640 1 -- 172.21.15.12:0/4252087753 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fa000030440 con 0x55dfd6b65780 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.770+0000 7fa0115d1740 10 client.18180 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.770+0000 7fa0115d1740 10 client.18180 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.770+0000 7fa0115d1740 20 client.18180 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:08.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.770+0000 7fa0115d1740 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55dfd6b75270 0x55dfd6b77660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.770+0000 7fa0115d1740 4 client.18180 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.770+0000 7fa0115d1740 1 -- 172.21.15.12:0/4252087753 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfd6ac9860 con 0x55dfd6b75270 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.770+0000 7fa00cf94640 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55dfd6b75270 0x55dfd6b77660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.770+0000 7fa00cf94640 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55dfd6b75270 0x55dfd6b77660 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3614d7c1cc6f5eda server_cookie=9bbfa31a95de621c in_seq=0 out_seq=0 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.770+0000 7f9fe7fff640 10 client.18180 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7f9fe7fff640 1 -- 172.21.15.12:0/4252087753 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfd6ac9860 con 0x55dfd6b75270 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7f9fe7fff640 10 client.18180 handle_command_reply: tid=0 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 client.18180 shutdown 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 -- 172.21.15.12:0/4252087753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 msgr2=0x55dfd6b62a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b62a10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fa000005fb0 tx=0x7fa000004690 comp rx=0 tx=0).stop 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 -- 172.21.15.12:0/4252087753 shutdown_connections 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55dfd6b75270 0x55dfd6b77660 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b62a10 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 0x55dfd6b62420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7f9fe7fff640 0 client.18180 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:50:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 --2- 172.21.15.12:0/4252087753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b65170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 -- 172.21.15.12:0/4252087753 >> 172.21.15.12:0/4252087753 conn(0x55dfd6b1f310 msgr2=0x55dfd6b58930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 -- 172.21.15.12:0/4252087753 shutdown_connections 2024-09-19T06:50:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.771+0000 7fa0115d1740 1 -- 172.21.15.12:0/4252087753 wait complete. 2024-09-19T06:50:08.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.772+0000 7fa0115d1740 20 client.18180 trim_cache size 0 max 16384 2024-09-19T06:50:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.784+0000 7fa0115d1740 1 Processor -- start 2024-09-19T06:50:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.784+0000 7fa0115d1740 1 -- start start 2024-09-19T06:50:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b61400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 0x55dfd6b7a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b7abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa0115d1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081ab8e0 con 0x55dfd6b65780 2024-09-19T06:50:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa0115d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081ad420 con 0x55dfd6b565d0 2024-09-19T06:50:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa0115d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081abfb0 con 0x55dfd6b57b40 2024-09-19T06:50:08.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa00d795640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b7abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa00d795640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b7abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52508/0 (socket says 172.21.15.12:52508) 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa00d795640 1 -- 172.21.15.12:0/3403114281 learned_addr learned my addr 172.21.15.12:0/3403114281 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa00cf94640 1 --2- 172.21.15.12:0/3403114281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b61400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa007fff640 1 --2- 172.21.15.12:0/3403114281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 0x55dfd6b7a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa00d795640 1 -- 172.21.15.12:0/3403114281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 msgr2=0x55dfd6b7a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa00d795640 1 --2- 172.21.15.12:0/3403114281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 0x55dfd6b7a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa00d795640 1 -- 172.21.15.12:0/3403114281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 msgr2=0x55dfd6b61400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa00d795640 1 --2- 172.21.15.12:0/3403114281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b61400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa00d795640 1 -- 172.21.15.12:0/3403114281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd6b51310 con 0x55dfd6b65780 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa007fff640 1 --2- 172.21.15.12:0/3403114281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 0x55dfd6b7a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7fa00d795640 1 --2- 172.21.15.12:0/3403114281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b7abc0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa000030860 tx=0x7fa000009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4497a522ed57b06d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.785+0000 7f9ff27fc640 1 -- 172.21.15.12:0/3403114281 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00004d070 con 0x55dfd6b65780 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7f9ff27fc640 1 -- 172.21.15.12:0/3403114281 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa00002f710 con 0x55dfd6b65780 2024-09-19T06:50:08.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7f9ff27fc640 1 -- 172.21.15.12:0/3403114281 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000030600 con 0x55dfd6b65780 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7fa0115d1740 1 -- 172.21.15.12:0/3403114281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 msgr2=0x55dfd6b7abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7fa0115d1740 1 --2- 172.21.15.12:0/3403114281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b7abc0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fa000030860 tx=0x7fa000009680 comp rx=0 tx=0).stop 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7fa0115d1740 1 -- 172.21.15.12:0/3403114281 shutdown_connections 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7fa0115d1740 1 --2- 172.21.15.12:0/3403114281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b7abc0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7fa0115d1740 1 --2- 172.21.15.12:0/3403114281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b57b40 0x55dfd6b7a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7fa0115d1740 1 --2- 172.21.15.12:0/3403114281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b565d0 0x55dfd6b61400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7fa0115d1740 1 -- 172.21.15.12:0/3403114281 >> 172.21.15.12:0/3403114281 conn(0x55dfd6b1f310 msgr2=0x55dfd6b60cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7fa0115d1740 1 -- 172.21.15.12:0/3403114281 shutdown_connections 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.786+0000 7fa0115d1740 1 -- 172.21.15.12:0/3403114281 wait complete. 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa0115d1740 1 -- start start 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa0115d1740 1 Processor -- start 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b565d0 0x55dfd6b7afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b57b40 0x55dfd6b782f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa0115d1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b78a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa0115d1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081acd50 con 0x55dfd6b65780 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa0115d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081ac680 con 0x55dfd6b57b40 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa0115d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081a98e0 con 0x55dfd6b565d0 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa0115d1740 10 client.0 _ll_register_callbacks cb 0x7f9ffc004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa00d795640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b78a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa00d795640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b78a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52516/0 (socket says 172.21.15.12:52516) 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa00d795640 1 -- 172.21.15.12:0/3686544947 learned_addr learned my addr 172.21.15.12:0/3686544947 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa007fff640 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b57b40 0x55dfd6b782f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.787+0000 7fa00cf94640 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b565d0 0x55dfd6b7afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7fa00d795640 1 -- 172.21.15.12:0/3686544947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b565d0 msgr2=0x55dfd6b7afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7fa00d795640 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b565d0 0x55dfd6b7afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7fa00d795640 1 -- 172.21.15.12:0/3686544947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b57b40 msgr2=0x55dfd6b782f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:08.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7fa00d795640 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b57b40 0x55dfd6b782f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7fa00d795640 1 -- 172.21.15.12:0/3686544947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd6b52ed0 con 0x55dfd6b65780 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7fa007fff640 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b57b40 0x55dfd6b782f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7fa00d795640 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b78a80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa000005de0 tx=0x7fa00002f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f9f1f61714901e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7f9fe7fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7f9fe7fff640 1 -- 172.21.15.12:0/3686544947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00004d040 con 0x55dfd6b65780 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7f9fe7fff640 1 -- 172.21.15.12:0/3686544947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8687+0+0 (secure 0 0 0) 0x7fa000030c50 con 0x55dfd6b65780 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7fa0115d1740 1 -- 172.21.15.12:0/3686544947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa00002f710 con 0x55dfd6b65780 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7f9fe7fff640 1 -- 172.21.15.12:0/3686544947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fa000074050 con 0x55dfd6b65780 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7fa0115d1740 10 client.18186 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7fa0115d1740 1 -- 172.21.15.12:0/3686544947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55dfd6bdfb10 con 0x55dfd6b65780 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.788+0000 7f9fe7fff640 1 -- 172.21.15.12:0/3686544947 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa00002f710 con 0x55dfd6b65780 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.789+0000 7f9fe7fff640 1 -- 172.21.15.12:0/3686544947 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fa00006b070 con 0x55dfd6b65780 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.789+0000 7fa0115d1740 10 client.18186 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.789+0000 7fa0115d1740 10 client.18186 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.789+0000 7fa0115d1740 20 client.18186 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.789+0000 7fa0115d1740 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55dfd6bdffe0 0x55dfd6be23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.789+0000 7fa0115d1740 4 client.18186 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.789+0000 7fa0115d1740 1 -- 172.21.15.12:0/3686544947 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dfd6ac3d70 con 0x55dfd6bdffe0 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.789+0000 7fa00cf94640 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55dfd6bdffe0 0x55dfd6be23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.789+0000 7f9fe7fff640 10 client.18186 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.789+0000 7fa00cf94640 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55dfd6bdffe0 0x55dfd6be23d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e81c9ebd3d8459db server_cookie=87867b7a7e11b778 in_seq=0 out_seq=0 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7f9fe7fff640 1 -- 172.21.15.12:0/3686544947 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dfd6ac3d70 con 0x55dfd6bdffe0 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7f9fe7fff640 10 client.18186 handle_command_reply: tid=0 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 client.18186 shutdown 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 -- 172.21.15.12:0/3686544947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 msgr2=0x55dfd6b78a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b78a80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa000005de0 tx=0x7fa00002f3a0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 -- 172.21.15.12:0/3686544947 shutdown_connections 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55dfd6bdffe0 0x55dfd6be23d0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55dfd6b65780 0x55dfd6b78a80 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55dfd6b57b40 0x55dfd6b782f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 --2- 172.21.15.12:0/3686544947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dfd6b565d0 0x55dfd6b7afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 -- 172.21.15.12:0/3686544947 >> 172.21.15.12:0/3686544947 conn(0x55dfd6b1f310 msgr2=0x55dfd6b61510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:08.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7f9fe7fff640 0 client.18186 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:50:08.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 -- 172.21.15.12:0/3686544947 shutdown_connections 2024-09-19T06:50:08.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 1 -- 172.21.15.12:0/3686544947 wait complete. 2024-09-19T06:50:08.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa0115d1740 20 client.18186 trim_cache size 0 max 16384 2024-09-19T06:50:08.799 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:50:08.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa00f1f8640 1 -- 172.21.15.12:0/371639176 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9ff80a33b0 msgr2=0x7f9ff80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:08.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa00f1f8640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9ff80a33b0 0x7f9ff80a5870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa00004e000 tx=0x7fa00004c000 comp rx=0 tx=0).stop 2024-09-19T06:50:08.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa00f1f8640 1 -- 172.21.15.12:0/371639176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0081036c0 msgr2=0x7fa0081988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:08.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.790+0000 7fa00f1f8640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0081036c0 0x7fa0081988e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400d950 tx=0x7f9ff400de10 comp rx=0 tx=0).stop 2024-09-19T06:50:08.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.791+0000 7fa00f1f8640 1 -- 172.21.15.12:0/371639176 shutdown_connections 2024-09-19T06:50:08.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.791+0000 7fa00f1f8640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa00810c180 0x7fa00819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.791+0000 7fa00f1f8640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0081036c0 0x7fa0081988e0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.791+0000 7fa00f1f8640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9ff80a33b0 0x7f9ff80a5870 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.791+0000 7fa00f1f8640 1 --2- 172.21.15.12:0/371639176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa008102da0 0x7fa0081983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:08.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.791+0000 7fa00f1f8640 1 -- 172.21.15.12:0/371639176 >> 172.21.15.12:0/371639176 conn(0x7fa0080fc7a0 msgr2=0x7fa0080fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:08.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.791+0000 7fa00f1f8640 1 -- 172.21.15.12:0/371639176 shutdown_connections 2024-09-19T06:50:08.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:08.791+0000 7fa00f1f8640 1 -- 172.21.15.12:0/371639176 wait complete. 2024-09-19T06:50:09.870 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:50:10.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:10 smithi012 ceph-mon[30937]: pgmap v309: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 21 MiB/s wr, 1.69k op/s 2024-09-19T06:50:10.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:10 smithi012 ceph-mon[30937]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:50:10.132 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:10.311 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:10 smithi016 ceph-mon[34911]: pgmap v309: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 21 MiB/s wr, 1.69k op/s 2024-09-19T06:50:10.311 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:10 smithi016 ceph-mon[34911]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:50:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:10 smithi173 ceph-mon[35349]: pgmap v309: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 21 MiB/s wr, 1.69k op/s 2024-09-19T06:50:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:10 smithi173 ceph-mon[35349]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:50:10.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.612+0000 7f412d0bb640 1 -- 172.21.15.12:0/1311010933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4128100e20 msgr2=0x7f4128101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:10.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.612+0000 7f412d0bb640 1 --2- 172.21.15.12:0/1311010933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4128100e20 0x7f4128101200 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f4118009900 tx=0x7f411802a480 comp rx=0 tx=0).stop 2024-09-19T06:50:10.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.612+0000 7f412d0bb640 1 -- 172.21.15.12:0/1311010933 shutdown_connections 2024-09-19T06:50:10.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.612+0000 7f412d0bb640 1 --2- 172.21.15.12:0/1311010933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4128102ef0 0x7f412810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.612+0000 7f412d0bb640 1 --2- 172.21.15.12:0/1311010933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4128102570 0x7f41281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.612+0000 7f412d0bb640 1 --2- 172.21.15.12:0/1311010933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4128100e20 0x7f4128101200 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.612+0000 7f412d0bb640 1 -- 172.21.15.12:0/1311010933 >> 172.21.15.12:0/1311010933 conn(0x7f41280fc7d0 msgr2=0x7f41280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:10.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.612+0000 7f412d0bb640 1 -- 172.21.15.12:0/1311010933 shutdown_connections 2024-09-19T06:50:10.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.612+0000 7f412d0bb640 1 -- 172.21.15.12:0/1311010933 wait complete. 2024-09-19T06:50:10.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.612+0000 7f412d0bb640 1 Processor -- start 2024-09-19T06:50:10.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f412d0bb640 1 -- start start 2024-09-19T06:50:10.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f412d0bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4128100e20 0x7f41280fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f412d0bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4128102570 0x7f41280fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f412d0bb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4128102ef0 0x7f41280fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f412d0bb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4128110f50 con 0x7f4128100e20 2024-09-19T06:50:10.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f412d0bb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4128110dd0 con 0x7f4128102570 2024-09-19T06:50:10.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f412d0bb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41281110d0 con 0x7f4128102ef0 2024-09-19T06:50:10.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f4126d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4128100e20 0x7f41280fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f4126d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4128100e20 0x7f41280fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42976/0 (socket says 172.21.15.12:42976) 2024-09-19T06:50:10.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f4126d9d640 1 -- 172.21.15.12:0/4122020721 learned_addr learned my addr 172.21.15.12:0/4122020721 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:10.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f412759e640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4128102ef0 0x7f41280fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f412659c640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4128102570 0x7f41280fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f4126d9d640 1 -- 172.21.15.12:0/4122020721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4128102ef0 msgr2=0x7f41280fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:10.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f4126d9d640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4128102ef0 0x7f41280fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f4126d9d640 1 -- 172.21.15.12:0/4122020721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4128102570 msgr2=0x7f41280fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:10.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f4126d9d640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4128102570 0x7f41280fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f4126d9d640 1 -- 172.21.15.12:0/4122020721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41281a68a0 con 0x7f4128100e20 2024-09-19T06:50:10.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.613+0000 7f412659c640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4128102570 0x7f41280fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.614+0000 7f4126d9d640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4128100e20 0x7f41280fcc80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f4118006010 tx=0x7f4118003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.614+0000 7f410ffff640 1 -- 172.21.15.12:0/4122020721 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411803f070 con 0x7f4128100e20 2024-09-19T06:50:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.614+0000 7f410ffff640 1 -- 172.21.15.12:0/4122020721 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4118031e30 con 0x7f4128100e20 2024-09-19T06:50:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.614+0000 7f412d0bb640 1 -- 172.21.15.12:0/4122020721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41281a6b30 con 0x7f4128100e20 2024-09-19T06:50:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.614+0000 7f410ffff640 1 -- 172.21.15.12:0/4122020721 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118035030 con 0x7f4128100e20 2024-09-19T06:50:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.614+0000 7f412d0bb640 1 -- 172.21.15.12:0/4122020721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41281a7060 con 0x7f4128100e20 2024-09-19T06:50:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.616+0000 7f410ffff640 1 -- 172.21.15.12:0/4122020721 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4118042070 con 0x7f4128100e20 2024-09-19T06:50:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.616+0000 7f412f494740 1 Processor -- start 2024-09-19T06:50:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412f494740 1 -- start start 2024-09-19T06:50:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412f494740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e4f8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412f494740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e4f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412f494740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e505760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412f494740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559e3e45e2f0 con 0x559e3e503370 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412f494740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559e3e405cf0 con 0x559e3e4f9b40 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412f494740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559e3e45a2b0 con 0x559e3e4f85d0 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e505760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f410ffff640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41100a3430 0x7f41100a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e505760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42978/0 (socket says 172.21.15.12:42978) 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412659c640 1 -- 172.21.15.12:0/1805384581 learned_addr learned my addr 172.21.15.12:0/1805384581 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f4126d9d640 1 --2- 172.21.15.12:0/1805384581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e4f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412759e640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41100a3430 0x7f41100a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f410ffff640 1 -- 172.21.15.12:0/4122020721 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7f41180f06e0 con 0x7f4128100e20 2024-09-19T06:50:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412759e640 1 --2- 172.21.15.12:0/1805384581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e4f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412659c640 1 -- 172.21.15.12:0/1805384581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 msgr2=0x559e3e4f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412659c640 1 --2- 172.21.15.12:0/1805384581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e4f8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412659c640 1 -- 172.21.15.12:0/1805384581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 msgr2=0x559e3e4f8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412659c640 1 --2- 172.21.15.12:0/1805384581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e4f8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412659c640 1 -- 172.21.15.12:0/1805384581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e3e3ea3a0 con 0x559e3e503370 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.617+0000 7f412759e640 1 --2- 172.21.15.12:0/1805384581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e4f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.618+0000 7f412659c640 1 --2- 172.21.15.12:0/1805384581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e505760 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f411c008c10 tx=0x7f411c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbface93ce3892db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.618+0000 7f412759e640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41100a3430 0x7f41100a58f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4120007fd0 tx=0x7f4120007a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.618+0000 7f410d7fa640 1 -- 172.21.15.12:0/1805384581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c014070 con 0x559e3e503370 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.618+0000 7f410d7fa640 1 -- 172.21.15.12:0/1805384581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f411c0047a0 con 0x559e3e503370 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.618+0000 7f410d7fa640 1 -- 172.21.15.12:0/1805384581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c010690 con 0x559e3e503370 2024-09-19T06:50:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 -- 172.21.15.12:0/1805384581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 msgr2=0x559e3e505760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 --2- 172.21.15.12:0/1805384581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e505760 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f411c008c10 tx=0x7f411c00e720 comp rx=0 tx=0).stop 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 -- 172.21.15.12:0/1805384581 shutdown_connections 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 --2- 172.21.15.12:0/1805384581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e505760 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 --2- 172.21.15.12:0/1805384581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e4f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 --2- 172.21.15.12:0/1805384581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e4f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 -- 172.21.15.12:0/1805384581 >> 172.21.15.12:0/1805384581 conn(0x559e3e4c1310 msgr2=0x559e3e4f4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 -- 172.21.15.12:0/1805384581 shutdown_connections 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 -- 172.21.15.12:0/1805384581 wait complete. 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 -- start start 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.619+0000 7f412f494740 1 Processor -- start 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f412f494740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e502d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f412f494740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e4fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f412f494740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e5005d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f412f494740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559e3e506070 con 0x559e3e503370 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f412f494740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559e3e419060 con 0x559e3e4f9b40 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f412f494740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559e3e5061f0 con 0x559e3e4f85d0 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f412f494740 10 client.0 _ll_register_callbacks cb 0x559e3e16c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f412759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e5005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f4126d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e502d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f4126d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e502d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:52660/0 (socket says 172.21.15.12:52660) 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f4126d9d640 1 -- 172.21.15.12:0/1504938334 learned_addr learned my addr 172.21.15.12:0/1504938334 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f412759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e5005d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42982/0 (socket says 172.21.15.12:42982) 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f412659c640 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e4fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f4126d9d640 1 -- 172.21.15.12:0/1504938334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 msgr2=0x559e3e4fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f4126d9d640 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e4fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f4126d9d640 1 -- 172.21.15.12:0/1504938334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 msgr2=0x559e3e5005d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f4126d9d640 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e5005d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f4126d9d640 1 -- 172.21.15.12:0/1504938334 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e3e1cf3c0 con 0x559e3e4f85d0 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f4126d9d640 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e502d30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f41180b92a0 tx=0x7f411808c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f083a1ab61cb46eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.620+0000 7f410aff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f410aff5640 1 -- 172.21.15.12:0/1504938334 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118049040 con 0x559e3e4f85d0 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f410aff5640 1 -- 172.21.15.12:0/1504938334 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7f41180edfc0 con 0x559e3e4f85d0 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f412f494740 1 -- 172.21.15.12:0/1504938334 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f411c0047a0 con 0x559e3e4f85d0 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f410aff5640 1 -- 172.21.15.12:0/1504938334 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f41180bc6a0 con 0x559e3e4f85d0 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f412f494740 10 client.27559 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f412f494740 1 -- 172.21.15.12:0/1504938334 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559e3e506120 con 0x559e3e4f85d0 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f410aff5640 1 -- 172.21.15.12:0/1504938334 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f411c0047a0 con 0x559e3e4f85d0 2024-09-19T06:50:10.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f410aff5640 1 -- 172.21.15.12:0/1504938334 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f41180a5bd0 con 0x559e3e4f85d0 2024-09-19T06:50:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f412f494740 10 client.27559 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f412f494740 10 client.27559 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:50:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f412f494740 20 client.27559 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f412f494740 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x559e3e512ea0 0x559e3e515310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f412f494740 4 client.27559 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f412f494740 1 -- 172.21.15.12:0/1504938334 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e3e46b860 con 0x559e3e512ea0 2024-09-19T06:50:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.621+0000 7f412659c640 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x559e3e512ea0 0x559e3e515310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.622+0000 7f412659c640 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x559e3e512ea0 0x559e3e515310 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=621c0dba3723d2a5 server_cookie=9193647281040177 in_seq=0 out_seq=0 2024-09-19T06:50:10.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.622+0000 7f410aff5640 10 client.27559 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:50:10.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.622+0000 7f410aff5640 1 -- 172.21.15.12:0/1504938334 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e3e46b860 con 0x559e3e512ea0 2024-09-19T06:50:10.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.622+0000 7f410aff5640 10 client.27559 handle_command_reply: tid=0 2024-09-19T06:50:10.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.622+0000 7f412f494740 1 client.27559 shutdown 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 1 -- 172.21.15.12:0/1504938334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 msgr2=0x559e3e502d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e502d30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f41180b92a0 tx=0x7f411808c4f0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 1 -- 172.21.15.12:0/1504938334 shutdown_connections 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x559e3e512ea0 0x559e3e515310 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e5005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e4fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f410aff5640 0 client.27559 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 1 --2- 172.21.15.12:0/1504938334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e502d30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 1 -- 172.21.15.12:0/1504938334 >> 172.21.15.12:0/1504938334 conn(0x559e3e4c1310 msgr2=0x559e3e4fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 1 -- 172.21.15.12:0/1504938334 shutdown_connections 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 1 -- 172.21.15.12:0/1504938334 wait complete. 2024-09-19T06:50:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.623+0000 7f412f494740 20 client.27559 trim_cache size 0 max 16384 2024-09-19T06:50:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412f494740 1 Processor -- start 2024-09-19T06:50:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412f494740 1 -- start start 2024-09-19T06:50:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412f494740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e50f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412f494740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e504760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412f494740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e504ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412f494740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41281afc20 con 0x559e3e503370 2024-09-19T06:50:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412f494740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41281b1760 con 0x559e3e4f9b40 2024-09-19T06:50:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412f494740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41281b02f0 con 0x559e3e4f85d0 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e504ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e504ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42992/0 (socket says 172.21.15.12:42992) 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.636+0000 7f412759e640 1 -- 172.21.15.12:0/3127786897 learned_addr learned my addr 172.21.15.12:0/3127786897 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f412659c640 1 --2- 172.21.15.12:0/3127786897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e504760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f4126d9d640 1 --2- 172.21.15.12:0/3127786897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e50f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f412759e640 1 -- 172.21.15.12:0/3127786897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 msgr2=0x559e3e50f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f412759e640 1 --2- 172.21.15.12:0/3127786897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e50f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f412759e640 1 -- 172.21.15.12:0/3127786897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 msgr2=0x559e3e504760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f412759e640 1 --2- 172.21.15.12:0/3127786897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e504760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f412759e640 1 -- 172.21.15.12:0/3127786897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e3e505f50 con 0x559e3e503370 2024-09-19T06:50:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f4126d9d640 1 --2- 172.21.15.12:0/3127786897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e50f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:10.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f412759e640 1 --2- 172.21.15.12:0/3127786897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e504ca0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f4120014f70 tx=0x7f4120007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3863b68f55f20c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f410cff9640 1 -- 172.21.15.12:0/3127786897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120004d20 con 0x559e3e503370 2024-09-19T06:50:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f410cff9640 1 -- 172.21.15.12:0/3127786897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f412000fe90 con 0x559e3e503370 2024-09-19T06:50:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.637+0000 7f410cff9640 1 -- 172.21.15.12:0/3127786897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120005700 con 0x559e3e503370 2024-09-19T06:50:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 -- 172.21.15.12:0/3127786897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 msgr2=0x559e3e504ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 --2- 172.21.15.12:0/3127786897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e504ca0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f4120014f70 tx=0x7f4120007520 comp rx=0 tx=0).stop 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 -- 172.21.15.12:0/3127786897 shutdown_connections 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 --2- 172.21.15.12:0/3127786897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e503370 0x559e3e504ca0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 --2- 172.21.15.12:0/3127786897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e4f9b40 0x559e3e504760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 --2- 172.21.15.12:0/3127786897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e50f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 -- 172.21.15.12:0/3127786897 >> 172.21.15.12:0/3127786897 conn(0x559e3e4c1310 msgr2=0x559e3e5053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 -- 172.21.15.12:0/3127786897 shutdown_connections 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 -- 172.21.15.12:0/3127786897 wait complete. 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 -- start start 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.638+0000 7f412f494740 1 Processor -- start 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412f494740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e50b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412f494740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e4f9b40 0x559e3e50b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412f494740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e503370 0x559e3e506440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412f494740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41281b1090 con 0x559e3e4f9b40 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412f494740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41281b09c0 con 0x559e3e503370 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412f494740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41281adc20 con 0x559e3e4f85d0 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e4f9b40 0x559e3e50b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412f494740 10 client.0 _ll_register_callbacks cb 0x7f411803b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e4f9b40 0x559e3e50b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43004/0 (socket says 172.21.15.12:43004) 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412659c640 1 -- 172.21.15.12:0/3336926661 learned_addr learned my addr 172.21.15.12:0/3336926661 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f4126d9d640 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e50b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412759e640 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e503370 0x559e3e506440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412659c640 1 -- 172.21.15.12:0/3336926661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 msgr2=0x559e3e50b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412659c640 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e50b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412659c640 1 -- 172.21.15.12:0/3336926661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e503370 msgr2=0x559e3e506440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412659c640 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e503370 0x559e3e506440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412659c640 1 -- 172.21.15.12:0/3336926661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e3e4f9400 con 0x559e3e4f9b40 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f412659c640 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e4f9b40 0x559e3e50b9d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f411c00f010 tx=0x7f411c008f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4fd60a499e0ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f410aff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.639+0000 7f410aff5640 1 -- 172.21.15.12:0/3336926661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c029030 con 0x559e3e4f9b40 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f410aff5640 1 -- 172.21.15.12:0/3336926661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7f411c010430 con 0x559e3e4f9b40 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f412f494740 1 -- 172.21.15.12:0/3336926661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f412000fe90 con 0x559e3e4f9b40 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f410aff5640 1 -- 172.21.15.12:0/3336926661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f411c014040 con 0x559e3e4f9b40 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f412f494740 10 client.18204 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f412f494740 1 -- 172.21.15.12:0/3336926661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559e3e57dfd0 con 0x559e3e4f9b40 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f410aff5640 1 -- 172.21.15.12:0/3336926661 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f412000fe90 con 0x559e3e4f9b40 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f410aff5640 1 -- 172.21.15.12:0/3336926661 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f411c0357c0 con 0x559e3e4f9b40 2024-09-19T06:50:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f412f494740 10 client.18204 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f412f494740 10 client.18204 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f412f494740 20 client.18204 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f412f494740 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x559e3e57e470 0x559e3e580860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f412f494740 4 client.18204 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f412f494740 1 -- 172.21.15.12:0/3336926661 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e3e465d70 con 0x559e3e57e470 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.640+0000 7f4126d9d640 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x559e3e57e470 0x559e3e580860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f4126d9d640 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x559e3e57e470 0x559e3e580860 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b79d545895bfd7d server_cookie=abc8e0a87309e79b in_seq=0 out_seq=0 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f410aff5640 10 client.18204 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f410aff5640 1 -- 172.21.15.12:0/3336926661 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e3e465d70 con 0x559e3e57e470 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f410aff5640 10 client.18204 handle_command_reply: tid=0 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 client.18204 shutdown 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 -- 172.21.15.12:0/3336926661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e4f9b40 msgr2=0x559e3e50b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e4f9b40 0x559e3e50b9d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f411c00f010 tx=0x7f411c008f10 comp rx=0 tx=0).stop 2024-09-19T06:50:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 -- 172.21.15.12:0/3336926661 shutdown_connections 2024-09-19T06:50:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x559e3e57e470 0x559e3e580860 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e3e503370 0x559e3e506440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e3e4f9b40 0x559e3e50b9d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 --2- 172.21.15.12:0/3336926661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559e3e4f85d0 0x559e3e50b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 -- 172.21.15.12:0/3336926661 >> 172.21.15.12:0/3336926661 conn(0x559e3e4c1310 msgr2=0x559e3e4f34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f410aff5640 0 client.18204 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:50:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 -- 172.21.15.12:0/3336926661 shutdown_connections 2024-09-19T06:50:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 1 -- 172.21.15.12:0/3336926661 wait complete. 2024-09-19T06:50:10.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.641+0000 7f412f494740 20 client.18204 trim_cache size 0 max 16384 2024-09-19T06:50:10.649 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:50:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 -- 172.21.15.12:0/4122020721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41100a3430 msgr2=0x7f41100a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41100a3430 0x7f41100a58f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4120007fd0 tx=0x7f4120007a20 comp rx=0 tx=0).stop 2024-09-19T06:50:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 -- 172.21.15.12:0/4122020721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4128100e20 msgr2=0x7f41280fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4128100e20 0x7f41280fcc80 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f4118006010 tx=0x7f4118003c80 comp rx=0 tx=0).stop 2024-09-19T06:50:10.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 -- 172.21.15.12:0/4122020721 shutdown_connections 2024-09-19T06:50:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41100a3430 0x7f41100a58f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4128102ef0 0x7f41280fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4128102570 0x7f41280fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 --2- 172.21.15.12:0/4122020721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4128100e20 0x7f41280fcc80 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 -- 172.21.15.12:0/4122020721 >> 172.21.15.12:0/4122020721 conn(0x7f41280fc7d0 msgr2=0x7f412806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 -- 172.21.15.12:0/4122020721 shutdown_connections 2024-09-19T06:50:10.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:10.642+0000 7f412d0bb640 1 -- 172.21.15.12:0/4122020721 wait complete. 2024-09-19T06:50:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:50:11.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:50:11.699 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.894+0000 7fa0712dd640 1 -- 172.21.15.12:0/574417622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa06c10c110 msgr2=0x7fa06c10e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.894+0000 7fa0712dd640 1 --2- 172.21.15.12:0/574417622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa06c10c110 0x7fa06c10e590 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fa064009ca0 tx=0x7fa06402a950 comp rx=0 tx=0).stop 2024-09-19T06:50:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.894+0000 7fa0712dd640 1 -- 172.21.15.12:0/574417622 shutdown_connections 2024-09-19T06:50:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.894+0000 7fa0712dd640 1 --2- 172.21.15.12:0/574417622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa06c10c110 0x7fa06c10e590 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.894+0000 7fa0712dd640 1 --2- 172.21.15.12:0/574417622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06c1035e0 0x7fa06c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 --2- 172.21.15.12:0/574417622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa06c102cc0 0x7fa06c1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 -- 172.21.15.12:0/574417622 >> 172.21.15.12:0/574417622 conn(0x7fa06c0fc6b0 msgr2=0x7fa06c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 -- 172.21.15.12:0/574417622 shutdown_connections 2024-09-19T06:50:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 -- 172.21.15.12:0/574417622 wait complete. 2024-09-19T06:50:11.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 Processor -- start 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 -- start start 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa06c102cc0 0x7fa06c100910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06c1035e0 0x7fa06c100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa06c10c110 0x7fa06c101390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c111f40 con 0x7fa06c10c110 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c111dc0 con 0x7fa06c102cc0 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.895+0000 7fa0712dd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1120c0 con 0x7fa06c1035e0 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa06b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa06c10c110 0x7fa06c101390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa06b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa06c10c110 0x7fa06c101390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43018/0 (socket says 172.21.15.12:43018) 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa06b7fe640 1 -- 172.21.15.12:0/3863113801 learned_addr learned my addr 172.21.15.12:0/3863113801 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa063fff640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06c1035e0 0x7fa06c100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa06affd640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa06c102cc0 0x7fa06c100910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.899 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa06b7fe640 1 -- 172.21.15.12:0/3863113801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06c1035e0 msgr2=0x7fa06c100e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa06b7fe640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06c1035e0 0x7fa06c100e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa06b7fe640 1 -- 172.21.15.12:0/3863113801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa06c102cc0 msgr2=0x7fa06c100910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa06b7fe640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa06c102cc0 0x7fa06c100910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa06b7fe640 1 -- 172.21.15.12:0/3863113801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c1a6830 con 0x7fa06c10c110 2024-09-19T06:50:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa06b7fe640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa06c10c110 0x7fa06c101390 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fa064009dc0 tx=0x7fa064003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa068ff9640 1 -- 172.21.15.12:0/3863113801 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064034040 con 0x7fa06c10c110 2024-09-19T06:50:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa068ff9640 1 -- 172.21.15.12:0/3863113801 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa06402fe20 con 0x7fa06c10c110 2024-09-19T06:50:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa0712dd640 1 -- 172.21.15.12:0/3863113801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06c1a6ac0 con 0x7fa06c10c110 2024-09-19T06:50:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa068ff9640 1 -- 172.21.15.12:0/3863113801 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640047f0 con 0x7fa06c10c110 2024-09-19T06:50:11.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.896+0000 7fa0712dd640 1 -- 172.21.15.12:0/3863113801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06c1a6fb0 con 0x7fa06c10c110 2024-09-19T06:50:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.899+0000 7fa068ff9640 1 -- 172.21.15.12:0/3863113801 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa064037020 con 0x7fa06c10c110 2024-09-19T06:50:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.899+0000 7fa07407c740 1 Processor -- start 2024-09-19T06:50:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.899+0000 7fa07407c740 1 -- start start 2024-09-19T06:50:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.899+0000 7fa07407c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x560308838ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.899+0000 7fa07407c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308843770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.899+0000 7fa07407c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x5603088460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.899+0000 7fa07407c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56030879d2f0 con 0x560308839410 2024-09-19T06:50:11.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.899+0000 7fa07407c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560308745270 con 0x560308843cb0 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.899+0000 7fa07407c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5603087992b0 con 0x560308838af0 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308843770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308843770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43028/0 (socket says 172.21.15.12:43028) 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa068ff9640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0580a3460 0x7fa0580a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06affd640 1 -- 172.21.15.12:0/941462264 learned_addr learned my addr 172.21.15.12:0/941462264 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa063fff640 1 --2- 172.21.15.12:0/941462264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x560308838ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa063fff640 1 --2- 172.21.15.12:0/941462264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x5603088460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06b7fe640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0580a3460 0x7fa0580a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06affd640 1 -- 172.21.15.12:0/941462264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 msgr2=0x560308838ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06affd640 1 --2- 172.21.15.12:0/941462264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x560308838ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06affd640 1 -- 172.21.15.12:0/941462264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 msgr2=0x5603088460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:11.906 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06affd640 1 --2- 172.21.15.12:0/941462264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x5603088460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06affd640 1 -- 172.21.15.12:0/941462264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560308744340 con 0x560308839410 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa068ff9640 1 -- 172.21.15.12:0/3863113801 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7fa0640f0b40 con 0x7fa06c10c110 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa063fff640 1 --2- 172.21.15.12:0/941462264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x5603088460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06affd640 1 --2- 172.21.15.12:0/941462264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308843770 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00ac10 tx=0x7fa05c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda67f1ec5310fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa06b7fe640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0580a3460 0x7fa0580a5920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa0640ee380 tx=0x7fa06408ebe0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa0617fa640 1 -- 172.21.15.12:0/941462264 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c01d070 con 0x560308839410 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa0617fa640 1 -- 172.21.15.12:0/941462264 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa05c018b20 con 0x560308839410 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.900+0000 7fa0617fa640 1 -- 172.21.15.12:0/941462264 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c010b40 con 0x560308839410 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.901+0000 7fa07407c740 1 -- 172.21.15.12:0/941462264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 msgr2=0x560308843770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.901+0000 7fa07407c740 1 --2- 172.21.15.12:0/941462264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308843770 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00ac10 tx=0x7fa05c00f790 comp rx=0 tx=0).stop 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.901+0000 7fa07407c740 1 -- 172.21.15.12:0/941462264 shutdown_connections 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.901+0000 7fa07407c740 1 --2- 172.21.15.12:0/941462264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x5603088460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.901+0000 7fa07407c740 1 --2- 172.21.15.12:0/941462264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308843770 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.901+0000 7fa07407c740 1 --2- 172.21.15.12:0/941462264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x560308838ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.901+0000 7fa07407c740 1 -- 172.21.15.12:0/941462264 >> 172.21.15.12:0/941462264 conn(0x560308835060 msgr2=0x560308835440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.901+0000 7fa07407c740 1 -- 172.21.15.12:0/941462264 shutdown_connections 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.901+0000 7fa07407c740 1 -- 172.21.15.12:0/941462264 wait complete. 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa07407c740 1 -- start start 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa07407c740 1 Processor -- start 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa07407c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308838af0 0x560308840b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa07407c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308839410 0x5603088410d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa07407c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308843cb0 0x560308841610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa07407c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560308846880 con 0x560308838af0 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa07407c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560308726290 con 0x560308839410 2024-09-19T06:50:11.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa07407c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560308846a00 con 0x560308843cb0 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa07407c740 10 client.0 _ll_register_callbacks cb 0x560308757140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa063fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308838af0 0x560308840b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa063fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308838af0 0x560308840b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43030/0 (socket says 172.21.15.12:43030) 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa063fff640 1 -- 172.21.15.12:0/3748885657 learned_addr learned my addr 172.21.15.12:0/3748885657 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa06affd640 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308839410 0x5603088410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa063fff640 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308843cb0 0x560308841610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa063fff640 1 -- 172.21.15.12:0/3748885657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308843cb0 msgr2=0x560308841610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa063fff640 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308843cb0 0x560308841610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa063fff640 1 -- 172.21.15.12:0/3748885657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308839410 msgr2=0x5603088410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa063fff640 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308839410 0x5603088410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa063fff640 1 -- 172.21.15.12:0/3748885657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603084b0210 con 0x560308838af0 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa06affd640 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308839410 0x5603088410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:11.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa063fff640 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308838af0 0x560308840b90 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa0540042f0 tx=0x7fa0540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bde2b4c1e61bc63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa0527fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.902+0000 7fa0527fc640 1 -- 172.21.15.12:0/3748885657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054005220 con 0x560308838af0 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa0527fc640 1 -- 172.21.15.12:0/3748885657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7fa0540053c0 con 0x560308838af0 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa07407c740 1 -- 172.21.15.12:0/3748885657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa05c018b20 con 0x560308838af0 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa0527fc640 1 -- 172.21.15.12:0/3748885657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fa0540055c0 con 0x560308838af0 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa07407c740 10 client.18216 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa07407c740 1 -- 172.21.15.12:0/3748885657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56030857c620 con 0x560308838af0 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa0527fc640 1 -- 172.21.15.12:0/3748885657 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa05c018b20 con 0x560308838af0 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa0527fc640 1 -- 172.21.15.12:0/3748885657 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fa054010a80 con 0x560308838af0 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa07407c740 10 client.18216 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa07407c740 10 client.18216 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa07407c740 20 client.18216 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:11.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa07407c740 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560308853c20 0x560308856030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa07407c740 4 client.18216 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa07407c740 1 -- 172.21.15.12:0/3748885657 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603087aaa20 con 0x560308853c20 2024-09-19T06:50:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.903+0000 7fa06affd640 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560308853c20 0x560308856030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.904+0000 7fa0527fc640 10 client.18216 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:11.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.904+0000 7fa06affd640 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560308853c20 0x560308856030 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c4e43913b36f26 server_cookie=4e671ef86ea9745a in_seq=0 out_seq=0 2024-09-19T06:50:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa0527fc640 1 -- 172.21.15.12:0/3748885657 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603087aaa20 con 0x560308853c20 2024-09-19T06:50:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa0527fc640 10 client.18216 handle_command_reply: tid=0 2024-09-19T06:50:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 client.18216 shutdown 2024-09-19T06:50:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 -- 172.21.15.12:0/3748885657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308838af0 msgr2=0x560308840b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308838af0 0x560308840b90 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa0540042f0 tx=0x7fa0540046c0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 -- 172.21.15.12:0/3748885657 shutdown_connections 2024-09-19T06:50:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560308853c20 0x560308856030 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308843cb0 0x560308841610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa0527fc640 0 client.18216 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308839410 0x5603088410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 --2- 172.21.15.12:0/3748885657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308838af0 0x560308840b90 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 -- 172.21.15.12:0/3748885657 >> 172.21.15.12:0/3748885657 conn(0x560308835060 msgr2=0x56030883ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 -- 172.21.15.12:0/3748885657 shutdown_connections 2024-09-19T06:50:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 1 -- 172.21.15.12:0/3748885657 wait complete. 2024-09-19T06:50:11.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.905+0000 7fa07407c740 20 client.18216 trim_cache size 0 max 16384 2024-09-19T06:50:11.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.919+0000 7fa07407c740 1 Processor -- start 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.919+0000 7fa07407c740 1 -- start start 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.919+0000 7fa07407c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x56030883b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.919+0000 7fa07407c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308841440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.919+0000 7fa07407c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x56030885b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.919+0000 7fa07407c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1afcc0 con 0x560308839410 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.919+0000 7fa07407c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1b1800 con 0x560308843cb0 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.919+0000 7fa07407c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1b0390 con 0x560308838af0 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa06affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308841440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa06affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308841440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43034/0 (socket says 172.21.15.12:43034) 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa06affd640 1 -- 172.21.15.12:0/2616951873 learned_addr learned my addr 172.21.15.12:0/2616951873 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa063fff640 1 --2- 172.21.15.12:0/2616951873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x56030885b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa063fff640 1 --2- 172.21.15.12:0/2616951873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x56030883b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa06affd640 1 -- 172.21.15.12:0/2616951873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 msgr2=0x56030883b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa06affd640 1 --2- 172.21.15.12:0/2616951873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x56030883b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa06affd640 1 -- 172.21.15.12:0/2616951873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 msgr2=0x56030885b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa06affd640 1 --2- 172.21.15.12:0/2616951873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x56030885b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa06affd640 1 -- 172.21.15.12:0/2616951873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560308838870 con 0x560308839410 2024-09-19T06:50:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa063fff640 1 --2- 172.21.15.12:0/2616951873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x56030883b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa06affd640 1 --2- 172.21.15.12:0/2616951873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308841440 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00fc90 tx=0x7fa05c00af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a7dbbe3ffbca95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa060ff9640 1 -- 172.21.15.12:0/2616951873 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c01d040 con 0x560308839410 2024-09-19T06:50:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa060ff9640 1 -- 172.21.15.12:0/2616951873 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa05c004020 con 0x560308839410 2024-09-19T06:50:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.920+0000 7fa060ff9640 1 -- 172.21.15.12:0/2616951873 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c005400 con 0x560308839410 2024-09-19T06:50:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 -- 172.21.15.12:0/2616951873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 msgr2=0x560308841440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 --2- 172.21.15.12:0/2616951873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308841440 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00fc90 tx=0x7fa05c00af10 comp rx=0 tx=0).stop 2024-09-19T06:50:11.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 -- 172.21.15.12:0/2616951873 shutdown_connections 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 --2- 172.21.15.12:0/2616951873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x56030885b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 --2- 172.21.15.12:0/2616951873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308841440 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 --2- 172.21.15.12:0/2616951873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x56030883b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 -- 172.21.15.12:0/2616951873 >> 172.21.15.12:0/2616951873 conn(0x560308835060 msgr2=0x560308842c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 -- 172.21.15.12:0/2616951873 shutdown_connections 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 -- 172.21.15.12:0/2616951873 wait complete. 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 -- start start 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.921+0000 7fa07407c740 1 Processor -- start 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa07407c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x5603088479e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa07407c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308847f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.927 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa07407c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x560308848460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa07407c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1b1130 con 0x560308839410 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa07407c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1b0a60 con 0x560308843cb0 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa07407c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1adcc0 con 0x560308838af0 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa07407c740 10 client.0 _ll_register_callbacks cb 0x7fa05400bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa06affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308847f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa06affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308847f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43042/0 (socket says 172.21.15.12:43042) 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa06affd640 1 -- 172.21.15.12:0/1408427229 learned_addr learned my addr 172.21.15.12:0/1408427229 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa063fff640 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x560308848460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa063fff640 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x5603088479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa06affd640 1 -- 172.21.15.12:0/1408427229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 msgr2=0x5603088479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa06affd640 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x5603088479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa06affd640 1 -- 172.21.15.12:0/1408427229 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 msgr2=0x560308848460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:11.928 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa06affd640 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x560308848460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa06affd640 1 -- 172.21.15.12:0/1408427229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603088bd910 con 0x560308839410 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa06affd640 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308847f20 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fa05c01b040 tx=0x7fa05c00a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ca421ac04bfb65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa0527fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa0527fc640 1 -- 172.21.15.12:0/1408427229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c033070 con 0x560308839410 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa0527fc640 1 -- 172.21.15.12:0/1408427229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7fa05c0043d0 con 0x560308839410 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.922+0000 7fa07407c740 1 -- 172.21.15.12:0/1408427229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa05c004020 con 0x560308839410 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa0527fc640 1 -- 172.21.15.12:0/1408427229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fa05c03f050 con 0x560308839410 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa07407c740 10 client.18222 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa07407c740 1 -- 172.21.15.12:0/1408427229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5603088bebd0 con 0x560308839410 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa0527fc640 1 -- 172.21.15.12:0/1408427229 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa05c004020 con 0x560308839410 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa0527fc640 1 -- 172.21.15.12:0/1408427229 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fa05c02b030 con 0x560308839410 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa07407c740 10 client.18222 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:11.929 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa07407c740 10 client.18222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa07407c740 20 client.18222 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa07407c740 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5603088bf0f0 0x5603088c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa07407c740 4 client.18222 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:50:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa07407c740 1 -- 172.21.15.12:0/1408427229 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5603087a4d70 con 0x5603088bf0f0 2024-09-19T06:50:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.923+0000 7fa063fff640 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5603088bf0f0 0x5603088c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.924+0000 7fa0527fc640 10 client.18222 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:11.930 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.924+0000 7fa063fff640 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5603088bf0f0 0x5603088c1510 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12e2ea7f93975c61 server_cookie=e88e8e042be414f in_seq=0 out_seq=0 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa0527fc640 1 -- 172.21.15.12:0/1408427229 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5603087a4d70 con 0x5603088bf0f0 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa0527fc640 10 client.18222 handle_command_reply: tid=0 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 client.18222 shutdown 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 -- 172.21.15.12:0/1408427229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 msgr2=0x560308847f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308847f20 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fa05c01b040 tx=0x7fa05c00a6c0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 -- 172.21.15.12:0/1408427229 shutdown_connections 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5603088bf0f0 0x5603088c1510 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560308843cb0 0x560308848460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560308839410 0x560308847f20 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 --2- 172.21.15.12:0/1408427229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560308838af0 0x5603088479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 -- 172.21.15.12:0/1408427229 >> 172.21.15.12:0/1408427229 conn(0x560308835060 msgr2=0x5603088339a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa0527fc640 0 client.18222 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 -- 172.21.15.12:0/1408427229 shutdown_connections 2024-09-19T06:50:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 1 -- 172.21.15.12:0/1408427229 wait complete. 2024-09-19T06:50:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.936+0000 7fa07407c740 20 client.18222 trim_cache size 0 max 16384 2024-09-19T06:50:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:50:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:50:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:50:11.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:50:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 -- 172.21.15.12:0/3863113801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0580a3460 msgr2=0x7fa0580a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0580a3460 0x7fa0580a5920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa0640ee380 tx=0x7fa06408ebe0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 -- 172.21.15.12:0/3863113801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa06c10c110 msgr2=0x7fa06c101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa06c10c110 0x7fa06c101390 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fa064009dc0 tx=0x7fa064003f10 comp rx=0 tx=0).stop 2024-09-19T06:50:11.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 -- 172.21.15.12:0/3863113801 shutdown_connections 2024-09-19T06:50:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa06c10c110 0x7fa06c101390 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0580a3460 0x7fa0580a5920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa06c1035e0 0x7fa06c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 --2- 172.21.15.12:0/3863113801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa06c102cc0 0x7fa06c100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 -- 172.21.15.12:0/3863113801 >> 172.21.15.12:0/3863113801 conn(0x7fa06c0fc6b0 msgr2=0x7fa06c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 -- 172.21.15.12:0/3863113801 shutdown_connections 2024-09-19T06:50:11.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:11.937+0000 7fa0712dd640 1 -- 172.21.15.12:0/3863113801 wait complete. 2024-09-19T06:50:12.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:12 smithi012 ceph-mon[30937]: pgmap v311: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.54k op/s 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.145+0000 7f3342a3d640 1 -- 172.21.15.12:0/2668971953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c10c170 msgr2=0x7f333c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.145+0000 7f3342a3d640 1 --2- 172.21.15.12:0/2668971953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c10c170 0x7f333c10e610 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3334009ca0 tx=0x7f333402a950 comp rx=0 tx=0).stop 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.146+0000 7f3342a3d640 1 -- 172.21.15.12:0/2668971953 shutdown_connections 2024-09-19T06:50:12.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.146+0000 7f3342a3d640 1 --2- 172.21.15.12:0/2668971953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c10c170 0x7f333c10e610 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.146+0000 7f3342a3d640 1 --2- 172.21.15.12:0/2668971953 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f333c103660 0x7f333c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.146+0000 7f3342a3d640 1 --2- 172.21.15.12:0/2668971953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f333c102d40 0x7f333c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.146+0000 7f3342a3d640 1 -- 172.21.15.12:0/2668971953 >> 172.21.15.12:0/2668971953 conn(0x7f333c0fc7a0 msgr2=0x7f333c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.146+0000 7f3342a3d640 1 -- 172.21.15.12:0/2668971953 shutdown_connections 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.146+0000 7f3342a3d640 1 -- 172.21.15.12:0/2668971953 wait complete. 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.146+0000 7f3342a3d640 1 Processor -- start 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.146+0000 7f3342a3d640 1 -- start start 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3342a3d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f333c102d40 0x7f333c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3342a3d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f333c103660 0x7f333c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3342a3d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c10c170 0x7f333c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3342a3d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f333c111f30 con 0x7f333c10c170 2024-09-19T06:50:12.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3342a3d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f333c111db0 con 0x7f333c102d40 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3342a3d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1120b0 con 0x7f333c103660 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3340fda640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c10c170 0x7f333c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3340fda640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c10c170 0x7f333c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43056/0 (socket says 172.21.15.12:43056) 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3340fda640 1 -- 172.21.15.12:0/2072024159 learned_addr learned my addr 172.21.15.12:0/2072024159 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f333b7fe640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f333c103660 0x7f333c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f333bfff640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f333c102d40 0x7f333c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3340fda640 1 -- 172.21.15.12:0/2072024159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f333c103660 msgr2=0x7f333c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3340fda640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f333c103660 0x7f333c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3340fda640 1 -- 172.21.15.12:0/2072024159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f333c102d40 msgr2=0x7f333c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3340fda640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f333c102d40 0x7f333c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3340fda640 1 -- 172.21.15.12:0/2072024159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c1a6900 con 0x7f333c10c170 2024-09-19T06:50:12.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.147+0000 7f3340fda640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c10c170 0x7f333c101420 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f333402ae70 tx=0x7f333402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.148+0000 7f33397fa640 1 -- 172.21.15.12:0/2072024159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334034040 con 0x7f333c10c170 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.148+0000 7f33397fa640 1 -- 172.21.15.12:0/2072024159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3334030920 con 0x7f333c10c170 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.148+0000 7f3342a3d640 1 -- 172.21.15.12:0/2072024159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c1a6b90 con 0x7f333c10c170 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.148+0000 7f33397fa640 1 -- 172.21.15.12:0/2072024159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334045480 con 0x7f333c10c170 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.148+0000 7f3342a3d640 1 -- 172.21.15.12:0/2072024159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c1a7070 con 0x7f333c10c170 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.150+0000 7f33397fa640 1 -- 172.21.15.12:0/2072024159 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3334037020 con 0x7f333c10c170 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.150+0000 7f3344e16740 1 Processor -- start 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.150+0000 7f3344e16740 1 -- start start 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.150+0000 7f3344e16740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 0x55c197a10090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.150+0000 7f3344e16740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a105d0 0x55c197a10a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f3344e16740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a1d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f3344e16740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c1979762f0 con 0x55c197a1b370 2024-09-19T06:50:12.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f3344e16740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c19791dcf0 con 0x55c197a105d0 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f3344e16740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c1979722b0 con 0x55c197a11b40 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a1d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f33397fa640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33240a33b0 0x7f33240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a1d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43072/0 (socket says 172.21.15.12:43072) 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333b7fe640 1 -- 172.21.15.12:0/3847917056 learned_addr learned my addr 172.21.15.12:0/3847917056 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333bfff640 1 --2- 172.21.15.12:0/3847917056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a105d0 0x55c197a10a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333b7fe640 1 --2- 172.21.15.12:0/3847917056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 0x55c197a10090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f3340fda640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33240a33b0 0x7f33240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333b7fe640 1 -- 172.21.15.12:0/3847917056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 msgr2=0x55c197a10090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333b7fe640 1 --2- 172.21.15.12:0/3847917056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 0x55c197a10090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333b7fe640 1 -- 172.21.15.12:0/3847917056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a105d0 msgr2=0x55c197a10a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333b7fe640 1 --2- 172.21.15.12:0/3847917056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a105d0 0x55c197a10a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333b7fe640 1 -- 172.21.15.12:0/3847917056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1979023a0 con 0x55c197a1b370 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f33397fa640 1 -- 172.21.15.12:0/2072024159 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7f33340f0bc0 con 0x7f333c10c170 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f333b7fe640 1 --2- 172.21.15.12:0/3847917056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a1d760 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f3330012710 tx=0x7f333000b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a4625be7dce1eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f33227fc640 1 -- 172.21.15.12:0/3847917056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330012c90 con 0x55c197a1b370 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f3340fda640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33240a33b0 0x7f33240a5870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3334009430 tx=0x7f333404e000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f33227fc640 1 -- 172.21.15.12:0/3847917056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3330012e30 con 0x55c197a1b370 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.151+0000 7f33227fc640 1 -- 172.21.15.12:0/3847917056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33300037f0 con 0x55c197a1b370 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.152+0000 7f3344e16740 1 -- 172.21.15.12:0/3847917056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 msgr2=0x55c197a1d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.152+0000 7f3344e16740 1 --2- 172.21.15.12:0/3847917056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a1d760 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f3330012710 tx=0x7f333000b5a0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.152+0000 7f3344e16740 1 -- 172.21.15.12:0/3847917056 shutdown_connections 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.152+0000 7f3344e16740 1 --2- 172.21.15.12:0/3847917056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a1d760 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.152+0000 7f3344e16740 1 --2- 172.21.15.12:0/3847917056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a105d0 0x55c197a10a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.152+0000 7f3344e16740 1 --2- 172.21.15.12:0/3847917056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 0x55c197a10090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.152+0000 7f3344e16740 1 -- 172.21.15.12:0/3847917056 >> 172.21.15.12:0/3847917056 conn(0x55c1979d9310 msgr2=0x55c197a0cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.152+0000 7f3344e16740 1 -- 172.21.15.12:0/3847917056 shutdown_connections 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.152+0000 7f3344e16740 1 -- 172.21.15.12:0/3847917056 wait complete. 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f3344e16740 1 -- start start 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f3344e16740 1 Processor -- start 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f3344e16740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a1ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f3344e16740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 0x55c197a18020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f3344e16740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a1b370 0x55c197a18610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f3344e16740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c197a1e070 con 0x55c197a105d0 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f3344e16740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c197931060 con 0x55c197a11b40 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f3344e16740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c197a1e1f0 con 0x55c197a1b370 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f3344e16740 10 client.0 _ll_register_callbacks cb 0x55c1976848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f333b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a1ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f333b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a1ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43080/0 (socket says 172.21.15.12:43080) 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f333b7fe640 1 -- 172.21.15.12:0/1313890088 learned_addr learned my addr 172.21.15.12:0/1313890088 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f333bfff640 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 0x55c197a18020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.153+0000 7f333b7fe640 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a1b370 0x55c197a18610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f333b7fe640 1 -- 172.21.15.12:0/1313890088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a1b370 msgr2=0x55c197a18610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f333b7fe640 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a1b370 0x55c197a18610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f333b7fe640 1 -- 172.21.15.12:0/1313890088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 msgr2=0x55c197a18020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f333b7fe640 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 0x55c197a18020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f333b7fe640 1 -- 172.21.15.12:0/1313890088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1976e73c0 con 0x55c197a105d0 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f333b7fe640 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a1ad70 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3330015040 tx=0x7f3330010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3837472c89671553 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f331b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f331b7fe640 1 -- 172.21.15.12:0/1313890088 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330012c90 con 0x55c197a105d0 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f331b7fe640 1 -- 172.21.15.12:0/1313890088 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7f3330004430 con 0x55c197a105d0 2024-09-19T06:50:12.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f3344e16740 1 -- 172.21.15.12:0/1313890088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3330012e30 con 0x55c197a105d0 2024-09-19T06:50:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f331b7fe640 1 -- 172.21.15.12:0/1313890088 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3330005040 con 0x55c197a105d0 2024-09-19T06:50:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f3344e16740 10 client.18234 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f3344e16740 1 -- 172.21.15.12:0/1313890088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c197a29b40 con 0x55c197a105d0 2024-09-19T06:50:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.154+0000 7f331b7fe640 1 -- 172.21.15.12:0/1313890088 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3330012e30 con 0x55c197a105d0 2024-09-19T06:50:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.155+0000 7f331b7fe640 1 -- 172.21.15.12:0/1313890088 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f3330004bf0 con 0x55c197a105d0 2024-09-19T06:50:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.155+0000 7f3344e16740 10 client.18234 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.155+0000 7f3344e16740 10 client.18234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.155+0000 7f3344e16740 20 client.18234 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.155+0000 7f3344e16740 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c197a2ae90 0x55c197a2d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.155+0000 7f3344e16740 4 client.18234 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.155+0000 7f3344e16740 1 -- 172.21.15.12:0/1313890088 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c197983860 con 0x55c197a2ae90 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.155+0000 7f333bfff640 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c197a2ae90 0x55c197a2d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.155+0000 7f331b7fe640 10 client.18234 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.155+0000 7f333bfff640 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c197a2ae90 0x55c197a2d280 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cd65c50e7367e6c server_cookie=c1fb464c279e8d6f in_seq=0 out_seq=0 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f331b7fe640 1 -- 172.21.15.12:0/1313890088 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c197983860 con 0x55c197a2ae90 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f331b7fe640 10 client.18234 handle_command_reply: tid=0 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 client.18234 shutdown 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 -- 172.21.15.12:0/1313890088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 msgr2=0x55c197a1ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a1ad70 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3330015040 tx=0x7f3330010e80 comp rx=0 tx=0).stop 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 -- 172.21.15.12:0/1313890088 shutdown_connections 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c197a2ae90 0x55c197a2d280 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a1b370 0x55c197a18610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 0x55c197a18020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 --2- 172.21.15.12:0/1313890088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a1ad70 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 -- 172.21.15.12:0/1313890088 >> 172.21.15.12:0/1313890088 conn(0x55c1979d9310 msgr2=0x55c197a12960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f331b7fe640 0 client.18234 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 -- 172.21.15.12:0/1313890088 shutdown_connections 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 1 -- 172.21.15.12:0/1313890088 wait complete. 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.156+0000 7f3344e16740 20 client.18234 trim_cache size 0 max 16384 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f3344e16740 1 Processor -- start 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f3344e16740 1 -- start start 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f3344e16740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a105d0 0x55c197a27340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f3344e16740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 0x55c197a32a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f3344e16740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a32f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f3344e16740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1afd90 con 0x55c197a1b370 2024-09-19T06:50:12.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f3344e16740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1b18d0 con 0x55c197a11b40 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f3344e16740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1b0460 con 0x55c197a105d0 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 0x55c197a32a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 0x55c197a32a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45318/0 (socket says 172.21.15.12:45318) 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333bfff640 1 -- 172.21.15.12:0/4258166532 learned_addr learned my addr 172.21.15.12:0/4258166532 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333b7fe640 1 --2- 172.21.15.12:0/4258166532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a105d0 0x55c197a27340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333b7fe640 1 --2- 172.21.15.12:0/4258166532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a32f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333bfff640 1 -- 172.21.15.12:0/4258166532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a105d0 msgr2=0x55c197a27340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333bfff640 1 --2- 172.21.15.12:0/4258166532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a105d0 0x55c197a27340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333bfff640 1 -- 172.21.15.12:0/4258166532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 msgr2=0x55c197a32f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333bfff640 1 --2- 172.21.15.12:0/4258166532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a32f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333bfff640 1 -- 172.21.15.12:0/4258166532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c197a16570 con 0x55c197a11b40 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.170+0000 7f333b7fe640 1 --2- 172.21.15.12:0/4258166532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a32f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f333bfff640 1 --2- 172.21.15.12:0/4258166532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 0x55c197a32a40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f332c004650 tx=0x7f332c00b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8e985f53310c874 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f3321ffb640 1 -- 172.21.15.12:0/4258166532 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c003d00 con 0x55c197a11b40 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f3321ffb640 1 -- 172.21.15.12:0/4258166532 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f332c011920 con 0x55c197a11b40 2024-09-19T06:50:12.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f3321ffb640 1 -- 172.21.15.12:0/4258166532 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0269e0 con 0x55c197a11b40 2024-09-19T06:50:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f3344e16740 1 -- 172.21.15.12:0/4258166532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 msgr2=0x55c197a32a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f3344e16740 1 --2- 172.21.15.12:0/4258166532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 0x55c197a32a40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f332c004650 tx=0x7f332c00b390 comp rx=0 tx=0).stop 2024-09-19T06:50:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f3344e16740 1 -- 172.21.15.12:0/4258166532 shutdown_connections 2024-09-19T06:50:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f3344e16740 1 --2- 172.21.15.12:0/4258166532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a1b370 0x55c197a32f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f3344e16740 1 --2- 172.21.15.12:0/4258166532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a11b40 0x55c197a32a40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f3344e16740 1 --2- 172.21.15.12:0/4258166532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a105d0 0x55c197a27340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.171+0000 7f3344e16740 1 -- 172.21.15.12:0/4258166532 >> 172.21.15.12:0/4258166532 conn(0x55c1979d9310 msgr2=0x55c197a17110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.172+0000 7f3344e16740 1 -- 172.21.15.12:0/4258166532 shutdown_connections 2024-09-19T06:50:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.172+0000 7f3344e16740 1 -- 172.21.15.12:0/4258166532 wait complete. 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.172+0000 7f3344e16740 1 -- start start 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.172+0000 7f3344e16740 1 Processor -- start 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.172+0000 7f3344e16740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a23ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.172+0000 7f3344e16740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 0x55c197a1edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.172+0000 7f3344e16740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a1b370 0x55c197a1f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.172+0000 7f3344e16740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1b1200 con 0x55c197a105d0 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.172+0000 7f3344e16740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1b0b30 con 0x55c197a1b370 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.172+0000 7f3344e16740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1add90 con 0x55c197a11b40 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a23ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a23ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43096/0 (socket says 172.21.15.12:43096) 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333b7fe640 1 -- 172.21.15.12:0/1791339933 learned_addr learned my addr 172.21.15.12:0/1791339933 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333bfff640 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 0x55c197a1edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f3344e16740 10 client.0 _ll_register_callbacks cb 0x7f332c00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333b7fe640 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a1b370 0x55c197a1f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333bfff640 1 -- 172.21.15.12:0/1791339933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a1b370 msgr2=0x55c197a1f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333bfff640 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a1b370 0x55c197a1f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333bfff640 1 -- 172.21.15.12:0/1791339933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 msgr2=0x55c197a23ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333bfff640 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a23ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333bfff640 1 -- 172.21.15.12:0/1791339933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c197a1fa20 con 0x55c197a11b40 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333b7fe640 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a1b370 0x55c197a1f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f333bfff640 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 0x55c197a1edf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f332c005940 tx=0x7f332c026410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40be45c694b607e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f331b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f331b7fe640 1 -- 172.21.15.12:0/1791339933 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c011ad0 con 0x55c197a11b40 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f331b7fe640 1 -- 172.21.15.12:0/1791339933 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7f332c011c70 con 0x55c197a11b40 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.173+0000 7f3344e16740 1 -- 172.21.15.12:0/1791339933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f332c011920 con 0x55c197a11b40 2024-09-19T06:50:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f331b7fe640 1 -- 172.21.15.12:0/1791339933 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f332c003b00 con 0x55c197a11b40 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f3344e16740 10 client.27598 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f3344e16740 1 -- 172.21.15.12:0/1791339933 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c197a958b0 con 0x55c197a11b40 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f331b7fe640 1 -- 172.21.15.12:0/1791339933 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f332c011920 con 0x55c197a11b40 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f331b7fe640 1 -- 172.21.15.12:0/1791339933 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f332c02e020 con 0x55c197a11b40 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f3344e16740 10 client.27598 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f3344e16740 10 client.27598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f3344e16740 20 client.27598 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f3344e16740 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c197a95f80 0x55c197a983a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f3344e16740 4 client.27598 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.174+0000 7f3344e16740 1 -- 172.21.15.12:0/1791339933 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c19797dd70 con 0x55c197a95f80 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f333b7fe640 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c197a95f80 0x55c197a983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f333b7fe640 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c197a95f80 0x55c197a983a0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5be96ceb84376373 server_cookie=1b771c8de40c0de in_seq=0 out_seq=0 2024-09-19T06:50:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f331b7fe640 10 client.27598 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f331b7fe640 1 -- 172.21.15.12:0/1791339933 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c19797dd70 con 0x55c197a95f80 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f331b7fe640 10 client.27598 handle_command_reply: tid=0 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f3344e16740 1 client.27598 shutdown 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f3344e16740 1 -- 172.21.15.12:0/1791339933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 msgr2=0x55c197a1edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f3344e16740 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 0x55c197a1edf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f332c005940 tx=0x7f332c026410 comp rx=0 tx=0).stop 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f3344e16740 1 -- 172.21.15.12:0/1791339933 shutdown_connections 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f3344e16740 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c197a95f80 0x55c197a983a0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f3344e16740 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c197a1b370 0x55c197a1f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f3344e16740 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c197a11b40 0x55c197a1edf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f331b7fe640 0 client.27598 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f3344e16740 1 --2- 172.21.15.12:0/1791339933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c197a105d0 0x55c197a23ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f3344e16740 1 -- 172.21.15.12:0/1791339933 >> 172.21.15.12:0/1791339933 conn(0x55c1979d9310 msgr2=0x55c197a0b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.175+0000 7f3344e16740 1 -- 172.21.15.12:0/1791339933 shutdown_connections 2024-09-19T06:50:12.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3344e16740 1 -- 172.21.15.12:0/1791339933 wait complete. 2024-09-19T06:50:12.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3344e16740 20 client.27598 trim_cache size 0 max 16384 2024-09-19T06:50:12.192 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:50:12.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 -- 172.21.15.12:0/2072024159 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33240a33b0 msgr2=0x7f33240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33240a33b0 0x7f33240a5870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3334009430 tx=0x7f333404e000 comp rx=0 tx=0).stop 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 -- 172.21.15.12:0/2072024159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c10c170 msgr2=0x7f333c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c10c170 0x7f333c101420 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f333402ae70 tx=0x7f333402f5b0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 -- 172.21.15.12:0/2072024159 shutdown_connections 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f333c10c170 0x7f333c101420 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33240a33b0 0x7f33240a5870 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f333c103660 0x7f333c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 --2- 172.21.15.12:0/2072024159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f333c102d40 0x7f333c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 -- 172.21.15.12:0/2072024159 >> 172.21.15.12:0/2072024159 conn(0x7f333c0fc7a0 msgr2=0x7f333c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 -- 172.21.15.12:0/2072024159 shutdown_connections 2024-09-19T06:50:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:12.176+0000 7f3342a3d640 1 -- 172.21.15.12:0/2072024159 wait complete. 2024-09-19T06:50:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:12 smithi173 ceph-mon[35349]: pgmap v311: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.54k op/s 2024-09-19T06:50:12.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:12 smithi016 ceph-mon[34911]: pgmap v311: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.54k op/s 2024-09-19T06:50:14.051 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:50:14.051 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:50:14.326 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:14 smithi173 ceph-mon[35349]: pgmap v312: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.54k op/s 2024-09-19T06:50:14.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:14 smithi012 ceph-mon[30937]: pgmap v312: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.54k op/s 2024-09-19T06:50:14.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:14 smithi016 ceph-mon[34911]: pgmap v312: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.54k op/s 2024-09-19T06:50:14.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.798+0000 7fae2b96a640 1 -- 172.21.15.12:0/3123249420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae241037a0 msgr2=0x7fae2410bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:14.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.798+0000 7fae2b96a640 1 --2- 172.21.15.12:0/3123249420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae241037a0 0x7fae2410bc00 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fae14009900 tx=0x7fae1402a410 comp rx=0 tx=0).stop 2024-09-19T06:50:14.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.798+0000 7fae2b96a640 1 -- 172.21.15.12:0/3123249420 shutdown_connections 2024-09-19T06:50:14.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.798+0000 7fae2b96a640 1 --2- 172.21.15.12:0/3123249420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae2410c2f0 0x7fae2410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.798+0000 7fae2b96a640 1 --2- 172.21.15.12:0/3123249420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae241037a0 0x7fae2410bc00 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.798+0000 7fae2b96a640 1 --2- 172.21.15.12:0/3123249420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae24102df0 0x7fae241031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.798+0000 7fae2b96a640 1 -- 172.21.15.12:0/3123249420 >> 172.21.15.12:0/3123249420 conn(0x7fae240fc7d0 msgr2=0x7fae240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:14.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.798+0000 7fae2b96a640 1 -- 172.21.15.12:0/3123249420 shutdown_connections 2024-09-19T06:50:14.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.798+0000 7fae2b96a640 1 -- 172.21.15.12:0/3123249420 wait complete. 2024-09-19T06:50:14.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae2b96a640 1 Processor -- start 2024-09-19T06:50:14.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae2b96a640 1 -- start start 2024-09-19T06:50:14.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae2b96a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae24102df0 0x7fae24100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae2b96a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae241037a0 0x7fae24100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae2b96a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2410c2f0 0x7fae241014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae2b96a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fae24112130 con 0x7fae241037a0 2024-09-19T06:50:14.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae2b96a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fae24111fb0 con 0x7fae24102df0 2024-09-19T06:50:14.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae2b96a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fae241122b0 con 0x7fae2410c2f0 2024-09-19T06:50:14.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae28f05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae241037a0 0x7fae24100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae28f05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae241037a0 0x7fae24100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43106/0 (socket says 172.21.15.12:43106) 2024-09-19T06:50:14.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae28f05640 1 -- 172.21.15.12:0/3830721063 learned_addr learned my addr 172.21.15.12:0/3830721063 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae29706640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae24102df0 0x7fae24100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae28f05640 1 -- 172.21.15.12:0/3830721063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2410c2f0 msgr2=0x7fae241014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae28f05640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2410c2f0 0x7fae241014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae28f05640 1 -- 172.21.15.12:0/3830721063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae24102df0 msgr2=0x7fae24100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae28f05640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae24102df0 0x7fae24100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.799+0000 7fae28f05640 1 -- 172.21.15.12:0/3830721063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae241a6b50 con 0x7fae241037a0 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.800+0000 7fae28f05640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae241037a0 0x7fae24100f90 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fae14006010 tx=0x7fae140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.800+0000 7fae1a7fc640 1 -- 172.21.15.12:0/3830721063 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1403f030 con 0x7fae241037a0 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.800+0000 7fae1a7fc640 1 -- 172.21.15.12:0/3830721063 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae14003ce0 con 0x7fae241037a0 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.800+0000 7fae2b96a640 1 -- 172.21.15.12:0/3830721063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae241a6de0 con 0x7fae241037a0 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.800+0000 7fae1a7fc640 1 -- 172.21.15.12:0/3830721063 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14035070 con 0x7fae241037a0 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.800+0000 7fae2b96a640 1 -- 172.21.15.12:0/3830721063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae241a7230 con 0x7fae241037a0 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.802+0000 7fae1a7fc640 1 -- 172.21.15.12:0/3830721063 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fae14042030 con 0x7fae241037a0 2024-09-19T06:50:14.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae2dd43740 1 Processor -- start 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae2dd43740 1 -- start start 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7adcb60 0x5581d7adcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7ae7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7ae7d40 0x5581d7aea130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae2dd43740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5581d7a42280 con 0x5581d7adcb60 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae2dd43740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5581d79e9b10 con 0x5581d7add480 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae2dd43740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5581d7a3e240 con 0x5581d7ae7d40 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae29f07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7adcb60 0x5581d7adcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae1a7fc640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae100a3430 0x7fae100a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae29f07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7adcb60 0x5581d7adcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43118/0 (socket says 172.21.15.12:43118) 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae29f07640 1 -- 172.21.15.12:0/3844576658 learned_addr learned my addr 172.21.15.12:0/3844576658 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:14.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae28f05640 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7ae7d40 0x5581d7aea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.803+0000 7fae29706640 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7ae7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae29f07640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae100a3430 0x7fae100a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae1a7fc640 1 -- 172.21.15.12:0/3830721063 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7fae140f03f0 con 0x7fae241037a0 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae29f07640 1 -- 172.21.15.12:0/3844576658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7ae7d40 msgr2=0x5581d7aea130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae29f07640 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7ae7d40 0x5581d7aea130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae29f07640 1 -- 172.21.15.12:0/3844576658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 msgr2=0x5581d7ae7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae29f07640 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7ae7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae29f07640 1 -- 172.21.15.12:0/3844576658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581d79f61f0 con 0x5581d7adcb60 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae29706640 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7ae7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae28f05640 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7ae7d40 0x5581d7aea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae29f07640 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7adcb60 0x5581d7adcf40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fae1c013850 tx=0x7fae1c013d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab31c43df3f61e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae0f7fe640 1 -- 172.21.15.12:0/3844576658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c020070 con 0x5581d7adcb60 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae0f7fe640 1 -- 172.21.15.12:0/3844576658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1c01bc90 con 0x5581d7adcb60 2024-09-19T06:50:14.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.804+0000 7fae0f7fe640 1 -- 172.21.15.12:0/3844576658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c01adb0 con 0x5581d7adcb60 2024-09-19T06:50:14.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 -- 172.21.15.12:0/3844576658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7adcb60 msgr2=0x5581d7adcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:14.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae29f07640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae100a3430 0x7fae100a58f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae1c01d000 tx=0x7fae1c01b000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:14.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7adcb60 0x5581d7adcf40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fae1c013850 tx=0x7fae1c013d10 comp rx=0 tx=0).stop 2024-09-19T06:50:14.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 -- 172.21.15.12:0/3844576658 shutdown_connections 2024-09-19T06:50:14.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7ae7d40 0x5581d7aea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7ae7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 --2- 172.21.15.12:0/3844576658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7adcb60 0x5581d7adcf40 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 -- 172.21.15.12:0/3844576658 >> 172.21.15.12:0/3844576658 conn(0x5581d7ad90f0 msgr2=0x5581d7ad94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:14.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 -- 172.21.15.12:0/3844576658 shutdown_connections 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 -- 172.21.15.12:0/3844576658 wait complete. 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 -- start start 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.805+0000 7fae2dd43740 1 Processor -- start 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 0x5581d7ae4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7ae5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ae5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae2dd43740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5581d7aea910 con 0x5581d7ae7d40 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae2dd43740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5581d79fcf10 con 0x5581d7add480 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae2dd43740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5581d7aeaa90 con 0x5581d7adcb60 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae2dd43740 10 client.0 _ll_register_callbacks cb 0x5581d79c5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae29f07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ae5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae29f07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ae5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43132/0 (socket says 172.21.15.12:43132) 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae29f07640 1 -- 172.21.15.12:0/1876882751 learned_addr learned my addr 172.21.15.12:0/1876882751 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae29706640 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 0x5581d7ae4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae28f05640 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7ae5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae29f07640 1 -- 172.21.15.12:0/1876882751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 msgr2=0x5581d7ae4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae29f07640 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 0x5581d7ae4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae29f07640 1 -- 172.21.15.12:0/1876882751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 msgr2=0x5581d7ae5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae29f07640 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7ae5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae29f07640 1 -- 172.21.15.12:0/1876882751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581d77b36a0 con 0x5581d7ae7d40 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.806+0000 7fae29706640 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 0x5581d7ae4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae29f07640 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ae5680 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fae1c01a950 tx=0x7fae1c005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8f71d846ba7d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:14.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae0cff9640 1 -- 172.21.15.12:0/1876882751 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c020050 con 0x5581d7ae7d40 2024-09-19T06:50:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae0cff9640 1 -- 172.21.15.12:0/1876882751 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7fae1c007da0 con 0x5581d7ae7d40 2024-09-19T06:50:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae2dd43740 1 -- 172.21.15.12:0/1876882751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae1c01bc90 con 0x5581d7ae7d40 2024-09-19T06:50:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae0cff9640 1 -- 172.21.15.12:0/1876882751 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fae1c010ca0 con 0x5581d7ae7d40 2024-09-19T06:50:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae2dd43740 10 client.18252 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae2dd43740 1 -- 172.21.15.12:0/1876882751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5581d7af6520 con 0x5581d7ae7d40 2024-09-19T06:50:14.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae0cff9640 1 -- 172.21.15.12:0/1876882751 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1c01bc90 con 0x5581d7ae7d40 2024-09-19T06:50:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae0cff9640 1 -- 172.21.15.12:0/1876882751 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fae1c035030 con 0x5581d7ae7d40 2024-09-19T06:50:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae2dd43740 10 client.18252 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae2dd43740 10 client.18252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae2dd43740 20 client.18252 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.807+0000 7fae2dd43740 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5581d7af79e0 0x5581d7af9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.808+0000 7fae2dd43740 4 client.18252 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:14.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.808+0000 7fae2dd43740 1 -- 172.21.15.12:0/1876882751 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581d7a4f7f0 con 0x5581d7af79e0 2024-09-19T06:50:14.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.808+0000 7fae29706640 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5581d7af79e0 0x5581d7af9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.808+0000 7fae29706640 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5581d7af79e0 0x5581d7af9dd0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1373fcfdfa359a1 server_cookie=aced8b488af31b07 in_seq=0 out_seq=0 2024-09-19T06:50:14.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.808+0000 7fae0cff9640 10 client.18252 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:14.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae0cff9640 1 -- 172.21.15.12:0/1876882751 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5581d7a4f7f0 con 0x5581d7af79e0 2024-09-19T06:50:14.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae0cff9640 10 client.18252 handle_command_reply: tid=0 2024-09-19T06:50:14.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 client.18252 shutdown 2024-09-19T06:50:14.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 -- 172.21.15.12:0/1876882751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 msgr2=0x5581d7ae5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:14.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ae5680 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fae1c01a950 tx=0x7fae1c005f10 comp rx=0 tx=0).stop 2024-09-19T06:50:14.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 -- 172.21.15.12:0/1876882751 shutdown_connections 2024-09-19T06:50:14.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5581d7af79e0 0x5581d7af9dd0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ae5680 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7ae5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 --2- 172.21.15.12:0/1876882751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 0x5581d7ae4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae0cff9640 0 client.18252 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:14.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 -- 172.21.15.12:0/1876882751 >> 172.21.15.12:0/1876882751 conn(0x5581d7ad90f0 msgr2=0x5581d7adee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:14.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 -- 172.21.15.12:0/1876882751 shutdown_connections 2024-09-19T06:50:14.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.809+0000 7fae2dd43740 1 -- 172.21.15.12:0/1876882751 wait complete. 2024-09-19T06:50:14.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.810+0000 7fae2dd43740 20 client.18252 trim_cache size 0 max 16384 2024-09-19T06:50:14.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae2dd43740 1 Processor -- start 2024-09-19T06:50:14.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae2dd43740 1 -- start start 2024-09-19T06:50:14.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7adcb60 0x5581d7aff590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7add480 0x5581d7affad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ad7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae2dd43740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fae241afe30 con 0x5581d7ae7d40 2024-09-19T06:50:14.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae2dd43740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fae241b1970 con 0x5581d7adcb60 2024-09-19T06:50:14.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae2dd43740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fae241b0500 con 0x5581d7add480 2024-09-19T06:50:14.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae29f07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ad7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae29f07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ad7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43148/0 (socket says 172.21.15.12:43148) 2024-09-19T06:50:14.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.827+0000 7fae29f07640 1 -- 172.21.15.12:0/3274567586 learned_addr learned my addr 172.21.15.12:0/3274567586 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae29706640 1 --2- 172.21.15.12:0/3274567586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7adcb60 0x5581d7aff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae28f05640 1 --2- 172.21.15.12:0/3274567586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7add480 0x5581d7affad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae29f07640 1 -- 172.21.15.12:0/3274567586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7add480 msgr2=0x5581d7affad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae29f07640 1 --2- 172.21.15.12:0/3274567586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7add480 0x5581d7affad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae29f07640 1 -- 172.21.15.12:0/3274567586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7adcb60 msgr2=0x5581d7aff590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae29f07640 1 --2- 172.21.15.12:0/3274567586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7adcb60 0x5581d7aff590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae29f07640 1 -- 172.21.15.12:0/3274567586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581d7ad8f20 con 0x5581d7ae7d40 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae29f07640 1 --2- 172.21.15.12:0/3274567586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ad7a50 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fae1c002230 tx=0x7fae1c013d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15a6c07e970124 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae0effd640 1 -- 172.21.15.12:0/3274567586 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c020040 con 0x5581d7ae7d40 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae0effd640 1 -- 172.21.15.12:0/3274567586 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1c01bc90 con 0x5581d7ae7d40 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.828+0000 7fae0effd640 1 -- 172.21.15.12:0/3274567586 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0247e0 con 0x5581d7ae7d40 2024-09-19T06:50:14.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 -- 172.21.15.12:0/3274567586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 msgr2=0x5581d7ad7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 --2- 172.21.15.12:0/3274567586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ad7a50 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fae1c002230 tx=0x7fae1c013d10 comp rx=0 tx=0).stop 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 -- 172.21.15.12:0/3274567586 shutdown_connections 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 --2- 172.21.15.12:0/3274567586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7ad7a50 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 --2- 172.21.15.12:0/3274567586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7add480 0x5581d7affad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 --2- 172.21.15.12:0/3274567586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7adcb60 0x5581d7aff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 -- 172.21.15.12:0/3274567586 >> 172.21.15.12:0/3274567586 conn(0x5581d7ad90f0 msgr2=0x5581d7ae6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 -- 172.21.15.12:0/3274567586 shutdown_connections 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 -- 172.21.15.12:0/3274567586 wait complete. 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 -- start start 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.829+0000 7fae2dd43740 1 Processor -- start 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 0x5581d7af0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7aeb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae2dd43740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7aebc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae2dd43740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fae241b12a0 con 0x5581d7ae7d40 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae2dd43740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fae241b0bd0 con 0x5581d7add480 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae2dd43740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fae241ade30 con 0x5581d7adcb60 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae2dd43740 10 client.0 _ll_register_callbacks cb 0x7fae1c01e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae29f07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7aebc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae29f07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7aebc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43162/0 (socket says 172.21.15.12:43162) 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae29f07640 1 -- 172.21.15.12:0/720073268 learned_addr learned my addr 172.21.15.12:0/720073268 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae29706640 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 0x5581d7af0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae28f05640 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7aeb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae29f07640 1 -- 172.21.15.12:0/720073268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 msgr2=0x5581d7af0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae29f07640 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 0x5581d7af0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae29f07640 1 -- 172.21.15.12:0/720073268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 msgr2=0x5581d7aeb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:14.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae29f07640 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7aeb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae29f07640 1 -- 172.21.15.12:0/720073268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581d7aec450 con 0x5581d7ae7d40 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae28f05640 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7aeb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae29f07640 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7aebc70 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fae1c007f10 tx=0x7fae1c0075e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a5e77fbb6ccb81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae0cff9640 1 -- 172.21.15.12:0/720073268 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c042070 con 0x5581d7ae7d40 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae0cff9640 1 -- 172.21.15.12:0/720073268 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8731+0+0 (secure 0 0 0) 0x7fae1c013250 con 0x5581d7ae7d40 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.830+0000 7fae2dd43740 1 -- 172.21.15.12:0/720073268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae1c01bc90 con 0x5581d7ae7d40 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae0cff9640 1 -- 172.21.15.12:0/720073268 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fae1c04e050 con 0x5581d7ae7d40 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae2dd43740 10 client.18258 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae2dd43740 1 -- 172.21.15.12:0/720073268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5581d7b62550 con 0x5581d7ae7d40 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae0cff9640 1 -- 172.21.15.12:0/720073268 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae1c01bc90 con 0x5581d7ae7d40 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae0cff9640 1 -- 172.21.15.12:0/720073268 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fae1c03d030 con 0x5581d7ae7d40 2024-09-19T06:50:14.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae2dd43740 10 client.18258 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae2dd43740 10 client.18258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae2dd43740 20 client.18258 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae2dd43740 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5581d7b62b50 0x5581d7b64f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae2dd43740 4 client.18258 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae2dd43740 1 -- 172.21.15.12:0/720073268 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5581d7a49d00 con 0x5581d7b62b50 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.831+0000 7fae29706640 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5581d7b62b50 0x5581d7b64f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.832+0000 7fae29706640 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5581d7b62b50 0x5581d7b64f40 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbd365e2784128d3 server_cookie=f54c476cf09d3a42 in_seq=0 out_seq=0 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.832+0000 7fae0cff9640 10 client.18258 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae0cff9640 1 -- 172.21.15.12:0/720073268 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5581d7a49d00 con 0x5581d7b62b50 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae0cff9640 10 client.18258 handle_command_reply: tid=0 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 client.18258 shutdown 2024-09-19T06:50:14.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 -- 172.21.15.12:0/720073268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 msgr2=0x5581d7aebc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7aebc70 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fae1c007f10 tx=0x7fae1c0075e0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 -- 172.21.15.12:0/720073268 shutdown_connections 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5581d7b62b50 0x5581d7b64f40 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5581d7ae7d40 0x5581d7aebc70 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5581d7add480 0x5581d7aeb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 --2- 172.21.15.12:0/720073268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5581d7adcb60 0x5581d7af0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 -- 172.21.15.12:0/720073268 >> 172.21.15.12:0/720073268 conn(0x5581d7ad90f0 msgr2=0x5581d7ad7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae0cff9640 0 client.18258 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 -- 172.21.15.12:0/720073268 shutdown_connections 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 1 -- 172.21.15.12:0/720073268 wait complete. 2024-09-19T06:50:14.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.833+0000 7fae2dd43740 20 client.18258 trim_cache size 0 max 16384 2024-09-19T06:50:14.852 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:50:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:50:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "5f7d79c9-b68b-45b8-a52f-9094394fc02e", 2024-09-19T06:50:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:50:14.852 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:50:14.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 -- 172.21.15.12:0/3830721063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae100a3430 msgr2=0x7fae100a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae100a3430 0x7fae100a58f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fae1c01d000 tx=0x7fae1c01b000 comp rx=0 tx=0).stop 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 -- 172.21.15.12:0/3830721063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae241037a0 msgr2=0x7fae24100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae241037a0 0x7fae24100f90 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fae14006010 tx=0x7fae140042f0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 -- 172.21.15.12:0/3830721063 shutdown_connections 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae100a3430 0x7fae100a58f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae2410c2f0 0x7fae241014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae241037a0 0x7fae24100f90 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 --2- 172.21.15.12:0/3830721063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae24102df0 0x7fae24100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 -- 172.21.15.12:0/3830721063 >> 172.21.15.12:0/3830721063 conn(0x7fae240fc7d0 msgr2=0x7fae240fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 -- 172.21.15.12:0/3830721063 shutdown_connections 2024-09-19T06:50:14.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:14.834+0000 7fae2b96a640 1 -- 172.21.15.12:0/3830721063 wait complete. 2024-09-19T06:50:15.258 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:50:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: 2024-09-19T06:50:14.859+0000 7f466df5b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [...10,head] /volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans/ auth{1=1,2=1,3=1,4=1} v1941 ap=3 f(v19 m2024-09-19T06:49:53.045219+0000 4=4+0) n(v36 rc2024-09-19T06:50:03.859128+0000 b892928 5=4+1) old_inodes=6 (inest sync->mix g=1,2,3,4) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:3890 nref=3)) mcw={2=AsLsXsFs,4=AsLsXsFs} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55a161e61180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v310>,<0x10000000005/data v119>,<0x100000001fb/postgres v23>,<0x100000001fa/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 v38>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v1941>,<0x10000000005/data v769>,<0x100000001fb/postgres v440>,<0x100000001fa/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 v466>,<0x10000000001/sv_1 v477>,<0x10000000000/qa v484>,<0x1/volumes v428>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:49:28.298430+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:50:03.859128+0000 b892928 5=4+1)","memory_value.dirstat":"f(v19 m2024-09-19T06:49:53.045219+0000 4=4+0)","memory_value.rstat":"n(v36 rc2024-09-19T06:50:03.859128+0000 b892928 5=4+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-19T06:50:15.666 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:50:15.809 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:50:15.923 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:16.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: pgmap v313: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 16 MiB/s wr, 1.23k op/s 2024-09-19T06:50:16.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:50:16.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.045 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.046 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:15 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: pgmap v313: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 16 MiB/s wr, 1.23k op/s 2024-09-19T06:50:16.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:50:16.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:50:16.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:50:16.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:50:16.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:50:16.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:50:16.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:50:16.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:50:16.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:50:16.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.262 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.262 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:15 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: pgmap v313: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 16 MiB/s wr, 1.23k op/s 2024-09-19T06:50:16.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:50:16.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:50:16.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:50:16.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:50:16.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:50:16.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:50:16.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:50:16.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:50:16.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:50:16.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.335 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:15 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:50:16.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.399+0000 7fe54c580640 1 -- 172.21.15.12:0/2531371190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544100e20 msgr2=0x7fe544101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:16.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.399+0000 7fe54c580640 1 --2- 172.21.15.12:0/2531371190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544100e20 0x7fe544101200 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe540009900 tx=0x7fe54002a480 comp rx=0 tx=0).stop 2024-09-19T06:50:16.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.399+0000 7fe54c580640 1 -- 172.21.15.12:0/2531371190 shutdown_connections 2024-09-19T06:50:16.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.399+0000 7fe54c580640 1 --2- 172.21.15.12:0/2531371190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe544102ef0 0x7fe54410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.399+0000 7fe54c580640 1 --2- 172.21.15.12:0/2531371190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe544102570 0x7fe5441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.399+0000 7fe54c580640 1 --2- 172.21.15.12:0/2531371190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544100e20 0x7fe544101200 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.399+0000 7fe54c580640 1 -- 172.21.15.12:0/2531371190 >> 172.21.15.12:0/2531371190 conn(0x7fe5440fc7d0 msgr2=0x7fe5440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:16.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe54c580640 1 -- 172.21.15.12:0/2531371190 shutdown_connections 2024-09-19T06:50:16.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe54c580640 1 -- 172.21.15.12:0/2531371190 wait complete. 2024-09-19T06:50:16.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe54c580640 1 Processor -- start 2024-09-19T06:50:16.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe54c580640 1 -- start start 2024-09-19T06:50:16.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe54c580640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe544100e20 0x7fe544199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe54c580640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544102570 0x7fe544199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe54c580640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe544102ef0 0x7fe5441a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe54c580640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe544110f50 con 0x7fe544102570 2024-09-19T06:50:16.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe54c580640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe544110dd0 con 0x7fe544102ef0 2024-09-19T06:50:16.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe54c580640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441110d0 con 0x7fe544100e20 2024-09-19T06:50:16.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe549b1b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544102570 0x7fe544199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.400+0000 7fe549b1b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544102570 0x7fe544199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43178/0 (socket says 172.21.15.12:43178) 2024-09-19T06:50:16.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe549b1b640 1 -- 172.21.15.12:0/2123481643 learned_addr learned my addr 172.21.15.12:0/2123481643 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:16.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe544102ef0 0x7fe5441a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe54a31c640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe544100e20 0x7fe544199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe549b1b640 1 -- 172.21.15.12:0/2123481643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe544100e20 msgr2=0x7fe544199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:16.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe549b1b640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe544100e20 0x7fe544199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe549b1b640 1 -- 172.21.15.12:0/2123481643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe544102ef0 msgr2=0x7fe5441a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:16.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe549b1b640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe544102ef0 0x7fe5441a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe549b1b640 1 -- 172.21.15.12:0/2123481643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5441a48c0 con 0x7fe544102570 2024-09-19T06:50:16.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe544102ef0 0x7fe5441a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:16.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe54a31c640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe544100e20 0x7fe544199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:16.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe549b1b640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544102570 0x7fe544199840 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe53400c920 tx=0x7fe53400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:16.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe53b7fe640 1 -- 172.21.15.12:0/2123481643 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe534007c70 con 0x7fe544102570 2024-09-19T06:50:16.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe53b7fe640 1 -- 172.21.15.12:0/2123481643 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe534007e10 con 0x7fe544102570 2024-09-19T06:50:16.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe54c580640 1 -- 172.21.15.12:0/2123481643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5441a4a90 con 0x7fe544102570 2024-09-19T06:50:16.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe53b7fe640 1 -- 172.21.15.12:0/2123481643 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe534018890 con 0x7fe544102570 2024-09-19T06:50:16.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.401+0000 7fe54c580640 1 -- 172.21.15.12:0/2123481643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5441a4fd0 con 0x7fe544102570 2024-09-19T06:50:16.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.403+0000 7fe53b7fe640 1 -- 172.21.15.12:0/2123481643 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe534018a70 con 0x7fe544102570 2024-09-19T06:50:16.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe54e959740 1 Processor -- start 2024-09-19T06:50:16.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe54e959740 1 -- start start 2024-09-19T06:50:16.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe54e959740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727360 0x562201727740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe54e959740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 0x562201736550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe54e959740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201738e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe54e959740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56220168d2e0 con 0x562201736a90 2024-09-19T06:50:16.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe54e959740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562201634ce0 con 0x562201727360 2024-09-19T06:50:16.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe54e959740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5622016892a0 con 0x562201727c80 2024-09-19T06:50:16.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe549b1b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201738e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe549b1b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201738e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43188/0 (socket says 172.21.15.12:43188) 2024-09-19T06:50:16.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe549b1b640 1 -- 172.21.15.12:0/1647150112 learned_addr learned my addr 172.21.15.12:0/1647150112 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:16.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727360 0x562201727740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.404+0000 7fe54a31c640 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 0x562201736550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe53b7fe640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe5300a3430 0x7fe5300a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe549b1b640 1 -- 172.21.15.12:0/1647150112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 msgr2=0x562201736550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:16.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe549b1b640 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 0x562201736550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe549b1b640 1 -- 172.21.15.12:0/1647150112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727360 msgr2=0x562201727740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:16.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe549b1b640 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727360 0x562201727740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe549b1b640 1 -- 172.21.15.12:0/1647150112 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562201619440 con 0x562201736a90 2024-09-19T06:50:16.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe54a31c640 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 0x562201736550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:16.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727360 0x562201727740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:16.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe5300a3430 0x7fe5300a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe53b7fe640 1 -- 172.21.15.12:0/2123481643 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fe5340cfff0 con 0x7fe544102570 2024-09-19T06:50:16.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe549b1b640 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201738e80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe5340cd580 tx=0x7fe534091660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2e3aaccb65790 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:16.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe538ff9640 1 -- 172.21.15.12:0/1647150112 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53406be60 con 0x562201736a90 2024-09-19T06:50:16.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe538ff9640 1 -- 172.21.15.12:0/1647150112 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe534094f80 con 0x562201736a90 2024-09-19T06:50:16.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.405+0000 7fe538ff9640 1 -- 172.21.15.12:0/1647150112 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53406acd0 con 0x562201736a90 2024-09-19T06:50:16.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.406+0000 7fe54e959740 1 -- 172.21.15.12:0/1647150112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 msgr2=0x562201738e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:16.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.406+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe5300a3430 0x7fe5300a58f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe53c011580 tx=0x7fe53c004a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:16.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.406+0000 7fe54e959740 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201738e80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe5340cd580 tx=0x7fe534091660 comp rx=0 tx=0).stop 2024-09-19T06:50:16.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.406+0000 7fe54e959740 1 -- 172.21.15.12:0/1647150112 shutdown_connections 2024-09-19T06:50:16.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.406+0000 7fe54e959740 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201738e80 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.406+0000 7fe54e959740 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 0x562201736550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.406+0000 7fe54e959740 1 --2- 172.21.15.12:0/1647150112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727360 0x562201727740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.406+0000 7fe54e959740 1 -- 172.21.15.12:0/1647150112 >> 172.21.15.12:0/1647150112 conn(0x562201723a30 msgr2=0x562201723e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.406+0000 7fe54e959740 1 -- 172.21.15.12:0/1647150112 shutdown_connections 2024-09-19T06:50:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.406+0000 7fe54e959740 1 -- 172.21.15.12:0/1647150112 wait complete. 2024-09-19T06:50:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54e959740 1 -- start start 2024-09-19T06:50:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54e959740 1 Processor -- start 2024-09-19T06:50:16.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54e959740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727360 0x5622017363c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54e959740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 0x562201733670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54e959740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201733bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54e959740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562201739600 con 0x562201736a90 2024-09-19T06:50:16.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54e959740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562201648050 con 0x562201727c80 2024-09-19T06:50:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54e959740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562201739780 con 0x562201727360 2024-09-19T06:50:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54e959740 10 client.0 _ll_register_callbacks cb 0x562201688160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54ab1d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201733bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54ab1d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201733bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43202/0 (socket says 172.21.15.12:43202) 2024-09-19T06:50:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54ab1d640 1 -- 172.21.15.12:0/1224354349 learned_addr learned my addr 172.21.15.12:0/1224354349 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.407+0000 7fe54a31c640 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727360 0x5622017363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe549b1b640 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 0x562201733670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe54ab1d640 1 -- 172.21.15.12:0/1224354349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727360 msgr2=0x5622017363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727360 0x5622017363c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe54ab1d640 1 -- 172.21.15.12:0/1224354349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 msgr2=0x562201733670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 0x562201733670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe54ab1d640 1 -- 172.21.15.12:0/1224354349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622013fe3c0 con 0x562201736a90 2024-09-19T06:50:16.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201733bb0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00ef30 tx=0x7fe53c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c7cfdb171fce4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:16.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe52dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:16.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe52dffb640 1 -- 172.21.15.12:0/1224354349 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c01d860 con 0x562201736a90 2024-09-19T06:50:16.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe52dffb640 1 -- 172.21.15.12:0/1224354349 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fe53c01da00 con 0x562201736a90 2024-09-19T06:50:16.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe54e959740 1 -- 172.21.15.12:0/1224354349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56220169a850 con 0x562201736a90 2024-09-19T06:50:16.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe52dffb640 1 -- 172.21.15.12:0/1224354349 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe53c00aa40 con 0x562201736a90 2024-09-19T06:50:16.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe54e959740 10 client.18270 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:16.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe54e959740 1 -- 172.21.15.12:0/1224354349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x562201744fc0 con 0x562201736a90 2024-09-19T06:50:16.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.408+0000 7fe52dffb640 1 -- 172.21.15.12:0/1224354349 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56220169a850 con 0x562201736a90 2024-09-19T06:50:16.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.409+0000 7fe52dffb640 1 -- 172.21.15.12:0/1224354349 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fe53c01b440 con 0x562201736a90 2024-09-19T06:50:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.409+0000 7fe54e959740 10 client.18270 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.409+0000 7fe54e959740 10 client.18270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.409+0000 7fe54e959740 20 client.18270 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.409+0000 7fe54e959740 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562201746480 0x562201748870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.409+0000 7fe54e959740 4 client.18270 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.409+0000 7fe54e959740 1 -- 172.21.15.12:0/1224354349 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562201694d60 con 0x562201746480 2024-09-19T06:50:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.409+0000 7fe54a31c640 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562201746480 0x562201748870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.410+0000 7fe54a31c640 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562201746480 0x562201748870 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=411099a2cd6bd9cf server_cookie=27c485ad8f3718be in_seq=0 out_seq=0 2024-09-19T06:50:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.410+0000 7fe52dffb640 10 client.18270 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.410+0000 7fe52dffb640 1 -- 172.21.15.12:0/1224354349 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562201694d60 con 0x562201746480 2024-09-19T06:50:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.410+0000 7fe52dffb640 10 client.18270 handle_command_reply: tid=0 2024-09-19T06:50:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.410+0000 7fe54e959740 1 client.18270 shutdown 2024-09-19T06:50:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.410+0000 7fe54e959740 1 -- 172.21.15.12:0/1224354349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 msgr2=0x562201733bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.410+0000 7fe54e959740 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201733bb0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00ef30 tx=0x7fe53c004ab0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.411+0000 7fe54e959740 1 -- 172.21.15.12:0/1224354349 shutdown_connections 2024-09-19T06:50:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.411+0000 7fe54e959740 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562201746480 0x562201748870 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.411+0000 7fe54e959740 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201736a90 0x562201733bb0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.411+0000 7fe54e959740 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 0x562201733670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.411+0000 7fe54e959740 1 --2- 172.21.15.12:0/1224354349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727360 0x5622017363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.411+0000 7fe52dffb640 0 client.18270 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:16.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.411+0000 7fe54e959740 1 -- 172.21.15.12:0/1224354349 >> 172.21.15.12:0/1224354349 conn(0x562201723a30 msgr2=0x562201729790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:16.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.411+0000 7fe54e959740 1 -- 172.21.15.12:0/1224354349 shutdown_connections 2024-09-19T06:50:16.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.411+0000 7fe54e959740 1 -- 172.21.15.12:0/1224354349 wait complete. 2024-09-19T06:50:16.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.411+0000 7fe54e959740 20 client.18270 trim_cache size 0 max 16384 2024-09-19T06:50:16.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54e959740 1 Processor -- start 2024-09-19T06:50:16.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54e959740 1 -- start start 2024-09-19T06:50:16.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54e959740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x5622017428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54e959740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 0x56220172e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54e959740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201736a90 0x56220174e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54e959740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441ab9f0 con 0x562201727360 2024-09-19T06:50:16.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54e959740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441ad530 con 0x562201736a90 2024-09-19T06:50:16.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54e959740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441ac0c0 con 0x562201727c80 2024-09-19T06:50:16.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54a31c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x5622017428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54a31c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x5622017428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43212/0 (socket says 172.21.15.12:43212) 2024-09-19T06:50:16.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe54a31c640 1 -- 172.21.15.12:0/1816394317 learned_addr learned my addr 172.21.15.12:0/1816394317 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:16.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.428+0000 7fe549b1b640 1 --2- 172.21.15.12:0/1816394317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 0x56220172e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/1816394317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201736a90 0x56220174e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe54a31c640 1 -- 172.21.15.12:0/1816394317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 msgr2=0x56220172e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe54a31c640 1 --2- 172.21.15.12:0/1816394317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 0x56220172e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe54a31c640 1 -- 172.21.15.12:0/1816394317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201736a90 msgr2=0x56220174e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe54a31c640 1 --2- 172.21.15.12:0/1816394317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201736a90 0x56220174e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe54a31c640 1 -- 172.21.15.12:0/1816394317 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562201727ab0 con 0x562201727360 2024-09-19T06:50:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe549b1b640 1 --2- 172.21.15.12:0/1816394317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 0x56220172e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe54a31c640 1 --2- 172.21.15.12:0/1816394317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x5622017428a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe5400314e0 tx=0x7fe540005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de83b187b610c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe52ffff640 1 -- 172.21.15.12:0/1816394317 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54004a070 con 0x562201727360 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe52ffff640 1 -- 172.21.15.12:0/1816394317 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe540003cd0 con 0x562201727360 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.429+0000 7fe52ffff640 1 -- 172.21.15.12:0/1816394317 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540035040 con 0x562201727360 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 -- 172.21.15.12:0/1816394317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 msgr2=0x5622017428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 --2- 172.21.15.12:0/1816394317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x5622017428a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe5400314e0 tx=0x7fe540005b50 comp rx=0 tx=0).stop 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 -- 172.21.15.12:0/1816394317 shutdown_connections 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 --2- 172.21.15.12:0/1816394317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201736a90 0x56220174e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 --2- 172.21.15.12:0/1816394317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201727c80 0x56220172e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 --2- 172.21.15.12:0/1816394317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x5622017428a0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 -- 172.21.15.12:0/1816394317 >> 172.21.15.12:0/1816394317 conn(0x562201723a30 msgr2=0x5622017356f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 -- 172.21.15.12:0/1816394317 shutdown_connections 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 -- 172.21.15.12:0/1816394317 wait complete. 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 -- start start 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 Processor -- start 2024-09-19T06:50:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x56220173eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 0x56220173efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201736a90 0x562201730790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441ace60 con 0x562201727360 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441ac790 con 0x562201727c80 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe5441a99f0 con 0x562201736a90 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54e959740 10 client.0 _ll_register_callbacks cb 0x7fe53c00ae30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.430+0000 7fe54a31c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x56220173eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54a31c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x56220173eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43226/0 (socket says 172.21.15.12:43226) 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54a31c640 1 -- 172.21.15.12:0/263390026 learned_addr learned my addr 172.21.15.12:0/263390026 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe549b1b640 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 0x56220173efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201736a90 0x562201730790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54a31c640 1 -- 172.21.15.12:0/263390026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201736a90 msgr2=0x562201730790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54a31c640 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201736a90 0x562201730790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54a31c640 1 -- 172.21.15.12:0/263390026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 msgr2=0x56220173efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54a31c640 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 0x56220173efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54a31c640 1 -- 172.21.15.12:0/263390026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562201730d80 con 0x562201727360 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe549b1b640 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 0x56220173efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54ab1d640 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201736a90 0x562201730790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54a31c640 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x56220173eaa0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe54002a9a0 tx=0x7fe5400315c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ff4795f36d2d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe52dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe52dffb640 1 -- 172.21.15.12:0/263390026 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54004a040 con 0x562201727360 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe52dffb640 1 -- 172.21.15.12:0/263390026 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fe540031d00 con 0x562201727360 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54e959740 1 -- 172.21.15.12:0/263390026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe540003cd0 con 0x562201727360 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe52dffb640 1 -- 172.21.15.12:0/263390026 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe540035040 con 0x562201727360 2024-09-19T06:50:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54e959740 10 client.18276 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.431+0000 7fe54e959740 1 -- 172.21.15.12:0/263390026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56220173c4a0 con 0x562201727360 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.432+0000 7fe52dffb640 1 -- 172.21.15.12:0/263390026 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe540003cd0 con 0x562201727360 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.432+0000 7fe52dffb640 1 -- 172.21.15.12:0/263390026 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fe54003d7f0 con 0x562201727360 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.432+0000 7fe54e959740 10 client.18276 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.432+0000 7fe54e959740 10 client.18276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.432+0000 7fe54e959740 20 client.18276 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.432+0000 7fe54e959740 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5622017b5ac0 0x5622017b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.432+0000 7fe54e959740 4 client.18276 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.432+0000 7fe54e959740 1 -- 172.21.15.12:0/263390026 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562201611210 con 0x5622017b5ac0 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.432+0000 7fe549b1b640 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5622017b5ac0 0x5622017b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe549b1b640 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5622017b5ac0 0x5622017b7ee0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7957035399dc7558 server_cookie=9d3083d3437dc26b in_seq=0 out_seq=0 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe52dffb640 10 client.18276 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe52dffb640 1 -- 172.21.15.12:0/263390026 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562201611210 con 0x5622017b5ac0 2024-09-19T06:50:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe52dffb640 10 client.18276 handle_command_reply: tid=0 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 client.18276 shutdown 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 -- 172.21.15.12:0/263390026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 msgr2=0x56220173eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x56220173eaa0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe54002a9a0 tx=0x7fe5400315c0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 -- 172.21.15.12:0/263390026 shutdown_connections 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5622017b5ac0 0x5622017b7ee0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562201736a90 0x562201730790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562201727c80 0x56220173efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe52dffb640 0 client.18276 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 --2- 172.21.15.12:0/263390026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562201727360 0x56220173eaa0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 -- 172.21.15.12:0/263390026 >> 172.21.15.12:0/263390026 conn(0x562201723a30 msgr2=0x562201722370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 -- 172.21.15.12:0/263390026 shutdown_connections 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 1 -- 172.21.15.12:0/263390026 wait complete. 2024-09-19T06:50:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.433+0000 7fe54e959740 20 client.18276 trim_cache size 0 max 16384 2024-09-19T06:50:16.460 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:50:16.460 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:50:16.460 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:50:16.460 INFO:teuthology.orchestra.run.smithi012.stdout: "5f7d79c9-b68b-45b8-a52f-9094394fc02e": { 2024-09-19T06:50:16.460 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:50:16.460 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "5f7d79c9-b68b-45b8-a52f-9094394fc02e", 2024-09-19T06:50:16.460 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:50:16.460 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:16.460 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:16.460 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:50:16.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 -- 172.21.15.12:0/2123481643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe5300a3430 msgr2=0x7fe5300a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:16.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe5300a3430 0x7fe5300a58f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe53c011580 tx=0x7fe53c004a40 comp rx=0 tx=0).stop 2024-09-19T06:50:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 -- 172.21.15.12:0/2123481643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544102570 msgr2=0x7fe544199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544102570 0x7fe544199840 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe53400c920 tx=0x7fe53400cde0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 -- 172.21.15.12:0/2123481643 shutdown_connections 2024-09-19T06:50:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe544102ef0 0x7fe5441a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe544102570 0x7fe544199840 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe5300a3430 0x7fe5300a58f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 --2- 172.21.15.12:0/2123481643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe544100e20 0x7fe544199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 -- 172.21.15.12:0/2123481643 >> 172.21.15.12:0/2123481643 conn(0x7fe5440fc7d0 msgr2=0x7fe5440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 -- 172.21.15.12:0/2123481643 shutdown_connections 2024-09-19T06:50:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:16.434+0000 7fe54c580640 1 -- 172.21.15.12:0/2123481643 wait complete. 2024-09-19T06:50:17.276 INFO:tasks.cephfs.filesystem:scrub status for tag:5f7d79c9-b68b-45b8-a52f-9094394fc02e - {'path': '/', 'tag': '5f7d79c9-b68b-45b8-a52f-9094394fc02e', 'options': 'recursive,force'} 2024-09-19T06:50:18.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:17 smithi012 ceph-mon[30937]: pgmap v315: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 24 op/s 2024-09-19T06:50:18.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:17 smithi016 ceph-mon[34911]: pgmap v315: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 24 op/s 2024-09-19T06:50:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:17 smithi173 ceph-mon[35349]: pgmap v315: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 85 KiB/s wr, 24 op/s 2024-09-19T06:50:20.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:19 smithi012 ceph-mon[30937]: pgmap v316: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 21 op/s 2024-09-19T06:50:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:19 smithi016 ceph-mon[34911]: pgmap v316: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 21 op/s 2024-09-19T06:50:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:19 smithi173 ceph-mon[35349]: pgmap v316: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 21 op/s 2024-09-19T06:50:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:50:22.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:21 smithi012 ceph-mon[30937]: pgmap v317: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.5 MiB/s wr, 409 op/s 2024-09-19T06:50:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:21 smithi016 ceph-mon[34911]: pgmap v317: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.5 MiB/s wr, 409 op/s 2024-09-19T06:50:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:21 smithi173 ceph-mon[35349]: pgmap v317: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.5 MiB/s wr, 409 op/s 2024-09-19T06:50:24.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:23 smithi012 ceph-mon[30937]: pgmap v318: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.5 MiB/s wr, 409 op/s 2024-09-19T06:50:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:23 smithi016 ceph-mon[34911]: pgmap v318: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.5 MiB/s wr, 409 op/s 2024-09-19T06:50:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:23 smithi173 ceph-mon[35349]: pgmap v318: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.5 MiB/s wr, 409 op/s 2024-09-19T06:50:25.007 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:24 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:50:25.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.028+0000 7fa50ae53640 1 -- 172.21.15.12:0/1611113543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa504102d00 msgr2=0x7fa5041030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.028+0000 7fa50ae53640 1 --2- 172.21.15.12:0/1611113543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa504102d00 0x7fa5041030e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009ca0 tx=0x7fa4f402a950 comp rx=0 tx=0).stop 2024-09-19T06:50:25.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.028+0000 7fa50ae53640 1 -- 172.21.15.12:0/1611113543 shutdown_connections 2024-09-19T06:50:25.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.028+0000 7fa50ae53640 1 --2- 172.21.15.12:0/1611113543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa50410c0d0 0x7fa50410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.028+0000 7fa50ae53640 1 --2- 172.21.15.12:0/1611113543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa504103620 0x7fa50410bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.028+0000 7fa50ae53640 1 --2- 172.21.15.12:0/1611113543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa504102d00 0x7fa5041030e0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.028+0000 7fa50ae53640 1 -- 172.21.15.12:0/1611113543 >> 172.21.15.12:0/1611113543 conn(0x7fa504077990 msgr2=0x7fa5040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:25.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.028+0000 7fa50ae53640 1 -- 172.21.15.12:0/1611113543 shutdown_connections 2024-09-19T06:50:25.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa50ae53640 1 -- 172.21.15.12:0/1611113543 wait complete. 2024-09-19T06:50:25.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa50ae53640 1 Processor -- start 2024-09-19T06:50:25.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa50ae53640 1 -- start start 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa50ae53640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa504102d00 0x7fa504198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa50ae53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa504103620 0x7fa504198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa50ae53640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa50410c0d0 0x7fa50419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa50ae53640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa504111eb0 con 0x7fa504103620 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa50ae53640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa504111d30 con 0x7fa50410c0d0 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa50ae53640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa504112030 con 0x7fa504102d00 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa503fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa504103620 0x7fa504198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa503fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa504103620 0x7fa504198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35926/0 (socket says 172.21.15.12:35926) 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.029+0000 7fa503fff640 1 -- 172.21.15.12:0/1040414075 learned_addr learned my addr 172.21.15.12:0/1040414075 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa508bef640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa504102d00 0x7fa504198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa5093f0640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa50410c0d0 0x7fa50419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa503fff640 1 -- 172.21.15.12:0/1040414075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa504102d00 msgr2=0x7fa504198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa503fff640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa504102d00 0x7fa504198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa503fff640 1 -- 172.21.15.12:0/1040414075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa50410c0d0 msgr2=0x7fa50419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa503fff640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa50410c0d0 0x7fa50419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa503fff640 1 -- 172.21.15.12:0/1040414075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50419d310 con 0x7fa504103620 2024-09-19T06:50:25.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa508bef640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa504102d00 0x7fa504198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:25.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa503fff640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa504103620 0x7fa504198860 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00d950 tx=0x7fa4ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa501ffb640 1 -- 172.21.15.12:0/1040414075 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec017070 con 0x7fa504103620 2024-09-19T06:50:25.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa501ffb640 1 -- 172.21.15.12:0/1040414075 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4ec009c30 con 0x7fa504103620 2024-09-19T06:50:25.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa50ae53640 1 -- 172.21.15.12:0/1040414075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50419d600 con 0x7fa504103620 2024-09-19T06:50:25.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa501ffb640 1 -- 172.21.15.12:0/1040414075 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec00f6b0 con 0x7fa504103620 2024-09-19T06:50:25.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.030+0000 7fa50ae53640 1 -- 172.21.15.12:0/1040414075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5041a4e90 con 0x7fa504103620 2024-09-19T06:50:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.032+0000 7fa501ffb640 1 -- 172.21.15.12:0/1040414075 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa4ec0109d0 con 0x7fa504103620 2024-09-19T06:50:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.033+0000 7fa50dbe9740 1 Processor -- start 2024-09-19T06:50:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.033+0000 7fa50dbe9740 1 -- start start 2024-09-19T06:50:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.033+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 0x563fe54aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.033+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563fe540f2f0 con 0x563fe54ab410 2024-09-19T06:50:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563fe53b7270 con 0x563fe54aaaf0 2024-09-19T06:50:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563fe540b2b0 con 0x563fe54b5cb0 2024-09-19T06:50:25.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa501ffb640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4f00a3460 0x7fa4f00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa508bef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa508bef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35932/0 (socket says 172.21.15.12:35932) 2024-09-19T06:50:25.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa508bef640 1 -- 172.21.15.12:0/4291995135 learned_addr learned my addr 172.21.15.12:0/4291995135 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:25.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa5093f0640 1 --2- 172.21.15.12:0/4291995135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 0x563fe54aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa501ffb640 1 -- 172.21.15.12:0/1040414075 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fa4ec0cfb20 con 0x7fa504103620 2024-09-19T06:50:25.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa5093f0640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4f00a3460 0x7fa4f00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa503fff640 1 --2- 172.21.15.12:0/4291995135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa508bef640 1 -- 172.21.15.12:0/4291995135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 msgr2=0x563fe54b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa508bef640 1 --2- 172.21.15.12:0/4291995135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa508bef640 1 -- 172.21.15.12:0/4291995135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 msgr2=0x563fe54aaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa508bef640 1 --2- 172.21.15.12:0/4291995135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 0x563fe54aaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa508bef640 1 -- 172.21.15.12:0/4291995135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe53b6340 con 0x563fe54ab410 2024-09-19T06:50:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa5093f0640 1 --2- 172.21.15.12:0/4291995135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 0x563fe54aaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa508bef640 1 --2- 172.21.15.12:0/4291995135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b5770 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa4f402ff00 tx=0x7fa4f40093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b80f872d2a3e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa5093f0640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4f00a3460 0x7fa4f00a5920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0058c0 tx=0x7fa4fc004730 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa4faffd640 1 -- 172.21.15.12:0/4291995135 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4034040 con 0x563fe54ab410 2024-09-19T06:50:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa4faffd640 1 -- 172.21.15.12:0/4291995135 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4f402fbc0 con 0x563fe54ab410 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.034+0000 7fa4faffd640 1 -- 172.21.15.12:0/4291995135 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4004540 con 0x563fe54ab410 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.035+0000 7fa50dbe9740 1 -- 172.21.15.12:0/4291995135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 msgr2=0x563fe54b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.035+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/4291995135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b5770 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa4f402ff00 tx=0x7fa4f40093f0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.035+0000 7fa50dbe9740 1 -- 172.21.15.12:0/4291995135 shutdown_connections 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.035+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/4291995135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.035+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/4291995135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b5770 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.035+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/4291995135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 0x563fe54aaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.035+0000 7fa50dbe9740 1 -- 172.21.15.12:0/4291995135 >> 172.21.15.12:0/4291995135 conn(0x563fe54a7060 msgr2=0x563fe54a7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.035+0000 7fa50dbe9740 1 -- 172.21.15.12:0/4291995135 shutdown_connections 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.035+0000 7fa50dbe9740 1 -- 172.21.15.12:0/4291995135 wait complete. 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa50dbe9740 1 -- start start 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa50dbe9740 1 Processor -- start 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54aaaf0 0x563fe54b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54b5cb0 0x563fe54b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563fe54b8880 con 0x563fe54ab410 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563fe5398290 con 0x563fe54b5cb0 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563fe54b8a00 con 0x563fe54aaaf0 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa50dbe9740 10 client.0 _ll_register_callbacks cb 0x563fe53c9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa503fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa503fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35942/0 (socket says 172.21.15.12:35942) 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa503fff640 1 -- 172.21.15.12:0/3236494729 learned_addr learned my addr 172.21.15.12:0/3236494729 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa5093f0640 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54b5cb0 0x563fe54b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.036+0000 7fa508bef640 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54aaaf0 0x563fe54b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa503fff640 1 -- 172.21.15.12:0/3236494729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54aaaf0 msgr2=0x563fe54b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa503fff640 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54aaaf0 0x563fe54b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa503fff640 1 -- 172.21.15.12:0/3236494729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54b5cb0 msgr2=0x563fe54b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa503fff640 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54b5cb0 0x563fe54b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa503fff640 1 -- 172.21.15.12:0/3236494729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe5122210 con 0x563fe54ab410 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa503fff640 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b3030 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec098160 tx=0x7fa4ec00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863e24601a95f8fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa4e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa4e3fff640 1 -- 172.21.15.12:0/3236494729 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec020040 con 0x563fe54ab410 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa4e3fff640 1 -- 172.21.15.12:0/3236494729 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fa4ec09b150 con 0x563fe54ab410 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa50dbe9740 1 -- 172.21.15.12:0/3236494729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563fe541ca20 con 0x563fe54ab410 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa4e3fff640 1 -- 172.21.15.12:0/3236494729 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fa4ec0cd5f0 con 0x563fe54ab410 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa50dbe9740 10 client.18288 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa50dbe9740 1 -- 172.21.15.12:0/3236494729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x563fe51ee620 con 0x563fe54ab410 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa4e3fff640 1 -- 172.21.15.12:0/3236494729 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563fe541ca20 con 0x563fe54ab410 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa4e3fff640 1 -- 172.21.15.12:0/3236494729 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fa4ec0105f0 con 0x563fe54ab410 2024-09-19T06:50:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa50dbe9740 10 client.18288 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa50dbe9740 10 client.18288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa50dbe9740 20 client.18288 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563fe54c5b70 0x563fe54c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa50dbe9740 4 client.18288 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.037+0000 7fa50dbe9740 1 -- 172.21.15.12:0/3236494729 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fe5416d70 con 0x563fe54c5b70 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.038+0000 7fa508bef640 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563fe54c5b70 0x563fe54c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.038+0000 7fa508bef640 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563fe54c5b70 0x563fe54c7f80 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68a25e26551e5c8e server_cookie=ec2b27b9d9d16e27 in_seq=0 out_seq=0 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.038+0000 7fa4e3fff640 10 client.18288 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa4e3fff640 1 -- 172.21.15.12:0/3236494729 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563fe5416d70 con 0x563fe54c5b70 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa4e3fff640 10 client.18288 handle_command_reply: tid=0 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 client.18288 shutdown 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 -- 172.21.15.12:0/3236494729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 msgr2=0x563fe54b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b3030 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec098160 tx=0x7fa4ec00bf60 comp rx=0 tx=0).stop 2024-09-19T06:50:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 -- 172.21.15.12:0/3236494729 shutdown_connections 2024-09-19T06:50:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563fe54c5b70 0x563fe54c7f80 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54b5cb0 0x563fe54b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b3030 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa4e3fff640 0 client.18288 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/3236494729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54aaaf0 0x563fe54b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 -- 172.21.15.12:0/3236494729 >> 172.21.15.12:0/3236494729 conn(0x563fe54a7060 msgr2=0x563fe54acdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 -- 172.21.15.12:0/3236494729 shutdown_connections 2024-09-19T06:50:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 1 -- 172.21.15.12:0/3236494729 wait complete. 2024-09-19T06:50:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.039+0000 7fa50dbe9740 20 client.18288 trim_cache size 0 max 16384 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.053+0000 7fa50dbe9740 1 Processor -- start 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.053+0000 7fa50dbe9740 1 -- start start 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.053+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54aaaf0 0x563fe54ad560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54ab410 0x563fe54b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041adaa0 con 0x563fe54aaaf0 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041af5e0 con 0x563fe54ab410 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041ae170 con 0x563fe54b5cb0 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa508bef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54aaaf0 0x563fe54ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa508bef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54aaaf0 0x563fe54ad560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35948/0 (socket says 172.21.15.12:35948) 2024-09-19T06:50:25.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa508bef640 1 -- 172.21.15.12:0/2575551224 learned_addr learned my addr 172.21.15.12:0/2575551224 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa503fff640 1 --2- 172.21.15.12:0/2575551224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54ab410 0x563fe54b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa508bef640 1 -- 172.21.15.12:0/2575551224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 msgr2=0x563fe54cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa508bef640 1 --2- 172.21.15.12:0/2575551224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa508bef640 1 -- 172.21.15.12:0/2575551224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54ab410 msgr2=0x563fe54b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa508bef640 1 --2- 172.21.15.12:0/2575551224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54ab410 0x563fe54b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa508bef640 1 -- 172.21.15.12:0/2575551224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe54a6e90 con 0x563fe54aaaf0 2024-09-19T06:50:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa503fff640 1 --2- 172.21.15.12:0/2575551224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54ab410 0x563fe54b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa508bef640 1 --2- 172.21.15.12:0/2575551224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54aaaf0 0x563fe54ad560 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4004150 tx=0x7fa4f4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2abaa935dec4222 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa4fa7fc640 1 -- 172.21.15.12:0/2575551224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4034040 con 0x563fe54aaaf0 2024-09-19T06:50:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa4fa7fc640 1 -- 172.21.15.12:0/2575551224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4f4003970 con 0x563fe54aaaf0 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.054+0000 7fa4fa7fc640 1 -- 172.21.15.12:0/2575551224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4004450 con 0x563fe54aaaf0 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 -- 172.21.15.12:0/2575551224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54aaaf0 msgr2=0x563fe54ad560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/2575551224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54aaaf0 0x563fe54ad560 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4004150 tx=0x7fa4f4009a20 comp rx=0 tx=0).stop 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 -- 172.21.15.12:0/2575551224 shutdown_connections 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/2575551224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/2575551224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54ab410 0x563fe54b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/2575551224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54aaaf0 0x563fe54ad560 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 -- 172.21.15.12:0/2575551224 >> 172.21.15.12:0/2575551224 conn(0x563fe54a7060 msgr2=0x563fe54b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 -- 172.21.15.12:0/2575551224 shutdown_connections 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 -- 172.21.15.12:0/2575551224 wait complete. 2024-09-19T06:50:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 -- start start 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.055+0000 7fa50dbe9740 1 Processor -- start 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 0x563fe54be570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa50dbe9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54b9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041aef10 con 0x563fe54ab410 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041ae840 con 0x563fe54aaaf0 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa50dbe9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa5041abaa0 con 0x563fe54b5cb0 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa50dbe9740 10 client.0 _ll_register_callbacks cb 0x7fa4ec09b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa503fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa503fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35954/0 (socket says 172.21.15.12:35954) 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa503fff640 1 -- 172.21.15.12:0/1898974636 learned_addr learned my addr 172.21.15.12:0/1898974636 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa508bef640 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 0x563fe54be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa5093f0640 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54b9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa503fff640 1 -- 172.21.15.12:0/1898974636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 msgr2=0x563fe54b9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa503fff640 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54b9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa503fff640 1 -- 172.21.15.12:0/1898974636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 msgr2=0x563fe54be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa503fff640 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 0x563fe54be570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa503fff640 1 -- 172.21.15.12:0/1898974636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe54a22d0 con 0x563fe54ab410 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa503fff640 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b9890 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec010fd0 tx=0x7fa4ec09b010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2542f10e06b48191 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa4e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa4e3fff640 1 -- 172.21.15.12:0/1898974636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec0a4970 con 0x563fe54ab410 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa4e3fff640 1 -- 172.21.15.12:0/1898974636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fa4ec097a50 con 0x563fe54ab410 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa50dbe9740 1 -- 172.21.15.12:0/1898974636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4f4003970 con 0x563fe54ab410 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa4e3fff640 1 -- 172.21.15.12:0/1898974636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fa4ec097c70 con 0x563fe54ab410 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa50dbe9740 10 client.18294 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.056+0000 7fa50dbe9740 1 -- 172.21.15.12:0/1898974636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x563fe54a7cf0 con 0x563fe54ab410 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa4e3fff640 1 -- 172.21.15.12:0/1898974636 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4f4003970 con 0x563fe54ab410 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa4e3fff640 1 -- 172.21.15.12:0/1898974636 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fa4ec0a1360 con 0x563fe54ab410 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa50dbe9740 10 client.18294 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa50dbe9740 10 client.18294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa50dbe9740 20 client.18294 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563fe5530af0 0x563fe5532f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa50dbe9740 4 client.18294 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa50dbe9740 1 -- 172.21.15.12:0/1898974636 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563fe5393900 con 0x563fe5530af0 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa508bef640 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563fe5530af0 0x563fe5532f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa4e3fff640 10 client.18294 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.057+0000 7fa508bef640 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563fe5530af0 0x563fe5532f10 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86b94bc7c35be47 server_cookie=dba11dbaeeccbad4 in_seq=0 out_seq=0 2024-09-19T06:50:25.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa4e3fff640 1 -- 172.21.15.12:0/1898974636 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563fe5393900 con 0x563fe5530af0 2024-09-19T06:50:25.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa4e3fff640 10 client.18294 handle_command_reply: tid=0 2024-09-19T06:50:25.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 client.18294 shutdown 2024-09-19T06:50:25.069 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 -- 172.21.15.12:0/1898974636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 msgr2=0x563fe54b9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b9890 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec010fd0 tx=0x7fa4ec09b010 comp rx=0 tx=0).stop 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 -- 172.21.15.12:0/1898974636 shutdown_connections 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563fe5530af0 0x563fe5532f10 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563fe54b5cb0 0x563fe54b9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563fe54ab410 0x563fe54b9890 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa4e3fff640 0 client.18294 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 --2- 172.21.15.12:0/1898974636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563fe54aaaf0 0x563fe54be570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 -- 172.21.15.12:0/1898974636 >> 172.21.15.12:0/1898974636 conn(0x563fe54a7060 msgr2=0x563fe54b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 -- 172.21.15.12:0/1898974636 shutdown_connections 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 1 -- 172.21.15.12:0/1898974636 wait complete. 2024-09-19T06:50:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.067+0000 7fa50dbe9740 20 client.18294 trim_cache size 0 max 16384 2024-09-19T06:50:25.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:50:25.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:50:25.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:50:25.071 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 -- 172.21.15.12:0/1040414075 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4f00a3460 msgr2=0x7fa4f00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4f00a3460 0x7fa4f00a5920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0058c0 tx=0x7fa4fc004730 comp rx=0 tx=0).stop 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 -- 172.21.15.12:0/1040414075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa504103620 msgr2=0x7fa504198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa504103620 0x7fa504198860 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00d950 tx=0x7fa4ec00de10 comp rx=0 tx=0).stop 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 -- 172.21.15.12:0/1040414075 shutdown_connections 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa50410c0d0 0x7fa50419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa504103620 0x7fa504198860 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa4f00a3460 0x7fa4f00a5920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 --2- 172.21.15.12:0/1040414075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa504102d00 0x7fa504198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 -- 172.21.15.12:0/1040414075 >> 172.21.15.12:0/1040414075 conn(0x7fa504077990 msgr2=0x7fa5040fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 -- 172.21.15.12:0/1040414075 shutdown_connections 2024-09-19T06:50:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:25.068+0000 7fa50ae53640 1 -- 172.21.15.12:0/1040414075 wait complete. 2024-09-19T06:50:25.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:24 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:50:25.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:24 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:50:25.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:50:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:25 smithi016 ceph-mon[34911]: pgmap v319: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.5 MiB/s wr, 408 op/s 2024-09-19T06:50:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:25 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:25 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:25 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:25 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:25 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:25 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:25 smithi173 ceph-mon[35349]: pgmap v319: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.5 MiB/s wr, 408 op/s 2024-09-19T06:50:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:25 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:25 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:25 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:25 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:25 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:25 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:25 smithi012 ceph-mon[30937]: pgmap v319: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 2.5 MiB/s wr, 408 op/s 2024-09-19T06:50:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:25 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:25 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:25 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:25 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:25 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:25 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:27.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:50:27.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:50:27.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:26 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:50:27.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:50:27.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:26 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:50:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:50:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:50:27.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:26 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:50:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:27 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi016 to 177.0M 2024-09-19T06:50:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:27 smithi016 ceph-mon[34911]: Unable to set osd_memory_target on smithi016 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T06:50:28.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:27 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi012 to 177.0M 2024-09-19T06:50:28.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:27 smithi016 ceph-mon[34911]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-19T06:50:28.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:27 smithi016 ceph-mon[34911]: Unable to set osd_memory_target on smithi012 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:50:28.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:27 smithi016 ceph-mon[34911]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-19T06:50:28.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:27 smithi016 ceph-mon[34911]: pgmap v320: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 2.1 MiB/s wr, 354 op/s 2024-09-19T06:50:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:27 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi016 to 177.0M 2024-09-19T06:50:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:27 smithi173 ceph-mon[35349]: Unable to set osd_memory_target on smithi016 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T06:50:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:27 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi012 to 177.0M 2024-09-19T06:50:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:27 smithi173 ceph-mon[35349]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-19T06:50:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:27 smithi173 ceph-mon[35349]: Unable to set osd_memory_target on smithi012 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:50:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:27 smithi173 ceph-mon[35349]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-19T06:50:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:27 smithi173 ceph-mon[35349]: pgmap v320: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 2.1 MiB/s wr, 354 op/s 2024-09-19T06:50:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:27 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi016 to 177.0M 2024-09-19T06:50:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:27 smithi012 ceph-mon[30937]: Unable to set osd_memory_target on smithi016 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T06:50:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:27 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi012 to 177.0M 2024-09-19T06:50:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:27 smithi012 ceph-mon[30937]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-19T06:50:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:27 smithi012 ceph-mon[30937]: Unable to set osd_memory_target on smithi012 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T06:50:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:27 smithi012 ceph-mon[30937]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-19T06:50:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:27 smithi012 ceph-mon[30937]: pgmap v320: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 2.1 MiB/s wr, 354 op/s 2024-09-19T06:50:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:28 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:50:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:28 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:50:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:28 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:50:29.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:50:29.325 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:28 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:50:29.325 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:28 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:50:29.325 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:28 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:50:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:28 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:50:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:28 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:50:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:28 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:50:29.566 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:30.052 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:29 smithi012 ceph-mon[30937]: pgmap v321: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 2.0 MiB/s wr, 337 op/s 2024-09-19T06:50:30.053 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:29 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:50:30.053 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:29 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:50:30.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.134+0000 7f7a038f5640 1 -- 172.21.15.12:0/21308341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79fc106a80 msgr2=0x7f79fc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:30.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.134+0000 7f7a038f5640 1 --2- 172.21.15.12:0/21308341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79fc106a80 0x7f79fc106e60 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009930 tx=0x7f79f802a420 comp rx=0 tx=0).stop 2024-09-19T06:50:30.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.134+0000 7f7a038f5640 1 -- 172.21.15.12:0/21308341 shutdown_connections 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.134+0000 7f7a038f5640 1 --2- 172.21.15.12:0/21308341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79fc101420 0x7f79fc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.134+0000 7f7a038f5640 1 --2- 172.21.15.12:0/21308341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79fc100a80 0x7f79fc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.134+0000 7f7a038f5640 1 --2- 172.21.15.12:0/21308341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79fc106a80 0x7f79fc106e60 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.134+0000 7f7a038f5640 1 -- 172.21.15.12:0/21308341 >> 172.21.15.12:0/21308341 conn(0x7f79fc0fc7a0 msgr2=0x7f79fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.135+0000 7f7a038f5640 1 -- 172.21.15.12:0/21308341 shutdown_connections 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.135+0000 7f7a038f5640 1 -- 172.21.15.12:0/21308341 wait complete. 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.135+0000 7f7a038f5640 1 Processor -- start 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.135+0000 7f7a038f5640 1 -- start start 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a038f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79fc100a80 0x7f79fc199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a038f5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79fc101420 0x7f79fc1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a038f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79fc106a80 0x7f79fc1a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a038f5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc110e80 con 0x7f79fc106a80 2024-09-19T06:50:30.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a038f5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc110d00 con 0x7f79fc100a80 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a038f5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc111000 con 0x7f79fc101420 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a01e92640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79fc106a80 0x7f79fc1a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a01e92640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79fc106a80 0x7f79fc1a4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35962/0 (socket says 172.21.15.12:35962) 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a01e92640 1 -- 172.21.15.12:0/2814692677 learned_addr learned my addr 172.21.15.12:0/2814692677 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a00e90640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79fc101420 0x7f79fc1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a01691640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79fc100a80 0x7f79fc199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a01e92640 1 -- 172.21.15.12:0/2814692677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79fc101420 msgr2=0x7f79fc1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a01e92640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79fc101420 0x7f79fc1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a01e92640 1 -- 172.21.15.12:0/2814692677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79fc100a80 msgr2=0x7f79fc199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a01e92640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79fc100a80 0x7f79fc199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a01e92640 1 -- 172.21.15.12:0/2814692677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc1a4850 con 0x7f79fc106a80 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.136+0000 7f7a01691640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79fc100a80 0x7f79fc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.137+0000 7f7a01e92640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79fc106a80 0x7f79fc1a4310 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f79f400eaa0 tx=0x7f79f400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.137+0000 7f79f27fc640 1 -- 172.21.15.12:0/2814692677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f400cdb0 con 0x7f79fc106a80 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.137+0000 7f79f27fc640 1 -- 172.21.15.12:0/2814692677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79f4005020 con 0x7f79fc106a80 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.137+0000 7f7a038f5640 1 -- 172.21.15.12:0/2814692677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79fc1a4a20 con 0x7f79fc106a80 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.137+0000 7f79f27fc640 1 -- 172.21.15.12:0/2814692677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f40116b0 con 0x7f79fc106a80 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.137+0000 7f7a038f5640 1 -- 172.21.15.12:0/2814692677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79fc1a4fb0 con 0x7f79fc106a80 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.138+0000 7f7a038f5640 1 -- 172.21.15.12:0/2814692677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79fc100ee0 con 0x7f79fc106a80 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.139+0000 7f79f27fc640 1 -- 172.21.15.12:0/2814692677 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f79f4005560 con 0x7f79fc106a80 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.140+0000 7f79f27fc640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79e80a3430 0x7f79e80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.140+0000 7f7a01691640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79e80a3430 0x7f79e80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.140+0000 7f79f27fc640 1 -- 172.21.15.12:0/2814692677 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f79f40cff60 con 0x7f79fc106a80 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.141+0000 7f7a01691640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79e80a3430 0x7f79e80a58f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f79f8000c00 tx=0x7f79f8005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:30.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.145+0000 7f79f27fc640 1 -- 172.21.15.12:0/2814692677 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79f4016030 con 0x7f79fc106a80 2024-09-19T06:50:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:29 smithi016 ceph-mon[34911]: pgmap v321: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 2.0 MiB/s wr, 337 op/s 2024-09-19T06:50:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:29 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:50:30.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:29 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:50:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:29 smithi173 ceph-mon[35349]: pgmap v321: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 2.0 MiB/s wr, 337 op/s 2024-09-19T06:50:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:29 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:50:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:29 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:50:30.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.357+0000 7f7a038f5640 1 -- 172.21.15.12:0/2814692677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79fc108ff0 con 0x7f79fc106a80 2024-09-19T06:50:30.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.358+0000 7f79f27fc640 1 -- 172.21.15.12:0/2814692677 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11971 (secure 0 0 0) 0x7f79f409c840 con 0x7f79fc106a80 2024-09-19T06:50:30.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:50:30.360 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"btime":"2024-09-19T06:48:35:302779+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:48:34.412947+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:50:30.361 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 44 2024-09-19T06:50:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 -- 172.21.15.12:0/2814692677 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79e80a3430 msgr2=0x7f79e80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79e80a3430 0x7f79e80a58f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f79f8000c00 tx=0x7f79f8005a20 comp rx=0 tx=0).stop 2024-09-19T06:50:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 -- 172.21.15.12:0/2814692677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79fc106a80 msgr2=0x7f79fc1a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79fc106a80 0x7f79fc1a4310 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f79f400eaa0 tx=0x7f79f400ef60 comp rx=0 tx=0).stop 2024-09-19T06:50:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 -- 172.21.15.12:0/2814692677 shutdown_connections 2024-09-19T06:50:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79fc106a80 0x7f79fc1a4310 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f79e80a3430 0x7f79e80a58f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f79fc101420 0x7f79fc1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 --2- 172.21.15.12:0/2814692677 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79fc100a80 0x7f79fc199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 -- 172.21.15.12:0/2814692677 >> 172.21.15.12:0/2814692677 conn(0x7f79fc0fc7a0 msgr2=0x7f79fc0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 -- 172.21.15.12:0/2814692677 shutdown_connections 2024-09-19T06:50:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:30.360+0000 7f7a038f5640 1 -- 172.21.15.12:0/2814692677 wait complete. 2024-09-19T06:50:30.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:50:31.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:30 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2814692677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:31.239 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 82920f6e --release --await' 2024-09-19T06:50:31.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 82920f6e --release --await 2024-09-19T06:50:31.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:30 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2814692677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:31.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:30 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2814692677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:31.540 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:32.053 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:31 smithi012 ceph-mon[30937]: pgmap v322: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.0 MiB/s wr, 344 op/s 2024-09-19T06:50:32.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.143+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2768509652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f4106f10 msgr2=0x7fe4f410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:32.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.143+0000 7fe4f9a3f640 1 --2- 172.21.15.12:0/2768509652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f4106f10 0x7fe4f410ea90 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009900 tx=0x7fe4e402a410 comp rx=0 tx=0).stop 2024-09-19T06:50:32.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.143+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2768509652 shutdown_connections 2024-09-19T06:50:32.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.143+0000 7fe4f9a3f640 1 --2- 172.21.15.12:0/2768509652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f4106f10 0x7fe4f410ea90 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.143+0000 7fe4f9a3f640 1 --2- 172.21.15.12:0/2768509652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f4102790 0x7fe4f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.143+0000 7fe4f9a3f640 1 --2- 172.21.15.12:0/2768509652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4f4101de0 0x7fe4f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.143+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2768509652 >> 172.21.15.12:0/2768509652 conn(0x7fe4f40fd8c0 msgr2=0x7fe4f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.143+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2768509652 shutdown_connections 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.143+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2768509652 wait complete. 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.144+0000 7fe4f9a3f640 1 Processor -- start 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.144+0000 7fe4f9a3f640 1 -- start start 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.144+0000 7fe4f9a3f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4f4101de0 0x7fe4f4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.144+0000 7fe4f9a3f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f4102790 0x7fe4f4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.144+0000 7fe4f9a3f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f4106f10 0x7fe4f419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.144+0000 7fe4f9a3f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f4111f70 con 0x7fe4f4102790 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.144+0000 7fe4f9a3f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f4111df0 con 0x7fe4f4101de0 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.144+0000 7fe4f9a3f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f41120f0 con 0x7fe4f4106f10 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f4102790 0x7fe4f4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f4102790 0x7fe4f4198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42832/0 (socket says 172.21.15.12:42832) 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f27fc640 1 -- 172.21.15.12:0/2861958663 learned_addr learned my addr 172.21.15.12:0/2861958663 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f37fe640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f4106f10 0x7fe4f419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4f4101de0 0x7fe4f4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f27fc640 1 -- 172.21.15.12:0/2861958663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f4106f10 msgr2=0x7fe4f419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f4106f10 0x7fe4f419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f27fc640 1 -- 172.21.15.12:0/2861958663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4f4101de0 msgr2=0x7fe4f4198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4f4101de0 0x7fe4f4198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f27fc640 1 -- 172.21.15.12:0/2861958663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f419d400 con 0x7fe4f4102790 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f4102790 0x7fe4f4198990 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00d950 tx=0x7fe4dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f8a3d640 1 -- 172.21.15.12:0/2861958663 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc017030 con 0x7fe4f4102790 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2861958663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f419d6f0 con 0x7fe4f4102790 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f8a3d640 1 -- 172.21.15.12:0/2861958663 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4dc004020 con 0x7fe4f4102790 2024-09-19T06:50:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f8a3d640 1 -- 172.21.15.12:0/2861958663 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0047a0 con 0x7fe4f4102790 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.145+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2861958663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f41a4fd0 con 0x7fe4f4102790 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.148+0000 7fe4f8a3d640 1 -- 172.21.15.12:0/2861958663 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe4dc0041d0 con 0x7fe4f4102790 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.148+0000 7fe4fbe18740 1 Processor -- start 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.148+0000 7fe4fbe18740 1 -- start start 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.148+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae60f40 0x55d0bae61320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.148+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae70110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.148+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0bae72a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.148+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d0badc6620 con 0x55d0bae70650 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.148+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d0bad6de50 con 0x55d0bae61860 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.148+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d0badc25e0 con 0x55d0bae60f40 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0bae72a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0bae72a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42836/0 (socket says 172.21.15.12:42836) 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f27fc640 1 -- 172.21.15.12:0/2497516865 learned_addr learned my addr 172.21.15.12:0/2497516865 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/2497516865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae70110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f37fe640 1 --2- 172.21.15.12:0/2497516865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae60f40 0x55d0bae61320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f27fc640 1 -- 172.21.15.12:0/2497516865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae60f40 msgr2=0x55d0bae61320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/2497516865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae60f40 0x55d0bae61320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f27fc640 1 -- 172.21.15.12:0/2497516865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 msgr2=0x55d0bae70110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/2497516865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae70110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f27fc640 1 -- 172.21.15.12:0/2497516865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0bad5ed40 con 0x55d0bae70650 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f8a3d640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe4e00a33b0 0x7fe4e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/2497516865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0bae72a40 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0ccc90 tx=0x7fe4dc0d5ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e69ef5da04ebdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f37fe640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe4e00a33b0 0x7fe4e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4f8a3d640 1 -- 172.21.15.12:0/2861958663 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fe4dc0cf700 con 0x7fe4f4102790 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4e9ffb640 1 -- 172.21.15.12:0/2497516865 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc097b80 con 0x55d0bae70650 2024-09-19T06:50:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4e9ffb640 1 -- 172.21.15.12:0/2497516865 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4dc09bfe0 con 0x55d0bae70650 2024-09-19T06:50:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.149+0000 7fe4e9ffb640 1 -- 172.21.15.12:0/2497516865 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc09b240 con 0x55d0bae70650 2024-09-19T06:50:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.150+0000 7fe4f37fe640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe4e00a33b0 0x7fe4e00a5870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4005c40 tx=0x7fe4e4005b50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.150+0000 7fe4fbe18740 1 -- 172.21.15.12:0/2497516865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 msgr2=0x55d0bae72a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.150+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/2497516865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0bae72a40 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0ccc90 tx=0x7fe4dc0d5ef0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.150+0000 7fe4fbe18740 1 -- 172.21.15.12:0/2497516865 shutdown_connections 2024-09-19T06:50:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.150+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/2497516865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0bae72a40 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.150+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/2497516865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae70110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.150+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/2497516865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae60f40 0x55d0bae61320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.150+0000 7fe4fbe18740 1 -- 172.21.15.12:0/2497516865 >> 172.21.15.12:0/2497516865 conn(0x55d0bae5d5f0 msgr2=0x55d0bae5d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.150+0000 7fe4fbe18740 1 -- 172.21.15.12:0/2497516865 shutdown_connections 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.150+0000 7fe4fbe18740 1 -- 172.21.15.12:0/2497516865 wait complete. 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4fbe18740 1 -- start start 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4fbe18740 1 Processor -- start 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae6d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae6da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae70650 0x55d0bae6dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d0bae73220 con 0x55d0bae60f40 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d0bad4ef10 con 0x55d0bae61860 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d0bae733a0 con 0x55d0bae70650 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4fbe18740 10 client.0 _ll_register_callbacks cb 0x55d0bad72db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4f2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae6d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4f2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae6d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42848/0 (socket says 172.21.15.12:42848) 2024-09-19T06:50:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4f2ffd640 1 -- 172.21.15.12:0/3923411663 learned_addr learned my addr 172.21.15.12:0/3923411663 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae6da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.151+0000 7fe4f37fe640 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae70650 0x55d0bae6dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4f2ffd640 1 -- 172.21.15.12:0/3923411663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae70650 msgr2=0x55d0bae6dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae70650 0x55d0bae6dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4f2ffd640 1 -- 172.21.15.12:0/3923411663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 msgr2=0x55d0bae6da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae6da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4f2ffd640 1 -- 172.21.15.12:0/3923411663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0baad5580 con 0x55d0bae60f40 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae6d550 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec011d40 tx=0x7fe4ec00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41d7f3c48a5d4ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3923411663 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec01f060 con 0x55d0bae60f40 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3923411663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4dc09bfe0 con 0x55d0bae60f40 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3923411663 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fe4ec01a3f0 con 0x55d0bae60f40 2024-09-19T06:50:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3923411663 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe4ec026050 con 0x55d0bae60f40 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4fbe18740 10 client.18312 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3923411663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55d0bab9f960 con 0x55d0bae60f40 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3923411663 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4dc09bfe0 con 0x55d0bae60f40 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.152+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3923411663 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fe4ec019030 con 0x55d0bae60f40 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.153+0000 7fe4fbe18740 10 client.18312 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.153+0000 7fe4fbe18740 10 client.18312 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.153+0000 7fe4fbe18740 20 client.18312 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.153+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d0bae80260 0x55d0bae826d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.153+0000 7fe4fbe18740 4 client.18312 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.153+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3923411663 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0badd3b90 con 0x55d0bae80260 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.153+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d0bae80260 0x55d0bae826d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.153+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d0bae80260 0x55d0bae826d0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dccbda6e23db4ae server_cookie=1ad841daec36777e in_seq=0 out_seq=0 2024-09-19T06:50:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.153+0000 7fe4d2ffd640 10 client.18312 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3923411663 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0badd3b90 con 0x55d0bae80260 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4d2ffd640 10 client.18312 handle_command_reply: tid=0 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 client.18312 shutdown 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3923411663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 msgr2=0x55d0bae6d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae6d550 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec011d40 tx=0x7fe4ec00f790 comp rx=0 tx=0).stop 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3923411663 shutdown_connections 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d0bae80260 0x55d0bae826d0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae70650 0x55d0bae6dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae6da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3923411663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae6d550 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4d2ffd640 0 client.18312 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3923411663 >> 172.21.15.12:0/3923411663 conn(0x55d0bae5d5f0 msgr2=0x55d0bae63350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3923411663 shutdown_connections 2024-09-19T06:50:32.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3923411663 wait complete. 2024-09-19T06:50:32.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.154+0000 7fe4fbe18740 20 client.18312 trim_cache size 0 max 16384 2024-09-19T06:50:32.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4fbe18740 1 Processor -- start 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4fbe18740 1 -- start start 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae68a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae6dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae70650 0x55d0bae6e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f41aba50 con 0x55d0bae60f40 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f41ad590 con 0x55d0bae61860 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f41ac120 con 0x55d0bae70650 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4f2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae68a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4f2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae68a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42854/0 (socket says 172.21.15.12:42854) 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4f2ffd640 1 -- 172.21.15.12:0/3607823104 learned_addr learned my addr 172.21.15.12:0/3607823104 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/3607823104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae6dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.172+0000 7fe4f37fe640 1 --2- 172.21.15.12:0/3607823104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae70650 0x55d0bae6e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.173+0000 7fe4f2ffd640 1 -- 172.21.15.12:0/3607823104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae70650 msgr2=0x55d0bae6e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:32.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.173+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/3607823104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae70650 0x55d0bae6e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.173+0000 7fe4f2ffd640 1 -- 172.21.15.12:0/3607823104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 msgr2=0x55d0bae6dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:32.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.173+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/3607823104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae6dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.173+0000 7fe4f2ffd640 1 -- 172.21.15.12:0/3607823104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0bae5c610 con 0x55d0bae60f40 2024-09-19T06:50:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.173+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/3607823104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae68a60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00a010 tx=0x7fe4ec00efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f05490f0bec2995 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.173+0000 7fe4e97fa640 1 -- 172.21.15.12:0/3607823104 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00e3b0 con 0x55d0bae60f40 2024-09-19T06:50:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.173+0000 7fe4e97fa640 1 -- 172.21.15.12:0/3607823104 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4ec003e50 con 0x55d0bae60f40 2024-09-19T06:50:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.173+0000 7fe4e97fa640 1 -- 172.21.15.12:0/3607823104 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec005320 con 0x55d0bae60f40 2024-09-19T06:50:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.174+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3607823104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 msgr2=0x55d0bae68a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.174+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3607823104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae68a60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00a010 tx=0x7fe4ec00efd0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.174+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3607823104 shutdown_connections 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.174+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3607823104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae70650 0x55d0bae6e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.174+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3607823104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae6dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.174+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3607823104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae60f40 0x55d0bae68a60 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.174+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3607823104 >> 172.21.15.12:0/3607823104 conn(0x55d0bae5d5f0 msgr2=0x55d0bae6d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.174+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3607823104 shutdown_connections 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.174+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3607823104 wait complete. 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.174+0000 7fe4fbe18740 1 -- start start 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4fbe18740 1 Processor -- start 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae60f40 0x55d0bae74ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae750e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4fbe18740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0baee9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f41acec0 con 0x55d0bae70650 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f41ac7f0 con 0x55d0bae61860 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4fbe18740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f41a9a50 con 0x55d0bae60f40 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4f37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0baee9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4fbe18740 10 client.0 _ll_register_callbacks cb 0x7fe4ec011920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4f37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0baee9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42870/0 (socket says 172.21.15.12:42870) 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4f37fe640 1 -- 172.21.15.12:0/3455185937 learned_addr learned my addr 172.21.15.12:0/3455185937 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae60f40 0x55d0bae74ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4f27fc640 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4f37fe640 1 -- 172.21.15.12:0/3455185937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae60f40 msgr2=0x55d0bae74ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4f37fe640 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae60f40 0x55d0bae74ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4f37fe640 1 -- 172.21.15.12:0/3455185937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 msgr2=0x55d0bae750e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4f37fe640 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae750e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.175+0000 7fe4f37fe640 1 -- 172.21.15.12:0/3455185937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0baeea5b0 con 0x55d0bae70650 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4f37fe640 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0baee9f70 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009900 tx=0x7fe4e4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312d5cf7edb07d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3455185937 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4035040 con 0x55d0bae70650 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3455185937 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fe4e4003a00 con 0x55d0bae70650 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3455185937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4ec003e50 con 0x55d0bae70650 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3455185937 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe4e4003c00 con 0x55d0bae70650 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4fbe18740 10 client.18318 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3455185937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55d0baeeb8d0 con 0x55d0bae70650 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3455185937 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4ec003e50 con 0x55d0bae70650 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3455185937 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fe4e404c440 con 0x55d0bae70650 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4fbe18740 10 client.18318 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4fbe18740 10 client.18318 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:50:32.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.176+0000 7fe4fbe18740 20 client.18318 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.177+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d0baeebff0 0x55d0baeee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.177+0000 7fe4fbe18740 4 client.18318 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "82920f6e", "release": true, "await": true}] 2024-09-19T06:50:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.177+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3455185937 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "82920f6e", "release": true, "await": true}) -- 0x55d0badce0a0 con 0x55d0baeebff0 2024-09-19T06:50:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.177+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d0baeebff0 0x55d0baeee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.177+0000 7fe4f2ffd640 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d0baeebff0 0x55d0baeee3e0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=981aa81f9bbf1f2b server_cookie=45c083e02d230ce5 in_seq=0 out_seq=0 2024-09-19T06:50:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.177+0000 7fe4d2ffd640 10 client.18318 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.212+0000 7fe4d2ffd640 1 -- 172.21.15.12:0/3455185937 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d0badce0a0 con 0x55d0baeebff0 2024-09-19T06:50:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.212+0000 7fe4d2ffd640 10 client.18318 handle_command_reply: tid=0 2024-09-19T06:50:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.212+0000 7fe4fbe18740 1 client.18318 shutdown 2024-09-19T06:50:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.212+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3455185937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 msgr2=0x55d0baee9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.212+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0baee9f70 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009900 tx=0x7fe4e4009260 comp rx=0 tx=0).stop 2024-09-19T06:50:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.213+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3455185937 shutdown_connections 2024-09-19T06:50:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.213+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55d0baeebff0 0x55d0baeee3e0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.213+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d0bae70650 0x55d0baee9f70 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.213+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0bae61860 0x55d0bae750e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.213+0000 7fe4d2ffd640 0 client.18318 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.213+0000 7fe4fbe18740 1 --2- 172.21.15.12:0/3455185937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d0bae60f40 0x55d0bae74ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.213+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3455185937 >> 172.21.15.12:0/3455185937 conn(0x55d0bae5d5f0 msgr2=0x55d0bae63270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.215+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3455185937 shutdown_connections 2024-09-19T06:50:32.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.215+0000 7fe4fbe18740 1 -- 172.21.15.12:0/3455185937 wait complete. 2024-09-19T06:50:32.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.216+0000 7fe4fbe18740 20 client.18318 trim_cache size 0 max 16384 2024-09-19T06:50:32.219 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:50:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 44, 2024-09-19T06:50:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:50:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 36, 2024-09-19T06:50:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:50:32.219 INFO:teuthology.orchestra.run.smithi012.stdout: "82920f6e": { 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 36, 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 150.0, 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:50:32.220 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:50:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:50:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:50:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:32.221 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:50:32.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2861958663 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe4e00a33b0 msgr2=0x7fe4e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:32.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe4e00a33b0 0x7fe4e00a5870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4005c40 tx=0x7fe4e4005b50 comp rx=0 tx=0).stop 2024-09-19T06:50:32.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2861958663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f4102790 msgr2=0x7fe4f4198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:32.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f4102790 0x7fe4f4198990 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00d950 tx=0x7fe4dc00de10 comp rx=0 tx=0).stop 2024-09-19T06:50:32.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2861958663 shutdown_connections 2024-09-19T06:50:32.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe4e00a33b0 0x7fe4e00a5870 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4f4106f10 0x7fe4f419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f4102790 0x7fe4f4198990 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 --2- 172.21.15.12:0/2861958663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4f4101de0 0x7fe4f4198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:32.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2861958663 >> 172.21.15.12:0/2861958663 conn(0x7fe4f40fd8c0 msgr2=0x7fe4f40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:32.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2861958663 shutdown_connections 2024-09-19T06:50:32.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:32.218+0000 7fe4f9a3f640 1 -- 172.21.15.12:0/2861958663 wait complete. 2024-09-19T06:50:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:31 smithi016 ceph-mon[34911]: pgmap v322: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.0 MiB/s wr, 344 op/s 2024-09-19T06:50:32.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:31 smithi173 ceph-mon[35349]: pgmap v322: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.0 MiB/s wr, 344 op/s 2024-09-19T06:50:33.107 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '82920f6e', total seconds elapsed: 33.8 2024-09-19T06:50:33.107 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T06:50:33.107 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:50:33.492 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.018+0000 7feb12e38640 1 -- 172.21.15.12:0/3283723675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb0c1036e0 msgr2=0x7feb0c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.018+0000 7feb12e38640 1 --2- 172.21.15.12:0/3283723675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb0c1036e0 0x7feb0c107b90 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009930 tx=0x7feaf802a420 comp rx=0 tx=0).stop 2024-09-19T06:50:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.018+0000 7feb12e38640 1 -- 172.21.15.12:0/3283723675 shutdown_connections 2024-09-19T06:50:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.018+0000 7feb12e38640 1 --2- 172.21.15.12:0/3283723675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c1082a0 0x7feb0c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.018+0000 7feb12e38640 1 --2- 172.21.15.12:0/3283723675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb0c1036e0 0x7feb0c107b90 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.018+0000 7feb12e38640 1 --2- 172.21.15.12:0/3283723675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb0c102d30 0x7feb0c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.018+0000 7feb12e38640 1 -- 172.21.15.12:0/3283723675 >> 172.21.15.12:0/3283723675 conn(0x7feb0c0fc7d0 msgr2=0x7feb0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.018+0000 7feb12e38640 1 -- 172.21.15.12:0/3283723675 shutdown_connections 2024-09-19T06:50:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.019+0000 7feb12e38640 1 -- 172.21.15.12:0/3283723675 wait complete. 2024-09-19T06:50:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.020+0000 7feb12e38640 1 Processor -- start 2024-09-19T06:50:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.020+0000 7feb12e38640 1 -- start start 2024-09-19T06:50:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.020+0000 7feb12e38640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb0c102d30 0x7feb0c19e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.020+0000 7feb12e38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c1082a0 0x7feb0c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.020+0000 7feb12e38640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb0c198600 0x7feb0c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.020+0000 7feb12e38640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c1120a0 con 0x7feb0c198600 2024-09-19T06:50:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.020+0000 7feb12e38640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c111f20 con 0x7feb0c1082a0 2024-09-19T06:50:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.020+0000 7feb12e38640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c112220 con 0x7feb0c102d30 2024-09-19T06:50:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb10bd4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb0c102d30 0x7feb0c19e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c1082a0 0x7feb0c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb10bd4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb0c102d30 0x7feb0c19e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58562/0 (socket says 172.21.15.12:58562) 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb10bd4640 1 -- 172.21.15.12:0/769117889 learned_addr learned my addr 172.21.15.12:0/769117889 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb113d5640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb0c198600 0x7feb0c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb0bfff640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c1082a0 0x7feb0c19e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34688/0 (socket says 172.21.15.12:34688) 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb10bd4640 1 -- 172.21.15.12:0/769117889 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c1082a0 msgr2=0x7feb0c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb10bd4640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c1082a0 0x7feb0c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb10bd4640 1 -- 172.21.15.12:0/769117889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb0c198600 msgr2=0x7feb0c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb10bd4640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb0c198600 0x7feb0c198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb10bd4640 1 -- 172.21.15.12:0/769117889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0c199120 con 0x7feb0c102d30 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb0bfff640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c1082a0 0x7feb0c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb10bd4640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb0c102d30 0x7feb0c19e440 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feb00009ca0 tx=0x7feb00007590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb09ffb640 1 -- 172.21.15.12:0/769117889 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0000e270 con 0x7feb0c102d30 2024-09-19T06:50:34.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb09ffb640 1 -- 172.21.15.12:0/769117889 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb0000e410 con 0x7feb0c102d30 2024-09-19T06:50:34.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb09ffb640 1 -- 172.21.15.12:0/769117889 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0000d660 con 0x7feb0c102d30 2024-09-19T06:50:34.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.021+0000 7feb12e38640 1 -- 172.21.15.12:0/769117889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0c199410 con 0x7feb0c102d30 2024-09-19T06:50:34.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.022+0000 7feb12e38640 1 -- 172.21.15.12:0/769117889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb0c100bb0 con 0x7feb0c102d30 2024-09-19T06:50:34.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.023+0000 7feb12e38640 1 -- 172.21.15.12:0/769117889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb0c107b90 con 0x7feb0c102d30 2024-09-19T06:50:34.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.024+0000 7feb09ffb640 1 -- 172.21.15.12:0/769117889 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7feb00017450 con 0x7feb0c102d30 2024-09-19T06:50:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.025+0000 7feb09ffb640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feafc0a3460 0x7feafc0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.025+0000 7feb09ffb640 1 -- 172.21.15.12:0/769117889 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7feb000cfd70 con 0x7feb0c102d30 2024-09-19T06:50:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.025+0000 7feb0bfff640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feafc0a3460 0x7feafc0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.026+0000 7feb0bfff640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feafc0a3460 0x7feafc0a5920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feaf8008000 tx=0x7feaf80058d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.029+0000 7feb09ffb640 1 -- 172.21.15.12:0/769117889 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feb0009c6b0 con 0x7feb0c102d30 2024-09-19T06:50:34.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:33 smithi016 ceph-mon[34911]: pgmap v323: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-19T06:50:34.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:33 smithi173 ceph-mon[35349]: pgmap v323: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-19T06:50:34.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.375+0000 7feb12e38640 1 -- 172.21.15.12:0/769117889 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb0c10a2b0 con 0x7feb0c102d30 2024-09-19T06:50:34.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:33 smithi012 ceph-mon[30937]: pgmap v323: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-19T06:50:34.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.376+0000 7feb09ffb640 1 -- 172.21.15.12:0/769117889 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11971 (secure 0 0 0) 0x7feb0009bfb0 con 0x7feb0c102d30 2024-09-19T06:50:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:50:34.379 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"btime":"2024-09-19T06:48:35:302779+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:48:34.412947+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:50:34.379 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 44 2024-09-19T06:50:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.380+0000 7feb12e38640 1 -- 172.21.15.12:0/769117889 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feafc0a3460 msgr2=0x7feafc0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.380+0000 7feb12e38640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feafc0a3460 0x7feafc0a5920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feaf8008000 tx=0x7feaf80058d0 comp rx=0 tx=0).stop 2024-09-19T06:50:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.380+0000 7feb12e38640 1 -- 172.21.15.12:0/769117889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb0c102d30 msgr2=0x7feb0c19e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.380+0000 7feb12e38640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb0c102d30 0x7feb0c19e440 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feb00009ca0 tx=0x7feb00007590 comp rx=0 tx=0).stop 2024-09-19T06:50:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.380+0000 7feb12e38640 1 -- 172.21.15.12:0/769117889 shutdown_connections 2024-09-19T06:50:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.380+0000 7feb12e38640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb0c198600 0x7feb0c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.380+0000 7feb12e38640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb0c1082a0 0x7feb0c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.380+0000 7feb12e38640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7feafc0a3460 0x7feafc0a5920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.380+0000 7feb12e38640 1 --2- 172.21.15.12:0/769117889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb0c102d30 0x7feb0c19e440 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.380+0000 7feb12e38640 1 -- 172.21.15.12:0/769117889 >> 172.21.15.12:0/769117889 conn(0x7feb0c0fc7d0 msgr2=0x7feb0c0fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:34.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.381+0000 7feb12e38640 1 -- 172.21.15.12:0/769117889 shutdown_connections 2024-09-19T06:50:34.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:34.381+0000 7feb12e38640 1 -- 172.21.15.12:0/769117889 wait complete. 2024-09-19T06:50:35.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:34 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/769117889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:35.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:34 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/769117889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:35.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:34 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/769117889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:35.391 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T06:50:35.391 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T06:50:35.777 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:35.817 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 590.0 s, 1414.4 tps, lat 445.686 ms stddev 3305.649 2024-09-19T06:50:36.233 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:35 smithi012 ceph-mon[30937]: pgmap v324: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 151 KiB/s wr, 31 op/s 2024-09-19T06:50:36.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:35 smithi016 ceph-mon[34911]: pgmap v324: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 151 KiB/s wr, 31 op/s 2024-09-19T06:50:36.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:35 smithi173 ceph-mon[35349]: pgmap v324: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 151 KiB/s wr, 31 op/s 2024-09-19T06:50:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.367+0000 7f39ef577640 1 -- 172.21.15.12:0/2570277442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e81091f0 msgr2=0x7f39e81095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.367+0000 7f39ef577640 1 --2- 172.21.15.12:0/2570277442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e81091f0 0x7f39e81095d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009ca0 tx=0x7f39d802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.367+0000 7f39ef577640 1 -- 172.21.15.12:0/2570277442 shutdown_connections 2024-09-19T06:50:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.367+0000 7f39ef577640 1 --2- 172.21.15.12:0/2570277442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39e8116ea0 0x7f39e8119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.367+0000 7f39ef577640 1 --2- 172.21.15.12:0/2570277442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e8109b10 0x7f39e8116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.367+0000 7f39ef577640 1 --2- 172.21.15.12:0/2570277442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e81091f0 0x7f39e81095d0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.367+0000 7f39ef577640 1 -- 172.21.15.12:0/2570277442 >> 172.21.15.12:0/2570277442 conn(0x7f39e806e140 msgr2=0x7f39e806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:36.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.368+0000 7f39ef577640 1 -- 172.21.15.12:0/2570277442 shutdown_connections 2024-09-19T06:50:36.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.368+0000 7f39ef577640 1 -- 172.21.15.12:0/2570277442 wait complete. 2024-09-19T06:50:36.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.368+0000 7f39ef577640 1 Processor -- start 2024-09-19T06:50:36.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.368+0000 7f39ef577640 1 -- start start 2024-09-19T06:50:36.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ef577640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39e81091f0 0x7f39e81a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ef577640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e8109b10 0x7f39e81a3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ef577640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e8116ea0 0x7f39e81a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ef577640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f39e811ca00 con 0x7f39e8116ea0 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ef577640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39e811c880 con 0x7f39e81091f0 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ef577640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f39e811cb80 con 0x7f39e8109b10 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ed313640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39e81091f0 0x7f39e81a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ed313640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39e81091f0 0x7f39e81a2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34700/0 (socket says 172.21.15.12:34700) 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ed313640 1 -- 172.21.15.12:0/2393502215 learned_addr learned my addr 172.21.15.12:0/2393502215 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ecb12640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e8109b10 0x7f39e81a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39edb14640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e8116ea0 0x7f39e81a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ed313640 1 -- 172.21.15.12:0/2393502215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e8109b10 msgr2=0x7f39e81a3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ed313640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e8109b10 0x7f39e81a3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ed313640 1 -- 172.21.15.12:0/2393502215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e8116ea0 msgr2=0x7f39e81a76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ed313640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e8116ea0 0x7f39e81a76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.369+0000 7f39ed313640 1 -- 172.21.15.12:0/2393502215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e81a7db0 con 0x7f39e81091f0 2024-09-19T06:50:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.370+0000 7f39ed313640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39e81091f0 0x7f39e81a2e00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f39d8005e30 tx=0x7f39d8003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.371+0000 7f39e67fc640 1 -- 172.21.15.12:0/2393502215 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d80316d0 con 0x7f39e81091f0 2024-09-19T06:50:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.371+0000 7f39e67fc640 1 -- 172.21.15.12:0/2393502215 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39d8031870 con 0x7f39e81091f0 2024-09-19T06:50:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.371+0000 7f39e67fc640 1 -- 172.21.15.12:0/2393502215 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d802fb70 con 0x7f39e81091f0 2024-09-19T06:50:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.371+0000 7f39ef577640 1 -- 172.21.15.12:0/2393502215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e81a8040 con 0x7f39e81091f0 2024-09-19T06:50:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.371+0000 7f39ef577640 1 -- 172.21.15.12:0/2393502215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e81a8470 con 0x7f39e81091f0 2024-09-19T06:50:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.374+0000 7f39e67fc640 1 -- 172.21.15.12:0/2393502215 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f39d802fd50 con 0x7f39e81091f0 2024-09-19T06:50:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.375+0000 7f39e67fc640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39d00a3500 0x7f39d00a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.375+0000 7f39e67fc640 1 -- 172.21.15.12:0/2393502215 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f39d80f0fc0 con 0x7f39e81091f0 2024-09-19T06:50:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.375+0000 7f39ecb12640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39d00a3500 0x7f39d00a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.376+0000 7f39f1950740 1 Processor -- start 2024-09-19T06:50:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.376+0000 7f39f1950740 1 -- start start 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.376+0000 7f39f1950740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdc760 0x55c426fdcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.376+0000 7f39f1950740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdd080 0x55c426fe7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.376+0000 7f39f1950740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 0x55c426fe9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.376+0000 7f39f1950740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c426f422a0 con 0x55c426fdd080 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.376+0000 7f39f1950740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c426ee9b10 con 0x55c426fe7940 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.376+0000 7f39f1950740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c426f3e260 con 0x55c426fdc760 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.376+0000 7f39ecb12640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39d00a3500 0x7f39d00a59c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f39e8119200 tx=0x7f39dc00b390 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.376+0000 7f39ecb12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdd080 0x55c426fe7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39ecb12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdd080 0x55c426fe7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42920/0 (socket says 172.21.15.12:42920) 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39edb14640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 0x55c426fe9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39ecb12640 1 -- 172.21.15.12:0/4040897947 learned_addr learned my addr 172.21.15.12:0/4040897947 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39ed313640 1 --2- 172.21.15.12:0/4040897947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdc760 0x55c426fdcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39edb14640 1 -- 172.21.15.12:0/4040897947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdc760 msgr2=0x55c426fdcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39edb14640 1 --2- 172.21.15.12:0/4040897947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdc760 0x55c426fdcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39edb14640 1 -- 172.21.15.12:0/4040897947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdd080 msgr2=0x55c426fe7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39edb14640 1 --2- 172.21.15.12:0/4040897947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdd080 0x55c426fe7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39edb14640 1 -- 172.21.15.12:0/4040897947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c426cb3b90 con 0x55c426fe7940 2024-09-19T06:50:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39ecb12640 1 --2- 172.21.15.12:0/4040897947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdd080 0x55c426fe7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39edb14640 1 --2- 172.21.15.12:0/4040897947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 0x55c426fe9d30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009b50 tx=0x7f39e0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f34ffa0842b15d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39cf7fe640 1 -- 172.21.15.12:0/4040897947 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0004050 con 0x55c426fe7940 2024-09-19T06:50:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39cf7fe640 1 -- 172.21.15.12:0/4040897947 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39e0005500 con 0x55c426fe7940 2024-09-19T06:50:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.377+0000 7f39cf7fe640 1 -- 172.21.15.12:0/4040897947 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e0004d00 con 0x55c426fe7940 2024-09-19T06:50:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.378+0000 7f39f1950740 1 -- 172.21.15.12:0/4040897947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 msgr2=0x55c426fe9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.378+0000 7f39f1950740 1 --2- 172.21.15.12:0/4040897947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 0x55c426fe9d30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009b50 tx=0x7f39e0011810 comp rx=0 tx=0).stop 2024-09-19T06:50:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.378+0000 7f39f1950740 1 -- 172.21.15.12:0/4040897947 shutdown_connections 2024-09-19T06:50:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.378+0000 7f39f1950740 1 --2- 172.21.15.12:0/4040897947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 0x55c426fe9d30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.378+0000 7f39f1950740 1 --2- 172.21.15.12:0/4040897947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdd080 0x55c426fe7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.378+0000 7f39f1950740 1 --2- 172.21.15.12:0/4040897947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdc760 0x55c426fdcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.378+0000 7f39f1950740 1 -- 172.21.15.12:0/4040897947 >> 172.21.15.12:0/4040897947 conn(0x55c426fd8cf0 msgr2=0x55c426fd90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.378+0000 7f39f1950740 1 -- 172.21.15.12:0/4040897947 shutdown_connections 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.378+0000 7f39f1950740 1 -- 172.21.15.12:0/4040897947 wait complete. 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.379+0000 7f39f1950740 1 -- start start 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.379+0000 7f39f1950740 1 Processor -- start 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.380+0000 7f39f1950740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdc760 0x55c426fe47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.380+0000 7f39ed313640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdc760 0x55c426fe47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.380+0000 7f39ed313640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdc760 0x55c426fe47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34716/0 (socket says 172.21.15.12:34716) 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.380+0000 7f39f1950740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 0x55c426fe4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.380+0000 7f39ed313640 1 -- 172.21.15.12:0/1343376227 learned_addr learned my addr 172.21.15.12:0/1343376227 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.380+0000 7f39f1950740 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fe7940 0x55c426fe5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.380+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c426fea510 con 0x55c426fe7940 2024-09-19T06:50:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.380+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c426eca6e0 con 0x55c426fdc760 2024-09-19T06:50:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.380+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c426fea690 con 0x55c426fdd080 2024-09-19T06:50:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.380+0000 7f39f1950740 10 client.0 _ll_register_callbacks cb 0x55c426eeea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.381+0000 7f39ecb12640 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 0x55c426fe4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.381+0000 7f39edb14640 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fe7940 0x55c426fe5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.381+0000 7f39ecb12640 1 -- 172.21.15.12:0/1343376227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdc760 msgr2=0x55c426fe47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.381+0000 7f39ecb12640 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdc760 0x55c426fe47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.381+0000 7f39ecb12640 1 -- 172.21.15.12:0/1343376227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fe7940 msgr2=0x55c426fe5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.381+0000 7f39ecb12640 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fe7940 0x55c426fe5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.381+0000 7f39ecb12640 1 -- 172.21.15.12:0/1343376227 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c426ffc1f0 con 0x55c426fdd080 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.382+0000 7f39ecb12640 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 0x55c426fe4d10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00b9c0 tx=0x7f39dc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d28377b7a046e9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.382+0000 7f39ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.382+0000 7f39ccff9640 1 -- 172.21.15.12:0/1343376227 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc01e7c0 con 0x55c426fdd080 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.382+0000 7f39ccff9640 1 -- 172.21.15.12:0/1343376227 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f39dc01e960 con 0x55c426fdd080 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.382+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39e0005500 con 0x55c426fdd080 2024-09-19T06:50:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.383+0000 7f39ccff9640 1 -- 172.21.15.12:0/1343376227 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f39dc01eba0 con 0x55c426fdd080 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.383+0000 7f39f1950740 10 client.27676 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.383+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c426ffebc0 con 0x55c426fdd080 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.383+0000 7f39ccff9640 1 -- 172.21.15.12:0/1343376227 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39e0005500 con 0x55c426fdd080 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.383+0000 7f39ccff9640 1 -- 172.21.15.12:0/1343376227 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f39dc01f430 con 0x55c426fdd080 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.383+0000 7f39f1950740 10 client.27676 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.383+0000 7f39f1950740 10 client.27676 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.383+0000 7f39f1950740 20 client.27676 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.383+0000 7f39f1950740 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c4270000d0 0x55c4270024f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.384+0000 7f39f1950740 4 client.27676 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.384+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c426f4f9d0 con 0x55c4270000d0 2024-09-19T06:50:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.384+0000 7f39ed313640 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c4270000d0 0x55c4270024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.384+0000 7f39ed313640 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c4270000d0 0x55c4270024f0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79869072fd04e3f server_cookie=f40e1ce1c4dfcbce in_seq=0 out_seq=0 2024-09-19T06:50:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.384+0000 7f39ccff9640 10 client.27676 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.385+0000 7f39ccff9640 1 -- 172.21.15.12:0/1343376227 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c426f4f9d0 con 0x55c4270000d0 2024-09-19T06:50:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.385+0000 7f39ccff9640 10 client.27676 handle_command_reply: tid=0 2024-09-19T06:50:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.385+0000 7f39f1950740 1 client.27676 shutdown 2024-09-19T06:50:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.385+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 msgr2=0x55c426fe4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.385+0000 7f39f1950740 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 0x55c426fe4d10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00b9c0 tx=0x7f39dc004730 comp rx=0 tx=0).stop 2024-09-19T06:50:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.386+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 shutdown_connections 2024-09-19T06:50:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.386+0000 7f39f1950740 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c4270000d0 0x55c4270024f0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.386+0000 7f39f1950740 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fe7940 0x55c426fe5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.386+0000 7f39ccff9640 0 client.27676 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.386+0000 7f39f1950740 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 0x55c426fe4d10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.386+0000 7f39f1950740 1 --2- 172.21.15.12:0/1343376227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdc760 0x55c426fe47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.386+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 >> 172.21.15.12:0/1343376227 conn(0x55c426fd8cf0 msgr2=0x55c426fdea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.386+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 shutdown_connections 2024-09-19T06:50:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.386+0000 7f39f1950740 1 -- 172.21.15.12:0/1343376227 wait complete. 2024-09-19T06:50:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.386+0000 7f39f1950740 20 client.27676 trim_cache size 0 max 16384 2024-09-19T06:50:36.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39f1950740 1 Processor -- start 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39f1950740 1 -- start start 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39f1950740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426fde8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39f1950740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 0x55c427007da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39f1950740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 0x55c4270082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39f1950740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f39e81b4170 con 0x55c426fdc760 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39f1950740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39e81b5cb0 con 0x55c426fe7940 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39f1950740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f39e81b4840 con 0x55c426fdd080 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39ed313640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426fde8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39ed313640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426fde8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42942/0 (socket says 172.21.15.12:42942) 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.409+0000 7f39ed313640 1 -- 172.21.15.12:0/2690815455 learned_addr learned my addr 172.21.15.12:0/2690815455 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39edb14640 1 --2- 172.21.15.12:0/2690815455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 0x55c4270082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39ecb12640 1 --2- 172.21.15.12:0/2690815455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 0x55c427007da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39ed313640 1 -- 172.21.15.12:0/2690815455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 msgr2=0x55c427007da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39ed313640 1 --2- 172.21.15.12:0/2690815455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 0x55c427007da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39ed313640 1 -- 172.21.15.12:0/2690815455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 msgr2=0x55c4270082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39ed313640 1 --2- 172.21.15.12:0/2690815455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 0x55c4270082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39ed313640 1 -- 172.21.15.12:0/2690815455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c426fdceb0 con 0x55c426fdc760 2024-09-19T06:50:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39ed313640 1 --2- 172.21.15.12:0/2690815455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426fde8c0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f39d80b97a0 tx=0x7f39d8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8250a5f8f0f0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39ceffd640 1 -- 172.21.15.12:0/2690815455 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d80cce80 con 0x55c426fdc760 2024-09-19T06:50:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39ceffd640 1 -- 172.21.15.12:0/2690815455 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39d8036040 con 0x55c426fdc760 2024-09-19T06:50:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.410+0000 7f39ceffd640 1 -- 172.21.15.12:0/2690815455 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8004620 con 0x55c426fdc760 2024-09-19T06:50:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.413+0000 7f39f1950740 1 -- 172.21.15.12:0/2690815455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 msgr2=0x55c426fde8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.413+0000 7f39f1950740 1 --2- 172.21.15.12:0/2690815455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426fde8c0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f39d80b97a0 tx=0x7f39d8000f40 comp rx=0 tx=0).stop 2024-09-19T06:50:36.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.414+0000 7f39f1950740 1 -- 172.21.15.12:0/2690815455 shutdown_connections 2024-09-19T06:50:36.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.414+0000 7f39f1950740 1 --2- 172.21.15.12:0/2690815455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fe7940 0x55c4270082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.414+0000 7f39f1950740 1 --2- 172.21.15.12:0/2690815455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fdd080 0x55c427007da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.414+0000 7f39f1950740 1 --2- 172.21.15.12:0/2690815455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426fde8c0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.414+0000 7f39f1950740 1 -- 172.21.15.12:0/2690815455 >> 172.21.15.12:0/2690815455 conn(0x55c426fd8cf0 msgr2=0x55c426fde1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:36.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.414+0000 7f39f1950740 1 -- 172.21.15.12:0/2690815455 shutdown_connections 2024-09-19T06:50:36.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.414+0000 7f39f1950740 1 -- 172.21.15.12:0/2690815455 wait complete. 2024-09-19T06:50:36.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.414+0000 7f39f1950740 1 -- start start 2024-09-19T06:50:36.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.414+0000 7f39f1950740 1 Processor -- start 2024-09-19T06:50:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39f1950740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426ff4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39f1950740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdd080 0x55c426ff4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39f1950740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fe7940 0x55c427069d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39f1950740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f39e81b55e0 con 0x55c426fdc760 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39f1950740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39e81b4f10 con 0x55c426fdd080 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39f1950740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f39e81b21b0 con 0x55c426fe7940 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39f1950740 10 client.0 _ll_register_callbacks cb 0x7f39dc010c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39ecb12640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdd080 0x55c426ff4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39ecb12640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdd080 0x55c426ff4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34722/0 (socket says 172.21.15.12:34722) 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39ecb12640 1 -- 172.21.15.12:0/4009334981 learned_addr learned my addr 172.21.15.12:0/4009334981 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39ed313640 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426ff4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39edb14640 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fe7940 0x55c427069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39ecb12640 1 -- 172.21.15.12:0/4009334981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fe7940 msgr2=0x55c427069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:36.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39ecb12640 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fe7940 0x55c427069d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39ecb12640 1 -- 172.21.15.12:0/4009334981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 msgr2=0x55c426ff4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39ecb12640 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426ff4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39ecb12640 1 -- 172.21.15.12:0/4009334981 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c42706a2b0 con 0x55c426fdd080 2024-09-19T06:50:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39edb14640 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fe7940 0x55c427069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.415+0000 7f39ed313640 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426ff4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.416+0000 7f39ecb12640 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdd080 0x55c426ff4b40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f39dc010860 tx=0x7f39dc01fcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a5730cb5b341a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.416+0000 7f39ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:50:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.416+0000 7f39ccff9640 1 -- 172.21.15.12:0/4009334981 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc005850 con 0x55c426fdd080 2024-09-19T06:50:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.416+0000 7f39ccff9640 1 -- 172.21.15.12:0/4009334981 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f39dc01e5c0 con 0x55c426fdd080 2024-09-19T06:50:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.416+0000 7f39f1950740 1 -- 172.21.15.12:0/4009334981 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d8036040 con 0x55c426fdd080 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.417+0000 7f39ccff9640 1 -- 172.21.15.12:0/4009334981 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f39dc010df0 con 0x55c426fdd080 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.417+0000 7f39f1950740 10 client.27734 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.417+0000 7f39f1950740 1 -- 172.21.15.12:0/4009334981 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c42706b4d0 con 0x55c426fdd080 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.417+0000 7f39ccff9640 1 -- 172.21.15.12:0/4009334981 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39d8036040 con 0x55c426fdd080 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.418+0000 7f39ccff9640 1 -- 172.21.15.12:0/4009334981 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f39dc02f450 con 0x55c426fdd080 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.418+0000 7f39f1950740 10 client.27734 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.418+0000 7f39f1950740 10 client.27734 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.418+0000 7f39f1950740 20 client.27734 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.418+0000 7f39f1950740 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c4270000d0 0x55c42706dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.418+0000 7f39f1950740 4 client.27734 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.418+0000 7f39f1950740 1 -- 172.21.15.12:0/4009334981 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55c426f49d20 con 0x55c4270000d0 2024-09-19T06:50:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.418+0000 7f39ed313640 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c4270000d0 0x55c42706dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.418+0000 7f39ed313640 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c4270000d0 0x55c42706dd20 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe264dbb10dd4188 server_cookie=e29f4b59059ed25 in_seq=0 out_seq=0 2024-09-19T06:50:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.418+0000 7f39ccff9640 10 client.27734 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:36.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.556+0000 7f39ccff9640 1 -- 172.21.15.12:0/4009334981 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c426f49d20 con 0x55c4270000d0 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.556+0000 7f39ccff9640 10 client.27734 handle_command_reply: tid=0 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.556+0000 7f39f1950740 1 client.27734 shutdown 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.556+0000 7f39f1950740 1 -- 172.21.15.12:0/4009334981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdd080 msgr2=0x55c426ff4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.556+0000 7f39f1950740 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdd080 0x55c426ff4b40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f39dc010860 tx=0x7f39dc01fcf0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.557+0000 7f39f1950740 1 -- 172.21.15.12:0/4009334981 shutdown_connections 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.557+0000 7f39f1950740 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c4270000d0 0x55c42706dd20 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.557+0000 7f39f1950740 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c426fe7940 0x55c427069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.557+0000 7f39f1950740 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c426fdd080 0x55c426ff4b40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.557+0000 7f39ccff9640 0 client.27734 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.557+0000 7f39f1950740 1 --2- 172.21.15.12:0/4009334981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c426fdc760 0x55c426ff4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.557+0000 7f39f1950740 1 -- 172.21.15.12:0/4009334981 >> 172.21.15.12:0/4009334981 conn(0x55c426fd8cf0 msgr2=0x55c426fe6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:36.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.557+0000 7f39f1950740 1 -- 172.21.15.12:0/4009334981 shutdown_connections 2024-09-19T06:50:36.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.557+0000 7f39f1950740 1 -- 172.21.15.12:0/4009334981 wait complete. 2024-09-19T06:50:36.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.557+0000 7f39f1950740 20 client.27734 trim_cache size 0 max 16384 2024-09-19T06:50:36.560 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:50:36.560 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 44, 2024-09-19T06:50:36.560 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:50:36.560 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 38, 2024-09-19T06:50:36.560 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "59926833": { 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 38, 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 150.0, 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:50:36.561 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:50:36.562 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:50:36.562 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:36.562 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:36.562 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:36.562 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:36.562 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:50:36.562 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 -- 172.21.15.12:0/2393502215 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39d00a3500 msgr2=0x7f39d00a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39d00a3500 0x7f39d00a59c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f39e8119200 tx=0x7f39dc00b390 comp rx=0 tx=0).stop 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 -- 172.21.15.12:0/2393502215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39e81091f0 msgr2=0x7f39e81a2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39e81091f0 0x7f39e81a2e00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f39d8005e30 tx=0x7f39d8003f90 comp rx=0 tx=0).stop 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 -- 172.21.15.12:0/2393502215 shutdown_connections 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39e8116ea0 0x7f39e81a76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f39d00a3500 0x7f39d00a59c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e8109b10 0x7f39e81a3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 --2- 172.21.15.12:0/2393502215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39e81091f0 0x7f39e81a2e00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 -- 172.21.15.12:0/2393502215 >> 172.21.15.12:0/2393502215 conn(0x7f39e806e140 msgr2=0x7f39e8117320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 -- 172.21.15.12:0/2393502215 shutdown_connections 2024-09-19T06:50:36.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:36.558+0000 7f39ef577640 1 -- 172.21.15.12:0/2393502215 wait complete. 2024-09-19T06:50:37.228 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '59926833', quiesce took 4.1 seconds. Will release after: 25.9 2024-09-19T06:50:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.173+0000 7fb63045a640 1 -- 172.21.15.12:0/3140781048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb628102480 msgr2=0x7fb62810e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.173+0000 7fb63045a640 1 --2- 172.21.15.12:0/3140781048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb628102480 0x7fb62810e9b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fb620009cd0 tx=0x7fb62002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.173+0000 7fb63045a640 1 -- 172.21.15.12:0/3140781048 shutdown_connections 2024-09-19T06:50:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.173+0000 7fb63045a640 1 --2- 172.21.15.12:0/3140781048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb628102480 0x7fb62810e9b0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.173+0000 7fb63045a640 1 --2- 172.21.15.12:0/3140781048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb628101ae0 0x7fb628101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.173+0000 7fb63045a640 1 --2- 172.21.15.12:0/3140781048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb628107b80 0x7fb628107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.173+0000 7fb63045a640 1 -- 172.21.15.12:0/3140781048 >> 172.21.15.12:0/3140781048 conn(0x7fb6280fd7e0 msgr2=0x7fb6280ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.173+0000 7fb63045a640 1 -- 172.21.15.12:0/3140781048 shutdown_connections 2024-09-19T06:50:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.173+0000 7fb63045a640 1 -- 172.21.15.12:0/3140781048 wait complete. 2024-09-19T06:50:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.173+0000 7fb63045a640 1 Processor -- start 2024-09-19T06:50:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb63045a640 1 -- start start 2024-09-19T06:50:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb63045a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb628101ae0 0x7fb628198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb63045a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb628102480 0x7fb628198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb63045a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb628107b80 0x7fb62819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb63045a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb628111ef0 con 0x7fb628102480 2024-09-19T06:50:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb63045a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb628111d70 con 0x7fb628101ae0 2024-09-19T06:50:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb63045a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb628112070 con 0x7fb628107b80 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb62d9f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb628102480 0x7fb628198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb62d9f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb628102480 0x7fb628198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42980/0 (socket says 172.21.15.12:42980) 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb62d9f5640 1 -- 172.21.15.12:0/2447314489 learned_addr learned my addr 172.21.15.12:0/2447314489 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb628101ae0 0x7fb628198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb62e9f7640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb628107b80 0x7fb62819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb62d9f5640 1 -- 172.21.15.12:0/2447314489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb628107b80 msgr2=0x7fb62819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb628107b80 0x7fb62819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb62d9f5640 1 -- 172.21.15.12:0/2447314489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb628101ae0 msgr2=0x7fb628198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb628101ae0 0x7fb628198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.174+0000 7fb62d9f5640 1 -- 172.21.15.12:0/2447314489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62819d310 con 0x7fb628102480 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.175+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb628102480 0x7fb628198860 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00d950 tx=0x7fb61c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.175+0000 7fb61b7fe640 1 -- 172.21.15.12:0/2447314489 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c017070 con 0x7fb628102480 2024-09-19T06:50:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.175+0000 7fb61b7fe640 1 -- 172.21.15.12:0/2447314489 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb61c009c30 con 0x7fb628102480 2024-09-19T06:50:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.175+0000 7fb63045a640 1 -- 172.21.15.12:0/2447314489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62819d600 con 0x7fb628102480 2024-09-19T06:50:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.175+0000 7fb61b7fe640 1 -- 172.21.15.12:0/2447314489 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c00f6b0 con 0x7fb628102480 2024-09-19T06:50:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.175+0000 7fb63045a640 1 -- 172.21.15.12:0/2447314489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6281a4e90 con 0x7fb628102480 2024-09-19T06:50:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.177+0000 7fb61b7fe640 1 -- 172.21.15.12:0/2447314489 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb61c0109d0 con 0x7fb628102480 2024-09-19T06:50:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.178+0000 7fb6331f5740 1 Processor -- start 2024-09-19T06:50:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.178+0000 7fb6331f5740 1 -- start start 2024-09-19T06:50:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfd9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfda410 0x55badcfe4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfe4cb0 0x55badcfe70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb6331f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55badcf3e2f0 con 0x55badcfd9af0 2024-09-19T06:50:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb6331f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55badcee6270 con 0x55badcfe4cb0 2024-09-19T06:50:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb6331f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55badcf3a2b0 con 0x55badcfda410 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62e9f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfd9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62e9f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfd9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42994/0 (socket says 172.21.15.12:42994) 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62e9f7640 1 -- 172.21.15.12:0/3971730913 learned_addr learned my addr 172.21.15.12:0/3971730913 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb61b7fe640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb6140a34e0 0x7fb6140a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/3971730913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfda410 0x55badcfe4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/3971730913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfe4cb0 0x55badcfe70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62e9f7640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb6140a34e0 0x7fb6140a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb61b7fe640 1 -- 172.21.15.12:0/2447314489 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fb61c0cf900 con 0x7fb628102480 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62e9f7640 1 -- 172.21.15.12:0/3971730913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfda410 msgr2=0x55badcfe4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62e9f7640 1 --2- 172.21.15.12:0/3971730913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfda410 0x55badcfe4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62e9f7640 1 -- 172.21.15.12:0/3971730913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfe4cb0 msgr2=0x55badcfe70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62e9f7640 1 --2- 172.21.15.12:0/3971730913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfe4cb0 0x55badcfe70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.179+0000 7fb62e9f7640 1 -- 172.21.15.12:0/3971730913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55badcee5340 con 0x55badcfd9af0 2024-09-19T06:50:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.180+0000 7fb62e9f7640 1 --2- 172.21.15.12:0/3971730913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfd9ed0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb620009430 tx=0x7fb620031b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27fcbfcde56e6f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.180+0000 7fb618bfe640 1 -- 172.21.15.12:0/3971730913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620004610 con 0x55badcfd9af0 2024-09-19T06:50:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.180+0000 7fb618bfe640 1 -- 172.21.15.12:0/3971730913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb620036070 con 0x55badcfd9af0 2024-09-19T06:50:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.180+0000 7fb618bfe640 1 -- 172.21.15.12:0/3971730913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62004a450 con 0x55badcfd9af0 2024-09-19T06:50:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.180+0000 7fb62e9f7640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb6140a34e0 0x7fb6140a59a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb620009a60 tx=0x7fb62004c000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 -- 172.21.15.12:0/3971730913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 msgr2=0x55badcfd9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3971730913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfd9ed0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb620009430 tx=0x7fb620031b00 comp rx=0 tx=0).stop 2024-09-19T06:50:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 -- 172.21.15.12:0/3971730913 shutdown_connections 2024-09-19T06:50:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3971730913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfe4cb0 0x55badcfe70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3971730913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfda410 0x55badcfe4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3971730913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfd9ed0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 -- 172.21.15.12:0/3971730913 >> 172.21.15.12:0/3971730913 conn(0x55badcfd6060 msgr2=0x55badcfd6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 -- 172.21.15.12:0/3971730913 shutdown_connections 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 -- 172.21.15.12:0/3971730913 wait complete. 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 -- start start 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 Processor -- start 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfe1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfda410 0x55badcfe20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfe4cb0 0x55badcfe2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55badcfe7880 con 0x55badcfd9af0 2024-09-19T06:50:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55badcec7290 con 0x55badcfe4cb0 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.181+0000 7fb6331f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55badcfe7a00 con 0x55badcfda410 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb6331f5740 10 client.0 _ll_register_callbacks cb 0x55badcef8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62e1f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfe1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62e1f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfe1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43008/0 (socket says 172.21.15.12:43008) 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62e1f6640 1 -- 172.21.15.12:0/1428551014 learned_addr learned my addr 172.21.15.12:0/1428551014 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62e9f7640 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfe4cb0 0x55badcfe2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfda410 0x55badcfe20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62e1f6640 1 -- 172.21.15.12:0/1428551014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfda410 msgr2=0x55badcfe20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfda410 0x55badcfe20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62e1f6640 1 -- 172.21.15.12:0/1428551014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfe4cb0 msgr2=0x55badcfe2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfe4cb0 0x55badcfe2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62e1f6640 1 -- 172.21.15.12:0/1428551014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55badcc51210 con 0x55badcfd9af0 2024-09-19T06:50:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfe1b90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb62400ba20 tx=0x7fb62400bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8395ca71b01076e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb611ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb611ffb640 1 -- 172.21.15.12:0/1428551014 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624003e80 con 0x55badcfd9af0 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb611ffb640 1 -- 172.21.15.12:0/1428551014 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fb624011440 con 0x55badcfd9af0 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb6331f5740 1 -- 172.21.15.12:0/1428551014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb620036070 con 0x55badcfd9af0 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb611ffb640 1 -- 172.21.15.12:0/1428551014 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb624011640 con 0x55badcfd9af0 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb6331f5740 10 client.18354 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.182+0000 7fb6331f5740 1 -- 172.21.15.12:0/1428551014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55badcd1d620 con 0x55badcfd9af0 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.183+0000 7fb611ffb640 1 -- 172.21.15.12:0/1428551014 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb620036070 con 0x55badcfd9af0 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.183+0000 7fb611ffb640 1 -- 172.21.15.12:0/1428551014 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fb624022aa0 con 0x55badcfd9af0 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.183+0000 7fb6331f5740 10 client.18354 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.183+0000 7fb6331f5740 10 client.18354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.183+0000 7fb6331f5740 20 client.18354 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.183+0000 7fb6331f5740 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55badcff4ca0 0x55badcff70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.183+0000 7fb6331f5740 4 client.18354 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.183+0000 7fb6331f5740 1 -- 172.21.15.12:0/1428551014 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55badcf4ba20 con 0x55badcff4ca0 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.183+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55badcff4ca0 0x55badcff70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55badcff4ca0 0x55badcff70d0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb49d4d76b45a0b0 server_cookie=2ac880e977ed6f2e in_seq=0 out_seq=0 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb611ffb640 10 client.18354 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb611ffb640 1 -- 172.21.15.12:0/1428551014 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55badcf4ba20 con 0x55badcff4ca0 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb611ffb640 10 client.18354 handle_command_reply: tid=0 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb6331f5740 1 client.18354 shutdown 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb6331f5740 1 -- 172.21.15.12:0/1428551014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 msgr2=0x55badcfe1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb6331f5740 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfe1b90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb62400ba20 tx=0x7fb62400bee0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb6331f5740 1 -- 172.21.15.12:0/1428551014 shutdown_connections 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb6331f5740 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55badcff4ca0 0x55badcff70d0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb6331f5740 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfe4cb0 0x55badcfe2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb6331f5740 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfda410 0x55badcfe20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb611ffb640 0 client.18354 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb6331f5740 1 --2- 172.21.15.12:0/1428551014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfe1b90 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.184+0000 7fb6331f5740 1 -- 172.21.15.12:0/1428551014 >> 172.21.15.12:0/1428551014 conn(0x55badcfd6060 msgr2=0x55badcfd51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.185+0000 7fb6331f5740 1 -- 172.21.15.12:0/1428551014 shutdown_connections 2024-09-19T06:50:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.185+0000 7fb6331f5740 1 -- 172.21.15.12:0/1428551014 wait complete. 2024-09-19T06:50:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.185+0000 7fb6331f5740 20 client.18354 trim_cache size 0 max 16384 2024-09-19T06:50:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.199+0000 7fb6331f5740 1 Processor -- start 2024-09-19T06:50:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.199+0000 7fb6331f5740 1 -- start start 2024-09-19T06:50:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.199+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfdc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.199+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfda410 0x55badcfe2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.199+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 0x55badcffca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.199+0000 7fb6331f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281adac0 con 0x55badcfd9af0 2024-09-19T06:50:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.199+0000 7fb6331f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281af600 con 0x55badcfda410 2024-09-19T06:50:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.199+0000 7fb6331f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281ae190 con 0x55badcfe4cb0 2024-09-19T06:50:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e1f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfdc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e1f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfdc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43012/0 (socket says 172.21.15.12:43012) 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e1f6640 1 -- 172.21.15.12:0/3638483225 learned_addr learned my addr 172.21.15.12:0/3638483225 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e9f7640 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 0x55badcffca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfda410 0x55badcfe2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e1f6640 1 -- 172.21.15.12:0/3638483225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 msgr2=0x55badcffca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 0x55badcffca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e1f6640 1 -- 172.21.15.12:0/3638483225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfda410 msgr2=0x55badcfe2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfda410 0x55badcfe2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e1f6640 1 -- 172.21.15.12:0/3638483225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55badcfd7110 con 0x55badcfd9af0 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e9f7640 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 0x55badcffca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfda410 0x55badcfe2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfdc560 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb624003b60 tx=0x7fb6240115d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e126d6cff53bf30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb613fff640 1 -- 172.21.15.12:0/3638483225 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6240043a0 con 0x55badcfd9af0 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb613fff640 1 -- 172.21.15.12:0/3638483225 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb624003e80 con 0x55badcfd9af0 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.200+0000 7fb613fff640 1 -- 172.21.15.12:0/3638483225 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624011b80 con 0x55badcfd9af0 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 -- 172.21.15.12:0/3638483225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 msgr2=0x55badcfdc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfdc560 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb624003b60 tx=0x7fb6240115d0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 -- 172.21.15.12:0/3638483225 shutdown_connections 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 0x55badcffca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfda410 0x55badcfe2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3638483225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfd9af0 0x55badcfdc560 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 -- 172.21.15.12:0/3638483225 >> 172.21.15.12:0/3638483225 conn(0x55badcfd6060 msgr2=0x55badcfe3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 -- 172.21.15.12:0/3638483225 shutdown_connections 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 -- 172.21.15.12:0/3638483225 wait complete. 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 -- start start 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.201+0000 7fb6331f5740 1 Processor -- start 2024-09-19T06:50:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfd9af0 0x55badcfed430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfda410 0x55badcfe8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb6331f5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 0x55badcfe8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb6331f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281aef30 con 0x55badcfda410 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb6331f5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281ae860 con 0x55badcfd9af0 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb6331f5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb6281abac0 con 0x55badcfe4cb0 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb6331f5740 10 client.0 _ll_register_callbacks cb 0x7fb624004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62d9f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfda410 0x55badcfe8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62d9f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfda410 0x55badcfe8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43014/0 (socket says 172.21.15.12:43014) 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62d9f5640 1 -- 172.21.15.12:0/3018245316 learned_addr learned my addr 172.21.15.12:0/3018245316 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfd9af0 0x55badcfed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62e9f7640 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 0x55badcfe8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62d9f5640 1 -- 172.21.15.12:0/3018245316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 msgr2=0x55badcfe8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 0x55badcfe8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62d9f5640 1 -- 172.21.15.12:0/3018245316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfd9af0 msgr2=0x55badcfed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfd9af0 0x55badcfed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62d9f5640 1 -- 172.21.15.12:0/3018245316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55badcfd12d0 con 0x55badcfda410 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb62d9f5640 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfda410 0x55badcfe8750 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb61c09bb20 tx=0x7fb61c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91261a2c746ab6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb611ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb611ffb640 1 -- 172.21.15.12:0/3018245316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c020040 con 0x55badcfda410 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb611ffb640 1 -- 172.21.15.12:0/3018245316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fb61c098200 con 0x55badcfda410 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.202+0000 7fb6331f5740 1 -- 172.21.15.12:0/3018245316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb624003e80 con 0x55badcfda410 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb611ffb640 1 -- 172.21.15.12:0/3018245316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb61c0cd1d0 con 0x55badcfda410 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb6331f5740 10 client.18360 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb6331f5740 1 -- 172.21.15.12:0/3018245316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55badcff3840 con 0x55badcfda410 2024-09-19T06:50:38.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb611ffb640 1 -- 172.21.15.12:0/3018245316 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb624003e80 con 0x55badcfda410 2024-09-19T06:50:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb611ffb640 1 -- 172.21.15.12:0/3018245316 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fb61c0b4ce0 con 0x55badcfda410 2024-09-19T06:50:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb6331f5740 10 client.18360 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb6331f5740 10 client.18360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb6331f5740 20 client.18360 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55badd05fdb0 0x55badd0621d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb6331f5740 4 client.18360 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:50:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb6331f5740 1 -- 172.21.15.12:0/3018245316 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55badcf45d70 con 0x55badd05fdb0 2024-09-19T06:50:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.203+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55badd05fdb0 0x55badd0621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.204+0000 7fb611ffb640 10 client.18360 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.204+0000 7fb62e1f6640 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55badd05fdb0 0x55badd0621d0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5483aef5d0d6577 server_cookie=b28819df40979d6d in_seq=0 out_seq=0 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb611ffb640 1 -- 172.21.15.12:0/3018245316 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55badcf45d70 con 0x55badd05fdb0 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb611ffb640 10 client.18360 handle_command_reply: tid=0 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 client.18360 shutdown 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 -- 172.21.15.12:0/3018245316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfda410 msgr2=0x55badcfe8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfda410 0x55badcfe8750 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb61c09bb20 tx=0x7fb61c01e000 comp rx=0 tx=0).stop 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 -- 172.21.15.12:0/3018245316 shutdown_connections 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55badd05fdb0 0x55badd0621d0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55badcfe4cb0 0x55badcfe8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb611ffb640 0 client.18360 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55badcfda410 0x55badcfe8750 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 --2- 172.21.15.12:0/3018245316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55badcfd9af0 0x55badcfed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 -- 172.21.15.12:0/3018245316 >> 172.21.15.12:0/3018245316 conn(0x55badcfd6060 msgr2=0x55badcfe33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 -- 172.21.15.12:0/3018245316 shutdown_connections 2024-09-19T06:50:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 1 -- 172.21.15.12:0/3018245316 wait complete. 2024-09-19T06:50:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.215+0000 7fb6331f5740 20 client.18360 trim_cache size 0 max 16384 2024-09-19T06:50:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:50:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:50:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:50:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:50:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 -- 172.21.15.12:0/2447314489 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb6140a34e0 msgr2=0x7fb6140a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb6140a34e0 0x7fb6140a59a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb620009a60 tx=0x7fb62004c000 comp rx=0 tx=0).stop 2024-09-19T06:50:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 -- 172.21.15.12:0/2447314489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb628102480 msgr2=0x7fb628198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb628102480 0x7fb628198860 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00d950 tx=0x7fb61c00de10 comp rx=0 tx=0).stop 2024-09-19T06:50:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 -- 172.21.15.12:0/2447314489 shutdown_connections 2024-09-19T06:50:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb6140a34e0 0x7fb6140a59a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb628107b80 0x7fb62819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb628102480 0x7fb628198860 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 --2- 172.21.15.12:0/2447314489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb628101ae0 0x7fb628198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 -- 172.21.15.12:0/2447314489 >> 172.21.15.12:0/2447314489 conn(0x7fb6280fd7e0 msgr2=0x7fb6280fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 -- 172.21.15.12:0/2447314489 shutdown_connections 2024-09-19T06:50:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:38.216+0000 7fb63045a640 1 -- 172.21.15.12:0/2447314489 wait complete. 2024-09-19T06:50:38.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:37 smithi016 ceph-mon[34911]: pgmap v325: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1.1 MiB/s wr, 135 op/s 2024-09-19T06:50:38.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:37 smithi173 ceph-mon[35349]: pgmap v325: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1.1 MiB/s wr, 135 op/s 2024-09-19T06:50:38.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:37 smithi012 ceph-mon[30937]: pgmap v325: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1.1 MiB/s wr, 135 op/s 2024-09-19T06:50:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:39 smithi016 ceph-mon[34911]: pgmap v326: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 1.1 MiB/s wr, 131 op/s 2024-09-19T06:50:40.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:39 smithi173 ceph-mon[35349]: pgmap v326: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 1.1 MiB/s wr, 131 op/s 2024-09-19T06:50:40.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:39 smithi012 ceph-mon[30937]: pgmap v326: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 1.1 MiB/s wr, 131 op/s 2024-09-19T06:50:40.811 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 595.0 s, 318.4 tps, lat 40.282 ms stddev 45.697 2024-09-19T06:50:42.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:41 smithi016 ceph-mon[34911]: pgmap v327: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-09-19T06:50:42.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:41 smithi173 ceph-mon[35349]: pgmap v327: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-09-19T06:50:42.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:41 smithi012 ceph-mon[30937]: pgmap v327: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-09-19T06:50:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:43 smithi016 ceph-mon[34911]: pgmap v328: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-09-19T06:50:44.382 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:43 smithi012 ceph-mon[30937]: pgmap v328: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-09-19T06:50:44.382 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:43 smithi173 ceph-mon[35349]: pgmap v328: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 2.1 MiB/s wr, 240 op/s 2024-09-19T06:50:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 600.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:50:46.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:45 smithi016 ceph-mon[34911]: pgmap v329: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.1 MiB/s wr, 241 op/s 2024-09-19T06:50:46.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:45 smithi173 ceph-mon[35349]: pgmap v329: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.1 MiB/s wr, 241 op/s 2024-09-19T06:50:46.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:45 smithi012 ceph-mon[30937]: pgmap v329: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.1 MiB/s wr, 241 op/s 2024-09-19T06:50:47.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:50:47.553 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.040+0000 7fecf741b640 1 -- 172.21.15.12:0/701836156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf00745a0 msgr2=0x7fecf0074980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.040+0000 7fecf741b640 1 --2- 172.21.15.12:0/701836156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf00745a0 0x7fecf0074980 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fecec009900 tx=0x7fecec02a410 comp rx=0 tx=0).stop 2024-09-19T06:50:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.041+0000 7fecf741b640 1 -- 172.21.15.12:0/701836156 shutdown_connections 2024-09-19T06:50:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.041+0000 7fecf741b640 1 --2- 172.21.15.12:0/701836156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf010e470 0x7fecf01108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.041+0000 7fecf741b640 1 --2- 172.21.15.12:0/701836156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf0074f50 0x7fecf010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.041+0000 7fecf741b640 1 --2- 172.21.15.12:0/701836156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf00745a0 0x7fecf0074980 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.041+0000 7fecf741b640 1 -- 172.21.15.12:0/701836156 >> 172.21.15.12:0/701836156 conn(0x7fecf00fd8d0 msgr2=0x7fecf00ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.041+0000 7fecf741b640 1 -- 172.21.15.12:0/701836156 shutdown_connections 2024-09-19T06:50:48.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.041+0000 7fecf741b640 1 -- 172.21.15.12:0/701836156 wait complete. 2024-09-19T06:50:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.041+0000 7fecf741b640 1 Processor -- start 2024-09-19T06:50:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.041+0000 7fecf741b640 1 -- start start 2024-09-19T06:50:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.041+0000 7fecf741b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf00745a0 0x7fecf01a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf741b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf0074f50 0x7fecf01a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf741b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf010e470 0x7fecf019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf741b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fecf01142c0 con 0x7fecf00745a0 2024-09-19T06:50:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf741b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0114140 con 0x7fecf0074f50 2024-09-19T06:50:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf741b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0114440 con 0x7fecf010e470 2024-09-19T06:50:48.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf51b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf00745a0 0x7fecf01a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf51b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf00745a0 0x7fecf01a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38518/0 (socket says 172.21.15.12:38518) 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf51b7640 1 -- 172.21.15.12:0/2060799225 learned_addr learned my addr 172.21.15.12:0/2060799225 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf49b6640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf0074f50 0x7fecf01a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf59b8640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf010e470 0x7fecf019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf51b7640 1 -- 172.21.15.12:0/2060799225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf010e470 msgr2=0x7fecf019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf51b7640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf010e470 0x7fecf019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf51b7640 1 -- 172.21.15.12:0/2060799225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf0074f50 msgr2=0x7fecf01a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf51b7640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf0074f50 0x7fecf01a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf51b7640 1 -- 172.21.15.12:0/2060799225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf019acc0 con 0x7fecf00745a0 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf51b7640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf00745a0 0x7fecf01a03d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fecec005ab0 tx=0x7fecec004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fece67fc640 1 -- 172.21.15.12:0/2060799225 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec03f030 con 0x7fecf00745a0 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf741b640 1 -- 172.21.15.12:0/2060799225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf019af50 con 0x7fecf00745a0 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fece67fc640 1 -- 172.21.15.12:0/2060799225 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecec003ce0 con 0x7fecf00745a0 2024-09-19T06:50:48.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fece67fc640 1 -- 172.21.15.12:0/2060799225 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec035070 con 0x7fecf00745a0 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.042+0000 7fecf741b640 1 -- 172.21.15.12:0/2060799225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf01a72a0 con 0x7fecf00745a0 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.045+0000 7fece67fc640 1 -- 172.21.15.12:0/2060799225 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fecec042030 con 0x7fecf00745a0 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.045+0000 7fecf97f4740 1 Processor -- start 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.045+0000 7fecf97f4740 1 -- start start 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.045+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 0x5615ec0eb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.045+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.045+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec0f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.045+0000 7fecf97f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5615ec0512e0 con 0x5615ec0ebdc0 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.045+0000 7fecf97f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5615ebff8ce0 con 0x5615ec0eb4a0 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.045+0000 7fecf97f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5615ec04d2a0 con 0x5615ec0f6680 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf51b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf51b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38526/0 (socket says 172.21.15.12:38526) 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf51b7640 1 -- 172.21.15.12:0/3738179948 learned_addr learned my addr 172.21.15.12:0/3738179948 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fece67fc640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecdc0a33b0 0x7fecdc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf59b8640 1 --2- 172.21.15.12:0/3738179948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 0x5615ec0eb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf49b6640 1 --2- 172.21.15.12:0/3738179948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec0f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf59b8640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecdc0a33b0 0x7fecdc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fece67fc640 1 -- 172.21.15.12:0/2060799225 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fecec0f06e0 con 0x7fecf00745a0 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf51b7640 1 -- 172.21.15.12:0/3738179948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 msgr2=0x5615ec0f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf51b7640 1 --2- 172.21.15.12:0/3738179948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec0f8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf51b7640 1 -- 172.21.15.12:0/3738179948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 msgr2=0x5615ec0eb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf51b7640 1 --2- 172.21.15.12:0/3738179948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 0x5615ec0eb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf51b7640 1 -- 172.21.15.12:0/3738179948 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615ebfdd440 con 0x5615ec0ebdc0 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf59b8640 1 --2- 172.21.15.12:0/3738179948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 0x5615ec0eb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:48.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf51b7640 1 --2- 172.21.15.12:0/3738179948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f6140 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fecec0bc620 tx=0x7fecec009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0deb77d1849ca57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecf59b8640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecdc0a33b0 0x7fecdc0a5870 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fece80070b0 tx=0x7fece800c040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.046+0000 7fecdb7fe640 1 -- 172.21.15.12:0/3738179948 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec049070 con 0x5615ec0ebdc0 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecdb7fe640 1 -- 172.21.15.12:0/3738179948 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecec0bd020 con 0x5615ec0ebdc0 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecdb7fe640 1 -- 172.21.15.12:0/3738179948 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec0b8f90 con 0x5615ec0ebdc0 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecf97f4740 1 -- 172.21.15.12:0/3738179948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0ebdc0 msgr2=0x5615ec0f6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3738179948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f6140 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fecec0bc620 tx=0x7fecec009560 comp rx=0 tx=0).stop 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecf97f4740 1 -- 172.21.15.12:0/3738179948 shutdown_connections 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3738179948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec0f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3738179948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f6140 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3738179948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 0x5615ec0eb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecf97f4740 1 -- 172.21.15.12:0/3738179948 >> 172.21.15.12:0/3738179948 conn(0x5615ec0e7a30 msgr2=0x5615ec0e7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecf97f4740 1 -- 172.21.15.12:0/3738179948 shutdown_connections 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.047+0000 7fecf97f4740 1 -- 172.21.15.12:0/3738179948 wait complete. 2024-09-19T06:50:48.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf97f4740 1 -- start start 2024-09-19T06:50:48.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf97f4740 1 Processor -- start 2024-09-19T06:50:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0f6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec0f3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf97f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5615ec0f9010 con 0x5615ec0eb4a0 2024-09-19T06:50:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf97f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5615ec00c050 con 0x5615ec0ebdc0 2024-09-19T06:50:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf97f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5615ec0f9190 con 0x5615ec0f6680 2024-09-19T06:50:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf97f4740 10 client.0 _ll_register_callbacks cb 0x5615ec04c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf51b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf51b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0f6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38532/0 (socket says 172.21.15.12:38532) 2024-09-19T06:50:48.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.048+0000 7fecf51b7640 1 -- 172.21.15.12:0/3981472975 learned_addr learned my addr 172.21.15.12:0/3981472975 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf59b8640 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec0f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf49b6640 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf51b7640 1 -- 172.21.15.12:0/3981472975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 msgr2=0x5615ec0f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf51b7640 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec0f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf51b7640 1 -- 172.21.15.12:0/3981472975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 msgr2=0x5615ec0f32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf51b7640 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf51b7640 1 -- 172.21.15.12:0/3981472975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615ebdc23c0 con 0x5615ec0eb4a0 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf49b6640 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf51b7640 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0f6030 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fecec0bc8b0 tx=0x7fecec0bc370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e111d3a72e8c97f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecd8ff9640 1 -- 172.21.15.12:0/3981472975 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec049070 con 0x5615ec0eb4a0 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecd8ff9640 1 -- 172.21.15.12:0/3981472975 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fecec0b8f90 con 0x5615ec0eb4a0 2024-09-19T06:50:48.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf97f4740 1 -- 172.21.15.12:0/3981472975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecec0bd020 con 0x5615ec0eb4a0 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecd8ff9640 1 -- 172.21.15.12:0/3981472975 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fecec0bc920 con 0x5615ec0eb4a0 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf97f4740 10 client.18372 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecf97f4740 1 -- 172.21.15.12:0/3981472975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5615ec0f9010 con 0x5615ec0eb4a0 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.049+0000 7fecd8ff9640 1 -- 172.21.15.12:0/3981472975 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecec0bd020 con 0x5615ec0eb4a0 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.050+0000 7fecd8ff9640 1 -- 172.21.15.12:0/3981472975 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fecec0bcb80 con 0x5615ec0eb4a0 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.050+0000 7fecf97f4740 10 client.18372 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.050+0000 7fecf97f4740 10 client.18372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.050+0000 7fecf97f4740 20 client.18372 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.050+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615ec105b50 0x5615ec107fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.050+0000 7fecf97f4740 4 client.18372 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.050+0000 7fecf97f4740 1 -- 172.21.15.12:0/3981472975 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615ec05e850 con 0x5615ec105b50 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.050+0000 7fecf49b6640 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615ec105b50 0x5615ec107fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.050+0000 7fecd8ff9640 10 client.18372 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.050+0000 7fecf49b6640 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615ec105b50 0x5615ec107fb0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28d95b8d08ae4af5 server_cookie=9f498ee8af66f949 in_seq=0 out_seq=0 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecd8ff9640 1 -- 172.21.15.12:0/3981472975 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615ec05e850 con 0x5615ec105b50 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecd8ff9640 10 client.18372 handle_command_reply: tid=0 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecf97f4740 1 client.18372 shutdown 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecf97f4740 1 -- 172.21.15.12:0/3981472975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 msgr2=0x5615ec0f6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0f6030 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fecec0bc8b0 tx=0x7fecec0bc370 comp rx=0 tx=0).stop 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecf97f4740 1 -- 172.21.15.12:0/3981472975 shutdown_connections 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615ec105b50 0x5615ec107fb0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec0f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 0x5615ec0f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3981472975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0f6030 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecd8ff9640 0 client.18372 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:48.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.051+0000 7fecf97f4740 1 -- 172.21.15.12:0/3981472975 >> 172.21.15.12:0/3981472975 conn(0x5615ec0e7a30 msgr2=0x5615ec0e6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.052+0000 7fecf97f4740 1 -- 172.21.15.12:0/3981472975 shutdown_connections 2024-09-19T06:50:48.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.052+0000 7fecf97f4740 1 -- 172.21.15.12:0/3981472975 wait complete. 2024-09-19T06:50:48.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.052+0000 7fecf97f4740 20 client.18372 trim_cache size 0 max 16384 2024-09-19T06:50:48.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf97f4740 1 Processor -- start 2024-09-19T06:50:48.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf97f4740 1 -- start start 2024-09-19T06:50:48.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0e6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 0x5615ec10d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec10ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf97f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fecf01afec0 con 0x5615ec0eb4a0 2024-09-19T06:50:48.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf97f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fecf01b1a00 con 0x5615ec0ebdc0 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf97f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fecf01b0590 con 0x5615ec0f6680 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf51b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf51b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0e6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38544/0 (socket says 172.21.15.12:38544) 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf51b7640 1 -- 172.21.15.12:0/3906007562 learned_addr learned my addr 172.21.15.12:0/3906007562 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf49b6640 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 0x5615ec10d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf59b8640 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec10ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf51b7640 1 -- 172.21.15.12:0/3906007562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 msgr2=0x5615ec10ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf51b7640 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec10ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf51b7640 1 -- 172.21.15.12:0/3906007562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 msgr2=0x5615ec10d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf51b7640 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 0x5615ec10d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf51b7640 1 -- 172.21.15.12:0/3906007562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615ec0e6a30 con 0x5615ec0eb4a0 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf59b8640 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec10ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:48.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.069+0000 7fecf49b6640 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 0x5615ec10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:48.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecf51b7640 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0e6350 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fecec0bc620 tx=0x7fecec009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fc741d086721e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecdaffd640 1 -- 172.21.15.12:0/3906007562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec049070 con 0x5615ec0eb4a0 2024-09-19T06:50:48.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecdaffd640 1 -- 172.21.15.12:0/3906007562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecec0d4020 con 0x5615ec0eb4a0 2024-09-19T06:50:48.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecdaffd640 1 -- 172.21.15.12:0/3906007562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec0bcb80 con 0x5615ec0eb4a0 2024-09-19T06:50:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecf97f4740 1 -- 172.21.15.12:0/3906007562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 msgr2=0x5615ec0e6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0e6350 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fecec0bc620 tx=0x7fecec009560 comp rx=0 tx=0).stop 2024-09-19T06:50:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecf97f4740 1 -- 172.21.15.12:0/3906007562 shutdown_connections 2024-09-19T06:50:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0f6680 0x5615ec10ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0ebdc0 0x5615ec10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecf97f4740 1 --2- 172.21.15.12:0/3906007562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0eb4a0 0x5615ec0e6350 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecf97f4740 1 -- 172.21.15.12:0/3906007562 >> 172.21.15.12:0/3906007562 conn(0x5615ec0e7a30 msgr2=0x5615ec0f22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.070+0000 7fecf97f4740 1 -- 172.21.15.12:0/3906007562 shutdown_connections 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf97f4740 1 -- 172.21.15.12:0/3906007562 wait complete. 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf97f4740 1 -- start start 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf97f4740 1 Processor -- start 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 0x5615ec0fc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0ebdc0 0x5615ec0fc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf97f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0f6680 0x5615ec0fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf97f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fecf01b1330 con 0x5615ec0f6680 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf97f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fecf01b0c60 con 0x5615ec0eb4a0 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf97f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fecf01adec0 con 0x5615ec0ebdc0 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf97f4740 10 client.0 _ll_register_callbacks cb 0x7fece00093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf59b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0f6680 0x5615ec0fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.071+0000 7fecf59b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0f6680 0x5615ec0fcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38556/0 (socket says 172.21.15.12:38556) 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf59b8640 1 -- 172.21.15.12:0/1837482338 learned_addr learned my addr 172.21.15.12:0/1837482338 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf49b6640 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0ebdc0 0x5615ec0fc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf51b7640 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 0x5615ec0fc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf59b8640 1 -- 172.21.15.12:0/1837482338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0ebdc0 msgr2=0x5615ec0fc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf59b8640 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0ebdc0 0x5615ec0fc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf59b8640 1 -- 172.21.15.12:0/1837482338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 msgr2=0x5615ec0fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf59b8640 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 0x5615ec0fc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf59b8640 1 -- 172.21.15.12:0/1837482338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615ec0f63a0 con 0x5615ec0f6680 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf51b7640 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 0x5615ec0fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf59b8640 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0f6680 0x5615ec0fcc00 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fece8017c50 tx=0x7fece80093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4c51046f856b97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecd8ff9640 1 -- 172.21.15.12:0/1837482338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8013040 con 0x5615ec0f6680 2024-09-19T06:50:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecd8ff9640 1 -- 172.21.15.12:0/1837482338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fece8016c90 con 0x5615ec0f6680 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf97f4740 1 -- 172.21.15.12:0/1837482338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecec0d4020 con 0x5615ec0f6680 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecd8ff9640 1 -- 172.21.15.12:0/1837482338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fece8032050 con 0x5615ec0f6680 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf97f4740 10 client.18378 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.072+0000 7fecf97f4740 1 -- 172.21.15.12:0/1837482338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5615ec170a20 con 0x5615ec0f6680 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecd8ff9640 1 -- 172.21.15.12:0/1837482338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecec0d4020 con 0x5615ec0f6680 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecd8ff9640 1 -- 172.21.15.12:0/1837482338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fece802d3b0 con 0x5615ec0f6680 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecf97f4740 10 client.18378 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecf97f4740 10 client.18378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecf97f4740 20 client.18378 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecf97f4740 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615ec1711f0 0x5615ec173610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecf97f4740 4 client.18378 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecf97f4740 1 -- 172.21.15.12:0/1837482338 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5615ec058d60 con 0x5615ec1711f0 2024-09-19T06:50:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecf51b7640 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615ec1711f0 0x5615ec173610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecd8ff9640 10 client.18378 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.073+0000 7fecf51b7640 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615ec1711f0 0x5615ec173610 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f4b7030e6384563 server_cookie=3aa7160b74950149 in_seq=0 out_seq=0 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecd8ff9640 1 -- 172.21.15.12:0/1837482338 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5615ec058d60 con 0x5615ec1711f0 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecd8ff9640 10 client.18378 handle_command_reply: tid=0 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 client.18378 shutdown 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 -- 172.21.15.12:0/1837482338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0f6680 msgr2=0x5615ec0fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0f6680 0x5615ec0fcc00 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fece8017c50 tx=0x7fece80093d0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 -- 172.21.15.12:0/1837482338 shutdown_connections 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5615ec1711f0 0x5615ec173610 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5615ec0f6680 0x5615ec0fcc00 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615ec0ebdc0 0x5615ec0fc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecd8ff9640 0 client.18378 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 --2- 172.21.15.12:0/1837482338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615ec0eb4a0 0x5615ec0fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 -- 172.21.15.12:0/1837482338 >> 172.21.15.12:0/1837482338 conn(0x5615ec0e7a30 msgr2=0x5615ec0f4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 -- 172.21.15.12:0/1837482338 shutdown_connections 2024-09-19T06:50:48.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 1 -- 172.21.15.12:0/1837482338 wait complete. 2024-09-19T06:50:48.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.074+0000 7fecf97f4740 20 client.18378 trim_cache size 0 max 16384 2024-09-19T06:50:48.082 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:50:48.082 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:50:48.082 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:50:48.082 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:50:48.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 -- 172.21.15.12:0/2060799225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecdc0a33b0 msgr2=0x7fecdc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecdc0a33b0 0x7fecdc0a5870 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fece80070b0 tx=0x7fece800c040 comp rx=0 tx=0).stop 2024-09-19T06:50:48.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 -- 172.21.15.12:0/2060799225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf00745a0 msgr2=0x7fecf01a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:48.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf00745a0 0x7fecf01a03d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fecec005ab0 tx=0x7fecec004360 comp rx=0 tx=0).stop 2024-09-19T06:50:48.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 -- 172.21.15.12:0/2060799225 shutdown_connections 2024-09-19T06:50:48.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fecdc0a33b0 0x7fecdc0a5870 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecf010e470 0x7fecf019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fecf0074f50 0x7fecf01a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 --2- 172.21.15.12:0/2060799225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecf00745a0 0x7fecf01a03d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:48.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 -- 172.21.15.12:0/2060799225 >> 172.21.15.12:0/2060799225 conn(0x7fecf00fd8d0 msgr2=0x7fecf00fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:48.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 -- 172.21.15.12:0/2060799225 shutdown_connections 2024-09-19T06:50:48.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:48.075+0000 7fecf741b640 1 -- 172.21.15.12:0/2060799225 wait complete. 2024-09-19T06:50:48.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:47 smithi016 ceph-mon[34911]: pgmap v330: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 2.0 MiB/s wr, 227 op/s 2024-09-19T06:50:48.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:47 smithi173 ceph-mon[35349]: pgmap v330: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 2.0 MiB/s wr, 227 op/s 2024-09-19T06:50:48.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:47 smithi012 ceph-mon[30937]: pgmap v330: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 2.0 MiB/s wr, 227 op/s 2024-09-19T06:50:48.901 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:50:48.902 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:50:49.161 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.610+0000 7f6a7595f640 1 -- 172.21.15.12:0/368832433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a70101de0 msgr2=0x7f6a701021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.610+0000 7f6a7595f640 1 --2- 172.21.15.12:0/368832433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a70101de0 0x7f6a701021c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009900 tx=0x7f6a6002a410 comp rx=0 tx=0).stop 2024-09-19T06:50:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.610+0000 7f6a7595f640 1 -- 172.21.15.12:0/368832433 shutdown_connections 2024-09-19T06:50:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.610+0000 7f6a7595f640 1 --2- 172.21.15.12:0/368832433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a70106f10 0x7f6a7010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:49.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.610+0000 7f6a7595f640 1 --2- 172.21.15.12:0/368832433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a70102790 0x7f6a701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:49.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.610+0000 7f6a7595f640 1 --2- 172.21.15.12:0/368832433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a70101de0 0x7f6a701021c0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:49.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.610+0000 7f6a7595f640 1 -- 172.21.15.12:0/368832433 >> 172.21.15.12:0/368832433 conn(0x7f6a700fd8c0 msgr2=0x7f6a700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:49.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.610+0000 7f6a7595f640 1 -- 172.21.15.12:0/368832433 shutdown_connections 2024-09-19T06:50:49.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.610+0000 7f6a7595f640 1 -- 172.21.15.12:0/368832433 wait complete. 2024-09-19T06:50:49.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a7595f640 1 Processor -- start 2024-09-19T06:50:49.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a7595f640 1 -- start start 2024-09-19T06:50:49.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a7595f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a70101de0 0x7f6a700744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:49.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a7595f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a70102790 0x7f6a70074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:49.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a7595f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a70106f10 0x7f6a70074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a7595f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a70111f90 con 0x7f6a70106f10 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a7595f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6a70111e10 con 0x7f6a70101de0 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a7595f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6a70112110 con 0x7f6a70102790 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a6f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a70106f10 0x7f6a70074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a6f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a70106f10 0x7f6a70074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38574/0 (socket says 172.21.15.12:38574) 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.611+0000 7f6a6f7fe640 1 -- 172.21.15.12:0/1012420243 learned_addr learned my addr 172.21.15.12:0/1012420243 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a6effd640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a70101de0 0x7f6a700744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a6e7fc640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a70102790 0x7f6a70074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a6f7fe640 1 -- 172.21.15.12:0/1012420243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a70102790 msgr2=0x7f6a70074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a6f7fe640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a70102790 0x7f6a70074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:49.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a6f7fe640 1 -- 172.21.15.12:0/1012420243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a70101de0 msgr2=0x7f6a700744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a6f7fe640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a70101de0 0x7f6a700744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a6f7fe640 1 -- 172.21.15.12:0/1012420243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a701a6950 con 0x7f6a70106f10 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a6effd640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a70101de0 0x7f6a700744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a6f7fe640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a70106f10 0x7f6a70074f70 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800b970 tx=0x7f6a6800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a7495d640 1 -- 172.21.15.12:0/1012420243 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68019070 con 0x7f6a70106f10 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a7595f640 1 -- 172.21.15.12:0/1012420243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a701a6c40 con 0x7f6a70106f10 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a7495d640 1 -- 172.21.15.12:0/1012420243 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a6800cb40 con 0x7f6a70106f10 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a7495d640 1 -- 172.21.15.12:0/1012420243 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68007650 con 0x7f6a70106f10 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.612+0000 7f6a7595f640 1 -- 172.21.15.12:0/1012420243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a701a7130 con 0x7f6a70106f10 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.613+0000 7f6a7595f640 1 -- 172.21.15.12:0/1012420243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a701021c0 con 0x7f6a70106f10 2024-09-19T06:50:49.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.614+0000 7f6a7495d640 1 -- 172.21.15.12:0/1012420243 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6a6801c070 con 0x7f6a70106f10 2024-09-19T06:50:49.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.615+0000 7f6a7495d640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a580a33b0 0x7f6a580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:49.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.615+0000 7f6a7495d640 1 -- 172.21.15.12:0/1012420243 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f6a680cf340 con 0x7f6a70106f10 2024-09-19T06:50:49.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.615+0000 7f6a6effd640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a580a33b0 0x7f6a580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:49.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.616+0000 7f6a6effd640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a580a33b0 0x7f6a580a5870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000c00 tx=0x7f6a60032d50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:49.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.619+0000 7f6a7495d640 1 -- 172.21.15.12:0/1012420243 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a6809bd90 con 0x7f6a70106f10 2024-09-19T06:50:49.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.831+0000 7f6a7595f640 1 -- 172.21.15.12:0/1012420243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a7002d7c0 con 0x7f6a70106f10 2024-09-19T06:50:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.831+0000 7f6a7495d640 1 -- 172.21.15.12:0/1012420243 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11971 (secure 0 0 0) 0x7f6a6809b690 con 0x7f6a70106f10 2024-09-19T06:50:49.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:50:49.833 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"btime":"2024-09-19T06:48:35:302779+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:48:34.412947+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:50:49.833 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 44 2024-09-19T06:50:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.833+0000 7f6a7595f640 1 -- 172.21.15.12:0/1012420243 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a580a33b0 msgr2=0x7f6a580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.833+0000 7f6a7595f640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a580a33b0 0x7f6a580a5870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000c00 tx=0x7f6a60032d50 comp rx=0 tx=0).stop 2024-09-19T06:50:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.833+0000 7f6a7595f640 1 -- 172.21.15.12:0/1012420243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a70106f10 msgr2=0x7f6a70074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.833+0000 7f6a7595f640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a70106f10 0x7f6a70074f70 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800b970 tx=0x7f6a6800be30 comp rx=0 tx=0).stop 2024-09-19T06:50:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.833+0000 7f6a7595f640 1 -- 172.21.15.12:0/1012420243 shutdown_connections 2024-09-19T06:50:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.833+0000 7f6a7595f640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a70106f10 0x7f6a70074f70 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.833+0000 7f6a7595f640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a580a33b0 0x7f6a580a5870 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.833+0000 7f6a7595f640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a70102790 0x7f6a70074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.833+0000 7f6a7595f640 1 --2- 172.21.15.12:0/1012420243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a70101de0 0x7f6a700744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:49.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.833+0000 7f6a7595f640 1 -- 172.21.15.12:0/1012420243 >> 172.21.15.12:0/1012420243 conn(0x7f6a700fd8c0 msgr2=0x7f6a700fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.834+0000 7f6a7595f640 1 -- 172.21.15.12:0/1012420243 shutdown_connections 2024-09-19T06:50:49.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:49.834+0000 7f6a7595f640 1 -- 172.21.15.12:0/1012420243 wait complete. 2024-09-19T06:50:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:49 smithi012 ceph-mon[30937]: pgmap v331: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.1 MiB/s wr, 122 op/s 2024-09-19T06:50:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:49 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1012420243' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:50.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:49 smithi016 ceph-mon[34911]: pgmap v331: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.1 MiB/s wr, 122 op/s 2024-09-19T06:50:50.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:49 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1012420243' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:50.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:49 smithi173 ceph-mon[35349]: pgmap v331: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.1 MiB/s wr, 122 op/s 2024-09-19T06:50:50.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:49 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1012420243' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:50:50.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:50:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:50:50.829 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 -- 172.21.15.12:0/1841891868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf041069c0 msgr2=0x7fbf04106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 --2- 172.21.15.12:0/1841891868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf041069c0 0x7fbf04106da0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009930 tx=0x7fbef402a420 comp rx=0 tx=0).stop 2024-09-19T06:50:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 -- 172.21.15.12:0/1841891868 shutdown_connections 2024-09-19T06:50:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 --2- 172.21.15.12:0/1841891868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf04101350 0x7fbf0410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 --2- 172.21.15.12:0/1841891868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf041009b0 0x7fbf04100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 --2- 172.21.15.12:0/1841891868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf041069c0 0x7fbf04106da0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 -- 172.21.15.12:0/1841891868 >> 172.21.15.12:0/1841891868 conn(0x7fbf04077990 msgr2=0x7fbf040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 -- 172.21.15.12:0/1841891868 shutdown_connections 2024-09-19T06:50:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 -- 172.21.15.12:0/1841891868 wait complete. 2024-09-19T06:50:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 Processor -- start 2024-09-19T06:50:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.310+0000 7fbf0a265640 1 -- start start 2024-09-19T06:50:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf0a265640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf041009b0 0x7fbf040fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf0a265640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf04101350 0x7fbf040fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf0a265640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf041069c0 0x7fbf040fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf0a265640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbf04110dc0 con 0x7fbf04101350 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf0a265640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbf04110c40 con 0x7fbf041069c0 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf0a265640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbf04110f40 con 0x7fbf041009b0 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf04101350 0x7fbf040fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf04101350 0x7fbf040fd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45186/0 (socket says 172.21.15.12:45186) 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf037fe640 1 -- 172.21.15.12:0/1133867381 learned_addr learned my addr 172.21.15.12:0/1133867381 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf08802640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf041069c0 0x7fbf040fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf03fff640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf041009b0 0x7fbf040fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf037fe640 1 -- 172.21.15.12:0/1133867381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf041009b0 msgr2=0x7fbf040fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf037fe640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf041009b0 0x7fbf040fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf037fe640 1 -- 172.21.15.12:0/1133867381 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf041069c0 msgr2=0x7fbf040fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf037fe640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf041069c0 0x7fbf040fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf037fe640 1 -- 172.21.15.12:0/1133867381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf041a6800 con 0x7fbf04101350 2024-09-19T06:50:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.311+0000 7fbf03fff640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf041009b0 0x7fbf040fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.312+0000 7fbf037fe640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf04101350 0x7fbf040fd320 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbef800d950 tx=0x7fbef800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.312+0000 7fbf017fa640 1 -- 172.21.15.12:0/1133867381 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8017030 con 0x7fbf04101350 2024-09-19T06:50:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.312+0000 7fbf017fa640 1 -- 172.21.15.12:0/1133867381 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbef8004020 con 0x7fbf04101350 2024-09-19T06:50:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.312+0000 7fbf017fa640 1 -- 172.21.15.12:0/1133867381 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef80047a0 con 0x7fbf04101350 2024-09-19T06:50:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.312+0000 7fbf0a265640 1 -- 172.21.15.12:0/1133867381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf041a6af0 con 0x7fbf04101350 2024-09-19T06:50:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.312+0000 7fbf0a265640 1 -- 172.21.15.12:0/1133867381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf041a7090 con 0x7fbf04101350 2024-09-19T06:50:51.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.289+0000 7f0bae37a640 1 -- 172.21.15.12:0/4253078666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8106a70 msgr2=0x7f0ba8106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.289+0000 7f0bae37a640 1 --2- 172.21.15.12:0/4253078666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8106a70 0x7f0ba8106e50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009930 tx=0x7f0b9802a420 comp rx=0 tx=0).stop 2024-09-19T06:50:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.289+0000 7f0bae37a640 1 -- 172.21.15.12:0/4253078666 shutdown_connections 2024-09-19T06:50:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.289+0000 7f0bae37a640 1 --2- 172.21.15.12:0/4253078666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ba8101410 0x7f0ba810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.289+0000 7f0bae37a640 1 --2- 172.21.15.12:0/4253078666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba8100a70 0x7f0ba8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.289+0000 7f0bae37a640 1 --2- 172.21.15.12:0/4253078666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8106a70 0x7f0ba8106e50 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.289+0000 7f0bae37a640 1 -- 172.21.15.12:0/4253078666 >> 172.21.15.12:0/4253078666 conn(0x7f0ba80fc7d0 msgr2=0x7f0ba80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.289+0000 7f0bae37a640 1 -- 172.21.15.12:0/4253078666 shutdown_connections 2024-09-19T06:50:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.289+0000 7f0bae37a640 1 -- 172.21.15.12:0/4253078666 wait complete. 2024-09-19T06:50:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bae37a640 1 Processor -- start 2024-09-19T06:50:51.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bae37a640 1 -- start start 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bae37a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ba8100a70 0x7f0ba81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bae37a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba8101410 0x7f0ba8198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bae37a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8106a70 0x7f0ba819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bae37a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba8110ee0 con 0x7f0ba8106a70 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bae37a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba8110d60 con 0x7f0ba8100a70 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bae37a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba8111060 con 0x7f0ba8101410 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bac917640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8106a70 0x7f0ba819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bac917640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8106a70 0x7f0ba819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45146/0 (socket says 172.21.15.12:45146) 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0bac917640 1 -- 172.21.15.12:0/879764521 learned_addr learned my addr 172.21.15.12:0/879764521 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ba8100a70 0x7f0ba81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.290+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba8101410 0x7f0ba8198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0bac917640 1 -- 172.21.15.12:0/879764521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba8101410 msgr2=0x7f0ba8198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0bac917640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba8101410 0x7f0ba8198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0bac917640 1 -- 172.21.15.12:0/879764521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ba8100a70 msgr2=0x7f0ba81984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0bac917640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ba8100a70 0x7f0ba81984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0bac917640 1 -- 172.21.15.12:0/879764521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba819d470 con 0x7f0ba8106a70 2024-09-19T06:50:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba8101410 0x7f0ba8198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0bac917640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8106a70 0x7f0ba819cd90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000eaa0 tx=0x7f0ba000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0ba5ffb640 1 -- 172.21.15.12:0/879764521 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba000cdb0 con 0x7f0ba8106a70 2024-09-19T06:50:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0bae37a640 1 -- 172.21.15.12:0/879764521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba819d760 con 0x7f0ba8106a70 2024-09-19T06:50:51.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0ba5ffb640 1 -- 172.21.15.12:0/879764521 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ba0005020 con 0x7f0ba8106a70 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0ba5ffb640 1 -- 172.21.15.12:0/879764521 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00116b0 con 0x7f0ba8106a70 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.291+0000 7f0bae37a640 1 -- 172.21.15.12:0/879764521 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba81a5040 con 0x7f0ba8106a70 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.294+0000 7f0bb0753740 1 Processor -- start 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.294+0000 7f0ba5ffb640 1 -- 172.21.15.12:0/879764521 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0ba0005560 con 0x7f0ba8106a70 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.294+0000 7f0bb0753740 1 -- start start 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c452ab40 0x5573c4529090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4529a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c4534370 0x5573c4536760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0bb0753740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5573c448f2f0 con 0x5573c4534370 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0bb0753740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5573c4436cf0 con 0x5573c45295d0 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0bb0753740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5573c448b2b0 con 0x5573c452ab40 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0ba7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4529a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0ba7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4529a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50308/0 (socket says 172.21.15.12:50308) 2024-09-19T06:50:51.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0ba7fff640 1 -- 172.21.15.12:0/1642291552 learned_addr learned my addr 172.21.15.12:0/1642291552 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/1642291552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c4534370 0x5573c4536760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/1642291552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c452ab40 0x5573c4529090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0ba5ffb640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b940a33b0 0x7f0b940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0ba7fff640 1 -- 172.21.15.12:0/1642291552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c452ab40 msgr2=0x5573c4529090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/1642291552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c452ab40 0x5573c4529090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0ba7fff640 1 -- 172.21.15.12:0/1642291552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c4534370 msgr2=0x5573c4536760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/1642291552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c4534370 0x5573c4536760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.295+0000 7f0bac917640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b940a33b0 0x7f0b940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.296+0000 7f0ba7fff640 1 -- 172.21.15.12:0/1642291552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573c441b3a0 con 0x5573c45295d0 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.296+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/1642291552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c4534370 0x5573c4536760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.296+0000 7f0ba5ffb640 1 -- 172.21.15.12:0/879764521 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f0ba00d0040 con 0x7f0ba8106a70 2024-09-19T06:50:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.296+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/1642291552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4529a10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009930 tx=0x7f0b98004180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61bdf951f780728f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.296+0000 7f0bac917640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b940a33b0 0x7f0b940a5870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00986e0 tx=0x7f0ba00c7050 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.296+0000 7f0b9e7fc640 1 -- 172.21.15.12:0/1642291552 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98035040 con 0x5573c45295d0 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.296+0000 7f0b9e7fc640 1 -- 172.21.15.12:0/1642291552 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b98005520 con 0x5573c45295d0 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.296+0000 7f0b9e7fc640 1 -- 172.21.15.12:0/1642291552 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98003850 con 0x5573c45295d0 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.297+0000 7f0bb0753740 1 -- 172.21.15.12:0/1642291552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 msgr2=0x5573c4529a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.297+0000 7f0bb0753740 1 --2- 172.21.15.12:0/1642291552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4529a10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009930 tx=0x7f0b98004180 comp rx=0 tx=0).stop 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.297+0000 7f0bb0753740 1 -- 172.21.15.12:0/1642291552 shutdown_connections 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.297+0000 7f0bb0753740 1 --2- 172.21.15.12:0/1642291552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c4534370 0x5573c4536760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.297+0000 7f0bb0753740 1 --2- 172.21.15.12:0/1642291552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4529a10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.297+0000 7f0bb0753740 1 --2- 172.21.15.12:0/1642291552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c452ab40 0x5573c4529090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.297+0000 7f0bb0753740 1 -- 172.21.15.12:0/1642291552 >> 172.21.15.12:0/1642291552 conn(0x5573c44f2310 msgr2=0x5573c4525c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.297+0000 7f0bb0753740 1 -- 172.21.15.12:0/1642291552 shutdown_connections 2024-09-19T06:50:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.297+0000 7f0bb0753740 1 -- 172.21.15.12:0/1642291552 wait complete. 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.297+0000 7f0bb0753740 1 -- start start 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0bb0753740 1 Processor -- start 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 0x5573c4533d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4531030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 0x5573c4531640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0bb0753740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5573c4537010 con 0x5573c452ab40 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0bb0753740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5573c444a060 con 0x5573c4534370 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0bb0753740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5573c4537190 con 0x5573c45295d0 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0bb0753740 10 client.0 _ll_register_callbacks cb 0x5573c419d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0ba7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4531030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0ba7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4531030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45162/0 (socket says 172.21.15.12:45162) 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0ba7fff640 1 -- 172.21.15.12:0/414196541 learned_addr learned my addr 172.21.15.12:0/414196541 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:51.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 0x5573c4533d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 0x5573c4531640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0ba7fff640 1 -- 172.21.15.12:0/414196541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 msgr2=0x5573c4533d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 0x5573c4533d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0ba7fff640 1 -- 172.21.15.12:0/414196541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 msgr2=0x5573c4531640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 0x5573c4531640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0ba7fff640 1 -- 172.21.15.12:0/414196541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573c42003c0 con 0x5573c452ab40 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.298+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 0x5573c4531640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4531030 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0b9802aa10 tx=0x7f0b9802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01b1c1c673bc9a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0b877fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0b877fe640 1 -- 172.21.15.12:0/414196541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98053060 con 0x5573c452ab40 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0b877fe640 1 -- 172.21.15.12:0/414196541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f0b98004f40 con 0x5573c452ab40 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0bb0753740 1 -- 172.21.15.12:0/414196541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b98005520 con 0x5573c452ab40 2024-09-19T06:50:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0b877fe640 1 -- 172.21.15.12:0/414196541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0b9805a050 con 0x5573c452ab40 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0bb0753740 10 client.18396 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0bb0753740 1 -- 172.21.15.12:0/414196541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5573c4542ae0 con 0x5573c452ab40 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0b877fe640 1 -- 172.21.15.12:0/414196541 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b98005520 con 0x5573c452ab40 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0b877fe640 1 -- 172.21.15.12:0/414196541 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f0b98003bf0 con 0x5573c452ab40 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0bb0753740 10 client.18396 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0bb0753740 10 client.18396 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0bb0753740 20 client.18396 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0bb0753740 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5573c4543e30 0x5573c4546220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.299+0000 7f0bb0753740 4 client.18396 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.300+0000 7f0bb0753740 1 -- 172.21.15.12:0/414196541 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573c449c860 con 0x5573c4543e30 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.300+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5573c4543e30 0x5573c4546220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.300+0000 7f0b877fe640 10 client.18396 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:50:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.300+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5573c4543e30 0x5573c4546220 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a395e070fb2f68a7 server_cookie=9317803d0b6cab0e in_seq=0 out_seq=0 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0b877fe640 1 -- 172.21.15.12:0/414196541 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573c449c860 con 0x5573c4543e30 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0b877fe640 10 client.18396 handle_command_reply: tid=0 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 client.18396 shutdown 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 -- 172.21.15.12:0/414196541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 msgr2=0x5573c4531030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4531030 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0b9802aa10 tx=0x7f0b9802a420 comp rx=0 tx=0).stop 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 -- 172.21.15.12:0/414196541 shutdown_connections 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5573c4543e30 0x5573c4546220 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 0x5573c4531640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4531030 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 --2- 172.21.15.12:0/414196541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 0x5573c4533d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0b877fe640 0 client.18396 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 -- 172.21.15.12:0/414196541 >> 172.21.15.12:0/414196541 conn(0x5573c44f2310 msgr2=0x5573c452b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 -- 172.21.15.12:0/414196541 shutdown_connections 2024-09-19T06:50:51.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 1 -- 172.21.15.12:0/414196541 wait complete. 2024-09-19T06:50:51.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.301+0000 7f0bb0753740 20 client.18396 trim_cache size 0 max 16384 2024-09-19T06:50:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.314+0000 7fbf017fa640 1 -- 172.21.15.12:0/1133867381 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbef80041d0 con 0x7fbf04101350 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.315+0000 7fbf017fa640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbeec0a34e0 0x7fbeec0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.315+0000 7fbf03fff640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbeec0a34e0 0x7fbeec0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.315+0000 7fbf017fa640 1 -- 172.21.15.12:0/1133867381 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fbef80cf720 con 0x7fbf04101350 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.315+0000 7fbf0d003740 1 Processor -- start 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf0d003740 1 -- start start 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf03fff640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbeec0a34e0 0x7fbeec0a59a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbef4000c00 tx=0x7fbef4005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e37916bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e379176770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e3791790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf0d003740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e3790d02f0 con 0x55e37916baf0 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf0d003740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e379078270 con 0x55e37916c410 2024-09-19T06:50:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf0d003740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e3790cc2b0 con 0x55e379176cb0 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e37916bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e37916bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45188/0 (socket says 172.21.15.12:45188) 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf03fff640 1 -- 172.21.15.12:0/2915967541 learned_addr learned my addr 172.21.15.12:0/2915967541 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf03fff640 1 -- 172.21.15.12:0/2915967541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 msgr2=0x55e3791790a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf03fff640 1 --2- 172.21.15.12:0/2915967541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e3791790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf03fff640 1 -- 172.21.15.12:0/2915967541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 msgr2=0x55e379176770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf03fff640 1 --2- 172.21.15.12:0/2915967541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e379176770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf03fff640 1 -- 172.21.15.12:0/2915967541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e379077340 con 0x55e37916baf0 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.316+0000 7fbf03fff640 1 --2- 172.21.15.12:0/2915967541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e37916bed0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fbef4033000 tx=0x7fbef403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74996a32b5b28b97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.317+0000 7fbeea7fc640 1 -- 172.21.15.12:0/2915967541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef404b070 con 0x55e37916baf0 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.317+0000 7fbeea7fc640 1 -- 172.21.15.12:0/2915967541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbef40035f0 con 0x55e37916baf0 2024-09-19T06:50:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.317+0000 7fbeea7fc640 1 -- 172.21.15.12:0/2915967541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4035050 con 0x55e37916baf0 2024-09-19T06:50:51.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.317+0000 7f0bb0753740 1 Processor -- start 2024-09-19T06:50:51.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.317+0000 7f0bb0753740 1 -- start start 2024-09-19T06:50:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.317+0000 7fbf0d003740 1 -- 172.21.15.12:0/2915967541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 msgr2=0x55e37916bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.317+0000 7fbf0d003740 1 --2- 172.21.15.12:0/2915967541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e37916bed0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fbef4033000 tx=0x7fbef403c000 comp rx=0 tx=0).stop 2024-09-19T06:50:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.317+0000 7fbf0d003740 1 -- 172.21.15.12:0/2915967541 shutdown_connections 2024-09-19T06:50:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.317+0000 7fbf0d003740 1 --2- 172.21.15.12:0/2915967541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e3791790a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.317+0000 7fbf0d003740 1 --2- 172.21.15.12:0/2915967541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e379176770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.317+0000 7fbf0d003740 1 --2- 172.21.15.12:0/2915967541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e37916bed0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.317+0000 7fbf0d003740 1 -- 172.21.15.12:0/2915967541 >> 172.21.15.12:0/2915967541 conn(0x55e379168060 msgr2=0x55e379168440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.318+0000 7fbf0d003740 1 -- 172.21.15.12:0/2915967541 shutdown_connections 2024-09-19T06:50:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.318+0000 7fbf0d003740 1 -- 172.21.15.12:0/2915967541 wait complete. 2024-09-19T06:50:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4540430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4530120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c4534370 0x5573c452c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0bb0753740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81ab9c0 con 0x5573c452ab40 2024-09-19T06:50:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0bb0753740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81ad500 con 0x5573c45295d0 2024-09-19T06:50:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0bb0753740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81ac090 con 0x5573c4534370 2024-09-19T06:50:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0b9ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4540430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0b9ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4540430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50366/0 (socket says 172.21.15.12:50366) 2024-09-19T06:50:51.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0b9ffff640 1 -- 172.21.15.12:0/2750371127 learned_addr learned my addr 172.21.15.12:0/2750371127 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.318+0000 7fbf0d003740 1 -- start start 2024-09-19T06:50:51.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/2750371127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4530120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/2750371127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c4534370 0x5573c452c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.318+0000 7fbf0d003740 1 Processor -- start 2024-09-19T06:50:51.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0b9ffff640 1 -- 172.21.15.12:0/2750371127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c4534370 msgr2=0x5573c452c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/2750371127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c4534370 0x5573c452c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0b9ffff640 1 -- 172.21.15.12:0/2750371127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 msgr2=0x5573c4530120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/2750371127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4530120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.318+0000 7f0b9ffff640 1 -- 172.21.15.12:0/2750371127 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573c4526960 con 0x5573c45295d0 2024-09-19T06:50:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.319+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/2750371127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4540430 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0b90023fd0 tx=0x7f0b9000c190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=594f3acb5bfe8388 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e379173bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.319+0000 7f0b9dffb640 1 -- 172.21.15.12:0/2750371127 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9000f040 con 0x5573c45295d0 2024-09-19T06:50:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.319+0000 7f0b9dffb640 1 -- 172.21.15.12:0/2750371127 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b9002a070 con 0x5573c45295d0 2024-09-19T06:50:51.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.319+0000 7f0b9dffb640 1 -- 172.21.15.12:0/2750371127 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90023a50 con 0x5573c45295d0 2024-09-19T06:50:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e3791740f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e379174630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf0d003740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e379179880 con 0x55e37916baf0 2024-09-19T06:50:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf0d003740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e379059290 con 0x55e37916c410 2024-09-19T06:50:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e379173bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf0d003740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e379179a00 con 0x55e379176cb0 2024-09-19T06:50:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e379173bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45206/0 (socket says 172.21.15.12:45206) 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf03fff640 1 -- 172.21.15.12:0/4280974145 learned_addr learned my addr 172.21.15.12:0/4280974145 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf08802640 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e379174630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf037fe640 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e3791740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf0d003740 10 client.0 _ll_register_callbacks cb 0x55e37908a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf03fff640 1 -- 172.21.15.12:0/4280974145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 msgr2=0x55e379174630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf03fff640 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e379174630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf03fff640 1 -- 172.21.15.12:0/4280974145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 msgr2=0x55e3791740f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf03fff640 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e3791740f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.319+0000 7fbf03fff640 1 -- 172.21.15.12:0/4280974145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e378de3210 con 0x55e37916baf0 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.320+0000 7fbf03fff640 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e379173bb0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fbef4003b90 tx=0x7fbef4003bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fd15083af0255 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.320+0000 7fbee37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.320+0000 7fbee37fe640 1 -- 172.21.15.12:0/4280974145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4058020 con 0x55e37916baf0 2024-09-19T06:50:51.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.320+0000 7f0bb0753740 1 -- 172.21.15.12:0/2750371127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 msgr2=0x5573c4540430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.320+0000 7f0bb0753740 1 --2- 172.21.15.12:0/2750371127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4540430 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0b90023fd0 tx=0x7f0b9000c190 comp rx=0 tx=0).stop 2024-09-19T06:50:51.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.320+0000 7f0bb0753740 1 -- 172.21.15.12:0/2750371127 shutdown_connections 2024-09-19T06:50:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.320+0000 7f0bb0753740 1 --2- 172.21.15.12:0/2750371127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c4534370 0x5573c452c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.320+0000 7f0bb0753740 1 --2- 172.21.15.12:0/2750371127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4530120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.320+0000 7f0bb0753740 1 --2- 172.21.15.12:0/2750371127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c45295d0 0x5573c4540430 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.320+0000 7f0bb0753740 1 -- 172.21.15.12:0/2750371127 >> 172.21.15.12:0/2750371127 conn(0x5573c44f2310 msgr2=0x5573c4520a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.320+0000 7f0bb0753740 1 -- 172.21.15.12:0/2750371127 shutdown_connections 2024-09-19T06:50:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.320+0000 7fbf0d003740 1 -- 172.21.15.12:0/4280974145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbef40035f0 con 0x55e37916baf0 2024-09-19T06:50:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.320+0000 7fbee37fe640 1 -- 172.21.15.12:0/4280974145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fbef40478d0 con 0x55e37916baf0 2024-09-19T06:50:51.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.320+0000 7f0bb0753740 1 -- 172.21.15.12:0/2750371127 wait complete. 2024-09-19T06:50:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.320+0000 7fbee37fe640 1 -- 172.21.15.12:0/4280974145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbef4063050 con 0x55e37916baf0 2024-09-19T06:50:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.320+0000 7fbf0d003740 10 client.18411 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:51.343 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.320+0000 7fbf0d003740 1 -- 172.21.15.12:0/4280974145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55e378eaf620 con 0x55e37916baf0 2024-09-19T06:50:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.320+0000 7f0bb0753740 1 -- start start 2024-09-19T06:50:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.320+0000 7fbee37fe640 1 -- 172.21.15.12:0/4280974145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbef40035f0 con 0x55e37916baf0 2024-09-19T06:50:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.321+0000 7fbee37fe640 1 -- 172.21.15.12:0/4280974145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fbef4050bd0 con 0x55e37916baf0 2024-09-19T06:50:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.321+0000 7fbf0d003740 10 client.18411 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.321+0000 7fbf0d003740 10 client.18411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.321+0000 7fbf0d003740 20 client.18411 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.321+0000 7fbf0d003740 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e379186bb0 0x55e379188fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.321+0000 7fbf0d003740 4 client.18411 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.321+0000 7fbf0d003740 1 -- 172.21.15.12:0/4280974145 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3790dda20 con 0x55e379186bb0 2024-09-19T06:50:51.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0bb0753740 1 Processor -- start 2024-09-19T06:50:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.321+0000 7fbf037fe640 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e379186bb0 0x55e379188fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 0x5573c45467c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4546d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0bb0753740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 0x5573c45ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0bb0753740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81ace30 con 0x5573c452ab40 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0bb0753740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81ac760 con 0x5573c4534370 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0bb0753740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba81a99c0 con 0x5573c45295d0 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0bb0753740 10 client.0 _ll_register_callbacks cb 0x7f0b9000c750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0ba7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4546d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0b9ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 0x5573c45467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0ba7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4546d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45214/0 (socket says 172.21.15.12:45214) 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0b9ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 0x5573c45467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:48850/0 (socket says 172.21.15.12:48850) 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0ba7fff640 1 -- 172.21.15.12:0/608842541 learned_addr learned my addr 172.21.15.12:0/608842541 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.321+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 0x5573c45ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.321+0000 7fbf037fe640 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e379186bb0 0x55e379188fa0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3916a224958449e8 server_cookie=59b311350f927aed in_seq=0 out_seq=0 2024-09-19T06:50:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.321+0000 7fbee37fe640 10 client.18411 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:51.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0ba7fff640 1 -- 172.21.15.12:0/608842541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 msgr2=0x5573c45467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 0x5573c45467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0ba7fff640 1 -- 172.21.15.12:0/608842541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 msgr2=0x5573c45ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 0x5573c45ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0ba7fff640 1 -- 172.21.15.12:0/608842541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573c45acca0 con 0x5573c452ab40 2024-09-19T06:50:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0ba7fff640 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4546d00 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0b9802a940 tx=0x7f0b980316c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86cd6d9816b3854 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0b877fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0b877fe640 1 -- 172.21.15.12:0/608842541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98053040 con 0x5573c452ab40 2024-09-19T06:50:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0b877fe640 1 -- 172.21.15.12:0/608842541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f0b98004950 con 0x5573c452ab40 2024-09-19T06:50:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0bb0753740 1 -- 172.21.15.12:0/608842541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b9002a070 con 0x5573c452ab40 2024-09-19T06:50:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbee37fe640 1 -- 172.21.15.12:0/4280974145 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3790dda20 con 0x55e379186bb0 2024-09-19T06:50:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbee37fe640 10 client.18411 handle_command_reply: tid=0 2024-09-19T06:50:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbf0d003740 1 client.18411 shutdown 2024-09-19T06:50:51.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0b877fe640 1 -- 172.21.15.12:0/608842541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0b98035050 con 0x5573c452ab40 2024-09-19T06:50:51.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0bb0753740 10 client.18414 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:51.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.322+0000 7f0bb0753740 1 -- 172.21.15.12:0/608842541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5573c45adf40 con 0x5573c452ab40 2024-09-19T06:50:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbf0d003740 1 -- 172.21.15.12:0/4280974145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 msgr2=0x55e379173bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbf0d003740 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e379173bb0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fbef4003b90 tx=0x7fbef4003bc0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbf0d003740 1 -- 172.21.15.12:0/4280974145 shutdown_connections 2024-09-19T06:50:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbf0d003740 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e379186bb0 0x55e379188fa0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbf0d003740 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e379174630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbf0d003740 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e3791740f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbf0d003740 1 --2- 172.21.15.12:0/4280974145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e379173bb0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbee37fe640 0 client.18411 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:51.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.322+0000 7fbf0d003740 1 -- 172.21.15.12:0/4280974145 >> 172.21.15.12:0/4280974145 conn(0x55e379168060 msgr2=0x55e37916ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.323+0000 7fbf0d003740 1 -- 172.21.15.12:0/4280974145 shutdown_connections 2024-09-19T06:50:51.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0b877fe640 1 -- 172.21.15.12:0/608842541 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b9002a070 con 0x5573c452ab40 2024-09-19T06:50:51.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.323+0000 7fbf0d003740 1 -- 172.21.15.12:0/4280974145 wait complete. 2024-09-19T06:50:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.323+0000 7fbf0d003740 20 client.18411 trim_cache size 0 max 16384 2024-09-19T06:50:51.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0b877fe640 1 -- 172.21.15.12:0/608842541 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f0b98004da0 con 0x5573c452ab40 2024-09-19T06:50:51.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0bb0753740 10 client.18414 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:51.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0bb0753740 10 client.18414 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:50:51.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0bb0753740 20 client.18414 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:51.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0bb0753740 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5573c45ae650 0x5573c45b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0bb0753740 4 client.18414 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0bb0753740 1 -- 172.21.15.12:0/608842541 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5573c4496d70 con 0x5573c45ae650 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5573c45ae650 0x5573c45b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0b877fe640 10 client.18414 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.323+0000 7f0b9ffff640 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5573c45ae650 0x5573c45b0a70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=243872e35b1e145 server_cookie=86573f137a818b7b in_seq=0 out_seq=0 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0b877fe640 1 -- 172.21.15.12:0/608842541 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5573c4496d70 con 0x5573c45ae650 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0b877fe640 10 client.18414 handle_command_reply: tid=0 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 client.18414 shutdown 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 -- 172.21.15.12:0/608842541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 msgr2=0x5573c4546d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4546d00 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0b9802a940 tx=0x7f0b980316c0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 -- 172.21.15.12:0/608842541 shutdown_connections 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5573c45ae650 0x5573c45b0a70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5573c4534370 0x5573c45ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5573c452ab40 0x5573c4546d00 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 --2- 172.21.15.12:0/608842541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5573c45295d0 0x5573c45467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0b877fe640 0 client.18414 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:50:51.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 -- 172.21.15.12:0/608842541 >> 172.21.15.12:0/608842541 conn(0x5573c44f2310 msgr2=0x5573c4530120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 -- 172.21.15.12:0/608842541 shutdown_connections 2024-09-19T06:50:51.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 1 -- 172.21.15.12:0/608842541 wait complete. 2024-09-19T06:50:51.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.324+0000 7f0bb0753740 20 client.18414 trim_cache size 0 max 16384 2024-09-19T06:50:51.356 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:50:51.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 -- 172.21.15.12:0/879764521 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b940a33b0 msgr2=0x7f0b940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b940a33b0 0x7f0b940a5870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00986e0 tx=0x7f0ba00c7050 comp rx=0 tx=0).stop 2024-09-19T06:50:51.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 -- 172.21.15.12:0/879764521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8106a70 msgr2=0x7f0ba819cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8106a70 0x7f0ba819cd90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000eaa0 tx=0x7f0ba000ef60 comp rx=0 tx=0).stop 2024-09-19T06:50:51.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 -- 172.21.15.12:0/879764521 shutdown_connections 2024-09-19T06:50:51.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ba8106a70 0x7f0ba819cd90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b940a33b0 0x7f0b940a5870 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba8101410 0x7f0ba8198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 --2- 172.21.15.12:0/879764521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ba8100a70 0x7f0ba81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 -- 172.21.15.12:0/879764521 >> 172.21.15.12:0/879764521 conn(0x7f0ba80fc7d0 msgr2=0x7f0ba806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 -- 172.21.15.12:0/879764521 shutdown_connections 2024-09-19T06:50:51.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:51.325+0000 7f0bae37a640 1 -- 172.21.15.12:0/879764521 wait complete. 2024-09-19T06:50:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.338+0000 7fbf0d003740 1 Processor -- start 2024-09-19T06:50:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf0d003740 1 -- start start 2024-09-19T06:50:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e3791740e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e379174620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e37918bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf0d003740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041afd80 con 0x55e37916baf0 2024-09-19T06:50:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf0d003740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041b18c0 con 0x55e37916c410 2024-09-19T06:50:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf0d003740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041b0450 con 0x55e379176cb0 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e3791740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e3791740e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45220/0 (socket says 172.21.15.12:45220) 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf03fff640 1 -- 172.21.15.12:0/1829859310 learned_addr learned my addr 172.21.15.12:0/1829859310 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf037fe640 1 --2- 172.21.15.12:0/1829859310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e379174620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.339+0000 7fbf08802640 1 --2- 172.21.15.12:0/1829859310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e37918bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.340+0000 7fbf03fff640 1 -- 172.21.15.12:0/1829859310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 msgr2=0x55e37918bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.340+0000 7fbf03fff640 1 --2- 172.21.15.12:0/1829859310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e37918bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.340+0000 7fbf03fff640 1 -- 172.21.15.12:0/1829859310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 msgr2=0x55e379174620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.340+0000 7fbf03fff640 1 --2- 172.21.15.12:0/1829859310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e379174620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.340+0000 7fbf03fff640 1 -- 172.21.15.12:0/1829859310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3791632d0 con 0x55e37916baf0 2024-09-19T06:50:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.340+0000 7fbf037fe640 1 --2- 172.21.15.12:0/1829859310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e379174620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.340+0000 7fbf03fff640 1 --2- 172.21.15.12:0/1829859310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e3791740e0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbef402a940 tx=0x7fbef4003830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5778b0fb0b74f9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.340+0000 7fbee9ffb640 1 -- 172.21.15.12:0/1829859310 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef403f070 con 0x55e37916baf0 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.340+0000 7fbee9ffb640 1 -- 172.21.15.12:0/1829859310 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbef40476d0 con 0x55e37916baf0 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.340+0000 7fbee9ffb640 1 -- 172.21.15.12:0/1829859310 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4058070 con 0x55e37916baf0 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.341+0000 7fbf0d003740 1 -- 172.21.15.12:0/1829859310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 msgr2=0x55e3791740e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.341+0000 7fbf0d003740 1 --2- 172.21.15.12:0/1829859310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e3791740e0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbef402a940 tx=0x7fbef4003830 comp rx=0 tx=0).stop 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.341+0000 7fbf0d003740 1 -- 172.21.15.12:0/1829859310 shutdown_connections 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.341+0000 7fbf0d003740 1 --2- 172.21.15.12:0/1829859310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e379176cb0 0x55e37918bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.341+0000 7fbf0d003740 1 --2- 172.21.15.12:0/1829859310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916c410 0x55e379174620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.341+0000 7fbf0d003740 1 --2- 172.21.15.12:0/1829859310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e37916baf0 0x55e3791740e0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.341+0000 7fbf0d003740 1 -- 172.21.15.12:0/1829859310 >> 172.21.15.12:0/1829859310 conn(0x55e379168060 msgr2=0x55e379175c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.341+0000 7fbf0d003740 1 -- 172.21.15.12:0/1829859310 shutdown_connections 2024-09-19T06:50:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.341+0000 7fbf0d003740 1 -- 172.21.15.12:0/1829859310 wait complete. 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.341+0000 7fbf0d003740 1 -- start start 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf0d003740 1 Processor -- start 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916baf0 0x55e3791897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e37916c410 0x55e379189d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf0d003740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e379176cb0 0x55e37918bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf0d003740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041b11f0 con 0x55e379176cb0 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf0d003740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041b0b20 con 0x55e37916baf0 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf0d003740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041add80 con 0x55e37916c410 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf0d003740 10 client.0 _ll_register_callbacks cb 0x7fbef4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf08802640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e379176cb0 0x55e37918bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf08802640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e379176cb0 0x55e37918bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45228/0 (socket says 172.21.15.12:45228) 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf08802640 1 -- 172.21.15.12:0/2035981939 learned_addr learned my addr 172.21.15.12:0/2035981939 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf037fe640 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e37916c410 0x55e379189d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf03fff640 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916baf0 0x55e3791897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf08802640 1 -- 172.21.15.12:0/2035981939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e37916c410 msgr2=0x55e379189d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf08802640 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e37916c410 0x55e379189d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf08802640 1 -- 172.21.15.12:0/2035981939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916baf0 msgr2=0x55e3791897d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf08802640 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916baf0 0x55e3791897d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.342+0000 7fbf08802640 1 -- 172.21.15.12:0/2035981939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e37918c450 con 0x55e379176cb0 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.343+0000 7fbf08802640 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e379176cb0 0x55e37918bdb0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fbefc005fd0 tx=0x7fbefc013d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ee8d65e95069a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.343+0000 7fbee37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.343+0000 7fbee37fe640 1 -- 172.21.15.12:0/2035981939 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc004b20 con 0x55e379176cb0 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.343+0000 7fbee37fe640 1 -- 172.21.15.12:0/2035981939 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fbefc004cc0 con 0x55e379176cb0 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.343+0000 7fbf0d003740 1 -- 172.21.15.12:0/2035981939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbef40476d0 con 0x55e379176cb0 2024-09-19T06:50:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.343+0000 7fbee37fe640 1 -- 172.21.15.12:0/2035981939 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbefc011a50 con 0x55e379176cb0 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.343+0000 7fbf0d003740 10 client.18420 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.343+0000 7fbf0d003740 1 -- 172.21.15.12:0/2035981939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55e3791f1070 con 0x55e379176cb0 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.343+0000 7fbee37fe640 1 -- 172.21.15.12:0/2035981939 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbef40476d0 con 0x55e379176cb0 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.344+0000 7fbee37fe640 1 -- 172.21.15.12:0/2035981939 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fbefc00f040 con 0x55e379176cb0 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.344+0000 7fbf0d003740 10 client.18420 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.344+0000 7fbf0d003740 10 client.18420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.344+0000 7fbf0d003740 20 client.18420 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.344+0000 7fbf0d003740 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e3791f1870 0x55e3791f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.344+0000 7fbf0d003740 4 client.18420 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.344+0000 7fbf0d003740 1 -- 172.21.15.12:0/2035981939 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e3790d7d70 con 0x55e3791f1870 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.344+0000 7fbf03fff640 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e3791f1870 0x55e3791f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.344+0000 7fbee37fe640 10 client.18420 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.344+0000 7fbf03fff640 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e3791f1870 0x55e3791f3c90 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3ab1baa3ea1a865 server_cookie=8a728fa7a4a29679 in_seq=0 out_seq=0 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbee37fe640 1 -- 172.21.15.12:0/2035981939 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e3790d7d70 con 0x55e3791f1870 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbee37fe640 10 client.18420 handle_command_reply: tid=0 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 client.18420 shutdown 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 -- 172.21.15.12:0/2035981939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e379176cb0 msgr2=0x55e37918bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e379176cb0 0x55e37918bdb0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fbefc005fd0 tx=0x7fbefc013d50 comp rx=0 tx=0).stop 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 -- 172.21.15.12:0/2035981939 shutdown_connections 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e3791f1870 0x55e3791f3c90 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e379176cb0 0x55e37918bdb0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e37916c410 0x55e379189d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 --2- 172.21.15.12:0/2035981939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e37916baf0 0x55e3791897d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 -- 172.21.15.12:0/2035981939 >> 172.21.15.12:0/2035981939 conn(0x55e379168060 msgr2=0x55e3791669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbee37fe640 0 client.18420 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 -- 172.21.15.12:0/2035981939 shutdown_connections 2024-09-19T06:50:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.355+0000 7fbf0d003740 1 -- 172.21.15.12:0/2035981939 wait complete. 2024-09-19T06:50:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0d003740 20 client.18420 trim_cache size 0 max 16384 2024-09-19T06:50:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:50:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:50:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:50:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:50:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0a265640 1 -- 172.21.15.12:0/1133867381 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbeec0a34e0 msgr2=0x7fbeec0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0a265640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbeec0a34e0 0x7fbeec0a59a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbef4000c00 tx=0x7fbef4005a20 comp rx=0 tx=0).stop 2024-09-19T06:50:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0a265640 1 -- 172.21.15.12:0/1133867381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf04101350 msgr2=0x7fbf040fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0a265640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf04101350 0x7fbf040fd320 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbef800d950 tx=0x7fbef800de10 comp rx=0 tx=0).stop 2024-09-19T06:50:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0a265640 1 -- 172.21.15.12:0/1133867381 shutdown_connections 2024-09-19T06:50:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0a265640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf041069c0 0x7fbf040fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0a265640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf04101350 0x7fbf040fd320 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0a265640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fbeec0a34e0 0x7fbeec0a59a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0a265640 1 --2- 172.21.15.12:0/1133867381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf041009b0 0x7fbf040fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.356+0000 7fbf0a265640 1 -- 172.21.15.12:0/1133867381 >> 172.21.15.12:0/1133867381 conn(0x7fbf04077990 msgr2=0x7fbf04069980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.357+0000 7fbf0a265640 1 -- 172.21.15.12:0/1133867381 shutdown_connections 2024-09-19T06:50:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:50:51.357+0000 7fbf0a265640 1 -- 172.21.15.12:0/1133867381 wait complete. 2024-09-19T06:50:52.069 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:51 smithi012 ceph-mon[30937]: pgmap v332: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-09-19T06:50:52.103 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:50:52.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:51 smithi016 ceph-mon[34911]: pgmap v332: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-09-19T06:50:52.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:51 smithi173 ceph-mon[35349]: pgmap v332: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-09-19T06:50:52.363 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:52.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.847+0000 7f02120da640 1 -- 172.21.15.12:0/3190002787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f020c101de0 msgr2=0x7f020c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:52.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.847+0000 7f02120da640 1 --2- 172.21.15.12:0/3190002787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f020c101de0 0x7f020c1021c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009ca0 tx=0x7f01fc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.847+0000 7f02120da640 1 -- 172.21.15.12:0/3190002787 shutdown_connections 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.847+0000 7f02120da640 1 --2- 172.21.15.12:0/3190002787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f020c106f10 0x7f020c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.847+0000 7f02120da640 1 --2- 172.21.15.12:0/3190002787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f020c102790 0x7f020c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.847+0000 7f02120da640 1 --2- 172.21.15.12:0/3190002787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f020c101de0 0x7f020c1021c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.847+0000 7f02120da640 1 -- 172.21.15.12:0/3190002787 >> 172.21.15.12:0/3190002787 conn(0x7f020c0fd8c0 msgr2=0x7f020c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.847+0000 7f02120da640 1 -- 172.21.15.12:0/3190002787 shutdown_connections 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.847+0000 7f02120da640 1 -- 172.21.15.12:0/3190002787 wait complete. 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.848+0000 7f02120da640 1 Processor -- start 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.848+0000 7f02120da640 1 -- start start 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.848+0000 7f02120da640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f020c101de0 0x7f020c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.848+0000 7f02120da640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f020c102790 0x7f020c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.848+0000 7f02120da640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f020c106f10 0x7f020c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.848+0000 7f02120da640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f020c111f90 con 0x7f020c101de0 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.848+0000 7f02120da640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f020c111e10 con 0x7f020c106f10 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.848+0000 7f02120da640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f020c112110 con 0x7f020c102790 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.848+0000 7f020b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f020c101de0 0x7f020c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.848+0000 7f020b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f020c101de0 0x7f020c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45236/0 (socket says 172.21.15.12:45236) 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f020b7fe640 1 -- 172.21.15.12:0/301843901 learned_addr learned my addr 172.21.15.12:0/301843901 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f020bfff640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f020c106f10 0x7f020c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f020affd640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f020c102790 0x7f020c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f020b7fe640 1 -- 172.21.15.12:0/301843901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f020c102790 msgr2=0x7f020c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f020b7fe640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f020c102790 0x7f020c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f020b7fe640 1 -- 172.21.15.12:0/301843901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f020c106f10 msgr2=0x7f020c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f020b7fe640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f020c106f10 0x7f020c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f020b7fe640 1 -- 172.21.15.12:0/301843901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020c19d440 con 0x7f020c101de0 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f020b7fe640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f020c101de0 0x7f020c198490 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f01fc02ade0 tx=0x7f01fc0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f0208ff9640 1 -- 172.21.15.12:0/301843901 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc02fa20 con 0x7f020c101de0 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f0208ff9640 1 -- 172.21.15.12:0/301843901 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01fc02fbc0 con 0x7f020c101de0 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f02120da640 1 -- 172.21.15.12:0/301843901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020c19d6d0 con 0x7f020c101de0 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f0208ff9640 1 -- 172.21.15.12:0/301843901 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc03a660 con 0x7f020c101de0 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.849+0000 7f02120da640 1 -- 172.21.15.12:0/301843901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020c1a5010 con 0x7f020c101de0 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.851+0000 7f0208ff9640 1 -- 172.21.15.12:0/301843901 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f01fc0305c0 con 0x7f020c101de0 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f02144b3740 1 Processor -- start 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f02144b3740 1 -- start start 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f02144b3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3181b40 0x55afa3180090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f02144b3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa3180a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f02144b3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa318b370 0x55afa318d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f02144b3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55afa30e62f0 con 0x55afa318b370 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f02144b3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55afa308dcf0 con 0x55afa31805d0 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f02144b3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55afa30e22b0 con 0x55afa3181b40 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f020affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa318b370 0x55afa318d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f020affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa318b370 0x55afa318d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45242/0 (socket says 172.21.15.12:45242) 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f020affd640 1 -- 172.21.15.12:0/1333730660 learned_addr learned my addr 172.21.15.12:0/1333730660 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f020b7fe640 1 --2- 172.21.15.12:0/1333730660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa3180a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f020bfff640 1 --2- 172.21.15.12:0/1333730660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3181b40 0x55afa3180090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f0208ff9640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01f80a3430 0x7f01f80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f020affd640 1 -- 172.21.15.12:0/1333730660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3181b40 msgr2=0x55afa3180090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f020affd640 1 --2- 172.21.15.12:0/1333730660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3181b40 0x55afa3180090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f020affd640 1 -- 172.21.15.12:0/1333730660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 msgr2=0x55afa3180a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.852+0000 7f020affd640 1 --2- 172.21.15.12:0/1333730660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa3180a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.853+0000 7f020affd640 1 -- 172.21.15.12:0/1333730660 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa30723a0 con 0x55afa318b370 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.853+0000 7f020b7fe640 1 --2- 172.21.15.12:0/1333730660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa3180a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.853+0000 7f020bfff640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01f80a3430 0x7f01f80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.853+0000 7f0208ff9640 1 -- 172.21.15.12:0/301843901 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f01fc0f1120 con 0x7f020c101de0 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.853+0000 7f020affd640 1 --2- 172.21.15.12:0/1333730660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa318b370 0x55afa318d760 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009a40 tx=0x7f01f4009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e932985a4c99d95a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.853+0000 7f0201ffb640 1 -- 172.21.15.12:0/1333730660 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4017070 con 0x55afa318b370 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.853+0000 7f0201ffb640 1 -- 172.21.15.12:0/1333730660 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01f4013470 con 0x55afa318b370 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.853+0000 7f0201ffb640 1 -- 172.21.15.12:0/1333730660 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f40125d0 con 0x55afa318b370 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 -- 172.21.15.12:0/1333730660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa318b370 msgr2=0x55afa318d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 --2- 172.21.15.12:0/1333730660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa318b370 0x55afa318d760 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009a40 tx=0x7f01f4009f00 comp rx=0 tx=0).stop 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f020bfff640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01f80a3430 0x7f01f80a58f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f020400b7a0 tx=0x7f02040046c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 -- 172.21.15.12:0/1333730660 shutdown_connections 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 --2- 172.21.15.12:0/1333730660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa318b370 0x55afa318d760 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 --2- 172.21.15.12:0/1333730660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa3180a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 --2- 172.21.15.12:0/1333730660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3181b40 0x55afa3180090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 -- 172.21.15.12:0/1333730660 >> 172.21.15.12:0/1333730660 conn(0x55afa3149310 msgr2=0x55afa317cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 -- 172.21.15.12:0/1333730660 shutdown_connections 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 -- 172.21.15.12:0/1333730660 wait complete. 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 -- start start 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.854+0000 7f02144b3740 1 Processor -- start 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f02144b3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa318ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f02144b3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3181b40 0x55afa3187f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f02144b3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 0x55afa31884f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f02144b3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55afa318e070 con 0x55afa3181b40 2024-09-19T06:50:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f02144b3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55afa30a1060 con 0x55afa31805d0 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f02144b3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55afa318e1f0 con 0x55afa318b370 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f02144b3740 10 client.0 _ll_register_callbacks cb 0x55afa2df48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3181b40 0x55afa3187f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3181b40 0x55afa3187f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45252/0 (socket says 172.21.15.12:45252) 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020affd640 1 -- 172.21.15.12:0/545750887 learned_addr learned my addr 172.21.15.12:0/545750887 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020b7fe640 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa318ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020bfff640 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 0x55afa31884f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020affd640 1 -- 172.21.15.12:0/545750887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 msgr2=0x55afa31884f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020affd640 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 0x55afa31884f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020affd640 1 -- 172.21.15.12:0/545750887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 msgr2=0x55afa318ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020affd640 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa318ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020affd640 1 -- 172.21.15.12:0/545750887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afa2e573c0 con 0x55afa3181b40 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020b7fe640 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa318ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f020affd640 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3181b40 0x55afa3187f90 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f01f400e660 tx=0x7f01f4013ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684b4f582f60aaa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.855+0000 7f01eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f01eaffd640 1 -- 172.21.15.12:0/545750887 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4017050 con 0x55afa3181b40 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f02144b3740 1 -- 172.21.15.12:0/545750887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01f4013470 con 0x55afa3181b40 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f01eaffd640 1 -- 172.21.15.12:0/545750887 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f01f401c450 con 0x55afa3181b40 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f01eaffd640 1 -- 172.21.15.12:0/545750887 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f01f401c650 con 0x55afa3181b40 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f02144b3740 10 client.18432 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f02144b3740 1 -- 172.21.15.12:0/545750887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55afa3199a80 con 0x55afa3181b40 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f01eaffd640 1 -- 172.21.15.12:0/545750887 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01f4013470 con 0x55afa3181b40 2024-09-19T06:50:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f01eaffd640 1 -- 172.21.15.12:0/545750887 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f01f40268d0 con 0x55afa3181b40 2024-09-19T06:50:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f02144b3740 10 client.18432 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f02144b3740 10 client.18432 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:50:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f02144b3740 20 client.18432 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f02144b3740 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55afa319ae80 0x55afa319d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f02144b3740 4 client.18432 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.856+0000 7f02144b3740 1 -- 172.21.15.12:0/545750887 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afa30f3860 con 0x55afa319ae80 2024-09-19T06:50:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.857+0000 7f020b7fe640 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55afa319ae80 0x55afa319d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.857+0000 7f01eaffd640 10 client.18432 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:50:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.857+0000 7f020b7fe640 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55afa319ae80 0x55afa319d270 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1537dbda37a6b414 server_cookie=a2c1655502c47db5 in_seq=0 out_seq=0 2024-09-19T06:50:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f01eaffd640 1 -- 172.21.15.12:0/545750887 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55afa30f3860 con 0x55afa319ae80 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f01eaffd640 10 client.18432 handle_command_reply: tid=0 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 client.18432 shutdown 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 -- 172.21.15.12:0/545750887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3181b40 msgr2=0x55afa3187f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3181b40 0x55afa3187f90 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f01f400e660 tx=0x7f01f4013ce0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 -- 172.21.15.12:0/545750887 shutdown_connections 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55afa319ae80 0x55afa319d270 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 0x55afa31884f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3181b40 0x55afa3187f90 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f01eaffd640 0 client.18432 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 --2- 172.21.15.12:0/545750887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa318ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 -- 172.21.15.12:0/545750887 >> 172.21.15.12:0/545750887 conn(0x55afa3149310 msgr2=0x55afa3182960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 -- 172.21.15.12:0/545750887 shutdown_connections 2024-09-19T06:50:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 1 -- 172.21.15.12:0/545750887 wait complete. 2024-09-19T06:50:52.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.858+0000 7f02144b3740 20 client.18432 trim_cache size 0 max 16384 2024-09-19T06:50:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.871+0000 7f02144b3740 1 Processor -- start 2024-09-19T06:50:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.871+0000 7f02144b3740 1 -- start start 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f02144b3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa31805d0 0x55afa3197310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f02144b3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa318b370 0x55afa3183120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f02144b3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3183660 0x55afa31a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f02144b3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f020c1adaa0 con 0x55afa31805d0 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f02144b3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f020c1af5e0 con 0x55afa318b370 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f02144b3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f020c1ae170 con 0x55afa3183660 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa31805d0 0x55afa3197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa31805d0 0x55afa3197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45254/0 (socket says 172.21.15.12:45254) 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020b7fe640 1 -- 172.21.15.12:0/116511406 learned_addr learned my addr 172.21.15.12:0/116511406 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020affd640 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa318b370 0x55afa3183120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020b7fe640 1 -- 172.21.15.12:0/116511406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3183660 msgr2=0x55afa31a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020bfff640 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3183660 0x55afa31a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020b7fe640 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3183660 0x55afa31a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020b7fe640 1 -- 172.21.15.12:0/116511406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa318b370 msgr2=0x55afa3183120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020b7fe640 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa318b370 0x55afa3183120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020b7fe640 1 -- 172.21.15.12:0/116511406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa31864e0 con 0x55afa31805d0 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020bfff640 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3183660 0x55afa31a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020affd640 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa318b370 0x55afa3183120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f020b7fe640 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa31805d0 0x55afa3197310 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0bd490 tx=0x7f01fc0f3630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a39c121028999d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f02017fa640 1 -- 172.21.15.12:0/116511406 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0bdc00 con 0x55afa31805d0 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f02017fa640 1 -- 172.21.15.12:0/116511406 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01fc036040 con 0x55afa31805d0 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.872+0000 7f02017fa640 1 -- 172.21.15.12:0/116511406 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0b9b70 con 0x55afa31805d0 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.873+0000 7f02144b3740 1 -- 172.21.15.12:0/116511406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa31805d0 msgr2=0x55afa3197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.873+0000 7f02144b3740 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa31805d0 0x55afa3197310 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0bd490 tx=0x7f01fc0f3630 comp rx=0 tx=0).stop 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.873+0000 7f02144b3740 1 -- 172.21.15.12:0/116511406 shutdown_connections 2024-09-19T06:50:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.873+0000 7f02144b3740 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa3183660 0x55afa31a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.873+0000 7f02144b3740 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa318b370 0x55afa3183120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.873+0000 7f02144b3740 1 --2- 172.21.15.12:0/116511406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa31805d0 0x55afa3197310 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.873+0000 7f02144b3740 1 -- 172.21.15.12:0/116511406 >> 172.21.15.12:0/116511406 conn(0x55afa3149310 msgr2=0x55afa318a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.873+0000 7f02144b3740 1 -- 172.21.15.12:0/116511406 shutdown_connections 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.873+0000 7f02144b3740 1 -- 172.21.15.12:0/116511406 wait complete. 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.873+0000 7f02144b3740 1 -- start start 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f02144b3740 1 Processor -- start 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f02144b3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa3193480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f02144b3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3183660 0x55afa31939c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f02144b3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 0x55afa3190450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f02144b3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f020c1aef10 con 0x55afa3183660 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f02144b3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f020c1ae840 con 0x55afa31805d0 2024-09-19T06:50:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f02144b3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f020c1abaa0 con 0x55afa318b370 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f02144b3740 10 client.0 _ll_register_callbacks cb 0x7f0204004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f020affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3183660 0x55afa31939c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f020affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3183660 0x55afa31939c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45268/0 (socket says 172.21.15.12:45268) 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f020affd640 1 -- 172.21.15.12:0/4158375304 learned_addr learned my addr 172.21.15.12:0/4158375304 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f020b7fe640 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa3193480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f020bfff640 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 0x55afa3190450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f020affd640 1 -- 172.21.15.12:0/4158375304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 msgr2=0x55afa3190450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f020affd640 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 0x55afa3190450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f020affd640 1 -- 172.21.15.12:0/4158375304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 msgr2=0x55afa3193480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f020affd640 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa3193480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.874+0000 7f020affd640 1 -- 172.21.15.12:0/4158375304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afa3194100 con 0x55afa3183660 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f020bfff640 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 0x55afa3190450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f020affd640 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3183660 0x55afa31939c0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f01f4026e90 tx=0x7f01f4006e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d9eff98cce6ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f01eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f01eaffd640 1 -- 172.21.15.12:0/4158375304 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4017040 con 0x55afa3183660 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f02144b3740 1 -- 172.21.15.12:0/4158375304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01fc036040 con 0x55afa3183660 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f01eaffd640 1 -- 172.21.15.12:0/4158375304 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f01f401c7f0 con 0x55afa3183660 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f01eaffd640 1 -- 172.21.15.12:0/4158375304 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f01f4009890 con 0x55afa3183660 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f02144b3740 10 client.18438 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f02144b3740 1 -- 172.21.15.12:0/4158375304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55afa3205e90 con 0x55afa3183660 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f01eaffd640 1 -- 172.21.15.12:0/4158375304 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01fc036040 con 0x55afa3183660 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f01eaffd640 1 -- 172.21.15.12:0/4158375304 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f01f4026890 con 0x55afa3183660 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f02144b3740 10 client.18438 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f02144b3740 10 client.18438 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f02144b3740 20 client.18438 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.875+0000 7f02144b3740 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55afa3206550 0x55afa3208940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.876+0000 7f02144b3740 4 client.18438 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.876+0000 7f02144b3740 1 -- 172.21.15.12:0/4158375304 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55afa30edd70 con 0x55afa3206550 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.876+0000 7f020b7fe640 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55afa3206550 0x55afa3208940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.876+0000 7f020b7fe640 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55afa3206550 0x55afa3208940 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=604696e673a0fb7b server_cookie=f3a04cb3f39a1411 in_seq=0 out_seq=0 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.876+0000 7f01eaffd640 10 client.18438 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.876+0000 7f01eaffd640 1 -- 172.21.15.12:0/4158375304 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55afa30edd70 con 0x55afa3206550 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.876+0000 7f01eaffd640 10 client.18438 handle_command_reply: tid=0 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.876+0000 7f02144b3740 1 client.18438 shutdown 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 1 -- 172.21.15.12:0/4158375304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3183660 msgr2=0x55afa31939c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3183660 0x55afa31939c0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f01f4026e90 tx=0x7f01f4006e40 comp rx=0 tx=0).stop 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 1 -- 172.21.15.12:0/4158375304 shutdown_connections 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55afa3206550 0x55afa3208940 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55afa318b370 0x55afa3190450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55afa3183660 0x55afa31939c0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f01eaffd640 0 client.18438 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:50:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 1 --2- 172.21.15.12:0/4158375304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55afa31805d0 0x55afa3193480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 1 -- 172.21.15.12:0/4158375304 >> 172.21.15.12:0/4158375304 conn(0x55afa3149310 msgr2=0x55afa3186730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 1 -- 172.21.15.12:0/4158375304 shutdown_connections 2024-09-19T06:50:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 1 -- 172.21.15.12:0/4158375304 wait complete. 2024-09-19T06:50:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02144b3740 20 client.18438 trim_cache size 0 max 16384 2024-09-19T06:50:52.886 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:50:52.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02120da640 1 -- 172.21.15.12:0/301843901 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01f80a3430 msgr2=0x7f01f80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:52.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02120da640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01f80a3430 0x7f01f80a58f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f020400b7a0 tx=0x7f02040046c0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02120da640 1 -- 172.21.15.12:0/301843901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f020c101de0 msgr2=0x7f020c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:52.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02120da640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f020c101de0 0x7f020c198490 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f01fc02ade0 tx=0x7f01fc0319f0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02120da640 1 -- 172.21.15.12:0/301843901 shutdown_connections 2024-09-19T06:50:52.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02120da640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f020c106f10 0x7f020c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02120da640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01f80a3430 0x7f01f80a58f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02120da640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f020c102790 0x7f020c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02120da640 1 --2- 172.21.15.12:0/301843901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f020c101de0 0x7f020c198490 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.877+0000 7f02120da640 1 -- 172.21.15.12:0/301843901 >> 172.21.15.12:0/301843901 conn(0x7f020c0fd8c0 msgr2=0x7f020c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.878+0000 7f02120da640 1 -- 172.21.15.12:0/301843901 shutdown_connections 2024-09-19T06:50:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:52.878+0000 7f02120da640 1 -- 172.21.15.12:0/301843901 wait complete. 2024-09-19T06:50:53.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:50:53.954 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:54.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:53 smithi012 ceph-mon[30937]: pgmap v333: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-19T06:50:54.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:53 smithi016 ceph-mon[34911]: pgmap v333: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-19T06:50:54.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:53 smithi173 ceph-mon[35349]: pgmap v333: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-19T06:50:54.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.423+0000 7fb03f614640 1 -- 172.21.15.12:0/2755359836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb038102790 msgr2=0x7fb0381067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.423+0000 7fb03f614640 1 --2- 172.21.15.12:0/2755359836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb038102790 0x7fb0381067e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb028009900 tx=0x7fb02802a410 comp rx=0 tx=0).stop 2024-09-19T06:50:54.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.423+0000 7fb03f614640 1 -- 172.21.15.12:0/2755359836 shutdown_connections 2024-09-19T06:50:54.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.423+0000 7fb03f614640 1 --2- 172.21.15.12:0/2755359836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb038106f10 0x7fb03810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.423+0000 7fb03f614640 1 --2- 172.21.15.12:0/2755359836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb038102790 0x7fb0381067e0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.423+0000 7fb03f614640 1 --2- 172.21.15.12:0/2755359836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb038101de0 0x7fb0381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.423+0000 7fb03f614640 1 -- 172.21.15.12:0/2755359836 >> 172.21.15.12:0/2755359836 conn(0x7fb0380fd8c0 msgr2=0x7fb0380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.423+0000 7fb03f614640 1 -- 172.21.15.12:0/2755359836 shutdown_connections 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.423+0000 7fb03f614640 1 -- 172.21.15.12:0/2755359836 wait complete. 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03f614640 1 Processor -- start 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03f614640 1 -- start start 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03f614640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb038101de0 0x7fb0381985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03f614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb038102790 0x7fb038198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03f614640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb038106f10 0x7fb03819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03f614640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb038112010 con 0x7fb038102790 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03f614640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb038111e90 con 0x7fb038101de0 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03f614640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb038112190 con 0x7fb038106f10 2024-09-19T06:50:54.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03cbaf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb038102790 0x7fb038198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03cbaf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb038102790 0x7fb038198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45280/0 (socket says 172.21.15.12:45280) 2024-09-19T06:50:54.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03cbaf640 1 -- 172.21.15.12:0/761920025 learned_addr learned my addr 172.21.15.12:0/761920025 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:54.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.424+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb038101de0 0x7fb0381985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb03dbb1640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb038106f10 0x7fb03819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb03cbaf640 1 -- 172.21.15.12:0/761920025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb038106f10 msgr2=0x7fb03819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb038106f10 0x7fb03819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb03cbaf640 1 -- 172.21.15.12:0/761920025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb038101de0 msgr2=0x7fb0381985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb038101de0 0x7fb0381985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb03cbaf640 1 -- 172.21.15.12:0/761920025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03819d560 con 0x7fb038102790 2024-09-19T06:50:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb03dbb1640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb038106f10 0x7fb03819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb038102790 0x7fb038198af0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb028005ab0 tx=0x7fb0280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb02e7fc640 1 -- 172.21.15.12:0/761920025 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02803f030 con 0x7fb038102790 2024-09-19T06:50:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb02e7fc640 1 -- 172.21.15.12:0/761920025 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb028003ce0 con 0x7fb038102790 2024-09-19T06:50:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb03f614640 1 -- 172.21.15.12:0/761920025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03819d7f0 con 0x7fb038102790 2024-09-19T06:50:54.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb02e7fc640 1 -- 172.21.15.12:0/761920025 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028035070 con 0x7fb038102790 2024-09-19T06:50:54.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.425+0000 7fb03f614640 1 -- 172.21.15.12:0/761920025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0381a5130 con 0x7fb038102790 2024-09-19T06:50:54.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.427+0000 7fb02e7fc640 1 -- 172.21.15.12:0/761920025 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb028042030 con 0x7fb038102790 2024-09-19T06:50:54.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb0419ed740 1 Processor -- start 2024-09-19T06:50:54.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb0419ed740 1 -- start start 2024-09-19T06:50:54.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 0x560abee49090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee49a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb02e7fc640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0240a3430 0x7fb0240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee58780 0x560abee5ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb0419ed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560abedaf2f0 con 0x560abee495d0 2024-09-19T06:50:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb0419ed740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560abed56cf0 con 0x560abee4ab40 2024-09-19T06:50:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb0419ed740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560abedab2b0 con 0x560abee58780 2024-09-19T06:50:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb03d3b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee49a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb03d3b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee49a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45282/0 (socket says 172.21.15.12:45282) 2024-09-19T06:50:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb03d3b0640 1 -- 172.21.15.12:0/1459753463 learned_addr learned my addr 172.21.15.12:0/1459753463 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.428+0000 7fb03dbb1640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0240a3430 0x7fb0240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb02e7fc640 1 -- 172.21.15.12:0/761920025 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fb0280f0700 con 0x7fb038102790 2024-09-19T06:50:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/1459753463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee58780 0x560abee5ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb03dbb1640 1 --2- 172.21.15.12:0/1459753463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 0x560abee49090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb03d3b0640 1 -- 172.21.15.12:0/1459753463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee58780 msgr2=0x560abee5ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/1459753463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee58780 0x560abee5ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb03d3b0640 1 -- 172.21.15.12:0/1459753463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 msgr2=0x560abee49090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/1459753463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 0x560abee49090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb03d3b0640 1 -- 172.21.15.12:0/1459753463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560abed3b3a0 con 0x560abee495d0 2024-09-19T06:50:54.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb03dbb1640 1 --2- 172.21.15.12:0/1459753463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 0x560abee49090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:54.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/1459753463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee49a10 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb034009a70 tx=0x7fb034009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8664671a3a083f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb03dbb1640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0240a3430 0x7fb0240a58f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb0300115b0 tx=0x7fb03000a3d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb0237fe640 1 -- 172.21.15.12:0/1459753463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034017070 con 0x560abee495d0 2024-09-19T06:50:54.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb0237fe640 1 -- 172.21.15.12:0/1459753463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb034013470 con 0x560abee495d0 2024-09-19T06:50:54.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.429+0000 7fb0237fe640 1 -- 172.21.15.12:0/1459753463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034012630 con 0x560abee495d0 2024-09-19T06:50:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.430+0000 7fb0419ed740 1 -- 172.21.15.12:0/1459753463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 msgr2=0x560abee49a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.430+0000 7fb0419ed740 1 --2- 172.21.15.12:0/1459753463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee49a10 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb034009a70 tx=0x7fb034009f30 comp rx=0 tx=0).stop 2024-09-19T06:50:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.430+0000 7fb0419ed740 1 -- 172.21.15.12:0/1459753463 shutdown_connections 2024-09-19T06:50:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.430+0000 7fb0419ed740 1 --2- 172.21.15.12:0/1459753463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee58780 0x560abee5ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.430+0000 7fb0419ed740 1 --2- 172.21.15.12:0/1459753463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee49a10 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.430+0000 7fb0419ed740 1 --2- 172.21.15.12:0/1459753463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 0x560abee49090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.430+0000 7fb0419ed740 1 -- 172.21.15.12:0/1459753463 >> 172.21.15.12:0/1459753463 conn(0x560abee12310 msgr2=0x560abee45c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.430+0000 7fb0419ed740 1 -- 172.21.15.12:0/1459753463 shutdown_connections 2024-09-19T06:50:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.430+0000 7fb0419ed740 1 -- 172.21.15.12:0/1459753463 wait complete. 2024-09-19T06:50:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.430+0000 7fb0419ed740 1 -- start start 2024-09-19T06:50:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb0419ed740 1 Processor -- start 2024-09-19T06:50:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee58060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee4ab40 0x560abee55310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee58780 0x560abee55850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb0419ed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560abee5b480 con 0x560abee495d0 2024-09-19T06:50:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb0419ed740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560abed6a060 con 0x560abee58780 2024-09-19T06:50:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb0419ed740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560abee5b600 con 0x560abee4ab40 2024-09-19T06:50:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb0419ed740 10 client.0 _ll_register_callbacks cb 0x560abeabd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb03d3b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee58060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb03d3b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee58060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45292/0 (socket says 172.21.15.12:45292) 2024-09-19T06:50:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb03d3b0640 1 -- 172.21.15.12:0/958192742 learned_addr learned my addr 172.21.15.12:0/958192742 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee4ab40 0x560abee55310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb03dbb1640 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee58780 0x560abee55850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb03d3b0640 1 -- 172.21.15.12:0/958192742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee4ab40 msgr2=0x560abee55310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee4ab40 0x560abee55310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb03d3b0640 1 -- 172.21.15.12:0/958192742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee58780 msgr2=0x560abee55850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee58780 0x560abee55850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.431+0000 7fb03d3b0640 1 -- 172.21.15.12:0/958192742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560abeb203c0 con 0x560abee495d0 2024-09-19T06:50:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.432+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee58060 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb034004810 tx=0x7fb034013cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c647acf5fe3d3cfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.432+0000 7fb020ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.432+0000 7fb020ff9640 1 -- 172.21.15.12:0/958192742 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034017050 con 0x560abee495d0 2024-09-19T06:50:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.432+0000 7fb020ff9640 1 -- 172.21.15.12:0/958192742 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fb03401c450 con 0x560abee495d0 2024-09-19T06:50:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.432+0000 7fb0419ed740 1 -- 172.21.15.12:0/958192742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb034013470 con 0x560abee495d0 2024-09-19T06:50:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.432+0000 7fb020ff9640 1 -- 172.21.15.12:0/958192742 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb03401c650 con 0x560abee495d0 2024-09-19T06:50:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.432+0000 7fb0419ed740 10 client.18450 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.432+0000 7fb0419ed740 1 -- 172.21.15.12:0/958192742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x560abee66da0 con 0x560abee495d0 2024-09-19T06:50:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.432+0000 7fb020ff9640 1 -- 172.21.15.12:0/958192742 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb034013470 con 0x560abee495d0 2024-09-19T06:50:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.432+0000 7fb020ff9640 1 -- 172.21.15.12:0/958192742 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fb034026a20 con 0x560abee495d0 2024-09-19T06:50:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.433+0000 7fb0419ed740 10 client.18450 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.433+0000 7fb0419ed740 10 client.18450 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:50:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.433+0000 7fb0419ed740 20 client.18450 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.433+0000 7fb0419ed740 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x560abee681a0 0x560abee6a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.433+0000 7fb0419ed740 4 client.18450 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.433+0000 7fb0419ed740 1 -- 172.21.15.12:0/958192742 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560abedbc860 con 0x560abee681a0 2024-09-19T06:50:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.433+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x560abee681a0 0x560abee6a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.433+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x560abee681a0 0x560abee6a590 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f34d99fd0a48c62 server_cookie=97e3dd5a0225715c in_seq=0 out_seq=0 2024-09-19T06:50:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.433+0000 7fb020ff9640 10 client.18450 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:50:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb020ff9640 1 -- 172.21.15.12:0/958192742 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560abedbc860 con 0x560abee681a0 2024-09-19T06:50:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb020ff9640 10 client.18450 handle_command_reply: tid=0 2024-09-19T06:50:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb0419ed740 1 client.18450 shutdown 2024-09-19T06:50:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb0419ed740 1 -- 172.21.15.12:0/958192742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 msgr2=0x560abee58060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb0419ed740 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee58060 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb034004810 tx=0x7fb034013cd0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb0419ed740 1 -- 172.21.15.12:0/958192742 shutdown_connections 2024-09-19T06:50:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb0419ed740 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x560abee681a0 0x560abee6a590 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb0419ed740 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee58780 0x560abee55850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb0419ed740 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee4ab40 0x560abee55310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb0419ed740 1 --2- 172.21.15.12:0/958192742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee58060 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb0419ed740 1 -- 172.21.15.12:0/958192742 >> 172.21.15.12:0/958192742 conn(0x560abee12310 msgr2=0x560abee4b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.434+0000 7fb020ff9640 0 client.18450 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:50:54.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.435+0000 7fb0419ed740 1 -- 172.21.15.12:0/958192742 shutdown_connections 2024-09-19T06:50:54.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.435+0000 7fb0419ed740 1 -- 172.21.15.12:0/958192742 wait complete. 2024-09-19T06:50:54.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.435+0000 7fb0419ed740 20 client.18450 trim_cache size 0 max 16384 2024-09-19T06:50:54.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb0419ed740 1 Processor -- start 2024-09-19T06:50:54.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb0419ed740 1 -- start start 2024-09-19T06:50:54.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee45e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 0x560abee64720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee58780 0x560abee48bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb0419ed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381abb10 con 0x560abee495d0 2024-09-19T06:50:54.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb0419ed740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381ad650 con 0x560abee4ab40 2024-09-19T06:50:54.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb0419ed740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381ac1e0 con 0x560abee58780 2024-09-19T06:50:54.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03d3b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee45e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03d3b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee45e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45294/0 (socket says 172.21.15.12:45294) 2024-09-19T06:50:54.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03d3b0640 1 -- 172.21.15.12:0/4220616771 learned_addr learned my addr 172.21.15.12:0/4220616771 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:54.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/4220616771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 0x560abee64720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03d3b0640 1 -- 172.21.15.12:0/4220616771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee58780 msgr2=0x560abee48bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:54.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03dbb1640 1 --2- 172.21.15.12:0/4220616771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee58780 0x560abee48bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/4220616771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee58780 0x560abee48bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03d3b0640 1 -- 172.21.15.12:0/4220616771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 msgr2=0x560abee64720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:54.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/4220616771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 0x560abee64720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03d3b0640 1 -- 172.21.15.12:0/4220616771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560abee560d0 con 0x560abee495d0 2024-09-19T06:50:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.448+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/4220616771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 0x560abee64720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.449+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/4220616771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee45e10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb034013f00 tx=0x7fb034009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e992e2e3aeb932b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.449+0000 7fb022ffd640 1 -- 172.21.15.12:0/4220616771 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034017070 con 0x560abee495d0 2024-09-19T06:50:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.449+0000 7fb022ffd640 1 -- 172.21.15.12:0/4220616771 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0340139f0 con 0x560abee495d0 2024-09-19T06:50:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.449+0000 7fb022ffd640 1 -- 172.21.15.12:0/4220616771 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034026640 con 0x560abee495d0 2024-09-19T06:50:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.449+0000 7fb0419ed740 1 -- 172.21.15.12:0/4220616771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 msgr2=0x560abee45e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.449+0000 7fb0419ed740 1 --2- 172.21.15.12:0/4220616771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee45e10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb034013f00 tx=0x7fb034009190 comp rx=0 tx=0).stop 2024-09-19T06:50:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 -- 172.21.15.12:0/4220616771 shutdown_connections 2024-09-19T06:50:54.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 --2- 172.21.15.12:0/4220616771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee58780 0x560abee48bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 --2- 172.21.15.12:0/4220616771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee4ab40 0x560abee64720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 --2- 172.21.15.12:0/4220616771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee495d0 0x560abee45e10 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 -- 172.21.15.12:0/4220616771 >> 172.21.15.12:0/4220616771 conn(0x560abee12310 msgr2=0x560abee45700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 -- 172.21.15.12:0/4220616771 shutdown_connections 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 -- 172.21.15.12:0/4220616771 wait complete. 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 -- start start 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 Processor -- start 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee495d0 0x560abee6ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee4ab40 0x560abee6f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.450+0000 7fb0419ed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee58780 0x560abee6f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb0419ed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381acf80 con 0x560abee58780 2024-09-19T06:50:54.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb0419ed740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381ac8b0 con 0x560abee495d0 2024-09-19T06:50:54.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb0419ed740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381a9b10 con 0x560abee4ab40 2024-09-19T06:50:54.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb0419ed740 10 client.0 _ll_register_callbacks cb 0x7fb0340098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:54.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03d3b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee495d0 0x560abee6ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03dbb1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee58780 0x560abee6f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03d3b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee495d0 0x560abee6ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50486/0 (socket says 172.21.15.12:50486) 2024-09-19T06:50:54.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03d3b0640 1 -- 172.21.15.12:0/146830321 learned_addr learned my addr 172.21.15.12:0/146830321 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:54.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee4ab40 0x560abee6f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03d3b0640 1 -- 172.21.15.12:0/146830321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee4ab40 msgr2=0x560abee6f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:54.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee4ab40 0x560abee6f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03d3b0640 1 -- 172.21.15.12:0/146830321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee58780 msgr2=0x560abee6f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:54.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee58780 0x560abee6f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03d3b0640 1 -- 172.21.15.12:0/146830321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560abee5fb30 con 0x560abee495d0 2024-09-19T06:50:54.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03dbb1640 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee58780 0x560abee6f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:54.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb03d3b0640 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee495d0 0x560abee6ebb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb034004700 tx=0x7fb03401df00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89004d104187ceb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb020ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:50:54.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.451+0000 7fb020ff9640 1 -- 172.21.15.12:0/146830321 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034017040 con 0x560abee495d0 2024-09-19T06:50:54.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb020ff9640 1 -- 172.21.15.12:0/146830321 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fb03402d650 con 0x560abee495d0 2024-09-19T06:50:54.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb0419ed740 1 -- 172.21.15.12:0/146830321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0340139f0 con 0x560abee495d0 2024-09-19T06:50:54.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb020ff9640 1 -- 172.21.15.12:0/146830321 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fb034044050 con 0x560abee495d0 2024-09-19T06:50:54.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb0419ed740 10 client.27827 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:54.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb0419ed740 1 -- 172.21.15.12:0/146830321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x560abee60e30 con 0x560abee495d0 2024-09-19T06:50:54.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb020ff9640 1 -- 172.21.15.12:0/146830321 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0340139f0 con 0x560abee495d0 2024-09-19T06:50:54.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb020ff9640 1 -- 172.21.15.12:0/146830321 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fb034026760 con 0x560abee495d0 2024-09-19T06:50:54.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb0419ed740 10 client.27827 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:54.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb0419ed740 10 client.27827 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:50:54.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb0419ed740 20 client.27827 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:54.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb0419ed740 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x560abeed2b90 0x560abeed4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb0419ed740 4 client.27827 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:54.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.452+0000 7fb0419ed740 1 -- 172.21.15.12:0/146830321 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560abedb6d70 con 0x560abeed2b90 2024-09-19T06:50:54.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.453+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x560abeed2b90 0x560abeed4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.453+0000 7fb020ff9640 10 client.27827 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:50:54.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.453+0000 7fb03cbaf640 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x560abeed2b90 0x560abeed4f80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c004326ca7076e50 server_cookie=597cd127bd1d4ff4 in_seq=0 out_seq=0 2024-09-19T06:50:54.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.453+0000 7fb020ff9640 1 -- 172.21.15.12:0/146830321 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560abedb6d70 con 0x560abeed2b90 2024-09-19T06:50:54.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.453+0000 7fb020ff9640 10 client.27827 handle_command_reply: tid=0 2024-09-19T06:50:54.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.453+0000 7fb0419ed740 1 client.27827 shutdown 2024-09-19T06:50:54.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 1 -- 172.21.15.12:0/146830321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee495d0 msgr2=0x560abee6ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee495d0 0x560abee6ebb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb034004700 tx=0x7fb03401df00 comp rx=0 tx=0).stop 2024-09-19T06:50:54.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 1 -- 172.21.15.12:0/146830321 shutdown_connections 2024-09-19T06:50:54.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x560abeed2b90 0x560abeed4f80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560abee58780 0x560abee6f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560abee4ab40 0x560abee6f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb020ff9640 0 client.27827 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:50:54.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 1 --2- 172.21.15.12:0/146830321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560abee495d0 0x560abee6ebb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 1 -- 172.21.15.12:0/146830321 >> 172.21.15.12:0/146830321 conn(0x560abee12310 msgr2=0x560abee53be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 1 -- 172.21.15.12:0/146830321 shutdown_connections 2024-09-19T06:50:54.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 1 -- 172.21.15.12:0/146830321 wait complete. 2024-09-19T06:50:54.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb0419ed740 20 client.27827 trim_cache size 0 max 16384 2024-09-19T06:50:54.475 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:50:54.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb03f614640 1 -- 172.21.15.12:0/761920025 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0240a3430 msgr2=0x7fb0240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb03f614640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0240a3430 0x7fb0240a58f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb0300115b0 tx=0x7fb03000a3d0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb03f614640 1 -- 172.21.15.12:0/761920025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb038102790 msgr2=0x7fb038198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb03f614640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb038102790 0x7fb038198af0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb028005ab0 tx=0x7fb0280042f0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb03f614640 1 -- 172.21.15.12:0/761920025 shutdown_connections 2024-09-19T06:50:54.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.454+0000 7fb03f614640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0240a3430 0x7fb0240a58f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.455+0000 7fb03f614640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb038106f10 0x7fb03819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.455+0000 7fb03f614640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb038102790 0x7fb038198af0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.455+0000 7fb03f614640 1 --2- 172.21.15.12:0/761920025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb038101de0 0x7fb0381985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.455+0000 7fb03f614640 1 -- 172.21.15.12:0/761920025 >> 172.21.15.12:0/761920025 conn(0x7fb0380fd8c0 msgr2=0x7fb0380fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.455+0000 7fb03f614640 1 -- 172.21.15.12:0/761920025 shutdown_connections 2024-09-19T06:50:54.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:54.455+0000 7fb03f614640 1 -- 172.21.15.12:0/761920025 wait complete. 2024-09-19T06:50:55.376 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:50:55.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:50:55.842 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:56.255 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:55 smithi012 ceph-mon[30937]: pgmap v334: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-19T06:50:56.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:55 smithi016 ceph-mon[34911]: pgmap v334: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-19T06:50:56.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:55 smithi173 ceph-mon[35349]: pgmap v334: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-19T06:50:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.338+0000 7f059f33d640 1 -- 172.21.15.12:0/3533643249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0598103740 msgr2=0x7f0598107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.338+0000 7f059f33d640 1 --2- 172.21.15.12:0/3533643249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0598103740 0x7f0598107b80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f0588009930 tx=0x7f058802a420 comp rx=0 tx=0).stop 2024-09-19T06:50:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.338+0000 7f059f33d640 1 -- 172.21.15.12:0/3533643249 shutdown_connections 2024-09-19T06:50:56.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.338+0000 7f059f33d640 1 --2- 172.21.15.12:0/3533643249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0598108290 0x7f059810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.338+0000 7f059f33d640 1 --2- 172.21.15.12:0/3533643249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0598103740 0x7f0598107b80 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.338+0000 7f059f33d640 1 --2- 172.21.15.12:0/3533643249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598102d90 0x7f0598103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.338+0000 7f059f33d640 1 -- 172.21.15.12:0/3533643249 >> 172.21.15.12:0/3533643249 conn(0x7f05980fc7d0 msgr2=0x7f05980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.338+0000 7f059f33d640 1 -- 172.21.15.12:0/3533643249 shutdown_connections 2024-09-19T06:50:56.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.338+0000 7f059f33d640 1 -- 172.21.15.12:0/3533643249 wait complete. 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059f33d640 1 Processor -- start 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059f33d640 1 -- start start 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059f33d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0598102d90 0x7f0598198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059f33d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598103740 0x7f0598198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059f33d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0598108290 0x7f059819cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059f33d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05981120b0 con 0x7f0598108290 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059f33d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0598111f30 con 0x7f0598102d90 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059f33d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0598112230 con 0x7f0598103740 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059d8da640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0598108290 0x7f059819cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059d8da640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0598108290 0x7f059819cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45320/0 (socket says 172.21.15.12:45320) 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059d8da640 1 -- 172.21.15.12:0/3041122595 learned_addr learned my addr 172.21.15.12:0/3041122595 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059d0d9640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0598102d90 0x7f0598198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059c8d8640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598103740 0x7f0598198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059d8da640 1 -- 172.21.15.12:0/3041122595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598103740 msgr2=0x7f0598198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059d8da640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598103740 0x7f0598198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059d8da640 1 -- 172.21.15.12:0/3041122595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0598102d90 msgr2=0x7f0598198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059d8da640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0598102d90 0x7f0598198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.339+0000 7f059d8da640 1 -- 172.21.15.12:0/3041122595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059819d5e0 con 0x7f0598108290 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.340+0000 7f059d8da640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0598108290 0x7f059819cf00 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f059000cad0 tx=0x7f059000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.340+0000 7f058e7fc640 1 -- 172.21.15.12:0/3041122595 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059000ad60 con 0x7f0598108290 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.340+0000 7f058e7fc640 1 -- 172.21.15.12:0/3041122595 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0590005020 con 0x7f0598108290 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.340+0000 7f059f33d640 1 -- 172.21.15.12:0/3041122595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059819d8d0 con 0x7f0598108290 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.340+0000 7f058e7fc640 1 -- 172.21.15.12:0/3041122595 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059000f6b0 con 0x7f0598108290 2024-09-19T06:50:56.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.340+0000 7f059f33d640 1 -- 172.21.15.12:0/3041122595 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05981a51b0 con 0x7f0598108290 2024-09-19T06:50:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.342+0000 7f058e7fc640 1 -- 172.21.15.12:0/3041122595 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0590005560 con 0x7f0598108290 2024-09-19T06:50:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f05a1716740 1 Processor -- start 2024-09-19T06:50:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f05a1716740 1 -- start start 2024-09-19T06:50:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f05a1716740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94292f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f05a1716740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94292f5d0 0x55c94292fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f05a1716740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94293e780 0x55c942940b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f05a1716740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c9428952f0 con 0x55c942930b40 2024-09-19T06:50:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f05a1716740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c94283ccf0 con 0x55c94292f5d0 2024-09-19T06:50:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f05a1716740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c9428912b0 con 0x55c94293e780 2024-09-19T06:50:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f059c8d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94292f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f059c8d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94292f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45326/0 (socket says 172.21.15.12:45326) 2024-09-19T06:50:56.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.343+0000 7f059c8d8640 1 -- 172.21.15.12:0/379214542 learned_addr learned my addr 172.21.15.12:0/379214542 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:56.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f058e7fc640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f05840a3430 0x7f05840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f059c8d8640 1 --2- 172.21.15.12:0/379214542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94293e780 0x55c942940b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f059d0d9640 1 --2- 172.21.15.12:0/379214542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94292f5d0 0x55c94292fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f059c8d8640 1 -- 172.21.15.12:0/379214542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94293e780 msgr2=0x55c942940b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f059c8d8640 1 --2- 172.21.15.12:0/379214542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94293e780 0x55c942940b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f059c8d8640 1 -- 172.21.15.12:0/379214542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94292f5d0 msgr2=0x55c94292fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f059c8d8640 1 --2- 172.21.15.12:0/379214542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94292f5d0 0x55c94292fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f059c8d8640 1 -- 172.21.15.12:0/379214542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9428213a0 con 0x55c942930b40 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f059d8da640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f05840a3430 0x7f05840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f058e7fc640 1 -- 172.21.15.12:0/3041122595 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f05900cfd60 con 0x7f0598108290 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f059c8d8640 1 --2- 172.21.15.12:0/379214542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94292f090 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0588000c00 tx=0x7f0588005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd4192bbe32e512 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f05837fe640 1 -- 172.21.15.12:0/379214542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588035040 con 0x55c942930b40 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f05837fe640 1 -- 172.21.15.12:0/379214542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0588005020 con 0x55c942930b40 2024-09-19T06:50:56.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.344+0000 7f05837fe640 1 -- 172.21.15.12:0/379214542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588004bc0 con 0x55c942930b40 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 -- 172.21.15.12:0/379214542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 msgr2=0x55c94292f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f059d8da640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f05840a3430 0x7f05840a58f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f059009bca0 tx=0x7f0590005960 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 --2- 172.21.15.12:0/379214542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94292f090 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0588000c00 tx=0x7f0588005fd0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 -- 172.21.15.12:0/379214542 shutdown_connections 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 --2- 172.21.15.12:0/379214542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94293e780 0x55c942940b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 --2- 172.21.15.12:0/379214542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94292f5d0 0x55c94292fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 --2- 172.21.15.12:0/379214542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94292f090 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 -- 172.21.15.12:0/379214542 >> 172.21.15.12:0/379214542 conn(0x55c9428f8310 msgr2=0x55c94292bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 -- 172.21.15.12:0/379214542 shutdown_connections 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 -- 172.21.15.12:0/379214542 wait complete. 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 -- start start 2024-09-19T06:50:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.345+0000 7f05a1716740 1 Processor -- start 2024-09-19T06:50:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f05a1716740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94292f5d0 0x55c94293e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f05a1716740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94293b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f05a1716740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94293e780 0x55c94293b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f05a1716740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c942941420 con 0x55c942930b40 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f05a1716740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c942850060 con 0x55c94293e780 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f05a1716740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c9429415a0 con 0x55c94292f5d0 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f05a1716740 10 client.0 _ll_register_callbacks cb 0x55c9425a38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059d0d9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94293b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059d0d9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94293b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45336/0 (socket says 172.21.15.12:45336) 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059d0d9640 1 -- 172.21.15.12:0/1455438398 learned_addr learned my addr 172.21.15.12:0/1455438398 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059c8d8640 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94292f5d0 0x55c94293e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059c8d8640 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94293e780 0x55c94293b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059d0d9640 1 -- 172.21.15.12:0/1455438398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94292f5d0 msgr2=0x55c94293e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059d0d9640 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94292f5d0 0x55c94293e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059d0d9640 1 -- 172.21.15.12:0/1455438398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94293e780 msgr2=0x55c94293b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059d0d9640 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94293e780 0x55c94293b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059d0d9640 1 -- 172.21.15.12:0/1455438398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9426063c0 con 0x55c942930b40 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.346+0000 7f059c8d8640 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94292f5d0 0x55c94293e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f059d0d9640 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94293b3f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0594009f60 tx=0x7f0594009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfce59c4c9993801 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f0580ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f0580ff9640 1 -- 172.21.15.12:0/1455438398 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594019070 con 0x55c942930b40 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f0580ff9640 1 -- 172.21.15.12:0/1455438398 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f0594015870 con 0x55c942930b40 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f05a1716740 1 -- 172.21.15.12:0/1455438398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0588005020 con 0x55c942930b40 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f0580ff9640 1 -- 172.21.15.12:0/1455438398 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0594025050 con 0x55c942930b40 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f05a1716740 10 client.18468 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f05a1716740 1 -- 172.21.15.12:0/1455438398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c94294cee0 con 0x55c942930b40 2024-09-19T06:50:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f0580ff9640 1 -- 172.21.15.12:0/1455438398 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0588005020 con 0x55c942930b40 2024-09-19T06:50:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f0580ff9640 1 -- 172.21.15.12:0/1455438398 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f0594014b50 con 0x55c942930b40 2024-09-19T06:50:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f05a1716740 10 client.18468 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f05a1716740 10 client.18468 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:50:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f05a1716740 20 client.18468 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f05a1716740 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c94294e390 0x55c9429507b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f05a1716740 4 client.18468 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.347+0000 7f05a1716740 1 -- 172.21.15.12:0/1455438398 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9428a2860 con 0x55c94294e390 2024-09-19T06:50:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.348+0000 7f059c8d8640 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c94294e390 0x55c9429507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.348+0000 7f0580ff9640 10 client.18468 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.348+0000 7f059c8d8640 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c94294e390 0x55c9429507b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ebb7151b52bcf05f server_cookie=e15701de291edd73 in_seq=0 out_seq=0 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f0580ff9640 1 -- 172.21.15.12:0/1455438398 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9428a2860 con 0x55c94294e390 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f0580ff9640 10 client.18468 handle_command_reply: tid=0 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 client.18468 shutdown 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 -- 172.21.15.12:0/1455438398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 msgr2=0x55c94293b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94293b3f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0594009f60 tx=0x7f0594009f90 comp rx=0 tx=0).stop 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 -- 172.21.15.12:0/1455438398 shutdown_connections 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c94294e390 0x55c9429507b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94293e780 0x55c94293b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c942930b40 0x55c94293b3f0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 --2- 172.21.15.12:0/1455438398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c94292f5d0 0x55c94293e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 -- 172.21.15.12:0/1455438398 >> 172.21.15.12:0/1455438398 conn(0x55c9428f8310 msgr2=0x55c942931960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f0580ff9640 0 client.18468 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:50:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 -- 172.21.15.12:0/1455438398 shutdown_connections 2024-09-19T06:50:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 1 -- 172.21.15.12:0/1455438398 wait complete. 2024-09-19T06:50:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.349+0000 7f05a1716740 20 client.18468 trim_cache size 0 max 16384 2024-09-19T06:50:56.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f05a1716740 1 Processor -- start 2024-09-19T06:50:56.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f05a1716740 1 -- start start 2024-09-19T06:50:56.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f05a1716740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94292f5d0 0x55c94294a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f05a1716740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 0x55c94293a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f05a1716740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94293e780 0x55c942956060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f05a1716740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05981ab950 con 0x55c94293e780 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f05a1716740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f05981ad490 con 0x55c94292f5d0 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f05a1716740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f05981ac020 con 0x55c942930b40 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f059c8d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94293e780 0x55c942956060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f059c8d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94293e780 0x55c942956060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45350/0 (socket says 172.21.15.12:45350) 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f059c8d8640 1 -- 172.21.15.12:0/2409865512 learned_addr learned my addr 172.21.15.12:0/2409865512 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f059c8d8640 1 --2- 172.21.15.12:0/2409865512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94292f5d0 0x55c94294a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.362+0000 7f059d0d9640 1 --2- 172.21.15.12:0/2409865512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 0x55c94293a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.363+0000 7f059c8d8640 1 -- 172.21.15.12:0/2409865512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 msgr2=0x55c94293a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.363+0000 7f059c8d8640 1 --2- 172.21.15.12:0/2409865512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 0x55c94293a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.363+0000 7f059c8d8640 1 -- 172.21.15.12:0/2409865512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94292f5d0 msgr2=0x55c94294a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.363+0000 7f059c8d8640 1 --2- 172.21.15.12:0/2409865512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94292f5d0 0x55c94294a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.363+0000 7f059c8d8640 1 -- 172.21.15.12:0/2409865512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c94292bed0 con 0x55c94293e780 2024-09-19T06:50:56.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.363+0000 7f059d0d9640 1 --2- 172.21.15.12:0/2409865512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 0x55c94293a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:56.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.363+0000 7f059c8d8640 1 --2- 172.21.15.12:0/2409865512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94293e780 0x55c942956060 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f05880059d0 tx=0x7f0588040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebeee9dc74bf3362 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:56.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.363+0000 7f0582ffd640 1 -- 172.21.15.12:0/2409865512 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588035040 con 0x55c94293e780 2024-09-19T06:50:56.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.363+0000 7f0582ffd640 1 -- 172.21.15.12:0/2409865512 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05880043d0 con 0x55c94293e780 2024-09-19T06:50:56.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.363+0000 7f0582ffd640 1 -- 172.21.15.12:0/2409865512 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058804a900 con 0x55c94293e780 2024-09-19T06:50:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 -- 172.21.15.12:0/2409865512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94293e780 msgr2=0x55c942956060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 --2- 172.21.15.12:0/2409865512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94293e780 0x55c942956060 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f05880059d0 tx=0x7f0588040040 comp rx=0 tx=0).stop 2024-09-19T06:50:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 -- 172.21.15.12:0/2409865512 shutdown_connections 2024-09-19T06:50:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 --2- 172.21.15.12:0/2409865512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94293e780 0x55c942956060 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 --2- 172.21.15.12:0/2409865512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 0x55c94293a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 --2- 172.21.15.12:0/2409865512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94292f5d0 0x55c94294a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 -- 172.21.15.12:0/2409865512 >> 172.21.15.12:0/2409865512 conn(0x55c9428f8310 msgr2=0x55c942939cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:56.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 -- 172.21.15.12:0/2409865512 shutdown_connections 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 -- 172.21.15.12:0/2409865512 wait complete. 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 -- start start 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.364+0000 7f05a1716740 1 Processor -- start 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f05a1716740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94292f5d0 0x55c942946ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f05a1716740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 0x55c942942220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f05a1716740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94293e780 0x55c942942760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f05a1716740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05981acdc0 con 0x55c94292f5d0 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f05a1716740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f05981ac6f0 con 0x55c94293e780 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f05a1716740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f05981a9950 con 0x55c942930b40 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f05a1716740 10 client.0 _ll_register_callbacks cb 0x7f0594009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059c8d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94292f5d0 0x55c942946ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059c8d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94292f5d0 0x55c942946ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45352/0 (socket says 172.21.15.12:45352) 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059c8d8640 1 -- 172.21.15.12:0/2282741192 learned_addr learned my addr 172.21.15.12:0/2282741192 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:56.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059c8d8640 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94293e780 0x55c942942760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059d0d9640 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 0x55c942942220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059c8d8640 1 -- 172.21.15.12:0/2282741192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 msgr2=0x55c942942220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059c8d8640 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 0x55c942942220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059c8d8640 1 -- 172.21.15.12:0/2282741192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94293e780 msgr2=0x55c942942760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059c8d8640 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94293e780 0x55c942942760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059c8d8640 1 -- 172.21.15.12:0/2282741192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c942942f70 con 0x55c94292f5d0 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f059c8d8640 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94292f5d0 0x55c942946ef0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0588031b70 tx=0x7f058804a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d2506d85f71256 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f0580ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f0580ff9640 1 -- 172.21.15.12:0/2282741192 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588035070 con 0x55c94292f5d0 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f0580ff9640 1 -- 172.21.15.12:0/2282741192 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f0588005020 con 0x55c94292f5d0 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.365+0000 7f05a1716740 1 -- 172.21.15.12:0/2282741192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05880043d0 con 0x55c94292f5d0 2024-09-19T06:50:56.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f0580ff9640 1 -- 172.21.15.12:0/2282741192 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0588005220 con 0x55c94292f5d0 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f05a1716740 10 client.18474 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f05a1716740 1 -- 172.21.15.12:0/2282741192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c9429b8fa0 con 0x55c94292f5d0 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f0580ff9640 1 -- 172.21.15.12:0/2282741192 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05880043d0 con 0x55c94292f5d0 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f0580ff9640 1 -- 172.21.15.12:0/2282741192 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f058804a7f0 con 0x55c94292f5d0 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f05a1716740 10 client.18474 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f05a1716740 10 client.18474 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f05a1716740 20 client.18474 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f05a1716740 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c9429b9280 0x55c9429bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f05a1716740 4 client.18474 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f05a1716740 1 -- 172.21.15.12:0/2282741192 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c94289cd70 con 0x55c9429b9280 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.366+0000 7f059d0d9640 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c9429b9280 0x55c9429bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f0580ff9640 10 client.18474 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:50:56.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f059d0d9640 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c9429b9280 0x55c9429bb670 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37df8c218b5462cb server_cookie=bea8ff279770179 in_seq=0 out_seq=0 2024-09-19T06:50:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f0580ff9640 1 -- 172.21.15.12:0/2282741192 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c94289cd70 con 0x55c9429b9280 2024-09-19T06:50:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f0580ff9640 10 client.18474 handle_command_reply: tid=0 2024-09-19T06:50:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 client.18474 shutdown 2024-09-19T06:50:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 -- 172.21.15.12:0/2282741192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94292f5d0 msgr2=0x55c942946ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94292f5d0 0x55c942946ef0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0588031b70 tx=0x7f058804a4e0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 -- 172.21.15.12:0/2282741192 shutdown_connections 2024-09-19T06:50:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55c9429b9280 0x55c9429bb670 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c94293e780 0x55c942942760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c942930b40 0x55c942942220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f0580ff9640 0 client.18474 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:50:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 --2- 172.21.15.12:0/2282741192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c94292f5d0 0x55c942946ef0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 -- 172.21.15.12:0/2282741192 >> 172.21.15.12:0/2282741192 conn(0x55c9428f8310 msgr2=0x55c94293a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 -- 172.21.15.12:0/2282741192 shutdown_connections 2024-09-19T06:50:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 1 -- 172.21.15.12:0/2282741192 wait complete. 2024-09-19T06:50:56.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.367+0000 7f05a1716740 20 client.18474 trim_cache size 0 max 16384 2024-09-19T06:50:56.374 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 -- 172.21.15.12:0/3041122595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f05840a3430 msgr2=0x7f05840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f05840a3430 0x7f05840a58f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f059009bca0 tx=0x7f0590005960 comp rx=0 tx=0).stop 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 -- 172.21.15.12:0/3041122595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0598108290 msgr2=0x7f059819cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0598108290 0x7f059819cf00 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f059000cad0 tx=0x7f059000ced0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 -- 172.21.15.12:0/3041122595 shutdown_connections 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0598108290 0x7f059819cf00 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f05840a3430 0x7f05840a58f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598103740 0x7f0598198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 --2- 172.21.15.12:0/3041122595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0598102d90 0x7f0598198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 -- 172.21.15.12:0/3041122595 >> 172.21.15.12:0/3041122595 conn(0x7f05980fc7d0 msgr2=0x7f0598105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 -- 172.21.15.12:0/3041122595 shutdown_connections 2024-09-19T06:50:56.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:56.368+0000 7f059f33d640 1 -- 172.21.15.12:0/3041122595 wait complete. 2024-09-19T06:50:57.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:50:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:50:57.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.905+0000 7f55cc4b5640 1 -- 172.21.15.12:0/3783170168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c4106f10 msgr2=0x7f55c410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:57.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.905+0000 7f55cc4b5640 1 --2- 172.21.15.12:0/3783170168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c4106f10 0x7f55c410ea90 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009ca0 tx=0x7f55bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.905+0000 7f55cc4b5640 1 -- 172.21.15.12:0/3783170168 shutdown_connections 2024-09-19T06:50:57.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.905+0000 7f55cc4b5640 1 --2- 172.21.15.12:0/3783170168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c4106f10 0x7f55c410ea90 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.905+0000 7f55cc4b5640 1 --2- 172.21.15.12:0/3783170168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55c4102790 0x7f55c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.905+0000 7f55cc4b5640 1 --2- 172.21.15.12:0/3783170168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c4101de0 0x7f55c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.905+0000 7f55cc4b5640 1 -- 172.21.15.12:0/3783170168 >> 172.21.15.12:0/3783170168 conn(0x7f55c40fd8c0 msgr2=0x7f55c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.905+0000 7f55cc4b5640 1 -- 172.21.15.12:0/3783170168 shutdown_connections 2024-09-19T06:50:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.905+0000 7f55cc4b5640 1 -- 172.21.15.12:0/3783170168 wait complete. 2024-09-19T06:50:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55cc4b5640 1 Processor -- start 2024-09-19T06:50:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55cc4b5640 1 -- start start 2024-09-19T06:50:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55cc4b5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55c4101de0 0x7f55c41983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55cc4b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c4102790 0x7f55c41988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55cc4b5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c4106f10 0x7f55c419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55cc4b5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4111f70 con 0x7f55c4102790 2024-09-19T06:50:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55cc4b5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4111df0 con 0x7f55c4106f10 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55cc4b5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41120f0 con 0x7f55c4101de0 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55c9a50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c4102790 0x7f55c41988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55c9a50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c4102790 0x7f55c41988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45364/0 (socket says 172.21.15.12:45364) 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55c9a50640 1 -- 172.21.15.12:0/683827084 learned_addr learned my addr 172.21.15.12:0/683827084 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55caa52640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c4106f10 0x7f55c419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55ca251640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55c4101de0 0x7f55c41983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55c9a50640 1 -- 172.21.15.12:0/683827084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55c4101de0 msgr2=0x7f55c41983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55c9a50640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55c4101de0 0x7f55c41983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55c9a50640 1 -- 172.21.15.12:0/683827084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c4106f10 msgr2=0x7f55c419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.906+0000 7f55c9a50640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c4106f10 0x7f55c419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.907+0000 7f55c9a50640 1 -- 172.21.15.12:0/683827084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c419d360 con 0x7f55c4102790 2024-09-19T06:50:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.907+0000 7f55caa52640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c4106f10 0x7f55c419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.907+0000 7f55c9a50640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c4102790 0x7f55c41988f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f55b400d950 tx=0x7f55b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.907+0000 7f55bb7fe640 1 -- 172.21.15.12:0/683827084 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b4017070 con 0x7f55c4102790 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.907+0000 7f55bb7fe640 1 -- 172.21.15.12:0/683827084 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55b4009c30 con 0x7f55c4102790 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.907+0000 7f55cc4b5640 1 -- 172.21.15.12:0/683827084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c419d650 con 0x7f55c4102790 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.907+0000 7f55bb7fe640 1 -- 172.21.15.12:0/683827084 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b400f6b0 con 0x7f55c4102790 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.907+0000 7f55cc4b5640 1 -- 172.21.15.12:0/683827084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c41a4f30 con 0x7f55c4102790 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.909+0000 7f55bb7fe640 1 -- 172.21.15.12:0/683827084 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f55b40109d0 con 0x7f55c4102790 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.909+0000 7f55ce88e740 1 Processor -- start 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55ce88e740 1 -- start start 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf39a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf39aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55ce88e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eadf3002f0 con 0x55eadf3a5370 2024-09-19T06:50:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55ce88e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55eadf2a7cf0 con 0x55eadf39bb40 2024-09-19T06:50:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55ce88e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eadf2fc2b0 con 0x55eadf39a5d0 2024-09-19T06:50:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55c9a50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55caa52640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf39a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55ca251640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf39aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55c9a50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45376/0 (socket says 172.21.15.12:45376) 2024-09-19T06:50:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55c9a50640 1 -- 172.21.15.12:0/2888902430 learned_addr learned my addr 172.21.15.12:0/2888902430 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.910+0000 7f55bb7fe640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55b00a33b0 0x7f55b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55ca251640 1 -- 172.21.15.12:0/2888902430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 msgr2=0x55eadf39a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55ca251640 1 --2- 172.21.15.12:0/2888902430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf39a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55ca251640 1 -- 172.21.15.12:0/2888902430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 msgr2=0x55eadf3a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55ca251640 1 --2- 172.21.15.12:0/2888902430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55ca251640 1 -- 172.21.15.12:0/2888902430 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eadf28c3a0 con 0x55eadf39a5d0 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55caa52640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55b00a33b0 0x7f55b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55c9a50640 1 --2- 172.21.15.12:0/2888902430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55bb7fe640 1 -- 172.21.15.12:0/683827084 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f55b40cfa20 con 0x7f55c4102790 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55ca251640 1 --2- 172.21.15.12:0/2888902430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf39aa10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f55c000bbe0 tx=0x7f55c000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e58ca0d15116c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55b8ff9640 1 -- 172.21.15.12:0/2888902430 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0015070 con 0x55eadf39a5d0 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55b8ff9640 1 -- 172.21.15.12:0/2888902430 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55c00035f0 con 0x55eadf39a5d0 2024-09-19T06:50:57.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.911+0000 7f55b8ff9640 1 -- 172.21.15.12:0/2888902430 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c00116a0 con 0x55eadf39a5d0 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 -- 172.21.15.12:0/2888902430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 msgr2=0x55eadf39aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 --2- 172.21.15.12:0/2888902430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf39aa10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f55c000bbe0 tx=0x7f55c000f730 comp rx=0 tx=0).stop 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55caa52640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55b00a33b0 0x7f55b00a5870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f55bc004af0 tx=0x7f55bc02a8c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 -- 172.21.15.12:0/2888902430 shutdown_connections 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 --2- 172.21.15.12:0/2888902430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 --2- 172.21.15.12:0/2888902430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf39aa10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 --2- 172.21.15.12:0/2888902430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf39a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 -- 172.21.15.12:0/2888902430 >> 172.21.15.12:0/2888902430 conn(0x55eadf363310 msgr2=0x55eadf396c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 -- 172.21.15.12:0/2888902430 shutdown_connections 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 -- 172.21.15.12:0/2888902430 wait complete. 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 -- start start 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.912+0000 7f55ce88e740 1 Processor -- start 2024-09-19T06:50:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf39a5d0 0x55eadf3a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39bb40 0x55eadf3a2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf3a5370 0x55eadf3a2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ce88e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eadf3a8070 con 0x55eadf39a5d0 2024-09-19T06:50:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ce88e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55eadf2bb060 con 0x55eadf3a5370 2024-09-19T06:50:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ce88e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eadf3a81f0 con 0x55eadf39bb40 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ce88e740 10 client.0 _ll_register_callbacks cb 0x55eadf00e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ca251640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf39a5d0 0x55eadf3a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ca251640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf39a5d0 0x55eadf3a4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45378/0 (socket says 172.21.15.12:45378) 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ca251640 1 -- 172.21.15.12:0/307838483 learned_addr learned my addr 172.21.15.12:0/307838483 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55c9a50640 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39bb40 0x55eadf3a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55caa52640 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf3a5370 0x55eadf3a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ca251640 1 -- 172.21.15.12:0/307838483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39bb40 msgr2=0x55eadf3a2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ca251640 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39bb40 0x55eadf3a2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ca251640 1 -- 172.21.15.12:0/307838483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf3a5370 msgr2=0x55eadf3a2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ca251640 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf3a5370 0x55eadf3a2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ca251640 1 -- 172.21.15.12:0/307838483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eadf0713c0 con 0x55eadf39a5d0 2024-09-19T06:50:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55ca251640 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf39a5d0 0x55eadf3a4d60 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f55c000fc30 tx=0x7f55c0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafdf5898211233e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55adffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.913+0000 7f55adffb640 1 -- 172.21.15.12:0/307838483 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c0028060 con 0x55eadf39a5d0 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55adffb640 1 -- 172.21.15.12:0/307838483 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f55c00039b0 con 0x55eadf39a5d0 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55ce88e740 1 -- 172.21.15.12:0/307838483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55c00035f0 con 0x55eadf39a5d0 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55adffb640 1 -- 172.21.15.12:0/307838483 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f55c002f050 con 0x55eadf39a5d0 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55ce88e740 10 client.18486 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55ce88e740 1 -- 172.21.15.12:0/307838483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55eadf3b3b10 con 0x55eadf39a5d0 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55adffb640 1 -- 172.21.15.12:0/307838483 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55c00035f0 con 0x55eadf39a5d0 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55adffb640 1 -- 172.21.15.12:0/307838483 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f55c00119a0 con 0x55eadf39a5d0 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55ce88e740 10 client.18486 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55ce88e740 10 client.18486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55ce88e740 20 client.18486 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55ce88e740 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eadf3b4f10 0x55eadf3b7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55ce88e740 4 client.18486 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:50:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55ce88e740 1 -- 172.21.15.12:0/307838483 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eadf30d860 con 0x55eadf3b4f10 2024-09-19T06:50:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.914+0000 7f55c9a50640 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eadf3b4f10 0x55eadf3b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.915+0000 7f55adffb640 10 client.18486 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.915+0000 7f55c9a50640 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eadf3b4f10 0x55eadf3b7300 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1339fa863a2c749 server_cookie=8f7c426d8feb9ae0 in_seq=0 out_seq=0 2024-09-19T06:50:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.915+0000 7f55adffb640 1 -- 172.21.15.12:0/307838483 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eadf30d860 con 0x55eadf3b4f10 2024-09-19T06:50:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.915+0000 7f55adffb640 10 client.18486 handle_command_reply: tid=0 2024-09-19T06:50:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 client.18486 shutdown 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 -- 172.21.15.12:0/307838483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf39a5d0 msgr2=0x55eadf3a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf39a5d0 0x55eadf3a4d60 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f55c000fc30 tx=0x7f55c0005740 comp rx=0 tx=0).stop 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 -- 172.21.15.12:0/307838483 shutdown_connections 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eadf3b4f10 0x55eadf3b7300 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf3a5370 0x55eadf3a2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39bb40 0x55eadf3a2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55adffb640 0 client.18486 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 --2- 172.21.15.12:0/307838483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf39a5d0 0x55eadf3a4d60 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 -- 172.21.15.12:0/307838483 >> 172.21.15.12:0/307838483 conn(0x55eadf363310 msgr2=0x55eadf39c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 -- 172.21.15.12:0/307838483 shutdown_connections 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 1 -- 172.21.15.12:0/307838483 wait complete. 2024-09-19T06:50:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.916+0000 7f55ce88e740 20 client.18486 trim_cache size 0 max 16384 2024-09-19T06:50:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55ce88e740 1 Processor -- start 2024-09-19T06:50:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55ce88e740 1 -- start start 2024-09-19T06:50:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf395bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf3a6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55ce88e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41adc20 con 0x55eadf3a5370 2024-09-19T06:50:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55ce88e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41af760 con 0x55eadf39bb40 2024-09-19T06:50:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55ce88e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41ae2f0 con 0x55eadf39a5d0 2024-09-19T06:50:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55caa52640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55caa52640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45382/0 (socket says 172.21.15.12:45382) 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.929+0000 7f55caa52640 1 -- 172.21.15.12:0/1711899726 learned_addr learned my addr 172.21.15.12:0/1711899726 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55ca251640 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf395bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55c9a50640 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf3a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55caa52640 1 -- 172.21.15.12:0/1711899726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 msgr2=0x55eadf395bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55caa52640 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf395bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55caa52640 1 -- 172.21.15.12:0/1711899726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 msgr2=0x55eadf3a6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55caa52640 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf3a6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55caa52640 1 -- 172.21.15.12:0/1711899726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eadf3a71e0 con 0x55eadf3a5370 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55ca251640 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf395bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55c9a50640 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf3a6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55caa52640 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a6ca0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009580 tx=0x7f55bc005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae02e467c7b9bc19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55affff640 1 -- 172.21.15.12:0/1711899726 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc044070 con 0x55eadf3a5370 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55affff640 1 -- 172.21.15.12:0/1711899726 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55bc04f070 con 0x55eadf3a5370 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.930+0000 7f55affff640 1 -- 172.21.15.12:0/1711899726 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc02fc70 con 0x55eadf3a5370 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 -- 172.21.15.12:0/1711899726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 msgr2=0x55eadf3a6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a6ca0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009580 tx=0x7f55bc005f60 comp rx=0 tx=0).stop 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 -- 172.21.15.12:0/1711899726 shutdown_connections 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3a6ca0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf3a6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 --2- 172.21.15.12:0/1711899726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf395bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 -- 172.21.15.12:0/1711899726 >> 172.21.15.12:0/1711899726 conn(0x55eadf363310 msgr2=0x55eadf3954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 -- 172.21.15.12:0/1711899726 shutdown_connections 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 -- 172.21.15.12:0/1711899726 wait complete. 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 -- start start 2024-09-19T06:50:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 Processor -- start 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.931+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf3b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf3b6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55ce88e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55ce88e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41af090 con 0x55eadf3a5370 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55ce88e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41ae9c0 con 0x55eadf39bb40 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55ce88e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41abc20 con 0x55eadf39a5d0 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55ce88e740 10 client.0 _ll_register_callbacks cb 0x7f55b4097ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55caa52640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55ca251640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf3b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55caa52640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45390/0 (socket says 172.21.15.12:45390) 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55caa52640 1 -- 172.21.15.12:0/3164888134 learned_addr learned my addr 172.21.15.12:0/3164888134 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:50:57.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55c9a50640 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf3b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55caa52640 1 -- 172.21.15.12:0/3164888134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 msgr2=0x55eadf3b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55caa52640 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf3b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55caa52640 1 -- 172.21.15.12:0/3164888134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 msgr2=0x55eadf3b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55caa52640 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf3b6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55caa52640 1 -- 172.21.15.12:0/3164888134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eadf41e840 con 0x55eadf3a5370 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55caa52640 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3b6a40 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f55bc02ade0 tx=0x7f55bc02f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8313a5d4f1c3630 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55adffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55adffb640 1 -- 172.21.15.12:0/3164888134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc05a030 con 0x55eadf3a5370 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55adffb640 1 -- 172.21.15.12:0/3164888134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f55bc02fb00 con 0x55eadf3a5370 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.932+0000 7f55ce88e740 1 -- 172.21.15.12:0/3164888134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55bc04f070 con 0x55eadf3a5370 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55adffb640 1 -- 172.21.15.12:0/3164888134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f55bc066050 con 0x55eadf3a5370 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55ce88e740 10 client.18492 fetch_fsmap learned FSMap version 44 2024-09-19T06:50:57.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55ce88e740 1 -- 172.21.15.12:0/3164888134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55eadf41f9d0 con 0x55eadf3a5370 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55adffb640 1 -- 172.21.15.12:0/3164888134 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55bc04f070 con 0x55eadf3a5370 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55adffb640 1 -- 172.21.15.12:0/3164888134 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f55bc047030 con 0x55eadf3a5370 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55ce88e740 10 client.18492 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55ce88e740 10 client.18492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55ce88e740 20 client.18492 populate_metadata read hostname 'smithi012' 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55ce88e740 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eadf420040 0x55eadf422460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55ce88e740 4 client.18492 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55ce88e740 1 -- 172.21.15.12:0/3164888134 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eadf307d70 con 0x55eadf420040 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.933+0000 7f55ca251640 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eadf420040 0x55eadf422460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ca251640 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eadf420040 0x55eadf422460 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=252055d24743ee15 server_cookie=e82a5500c5bf93ec in_seq=0 out_seq=0 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55adffb640 10 client.18492 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55adffb640 1 -- 172.21.15.12:0/3164888134 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eadf307d70 con 0x55eadf420040 2024-09-19T06:50:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55adffb640 10 client.18492 handle_command_reply: tid=0 2024-09-19T06:50:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 client.18492 shutdown 2024-09-19T06:50:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 -- 172.21.15.12:0/3164888134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 msgr2=0x55eadf3b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3b6a40 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f55bc02ade0 tx=0x7f55bc02f3e0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 -- 172.21.15.12:0/3164888134 shutdown_connections 2024-09-19T06:50:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eadf420040 0x55eadf422460 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55adffb640 0 client.18492 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:50:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eadf3a5370 0x55eadf3b6a40 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eadf39bb40 0x55eadf3b6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 --2- 172.21.15.12:0/3164888134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eadf39a5d0 0x55eadf3b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 -- 172.21.15.12:0/3164888134 >> 172.21.15.12:0/3164888134 conn(0x55eadf363310 msgr2=0x55eadf395d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 -- 172.21.15.12:0/3164888134 shutdown_connections 2024-09-19T06:50:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 1 -- 172.21.15.12:0/3164888134 wait complete. 2024-09-19T06:50:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.934+0000 7f55ce88e740 20 client.18492 trim_cache size 0 max 16384 2024-09-19T06:50:57.946 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:50:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 -- 172.21.15.12:0/683827084 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55b00a33b0 msgr2=0x7f55b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55b00a33b0 0x7f55b00a5870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f55bc004af0 tx=0x7f55bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 -- 172.21.15.12:0/683827084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c4102790 msgr2=0x7f55c41988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c4102790 0x7f55c41988f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f55b400d950 tx=0x7f55b400de10 comp rx=0 tx=0).stop 2024-09-19T06:50:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 -- 172.21.15.12:0/683827084 shutdown_connections 2024-09-19T06:50:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c4106f10 0x7f55c419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55c4102790 0x7f55c41988f0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55b00a33b0 0x7f55b00a5870 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 --2- 172.21.15.12:0/683827084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55c4101de0 0x7f55c41983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 -- 172.21.15.12:0/683827084 >> 172.21.15.12:0/683827084 conn(0x7f55c40fd8c0 msgr2=0x7f55c40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 -- 172.21.15.12:0/683827084 shutdown_connections 2024-09-19T06:50:57.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:50:57.935+0000 7f55cc4b5640 1 -- 172.21.15.12:0/683827084 wait complete. 2024-09-19T06:50:58.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:57 smithi012 ceph-mon[30937]: pgmap v335: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-09-19T06:50:58.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:57 smithi016 ceph-mon[34911]: pgmap v335: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-09-19T06:50:58.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:57 smithi173 ceph-mon[35349]: pgmap v335: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 KiB/s wr, 18 op/s 2024-09-19T06:50:59.664 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:50:59.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:50:59.935 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:00.209 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:50:59 smithi012 ceph-mon[30937]: pgmap v336: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-19T06:51:00.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:50:59 smithi016 ceph-mon[34911]: pgmap v336: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-19T06:51:00.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:50:59 smithi173 ceph-mon[35349]: pgmap v336: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-19T06:51:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 -- 172.21.15.12:0/1559180218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faea4102d30 msgr2=0x7faea4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 --2- 172.21.15.12:0/1559180218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faea4102d30 0x7faea4103110 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009930 tx=0x7fae9c02a420 comp rx=0 tx=0).stop 2024-09-19T06:51:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 -- 172.21.15.12:0/1559180218 shutdown_connections 2024-09-19T06:51:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 --2- 172.21.15.12:0/1559180218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea41082a0 0x7faea410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 --2- 172.21.15.12:0/1559180218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faea41036e0 0x7faea4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 --2- 172.21.15.12:0/1559180218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faea4102d30 0x7faea4103110 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 -- 172.21.15.12:0/1559180218 >> 172.21.15.12:0/1559180218 conn(0x7faea40fc7d0 msgr2=0x7faea40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 -- 172.21.15.12:0/1559180218 shutdown_connections 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 -- 172.21.15.12:0/1559180218 wait complete. 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 Processor -- start 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.442+0000 7faeac640640 1 -- start start 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeac640640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faea4102d30 0x7faea41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeac640640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea41036e0 0x7faea4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeac640640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faea41082a0 0x7faea419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeac640640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faea41120a0 con 0x7faea41082a0 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeac640640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faea4111f20 con 0x7faea4102d30 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeac640640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faea4112220 con 0x7faea41036e0 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaabdd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faea41082a0 0x7faea419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaabdd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faea41082a0 0x7faea419cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58526/0 (socket says 172.21.15.12:58526) 2024-09-19T06:51:00.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaabdd640 1 -- 172.21.15.12:0/3110372832 learned_addr learned my addr 172.21.15.12:0/3110372832 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faea9bdb640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea41036e0 0x7faea4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faea4102d30 0x7faea41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaabdd640 1 -- 172.21.15.12:0/3110372832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea41036e0 msgr2=0x7faea4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaabdd640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea41036e0 0x7faea4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaabdd640 1 -- 172.21.15.12:0/3110372832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faea4102d30 msgr2=0x7faea41984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaabdd640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faea4102d30 0x7faea41984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaabdd640 1 -- 172.21.15.12:0/3110372832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea419d470 con 0x7faea41082a0 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faea4102d30 0x7faea41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faea9bdb640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea41036e0 0x7faea4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faeaabdd640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faea41082a0 0x7faea419cd90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fae9400cce0 tx=0x7fae9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faea37fe640 1 -- 172.21.15.12:0/3110372832 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9400f450 con 0x7faea41082a0 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.443+0000 7faea37fe640 1 -- 172.21.15.12:0/3110372832 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae9400fad0 con 0x7faea41082a0 2024-09-19T06:51:00.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.444+0000 7faeac640640 1 -- 172.21.15.12:0/3110372832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea419d760 con 0x7faea41082a0 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.444+0000 7faea37fe640 1 -- 172.21.15.12:0/3110372832 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94018c10 con 0x7faea41082a0 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.444+0000 7faeac640640 1 -- 172.21.15.12:0/3110372832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea41a5040 con 0x7faea41082a0 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.446+0000 7faea37fe640 1 -- 172.21.15.12:0/3110372832 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fae9400f5f0 con 0x7faea41082a0 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.446+0000 7faeaea19740 1 Processor -- start 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.446+0000 7faeaea19740 1 -- start start 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faeaea19740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4571b60 0x55ded4571f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faeaea19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded4572480 0x55ded457c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faeaea19740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded457cd40 0x55ded457f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faeaea19740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ded44d7280 con 0x55ded4571b60 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faeaea19740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ded447eb10 con 0x55ded4572480 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faeaea19740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ded44d3240 con 0x55ded457cd40 2024-09-19T06:51:00.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea9bdb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4571b60 0x55ded4571f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea37fe640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae8c0a33b0 0x7fae8c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea9bdb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4571b60 0x55ded4571f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58538/0 (socket says 172.21.15.12:58538) 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea9bdb640 1 -- 172.21.15.12:0/3992441647 learned_addr learned my addr 172.21.15.12:0/3992441647 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/3992441647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded4572480 0x55ded457c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea9bdb640 1 --2- 172.21.15.12:0/3992441647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded457cd40 0x55ded457f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faeaabdd640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae8c0a33b0 0x7fae8c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea9bdb640 1 -- 172.21.15.12:0/3992441647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded457cd40 msgr2=0x55ded457f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea9bdb640 1 --2- 172.21.15.12:0/3992441647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded457cd40 0x55ded457f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea9bdb640 1 -- 172.21.15.12:0/3992441647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded4572480 msgr2=0x55ded457c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea9bdb640 1 --2- 172.21.15.12:0/3992441647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded4572480 0x55ded457c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea37fe640 1 -- 172.21.15.12:0/3110372832 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fae940d04b0 con 0x7faea41082a0 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea9bdb640 1 -- 172.21.15.12:0/3992441647 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded448b1f0 con 0x55ded4571b60 2024-09-19T06:51:00.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.447+0000 7faea9bdb640 1 --2- 172.21.15.12:0/3992441647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4571b60 0x55ded4571f40 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fae98005e10 tx=0x7fae980085e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d16529eb4f8966 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faea0ff9640 1 -- 172.21.15.12:0/3992441647 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98018030 con 0x55ded4571b60 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faeaabdd640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae8c0a33b0 0x7fae8c0a5870 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae940ce160 tx=0x7fae9406e470 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faea0ff9640 1 -- 172.21.15.12:0/3992441647 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae98005500 con 0x55ded4571b60 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faea0ff9640 1 -- 172.21.15.12:0/3992441647 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9800c870 con 0x55ded4571b60 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faeaea19740 1 -- 172.21.15.12:0/3992441647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4571b60 msgr2=0x55ded4571f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faeaea19740 1 --2- 172.21.15.12:0/3992441647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4571b60 0x55ded4571f40 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fae98005e10 tx=0x7fae980085e0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faeaea19740 1 -- 172.21.15.12:0/3992441647 shutdown_connections 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faeaea19740 1 --2- 172.21.15.12:0/3992441647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded457cd40 0x55ded457f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faeaea19740 1 --2- 172.21.15.12:0/3992441647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded4572480 0x55ded457c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faeaea19740 1 --2- 172.21.15.12:0/3992441647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4571b60 0x55ded4571f40 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faeaea19740 1 -- 172.21.15.12:0/3992441647 >> 172.21.15.12:0/3992441647 conn(0x55ded456e0f0 msgr2=0x55ded456e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:00.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.448+0000 7faeaea19740 1 -- 172.21.15.12:0/3992441647 shutdown_connections 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaea19740 1 -- 172.21.15.12:0/3992441647 wait complete. 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaea19740 1 -- start start 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaea19740 1 Processor -- start 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaea19740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 0x55ded4579ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaea19740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaea19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded457a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaea19740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ded457f910 con 0x55ded4572480 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaea19740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ded4491f10 con 0x55ded457cd40 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaea19740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ded457fa90 con 0x55ded4571b60 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaea19740 10 client.0 _ll_register_callbacks cb 0x55ded445aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaa3dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaa3dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58554/0 (socket says 172.21.15.12:58554) 2024-09-19T06:51:00.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaa3dc640 1 -- 172.21.15.12:0/2107672603 learned_addr learned my addr 172.21.15.12:0/2107672603 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaa3dc640 1 -- 172.21.15.12:0/2107672603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 msgr2=0x55ded4579ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.449+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 0x55ded4579ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7faeaa3dc640 1 -- 172.21.15.12:0/2107672603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 msgr2=0x55ded457a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded457a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7faeaa3dc640 1 -- 172.21.15.12:0/2107672603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded42486a0 con 0x55ded4572480 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a0e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fae9c031550 tx=0x7fae9c0317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb697f1f28a26a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7fae89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7fae89ffb640 1 -- 172.21.15.12:0/2107672603 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c040070 con 0x55ded4572480 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7fae89ffb640 1 -- 172.21.15.12:0/2107672603 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fae9c004450 con 0x55ded4572480 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7faeaea19740 1 -- 172.21.15.12:0/2107672603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae98005500 con 0x55ded4572480 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7fae89ffb640 1 -- 172.21.15.12:0/2107672603 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fae9c035040 con 0x55ded4572480 2024-09-19T06:51:00.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7faeaea19740 10 client.18504 fetch_fsmap learned FSMap version 44 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7faeaea19740 1 -- 172.21.15.12:0/2107672603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55ded458b4a0 con 0x55ded4572480 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7fae89ffb640 1 -- 172.21.15.12:0/2107672603 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae98005500 con 0x55ded4572480 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7fae89ffb640 1 -- 172.21.15.12:0/2107672603 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fae9c004b40 con 0x55ded4572480 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7faeaea19740 10 client.18504 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7faeaea19740 10 client.18504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.450+0000 7faeaea19740 20 client.18504 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.451+0000 7faeaea19740 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ded458c960 0x55ded458eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.451+0000 7faeaea19740 4 client.18504 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.451+0000 7faeaea19740 1 -- 172.21.15.12:0/2107672603 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ded44e47f0 con 0x55ded458c960 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.451+0000 7faea9bdb640 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ded458c960 0x55ded458eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.451+0000 7faea9bdb640 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ded458c960 0x55ded458eda0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=536b891d2440d58c server_cookie=36eb21c8b2425abc in_seq=0 out_seq=0 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.451+0000 7fae89ffb640 10 client.18504 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7fae89ffb640 1 -- 172.21.15.12:0/2107672603 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ded44e47f0 con 0x55ded458c960 2024-09-19T06:51:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7fae89ffb640 10 client.18504 handle_command_reply: tid=0 2024-09-19T06:51:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7faeaea19740 1 client.18504 shutdown 2024-09-19T06:51:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7faeaea19740 1 -- 172.21.15.12:0/2107672603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 msgr2=0x55ded457a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7faeaea19740 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a0e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fae9c031550 tx=0x7fae9c0317e0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7faeaea19740 1 -- 172.21.15.12:0/2107672603 shutdown_connections 2024-09-19T06:51:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7faeaea19740 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ded458c960 0x55ded458eda0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7faeaea19740 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded457a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7faeaea19740 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a0e0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7faeaea19740 1 --2- 172.21.15.12:0/2107672603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 0x55ded4579ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7fae89ffb640 0 client.18504 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:00.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.452+0000 7faeaea19740 1 -- 172.21.15.12:0/2107672603 >> 172.21.15.12:0/2107672603 conn(0x55ded456e0f0 msgr2=0x55ded4573e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:00.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.453+0000 7faeaea19740 1 -- 172.21.15.12:0/2107672603 shutdown_connections 2024-09-19T06:51:00.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.453+0000 7faeaea19740 1 -- 172.21.15.12:0/2107672603 wait complete. 2024-09-19T06:51:00.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.453+0000 7faeaea19740 20 client.18504 trim_cache size 0 max 16384 2024-09-19T06:51:00.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.470+0000 7faeaea19740 1 Processor -- start 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.470+0000 7faeaea19740 1 -- start start 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaea19740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 0x55ded4578e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaea19740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaea19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded45850c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaea19740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faea41adb10 con 0x55ded4572480 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaea19740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faea41af650 con 0x55ded457cd40 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaea19740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faea41ae1e0 con 0x55ded4571b60 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaa3dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaa3dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58556/0 (socket says 172.21.15.12:58556) 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaa3dc640 1 -- 172.21.15.12:0/3731955975 learned_addr learned my addr 172.21.15.12:0/3731955975 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:00.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faea9bdb640 1 --2- 172.21.15.12:0/3731955975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 0x55ded4578e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faea9bdb640 1 --2- 172.21.15.12:0/3731955975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded45850c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaa3dc640 1 -- 172.21.15.12:0/3731955975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 msgr2=0x55ded4578e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:00.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/3731955975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 0x55ded4578e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaa3dc640 1 -- 172.21.15.12:0/3731955975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 msgr2=0x55ded45850c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:00.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/3731955975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded45850c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaa3dc640 1 -- 172.21.15.12:0/3731955975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded456df20 con 0x55ded4572480 2024-09-19T06:51:00.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.471+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/3731955975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a470 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fae9c003640 tx=0x7fae9c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d959275d76cc49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:00.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.472+0000 7fae8bfff640 1 -- 172.21.15.12:0/3731955975 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c040070 con 0x55ded4572480 2024-09-19T06:51:00.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.472+0000 7fae8bfff640 1 -- 172.21.15.12:0/3731955975 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae9c004450 con 0x55ded4572480 2024-09-19T06:51:00.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.472+0000 7fae8bfff640 1 -- 172.21.15.12:0/3731955975 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c004c20 con 0x55ded4572480 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 -- 172.21.15.12:0/3731955975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 msgr2=0x55ded457a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 --2- 172.21.15.12:0/3731955975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a470 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fae9c003640 tx=0x7fae9c02a420 comp rx=0 tx=0).stop 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 -- 172.21.15.12:0/3731955975 shutdown_connections 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 --2- 172.21.15.12:0/3731955975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded45850c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 --2- 172.21.15.12:0/3731955975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded457a470 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 --2- 172.21.15.12:0/3731955975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 0x55ded4578e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 -- 172.21.15.12:0/3731955975 >> 172.21.15.12:0/3731955975 conn(0x55ded456e0f0 msgr2=0x55ded457bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 -- 172.21.15.12:0/3731955975 shutdown_connections 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 -- 172.21.15.12:0/3731955975 wait complete. 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 -- start start 2024-09-19T06:51:00.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.473+0000 7faeaea19740 1 Processor -- start 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaea19740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 0x55ded4576010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaea19740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded4576550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaea19740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded4576af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaea19740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faea41aef80 con 0x55ded4572480 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaea19740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faea41ae8b0 con 0x55ded457cd40 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaea19740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faea41abb10 con 0x55ded4571b60 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaea19740 10 client.0 _ll_register_callbacks cb 0x7fae9c005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaa3dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded4576550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaa3dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded4576550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58562/0 (socket says 172.21.15.12:58562) 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaa3dc640 1 -- 172.21.15.12:0/1900808826 learned_addr learned my addr 172.21.15.12:0/1900808826 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faea9bdb640 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded4576af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaa3dc640 1 -- 172.21.15.12:0/1900808826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 msgr2=0x55ded4576010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:00.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 0x55ded4576010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaa3dc640 1 -- 172.21.15.12:0/1900808826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 msgr2=0x55ded4576af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded4576af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaa3dc640 1 -- 172.21.15.12:0/1900808826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded45749d0 con 0x55ded4572480 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faea9bdb640 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded4576af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7faeaa3dc640 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded4576550 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fae9c006010 tx=0x7fae9c004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3110ce7a4885148a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.474+0000 7fae89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7fae89ffb640 1 -- 172.21.15.12:0/1900808826 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c040070 con 0x55ded4572480 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7faeaea19740 1 -- 172.21.15.12:0/1900808826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae9c004450 con 0x55ded4572480 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7fae89ffb640 1 -- 172.21.15.12:0/1900808826 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fae9c004250 con 0x55ded4572480 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7fae89ffb640 1 -- 172.21.15.12:0/1900808826 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fae9c064050 con 0x55ded4572480 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7faeaea19740 10 client.18510 fetch_fsmap learned FSMap version 44 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7faeaea19740 1 -- 172.21.15.12:0/1900808826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55ded45fbce0 con 0x55ded4572480 2024-09-19T06:51:00.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7fae89ffb640 1 -- 172.21.15.12:0/1900808826 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae9c004450 con 0x55ded4572480 2024-09-19T06:51:00.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7fae89ffb640 1 -- 172.21.15.12:0/1900808826 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fae9c0604c0 con 0x55ded4572480 2024-09-19T06:51:00.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7faeaea19740 10 client.18510 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:51:00.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7faeaea19740 10 client.18510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:00.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7faeaea19740 20 client.18510 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:00.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7faeaea19740 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ded45fc330 0x55ded45fe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:00.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7faeaea19740 4 client.18510 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:51:00.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.475+0000 7faeaea19740 1 -- 172.21.15.12:0/1900808826 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ded44ded00 con 0x55ded45fc330 2024-09-19T06:51:00.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.476+0000 7faea9bdb640 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ded45fc330 0x55ded45fe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:00.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.476+0000 7faea9bdb640 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ded45fc330 0x55ded45fe790 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a796a81c899ac63 server_cookie=98e883e02eb468c9 in_seq=0 out_seq=0 2024-09-19T06:51:00.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.476+0000 7fae89ffb640 10 client.18510 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:00.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.477+0000 7fae89ffb640 1 -- 172.21.15.12:0/1900808826 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ded44ded00 con 0x55ded45fc330 2024-09-19T06:51:00.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.477+0000 7fae89ffb640 10 client.18510 handle_command_reply: tid=0 2024-09-19T06:51:00.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.477+0000 7faeaea19740 1 client.18510 shutdown 2024-09-19T06:51:00.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 1 -- 172.21.15.12:0/1900808826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 msgr2=0x55ded4576550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded4576550 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fae9c006010 tx=0x7fae9c004e00 comp rx=0 tx=0).stop 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 1 -- 172.21.15.12:0/1900808826 shutdown_connections 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55ded45fc330 0x55ded45fe790 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ded457cd40 0x55ded4576af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ded4572480 0x55ded4576550 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7fae89ffb640 0 client.18510 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 1 --2- 172.21.15.12:0/1900808826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ded4571b60 0x55ded4576010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 1 -- 172.21.15.12:0/1900808826 >> 172.21.15.12:0/1900808826 conn(0x55ded456e0f0 msgr2=0x55ded45735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 1 -- 172.21.15.12:0/1900808826 shutdown_connections 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 1 -- 172.21.15.12:0/1900808826 wait complete. 2024-09-19T06:51:00.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.478+0000 7faeaea19740 20 client.18510 trim_cache size 0 max 16384 2024-09-19T06:51:00.483 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:51:00.483 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:51:00.483 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "05c1337d-66fa-4c3e-a31b-1f32ffefeb11", 2024-09-19T06:51:00.483 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:51:00.483 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:51:00.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 -- 172.21.15.12:0/3110372832 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae8c0a33b0 msgr2=0x7fae8c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:00.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae8c0a33b0 0x7fae8c0a5870 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae940ce160 tx=0x7fae9406e470 comp rx=0 tx=0).stop 2024-09-19T06:51:00.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 -- 172.21.15.12:0/3110372832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faea41082a0 msgr2=0x7faea419cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:00.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faea41082a0 0x7faea419cd90 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fae9400cce0 tx=0x7fae9400a620 comp rx=0 tx=0).stop 2024-09-19T06:51:00.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 -- 172.21.15.12:0/3110372832 shutdown_connections 2024-09-19T06:51:00.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faea41082a0 0x7faea419cd90 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fae8c0a33b0 0x7fae8c0a5870 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea41036e0 0x7faea4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 --2- 172.21.15.12:0/3110372832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faea4102d30 0x7faea41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:00.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 -- 172.21.15.12:0/3110372832 >> 172.21.15.12:0/3110372832 conn(0x7faea40fc7d0 msgr2=0x7faea4105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:00.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 -- 172.21.15.12:0/3110372832 shutdown_connections 2024-09-19T06:51:00.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:00.479+0000 7faeac640640 1 -- 172.21.15.12:0/3110372832 wait complete. 2024-09-19T06:51:00.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:51:01.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:00 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.269 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:51:01.269 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.269 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:01.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:01.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:01.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:01.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:01.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:01.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.270 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:00 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:51:01.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:51:01.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:01.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:01.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:01.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:01.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:01.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:01.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:00 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:01.560 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.032+0000 7fddd8d45640 1 -- 172.21.15.12:0/1902746233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd4103660 msgr2=0x7fddd410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:02.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.032+0000 7fddd8d45640 1 --2- 172.21.15.12:0/1902746233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd4103660 0x7fddd410bb50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009900 tx=0x7fddc802a480 comp rx=0 tx=0).stop 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.032+0000 7fddd8d45640 1 -- 172.21.15.12:0/1902746233 shutdown_connections 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.032+0000 7fddd8d45640 1 --2- 172.21.15.12:0/1902746233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd410c170 0x7fddd410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.032+0000 7fddd8d45640 1 --2- 172.21.15.12:0/1902746233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd4103660 0x7fddd410bb50 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.032+0000 7fddd8d45640 1 --2- 172.21.15.12:0/1902746233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd4102d40 0x7fddd4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.032+0000 7fddd8d45640 1 -- 172.21.15.12:0/1902746233 >> 172.21.15.12:0/1902746233 conn(0x7fddd40fc7a0 msgr2=0x7fddd40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.032+0000 7fddd8d45640 1 -- 172.21.15.12:0/1902746233 shutdown_connections 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.032+0000 7fddd8d45640 1 -- 172.21.15.12:0/1902746233 wait complete. 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.033+0000 7fddd8d45640 1 Processor -- start 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.033+0000 7fddd8d45640 1 -- start start 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd8d45640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4102d40 0x7fddd4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd8d45640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd4103660 0x7fddd41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd8d45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd410c170 0x7fddd419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd8d45640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4111f70 con 0x7fddd4103660 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd8d45640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4111df0 con 0x7fddd410c170 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd8d45640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41120f0 con 0x7fddd4102d40 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd4103660 0x7fddd41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd4103660 0x7fddd41989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58574/0 (socket says 172.21.15.12:58574) 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd1d9b640 1 -- 172.21.15.12:0/2839941880 learned_addr learned my addr 172.21.15.12:0/2839941880 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd259c640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4102d40 0x7fddd4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd2d9d640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd410c170 0x7fddd419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd1d9b640 1 -- 172.21.15.12:0/2839941880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4102d40 msgr2=0x7fddd4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4102d40 0x7fddd4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd1d9b640 1 -- 172.21.15.12:0/2839941880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd410c170 msgr2=0x7fddd419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:02.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd410c170 0x7fddd419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd1d9b640 1 -- 172.21.15.12:0/2839941880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd419d420 con 0x7fddd4103660 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd2d9d640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd410c170 0x7fddd419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd4103660 0x7fddd41989b0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fddc8006010 tx=0x7fddc80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddc37fe640 1 -- 172.21.15.12:0/2839941880 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc803f030 con 0x7fddd4103660 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddc37fe640 1 -- 172.21.15.12:0/2839941880 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddc8003ce0 con 0x7fddd4103660 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd8d45640 1 -- 172.21.15.12:0/2839941880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd419d6b0 con 0x7fddd4103660 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddc37fe640 1 -- 172.21.15.12:0/2839941880 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8035070 con 0x7fddd4103660 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.034+0000 7fddd8d45640 1 -- 172.21.15.12:0/2839941880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd41a4ff0 con 0x7fddd4103660 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.037+0000 7fddc37fe640 1 -- 172.21.15.12:0/2839941880 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fddc8042030 con 0x7fddd4103660 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.037+0000 7fdddb11e740 1 Processor -- start 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.037+0000 7fdddb11e740 1 -- start start 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabe380 0x5596bdabe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdacd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdacfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fdddb11e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5596bda242e0 con 0x5596bdabeca0 2024-09-19T06:51:02.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fdddb11e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5596bd9cbce0 con 0x5596bdabe380 2024-09-19T06:51:02.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fdddb11e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5596bda202a0 con 0x5596bdacda90 2024-09-19T06:51:02.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdacd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.511 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:01 smithi173 ceph-mon[35349]: pgmap v337: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.9 MiB/s wr, 445 op/s 2024-09-19T06:51:02.511 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:01 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:02.511 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:01 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:02.511 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:02.511 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:02.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:02.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:01 smithi016 ceph-mon[34911]: pgmap v337: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.9 MiB/s wr, 445 op/s 2024-09-19T06:51:02.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:01 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:02.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:01 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:02.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:02.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:02.512 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:02.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdacd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58586/0 (socket says 172.21.15.12:58586) 2024-09-19T06:51:02.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd259c640 1 -- 172.21.15.12:0/3254853591 learned_addr learned my addr 172.21.15.12:0/3254853591 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddc37fe640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddbc0a3430 0x7fddbc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/3254853591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdacfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd2d9d640 1 --2- 172.21.15.12:0/3254853591 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabe380 0x5596bdabe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd2d9d640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddbc0a3430 0x7fddbc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd259c640 1 -- 172.21.15.12:0/3254853591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 msgr2=0x5596bdacfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd259c640 1 --2- 172.21.15.12:0/3254853591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdacfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd259c640 1 -- 172.21.15.12:0/3254853591 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabe380 msgr2=0x5596bdabe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd259c640 1 --2- 172.21.15.12:0/3254853591 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabe380 0x5596bdabe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd259c640 1 -- 172.21.15.12:0/3254853591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596bd9b0440 con 0x5596bdabeca0 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/3254853591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdacfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddc37fe640 1 -- 172.21.15.12:0/2839941880 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fddc80f0380 con 0x7fddd4103660 2024-09-19T06:51:02.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.038+0000 7fddd259c640 1 --2- 172.21.15.12:0/3254853591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdacd550 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fddc400bcd0 tx=0x7fddc40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe66ce7e2590518 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fddd2d9d640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddbc0a3430 0x7fddbc0a58f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fddcc005c40 tx=0x7fddcc009200 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fddc0ff9640 1 -- 172.21.15.12:0/3254853591 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4005220 con 0x5596bdabeca0 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fddc0ff9640 1 -- 172.21.15.12:0/3254853591 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddc4004c80 con 0x5596bdabeca0 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fddc0ff9640 1 -- 172.21.15.12:0/3254853591 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40117a0 con 0x5596bdabeca0 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fdddb11e740 1 -- 172.21.15.12:0/3254853591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 msgr2=0x5596bdacd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fdddb11e740 1 --2- 172.21.15.12:0/3254853591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdacd550 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fddc400bcd0 tx=0x7fddc40107a0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fdddb11e740 1 -- 172.21.15.12:0/3254853591 shutdown_connections 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fdddb11e740 1 --2- 172.21.15.12:0/3254853591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdacfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fdddb11e740 1 --2- 172.21.15.12:0/3254853591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdacd550 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fdddb11e740 1 --2- 172.21.15.12:0/3254853591 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabe380 0x5596bdabe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.039+0000 7fdddb11e740 1 -- 172.21.15.12:0/3254853591 >> 172.21.15.12:0/3254853591 conn(0x5596bdabaa30 msgr2=0x5596bdabae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 1 -- 172.21.15.12:0/3254853591 shutdown_connections 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 1 -- 172.21.15.12:0/3254853591 wait complete. 2024-09-19T06:51:02.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 1 -- start start 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 1 Processor -- start 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdacd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 0x5596bdaca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdacad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5596bdad0660 con 0x5596bdabe380 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5596bd9df050 con 0x5596bdabeca0 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5596bdad07e0 con 0x5596bdacda90 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fdddb11e740 10 client.0 _ll_register_callbacks cb 0x5596bda1f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fddd259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdacd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fddd259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdacd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58600/0 (socket says 172.21.15.12:58600) 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fddd259c640 1 -- 172.21.15.12:0/4008578833 learned_addr learned my addr 172.21.15.12:0/4008578833 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:02.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.040+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 0x5596bdaca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddd2d9d640 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdacad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddd259c640 1 -- 172.21.15.12:0/4008578833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 msgr2=0x5596bdacad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddd259c640 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdacad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddd259c640 1 -- 172.21.15.12:0/4008578833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 msgr2=0x5596bdaca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddd259c640 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 0x5596bdaca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddd259c640 1 -- 172.21.15.12:0/4008578833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596bd7953c0 con 0x5596bdabe380 2024-09-19T06:51:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddd259c640 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdacd400 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fddc4011010 tx=0x7fddc40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac52befc27a8e6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddb9ffb640 1 -- 172.21.15.12:0/4008578833 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4004ae0 con 0x5596bdabe380 2024-09-19T06:51:02.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddb9ffb640 1 -- 172.21.15.12:0/4008578833 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fddc4005040 con 0x5596bdabe380 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fdddb11e740 1 -- 172.21.15.12:0/4008578833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc4004c80 con 0x5596bdabe380 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddb9ffb640 1 -- 172.21.15.12:0/4008578833 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fddc400be80 con 0x5596bdabe380 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fdddb11e740 10 client.18522 fetch_fsmap learned FSMap version 44 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fdddb11e740 1 -- 172.21.15.12:0/4008578833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5596bdadc0b0 con 0x5596bdabe380 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddb9ffb640 1 -- 172.21.15.12:0/4008578833 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddc4004c80 con 0x5596bdabe380 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.041+0000 7fddb9ffb640 1 -- 172.21.15.12:0/4008578833 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fddc4003ae0 con 0x5596bdabe380 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.042+0000 7fdddb11e740 10 client.18522 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.042+0000 7fdddb11e740 10 client.18522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.042+0000 7fdddb11e740 20 client.18522 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.042+0000 7fdddb11e740 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5596bdadd510 0x5596bdadf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.042+0000 7fdddb11e740 4 client.18522 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:02.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.042+0000 7fdddb11e740 1 -- 172.21.15.12:0/4008578833 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596bda31850 con 0x5596bdadd510 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.042+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5596bdadd510 0x5596bdadf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.042+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5596bdadd510 0x5596bdadf900 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73fb38fd14c9af58 server_cookie=fc75e00c4bbcfe36 in_seq=0 out_seq=0 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.042+0000 7fddb9ffb640 10 client.18522 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fddb9ffb640 1 -- 172.21.15.12:0/4008578833 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596bda31850 con 0x5596bdadd510 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fddb9ffb640 10 client.18522 handle_command_reply: tid=0 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 client.18522 shutdown 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 -- 172.21.15.12:0/4008578833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 msgr2=0x5596bdacd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdacd400 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fddc4011010 tx=0x7fddc40048f0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 -- 172.21.15.12:0/4008578833 shutdown_connections 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5596bdadd510 0x5596bdadf900 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdacad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 0x5596bdaca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 --2- 172.21.15.12:0/4008578833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdacd400 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fddb9ffb640 0 client.18522 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 -- 172.21.15.12:0/4008578833 >> 172.21.15.12:0/4008578833 conn(0x5596bdabaa30 msgr2=0x5596bdac0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 -- 172.21.15.12:0/4008578833 shutdown_connections 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 1 -- 172.21.15.12:0/4008578833 wait complete. 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.043+0000 7fdddb11e740 20 client.18522 trim_cache size 0 max 16384 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fdddb11e740 1 Processor -- start 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fdddb11e740 1 -- start start 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdab9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 0x5596bdac9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdae4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fdddb11e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ab9b0 con 0x5596bdabe380 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fdddb11e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ad4f0 con 0x5596bdabeca0 2024-09-19T06:51:02.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fdddb11e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ac080 con 0x5596bdacda90 2024-09-19T06:51:02.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdab9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdab9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58616/0 (socket says 172.21.15.12:58616) 2024-09-19T06:51:02.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd259c640 1 -- 172.21.15.12:0/2832692988 learned_addr learned my addr 172.21.15.12:0/2832692988 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:02.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd2d9d640 1 --2- 172.21.15.12:0/2832692988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdae4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/2832692988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 0x5596bdac9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd259c640 1 -- 172.21.15.12:0/2832692988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 msgr2=0x5596bdae4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:02.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd259c640 1 --2- 172.21.15.12:0/2832692988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdae4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd259c640 1 -- 172.21.15.12:0/2832692988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 msgr2=0x5596bdac9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:02.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd259c640 1 --2- 172.21.15.12:0/2832692988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 0x5596bdac9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd259c640 1 -- 172.21.15.12:0/2832692988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596bdac8c50 con 0x5596bdabe380 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.061+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/2832692988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 0x5596bdac9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fddd259c640 1 --2- 172.21.15.12:0/2832692988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdab9e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fddc400bbf0 tx=0x7fddc40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72cc73cece5e24d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fddbbfff640 1 -- 172.21.15.12:0/2832692988 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4005850 con 0x5596bdabe380 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fddbbfff640 1 -- 172.21.15.12:0/2832692988 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddc400b810 con 0x5596bdabe380 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fddbbfff640 1 -- 172.21.15.12:0/2832692988 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4004000 con 0x5596bdabe380 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fdddb11e740 1 -- 172.21.15.12:0/2832692988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 msgr2=0x5596bdab9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fdddb11e740 1 --2- 172.21.15.12:0/2832692988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdab9e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fddc400bbf0 tx=0x7fddc40107a0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fdddb11e740 1 -- 172.21.15.12:0/2832692988 shutdown_connections 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fdddb11e740 1 --2- 172.21.15.12:0/2832692988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdacda90 0x5596bdae4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fdddb11e740 1 --2- 172.21.15.12:0/2832692988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdabeca0 0x5596bdac9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fdddb11e740 1 --2- 172.21.15.12:0/2832692988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabe380 0x5596bdab9e20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.062+0000 7fdddb11e740 1 -- 172.21.15.12:0/2832692988 >> 172.21.15.12:0/2832692988 conn(0x5596bdabaa30 msgr2=0x5596bdac06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 1 -- 172.21.15.12:0/2832692988 shutdown_connections 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 1 -- 172.21.15.12:0/2832692988 wait complete. 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 1 -- start start 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 1 Processor -- start 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdabe380 0x5596bdad1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdad1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdacda90 0x5596bdad2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ace20 con 0x5596bdabeca0 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ac750 con 0x5596bdacda90 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41a99b0 con 0x5596bdabe380 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fdddb11e740 10 client.0 _ll_register_callbacks cb 0x7fddc400bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fddd1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdad1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fddd1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdad1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58622/0 (socket says 172.21.15.12:58622) 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fddd1d9b640 1 -- 172.21.15.12:0/2837466225 learned_addr learned my addr 172.21.15.12:0/2837466225 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fddd259c640 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdabe380 0x5596bdad1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.063+0000 7fddd2d9d640 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdacda90 0x5596bdad2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddd1d9b640 1 -- 172.21.15.12:0/2837466225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdabe380 msgr2=0x5596bdad1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdabe380 0x5596bdad1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddd1d9b640 1 -- 172.21.15.12:0/2837466225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdacda90 msgr2=0x5596bdad2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdacda90 0x5596bdad2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddd1d9b640 1 -- 172.21.15.12:0/2837466225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596bdb46f00 con 0x5596bdabeca0 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddd259c640 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdabe380 0x5596bdad1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddd1d9b640 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdad1c50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fddc80bc5b0 tx=0x7fddc8031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c304516794f2ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddb9ffb640 1 -- 172.21.15.12:0/2837466225 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8049040 con 0x5596bdabeca0 2024-09-19T06:51:02.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddb9ffb640 1 -- 172.21.15.12:0/2837466225 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7fddc80edc50 con 0x5596bdabeca0 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fdddb11e740 1 -- 172.21.15.12:0/2837466225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc400b810 con 0x5596bdabeca0 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddb9ffb640 1 -- 172.21.15.12:0/2837466225 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fddc80bc160 con 0x5596bdabeca0 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fdddb11e740 10 client.18528 fetch_fsmap learned FSMap version 44 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fdddb11e740 1 -- 172.21.15.12:0/2837466225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5596bdb480f0 con 0x5596bdabeca0 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.064+0000 7fddb9ffb640 1 -- 172.21.15.12:0/2837466225 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddc400b810 con 0x5596bdabeca0 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fddb9ffb640 1 -- 172.21.15.12:0/2837466225 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7fddc80c4e00 con 0x5596bdabeca0 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fdddb11e740 10 client.18528 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fdddb11e740 10 client.18528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fdddb11e740 20 client.18528 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fdddb11e740 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5596bdb48870 0x5596bdb4ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fdddb11e740 4 client.18528 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fdddb11e740 1 -- 172.21.15.12:0/2837466225 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5596bda2bd60 con 0x5596bdb48870 2024-09-19T06:51:02.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fddd259c640 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5596bdb48870 0x5596bdb4ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fddd259c640 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5596bdb48870 0x5596bdb4ac90 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=466c1cedae0f75b server_cookie=de17b4bad459635b in_seq=0 out_seq=0 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fddb9ffb640 10 client.18528 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fddb9ffb640 1 -- 172.21.15.12:0/2837466225 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5596bda2bd60 con 0x5596bdb48870 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fddb9ffb640 10 client.18528 handle_command_reply: tid=0 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.065+0000 7fdddb11e740 1 client.18528 shutdown 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 1 -- 172.21.15.12:0/2837466225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 msgr2=0x5596bdad1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdad1c50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fddc80bc5b0 tx=0x7fddc8031a60 comp rx=0 tx=0).stop 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 1 -- 172.21.15.12:0/2837466225 shutdown_connections 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5596bdb48870 0x5596bdb4ac90 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5596bdacda90 0x5596bdad2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5596bdabeca0 0x5596bdad1c50 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 1 --2- 172.21.15.12:0/2837466225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5596bdabe380 0x5596bdad1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 1 -- 172.21.15.12:0/2837466225 >> 172.21.15.12:0/2837466225 conn(0x5596bdabaa30 msgr2=0x5596bdabfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fddb9ffb640 0 client.18528 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 1 -- 172.21.15.12:0/2837466225 shutdown_connections 2024-09-19T06:51:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 1 -- 172.21.15.12:0/2837466225 wait complete. 2024-09-19T06:51:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fdddb11e740 20 client.18528 trim_cache size 0 max 16384 2024-09-19T06:51:02.531 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:51:02.531 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:51:02.531 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:51:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: "05c1337d-66fa-4c3e-a31b-1f32ffefeb11": { 2024-09-19T06:51:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:51:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "05c1337d-66fa-4c3e-a31b-1f32ffefeb11", 2024-09-19T06:51:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:51:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:51:02.532 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:51:02.532 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fddd8d45640 1 -- 172.21.15.12:0/2839941880 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddbc0a3430 msgr2=0x7fddbc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fddd8d45640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddbc0a3430 0x7fddbc0a58f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fddcc005c40 tx=0x7fddcc009200 comp rx=0 tx=0).stop 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fddd8d45640 1 -- 172.21.15.12:0/2839941880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd4103660 msgr2=0x7fddd41989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.066+0000 7fddd8d45640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd4103660 0x7fddd41989b0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fddc8006010 tx=0x7fddc80042f0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.067+0000 7fddd8d45640 1 -- 172.21.15.12:0/2839941880 shutdown_connections 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.067+0000 7fddd8d45640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd410c170 0x7fddd419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.067+0000 7fddd8d45640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd4103660 0x7fddd41989b0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.067+0000 7fddd8d45640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddbc0a3430 0x7fddbc0a58f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.067+0000 7fddd8d45640 1 --2- 172.21.15.12:0/2839941880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4102d40 0x7fddd4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.067+0000 7fddd8d45640 1 -- 172.21.15.12:0/2839941880 >> 172.21.15.12:0/2839941880 conn(0x7fddd40fc7a0 msgr2=0x7fddd40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.067+0000 7fddd8d45640 1 -- 172.21.15.12:0/2839941880 shutdown_connections 2024-09-19T06:51:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:02.067+0000 7fddd8d45640 1 -- 172.21.15.12:0/2839941880 wait complete. 2024-09-19T06:51:02.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:01 smithi012 ceph-mon[30937]: pgmap v337: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.9 MiB/s wr, 445 op/s 2024-09-19T06:51:02.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:01 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:02.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:01 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:02.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:02.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:02.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:02.783 INFO:tasks.cephfs.filesystem:scrub status for tag:05c1337d-66fa-4c3e-a31b-1f32ffefeb11 - {'path': '/', 'tag': '05c1337d-66fa-4c3e-a31b-1f32ffefeb11', 'options': 'recursive,force'} 2024-09-19T06:51:03.129 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:51:03.393 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:03.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.854+0000 7f352d487640 1 -- 172.21.15.12:0/4081888446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35281082a0 msgr2=0x7f352810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:03.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.854+0000 7f352d487640 1 --2- 172.21.15.12:0/4081888446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35281082a0 0x7f352810ec40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3520009cd0 tx=0x7f352002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:51:03.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.854+0000 7f352d487640 1 -- 172.21.15.12:0/4081888446 shutdown_connections 2024-09-19T06:51:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.854+0000 7f352d487640 1 --2- 172.21.15.12:0/4081888446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35281082a0 0x7f352810ec40 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.854+0000 7f352d487640 1 --2- 172.21.15.12:0/4081888446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35281036e0 0x7f3528107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.854+0000 7f352d487640 1 --2- 172.21.15.12:0/4081888446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3528102d30 0x7f3528103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.854+0000 7f352d487640 1 -- 172.21.15.12:0/4081888446 >> 172.21.15.12:0/4081888446 conn(0x7f35280fc7d0 msgr2=0x7f35280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.854+0000 7f352d487640 1 -- 172.21.15.12:0/4081888446 shutdown_connections 2024-09-19T06:51:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.854+0000 7f352d487640 1 -- 172.21.15.12:0/4081888446 wait complete. 2024-09-19T06:51:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.854+0000 7f352d487640 1 Processor -- start 2024-09-19T06:51:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f352d487640 1 -- start start 2024-09-19T06:51:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f352d487640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3528102d30 0x7f3528100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:03.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f352d487640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35281036e0 0x7f3528100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f352d487640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35281082a0 0x7f3528101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f352d487640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f35281120a0 con 0x7f3528102d30 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f352d487640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3528111f20 con 0x7f35281036e0 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f352d487640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3528112220 con 0x7f35281082a0 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f3526ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3528102d30 0x7f3528100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f3526ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3528102d30 0x7f3528100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58640/0 (socket says 172.21.15.12:58640) 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f3526ffd640 1 -- 172.21.15.12:0/771313673 learned_addr learned my addr 172.21.15.12:0/771313673 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f35277fe640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35281082a0 0x7f3528101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f35267fc640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35281036e0 0x7f3528100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f3526ffd640 1 -- 172.21.15.12:0/771313673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35281082a0 msgr2=0x7f3528101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:03.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f3526ffd640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35281082a0 0x7f3528101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f3526ffd640 1 -- 172.21.15.12:0/771313673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35281036e0 msgr2=0x7f3528100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f3526ffd640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35281036e0 0x7f3528100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f3526ffd640 1 -- 172.21.15.12:0/771313673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35281a69c0 con 0x7f3528102d30 2024-09-19T06:51:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f35277fe640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35281082a0 0x7f3528101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.855+0000 7f35267fc640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35281036e0 0x7f3528100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.856+0000 7f3526ffd640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3528102d30 0x7f3528100990 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f351800c920 tx=0x7f351800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.856+0000 7f350ffff640 1 -- 172.21.15.12:0/771313673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3518007c70 con 0x7f3528102d30 2024-09-19T06:51:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.856+0000 7f350ffff640 1 -- 172.21.15.12:0/771313673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3518007e10 con 0x7f3528102d30 2024-09-19T06:51:03.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.856+0000 7f352d487640 1 -- 172.21.15.12:0/771313673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35281a6cb0 con 0x7f3528102d30 2024-09-19T06:51:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.856+0000 7f350ffff640 1 -- 172.21.15.12:0/771313673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3518018890 con 0x7f3528102d30 2024-09-19T06:51:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.856+0000 7f352d487640 1 -- 172.21.15.12:0/771313673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35281a71a0 con 0x7f3528102d30 2024-09-19T06:51:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.857+0000 7f352d487640 1 -- 172.21.15.12:0/771313673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3528103110 con 0x7f3528102d30 2024-09-19T06:51:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.858+0000 7f350ffff640 1 -- 172.21.15.12:0/771313673 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3518018a50 con 0x7f3528102d30 2024-09-19T06:51:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.859+0000 7f350ffff640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35100a33b0 0x7f35100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.859+0000 7f350ffff640 1 -- 172.21.15.12:0/771313673 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8687+0+0 (secure 0 0 0) 0x7f35180d01f0 con 0x7f3528102d30 2024-09-19T06:51:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.859+0000 7f35267fc640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35100a33b0 0x7f35100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.860+0000 7f35267fc640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35100a33b0 0x7f35100a5870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f351c005fd0 tx=0x7f351c0094d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:03.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:03.862+0000 7f350ffff640 1 -- 172.21.15.12:0/771313673 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3518014030 con 0x7f3528102d30 2024-09-19T06:51:04.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:03 smithi012 ceph-mon[30937]: pgmap v338: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 439 op/s 2024-09-19T06:51:04.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.189+0000 7f352d487640 1 -- 172.21.15.12:0/771313673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3528101ec0 con 0x7f3528102d30 2024-09-19T06:51:04.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.190+0000 7f350ffff640 1 -- 172.21.15.12:0/771313673 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11971 (secure 0 0 0) 0x7f3528101ec0 con 0x7f3528102d30 2024-09-19T06:51:04.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:51:04.193 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"btime":"2024-09-19T06:48:35:302779+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:48:34.412947+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:51:04.194 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 44 2024-09-19T06:51:04.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.194+0000 7f352d487640 1 -- 172.21.15.12:0/771313673 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35100a33b0 msgr2=0x7f35100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.194+0000 7f352d487640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35100a33b0 0x7f35100a5870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f351c005fd0 tx=0x7f351c0094d0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.194+0000 7f352d487640 1 -- 172.21.15.12:0/771313673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3528102d30 msgr2=0x7f3528100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.194+0000 7f352d487640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3528102d30 0x7f3528100990 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f351800c920 tx=0x7f351800cde0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.195+0000 7f352d487640 1 -- 172.21.15.12:0/771313673 shutdown_connections 2024-09-19T06:51:04.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.195+0000 7f352d487640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35100a33b0 0x7f35100a5870 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.195+0000 7f352d487640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35281082a0 0x7f3528101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.195+0000 7f352d487640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35281036e0 0x7f3528100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.195+0000 7f352d487640 1 --2- 172.21.15.12:0/771313673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3528102d30 0x7f3528100990 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.195+0000 7f352d487640 1 -- 172.21.15.12:0/771313673 >> 172.21.15.12:0/771313673 conn(0x7f35280fc7d0 msgr2=0x7f35280fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:04.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.195+0000 7f352d487640 1 -- 172.21.15.12:0/771313673 shutdown_connections 2024-09-19T06:51:04.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:04.195+0000 7f352d487640 1 -- 172.21.15.12:0/771313673 wait complete. 2024-09-19T06:51:04.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:03 smithi016 ceph-mon[34911]: pgmap v338: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 439 op/s 2024-09-19T06:51:04.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:03 smithi173 ceph-mon[35349]: pgmap v338: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 439 op/s 2024-09-19T06:51:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.449+0000 7f558709b640 1 -- 172.21.15.12:0/1668033877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5580102c80 msgr2=0x7f5580103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.449+0000 7f558709b640 1 --2- 172.21.15.12:0/1668033877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5580102c80 0x7f5580103060 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f5574009900 tx=0x7f557402a480 comp rx=0 tx=0).stop 2024-09-19T06:51:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.449+0000 7f558709b640 1 -- 172.21.15.12:0/1668033877 shutdown_connections 2024-09-19T06:51:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.449+0000 7f558709b640 1 --2- 172.21.15.12:0/1668033877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f558010c0d0 0x7f558010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.449+0000 7f558709b640 1 --2- 172.21.15.12:0/1668033877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55801035a0 0x7f558010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.449+0000 7f558709b640 1 --2- 172.21.15.12:0/1668033877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5580102c80 0x7f5580103060 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.449+0000 7f558709b640 1 -- 172.21.15.12:0/1668033877 >> 172.21.15.12:0/1668033877 conn(0x7f5580077990 msgr2=0x7f55800fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.449+0000 7f558709b640 1 -- 172.21.15.12:0/1668033877 shutdown_connections 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.449+0000 7f558709b640 1 -- 172.21.15.12:0/1668033877 wait complete. 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.449+0000 7f558709b640 1 Processor -- start 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f558709b640 1 -- start start 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f558709b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5580102c80 0x7f5580198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f558709b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55801035a0 0x7f5580198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f558709b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f558010c0d0 0x7f558019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f558709b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5580111f00 con 0x7f55801035a0 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f558709b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5580111d80 con 0x7f5580102c80 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f558709b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5580112080 con 0x7f558010c0d0 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f557ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55801035a0 0x7f5580198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f557ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55801035a0 0x7f5580198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58660/0 (socket says 172.21.15.12:58660) 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f557ffff640 1 -- 172.21.15.12:0/3760580779 learned_addr learned my addr 172.21.15.12:0/3760580779 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f5584e37640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5580102c80 0x7f5580198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f5585638640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f558010c0d0 0x7f558019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f557ffff640 1 -- 172.21.15.12:0/3760580779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f558010c0d0 msgr2=0x7f558019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f557ffff640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f558010c0d0 0x7f558019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f557ffff640 1 -- 172.21.15.12:0/3760580779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5580102c80 msgr2=0x7f5580198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f557ffff640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5580102c80 0x7f5580198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f557ffff640 1 -- 172.21.15.12:0/3760580779 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558019d300 con 0x7f55801035a0 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.450+0000 7f557ffff640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55801035a0 0x7f5580198850 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f556c00c970 tx=0x7f556c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.451+0000 7f557dffb640 1 -- 172.21.15.12:0/3760580779 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c007bb0 con 0x7f55801035a0 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.451+0000 7f558709b640 1 -- 172.21.15.12:0/3760580779 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558019d5f0 con 0x7f55801035a0 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.451+0000 7f557dffb640 1 -- 172.21.15.12:0/3760580779 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f556c007d50 con 0x7f55801035a0 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.451+0000 7f557dffb640 1 -- 172.21.15.12:0/3760580779 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c018820 con 0x7f55801035a0 2024-09-19T06:51:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.451+0000 7f558709b640 1 -- 172.21.15.12:0/3760580779 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55801a4e80 con 0x7f55801035a0 2024-09-19T06:51:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.453+0000 7f557dffb640 1 -- 172.21.15.12:0/3760580779 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f556c0189c0 con 0x7f55801035a0 2024-09-19T06:51:04.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.453+0000 7f5589e32740 1 Processor -- start 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5589e32740 1 -- start start 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5589e32740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 0x55eee26eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5589e32740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee26f9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5589e32740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5589e32740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eee26532f0 con 0x55eee26f9cb0 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5589e32740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55eee25fb270 con 0x55eee26eeaf0 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5589e32740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eee264f2b0 con 0x55eee26ef410 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f557ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5584e37640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee26f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f557ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26fc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58664/0 (socket says 172.21.15.12:58664) 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f557ffff640 1 -- 172.21.15.12:0/1275976658 learned_addr learned my addr 172.21.15.12:0/1275976658 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5585638640 1 --2- 172.21.15.12:0/1275976658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 0x55eee26eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f557dffb640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55700a3460 0x7f55700a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5584e37640 1 -- 172.21.15.12:0/1275976658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 msgr2=0x55eee26eeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5584e37640 1 --2- 172.21.15.12:0/1275976658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 0x55eee26eeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5584e37640 1 -- 172.21.15.12:0/1275976658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 msgr2=0x55eee26fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5584e37640 1 --2- 172.21.15.12:0/1275976658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5585638640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55700a3460 0x7f55700a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f5584e37640 1 -- 172.21.15.12:0/1275976658 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eee25fa340 con 0x55eee26ef410 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.454+0000 7f557dffb640 1 -- 172.21.15.12:0/3760580779 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8731+0+0 (secure 0 0 0) 0x7f556c0cfe80 con 0x7f55801035a0 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.455+0000 7f5584e37640 1 --2- 172.21.15.12:0/1275976658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee26f9770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f557402aa70 tx=0x7f55740040f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=433a74d4d8afce7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.455+0000 7f5585638640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55700a3460 0x7f55700a5920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f55780094d0 tx=0x7f5578004ab0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.455+0000 7f556affd640 1 -- 172.21.15.12:0/1275976658 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5574035040 con 0x55eee26ef410 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.455+0000 7f556affd640 1 -- 172.21.15.12:0/1275976658 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5574005520 con 0x55eee26ef410 2024-09-19T06:51:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.455+0000 7f556affd640 1 -- 172.21.15.12:0/1275976658 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55740037f0 con 0x55eee26ef410 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.455+0000 7f5589e32740 1 -- 172.21.15.12:0/1275976658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 msgr2=0x55eee26f9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.455+0000 7f5589e32740 1 --2- 172.21.15.12:0/1275976658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee26f9770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f557402aa70 tx=0x7f55740040f0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 -- 172.21.15.12:0/1275976658 shutdown_connections 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 --2- 172.21.15.12:0/1275976658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 --2- 172.21.15.12:0/1275976658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee26f9770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 --2- 172.21.15.12:0/1275976658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 0x55eee26eeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 -- 172.21.15.12:0/1275976658 >> 172.21.15.12:0/1275976658 conn(0x55eee26eb060 msgr2=0x55eee26eb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 -- 172.21.15.12:0/1275976658 shutdown_connections 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 -- 172.21.15.12:0/1275976658 wait complete. 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 -- start start 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 Processor -- start 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26eeaf0 0x55eee26f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee26f7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26f9cb0 0x55eee26f7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eee26fc880 con 0x55eee26eeaf0 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55eee25dc290 con 0x55eee26f9cb0 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eee26fca00 con 0x55eee26ef410 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5589e32740 10 client.0 _ll_register_callbacks cb 0x55eee260d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.456+0000 7f5584e37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26eeaf0 0x55eee26f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5584e37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26eeaf0 0x55eee26f6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58674/0 (socket says 172.21.15.12:58674) 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5584e37640 1 -- 172.21.15.12:0/3492519085 learned_addr learned my addr 172.21.15.12:0/3492519085 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f557ffff640 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee26f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5585638640 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26f9cb0 0x55eee26f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5584e37640 1 -- 172.21.15.12:0/3492519085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 msgr2=0x55eee26f7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5584e37640 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee26f7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5584e37640 1 -- 172.21.15.12:0/3492519085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26f9cb0 msgr2=0x55eee26f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5584e37640 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26f9cb0 0x55eee26f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5584e37640 1 -- 172.21.15.12:0/3492519085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eee2366210 con 0x55eee26eeaf0 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f557ffff640 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee26f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5585638640 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26f9cb0 0x55eee26f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5584e37640 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26eeaf0 0x55eee26f6bc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f55740096c0 tx=0x7f55740056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee953c2b5522273 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f555ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f555ffff640 1 -- 172.21.15.12:0/3492519085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5574035070 con 0x55eee26eeaf0 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f555ffff640 1 -- 172.21.15.12:0/3492519085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8731+0+0 (secure 0 0 0) 0x7f5574004eb0 con 0x55eee26eeaf0 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5589e32740 1 -- 172.21.15.12:0/3492519085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5574005520 con 0x55eee26eeaf0 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f555ffff640 1 -- 172.21.15.12:0/3492519085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f55740050b0 con 0x55eee26eeaf0 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5589e32740 10 client.18546 fetch_fsmap learned FSMap version 44 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.457+0000 7f5589e32740 1 -- 172.21.15.12:0/3492519085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55eee2432620 con 0x55eee26eeaf0 2024-09-19T06:51:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.458+0000 7f555ffff640 1 -- 172.21.15.12:0/3492519085 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5574005520 con 0x55eee26eeaf0 2024-09-19T06:51:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.458+0000 7f555ffff640 1 -- 172.21.15.12:0/3492519085 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f5574003680 con 0x55eee26eeaf0 2024-09-19T06:51:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.458+0000 7f5589e32740 10 client.18546 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:51:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.458+0000 7f5589e32740 10 client.18546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.458+0000 7f5589e32740 20 client.18546 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.458+0000 7f5589e32740 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eee2709ab0 0x55eee270bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.458+0000 7f5589e32740 4 client.18546 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.458+0000 7f5589e32740 1 -- 172.21.15.12:0/3492519085 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eee2660a20 con 0x55eee2709ab0 2024-09-19T06:51:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.458+0000 7f557ffff640 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eee2709ab0 0x55eee270bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f557ffff640 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eee2709ab0 0x55eee270bea0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29b5a0167f6c7816 server_cookie=cc99b017c98c4fa6 in_seq=0 out_seq=0 2024-09-19T06:51:04.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f555ffff640 10 client.18546 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f555ffff640 1 -- 172.21.15.12:0/3492519085 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eee2660a20 con 0x55eee2709ab0 2024-09-19T06:51:04.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f555ffff640 10 client.18546 handle_command_reply: tid=0 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f5589e32740 1 client.18546 shutdown 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f5589e32740 1 -- 172.21.15.12:0/3492519085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26eeaf0 msgr2=0x55eee26f6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f5589e32740 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26eeaf0 0x55eee26f6bc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f55740096c0 tx=0x7f55740056d0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f5589e32740 1 -- 172.21.15.12:0/3492519085 shutdown_connections 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f5589e32740 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eee2709ab0 0x55eee270bea0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f5589e32740 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26f9cb0 0x55eee26f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f555ffff640 0 client.18546 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f5589e32740 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee26f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f5589e32740 1 --2- 172.21.15.12:0/3492519085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26eeaf0 0x55eee26f6bc0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.459+0000 7f5589e32740 1 -- 172.21.15.12:0/3492519085 >> 172.21.15.12:0/3492519085 conn(0x55eee26eb060 msgr2=0x55eee26f0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.460+0000 7f5589e32740 1 -- 172.21.15.12:0/3492519085 shutdown_connections 2024-09-19T06:51:04.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.460+0000 7f5589e32740 1 -- 172.21.15.12:0/3492519085 wait complete. 2024-09-19T06:51:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.460+0000 7f5589e32740 20 client.18546 trim_cache size 0 max 16384 2024-09-19T06:51:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5589e32740 1 Processor -- start 2024-09-19T06:51:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5589e32740 1 -- start start 2024-09-19T06:51:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5589e32740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26eeaf0 0x55eee26f1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5589e32740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26ef410 0x55eee26eb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5589e32740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26f7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5589e32740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55801adb20 con 0x55eee26f9cb0 2024-09-19T06:51:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5589e32740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55801af660 con 0x55eee26ef410 2024-09-19T06:51:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5589e32740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f55801ae1f0 con 0x55eee26eeaf0 2024-09-19T06:51:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5585638640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5585638640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58682/0 (socket says 172.21.15.12:58682) 2024-09-19T06:51:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5585638640 1 -- 172.21.15.12:0/2490324714 learned_addr learned my addr 172.21.15.12:0/2490324714 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f557ffff640 1 --2- 172.21.15.12:0/2490324714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26ef410 0x55eee26eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.474+0000 7f5584e37640 1 --2- 172.21.15.12:0/2490324714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26eeaf0 0x55eee26f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.475+0000 7f5585638640 1 -- 172.21.15.12:0/2490324714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26eeaf0 msgr2=0x55eee26f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.475+0000 7f5585638640 1 --2- 172.21.15.12:0/2490324714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26eeaf0 0x55eee26f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.475+0000 7f5585638640 1 -- 172.21.15.12:0/2490324714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26ef410 msgr2=0x55eee26eb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.475+0000 7f5585638640 1 --2- 172.21.15.12:0/2490324714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26ef410 0x55eee26eb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.475+0000 7f5585638640 1 -- 172.21.15.12:0/2490324714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eee26f5b50 con 0x55eee26f9cb0 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.475+0000 7f5585638640 1 --2- 172.21.15.12:0/2490324714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26f7470 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f5578012f10 tx=0x7f5578009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc9fc46e47ca646 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.475+0000 7f556a7fc640 1 -- 172.21.15.12:0/2490324714 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578028070 con 0x55eee26f9cb0 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.475+0000 7f556a7fc640 1 -- 172.21.15.12:0/2490324714 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5578003d40 con 0x55eee26f9cb0 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.475+0000 7f556a7fc640 1 -- 172.21.15.12:0/2490324714 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578023470 con 0x55eee26f9cb0 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 -- 172.21.15.12:0/2490324714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 msgr2=0x55eee26f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 --2- 172.21.15.12:0/2490324714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26f7470 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f5578012f10 tx=0x7f5578009a70 comp rx=0 tx=0).stop 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 -- 172.21.15.12:0/2490324714 shutdown_connections 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 --2- 172.21.15.12:0/2490324714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee26f7470 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 --2- 172.21.15.12:0/2490324714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26ef410 0x55eee26eb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 --2- 172.21.15.12:0/2490324714 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26eeaf0 0x55eee26f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 -- 172.21.15.12:0/2490324714 >> 172.21.15.12:0/2490324714 conn(0x55eee26eb060 msgr2=0x55eee26f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 -- 172.21.15.12:0/2490324714 shutdown_connections 2024-09-19T06:51:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 -- 172.21.15.12:0/2490324714 wait complete. 2024-09-19T06:51:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 -- start start 2024-09-19T06:51:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 Processor -- start 2024-09-19T06:51:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 0x55eee270f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee270c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee270ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55801aef90 con 0x55eee26f9cb0 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55801ae8c0 con 0x55eee26eeaf0 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f55801abb20 con 0x55eee26ef410 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.476+0000 7f5589e32740 10 client.0 _ll_register_callbacks cb 0x7f556c098160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5585638640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee270ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5584e37640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 0x55eee270f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5585638640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee270ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58690/0 (socket says 172.21.15.12:58690) 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5585638640 1 -- 172.21.15.12:0/3870922644 learned_addr learned my addr 172.21.15.12:0/3870922644 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f557ffff640 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee270c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5584e37640 1 -- 172.21.15.12:0/3870922644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 msgr2=0x55eee270c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5584e37640 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee270c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5584e37640 1 -- 172.21.15.12:0/3870922644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 msgr2=0x55eee270ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5584e37640 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee270ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5584e37640 1 -- 172.21.15.12:0/3870922644 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eee270d660 con 0x55eee26eeaf0 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5585638640 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee270ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5584e37640 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 0x55eee270f5b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5574031550 tx=0x7f5574005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d9c75c5ff7fb371 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f555ffff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f555ffff640 1 -- 172.21.15.12:0/3870922644 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5574035040 con 0x55eee26eeaf0 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f555ffff640 1 -- 172.21.15.12:0/3870922644 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8731+0+0 (secure 0 0 0) 0x7f55740048d0 con 0x55eee26eeaf0 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5589e32740 1 -- 172.21.15.12:0/3870922644 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5578003d40 con 0x55eee26eeaf0 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f555ffff640 1 -- 172.21.15.12:0/3870922644 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5574063050 con 0x55eee26eeaf0 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5589e32740 10 client.27884 fetch_fsmap learned FSMap version 44 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.477+0000 7f5589e32740 1 -- 172.21.15.12:0/3870922644 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55eee2774390 con 0x55eee26eeaf0 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f555ffff640 1 -- 172.21.15.12:0/3870922644 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5578003d40 con 0x55eee26eeaf0 2024-09-19T06:51:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f555ffff640 1 -- 172.21.15.12:0/3870922644 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f557405c060 con 0x55eee26eeaf0 2024-09-19T06:51:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f5589e32740 10 client.27884 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:51:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f5589e32740 10 client.27884 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f5589e32740 20 client.27884 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f5589e32740 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eee27749f0 0x55eee2776de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f5589e32740 4 client.27884 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:51:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f5589e32740 1 -- 172.21.15.12:0/3870922644 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eee265ad70 con 0x55eee27749f0 2024-09-19T06:51:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f557ffff640 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eee27749f0 0x55eee2776de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f557ffff640 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eee27749f0 0x55eee2776de0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c68e62c841bff37 server_cookie=1f91ca413aa45d78 in_seq=0 out_seq=0 2024-09-19T06:51:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.478+0000 7f555ffff640 10 client.27884 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.492+0000 7f555ffff640 1 -- 172.21.15.12:0/3870922644 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eee265ad70 con 0x55eee27749f0 2024-09-19T06:51:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.492+0000 7f555ffff640 10 client.27884 handle_command_reply: tid=0 2024-09-19T06:51:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.492+0000 7f5589e32740 1 client.27884 shutdown 2024-09-19T06:51:04.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.492+0000 7f5589e32740 1 -- 172.21.15.12:0/3870922644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 msgr2=0x55eee270f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.492+0000 7f5589e32740 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 0x55eee270f5b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5574031550 tx=0x7f5574005040 comp rx=0 tx=0).stop 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f5589e32740 1 -- 172.21.15.12:0/3870922644 shutdown_connections 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f5589e32740 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55eee27749f0 0x55eee2776de0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f5589e32740 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eee26f9cb0 0x55eee270ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f5589e32740 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eee26ef410 0x55eee270c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f555ffff640 0 client.27884 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f5589e32740 1 --2- 172.21.15.12:0/3870922644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55eee26eeaf0 0x55eee270f5b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f5589e32740 1 -- 172.21.15.12:0/3870922644 >> 172.21.15.12:0/3870922644 conn(0x55eee26eb060 msgr2=0x55eee2704c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f5589e32740 1 -- 172.21.15.12:0/3870922644 shutdown_connections 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f5589e32740 1 -- 172.21.15.12:0/3870922644 wait complete. 2024-09-19T06:51:04.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f5589e32740 20 client.27884 trim_cache size 0 max 16384 2024-09-19T06:51:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:51:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:51:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:51:04.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f558709b640 1 -- 172.21.15.12:0/3760580779 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55700a3460 msgr2=0x7f55700a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f558709b640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55700a3460 0x7f55700a5920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f55780094d0 tx=0x7f5578004ab0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f558709b640 1 -- 172.21.15.12:0/3760580779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55801035a0 msgr2=0x7f5580198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f558709b640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55801035a0 0x7f5580198850 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f556c00c970 tx=0x7f556c00ce30 comp rx=0 tx=0).stop 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f558709b640 1 -- 172.21.15.12:0/3760580779 shutdown_connections 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f558709b640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f55700a3460 0x7f55700a5920 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f558709b640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f558010c0d0 0x7f558019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f558709b640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55801035a0 0x7f5580198850 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.493+0000 7f558709b640 1 --2- 172.21.15.12:0/3760580779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5580102c80 0x7f5580198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.494+0000 7f558709b640 1 -- 172.21.15.12:0/3760580779 >> 172.21.15.12:0/3760580779 conn(0x7f5580077990 msgr2=0x7f55800fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:04.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.494+0000 7f558709b640 1 -- 172.21.15.12:0/3760580779 shutdown_connections 2024-09-19T06:51:04.498 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:04.494+0000 7f558709b640 1 -- 172.21.15.12:0/3760580779 wait complete. 2024-09-19T06:51:05.017 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 59926833 --release --await' 2024-09-19T06:51:05.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 59926833 --release --await 2024-09-19T06:51:05.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:04 smithi016 ceph-mon[34911]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:51:05.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:04 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/771313673' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:05.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:04 smithi173 ceph-mon[35349]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:51:05.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:04 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/771313673' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:05.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:04 smithi012 ceph-mon[30937]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:51:05.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:04 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/771313673' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 -- 172.21.15.12:0/4080553220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60102d90 msgr2=0x7f1b60103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 --2- 172.21.15.12:0/4080553220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60102d90 0x7f1b60103170 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009cd0 tx=0x7f1b5002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 -- 172.21.15.12:0/4080553220 shutdown_connections 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 --2- 172.21.15.12:0/4080553220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b60108290 0x7f1b6010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 --2- 172.21.15.12:0/4080553220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b60103740 0x7f1b60107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 --2- 172.21.15.12:0/4080553220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60102d90 0x7f1b60103170 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 -- 172.21.15.12:0/4080553220 >> 172.21.15.12:0/4080553220 conn(0x7f1b600fc7d0 msgr2=0x7f1b600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 -- 172.21.15.12:0/4080553220 shutdown_connections 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 -- 172.21.15.12:0/4080553220 wait complete. 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 Processor -- start 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.756+0000 7f1b67385640 1 -- start start 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b67385640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b60102d90 0x7f1b601009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b67385640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b60103740 0x7f1b60100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b67385640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60108290 0x7f1b60101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b67385640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b60112090 con 0x7f1b60108290 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b67385640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1b60111f10 con 0x7f1b60103740 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b67385640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1b60112210 con 0x7f1b60102d90 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b65922640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60108290 0x7f1b60101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b65922640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60108290 0x7f1b60101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58704/0 (socket says 172.21.15.12:58704) 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b65922640 1 -- 172.21.15.12:0/425202785 learned_addr learned my addr 172.21.15.12:0/425202785 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b65121640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b60102d90 0x7f1b601009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b64920640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b60103740 0x7f1b60100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b65922640 1 -- 172.21.15.12:0/425202785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b60102d90 msgr2=0x7f1b601009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b65922640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b60102d90 0x7f1b601009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b65922640 1 -- 172.21.15.12:0/425202785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b60103740 msgr2=0x7f1b60100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b65922640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b60103740 0x7f1b60100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b65922640 1 -- 172.21.15.12:0/425202785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b601a6a70 con 0x7f1b60108290 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b65922640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60108290 0x7f1b60101470 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800e970 tx=0x7f1b5800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.757+0000 7f1b5e7fc640 1 -- 172.21.15.12:0/425202785 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5800ccc0 con 0x7f1b60108290 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.758+0000 7f1b5e7fc640 1 -- 172.21.15.12:0/425202785 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b5800ce60 con 0x7f1b60108290 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.758+0000 7f1b67385640 1 -- 172.21.15.12:0/425202785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b601a6d60 con 0x7f1b60108290 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.758+0000 7f1b5e7fc640 1 -- 172.21.15.12:0/425202785 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58010490 con 0x7f1b60108290 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.758+0000 7f1b67385640 1 -- 172.21.15.12:0/425202785 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b601a7250 con 0x7f1b60108290 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b6975e740 1 Processor -- start 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b5e7fc640 1 -- 172.21.15.12:0/425202785 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1b58005020 con 0x7f1b60108290 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b6975e740 1 -- start start 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c060 0x5570ee17c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c980 0x5570ee186d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee187240 0x5570ee189630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b6975e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5570ee0e1620 con 0x5570ee17c980 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b6975e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5570ee088e50 con 0x5570ee187240 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b6975e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5570ee0dd5e0 con 0x5570ee17c060 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b65121640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c980 0x5570ee186d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b65121640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c980 0x5570ee186d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58706/0 (socket says 172.21.15.12:58706) 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b65121640 1 -- 172.21.15.12:0/3398281995 learned_addr learned my addr 172.21.15.12:0/3398281995 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.761+0000 7f1b64920640 1 --2- 172.21.15.12:0/3398281995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c060 0x5570ee17c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b64920640 1 --2- 172.21.15.12:0/3398281995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee187240 0x5570ee189630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b65121640 1 -- 172.21.15.12:0/3398281995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c060 msgr2=0x5570ee17c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b65121640 1 --2- 172.21.15.12:0/3398281995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c060 0x5570ee17c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b65121640 1 -- 172.21.15.12:0/3398281995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee187240 msgr2=0x5570ee189630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b65121640 1 --2- 172.21.15.12:0/3398281995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee187240 0x5570ee189630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b65121640 1 -- 172.21.15.12:0/3398281995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ee079d40 con 0x5570ee17c980 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b64920640 1 --2- 172.21.15.12:0/3398281995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee187240 0x5570ee189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b5e7fc640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b480a33b0 0x7f1b480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b64920640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b480a33b0 0x7f1b480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b5e7fc640 1 -- 172.21.15.12:0/425202785 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8731+0+0 (secure 0 0 0) 0x7f1b580d0340 con 0x7f1b60108290 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b65121640 1 --2- 172.21.15.12:0/3398281995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c980 0x5570ee186d00 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f1b50000f80 tx=0x7f1b50009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a865b67cbc2a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b477fe640 1 -- 172.21.15.12:0/3398281995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b500318c0 con 0x5570ee17c980 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b477fe640 1 -- 172.21.15.12:0/3398281995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b50036040 con 0x5570ee17c980 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.762+0000 7f1b477fe640 1 -- 172.21.15.12:0/3398281995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b50004500 con 0x5570ee17c980 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b6975e740 1 -- 172.21.15.12:0/3398281995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c980 msgr2=0x5570ee186d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b6975e740 1 --2- 172.21.15.12:0/3398281995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c980 0x5570ee186d00 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f1b50000f80 tx=0x7f1b50009a20 comp rx=0 tx=0).stop 2024-09-19T06:51:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b64920640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b480a33b0 0x7f1b480a5870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5570ee179970 tx=0x7f1b540046c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b6975e740 1 -- 172.21.15.12:0/3398281995 shutdown_connections 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b6975e740 1 --2- 172.21.15.12:0/3398281995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee187240 0x5570ee189630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b6975e740 1 --2- 172.21.15.12:0/3398281995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c980 0x5570ee186d00 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b6975e740 1 --2- 172.21.15.12:0/3398281995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c060 0x5570ee17c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b6975e740 1 -- 172.21.15.12:0/3398281995 >> 172.21.15.12:0/3398281995 conn(0x5570ee1785f0 msgr2=0x5570ee1789d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b6975e740 1 -- 172.21.15.12:0/3398281995 shutdown_connections 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b6975e740 1 -- 172.21.15.12:0/3398281995 wait complete. 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.763+0000 7f1b6975e740 1 -- start start 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b6975e740 1 Processor -- start 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c060 0x5570ee1840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c980 0x5570ee184610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee184b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b6975e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5570ee189e10 con 0x5570ee187240 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b6975e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5570ee069f10 con 0x5570ee17c980 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b6975e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5570ee189f90 con 0x5570ee17c060 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b6975e740 10 client.0 _ll_register_callbacks cb 0x5570ee08ddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b65922640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee184b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b65922640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee184b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58720/0 (socket says 172.21.15.12:58720) 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b65922640 1 -- 172.21.15.12:0/1019494958 learned_addr learned my addr 172.21.15.12:0/1019494958 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b65121640 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c060 0x5570ee1840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b64920640 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c980 0x5570ee184610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b65922640 1 -- 172.21.15.12:0/1019494958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c060 msgr2=0x5570ee1840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b65922640 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c060 0x5570ee1840d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b65922640 1 -- 172.21.15.12:0/1019494958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c980 msgr2=0x5570ee184610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b65922640 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c980 0x5570ee184610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.764+0000 7f1b65922640 1 -- 172.21.15.12:0/1019494958 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570eddf0580 con 0x5570ee187240 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b65922640 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee184b50 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f1b580989b0 tx=0x7f1b5809cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ea64147cf98e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1019494958 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b580b4020 con 0x5570ee187240 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1019494958 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8731+0+0 (secure 0 0 0) 0x7f1b58098bc0 con 0x5570ee187240 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b6975e740 1 -- 172.21.15.12:0/1019494958 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b50036040 con 0x5570ee187240 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1019494958 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f1b580a0900 con 0x5570ee187240 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b6975e740 10 client.18564 fetch_fsmap learned FSMap version 44 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b6975e740 1 -- 172.21.15.12:0/1019494958 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5570edeba960 con 0x5570ee187240 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1019494958 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b50036040 con 0x5570ee187240 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1019494958 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f1b58067260 con 0x5570ee187240 2024-09-19T06:51:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b6975e740 10 client.18564 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:51:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b6975e740 10 client.18564 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:51:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b6975e740 20 client.18564 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5570ee196d60 0x5570ee199200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b6975e740 4 client.18564 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.765+0000 7f1b6975e740 1 -- 172.21.15.12:0/1019494958 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570ee0eeb90 con 0x5570ee196d60 2024-09-19T06:51:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.766+0000 7f1b65121640 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5570ee196d60 0x5570ee199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.766+0000 7f1b65121640 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5570ee196d60 0x5570ee199200 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43872b61b049097 server_cookie=f119a085ce93111 in_seq=0 out_seq=0 2024-09-19T06:51:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.766+0000 7f1b44ff9640 10 client.18564 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1019494958 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570ee0eeb90 con 0x5570ee196d60 2024-09-19T06:51:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b44ff9640 10 client.18564 handle_command_reply: tid=0 2024-09-19T06:51:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 client.18564 shutdown 2024-09-19T06:51:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 -- 172.21.15.12:0/1019494958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 msgr2=0x5570ee184b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee184b50 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f1b580989b0 tx=0x7f1b5809cc50 comp rx=0 tx=0).stop 2024-09-19T06:51:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 -- 172.21.15.12:0/1019494958 shutdown_connections 2024-09-19T06:51:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5570ee196d60 0x5570ee199200 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee184b50 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c980 0x5570ee184610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1019494958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c060 0x5570ee1840d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b44ff9640 0 client.18564 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 -- 172.21.15.12:0/1019494958 >> 172.21.15.12:0/1019494958 conn(0x5570ee1785f0 msgr2=0x5570ee17e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 -- 172.21.15.12:0/1019494958 shutdown_connections 2024-09-19T06:51:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 1 -- 172.21.15.12:0/1019494958 wait complete. 2024-09-19T06:51:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.767+0000 7f1b6975e740 20 client.18564 trim_cache size 0 max 16384 2024-09-19T06:51:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b6975e740 1 Processor -- start 2024-09-19T06:51:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b6975e740 1 -- start start 2024-09-19T06:51:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c060 0x5570ee17e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c980 0x5570ee19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee19f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b6975e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b601afe70 con 0x5570ee187240 2024-09-19T06:51:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b6975e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1b601b19b0 con 0x5570ee17c060 2024-09-19T06:51:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b6975e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1b601b0540 con 0x5570ee17c980 2024-09-19T06:51:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b65922640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b65922640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee19f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58724/0 (socket says 172.21.15.12:58724) 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b65922640 1 -- 172.21.15.12:0/2847658693 learned_addr learned my addr 172.21.15.12:0/2847658693 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b64920640 1 --2- 172.21.15.12:0/2847658693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c980 0x5570ee19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b65121640 1 --2- 172.21.15.12:0/2847658693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c060 0x5570ee17e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b65922640 1 -- 172.21.15.12:0/2847658693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c980 msgr2=0x5570ee19ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b65922640 1 --2- 172.21.15.12:0/2847658693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c980 0x5570ee19ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b65922640 1 -- 172.21.15.12:0/2847658693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c060 msgr2=0x5570ee17e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b65922640 1 --2- 172.21.15.12:0/2847658693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c060 0x5570ee17e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b65922640 1 -- 172.21.15.12:0/2847658693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ee178420 con 0x5570ee187240 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.786+0000 7f1b65922640 1 --2- 172.21.15.12:0/2847658693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee19f010 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f1b580cda70 tx=0x7f1b5809aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb82747075770f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b46ffd640 1 -- 172.21.15.12:0/2847658693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b580b4070 con 0x5570ee187240 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b46ffd640 1 -- 172.21.15.12:0/2847658693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b580d0070 con 0x5570ee187240 2024-09-19T06:51:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b46ffd640 1 -- 172.21.15.12:0/2847658693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58016dd0 con 0x5570ee187240 2024-09-19T06:51:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b6975e740 1 -- 172.21.15.12:0/2847658693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 msgr2=0x5570ee19f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b6975e740 1 --2- 172.21.15.12:0/2847658693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee19f010 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f1b580cda70 tx=0x7f1b5809aa60 comp rx=0 tx=0).stop 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b6975e740 1 -- 172.21.15.12:0/2847658693 shutdown_connections 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b6975e740 1 --2- 172.21.15.12:0/2847658693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee187240 0x5570ee19f010 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b6975e740 1 --2- 172.21.15.12:0/2847658693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee17c980 0x5570ee19ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b6975e740 1 --2- 172.21.15.12:0/2847658693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c060 0x5570ee17e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b6975e740 1 -- 172.21.15.12:0/2847658693 >> 172.21.15.12:0/2847658693 conn(0x5570ee1785f0 msgr2=0x5570ee17dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b6975e740 1 -- 172.21.15.12:0/2847658693 shutdown_connections 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.787+0000 7f1b6975e740 1 -- 172.21.15.12:0/2847658693 wait complete. 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.788+0000 7f1b6975e740 1 -- start start 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.788+0000 7f1b6975e740 1 Processor -- start 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.788+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c060 0x5570ee18bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.788+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c980 0x5570ee18c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.788+0000 7f1b6975e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee187240 0x5570ee1f9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.788+0000 7f1b6975e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b601b12e0 con 0x5570ee17c060 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.788+0000 7f1b6975e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1b601b0c10 con 0x5570ee17c980 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.788+0000 7f1b6975e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1b601ade70 con 0x5570ee187240 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.788+0000 7f1b6975e740 10 client.0 _ll_register_callbacks cb 0x7f1b5809c090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65121640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c060 0x5570ee18bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65922640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee187240 0x5570ee1f9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65121640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c060 0x5570ee18bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58738/0 (socket says 172.21.15.12:58738) 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65121640 1 -- 172.21.15.12:0/1438167640 learned_addr learned my addr 172.21.15.12:0/1438167640 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b64920640 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c980 0x5570ee18c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65121640 1 -- 172.21.15.12:0/1438167640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee187240 msgr2=0x5570ee1f9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65121640 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee187240 0x5570ee1f9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65121640 1 -- 172.21.15.12:0/1438167640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c980 msgr2=0x5570ee18c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65121640 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c980 0x5570ee18c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65121640 1 -- 172.21.15.12:0/1438167640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ee1fa120 con 0x5570ee17c060 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65922640 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee187240 0x5570ee1f9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b65121640 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c060 0x5570ee18bb00 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f1b50000f80 tx=0x7f1b500040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4fc9a81b418487b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1438167640 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b50031b90 con 0x5570ee17c060 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1438167640 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8731+0+0 (secure 0 0 0) 0x7f1b50003970 con 0x5570ee17c060 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.789+0000 7f1b6975e740 1 -- 172.21.15.12:0/1438167640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b580d0070 con 0x5570ee17c060 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1438167640 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f1b50062050 con 0x5570ee17c060 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b6975e740 10 client.18570 fetch_fsmap learned FSMap version 44 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b6975e740 1 -- 172.21.15.12:0/1438167640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5570ee202660 con 0x5570ee17c060 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1438167640 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b580d0070 con 0x5570ee17c060 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1438167640 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7f1b50030070 con 0x5570ee17c060 2024-09-19T06:51:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b6975e740 10 client.18570 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:51:05.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b6975e740 10 client.18570 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:51:05.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b6975e740 20 client.18570 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:05.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5570ee2028f0 0x5570ee204ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:05.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b6975e740 4 client.18570 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "59926833", "release": true, "await": true}] 2024-09-19T06:51:05.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b6975e740 1 -- 172.21.15.12:0/1438167640 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "59926833", "release": true, "await": true}) -- 0x5570ee0e90a0 con 0x5570ee2028f0 2024-09-19T06:51:05.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.790+0000 7f1b64920640 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5570ee2028f0 0x5570ee204ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:05.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.791+0000 7f1b64920640 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5570ee2028f0 0x5570ee204ce0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e652b1ffe500f0be server_cookie=213b70aa05d63487 in_seq=0 out_seq=0 2024-09-19T06:51:05.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.791+0000 7f1b44ff9640 10 client.18570 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 620.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:51:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b44ff9640 1 -- 172.21.15.12:0/1438167640 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5570ee0e90a0 con 0x5570ee2028f0 2024-09-19T06:51:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b44ff9640 10 client.18570 handle_command_reply: tid=0 2024-09-19T06:51:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b6975e740 1 client.18570 shutdown 2024-09-19T06:51:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b6975e740 1 -- 172.21.15.12:0/1438167640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c060 msgr2=0x5570ee18bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c060 0x5570ee18bb00 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f1b50000f80 tx=0x7f1b500040e0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b6975e740 1 -- 172.21.15.12:0/1438167640 shutdown_connections 2024-09-19T06:51:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5570ee2028f0 0x5570ee204ce0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5570ee187240 0x5570ee1f9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b44ff9640 0 client.18570 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5570ee17c980 0x5570ee18c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b6975e740 1 --2- 172.21.15.12:0/1438167640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee17c060 0x5570ee18bb00 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.842+0000 7f1b6975e740 1 -- 172.21.15.12:0/1438167640 >> 172.21.15.12:0/1438167640 conn(0x5570ee1785f0 msgr2=0x5570ee1848b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.843+0000 7f1b6975e740 1 -- 172.21.15.12:0/1438167640 shutdown_connections 2024-09-19T06:51:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.843+0000 7f1b6975e740 1 -- 172.21.15.12:0/1438167640 wait complete. 2024-09-19T06:51:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.843+0000 7f1b6975e740 20 client.18570 trim_cache size 0 max 16384 2024-09-19T06:51:05.845 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:51:05.845 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 44, 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 40, 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "59926833": { 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 40, 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 150.0, 2024-09-19T06:51:05.846 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:51:05.847 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:51:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 -- 172.21.15.12:0/425202785 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b480a33b0 msgr2=0x7f1b480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b480a33b0 0x7f1b480a5870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5570ee179970 tx=0x7f1b540046c0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 -- 172.21.15.12:0/425202785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60108290 msgr2=0x7f1b60101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60108290 0x7f1b60101470 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800e970 tx=0x7f1b5800ed70 comp rx=0 tx=0).stop 2024-09-19T06:51:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 -- 172.21.15.12:0/425202785 shutdown_connections 2024-09-19T06:51:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60108290 0x7f1b60101470 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b60103740 0x7f1b60100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b480a33b0 0x7f1b480a5870 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 --2- 172.21.15.12:0/425202785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b60102d90 0x7f1b601009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:05.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 -- 172.21.15.12:0/425202785 >> 172.21.15.12:0/425202785 conn(0x7f1b600fc7d0 msgr2=0x7f1b60105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:05.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 -- 172.21.15.12:0/425202785 shutdown_connections 2024-09-19T06:51:05.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:05.844+0000 7f1b67385640 1 -- 172.21.15.12:0/425202785 wait complete. 2024-09-19T06:51:06.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:05 smithi016 ceph-mon[34911]: pgmap v340: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2024-09-19T06:51:06.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:05 smithi173 ceph-mon[35349]: pgmap v340: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2024-09-19T06:51:06.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:05 smithi012 ceph-mon[30937]: pgmap v340: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.9 MiB/s wr, 554 op/s 2024-09-19T06:51:06.815 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '59926833', total seconds elapsed: 33.7 2024-09-19T06:51:08.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:07 smithi016 ceph-mon[34911]: pgmap v341: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 5.9 MiB/s wr, 648 op/s 2024-09-19T06:51:08.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:07 smithi173 ceph-mon[35349]: pgmap v341: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 5.9 MiB/s wr, 648 op/s 2024-09-19T06:51:08.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:07 smithi012 ceph-mon[30937]: pgmap v341: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 5.9 MiB/s wr, 648 op/s 2024-09-19T06:51:10.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:09 smithi016 ceph-mon[34911]: pgmap v342: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 5.9 MiB/s wr, 648 op/s 2024-09-19T06:51:10.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:09 smithi016 ceph-mon[34911]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T06:51:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:09 smithi173 ceph-mon[35349]: pgmap v342: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 5.9 MiB/s wr, 648 op/s 2024-09-19T06:51:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:09 smithi173 ceph-mon[35349]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T06:51:10.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:09 smithi012 ceph-mon[30937]: pgmap v342: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 5.9 MiB/s wr, 648 op/s 2024-09-19T06:51:10.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:09 smithi012 ceph-mon[30937]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T06:51:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 625.0 s, 3280.2 tps, lat 209.412 ms stddev 2295.296 2024-09-19T06:51:12.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:11 smithi016 ceph-mon[34911]: pgmap v344: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 3.6 MiB/s wr, 524 op/s 2024-09-19T06:51:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:11 smithi173 ceph-mon[35349]: pgmap v344: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 3.6 MiB/s wr, 524 op/s 2024-09-19T06:51:12.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:11 smithi012 ceph-mon[30937]: pgmap v344: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 3.6 MiB/s wr, 524 op/s 2024-09-19T06:51:14.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:13 smithi016 ceph-mon[34911]: pgmap v345: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 3.5 MiB/s wr, 502 op/s 2024-09-19T06:51:14.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:13 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:51:14.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:13 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:51:14.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:13 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:51:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:13 smithi173 ceph-mon[35349]: pgmap v345: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 3.5 MiB/s wr, 502 op/s 2024-09-19T06:51:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:13 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:51:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:13 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:51:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:13 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:51:14.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:13 smithi012 ceph-mon[30937]: pgmap v345: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 3.5 MiB/s wr, 502 op/s 2024-09-19T06:51:14.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:13 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:51:14.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:13 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:51:14.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:13 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:51:15.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:51:15.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:51:15.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:51:15.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:51:15.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:51:15.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:51:15.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 630.0 s, 2149.2 tps, lat 46.354 ms stddev 49.652 2024-09-19T06:51:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:15 smithi016 ceph-mon[34911]: pgmap v346: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 3.3 MiB/s wr, 445 op/s 2024-09-19T06:51:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:15 smithi173 ceph-mon[35349]: pgmap v346: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 3.3 MiB/s wr, 445 op/s 2024-09-19T06:51:16.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:15 smithi012 ceph-mon[30937]: pgmap v346: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 3.3 MiB/s wr, 445 op/s 2024-09-19T06:51:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.626+0000 7ff2a7e50640 1 -- 172.21.15.12:0/3182985763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2a0107b70 msgr2=0x7ff2a0107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.626+0000 7ff2a7e50640 1 --2- 172.21.15.12:0/3182985763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2a0107b70 0x7ff2a0107f50 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff290009930 tx=0x7ff29002a420 comp rx=0 tx=0).stop 2024-09-19T06:51:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.626+0000 7ff2a7e50640 1 -- 172.21.15.12:0/3182985763 shutdown_connections 2024-09-19T06:51:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.626+0000 7ff2a7e50640 1 --2- 172.21.15.12:0/3182985763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2a0102470 0x7ff2a010e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.626+0000 7ff2a7e50640 1 --2- 172.21.15.12:0/3182985763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a0101ad0 0x7ff2a0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.626+0000 7ff2a7e50640 1 --2- 172.21.15.12:0/3182985763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2a0107b70 0x7ff2a0107f50 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.626+0000 7ff2a7e50640 1 -- 172.21.15.12:0/3182985763 >> 172.21.15.12:0/3182985763 conn(0x7ff2a00fd7b0 msgr2=0x7ff2a00ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.626+0000 7ff2a7e50640 1 -- 172.21.15.12:0/3182985763 shutdown_connections 2024-09-19T06:51:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.627+0000 7ff2a7e50640 1 -- 172.21.15.12:0/3182985763 wait complete. 2024-09-19T06:51:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a7e50640 1 Processor -- start 2024-09-19T06:51:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a7e50640 1 -- start start 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a7e50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2a0101ad0 0x7ff2a0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a7e50640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2a0102470 0x7ff2a01988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a7e50640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a0107b70 0x7ff2a019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a7e50640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a0111f70 con 0x7ff2a0101ad0 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a7e50640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a0111df0 con 0x7ff2a0107b70 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a7e50640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01120f0 con 0x7ff2a0102470 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a5bec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2a0101ad0 0x7ff2a0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a5bec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2a0101ad0 0x7ff2a0198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33174/0 (socket says 172.21.15.12:33174) 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a5bec640 1 -- 172.21.15.12:0/356615716 learned_addr learned my addr 172.21.15.12:0/356615716 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2a0102470 0x7ff2a01988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.628+0000 7ff2a63ed640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a0107b70 0x7ff2a019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.629+0000 7ff2a53eb640 1 -- 172.21.15.12:0/356615716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a0107b70 msgr2=0x7ff2a019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.629+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a0107b70 0x7ff2a019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.629+0000 7ff2a53eb640 1 -- 172.21.15.12:0/356615716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2a0101ad0 msgr2=0x7ff2a0198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.629+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2a0101ad0 0x7ff2a0198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.629+0000 7ff2a53eb640 1 -- 172.21.15.12:0/356615716 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a019d350 con 0x7ff2a0102470 2024-09-19T06:51:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.629+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2a0102470 0x7ff2a01988a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00e9f0 tx=0x7ff29c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.630+0000 7ff296ffd640 1 -- 172.21.15.12:0/356615716 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00ccc0 con 0x7ff2a0102470 2024-09-19T06:51:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.630+0000 7ff296ffd640 1 -- 172.21.15.12:0/356615716 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff29c010910 con 0x7ff2a0102470 2024-09-19T06:51:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.630+0000 7ff296ffd640 1 -- 172.21.15.12:0/356615716 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c018980 con 0x7ff2a0102470 2024-09-19T06:51:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.630+0000 7ff2a7e50640 1 -- 172.21.15.12:0/356615716 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a019d640 con 0x7ff2a0102470 2024-09-19T06:51:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.630+0000 7ff2a7e50640 1 -- 172.21.15.12:0/356615716 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a0074420 con 0x7ff2a0102470 2024-09-19T06:51:17.635 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.634+0000 7ff296ffd640 1 -- 172.21.15.12:0/356615716 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff29c010ac0 con 0x7ff2a0102470 2024-09-19T06:51:17.635 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.634+0000 7ff2aabe2740 1 Processor -- start 2024-09-19T06:51:17.635 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.634+0000 7ff2aabe2740 1 -- start start 2024-09-19T06:51:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.635+0000 7ff296ffd640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff28c0a3610 0x7ff28c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.635+0000 7ff296ffd640 1 -- 172.21.15.12:0/356615716 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7ff29c0d00f0 con 0x7ff2a0102470 2024-09-19T06:51:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2beed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2c9cb0 0x562e5c2cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562e5c2232f0 con 0x562e5c2beaf0 2024-09-19T06:51:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562e5c1cb270 con 0x562e5c2c9cb0 2024-09-19T06:51:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562e5c21f2b0 con 0x562e5c2bf410 2024-09-19T06:51:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2a5bec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2a63ed640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff28c0a3610 0x7ff28c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2a5bec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2beed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33182/0 (socket says 172.21.15.12:33182) 2024-09-19T06:51:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2a5bec640 1 -- 172.21.15.12:0/3932951217 learned_addr learned my addr 172.21.15.12:0/3932951217 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.636+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff2a53eb640 1 -- 172.21.15.12:0/3932951217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2c9cb0 msgr2=0x562e5c2cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff2a63ed640 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2c9cb0 0x562e5c2cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2c9cb0 0x562e5c2cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff2a53eb640 1 -- 172.21.15.12:0/3932951217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 msgr2=0x562e5c2beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff2a53eb640 1 -- 172.21.15.12:0/3932951217 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e5c1ca340 con 0x562e5c2bf410 2024-09-19T06:51:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff2a63ed640 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2c9cb0 0x562e5c2cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff2a5bec640 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff2a63ed640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff28c0a3610 0x7ff28c0a5ad0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff298005fd0 tx=0x7ff298009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c9770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0cd7a0 tx=0x7ff29c09bd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a84a13020d263e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff28bfff640 1 -- 172.21.15.12:0/3932951217 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0a4fa0 con 0x562e5c2bf410 2024-09-19T06:51:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff28bfff640 1 -- 172.21.15.12:0/3932951217 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff29c0cda20 con 0x562e5c2bf410 2024-09-19T06:51:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.637+0000 7ff28bfff640 1 -- 172.21.15.12:0/3932951217 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c010430 con 0x562e5c2bf410 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.639+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3932951217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 msgr2=0x562e5c2c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.639+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c9770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0cd7a0 tx=0x7ff29c09bd50 comp rx=0 tx=0).stop 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.639+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3932951217 shutdown_connections 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.639+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2c9cb0 0x562e5c2cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.639+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c9770 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.639+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/3932951217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.639+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3932951217 >> 172.21.15.12:0/3932951217 conn(0x562e5c2bb060 msgr2=0x562e5c2bb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.639+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3932951217 shutdown_connections 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.639+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3932951217 wait complete. 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.640+0000 7ff2aabe2740 1 -- start start 2024-09-19T06:51:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.640+0000 7ff2aabe2740 1 Processor -- start 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.640+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 0x562e5c2c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.640+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.640+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2c9cb0 0x562e5c2c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.640+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562e5c2cc880 con 0x562e5c2c9cb0 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.640+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562e5c1ac290 con 0x562e5c2beaf0 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.640+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562e5c2cca00 con 0x562e5c2bf410 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.640+0000 7ff2aabe2740 10 client.0 _ll_register_callbacks cb 0x562e5c1dd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.640+0000 7ff2a53eb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.641+0000 7ff2a53eb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:42222/0 (socket says 172.21.15.12:42222) 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.641+0000 7ff2a53eb640 1 -- 172.21.15.12:0/1645853601 learned_addr learned my addr 172.21.15.12:0/1645853601 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.641+0000 7ff2a5bec640 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 0x562e5c2c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.641+0000 7ff2a63ed640 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2c9cb0 0x562e5c2c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.641+0000 7ff2a53eb640 1 -- 172.21.15.12:0/1645853601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 msgr2=0x562e5c2c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.641+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 0x562e5c2c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.641+0000 7ff2a53eb640 1 -- 172.21.15.12:0/1645853601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2c9cb0 msgr2=0x562e5c2c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.641+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2c9cb0 0x562e5c2c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.641+0000 7ff2a53eb640 1 -- 172.21.15.12:0/1645853601 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e5bf36210 con 0x562e5c2bf410 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.642+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c70d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0cd850 tx=0x7ff29c09bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ec6fc6198ad36ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.642+0000 7ff2897fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.642+0000 7ff2897fa640 1 -- 172.21.15.12:0/1645853601 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0b4070 con 0x562e5c2bf410 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.642+0000 7ff2897fa640 1 -- 172.21.15.12:0/1645853601 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7ff29c0b5260 con 0x562e5c2bf410 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.642+0000 7ff2aabe2740 1 -- 172.21.15.12:0/1645853601 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff29c0cda20 con 0x562e5c2bf410 2024-09-19T06:51:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2897fa640 1 -- 172.21.15.12:0/1645853601 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff29c0a4fa0 con 0x562e5c2bf410 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2aabe2740 10 client.27865 fetch_fsmap learned FSMap version 44 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2aabe2740 1 -- 172.21.15.12:0/1645853601 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x562e5c002620 con 0x562e5c2bf410 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2897fa640 1 -- 172.21.15.12:0/1645853601 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff29c0cda20 con 0x562e5c2bf410 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2897fa640 1 -- 172.21.15.12:0/1645853601 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7ff29c098110 con 0x562e5c2bf410 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2aabe2740 10 client.27865 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2aabe2740 10 client.27865 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2aabe2740 20 client.27865 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562e5c2d99f0 0x562e5c2dbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2aabe2740 4 client.27865 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.643+0000 7ff2aabe2740 1 -- 172.21.15.12:0/1645853601 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e5c230a20 con 0x562e5c2d99f0 2024-09-19T06:51:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.644+0000 7ff2a5bec640 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562e5c2d99f0 0x562e5c2dbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.644+0000 7ff2897fa640 10 client.27865 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.644+0000 7ff2a5bec640 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562e5c2d99f0 0x562e5c2dbde0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd373a72f4e28d85 server_cookie=9e6ea949eca03b72 in_seq=0 out_seq=0 2024-09-19T06:51:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2897fa640 1 -- 172.21.15.12:0/1645853601 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e5c230a20 con 0x562e5c2d99f0 2024-09-19T06:51:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2897fa640 10 client.27865 handle_command_reply: tid=0 2024-09-19T06:51:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 client.27865 shutdown 2024-09-19T06:51:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 -- 172.21.15.12:0/1645853601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 msgr2=0x562e5c2c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c70d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0cd850 tx=0x7ff29c09bdc0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 -- 172.21.15.12:0/1645853601 shutdown_connections 2024-09-19T06:51:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562e5c2d99f0 0x562e5c2dbde0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2c9cb0 0x562e5c2c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2bf410 0x562e5c2c70d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/1645853601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 0x562e5c2c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 -- 172.21.15.12:0/1645853601 >> 172.21.15.12:0/1645853601 conn(0x562e5c2bb060 msgr2=0x562e5c2c0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2897fa640 0 client.27865 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 -- 172.21.15.12:0/1645853601 shutdown_connections 2024-09-19T06:51:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.645+0000 7ff2aabe2740 1 -- 172.21.15.12:0/1645853601 wait complete. 2024-09-19T06:51:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.646+0000 7ff2aabe2740 20 client.27865 trim_cache size 0 max 16384 2024-09-19T06:51:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.666+0000 7ff2aabe2740 1 Processor -- start 2024-09-19T06:51:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.666+0000 7ff2aabe2740 1 -- start start 2024-09-19T06:51:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.666+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 0x562e5c2c7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.666+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2bf410 0x562e5c2d53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2c9cb0 0x562e5c2c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ab9d0 con 0x562e5c2bf410 2024-09-19T06:51:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ad510 con 0x562e5c2beaf0 2024-09-19T06:51:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ac0a0 con 0x562e5c2c9cb0 2024-09-19T06:51:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2a5bec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 0x562e5c2c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2a5bec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 0x562e5c2c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:38118/0 (socket says 172.21.15.12:38118) 2024-09-19T06:51:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2a5bec640 1 -- 172.21.15.12:0/435176181 learned_addr learned my addr 172.21.15.12:0/435176181 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2a63ed640 1 --2- 172.21.15.12:0/435176181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2c9cb0 0x562e5c2c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/435176181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2bf410 0x562e5c2d53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2a5bec640 1 -- 172.21.15.12:0/435176181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2c9cb0 msgr2=0x562e5c2c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:17.669 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2a5bec640 1 --2- 172.21.15.12:0/435176181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2c9cb0 0x562e5c2c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2a5bec640 1 -- 172.21.15.12:0/435176181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2bf410 msgr2=0x562e5c2d53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2a5bec640 1 --2- 172.21.15.12:0/435176181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2bf410 0x562e5c2d53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.667+0000 7ff2a5bec640 1 -- 172.21.15.12:0/435176181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e5c2bae90 con 0x562e5c2beaf0 2024-09-19T06:51:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.668+0000 7ff2a5bec640 1 --2- 172.21.15.12:0/435176181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 0x562e5c2c7440 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff290005ab0 tx=0x7ff29002a920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=272739c163e561e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.668+0000 7ff28b7fe640 1 -- 172.21.15.12:0/435176181 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff290035040 con 0x562e5c2beaf0 2024-09-19T06:51:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.668+0000 7ff28b7fe640 1 -- 172.21.15.12:0/435176181 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff29004a070 con 0x562e5c2beaf0 2024-09-19T06:51:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.668+0000 7ff28b7fe640 1 -- 172.21.15.12:0/435176181 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2900315b0 con 0x562e5c2beaf0 2024-09-19T06:51:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.669+0000 7ff2aabe2740 1 -- 172.21.15.12:0/435176181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 msgr2=0x562e5c2c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.669+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/435176181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 0x562e5c2c7440 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff290005ab0 tx=0x7ff29002a920 comp rx=0 tx=0).stop 2024-09-19T06:51:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.669+0000 7ff2aabe2740 1 -- 172.21.15.12:0/435176181 shutdown_connections 2024-09-19T06:51:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.669+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/435176181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2c9cb0 0x562e5c2c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.669+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/435176181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2bf410 0x562e5c2d53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.669+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/435176181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2beaf0 0x562e5c2c7440 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.669+0000 7ff2aabe2740 1 -- 172.21.15.12:0/435176181 >> 172.21.15.12:0/435176181 conn(0x562e5c2bb060 msgr2=0x562e5c2d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.669+0000 7ff2aabe2740 1 -- 172.21.15.12:0/435176181 shutdown_connections 2024-09-19T06:51:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.669+0000 7ff2aabe2740 1 -- 172.21.15.12:0/435176181 wait complete. 2024-09-19T06:51:17.672 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2aabe2740 1 -- start start 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2aabe2740 1 Processor -- start 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2df1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2bf410 0x562e5c2dc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2aabe2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2c9cb0 0x562e5c2dca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ace40 con 0x562e5c2beaf0 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ac770 con 0x562e5c2bf410 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2aabe2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01a99d0 con 0x562e5c2c9cb0 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2a5bec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2df1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2aabe2740 10 client.0 _ll_register_callbacks cb 0x7ff29c0107c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2a5bec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2df1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33216/0 (socket says 172.21.15.12:33216) 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.670+0000 7ff2a5bec640 1 -- 172.21.15.12:0/3893332103 learned_addr learned my addr 172.21.15.12:0/3893332103 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2bf410 0x562e5c2dc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2a63ed640 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2c9cb0 0x562e5c2dca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2a53eb640 1 -- 172.21.15.12:0/3893332103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2c9cb0 msgr2=0x562e5c2dca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2c9cb0 0x562e5c2dca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2a53eb640 1 -- 172.21.15.12:0/3893332103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 msgr2=0x562e5c2df1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2df1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2a53eb640 1 -- 172.21.15.12:0/3893332103 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e5c2dd230 con 0x562e5c2bf410 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2a53eb640 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2bf410 0x562e5c2dc4f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff29c09c030 tx=0x7ff29c09bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8be6bb7f82a6cc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2897fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2897fa640 1 -- 172.21.15.12:0/3893332103 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0b4040 con 0x562e5c2bf410 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.671+0000 7ff2897fa640 1 -- 172.21.15.12:0/3893332103 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7ff29c018b20 con 0x562e5c2bf410 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.672+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3893332103 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff29004a070 con 0x562e5c2bf410 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.672+0000 7ff2897fa640 1 -- 172.21.15.12:0/3893332103 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7ff29c09be70 con 0x562e5c2bf410 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.672+0000 7ff2aabe2740 10 client.27908 fetch_fsmap learned FSMap version 44 2024-09-19T06:51:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.672+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3893332103 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x562e5c344370 con 0x562e5c2bf410 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.672+0000 7ff2897fa640 1 -- 172.21.15.12:0/3893332103 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff29c09b780 con 0x562e5c2bf410 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.673+0000 7ff2897fa640 1 -- 172.21.15.12:0/3893332103 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 44) ==== 8362+0+0 (secure 0 0 0) 0x7ff29c09b2e0 con 0x562e5c2bf410 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.673+0000 7ff2aabe2740 10 client.27908 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.673+0000 7ff2aabe2740 10 client.27908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.673+0000 7ff2aabe2740 20 client.27908 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.673+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562e5c3448a0 0x562e5c346c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.673+0000 7ff2aabe2740 4 client.27908 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.673+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3893332103 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7ff29004a070 con 0x562e5c3448a0 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.673+0000 7ff2a5bec640 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562e5c3448a0 0x562e5c346c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.673+0000 7ff2a5bec640 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562e5c3448a0 0x562e5c346c90 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=251bfdd00cf9777d server_cookie=f3aa6bcca4709ab0 in_seq=0 out_seq=0 2024-09-19T06:51:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.673+0000 7ff2897fa640 10 client.27908 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.704+0000 7ff2897fa640 1 -- 172.21.15.12:0/3893332103 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7ff29004a070 con 0x562e5c3448a0 2024-09-19T06:51:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.704+0000 7ff2897fa640 10 client.27908 handle_command_reply: tid=0 2024-09-19T06:51:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.704+0000 7ff2aabe2740 1 client.27908 shutdown 2024-09-19T06:51:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.704+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3893332103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2bf410 msgr2=0x562e5c2dc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.704+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2bf410 0x562e5c2dc4f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff29c09c030 tx=0x7ff29c09bd50 comp rx=0 tx=0).stop 2024-09-19T06:51:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.705+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3893332103 shutdown_connections 2024-09-19T06:51:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.705+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562e5c3448a0 0x562e5c346c90 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.705+0000 7ff2897fa640 0 client.27908 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.705+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562e5c2c9cb0 0x562e5c2dca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.705+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562e5c2bf410 0x562e5c2dc4f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.705+0000 7ff2aabe2740 1 --2- 172.21.15.12:0/3893332103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562e5c2beaf0 0x562e5c2df1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.705+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3893332103 >> 172.21.15.12:0/3893332103 conn(0x562e5c2bb060 msgr2=0x562e5c2ba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.709+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3893332103 shutdown_connections 2024-09-19T06:51:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.710+0000 7ff2aabe2740 1 -- 172.21.15.12:0/3893332103 wait complete. 2024-09-19T06:51:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.710+0000 7ff2aabe2740 20 client.27908 trim_cache size 0 max 16384 2024-09-19T06:51:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:51:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:51:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:51:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:51:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.712+0000 7ff2a7e50640 1 -- 172.21.15.12:0/356615716 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff28c0a3610 msgr2=0x7ff28c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.712+0000 7ff2a7e50640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff28c0a3610 0x7ff28c0a5ad0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff298005fd0 tx=0x7ff298009500 comp rx=0 tx=0).stop 2024-09-19T06:51:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.712+0000 7ff2a7e50640 1 -- 172.21.15.12:0/356615716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2a0102470 msgr2=0x7ff2a01988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.712+0000 7ff2a7e50640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2a0102470 0x7ff2a01988a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00e9f0 tx=0x7ff29c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.714+0000 7ff2a7e50640 1 -- 172.21.15.12:0/356615716 shutdown_connections 2024-09-19T06:51:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.714+0000 7ff2a7e50640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2a0107b70 0x7ff2a019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.714+0000 7ff2a7e50640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff28c0a3610 0x7ff28c0a5ad0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.714+0000 7ff2a7e50640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2a0102470 0x7ff2a01988a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.714+0000 7ff2a7e50640 1 --2- 172.21.15.12:0/356615716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2a0101ad0 0x7ff2a0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.714+0000 7ff2a7e50640 1 -- 172.21.15.12:0/356615716 >> 172.21.15.12:0/356615716 conn(0x7ff2a00fd7b0 msgr2=0x7ff2a00fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.715+0000 7ff2a7e50640 1 -- 172.21.15.12:0/356615716 shutdown_connections 2024-09-19T06:51:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:17.715+0000 7ff2a7e50640 1 -- 172.21.15.12:0/356615716 wait complete. 2024-09-19T06:51:18.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:17 smithi016 ceph-mon[34911]: pgmap v347: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.0 MiB/s wr, 624 op/s 2024-09-19T06:51:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:18 smithi173 ceph-mon[35349]: pgmap v347: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.0 MiB/s wr, 624 op/s 2024-09-19T06:51:18.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:17 smithi012 ceph-mon[30937]: pgmap v347: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.0 MiB/s wr, 624 op/s 2024-09-19T06:51:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:20 smithi173 ceph-mon[35349]: pgmap v348: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.0 MiB/s wr, 624 op/s 2024-09-19T06:51:20.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:20 smithi012 ceph-mon[30937]: pgmap v348: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.0 MiB/s wr, 624 op/s 2024-09-19T06:51:20.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:20 smithi016 ceph-mon[34911]: pgmap v348: 97 pgs: 97 active+clean; 4.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 6.0 MiB/s wr, 624 op/s 2024-09-19T06:51:20.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 635.0 s, 2673.8 tps, lat 37.531 ms stddev 45.297 2024-09-19T06:51:21.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:21 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:51:21.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:21 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:51:21.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:21 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:51:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:22 smithi173 ceph-mon[35349]: pgmap v349: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.2 MiB/s wr, 648 op/s 2024-09-19T06:51:22.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:22 smithi012 ceph-mon[30937]: pgmap v349: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.2 MiB/s wr, 648 op/s 2024-09-19T06:51:22.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:22 smithi016 ceph-mon[34911]: pgmap v349: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.2 MiB/s wr, 648 op/s 2024-09-19T06:51:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:24 smithi173 ceph-mon[35349]: pgmap v350: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.4 MiB/s wr, 564 op/s 2024-09-19T06:51:24.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:24 smithi012 ceph-mon[30937]: pgmap v350: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.4 MiB/s wr, 564 op/s 2024-09-19T06:51:24.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:24 smithi016 ceph-mon[34911]: pgmap v350: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.4 MiB/s wr, 564 op/s 2024-09-19T06:51:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 640.0 s, 2127.2 tps, lat 46.839 ms stddev 55.454 2024-09-19T06:51:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:26 smithi173 ceph-mon[35349]: pgmap v351: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.9 MiB/s wr, 621 op/s 2024-09-19T06:51:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:26 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:51:26.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:26 smithi012 ceph-mon[30937]: pgmap v351: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.9 MiB/s wr, 621 op/s 2024-09-19T06:51:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:26 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:51:26.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:26 smithi016 ceph-mon[34911]: pgmap v351: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.9 MiB/s wr, 621 op/s 2024-09-19T06:51:26.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:26 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:51:27.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:27 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:51:27.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:27 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:51:27.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:27 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:51:27.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:27 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:51:27.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:27 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:51:27.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:27 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:51:27.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:27 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:51:27.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:27 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:51:27.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:27 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:51:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:28 smithi173 ceph-mon[35349]: pgmap v352: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.4 MiB/s wr, 778 op/s 2024-09-19T06:51:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:28 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:51:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:28 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:51:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:28 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:51:28.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:28 smithi012 ceph-mon[30937]: pgmap v352: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.4 MiB/s wr, 778 op/s 2024-09-19T06:51:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:28 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:51:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:28 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:51:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:28 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:51:28.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:28 smithi016 ceph-mon[34911]: pgmap v352: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.4 MiB/s wr, 778 op/s 2024-09-19T06:51:28.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:28 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:51:28.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:28 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:51:28.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:28 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:51:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:30 smithi173 ceph-mon[35349]: pgmap v353: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.1 MiB/s wr, 545 op/s 2024-09-19T06:51:30.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:30 smithi012 ceph-mon[30937]: pgmap v353: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.1 MiB/s wr, 545 op/s 2024-09-19T06:51:30.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:30 smithi016 ceph-mon[34911]: pgmap v353: 97 pgs: 97 active+clean; 4.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.1 MiB/s wr, 545 op/s 2024-09-19T06:51:30.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 645.0 s, 1905.6 tps, lat 52.449 ms stddev 53.626 2024-09-19T06:51:30.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.837+0000 7fe14acc9640 1 -- 172.21.15.12:0/2249741282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe144107b70 msgr2=0x7fe144107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.837+0000 7fe14acc9640 1 --2- 172.21.15.12:0/2249741282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe144107b70 0x7fe144107f50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe13401acb0 tx=0x7fe13403b5b0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.837+0000 7fe14acc9640 1 -- 172.21.15.12:0/2249741282 shutdown_connections 2024-09-19T06:51:30.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.837+0000 7fe14acc9640 1 --2- 172.21.15.12:0/2249741282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe144102470 0x7fe14410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.837+0000 7fe14acc9640 1 --2- 172.21.15.12:0/2249741282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe144101ad0 0x7fe144101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.837+0000 7fe14acc9640 1 --2- 172.21.15.12:0/2249741282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe144107b70 0x7fe144107f50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.837+0000 7fe14acc9640 1 -- 172.21.15.12:0/2249741282 >> 172.21.15.12:0/2249741282 conn(0x7fe1440fd7d0 msgr2=0x7fe1440ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.837+0000 7fe14acc9640 1 -- 172.21.15.12:0/2249741282 shutdown_connections 2024-09-19T06:51:30.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.837+0000 7fe14acc9640 1 -- 172.21.15.12:0/2249741282 wait complete. 2024-09-19T06:51:30.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe14acc9640 1 Processor -- start 2024-09-19T06:51:30.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe14acc9640 1 -- start start 2024-09-19T06:51:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe14acc9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe144101ad0 0x7fe1440759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe14acc9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe144102470 0x7fe144075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe14acc9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe144107b70 0x7fe14406fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe14acc9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe14406e5a0 con 0x7fe144102470 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe14acc9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe14406e420 con 0x7fe144101ad0 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe14acc9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe14406e720 con 0x7fe144107b70 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe13bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe144102470 0x7fe144075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe13bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe144102470 0x7fe144075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59318/0 (socket says 172.21.15.12:59318) 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe13bfff640 1 -- 172.21.15.12:0/2044060517 learned_addr learned my addr 172.21.15.12:0/2044060517 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe149266640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe144107b70 0x7fe14406fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.838+0000 7fe148a65640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe144101ad0 0x7fe1440759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.839+0000 7fe149266640 1 -- 172.21.15.12:0/2044060517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe144101ad0 msgr2=0x7fe1440759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.839+0000 7fe149266640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe144101ad0 0x7fe1440759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.839+0000 7fe149266640 1 -- 172.21.15.12:0/2044060517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe144102470 msgr2=0x7fe144075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.839+0000 7fe149266640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe144102470 0x7fe144075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.839+0000 7fe149266640 1 -- 172.21.15.12:0/2044060517 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe144070340 con 0x7fe144107b70 2024-09-19T06:51:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.839+0000 7fe149266640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe144107b70 0x7fe14406fa80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe13c003b80 tx=0x7fe13c009740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.840+0000 7fe1427fc640 1 -- 172.21.15.12:0/2044060517 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c005020 con 0x7fe144107b70 2024-09-19T06:51:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.840+0000 7fe1427fc640 1 -- 172.21.15.12:0/2044060517 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe13c0056a0 con 0x7fe144107b70 2024-09-19T06:51:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.840+0000 7fe14acc9640 1 -- 172.21.15.12:0/2044060517 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe144070630 con 0x7fe144107b70 2024-09-19T06:51:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.840+0000 7fe14acc9640 1 -- 172.21.15.12:0/2044060517 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14419a4b0 con 0x7fe144107b70 2024-09-19T06:51:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.840+0000 7fe1427fc640 1 -- 172.21.15.12:0/2044060517 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c01c680 con 0x7fe144107b70 2024-09-19T06:51:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.842+0000 7fe1427fc640 1 -- 172.21.15.12:0/2044060517 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe13c023020 con 0x7fe144107b70 2024-09-19T06:51:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe14da5e740 1 Processor -- start 2024-09-19T06:51:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe14da5e740 1 -- start start 2024-09-19T06:51:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77930ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b7793b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b7793bcb0 0x561b7793e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe14da5e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561b778952f0 con 0x561b77931410 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe14da5e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561b7783d270 con 0x561b77930af0 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe14da5e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561b778912b0 con 0x561b7793bcb0 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe148a65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b7793b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe148a65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b7793b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59328/0 (socket says 172.21.15.12:59328) 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe13bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77930ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe148a65640 1 -- 172.21.15.12:0/928880611 learned_addr learned my addr 172.21.15.12:0/928880611 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe1427fc640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe1300a35c0 0x7fe1300a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe13bfff640 1 --2- 172.21.15.12:0/928880611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b7793bcb0 0x561b7793e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.843+0000 7fe149266640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe1300a35c0 0x7fe1300a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe1427fc640 1 -- 172.21.15.12:0/2044060517 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7fe13c0d7950 con 0x7fe144107b70 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe148a65640 1 -- 172.21.15.12:0/928880611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b7793bcb0 msgr2=0x561b7793e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe148a65640 1 --2- 172.21.15.12:0/928880611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b7793bcb0 0x561b7793e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe148a65640 1 -- 172.21.15.12:0/928880611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 msgr2=0x561b77930ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe148a65640 1 --2- 172.21.15.12:0/928880611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77930ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe148a65640 1 -- 172.21.15.12:0/928880611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7783c340 con 0x561b77931410 2024-09-19T06:51:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe13bfff640 1 --2- 172.21.15.12:0/928880611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77930ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe148a65640 1 --2- 172.21.15.12:0/928880611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b7793b770 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe134045000 tx=0x7fe134005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03315bcf2e77618 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe149266640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe1300a35c0 0x7fe1300a5a80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0a3830 tx=0x7fe13c0737d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe13affd640 1 -- 172.21.15.12:0/928880611 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1340425c0 con 0x561b77931410 2024-09-19T06:51:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe13affd640 1 -- 172.21.15.12:0/928880611 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe134042760 con 0x561b77931410 2024-09-19T06:51:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.844+0000 7fe13affd640 1 -- 172.21.15.12:0/928880611 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134004370 con 0x561b77931410 2024-09-19T06:51:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.845+0000 7fe14da5e740 1 -- 172.21.15.12:0/928880611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 msgr2=0x561b7793b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.845+0000 7fe14da5e740 1 --2- 172.21.15.12:0/928880611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b7793b770 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe134045000 tx=0x7fe134005ef0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.845+0000 7fe14da5e740 1 -- 172.21.15.12:0/928880611 shutdown_connections 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.845+0000 7fe14da5e740 1 --2- 172.21.15.12:0/928880611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b7793bcb0 0x561b7793e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.845+0000 7fe14da5e740 1 --2- 172.21.15.12:0/928880611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b7793b770 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.845+0000 7fe14da5e740 1 --2- 172.21.15.12:0/928880611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77930ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.845+0000 7fe14da5e740 1 -- 172.21.15.12:0/928880611 >> 172.21.15.12:0/928880611 conn(0x561b7792d060 msgr2=0x561b7792d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.845+0000 7fe14da5e740 1 -- 172.21.15.12:0/928880611 shutdown_connections 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.846+0000 7fe14da5e740 1 -- 172.21.15.12:0/928880611 wait complete. 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.846+0000 7fe14da5e740 1 -- start start 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.846+0000 7fe14da5e740 1 Processor -- start 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77938bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 0x561b779390f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7793bcb0 0x561b77939630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe14da5e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561b7793e880 con 0x561b7793bcb0 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe14da5e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561b7781e290 con 0x561b77930af0 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe14da5e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561b7793ea00 con 0x561b77931410 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe14da5e740 10 client.0 _ll_register_callbacks cb 0x561b7784f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe13bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77938bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe13bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77938bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60648/0 (socket says 172.21.15.12:60648) 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe13bfff640 1 -- 172.21.15.12:0/3912161999 learned_addr learned my addr 172.21.15.12:0/3912161999 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7793bcb0 0x561b77939630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe148a65640 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 0x561b779390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe13bfff640 1 -- 172.21.15.12:0/3912161999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 msgr2=0x561b779390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 0x561b779390f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe13bfff640 1 -- 172.21.15.12:0/3912161999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7793bcb0 msgr2=0x561b77939630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7793bcb0 0x561b77939630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.847+0000 7fe13bfff640 1 -- 172.21.15.12:0/3912161999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b775a8210 con 0x561b77930af0 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77938bb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe12c012d00 tx=0x7fe12c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c8e3ecd8b6f12a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe123fff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe123fff640 1 -- 172.21.15.12:0/3912161999 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c01a040 con 0x561b77930af0 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe14da5e740 1 -- 172.21.15.12:0/3912161999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe134042760 con 0x561b77930af0 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe123fff640 1 -- 172.21.15.12:0/3912161999 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7fe12c011220 con 0x561b77930af0 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe123fff640 1 -- 172.21.15.12:0/3912161999 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fe12c00fe60 con 0x561b77930af0 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe14da5e740 10 client.27920 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe14da5e740 1 -- 172.21.15.12:0/3912161999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x561b77674620 con 0x561b77930af0 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe123fff640 1 -- 172.21.15.12:0/3912161999 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe134042760 con 0x561b77930af0 2024-09-19T06:51:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe123fff640 1 -- 172.21.15.12:0/3912161999 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7fe12c0047a0 con 0x561b77930af0 2024-09-19T06:51:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe14da5e740 10 client.27920 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe14da5e740 10 client.27920 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe14da5e740 20 client.27920 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561b7794c090 0x561b7794e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe14da5e740 4 client.27920 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.848+0000 7fe14da5e740 1 -- 172.21.15.12:0/3912161999 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b778a2a20 con 0x561b7794c090 2024-09-19T06:51:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.849+0000 7fe148a65640 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561b7794c090 0x561b7794e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.849+0000 7fe123fff640 10 client.27920 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.849+0000 7fe148a65640 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561b7794c090 0x561b7794e530 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5501d18c00c29443 server_cookie=9721f48c8ff6fcae in_seq=0 out_seq=0 2024-09-19T06:51:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe123fff640 1 -- 172.21.15.12:0/3912161999 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b778a2a20 con 0x561b7794c090 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe123fff640 10 client.27920 handle_command_reply: tid=0 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 client.27920 shutdown 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 -- 172.21.15.12:0/3912161999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 msgr2=0x561b77938bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77938bb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe12c012d00 tx=0x7fe12c004730 comp rx=0 tx=0).stop 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 -- 172.21.15.12:0/3912161999 shutdown_connections 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561b7794c090 0x561b7794e530 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b7793bcb0 0x561b77939630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 0x561b779390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3912161999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77938bb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 -- 172.21.15.12:0/3912161999 >> 172.21.15.12:0/3912161999 conn(0x561b7792d060 msgr2=0x561b77932dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe123fff640 0 client.27920 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 -- 172.21.15.12:0/3912161999 shutdown_connections 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 1 -- 172.21.15.12:0/3912161999 wait complete. 2024-09-19T06:51:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.850+0000 7fe14da5e740 20 client.27920 trim_cache size 0 max 16384 2024-09-19T06:51:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe14da5e740 1 Processor -- start 2024-09-19T06:51:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe14da5e740 1 -- start start 2024-09-19T06:51:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77930af0 0x561b779335b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 0x561b77939460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b7793bcb0 0x561b7793ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe14da5e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1441a30b0 con 0x561b77930af0 2024-09-19T06:51:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe14da5e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe1441a4c80 con 0x561b7793bcb0 2024-09-19T06:51:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe14da5e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1441a3780 con 0x561b77931410 2024-09-19T06:51:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe13bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77930af0 0x561b779335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe13bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77930af0 0x561b779335b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59352/0 (socket says 172.21.15.12:59352) 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.871+0000 7fe13bfff640 1 -- 172.21.15.12:0/3149809395 learned_addr learned my addr 172.21.15.12:0/3149809395 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3149809395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b7793bcb0 0x561b7793ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe148a65640 1 --2- 172.21.15.12:0/3149809395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 0x561b77939460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe13bfff640 1 -- 172.21.15.12:0/3149809395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 msgr2=0x561b77939460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3149809395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 0x561b77939460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe13bfff640 1 -- 172.21.15.12:0/3149809395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b7793bcb0 msgr2=0x561b7793ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3149809395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b7793bcb0 0x561b7793ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe13bfff640 1 -- 172.21.15.12:0/3149809395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b77930870 con 0x561b77930af0 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe148a65640 1 --2- 172.21.15.12:0/3149809395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 0x561b77939460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3149809395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77930af0 0x561b779335b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe12c015040 tx=0x7fe12c012650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f280fc3e9a60b073 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe13a7fc640 1 -- 172.21.15.12:0/3149809395 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c004020 con 0x561b77930af0 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.872+0000 7fe13a7fc640 1 -- 172.21.15.12:0/3149809395 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe12c0035f0 con 0x561b77930af0 2024-09-19T06:51:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.873+0000 7fe13a7fc640 1 -- 172.21.15.12:0/3149809395 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c005040 con 0x561b77930af0 2024-09-19T06:51:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 -- 172.21.15.12:0/3149809395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77930af0 msgr2=0x561b779335b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3149809395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77930af0 0x561b779335b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe12c015040 tx=0x7fe12c012650 comp rx=0 tx=0).stop 2024-09-19T06:51:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 -- 172.21.15.12:0/3149809395 shutdown_connections 2024-09-19T06:51:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3149809395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b7793bcb0 0x561b7793ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3149809395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b77931410 0x561b77939460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3149809395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77930af0 0x561b779335b0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 -- 172.21.15.12:0/3149809395 >> 172.21.15.12:0/3149809395 conn(0x561b7792d060 msgr2=0x561b7793a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 -- 172.21.15.12:0/3149809395 shutdown_connections 2024-09-19T06:51:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 -- 172.21.15.12:0/3149809395 wait complete. 2024-09-19T06:51:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 -- start start 2024-09-19T06:51:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.874+0000 7fe14da5e740 1 Processor -- start 2024-09-19T06:51:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77943c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b779441d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe14da5e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b7793bcb0 0x561b77934ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe14da5e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1441a45b0 con 0x561b77931410 2024-09-19T06:51:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe14da5e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe1441a3ee0 con 0x561b77930af0 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe14da5e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1441a10b0 con 0x561b7793bcb0 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe14da5e740 10 client.0 _ll_register_callbacks cb 0x7fe12c0125a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe148a65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b779441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe148a65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b779441d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59364/0 (socket says 172.21.15.12:59364) 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe148a65640 1 -- 172.21.15.12:0/3066258444 learned_addr learned my addr 172.21.15.12:0/3066258444 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77943c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b7793bcb0 0x561b77934ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe148a65640 1 -- 172.21.15.12:0/3066258444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b7793bcb0 msgr2=0x561b77934ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe148a65640 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b7793bcb0 0x561b77934ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe148a65640 1 -- 172.21.15.12:0/3066258444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 msgr2=0x561b77943c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe148a65640 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77943c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.875+0000 7fe148a65640 1 -- 172.21.15.12:0/3066258444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b77935420 con 0x561b77931410 2024-09-19T06:51:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe148a65640 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b779441d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe13401aa70 tx=0x7fe134003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e73d8d315a5159 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe123fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe123fff640 1 -- 172.21.15.12:0/3066258444 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134003970 con 0x561b77931410 2024-09-19T06:51:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe123fff640 1 -- 172.21.15.12:0/3066258444 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7fe134003b10 con 0x561b77931410 2024-09-19T06:51:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe14da5e740 1 -- 172.21.15.12:0/3066258444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe12c0035f0 con 0x561b77931410 2024-09-19T06:51:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe123fff640 1 -- 172.21.15.12:0/3066258444 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fe13406f050 con 0x561b77931410 2024-09-19T06:51:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe14da5e740 10 client.18606 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe14da5e740 1 -- 172.21.15.12:0/3066258444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x561b779b6410 con 0x561b77931410 2024-09-19T06:51:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe123fff640 1 -- 172.21.15.12:0/3066258444 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe12c0035f0 con 0x561b77931410 2024-09-19T06:51:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe123fff640 1 -- 172.21.15.12:0/3066258444 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7fe13405e070 con 0x561b77931410 2024-09-19T06:51:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe14da5e740 10 client.18606 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe14da5e740 10 client.18606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe14da5e740 20 client.18606 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561b779b67a0 0x561b779b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe14da5e740 4 client.18606 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:51:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.876+0000 7fe14da5e740 1 -- 172.21.15.12:0/3066258444 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b7789cd70 con 0x561b779b67a0 2024-09-19T06:51:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.877+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561b779b67a0 0x561b779b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.877+0000 7fe123fff640 10 client.18606 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.877+0000 7fe13bfff640 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561b779b67a0 0x561b779b8b90 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ef79863868e4edc server_cookie=e525deb19deaf0fe in_seq=0 out_seq=0 2024-09-19T06:51:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe123fff640 1 -- 172.21.15.12:0/3066258444 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b7789cd70 con 0x561b779b67a0 2024-09-19T06:51:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe123fff640 10 client.18606 handle_command_reply: tid=0 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 client.18606 shutdown 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 -- 172.21.15.12:0/3066258444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 msgr2=0x561b779441d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b779441d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe13401aa70 tx=0x7fe134003e70 comp rx=0 tx=0).stop 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 -- 172.21.15.12:0/3066258444 shutdown_connections 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561b779b67a0 0x561b779b8b90 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe123fff640 0 client.18606 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561b7793bcb0 0x561b77934ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b77931410 0x561b779441d0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 --2- 172.21.15.12:0/3066258444 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561b77930af0 0x561b77943c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 -- 172.21.15.12:0/3066258444 >> 172.21.15.12:0/3066258444 conn(0x561b7792d060 msgr2=0x561b7792c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 -- 172.21.15.12:0/3066258444 shutdown_connections 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 1 -- 172.21.15.12:0/3066258444 wait complete. 2024-09-19T06:51:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.888+0000 7fe14da5e740 20 client.18606 trim_cache size 0 max 16384 2024-09-19T06:51:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:51:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:51:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:51:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:51:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.893+0000 7fe14acc9640 1 -- 172.21.15.12:0/2044060517 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe1300a35c0 msgr2=0x7fe1300a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.893+0000 7fe14acc9640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe1300a35c0 0x7fe1300a5a80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0a3830 tx=0x7fe13c0737d0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.893+0000 7fe14acc9640 1 -- 172.21.15.12:0/2044060517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe144107b70 msgr2=0x7fe14406fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.893+0000 7fe14acc9640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe144107b70 0x7fe14406fa80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe13c003b80 tx=0x7fe13c009740 comp rx=0 tx=0).stop 2024-09-19T06:51:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.897+0000 7fe14acc9640 1 -- 172.21.15.12:0/2044060517 shutdown_connections 2024-09-19T06:51:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.897+0000 7fe14acc9640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe1300a35c0 0x7fe1300a5a80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.897+0000 7fe14acc9640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe144107b70 0x7fe14406fa80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.897+0000 7fe14acc9640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe144102470 0x7fe144075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.897+0000 7fe14acc9640 1 --2- 172.21.15.12:0/2044060517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe144101ad0 0x7fe1440759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.897+0000 7fe14acc9640 1 -- 172.21.15.12:0/2044060517 >> 172.21.15.12:0/2044060517 conn(0x7fe1440fd7d0 msgr2=0x7fe1440fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.900+0000 7fe14acc9640 1 -- 172.21.15.12:0/2044060517 shutdown_connections 2024-09-19T06:51:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:30.904+0000 7fe14acc9640 1 -- 172.21.15.12:0/2044060517 wait complete. 2024-09-19T06:51:32.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:32 smithi173 ceph-mon[35349]: pgmap v354: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.7 MiB/s wr, 820 op/s 2024-09-19T06:51:32.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:32 smithi012 ceph-mon[30937]: pgmap v354: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.7 MiB/s wr, 820 op/s 2024-09-19T06:51:32.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:32 smithi016 ceph-mon[34911]: pgmap v354: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.7 MiB/s wr, 820 op/s 2024-09-19T06:51:32.785 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:51:33.179 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.765+0000 7f20048c8640 1 -- 172.21.15.12:0/3692948135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2000102790 msgr2=0x7f20001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.765+0000 7f20048c8640 1 --2- 172.21.15.12:0/3692948135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2000102790 0x7f20001067e0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009900 tx=0x7f1fe802a410 comp rx=0 tx=0).stop 2024-09-19T06:51:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.765+0000 7f20048c8640 1 -- 172.21.15.12:0/3692948135 shutdown_connections 2024-09-19T06:51:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.765+0000 7f20048c8640 1 --2- 172.21.15.12:0/3692948135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2000106f10 0x7f200010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.765+0000 7f20048c8640 1 --2- 172.21.15.12:0/3692948135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2000102790 0x7f20001067e0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.765+0000 7f20048c8640 1 --2- 172.21.15.12:0/3692948135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2000101de0 0x7f20001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.765+0000 7f20048c8640 1 -- 172.21.15.12:0/3692948135 >> 172.21.15.12:0/3692948135 conn(0x7f20000fd880 msgr2=0x7f20000ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.765+0000 7f20048c8640 1 -- 172.21.15.12:0/3692948135 shutdown_connections 2024-09-19T06:51:33.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.765+0000 7f20048c8640 1 -- 172.21.15.12:0/3692948135 wait complete. 2024-09-19T06:51:33.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.766+0000 7f20048c8640 1 Processor -- start 2024-09-19T06:51:33.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.766+0000 7f20048c8640 1 -- start start 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.766+0000 7f20048c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2000101de0 0x7f200019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.766+0000 7f20048c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2000102790 0x7f200019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.766+0000 7f20048c8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2000106f10 0x7f200019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.766+0000 7f20048c8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2000111f70 con 0x7f2000101de0 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.766+0000 7f20048c8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2000111df0 con 0x7f2000102790 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.766+0000 7f20048c8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20001120f0 con 0x7f2000106f10 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ffe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2000101de0 0x7f200019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ffe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2000101de0 0x7f200019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59386/0 (socket says 172.21.15.12:59386) 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ffe59c640 1 -- 172.21.15.12:0/2559952644 learned_addr learned my addr 172.21.15.12:0/2559952644 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ff7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2000102790 0x7f200019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ffed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2000106f10 0x7f200019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ffe59c640 1 -- 172.21.15.12:0/2559952644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2000106f10 msgr2=0x7f200019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:33.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2000106f10 0x7f200019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ffe59c640 1 -- 172.21.15.12:0/2559952644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2000102790 msgr2=0x7f200019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:33.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2000102790 0x7f200019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ffe59c640 1 -- 172.21.15.12:0/2559952644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200019f5f0 con 0x7f2000101de0 2024-09-19T06:51:33.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.767+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2000101de0 0x7f200019a640 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000e9f0 tx=0x7f1ff000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:33.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.768+0000 7f1ff77fe640 1 -- 172.21.15.12:0/2559952644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000cd80 con 0x7f2000101de0 2024-09-19T06:51:33.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.768+0000 7f1ff77fe640 1 -- 172.21.15.12:0/2559952644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff0010910 con 0x7f2000101de0 2024-09-19T06:51:33.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.768+0000 7f1ff77fe640 1 -- 172.21.15.12:0/2559952644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0018990 con 0x7f2000101de0 2024-09-19T06:51:33.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.768+0000 7f20048c8640 1 -- 172.21.15.12:0/2559952644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200019f8e0 con 0x7f2000101de0 2024-09-19T06:51:33.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.768+0000 7f20048c8640 1 -- 172.21.15.12:0/2559952644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20001a71c0 con 0x7f2000101de0 2024-09-19T06:51:33.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.772+0000 7f2006ca1740 1 Processor -- start 2024-09-19T06:51:33.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.772+0000 7f2006ca1740 1 -- start start 2024-09-19T06:51:33.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ff77fe640 1 -- 172.21.15.12:0/2559952644 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1ff0010ac0 con 0x7f2000101de0 2024-09-19T06:51:33.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a981f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a982a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 0x5587a982ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f2006ca1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5587a97852e0 con 0x5587a981fdc0 2024-09-19T06:51:33.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f2006ca1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5587a972cce0 con 0x5587a982a680 2024-09-19T06:51:33.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f2006ca1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5587a97812a0 con 0x5587a981f4a0 2024-09-19T06:51:33.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a982a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a981f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffe59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a982a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59390/0 (socket says 172.21.15.12:59390) 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ff7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 0x5587a982ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a981f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:32936/0 (socket says 172.21.15.12:32936) 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffe59c640 1 -- 172.21.15.12:0/2440574840 learned_addr learned my addr 172.21.15.12:0/2440574840 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffe59c640 1 -- 172.21.15.12:0/2440574840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 msgr2=0x5587a981f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/2440574840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a981f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffe59c640 1 -- 172.21.15.12:0/2440574840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 msgr2=0x5587a982ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/2440574840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 0x5587a982ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffe59c640 1 -- 172.21.15.12:0/2440574840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a9711440 con 0x5587a981fdc0 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ffed9d640 1 --2- 172.21.15.12:0/2440574840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a981f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:33.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.773+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/2440574840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 0x5587a982ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:33.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.774+0000 7f1ff77fe640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1fec0a3430 0x7f1fec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.774+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/2440574840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a982a140 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00cd690 tx=0x7f1ff00d8780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a178639949012e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:33.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.774+0000 7f1ffed9d640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1fec0a3430 0x7f1fec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.774+0000 7f1ff77fe640 1 -- 172.21.15.12:0/2559952644 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f1ff00d0070 con 0x7f2000101de0 2024-09-19T06:51:33.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.774+0000 7f1ff4ff9640 1 -- 172.21.15.12:0/2440574840 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0098600 con 0x5587a981fdc0 2024-09-19T06:51:33.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.774+0000 7f1ff4ff9640 1 -- 172.21.15.12:0/2440574840 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff009c360 con 0x5587a981fdc0 2024-09-19T06:51:33.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.774+0000 7f1ff4ff9640 1 -- 172.21.15.12:0/2440574840 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff009bcc0 con 0x5587a981fdc0 2024-09-19T06:51:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.775+0000 7f2006ca1740 1 -- 172.21.15.12:0/2440574840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 msgr2=0x5587a982a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.775+0000 7f2006ca1740 1 --2- 172.21.15.12:0/2440574840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a982a140 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00cd690 tx=0x7f1ff00d8780 comp rx=0 tx=0).stop 2024-09-19T06:51:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.775+0000 7f1ffed9d640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1fec0a3430 0x7f1fec0a58f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8005fd0 tx=0x7f1ff80096a0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.775+0000 7f2006ca1740 1 -- 172.21.15.12:0/2440574840 shutdown_connections 2024-09-19T06:51:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.775+0000 7f2006ca1740 1 --2- 172.21.15.12:0/2440574840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 0x5587a982ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.775+0000 7f2006ca1740 1 --2- 172.21.15.12:0/2440574840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a982a140 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.775+0000 7f2006ca1740 1 --2- 172.21.15.12:0/2440574840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a981f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.775+0000 7f2006ca1740 1 -- 172.21.15.12:0/2440574840 >> 172.21.15.12:0/2440574840 conn(0x5587a981ba30 msgr2=0x5587a981be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.776+0000 7f2006ca1740 1 -- 172.21.15.12:0/2440574840 shutdown_connections 2024-09-19T06:51:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.776+0000 7f2006ca1740 1 -- 172.21.15.12:0/2440574840 wait complete. 2024-09-19T06:51:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.776+0000 7f2006ca1740 1 -- start start 2024-09-19T06:51:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.776+0000 7f2006ca1740 1 Processor -- start 2024-09-19T06:51:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a9829fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a9827250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 0x5587a9827790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f2006ca1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5587a982d250 con 0x5587a981fdc0 2024-09-19T06:51:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f2006ca1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5587a9740050 con 0x5587a981f4a0 2024-09-19T06:51:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f2006ca1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5587a982d3d0 con 0x5587a982a680 2024-09-19T06:51:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f2006ca1740 10 client.0 _ll_register_callbacks cb 0x5587a9780160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f1ffe59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a9829fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f1ffe59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a9829fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60706/0 (socket says 172.21.15.12:60706) 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f1ffe59c640 1 -- 172.21.15.12:0/3786525734 learned_addr learned my addr 172.21.15.12:0/3786525734 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f1ffed9d640 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 0x5587a9827790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a9827250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f1ffe59c640 1 -- 172.21.15.12:0/3786525734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 msgr2=0x5587a9827790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 0x5587a9827790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f1ffe59c640 1 -- 172.21.15.12:0/3786525734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 msgr2=0x5587a9827250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.777+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a9827250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f1ffe59c640 1 -- 172.21.15.12:0/3786525734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a94f63c0 con 0x5587a981f4a0 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a9827250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a9829fa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000c6a0 tx=0x7f1ff0009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=816c545d587e4a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f1fe5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:51:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/3786525734 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff009bea0 con 0x5587a981f4a0 2024-09-19T06:51:33.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f2006ca1740 1 -- 172.21.15.12:0/3786525734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ff009c360 con 0x5587a981f4a0 2024-09-19T06:51:33.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/3786525734 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f1ff009c7c0 con 0x5587a981f4a0 2024-09-19T06:51:33.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/3786525734 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f1ff009c130 con 0x5587a981f4a0 2024-09-19T06:51:33.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f2006ca1740 10 client.27938 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:33.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f2006ca1740 1 -- 172.21.15.12:0/3786525734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5587a982d250 con 0x5587a981f4a0 2024-09-19T06:51:33.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/3786525734 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff009c360 con 0x5587a981f4a0 2024-09-19T06:51:33.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/3786525734 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f1ff00a4a90 con 0x5587a981f4a0 2024-09-19T06:51:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f2006ca1740 10 client.27938 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.778+0000 7f2006ca1740 10 client.27938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.779+0000 7f2006ca1740 20 client.27938 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.779+0000 7f2006ca1740 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5587a9842560 0x5587a9844950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.779+0000 7f2006ca1740 4 client.27938 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.779+0000 7f2006ca1740 1 -- 172.21.15.12:0/3786525734 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587a9792850 con 0x5587a9842560 2024-09-19T06:51:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.779+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5587a9842560 0x5587a9844950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.779+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5587a9842560 0x5587a9844950 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a35b9eec1ad168f9 server_cookie=30b2f5bc277af198 in_seq=0 out_seq=0 2024-09-19T06:51:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.779+0000 7f1fe5ffb640 10 client.27938 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/3786525734 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587a9792850 con 0x5587a9842560 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f1fe5ffb640 10 client.27938 handle_command_reply: tid=0 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 client.27938 shutdown 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 -- 172.21.15.12:0/3786525734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 msgr2=0x5587a9829fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a9829fa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000c6a0 tx=0x7f1ff0009770 comp rx=0 tx=0).stop 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 -- 172.21.15.12:0/3786525734 shutdown_connections 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5587a9842560 0x5587a9844950 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 0x5587a9827790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a9827250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f1fe5ffb640 0 client.27938 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 --2- 172.21.15.12:0/3786525734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a9829fa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 -- 172.21.15.12:0/3786525734 >> 172.21.15.12:0/3786525734 conn(0x5587a981ba30 msgr2=0x5587a9821710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 -- 172.21.15.12:0/3786525734 shutdown_connections 2024-09-19T06:51:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 1 -- 172.21.15.12:0/3786525734 wait complete. 2024-09-19T06:51:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.780+0000 7f2006ca1740 20 client.27938 trim_cache size 0 max 16384 2024-09-19T06:51:33.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.807+0000 7f2006ca1740 1 Processor -- start 2024-09-19T06:51:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.807+0000 7f2006ca1740 1 -- start start 2024-09-19T06:51:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.807+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a984a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.807+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a984a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.807+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 0x5587a98259f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.807+0000 7f2006ca1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20001aba10 con 0x5587a981fdc0 2024-09-19T06:51:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.807+0000 7f2006ca1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20001ad5e0 con 0x5587a982a680 2024-09-19T06:51:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.807+0000 7f2006ca1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20001ac0e0 con 0x5587a981f4a0 2024-09-19T06:51:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ffe59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a984a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ffe59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a984a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:32950/0 (socket says 172.21.15.12:32950) 2024-09-19T06:51:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ffe59c640 1 -- 172.21.15.12:0/4217433818 learned_addr learned my addr 172.21.15.12:0/4217433818 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ffed9d640 1 --2- 172.21.15.12:0/4217433818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 0x5587a98259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/4217433818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a984a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ffe59c640 1 -- 172.21.15.12:0/4217433818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 msgr2=0x5587a98259f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/4217433818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 0x5587a98259f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ffe59c640 1 -- 172.21.15.12:0/4217433818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 msgr2=0x5587a984a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/4217433818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a984a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ffe59c640 1 -- 172.21.15.12:0/4217433818 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a981f220 con 0x5587a981f4a0 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.808+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/4217433818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a984a040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000e9c0 tx=0x7f1ff009a870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8131709a24ebaa94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.809+0000 7f1fe7fff640 1 -- 172.21.15.12:0/4217433818 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff009bea0 con 0x5587a981f4a0 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.809+0000 7f1fe7fff640 1 -- 172.21.15.12:0/4217433818 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff00d3990 con 0x5587a981f4a0 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.809+0000 7f1fe7fff640 1 -- 172.21.15.12:0/4217433818 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0098600 con 0x5587a981f4a0 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.809+0000 7f2006ca1740 1 -- 172.21.15.12:0/4217433818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 msgr2=0x5587a984a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.809+0000 7f2006ca1740 1 --2- 172.21.15.12:0/4217433818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a984a040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000e9c0 tx=0x7f1ff009a870 comp rx=0 tx=0).stop 2024-09-19T06:51:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.810+0000 7f2006ca1740 1 -- 172.21.15.12:0/4217433818 shutdown_connections 2024-09-19T06:51:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.810+0000 7f2006ca1740 1 --2- 172.21.15.12:0/4217433818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a982a680 0x5587a98259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.810+0000 7f2006ca1740 1 --2- 172.21.15.12:0/4217433818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a984a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.810+0000 7f2006ca1740 1 --2- 172.21.15.12:0/4217433818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a981f4a0 0x5587a984a040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.810+0000 7f2006ca1740 1 -- 172.21.15.12:0/4217433818 >> 172.21.15.12:0/4217433818 conn(0x5587a981ba30 msgr2=0x5587a9822900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.810+0000 7f2006ca1740 1 -- 172.21.15.12:0/4217433818 shutdown_connections 2024-09-19T06:51:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.810+0000 7f2006ca1740 1 -- 172.21.15.12:0/4217433818 wait complete. 2024-09-19T06:51:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.810+0000 7f2006ca1740 1 -- start start 2024-09-19T06:51:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f2006ca1740 1 Processor -- start 2024-09-19T06:51:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a98a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a98a5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f2006ca1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 0x5587a98a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f2006ca1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f20001acf10 con 0x5587a981fdc0 2024-09-19T06:51:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f2006ca1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20001ac840 con 0x5587a981f4a0 2024-09-19T06:51:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f2006ca1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20001a9a90 con 0x5587a982a680 2024-09-19T06:51:33.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f2006ca1740 10 client.0 _ll_register_callbacks cb 0x7f1fe8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f1ff7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a98a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f1ff7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a98a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59422/0 (socket says 172.21.15.12:59422) 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f1ff7fff640 1 -- 172.21.15.12:0/1233644711 learned_addr learned my addr 172.21.15.12:0/1233644711 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a98a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.811+0000 7f1ffed9d640 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 0x5587a98a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1ffe59c640 1 -- 172.21.15.12:0/1233644711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 msgr2=0x5587a98a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 0x5587a98a5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1ffe59c640 1 -- 172.21.15.12:0/1233644711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 msgr2=0x5587a98a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a98a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1ffe59c640 1 -- 172.21.15.12:0/1233644711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a98a63c0 con 0x5587a981f4a0 2024-09-19T06:51:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a98a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1ffed9d640 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 0x5587a98a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1ffe59c640 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a98a85a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5587a97928a0 tx=0x7f1ff0018ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8280d5cda6a8474f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1fe5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/1233644711 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff009bcc0 con 0x5587a981f4a0 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/1233644711 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f1ff009b7b0 con 0x5587a981f4a0 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.812+0000 7f2006ca1740 1 -- 172.21.15.12:0/1233644711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ff00d3990 con 0x5587a981f4a0 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/1233644711 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f1ff00a6030 con 0x5587a981f4a0 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f2006ca1740 10 client.27944 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f2006ca1740 1 -- 172.21.15.12:0/1233644711 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5587a98a63c0 con 0x5587a981f4a0 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/1233644711 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff00a4f20 con 0x5587a981f4a0 2024-09-19T06:51:33.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/1233644711 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f1ff00d3170 con 0x5587a981f4a0 2024-09-19T06:51:33.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f2006ca1740 10 client.27944 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:33.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f2006ca1740 10 client.27944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:33.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f2006ca1740 20 client.27944 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:33.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f2006ca1740 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5587a98375c0 0x5587a98399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:33.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f2006ca1740 4 client.27944 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:51:33.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f2006ca1740 1 -- 172.21.15.12:0/1233644711 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1ff00d3990 con 0x5587a98375c0 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.813+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5587a98375c0 0x5587a98399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f1ff7fff640 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5587a98375c0 0x5587a98399b0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b61c65902c311543 server_cookie=f3b46319c0debfa2 in_seq=0 out_seq=0 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f1fe5ffb640 10 client.27944 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f1fe5ffb640 1 -- 172.21.15.12:0/1233644711 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f1ff00d3990 con 0x5587a98375c0 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f1fe5ffb640 10 client.27944 handle_command_reply: tid=0 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 client.27944 shutdown 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 -- 172.21.15.12:0/1233644711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 msgr2=0x5587a98a85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a98a85a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5587a97928a0 tx=0x7f1ff0018ba0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 -- 172.21.15.12:0/1233644711 shutdown_connections 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5587a98375c0 0x5587a98399b0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587a982a680 0x5587a98a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f1fe5ffb640 0 client.27944 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587a981fdc0 0x5587a98a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 --2- 172.21.15.12:0/1233644711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587a981f4a0 0x5587a98a85a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 -- 172.21.15.12:0/1233644711 >> 172.21.15.12:0/1233644711 conn(0x5587a981ba30 msgr2=0x5587a981a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 -- 172.21.15.12:0/1233644711 shutdown_connections 2024-09-19T06:51:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.814+0000 7f2006ca1740 1 -- 172.21.15.12:0/1233644711 wait complete. 2024-09-19T06:51:33.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.815+0000 7f2006ca1740 20 client.27944 trim_cache size 0 max 16384 2024-09-19T06:51:33.822 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:51:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:51:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:51:33.822 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:51:33.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.815+0000 7f20048c8640 1 -- 172.21.15.12:0/2559952644 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1fec0a3430 msgr2=0x7f1fec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:33.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.815+0000 7f20048c8640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1fec0a3430 0x7f1fec0a58f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8005fd0 tx=0x7f1ff80096a0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.815+0000 7f20048c8640 1 -- 172.21.15.12:0/2559952644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2000101de0 msgr2=0x7f200019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.815+0000 7f20048c8640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2000101de0 0x7f200019a640 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000e9f0 tx=0x7f1ff000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.816+0000 7f20048c8640 1 -- 172.21.15.12:0/2559952644 shutdown_connections 2024-09-19T06:51:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.816+0000 7f20048c8640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1fec0a3430 0x7f1fec0a58f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.816+0000 7f20048c8640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2000106f10 0x7f200019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.816+0000 7f20048c8640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2000102790 0x7f200019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.816+0000 7f20048c8640 1 --2- 172.21.15.12:0/2559952644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2000101de0 0x7f200019a640 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.816+0000 7f20048c8640 1 -- 172.21.15.12:0/2559952644 >> 172.21.15.12:0/2559952644 conn(0x7f20000fd880 msgr2=0x7f20000ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.816+0000 7f20048c8640 1 -- 172.21.15.12:0/2559952644 shutdown_connections 2024-09-19T06:51:33.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:33.816+0000 7f20048c8640 1 -- 172.21.15.12:0/2559952644 wait complete. 2024-09-19T06:51:34.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:34 smithi173 ceph-mon[35349]: pgmap v355: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 533 op/s 2024-09-19T06:51:34.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:34 smithi012 ceph-mon[30937]: pgmap v355: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 533 op/s 2024-09-19T06:51:34.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:34 smithi016 ceph-mon[34911]: pgmap v355: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.9 MiB/s wr, 533 op/s 2024-09-19T06:51:34.735 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:51:34.736 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:51:35.092 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 650.0 s, 1847.8 tps, lat 54.244 ms stddev 59.537 2024-09-19T06:51:35.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.683+0000 7f26b7aec640 1 -- 172.21.15.12:0/744136584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b01027a0 msgr2=0x7f26b01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:35.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.683+0000 7f26b7aec640 1 --2- 172.21.15.12:0/744136584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b01027a0 0x7f26b01067f0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009900 tx=0x7f26a002a410 comp rx=0 tx=0).stop 2024-09-19T06:51:35.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.683+0000 7f26b7aec640 1 -- 172.21.15.12:0/744136584 shutdown_connections 2024-09-19T06:51:35.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.683+0000 7f26b7aec640 1 --2- 172.21.15.12:0/744136584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b0106f20 0x7f26b010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:35.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.683+0000 7f26b7aec640 1 --2- 172.21.15.12:0/744136584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b01027a0 0x7f26b01067f0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.683+0000 7f26b7aec640 1 --2- 172.21.15.12:0/744136584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b0101df0 0x7f26b01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.683+0000 7f26b7aec640 1 -- 172.21.15.12:0/744136584 >> 172.21.15.12:0/744136584 conn(0x7f26b00fd8f0 msgr2=0x7f26b00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.684+0000 7f26b7aec640 1 -- 172.21.15.12:0/744136584 shutdown_connections 2024-09-19T06:51:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.684+0000 7f26b7aec640 1 -- 172.21.15.12:0/744136584 wait complete. 2024-09-19T06:51:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.684+0000 7f26b7aec640 1 Processor -- start 2024-09-19T06:51:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b7aec640 1 -- start start 2024-09-19T06:51:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b7aec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b0101df0 0x7f26b0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b7aec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b01027a0 0x7f26b01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b7aec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b0106f20 0x7f26b019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b7aec640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0111f80 con 0x7f26b01027a0 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b7aec640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0111e00 con 0x7f26b0101df0 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b7aec640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0112100 con 0x7f26b0106f20 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b5087640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b01027a0 0x7f26b01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b5087640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b01027a0 0x7f26b01989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59438/0 (socket says 172.21.15.12:59438) 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b5888640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b0101df0 0x7f26b0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b5087640 1 -- 172.21.15.12:0/1668164178 learned_addr learned my addr 172.21.15.12:0/1668164178 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b6089640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b0106f20 0x7f26b019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b5087640 1 -- 172.21.15.12:0/1668164178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b0106f20 msgr2=0x7f26b019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b5087640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b0106f20 0x7f26b019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:35.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b5087640 1 -- 172.21.15.12:0/1668164178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b0101df0 msgr2=0x7f26b0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b5087640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b0101df0 0x7f26b0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b5087640 1 -- 172.21.15.12:0/1668164178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b019d410 con 0x7f26b01027a0 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.685+0000 7f26b5888640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b0101df0 0x7f26b0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.686+0000 7f26b5087640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b01027a0 0x7f26b01989a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f26a0006010 tx=0x7f26a0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.686+0000 7f26a6ffd640 1 -- 172.21.15.12:0/1668164178 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a003f030 con 0x7f26b01027a0 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.686+0000 7f26a6ffd640 1 -- 172.21.15.12:0/1668164178 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26a0004440 con 0x7f26b01027a0 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.686+0000 7f26b7aec640 1 -- 172.21.15.12:0/1668164178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b019d6a0 con 0x7f26b01027a0 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.686+0000 7f26a6ffd640 1 -- 172.21.15.12:0/1668164178 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0035070 con 0x7f26b01027a0 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.686+0000 7f26b7aec640 1 -- 172.21.15.12:0/1668164178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b01a4fe0 con 0x7f26b01027a0 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.687+0000 7f26b7aec640 1 -- 172.21.15.12:0/1668164178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b01032d0 con 0x7f26b01027a0 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.691+0000 7f26a6ffd640 1 -- 172.21.15.12:0/1668164178 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f26a0042030 con 0x7f26b01027a0 2024-09-19T06:51:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.692+0000 7f26a6ffd640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f269c0a34b0 0x7f269c0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.692+0000 7f26a6ffd640 1 -- 172.21.15.12:0/1668164178 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f26a00f0190 con 0x7f26b01027a0 2024-09-19T06:51:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.692+0000 7f26b5888640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f269c0a34b0 0x7f269c0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.692+0000 7f26b5888640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f269c0a34b0 0x7f269c0a5970 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009c20 tx=0x7f26ac005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:35.695+0000 7f26a6ffd640 1 -- 172.21.15.12:0/1668164178 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26a00bca70 con 0x7f26b01027a0 2024-09-19T06:51:36.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.036+0000 7f26b7aec640 1 -- 172.21.15.12:0/1668164178 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26b010a190 con 0x7f26b01027a0 2024-09-19T06:51:36.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.037+0000 7f26a6ffd640 1 -- 172.21.15.12:0/1668164178 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11976 (secure 0 0 0) 0x7f26a00bc370 con 0x7f26b01027a0 2024-09-19T06:51:36.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:51:36.038 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":46,"btime":"2024-09-19T06:51:25:027076+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:51:24.416445+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:51:36.039 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 46 2024-09-19T06:51:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.039+0000 7f26b7aec640 1 -- 172.21.15.12:0/1668164178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f269c0a34b0 msgr2=0x7f269c0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.039+0000 7f26b7aec640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f269c0a34b0 0x7f269c0a5970 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009c20 tx=0x7f26ac005f90 comp rx=0 tx=0).stop 2024-09-19T06:51:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.039+0000 7f26b7aec640 1 -- 172.21.15.12:0/1668164178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b01027a0 msgr2=0x7f26b01989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.039+0000 7f26b7aec640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b01027a0 0x7f26b01989a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f26a0006010 tx=0x7f26a0004040 comp rx=0 tx=0).stop 2024-09-19T06:51:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.040+0000 7f26b7aec640 1 -- 172.21.15.12:0/1668164178 shutdown_connections 2024-09-19T06:51:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.040+0000 7f26b7aec640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f269c0a34b0 0x7f269c0a5970 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.040+0000 7f26b7aec640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26b0106f20 0x7f26b019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.040+0000 7f26b7aec640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b01027a0 0x7f26b01989a0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.040+0000 7f26b7aec640 1 --2- 172.21.15.12:0/1668164178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26b0101df0 0x7f26b0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.040+0000 7f26b7aec640 1 -- 172.21.15.12:0/1668164178 >> 172.21.15.12:0/1668164178 conn(0x7f26b00fd8f0 msgr2=0x7f26b00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.040+0000 7f26b7aec640 1 -- 172.21.15.12:0/1668164178 shutdown_connections 2024-09-19T06:51:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:36.040+0000 7f26b7aec640 1 -- 172.21.15.12:0/1668164178 wait complete. 2024-09-19T06:51:36.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:36 smithi173 ceph-mon[35349]: pgmap v356: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 575 op/s 2024-09-19T06:51:36.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:36 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1668164178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:36.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:36 smithi012 ceph-mon[30937]: pgmap v356: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 575 op/s 2024-09-19T06:51:36.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:36 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1668164178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:36.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:36 smithi016 ceph-mon[34911]: pgmap v356: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 575 op/s 2024-09-19T06:51:36.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:36 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1668164178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:51:36.965 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:51:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:37.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:37 smithi012 ceph-mon[30937]: pgmap v357: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 738 op/s 2024-09-19T06:51:37.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:37 smithi016 ceph-mon[34911]: pgmap v357: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 738 op/s 2024-09-19T06:51:37.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:37 smithi173 ceph-mon[35349]: pgmap v357: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 738 op/s 2024-09-19T06:51:38.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.252+0000 7f41da6d1640 1 -- 172.21.15.12:0/1879637236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d4102d30 msgr2=0x7f41d4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:38.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.252+0000 7f41da6d1640 1 --2- 172.21.15.12:0/1879637236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d4102d30 0x7f41d4103110 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009930 tx=0x7f41c402a420 comp rx=0 tx=0).stop 2024-09-19T06:51:38.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.252+0000 7f41da6d1640 1 -- 172.21.15.12:0/1879637236 shutdown_connections 2024-09-19T06:51:38.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.252+0000 7f41da6d1640 1 --2- 172.21.15.12:0/1879637236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d41082a0 0x7f41d410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.252+0000 7f41da6d1640 1 --2- 172.21.15.12:0/1879637236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41d41036e0 0x7f41d4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.252+0000 7f41da6d1640 1 --2- 172.21.15.12:0/1879637236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d4102d30 0x7f41d4103110 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.252+0000 7f41da6d1640 1 -- 172.21.15.12:0/1879637236 >> 172.21.15.12:0/1879637236 conn(0x7f41d40fc7d0 msgr2=0x7f41d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:38.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.252+0000 7f41da6d1640 1 -- 172.21.15.12:0/1879637236 shutdown_connections 2024-09-19T06:51:38.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.253+0000 7f41da6d1640 1 -- 172.21.15.12:0/1879637236 wait complete. 2024-09-19T06:51:38.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.255+0000 7f41da6d1640 1 Processor -- start 2024-09-19T06:51:38.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.255+0000 7f41da6d1640 1 -- start start 2024-09-19T06:51:38.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41da6d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41d4102d30 0x7f41d4198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41da6d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41036e0 0x7f41d4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41da6d1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d41082a0 0x7f41d419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41da6d1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41120a0 con 0x7f41d4102d30 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41da6d1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4111f20 con 0x7f41d41036e0 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41da6d1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4112220 con 0x7f41d41082a0 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41d8c6e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d41082a0 0x7f41d419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41d4102d30 0x7f41d4198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41cbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41036e0 0x7f41d4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41d4102d30 0x7f41d4198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59458/0 (socket says 172.21.15.12:59458) 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41d3fff640 1 -- 172.21.15.12:0/3718266709 learned_addr learned my addr 172.21.15.12:0/3718266709 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41cbfff640 1 -- 172.21.15.12:0/3718266709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d41082a0 msgr2=0x7f41d419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41cbfff640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d41082a0 0x7f41d419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41cbfff640 1 -- 172.21.15.12:0/3718266709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41d4102d30 msgr2=0x7f41d4198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41cbfff640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41d4102d30 0x7f41d4198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.256+0000 7f41cbfff640 1 -- 172.21.15.12:0/3718266709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d419d610 con 0x7f41d41036e0 2024-09-19T06:51:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.257+0000 7f41cbfff640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41036e0 0x7f41d4198ba0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f41d40697d0 tx=0x7f41bc00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.257+0000 7f41d1ffb640 1 -- 172.21.15.12:0/3718266709 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00cc40 con 0x7f41d41036e0 2024-09-19T06:51:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.257+0000 7f41d1ffb640 1 -- 172.21.15.12:0/3718266709 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41bc00cde0 con 0x7f41d41036e0 2024-09-19T06:51:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.257+0000 7f41d1ffb640 1 -- 172.21.15.12:0/3718266709 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc0188e0 con 0x7f41d41036e0 2024-09-19T06:51:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.257+0000 7f41da6d1640 1 -- 172.21.15.12:0/3718266709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d419d900 con 0x7f41d41036e0 2024-09-19T06:51:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.257+0000 7f41da6d1640 1 -- 172.21.15.12:0/3718266709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d41a51e0 con 0x7f41d41036e0 2024-09-19T06:51:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.260+0000 7f41dcaaa740 1 Processor -- start 2024-09-19T06:51:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.260+0000 7f41dcaaa740 1 -- start start 2024-09-19T06:51:38.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122881090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b122881a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 0x55b12288e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b1227e72f0 con 0x55b122882b40 2024-09-19T06:51:38.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b12278ecf0 con 0x55b12288c370 2024-09-19T06:51:38.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b1227e32b0 con 0x55b1228815d0 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41d8c6e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122881090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41d1ffb640 1 -- 172.21.15.12:0/3718266709 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f41bc010430 con 0x7f41d41036e0 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41d8c6e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122881090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59472/0 (socket says 172.21.15.12:59472) 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41d8c6e640 1 -- 172.21.15.12:0/2087880520 learned_addr learned my addr 172.21.15.12:0/2087880520 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41d3fff640 1 --2- 172.21.15.12:0/2087880520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b122881a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41cbfff640 1 --2- 172.21.15.12:0/2087880520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 0x55b12288e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41d3fff640 1 -- 172.21.15.12:0/2087880520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 msgr2=0x55b12288e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41d3fff640 1 --2- 172.21.15.12:0/2087880520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 0x55b12288e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41d3fff640 1 -- 172.21.15.12:0/2087880520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 msgr2=0x55b122881090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41d3fff640 1 --2- 172.21.15.12:0/2087880520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122881090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.261+0000 7f41d3fff640 1 -- 172.21.15.12:0/2087880520 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1227733a0 con 0x55b1228815d0 2024-09-19T06:51:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.262+0000 7f41d3fff640 1 --2- 172.21.15.12:0/2087880520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b122881a10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009900 tx=0x7f41c4005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfdd242b9f71cab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:38.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.262+0000 7f41ca7fc640 1 -- 172.21.15.12:0/2087880520 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4040070 con 0x55b1228815d0 2024-09-19T06:51:38.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.262+0000 7f41ca7fc640 1 -- 172.21.15.12:0/2087880520 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41c40318f0 con 0x55b1228815d0 2024-09-19T06:51:38.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.262+0000 7f41d1ffb640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41c00a3430 0x7f41c00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.262+0000 7f41d1ffb640 1 -- 172.21.15.12:0/3718266709 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f41bc0d00b0 con 0x7f41d41036e0 2024-09-19T06:51:38.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.262+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41c00a3430 0x7f41c00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.263+0000 7f41ca7fc640 1 -- 172.21.15.12:0/2087880520 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4035040 con 0x55b1228815d0 2024-09-19T06:51:38.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.263+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2087880520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 msgr2=0x55b122881a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:38.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.263+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2087880520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b122881a10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009900 tx=0x7f41c4005dc0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.263+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41c00a3430 0x7f41c00a58f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f41cc011630 tx=0x7f41cc009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:38.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.263+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2087880520 shutdown_connections 2024-09-19T06:51:38.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.263+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2087880520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 0x55b12288e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.263+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2087880520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b122881a10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.263+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2087880520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122881090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.263+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2087880520 >> 172.21.15.12:0/2087880520 conn(0x55b12284a310 msgr2=0x55b12287dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:38.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.263+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2087880520 shutdown_connections 2024-09-19T06:51:38.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.264+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2087880520 wait complete. 2024-09-19T06:51:38.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.265+0000 7f41dcaaa740 1 -- start start 2024-09-19T06:51:38.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.265+0000 7f41dcaaa740 1 Processor -- start 2024-09-19T06:51:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b12288b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b122882b40 0x55b122888ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b12288c370 0x55b122889420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b1228934c0 con 0x55b12288c370 2024-09-19T06:51:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b1227a2060 con 0x55b122882b40 2024-09-19T06:51:38.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b122893640 con 0x55b1228815d0 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41dcaaa740 10 client.0 _ll_register_callbacks cb 0x55b1224f58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b12288b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b12288b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33000/0 (socket says 172.21.15.12:33000) 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41d3fff640 1 -- 172.21.15.12:0/2056672297 learned_addr learned my addr 172.21.15.12:0/2056672297 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41cbfff640 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b122882b40 0x55b122888ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.266+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b12288c370 0x55b122889420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41d3fff640 1 -- 172.21.15.12:0/2056672297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b122882b40 msgr2=0x55b122888ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41d3fff640 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b122882b40 0x55b122888ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41d3fff640 1 -- 172.21.15.12:0/2056672297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b12288c370 msgr2=0x55b122889420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41d3fff640 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b12288c370 0x55b122889420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41d3fff640 1 -- 172.21.15.12:0/2056672297 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1225583c0 con 0x55b1228815d0 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b12288c370 0x55b122889420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:38.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41d3fff640 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b12288b9c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41c40055a0 tx=0x7f41c4005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78b7cbb572608709 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41b37fe640 1 -- 172.21.15.12:0/2056672297 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c404d060 con 0x55b1228815d0 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2056672297 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41c40318f0 con 0x55b1228815d0 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41b37fe640 1 -- 172.21.15.12:0/2056672297 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f41c4004240 con 0x55b1228815d0 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41b37fe640 1 -- 172.21.15.12:0/2056672297 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f41c4054050 con 0x55b1228815d0 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41dcaaa740 10 client.27922 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.267+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2056672297 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b1228934c0 con 0x55b1228815d0 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41b37fe640 1 -- 172.21.15.12:0/2056672297 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41c40318f0 con 0x55b1228815d0 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41b37fe640 1 -- 172.21.15.12:0/2056672297 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f41c4003710 con 0x55b1228815d0 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41dcaaa740 10 client.27922 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41dcaaa740 10 client.27922 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41dcaaa740 20 client.27922 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:38.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b1228a44a0 0x55b1228a6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41dcaaa740 4 client.27922 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2056672297 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1227f4860 con 0x55b1228a44a0 2024-09-19T06:51:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41cbfff640 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b1228a44a0 0x55b1228a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41b37fe640 10 client.27922 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:51:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.268+0000 7f41cbfff640 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b1228a44a0 0x55b1228a6890 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=49cbd84124971815 server_cookie=cd61022b822a463b in_seq=0 out_seq=0 2024-09-19T06:51:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.269+0000 7f41b37fe640 1 -- 172.21.15.12:0/2056672297 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b1227f4860 con 0x55b1228a44a0 2024-09-19T06:51:38.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.269+0000 7f41b37fe640 10 client.27922 handle_command_reply: tid=0 2024-09-19T06:51:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.269+0000 7f41dcaaa740 1 client.27922 shutdown 2024-09-19T06:51:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2056672297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 msgr2=0x55b12288b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b12288b9c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41c40055a0 tx=0x7f41c4005250 comp rx=0 tx=0).stop 2024-09-19T06:51:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2056672297 shutdown_connections 2024-09-19T06:51:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b1228a44a0 0x55b1228a6890 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b12288c370 0x55b122889420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b122882b40 0x55b122888ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2056672297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b12288b9c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2056672297 >> 172.21.15.12:0/2056672297 conn(0x55b12284a310 msgr2=0x55b122883960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41b37fe640 0 client.27922 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:51:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2056672297 shutdown_connections 2024-09-19T06:51:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2056672297 wait complete. 2024-09-19T06:51:38.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.270+0000 7f41dcaaa740 20 client.27922 trim_cache size 0 max 16384 2024-09-19T06:51:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41dcaaa740 1 Processor -- start 2024-09-19T06:51:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41dcaaa740 1 -- start start 2024-09-19T06:51:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b1228918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122884120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 0x55b122884660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41abaa0 con 0x55b122882b40 2024-09-19T06:51:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41ad670 con 0x55b12288c370 2024-09-19T06:51:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41ac170 con 0x55b1228815d0 2024-09-19T06:51:38.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122884120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41d8c6e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 0x55b122884660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122884120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59496/0 (socket says 172.21.15.12:59496) 2024-09-19T06:51:38.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41cbfff640 1 -- 172.21.15.12:0/2818841856 learned_addr learned my addr 172.21.15.12:0/2818841856 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:38.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.288+0000 7f41d3fff640 1 --2- 172.21.15.12:0/2818841856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b1228918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.289+0000 7f41d8c6e640 1 -- 172.21.15.12:0/2818841856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 msgr2=0x55b1228918b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.289+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/2818841856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b1228918b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.289+0000 7f41d8c6e640 1 -- 172.21.15.12:0/2818841856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 msgr2=0x55b122884120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.289+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/2818841856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122884120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.289+0000 7f41d8c6e640 1 -- 172.21.15.12:0/2818841856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1228813d0 con 0x55b12288c370 2024-09-19T06:51:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.289+0000 7f41cbfff640 1 --2- 172.21.15.12:0/2818841856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122884120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.290+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/2818841856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 0x55b122884660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f41cc005fd0 tx=0x7f41cc011f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed335b9958bbcc51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.290+0000 7f41c9ffb640 1 -- 172.21.15.12:0/2818841856 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc003d50 con 0x55b12288c370 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.290+0000 7f41c9ffb640 1 -- 172.21.15.12:0/2818841856 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41cc004590 con 0x55b12288c370 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.290+0000 7f41c9ffb640 1 -- 172.21.15.12:0/2818841856 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc01e430 con 0x55b12288c370 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.291+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2818841856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 msgr2=0x55b122884660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.291+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2818841856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 0x55b122884660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f41cc005fd0 tx=0x7f41cc011f90 comp rx=0 tx=0).stop 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.291+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2818841856 shutdown_connections 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.291+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2818841856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b12288c370 0x55b122884660 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.291+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2818841856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b122882b40 0x55b122884120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.291+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2818841856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1228815d0 0x55b1228918b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.291+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2818841856 >> 172.21.15.12:0/2818841856 conn(0x55b12284a310 msgr2=0x55b12288af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.291+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2818841856 shutdown_connections 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.291+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2818841856 wait complete. 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.292+0000 7f41dcaaa740 1 -- start start 2024-09-19T06:51:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.292+0000 7f41dcaaa740 1 Processor -- start 2024-09-19T06:51:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.292+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1228815d0 0x55b1228a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.292+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b122882b40 0x55b12289cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.292+0000 7f41dcaaa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b12288c370 0x55b12289d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.292+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41acfa0 con 0x55b1228815d0 2024-09-19T06:51:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41ac8d0 con 0x55b122882b40 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41dcaaa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41a9aa0 con 0x55b12288c370 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41dcaaa740 10 client.0 _ll_register_callbacks cb 0x7f41cc009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1228815d0 0x55b1228a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41d3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1228815d0 0x55b1228a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59512/0 (socket says 172.21.15.12:59512) 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41d3fff640 1 -- 172.21.15.12:0/2761864824 learned_addr learned my addr 172.21.15.12:0/2761864824 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41cbfff640 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b122882b40 0x55b12289cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b12288c370 0x55b12289d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41d8c6e640 1 -- 172.21.15.12:0/2761864824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b122882b40 msgr2=0x55b12289cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b122882b40 0x55b12289cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41d8c6e640 1 -- 172.21.15.12:0/2761864824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1228815d0 msgr2=0x55b1228a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1228815d0 0x55b1228a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.293+0000 7f41d8c6e640 1 -- 172.21.15.12:0/2761864824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b12290dec0 con 0x55b12288c370 2024-09-19T06:51:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.294+0000 7f41d8c6e640 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b12288c370 0x55b12289d720 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55b122879210 tx=0x7f41cc00fb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9ceea13379ac1fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.294+0000 7f41b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:51:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.294+0000 7f41b37fe640 1 -- 172.21.15.12:0/2761864824 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc004a40 con 0x55b12288c370 2024-09-19T06:51:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.294+0000 7f41b37fe640 1 -- 172.21.15.12:0/2761864824 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f41cc025040 con 0x55b12288c370 2024-09-19T06:51:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.294+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2761864824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41cc004590 con 0x55b12288c370 2024-09-19T06:51:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.295+0000 7f41b37fe640 1 -- 172.21.15.12:0/2761864824 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f41cc004be0 con 0x55b12288c370 2024-09-19T06:51:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.295+0000 7f41dcaaa740 10 client.27928 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.295+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2761864824 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b12290f0a0 con 0x55b12288c370 2024-09-19T06:51:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.295+0000 7f41b37fe640 1 -- 172.21.15.12:0/2761864824 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41cc004590 con 0x55b12288c370 2024-09-19T06:51:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.296+0000 7f41b37fe640 1 -- 172.21.15.12:0/2761864824 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f41cc039030 con 0x55b12288c370 2024-09-19T06:51:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.296+0000 7f41dcaaa740 10 client.27928 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.296+0000 7f41dcaaa740 10 client.27928 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.296+0000 7f41dcaaa740 20 client.27928 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.296+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b12290f710 0x55b122911b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.296+0000 7f41dcaaa740 4 client.27928 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.296+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2761864824 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b1227eed70 con 0x55b12290f710 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.296+0000 7f41d3fff640 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b12290f710 0x55b122911b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41d3fff640 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b12290f710 0x55b122911b40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=53d08340ed71905c server_cookie=208e68c8c8c98826 in_seq=0 out_seq=0 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41b37fe640 10 client.27928 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41b37fe640 1 -- 172.21.15.12:0/2761864824 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b1227eed70 con 0x55b12290f710 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41b37fe640 10 client.27928 handle_command_reply: tid=0 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41dcaaa740 1 client.27928 shutdown 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2761864824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b12288c370 msgr2=0x55b12289d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b12288c370 0x55b12289d720 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55b122879210 tx=0x7f41cc00fb50 comp rx=0 tx=0).stop 2024-09-19T06:51:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2761864824 shutdown_connections 2024-09-19T06:51:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b12290f710 0x55b122911b40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41b37fe640 0 client.27928 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:51:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b12288c370 0x55b12289d720 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b122882b40 0x55b12289cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41dcaaa740 1 --2- 172.21.15.12:0/2761864824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b1228815d0 0x55b1228a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2761864824 >> 172.21.15.12:0/2761864824 conn(0x55b12284a310 msgr2=0x55b12288a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.297+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2761864824 shutdown_connections 2024-09-19T06:51:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.298+0000 7f41dcaaa740 1 -- 172.21.15.12:0/2761864824 wait complete. 2024-09-19T06:51:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.298+0000 7f41dcaaa740 20 client.27928 trim_cache size 0 max 16384 2024-09-19T06:51:38.303 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:51:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.299+0000 7f41da6d1640 1 -- 172.21.15.12:0/3718266709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41c00a3430 msgr2=0x7f41c00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.299+0000 7f41da6d1640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41c00a3430 0x7f41c00a58f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f41cc011630 tx=0x7f41cc009500 comp rx=0 tx=0).stop 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.299+0000 7f41da6d1640 1 -- 172.21.15.12:0/3718266709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41036e0 msgr2=0x7f41d4198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.299+0000 7f41da6d1640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41036e0 0x7f41d4198ba0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f41d40697d0 tx=0x7f41bc00ee50 comp rx=0 tx=0).stop 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.299+0000 7f41da6d1640 1 -- 172.21.15.12:0/3718266709 shutdown_connections 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.299+0000 7f41da6d1640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41c00a3430 0x7f41c00a58f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.299+0000 7f41da6d1640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41d41082a0 0x7f41d419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.299+0000 7f41da6d1640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41d41036e0 0x7f41d4198ba0 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f41d40697d0 tx=0x7f41bc00ee50 comp rx=0 tx=0).stop 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.299+0000 7f41da6d1640 1 --2- 172.21.15.12:0/3718266709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41d4102d30 0x7f41d4198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.299+0000 7f41da6d1640 1 -- 172.21.15.12:0/3718266709 >> 172.21.15.12:0/3718266709 conn(0x7f41d40fc7d0 msgr2=0x7f41d4105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.300+0000 7f41da6d1640 1 -- 172.21.15.12:0/3718266709 shutdown_connections 2024-09-19T06:51:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:38.300+0000 7f41da6d1640 1 -- 172.21.15.12:0/3718266709 wait complete. 2024-09-19T06:51:39.178 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:51:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:39.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:39 smithi012 ceph-mon[30937]: pgmap v358: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.0 MiB/s wr, 535 op/s 2024-09-19T06:51:39.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:39 smithi016 ceph-mon[34911]: pgmap v358: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.0 MiB/s wr, 535 op/s 2024-09-19T06:51:39.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:39 smithi173 ceph-mon[35349]: pgmap v358: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.0 MiB/s wr, 535 op/s 2024-09-19T06:51:40.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.197+0000 7f6d083dc640 1 -- 172.21.15.12:0/524015682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d00102ef0 msgr2=0x7f6d0010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:40.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.197+0000 7f6d083dc640 1 --2- 172.21.15.12:0/524015682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d00102ef0 0x7f6d0010da40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009c10 tx=0x7f6cf802a770 comp rx=0 tx=0).stop 2024-09-19T06:51:40.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.198+0000 7f6d083dc640 1 -- 172.21.15.12:0/524015682 shutdown_connections 2024-09-19T06:51:40.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.198+0000 7f6d083dc640 1 --2- 172.21.15.12:0/524015682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d00102ef0 0x7f6d0010da40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.198+0000 7f6d083dc640 1 --2- 172.21.15.12:0/524015682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00102570 0x7f6d001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.198+0000 7f6d083dc640 1 --2- 172.21.15.12:0/524015682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00100e20 0x7f6d00101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.198+0000 7f6d083dc640 1 -- 172.21.15.12:0/524015682 >> 172.21.15.12:0/524015682 conn(0x7f6d000fc7d0 msgr2=0x7f6d000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.198+0000 7f6d083dc640 1 -- 172.21.15.12:0/524015682 shutdown_connections 2024-09-19T06:51:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.198+0000 7f6d083dc640 1 -- 172.21.15.12:0/524015682 wait complete. 2024-09-19T06:51:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.199+0000 7f6d083dc640 1 Processor -- start 2024-09-19T06:51:40.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.199+0000 7f6d083dc640 1 -- start start 2024-09-19T06:51:40.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.199+0000 7f6d083dc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d00100e20 0x7f6d001a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.199+0000 7f6d083dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00102570 0x7f6d001a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.199+0000 7f6d083dc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00102ef0 0x7f6d0019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.199+0000 7f6d083dc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001186b0 con 0x7f6d00102570 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.199+0000 7f6d083dc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00118530 con 0x7f6d00102ef0 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.199+0000 7f6d083dc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00118830 con 0x7f6d00100e20 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d06979640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00102ef0 0x7f6d0019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d05977640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00102570 0x7f6d001a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d06178640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d00100e20 0x7f6d001a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d06979640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00102ef0 0x7f6d0019e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60834/0 (socket says 172.21.15.12:60834) 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d06979640 1 -- 172.21.15.12:0/880448722 learned_addr learned my addr 172.21.15.12:0/880448722 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d06979640 1 -- 172.21.15.12:0/880448722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d00100e20 msgr2=0x7f6d001a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d06979640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d00100e20 0x7f6d001a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d06979640 1 -- 172.21.15.12:0/880448722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00102570 msgr2=0x7f6d001a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d06979640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00102570 0x7f6d001a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d06979640 1 -- 172.21.15.12:0/880448722 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0019f090 con 0x7f6d00102ef0 2024-09-19T06:51:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.200+0000 7f6d06979640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00102ef0 0x7f6d0019e960 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6cf802ac90 tx=0x7f6cf80305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.201+0000 7f6cf77fe640 1 -- 172.21.15.12:0/880448722 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8041020 con 0x7f6d00102ef0 2024-09-19T06:51:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.201+0000 7f6cf77fe640 1 -- 172.21.15.12:0/880448722 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cf8003e50 con 0x7f6d00102ef0 2024-09-19T06:51:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.201+0000 7f6cf77fe640 1 -- 172.21.15.12:0/880448722 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8036040 con 0x7f6d00102ef0 2024-09-19T06:51:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.201+0000 7f6d083dc640 1 -- 172.21.15.12:0/880448722 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0019f320 con 0x7f6d00102ef0 2024-09-19T06:51:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.201+0000 7f6d083dc640 1 -- 172.21.15.12:0/880448722 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0006bc10 con 0x7f6d00102ef0 2024-09-19T06:51:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.206+0000 7f6d0a7b5740 1 Processor -- start 2024-09-19T06:51:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.206+0000 7f6cf77fe640 1 -- 172.21.15.12:0/880448722 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6cf8044020 con 0x7f6d00102ef0 2024-09-19T06:51:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.207+0000 7f6d0a7b5740 1 -- start start 2024-09-19T06:51:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.207+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.207+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 0x559a468e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.207+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468ed370 0x559a468ef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.208+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559a468482f0 con 0x559a468ed370 2024-09-19T06:51:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.208+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559a467efcf0 con 0x559a468e3b40 2024-09-19T06:51:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.208+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559a468442b0 con 0x559a468e25d0 2024-09-19T06:51:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.208+0000 7f6d05977640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.208+0000 7f6d05977640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60848/0 (socket says 172.21.15.12:60848) 2024-09-19T06:51:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.208+0000 7f6d05977640 1 -- 172.21.15.12:0/1004636239 learned_addr learned my addr 172.21.15.12:0/1004636239 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.208+0000 7f6cf77fe640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6cec0a3500 0x7f6cec0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.208+0000 7f6cf77fe640 1 -- 172.21.15.12:0/880448722 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f6cf80f07c0 con 0x7f6d00102ef0 2024-09-19T06:51:40.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.209+0000 7f6d05977640 1 --2- 172.21.15.12:0/1004636239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468ed370 0x559a468ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.209+0000 7f6d06979640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6cec0a3500 0x7f6cec0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.209+0000 7f6d06178640 1 --2- 172.21.15.12:0/1004636239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 0x559a468e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.209+0000 7f6d05977640 1 -- 172.21.15.12:0/1004636239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 msgr2=0x559a468e2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.209+0000 7f6d05977640 1 --2- 172.21.15.12:0/1004636239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 0x559a468e2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.209+0000 7f6d05977640 1 -- 172.21.15.12:0/1004636239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468ed370 msgr2=0x559a468ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.209+0000 7f6d05977640 1 --2- 172.21.15.12:0/1004636239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468ed370 0x559a468ef760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.209+0000 7f6d05977640 1 -- 172.21.15.12:0/1004636239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a467d43a0 con 0x559a468e3b40 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.209+0000 7f6d05977640 1 --2- 172.21.15.12:0/1004636239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e2090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009330 tx=0x7f6cf0009590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f012d7f30a5fed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.210+0000 7f6cf4dea640 1 -- 172.21.15.12:0/1004636239 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf000f040 con 0x559a468e3b40 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.210+0000 7f6d06979640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6cec0a3500 0x7f6cec0a59c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80bc990 tx=0x7f6cf8031970 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.210+0000 7f6cf4dea640 1 -- 172.21.15.12:0/1004636239 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cf001c070 con 0x559a468e3b40 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.210+0000 7f6cf4dea640 1 -- 172.21.15.12:0/1004636239 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0015760 con 0x559a468e3b40 2024-09-19T06:51:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.210+0000 7f6d06178640 1 --2- 172.21.15.12:0/1004636239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 0x559a468e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:40.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.211+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1004636239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 msgr2=0x559a468e2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:40.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.211+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1004636239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e2090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009330 tx=0x7f6cf0009590 comp rx=0 tx=0).stop 2024-09-19T06:51:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.211+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1004636239 shutdown_connections 2024-09-19T06:51:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.211+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1004636239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468ed370 0x559a468ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.211+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1004636239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 0x559a468e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.211+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1004636239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e2090 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.211+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1004636239 >> 172.21.15.12:0/1004636239 conn(0x559a468ab310 msgr2=0x559a468dec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.212+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1004636239 shutdown_connections 2024-09-19T06:51:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.212+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1004636239 wait complete. 2024-09-19T06:51:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.212+0000 7f6d0a7b5740 1 -- start start 2024-09-19T06:51:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.212+0000 7f6d0a7b5740 1 Processor -- start 2024-09-19T06:51:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 0x559a468ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 0x559a468ea070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468ed370 0x559a468ea800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559a468f0070 con 0x559a468e3b40 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559a46803060 con 0x559a468ed370 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559a468f01f0 con 0x559a468e25d0 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d0a7b5740 10 client.0 _ll_register_callbacks cb 0x559a465568c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d05977640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468ed370 0x559a468ea800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d05977640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468ed370 0x559a468ea800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60854/0 (socket says 172.21.15.12:60854) 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d05977640 1 -- 172.21.15.12:0/1126933862 learned_addr learned my addr 172.21.15.12:0/1126933862 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d05977640 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 0x559a468ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d06178640 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 0x559a468ea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d05977640 1 -- 172.21.15.12:0/1126933862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 msgr2=0x559a468ecdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d05977640 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 0x559a468ecdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d05977640 1 -- 172.21.15.12:0/1126933862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 msgr2=0x559a468ea070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d05977640 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 0x559a468ea070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.213+0000 7f6d05977640 1 -- 172.21.15.12:0/1126933862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a465b93c0 con 0x559a468ed370 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.214+0000 7f6d05977640 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468ed370 0x559a468ea800 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009480 tx=0x7f6cf0017f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e87db7bf89698df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.214+0000 7f6ce9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.214+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1126933862 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0017850 con 0x559a468ed370 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.214+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1126933862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf001c070 con 0x559a468ed370 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.214+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1126933862 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f6cf00179f0 con 0x559a468ed370 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.215+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1126933862 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6cf0034050 con 0x559a468ed370 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.215+0000 7f6d0a7b5740 10 client.27977 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.215+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1126933862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x559a468fbaf0 con 0x559a468ed370 2024-09-19T06:51:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.215+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1126933862 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cf001c070 con 0x559a468ed370 2024-09-19T06:51:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.216+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1126933862 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f6cf002f540 con 0x559a468ed370 2024-09-19T06:51:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.216+0000 7f6d0a7b5740 10 client.27977 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:40.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.216+0000 7f6d0a7b5740 10 client.27977 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:51:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.216+0000 7f6d0a7b5740 20 client.27977 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.216+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x559a468fd320 0x559a468ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.216+0000 7f6d0a7b5740 4 client.27977 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.216+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1126933862 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a46855860 con 0x559a468fd320 2024-09-19T06:51:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.219+0000 7f6d06178640 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x559a468fd320 0x559a468ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.220+0000 7f6d06178640 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x559a468fd320 0x559a468ff740 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3c6311cea6c0d414 server_cookie=171dfcf3871c1240 in_seq=0 out_seq=0 2024-09-19T06:51:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.220+0000 7f6ce9ffb640 10 client.27977 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:51:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1126933862 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a46855860 con 0x559a468fd320 2024-09-19T06:51:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6ce9ffb640 10 client.27977 handle_command_reply: tid=0 2024-09-19T06:51:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 client.27977 shutdown 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1126933862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468ed370 msgr2=0x559a468ea800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468ed370 0x559a468ea800 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009480 tx=0x7f6cf0017f20 comp rx=0 tx=0).stop 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1126933862 shutdown_connections 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x559a468fd320 0x559a468ff740 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468ed370 0x559a468ea800 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 0x559a468ea070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1126933862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468e25d0 0x559a468ecdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6ce9ffb640 0 client.27977 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1126933862 >> 172.21.15.12:0/1126933862 conn(0x559a468ab310 msgr2=0x559a468e4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1126933862 shutdown_connections 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1126933862 wait complete. 2024-09-19T06:51:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.221+0000 7f6d0a7b5740 20 client.27977 trim_cache size 0 max 16384 2024-09-19T06:51:40.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.245+0000 7f6d0a7b5740 1 Processor -- start 2024-09-19T06:51:40.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.245+0000 7f6d0a7b5740 1 -- start start 2024-09-19T06:51:40.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.245+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e25d0 0x559a468e3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.245+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.245+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 0x559a468e5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.245+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001bc7f0 con 0x559a468e25d0 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.245+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001be3c0 con 0x559a468e3b40 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.245+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001bcec0 con 0x559a468ed370 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d06178640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d06178640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60870/0 (socket says 172.21.15.12:60870) 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d05977640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e25d0 0x559a468e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d06178640 1 -- 172.21.15.12:0/286469574 learned_addr learned my addr 172.21.15.12:0/286469574 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d05977640 1 --2- 172.21.15.12:0/286469574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 0x559a468e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d06178640 1 -- 172.21.15.12:0/286469574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 msgr2=0x559a468e5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d06178640 1 --2- 172.21.15.12:0/286469574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 0x559a468e5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d06178640 1 -- 172.21.15.12:0/286469574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e25d0 msgr2=0x559a468e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:40.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d06178640 1 --2- 172.21.15.12:0/286469574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e25d0 0x559a468e3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d06178640 1 -- 172.21.15.12:0/286469574 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a468ffdc0 con 0x559a468e3b40 2024-09-19T06:51:40.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.246+0000 7f6d06178640 1 --2- 172.21.15.12:0/286469574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e5120 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009ce0 tx=0x7f6cfc014900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dfa9a47e765de67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:40.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.248+0000 7f6cebfff640 1 -- 172.21.15.12:0/286469574 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc01d460 con 0x559a468e3b40 2024-09-19T06:51:40.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.248+0000 7f6cebfff640 1 -- 172.21.15.12:0/286469574 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc01dae0 con 0x559a468e3b40 2024-09-19T06:51:40.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.248+0000 7f6cebfff640 1 -- 172.21.15.12:0/286469574 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc012c10 con 0x559a468e3b40 2024-09-19T06:51:40.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.249+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/286469574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 msgr2=0x559a468e5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.249+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/286469574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e5120 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009ce0 tx=0x7f6cfc014900 comp rx=0 tx=0).stop 2024-09-19T06:51:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.249+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/286469574 shutdown_connections 2024-09-19T06:51:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.249+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/286469574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 0x559a468e5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.249+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/286469574 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e3b40 0x559a468e5120 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.249+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/286469574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e25d0 0x559a468e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.249+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/286469574 >> 172.21.15.12:0/286469574 conn(0x559a468ab310 msgr2=0x559a468d9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.249+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/286469574 shutdown_connections 2024-09-19T06:51:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.250+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/286469574 wait complete. 2024-09-19T06:51:40.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.250+0000 7f6d0a7b5740 1 -- start start 2024-09-19T06:51:40.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.250+0000 7f6d0a7b5740 1 Processor -- start 2024-09-19T06:51:40.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.251+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e25d0 0x559a468f5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.251+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 0x559a468f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.251+0000 7f6d0a7b5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 0x559a468e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.251+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001bdcf0 con 0x559a468e3b40 2024-09-19T06:51:40.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.251+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001bd620 con 0x559a468e25d0 2024-09-19T06:51:40.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.251+0000 7f6d0a7b5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00072620 con 0x559a468ed370 2024-09-19T06:51:40.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d0a7b5740 10 client.0 _ll_register_callbacks cb 0x7f6cf0009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:40.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d05977640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e25d0 0x559a468f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d05977640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 0x559a468e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d06178640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 0x559a468f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d05977640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e25d0 0x559a468f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:60872/0 (socket says 172.21.15.12:60872) 2024-09-19T06:51:40.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d05977640 1 -- 172.21.15.12:0/1024535477 learned_addr learned my addr 172.21.15.12:0/1024535477 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:40.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d05977640 1 -- 172.21.15.12:0/1024535477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e25d0 msgr2=0x559a468f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:40.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d05977640 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e25d0 0x559a468f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d05977640 1 -- 172.21.15.12:0/1024535477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 msgr2=0x559a468f59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:40.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d05977640 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 0x559a468f59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d05977640 1 -- 172.21.15.12:0/1024535477 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a468e6c10 con 0x559a468ed370 2024-09-19T06:51:40.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.252+0000 7f6d06178640 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 0x559a468f59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:40.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.253+0000 7f6d05977640 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 0x559a468e66a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0006b90 tx=0x7f6cf0017f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed446331948ac652 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:40.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.253+0000 7f6ce9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:51:40.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.253+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1024535477 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0026040 con 0x559a468ed370 2024-09-19T06:51:40.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.253+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1024535477 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f6cf002f420 con 0x559a468ed370 2024-09-19T06:51:40.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.253+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1024535477 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cfc01dae0 con 0x559a468ed370 2024-09-19T06:51:40.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1024535477 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6cf002f620 con 0x559a468ed370 2024-09-19T06:51:40.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6d0a7b5740 10 client.27943 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:40.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1024535477 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x559a46967860 con 0x559a468ed370 2024-09-19T06:51:40.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1024535477 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cfc01dae0 con 0x559a468ed370 2024-09-19T06:51:40.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1024535477 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f6cf0042030 con 0x559a468ed370 2024-09-19T06:51:40.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6d0a7b5740 10 client.27943 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:40.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6d0a7b5740 10 client.27943 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:51:40.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6d0a7b5740 20 client.27943 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:40.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x559a46967e60 0x559a4696a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:40.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6d0a7b5740 4 client.27943 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:51:40.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.254+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1024535477 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a4684fd70 con 0x559a46967e60 2024-09-19T06:51:40.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.255+0000 7f6d06178640 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x559a46967e60 0x559a4696a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:40.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.255+0000 7f6d06178640 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x559a46967e60 0x559a4696a250 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=15891d80e3bbe208 server_cookie=224304a132be5ffb in_seq=0 out_seq=0 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.256+0000 7f6ce9ffb640 10 client.27943 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.256+0000 7f6ce9ffb640 1 -- 172.21.15.12:0/1024535477 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a4684fd70 con 0x559a46967e60 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.256+0000 7f6ce9ffb640 10 client.27943 handle_command_reply: tid=0 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.256+0000 7f6d0a7b5740 1 client.27943 shutdown 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.256+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1024535477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 msgr2=0x559a468e66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.256+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 0x559a468e66a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0006b90 tx=0x7f6cf0017f20 comp rx=0 tx=0).stop 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.257+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1024535477 shutdown_connections 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.257+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x559a46967e60 0x559a4696a250 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.257+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a468ed370 0x559a468e66a0 secure :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0006b90 tx=0x7f6cf0017f20 comp rx=0 tx=0).stop 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.257+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a468e3b40 0x559a468f59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.257+0000 7f6d0a7b5740 1 --2- 172.21.15.12:0/1024535477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a468e25d0 0x559a468f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.257+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1024535477 >> 172.21.15.12:0/1024535477 conn(0x559a468ab310 msgr2=0x559a468ec0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:40.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.257+0000 7f6ce9ffb640 0 client.27943 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:51:40.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.257+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1024535477 shutdown_connections 2024-09-19T06:51:40.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.257+0000 7f6d0a7b5740 1 -- 172.21.15.12:0/1024535477 wait complete. 2024-09-19T06:51:40.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.257+0000 7f6d0a7b5740 20 client.27943 trim_cache size 0 max 16384 2024-09-19T06:51:40.262 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:51:40.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.263+0000 7f6d083dc640 1 -- 172.21.15.12:0/880448722 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6cec0a3500 msgr2=0x7f6cec0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:40.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.263+0000 7f6d083dc640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6cec0a3500 0x7f6cec0a59c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80bc990 tx=0x7f6cf8031970 comp rx=0 tx=0).stop 2024-09-19T06:51:40.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.263+0000 7f6d083dc640 1 -- 172.21.15.12:0/880448722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00102ef0 msgr2=0x7f6d0019e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:40.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.263+0000 7f6d083dc640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00102ef0 0x7f6d0019e960 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6cf802ac90 tx=0x7f6cf80305d0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.263+0000 7f6d083dc640 1 -- 172.21.15.12:0/880448722 shutdown_connections 2024-09-19T06:51:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.263+0000 7f6d083dc640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d00102ef0 0x7f6d0019e960 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.263+0000 7f6d083dc640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d00102570 0x7f6d001a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.263+0000 7f6d083dc640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6cec0a3500 0x7f6cec0a59c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.263+0000 7f6d083dc640 1 --2- 172.21.15.12:0/880448722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6d00100e20 0x7f6d001a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.263+0000 7f6d083dc640 1 -- 172.21.15.12:0/880448722 >> 172.21.15.12:0/880448722 conn(0x7f6d000fc7d0 msgr2=0x7f6d00104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.265+0000 7f6d083dc640 1 -- 172.21.15.12:0/880448722 shutdown_connections 2024-09-19T06:51:40.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:40.267+0000 7f6d083dc640 1 -- 172.21.15.12:0/880448722 wait complete. 2024-09-19T06:51:40.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 655.0 s, 2699.6 tps, lat 37.328 ms stddev 45.229 2024-09-19T06:51:41.229 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:51:41.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:41 smithi012 ceph-mon[30937]: pgmap v359: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 859 op/s 2024-09-19T06:51:41.643 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:41.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:41 smithi016 ceph-mon[34911]: pgmap v359: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 859 op/s 2024-09-19T06:51:41.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:41 smithi173 ceph-mon[35349]: pgmap v359: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 859 op/s 2024-09-19T06:51:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 -- 172.21.15.12:0/3460780085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38d0105f50 msgr2=0x7f38d01063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 --2- 172.21.15.12:0/3460780085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38d0105f50 0x7f38d01063e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009be0 tx=0x7f38c802a750 comp rx=0 tx=0).stop 2024-09-19T06:51:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 -- 172.21.15.12:0/3460780085 shutdown_connections 2024-09-19T06:51:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 --2- 172.21.15.12:0/3460780085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38d0105f50 0x7f38d01063e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 --2- 172.21.15.12:0/3460780085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38d0101460 0x7f38d0105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 --2- 172.21.15.12:0/3460780085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38d0100b40 0x7f38d0100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 -- 172.21.15.12:0/3460780085 >> 172.21.15.12:0/3460780085 conn(0x7f38d00fc7d0 msgr2=0x7f38d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 -- 172.21.15.12:0/3460780085 shutdown_connections 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 -- 172.21.15.12:0/3460780085 wait complete. 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 Processor -- start 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.367+0000 7f38d6510640 1 -- start start 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38d6510640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38d0100b40 0x7f38d01a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38d6510640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38d0101460 0x7f38d01a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38cffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38d0100b40 0x7f38d01a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38d0101460 0x7f38d01a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38d0101460 0x7f38d01a4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43828/0 (socket says 172.21.15.12:43828) 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38cffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38d0100b40 0x7f38d01a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:44436/0 (socket says 172.21.15.12:44436) 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38cf7fe640 1 -- 172.21.15.12:0/274312916 learned_addr learned my addr 172.21.15.12:0/274312916 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38d6510640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38d0105f50 0x7f38d019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01184c0 con 0x7f38d0101460 2024-09-19T06:51:42.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0118340 con 0x7f38d0105f50 2024-09-19T06:51:42.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.368+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f38d0118640 con 0x7f38d0100b40 2024-09-19T06:51:42.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.369+0000 7f38d4aad640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38d0105f50 0x7f38d019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.369+0000 7f38cf7fe640 1 -- 172.21.15.12:0/274312916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38d0100b40 msgr2=0x7f38d01a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.369+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38d0100b40 0x7f38d01a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.369+0000 7f38cf7fe640 1 -- 172.21.15.12:0/274312916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38d0105f50 msgr2=0x7f38d019e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.369+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38d0105f50 0x7f38d019e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.369+0000 7f38cf7fe640 1 -- 172.21.15.12:0/274312916 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d019f040 con 0x7f38d0101460 2024-09-19T06:51:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.369+0000 7f38d4aad640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38d0105f50 0x7f38d019e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.370+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38d0101460 0x7f38d01a4c90 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f38c400e910 tx=0x7f38c400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.371+0000 7f38cd7fa640 1 -- 172.21.15.12:0/274312916 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c400cd80 con 0x7f38d0101460 2024-09-19T06:51:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.371+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d019f330 con 0x7f38d0101460 2024-09-19T06:51:42.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.371+0000 7f38cd7fa640 1 -- 172.21.15.12:0/274312916 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c40035f0 con 0x7f38d0101460 2024-09-19T06:51:42.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.371+0000 7f38cd7fa640 1 -- 172.21.15.12:0/274312916 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4010670 con 0x7f38d0101460 2024-09-19T06:51:42.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.371+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d01ab620 con 0x7f38d0101460 2024-09-19T06:51:42.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.373+0000 7f38cd7fa640 1 -- 172.21.15.12:0/274312916 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f38c40037a0 con 0x7f38d0101460 2024-09-19T06:51:42.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38d88e9740 1 Processor -- start 2024-09-19T06:51:42.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38cd7fa640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38b80a33b0 0x7f38b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38d88e9740 1 -- start start 2024-09-19T06:51:42.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38cd7fa640 1 -- 172.21.15.12:0/274312916 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f38c40cffc0 con 0x7f38d0101460 2024-09-19T06:51:42.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38d4aad640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38b80a33b0 0x7f38b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa1bb40 0x559c5fa1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 0x559c5fa1aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38d88e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559c5f9802f0 con 0x559c5fa25370 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38d88e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559c5f927cf0 con 0x559c5fa1a5d0 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38d88e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559c5f97c2b0 con 0x559c5fa1bb40 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38cffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa1bb40 0x559c5fa1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38cffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa1bb40 0x559c5fa1a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:44438/0 (socket says 172.21.15.12:44438) 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38cffff640 1 -- 172.21.15.12:0/1884050313 learned_addr learned my addr 172.21.15.12:0/1884050313 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.374+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/1884050313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 0x559c5fa1aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38cf7fe640 1 -- 172.21.15.12:0/1884050313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa1bb40 msgr2=0x559c5fa1a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/1884050313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa1bb40 0x559c5fa1a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38d4aad640 1 --2- 172.21.15.12:0/1884050313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38cf7fe640 1 -- 172.21.15.12:0/1884050313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 msgr2=0x559c5fa27760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/1884050313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa27760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38cf7fe640 1 -- 172.21.15.12:0/1884050313 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c5f90c3a0 con 0x559c5fa1a5d0 2024-09-19T06:51:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38d4aad640 1 --2- 172.21.15.12:0/1884050313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38d4aad640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38b80a33b0 0x7f38b80a5870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f38c80099a0 tx=0x7f38c8030a90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/1884050313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 0x559c5fa1aa10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f38c40cd670 tx=0x7f38c40985d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=896502f867ba5dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38b67fc640 1 -- 172.21.15.12:0/1884050313 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c40b5070 con 0x559c5fa1a5d0 2024-09-19T06:51:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38b67fc640 1 -- 172.21.15.12:0/1884050313 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c409c200 con 0x559c5fa1a5d0 2024-09-19T06:51:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.375+0000 7f38b67fc640 1 -- 172.21.15.12:0/1884050313 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4098870 con 0x559c5fa1a5d0 2024-09-19T06:51:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.376+0000 7f38d88e9740 1 -- 172.21.15.12:0/1884050313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 msgr2=0x559c5fa1aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.376+0000 7f38d88e9740 1 --2- 172.21.15.12:0/1884050313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 0x559c5fa1aa10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f38c40cd670 tx=0x7f38c40985d0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.376+0000 7f38d88e9740 1 -- 172.21.15.12:0/1884050313 shutdown_connections 2024-09-19T06:51:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.376+0000 7f38d88e9740 1 --2- 172.21.15.12:0/1884050313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.376+0000 7f38d88e9740 1 --2- 172.21.15.12:0/1884050313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 0x559c5fa1aa10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.376+0000 7f38d88e9740 1 --2- 172.21.15.12:0/1884050313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa1bb40 0x559c5fa1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.376+0000 7f38d88e9740 1 -- 172.21.15.12:0/1884050313 >> 172.21.15.12:0/1884050313 conn(0x559c5f9e3310 msgr2=0x559c5fa16c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.377+0000 7f38d88e9740 1 -- 172.21.15.12:0/1884050313 shutdown_connections 2024-09-19T06:51:42.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.378+0000 7f38d88e9740 1 -- 172.21.15.12:0/1884050313 wait complete. 2024-09-19T06:51:42.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.379+0000 7f38d88e9740 1 -- start start 2024-09-19T06:51:42.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.379+0000 7f38d88e9740 1 Processor -- start 2024-09-19T06:51:42.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.380+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 0x559c5fa24de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.380+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa1bb40 0x559c5fa22090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.380+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa227d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.380+0000 7f38d88e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559c5fa28010 con 0x559c5fa25370 2024-09-19T06:51:42.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.380+0000 7f38d88e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559c5f93b060 con 0x559c5fa1a5d0 2024-09-19T06:51:42.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.381+0000 7f38d88e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559c5fa28190 con 0x559c5fa1bb40 2024-09-19T06:51:42.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.381+0000 7f38d88e9740 10 client.0 _ll_register_callbacks cb 0x559c5f68e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:42.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.385+0000 7f38d4aad640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.385+0000 7f38d4aad640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43840/0 (socket says 172.21.15.12:43840) 2024-09-19T06:51:42.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.385+0000 7f38d4aad640 1 -- 172.21.15.12:0/541995392 learned_addr learned my addr 172.21.15.12:0/541995392 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.386+0000 7f38cffff640 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 0x559c5fa24de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.386+0000 7f38d4aad640 1 -- 172.21.15.12:0/541995392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa1bb40 msgr2=0x559c5fa22090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.386+0000 7f38d4aad640 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa1bb40 0x559c5fa22090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.386+0000 7f38d4aad640 1 -- 172.21.15.12:0/541995392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 msgr2=0x559c5fa24de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:42.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.386+0000 7f38d4aad640 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 0x559c5fa24de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.386+0000 7f38d4aad640 1 -- 172.21.15.12:0/541995392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c5f6f13c0 con 0x559c5fa25370 2024-09-19T06:51:42.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.387+0000 7f38d4aad640 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa227d0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f38c8033000 tx=0x7f38c802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8759d8e319f730ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:42.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.387+0000 7f38af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:42.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.395+0000 7f38af7fe640 1 -- 172.21.15.12:0/541995392 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c804f060 con 0x559c5fa25370 2024-09-19T06:51:42.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.395+0000 7f38af7fe640 1 -- 172.21.15.12:0/541995392 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f38c8004250 con 0x559c5fa25370 2024-09-19T06:51:42.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.395+0000 7f38d88e9740 1 -- 172.21.15.12:0/541995392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38c409c200 con 0x559c5fa25370 2024-09-19T06:51:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.397+0000 7f38af7fe640 1 -- 172.21.15.12:0/541995392 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f38c8036040 con 0x559c5fa25370 2024-09-19T06:51:42.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.399+0000 7f38d88e9740 10 client.18672 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:42.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.399+0000 7f38d88e9740 1 -- 172.21.15.12:0/541995392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x559c5fa33ab0 con 0x559c5fa25370 2024-09-19T06:51:42.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.401+0000 7f38af7fe640 1 -- 172.21.15.12:0/541995392 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c409c200 con 0x559c5fa25370 2024-09-19T06:51:42.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.401+0000 7f38af7fe640 1 -- 172.21.15.12:0/541995392 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f38c803c030 con 0x559c5fa25370 2024-09-19T06:51:42.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.401+0000 7f38d88e9740 10 client.18672 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:42.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.401+0000 7f38d88e9740 10 client.18672 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:51:42.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.401+0000 7f38d88e9740 20 client.18672 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:42.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.401+0000 7f38d88e9740 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x559c5fa34f10 0x559c5fa37360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.401+0000 7f38d88e9740 4 client.18672 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:42.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.401+0000 7f38d88e9740 1 -- 172.21.15.12:0/541995392 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c5f98d860 con 0x559c5fa34f10 2024-09-19T06:51:42.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.403+0000 7f38cffff640 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x559c5fa34f10 0x559c5fa37360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.406+0000 7f38af7fe640 10 client.18672 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:51:42.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.406+0000 7f38cffff640 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x559c5fa34f10 0x559c5fa37360 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1a7680a7ca17855c server_cookie=3ff98ac2b024aa4a in_seq=0 out_seq=0 2024-09-19T06:51:42.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.408+0000 7f38af7fe640 1 -- 172.21.15.12:0/541995392 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c5f98d860 con 0x559c5fa34f10 2024-09-19T06:51:42.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.408+0000 7f38af7fe640 10 client.18672 handle_command_reply: tid=0 2024-09-19T06:51:42.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.408+0000 7f38d88e9740 1 client.18672 shutdown 2024-09-19T06:51:42.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.412+0000 7f38d88e9740 1 -- 172.21.15.12:0/541995392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 msgr2=0x559c5fa227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:42.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.412+0000 7f38d88e9740 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa227d0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f38c8033000 tx=0x7f38c802a750 comp rx=0 tx=0).stop 2024-09-19T06:51:42.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.421+0000 7f38d88e9740 1 -- 172.21.15.12:0/541995392 shutdown_connections 2024-09-19T06:51:42.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.421+0000 7f38d88e9740 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x559c5fa34f10 0x559c5fa37360 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.421+0000 7f38d88e9740 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa25370 0x559c5fa227d0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.421+0000 7f38af7fe640 0 client.18672 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:51:42.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.421+0000 7f38d88e9740 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa1bb40 0x559c5fa22090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.421+0000 7f38d88e9740 1 --2- 172.21.15.12:0/541995392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1a5d0 0x559c5fa24de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.421+0000 7f38d88e9740 1 -- 172.21.15.12:0/541995392 >> 172.21.15.12:0/541995392 conn(0x559c5f9e3310 msgr2=0x559c5fa1c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:42.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.423+0000 7f38d88e9740 1 -- 172.21.15.12:0/541995392 shutdown_connections 2024-09-19T06:51:42.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.426+0000 7f38d88e9740 1 -- 172.21.15.12:0/541995392 wait complete. 2024-09-19T06:51:42.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.426+0000 7f38d88e9740 20 client.18672 trim_cache size 0 max 16384 2024-09-19T06:51:42.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.453+0000 7f38d88e9740 1 Processor -- start 2024-09-19T06:51:42.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.453+0000 7f38d88e9740 1 -- start start 2024-09-19T06:51:42.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.454+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa1a5d0 0x559c5fa312b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.454+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa15bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.454+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 0x559c5fa3cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.455+0000 7f38d88e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01b42c0 con 0x559c5fa1a5d0 2024-09-19T06:51:42.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.455+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa15bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.455+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa15bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:42208/0 (socket says 172.21.15.12:42208) 2024-09-19T06:51:42.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.455+0000 7f38cf7fe640 1 -- 172.21.15.12:0/476545584 learned_addr learned my addr 172.21.15.12:0/476545584 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:42.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.455+0000 7f38d4aad640 1 --2- 172.21.15.12:0/476545584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 0x559c5fa3cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.455+0000 7f38d88e9740 1 -- 172.21.15.12:0/476545584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01b5e90 con 0x559c5fa1bb40 2024-09-19T06:51:42.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.455+0000 7f38d88e9740 1 -- 172.21.15.12:0/476545584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01b4990 con 0x559c5fa25370 2024-09-19T06:51:42.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.456+0000 7f38d4aad640 1 -- 172.21.15.12:0/476545584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 msgr2=0x559c5fa15bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:42.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.456+0000 7f38d4aad640 1 --2- 172.21.15.12:0/476545584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa15bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.456+0000 7f38d4aad640 1 -- 172.21.15.12:0/476545584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa1a5d0 msgr2=0x559c5fa312b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:51:42.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.456+0000 7f38d4aad640 1 --2- 172.21.15.12:0/476545584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa1a5d0 0x559c5fa312b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.456+0000 7f38d4aad640 1 -- 172.21.15.12:0/476545584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c5fa379e0 con 0x559c5fa25370 2024-09-19T06:51:42.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.456+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/476545584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa15bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:42.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.457+0000 7f38d4aad640 1 --2- 172.21.15.12:0/476545584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 0x559c5fa3cc70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f38c802ac70 tx=0x7f38c8009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7516cea28456a2d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:42.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.457+0000 7f38b5ffb640 1 -- 172.21.15.12:0/476545584 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c804f070 con 0x559c5fa25370 2024-09-19T06:51:42.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.457+0000 7f38b5ffb640 1 -- 172.21.15.12:0/476545584 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c8037040 con 0x559c5fa25370 2024-09-19T06:51:42.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.457+0000 7f38b5ffb640 1 -- 172.21.15.12:0/476545584 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8059080 con 0x559c5fa25370 2024-09-19T06:51:42.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.459+0000 7f38d88e9740 1 -- 172.21.15.12:0/476545584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 msgr2=0x559c5fa3cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:42.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.459+0000 7f38d88e9740 1 --2- 172.21.15.12:0/476545584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 0x559c5fa3cc70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f38c802ac70 tx=0x7f38c8009500 comp rx=0 tx=0).stop 2024-09-19T06:51:42.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.459+0000 7f38d88e9740 1 -- 172.21.15.12:0/476545584 shutdown_connections 2024-09-19T06:51:42.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.459+0000 7f38d88e9740 1 --2- 172.21.15.12:0/476545584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 0x559c5fa3cc70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.459+0000 7f38d88e9740 1 --2- 172.21.15.12:0/476545584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa15bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.459+0000 7f38d88e9740 1 --2- 172.21.15.12:0/476545584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa1a5d0 0x559c5fa312b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.459+0000 7f38d88e9740 1 -- 172.21.15.12:0/476545584 >> 172.21.15.12:0/476545584 conn(0x559c5f9e3310 msgr2=0x559c5fa154e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:42.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.460+0000 7f38d88e9740 1 -- 172.21.15.12:0/476545584 shutdown_connections 2024-09-19T06:51:42.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.460+0000 7f38d88e9740 1 -- 172.21.15.12:0/476545584 wait complete. 2024-09-19T06:51:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.460+0000 7f38d88e9740 1 -- start start 2024-09-19T06:51:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.460+0000 7f38d88e9740 1 Processor -- start 2024-09-19T06:51:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.460+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa1a5d0 0x559c5fa29d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.460+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa2a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.460+0000 7f38d88e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 0x559c5fa97c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.460+0000 7f38d88e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01b57c0 con 0x559c5fa1a5d0 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.460+0000 7f38d88e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01b50f0 con 0x559c5fa1bb40 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.460+0000 7f38d88e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f38d01b22c0 con 0x559c5fa25370 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38d88e9740 10 client.0 _ll_register_callbacks cb 0x7f38c8034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa2a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38cf7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa2a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:42222/0 (socket says 172.21.15.12:42222) 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38cf7fe640 1 -- 172.21.15.12:0/4210068169 learned_addr learned my addr 172.21.15.12:0/4210068169 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38cffff640 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa1a5d0 0x559c5fa29d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38d4aad640 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 0x559c5fa97c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38cf7fe640 1 -- 172.21.15.12:0/4210068169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 msgr2=0x559c5fa97c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 0x559c5fa97c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38cf7fe640 1 -- 172.21.15.12:0/4210068169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa1a5d0 msgr2=0x559c5fa29d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa1a5d0 0x559c5fa29d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38cf7fe640 1 -- 172.21.15.12:0/4210068169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c5fa982c0 con 0x559c5fa1bb40 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38d4aad640 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 0x559c5fa97c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38cf7fe640 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa2a250 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f38c409c190 tx=0x7f38c4098aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b84f271fc7fcf6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.461+0000 7f38af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.462+0000 7f38af7fe640 1 -- 172.21.15.12:0/4210068169 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c40b5040 con 0x559c5fa1bb40 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.462+0000 7f38d88e9740 1 -- 172.21.15.12:0/4210068169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38c8037040 con 0x559c5fa1bb40 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.462+0000 7f38af7fe640 1 -- 172.21.15.12:0/4210068169 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f38c40bc050 con 0x559c5fa1bb40 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.462+0000 7f38af7fe640 1 -- 172.21.15.12:0/4210068169 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f38c409c200 con 0x559c5fa1bb40 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.463+0000 7f38d88e9740 10 client.28001 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.463+0000 7f38d88e9740 1 -- 172.21.15.12:0/4210068169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x559c5faa0780 con 0x559c5fa1bb40 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.463+0000 7f38af7fe640 1 -- 172.21.15.12:0/4210068169 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c8037040 con 0x559c5fa1bb40 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.463+0000 7f38af7fe640 1 -- 172.21.15.12:0/4210068169 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f38c409b650 con 0x559c5fa1bb40 2024-09-19T06:51:42.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.464+0000 7f38d88e9740 10 client.28001 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.464+0000 7f38d88e9740 10 client.28001 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:51:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.464+0000 7f38d88e9740 20 client.28001 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.464+0000 7f38d88e9740 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x559c5faa0ab0 0x559c5faa2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.464+0000 7f38d88e9740 4 client.28001 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:51:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.464+0000 7f38d88e9740 1 -- 172.21.15.12:0/4210068169 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c5f987d70 con 0x559c5faa0ab0 2024-09-19T06:51:42.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.464+0000 7f38cffff640 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x559c5faa0ab0 0x559c5faa2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.464+0000 7f38cffff640 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x559c5faa0ab0 0x559c5faa2ea0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4de2578f563d1478 server_cookie=635455f0de5f27b in_seq=0 out_seq=0 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.464+0000 7f38af7fe640 10 client.28001 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38af7fe640 1 -- 172.21.15.12:0/4210068169 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c5f987d70 con 0x559c5faa0ab0 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38af7fe640 10 client.28001 handle_command_reply: tid=0 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 client.28001 shutdown 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 -- 172.21.15.12:0/4210068169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 msgr2=0x559c5fa2a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa2a250 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f38c409c190 tx=0x7f38c4098aa0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 -- 172.21.15.12:0/4210068169 shutdown_connections 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x559c5faa0ab0 0x559c5faa2ea0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c5fa25370 0x559c5fa97c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559c5fa1bb40 0x559c5fa2a250 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 --2- 172.21.15.12:0/4210068169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c5fa1a5d0 0x559c5fa29d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38af7fe640 0 client.28001 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:51:42.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 -- 172.21.15.12:0/4210068169 >> 172.21.15.12:0/4210068169 conn(0x559c5f9e3310 msgr2=0x559c5fa24110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:42.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 -- 172.21.15.12:0/4210068169 shutdown_connections 2024-09-19T06:51:42.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 1 -- 172.21.15.12:0/4210068169 wait complete. 2024-09-19T06:51:42.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.465+0000 7f38d88e9740 20 client.28001 trim_cache size 0 max 16384 2024-09-19T06:51:42.471 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38b80a33b0 msgr2=0x7f38b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38b80a33b0 0x7f38b80a5870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f38c80099a0 tx=0x7f38c8030a90 comp rx=0 tx=0).stop 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38d0101460 msgr2=0x7f38d01a4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38d0101460 0x7f38d01a4c90 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f38c400e910 tx=0x7f38c400edd0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 shutdown_connections 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38d0105f50 0x7f38d019e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38d0101460 0x7f38d01a4c90 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f38b80a33b0 0x7f38b80a5870 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 --2- 172.21.15.12:0/274312916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38d0100b40 0x7f38d01a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 >> 172.21.15.12:0/274312916 conn(0x7f38d00fc7d0 msgr2=0x7f38d010f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 shutdown_connections 2024-09-19T06:51:42.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:42.466+0000 7f38d6510640 1 -- 172.21.15.12:0/274312916 wait complete. 2024-09-19T06:51:43.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:51:43.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:43 smithi012 ceph-mon[30937]: pgmap v360: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 585 op/s 2024-09-19T06:51:43.643 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:43.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:43 smithi016 ceph-mon[34911]: pgmap v360: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 585 op/s 2024-09-19T06:51:43.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:43 smithi173 ceph-mon[35349]: pgmap v360: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 585 op/s 2024-09-19T06:51:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.023+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1993405791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc10c0e0 msgr2=0x7f40dc10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.023+0000 7f40e1ab7640 1 --2- 172.21.15.12:0/1993405791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc10c0e0 0x7f40dc10e550 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009ca0 tx=0x7f40d402a950 comp rx=0 tx=0).stop 2024-09-19T06:51:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.023+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1993405791 shutdown_connections 2024-09-19T06:51:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.023+0000 7f40e1ab7640 1 --2- 172.21.15.12:0/1993405791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc10c0e0 0x7f40dc10e550 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.023+0000 7f40e1ab7640 1 --2- 172.21.15.12:0/1993405791 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40dc1035e0 0x7f40dc10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.023+0000 7f40e1ab7640 1 --2- 172.21.15.12:0/1993405791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40dc102cc0 0x7f40dc1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.023+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1993405791 >> 172.21.15.12:0/1993405791 conn(0x7f40dc077990 msgr2=0x7f40dc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.023+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1993405791 shutdown_connections 2024-09-19T06:51:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.023+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1993405791 wait complete. 2024-09-19T06:51:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.024+0000 7f40e1ab7640 1 Processor -- start 2024-09-19T06:51:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.024+0000 7f40e1ab7640 1 -- start start 2024-09-19T06:51:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40e1ab7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc102cc0 0x7f40dc10abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40e1ab7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40dc1035e0 0x7f40dc10b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40e1ab7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40dc10c0e0 0x7f40dc19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40e1ab7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc111eb0 con 0x7f40dc102cc0 2024-09-19T06:51:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40e1ab7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc111d30 con 0x7f40dc10c0e0 2024-09-19T06:51:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40e1ab7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc112030 con 0x7f40dc1035e0 2024-09-19T06:51:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40dbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40dc10c0e0 0x7f40dc19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40daffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40dc1035e0 0x7f40dc10b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40dbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40dc10c0e0 0x7f40dc19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:42240/0 (socket says 172.21.15.12:42240) 2024-09-19T06:51:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40dbfff640 1 -- 172.21.15.12:0/1422367595 learned_addr learned my addr 172.21.15.12:0/1422367595 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.025+0000 7f40db7fe640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc102cc0 0x7f40dc10abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.026+0000 7f40daffd640 1 -- 172.21.15.12:0/1422367595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40dc10c0e0 msgr2=0x7f40dc19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.026+0000 7f40daffd640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40dc10c0e0 0x7f40dc19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.026+0000 7f40daffd640 1 -- 172.21.15.12:0/1422367595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc102cc0 msgr2=0x7f40dc10abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.026+0000 7f40daffd640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc102cc0 0x7f40dc10abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.026+0000 7f40daffd640 1 -- 172.21.15.12:0/1422367595 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40dc19af20 con 0x7f40dc1035e0 2024-09-19T06:51:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.026+0000 7f40daffd640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40dc1035e0 0x7f40dc10b130 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e9f0 tx=0x7f40d000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.026+0000 7f40d8ff9640 1 -- 172.21.15.12:0/1422367595 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d000ccc0 con 0x7f40dc1035e0 2024-09-19T06:51:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.026+0000 7f40d8ff9640 1 -- 172.21.15.12:0/1422367595 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d0010910 con 0x7f40dc1035e0 2024-09-19T06:51:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.026+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1422367595 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40dc19b1b0 con 0x7f40dc1035e0 2024-09-19T06:51:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.027+0000 7f40d8ff9640 1 -- 172.21.15.12:0/1422367595 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0018960 con 0x7f40dc1035e0 2024-09-19T06:51:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.027+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1422367595 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40dc19b6f0 con 0x7f40dc1035e0 2024-09-19T06:51:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.030+0000 7f40d8ff9640 1 -- 172.21.15.12:0/1422367595 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f40d0018b00 con 0x7f40dc1035e0 2024-09-19T06:51:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.030+0000 7f40e4852740 1 Processor -- start 2024-09-19T06:51:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.030+0000 7f40e4852740 1 -- start start 2024-09-19T06:51:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40e4852740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fbaf0 0x55e5600fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40e4852740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 0x55e560106770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40e4852740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e560106cb0 0x55e5601090a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40e4852740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e5600602f0 con 0x55e560106cb0 2024-09-19T06:51:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40e4852740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e560008270 con 0x55e5600fc410 2024-09-19T06:51:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40d8ff9640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40c40a34e0 0x7f40c40a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40e4852740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e56005c2b0 con 0x55e5600fbaf0 2024-09-19T06:51:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40dbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fbaf0 0x55e5600fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40db7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 0x55e560106770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40dbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fbaf0 0x55e5600fbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:44494/0 (socket says 172.21.15.12:44494) 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40dbfff640 1 -- 172.21.15.12:0/3688984997 learned_addr learned my addr 172.21.15.12:0/3688984997 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40db7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 0x55e560106770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:42248/0 (socket says 172.21.15.12:42248) 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40dbfff640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40c40a34e0 0x7f40c40a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40d8ff9640 1 -- 172.21.15.12:0/1422367595 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f40d00d0100 con 0x7f40dc1035e0 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40daffd640 1 --2- 172.21.15.12:0/3688984997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e560106cb0 0x55e5601090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40dbfff640 1 -- 172.21.15.12:0/3688984997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 msgr2=0x55e560106770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40dbfff640 1 --2- 172.21.15.12:0/3688984997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 0x55e560106770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40dbfff640 1 -- 172.21.15.12:0/3688984997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e560106cb0 msgr2=0x55e5601090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40dbfff640 1 --2- 172.21.15.12:0/3688984997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e560106cb0 0x55e5601090a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.031+0000 7f40dbfff640 1 -- 172.21.15.12:0/3688984997 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e560007340 con 0x55e5600fbaf0 2024-09-19T06:51:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.032+0000 7f40dbfff640 1 --2- 172.21.15.12:0/3688984997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fbaf0 0x55e5600fbed0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f40d402f4a0 tx=0x7f40d402f4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db95c48d1ce57d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.032+0000 7f40dbfff640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40c40a34e0 0x7f40c40a59a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40d402f540 tx=0x7f40d4043000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.032+0000 7f40c1ffb640 1 -- 172.21.15.12:0/3688984997 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4034040 con 0x55e5600fbaf0 2024-09-19T06:51:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.032+0000 7f40c1ffb640 1 -- 172.21.15.12:0/3688984997 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d402fb70 con 0x55e5600fbaf0 2024-09-19T06:51:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.032+0000 7f40c1ffb640 1 -- 172.21.15.12:0/3688984997 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4005050 con 0x55e5600fbaf0 2024-09-19T06:51:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 -- 172.21.15.12:0/3688984997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fbaf0 msgr2=0x55e5600fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 --2- 172.21.15.12:0/3688984997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fbaf0 0x55e5600fbed0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f40d402f4a0 tx=0x7f40d402f4d0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 -- 172.21.15.12:0/3688984997 shutdown_connections 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 --2- 172.21.15.12:0/3688984997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e560106cb0 0x55e5601090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 --2- 172.21.15.12:0/3688984997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 0x55e560106770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 --2- 172.21.15.12:0/3688984997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fbaf0 0x55e5600fbed0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 -- 172.21.15.12:0/3688984997 >> 172.21.15.12:0/3688984997 conn(0x55e5600f8060 msgr2=0x55e5600f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 -- 172.21.15.12:0/3688984997 shutdown_connections 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 -- 172.21.15.12:0/3688984997 wait complete. 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 -- start start 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.033+0000 7f40e4852740 1 Processor -- start 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40e4852740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e560103c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40e4852740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 0x55e560104180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40e4852740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e560106cb0 0x55e5601046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40e4852740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e560109880 con 0x55e5600fbaf0 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40e4852740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e55ffe9290 con 0x55e560106cb0 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40e4852740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e560109a00 con 0x55e5600fc410 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e560103c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e560103c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43896/0 (socket says 172.21.15.12:43896) 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40db7fe640 1 -- 172.21.15.12:0/1905615740 learned_addr learned my addr 172.21.15.12:0/1905615740 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40daffd640 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 0x55e560104180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40e4852740 10 client.0 _ll_register_callbacks cb 0x55e56001a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40dbfff640 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e560106cb0 0x55e5601046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40db7fe640 1 -- 172.21.15.12:0/1905615740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 msgr2=0x55e560104180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40db7fe640 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 0x55e560104180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40db7fe640 1 -- 172.21.15.12:0/1905615740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e560106cb0 msgr2=0x55e5601046c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40db7fe640 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e560106cb0 0x55e5601046c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.034+0000 7f40db7fe640 1 -- 172.21.15.12:0/1905615740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e55fd73210 con 0x55e5600fbaf0 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.035+0000 7f40db7fe640 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e560103c40 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0126e0 tx=0x7f40cc012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0328290279f68e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.035+0000 7f40baffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.035+0000 7f40baffd640 1 -- 172.21.15.12:0/1905615740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc012190 con 0x55e5600fbaf0 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.035+0000 7f40baffd640 1 -- 172.21.15.12:0/1905615740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f40cc004020 con 0x55e5600fbaf0 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.035+0000 7f40e4852740 1 -- 172.21.15.12:0/1905615740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e56006da20 con 0x55e5600fbaf0 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.035+0000 7f40baffd640 1 -- 172.21.15.12:0/1905615740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f40cc004220 con 0x55e5600fbaf0 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.035+0000 7f40e4852740 10 client.18687 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.036+0000 7f40e4852740 1 -- 172.21.15.12:0/1905615740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55e55fe3f620 con 0x55e5600fbaf0 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.038+0000 7f40baffd640 1 -- 172.21.15.12:0/1905615740 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40cc00fe00 con 0x55e5600fbaf0 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.038+0000 7f40baffd640 1 -- 172.21.15.12:0/1905615740 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f40cc003b50 con 0x55e5600fbaf0 2024-09-19T06:51:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.038+0000 7f40e4852740 10 client.18687 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.038+0000 7f40e4852740 10 client.18687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.038+0000 7f40e4852740 20 client.18687 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.039+0000 7f40e4852740 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e560116cd0 0x55e5601190c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.039+0000 7f40e4852740 4 client.18687 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.039+0000 7f40e4852740 1 -- 172.21.15.12:0/1905615740 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e56006da20 con 0x55e560116cd0 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.039+0000 7f40daffd640 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e560116cd0 0x55e5601190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.039+0000 7f40baffd640 10 client.18687 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.039+0000 7f40daffd640 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e560116cd0 0x55e5601190c0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45eef7e97ff17454 server_cookie=4d53d797c1902e35 in_seq=0 out_seq=0 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.040+0000 7f40baffd640 1 -- 172.21.15.12:0/1905615740 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e56006da20 con 0x55e560116cd0 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.040+0000 7f40baffd640 10 client.18687 handle_command_reply: tid=0 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.040+0000 7f40e4852740 1 client.18687 shutdown 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.040+0000 7f40e4852740 1 -- 172.21.15.12:0/1905615740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 msgr2=0x55e560103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.040+0000 7f40e4852740 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e560103c40 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0126e0 tx=0x7f40cc012ba0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.040+0000 7f40e4852740 1 -- 172.21.15.12:0/1905615740 shutdown_connections 2024-09-19T06:51:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.041+0000 7f40e4852740 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e560116cd0 0x55e5601190c0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.041+0000 7f40baffd640 0 client.18687 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.041+0000 7f40e4852740 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e560106cb0 0x55e5601046c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.041+0000 7f40e4852740 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 0x55e560104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.041+0000 7f40e4852740 1 --2- 172.21.15.12:0/1905615740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e560103c40 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.041+0000 7f40e4852740 1 -- 172.21.15.12:0/1905615740 >> 172.21.15.12:0/1905615740 conn(0x55e5600f8060 msgr2=0x55e5600fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.041+0000 7f40e4852740 1 -- 172.21.15.12:0/1905615740 shutdown_connections 2024-09-19T06:51:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.041+0000 7f40e4852740 1 -- 172.21.15.12:0/1905615740 wait complete. 2024-09-19T06:51:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.041+0000 7f40e4852740 20 client.18687 trim_cache size 0 max 16384 2024-09-19T06:51:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.061+0000 7f40e4852740 1 Processor -- start 2024-09-19T06:51:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.061+0000 7f40e4852740 1 -- start start 2024-09-19T06:51:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40e4852740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e5600fe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40e4852740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 0x55e5601044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e5600fe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e5600fe5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43900/0 (socket says 172.21.15.12:43900) 2024-09-19T06:51:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40e4852740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e560106cb0 0x55e56011e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40db7fe640 1 -- 172.21.15.12:0/1388505907 learned_addr learned my addr 172.21.15.12:0/1388505907 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40daffd640 1 --2- 172.21.15.12:0/1388505907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 0x55e5601044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40e4852740 1 -- 172.21.15.12:0/1388505907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc1ab850 con 0x55e5600fbaf0 2024-09-19T06:51:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40e4852740 1 -- 172.21.15.12:0/1388505907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc1ad420 con 0x55e560106cb0 2024-09-19T06:51:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40e4852740 1 -- 172.21.15.12:0/1388505907 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc1abf20 con 0x55e5600fc410 2024-09-19T06:51:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.062+0000 7f40dbfff640 1 --2- 172.21.15.12:0/1388505907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e560106cb0 0x55e56011e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.063+0000 7f40daffd640 1 -- 172.21.15.12:0/1388505907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e560106cb0 msgr2=0x55e56011e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.063+0000 7f40daffd640 1 --2- 172.21.15.12:0/1388505907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e560106cb0 0x55e56011e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.063+0000 7f40daffd640 1 -- 172.21.15.12:0/1388505907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 msgr2=0x55e5600fe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.063+0000 7f40daffd640 1 --2- 172.21.15.12:0/1388505907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e5600fe5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.063+0000 7f40daffd640 1 -- 172.21.15.12:0/1388505907 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5600fd000 con 0x55e5600fc410 2024-09-19T06:51:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.063+0000 7f40daffd640 1 --2- 172.21.15.12:0/1388505907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 0x55e5601044f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f40d00cd7b0 tx=0x7f40d00986d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbf474b1ac644390 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.063+0000 7f40c17fa640 1 -- 172.21.15.12:0/1388505907 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00a4fb0 con 0x55e5600fc410 2024-09-19T06:51:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.063+0000 7f40c17fa640 1 -- 172.21.15.12:0/1388505907 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d009a6f0 con 0x55e5600fc410 2024-09-19T06:51:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.063+0000 7f40c17fa640 1 -- 172.21.15.12:0/1388505907 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00ac1b0 con 0x55e5600fc410 2024-09-19T06:51:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 -- 172.21.15.12:0/1388505907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 msgr2=0x55e5601044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 --2- 172.21.15.12:0/1388505907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 0x55e5601044f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f40d00cd7b0 tx=0x7f40d00986d0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 -- 172.21.15.12:0/1388505907 shutdown_connections 2024-09-19T06:51:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 --2- 172.21.15.12:0/1388505907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e560106cb0 0x55e56011e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 --2- 172.21.15.12:0/1388505907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5600fc410 0x55e5601044f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 --2- 172.21.15.12:0/1388505907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e5600fe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 -- 172.21.15.12:0/1388505907 >> 172.21.15.12:0/1388505907 conn(0x55e5600f8060 msgr2=0x55e560105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 -- 172.21.15.12:0/1388505907 shutdown_connections 2024-09-19T06:51:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 -- 172.21.15.12:0/1388505907 wait complete. 2024-09-19T06:51:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 -- start start 2024-09-19T06:51:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.064+0000 7f40e4852740 1 Processor -- start 2024-09-19T06:51:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40e4852740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e56010f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40e4852740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 0x55e5601009a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40e4852740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e560106cb0 0x55e560100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40e4852740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc1acd50 con 0x55e5600fbaf0 2024-09-19T06:51:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40e4852740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc1ac680 con 0x55e5600fc410 2024-09-19T06:51:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40e4852740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc1030a0 con 0x55e560106cb0 2024-09-19T06:51:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40e4852740 10 client.0 _ll_register_callbacks cb 0x7f40cc009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e56010f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e56010f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43904/0 (socket says 172.21.15.12:43904) 2024-09-19T06:51:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40db7fe640 1 -- 172.21.15.12:0/3639576579 learned_addr learned my addr 172.21.15.12:0/3639576579 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40dbfff640 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e560106cb0 0x55e560100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.065+0000 7f40daffd640 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 0x55e5601009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40dbfff640 1 -- 172.21.15.12:0/3639576579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 msgr2=0x55e5601009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40dbfff640 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 0x55e5601009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40dbfff640 1 -- 172.21.15.12:0/3639576579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 msgr2=0x55e56010f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40dbfff640 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e56010f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40dbfff640 1 -- 172.21.15.12:0/3639576579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5601016c0 con 0x55e560106cb0 2024-09-19T06:51:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40dbfff640 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e560106cb0 0x55e560100ee0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f40d402ae70 tx=0x7f40d402f870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=511d03e14b632c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40baffd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:51:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40baffd640 1 -- 172.21.15.12:0/3639576579 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4003e30 con 0x55e560106cb0 2024-09-19T06:51:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40e4852740 1 -- 172.21.15.12:0/3639576579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d009a6f0 con 0x55e560106cb0 2024-09-19T06:51:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40baffd640 1 -- 172.21.15.12:0/3639576579 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f40d4004040 con 0x55e560106cb0 2024-09-19T06:51:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40baffd640 1 -- 172.21.15.12:0/3639576579 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f40d4067050 con 0x55e560106cb0 2024-09-19T06:51:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40e4852740 10 client.27976 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.066+0000 7f40e4852740 1 -- 172.21.15.12:0/3639576579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55e5601819d0 con 0x55e560106cb0 2024-09-19T06:51:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40baffd640 1 -- 172.21.15.12:0/3639576579 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40d009a6f0 con 0x55e560106cb0 2024-09-19T06:51:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40baffd640 1 -- 172.21.15.12:0/3639576579 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f40d4062030 con 0x55e560106cb0 2024-09-19T06:51:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40e4852740 10 client.27976 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40e4852740 10 client.27976 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40e4852740 20 client.27976 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40e4852740 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e560116cd0 0x55e560183d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40e4852740 4 client.27976 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:51:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40e4852740 1 -- 172.21.15.12:0/3639576579 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e560067d70 con 0x55e560116cd0 2024-09-19T06:51:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40db7fe640 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e560116cd0 0x55e560183d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40baffd640 10 client.27976 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.067+0000 7f40db7fe640 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e560116cd0 0x55e560183d70 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f20b5fe7c969b1e server_cookie=ca153b14c761f133 in_seq=0 out_seq=0 2024-09-19T06:51:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40baffd640 1 -- 172.21.15.12:0/3639576579 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e560067d70 con 0x55e560116cd0 2024-09-19T06:51:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40baffd640 10 client.27976 handle_command_reply: tid=0 2024-09-19T06:51:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40e4852740 1 client.27976 shutdown 2024-09-19T06:51:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40e4852740 1 -- 172.21.15.12:0/3639576579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e560106cb0 msgr2=0x55e560100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40e4852740 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e560106cb0 0x55e560100ee0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f40d402ae70 tx=0x7f40d402f870 comp rx=0 tx=0).stop 2024-09-19T06:51:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40e4852740 1 -- 172.21.15.12:0/3639576579 shutdown_connections 2024-09-19T06:51:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40e4852740 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e560116cd0 0x55e560183d70 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40e4852740 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e560106cb0 0x55e560100ee0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40e4852740 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5600fc410 0x55e5601009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40e4852740 1 --2- 172.21.15.12:0/3639576579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5600fbaf0 0x55e56010f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40baffd640 0 client.27976 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.077+0000 7f40e4852740 1 -- 172.21.15.12:0/3639576579 >> 172.21.15.12:0/3639576579 conn(0x55e5600f8060 msgr2=0x55e560105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e4852740 1 -- 172.21.15.12:0/3639576579 shutdown_connections 2024-09-19T06:51:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e4852740 1 -- 172.21.15.12:0/3639576579 wait complete. 2024-09-19T06:51:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e4852740 20 client.27976 trim_cache size 0 max 16384 2024-09-19T06:51:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:51:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:51:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:51:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:51:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1422367595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40c40a34e0 msgr2=0x7f40c40a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e1ab7640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40c40a34e0 0x7f40c40a59a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40d402f540 tx=0x7f40d4043000 comp rx=0 tx=0).stop 2024-09-19T06:51:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1422367595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40dc1035e0 msgr2=0x7f40dc10b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e1ab7640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40dc1035e0 0x7f40dc10b130 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e9f0 tx=0x7f40d000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1422367595 shutdown_connections 2024-09-19T06:51:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e1ab7640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40dc10c0e0 0x7f40dc19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e1ab7640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40c40a34e0 0x7f40c40a59a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e1ab7640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40dc1035e0 0x7f40dc10b130 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e1ab7640 1 --2- 172.21.15.12:0/1422367595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc102cc0 0x7f40dc10abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.078+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1422367595 >> 172.21.15.12:0/1422367595 conn(0x7f40dc077990 msgr2=0x7f40dc1008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.079+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1422367595 shutdown_connections 2024-09-19T06:51:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:44.079+0000 7f40e1ab7640 1 -- 172.21.15.12:0/1422367595 wait complete. 2024-09-19T06:51:44.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.218+0000 7f18815b8640 1 -- 172.21.15.12:0/225674212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f187c102780 msgr2=0x7f187c1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.218+0000 7f18815b8640 1 --2- 172.21.15.12:0/225674212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f187c102780 0x7f187c1067d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1870009860 tx=0x7f187002a360 comp rx=0 tx=0).stop 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.219+0000 7f18815b8640 1 -- 172.21.15.12:0/225674212 shutdown_connections 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.219+0000 7f18815b8640 1 --2- 172.21.15.12:0/225674212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187c106f00 0x7f187c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.219+0000 7f18815b8640 1 --2- 172.21.15.12:0/225674212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f187c102780 0x7f187c1067d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.219+0000 7f18815b8640 1 --2- 172.21.15.12:0/225674212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f187c101dd0 0x7f187c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.219+0000 7f18815b8640 1 -- 172.21.15.12:0/225674212 >> 172.21.15.12:0/225674212 conn(0x7f187c0fd8b0 msgr2=0x7f187c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.219+0000 7f18815b8640 1 -- 172.21.15.12:0/225674212 shutdown_connections 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.219+0000 7f18815b8640 1 -- 172.21.15.12:0/225674212 wait complete. 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.220+0000 7f18815b8640 1 Processor -- start 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.220+0000 7f18815b8640 1 -- start start 2024-09-19T06:51:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.220+0000 7f18815b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f187c101dd0 0x7f187c10e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.220+0000 7f18815b8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f187c102780 0x7f187c10b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.220+0000 7f18815b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187c106f00 0x7f187c10bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.220+0000 7f18815b8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f187c075ab0 con 0x7f187c101dd0 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.220+0000 7f18815b8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f187c075930 con 0x7f187c106f00 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.220+0000 7f18815b8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f187c075c30 con 0x7f187c102780 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.220+0000 7f187affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f187c101dd0 0x7f187c10e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.220+0000 7f187a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f187c102780 0x7f187c10b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f187a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f187c102780 0x7f187c10b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:44552/0 (socket says 172.21.15.12:44552) 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f187a7fc640 1 -- 172.21.15.12:0/243346440 learned_addr learned my addr 172.21.15.12:0/243346440 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f187b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187c106f00 0x7f187c10bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f187a7fc640 1 -- 172.21.15.12:0/243346440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187c106f00 msgr2=0x7f187c10bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f187a7fc640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187c106f00 0x7f187c10bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f187a7fc640 1 -- 172.21.15.12:0/243346440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f187c101dd0 msgr2=0x7f187c10e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f187a7fc640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f187c101dd0 0x7f187c10e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f187a7fc640 1 -- 172.21.15.12:0/243346440 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c10c0b0 con 0x7f187c102780 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f187a7fc640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f187c102780 0x7f187c10b630 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1870035040 tx=0x7f1870030fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f1863fff640 1 -- 172.21.15.12:0/243346440 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187003f020 con 0x7f187c102780 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f1863fff640 1 -- 172.21.15.12:0/243346440 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1870004040 con 0x7f187c102780 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.221+0000 7f1863fff640 1 -- 172.21.15.12:0/243346440 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870037040 con 0x7f187c102780 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.222+0000 7f18815b8640 1 -- 172.21.15.12:0/243346440 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f187c10c340 con 0x7f187c102780 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.222+0000 7f18815b8640 1 -- 172.21.15.12:0/243346440 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f187c1ab430 con 0x7f187c102780 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f1883991740 1 Processor -- start 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f1883991740 1 -- start start 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f1883991740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769aeb40 0x5638769ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f1883991740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769ad5d0 0x5638769ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f1883991740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769b8370 0x5638769ba760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f1883991740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5638769132f0 con 0x5638769b8370 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f1883991740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5638768bacf0 con 0x5638769aeb40 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f1883991740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56387690f2b0 con 0x5638769ad5d0 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f187affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769ad5d0 0x5638769ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f187affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769ad5d0 0x5638769ada10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:44566/0 (socket says 172.21.15.12:44566) 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f187b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769aeb40 0x5638769ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f187affd640 1 -- 172.21.15.12:0/2400770695 learned_addr learned my addr 172.21.15.12:0/2400770695 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f187b7fe640 1 -- 172.21.15.12:0/2400770695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769ad5d0 msgr2=0x5638769ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f187b7fe640 1 --2- 172.21.15.12:0/2400770695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769ad5d0 0x5638769ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f187b7fe640 1 -- 172.21.15.12:0/2400770695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769b8370 msgr2=0x5638769ba760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f187b7fe640 1 --2- 172.21.15.12:0/2400770695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769b8370 0x5638769ba760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.225+0000 7f187b7fe640 1 -- 172.21.15.12:0/2400770695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56387689f3a0 con 0x5638769aeb40 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.226+0000 7f187affd640 1 --2- 172.21.15.12:0/2400770695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769ad5d0 0x5638769ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:44.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.226+0000 7f187b7fe640 1 --2- 172.21.15.12:0/2400770695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769aeb40 0x5638769ad090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1874009f00 tx=0x7f1874011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f53fdec09558ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.226+0000 7f18617fa640 1 -- 172.21.15.12:0/2400770695 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1874004d20 con 0x5638769aeb40 2024-09-19T06:51:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.226+0000 7f1863fff640 1 -- 172.21.15.12:0/243346440 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1870042020 con 0x7f187c102780 2024-09-19T06:51:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.226+0000 7f18617fa640 1 -- 172.21.15.12:0/2400770695 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1874004050 con 0x5638769aeb40 2024-09-19T06:51:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.226+0000 7f18617fa640 1 -- 172.21.15.12:0/2400770695 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1874005240 con 0x5638769aeb40 2024-09-19T06:51:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.227+0000 7f1883991740 1 -- 172.21.15.12:0/2400770695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769aeb40 msgr2=0x5638769ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.227+0000 7f1883991740 1 --2- 172.21.15.12:0/2400770695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769aeb40 0x5638769ad090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1874009f00 tx=0x7f1874011810 comp rx=0 tx=0).stop 2024-09-19T06:51:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.230+0000 7f1863fff640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18640a3500 0x7f18640a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.230+0000 7f187b7fe640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18640a3500 0x7f18640a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.230+0000 7f1863fff640 1 -- 172.21.15.12:0/243346440 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f18700efca0 con 0x7f187c102780 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.230+0000 7f1883991740 1 -- 172.21.15.12:0/2400770695 shutdown_connections 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.230+0000 7f1883991740 1 --2- 172.21.15.12:0/2400770695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769b8370 0x5638769ba760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.230+0000 7f1883991740 1 --2- 172.21.15.12:0/2400770695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769ad5d0 0x5638769ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.230+0000 7f1883991740 1 --2- 172.21.15.12:0/2400770695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769aeb40 0x5638769ad090 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.230+0000 7f1883991740 1 -- 172.21.15.12:0/2400770695 >> 172.21.15.12:0/2400770695 conn(0x563876976310 msgr2=0x5638769a9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.231+0000 7f187b7fe640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18640a3500 0x7f18640a59c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f187401b040 tx=0x7f1874004f60 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.231+0000 7f1883991740 1 -- 172.21.15.12:0/2400770695 shutdown_connections 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.231+0000 7f1883991740 1 -- 172.21.15.12:0/2400770695 wait complete. 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.231+0000 7f1883991740 1 -- start start 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.231+0000 7f1883991740 1 Processor -- start 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f1883991740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f1883991740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769aeb40 0x5638769b5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f1883991740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769b8370 0x5638769b5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f1883991740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5638769bb070 con 0x5638769ad5d0 2024-09-19T06:51:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f1883991740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5638768ce060 con 0x5638769aeb40 2024-09-19T06:51:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f1883991740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5638769bb1f0 con 0x5638769b8370 2024-09-19T06:51:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f187affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f1883991740 10 client.0 _ll_register_callbacks cb 0x5638766218c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f187affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769b7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43926/0 (socket says 172.21.15.12:43926) 2024-09-19T06:51:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f187affd640 1 -- 172.21.15.12:0/2148897131 learned_addr learned my addr 172.21.15.12:0/2148897131 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f187affd640 1 -- 172.21.15.12:0/2148897131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769b8370 msgr2=0x5638769b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f187affd640 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769b8370 0x5638769b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f187affd640 1 -- 172.21.15.12:0/2148897131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769aeb40 msgr2=0x5638769b5010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f187affd640 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769aeb40 0x5638769b5010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f187affd640 1 -- 172.21.15.12:0/2148897131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638766843c0 con 0x5638769ad5d0 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f187affd640 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769b7d60 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f186c011760 tx=0x7f186c011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6141da18d39d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f185eff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.232+0000 7f185eff5640 1 -- 172.21.15.12:0/2148897131 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c004260 con 0x5638769ad5d0 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.233+0000 7f1883991740 1 -- 172.21.15.12:0/2148897131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1874004050 con 0x5638769ad5d0 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.233+0000 7f185eff5640 1 -- 172.21.15.12:0/2148897131 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f186c004400 con 0x5638769ad5d0 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.233+0000 7f185eff5640 1 -- 172.21.15.12:0/2148897131 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f186c00f920 con 0x5638769ad5d0 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.233+0000 7f1883991740 10 client.18702 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.233+0000 7f1883991740 1 -- 172.21.15.12:0/2148897131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5638769c6b90 con 0x5638769ad5d0 2024-09-19T06:51:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.233+0000 7f185eff5640 1 -- 172.21.15.12:0/2148897131 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1874004050 con 0x5638769ad5d0 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.234+0000 7f185eff5640 1 -- 172.21.15.12:0/2148897131 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f186c01a4a0 con 0x5638769ad5d0 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.234+0000 7f1883991740 10 client.18702 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.234+0000 7f1883991740 10 client.18702 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.234+0000 7f1883991740 20 client.18702 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.234+0000 7f1883991740 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5638769c8380 0x5638769ca810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.234+0000 7f1883991740 4 client.18702 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.234+0000 7f1883991740 1 -- 172.21.15.12:0/2148897131 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563876920860 con 0x5638769c8380 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.234+0000 7f187a7fc640 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5638769c8380 0x5638769ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.234+0000 7f187a7fc640 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5638769c8380 0x5638769ca810 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e5d177769ec566f server_cookie=82414e5e11fd1253 in_seq=0 out_seq=0 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f185eff5640 10 client.18702 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f185eff5640 1 -- 172.21.15.12:0/2148897131 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563876920860 con 0x5638769c8380 2024-09-19T06:51:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f185eff5640 10 client.18702 handle_command_reply: tid=0 2024-09-19T06:51:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f1883991740 1 client.18702 shutdown 2024-09-19T06:51:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f1883991740 1 -- 172.21.15.12:0/2148897131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 msgr2=0x5638769b7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f1883991740 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769b7d60 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f186c011760 tx=0x7f186c011c20 comp rx=0 tx=0).stop 2024-09-19T06:51:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f1883991740 1 -- 172.21.15.12:0/2148897131 shutdown_connections 2024-09-19T06:51:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f1883991740 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5638769c8380 0x5638769ca810 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f1883991740 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769b8370 0x5638769b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f1883991740 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769aeb40 0x5638769b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f1883991740 1 --2- 172.21.15.12:0/2148897131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769b7d60 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f1883991740 1 -- 172.21.15.12:0/2148897131 >> 172.21.15.12:0/2148897131 conn(0x563876976310 msgr2=0x5638769af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.235+0000 7f185eff5640 0 client.18702 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:51:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.236+0000 7f1883991740 1 -- 172.21.15.12:0/2148897131 shutdown_connections 2024-09-19T06:51:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.236+0000 7f1883991740 1 -- 172.21.15.12:0/2148897131 wait complete. 2024-09-19T06:51:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.236+0000 7f1883991740 20 client.18702 trim_cache size 0 max 16384 2024-09-19T06:51:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.253+0000 7f1883991740 1 Processor -- start 2024-09-19T06:51:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.253+0000 7f1883991740 1 -- start start 2024-09-19T06:51:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.253+0000 7f1883991740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769ad5d0 0x5638769a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.253+0000 7f1883991740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769aeb40 0x5638769c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f1883991740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769b8370 0x5638769d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769ad5d0 0x5638769a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769aeb40 0x5638769c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769ad5d0 0x5638769a9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:42290/0 (socket says 172.21.15.12:42290) 2024-09-19T06:51:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769aeb40 0x5638769c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43940/0 (socket says 172.21.15.12:43940) 2024-09-19T06:51:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187a7fc640 1 -- 172.21.15.12:0/3220378486 learned_addr learned my addr 172.21.15.12:0/3220378486 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f1883991740 1 -- 172.21.15.12:0/3220378486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1b41e0 con 0x5638769aeb40 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f1883991740 1 -- 172.21.15.12:0/3220378486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1b5db0 con 0x5638769ad5d0 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f1883991740 1 -- 172.21.15.12:0/3220378486 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1b48b0 con 0x5638769b8370 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187b7fe640 1 --2- 172.21.15.12:0/3220378486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769b8370 0x5638769d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187affd640 1 -- 172.21.15.12:0/3220378486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769b8370 msgr2=0x5638769d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187affd640 1 --2- 172.21.15.12:0/3220378486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769b8370 0x5638769d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187affd640 1 -- 172.21.15.12:0/3220378486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769aeb40 msgr2=0x5638769c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187affd640 1 --2- 172.21.15.12:0/3220378486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769aeb40 0x5638769c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187affd640 1 -- 172.21.15.12:0/3220378486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638769b80d0 con 0x5638769ad5d0 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187a7fc640 1 --2- 172.21.15.12:0/3220378486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769aeb40 0x5638769c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.254+0000 7f187affd640 1 --2- 172.21.15.12:0/3220378486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769ad5d0 0x5638769a9e10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f186c023040 tx=0x7f186c011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc1a88c7f3adb68b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.255+0000 7f1860ff9640 1 -- 172.21.15.12:0/3220378486 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c030070 con 0x5638769ad5d0 2024-09-19T06:51:44.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.255+0000 7f1860ff9640 1 -- 172.21.15.12:0/3220378486 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f186c005710 con 0x5638769ad5d0 2024-09-19T06:51:44.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.255+0000 7f1860ff9640 1 -- 172.21.15.12:0/3220378486 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c01a640 con 0x5638769ad5d0 2024-09-19T06:51:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.255+0000 7f1883991740 1 -- 172.21.15.12:0/3220378486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769ad5d0 msgr2=0x5638769a9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.255+0000 7f1883991740 1 --2- 172.21.15.12:0/3220378486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769ad5d0 0x5638769a9e10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f186c023040 tx=0x7f186c011440 comp rx=0 tx=0).stop 2024-09-19T06:51:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.255+0000 7f1883991740 1 -- 172.21.15.12:0/3220378486 shutdown_connections 2024-09-19T06:51:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.255+0000 7f1883991740 1 --2- 172.21.15.12:0/3220378486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769b8370 0x5638769d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.255+0000 7f1883991740 1 --2- 172.21.15.12:0/3220378486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769aeb40 0x5638769c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.255+0000 7f1883991740 1 --2- 172.21.15.12:0/3220378486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769ad5d0 0x5638769a9e10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.255+0000 7f1883991740 1 -- 172.21.15.12:0/3220378486 >> 172.21.15.12:0/3220378486 conn(0x563876976310 msgr2=0x5638769a9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.256+0000 7f1883991740 1 -- 172.21.15.12:0/3220378486 shutdown_connections 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.256+0000 7f1883991740 1 -- 172.21.15.12:0/3220378486 wait complete. 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.256+0000 7f1883991740 1 -- start start 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.256+0000 7f1883991740 1 Processor -- start 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.256+0000 7f1883991740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f1883991740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769aeb40 0x5638769bbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f1883991740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769b8370 0x5638769bc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f1883991740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1b56e0 con 0x5638769ad5d0 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f1883991740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1b5010 con 0x5638769b8370 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f1883991740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1b21e0 con 0x5638769aeb40 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769aeb40 0x5638769bbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f1883991740 10 client.0 _ll_register_callbacks cb 0x7f186c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187a7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769aeb40 0x5638769bbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:44604/0 (socket says 172.21.15.12:44604) 2024-09-19T06:51:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187a7fc640 1 -- 172.21.15.12:0/4279446695 learned_addr learned my addr 172.21.15.12:0/4279446695 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187b7fe640 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769b8370 0x5638769bc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187affd640 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187a7fc640 1 -- 172.21.15.12:0/4279446695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769b8370 msgr2=0x5638769bc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187a7fc640 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769b8370 0x5638769bc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187a7fc640 1 -- 172.21.15.12:0/4279446695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 msgr2=0x5638769c0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187a7fc640 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769c0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187a7fc640 1 -- 172.21.15.12:0/4279446695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638769bcc00 con 0x5638769aeb40 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187b7fe640 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769b8370 0x5638769bc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.257+0000 7f187affd640 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769c0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f187a7fc640 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769aeb40 0x5638769bbe90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f187002a950 tx=0x7f1870033e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7575f97b53039c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f185eff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f185eff5640 1 -- 172.21.15.12:0/4279446695 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18700bbff0 con 0x5638769aeb40 2024-09-19T06:51:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f185eff5640 1 -- 172.21.15.12:0/4279446695 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f18700b8660 con 0x5638769aeb40 2024-09-19T06:51:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f1883991740 1 -- 172.21.15.12:0/4279446695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56387691ad70 con 0x5638769aeb40 2024-09-19T06:51:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f185eff5640 1 -- 172.21.15.12:0/4279446695 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f18700c9050 con 0x5638769aeb40 2024-09-19T06:51:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f1883991740 10 client.27988 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f1883991740 1 -- 172.21.15.12:0/4279446695 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x563876a44070 con 0x5638769aeb40 2024-09-19T06:51:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f185eff5640 1 -- 172.21.15.12:0/4279446695 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56387691ad70 con 0x5638769aeb40 2024-09-19T06:51:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f185eff5640 1 -- 172.21.15.12:0/4279446695 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f187003a030 con 0x5638769aeb40 2024-09-19T06:51:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f1883991740 10 client.27988 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f1883991740 10 client.27988 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:51:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f1883991740 20 client.27988 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.258+0000 7f1883991740 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x563876a447e0 0x563876a46c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.259+0000 7f1883991740 4 client.27988 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.259+0000 7f1883991740 1 -- 172.21.15.12:0/4279446695 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563876897170 con 0x563876a447e0 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.259+0000 7f187affd640 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x563876a447e0 0x563876a46c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.259+0000 7f187affd640 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x563876a447e0 0x563876a46c00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dfcc3124ae2f99bf server_cookie=842356adc79429bc in_seq=0 out_seq=0 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.259+0000 7f185eff5640 10 client.27988 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.259+0000 7f185eff5640 1 -- 172.21.15.12:0/4279446695 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563876897170 con 0x563876a447e0 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.259+0000 7f185eff5640 10 client.27988 handle_command_reply: tid=0 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.259+0000 7f1883991740 1 client.27988 shutdown 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 1 -- 172.21.15.12:0/4279446695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769aeb40 msgr2=0x5638769bbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769aeb40 0x5638769bbe90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f187002a950 tx=0x7f1870033e90 comp rx=0 tx=0).stop 2024-09-19T06:51:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 1 -- 172.21.15.12:0/4279446695 shutdown_connections 2024-09-19T06:51:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x563876a447e0 0x563876a46c00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638769b8370 0x5638769bc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638769aeb40 0x5638769bbe90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f185eff5640 0 client.27988 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:51:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 1 --2- 172.21.15.12:0/4279446695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638769ad5d0 0x5638769c0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 1 -- 172.21.15.12:0/4279446695 >> 172.21.15.12:0/4279446695 conn(0x563876976310 msgr2=0x5638769a84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 1 -- 172.21.15.12:0/4279446695 shutdown_connections 2024-09-19T06:51:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 1 -- 172.21.15.12:0/4279446695 wait complete. 2024-09-19T06:51:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f1883991740 20 client.27988 trim_cache size 0 max 16384 2024-09-19T06:51:44.267 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:51:44.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f18815b8640 1 -- 172.21.15.12:0/243346440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18640a3500 msgr2=0x7f18640a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f18815b8640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18640a3500 0x7f18640a59c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f187401b040 tx=0x7f1874004f60 comp rx=0 tx=0).stop 2024-09-19T06:51:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f18815b8640 1 -- 172.21.15.12:0/243346440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f187c102780 msgr2=0x7f187c10b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.260+0000 7f18815b8640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f187c102780 0x7f187c10b630 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1870035040 tx=0x7f1870030fb0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.261+0000 7f18815b8640 1 -- 172.21.15.12:0/243346440 shutdown_connections 2024-09-19T06:51:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.261+0000 7f18815b8640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f187c106f00 0x7f187c10bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.261+0000 7f18815b8640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18640a3500 0x7f18640a59c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.261+0000 7f18815b8640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f187c102780 0x7f187c10b630 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.261+0000 7f18815b8640 1 --2- 172.21.15.12:0/243346440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f187c101dd0 0x7f187c10e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.261+0000 7f18815b8640 1 -- 172.21.15.12:0/243346440 >> 172.21.15.12:0/243346440 conn(0x7f187c0fd8b0 msgr2=0x7f187c0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.261+0000 7f18815b8640 1 -- 172.21.15.12:0/243346440 shutdown_connections 2024-09-19T06:51:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:44.261+0000 7f18815b8640 1 -- 172.21.15.12:0/243346440 wait complete. 2024-09-19T06:51:45.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:51:45.513 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:45.662 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:45 smithi012 ceph-mon[30937]: pgmap v361: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.3 MiB/s wr, 711 op/s 2024-09-19T06:51:45.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:45 smithi016 ceph-mon[34911]: pgmap v361: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.3 MiB/s wr, 711 op/s 2024-09-19T06:51:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 660.0 s, 2088.2 tps, lat 47.363 ms stddev 56.581 2024-09-19T06:51:45.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:45 smithi173 ceph-mon[35349]: pgmap v361: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.3 MiB/s wr, 711 op/s 2024-09-19T06:51:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/373111831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a88106a90 msgr2=0x7f6a88106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 --2- 172.21.15.12:0/373111831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a88106a90 0x7f6a88106e70 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009930 tx=0x7f6a7802a420 comp rx=0 tx=0).stop 2024-09-19T06:51:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/373111831 shutdown_connections 2024-09-19T06:51:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 --2- 172.21.15.12:0/373111831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a88101430 0x7f6a8810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 --2- 172.21.15.12:0/373111831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a88100a90 0x7f6a88100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 --2- 172.21.15.12:0/373111831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a88106a90 0x7f6a88106e70 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/373111831 >> 172.21.15.12:0/373111831 conn(0x7f6a880fc7d0 msgr2=0x7f6a880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/373111831 shutdown_connections 2024-09-19T06:51:46.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/373111831 wait complete. 2024-09-19T06:51:46.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 Processor -- start 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.111+0000 7f6a8e4cc640 1 -- start start 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a8e4cc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a88100a90 0x7f6a880fcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a8e4cc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a88101430 0x7f6a880fd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a8e4cc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a88106a90 0x7f6a880fd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a8e4cc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a88110ee0 con 0x7f6a88106a90 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a8e4cc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6a88110d60 con 0x7f6a88100a90 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a8e4cc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6a88111060 con 0x7f6a88101430 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a87fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a88100a90 0x7f6a880fcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a7ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a88101430 0x7f6a880fd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a87fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a88100a90 0x7f6a880fcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:42324/0 (socket says 172.21.15.12:42324) 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a7ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a88101430 0x7f6a880fd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:44622/0 (socket says 172.21.15.12:44622) 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a87fff640 1 -- 172.21.15.12:0/4271183575 learned_addr learned my addr 172.21.15.12:0/4271183575 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:46.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a8ca69640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a88106a90 0x7f6a880fd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a87fff640 1 -- 172.21.15.12:0/4271183575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a88101430 msgr2=0x7f6a880fd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a87fff640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a88101430 0x7f6a880fd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a87fff640 1 -- 172.21.15.12:0/4271183575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a88106a90 msgr2=0x7f6a880fd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a87fff640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a88106a90 0x7f6a880fd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.112+0000 7f6a87fff640 1 -- 172.21.15.12:0/4271183575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a881a69d0 con 0x7f6a88100a90 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.113+0000 7f6a87fff640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a88100a90 0x7f6a880fcdf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6a7802a940 tx=0x7f6a78003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.113+0000 7f6a85ffb640 1 -- 172.21.15.12:0/4271183575 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7803f070 con 0x7f6a88100a90 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.113+0000 7f6a85ffb640 1 -- 172.21.15.12:0/4271183575 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a78031c90 con 0x7f6a88100a90 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.113+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/4271183575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a881a6c60 con 0x7f6a88100a90 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.113+0000 7f6a85ffb640 1 -- 172.21.15.12:0/4271183575 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a78035030 con 0x7f6a88100a90 2024-09-19T06:51:46.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.113+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/4271183575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a881a7140 con 0x7f6a88100a90 2024-09-19T06:51:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.117+0000 7f6a908a5740 1 Processor -- start 2024-09-19T06:51:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.117+0000 7f6a908a5740 1 -- start start 2024-09-19T06:51:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c79bb40 0x559f8c79a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79a5d0 0x559f8c79aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c7a5370 0x559f8c7a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a908a5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f8c7002f0 con 0x559f8c79a5d0 2024-09-19T06:51:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a908a5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559f8c6a7cf0 con 0x559f8c7a5370 2024-09-19T06:51:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a908a5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559f8c6fc2b0 con 0x559f8c79bb40 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a7ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c7a5370 0x559f8c7a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a8ca69640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c79bb40 0x559f8c79a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a8ca69640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c79bb40 0x559f8c79a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:44630/0 (socket says 172.21.15.12:44630) 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a7ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c7a5370 0x559f8c7a7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:42334/0 (socket says 172.21.15.12:42334) 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a8ca69640 1 -- 172.21.15.12:0/1104623964 learned_addr learned my addr 172.21.15.12:0/1104623964 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a7ffff640 1 -- 172.21.15.12:0/1104623964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c79bb40 msgr2=0x559f8c79a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a7ffff640 1 --2- 172.21.15.12:0/1104623964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c79bb40 0x559f8c79a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.118+0000 7f6a7ffff640 1 -- 172.21.15.12:0/1104623964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79a5d0 msgr2=0x559f8c79aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.119+0000 7f6a7ffff640 1 --2- 172.21.15.12:0/1104623964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79a5d0 0x559f8c79aa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.119+0000 7f6a7ffff640 1 -- 172.21.15.12:0/1104623964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8c68c3a0 con 0x559f8c7a5370 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.119+0000 7f6a7ffff640 1 --2- 172.21.15.12:0/1104623964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c7a5370 0x559f8c7a7760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009bf0 tx=0x7f6a70011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8862c91d797a9278 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.119+0000 7f6a7e7fc640 1 -- 172.21.15.12:0/1104623964 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70004050 con 0x559f8c7a5370 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.119+0000 7f6a7e7fc640 1 -- 172.21.15.12:0/1104623964 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a70005500 con 0x559f8c7a5370 2024-09-19T06:51:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.119+0000 7f6a7e7fc640 1 -- 172.21.15.12:0/1104623964 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70004e10 con 0x559f8c7a5370 2024-09-19T06:51:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.119+0000 7f6a85ffb640 1 -- 172.21.15.12:0/4271183575 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6a78042070 con 0x7f6a88100a90 2024-09-19T06:51:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a908a5740 1 -- 172.21.15.12:0/1104623964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c7a5370 msgr2=0x559f8c7a7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1104623964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c7a5370 0x559f8c7a7760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009bf0 tx=0x7f6a70011810 comp rx=0 tx=0).stop 2024-09-19T06:51:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a85ffb640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a740a33b0 0x7f6a740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a908a5740 1 -- 172.21.15.12:0/1104623964 shutdown_connections 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1104623964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c7a5370 0x559f8c7a7760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1104623964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79a5d0 0x559f8c79aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1104623964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c79bb40 0x559f8c79a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a908a5740 1 -- 172.21.15.12:0/1104623964 >> 172.21.15.12:0/1104623964 conn(0x559f8c763310 msgr2=0x559f8c796c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a8ca69640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a740a33b0 0x7f6a740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a85ffb640 1 -- 172.21.15.12:0/4271183575 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f6a780f04b0 con 0x7f6a88100a90 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a908a5740 1 -- 172.21.15.12:0/1104623964 shutdown_connections 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a908a5740 1 -- 172.21.15.12:0/1104623964 wait complete. 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.120+0000 7f6a8ca69640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a740a33b0 0x7f6a740a5870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6a80005f10 tx=0x7f6a80009600 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a908a5740 1 -- start start 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a908a5740 1 Processor -- start 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79a5d0 0x559f8c7a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79bb40 0x559f8c7a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a908a5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f8c7a8070 con 0x559f8c79a5d0 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a908a5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559f8c6bb060 con 0x559f8c79bb40 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a908a5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559f8c7a81f0 con 0x559f8c7a5370 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a908a5740 10 client.0 _ll_register_callbacks cb 0x559f8c40e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a8ca69640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a8ca69640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:44634/0 (socket says 172.21.15.12:44634) 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.121+0000 7f6a8ca69640 1 -- 172.21.15.12:0/1956177745 learned_addr learned my addr 172.21.15.12:0/1956177745 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.122+0000 7f6a7ffff640 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79bb40 0x559f8c7a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.122+0000 7f6a87fff640 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79a5d0 0x559f8c7a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.122+0000 7f6a7ffff640 1 -- 172.21.15.12:0/1956177745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 msgr2=0x559f8c7a27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.122+0000 7f6a7ffff640 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.122+0000 7f6a7ffff640 1 -- 172.21.15.12:0/1956177745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79a5d0 msgr2=0x559f8c7a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.122+0000 7f6a7ffff640 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79a5d0 0x559f8c7a4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.122+0000 7f6a7ffff640 1 -- 172.21.15.12:0/1956177745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8c4713c0 con 0x559f8c79bb40 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.122+0000 7f6a8ca69640 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.122+0000 7f6a7ffff640 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79bb40 0x559f8c7a2090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009700 tx=0x7f6a70009fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd16257f3d9a88a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.122+0000 7f6a677fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a677fe640 1 -- 172.21.15.12:0/1956177745 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70029070 con 0x559f8c79bb40 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a677fe640 1 -- 172.21.15.12:0/1956177745 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f6a70003a00 con 0x559f8c79bb40 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a908a5740 1 -- 172.21.15.12:0/1956177745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a70005500 con 0x559f8c79bb40 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a677fe640 1 -- 172.21.15.12:0/1956177745 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6a70035050 con 0x559f8c79bb40 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a908a5740 10 client.28046 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a908a5740 1 -- 172.21.15.12:0/1956177745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x559f8c7b3ba0 con 0x559f8c79bb40 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a677fe640 1 -- 172.21.15.12:0/1956177745 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a70005500 con 0x559f8c79bb40 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a677fe640 1 -- 172.21.15.12:0/1956177745 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f6a70023430 con 0x559f8c79bb40 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a908a5740 10 client.28046 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a908a5740 10 client.28046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a908a5740 20 client.28046 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.123+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559f8c7b4ef0 0x559f8c7b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.124+0000 7f6a908a5740 4 client.28046 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.124+0000 7f6a908a5740 1 -- 172.21.15.12:0/1956177745 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f8c70d860 con 0x559f8c7b4ef0 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.124+0000 7f6a87fff640 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559f8c7b4ef0 0x559f8c7b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.124+0000 7f6a677fe640 10 client.28046 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.124+0000 7f6a87fff640 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559f8c7b4ef0 0x559f8c7b72e0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8a7e5068abdf61a server_cookie=f7a0a227c76d27b4 in_seq=0 out_seq=0 2024-09-19T06:51:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a677fe640 1 -- 172.21.15.12:0/1956177745 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f8c70d860 con 0x559f8c7b4ef0 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a677fe640 10 client.28046 handle_command_reply: tid=0 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a908a5740 1 client.28046 shutdown 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a908a5740 1 -- 172.21.15.12:0/1956177745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79bb40 msgr2=0x559f8c7a2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79bb40 0x559f8c7a2090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009700 tx=0x7f6a70009fd0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a908a5740 1 -- 172.21.15.12:0/1956177745 shutdown_connections 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559f8c7b4ef0 0x559f8c7b72e0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79bb40 0x559f8c7a2090 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1956177745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79a5d0 0x559f8c7a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a677fe640 0 client.28046 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.125+0000 7f6a908a5740 1 -- 172.21.15.12:0/1956177745 >> 172.21.15.12:0/1956177745 conn(0x559f8c763310 msgr2=0x559f8c79c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.126+0000 7f6a908a5740 1 -- 172.21.15.12:0/1956177745 shutdown_connections 2024-09-19T06:51:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.126+0000 7f6a908a5740 1 -- 172.21.15.12:0/1956177745 wait complete. 2024-09-19T06:51:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.126+0000 7f6a908a5740 20 client.28046 trim_cache size 0 max 16384 2024-09-19T06:51:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.143+0000 7f6a908a5740 1 Processor -- start 2024-09-19T06:51:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.143+0000 7f6a908a5740 1 -- start start 2024-09-19T06:51:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.143+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 0x559f8c796d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.143+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 0x559f8c7b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.143+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.143+0000 7f6a908a5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a881afdc0 con 0x559f8c79bb40 2024-09-19T06:51:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.143+0000 7f6a908a5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6a881b1990 con 0x559f8c79a5d0 2024-09-19T06:51:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.143+0000 7f6a908a5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6a881b0490 con 0x559f8c7a5370 2024-09-19T06:51:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.143+0000 7f6a7ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 0x559f8c7b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.144+0000 7f6a7ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 0x559f8c7b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43988/0 (socket says 172.21.15.12:43988) 2024-09-19T06:51:46.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.144+0000 7f6a7ffff640 1 -- 172.21.15.12:0/1192228512 learned_addr learned my addr 172.21.15.12:0/1192228512 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:46.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.144+0000 7f6a8ca69640 1 --2- 172.21.15.12:0/1192228512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.144+0000 7f6a87fff640 1 --2- 172.21.15.12:0/1192228512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 0x559f8c796d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.144+0000 7f6a8ca69640 1 -- 172.21.15.12:0/1192228512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 msgr2=0x559f8c796d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.144+0000 7f6a8ca69640 1 --2- 172.21.15.12:0/1192228512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 0x559f8c796d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.144+0000 7f6a8ca69640 1 -- 172.21.15.12:0/1192228512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 msgr2=0x559f8c7b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.144+0000 7f6a8ca69640 1 --2- 172.21.15.12:0/1192228512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 0x559f8c7b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.144+0000 7f6a8ca69640 1 -- 172.21.15.12:0/1192228512 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8c797960 con 0x559f8c7a5370 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.144+0000 7f6a8ca69640 1 --2- 172.21.15.12:0/1192228512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a1090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6a800042e0 tx=0x7f6a8000b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b326e3fab01093d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.145+0000 7f6a7dffb640 1 -- 172.21.15.12:0/1192228512 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80011b60 con 0x559f8c7a5370 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.145+0000 7f6a7dffb640 1 -- 172.21.15.12:0/1192228512 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a80011d00 con 0x559f8c7a5370 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.145+0000 7f6a7dffb640 1 -- 172.21.15.12:0/1192228512 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8001e7c0 con 0x559f8c7a5370 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.146+0000 7f6a908a5740 1 -- 172.21.15.12:0/1192228512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 msgr2=0x559f8c7a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.146+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1192228512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a1090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6a800042e0 tx=0x7f6a8000b000 comp rx=0 tx=0).stop 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.146+0000 7f6a908a5740 1 -- 172.21.15.12:0/1192228512 shutdown_connections 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.146+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1192228512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7a1090 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.146+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1192228512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 0x559f8c7b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.146+0000 7f6a908a5740 1 --2- 172.21.15.12:0/1192228512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 0x559f8c796d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.146+0000 7f6a908a5740 1 -- 172.21.15.12:0/1192228512 >> 172.21.15.12:0/1192228512 conn(0x559f8c763310 msgr2=0x559f8c7a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.146+0000 7f6a908a5740 1 -- 172.21.15.12:0/1192228512 shutdown_connections 2024-09-19T06:51:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.146+0000 7f6a908a5740 1 -- 172.21.15.12:0/1192228512 wait complete. 2024-09-19T06:51:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.147+0000 7f6a908a5740 1 -- start start 2024-09-19T06:51:46.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.147+0000 7f6a908a5740 1 Processor -- start 2024-09-19T06:51:46.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.147+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 0x559f8c79fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.147+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 0x559f8c7ad480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.147+0000 7f6a908a5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a7ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 0x559f8c7ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a87fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 0x559f8c79fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a87fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 0x559f8c79fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:42352/0 (socket says 172.21.15.12:42352) 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a87fff640 1 -- 172.21.15.12:0/920528315 learned_addr learned my addr 172.21.15.12:0/920528315 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a881b12c0 con 0x559f8c79bb40 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6a881b0bf0 con 0x559f8c79a5d0 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6a881addc0 con 0x559f8c7a5370 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a8ca69640 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a908a5740 10 client.0 _ll_register_callbacks cb 0x7f6a80009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a87fff640 1 -- 172.21.15.12:0/920528315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 msgr2=0x559f8c7ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a87fff640 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7ad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a87fff640 1 -- 172.21.15.12:0/920528315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 msgr2=0x559f8c7ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a87fff640 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 0x559f8c7ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a87fff640 1 -- 172.21.15.12:0/920528315 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f8c79e320 con 0x559f8c79a5d0 2024-09-19T06:51:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a87fff640 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 0x559f8c79fb60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6a780bc6d0 tx=0x7f6a78005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e114fb1c4c93a31b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a677fe640 10 client.28052 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:51:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a80011d00 con 0x559f8c79a5d0 2024-09-19T06:51:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.148+0000 7f6a677fe640 1 -- 172.21.15.12:0/920528315 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a78049040 con 0x559f8c79a5d0 2024-09-19T06:51:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.149+0000 7f6a677fe640 1 -- 172.21.15.12:0/920528315 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f6a7803b460 con 0x559f8c79a5d0 2024-09-19T06:51:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.149+0000 7f6a677fe640 1 -- 172.21.15.12:0/920528315 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6a780c5300 con 0x559f8c79a5d0 2024-09-19T06:51:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.149+0000 7f6a908a5740 10 client.28052 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.149+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=46}) -- 0x559f8c82fb20 con 0x559f8c79a5d0 2024-09-19T06:51:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.150+0000 7f6a677fe640 1 -- 172.21.15.12:0/920528315 <== mon.2 v2:172.21.15.16:3300/0 4 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f6a780b8db0 con 0x559f8c79a5d0 2024-09-19T06:51:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.150+0000 7f6a908a5740 10 client.28052 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.150+0000 7f6a908a5740 10 client.28052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.150+0000 7f6a908a5740 20 client.28052 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.150+0000 7f6a908a5740 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559f8c8300e0 0x559f8c832500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.150+0000 7f6a908a5740 4 client.28052 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.150+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6a80011d00 con 0x559f8c8300e0 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.151+0000 7f6a7ffff640 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559f8c8300e0 0x559f8c832500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.151+0000 7f6a7ffff640 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559f8c8300e0 0x559f8c832500 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23a3900f80003ad6 server_cookie=4dc25a3dee5d2648 in_seq=0 out_seq=0 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.151+0000 7f6a677fe640 10 client.28052 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.151+0000 7f6a677fe640 1 -- 172.21.15.12:0/920528315 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6a80011d00 con 0x559f8c8300e0 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.151+0000 7f6a677fe640 10 client.28052 handle_command_reply: tid=0 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.152+0000 7f6a908a5740 1 client.28052 shutdown 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.152+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 msgr2=0x559f8c79fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.152+0000 7f6a908a5740 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 0x559f8c79fb60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6a780bc6d0 tx=0x7f6a78005e50 comp rx=0 tx=0).stop 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.152+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 shutdown_connections 2024-09-19T06:51:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.152+0000 7f6a908a5740 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559f8c8300e0 0x559f8c832500 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.152+0000 7f6a908a5740 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559f8c7a5370 0x559f8c7ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.152+0000 7f6a908a5740 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f8c79bb40 0x559f8c7ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.152+0000 7f6a908a5740 1 --2- 172.21.15.12:0/920528315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559f8c79a5d0 0x559f8c79fb60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.152+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 >> 172.21.15.12:0/920528315 conn(0x559f8c763310 msgr2=0x559f8c7954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:46.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a677fe640 0 client.28052 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:46.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 shutdown_connections 2024-09-19T06:51:46.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a908a5740 1 -- 172.21.15.12:0/920528315 wait complete. 2024-09-19T06:51:46.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a908a5740 20 client.28052 trim_cache size 0 max 16384 2024-09-19T06:51:46.156 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/4271183575 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a740a33b0 msgr2=0x7f6a740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a8e4cc640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a740a33b0 0x7f6a740a5870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6a80005f10 tx=0x7f6a80009600 comp rx=0 tx=0).stop 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/4271183575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a88100a90 msgr2=0x7f6a880fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a8e4cc640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a88100a90 0x7f6a880fcdf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6a7802a940 tx=0x7f6a78003b90 comp rx=0 tx=0).stop 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/4271183575 shutdown_connections 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a8e4cc640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a88106a90 0x7f6a880fd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a8e4cc640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f6a740a33b0 0x7f6a740a5870 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.153+0000 7f6a8e4cc640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a88101430 0x7f6a880fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.154+0000 7f6a8e4cc640 1 --2- 172.21.15.12:0/4271183575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a88100a90 0x7f6a880fcdf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.154+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/4271183575 >> 172.21.15.12:0/4271183575 conn(0x7f6a880fc7d0 msgr2=0x7f6a8806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:46.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.154+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/4271183575 shutdown_connections 2024-09-19T06:51:46.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:46.154+0000 7f6a8e4cc640 1 -- 172.21.15.12:0/4271183575 wait complete. 2024-09-19T06:51:47.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:47 smithi016 ceph-mon[34911]: pgmap v362: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.3 MiB/s wr, 836 op/s 2024-09-19T06:51:47.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:47 smithi173 ceph-mon[35349]: pgmap v362: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.3 MiB/s wr, 836 op/s 2024-09-19T06:51:47.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:47 smithi012 ceph-mon[30937]: pgmap v362: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.3 MiB/s wr, 836 op/s 2024-09-19T06:51:48.007 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:51:48.007 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:51:48.407 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:48.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.990+0000 7f2985a2b640 1 -- 172.21.15.12:0/969506915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2980109b10 msgr2=0x7f2980114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:48.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.990+0000 7f2985a2b640 1 --2- 172.21.15.12:0/969506915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2980109b10 0x7f2980114570 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2968009900 tx=0x7f296802a480 comp rx=0 tx=0).stop 2024-09-19T06:51:48.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.990+0000 7f2985a2b640 1 -- 172.21.15.12:0/969506915 shutdown_connections 2024-09-19T06:51:48.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.990+0000 7f2985a2b640 1 --2- 172.21.15.12:0/969506915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2980114ab0 0x7f2980116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:48.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.990+0000 7f2985a2b640 1 --2- 172.21.15.12:0/969506915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2980109b10 0x7f2980114570 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:48.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.990+0000 7f2985a2b640 1 --2- 172.21.15.12:0/969506915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29801091f0 0x7f29801095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:48.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.990+0000 7f2985a2b640 1 -- 172.21.15.12:0/969506915 >> 172.21.15.12:0/969506915 conn(0x7f298006e140 msgr2=0x7f298006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:48.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.990+0000 7f2985a2b640 1 -- 172.21.15.12:0/969506915 shutdown_connections 2024-09-19T06:51:48.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.990+0000 7f2985a2b640 1 -- 172.21.15.12:0/969506915 wait complete. 2024-09-19T06:51:48.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f2985a2b640 1 Processor -- start 2024-09-19T06:51:48.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f2985a2b640 1 -- start start 2024-09-19T06:51:48.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f2985a2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29801091f0 0x7f298010a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:48.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f2985a2b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2980109b10 0x7f298010a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:48.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f2985a2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980114ab0 0x7f298010ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:48.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f2985a2b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f298011a7e0 con 0x7f29801091f0 2024-09-19T06:51:48.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f2985a2b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f298011a660 con 0x7f2980114ab0 2024-09-19T06:51:48.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f297effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29801091f0 0x7f298010a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:48.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f2985a2b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f298011a960 con 0x7f2980109b10 2024-09-19T06:51:48.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f297effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29801091f0 0x7f298010a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44022/0 (socket says 172.21.15.12:44022) 2024-09-19T06:51:48.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.991+0000 7f297effd640 1 -- 172.21.15.12:0/3413748329 learned_addr learned my addr 172.21.15.12:0/3413748329 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:48.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f297f7fe640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980114ab0 0x7f298010ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:48.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f2977fff640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2980109b10 0x7f298010a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:48.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f297effd640 1 -- 172.21.15.12:0/3413748329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2980109b10 msgr2=0x7f298010a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:48.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f297effd640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2980109b10 0x7f298010a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:48.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f297effd640 1 -- 172.21.15.12:0/3413748329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980114ab0 msgr2=0x7f298010ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:48.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f297effd640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980114ab0 0x7f298010ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:48.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f297effd640 1 -- 172.21.15.12:0/3413748329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29801af0e0 con 0x7f29801091f0 2024-09-19T06:51:48.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f297effd640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29801091f0 0x7f298010a3d0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f297000e9f0 tx=0x7f297000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:48.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f2984a29640 1 -- 172.21.15.12:0/3413748329 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297000cd80 con 0x7f29801091f0 2024-09-19T06:51:49.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f2984a29640 1 -- 172.21.15.12:0/3413748329 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2970010910 con 0x7f29801091f0 2024-09-19T06:51:49.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.992+0000 7f2985a2b640 1 -- 172.21.15.12:0/3413748329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29801af3d0 con 0x7f29801091f0 2024-09-19T06:51:49.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.993+0000 7f2984a29640 1 -- 172.21.15.12:0/3413748329 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970018990 con 0x7f29801091f0 2024-09-19T06:51:49.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.993+0000 7f2985a2b640 1 -- 172.21.15.12:0/3413748329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29801af930 con 0x7f29801091f0 2024-09-19T06:51:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.996+0000 7f2987e04740 1 Processor -- start 2024-09-19T06:51:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2987e04740 1 -- start start 2024-09-19T06:51:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2987e04740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c75ab60 0x556c2c75af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2987e04740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75b480 0x556c2c765800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2987e04740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c765d40 0x556c2c768130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2987e04740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556c2c6c0280 con 0x556c2c765d40 2024-09-19T06:51:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2987e04740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556c2c667b10 con 0x556c2c75ab60 2024-09-19T06:51:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2987e04740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556c2c6bc240 con 0x556c2c75b480 2024-09-19T06:51:49.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2977fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c765d40 0x556c2c768130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2977fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c765d40 0x556c2c768130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44032/0 (socket says 172.21.15.12:44032) 2024-09-19T06:51:49.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2977fff640 1 -- 172.21.15.12:0/3892015702 learned_addr learned my addr 172.21.15.12:0/3892015702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:49.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f297f7fe640 1 --2- 172.21.15.12:0/3892015702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c75ab60 0x556c2c75af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.997+0000 7f2984a29640 1 -- 172.21.15.12:0/3413748329 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2970010ac0 con 0x7f29801091f0 2024-09-19T06:51:49.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.998+0000 7f297f7fe640 1 -- 172.21.15.12:0/3892015702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75b480 msgr2=0x556c2c765800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:51:49.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.998+0000 7f297f7fe640 1 --2- 172.21.15.12:0/3892015702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75b480 0x556c2c765800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.998+0000 7f297f7fe640 1 -- 172.21.15.12:0/3892015702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c765d40 msgr2=0x556c2c768130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.998+0000 7f297f7fe640 1 --2- 172.21.15.12:0/3892015702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c765d40 0x556c2c768130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.998+0000 7f297f7fe640 1 -- 172.21.15.12:0/3892015702 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c2c6741f0 con 0x556c2c75ab60 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.998+0000 7f297f7fe640 1 --2- 172.21.15.12:0/3892015702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c75ab60 0x556c2c75af40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f29800743f0 tx=0x7f297800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3e4d46018d6500f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.998+0000 7f2975ffb640 1 -- 172.21.15.12:0/3892015702 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978003b70 con 0x556c2c75ab60 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.999+0000 7f2975ffb640 1 -- 172.21.15.12:0/3892015702 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2978007e50 con 0x556c2c75ab60 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.999+0000 7f2984a29640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f296c0a3430 0x7f296c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.999+0000 7f2984a29640 1 -- 172.21.15.12:0/3413748329 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f29700d4060 con 0x7f29801091f0 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:48.999+0000 7f2975ffb640 1 -- 172.21.15.12:0/3892015702 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978010a50 con 0x556c2c75ab60 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f2987e04740 1 -- 172.21.15.12:0/3892015702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c75ab60 msgr2=0x556c2c75af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f2987e04740 1 --2- 172.21.15.12:0/3892015702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c75ab60 0x556c2c75af40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f29800743f0 tx=0x7f297800f790 comp rx=0 tx=0).stop 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f2987e04740 1 -- 172.21.15.12:0/3892015702 shutdown_connections 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f2987e04740 1 --2- 172.21.15.12:0/3892015702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c765d40 0x556c2c768130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f2987e04740 1 --2- 172.21.15.12:0/3892015702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75b480 0x556c2c765800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f2987e04740 1 --2- 172.21.15.12:0/3892015702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c75ab60 0x556c2c75af40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f2987e04740 1 -- 172.21.15.12:0/3892015702 >> 172.21.15.12:0/3892015702 conn(0x556c2c7570f0 msgr2=0x556c2c7574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f297effd640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f296c0a3430 0x7f296c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f2987e04740 1 -- 172.21.15.12:0/3892015702 shutdown_connections 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f2987e04740 1 -- 172.21.15.12:0/3892015702 wait complete. 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.000+0000 7f297effd640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f296c0a3430 0x7f296c0a58f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f29801afb00 tx=0x7f2970018420 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.001+0000 7f2987e04740 1 -- start start 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.001+0000 7f2987e04740 1 Processor -- start 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2987e04740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 0x556c2c7657d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2987e04740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 0x556c2c762b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2987e04740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c7632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2977fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 0x556c2c762b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2977fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 0x556c2c762b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44046/0 (socket says 172.21.15.12:44046) 2024-09-19T06:51:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2977fff640 1 -- 172.21.15.12:0/876502487 learned_addr learned my addr 172.21.15.12:0/876502487 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f297f7fe640 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 0x556c2c7657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556c2c771170 con 0x556c2c75b480 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556c2c67af10 con 0x556c2c765d40 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556c2c7712f0 con 0x556c2c75ab60 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2987e04740 10 client.0 _ll_register_callbacks cb 0x556c2c643a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f297f7fe640 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c7632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2977fff640 1 -- 172.21.15.12:0/876502487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 msgr2=0x556c2c7657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.002+0000 7f2977fff640 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 0x556c2c7657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.003+0000 7f2977fff640 1 -- 172.21.15.12:0/876502487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 msgr2=0x556c2c7632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.003+0000 7f2977fff640 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c7632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.003+0000 7f2977fff640 1 -- 172.21.15.12:0/876502487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c2c4316a0 con 0x556c2c75b480 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.003+0000 7f297f7fe640 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c7632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.003+0000 7f2977fff640 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 0x556c2c762b20 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2968033000 tx=0x7f29680044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78b35e5cad50ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.003+0000 7f295effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.003+0000 7f295effd640 1 -- 172.21.15.12:0/876502487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968035040 con 0x556c2c75b480 2024-09-19T06:51:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.003+0000 7f295effd640 1 -- 172.21.15.12:0/876502487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f2968005590 con 0x556c2c75b480 2024-09-19T06:51:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.003+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2978007e50 con 0x556c2c75b480 2024-09-19T06:51:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.004+0000 7f295effd640 1 -- 172.21.15.12:0/876502487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f29680046c0 con 0x556c2c75b480 2024-09-19T06:51:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.004+0000 7f2987e04740 10 client.18735 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.004+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x556c2c770c30 con 0x556c2c75b480 2024-09-19T06:51:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.004+0000 7f295effd640 1 -- 172.21.15.12:0/876502487 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2968041070 con 0x556c2c75b480 2024-09-19T06:51:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.006+0000 7f295effd640 1 -- 172.21.15.12:0/876502487 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f2968003bf0 con 0x556c2c75b480 2024-09-19T06:51:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.006+0000 7f2987e04740 10 client.18735 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.006+0000 7f2987e04740 10 client.18735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.006+0000 7f2987e04740 20 client.18735 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.006+0000 7f2987e04740 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556c2c786990 0x556c2c788d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.006+0000 7f2987e04740 4 client.18735 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.006+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2978007e50 con 0x556c2c786990 2024-09-19T06:51:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.006+0000 7f297f7fe640 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556c2c786990 0x556c2c788d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.007+0000 7f297f7fe640 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556c2c786990 0x556c2c788d80 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dff7584e4fcf1d server_cookie=5ae30850f2e33e3d in_seq=0 out_seq=0 2024-09-19T06:51:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.007+0000 7f295effd640 10 client.18735 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.007+0000 7f295effd640 1 -- 172.21.15.12:0/876502487 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2978007e50 con 0x556c2c786990 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.007+0000 7f295effd640 10 client.18735 handle_command_reply: tid=0 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.007+0000 7f2987e04740 1 client.18735 shutdown 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.007+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 msgr2=0x556c2c762b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.007+0000 7f2987e04740 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 0x556c2c762b20 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2968033000 tx=0x7f29680044f0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.007+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 shutdown_connections 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.008+0000 7f2987e04740 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556c2c786990 0x556c2c788d80 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.008+0000 7f2987e04740 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c7632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.008+0000 7f2987e04740 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 0x556c2c762b20 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.008+0000 7f2987e04740 1 --2- 172.21.15.12:0/876502487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 0x556c2c7657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.008+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 >> 172.21.15.12:0/876502487 conn(0x556c2c7570f0 msgr2=0x556c2c75cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.008+0000 7f295effd640 0 client.18735 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.008+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 shutdown_connections 2024-09-19T06:51:49.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.008+0000 7f2987e04740 1 -- 172.21.15.12:0/876502487 wait complete. 2024-09-19T06:51:49.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.008+0000 7f2987e04740 20 client.18735 trim_cache size 0 max 16384 2024-09-19T06:51:49.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.042+0000 7f2987e04740 1 Processor -- start 2024-09-19T06:51:49.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.042+0000 7f2987e04740 1 -- start start 2024-09-19T06:51:49.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.043+0000 7f2987e04740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 0x556c2c75d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.043+0000 7f2987e04740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 0x556c2c764980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.043+0000 7f2987e04740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c78e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.043+0000 7f297f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 0x556c2c75d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.043+0000 7f297f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 0x556c2c75d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:44708/0 (socket says 172.21.15.12:44708) 2024-09-19T06:51:49.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.043+0000 7f297f7fe640 1 -- 172.21.15.12:0/3828371457 learned_addr learned my addr 172.21.15.12:0/3828371457 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:49.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.044+0000 7f2987e04740 1 -- 172.21.15.12:0/3828371457 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29801b4280 con 0x556c2c75b480 2024-09-19T06:51:49.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.044+0000 7f2987e04740 1 -- 172.21.15.12:0/3828371457 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f29801b5e50 con 0x556c2c765d40 2024-09-19T06:51:49.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.044+0000 7f2987e04740 1 -- 172.21.15.12:0/3828371457 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29801b4950 con 0x556c2c75ab60 2024-09-19T06:51:49.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.045+0000 7f297f7fe640 1 --2- 172.21.15.12:0/3828371457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c78e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.048+0000 7f297f7fe640 1 -- 172.21.15.12:0/3828371457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 msgr2=0x556c2c75d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.048+0000 7f297f7fe640 1 --2- 172.21.15.12:0/3828371457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 0x556c2c75d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.048+0000 7f297f7fe640 1 -- 172.21.15.12:0/3828371457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 msgr2=0x556c2c764980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.048+0000 7f297f7fe640 1 --2- 172.21.15.12:0/3828371457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 0x556c2c764980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.048+0000 7f297f7fe640 1 -- 172.21.15.12:0/3828371457 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c2c752830 con 0x556c2c765d40 2024-09-19T06:51:49.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.049+0000 7f297f7fe640 1 --2- 172.21.15.12:0/3828371457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c78e610 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f297800fc90 tx=0x7f2978000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caf6e8c3047e720c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.053+0000 7f29757fa640 1 -- 172.21.15.12:0/3828371457 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297801d040 con 0x556c2c765d40 2024-09-19T06:51:49.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.053+0000 7f29757fa640 1 -- 172.21.15.12:0/3828371457 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2978007e50 con 0x556c2c765d40 2024-09-19T06:51:49.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.053+0000 7f29757fa640 1 -- 172.21.15.12:0/3828371457 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978010a80 con 0x556c2c765d40 2024-09-19T06:51:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.054+0000 7f2987e04740 1 -- 172.21.15.12:0/3828371457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 msgr2=0x556c2c78e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.054+0000 7f2987e04740 1 --2- 172.21.15.12:0/3828371457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c78e610 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f297800fc90 tx=0x7f2978000f40 comp rx=0 tx=0).stop 2024-09-19T06:51:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.061+0000 7f2987e04740 1 -- 172.21.15.12:0/3828371457 shutdown_connections 2024-09-19T06:51:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.061+0000 7f2987e04740 1 --2- 172.21.15.12:0/3828371457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c78e610 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.061+0000 7f2987e04740 1 --2- 172.21.15.12:0/3828371457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75b480 0x556c2c764980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.061+0000 7f2987e04740 1 --2- 172.21.15.12:0/3828371457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75ab60 0x556c2c75d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.061+0000 7f2987e04740 1 -- 172.21.15.12:0/3828371457 >> 172.21.15.12:0/3828371457 conn(0x556c2c7570f0 msgr2=0x556c2c764270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:49.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.063+0000 7f2987e04740 1 -- 172.21.15.12:0/3828371457 shutdown_connections 2024-09-19T06:51:49.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.067+0000 7f2987e04740 1 -- 172.21.15.12:0/3828371457 wait complete. 2024-09-19T06:51:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.067+0000 7f2987e04740 1 -- start start 2024-09-19T06:51:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.068+0000 7f2987e04740 1 Processor -- start 2024-09-19T06:51:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.070+0000 7f2987e04740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75ab60 0x556c2c76a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.070+0000 7f2987e04740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75b480 0x556c2c76ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.070+0000 7f2987e04740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c76b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.070+0000 7f2987e04740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29801b5780 con 0x556c2c75ab60 2024-09-19T06:51:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.070+0000 7f2987e04740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f29801b50b0 con 0x556c2c765d40 2024-09-19T06:51:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.070+0000 7f2987e04740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29801b22c0 con 0x556c2c75b480 2024-09-19T06:51:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.071+0000 7f2987e04740 10 client.0 _ll_register_callbacks cb 0x7f2968005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:49.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.072+0000 7f297f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75ab60 0x556c2c76a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.072+0000 7f297f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75ab60 0x556c2c76a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44062/0 (socket says 172.21.15.12:44062) 2024-09-19T06:51:49.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.072+0000 7f297f7fe640 1 -- 172.21.15.12:0/438345495 learned_addr learned my addr 172.21.15.12:0/438345495 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:49.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.073+0000 7f2977fff640 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75b480 0x556c2c76ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.073+0000 7f297f7fe640 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c76b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.073+0000 7f297f7fe640 1 -- 172.21.15.12:0/438345495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75b480 msgr2=0x556c2c76ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.073+0000 7f297f7fe640 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75b480 0x556c2c76ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.073+0000 7f297f7fe640 1 -- 172.21.15.12:0/438345495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 msgr2=0x556c2c76b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.073+0000 7f297f7fe640 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c76b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.073+0000 7f297f7fe640 1 -- 172.21.15.12:0/438345495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c2c763620 con 0x556c2c75ab60 2024-09-19T06:51:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.073+0000 7f297f7fe640 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75ab60 0x556c2c76a650 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2978004730 tx=0x7f2978003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbcc3b9f0bb9194 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.074+0000 7f295effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.074+0000 7f295effd640 1 -- 172.21.15.12:0/438345495 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978004210 con 0x556c2c75ab60 2024-09-19T06:51:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.074+0000 7f295effd640 1 -- 172.21.15.12:0/438345495 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f297801d040 con 0x556c2c75ab60 2024-09-19T06:51:49.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.076+0000 7f2987e04740 1 -- 172.21.15.12:0/438345495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2978007e50 con 0x556c2c75ab60 2024-09-19T06:51:49.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.078+0000 7f295effd640 1 -- 172.21.15.12:0/438345495 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f29780043b0 con 0x556c2c75ab60 2024-09-19T06:51:49.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.078+0000 7f2987e04740 10 client.18738 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:49.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.078+0000 7f2987e04740 1 -- 172.21.15.12:0/438345495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x556c2c7f16b0 con 0x556c2c75ab60 2024-09-19T06:51:49.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.079+0000 7f295effd640 1 -- 172.21.15.12:0/438345495 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2978004d90 con 0x556c2c75ab60 2024-09-19T06:51:49.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.079+0000 7f295effd640 1 -- 172.21.15.12:0/438345495 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f2978005030 con 0x556c2c75ab60 2024-09-19T06:51:49.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.079+0000 7f2987e04740 10 client.18738 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:49.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.079+0000 7f2987e04740 10 client.18738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:49.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.079+0000 7f2987e04740 20 client.18738 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:49.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.079+0000 7f2987e04740 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556c2c7f19e0 0x556c2c7f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:49.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.079+0000 7f2987e04740 4 client.18738 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:51:49.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.079+0000 7f2987e04740 1 -- 172.21.15.12:0/438345495 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f2978007e50 con 0x556c2c7f19e0 2024-09-19T06:51:49.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.080+0000 7f2977fff640 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556c2c7f19e0 0x556c2c7f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:49.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.082+0000 7f295effd640 10 client.18738 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:49.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.082+0000 7f2977fff640 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556c2c7f19e0 0x556c2c7f3dd0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b22fb4a66b3e2f98 server_cookie=ec0b83e39fd54e85 in_seq=0 out_seq=0 2024-09-19T06:51:49.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.083+0000 7f295effd640 1 -- 172.21.15.12:0/438345495 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f2978007e50 con 0x556c2c7f19e0 2024-09-19T06:51:49.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.083+0000 7f295effd640 10 client.18738 handle_command_reply: tid=0 2024-09-19T06:51:49.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.083+0000 7f2987e04740 1 client.18738 shutdown 2024-09-19T06:51:49.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.083+0000 7f2987e04740 1 -- 172.21.15.12:0/438345495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75ab60 msgr2=0x556c2c76a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.083+0000 7f2987e04740 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75ab60 0x556c2c76a650 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2978004730 tx=0x7f2978003d00 comp rx=0 tx=0).stop 2024-09-19T06:51:49.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.084+0000 7f2987e04740 1 -- 172.21.15.12:0/438345495 shutdown_connections 2024-09-19T06:51:49.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.084+0000 7f2987e04740 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556c2c7f19e0 0x556c2c7f3dd0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.084+0000 7f2987e04740 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556c2c765d40 0x556c2c76b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.084+0000 7f2987e04740 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556c2c75b480 0x556c2c76ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.084+0000 7f2987e04740 1 --2- 172.21.15.12:0/438345495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556c2c75ab60 0x556c2c76a650 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.084+0000 7f2987e04740 1 -- 172.21.15.12:0/438345495 >> 172.21.15.12:0/438345495 conn(0x556c2c7570f0 msgr2=0x556c2c761ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:49.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.084+0000 7f295effd640 0 client.18738 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:49.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.084+0000 7f2987e04740 1 -- 172.21.15.12:0/438345495 shutdown_connections 2024-09-19T06:51:49.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.084+0000 7f2987e04740 1 -- 172.21.15.12:0/438345495 wait complete. 2024-09-19T06:51:49.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.084+0000 7f2987e04740 20 client.18738 trim_cache size 0 max 16384 2024-09-19T06:51:49.086 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:51:49.086 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:51:49.086 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "bf68e23c-7332-4d87-9d57-45f24a71eaab", 2024-09-19T06:51:49.086 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:51:49.087 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:51:49.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 -- 172.21.15.12:0/3413748329 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f296c0a3430 msgr2=0x7f296c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f296c0a3430 0x7f296c0a58f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f29801afb00 tx=0x7f2970018420 comp rx=0 tx=0).stop 2024-09-19T06:51:49.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 -- 172.21.15.12:0/3413748329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29801091f0 msgr2=0x7f298010a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:49.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29801091f0 0x7f298010a3d0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f297000e9f0 tx=0x7f297000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 -- 172.21.15.12:0/3413748329 shutdown_connections 2024-09-19T06:51:49.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2980114ab0 0x7f298010ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f296c0a3430 0x7f296c0a58f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2980109b10 0x7f298010a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 --2- 172.21.15.12:0/3413748329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29801091f0 0x7f298010a3d0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:49.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 -- 172.21.15.12:0/3413748329 >> 172.21.15.12:0/3413748329 conn(0x7f298006e140 msgr2=0x7f2980070860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:49.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 -- 172.21.15.12:0/3413748329 shutdown_connections 2024-09-19T06:51:49.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:49.085+0000 7f2985a2b640 1 -- 172.21.15.12:0/3413748329 wait complete. 2024-09-19T06:51:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:49 smithi016 ceph-mon[34911]: pgmap v363: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 617 op/s 2024-09-19T06:51:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:49 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:49 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:49 smithi173 ceph-mon[35349]: pgmap v363: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 617 op/s 2024-09-19T06:51:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:49 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:49 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:49.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:49 smithi012 ceph-mon[30937]: pgmap v363: 97 pgs: 97 active+clean; 4.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 617 op/s 2024-09-19T06:51:49.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:49 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:49.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:49 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.059 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:51:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:50 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:50 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 665.0 s, 1860.2 tps, lat 54.009 ms stddev 113.882 2024-09-19T06:51:50.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:51:50.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:50.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:50.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:50.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:51:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:50.834 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:50 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:51:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.031+0000 7f063cf82640 1 -- 172.21.15.12:0/3676298746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638100b20 msgr2=0x7f0638100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.031+0000 7f063cf82640 1 --2- 172.21.15.12:0/3676298746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638100b20 0x7f0638100f00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0628009900 tx=0x7f062802a470 comp rx=0 tx=0).stop 2024-09-19T06:51:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.031+0000 7f063cf82640 1 -- 172.21.15.12:0/3676298746 shutdown_connections 2024-09-19T06:51:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.031+0000 7f063cf82640 1 --2- 172.21.15.12:0/3676298746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0638105f30 0x7f06381063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.031+0000 7f063cf82640 1 --2- 172.21.15.12:0/3676298746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0638101440 0x7f0638105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.031+0000 7f063cf82640 1 --2- 172.21.15.12:0/3676298746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638100b20 0x7f0638100f00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.031+0000 7f063cf82640 1 -- 172.21.15.12:0/3676298746 >> 172.21.15.12:0/3676298746 conn(0x7f06380fc7d0 msgr2=0x7f06380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:51.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.032+0000 7f063cf82640 1 -- 172.21.15.12:0/3676298746 shutdown_connections 2024-09-19T06:51:51.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.032+0000 7f063cf82640 1 -- 172.21.15.12:0/3676298746 wait complete. 2024-09-19T06:51:51.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.033+0000 7f063cf82640 1 Processor -- start 2024-09-19T06:51:51.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.033+0000 7f063cf82640 1 -- start start 2024-09-19T06:51:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f063cf82640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638100b20 0x7f06381a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f063cf82640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0638101440 0x7f06381a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f063cf82640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0638105f30 0x7f063819e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f0635d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0638101440 0x7f06381a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f0635d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0638101440 0x7f06381a4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50610/0 (socket says 172.21.15.12:50610) 2024-09-19T06:51:51.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f0635d9b640 1 -- 172.21.15.12:0/1981901260 learned_addr learned my addr 172.21.15.12:0/1981901260 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:51.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f0636d9d640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0638105f30 0x7f063819e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0638118560 con 0x7f0638105f30 2024-09-19T06:51:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f06381183e0 con 0x7f0638101440 2024-09-19T06:51:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f06381186e0 con 0x7f0638100b20 2024-09-19T06:51:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.034+0000 7f063659c640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638100b20 0x7f06381a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.035+0000 7f0636d9d640 1 -- 172.21.15.12:0/1981901260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638100b20 msgr2=0x7f06381a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.035+0000 7f0636d9d640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638100b20 0x7f06381a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.035+0000 7f0636d9d640 1 -- 172.21.15.12:0/1981901260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0638101440 msgr2=0x7f06381a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:51.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.035+0000 7f0636d9d640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0638101440 0x7f06381a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.035+0000 7f0636d9d640 1 -- 172.21.15.12:0/1981901260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063819efe0 con 0x7f0638105f30 2024-09-19T06:51:51.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.035+0000 7f0635d9b640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0638101440 0x7f06381a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:51.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.036+0000 7f0636d9d640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0638105f30 0x7f063819e8b0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f0630009fd0 tx=0x7f063000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:51.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.036+0000 7f06277fe640 1 -- 172.21.15.12:0/1981901260 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063000ce20 con 0x7f0638105f30 2024-09-19T06:51:51.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.036+0000 7f06277fe640 1 -- 172.21.15.12:0/1981901260 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0630005020 con 0x7f0638105f30 2024-09-19T06:51:51.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.036+0000 7f06277fe640 1 -- 172.21.15.12:0/1981901260 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300106b0 con 0x7f0638105f30 2024-09-19T06:51:51.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.036+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063819f2d0 con 0x7f0638105f30 2024-09-19T06:51:51.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.037+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06381ab5c0 con 0x7f0638105f30 2024-09-19T06:51:51.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.040+0000 7f06277fe640 1 -- 172.21.15.12:0/1981901260 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f06300051d0 con 0x7f0638105f30 2024-09-19T06:51:51.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.040+0000 7f063f35b740 1 Processor -- start 2024-09-19T06:51:51.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.041+0000 7f063f35b740 1 -- start start 2024-09-19T06:51:51.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.041+0000 7f063f35b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5964a0 0x56021a596880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.041+0000 7f063f35b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a5a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.041+0000 7f063f35b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5a1680 0x56021a5a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.042+0000 7f063659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a5a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.042+0000 7f06277fe640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f06200a3500 0x7f06200a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.042+0000 7f063659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a5a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50618/0 (socket says 172.21.15.12:50618) 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.042+0000 7f0636d9d640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f06200a3500 0x7f06200a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.042+0000 7f063659c640 1 -- 172.21.15.12:0/258620048 learned_addr learned my addr 172.21.15.12:0/258620048 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.042+0000 7f063f35b740 1 -- 172.21.15.12:0/258620048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56021a4fc2e0 con 0x56021a5a1680 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.042+0000 7f063f35b740 1 -- 172.21.15.12:0/258620048 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56021a4a3ce0 con 0x56021a596dc0 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.042+0000 7f063f35b740 1 -- 172.21.15.12:0/258620048 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56021a4f82a0 con 0x56021a5964a0 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.042+0000 7f0635d9b640 1 --2- 172.21.15.12:0/258620048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5964a0 0x56021a596880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.042+0000 7f0635d9b640 1 --2- 172.21.15.12:0/258620048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5a1680 0x56021a5a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f0635d9b640 1 -- 172.21.15.12:0/258620048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5964a0 msgr2=0x56021a596880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f0635d9b640 1 --2- 172.21.15.12:0/258620048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5964a0 0x56021a596880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f0635d9b640 1 -- 172.21.15.12:0/258620048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 msgr2=0x56021a5a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:51.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f0635d9b640 1 --2- 172.21.15.12:0/258620048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a5a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f0635d9b640 1 -- 172.21.15.12:0/258620048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56021a488440 con 0x56021a5a1680 2024-09-19T06:51:51.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f06277fe640 1 -- 172.21.15.12:0/1981901260 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f06300d0280 con 0x7f0638105f30 2024-09-19T06:51:51.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f0636d9d640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f06200a3500 0x7f06200a59c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f063006ab20 tx=0x7f06300987e0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:51.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f0635d9b640 1 --2- 172.21.15.12:0/258620048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5a1680 0x56021a5a3a70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f06380ffed0 tx=0x7f062c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ba43c4ba88ce97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:51.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f0624ff9640 1 -- 172.21.15.12:0/258620048 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c0120d0 con 0x56021a5a1680 2024-09-19T06:51:51.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f0624ff9640 1 -- 172.21.15.12:0/258620048 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f062c012270 con 0x56021a5a1680 2024-09-19T06:51:51.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.043+0000 7f0624ff9640 1 -- 172.21.15.12:0/258620048 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c004e10 con 0x56021a5a1680 2024-09-19T06:51:51.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.044+0000 7f063f35b740 1 -- 172.21.15.12:0/258620048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5a1680 msgr2=0x56021a5a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:51.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.044+0000 7f063f35b740 1 --2- 172.21.15.12:0/258620048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5a1680 0x56021a5a3a70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f06380ffed0 tx=0x7f062c005f90 comp rx=0 tx=0).stop 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.044+0000 7f063f35b740 1 -- 172.21.15.12:0/258620048 shutdown_connections 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.044+0000 7f063f35b740 1 --2- 172.21.15.12:0/258620048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5a1680 0x56021a5a3a70 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.044+0000 7f063f35b740 1 --2- 172.21.15.12:0/258620048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a5a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.044+0000 7f063f35b740 1 --2- 172.21.15.12:0/258620048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5964a0 0x56021a596880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.044+0000 7f063f35b740 1 -- 172.21.15.12:0/258620048 >> 172.21.15.12:0/258620048 conn(0x56021a592a30 msgr2=0x56021a592e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.044+0000 7f063f35b740 1 -- 172.21.15.12:0/258620048 shutdown_connections 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.045+0000 7f063f35b740 1 -- 172.21.15.12:0/258620048 wait complete. 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.045+0000 7f063f35b740 1 -- start start 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.046+0000 7f063f35b740 1 Processor -- start 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.047+0000 7f063f35b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5a1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.047+0000 7f063f35b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a59e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.047+0000 7f063f35b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 0x56021a59e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.047+0000 7f063f35b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56021a5a4250 con 0x56021a5964a0 2024-09-19T06:51:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.047+0000 7f063f35b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56021a4b7050 con 0x56021a596dc0 2024-09-19T06:51:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.047+0000 7f063f35b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56021a5a43d0 con 0x56021a5a1680 2024-09-19T06:51:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.047+0000 7f063659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a59e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.047+0000 7f063659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a59e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50634/0 (socket says 172.21.15.12:50634) 2024-09-19T06:51:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.047+0000 7f063659c640 1 -- 172.21.15.12:0/2494308755 learned_addr learned my addr 172.21.15.12:0/2494308755 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.047+0000 7f063f35b740 10 client.0 _ll_register_callbacks cb 0x56021a4f7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f0635d9b640 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 0x56021a59e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f0635d9b640 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f063659c640 1 -- 172.21.15.12:0/2494308755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 msgr2=0x56021a59e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f063659c640 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 0x56021a59e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f063659c640 1 -- 172.21.15.12:0/2494308755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 msgr2=0x56021a5a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f063659c640 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5a1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f063659c640 1 -- 172.21.15.12:0/2494308755 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56021a26d3c0 con 0x56021a596dc0 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f0635d9b640 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 0x56021a59e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f063659c640 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a59e2b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0628031550 tx=0x7f06280317e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fbdaf113d6af1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f061dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f061dffb640 1 -- 172.21.15.12:0/2494308755 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628035040 con 0x56021a596dc0 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f063f35b740 1 -- 172.21.15.12:0/2494308755 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f062c012270 con 0x56021a596dc0 2024-09-19T06:51:51.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.048+0000 7f061dffb640 1 -- 172.21.15.12:0/2494308755 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f0628004040 con 0x56021a596dc0 2024-09-19T06:51:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f061dffb640 1 -- 172.21.15.12:0/2494308755 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f0628004240 con 0x56021a596dc0 2024-09-19T06:51:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f063f35b740 10 client.28079 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f063f35b740 1 -- 172.21.15.12:0/2494308755 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x56021a5afc70 con 0x56021a596dc0 2024-09-19T06:51:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f061dffb640 1 -- 172.21.15.12:0/2494308755 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f062c012270 con 0x56021a596dc0 2024-09-19T06:51:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f061dffb640 1 -- 172.21.15.12:0/2494308755 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f06280049e0 con 0x56021a596dc0 2024-09-19T06:51:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f063f35b740 10 client.28079 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:51.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f063f35b740 10 client.28079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f063f35b740 20 client.28079 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f063f35b740 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56021a5b1490 0x56021a5b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f063f35b740 4 client.28079 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f063f35b740 1 -- 172.21.15.12:0/2494308755 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56021a509850 con 0x56021a5b1490 2024-09-19T06:51:51.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.049+0000 7f0635d9b640 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56021a5b1490 0x56021a5b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.050+0000 7f0635d9b640 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56021a5b1490 0x56021a5b3930 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafa9ffccc53831e server_cookie=304db6a63aee72d4 in_seq=0 out_seq=0 2024-09-19T06:51:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.050+0000 7f061dffb640 10 client.28079 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.050+0000 7f061dffb640 1 -- 172.21.15.12:0/2494308755 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56021a509850 con 0x56021a5b1490 2024-09-19T06:51:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.050+0000 7f061dffb640 10 client.28079 handle_command_reply: tid=0 2024-09-19T06:51:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 client.28079 shutdown 2024-09-19T06:51:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 -- 172.21.15.12:0/2494308755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 msgr2=0x56021a59e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a59e2b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0628031550 tx=0x7f06280317e0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 -- 172.21.15.12:0/2494308755 shutdown_connections 2024-09-19T06:51:51.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56021a5b1490 0x56021a5b3930 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 0x56021a59e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a59e2b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 --2- 172.21.15.12:0/2494308755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 -- 172.21.15.12:0/2494308755 >> 172.21.15.12:0/2494308755 conn(0x56021a592a30 msgr2=0x56021a598710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:51.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f061dffb640 0 client.28079 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:51.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 -- 172.21.15.12:0/2494308755 shutdown_connections 2024-09-19T06:51:51.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 1 -- 172.21.15.12:0/2494308755 wait complete. 2024-09-19T06:51:51.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.051+0000 7f063f35b740 20 client.28079 trim_cache size 0 max 16384 2024-09-19T06:51:51.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.077+0000 7f063f35b740 1 Processor -- start 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.078+0000 7f063f35b740 1 -- start start 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f063f35b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f063f35b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a59cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f063f35b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 0x56021a5997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f063f35b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f06381b41e0 con 0x56021a5964a0 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f063f35b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f06381b5db0 con 0x56021a596dc0 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f063f35b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f06381b48b0 con 0x56021a5a1680 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f0635d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f0635d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53724/0 (socket says 172.21.15.12:53724) 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f0635d9b640 1 -- 172.21.15.12:0/2071154676 learned_addr learned my addr 172.21.15.12:0/2071154676 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:51.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f063659c640 1 --2- 172.21.15.12:0/2071154676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a59cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.079+0000 7f0635d9b640 1 --2- 172.21.15.12:0/2071154676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 0x56021a5997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.080+0000 7f0635d9b640 1 -- 172.21.15.12:0/2071154676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 msgr2=0x56021a5997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.080+0000 7f0635d9b640 1 --2- 172.21.15.12:0/2071154676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 0x56021a5997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.080+0000 7f0635d9b640 1 -- 172.21.15.12:0/2071154676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 msgr2=0x56021a59cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.080+0000 7f0635d9b640 1 --2- 172.21.15.12:0/2071154676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a59cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.080+0000 7f0635d9b640 1 -- 172.21.15.12:0/2071154676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56021a59d260 con 0x56021a5964a0 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.080+0000 7f0635d9b640 1 --2- 172.21.15.12:0/2071154676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5ad4b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f062c004aa0 tx=0x7f062c009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a94bbdf0b222ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.080+0000 7f061ffff640 1 -- 172.21.15.12:0/2071154676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c016040 con 0x56021a5964a0 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.081+0000 7f061ffff640 1 -- 172.21.15.12:0/2071154676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f062c017040 con 0x56021a5964a0 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.081+0000 7f061ffff640 1 -- 172.21.15.12:0/2071154676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c010960 con 0x56021a5964a0 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.081+0000 7f063f35b740 1 -- 172.21.15.12:0/2071154676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 msgr2=0x56021a5ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.081+0000 7f063f35b740 1 --2- 172.21.15.12:0/2071154676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5ad4b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f062c004aa0 tx=0x7f062c009d10 comp rx=0 tx=0).stop 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.081+0000 7f063f35b740 1 -- 172.21.15.12:0/2071154676 shutdown_connections 2024-09-19T06:51:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.081+0000 7f063f35b740 1 --2- 172.21.15.12:0/2071154676 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a5a1680 0x56021a5997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.081+0000 7f063f35b740 1 --2- 172.21.15.12:0/2071154676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a596dc0 0x56021a59cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.081+0000 7f063f35b740 1 --2- 172.21.15.12:0/2071154676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5ad4b0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.082+0000 7f063f35b740 1 -- 172.21.15.12:0/2071154676 >> 172.21.15.12:0/2071154676 conn(0x56021a592a30 msgr2=0x56021a5990e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:51.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.082+0000 7f063f35b740 1 -- 172.21.15.12:0/2071154676 shutdown_connections 2024-09-19T06:51:51.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.082+0000 7f063f35b740 1 -- 172.21.15.12:0/2071154676 wait complete. 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.082+0000 7f063f35b740 1 -- start start 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.082+0000 7f063f35b740 1 Processor -- start 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f063f35b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f063f35b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a596dc0 0x56021a5a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f063f35b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a5a1680 0x56021a6141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f063f35b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f06381b56e0 con 0x56021a5964a0 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f063f35b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f06381b5010 con 0x56021a5a1680 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f063f35b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f06381b21e0 con 0x56021a596dc0 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f063f35b740 10 client.0 _ll_register_callbacks cb 0x7f062c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f0635d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f0635d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5a4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53726/0 (socket says 172.21.15.12:53726) 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f0635d9b640 1 -- 172.21.15.12:0/16994525 learned_addr learned my addr 172.21.15.12:0/16994525 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f063659c640 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a596dc0 0x56021a5a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.083+0000 7f0635d9b640 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a5a1680 0x56021a6141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.084+0000 7f0635d9b640 1 -- 172.21.15.12:0/16994525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a596dc0 msgr2=0x56021a5a52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.084+0000 7f0635d9b640 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a596dc0 0x56021a5a52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.084+0000 7f0635d9b640 1 -- 172.21.15.12:0/16994525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a5a1680 msgr2=0x56021a6141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.084+0000 7f0635d9b640 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a5a1680 0x56021a6141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.084+0000 7f0635d9b640 1 -- 172.21.15.12:0/16994525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56021a5a1370 con 0x56021a5964a0 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.084+0000 7f0635d9b640 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5a4d60 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f062c012740 tx=0x7f062c012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d685d5c4809bca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.084+0000 7f061dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.084+0000 7f061dffb640 1 -- 172.21.15.12:0/16994525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c034070 con 0x56021a5964a0 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.084+0000 7f063f35b740 1 -- 172.21.15.12:0/16994525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f062c017040 con 0x56021a5964a0 2024-09-19T06:51:51.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.084+0000 7f061dffb640 1 -- 172.21.15.12:0/16994525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f062c00fba0 con 0x56021a5964a0 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f061dffb640 1 -- 172.21.15.12:0/16994525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f062c03d050 con 0x56021a5964a0 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f063f35b740 10 client.18753 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f063f35b740 1 -- 172.21.15.12:0/16994525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x56021a61b9b0 con 0x56021a5964a0 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f061dffb640 1 -- 172.21.15.12:0/16994525 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f062c017040 con 0x56021a5964a0 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f061dffb640 1 -- 172.21.15.12:0/16994525 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f062c037030 con 0x56021a5964a0 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f063f35b740 10 client.18753 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f063f35b740 10 client.18753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f063f35b740 20 client.18753 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f063f35b740 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56021a61bd90 0x56021a61e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f063f35b740 4 client.18753 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.085+0000 7f063f35b740 1 -- 172.21.15.12:0/16994525 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56021a503d60 con 0x56021a61bd90 2024-09-19T06:51:51.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.086+0000 7f063659c640 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56021a61bd90 0x56021a61e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:51.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.086+0000 7f061dffb640 10 client.18753 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:51.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.087+0000 7f063659c640 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56021a61bd90 0x56021a61e180 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ca54b7d7d6ac277 server_cookie=80bb2dd27e9045f0 in_seq=0 out_seq=0 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.087+0000 7f061dffb640 1 -- 172.21.15.12:0/16994525 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56021a503d60 con 0x56021a61bd90 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.087+0000 7f061dffb640 10 client.18753 handle_command_reply: tid=0 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.087+0000 7f063f35b740 1 client.18753 shutdown 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 1 -- 172.21.15.12:0/16994525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 msgr2=0x56021a5a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5a4d60 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f062c012740 tx=0x7f062c012690 comp rx=0 tx=0).stop 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 1 -- 172.21.15.12:0/16994525 shutdown_connections 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56021a61bd90 0x56021a61e180 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56021a5a1680 0x56021a6141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56021a596dc0 0x56021a5a52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 1 --2- 172.21.15.12:0/16994525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56021a5964a0 0x56021a5a4d60 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 1 -- 172.21.15.12:0/16994525 >> 172.21.15.12:0/16994525 conn(0x56021a592a30 msgr2=0x56021a5a0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f061dffb640 0 client.18753 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 1 -- 172.21.15.12:0/16994525 shutdown_connections 2024-09-19T06:51:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 1 -- 172.21.15.12:0/16994525 wait complete. 2024-09-19T06:51:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.088+0000 7f063f35b740 20 client.18753 trim_cache size 0 max 16384 2024-09-19T06:51:51.092 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:51:51.092 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:51:51.092 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:51:51.092 INFO:teuthology.orchestra.run.smithi012.stdout: "bf68e23c-7332-4d87-9d57-45f24a71eaab": { 2024-09-19T06:51:51.092 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:51:51.092 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "bf68e23c-7332-4d87-9d57-45f24a71eaab", 2024-09-19T06:51:51.092 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:51:51.092 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:51:51.093 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:51:51.093 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:51:51.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.089+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f06200a3500 msgr2=0x7f06200a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:51.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.089+0000 7f063cf82640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f06200a3500 0x7f06200a59c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f063006ab20 tx=0x7f06300987e0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.089+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0638105f30 msgr2=0x7f063819e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.089+0000 7f063cf82640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0638105f30 0x7f063819e8b0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f0630009fd0 tx=0x7f063000ef10 comp rx=0 tx=0).stop 2024-09-19T06:51:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.089+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 shutdown_connections 2024-09-19T06:51:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.090+0000 7f063cf82640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0638105f30 0x7f063819e8b0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.090+0000 7f063cf82640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0638101440 0x7f06381a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.090+0000 7f063cf82640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f06200a3500 0x7f06200a59c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.090+0000 7f063cf82640 1 --2- 172.21.15.12:0/1981901260 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638100b20 0x7f06381a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.090+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 >> 172.21.15.12:0/1981901260 conn(0x7f06380fc7d0 msgr2=0x7f06380fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.090+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 shutdown_connections 2024-09-19T06:51:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:51:51.090+0000 7f063cf82640 1 -- 172.21.15.12:0/1981901260 wait complete. 2024-09-19T06:51:51.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:51 smithi016 ceph-mon[34911]: pgmap v364: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 31 MiB/s wr, 2.05k op/s 2024-09-19T06:51:51.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:51 smithi173 ceph-mon[35349]: pgmap v364: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 31 MiB/s wr, 2.05k op/s 2024-09-19T06:51:51.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:51 smithi012 ceph-mon[30937]: pgmap v364: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 31 MiB/s wr, 2.05k op/s 2024-09-19T06:51:52.081 INFO:tasks.cephfs.filesystem:scrub status for tag:bf68e23c-7332-4d87-9d57-45f24a71eaab - {'path': '/', 'tag': 'bf68e23c-7332-4d87-9d57-45f24a71eaab', 'options': 'recursive,force'} 2024-09-19T06:51:53.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:53 smithi016 ceph-mon[34911]: pgmap v365: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 28 MiB/s wr, 1.73k op/s 2024-09-19T06:51:53.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:53 smithi173 ceph-mon[35349]: pgmap v365: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 28 MiB/s wr, 1.73k op/s 2024-09-19T06:51:53.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:53 smithi012 ceph-mon[30937]: pgmap v365: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 28 MiB/s wr, 1.73k op/s 2024-09-19T06:51:55.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:55 smithi016 ceph-mon[34911]: pgmap v366: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 28 MiB/s wr, 1.73k op/s 2024-09-19T06:51:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 670.0 s, 2278.2 tps, lat 43.766 ms stddev 50.689 2024-09-19T06:51:55.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:55 smithi173 ceph-mon[35349]: pgmap v366: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 28 MiB/s wr, 1.73k op/s 2024-09-19T06:51:55.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:55 smithi012 ceph-mon[30937]: pgmap v366: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 28 MiB/s wr, 1.73k op/s 2024-09-19T06:51:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.210+0000 7f4ec1a23640 1 -- 172.21.15.12:0/44625723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ebc1009b0 msgr2=0x7f4ebc100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.210+0000 7f4ec1a23640 1 --2- 172.21.15.12:0/44625723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ebc1009b0 0x7f4ebc100e10 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009930 tx=0x7f4eb002a420 comp rx=0 tx=0).stop 2024-09-19T06:51:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.210+0000 7f4ec1a23640 1 -- 172.21.15.12:0/44625723 shutdown_connections 2024-09-19T06:51:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.210+0000 7f4ec1a23640 1 --2- 172.21.15.12:0/44625723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ebc101350 0x7f4ebc10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.210+0000 7f4ec1a23640 1 --2- 172.21.15.12:0/44625723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ebc1009b0 0x7f4ebc100e10 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.210+0000 7f4ec1a23640 1 --2- 172.21.15.12:0/44625723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ebc1069c0 0x7f4ebc106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.210+0000 7f4ec1a23640 1 -- 172.21.15.12:0/44625723 >> 172.21.15.12:0/44625723 conn(0x7f4ebc077990 msgr2=0x7f4ebc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.211+0000 7f4ec1a23640 1 -- 172.21.15.12:0/44625723 shutdown_connections 2024-09-19T06:51:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.211+0000 7f4ec1a23640 1 -- 172.21.15.12:0/44625723 wait complete. 2024-09-19T06:51:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.212+0000 7f4ec1a23640 1 Processor -- start 2024-09-19T06:51:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.213+0000 7f4ec1a23640 1 -- start start 2024-09-19T06:51:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.213+0000 7f4ec1a23640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ebc1009b0 0x7f4ebc1a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.213+0000 7f4ec1a23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ebc101350 0x7f4ebc1a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.213+0000 7f4ebaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ebc1009b0 0x7f4ebc1a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.213+0000 7f4ebaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ebc1009b0 0x7f4ebc1a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41508/0 (socket says 172.21.15.12:41508) 2024-09-19T06:51:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.213+0000 7f4eba7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ebc101350 0x7f4ebc1a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4eba7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ebc101350 0x7f4ebc1a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53752/0 (socket says 172.21.15.12:53752) 2024-09-19T06:51:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ec1a23640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ebc1069c0 0x7f4ebc19ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ec1a23640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc110dc0 con 0x7f4ebc101350 2024-09-19T06:51:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ec1a23640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc110c40 con 0x7f4ebc1069c0 2024-09-19T06:51:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ec1a23640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc110f40 con 0x7f4ebc1009b0 2024-09-19T06:51:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ebaffd640 1 -- 172.21.15.12:0/4216857471 learned_addr learned my addr 172.21.15.12:0/4216857471 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ebb7fe640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ebc1069c0 0x7f4ebc19ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ebaffd640 1 -- 172.21.15.12:0/4216857471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ebc1069c0 msgr2=0x7f4ebc19ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ebc1069c0 0x7f4ebc19ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ebaffd640 1 -- 172.21.15.12:0/4216857471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ebc101350 msgr2=0x7f4ebc1a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ebc101350 0x7f4ebc1a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ebaffd640 1 -- 172.21.15.12:0/4216857471 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc19f300 con 0x7f4ebc1009b0 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.214+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ebc1009b0 0x7f4ebc1a4680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00d950 tx=0x7f4eac00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.215+0000 7f4ec0a21640 1 -- 172.21.15.12:0/4216857471 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac017070 con 0x7f4ebc1009b0 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.215+0000 7f4ec1a23640 1 -- 172.21.15.12:0/4216857471 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ebc19f590 con 0x7f4ebc1009b0 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.215+0000 7f4ec0a21640 1 -- 172.21.15.12:0/4216857471 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4eac009c30 con 0x7f4ebc1009b0 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.215+0000 7f4ec0a21640 1 -- 172.21.15.12:0/4216857471 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00f6b0 con 0x7f4ebc1009b0 2024-09-19T06:51:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.215+0000 7f4ec1a23640 1 -- 172.21.15.12:0/4216857471 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ebc1ab600 con 0x7f4ebc1009b0 2024-09-19T06:51:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.218+0000 7f4ec47ba740 1 Processor -- start 2024-09-19T06:51:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.218+0000 7f4ec47ba740 1 -- start start 2024-09-19T06:51:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.218+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6763af0 0x5623d6763ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.218+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d6764410 0x5623d676e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.218+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d676ecb0 0x5623d67710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.218+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5623d66c82f0 con 0x5623d6764410 2024-09-19T06:51:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.218+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5623d6670270 con 0x5623d6763af0 2024-09-19T06:51:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.218+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5623d66c42b0 con 0x5623d676ecb0 2024-09-19T06:51:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.218+0000 7f4eba7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d676ecb0 0x5623d67710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.219+0000 7f4eba7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d676ecb0 0x5623d67710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41524/0 (socket says 172.21.15.12:41524) 2024-09-19T06:51:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.219+0000 7f4eba7fc640 1 -- 172.21.15.12:0/1848524511 learned_addr learned my addr 172.21.15.12:0/1848524511 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.219+0000 7f4ebb7fe640 1 --2- 172.21.15.12:0/1848524511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6763af0 0x5623d6763ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.219+0000 7f4eba7fc640 1 -- 172.21.15.12:0/1848524511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6763af0 msgr2=0x5623d6763ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.219+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/1848524511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6763af0 0x5623d6763ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.219+0000 7f4eba7fc640 1 -- 172.21.15.12:0/1848524511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d6764410 msgr2=0x5623d676e770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:51:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.219+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/1848524511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d6764410 0x5623d676e770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.219+0000 7f4eba7fc640 1 -- 172.21.15.12:0/1848524511 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623d666f340 con 0x5623d676ecb0 2024-09-19T06:51:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.219+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/1848524511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d676ecb0 0x5623d67710a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4eb002a940 tx=0x7f4eb0005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=158bfcbadccb16cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.219+0000 7f4ec0a21640 1 -- 172.21.15.12:0/4216857471 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4eac0109d0 con 0x7f4ebc1009b0 2024-09-19T06:51:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.220+0000 7f4ea1ffb640 1 -- 172.21.15.12:0/1848524511 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0040070 con 0x5623d676ecb0 2024-09-19T06:51:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.220+0000 7f4ea1ffb640 1 -- 172.21.15.12:0/1848524511 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4eb00318f0 con 0x5623d676ecb0 2024-09-19T06:51:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.220+0000 7f4ea1ffb640 1 -- 172.21.15.12:0/1848524511 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0035040 con 0x5623d676ecb0 2024-09-19T06:51:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec0a21640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ea40a3560 0x7f4ea40a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec47ba740 1 -- 172.21.15.12:0/1848524511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d676ecb0 msgr2=0x5623d67710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/1848524511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d676ecb0 0x5623d67710a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4eb002a940 tx=0x7f4eb0005c00 comp rx=0 tx=0).stop 2024-09-19T06:51:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec47ba740 1 -- 172.21.15.12:0/1848524511 shutdown_connections 2024-09-19T06:51:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/1848524511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d676ecb0 0x5623d67710a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/1848524511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d6764410 0x5623d676e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/1848524511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6763af0 0x5623d6763ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec0a21640 1 -- 172.21.15.12:0/4216857471 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f4eac0cfcc0 con 0x7f4ebc1009b0 2024-09-19T06:51:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec47ba740 1 -- 172.21.15.12:0/1848524511 >> 172.21.15.12:0/1848524511 conn(0x5623d6760060 msgr2=0x5623d6760440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ebb7fe640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ea40a3560 0x7f4ea40a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec47ba740 1 -- 172.21.15.12:0/1848524511 shutdown_connections 2024-09-19T06:51:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.221+0000 7f4ec47ba740 1 -- 172.21.15.12:0/1848524511 wait complete. 2024-09-19T06:51:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.222+0000 7f4ec47ba740 1 -- start start 2024-09-19T06:51:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.222+0000 7f4ebb7fe640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ea40a3560 0x7f4ea40a5a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4005fd0 tx=0x7f4eb4009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.222+0000 7f4ec47ba740 1 Processor -- start 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6763af0 0x5623d676bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 0x5623d676c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d676ecb0 0x5623d676c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5623d6782890 con 0x5623d676ecb0 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5623d6651290 con 0x5623d6764410 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5623d6782a10 con 0x5623d6763af0 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4ec47ba740 10 client.0 _ll_register_callbacks cb 0x5623d6682140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4ebb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d676ecb0 0x5623d676c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4ebb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d676ecb0 0x5623d676c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53762/0 (socket says 172.21.15.12:53762) 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4ebb7fe640 1 -- 172.21.15.12:0/3119768209 learned_addr learned my addr 172.21.15.12:0/3119768209 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.223+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 0x5623d676c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.224+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6763af0 0x5623d676bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.224+0000 7f4ebaffd640 1 -- 172.21.15.12:0/3119768209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 msgr2=0x5623d676c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.224+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 0x5623d676c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.224+0000 7f4ebaffd640 1 -- 172.21.15.12:0/3119768209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d676ecb0 msgr2=0x5623d676c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.224+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d676ecb0 0x5623d676c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.224+0000 7f4ebaffd640 1 -- 172.21.15.12:0/3119768209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623d63db210 con 0x5623d6763af0 2024-09-19T06:51:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.224+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6763af0 0x5623d676bbe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0cd310 tx=0x7f4eac009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3274f245edc8914a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.224+0000 7f4e9affd640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:51:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.225+0000 7f4e9affd640 1 -- 172.21.15.12:0/3119768209 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac020070 con 0x5623d6763af0 2024-09-19T06:51:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.225+0000 7f4ec47ba740 1 -- 172.21.15.12:0/3119768209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4eb00318f0 con 0x5623d6763af0 2024-09-19T06:51:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.225+0000 7f4e9affd640 1 -- 172.21.15.12:0/3119768209 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f4eac0cd590 con 0x5623d6763af0 2024-09-19T06:51:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.225+0000 7f4e9affd640 1 -- 172.21.15.12:0/3119768209 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f4eac0cd790 con 0x5623d6763af0 2024-09-19T06:51:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.225+0000 7f4ec47ba740 10 client.28045 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.225+0000 7f4ec47ba740 1 -- 172.21.15.12:0/3119768209 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5623d64a7620 con 0x5623d6763af0 2024-09-19T06:51:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.226+0000 7f4e9affd640 1 -- 172.21.15.12:0/3119768209 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4eb00318f0 con 0x5623d6763af0 2024-09-19T06:51:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.226+0000 7f4e9affd640 1 -- 172.21.15.12:0/3119768209 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f4eac09b2f0 con 0x5623d6763af0 2024-09-19T06:51:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.226+0000 7f4ec47ba740 10 client.28045 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.226+0000 7f4ec47ba740 10 client.28045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.226+0000 7f4ec47ba740 20 client.28045 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.227+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5623d67900d0 0x5623d67924c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.227+0000 7f4ec47ba740 4 client.28045 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:51:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.227+0000 7f4ec47ba740 1 -- 172.21.15.12:0/3119768209 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623d66d5a20 con 0x5623d67900d0 2024-09-19T06:51:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.227+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5623d67900d0 0x5623d67924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.227+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5623d67900d0 0x5623d67924c0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec21757060c8485e server_cookie=86b4be33ed95ecc0 in_seq=0 out_seq=0 2024-09-19T06:51:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.227+0000 7f4e9affd640 10 client.28045 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4e9affd640 1 -- 172.21.15.12:0/3119768209 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623d66d5a20 con 0x5623d67900d0 2024-09-19T06:51:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4e9affd640 10 client.28045 handle_command_reply: tid=0 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 client.28045 shutdown 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 -- 172.21.15.12:0/3119768209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6763af0 msgr2=0x5623d676bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6763af0 0x5623d676bbe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0cd310 tx=0x7f4eac009ea0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 -- 172.21.15.12:0/3119768209 shutdown_connections 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5623d67900d0 0x5623d67924c0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d676ecb0 0x5623d676c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 0x5623d676c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/3119768209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6763af0 0x5623d676bbe0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 -- 172.21.15.12:0/3119768209 >> 172.21.15.12:0/3119768209 conn(0x5623d6760060 msgr2=0x5623d6765dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4e9affd640 0 client.28045 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 -- 172.21.15.12:0/3119768209 shutdown_connections 2024-09-19T06:51:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.229+0000 7f4ec47ba740 1 -- 172.21.15.12:0/3119768209 wait complete. 2024-09-19T06:51:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.230+0000 7f4ec47ba740 20 client.28045 trim_cache size 0 max 16384 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.258+0000 7f4ec47ba740 1 Processor -- start 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.264+0000 7f4ec47ba740 1 -- start start 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.264+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6763af0 0x5623d6797da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.264+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 0x5623d67982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.264+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d676ecb0 0x5623d6768e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.264+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc1aba50 con 0x5623d676ecb0 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.264+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc1ad620 con 0x5623d6764410 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.264+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc1ac120 con 0x5623d6763af0 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.265+0000 7f4eba7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 0x5623d67982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.265+0000 7f4eba7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 0x5623d67982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50720/0 (socket says 172.21.15.12:50720) 2024-09-19T06:51:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.265+0000 7f4eba7fc640 1 -- 172.21.15.12:0/2532341799 learned_addr learned my addr 172.21.15.12:0/2532341799 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.265+0000 7f4eba7fc640 1 -- 172.21.15.12:0/2532341799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6763af0 msgr2=0x5623d6797da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.265+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/2532341799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6763af0 0x5623d6797da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.265+0000 7f4eba7fc640 1 -- 172.21.15.12:0/2532341799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d676ecb0 msgr2=0x5623d6768e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.265+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/2532341799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d676ecb0 0x5623d6768e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.265+0000 7f4eba7fc640 1 -- 172.21.15.12:0/2532341799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623d6763870 con 0x5623d6764410 2024-09-19T06:51:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.265+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/2532341799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 0x5623d67982e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0005540 tx=0x7f4eb0005570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94a23708f90fe79b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.267+0000 7f4ea17fa640 1 -- 172.21.15.12:0/2532341799 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0040040 con 0x5623d6764410 2024-09-19T06:51:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.267+0000 7f4ea17fa640 1 -- 172.21.15.12:0/2532341799 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4eb00055e0 con 0x5623d6764410 2024-09-19T06:51:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.267+0000 7f4ea17fa640 1 -- 172.21.15.12:0/2532341799 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0035040 con 0x5623d6764410 2024-09-19T06:51:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.270+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2532341799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 msgr2=0x5623d67982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.270+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/2532341799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 0x5623d67982e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0005540 tx=0x7f4eb0005570 comp rx=0 tx=0).stop 2024-09-19T06:51:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.274+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2532341799 shutdown_connections 2024-09-19T06:51:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.274+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/2532341799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d676ecb0 0x5623d6768e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.274+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/2532341799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d6764410 0x5623d67982e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.274+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/2532341799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6763af0 0x5623d6797da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.274+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2532341799 >> 172.21.15.12:0/2532341799 conn(0x5623d6760060 msgr2=0x5623d676dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.278+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2532341799 shutdown_connections 2024-09-19T06:51:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.279+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2532341799 wait complete. 2024-09-19T06:51:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.279+0000 7f4ec47ba740 1 -- start start 2024-09-19T06:51:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.280+0000 7f4ec47ba740 1 Processor -- start 2024-09-19T06:51:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.281+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d6763af0 0x5623d6788480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.281+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6764410 0x5623d67689c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.281+0000 7f4ec47ba740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d676ecb0 0x5623d6768fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.281+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc1acf50 con 0x5623d6763af0 2024-09-19T06:51:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.281+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc1ac880 con 0x5623d676ecb0 2024-09-19T06:51:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.281+0000 7f4ec47ba740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc19fc70 con 0x5623d6764410 2024-09-19T06:51:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.281+0000 7f4ec47ba740 10 client.0 _ll_register_callbacks cb 0x7f4eac00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:51:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.282+0000 7f4ebb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d676ecb0 0x5623d6768fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.282+0000 7f4ebb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d676ecb0 0x5623d6768fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:50734/0 (socket says 172.21.15.12:50734) 2024-09-19T06:51:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.282+0000 7f4ebb7fe640 1 -- 172.21.15.12:0/2974891607 learned_addr learned my addr 172.21.15.12:0/2974891607 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:51:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.283+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d6763af0 0x5623d6788480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.283+0000 7f4ebaffd640 1 -- 172.21.15.12:0/2974891607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6764410 msgr2=0x5623d67689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.283+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6764410 0x5623d67689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.283+0000 7f4ebaffd640 1 -- 172.21.15.12:0/2974891607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d676ecb0 msgr2=0x5623d6768fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:51:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.283+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d676ecb0 0x5623d6768fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.284+0000 7f4ebaffd640 1 -- 172.21.15.12:0/2974891607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623d67697d0 con 0x5623d6763af0 2024-09-19T06:51:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.284+0000 7f4ebaffd640 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d6763af0 0x5623d6788480 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4eac09be30 tx=0x7f4eac0cd7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac365b8d98929d3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.287+0000 7f4e9affd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:51:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.287+0000 7f4e9affd640 1 -- 172.21.15.12:0/2974891607 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac0a0250 con 0x5623d6763af0 2024-09-19T06:51:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.287+0000 7f4e9affd640 1 -- 172.21.15.12:0/2974891607 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8687+0+0 (secure 0 0 0) 0x7f4eac097f10 con 0x5623d6763af0 2024-09-19T06:51:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.289+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2974891607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4eb00055e0 con 0x5623d6763af0 2024-09-19T06:51:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.294+0000 7f4e9affd640 1 -- 172.21.15.12:0/2974891607 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f4eac0a4890 con 0x5623d6763af0 2024-09-19T06:51:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.294+0000 7f4ec47ba740 10 client.18765 fetch_fsmap learned FSMap version 46 2024-09-19T06:51:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.294+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2974891607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5623d67697d0 con 0x5623d6763af0 2024-09-19T06:51:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.298+0000 7f4e9affd640 1 -- 172.21.15.12:0/2974891607 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4eb00055e0 con 0x5623d6763af0 2024-09-19T06:51:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.298+0000 7f4e9affd640 1 -- 172.21.15.12:0/2974891607 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f4eac010460 con 0x5623d6763af0 2024-09-19T06:51:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.300+0000 7f4ec47ba740 10 client.18765 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:51:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.300+0000 7f4ec47ba740 10 client.18765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:51:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.300+0000 7f4ec47ba740 20 client.18765 populate_metadata read hostname 'smithi012' 2024-09-19T06:51:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.300+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5623d67fb1d0 0x5623d67fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.300+0000 7f4ec47ba740 4 client.18765 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:51:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.300+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2974891607 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623d66cfd70 con 0x5623d67fb1d0 2024-09-19T06:51:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.310+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5623d67fb1d0 0x5623d67fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.319+0000 7f4eba7fc640 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5623d67fb1d0 0x5623d67fd5f0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74bb817fb179aefc server_cookie=4e77e202874ff34f in_seq=0 out_seq=0 2024-09-19T06:51:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.319+0000 7f4e9affd640 10 client.18765 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.348+0000 7f4e9affd640 1 -- 172.21.15.12:0/2974891607 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623d66cfd70 con 0x5623d67fb1d0 2024-09-19T06:51:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.348+0000 7f4e9affd640 10 client.18765 handle_command_reply: tid=0 2024-09-19T06:51:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.348+0000 7f4ec47ba740 1 client.18765 shutdown 2024-09-19T06:51:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.349+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2974891607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d6763af0 msgr2=0x5623d6788480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.349+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d6763af0 0x5623d6788480 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4eac09be30 tx=0x7f4eac0cd7c0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.350+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2974891607 shutdown_connections 2024-09-19T06:51:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.350+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5623d67fb1d0 0x5623d67fd5f0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.350+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5623d676ecb0 0x5623d6768fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.350+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5623d6764410 0x5623d67689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.350+0000 7f4ec47ba740 1 --2- 172.21.15.12:0/2974891607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5623d6763af0 0x5623d6788480 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.350+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2974891607 >> 172.21.15.12:0/2974891607 conn(0x5623d6760060 msgr2=0x5623d6765550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.350+0000 7f4e9affd640 0 client.18765 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:51:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.350+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2974891607 shutdown_connections 2024-09-19T06:51:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.350+0000 7f4ec47ba740 1 -- 172.21.15.12:0/2974891607 wait complete. 2024-09-19T06:51:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.350+0000 7f4ec47ba740 20 client.18765 trim_cache size 0 max 16384 2024-09-19T06:51:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:51:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:51:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:51:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.352+0000 7f4ec1a23640 1 -- 172.21.15.12:0/4216857471 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ea40a3560 msgr2=0x7f4ea40a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.352+0000 7f4ec1a23640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ea40a3560 0x7f4ea40a5a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4005fd0 tx=0x7f4eb4009500 comp rx=0 tx=0).stop 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.352+0000 7f4ec1a23640 1 -- 172.21.15.12:0/4216857471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ebc1009b0 msgr2=0x7f4ebc1a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.352+0000 7f4ec1a23640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ebc1009b0 0x7f4ebc1a4680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00d950 tx=0x7f4eac00de10 comp rx=0 tx=0).stop 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.352+0000 7f4ec1a23640 1 -- 172.21.15.12:0/4216857471 shutdown_connections 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.352+0000 7f4ec1a23640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ebc1069c0 0x7f4ebc19ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.352+0000 7f4ec1a23640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ebc101350 0x7f4ebc1a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.352+0000 7f4ec1a23640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ea40a3560 0x7f4ea40a5a20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.352+0000 7f4ec1a23640 1 --2- 172.21.15.12:0/4216857471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ebc1009b0 0x7f4ebc1a4680 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.352+0000 7f4ec1a23640 1 -- 172.21.15.12:0/4216857471 >> 172.21.15.12:0/4216857471 conn(0x7f4ebc077990 msgr2=0x7f4ebc103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.353+0000 7f4ec1a23640 1 -- 172.21.15.12:0/4216857471 shutdown_connections 2024-09-19T06:51:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:51:57.353+0000 7f4ec1a23640 1 -- 172.21.15.12:0/4216857471 wait complete. 2024-09-19T06:51:57.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:57 smithi016 ceph-mon[34911]: pgmap v367: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 31 MiB/s wr, 1.91k op/s 2024-09-19T06:51:57.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:57 smithi173 ceph-mon[35349]: pgmap v367: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 31 MiB/s wr, 1.91k op/s 2024-09-19T06:51:57.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:57 smithi012 ceph-mon[30937]: pgmap v367: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 31 MiB/s wr, 1.91k op/s 2024-09-19T06:51:59.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:51:59 smithi016 ceph-mon[34911]: pgmap v368: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 30 MiB/s wr, 1.74k op/s 2024-09-19T06:51:59.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:51:59 smithi173 ceph-mon[35349]: pgmap v368: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 30 MiB/s wr, 1.74k op/s 2024-09-19T06:51:59.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:51:59 smithi012 ceph-mon[30937]: pgmap v368: 97 pgs: 97 active+clean; 4.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 30 MiB/s wr, 1.74k op/s 2024-09-19T06:52:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 675.0 s, 2056.2 tps, lat 47.512 ms stddev 53.706 2024-09-19T06:52:01.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:01 smithi016 ceph-mon[34911]: pgmap v369: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 39 MiB/s wr, 2.09k op/s 2024-09-19T06:52:01.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:01 smithi173 ceph-mon[35349]: pgmap v369: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 39 MiB/s wr, 2.09k op/s 2024-09-19T06:52:01.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:01 smithi012 ceph-mon[30937]: pgmap v369: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 39 MiB/s wr, 2.09k op/s 2024-09-19T06:52:03.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:03 smithi016 ceph-mon[34911]: pgmap v370: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 660 op/s 2024-09-19T06:52:03.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:03 smithi173 ceph-mon[35349]: pgmap v370: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 660 op/s 2024-09-19T06:52:03.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:03 smithi012 ceph-mon[30937]: pgmap v370: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 14 MiB/s wr, 660 op/s 2024-09-19T06:52:04.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:04 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:52:04.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:04 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:52:04.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:04 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:52:04.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:04 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:52:04.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:04 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:52:04.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:04 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:52:04.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:04 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:52:04.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:04 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:52:04.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:04 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:52:04.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:04 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:52:04.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:04 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:52:04.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:04 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:52:04.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:04 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:52:04.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:04 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:52:04.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:04 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:52:05.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:05 smithi016 ceph-mon[34911]: pgmap v371: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 710 op/s 2024-09-19T06:52:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 680.0 s, 1818.0 tps, lat 55.868 ms stddev 125.339 2024-09-19T06:52:05.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:05 smithi173 ceph-mon[35349]: pgmap v371: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 710 op/s 2024-09-19T06:52:05.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:05 smithi012 ceph-mon[30937]: pgmap v371: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 710 op/s 2024-09-19T06:52:07.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:07 smithi016 ceph-mon[34911]: pgmap v372: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 30 MiB/s wr, 1.82k op/s 2024-09-19T06:52:07.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:07 smithi173 ceph-mon[35349]: pgmap v372: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 30 MiB/s wr, 1.82k op/s 2024-09-19T06:52:07.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:07 smithi012 ceph-mon[30937]: pgmap v372: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 30 MiB/s wr, 1.82k op/s 2024-09-19T06:52:09.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:09 smithi016 ceph-mon[34911]: pgmap v373: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 25 MiB/s wr, 1.52k op/s 2024-09-19T06:52:09.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:09 smithi016 ceph-mon[34911]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T06:52:09.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:09 smithi173 ceph-mon[35349]: pgmap v373: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 25 MiB/s wr, 1.52k op/s 2024-09-19T06:52:09.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:09 smithi173 ceph-mon[35349]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T06:52:09.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:09 smithi012 ceph-mon[30937]: pgmap v373: 97 pgs: 97 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 25 MiB/s wr, 1.52k op/s 2024-09-19T06:52:09.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:09 smithi012 ceph-mon[30937]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T06:52:10.483 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.482+0000 7fda0cd52640 1 -- 172.21.15.12:0/2423682395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda081009b0 msgr2=0x7fda08100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.482+0000 7fda0cd52640 1 --2- 172.21.15.12:0/2423682395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda081009b0 0x7fda08100e10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009900 tx=0x7fd9f802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.482+0000 7fda0cd52640 1 -- 172.21.15.12:0/2423682395 shutdown_connections 2024-09-19T06:52:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.482+0000 7fda0cd52640 1 --2- 172.21.15.12:0/2423682395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda08101350 0x7fda0810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.482+0000 7fda0cd52640 1 --2- 172.21.15.12:0/2423682395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda081009b0 0x7fda08100e10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.482+0000 7fda0cd52640 1 --2- 172.21.15.12:0/2423682395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda081069c0 0x7fda08106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.482+0000 7fda0cd52640 1 -- 172.21.15.12:0/2423682395 >> 172.21.15.12:0/2423682395 conn(0x7fda08077990 msgr2=0x7fda080fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.482+0000 7fda0cd52640 1 -- 172.21.15.12:0/2423682395 shutdown_connections 2024-09-19T06:52:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.482+0000 7fda0cd52640 1 -- 172.21.15.12:0/2423682395 wait complete. 2024-09-19T06:52:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.483+0000 7fda0cd52640 1 Processor -- start 2024-09-19T06:52:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.483+0000 7fda0cd52640 1 -- start start 2024-09-19T06:52:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.483+0000 7fda0cd52640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda081009b0 0x7fda081a3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.483+0000 7fda0cd52640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda08101350 0x7fda081a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda0cd52640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda081069c0 0x7fda0810c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.486 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda0cd52640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fda08111ed0 con 0x7fda08101350 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda0cd52640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fda08111d50 con 0x7fda081069c0 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda0cd52640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fda08112050 con 0x7fda081009b0 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda05d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda08101350 0x7fda081a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda06d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda081069c0 0x7fda0810c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda05d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda08101350 0x7fda081a3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56936/0 (socket says 172.21.15.12:56936) 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda0659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda081009b0 0x7fda081a3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda05d9b640 1 -- 172.21.15.12:0/4202950508 learned_addr learned my addr 172.21.15.12:0/4202950508 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda06d9d640 1 -- 172.21.15.12:0/4202950508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda081009b0 msgr2=0x7fda081a3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda06d9d640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda081009b0 0x7fda081a3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda06d9d640 1 -- 172.21.15.12:0/4202950508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda08101350 msgr2=0x7fda081a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda06d9d640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda08101350 0x7fda081a3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.487 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda06d9d640 1 -- 172.21.15.12:0/4202950508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0810d060 con 0x7fda081069c0 2024-09-19T06:52:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.484+0000 7fda06d9d640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda081069c0 0x7fda0810c910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fda00009fd0 tx=0x7fda0000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.485+0000 7fd9f77fe640 1 -- 172.21.15.12:0/4202950508 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0000ce20 con 0x7fda081069c0 2024-09-19T06:52:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.485+0000 7fd9f77fe640 1 -- 172.21.15.12:0/4202950508 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda00005020 con 0x7fda081069c0 2024-09-19T06:52:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.485+0000 7fd9f77fe640 1 -- 172.21.15.12:0/4202950508 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00010720 con 0x7fda081069c0 2024-09-19T06:52:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.485+0000 7fda0cd52640 1 -- 172.21.15.12:0/4202950508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0810d350 con 0x7fda081069c0 2024-09-19T06:52:10.488 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.485+0000 7fda0cd52640 1 -- 172.21.15.12:0/4202950508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda081ab440 con 0x7fda081069c0 2024-09-19T06:52:10.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.489+0000 7fd9f77fe640 1 -- 172.21.15.12:0/4202950508 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fda00005540 con 0x7fda081069c0 2024-09-19T06:52:10.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.489+0000 7fda0fbbf740 1 Processor -- start 2024-09-19T06:52:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.490+0000 7fd9f77fe640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9f00a34e0 0x7fd9f00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.490+0000 7fd9f77fe640 1 -- 172.21.15.12:0/4202950508 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8731+0+0 (secure 0 0 0) 0x7fda000d0470 con 0x7fda081069c0 2024-09-19T06:52:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.490+0000 7fda05d9b640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9f00a34e0 0x7fd9f00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.490+0000 7fda0fbbf740 1 -- start start 2024-09-19T06:52:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77caf0 0x55b4ad77ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77d410 0x55b4ad787770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad787cb0 0x55b4ad78a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b4ad6e12f0 con 0x55b4ad77caf0 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b4ad689270 con 0x55b4ad77d410 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b4ad6dd2b0 con 0x55b4ad787cb0 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda05d9b640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9f00a34e0 0x7fd9f00a59a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fda0810dc10 tx=0x7fd9f8005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda05d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77d410 0x55b4ad787770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77caf0 0x55b4ad77ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77caf0 0x55b4ad77ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56938/0 (socket says 172.21.15.12:56938) 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda05d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77d410 0x55b4ad787770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37136/0 (socket says 172.21.15.12:37136) 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0659c640 1 -- 172.21.15.12:0/1060598323 learned_addr learned my addr 172.21.15.12:0/1060598323 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda06d9d640 1 --2- 172.21.15.12:0/1060598323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad787cb0 0x55b4ad78a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0659c640 1 -- 172.21.15.12:0/1060598323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad787cb0 msgr2=0x55b4ad78a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0659c640 1 --2- 172.21.15.12:0/1060598323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad787cb0 0x55b4ad78a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0659c640 1 -- 172.21.15.12:0/1060598323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77d410 msgr2=0x55b4ad787770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0659c640 1 --2- 172.21.15.12:0/1060598323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77d410 0x55b4ad787770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda0659c640 1 -- 172.21.15.12:0/1060598323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4ad688340 con 0x55b4ad77caf0 2024-09-19T06:52:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.491+0000 7fda05d9b640 1 --2- 172.21.15.12:0/1060598323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77d410 0x55b4ad787770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.492+0000 7fda0659c640 1 --2- 172.21.15.12:0/1060598323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77caf0 0x55b4ad77ced0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00bc90 tx=0x7fd9fc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c2d0a53b15bac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.492+0000 7fd9f4ff9640 1 -- 172.21.15.12:0/1060598323 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc01c480 con 0x55b4ad77caf0 2024-09-19T06:52:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.492+0000 7fd9f4ff9640 1 -- 172.21.15.12:0/1060598323 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc01cb00 con 0x55b4ad77caf0 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.493+0000 7fda0fbbf740 1 -- 172.21.15.12:0/1060598323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77caf0 msgr2=0x55b4ad77ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.493+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/1060598323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77caf0 0x55b4ad77ced0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00bc90 tx=0x7fd9fc0107a0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.494+0000 7fda0fbbf740 1 -- 172.21.15.12:0/1060598323 shutdown_connections 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.494+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/1060598323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad787cb0 0x55b4ad78a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.494+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/1060598323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77d410 0x55b4ad787770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.494+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/1060598323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77caf0 0x55b4ad77ced0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.494+0000 7fda0fbbf740 1 -- 172.21.15.12:0/1060598323 >> 172.21.15.12:0/1060598323 conn(0x55b4ad779060 msgr2=0x55b4ad779440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.494+0000 7fda0fbbf740 1 -- 172.21.15.12:0/1060598323 shutdown_connections 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.494+0000 7fda0fbbf740 1 -- 172.21.15.12:0/1060598323 wait complete. 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.494+0000 7fda0fbbf740 1 -- start start 2024-09-19T06:52:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda0fbbf740 1 Processor -- start 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77caf0 0x55b4ad784b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77d410 0x55b4ad7850d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad787cb0 0x55b4ad785610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b4ad78a920 con 0x55b4ad77d410 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b4ad66a290 con 0x55b4ad787cb0 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b4ad78aaa0 con 0x55b4ad77caf0 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda0659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77caf0 0x55b4ad784b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda06d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad787cb0 0x55b4ad785610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda06d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad787cb0 0x55b4ad785610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:37150/0 (socket says 172.21.15.12:37150) 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda06d9d640 1 -- 172.21.15.12:0/2340645971 learned_addr learned my addr 172.21.15.12:0/2340645971 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda0659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77caf0 0x55b4ad784b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:52186/0 (socket says 172.21.15.12:52186) 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda05d9b640 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77d410 0x55b4ad7850d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.495+0000 7fda0fbbf740 10 client.0 _ll_register_callbacks cb 0x55b4ad69b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fda06d9d640 1 -- 172.21.15.12:0/2340645971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77caf0 msgr2=0x55b4ad784b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fda06d9d640 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77caf0 0x55b4ad784b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fda06d9d640 1 -- 172.21.15.12:0/2340645971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77d410 msgr2=0x55b4ad7850d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fda06d9d640 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77d410 0x55b4ad7850d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fda06d9d640 1 -- 172.21.15.12:0/2340645971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4ad3f4210 con 0x55b4ad787cb0 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fda06d9d640 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad787cb0 0x55b4ad785610 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fda000ce0f0 tx=0x7fda0009cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52bfca0e8fd72f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fd9edffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fd9edffb640 1 -- 172.21.15.12:0/2340645971 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda000b4070 con 0x55b4ad787cb0 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fd9edffb640 1 -- 172.21.15.12:0/2340645971 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8731+0+0 (secure 0 0 0) 0x7fda000a4e60 con 0x55b4ad787cb0 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fda0fbbf740 1 -- 172.21.15.12:0/2340645971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4ad6eea20 con 0x55b4ad787cb0 2024-09-19T06:52:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fd9edffb640 1 -- 172.21.15.12:0/2340645971 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fda000a52f0 con 0x55b4ad787cb0 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fda0fbbf740 10 client.28115 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fda0fbbf740 1 -- 172.21.15.12:0/2340645971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b4ad4c0620 con 0x55b4ad787cb0 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.496+0000 7fd9edffb640 1 -- 172.21.15.12:0/2340645971 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b4ad6eea20 con 0x55b4ad787cb0 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.497+0000 7fd9edffb640 1 -- 172.21.15.12:0/2340645971 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7fda0009bad0 con 0x55b4ad787cb0 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.497+0000 7fda0fbbf740 10 client.28115 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.497+0000 7fda0fbbf740 10 client.28115 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.497+0000 7fda0fbbf740 20 client.28115 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.497+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4ad797da0 0x55b4ad79a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.497+0000 7fda0fbbf740 4 client.28115 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.497+0000 7fda0fbbf740 1 -- 172.21.15.12:0/2340645971 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4ad6e8d70 con 0x55b4ad797da0 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.497+0000 7fda0659c640 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4ad797da0 0x55b4ad79a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.497+0000 7fd9edffb640 10 client.28115 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.497+0000 7fda0659c640 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4ad797da0 0x55b4ad79a1d0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b8d49bba39396cb server_cookie=bfb9eaf38efb987 in_seq=0 out_seq=0 2024-09-19T06:52:10.503 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.499+0000 7fd9edffb640 1 -- 172.21.15.12:0/2340645971 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4ad6e8d70 con 0x55b4ad797da0 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.499+0000 7fd9edffb640 10 client.28115 handle_command_reply: tid=0 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.499+0000 7fda0fbbf740 1 client.28115 shutdown 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.499+0000 7fda0fbbf740 1 -- 172.21.15.12:0/2340645971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad787cb0 msgr2=0x55b4ad785610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.499+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad787cb0 0x55b4ad785610 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fda000ce0f0 tx=0x7fda0009cd80 comp rx=0 tx=0).stop 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.500+0000 7fda0fbbf740 1 -- 172.21.15.12:0/2340645971 shutdown_connections 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.500+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4ad797da0 0x55b4ad79a1d0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.500+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad787cb0 0x55b4ad785610 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.500+0000 7fd9edffb640 0 client.28115 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.500+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad77d410 0x55b4ad7850d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.500+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/2340645971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77caf0 0x55b4ad784b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.500+0000 7fda0fbbf740 1 -- 172.21.15.12:0/2340645971 >> 172.21.15.12:0/2340645971 conn(0x55b4ad779060 msgr2=0x55b4ad77edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.500+0000 7fda0fbbf740 1 -- 172.21.15.12:0/2340645971 shutdown_connections 2024-09-19T06:52:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.500+0000 7fda0fbbf740 1 -- 172.21.15.12:0/2340645971 wait complete. 2024-09-19T06:52:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.500+0000 7fda0fbbf740 20 client.28115 trim_cache size 0 max 16384 2024-09-19T06:52:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.530+0000 7fda0fbbf740 1 Processor -- start 2024-09-19T06:52:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.530+0000 7fda0fbbf740 1 -- start start 2024-09-19T06:52:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.531+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 0x55b4ad785410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.531+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad79fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.531+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad787cb0 0x55b4ad79ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.531+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b4170 con 0x55b4ad787cb0 2024-09-19T06:52:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.531+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b5d40 con 0x55b4ad77caf0 2024-09-19T06:52:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.531+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b4840 con 0x55b4ad77d410 2024-09-19T06:52:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.531+0000 7fda0659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 0x55b4ad785410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.531+0000 7fda05d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad79fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.531+0000 7fda05d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad79fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:52198/0 (socket says 172.21.15.12:52198) 2024-09-19T06:52:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.531+0000 7fda05d9b640 1 -- 172.21.15.12:0/1611263114 learned_addr learned my addr 172.21.15.12:0/1611263114 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.532+0000 7fda0659c640 1 -- 172.21.15.12:0/1611263114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 msgr2=0x55b4ad79fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.532+0000 7fda0659c640 1 --2- 172.21.15.12:0/1611263114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad79fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.532+0000 7fda0659c640 1 -- 172.21.15.12:0/1611263114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad787cb0 msgr2=0x55b4ad79ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.532+0000 7fda0659c640 1 --2- 172.21.15.12:0/1611263114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad787cb0 0x55b4ad79ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.532+0000 7fda0659c640 1 -- 172.21.15.12:0/1611263114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4ad778e90 con 0x55b4ad77caf0 2024-09-19T06:52:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.532+0000 7fda0659c640 1 --2- 172.21.15.12:0/1611263114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 0x55b4ad785410 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc010ca0 tx=0x7fd9fc0059b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9471bc211c5697 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.534+0000 7fd9effff640 1 -- 172.21.15.12:0/1611263114 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc011440 con 0x55b4ad77caf0 2024-09-19T06:52:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.534+0000 7fd9effff640 1 -- 172.21.15.12:0/1611263114 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc0055a0 con 0x55b4ad77caf0 2024-09-19T06:52:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.535+0000 7fda0fbbf740 1 -- 172.21.15.12:0/1611263114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 msgr2=0x55b4ad785410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.535+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/1611263114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 0x55b4ad785410 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc010ca0 tx=0x7fd9fc0059b0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.537+0000 7fda0fbbf740 1 -- 172.21.15.12:0/1611263114 shutdown_connections 2024-09-19T06:52:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.537+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/1611263114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad787cb0 0x55b4ad79ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.537+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/1611263114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad79fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.537+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/1611263114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 0x55b4ad785410 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.537+0000 7fda0fbbf740 1 -- 172.21.15.12:0/1611263114 >> 172.21.15.12:0/1611263114 conn(0x55b4ad779060 msgr2=0x55b4ad786c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.537+0000 7fda0fbbf740 1 -- 172.21.15.12:0/1611263114 shutdown_connections 2024-09-19T06:52:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.537+0000 7fda0fbbf740 1 -- 172.21.15.12:0/1611263114 wait complete. 2024-09-19T06:52:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.537+0000 7fda0fbbf740 1 -- start start 2024-09-19T06:52:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda0fbbf740 1 Processor -- start 2024-09-19T06:52:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 0x55b4ad78ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad78bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda0fbbf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad787cb0 0x55b4ad78c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b5670 con 0x55b4ad787cb0 2024-09-19T06:52:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b4fa0 con 0x55b4ad77caf0 2024-09-19T06:52:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda0fbbf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b2170 con 0x55b4ad77d410 2024-09-19T06:52:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda0fbbf740 10 client.0 _ll_register_callbacks cb 0x7fda0009c540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda06d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad787cb0 0x55b4ad78c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda05d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad78bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda05d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad78bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:52200/0 (socket says 172.21.15.12:52200) 2024-09-19T06:52:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda05d9b640 1 -- 172.21.15.12:0/4045283484 learned_addr learned my addr 172.21.15.12:0/4045283484 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.538+0000 7fda0659c640 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 0x55b4ad78ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.539+0000 7fda05d9b640 1 -- 172.21.15.12:0/4045283484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 msgr2=0x55b4ad78ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.539+0000 7fda05d9b640 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 0x55b4ad78ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.539+0000 7fda05d9b640 1 -- 172.21.15.12:0/4045283484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad787cb0 msgr2=0x55b4ad78c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.539+0000 7fda05d9b640 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad787cb0 0x55b4ad78c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.539+0000 7fda05d9b640 1 -- 172.21.15.12:0/4045283484 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4ad77f940 con 0x55b4ad77d410 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.539+0000 7fda05d9b640 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad78bf60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009230 tx=0x7fd9f8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b4fe6d6483ae85c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.540+0000 7fd9edffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.540+0000 7fd9edffb640 1 -- 172.21.15.12:0/4045283484 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8035040 con 0x55b4ad77d410 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.540+0000 7fda0fbbf740 1 -- 172.21.15.12:0/4045283484 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9fc0055a0 con 0x55b4ad77d410 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.540+0000 7fd9edffb640 1 -- 172.21.15.12:0/4045283484 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8731+0+0 (secure 0 0 0) 0x7fd9f80053d0 con 0x55b4ad77d410 2024-09-19T06:52:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.540+0000 7fd9edffb640 1 -- 172.21.15.12:0/4045283484 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fd9f80055d0 con 0x55b4ad77d410 2024-09-19T06:52:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.542+0000 7fda0fbbf740 10 client.28063 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.542+0000 7fda0fbbf740 1 -- 172.21.15.12:0/4045283484 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b4ad813ae0 con 0x55b4ad77d410 2024-09-19T06:52:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.544+0000 7fd9edffb640 1 -- 172.21.15.12:0/4045283484 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc0055a0 con 0x55b4ad77d410 2024-09-19T06:52:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.546+0000 7fd9edffb640 1 -- 172.21.15.12:0/4045283484 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7fd9f8003a40 con 0x55b4ad77d410 2024-09-19T06:52:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.546+0000 7fda0fbbf740 10 client.28063 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.546+0000 7fda0fbbf740 10 client.28063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.546+0000 7fda0fbbf740 20 client.28063 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.546+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4ad814260 0x55b4ad816680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.546+0000 7fda0fbbf740 4 client.28063 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:52:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.546+0000 7fda0fbbf740 1 -- 172.21.15.12:0/4045283484 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b4ad665900 con 0x55b4ad814260 2024-09-19T06:52:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.546+0000 7fda0659c640 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4ad814260 0x55b4ad816680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.546+0000 7fd9edffb640 10 client.28063 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.546+0000 7fda0659c640 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4ad814260 0x55b4ad816680 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=255ee1175a9c7f47 server_cookie=ff69d5aafcf21c8e in_seq=0 out_seq=0 2024-09-19T06:52:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.558+0000 7fd9edffb640 1 -- 172.21.15.12:0/4045283484 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b4ad665900 con 0x55b4ad814260 2024-09-19T06:52:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.558+0000 7fd9edffb640 10 client.28063 handle_command_reply: tid=0 2024-09-19T06:52:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.558+0000 7fda0fbbf740 1 client.28063 shutdown 2024-09-19T06:52:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.559+0000 7fda0fbbf740 1 -- 172.21.15.12:0/4045283484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 msgr2=0x55b4ad78bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.559+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad78bf60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009230 tx=0x7fd9f8009260 comp rx=0 tx=0).stop 2024-09-19T06:52:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.560+0000 7fda0fbbf740 1 -- 172.21.15.12:0/4045283484 shutdown_connections 2024-09-19T06:52:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.560+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b4ad814260 0x55b4ad816680 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.560+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4ad787cb0 0x55b4ad78c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.560+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4ad77d410 0x55b4ad78bf60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.560+0000 7fd9edffb640 0 client.28063 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.560+0000 7fda0fbbf740 1 --2- 172.21.15.12:0/4045283484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4ad77caf0 0x55b4ad78ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.560+0000 7fda0fbbf740 1 -- 172.21.15.12:0/4045283484 >> 172.21.15.12:0/4045283484 conn(0x55b4ad779060 msgr2=0x55b4ad7779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.560+0000 7fda0fbbf740 1 -- 172.21.15.12:0/4045283484 shutdown_connections 2024-09-19T06:52:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.560+0000 7fda0fbbf740 1 -- 172.21.15.12:0/4045283484 wait complete. 2024-09-19T06:52:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0fbbf740 20 client.28063 trim_cache size 0 max 16384 2024-09-19T06:52:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:52:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:52:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:52:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:52:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 -- 172.21.15.12:0/4202950508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9f00a34e0 msgr2=0x7fd9f00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9f00a34e0 0x7fd9f00a59a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fda0810dc10 tx=0x7fd9f8005a20 comp rx=0 tx=0).stop 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 -- 172.21.15.12:0/4202950508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda081069c0 msgr2=0x7fda0810c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda081069c0 0x7fda0810c910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fda00009fd0 tx=0x7fda0000ef10 comp rx=0 tx=0).stop 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 -- 172.21.15.12:0/4202950508 shutdown_connections 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda081069c0 0x7fda0810c910 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda08101350 0x7fda081a3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd9f00a34e0 0x7fd9f00a59a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 --2- 172.21.15.12:0/4202950508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda081009b0 0x7fda081a3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 -- 172.21.15.12:0/4202950508 >> 172.21.15.12:0/4202950508 conn(0x7fda08077990 msgr2=0x7fda08103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 -- 172.21.15.12:0/4202950508 shutdown_connections 2024-09-19T06:52:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:10.561+0000 7fda0cd52640 1 -- 172.21.15.12:0/4202950508 wait complete. 2024-09-19T06:52:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 685.0 s, 2268.8 tps, lat 44.275 ms stddev 58.260 2024-09-19T06:52:11.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:11 smithi016 ceph-mon[34911]: pgmap v375: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 1.93k op/s 2024-09-19T06:52:11.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:11 smithi173 ceph-mon[35349]: pgmap v375: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 1.93k op/s 2024-09-19T06:52:11.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:11 smithi012 ceph-mon[30937]: pgmap v375: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 1.93k op/s 2024-09-19T06:52:13.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:13 smithi016 ceph-mon[34911]: pgmap v376: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 1.93k op/s 2024-09-19T06:52:13.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:13 smithi173 ceph-mon[35349]: pgmap v376: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 1.93k op/s 2024-09-19T06:52:13.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:13 smithi012 ceph-mon[30937]: pgmap v376: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 1.93k op/s 2024-09-19T06:52:15.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 690.0 s, 2597.0 tps, lat 38.766 ms stddev 48.369 2024-09-19T06:52:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:15 smithi016 ceph-mon[34911]: pgmap v377: 97 pgs: 97 active+clean; 3.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 29 MiB/s wr, 1.89k op/s 2024-09-19T06:52:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:15 smithi016 ceph-mon[34911]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T06:52:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:15 smithi173 ceph-mon[35349]: pgmap v377: 97 pgs: 97 active+clean; 3.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 29 MiB/s wr, 1.89k op/s 2024-09-19T06:52:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:15 smithi173 ceph-mon[35349]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T06:52:16.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:15 smithi012 ceph-mon[30937]: pgmap v377: 97 pgs: 97 active+clean; 3.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 29 MiB/s wr, 1.89k op/s 2024-09-19T06:52:16.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:15 smithi012 ceph-mon[30937]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T06:52:18.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:17 smithi016 ceph-mon[34911]: pgmap v379: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 1.07k op/s 2024-09-19T06:52:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:17 smithi173 ceph-mon[35349]: pgmap v379: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 1.07k op/s 2024-09-19T06:52:18.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:17 smithi012 ceph-mon[30937]: pgmap v379: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 1.07k op/s 2024-09-19T06:52:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:19 smithi016 ceph-mon[34911]: pgmap v380: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 MiB/s wr, 872 op/s 2024-09-19T06:52:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:19 smithi173 ceph-mon[35349]: pgmap v380: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 MiB/s wr, 872 op/s 2024-09-19T06:52:20.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:19 smithi012 ceph-mon[30937]: pgmap v380: 97 pgs: 97 active+clean; 4.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 18 MiB/s wr, 872 op/s 2024-09-19T06:52:20.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 695.0 s, 2516.4 tps, lat 39.431 ms stddev 44.884 2024-09-19T06:52:22.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:52:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:21 smithi016 ceph-mon[34911]: pgmap v381: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 697 op/s 2024-09-19T06:52:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:21 smithi173 ceph-mon[35349]: pgmap v381: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 697 op/s 2024-09-19T06:52:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:21 smithi012 ceph-mon[30937]: pgmap v381: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 697 op/s 2024-09-19T06:52:22.625 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.230+0000 7f2dc96b1640 1 -- 172.21.15.12:0/2795348102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc41027a0 msgr2=0x7f2dc41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.230+0000 7f2dc96b1640 1 --2- 172.21.15.12:0/2795348102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc41027a0 0x7f2dc41067f0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009900 tx=0x7f2db802a410 comp rx=0 tx=0).stop 2024-09-19T06:52:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.230+0000 7f2dc96b1640 1 -- 172.21.15.12:0/2795348102 shutdown_connections 2024-09-19T06:52:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.230+0000 7f2dc96b1640 1 --2- 172.21.15.12:0/2795348102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dc4106f20 0x7f2dc410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.230+0000 7f2dc96b1640 1 --2- 172.21.15.12:0/2795348102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc41027a0 0x7f2dc41067f0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.230+0000 7f2dc96b1640 1 --2- 172.21.15.12:0/2795348102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc4101df0 0x7f2dc41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.230+0000 7f2dc96b1640 1 -- 172.21.15.12:0/2795348102 >> 172.21.15.12:0/2795348102 conn(0x7f2dc40fd8f0 msgr2=0x7f2dc40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.230+0000 7f2dc96b1640 1 -- 172.21.15.12:0/2795348102 shutdown_connections 2024-09-19T06:52:23.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.230+0000 7f2dc96b1640 1 -- 172.21.15.12:0/2795348102 wait complete. 2024-09-19T06:52:23.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.231+0000 7f2dc96b1640 1 Processor -- start 2024-09-19T06:52:23.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.231+0000 7f2dc96b1640 1 -- start start 2024-09-19T06:52:23.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.231+0000 7f2dc96b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc4101df0 0x7f2dc4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.231+0000 7f2dc96b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc41027a0 0x7f2dc4198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc96b1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dc4106f20 0x7f2dc419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc41027a0 0x7f2dc4198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc41027a0 0x7f2dc4198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:53312/0 (socket says 172.21.15.12:53312) 2024-09-19T06:52:23.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc27fc640 1 -- 172.21.15.12:0/3956429703 learned_addr learned my addr 172.21.15.12:0/3956429703 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:23.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc4111ff0 con 0x7f2dc4101df0 2024-09-19T06:52:23.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc4111e70 con 0x7f2dc41027a0 2024-09-19T06:52:23.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc4112170 con 0x7f2dc4106f20 2024-09-19T06:52:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc37fe640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dc4106f20 0x7f2dc419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc4101df0 0x7f2dc4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc37fe640 1 -- 172.21.15.12:0/3956429703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc41027a0 msgr2=0x7f2dc4198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc37fe640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc41027a0 0x7f2dc4198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc37fe640 1 -- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc4101df0 msgr2=0x7f2dc4198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc37fe640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc4101df0 0x7f2dc4198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc37fe640 1 -- 172.21.15.12:0/3956429703 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc419d540 con 0x7f2dc4106f20 2024-09-19T06:52:23.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.232+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc4101df0 0x7f2dc4198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:23.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.233+0000 7f2dc37fe640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dc4106f20 0x7f2dc419ce60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00be20 tx=0x7f2dbc00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.233+0000 7f2dabfff640 1 -- 172.21.15.12:0/3956429703 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc019070 con 0x7f2dc4106f20 2024-09-19T06:52:23.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.233+0000 7f2dabfff640 1 -- 172.21.15.12:0/3956429703 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dbc014920 con 0x7f2dc4106f20 2024-09-19T06:52:23.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.233+0000 7f2dabfff640 1 -- 172.21.15.12:0/3956429703 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc012920 con 0x7f2dc4106f20 2024-09-19T06:52:23.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.233+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc419d830 con 0x7f2dc4106f20 2024-09-19T06:52:23.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.233+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc41a5110 con 0x7f2dc4106f20 2024-09-19T06:52:23.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.237+0000 7f2dcba8a740 1 Processor -- start 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.237+0000 7f2dabfff640 1 -- 172.21.15.12:0/3956429703 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2dbc01c070 con 0x7f2dc4106f20 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dcba8a740 1 -- start start 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a06ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 0x564563a01030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a016a0 0x564563a01b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dcba8a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56456395d2e0 con 0x564563a066e0 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dcba8a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564563904ce0 con 0x564563a016a0 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dcba8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5645639592a0 con 0x564563a07000 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dc27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a06ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dc27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a06ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55524/0 (socket says 172.21.15.12:55524) 2024-09-19T06:52:23.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dc27fc640 1 -- 172.21.15.12:0/3236461048 learned_addr learned my addr 172.21.15.12:0/3236461048 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.238+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3236461048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 0x564563a01030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dabfff640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2dac0a33b0 0x7f2dac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/3236461048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a016a0 0x564563a01b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3236461048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a016a0 msgr2=0x564563a01b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3236461048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a016a0 0x564563a01b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3236461048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 msgr2=0x564563a06ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3236461048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a06ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3236461048 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645638e9440 con 0x564563a07000 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/3236461048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a06ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dabfff640 1 -- 172.21.15.12:0/3956429703 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f2dbc0cf4d0 con 0x7f2dc4106f20 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dc37fe640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2dac0a33b0 0x7f2dac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3236461048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 0x564563a01030 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2db4005fd0 tx=0x7f2db400bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c41441710b8211e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2da97fa640 1 -- 172.21.15.12:0/3236461048 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4011700 con 0x564563a07000 2024-09-19T06:52:23.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2da97fa640 1 -- 172.21.15.12:0/3236461048 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2db4011d80 con 0x564563a07000 2024-09-19T06:52:23.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.239+0000 7f2da97fa640 1 -- 172.21.15.12:0/3236461048 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db401a5c0 con 0x564563a07000 2024-09-19T06:52:23.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.240+0000 7f2dc37fe640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2dac0a33b0 0x7f2dac0a5870 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00bdf0 tx=0x7f2dbc004b50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.240+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3236461048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 msgr2=0x564563a01030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.240+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3236461048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 0x564563a01030 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2db4005fd0 tx=0x7f2db400bf90 comp rx=0 tx=0).stop 2024-09-19T06:52:23.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.240+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3236461048 shutdown_connections 2024-09-19T06:52:23.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.240+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3236461048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a016a0 0x564563a01b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.240+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3236461048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 0x564563a01030 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.240+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3236461048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a06ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.240+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3236461048 >> 172.21.15.12:0/3236461048 conn(0x5645639f34e0 msgr2=0x5645639f38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.240+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3236461048 shutdown_connections 2024-09-19T06:52:23.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.240+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3236461048 wait complete. 2024-09-19T06:52:23.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.241+0000 7f2dcba8a740 1 -- start start 2024-09-19T06:52:23.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.242+0000 7f2dcba8a740 1 Processor -- start 2024-09-19T06:52:23.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.242+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a016a0 0x564563a0cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.243+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a0a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.243+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a07000 0x564563a0a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.243+0000 7f2dcba8a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564563a0da20 con 0x564563a07000 2024-09-19T06:52:23.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.243+0000 7f2dcba8a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564563918050 con 0x564563a066e0 2024-09-19T06:52:23.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.243+0000 7f2dcba8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564563a0dba0 con 0x564563a016a0 2024-09-19T06:52:23.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.243+0000 7f2dcba8a740 10 client.0 _ll_register_callbacks cb 0x564563958160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:23.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.243+0000 7f2dc2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a0a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.243+0000 7f2dc2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a0a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:53338/0 (socket says 172.21.15.12:53338) 2024-09-19T06:52:23.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.243+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3596207025 learned_addr learned my addr 172.21.15.12:0/3596207025 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:23.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.244+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3596207025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a016a0 msgr2=0x564563a0cf30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:52:23.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.244+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a016a0 0x564563a0cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.244+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3596207025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a07000 msgr2=0x564563a0a780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:52:23.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.244+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a07000 0x564563a0a780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.244+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3596207025 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645636ce3c0 con 0x564563a066e0 2024-09-19T06:52:23.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.251+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a0a1e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2db4005d00 tx=0x7f2db401c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15d4d81fba1f314c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.251+0000 7f2da6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:52:23.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.258+0000 7f2da6ff5640 1 -- 172.21.15.12:0/3596207025 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db403c060 con 0x564563a066e0 2024-09-19T06:52:23.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.258+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3596207025 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2db4011d80 con 0x564563a066e0 2024-09-19T06:52:23.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.258+0000 7f2da6ff5640 1 -- 172.21.15.12:0/3596207025 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f2db4011700 con 0x564563a066e0 2024-09-19T06:52:23.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.258+0000 7f2da6ff5640 1 -- 172.21.15.12:0/3596207025 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f2db4011900 con 0x564563a066e0 2024-09-19T06:52:23.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.258+0000 7f2dcba8a740 10 client.28133 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:23.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.258+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3596207025 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5645639f7810 con 0x564563a066e0 2024-09-19T06:52:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.259+0000 7f2da6ff5640 1 -- 172.21.15.12:0/3596207025 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2db4011aa0 con 0x564563a066e0 2024-09-19T06:52:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.259+0000 7f2da6ff5640 1 -- 172.21.15.12:0/3596207025 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f2db401a380 con 0x564563a066e0 2024-09-19T06:52:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.259+0000 7f2dcba8a740 10 client.28133 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.259+0000 7f2dcba8a740 10 client.28133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.259+0000 7f2dcba8a740 20 client.28133 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.260+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5645639f8f60 0x5645639fb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.260+0000 7f2dcba8a740 4 client.28133 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.260+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3596207025 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2db4011d80 con 0x5645639f8f60 2024-09-19T06:52:23.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.269+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5645639f8f60 0x5645639fb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.275+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5645639f8f60 0x5645639fb380 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cab2354fc8e6d48 server_cookie=ac5b9d5333ffb0fa in_seq=0 out_seq=0 2024-09-19T06:52:23.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.275+0000 7f2da6ff5640 10 client.28133 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2da6ff5640 1 -- 172.21.15.12:0/3596207025 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2db4011d80 con 0x5645639f8f60 2024-09-19T06:52:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2da6ff5640 10 client.28133 handle_command_reply: tid=0 2024-09-19T06:52:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2dcba8a740 1 client.28133 shutdown 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3596207025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 msgr2=0x564563a0a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a0a1e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2db4005d00 tx=0x7f2db401c730 comp rx=0 tx=0).stop 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3596207025 shutdown_connections 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5645639f8f60 0x5645639fb380 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a07000 0x564563a0a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a0a1e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3596207025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a016a0 0x564563a0cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2da6ff5640 0 client.28133 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.276+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3596207025 >> 172.21.15.12:0/3596207025 conn(0x5645639f34e0 msgr2=0x5645639f2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.277+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3596207025 shutdown_connections 2024-09-19T06:52:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.277+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3596207025 wait complete. 2024-09-19T06:52:23.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.277+0000 7f2dcba8a740 20 client.28133 trim_cache size 0 max 16384 2024-09-19T06:52:23.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.298+0000 7f2dcba8a740 1 Processor -- start 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.298+0000 7f2dcba8a740 1 -- start start 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a016a0 0x564563a05bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a07af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a07000 0x564563a00c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dcba8a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41abb00 con 0x564563a066e0 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dcba8a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41ad6d0 con 0x564563a07000 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dcba8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41ac1d0 con 0x564563a016a0 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dc27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a07000 0x564563a00c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dc2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a07af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dc2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a07af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55540/0 (socket says 172.21.15.12:55540) 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dc27fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a07000 0x564563a00c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:53342/0 (socket says 172.21.15.12:53342) 2024-09-19T06:52:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3303583501 learned_addr learned my addr 172.21.15.12:0/3303583501 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:23.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.299+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/3303583501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a016a0 0x564563a05bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.300+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3303583501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a016a0 msgr2=0x564563a05bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.300+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3303583501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a016a0 0x564563a05bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.300+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3303583501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a07000 msgr2=0x564563a00c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.300+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3303583501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a07000 0x564563a00c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.300+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/3303583501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564563a08750 con 0x564563a066e0 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.300+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/3303583501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a07af0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2db4011d50 tx=0x7f2db4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91f5e1f303e70c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.300+0000 7f2da8ff9640 1 -- 172.21.15.12:0/3303583501 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db403c050 con 0x564563a066e0 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.300+0000 7f2da8ff9640 1 -- 172.21.15.12:0/3303583501 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2db401aaf0 con 0x564563a066e0 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.300+0000 7f2da8ff9640 1 -- 172.21.15.12:0/3303583501 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4011500 con 0x564563a066e0 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.301+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3303583501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 msgr2=0x564563a07af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.301+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3303583501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a07af0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2db4011d50 tx=0x7f2db4001e50 comp rx=0 tx=0).stop 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.301+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3303583501 shutdown_connections 2024-09-19T06:52:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.301+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3303583501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a07000 0x564563a00c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.301+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3303583501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a066e0 0x564563a07af0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.301+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/3303583501 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a016a0 0x564563a05bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.301+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3303583501 >> 172.21.15.12:0/3303583501 conn(0x5645639f34e0 msgr2=0x564563a073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.301+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3303583501 shutdown_connections 2024-09-19T06:52:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.301+0000 7f2dcba8a740 1 -- 172.21.15.12:0/3303583501 wait complete. 2024-09-19T06:52:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dcba8a740 1 -- start start 2024-09-19T06:52:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dcba8a740 1 Processor -- start 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a016a0 0x564563a1bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dcba8a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a1c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dc27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a016a0 0x564563a1bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dc27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a016a0 0x564563a1bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55544/0 (socket says 172.21.15.12:55544) 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dc27fc640 1 -- 172.21.15.12:0/1696276859 learned_addr learned my addr 172.21.15.12:0/1696276859 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 0x564563a75420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41ad000 con 0x564563a016a0 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41ac930 con 0x564563a066e0 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc41a9b00 con 0x564563a07000 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dcba8a740 10 client.0 _ll_register_callbacks cb 0x7f2db400be90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.302+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a1c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 0x564563a75420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/1696276859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 msgr2=0x564563a75420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 0x564563a75420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/1696276859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a016a0 msgr2=0x564563a1bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a016a0 0x564563a1bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/1696276859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564563a75ac0 con 0x564563a066e0 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a016a0 0x564563a1bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a1c060 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x5645639e84e0 tx=0x7f2db4011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e2ba0c74be459d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2da6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2da6ff5640 1 -- 172.21.15.12:0/1696276859 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db403c070 con 0x564563a066e0 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2da6ff5640 1 -- 172.21.15.12:0/1696276859 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f2db4011700 con 0x564563a066e0 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2db401aaf0 con 0x564563a066e0 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2da6ff5640 1 -- 172.21.15.12:0/1696276859 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f2db405d050 con 0x564563a066e0 2024-09-19T06:52:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.303+0000 7f2dcba8a740 10 client.28139 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.304+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x564563a7ce60 con 0x564563a066e0 2024-09-19T06:52:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.304+0000 7f2da6ff5640 1 -- 172.21.15.12:0/1696276859 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2db401aaf0 con 0x564563a066e0 2024-09-19T06:52:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.304+0000 7f2da6ff5640 1 -- 172.21.15.12:0/1696276859 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f2db4058030 con 0x564563a066e0 2024-09-19T06:52:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.304+0000 7f2dcba8a740 10 client.28139 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.304+0000 7f2dcba8a740 10 client.28139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.304+0000 7f2dcba8a740 20 client.28139 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.304+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564563a7d540 0x564563a7f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.304+0000 7f2dcba8a740 4 client.28139 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:52:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.304+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56456396a850 con 0x564563a7d540 2024-09-19T06:52:23.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.304+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564563a7d540 0x564563a7f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.305+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564563a7d540 0x564563a7f960 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fa460d94313ad7b server_cookie=42cbdc7920c0f117 in_seq=0 out_seq=0 2024-09-19T06:52:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.305+0000 7f2da6ff5640 10 client.28139 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2da6ff5640 1 -- 172.21.15.12:0/1696276859 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56456396a850 con 0x564563a7d540 2024-09-19T06:52:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2da6ff5640 10 client.28139 handle_command_reply: tid=0 2024-09-19T06:52:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2dcba8a740 1 client.28139 shutdown 2024-09-19T06:52:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 msgr2=0x564563a1c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a1c060 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x5645639e84e0 tx=0x7f2db4011c50 comp rx=0 tx=0).stop 2024-09-19T06:52:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 shutdown_connections 2024-09-19T06:52:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564563a7d540 0x564563a7f960 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564563a07000 0x564563a75420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564563a066e0 0x564563a1c060 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2da6ff5640 0 client.28139 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.306+0000 7f2dcba8a740 1 --2- 172.21.15.12:0/1696276859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564563a016a0 0x564563a1bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.307+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 >> 172.21.15.12:0/1696276859 conn(0x5645639f34e0 msgr2=0x5645639f2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.307+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 shutdown_connections 2024-09-19T06:52:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.307+0000 7f2dcba8a740 1 -- 172.21.15.12:0/1696276859 wait complete. 2024-09-19T06:52:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.307+0000 7f2dcba8a740 20 client.28139 trim_cache size 0 max 16384 2024-09-19T06:52:23.316 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:52:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:52:23.316 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:52:23.316 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:52:23.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2dac0a33b0 msgr2=0x7f2dac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2dac0a33b0 0x7f2dac0a5870 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00bdf0 tx=0x7f2dbc004b50 comp rx=0 tx=0).stop 2024-09-19T06:52:23.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dc4106f20 msgr2=0x7f2dc419ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dc4106f20 0x7f2dc419ce60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00be20 tx=0x7f2dbc00bf10 comp rx=0 tx=0).stop 2024-09-19T06:52:23.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 shutdown_connections 2024-09-19T06:52:23.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f2dac0a33b0 0x7f2dac0a5870 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dc4106f20 0x7f2dc419ce60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dc41027a0 0x7f2dc4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 --2- 172.21.15.12:0/3956429703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc4101df0 0x7f2dc4198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 >> 172.21.15.12:0/3956429703 conn(0x7f2dc40fd8f0 msgr2=0x7f2dc40feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 shutdown_connections 2024-09-19T06:52:23.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:23.308+0000 7f2dc96b1640 1 -- 172.21.15.12:0/3956429703 wait complete. 2024-09-19T06:52:23.701 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.699+0000 7f913d1a6640 1 -- 172.21.15.12:0/1656986251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f913811b140 msgr2=0x7f913811d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.699+0000 7f913d1a6640 1 --2- 172.21.15.12:0/1656986251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f913811b140 0x7f913811d530 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f912c009890 tx=0x7f912c02a390 comp rx=0 tx=0).stop 2024-09-19T06:52:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.699+0000 7f913d1a6640 1 -- 172.21.15.12:0/1656986251 shutdown_connections 2024-09-19T06:52:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.699+0000 7f913d1a6640 1 --2- 172.21.15.12:0/1656986251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f913811b140 0x7f913811d530 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.699+0000 7f913d1a6640 1 --2- 172.21.15.12:0/1656986251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91381095d0 0x7f9138109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.699+0000 7f913d1a6640 1 --2- 172.21.15.12:0/1656986251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91381091f0 0x7f9138110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.699+0000 7f913d1a6640 1 -- 172.21.15.12:0/1656986251 >> 172.21.15.12:0/1656986251 conn(0x7f913806ce00 msgr2=0x7f913806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.705+0000 7f913d1a6640 1 -- 172.21.15.12:0/1656986251 shutdown_connections 2024-09-19T06:52:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.705+0000 7f913d1a6640 1 -- 172.21.15.12:0/1656986251 wait complete. 2024-09-19T06:52:23.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.706+0000 7f913d1a6640 1 Processor -- start 2024-09-19T06:52:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.709+0000 7f913d1a6640 1 -- start start 2024-09-19T06:52:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.710+0000 7f913d1a6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91381091f0 0x7f91381a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.710+0000 7f913d1a6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91381095d0 0x7f91381a7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.710+0000 7f913d1a6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f913811b140 0x7f91381ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.710+0000 7f913d1a6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9138120d00 con 0x7f91381095d0 2024-09-19T06:52:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.710+0000 7f913d1a6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9138120b80 con 0x7f91381091f0 2024-09-19T06:52:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.710+0000 7f913d1a6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9138120e80 con 0x7f913811b140 2024-09-19T06:52:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.710+0000 7f913759e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f913811b140 0x7f91381ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.710+0000 7f913759e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f913811b140 0x7f91381ab9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46336/0 (socket says 172.21.15.12:46336) 2024-09-19T06:52:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.710+0000 7f913759e640 1 -- 172.21.15.12:0/1177646871 learned_addr learned my addr 172.21.15.12:0/1177646871 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.710+0000 7f9136d9d640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91381091f0 0x7f91381a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.711+0000 7f913759e640 1 -- 172.21.15.12:0/1177646871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91381091f0 msgr2=0x7f91381a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.711+0000 7f913759e640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91381091f0 0x7f91381a7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.712+0000 7f913759e640 1 -- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91381095d0 msgr2=0x7f91381a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.712+0000 7f913659c640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91381095d0 0x7f91381a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.713+0000 7f913759e640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91381095d0 0x7f91381a7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.713+0000 7f913759e640 1 -- 172.21.15.12:0/1177646871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91381ac100 con 0x7f913811b140 2024-09-19T06:52:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.714+0000 7f913659c640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91381095d0 0x7f91381a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.717+0000 7f913759e640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f913811b140 0x7f91381ab9d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f912c035040 tx=0x7f912c033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.717+0000 7f911ffff640 1 -- 172.21.15.12:0/1177646871 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c037040 con 0x7f913811b140 2024-09-19T06:52:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.717+0000 7f911ffff640 1 -- 172.21.15.12:0/1177646871 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f912c040070 con 0x7f913811b140 2024-09-19T06:52:23.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.719+0000 7f913d1a6640 1 -- 172.21.15.12:0/1177646871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91381ac390 con 0x7f913811b140 2024-09-19T06:52:23.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.719+0000 7f911ffff640 1 -- 172.21.15.12:0/1177646871 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c003a20 con 0x7f913811b140 2024-09-19T06:52:23.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.719+0000 7f913d1a6640 1 -- 172.21.15.12:0/1177646871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91381b3c80 con 0x7f913811b140 2024-09-19T06:52:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.723+0000 7f9140021740 1 Processor -- start 2024-09-19T06:52:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.724+0000 7f911ffff640 1 -- 172.21.15.12:0/1177646871 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f912c003bc0 con 0x7f913811b140 2024-09-19T06:52:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.725+0000 7f911ffff640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91200a33e0 0x7f91200a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.725+0000 7f911ffff640 1 -- 172.21.15.12:0/1177646871 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f912c004250 con 0x7f913811b140 2024-09-19T06:52:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.726+0000 7f9140021740 1 -- start start 2024-09-19T06:52:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.726+0000 7f9140021740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef4af0 0x555d74ef4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.726+0000 7f9140021740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74eff770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.726+0000 7f9140021740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74effcb0 0x555d74f020a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.726+0000 7f9140021740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555d74e592f0 con 0x555d74ef5410 2024-09-19T06:52:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.726+0000 7f9140021740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555d74e01270 con 0x555d74effcb0 2024-09-19T06:52:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.726+0000 7f9140021740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555d74e552b0 con 0x555d74ef4af0 2024-09-19T06:52:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.727+0000 7f9136d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef4af0 0x555d74ef4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.727+0000 7f9136d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef4af0 0x555d74ef4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46342/0 (socket says 172.21.15.12:46342) 2024-09-19T06:52:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.727+0000 7f9136d9d640 1 -- 172.21.15.12:0/3322307235 learned_addr learned my addr 172.21.15.12:0/3322307235 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.727+0000 7f913759e640 1 --2- 172.21.15.12:0/3322307235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74effcb0 0x555d74f020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.727+0000 7f913659c640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91200a33e0 0x7f91200a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.727+0000 7f913659c640 1 --2- 172.21.15.12:0/3322307235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74eff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.728+0000 7f9136d9d640 1 -- 172.21.15.12:0/3322307235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74effcb0 msgr2=0x555d74f020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.728+0000 7f9136d9d640 1 --2- 172.21.15.12:0/3322307235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74effcb0 0x555d74f020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.728+0000 7f9136d9d640 1 -- 172.21.15.12:0/3322307235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 msgr2=0x555d74eff770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.728+0000 7f9136d9d640 1 --2- 172.21.15.12:0/3322307235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74eff770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.728+0000 7f9136d9d640 1 -- 172.21.15.12:0/3322307235 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d74e00340 con 0x555d74ef4af0 2024-09-19T06:52:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.728+0000 7f913659c640 1 --2- 172.21.15.12:0/3322307235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74eff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.728+0000 7f9136d9d640 1 --2- 172.21.15.12:0/3322307235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef4af0 0x555d74ef4ed0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f913000c450 tx=0x7f913000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8451ffca35d86ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.728+0000 7f911d7fa640 1 -- 172.21.15.12:0/3322307235 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913001a070 con 0x555d74ef4af0 2024-09-19T06:52:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.729+0000 7f911d7fa640 1 -- 172.21.15.12:0/3322307235 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9130007910 con 0x555d74ef4af0 2024-09-19T06:52:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.729+0000 7f911d7fa640 1 -- 172.21.15.12:0/3322307235 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130015a50 con 0x555d74ef4af0 2024-09-19T06:52:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.729+0000 7f913659c640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91200a33e0 0x7f91200a58a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x555d74ef1ec0 tx=0x7f9128005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.729+0000 7f9140021740 1 -- 172.21.15.12:0/3322307235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef4af0 msgr2=0x555d74ef4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.729+0000 7f9140021740 1 --2- 172.21.15.12:0/3322307235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef4af0 0x555d74ef4ed0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f913000c450 tx=0x7f913000c910 comp rx=0 tx=0).stop 2024-09-19T06:52:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.730+0000 7f9140021740 1 -- 172.21.15.12:0/3322307235 shutdown_connections 2024-09-19T06:52:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.730+0000 7f9140021740 1 --2- 172.21.15.12:0/3322307235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74effcb0 0x555d74f020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.730+0000 7f9140021740 1 --2- 172.21.15.12:0/3322307235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74eff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.730+0000 7f9140021740 1 --2- 172.21.15.12:0/3322307235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef4af0 0x555d74ef4ed0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.730+0000 7f9140021740 1 -- 172.21.15.12:0/3322307235 >> 172.21.15.12:0/3322307235 conn(0x555d74ef1060 msgr2=0x555d74ef1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.730+0000 7f9140021740 1 -- 172.21.15.12:0/3322307235 shutdown_connections 2024-09-19T06:52:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.730+0000 7f9140021740 1 -- 172.21.15.12:0/3322307235 wait complete. 2024-09-19T06:52:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.731+0000 7f9140021740 1 -- start start 2024-09-19T06:52:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.731+0000 7f9140021740 1 Processor -- start 2024-09-19T06:52:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.731+0000 7f9140021740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef4af0 0x555d74efcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.731+0000 7f9140021740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef5410 0x555d74efd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.731+0000 7f9140021740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 0x555d74efd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.731+0000 7f9140021740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555d74f028d0 con 0x555d74ef4af0 2024-09-19T06:52:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.731+0000 7f9140021740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555d74de2290 con 0x555d74ef5410 2024-09-19T06:52:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.731+0000 7f9140021740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555d74f02a50 con 0x555d74effcb0 2024-09-19T06:52:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.731+0000 7f9140021740 10 client.0 _ll_register_callbacks cb 0x555d74e13140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f9136d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef4af0 0x555d74efcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f9136d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef4af0 0x555d74efcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55568/0 (socket says 172.21.15.12:55568) 2024-09-19T06:52:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f913659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef5410 0x555d74efd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f9136d9d640 1 -- 172.21.15.12:0/1381647637 learned_addr learned my addr 172.21.15.12:0/1381647637 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f913759e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 0x555d74efd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f9136d9d640 1 -- 172.21.15.12:0/1381647637 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 msgr2=0x555d74efd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f9136d9d640 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 0x555d74efd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f9136d9d640 1 -- 172.21.15.12:0/1381647637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef5410 msgr2=0x555d74efd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f9136d9d640 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef5410 0x555d74efd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f9136d9d640 1 -- 172.21.15.12:0/1381647637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d74b6c210 con 0x555d74ef4af0 2024-09-19T06:52:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f9136d9d640 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef4af0 0x555d74efcb90 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9130009510 tx=0x7f9130015880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae8d8b5ae39e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f911aff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:52:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.732+0000 7f911aff5640 1 -- 172.21.15.12:0/1381647637 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913001a040 con 0x555d74ef4af0 2024-09-19T06:52:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f911aff5640 1 -- 172.21.15.12:0/1381647637 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f91300159a0 con 0x555d74ef4af0 2024-09-19T06:52:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f9140021740 1 -- 172.21.15.12:0/1381647637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9130007910 con 0x555d74ef4af0 2024-09-19T06:52:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f911aff5640 1 -- 172.21.15.12:0/1381647637 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f913002e050 con 0x555d74ef4af0 2024-09-19T06:52:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f9140021740 10 client.18801 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f9140021740 1 -- 172.21.15.12:0/1381647637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x555d74c38620 con 0x555d74ef4af0 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f911aff5640 1 -- 172.21.15.12:0/1381647637 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9130025070 con 0x555d74ef4af0 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f911aff5640 1 -- 172.21.15.12:0/1381647637 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f9130020ba0 con 0x555d74ef4af0 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f9140021740 10 client.18801 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f9140021740 10 client.18801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f9140021740 20 client.18801 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f9140021740 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x555d74f0fb90 0x555d74f11f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f9140021740 4 client.18801 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.733+0000 7f9140021740 1 -- 172.21.15.12:0/1381647637 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9130007910 con 0x555d74f0fb90 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.734+0000 7f913659c640 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x555d74f0fb90 0x555d74f11f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.734+0000 7f911aff5640 10 client.18801 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.734+0000 7f913659c640 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x555d74f0fb90 0x555d74f11f80 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4adb34e1cfa8ba9 server_cookie=45564745b16a784f in_seq=0 out_seq=0 2024-09-19T06:52:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.736+0000 7f911aff5640 1 -- 172.21.15.12:0/1381647637 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9130007910 con 0x555d74f0fb90 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.736+0000 7f911aff5640 10 client.18801 handle_command_reply: tid=0 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.736+0000 7f9140021740 1 client.18801 shutdown 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.736+0000 7f9140021740 1 -- 172.21.15.12:0/1381647637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef4af0 msgr2=0x555d74efcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.736+0000 7f9140021740 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef4af0 0x555d74efcb90 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9130009510 tx=0x7f9130015880 comp rx=0 tx=0).stop 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.737+0000 7f9140021740 1 -- 172.21.15.12:0/1381647637 shutdown_connections 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.737+0000 7f9140021740 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x555d74f0fb90 0x555d74f11f80 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.737+0000 7f9140021740 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 0x555d74efd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.737+0000 7f9140021740 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef5410 0x555d74efd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.737+0000 7f9140021740 1 --2- 172.21.15.12:0/1381647637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef4af0 0x555d74efcb90 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.737+0000 7f911aff5640 0 client.18801 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.737+0000 7f9140021740 1 -- 172.21.15.12:0/1381647637 >> 172.21.15.12:0/1381647637 conn(0x555d74ef1060 msgr2=0x555d74ef6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.737+0000 7f9140021740 1 -- 172.21.15.12:0/1381647637 shutdown_connections 2024-09-19T06:52:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.737+0000 7f9140021740 1 -- 172.21.15.12:0/1381647637 wait complete. 2024-09-19T06:52:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.737+0000 7f9140021740 20 client.18801 trim_cache size 0 max 16384 2024-09-19T06:52:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.760+0000 7f9140021740 1 Processor -- start 2024-09-19T06:52:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.760+0000 7f9140021740 1 -- start start 2024-09-19T06:52:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.760+0000 7f9140021740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 0x555d74ef7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.760+0000 7f9140021740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74efd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.761+0000 7f9140021740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 0x555d74f17580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.761+0000 7f9140021740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91381bc5b0 con 0x555d74ef5410 2024-09-19T06:52:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.761+0000 7f9140021740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f91381be180 con 0x555d74ef4af0 2024-09-19T06:52:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.761+0000 7f9140021740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f91381bcc80 con 0x555d74effcb0 2024-09-19T06:52:23.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.762+0000 7f913659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74efd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.762+0000 7f913659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74efd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55580/0 (socket says 172.21.15.12:55580) 2024-09-19T06:52:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.762+0000 7f913659c640 1 -- 172.21.15.12:0/3015455034 learned_addr learned my addr 172.21.15.12:0/3015455034 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.762+0000 7f913759e640 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 0x555d74f17580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.762+0000 7f9136d9d640 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 0x555d74ef7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.763+0000 7f9136d9d640 1 -- 172.21.15.12:0/3015455034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 msgr2=0x555d74f17580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.763+0000 7f9136d9d640 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 0x555d74f17580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.763+0000 7f9136d9d640 1 -- 172.21.15.12:0/3015455034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 msgr2=0x555d74efd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.763+0000 7f9136d9d640 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74efd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.763+0000 7f9136d9d640 1 -- 172.21.15.12:0/3015455034 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d74ef4920 con 0x555d74ef4af0 2024-09-19T06:52:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.763+0000 7f913659c640 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74efd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.763+0000 7f913759e640 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 0x555d74f17580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.763+0000 7f9136d9d640 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 0x555d74ef7530 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9130009510 tx=0x7f9130022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=499ed3508e0c98e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.764+0000 7f911cff9640 1 -- 172.21.15.12:0/3015455034 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913001a040 con 0x555d74ef4af0 2024-09-19T06:52:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.764+0000 7f911cff9640 1 -- 172.21.15.12:0/3015455034 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9130025040 con 0x555d74ef4af0 2024-09-19T06:52:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.764+0000 7f911cff9640 1 -- 172.21.15.12:0/3015455034 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130029590 con 0x555d74ef4af0 2024-09-19T06:52:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.765+0000 7f9140021740 1 -- 172.21.15.12:0/3015455034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 msgr2=0x555d74ef7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.765+0000 7f9140021740 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 0x555d74ef7530 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9130009510 tx=0x7f9130022000 comp rx=0 tx=0).stop 2024-09-19T06:52:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.765+0000 7f9140021740 1 -- 172.21.15.12:0/3015455034 shutdown_connections 2024-09-19T06:52:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.765+0000 7f9140021740 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74effcb0 0x555d74f17580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.765+0000 7f9140021740 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74ef5410 0x555d74efd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.765+0000 7f9140021740 1 --2- 172.21.15.12:0/3015455034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 0x555d74ef7530 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.765+0000 7f9140021740 1 -- 172.21.15.12:0/3015455034 >> 172.21.15.12:0/3015455034 conn(0x555d74ef1060 msgr2=0x555d74efec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.765+0000 7f9140021740 1 -- 172.21.15.12:0/3015455034 shutdown_connections 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.765+0000 7f9140021740 1 -- 172.21.15.12:0/3015455034 wait complete. 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.765+0000 7f9140021740 1 -- start start 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f9140021740 1 Processor -- start 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f9140021740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 0x555d74f08170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f9140021740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef5410 0x555d74f03490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f9140021740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74effcb0 0x555d74f039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f9140021740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91381bdab0 con 0x555d74effcb0 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f9140021740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f91381bd3e0 con 0x555d74ef4af0 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f9140021740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f91381ba5b0 con 0x555d74ef5410 2024-09-19T06:52:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f913759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74effcb0 0x555d74f039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f913759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74effcb0 0x555d74f039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55582/0 (socket says 172.21.15.12:55582) 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f913759e640 1 -- 172.21.15.12:0/1172649535 learned_addr learned my addr 172.21.15.12:0/1172649535 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f913659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef5410 0x555d74f03490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f9136d9d640 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 0x555d74f08170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.766+0000 7f9140021740 10 client.0 _ll_register_callbacks cb 0x7f9130018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.767+0000 7f913659c640 1 -- 172.21.15.12:0/1172649535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 msgr2=0x555d74f08170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.767+0000 7f913659c640 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 0x555d74f08170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.767+0000 7f913659c640 1 -- 172.21.15.12:0/1172649535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74effcb0 msgr2=0x555d74f039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.767+0000 7f913659c640 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74effcb0 0x555d74f039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.767+0000 7f913659c640 1 -- 172.21.15.12:0/1172649535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d74eec2d0 con 0x555d74ef5410 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.767+0000 7f913659c640 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef5410 0x555d74f03490 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9128009fa0 tx=0x7f9128004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac1ebdc0fbff5a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.767+0000 7f911aff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:52:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.768+0000 7f911aff5640 1 -- 172.21.15.12:0/1172649535 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9128029420 con 0x555d74ef5410 2024-09-19T06:52:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.768+0000 7f9140021740 1 -- 172.21.15.12:0/1172649535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9130025040 con 0x555d74ef5410 2024-09-19T06:52:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.768+0000 7f911aff5640 1 -- 172.21.15.12:0/1172649535 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f91280295c0 con 0x555d74ef5410 2024-09-19T06:52:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.768+0000 7f911aff5640 1 -- 172.21.15.12:0/1172649535 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f9128029800 con 0x555d74ef5410 2024-09-19T06:52:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.768+0000 7f9140021740 10 client.28090 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.768+0000 7f9140021740 1 -- 172.21.15.12:0/1172649535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x555d74f7a0e0 con 0x555d74ef5410 2024-09-19T06:52:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f911aff5640 1 -- 172.21.15.12:0/1172649535 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9128012510 con 0x555d74ef5410 2024-09-19T06:52:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f911aff5640 1 -- 172.21.15.12:0/1172649535 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f9128020420 con 0x555d74ef5410 2024-09-19T06:52:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f9140021740 10 client.28090 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f9140021740 10 client.28090 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f9140021740 20 client.28090 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f9140021740 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x555d74f7a890 0x555d74f7ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f9140021740 4 client.28090 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:52:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f9140021740 1 -- 172.21.15.12:0/1172649535 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f9130025040 con 0x555d74f7a890 2024-09-19T06:52:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f9136d9d640 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x555d74f7a890 0x555d74f7ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f911aff5640 10 client.28090 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.769+0000 7f9136d9d640 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x555d74f7a890 0x555d74f7ccb0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce1708eedc3e45f9 server_cookie=f6872a056d96c51a in_seq=0 out_seq=0 2024-09-19T06:52:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.780+0000 7f911aff5640 1 -- 172.21.15.12:0/1172649535 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f9130025040 con 0x555d74f7a890 2024-09-19T06:52:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.780+0000 7f911aff5640 10 client.28090 handle_command_reply: tid=0 2024-09-19T06:52:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.780+0000 7f9140021740 1 client.28090 shutdown 2024-09-19T06:52:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 1 -- 172.21.15.12:0/1172649535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef5410 msgr2=0x555d74f03490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef5410 0x555d74f03490 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9128009fa0 tx=0x7f9128004730 comp rx=0 tx=0).stop 2024-09-19T06:52:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 1 -- 172.21.15.12:0/1172649535 shutdown_connections 2024-09-19T06:52:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x555d74f7a890 0x555d74f7ccb0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d74effcb0 0x555d74f039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d74ef5410 0x555d74f03490 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f911aff5640 0 client.28090 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 1 --2- 172.21.15.12:0/1172649535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d74ef4af0 0x555d74f08170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 1 -- 172.21.15.12:0/1172649535 >> 172.21.15.12:0/1172649535 conn(0x555d74ef1060 msgr2=0x555d74eef9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 1 -- 172.21.15.12:0/1172649535 shutdown_connections 2024-09-19T06:52:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 1 -- 172.21.15.12:0/1172649535 wait complete. 2024-09-19T06:52:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.781+0000 7f9140021740 20 client.28090 trim_cache size 0 max 16384 2024-09-19T06:52:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:52:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:52:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:52:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:52:23.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 -- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91200a33e0 msgr2=0x7f91200a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91200a33e0 0x7f91200a58a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x555d74ef1ec0 tx=0x7f9128005a20 comp rx=0 tx=0).stop 2024-09-19T06:52:23.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 -- 172.21.15.12:0/1177646871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f913811b140 msgr2=0x7f91381ab9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:23.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f913811b140 0x7f91381ab9d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f912c035040 tx=0x7f912c033d10 comp rx=0 tx=0).stop 2024-09-19T06:52:23.786 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 -- 172.21.15.12:0/1177646871 shutdown_connections 2024-09-19T06:52:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91200a33e0 0x7f91200a58a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f913811b140 0x7f91381ab9d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91381095d0 0x7f91381a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 --2- 172.21.15.12:0/1177646871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91381091f0 0x7f91381a7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 -- 172.21.15.12:0/1177646871 >> 172.21.15.12:0/1177646871 conn(0x7f913806ce00 msgr2=0x7f913811b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 -- 172.21.15.12:0/1177646871 shutdown_connections 2024-09-19T06:52:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:23.782+0000 7f913d1a6640 1 -- 172.21.15.12:0/1177646871 wait complete. 2024-09-19T06:52:24.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:23 smithi012 ceph-mon[30937]: pgmap v382: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 697 op/s 2024-09-19T06:52:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:23 smithi016 ceph-mon[34911]: pgmap v382: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 697 op/s 2024-09-19T06:52:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:23 smithi173 ceph-mon[35349]: pgmap v382: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 697 op/s 2024-09-19T06:52:24.553 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:52:24.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:52:24.915 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:25.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.516+0000 7ff81063c640 1 -- 172.21.15.12:0/3375974507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff808074e30 msgr2=0x7ff80810df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:25.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.516+0000 7ff81063c640 1 --2- 172.21.15.12:0/3375974507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff808074e30 0x7ff80810df00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009900 tx=0x7ff7f802a480 comp rx=0 tx=0).stop 2024-09-19T06:52:25.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.517+0000 7ff81063c640 1 -- 172.21.15.12:0/3375974507 shutdown_connections 2024-09-19T06:52:25.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.517+0000 7ff81063c640 1 --2- 172.21.15.12:0/3375974507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff80810e440 0x7ff808110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:25.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.517+0000 7ff81063c640 1 --2- 172.21.15.12:0/3375974507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff808074e30 0x7ff80810df00 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:25.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.517+0000 7ff81063c640 1 --2- 172.21.15.12:0/3375974507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff808074510 0x7ff8080748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:25.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.517+0000 7ff81063c640 1 -- 172.21.15.12:0/3375974507 >> 172.21.15.12:0/3375974507 conn(0x7ff8080fd880 msgr2=0x7ff8080ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.517+0000 7ff81063c640 1 -- 172.21.15.12:0/3375974507 shutdown_connections 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.517+0000 7ff81063c640 1 -- 172.21.15.12:0/3375974507 wait complete. 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff81063c640 1 Processor -- start 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff81063c640 1 -- start start 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff81063c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff808074510 0x7ff80810dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff81063c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff808074e30 0x7ff80810ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff81063c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff80810e440 0x7ff80810b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff81063c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff808114140 con 0x7ff808074510 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff81063c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff808113fc0 con 0x7ff808074e30 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff81063c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8081142c0 con 0x7ff80810e440 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff80e3d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff808074510 0x7ff80810dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:25.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff80dbd7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff808074e30 0x7ff80810ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff80dbd7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff808074e30 0x7ff80810ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:53414/0 (socket says 172.21.15.12:53414) 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff80dbd7640 1 -- 172.21.15.12:0/3854123701 learned_addr learned my addr 172.21.15.12:0/3854123701 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.518+0000 7ff80ebd9640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff80810e440 0x7ff80810b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff80e3d8640 1 -- 172.21.15.12:0/3854123701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff80810e440 msgr2=0x7ff80810b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff80e3d8640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff80810e440 0x7ff80810b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff80e3d8640 1 -- 172.21.15.12:0/3854123701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff808074e30 msgr2=0x7ff80810ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff80e3d8640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff808074e30 0x7ff80810ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff80e3d8640 1 -- 172.21.15.12:0/3854123701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80810b9a0 con 0x7ff808074510 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff80dbd7640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff808074e30 0x7ff80810ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff80e3d8640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff808074510 0x7ff80810dc30 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff80400d6d0 tx=0x7ff80400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff7ff7fe640 1 -- 172.21.15.12:0/3854123701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804017070 con 0x7ff808074510 2024-09-19T06:52:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff7ff7fe640 1 -- 172.21.15.12:0/3854123701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff804009820 con 0x7ff808074510 2024-09-19T06:52:25.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff7ff7fe640 1 -- 172.21.15.12:0/3854123701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804004d00 con 0x7ff808074510 2024-09-19T06:52:25.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff81063c640 1 -- 172.21.15.12:0/3854123701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8081aae80 con 0x7ff808074510 2024-09-19T06:52:25.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.519+0000 7ff81063c640 1 -- 172.21.15.12:0/3854123701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8081ab280 con 0x7ff808074510 2024-09-19T06:52:25.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.521+0000 7ff81063c640 1 -- 172.21.15.12:0/3854123701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff808075c50 con 0x7ff808074510 2024-09-19T06:52:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.524+0000 7ff7ff7fe640 1 -- 172.21.15.12:0/3854123701 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff8040099d0 con 0x7ff808074510 2024-09-19T06:52:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.525+0000 7ff7ff7fe640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff7f40a34b0 0x7ff7f40a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.525+0000 7ff80dbd7640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff7f40a34b0 0x7ff7f40a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:25.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.525+0000 7ff7ff7fe640 1 -- 172.21.15.12:0/3854123701 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7ff8040cf8a0 con 0x7ff808074510 2024-09-19T06:52:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.527+0000 7ff80dbd7640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff7f40a34b0 0x7ff7f40a5970 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff80810c4a0 tx=0x7ff7f800b040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:25.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.530+0000 7ff7ff7fe640 1 -- 172.21.15.12:0/3854123701 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff80409bb30 con 0x7ff808074510 2024-09-19T06:52:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 700.0 s, 1538.8 tps, lat 64.649 ms stddev 138.633 2024-09-19T06:52:25.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.856+0000 7ff81063c640 1 -- 172.21.15.12:0/3854123701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8081ab4e0 con 0x7ff808074510 2024-09-19T06:52:25.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.857+0000 7ff7ff7fe640 1 -- 172.21.15.12:0/3854123701 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11976 (secure 0 0 0) 0x7ff80409fe30 con 0x7ff808074510 2024-09-19T06:52:25.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:52:25.860 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":46,"btime":"2024-09-19T06:51:25:027076+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:51:24.416445+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:52:25.860 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 46 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.859+0000 7ff81063c640 1 -- 172.21.15.12:0/3854123701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff7f40a34b0 msgr2=0x7ff7f40a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.859+0000 7ff81063c640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff7f40a34b0 0x7ff7f40a5970 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff80810c4a0 tx=0x7ff7f800b040 comp rx=0 tx=0).stop 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.859+0000 7ff81063c640 1 -- 172.21.15.12:0/3854123701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff808074510 msgr2=0x7ff80810dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.859+0000 7ff81063c640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff808074510 0x7ff80810dc30 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff80400d6d0 tx=0x7ff80400db90 comp rx=0 tx=0).stop 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.859+0000 7ff81063c640 1 -- 172.21.15.12:0/3854123701 shutdown_connections 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.859+0000 7ff81063c640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff7f40a34b0 0x7ff7f40a5970 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.859+0000 7ff81063c640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff80810e440 0x7ff80810b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.859+0000 7ff81063c640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff808074e30 0x7ff80810ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.859+0000 7ff81063c640 1 --2- 172.21.15.12:0/3854123701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff808074510 0x7ff80810dc30 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.859+0000 7ff81063c640 1 -- 172.21.15.12:0/3854123701 >> 172.21.15.12:0/3854123701 conn(0x7ff8080fd880 msgr2=0x7ff8080fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:25.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.860+0000 7ff81063c640 1 -- 172.21.15.12:0/3854123701 shutdown_connections 2024-09-19T06:52:25.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:25.860+0000 7ff81063c640 1 -- 172.21.15.12:0/3854123701 wait complete. 2024-09-19T06:52:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:25 smithi012 ceph-mon[30937]: pgmap v383: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 734 op/s 2024-09-19T06:52:26.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:25 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3854123701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:25 smithi016 ceph-mon[34911]: pgmap v383: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 734 op/s 2024-09-19T06:52:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:25 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3854123701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:25 smithi173 ceph-mon[35349]: pgmap v383: 97 pgs: 97 active+clean; 4.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 15 MiB/s wr, 734 op/s 2024-09-19T06:52:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:25 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3854123701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:52:26.670 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:52:27.074 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:27.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.674+0000 7f43a4152640 1 -- 172.21.15.12:0/4264449556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f439c109830 msgr2=0x7f439c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:27.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.674+0000 7f43a4152640 1 --2- 172.21.15.12:0/4264449556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f439c109830 0x7f439c109c90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4398009900 tx=0x7f439802a440 comp rx=0 tx=0).stop 2024-09-19T06:52:27.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.679+0000 7f43a4152640 1 -- 172.21.15.12:0/4264449556 shutdown_connections 2024-09-19T06:52:27.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.679+0000 7f43a4152640 1 --2- 172.21.15.12:0/4264449556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f439c11b140 0x7f439c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.679+0000 7f43a4152640 1 --2- 172.21.15.12:0/4264449556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f439c109830 0x7f439c109c90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.679+0000 7f43a4152640 1 --2- 172.21.15.12:0/4264449556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c109450 0x7f439c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.679+0000 7f43a4152640 1 -- 172.21.15.12:0/4264449556 >> 172.21.15.12:0/4264449556 conn(0x7f439c06e140 msgr2=0x7f439c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:27.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.679+0000 7f43a4152640 1 -- 172.21.15.12:0/4264449556 shutdown_connections 2024-09-19T06:52:27.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.679+0000 7f43a4152640 1 -- 172.21.15.12:0/4264449556 wait complete. 2024-09-19T06:52:27.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.680+0000 7f43a4152640 1 Processor -- start 2024-09-19T06:52:27.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.680+0000 7f43a4152640 1 -- start start 2024-09-19T06:52:27.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.680+0000 7f43a4152640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f439c109450 0x7f439c1a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.680+0000 7f43a4152640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f439c109830 0x7f439c1a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.680+0000 7f43a4152640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c11b140 0x7f439c1abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.680+0000 7f43a4152640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f439c120e30 con 0x7f439c109450 2024-09-19T06:52:27.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.680+0000 7f43a4152640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f439c120cb0 con 0x7f439c11b140 2024-09-19T06:52:27.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.680+0000 7f43a4152640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f439c120fb0 con 0x7f439c109830 2024-09-19T06:52:27.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.682+0000 7f43a1eee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f439c109450 0x7f439c1a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.682+0000 7f43a1eee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f439c109450 0x7f439c1a7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55604/0 (socket says 172.21.15.12:55604) 2024-09-19T06:52:27.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.682+0000 7f43a1eee640 1 -- 172.21.15.12:0/3031745600 learned_addr learned my addr 172.21.15.12:0/3031745600 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:27.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.686+0000 7f43a26ef640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c11b140 0x7f439c1abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.686+0000 7f43a26ef640 1 -- 172.21.15.12:0/3031745600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f439c109830 msgr2=0x7f439c1a78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:27.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.686+0000 7f43a26ef640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f439c109830 0x7f439c1a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.686+0000 7f43a26ef640 1 -- 172.21.15.12:0/3031745600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f439c109450 msgr2=0x7f439c1a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:27.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.686+0000 7f43a26ef640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f439c109450 0x7f439c1a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.686+0000 7f43a26ef640 1 -- 172.21.15.12:0/3031745600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439c1ac340 con 0x7f439c11b140 2024-09-19T06:52:27.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.687+0000 7f43a26ef640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c11b140 0x7f439c1abc40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f438c00b410 tx=0x7f438c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:27.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.687+0000 7f4392ffd640 1 -- 172.21.15.12:0/3031745600 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c015020 con 0x7f439c11b140 2024-09-19T06:52:27.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.687+0000 7f4392ffd640 1 -- 172.21.15.12:0/3031745600 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f438c011d10 con 0x7f439c11b140 2024-09-19T06:52:27.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.687+0000 7f43a4152640 1 -- 172.21.15.12:0/3031745600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f439c1ac630 con 0x7f439c11b140 2024-09-19T06:52:27.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.687+0000 7f4392ffd640 1 -- 172.21.15.12:0/3031745600 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c00f2e0 con 0x7f439c11b140 2024-09-19T06:52:27.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.687+0000 7f43a4152640 1 -- 172.21.15.12:0/3031745600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f439c110920 con 0x7f439c11b140 2024-09-19T06:52:27.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.692+0000 7f43a652b740 1 Processor -- start 2024-09-19T06:52:27.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.694+0000 7f43a652b740 1 -- start start 2024-09-19T06:52:27.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.694+0000 7f43a652b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55568348ab40 0x555683489090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.694+0000 7f43a652b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x555683489a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.694+0000 7f43a652b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555683494370 0x555683496760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.694+0000 7f43a652b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5556833ef2f0 con 0x55568348ab40 2024-09-19T06:52:27.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.694+0000 7f43a652b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555683396cf0 con 0x555683494370 2024-09-19T06:52:27.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.694+0000 7f43a652b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5556833eb2b0 con 0x5556834895d0 2024-09-19T06:52:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.695+0000 7f43a1eee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x555683489a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.695+0000 7f43a1eee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x555683489a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46420/0 (socket says 172.21.15.12:46420) 2024-09-19T06:52:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.695+0000 7f43a1eee640 1 -- 172.21.15.12:0/2910512665 learned_addr learned my addr 172.21.15.12:0/2910512665 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.695+0000 7f43a1eee640 1 -- 172.21.15.12:0/2910512665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555683494370 msgr2=0x555683496760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:52:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.695+0000 7f43a1eee640 1 --2- 172.21.15.12:0/2910512665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555683494370 0x555683496760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.695+0000 7f43a1eee640 1 -- 172.21.15.12:0/2910512665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55568348ab40 msgr2=0x555683489090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:52:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.695+0000 7f43a1eee640 1 --2- 172.21.15.12:0/2910512665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55568348ab40 0x555683489090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.695+0000 7f43a1eee640 1 -- 172.21.15.12:0/2910512665 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55568337b3a0 con 0x5556834895d0 2024-09-19T06:52:27.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.695+0000 7f43a1eee640 1 --2- 172.21.15.12:0/2910512665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x555683489a10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f43940115c0 tx=0x7f4394011a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ed1926e868436e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:27.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.697+0000 7f4387fff640 1 -- 172.21.15.12:0/2910512665 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439400f6c0 con 0x5556834895d0 2024-09-19T06:52:27.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.698+0000 7f4387fff640 1 -- 172.21.15.12:0/2910512665 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f439400fd40 con 0x5556834895d0 2024-09-19T06:52:27.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.699+0000 7f43a652b740 1 -- 172.21.15.12:0/2910512665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 msgr2=0x555683489a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:27.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.699+0000 7f43a652b740 1 --2- 172.21.15.12:0/2910512665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x555683489a10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f43940115c0 tx=0x7f4394011a80 comp rx=0 tx=0).stop 2024-09-19T06:52:27.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.699+0000 7f4392ffd640 1 -- 172.21.15.12:0/3031745600 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f438c018020 con 0x7f439c11b140 2024-09-19T06:52:27.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.700+0000 7f4392ffd640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43880a3430 0x7f43880a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.701+0000 7f43a652b740 1 -- 172.21.15.12:0/2910512665 shutdown_connections 2024-09-19T06:52:27.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.701+0000 7f43a652b740 1 --2- 172.21.15.12:0/2910512665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555683494370 0x555683496760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.701+0000 7f43a652b740 1 --2- 172.21.15.12:0/2910512665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x555683489a10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.701+0000 7f43a652b740 1 --2- 172.21.15.12:0/2910512665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55568348ab40 0x555683489090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.701+0000 7f43a652b740 1 -- 172.21.15.12:0/2910512665 >> 172.21.15.12:0/2910512665 conn(0x555683452310 msgr2=0x555683485c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:27.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.701+0000 7f43a652b740 1 -- 172.21.15.12:0/2910512665 shutdown_connections 2024-09-19T06:52:27.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.701+0000 7f43a652b740 1 -- 172.21.15.12:0/2910512665 wait complete. 2024-09-19T06:52:27.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.701+0000 7f43a652b740 1 -- start start 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.701+0000 7f43a652b740 1 Processor -- start 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.701+0000 7f43a16ed640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43880a3430 0x7f43880a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.702+0000 7f4392ffd640 1 -- 172.21.15.12:0/3031745600 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f438c0cf430 con 0x7f439c11b140 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.704+0000 7f43a652b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 0x555683493c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.704+0000 7f43a652b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x555683490f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.704+0000 7f43a652b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 0x555683491470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.704+0000 7f43a652b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5556834970c0 con 0x5556834895d0 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.705+0000 7f43a652b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5556833aa060 con 0x55568348ab40 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.705+0000 7f43a652b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555683497240 con 0x555683494370 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.705+0000 7f43a652b740 10 client.0 _ll_register_callbacks cb 0x5556830fd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.707+0000 7f43a1eee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 0x555683493c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.707+0000 7f43a1eee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 0x555683493c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55606/0 (socket says 172.21.15.12:55606) 2024-09-19T06:52:27.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.707+0000 7f43a1eee640 1 -- 172.21.15.12:0/1553132853 learned_addr learned my addr 172.21.15.12:0/1553132853 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:27.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.707+0000 7f43a26ef640 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 0x555683491470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.712+0000 7f43a16ed640 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x555683490f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.713+0000 7f43a1eee640 1 -- 172.21.15.12:0/1553132853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 msgr2=0x555683491470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:27.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.713+0000 7f43a1eee640 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 0x555683491470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.713+0000 7f43a1eee640 1 -- 172.21.15.12:0/1553132853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 msgr2=0x555683490f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:27.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.713+0000 7f43a1eee640 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x555683490f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.713+0000 7f43a1eee640 1 -- 172.21.15.12:0/1553132853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556831603c0 con 0x5556834895d0 2024-09-19T06:52:27.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.715+0000 7f43a26ef640 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 0x555683491470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:27.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.717+0000 7f43a1eee640 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 0x555683493c80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f4394019670 tx=0x7f4394019af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8534570a49e540d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:27.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.717+0000 7f43857fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:52:27.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.719+0000 7f43857fa640 1 -- 172.21.15.12:0/1553132853 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394028060 con 0x5556834895d0 2024-09-19T06:52:27.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.719+0000 7f43a652b740 1 -- 172.21.15.12:0/1553132853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f439400fd40 con 0x5556834895d0 2024-09-19T06:52:27.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.719+0000 7f43857fa640 1 -- 172.21.15.12:0/1553132853 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f4394003b80 con 0x5556834895d0 2024-09-19T06:52:27.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.719+0000 7f43857fa640 1 -- 172.21.15.12:0/1553132853 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f439402f050 con 0x5556834895d0 2024-09-19T06:52:27.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.719+0000 7f43a652b740 10 client.18819 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:27.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.719+0000 7f43a652b740 1 -- 172.21.15.12:0/1553132853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5556834a2b00 con 0x5556834895d0 2024-09-19T06:52:27.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.720+0000 7f43857fa640 1 -- 172.21.15.12:0/1553132853 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f439400fd40 con 0x5556834895d0 2024-09-19T06:52:27.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.720+0000 7f43857fa640 1 -- 172.21.15.12:0/1553132853 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f4394018af0 con 0x5556834895d0 2024-09-19T06:52:27.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.720+0000 7f43a16ed640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43880a3430 0x7f43880a58f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4398033040 tx=0x7f4398004cb0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:27.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.720+0000 7f43a652b740 10 client.18819 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:27.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.720+0000 7f43a652b740 10 client.18819 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:52:27.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.720+0000 7f43a652b740 20 client.18819 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:27.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.720+0000 7f43a652b740 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5556834a4390 0x5556834a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.720+0000 7f43a652b740 4 client.18819 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:27.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.720+0000 7f43a652b740 1 -- 172.21.15.12:0/1553132853 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556833fc860 con 0x5556834a4390 2024-09-19T06:52:27.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.721+0000 7f43a16ed640 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5556834a4390 0x5556834a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.721+0000 7f43a16ed640 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5556834a4390 0x5556834a67c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=45fefd15b738b8d server_cookie=97c23af04250823b in_seq=0 out_seq=0 2024-09-19T06:52:27.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.722+0000 7f43857fa640 10 client.18819 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:52:27.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.722+0000 7f43857fa640 1 -- 172.21.15.12:0/1553132853 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556833fc860 con 0x5556834a4390 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.722+0000 7f43857fa640 10 client.18819 handle_command_reply: tid=0 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.722+0000 7f43a652b740 1 client.18819 shutdown 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.723+0000 7f43a652b740 1 -- 172.21.15.12:0/1553132853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 msgr2=0x555683493c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.723+0000 7f43a652b740 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 0x555683493c80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f4394019670 tx=0x7f4394019af0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.724+0000 7f43a652b740 1 -- 172.21.15.12:0/1553132853 shutdown_connections 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.724+0000 7f43a652b740 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5556834a4390 0x5556834a67c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.724+0000 7f43a652b740 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 0x555683491470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.724+0000 7f43a652b740 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x555683490f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.724+0000 7f43a652b740 1 --2- 172.21.15.12:0/1553132853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 0x555683493c80 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.724+0000 7f43a652b740 1 -- 172.21.15.12:0/1553132853 >> 172.21.15.12:0/1553132853 conn(0x555683452310 msgr2=0x55568348b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.724+0000 7f43857fa640 0 client.18819 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:52:27.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.725+0000 7f43a652b740 1 -- 172.21.15.12:0/1553132853 shutdown_connections 2024-09-19T06:52:27.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.725+0000 7f43a652b740 1 -- 172.21.15.12:0/1553132853 wait complete. 2024-09-19T06:52:27.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.725+0000 7f43a652b740 20 client.18819 trim_cache size 0 max 16384 2024-09-19T06:52:27.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.759+0000 7f43a652b740 1 Processor -- start 2024-09-19T06:52:27.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.759+0000 7f43a652b740 1 -- start start 2024-09-19T06:52:27.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a652b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 0x5556834a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a652b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x555683492ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a652b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 0x5556834ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a652b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f439c1c52e0 con 0x5556834895d0 2024-09-19T06:52:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a652b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f439c1c6eb0 con 0x55568348ab40 2024-09-19T06:52:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a652b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f439c1c59b0 con 0x555683494370 2024-09-19T06:52:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a16ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x555683492ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a16ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x555683492ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:53448/0 (socket says 172.21.15.12:53448) 2024-09-19T06:52:27.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a16ed640 1 -- 172.21.15.12:0/3687717340 learned_addr learned my addr 172.21.15.12:0/3687717340 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a26ef640 1 --2- 172.21.15.12:0/3687717340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 0x5556834ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a1eee640 1 --2- 172.21.15.12:0/3687717340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 0x5556834a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a16ed640 1 -- 172.21.15.12:0/3687717340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 msgr2=0x5556834ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a16ed640 1 --2- 172.21.15.12:0/3687717340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 0x5556834ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a16ed640 1 -- 172.21.15.12:0/3687717340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 msgr2=0x5556834a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.760+0000 7f43a16ed640 1 --2- 172.21.15.12:0/3687717340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 0x5556834a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.761+0000 7f43a16ed640 1 -- 172.21.15.12:0/3687717340 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555683486960 con 0x55568348ab40 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.761+0000 7f43a16ed640 1 --2- 172.21.15.12:0/3687717340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x555683492ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4398009900 tx=0x7f4398048000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a709fb15e4618ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.761+0000 7f43877fe640 1 -- 172.21.15.12:0/3687717340 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4398005550 con 0x55568348ab40 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.761+0000 7f43877fe640 1 -- 172.21.15.12:0/3687717340 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4398040930 con 0x55568348ab40 2024-09-19T06:52:27.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.761+0000 7f43877fe640 1 -- 172.21.15.12:0/3687717340 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439803f730 con 0x55568348ab40 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.762+0000 7f43a652b740 1 -- 172.21.15.12:0/3687717340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 msgr2=0x555683492ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.762+0000 7f43a652b740 1 --2- 172.21.15.12:0/3687717340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x555683492ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4398009900 tx=0x7f4398048000 comp rx=0 tx=0).stop 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.763+0000 7f43a652b740 1 -- 172.21.15.12:0/3687717340 shutdown_connections 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.763+0000 7f43a652b740 1 --2- 172.21.15.12:0/3687717340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555683494370 0x5556834ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.763+0000 7f43a652b740 1 --2- 172.21.15.12:0/3687717340 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x555683492ea0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.763+0000 7f43a652b740 1 --2- 172.21.15.12:0/3687717340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556834895d0 0x5556834a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.763+0000 7f43a652b740 1 -- 172.21.15.12:0/3687717340 >> 172.21.15.12:0/3687717340 conn(0x555683452310 msgr2=0x555683492790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.763+0000 7f43a652b740 1 -- 172.21.15.12:0/3687717340 shutdown_connections 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.763+0000 7f43a652b740 1 -- 172.21.15.12:0/3687717340 wait complete. 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.764+0000 7f43a652b740 1 -- start start 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.764+0000 7f43a652b740 1 Processor -- start 2024-09-19T06:52:27.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a652b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x55568349c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a652b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x55568349ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a652b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555683494370 0x55568348d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a652b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f439c1c67e0 con 0x555683494370 2024-09-19T06:52:27.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a652b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f439c1c6110 con 0x55568348ab40 2024-09-19T06:52:27.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a652b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f439c117530 con 0x5556834895d0 2024-09-19T06:52:27.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a652b740 10 client.0 _ll_register_callbacks cb 0x7f4394011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:27.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a16ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x55568349ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a1eee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x55568349c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a1eee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x55568349c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46458/0 (socket says 172.21.15.12:46458) 2024-09-19T06:52:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a1eee640 1 -- 172.21.15.12:0/1166625543 learned_addr learned my addr 172.21.15.12:0/1166625543 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a26ef640 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555683494370 0x55568348d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a1eee640 1 -- 172.21.15.12:0/1166625543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 msgr2=0x55568349ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a1eee640 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x55568349ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a1eee640 1 -- 172.21.15.12:0/1166625543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555683494370 msgr2=0x55568348d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a1eee640 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555683494370 0x55568348d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.765+0000 7f43a1eee640 1 -- 172.21.15.12:0/1166625543 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55568348db50 con 0x5556834895d0 2024-09-19T06:52:27.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.766+0000 7f43a16ed640 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x55568349ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.766+0000 7f43a1eee640 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x55568349c550 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4394005c40 tx=0x7f4394019930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9791998751d2a9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.766+0000 7f43857fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:52:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.766+0000 7f43857fa640 1 -- 172.21.15.12:0/1166625543 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394016020 con 0x5556834895d0 2024-09-19T06:52:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.766+0000 7f43857fa640 1 -- 172.21.15.12:0/1166625543 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f4394003d80 con 0x5556834895d0 2024-09-19T06:52:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.766+0000 7f43a652b740 1 -- 172.21.15.12:0/1166625543 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4398040930 con 0x5556834895d0 2024-09-19T06:52:27.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.766+0000 7f43857fa640 1 -- 172.21.15.12:0/1166625543 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f4394028070 con 0x5556834895d0 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.766+0000 7f43a652b740 10 client.28111 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.766+0000 7f43a652b740 1 -- 172.21.15.12:0/1166625543 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55568350e880 con 0x5556834895d0 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.767+0000 7f43857fa640 1 -- 172.21.15.12:0/1166625543 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4398040930 con 0x5556834895d0 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.767+0000 7f43857fa640 1 -- 172.21.15.12:0/1166625543 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f439400fbd0 con 0x5556834895d0 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.767+0000 7f43a652b740 10 client.28111 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.767+0000 7f43a652b740 10 client.28111 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.767+0000 7f43a652b740 20 client.28111 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.767+0000 7f43a652b740 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55568350f020 0x555683511440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.767+0000 7f43a652b740 4 client.28111 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.767+0000 7f43a652b740 1 -- 172.21.15.12:0/1166625543 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55568348cbd0 con 0x55568350f020 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.767+0000 7f43a16ed640 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55568350f020 0x555683511440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43857fa640 10 client.28111 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:52:27.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43a16ed640 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55568350f020 0x555683511440 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=89f87f2f8aec6b4c server_cookie=ee7cc78dca331fd0 in_seq=0 out_seq=0 2024-09-19T06:52:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43857fa640 1 -- 172.21.15.12:0/1166625543 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55568348cbd0 con 0x55568350f020 2024-09-19T06:52:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43857fa640 10 client.28111 handle_command_reply: tid=0 2024-09-19T06:52:27.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43a652b740 1 client.28111 shutdown 2024-09-19T06:52:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43a652b740 1 -- 172.21.15.12:0/1166625543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 msgr2=0x55568349c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43a652b740 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x55568349c550 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4394005c40 tx=0x7f4394019930 comp rx=0 tx=0).stop 2024-09-19T06:52:27.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43a652b740 1 -- 172.21.15.12:0/1166625543 shutdown_connections 2024-09-19T06:52:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43a652b740 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55568350f020 0x555683511440 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43a652b740 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555683494370 0x55568348d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43a652b740 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55568348ab40 0x55568349ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43857fa640 0 client.28111 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:52:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43a652b740 1 --2- 172.21.15.12:0/1166625543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556834895d0 0x55568349c550 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.768+0000 7f43a652b740 1 -- 172.21.15.12:0/1166625543 >> 172.21.15.12:0/1166625543 conn(0x555683452310 msgr2=0x555683492fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.769+0000 7f43a652b740 1 -- 172.21.15.12:0/1166625543 shutdown_connections 2024-09-19T06:52:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.769+0000 7f43a652b740 1 -- 172.21.15.12:0/1166625543 wait complete. 2024-09-19T06:52:27.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.769+0000 7f43a652b740 20 client.28111 trim_cache size 0 max 16384 2024-09-19T06:52:27.776 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:52:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.770+0000 7f43a4152640 1 -- 172.21.15.12:0/3031745600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43880a3430 msgr2=0x7f43880a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.770+0000 7f43a4152640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43880a3430 0x7f43880a58f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4398033040 tx=0x7f4398004cb0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.770+0000 7f43a4152640 1 -- 172.21.15.12:0/3031745600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c11b140 msgr2=0x7f439c1abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.770+0000 7f43a4152640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c11b140 0x7f439c1abc40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f438c00b410 tx=0x7f438c00b8d0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.770+0000 7f43a4152640 1 -- 172.21.15.12:0/3031745600 shutdown_connections 2024-09-19T06:52:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.770+0000 7f43a4152640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c11b140 0x7f439c1abc40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.770+0000 7f43a4152640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43880a3430 0x7f43880a58f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.770+0000 7f43a4152640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f439c109830 0x7f439c1a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.770+0000 7f43a4152640 1 --2- 172.21.15.12:0/3031745600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f439c109450 0x7f439c1a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.770+0000 7f43a4152640 1 -- 172.21.15.12:0/3031745600 >> 172.21.15.12:0/3031745600 conn(0x7f439c06e140 msgr2=0x7f439c11bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.772+0000 7f43a4152640 1 -- 172.21.15.12:0/3031745600 shutdown_connections 2024-09-19T06:52:27.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:27.772+0000 7f43a4152640 1 -- 172.21.15.12:0/3031745600 wait complete. 2024-09-19T06:52:28.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:27 smithi012 ceph-mon[30937]: pgmap v384: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 MiB/s wr, 1.76k op/s 2024-09-19T06:52:28.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:27 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:52:28.246 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:27 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.247 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:27 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.247 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:27 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.247 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:27 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:27 smithi016 ceph-mon[34911]: pgmap v384: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 MiB/s wr, 1.76k op/s 2024-09-19T06:52:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:27 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:52:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:27 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:27 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:27 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:27 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:27 smithi173 ceph-mon[35349]: pgmap v384: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 MiB/s wr, 1.76k op/s 2024-09-19T06:52:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:27 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:52:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:27 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:27 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:27 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:27 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:28.687 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:52:29.085 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:29.216 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:28 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:52:29.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:28 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:52:29.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:28 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:28 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:52:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:28 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:52:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:28 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:28 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:52:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:28 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:52:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:28 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:52:29.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.818+0000 7fde06c90640 1 -- 172.21.15.12:0/1681208826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde00110190 msgr2=0x7fde0006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:29.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.818+0000 7fde06c90640 1 --2- 172.21.15.12:0/1681208826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde00110190 0x7fde0006e4f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009900 tx=0x7fddfc02a440 comp rx=0 tx=0).stop 2024-09-19T06:52:29.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.821+0000 7fde06c90640 1 -- 172.21.15.12:0/1681208826 shutdown_connections 2024-09-19T06:52:29.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.821+0000 7fde06c90640 1 --2- 172.21.15.12:0/1681208826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde0011b140 0x7fde0011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.821+0000 7fde06c90640 1 --2- 172.21.15.12:0/1681208826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde0006ea30 0x7fde0006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.821+0000 7fde06c90640 1 --2- 172.21.15.12:0/1681208826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde00110190 0x7fde0006e4f0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.821+0000 7fde06c90640 1 -- 172.21.15.12:0/1681208826 >> 172.21.15.12:0/1681208826 conn(0x7fde00073180 msgr2=0x7fde00073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.824+0000 7fde06c90640 1 -- 172.21.15.12:0/1681208826 shutdown_connections 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.824+0000 7fde06c90640 1 -- 172.21.15.12:0/1681208826 wait complete. 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.825+0000 7fde06c90640 1 Processor -- start 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.825+0000 7fde06c90640 1 -- start start 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.825+0000 7fde06c90640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde0006ea30 0x7fde001a7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.826+0000 7fde06c90640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde00110190 0x7fde001a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.826+0000 7fde06c90640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0011b140 0x7fde001aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.826+0000 7fde06c90640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fde00120bf0 con 0x7fde0011b140 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.826+0000 7fde06c90640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fde00120a70 con 0x7fde0006ea30 2024-09-19T06:52:29.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.826+0000 7fde06c90640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fde00120d70 con 0x7fde00110190 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.826+0000 7fde0648f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0011b140 0x7fde001aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.826+0000 7fde0648f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0011b140 0x7fde001aba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55646/0 (socket says 172.21.15.12:55646) 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.826+0000 7fde0648f640 1 -- 172.21.15.12:0/2342497359 learned_addr learned my addr 172.21.15.12:0/2342497359 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.826+0000 7fde0548d640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde00110190 0x7fde001a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.826+0000 7fde05c8e640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde0006ea30 0x7fde001a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fde0548d640 1 -- 172.21.15.12:0/2342497359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde0006ea30 msgr2=0x7fde001a7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fde0548d640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde0006ea30 0x7fde001a7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fde0548d640 1 -- 172.21.15.12:0/2342497359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0011b140 msgr2=0x7fde001aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fde0548d640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0011b140 0x7fde001aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fde0548d640 1 -- 172.21.15.12:0/2342497359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde001ac140 con 0x7fde00110190 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fde0548d640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde00110190 0x7fde001a76b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fddf000d6d0 tx=0x7fddf000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fddf6ffd640 1 -- 172.21.15.12:0/2342497359 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0017070 con 0x7fde00110190 2024-09-19T06:52:29.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fde06c90640 1 -- 172.21.15.12:0/2342497359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde001ac430 con 0x7fde00110190 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fddf6ffd640 1 -- 172.21.15.12:0/2342497359 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddf0009820 con 0x7fde00110190 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fde06c90640 1 -- 172.21.15.12:0/2342497359 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde00110920 con 0x7fde00110190 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.827+0000 7fddf6ffd640 1 -- 172.21.15.12:0/2342497359 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0004c60 con 0x7fde00110190 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.832+0000 7fddf6ffd640 1 -- 172.21.15.12:0/2342497359 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fddf00099d0 con 0x7fde00110190 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.832+0000 7fde0a2cb740 1 Processor -- start 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.832+0000 7fde0a2cb740 1 -- start start 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.833+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c8cf0 0x5556188c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.833+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c7780 0x5556188c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.833+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188d2520 0x5556188d4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.833+0000 7fde0a2cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55561882d2f0 con 0x5556188c8cf0 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.833+0000 7fde0a2cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5556187d4cf0 con 0x5556188c7780 2024-09-19T06:52:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.833+0000 7fde0a2cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5556188292b0 con 0x5556188d2520 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.833+0000 7fde05c8e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c7780 0x5556188c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.833+0000 7fde05c8e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c7780 0x5556188c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:53480/0 (socket says 172.21.15.12:53480) 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.833+0000 7fde05c8e640 1 -- 172.21.15.12:0/718026464 learned_addr learned my addr 172.21.15.12:0/718026464 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.833+0000 7fde0548d640 1 --2- 172.21.15.12:0/718026464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188d2520 0x5556188d4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.834+0000 7fde0648f640 1 --2- 172.21.15.12:0/718026464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c8cf0 0x5556188c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.834+0000 7fde05c8e640 1 -- 172.21.15.12:0/718026464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188d2520 msgr2=0x5556188d4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.834+0000 7fde05c8e640 1 --2- 172.21.15.12:0/718026464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188d2520 0x5556188d4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.834+0000 7fde05c8e640 1 -- 172.21.15.12:0/718026464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c8cf0 msgr2=0x5556188c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.834+0000 7fde05c8e640 1 --2- 172.21.15.12:0/718026464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c8cf0 0x5556188c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.834+0000 7fde05c8e640 1 -- 172.21.15.12:0/718026464 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556187b93a0 con 0x5556188c7780 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.834+0000 7fde0548d640 1 --2- 172.21.15.12:0/718026464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188d2520 0x5556188d4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.834+0000 7fde05c8e640 1 --2- 172.21.15.12:0/718026464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c7780 0x5556188c7bc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fddfc033000 tx=0x7fddfc004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6bc6dc1fea56cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.835+0000 7fddebfff640 1 -- 172.21.15.12:0/718026464 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc035030 con 0x5556188c7780 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.835+0000 7fddebfff640 1 -- 172.21.15.12:0/718026464 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddfc005520 con 0x5556188c7780 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.836+0000 7fddf6ffd640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddec0a3430 0x7fddec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.836+0000 7fddf6ffd640 1 -- 172.21.15.12:0/2342497359 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7fddf00cfa10 con 0x7fde00110190 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.836+0000 7fde0a2cb740 1 -- 172.21.15.12:0/718026464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c7780 msgr2=0x5556188c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.836+0000 7fde0648f640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddec0a3430 0x7fddec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.836+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/718026464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c7780 0x5556188c7bc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fddfc033000 tx=0x7fddfc004170 comp rx=0 tx=0).stop 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.836+0000 7fde0a2cb740 1 -- 172.21.15.12:0/718026464 shutdown_connections 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.836+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/718026464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188d2520 0x5556188d4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.836+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/718026464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c7780 0x5556188c7bc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.836+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/718026464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c8cf0 0x5556188c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.836+0000 7fde0a2cb740 1 -- 172.21.15.12:0/718026464 >> 172.21.15.12:0/718026464 conn(0x555618890310 msgr2=0x5556188c3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.837+0000 7fde0a2cb740 1 -- 172.21.15.12:0/718026464 shutdown_connections 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.837+0000 7fde0a2cb740 1 -- 172.21.15.12:0/718026464 wait complete. 2024-09-19T06:52:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.837+0000 7fde0648f640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddec0a3430 0x7fddec0a58f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fddf8007450 tx=0x7fddf800b040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.837+0000 7fde0a2cb740 1 -- start start 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.837+0000 7fde0a2cb740 1 Processor -- start 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 0x5556188d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c8cf0 0x5556188cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde0a2cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5556188d5260 con 0x5556188c7780 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde0a2cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5556187e8060 con 0x5556188d2520 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde0a2cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5556188d53e0 con 0x5556188c8cf0 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde0a2cb740 10 client.0 _ll_register_callbacks cb 0x55561853b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde0648f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde0648f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:53486/0 (socket says 172.21.15.12:53486) 2024-09-19T06:52:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde0648f640 1 -- 172.21.15.12:0/1830539196 learned_addr learned my addr 172.21.15.12:0/1830539196 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.838+0000 7fde05c8e640 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 0x5556188d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fde0548d640 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c8cf0 0x5556188cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fde0648f640 1 -- 172.21.15.12:0/1830539196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c8cf0 msgr2=0x5556188cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fde0648f640 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c8cf0 0x5556188cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fde0648f640 1 -- 172.21.15.12:0/1830539196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 msgr2=0x5556188d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fde0648f640 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 0x5556188d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fde0648f640 1 -- 172.21.15.12:0/1830539196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55561859e3c0 con 0x5556188d2520 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fde0648f640 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188cf790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fddf8016ea0 tx=0x7fddf8004a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ffa4553efd3c163 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fdde97fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fdde97fa640 1 -- 172.21.15.12:0/1830539196 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8025020 con 0x5556188d2520 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fdde97fa640 1 -- 172.21.15.12:0/1830539196 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7fddf8017d50 con 0x5556188d2520 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.839+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1830539196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55561883a860 con 0x5556188d2520 2024-09-19T06:52:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.840+0000 7fdde97fa640 1 -- 172.21.15.12:0/1830539196 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fddf801d040 con 0x5556188d2520 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.840+0000 7fde0a2cb740 10 client.28184 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.840+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1830539196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5556188e0e40 con 0x5556188d2520 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.840+0000 7fdde97fa640 1 -- 172.21.15.12:0/1830539196 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55561883a860 con 0x5556188d2520 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.840+0000 7fdde97fa640 1 -- 172.21.15.12:0/1830539196 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7fddf8020030 con 0x5556188d2520 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.840+0000 7fde0a2cb740 10 client.28184 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.840+0000 7fde0a2cb740 10 client.28184 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.840+0000 7fde0a2cb740 20 client.28184 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.841+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5556188e2250 0x5556188e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.841+0000 7fde0a2cb740 4 client.28184 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.841+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1830539196 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555618834d70 con 0x5556188e2250 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.841+0000 7fde05c8e640 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5556188e2250 0x5556188e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.842+0000 7fde05c8e640 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5556188e2250 0x5556188e46c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7e5ff155a03c8ebc server_cookie=4b9b117e34c7dc92 in_seq=0 out_seq=0 2024-09-19T06:52:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.842+0000 7fdde97fa640 10 client.28184 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.843+0000 7fdde97fa640 1 -- 172.21.15.12:0/1830539196 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555618834d70 con 0x5556188e2250 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.844+0000 7fdde97fa640 10 client.28184 handle_command_reply: tid=0 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.844+0000 7fde0a2cb740 1 client.28184 shutdown 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.844+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1830539196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 msgr2=0x5556188cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.844+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188cf790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fddf8016ea0 tx=0x7fddf8004a60 comp rx=0 tx=0).stop 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.844+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1830539196 shutdown_connections 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.844+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5556188e2250 0x5556188e46c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.844+0000 7fdde97fa640 0 client.28184 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.844+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188cf790 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.845+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c8cf0 0x5556188cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.845+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/1830539196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 0x5556188d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.845+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1830539196 >> 172.21.15.12:0/1830539196 conn(0x555618890310 msgr2=0x5556188c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.845+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1830539196 shutdown_connections 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.845+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1830539196 wait complete. 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.845+0000 7fde0a2cb740 20 client.28184 trim_cache size 0 max 16384 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.863+0000 7fde0a2cb740 1 Processor -- start 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.863+0000 7fde0a2cb740 1 -- start start 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.864+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 0x5556188de580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.864+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c8cf0 0x5556188ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.864+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188ca810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.864+0000 7fde0a2cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fde001c50e0 con 0x5556188c7780 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.864+0000 7fde0a2cb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fde001c6cb0 con 0x5556188d2520 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.864+0000 7fde0a2cb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fde001c57b0 con 0x5556188c8cf0 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.864+0000 7fde0648f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.864+0000 7fde0648f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:53498/0 (socket says 172.21.15.12:53498) 2024-09-19T06:52:29.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.864+0000 7fde0648f640 1 -- 172.21.15.12:0/1015773584 learned_addr learned my addr 172.21.15.12:0/1015773584 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.865+0000 7fde05c8e640 1 --2- 172.21.15.12:0/1015773584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 0x5556188de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.865+0000 7fde0548d640 1 --2- 172.21.15.12:0/1015773584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c8cf0 0x5556188ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.865+0000 7fde05c8e640 1 -- 172.21.15.12:0/1015773584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c8cf0 msgr2=0x5556188ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.865+0000 7fde05c8e640 1 --2- 172.21.15.12:0/1015773584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c8cf0 0x5556188ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.865+0000 7fde05c8e640 1 -- 172.21.15.12:0/1015773584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 msgr2=0x5556188ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.865+0000 7fde05c8e640 1 --2- 172.21.15.12:0/1015773584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.865+0000 7fde05c8e640 1 -- 172.21.15.12:0/1015773584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556188cd6f0 con 0x5556188c7780 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.866+0000 7fde05c8e640 1 --2- 172.21.15.12:0/1015773584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 0x5556188de580 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fddfc02a960 tx=0x7fddfc004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a2a9f2d2004964 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.866+0000 7fddeb7fe640 1 -- 172.21.15.12:0/1015773584 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc035040 con 0x5556188c7780 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.866+0000 7fddeb7fe640 1 -- 172.21.15.12:0/1015773584 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddfc031540 con 0x5556188c7780 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.866+0000 7fddeb7fe640 1 -- 172.21.15.12:0/1015773584 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc03b690 con 0x5556188c7780 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.867+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1015773584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 msgr2=0x5556188de580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:29.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.868+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/1015773584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 0x5556188de580 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fddfc02a960 tx=0x7fddfc004310 comp rx=0 tx=0).stop 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.868+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1015773584 shutdown_connections 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.868+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/1015773584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188d2520 0x5556188ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.868+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/1015773584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c8cf0 0x5556188ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.868+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/1015773584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188c7780 0x5556188de580 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.868+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1015773584 >> 172.21.15.12:0/1015773584 conn(0x555618890310 msgr2=0x5556188cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.868+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1015773584 shutdown_connections 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.868+0000 7fde0a2cb740 1 -- 172.21.15.12:0/1015773584 wait complete. 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.869+0000 7fde0a2cb740 1 -- start start 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.869+0000 7fde0a2cb740 1 Processor -- start 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.870+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c7780 0x5556188dacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.870+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c8cf0 0x5556188e9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.870+0000 7fde0a2cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188d2520 0x5556188e9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.870+0000 7fde05c8e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c7780 0x5556188dacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.870+0000 7fde05c8e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c7780 0x5556188dacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:46526/0 (socket says 172.21.15.12:46526) 2024-09-19T06:52:29.938 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:52:29.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.870+0000 7fde05c8e640 1 -- 172.21.15.12:0/3135150747 learned_addr learned my addr 172.21.15.12:0/3135150747 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:29.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.870+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fde001c65e0 con 0x5556188d2520 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.870+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fde001c5f10 con 0x5556188c8cf0 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.870+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fde001a84d0 con 0x5556188c7780 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.870+0000 7fde0a2cb740 10 client.0 _ll_register_callbacks cb 0x7fddf8009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fde0548d640 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c8cf0 0x5556188e9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fde0648f640 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188d2520 0x5556188e9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fde05c8e640 1 -- 172.21.15.12:0/3135150747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c8cf0 msgr2=0x5556188e9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fde05c8e640 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c8cf0 0x5556188e9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fde05c8e640 1 -- 172.21.15.12:0/3135150747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188d2520 msgr2=0x5556188e9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fde05c8e640 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188d2520 0x5556188e9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fde05c8e640 1 -- 172.21.15.12:0/3135150747 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556188ea330 con 0x5556188c7780 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fde0548d640 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c8cf0 0x5556188e9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:29.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fde0648f640 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188d2520 0x5556188e9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:29.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fde05c8e640 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c7780 0x5556188dacd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fddfc005d10 tx=0x7fddfc005d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99c5479766aba191 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:29.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fdde97fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:52:29.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.871+0000 7fdde97fa640 1 -- 172.21.15.12:0/3135150747 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc035040 con 0x5556188c7780 2024-09-19T06:52:29.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fdde97fa640 1 -- 172.21.15.12:0/3135150747 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7fddfc003c00 con 0x5556188c7780 2024-09-19T06:52:29.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddfc031540 con 0x5556188c7780 2024-09-19T06:52:29.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fdde97fa640 1 -- 172.21.15.12:0/3135150747 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fddfc003e00 con 0x5556188c7780 2024-09-19T06:52:29.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fde0a2cb740 10 client.28129 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:29.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55561894cfb0 con 0x5556188c7780 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fdde97fa640 1 -- 172.21.15.12:0/3135150747 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddfc031540 con 0x5556188c7780 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fdde97fa640 1 -- 172.21.15.12:0/3135150747 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7fddfc04c070 con 0x5556188c7780 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fde0a2cb740 10 client.28129 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fde0a2cb740 10 client.28129 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fde0a2cb740 20 client.28129 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.872+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5556188e2250 0x55561894f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.873+0000 7fde0a2cb740 4 client.28129 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.873+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556187b1170 con 0x5556188e2250 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.873+0000 7fde0548d640 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5556188e2250 0x55561894f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.873+0000 7fdde97fa640 10 client.28129 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.873+0000 7fde0548d640 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5556188e2250 0x55561894f190 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2176fb3e8ef64131 server_cookie=c00922072f10c07e in_seq=0 out_seq=0 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.873+0000 7fdde97fa640 1 -- 172.21.15.12:0/3135150747 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556187b1170 con 0x5556188e2250 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.873+0000 7fdde97fa640 10 client.28129 handle_command_reply: tid=0 2024-09-19T06:52:29.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.873+0000 7fde0a2cb740 1 client.28129 shutdown 2024-09-19T06:52:29.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.873+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c7780 msgr2=0x5556188dacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:29.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.873+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c7780 0x5556188dacd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fddfc005d10 tx=0x7fddfc005d40 comp rx=0 tx=0).stop 2024-09-19T06:52:29.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.874+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 shutdown_connections 2024-09-19T06:52:29.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.874+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5556188e2250 0x55561894f190 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.874+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5556188d2520 0x5556188e9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.874+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5556188c8cf0 0x5556188e9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.874+0000 7fde0a2cb740 1 --2- 172.21.15.12:0/3135150747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556188c7780 0x5556188dacd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.874+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 >> 172.21.15.12:0/3135150747 conn(0x555618890310 msgr2=0x5556188c2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:29.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.874+0000 7fdde97fa640 0 client.28129 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.874+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 shutdown_connections 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.875+0000 7fde0a2cb740 1 -- 172.21.15.12:0/3135150747 wait complete. 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.875+0000 7fde0a2cb740 20 client.28129 trim_cache size 0 max 16384 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.876+0000 7fde06c90640 1 -- 172.21.15.12:0/2342497359 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddec0a3430 msgr2=0x7fddec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.876+0000 7fde06c90640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddec0a3430 0x7fddec0a58f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fddf8007450 tx=0x7fddf800b040 comp rx=0 tx=0).stop 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.876+0000 7fde06c90640 1 -- 172.21.15.12:0/2342497359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde00110190 msgr2=0x7fde001a76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.876+0000 7fde06c90640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde00110190 0x7fde001a76b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fddf000d6d0 tx=0x7fddf000db90 comp rx=0 tx=0).stop 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.876+0000 7fde06c90640 1 -- 172.21.15.12:0/2342497359 shutdown_connections 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.876+0000 7fde06c90640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0011b140 0x7fde001aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.876+0000 7fde06c90640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fddec0a3430 0x7fddec0a58f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.876+0000 7fde06c90640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde00110190 0x7fde001a76b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.876+0000 7fde06c90640 1 --2- 172.21.15.12:0/2342497359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde0006ea30 0x7fde001a7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:29.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.876+0000 7fde06c90640 1 -- 172.21.15.12:0/2342497359 >> 172.21.15.12:0/2342497359 conn(0x7fde00073180 msgr2=0x7fde0011a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:29.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.877+0000 7fde06c90640 1 -- 172.21.15.12:0/2342497359 shutdown_connections 2024-09-19T06:52:29.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:29.877+0000 7fde06c90640 1 -- 172.21.15.12:0/2342497359 wait complete. 2024-09-19T06:52:30.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:29 smithi012 ceph-mon[30937]: pgmap v385: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 1.68k op/s 2024-09-19T06:52:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:29 smithi016 ceph-mon[34911]: pgmap v385: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 1.68k op/s 2024-09-19T06:52:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:29 smithi173 ceph-mon[35349]: pgmap v385: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 1.68k op/s 2024-09-19T06:52:30.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 705.0 s, 2018.6 tps, lat 50.029 ms stddev 67.849 2024-09-19T06:52:31.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:52:31.974 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:32.247 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:31 smithi012 ceph-mon[30937]: pgmap v386: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 34 MiB/s wr, 2.25k op/s 2024-09-19T06:52:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:31 smithi016 ceph-mon[34911]: pgmap v386: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 34 MiB/s wr, 2.25k op/s 2024-09-19T06:52:32.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:31 smithi173 ceph-mon[35349]: pgmap v386: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 34 MiB/s wr, 2.25k op/s 2024-09-19T06:52:32.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.559+0000 7f33e233b640 1 -- 172.21.15.12:0/1197808632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33dc109450 msgr2=0x7f33dc110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.559+0000 7f33e233b640 1 --2- 172.21.15.12:0/1197808632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33dc109450 0x7f33dc110250 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f33d401acb0 tx=0x7f33d403b900 comp rx=0 tx=0).stop 2024-09-19T06:52:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.559+0000 7f33e233b640 1 -- 172.21.15.12:0/1197808632 shutdown_connections 2024-09-19T06:52:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.559+0000 7f33e233b640 1 --2- 172.21.15.12:0/1197808632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33dc11b140 0x7f33dc11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.559+0000 7f33e233b640 1 --2- 172.21.15.12:0/1197808632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33dc109830 0x7f33dc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.559+0000 7f33e233b640 1 --2- 172.21.15.12:0/1197808632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33dc109450 0x7f33dc110250 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.559+0000 7f33e233b640 1 -- 172.21.15.12:0/1197808632 >> 172.21.15.12:0/1197808632 conn(0x7f33dc06e140 msgr2=0x7f33dc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.561+0000 7f33e233b640 1 -- 172.21.15.12:0/1197808632 shutdown_connections 2024-09-19T06:52:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.561+0000 7f33e233b640 1 -- 172.21.15.12:0/1197808632 wait complete. 2024-09-19T06:52:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.562+0000 7f33e233b640 1 Processor -- start 2024-09-19T06:52:32.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.564+0000 7f33e233b640 1 -- start start 2024-09-19T06:52:32.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.564+0000 7f33e233b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33dc109450 0x7f33dc11a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.564+0000 7f33e233b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33dc109830 0x7f33dc1168e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.564+0000 7f33e233b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33dc11b140 0x7f33dc116e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.564+0000 7f33e233b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc113320 con 0x7f33dc11b140 2024-09-19T06:52:32.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.564+0000 7f33e233b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc1131a0 con 0x7f33dc109450 2024-09-19T06:52:32.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.564+0000 7f33e233b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc1134a0 con 0x7f33dc109830 2024-09-19T06:52:32.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.564+0000 7f33e08d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33dc11b140 0x7f33dc116e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.564+0000 7f33e08d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33dc11b140 0x7f33dc116e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36114/0 (socket says 172.21.15.12:36114) 2024-09-19T06:52:32.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.564+0000 7f33e08d8640 1 -- 172.21.15.12:0/1667993621 learned_addr learned my addr 172.21.15.12:0/1667993621 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:32.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.565+0000 7f33db7fe640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33dc109830 0x7f33dc1168e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.565+0000 7f33dbfff640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33dc109450 0x7f33dc11a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.565+0000 7f33e08d8640 1 -- 172.21.15.12:0/1667993621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33dc109830 msgr2=0x7f33dc1168e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.565+0000 7f33e08d8640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33dc109830 0x7f33dc1168e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.565+0000 7f33e08d8640 1 -- 172.21.15.12:0/1667993621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33dc109450 msgr2=0x7f33dc11a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.565+0000 7f33e08d8640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33dc109450 0x7f33dc11a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.565+0000 7f33e08d8640 1 -- 172.21.15.12:0/1667993621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33dc117550 con 0x7f33dc11b140 2024-09-19T06:52:32.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.565+0000 7f33e08d8640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33dc11b140 0x7f33dc116e20 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f33d0001ea0 tx=0x7f33d000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:32.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.566+0000 7f33d97fa640 1 -- 172.21.15.12:0/1667993621 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0004020 con 0x7f33dc11b140 2024-09-19T06:52:32.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.566+0000 7f33d97fa640 1 -- 172.21.15.12:0/1667993621 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33d00041c0 con 0x7f33dc11b140 2024-09-19T06:52:32.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.566+0000 7f33d97fa640 1 -- 172.21.15.12:0/1667993621 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d00338a0 con 0x7f33dc11b140 2024-09-19T06:52:32.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.566+0000 7f33e233b640 1 -- 172.21.15.12:0/1667993621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33dc074420 con 0x7f33dc11b140 2024-09-19T06:52:32.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.567+0000 7f33e233b640 1 -- 172.21.15.12:0/1667993621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33dc074960 con 0x7f33dc11b140 2024-09-19T06:52:32.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.572+0000 7f33d97fa640 1 -- 172.21.15.12:0/1667993621 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f33d003b020 con 0x7f33dc11b140 2024-09-19T06:52:32.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.572+0000 7f33e4714740 1 Processor -- start 2024-09-19T06:52:32.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.572+0000 7f33e4714740 1 -- start start 2024-09-19T06:52:32.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33d97fa640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33c40a35c0 0x7f33c40a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33e4714740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 0x55ce173cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33e4714740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173cd5d0 0x55ce173cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33e4714740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 0x55ce173da760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33e4714740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce173332f0 con 0x55ce173d8370 2024-09-19T06:52:32.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33e4714740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ce172dacf0 con 0x55ce173ceb40 2024-09-19T06:52:32.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33e4714740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ce1732f2b0 con 0x55ce173cd5d0 2024-09-19T06:52:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33d97fa640 1 -- 172.21.15.12:0/1667993621 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f33d00f1cc0 con 0x7f33dc11b140 2024-09-19T06:52:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173cd5d0 0x55ce173cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173cd5d0 0x55ce173cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:56044/0 (socket says 172.21.15.12:56044) 2024-09-19T06:52:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33db7fe640 1 -- 172.21.15.12:0/325783837 learned_addr learned my addr 172.21.15.12:0/325783837 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.574+0000 7f33db7fe640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33c40a35c0 0x7f33c40a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.575+0000 7f33e08d8640 1 --2- 172.21.15.12:0/325783837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 0x55ce173da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.575+0000 7f33dbfff640 1 --2- 172.21.15.12:0/325783837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 0x55ce173cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.575+0000 7f33db7fe640 1 -- 172.21.15.12:0/325783837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 msgr2=0x55ce173cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:32.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.575+0000 7f33db7fe640 1 --2- 172.21.15.12:0/325783837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 0x55ce173cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.575+0000 7f33db7fe640 1 -- 172.21.15.12:0/325783837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 msgr2=0x55ce173da760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.575+0000 7f33db7fe640 1 --2- 172.21.15.12:0/325783837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 0x55ce173da760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.575+0000 7f33db7fe640 1 -- 172.21.15.12:0/325783837 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce172bf3a0 con 0x55ce173cd5d0 2024-09-19T06:52:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.575+0000 7f33e08d8640 1 --2- 172.21.15.12:0/325783837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 0x55ce173da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.575+0000 7f33db7fe640 1 --2- 172.21.15.12:0/325783837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173cd5d0 0x55ce173cda10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0127f0 tx=0x7f33cc012cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8ab7614feff9b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.577+0000 7f33db7fe640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33c40a35c0 0x7f33c40a5a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f33cc023000 tx=0x7f33cc00ef00 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.577+0000 7f33c27fc640 1 -- 172.21.15.12:0/325783837 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc010bb0 con 0x55ce173cd5d0 2024-09-19T06:52:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.577+0000 7f33c27fc640 1 -- 172.21.15.12:0/325783837 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33cc010d50 con 0x55ce173cd5d0 2024-09-19T06:52:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.577+0000 7f33c27fc640 1 -- 172.21.15.12:0/325783837 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc00e770 con 0x55ce173cd5d0 2024-09-19T06:52:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.578+0000 7f33e4714740 1 -- 172.21.15.12:0/325783837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173cd5d0 msgr2=0x55ce173cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.578+0000 7f33e4714740 1 --2- 172.21.15.12:0/325783837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173cd5d0 0x55ce173cda10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0127f0 tx=0x7f33cc012cb0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.579+0000 7f33e4714740 1 -- 172.21.15.12:0/325783837 shutdown_connections 2024-09-19T06:52:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.579+0000 7f33e4714740 1 --2- 172.21.15.12:0/325783837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 0x55ce173da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.579+0000 7f33e4714740 1 --2- 172.21.15.12:0/325783837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173cd5d0 0x55ce173cda10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.579+0000 7f33e4714740 1 --2- 172.21.15.12:0/325783837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 0x55ce173cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.579+0000 7f33e4714740 1 -- 172.21.15.12:0/325783837 >> 172.21.15.12:0/325783837 conn(0x55ce17396310 msgr2=0x55ce173c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.581+0000 7f33e4714740 1 -- 172.21.15.12:0/325783837 shutdown_connections 2024-09-19T06:52:32.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.581+0000 7f33e4714740 1 -- 172.21.15.12:0/325783837 wait complete. 2024-09-19T06:52:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.582+0000 7f33e4714740 1 -- start start 2024-09-19T06:52:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.582+0000 7f33e4714740 1 Processor -- start 2024-09-19T06:52:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.583+0000 7f33e4714740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 0x55ce173d7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.583+0000 7f33e4714740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173ceb40 0x55ce173d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.583+0000 7f33e4714740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 0x55ce173d5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.583+0000 7f33e4714740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce173db070 con 0x55ce173d8370 2024-09-19T06:52:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.583+0000 7f33e4714740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ce172ee060 con 0x55ce173cd5d0 2024-09-19T06:52:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.583+0000 7f33e4714740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ce173db1f0 con 0x55ce173ceb40 2024-09-19T06:52:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.583+0000 7f33e4714740 10 client.0 _ll_register_callbacks cb 0x55ce170418c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.584+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173ceb40 0x55ce173d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.584+0000 7f33dbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 0x55ce173d7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.584+0000 7f33e08d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 0x55ce173d5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.584+0000 7f33e08d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 0x55ce173d5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36136/0 (socket says 172.21.15.12:36136) 2024-09-19T06:52:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.584+0000 7f33e08d8640 1 -- 172.21.15.12:0/1264196257 learned_addr learned my addr 172.21.15.12:0/1264196257 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.585+0000 7f33dbfff640 1 -- 172.21.15.12:0/1264196257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173ceb40 msgr2=0x55ce173d4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.585+0000 7f33dbfff640 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173ceb40 0x55ce173d4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.585+0000 7f33dbfff640 1 -- 172.21.15.12:0/1264196257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 msgr2=0x55ce173d5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.585+0000 7f33dbfff640 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 0x55ce173d5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.585+0000 7f33dbfff640 1 -- 172.21.15.12:0/1264196257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce170a43c0 con 0x55ce173cd5d0 2024-09-19T06:52:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.585+0000 7f33dbfff640 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 0x55ce173d7d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f33d4006010 tx=0x7f33d40418a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=705bb39267679b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.585+0000 7f33bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:52:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.587+0000 7f33bb7fe640 1 -- 172.21.15.12:0/1264196257 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d4045040 con 0x55ce173cd5d0 2024-09-19T06:52:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.587+0000 7f33e4714740 1 -- 172.21.15.12:0/1264196257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33cc010d50 con 0x55ce173cd5d0 2024-09-19T06:52:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.587+0000 7f33bb7fe640 1 -- 172.21.15.12:0/1264196257 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f33d4019040 con 0x55ce173cd5d0 2024-09-19T06:52:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.587+0000 7f33bb7fe640 1 -- 172.21.15.12:0/1264196257 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f33d4060050 con 0x55ce173cd5d0 2024-09-19T06:52:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.587+0000 7f33e4714740 10 client.28199 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.588+0000 7f33e4714740 1 -- 172.21.15.12:0/1264196257 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55ce173e6aa0 con 0x55ce173cd5d0 2024-09-19T06:52:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.588+0000 7f33bb7fe640 1 -- 172.21.15.12:0/1264196257 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33cc010d50 con 0x55ce173cd5d0 2024-09-19T06:52:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.588+0000 7f33bb7fe640 1 -- 172.21.15.12:0/1264196257 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f33d405b030 con 0x55ce173cd5d0 2024-09-19T06:52:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.588+0000 7f33e4714740 10 client.28199 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.588+0000 7f33e4714740 10 client.28199 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:52:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.588+0000 7f33e4714740 20 client.28199 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.588+0000 7f33e4714740 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ce173e8430 0x55ce173ea890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.588+0000 7f33e4714740 4 client.28199 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.588+0000 7f33e4714740 1 -- 172.21.15.12:0/1264196257 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce17340860 con 0x55ce173e8430 2024-09-19T06:52:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.589+0000 7f33db7fe640 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ce173e8430 0x55ce173ea890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.590+0000 7f33db7fe640 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ce173e8430 0x55ce173ea890 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=380188aa79617d88 server_cookie=b9b9548105d33bfc in_seq=0 out_seq=0 2024-09-19T06:52:32.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.590+0000 7f33bb7fe640 10 client.28199 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:52:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.590+0000 7f33bb7fe640 1 -- 172.21.15.12:0/1264196257 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce17340860 con 0x55ce173e8430 2024-09-19T06:52:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.590+0000 7f33bb7fe640 10 client.28199 handle_command_reply: tid=0 2024-09-19T06:52:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.590+0000 7f33e4714740 1 client.28199 shutdown 2024-09-19T06:52:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 1 -- 172.21.15.12:0/1264196257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 msgr2=0x55ce173d7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 0x55ce173d7d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f33d4006010 tx=0x7f33d40418a0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 1 -- 172.21.15.12:0/1264196257 shutdown_connections 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ce173e8430 0x55ce173ea890 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173d8370 0x55ce173d5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173ceb40 0x55ce173d4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 1 --2- 172.21.15.12:0/1264196257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 0x55ce173d7d00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 1 -- 172.21.15.12:0/1264196257 >> 172.21.15.12:0/1264196257 conn(0x55ce17396310 msgr2=0x55ce173cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33bb7fe640 0 client.28199 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 1 -- 172.21.15.12:0/1264196257 shutdown_connections 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 1 -- 172.21.15.12:0/1264196257 wait complete. 2024-09-19T06:52:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.591+0000 7f33e4714740 20 client.28199 trim_cache size 0 max 16384 2024-09-19T06:52:32.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.614+0000 7f33e4714740 1 Processor -- start 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.614+0000 7f33e4714740 1 -- start start 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.614+0000 7f33e4714740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 0x55ce173e43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.614+0000 7f33e4714740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173ceb40 0x55ce173d9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33e4714740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173d8370 0x55ce173d9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33e4714740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33c800eb10 con 0x55ce173ceb40 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33e4714740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33c80106e0 con 0x55ce173cd5d0 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33e4714740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33c800f1e0 con 0x55ce173d8370 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173ceb40 0x55ce173d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173ceb40 0x55ce173d9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36138/0 (socket says 172.21.15.12:36138) 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33db7fe640 1 -- 172.21.15.12:0/3338495471 learned_addr learned my addr 172.21.15.12:0/3338495471 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33e08d8640 1 --2- 172.21.15.12:0/3338495471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173d8370 0x55ce173d9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33dbfff640 1 --2- 172.21.15.12:0/3338495471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 0x55ce173e43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33dbfff640 1 -- 172.21.15.12:0/3338495471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173d8370 msgr2=0x55ce173d9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:32.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33dbfff640 1 --2- 172.21.15.12:0/3338495471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173d8370 0x55ce173d9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33dbfff640 1 -- 172.21.15.12:0/3338495471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173ceb40 msgr2=0x55ce173d9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:32.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33dbfff640 1 --2- 172.21.15.12:0/3338495471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173ceb40 0x55ce173d9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.615+0000 7f33dbfff640 1 -- 172.21.15.12:0/3338495471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce173cadd0 con 0x55ce173cd5d0 2024-09-19T06:52:32.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.616+0000 7f33dbfff640 1 --2- 172.21.15.12:0/3338495471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 0x55ce173e43a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f33d401acb0 tx=0x7f33d403b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a942077db7aa16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:32.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.616+0000 7f33c1ffb640 1 -- 172.21.15.12:0/3338495471 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d4045040 con 0x55ce173cd5d0 2024-09-19T06:52:32.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.616+0000 7f33c1ffb640 1 -- 172.21.15.12:0/3338495471 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33d401a810 con 0x55ce173cd5d0 2024-09-19T06:52:32.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.616+0000 7f33c1ffb640 1 -- 172.21.15.12:0/3338495471 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d4040d50 con 0x55ce173cd5d0 2024-09-19T06:52:32.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.616+0000 7f33e4714740 1 -- 172.21.15.12:0/3338495471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 msgr2=0x55ce173e43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.616+0000 7f33e4714740 1 --2- 172.21.15.12:0/3338495471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 0x55ce173e43a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f33d401acb0 tx=0x7f33d403b900 comp rx=0 tx=0).stop 2024-09-19T06:52:32.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.617+0000 7f33e4714740 1 -- 172.21.15.12:0/3338495471 shutdown_connections 2024-09-19T06:52:32.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.617+0000 7f33e4714740 1 --2- 172.21.15.12:0/3338495471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173d8370 0x55ce173d9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.617+0000 7f33e4714740 1 --2- 172.21.15.12:0/3338495471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173ceb40 0x55ce173d9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.617+0000 7f33e4714740 1 --2- 172.21.15.12:0/3338495471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173cd5d0 0x55ce173e43a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.617+0000 7f33e4714740 1 -- 172.21.15.12:0/3338495471 >> 172.21.15.12:0/3338495471 conn(0x55ce17396310 msgr2=0x55ce173c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:32.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.617+0000 7f33e4714740 1 -- 172.21.15.12:0/3338495471 shutdown_connections 2024-09-19T06:52:32.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.617+0000 7f33e4714740 1 -- 172.21.15.12:0/3338495471 wait complete. 2024-09-19T06:52:32.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.617+0000 7f33e4714740 1 -- start start 2024-09-19T06:52:32.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.617+0000 7f33e4714740 1 Processor -- start 2024-09-19T06:52:32.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.618+0000 7f33e4714740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173cd5d0 0x55ce173ef190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.618+0000 7f33e4714740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 0x55ce173ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.618+0000 7f33e4714740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173d8370 0x55ce173efc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.618+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 0x55ce173ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.618+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 0x55ce173ef6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58626/0 (socket says 172.21.15.12:58626) 2024-09-19T06:52:32.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33db7fe640 1 -- 172.21.15.12:0/3173942780 learned_addr learned my addr 172.21.15.12:0/3173942780 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:32.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33c8010010 con 0x55ce173cd5d0 2024-09-19T06:52:32.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f33c800f940 con 0x55ce173ceb40 2024-09-19T06:52:32.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33e08d8640 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173d8370 0x55ce173efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33c800cb10 con 0x55ce173d8370 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33e4714740 10 client.0 _ll_register_callbacks cb 0x7f33cc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33db7fe640 1 -- 172.21.15.12:0/3173942780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173d8370 msgr2=0x55ce173efc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33db7fe640 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173d8370 0x55ce173efc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33db7fe640 1 -- 172.21.15.12:0/3173942780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173cd5d0 msgr2=0x55ce173ef190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33db7fe640 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173cd5d0 0x55ce173ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.619+0000 7f33db7fe640 1 -- 172.21.15.12:0/3173942780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce173df7e0 con 0x55ce173ceb40 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.620+0000 7f33db7fe640 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 0x55ce173ef6d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f33cc01d820 tx=0x7f33cc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae5430c7f94f31d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.620+0000 7f33bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.620+0000 7f33bb7fe640 1 -- 172.21.15.12:0/3173942780 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc012240 con 0x55ce173ceb40 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.621+0000 7f33bb7fe640 1 -- 172.21.15.12:0/3173942780 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f33cc0123e0 con 0x55ce173ceb40 2024-09-19T06:52:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.621+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33d401a810 con 0x55ce173ceb40 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.621+0000 7f33bb7fe640 1 -- 172.21.15.12:0/3173942780 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f33cc045050 con 0x55ce173ceb40 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.621+0000 7f33e4714740 10 client.28205 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.621+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55ce173e0a80 con 0x55ce173ceb40 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.621+0000 7f33bb7fe640 1 -- 172.21.15.12:0/3173942780 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33d401a810 con 0x55ce173ceb40 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.622+0000 7f33bb7fe640 1 -- 172.21.15.12:0/3173942780 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f33cc01d910 con 0x55ce173ceb40 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.622+0000 7f33e4714740 10 client.28205 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.622+0000 7f33e4714740 10 client.28205 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.622+0000 7f33e4714740 20 client.28205 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.622+0000 7f33e4714740 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ce17453170 0x55ce17455560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.622+0000 7f33e4714740 4 client.28205 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:52:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.622+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce1733ad70 con 0x55ce17453170 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.622+0000 7f33dbfff640 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ce17453170 0x55ce17455560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.623+0000 7f33bb7fe640 10 client.28205 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.623+0000 7f33dbfff640 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ce17453170 0x55ce17455560 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ceba6f34a8cf6737 server_cookie=8a4a81e01a018425 in_seq=0 out_seq=0 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.623+0000 7f33bb7fe640 1 -- 172.21.15.12:0/3173942780 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce1733ad70 con 0x55ce17453170 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.623+0000 7f33bb7fe640 10 client.28205 handle_command_reply: tid=0 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.623+0000 7f33e4714740 1 client.28205 shutdown 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.623+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 msgr2=0x55ce173ef6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.623+0000 7f33e4714740 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 0x55ce173ef6d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f33cc01d820 tx=0x7f33cc0046c0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.624+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 shutdown_connections 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.624+0000 7f33e4714740 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55ce17453170 0x55ce17455560 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.624+0000 7f33e4714740 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ce173d8370 0x55ce173efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.624+0000 7f33e4714740 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ce173ceb40 0x55ce173ef6d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.624+0000 7f33e4714740 1 --2- 172.21.15.12:0/3173942780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce173cd5d0 0x55ce173ef190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.624+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 >> 172.21.15.12:0/3173942780 conn(0x55ce17396310 msgr2=0x55ce173d4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:32.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.624+0000 7f33bb7fe640 0 client.28205 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:52:32.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.624+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 shutdown_connections 2024-09-19T06:52:32.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.624+0000 7f33e4714740 1 -- 172.21.15.12:0/3173942780 wait complete. 2024-09-19T06:52:32.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.624+0000 7f33e4714740 20 client.28205 trim_cache size 0 max 16384 2024-09-19T06:52:32.628 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 -- 172.21.15.12:0/1667993621 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33c40a35c0 msgr2=0x7f33c40a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33c40a35c0 0x7f33c40a5a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f33cc023000 tx=0x7f33cc00ef00 comp rx=0 tx=0).stop 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 -- 172.21.15.12:0/1667993621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33dc11b140 msgr2=0x7f33dc116e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33dc11b140 0x7f33dc116e20 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f33d0001ea0 tx=0x7f33d000c870 comp rx=0 tx=0).stop 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 -- 172.21.15.12:0/1667993621 shutdown_connections 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33dc11b140 0x7f33dc116e20 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f33c40a35c0 0x7f33c40a5a80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33dc109830 0x7f33dc1168e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 --2- 172.21.15.12:0/1667993621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33dc109450 0x7f33dc11a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 -- 172.21.15.12:0/1667993621 >> 172.21.15.12:0/1667993621 conn(0x7f33dc06e140 msgr2=0x7f33dc070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 -- 172.21.15.12:0/1667993621 shutdown_connections 2024-09-19T06:52:32.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:32.625+0000 7f33e233b640 1 -- 172.21.15.12:0/1667993621 wait complete. 2024-09-19T06:52:33.586 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:52:33.965 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:34.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:33 smithi016 ceph-mon[34911]: pgmap v387: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 27 MiB/s wr, 1.94k op/s 2024-09-19T06:52:34.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:33 smithi012 ceph-mon[30937]: pgmap v387: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 27 MiB/s wr, 1.94k op/s 2024-09-19T06:52:34.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:33 smithi173 ceph-mon[35349]: pgmap v387: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 27 MiB/s wr, 1.94k op/s 2024-09-19T06:52:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.683+0000 7f765c60c640 1 -- 172.21.15.12:0/922504184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7654105ec0 msgr2=0x7f7654106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.683+0000 7f765c60c640 1 --2- 172.21.15.12:0/922504184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7654105ec0 0x7f7654106340 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7650009900 tx=0x7f765002a440 comp rx=0 tx=0).stop 2024-09-19T06:52:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.684+0000 7f765c60c640 1 -- 172.21.15.12:0/922504184 shutdown_connections 2024-09-19T06:52:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.684+0000 7f765c60c640 1 --2- 172.21.15.12:0/922504184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7654105ec0 0x7f7654106340 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.684+0000 7f765c60c640 1 --2- 172.21.15.12:0/922504184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76541011e0 0x7f7654105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.684+0000 7f765c60c640 1 --2- 172.21.15.12:0/922504184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76541008c0 0x7f7654100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.684+0000 7f765c60c640 1 -- 172.21.15.12:0/922504184 >> 172.21.15.12:0/922504184 conn(0x7f76540fc7d0 msgr2=0x7f76540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:34.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.685+0000 7f765c60c640 1 -- 172.21.15.12:0/922504184 shutdown_connections 2024-09-19T06:52:34.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.685+0000 7f765c60c640 1 -- 172.21.15.12:0/922504184 wait complete. 2024-09-19T06:52:34.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.686+0000 7f765c60c640 1 Processor -- start 2024-09-19T06:52:34.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.686+0000 7f765c60c640 1 -- start start 2024-09-19T06:52:34.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.686+0000 7f765c60c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76541008c0 0x7f765406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.686+0000 7f765c60c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76541011e0 0x7f765406ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.687+0000 7f765c60c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7654105ec0 0x7f76541b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.687+0000 7f765c60c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f765406d0c0 con 0x7f7654105ec0 2024-09-19T06:52:34.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.687+0000 7f765c60c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f765406cf40 con 0x7f76541011e0 2024-09-19T06:52:34.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.687+0000 7f765c60c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f765406d240 con 0x7f76541008c0 2024-09-19T06:52:34.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.687+0000 7f7659ba7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76541011e0 0x7f765406ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.687+0000 7f7659ba7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76541011e0 0x7f765406ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58644/0 (socket says 172.21.15.12:58644) 2024-09-19T06:52:34.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.687+0000 7f7659ba7640 1 -- 172.21.15.12:0/1611488548 learned_addr learned my addr 172.21.15.12:0/1611488548 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:34.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.687+0000 7f765aba9640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7654105ec0 0x7f76541b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.688+0000 7f7659ba7640 1 -- 172.21.15.12:0/1611488548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76541008c0 msgr2=0x7f765406e7a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:52:34.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.688+0000 7f7659ba7640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76541008c0 0x7f765406e7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.688+0000 7f7659ba7640 1 -- 172.21.15.12:0/1611488548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7654105ec0 msgr2=0x7f76541b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:34.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.688+0000 7f7659ba7640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7654105ec0 0x7f76541b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.688+0000 7f7659ba7640 1 -- 172.21.15.12:0/1611488548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76541b3680 con 0x7f76541011e0 2024-09-19T06:52:34.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.688+0000 7f7659ba7640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76541011e0 0x7f765406ece0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f764400c890 tx=0x7f764400cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:34.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.689+0000 7f764b7fe640 1 -- 172.21.15.12:0/1611488548 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644004220 con 0x7f76541011e0 2024-09-19T06:52:34.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.689+0000 7f764b7fe640 1 -- 172.21.15.12:0/1611488548 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76440043c0 con 0x7f76541011e0 2024-09-19T06:52:34.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.689+0000 7f764b7fe640 1 -- 172.21.15.12:0/1611488548 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76440049c0 con 0x7f76541011e0 2024-09-19T06:52:34.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.689+0000 7f765c60c640 1 -- 172.21.15.12:0/1611488548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76541b3970 con 0x7f76541011e0 2024-09-19T06:52:34.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.689+0000 7f765c60c640 1 -- 172.21.15.12:0/1611488548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76541b3e60 con 0x7f76541011e0 2024-09-19T06:52:34.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.694+0000 7f765e9e5740 1 Processor -- start 2024-09-19T06:52:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.696+0000 7f765e9e5740 1 -- start start 2024-09-19T06:52:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.696+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 0x5602f638a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.696+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 0x5602f638aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.696+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f6395370 0x5602f6397760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.696+0000 7f765e9e5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5602f62f02f0 con 0x5602f638a5d0 2024-09-19T06:52:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.696+0000 7f765e9e5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5602f6297cf0 con 0x5602f6395370 2024-09-19T06:52:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.696+0000 7f765e9e5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5602f62ec2b0 con 0x5602f638bb40 2024-09-19T06:52:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.696+0000 7f765aba9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 0x5602f638a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.697+0000 7f765aba9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 0x5602f638a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:56084/0 (socket says 172.21.15.12:56084) 2024-09-19T06:52:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.697+0000 7f765aba9640 1 -- 172.21.15.12:0/2773870133 learned_addr learned my addr 172.21.15.12:0/2773870133 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.697+0000 7f765aba9640 1 -- 172.21.15.12:0/2773870133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f6395370 msgr2=0x5602f6397760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:52:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.697+0000 7f765aba9640 1 --2- 172.21.15.12:0/2773870133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f6395370 0x5602f6397760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.697+0000 7f765aba9640 1 -- 172.21.15.12:0/2773870133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 msgr2=0x5602f638aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.697+0000 7f765aba9640 1 --2- 172.21.15.12:0/2773870133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 0x5602f638aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.697+0000 7f765aba9640 1 -- 172.21.15.12:0/2773870133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602f627c3a0 con 0x5602f638bb40 2024-09-19T06:52:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.697+0000 7f765aba9640 1 --2- 172.21.15.12:0/2773870133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 0x5602f638a090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f76500314e0 tx=0x7f7650005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dd88ffcf2487666 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.698+0000 7f7648ff9640 1 -- 172.21.15.12:0/2773870133 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650040030 con 0x5602f638bb40 2024-09-19T06:52:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.698+0000 7f7648ff9640 1 -- 172.21.15.12:0/2773870133 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76500315c0 con 0x5602f638bb40 2024-09-19T06:52:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.698+0000 7f7648ff9640 1 -- 172.21.15.12:0/2773870133 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650035040 con 0x5602f638bb40 2024-09-19T06:52:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.699+0000 7f764b7fe640 1 -- 172.21.15.12:0/1611488548 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7644004b60 con 0x7f76541011e0 2024-09-19T06:52:34.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.701+0000 7f764b7fe640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76400a35c0 0x7f76400a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.701+0000 7f764b7fe640 1 -- 172.21.15.12:0/1611488548 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f76440cfd60 con 0x7f76541011e0 2024-09-19T06:52:34.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.701+0000 7f765e9e5740 1 -- 172.21.15.12:0/2773870133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 msgr2=0x5602f638a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:34.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.701+0000 7f765e9e5740 1 --2- 172.21.15.12:0/2773870133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 0x5602f638a090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f76500314e0 tx=0x7f7650005c00 comp rx=0 tx=0).stop 2024-09-19T06:52:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.704+0000 7f765a3a8640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76400a35c0 0x7f76400a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.706+0000 7f765e9e5740 1 -- 172.21.15.12:0/2773870133 shutdown_connections 2024-09-19T06:52:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.706+0000 7f765e9e5740 1 --2- 172.21.15.12:0/2773870133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f6395370 0x5602f6397760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.706+0000 7f765e9e5740 1 --2- 172.21.15.12:0/2773870133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 0x5602f638aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.706+0000 7f765e9e5740 1 --2- 172.21.15.12:0/2773870133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 0x5602f638a090 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.707+0000 7f765e9e5740 1 -- 172.21.15.12:0/2773870133 >> 172.21.15.12:0/2773870133 conn(0x5602f6353310 msgr2=0x5602f6386c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.707+0000 7f765a3a8640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76400a35c0 0x7f76400a5a80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5602f6387ac0 tx=0x7f764c009230 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.707+0000 7f765e9e5740 1 -- 172.21.15.12:0/2773870133 shutdown_connections 2024-09-19T06:52:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.708+0000 7f765e9e5740 1 -- 172.21.15.12:0/2773870133 wait complete. 2024-09-19T06:52:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.708+0000 7f765e9e5740 1 -- start start 2024-09-19T06:52:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.708+0000 7f765e9e5740 1 Processor -- start 2024-09-19T06:52:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.708+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 0x5602f6394d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 0x5602f6391ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f6395370 0x5602f63925e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765e9e5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5602f6398010 con 0x5602f638a5d0 2024-09-19T06:52:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765e9e5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5602f62ab060 con 0x5602f6395370 2024-09-19T06:52:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765e9e5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5602f6398190 con 0x5602f638bb40 2024-09-19T06:52:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765e9e5740 10 client.0 _ll_register_callbacks cb 0x5602f5ffe8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765a3a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 0x5602f6394d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765a3a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 0x5602f6394d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36182/0 (socket says 172.21.15.12:36182) 2024-09-19T06:52:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765a3a8640 1 -- 172.21.15.12:0/560463439 learned_addr learned my addr 172.21.15.12:0/560463439 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f7659ba7640 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 0x5602f6391ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765aba9640 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f6395370 0x5602f63925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765a3a8640 1 -- 172.21.15.12:0/560463439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 msgr2=0x5602f6391ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765a3a8640 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 0x5602f6391ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765a3a8640 1 -- 172.21.15.12:0/560463439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f6395370 msgr2=0x5602f63925e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765a3a8640 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f6395370 0x5602f63925e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.709+0000 7f765a3a8640 1 -- 172.21.15.12:0/560463439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602f60613c0 con 0x5602f638a5d0 2024-09-19T06:52:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.710+0000 7f765a3a8640 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 0x5602f6394d40 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f764c00d8e0 tx=0x7f764c004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799619c07492b81b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.710+0000 7f763dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:52:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.711+0000 7f763dffb640 1 -- 172.21.15.12:0/560463439 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c018cd0 con 0x5602f638a5d0 2024-09-19T06:52:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.711+0000 7f763dffb640 1 -- 172.21.15.12:0/560463439 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f764c023480 con 0x5602f638a5d0 2024-09-19T06:52:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.711+0000 7f765e9e5740 1 -- 172.21.15.12:0/560463439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76500315c0 con 0x5602f638a5d0 2024-09-19T06:52:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.712+0000 7f763dffb640 1 -- 172.21.15.12:0/560463439 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f764c023680 con 0x5602f638a5d0 2024-09-19T06:52:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.712+0000 7f765e9e5740 10 client.18861 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.712+0000 7f765e9e5740 1 -- 172.21.15.12:0/560463439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5602f63a3b70 con 0x5602f638a5d0 2024-09-19T06:52:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.713+0000 7f763dffb640 1 -- 172.21.15.12:0/560463439 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f764c023d00 con 0x5602f638a5d0 2024-09-19T06:52:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.713+0000 7f763dffb640 1 -- 172.21.15.12:0/560463439 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f764c01aa80 con 0x5602f638a5d0 2024-09-19T06:52:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.713+0000 7f765e9e5740 10 client.18861 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.713+0000 7f765e9e5740 10 client.18861 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:52:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.713+0000 7f765e9e5740 20 client.18861 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.713+0000 7f765e9e5740 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5602f63a5030 0x5602f63a7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.713+0000 7f765e9e5740 4 client.18861 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.713+0000 7f765e9e5740 1 -- 172.21.15.12:0/560463439 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f76500315c0 con 0x5602f63a5030 2024-09-19T06:52:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.713+0000 7f7659ba7640 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5602f63a5030 0x5602f63a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.715+0000 7f763dffb640 10 client.18861 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:52:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.715+0000 7f7659ba7640 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5602f63a5030 0x5602f63a7420 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3416700989d1f7f9 server_cookie=3c9286027ceec5a7 in_seq=0 out_seq=0 2024-09-19T06:52:34.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.716+0000 7f763dffb640 1 -- 172.21.15.12:0/560463439 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f76500315c0 con 0x5602f63a5030 2024-09-19T06:52:34.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.716+0000 7f763dffb640 10 client.18861 handle_command_reply: tid=0 2024-09-19T06:52:34.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.716+0000 7f765e9e5740 1 client.18861 shutdown 2024-09-19T06:52:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.716+0000 7f765e9e5740 1 -- 172.21.15.12:0/560463439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 msgr2=0x5602f6394d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.716+0000 7f765e9e5740 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 0x5602f6394d40 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f764c00d8e0 tx=0x7f764c004b60 comp rx=0 tx=0).stop 2024-09-19T06:52:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.717+0000 7f765e9e5740 1 -- 172.21.15.12:0/560463439 shutdown_connections 2024-09-19T06:52:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.717+0000 7f765e9e5740 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5602f63a5030 0x5602f63a7420 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.717+0000 7f765e9e5740 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f6395370 0x5602f63925e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.717+0000 7f765e9e5740 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f638bb40 0x5602f6391ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.717+0000 7f765e9e5740 1 --2- 172.21.15.12:0/560463439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f638a5d0 0x5602f6394d40 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.717+0000 7f765e9e5740 1 -- 172.21.15.12:0/560463439 >> 172.21.15.12:0/560463439 conn(0x5602f6353310 msgr2=0x5602f638c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.717+0000 7f763dffb640 0 client.18861 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:52:34.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.718+0000 7f765e9e5740 1 -- 172.21.15.12:0/560463439 shutdown_connections 2024-09-19T06:52:34.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.718+0000 7f765e9e5740 1 -- 172.21.15.12:0/560463439 wait complete. 2024-09-19T06:52:34.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.719+0000 7f765e9e5740 20 client.18861 trim_cache size 0 max 16384 2024-09-19T06:52:34.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.738+0000 7f765e9e5740 1 Processor -- start 2024-09-19T06:52:34.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.738+0000 7f765e9e5740 1 -- start start 2024-09-19T06:52:34.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.739+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6391fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.739+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 0x5602f63a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.739+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 0x5602f638a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.739+0000 7f765e9e5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f763800eb20 con 0x5602f6386f20 2024-09-19T06:52:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.739+0000 7f765e9e5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f76380106f0 con 0x5602f638bb40 2024-09-19T06:52:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.739+0000 7f765e9e5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f763800f1f0 con 0x5602f6395370 2024-09-19T06:52:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.739+0000 7f765a3a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6391fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.739+0000 7f765a3a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6391fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58666/0 (socket says 172.21.15.12:58666) 2024-09-19T06:52:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.739+0000 7f765a3a8640 1 -- 172.21.15.12:0/1917532618 learned_addr learned my addr 172.21.15.12:0/1917532618 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.740+0000 7f765aba9640 1 --2- 172.21.15.12:0/1917532618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 0x5602f638a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.740+0000 7f7659ba7640 1 --2- 172.21.15.12:0/1917532618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 0x5602f63a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.740+0000 7f765a3a8640 1 -- 172.21.15.12:0/1917532618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 msgr2=0x5602f63a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.740+0000 7f765a3a8640 1 --2- 172.21.15.12:0/1917532618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 0x5602f63a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.740+0000 7f765a3a8640 1 -- 172.21.15.12:0/1917532618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 msgr2=0x5602f638a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.740+0000 7f765a3a8640 1 --2- 172.21.15.12:0/1917532618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 0x5602f638a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.740+0000 7f765a3a8640 1 -- 172.21.15.12:0/1917532618 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602f6390540 con 0x5602f638bb40 2024-09-19T06:52:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.740+0000 7f765aba9640 1 --2- 172.21.15.12:0/1917532618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 0x5602f638a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.741+0000 7f765a3a8640 1 --2- 172.21.15.12:0/1917532618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6391fc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f764c00c760 tx=0x7f764c023610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=186586d50158533f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.742+0000 7f763ffff640 1 -- 172.21.15.12:0/1917532618 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c018cd0 con 0x5602f638bb40 2024-09-19T06:52:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.742+0000 7f763ffff640 1 -- 172.21.15.12:0/1917532618 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f764c037070 con 0x5602f638bb40 2024-09-19T06:52:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.742+0000 7f763ffff640 1 -- 172.21.15.12:0/1917532618 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c023820 con 0x5602f638bb40 2024-09-19T06:52:34.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.743+0000 7f765e9e5740 1 -- 172.21.15.12:0/1917532618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 msgr2=0x5602f6391fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:34.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.743+0000 7f765e9e5740 1 --2- 172.21.15.12:0/1917532618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6391fc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f764c00c760 tx=0x7f764c023610 comp rx=0 tx=0).stop 2024-09-19T06:52:34.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.743+0000 7f765e9e5740 1 -- 172.21.15.12:0/1917532618 shutdown_connections 2024-09-19T06:52:34.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.743+0000 7f765e9e5740 1 --2- 172.21.15.12:0/1917532618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 0x5602f638a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.743+0000 7f765e9e5740 1 --2- 172.21.15.12:0/1917532618 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 0x5602f63a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.743+0000 7f765e9e5740 1 --2- 172.21.15.12:0/1917532618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6391fc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.743+0000 7f765e9e5740 1 -- 172.21.15.12:0/1917532618 >> 172.21.15.12:0/1917532618 conn(0x5602f6353310 msgr2=0x5602f63918b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:34.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.743+0000 7f765e9e5740 1 -- 172.21.15.12:0/1917532618 shutdown_connections 2024-09-19T06:52:34.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.743+0000 7f765e9e5740 1 -- 172.21.15.12:0/1917532618 wait complete. 2024-09-19T06:52:34.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.744+0000 7f765e9e5740 1 -- start start 2024-09-19T06:52:34.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.744+0000 7f765e9e5740 1 Processor -- start 2024-09-19T06:52:34.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.744+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 0x5602f639db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.744+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6398e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.745+0000 7f765e9e5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 0x5602f63993c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.745+0000 7f7659ba7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6398e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.745+0000 7f7659ba7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6398e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58680/0 (socket says 172.21.15.12:58680) 2024-09-19T06:52:34.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.745+0000 7f7659ba7640 1 -- 172.21.15.12:0/2431305675 learned_addr learned my addr 172.21.15.12:0/2431305675 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:34.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.745+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7638010020 con 0x5602f6386f20 2024-09-19T06:52:34.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.745+0000 7f765aba9640 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 0x5602f63993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.745+0000 7f765a3a8640 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 0x5602f639db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.745+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f763800f950 con 0x5602f638bb40 2024-09-19T06:52:34.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.745+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f763800cb20 con 0x5602f6395370 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765a3a8640 1 -- 172.21.15.12:0/2431305675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 msgr2=0x5602f63993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765a3a8640 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 0x5602f63993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765a3a8640 1 -- 172.21.15.12:0/2431305675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 msgr2=0x5602f6398e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765a3a8640 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6398e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765a3a8640 1 -- 172.21.15.12:0/2431305675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602f6399bf0 con 0x5602f6386f20 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765aba9640 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 0x5602f63993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765e9e5740 10 client.0 _ll_register_callbacks cb 0x7f764c00cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f764c037070 con 0x5602f6386f20 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765a3a8640 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 0x5602f639db50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f764c00c760 tx=0x7f764c02ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ba9bf639c5e50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f763dffb640 10 client.18867 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f763dffb640 1 -- 172.21.15.12:0/2431305675 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c018ce0 con 0x5602f6386f20 2024-09-19T06:52:34.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f763dffb640 1 -- 172.21.15.12:0/2431305675 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f764c003a30 con 0x5602f6386f20 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f763dffb640 1 -- 172.21.15.12:0/2431305675 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f764c003cb0 con 0x5602f6386f20 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765e9e5740 10 client.18867 fetch_fsmap learned FSMap version 46 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.746+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({fsmap=46}) -- 0x5602f640f980 con 0x5602f6386f20 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.747+0000 7f763dffb640 1 -- 172.21.15.12:0/2431305675 <== mon.0 v2:172.21.15.12:3300/0 4 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f764c023820 con 0x5602f6386f20 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.747+0000 7f765e9e5740 10 client.18867 fetch_fsmap finished waiting for FSMap version 46 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.747+0000 7f765e9e5740 10 client.18867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.747+0000 7f765e9e5740 20 client.18867 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.747+0000 7f765e9e5740 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5602f640fff0 0x5602f6412450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.747+0000 7f765e9e5740 4 client.18867 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.747+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f764c037070 con 0x5602f640fff0 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.747+0000 7f7659ba7640 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5602f640fff0 0x5602f6412450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f7659ba7640 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5602f640fff0 0x5602f6412450 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5bf4506499c4511e server_cookie=d7e203878f26c999 in_seq=0 out_seq=0 2024-09-19T06:52:34.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f763dffb640 10 client.18867 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f763dffb640 1 -- 172.21.15.12:0/2431305675 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f764c037070 con 0x5602f640fff0 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f763dffb640 10 client.18867 handle_command_reply: tid=0 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f765e9e5740 1 client.18867 shutdown 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 msgr2=0x5602f639db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f765e9e5740 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 0x5602f639db50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f764c00c760 tx=0x7f764c02ab00 comp rx=0 tx=0).stop 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 shutdown_connections 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f765e9e5740 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5602f640fff0 0x5602f6412450 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f765e9e5740 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602f6395370 0x5602f63993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f763dffb640 0 client.18867 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f765e9e5740 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602f638bb40 0x5602f6398e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f765e9e5740 1 --2- 172.21.15.12:0/2431305675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602f6386f20 0x5602f639db50 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 >> 172.21.15.12:0/2431305675 conn(0x5602f6353310 msgr2=0x5602f63854e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.748+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 shutdown_connections 2024-09-19T06:52:34.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.749+0000 7f765e9e5740 1 -- 172.21.15.12:0/2431305675 wait complete. 2024-09-19T06:52:34.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.749+0000 7f765e9e5740 20 client.18867 trim_cache size 0 max 16384 2024-09-19T06:52:34.754 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:52:34.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.749+0000 7f765c60c640 1 -- 172.21.15.12:0/1611488548 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76400a35c0 msgr2=0x7f76400a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:34.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.749+0000 7f765c60c640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76400a35c0 0x7f76400a5a80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5602f6387ac0 tx=0x7f764c009230 comp rx=0 tx=0).stop 2024-09-19T06:52:34.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.749+0000 7f765c60c640 1 -- 172.21.15.12:0/1611488548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76541011e0 msgr2=0x7f765406ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:34.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.749+0000 7f765c60c640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76541011e0 0x7f765406ece0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f764400c890 tx=0x7f764400cd50 comp rx=0 tx=0).stop 2024-09-19T06:52:34.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.750+0000 7f765c60c640 1 -- 172.21.15.12:0/1611488548 shutdown_connections 2024-09-19T06:52:34.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.750+0000 7f765c60c640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7654105ec0 0x7f76541b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.750+0000 7f765c60c640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76541011e0 0x7f765406ece0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.750+0000 7f765c60c640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f76400a35c0 0x7f76400a5a80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.750+0000 7f765c60c640 1 --2- 172.21.15.12:0/1611488548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76541008c0 0x7f765406e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:34.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.750+0000 7f765c60c640 1 -- 172.21.15.12:0/1611488548 >> 172.21.15.12:0/1611488548 conn(0x7f76540fc7d0 msgr2=0x7f7654103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:34.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.750+0000 7f765c60c640 1 -- 172.21.15.12:0/1611488548 shutdown_connections 2024-09-19T06:52:34.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:34.750+0000 7f765c60c640 1 -- 172.21.15.12:0/1611488548 wait complete. 2024-09-19T06:52:35.580 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:52:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 710.0 s, 2399.6 tps, lat 41.010 ms stddev 48.035 2024-09-19T06:52:35.957 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:36.237 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:35 smithi012 ceph-mon[30937]: pgmap v388: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 28 MiB/s wr, 1.98k op/s 2024-09-19T06:52:36.237 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:35 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:52:36.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:35 smithi016 ceph-mon[34911]: pgmap v388: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 28 MiB/s wr, 1.98k op/s 2024-09-19T06:52:36.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:35 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:52:36.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:35 smithi173 ceph-mon[35349]: pgmap v388: 97 pgs: 97 active+clean; 4.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 28 MiB/s wr, 1.98k op/s 2024-09-19T06:52:36.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:35 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:52:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.591+0000 7fd0fc110640 1 -- 172.21.15.12:0/2633349105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0f4101440 msgr2=0x7fd0f4105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.591+0000 7fd0fc110640 1 --2- 172.21.15.12:0/2633349105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0f4101440 0x7fd0f4105910 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8009be0 tx=0x7fd0e802a740 comp rx=0 tx=0).stop 2024-09-19T06:52:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.591+0000 7fd0fc110640 1 -- 172.21.15.12:0/2633349105 shutdown_connections 2024-09-19T06:52:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.591+0000 7fd0fc110640 1 --2- 172.21.15.12:0/2633349105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0f4105f30 0x7fd0f41063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.591+0000 7fd0fc110640 1 --2- 172.21.15.12:0/2633349105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0f4101440 0x7fd0f4105910 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.591+0000 7fd0fc110640 1 --2- 172.21.15.12:0/2633349105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0f4100b20 0x7fd0f4100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.591+0000 7fd0fc110640 1 -- 172.21.15.12:0/2633349105 >> 172.21.15.12:0/2633349105 conn(0x7fd0f40fc790 msgr2=0x7fd0f40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.591+0000 7fd0fc110640 1 -- 172.21.15.12:0/2633349105 shutdown_connections 2024-09-19T06:52:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.591+0000 7fd0fc110640 1 -- 172.21.15.12:0/2633349105 wait complete. 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0fc110640 1 Processor -- start 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0fc110640 1 -- start start 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0fc110640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0f4100b20 0x7fd0f410eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0fc110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0f4101440 0x7fd0f410f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0fc110640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0f4105f30 0x7fd0f4113400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0fc110640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f4107270 con 0x7fd0f4101440 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0fc110640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41070f0 con 0x7fd0f4100b20 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0fc110640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41073f0 con 0x7fd0f4105f30 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0f96ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0f4101440 0x7fd0f410f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0f96ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0f4101440 0x7fd0f410f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36222/0 (socket says 172.21.15.12:36222) 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0f96ab640 1 -- 172.21.15.12:0/766765217 learned_addr learned my addr 172.21.15.12:0/766765217 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0f9eac640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0f4100b20 0x7fd0f410eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0fa6ad640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0f4105f30 0x7fd0f4113400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0f96ab640 1 -- 172.21.15.12:0/766765217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0f4105f30 msgr2=0x7fd0f4113400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0f96ab640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0f4105f30 0x7fd0f4113400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0f96ab640 1 -- 172.21.15.12:0/766765217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0f4100b20 msgr2=0x7fd0f410eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.592+0000 7fd0f96ab640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0f4100b20 0x7fd0f410eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.593+0000 7fd0f96ab640 1 -- 172.21.15.12:0/766765217 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f4113b00 con 0x7fd0f4101440 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.593+0000 7fd0f96ab640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0f4101440 0x7fd0f410f070 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8004af0 tx=0x7fd0e8030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.593+0000 7fd0f2ffd640 1 -- 172.21.15.12:0/766765217 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8041020 con 0x7fd0f4101440 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.593+0000 7fd0fc110640 1 -- 172.21.15.12:0/766765217 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f4113d90 con 0x7fd0f4101440 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.593+0000 7fd0f2ffd640 1 -- 172.21.15.12:0/766765217 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e8037040 con 0x7fd0f4101440 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.593+0000 7fd0f2ffd640 1 -- 172.21.15.12:0/766765217 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8036070 con 0x7fd0f4101440 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.593+0000 7fd0fc110640 1 -- 172.21.15.12:0/766765217 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f41b3ea0 con 0x7fd0f4101440 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.595+0000 7fd0f2ffd640 1 -- 172.21.15.12:0/766765217 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd0e8044020 con 0x7fd0f4101440 2024-09-19T06:52:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fe4e9740 1 Processor -- start 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fe4e9740 1 -- start start 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 0x55effc14b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14b5d0 0x55effc14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc156370 0x55effc158760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55effc0b12f0 con 0x55effc14b5d0 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55effc058cf0 con 0x55effc156370 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55effc0ad2b0 con 0x55effc14cb40 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fa6ad640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 0x55effc14b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fa6ad640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 0x55effc14b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:56144/0 (socket says 172.21.15.12:56144) 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0fa6ad640 1 -- 172.21.15.12:0/1015618513 learned_addr learned my addr 172.21.15.12:0/1015618513 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0f96ab640 1 --2- 172.21.15.12:0/1015618513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc156370 0x55effc158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0f9eac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14b5d0 0x55effc14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.596+0000 7fd0f2ffd640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0e40a33b0 0x7fd0e40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0fa6ad640 1 -- 172.21.15.12:0/1015618513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc156370 msgr2=0x55effc158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0fa6ad640 1 --2- 172.21.15.12:0/1015618513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc156370 0x55effc158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0fa6ad640 1 -- 172.21.15.12:0/1015618513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14b5d0 msgr2=0x55effc14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0fa6ad640 1 --2- 172.21.15.12:0/1015618513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14b5d0 0x55effc14ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0fa6ad640 1 -- 172.21.15.12:0/1015618513 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effc03d3a0 con 0x55effc14cb40 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0f2ffd640 1 -- 172.21.15.12:0/766765217 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7fd0e80f08f0 con 0x7fd0f4101440 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0fa6ad640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0e40a33b0 0x7fd0e40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0fa6ad640 1 --2- 172.21.15.12:0/1015618513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 0x55effc14b090 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009d80 tx=0x7fd0ec011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=893e48580b0849c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0dffff640 1 -- 172.21.15.12:0/1015618513 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec017050 con 0x55effc14cb40 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0dffff640 1 -- 172.21.15.12:0/1015618513 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0ec00fc60 con 0x55effc14cb40 2024-09-19T06:52:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0dffff640 1 -- 172.21.15.12:0/1015618513 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec00eb70 con 0x55effc14cb40 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.597+0000 7fd0fa6ad640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0e40a33b0 0x7fd0e40a5870 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec022000 tx=0x7fd0ec023000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.598+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/1015618513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 msgr2=0x55effc14b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.598+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/1015618513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 0x55effc14b090 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009d80 tx=0x7fd0ec011810 comp rx=0 tx=0).stop 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.598+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/1015618513 shutdown_connections 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.598+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/1015618513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc156370 0x55effc158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.598+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/1015618513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14b5d0 0x55effc14ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.598+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/1015618513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 0x55effc14b090 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.598+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/1015618513 >> 172.21.15.12:0/1015618513 conn(0x55effc114310 msgr2=0x55effc147c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.598+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/1015618513 shutdown_connections 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.598+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/1015618513 wait complete. 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.598+0000 7fd0fe4e9740 1 -- start start 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0fe4e9740 1 Processor -- start 2024-09-19T06:52:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14b5d0 0x55effc155d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14cb40 0x55effc152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 0x55effc153530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55effc159070 con 0x55effc156370 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55effc06c060 con 0x55effc14cb40 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55effc1591f0 con 0x55effc14b5d0 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0fe4e9740 10 client.0 _ll_register_callbacks cb 0x55effbdbf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0f96ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14cb40 0x55effc152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0f9eac640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14b5d0 0x55effc155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0fa6ad640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 0x55effc153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0f96ab640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14cb40 0x55effc152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:58718/0 (socket says 172.21.15.12:58718) 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0f96ab640 1 -- 172.21.15.12:0/400618062 learned_addr learned my addr 172.21.15.12:0/400618062 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0f96ab640 1 -- 172.21.15.12:0/400618062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14b5d0 msgr2=0x55effc155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0f96ab640 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14b5d0 0x55effc155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0f96ab640 1 -- 172.21.15.12:0/400618062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 msgr2=0x55effc153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0f96ab640 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 0x55effc153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.599+0000 7fd0f96ab640 1 -- 172.21.15.12:0/400618062 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effbe223c0 con 0x55effc14cb40 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0f96ab640 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14cb40 0x55effc152fb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80b9500 tx=0x7fd0e8003ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85399411796c15c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/400618062 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e80bde60 con 0x55effc14cb40 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/400618062 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7fd0e80a70b0 con 0x55effc14cb40 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/400618062 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0ec00fc60 con 0x55effc14cb40 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/400618062 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fd0e8030840 con 0x55effc14cb40 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0fe4e9740 10 client.28229 fetch_fsmap learned FSMap version 47 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/400618062 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55effc164aa0 con 0x55effc14cb40 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/400618062 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0ec00fc60 con 0x55effc14cb40 2024-09-19T06:52:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/400618062 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7fd0e80d5020 con 0x55effc14cb40 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0fe4e9740 10 client.28229 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0fe4e9740 10 client.28229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0fe4e9740 20 client.28229 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55effc165f00 0x55effc168320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0fe4e9740 4 client.28229 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.600+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/400618062 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55effc0be860 con 0x55effc165f00 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.601+0000 7fd0f9eac640 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55effc165f00 0x55effc168320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.601+0000 7fd0dd7fa640 10 client.28229 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.601+0000 7fd0f9eac640 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55effc165f00 0x55effc168320 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=321ed6f5c4eabbd2 server_cookie=f0f628fb1e2412db in_seq=0 out_seq=0 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/400618062 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55effc0be860 con 0x55effc165f00 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0dd7fa640 10 client.28229 handle_command_reply: tid=0 2024-09-19T06:52:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 client.28229 shutdown 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/400618062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14cb40 msgr2=0x55effc152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14cb40 0x55effc152fb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80b9500 tx=0x7fd0e8003ef0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/400618062 shutdown_connections 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55effc165f00 0x55effc168320 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 0x55effc153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14cb40 0x55effc152fb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/400618062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14b5d0 0x55effc155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/400618062 >> 172.21.15.12:0/400618062 conn(0x55effc114310 msgr2=0x55effc14d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0dd7fa640 0 client.28229 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/400618062 shutdown_connections 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/400618062 wait complete. 2024-09-19T06:52:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.602+0000 7fd0fe4e9740 20 client.28229 trim_cache size 0 max 16384 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.615+0000 7fd0fe4e9740 1 Processor -- start 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.615+0000 7fd0fe4e9740 1 -- start start 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.616+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14b5d0 0x55effc162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.616+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 0x55effc16dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.616+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 0x55effc16e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.616+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41bc960 con 0x55effc156370 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.616+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41be560 con 0x55effc14b5d0 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.616+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41bd030 con 0x55effc14cb40 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.616+0000 7fd0fa6ad640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 0x55effc16e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.616+0000 7fd0fa6ad640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 0x55effc16e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36252/0 (socket says 172.21.15.12:36252) 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.617+0000 7fd0fa6ad640 1 -- 172.21.15.12:0/2226152831 learned_addr learned my addr 172.21.15.12:0/2226152831 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.616+0000 7fd0f9eac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14b5d0 0x55effc162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.617+0000 7fd0fa6ad640 1 -- 172.21.15.12:0/2226152831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 msgr2=0x55effc16dbf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.617+0000 7fd0fa6ad640 1 --2- 172.21.15.12:0/2226152831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 0x55effc16dbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.617+0000 7fd0fa6ad640 1 -- 172.21.15.12:0/2226152831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14b5d0 msgr2=0x55effc162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.617+0000 7fd0fa6ad640 1 --2- 172.21.15.12:0/2226152831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14b5d0 0x55effc162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.617+0000 7fd0fa6ad640 1 -- 172.21.15.12:0/2226152831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effc14e120 con 0x55effc156370 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.622+0000 7fd0fa6ad640 1 --2- 172.21.15.12:0/2226152831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 0x55effc16e130 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0058c0 tx=0x7fd0ec009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3aad3f3b9da9a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.623+0000 7fd0df7fe640 1 -- 172.21.15.12:0/2226152831 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec033020 con 0x55effc156370 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.623+0000 7fd0df7fe640 1 -- 172.21.15.12:0/2226152831 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0ec02b040 con 0x55effc156370 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.623+0000 7fd0df7fe640 1 -- 172.21.15.12:0/2226152831 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec02a070 con 0x55effc156370 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.624+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/2226152831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 msgr2=0x55effc16e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.624+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/2226152831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 0x55effc16e130 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0058c0 tx=0x7fd0ec009820 comp rx=0 tx=0).stop 2024-09-19T06:52:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.624+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/2226152831 shutdown_connections 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.624+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/2226152831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc156370 0x55effc16e130 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.624+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/2226152831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc14cb40 0x55effc16dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.624+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/2226152831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14b5d0 0x55effc162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.624+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/2226152831 >> 172.21.15.12:0/2226152831 conn(0x55effc114310 msgr2=0x55effc14e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.625+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/2226152831 shutdown_connections 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.625+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/2226152831 wait complete. 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.626+0000 7fd0fe4e9740 1 -- start start 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.626+0000 7fd0fe4e9740 1 Processor -- start 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.627+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14b5d0 0x55effc15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.627+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14cb40 0x55effc15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.627+0000 7fd0fe4e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc156370 0x55effc1cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.628+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41bde90 con 0x55effc14cb40 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.628+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41bd790 con 0x55effc14b5d0 2024-09-19T06:52:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.628+0000 7fd0fe4e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41ba960 con 0x55effc156370 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.628+0000 7fd0fe4e9740 10 client.0 _ll_register_callbacks cb 0x7fd0e8003d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.629+0000 7fd0f96ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14cb40 0x55effc15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.629+0000 7fd0f96ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14cb40 0x55effc15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36258/0 (socket says 172.21.15.12:36258) 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.629+0000 7fd0f96ab640 1 -- 172.21.15.12:0/3841978216 learned_addr learned my addr 172.21.15.12:0/3841978216 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.629+0000 7fd0f9eac640 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14b5d0 0x55effc15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.629+0000 7fd0fa6ad640 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc156370 0x55effc1cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.630+0000 7fd0f96ab640 1 -- 172.21.15.12:0/3841978216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc156370 msgr2=0x55effc1cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.630+0000 7fd0f96ab640 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc156370 0x55effc1cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.630+0000 7fd0f96ab640 1 -- 172.21.15.12:0/3841978216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14b5d0 msgr2=0x55effc15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.630+0000 7fd0f96ab640 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14b5d0 0x55effc15a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.630+0000 7fd0f96ab640 1 -- 172.21.15.12:0/3841978216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effc1d0100 con 0x55effc14cb40 2024-09-19T06:52:36.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.631+0000 7fd0f96ab640 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14cb40 0x55effc15ab00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80bc830 tx=0x7fd0e80f0c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebf4d3407cef257 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.631+0000 7fd0dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.631+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/3841978216 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e80bde60 con 0x55effc14cb40 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.632+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/3841978216 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7fd0e8004d40 con 0x55effc14cb40 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.632+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/3841978216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0ec02b040 con 0x55effc14cb40 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.632+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/3841978216 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fd0e80a72f0 con 0x55effc14cb40 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.632+0000 7fd0fe4e9740 10 client.18885 fetch_fsmap learned FSMap version 47 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.632+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/3841978216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55effc1d0100 con 0x55effc14cb40 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.633+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/3841978216 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e80bd230 con 0x55effc14cb40 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.633+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/3841978216 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7fd0e80d5070 con 0x55effc14cb40 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.633+0000 7fd0fe4e9740 10 client.18885 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.633+0000 7fd0fe4e9740 10 client.18885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.633+0000 7fd0fe4e9740 20 client.18885 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.633+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55effc1d15f0 0x55effc1d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.633+0000 7fd0fe4e9740 4 client.18885 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.633+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/3841978216 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd0ec02b040 con 0x55effc1d15f0 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.633+0000 7fd0f9eac640 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55effc1d15f0 0x55effc1d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.634+0000 7fd0dd7fa640 10 client.18885 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.634+0000 7fd0f9eac640 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55effc1d15f0 0x55effc1d39e0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2564f1fe7703d8b9 server_cookie=19a2fb7f4fcf4d4e in_seq=0 out_seq=0 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.634+0000 7fd0dd7fa640 1 -- 172.21.15.12:0/3841978216 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd0ec02b040 con 0x55effc1d15f0 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.634+0000 7fd0dd7fa640 10 client.18885 handle_command_reply: tid=0 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.634+0000 7fd0fe4e9740 1 client.18885 shutdown 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.634+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/3841978216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14cb40 msgr2=0x55effc15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.634+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14cb40 0x55effc15ab00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80bc830 tx=0x7fd0e80f0c80 comp rx=0 tx=0).stop 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.635+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/3841978216 shutdown_connections 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.635+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55effc1d15f0 0x55effc1d39e0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.635+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55effc156370 0x55effc1cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.635+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55effc14cb40 0x55effc15ab00 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.635+0000 7fd0dd7fa640 0 client.18885 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.635+0000 7fd0fe4e9740 1 --2- 172.21.15.12:0/3841978216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55effc14b5d0 0x55effc15a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.635+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/3841978216 >> 172.21.15.12:0/3841978216 conn(0x55effc114310 msgr2=0x55effc1464e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.635+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/3841978216 shutdown_connections 2024-09-19T06:52:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.635+0000 7fd0fe4e9740 1 -- 172.21.15.12:0/3841978216 wait complete. 2024-09-19T06:52:36.785 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:52:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.635+0000 7fd0fe4e9740 20 client.18885 trim_cache size 0 max 16384 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.636+0000 7fd0fc110640 1 -- 172.21.15.12:0/766765217 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0e40a33b0 msgr2=0x7fd0e40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.636+0000 7fd0fc110640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0e40a33b0 0x7fd0e40a5870 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec022000 tx=0x7fd0ec023000 comp rx=0 tx=0).stop 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.636+0000 7fd0fc110640 1 -- 172.21.15.12:0/766765217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0f4101440 msgr2=0x7fd0f410f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.636+0000 7fd0fc110640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0f4101440 0x7fd0f410f070 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8004af0 tx=0x7fd0e8030650 comp rx=0 tx=0).stop 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.636+0000 7fd0fc110640 1 -- 172.21.15.12:0/766765217 shutdown_connections 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.636+0000 7fd0fc110640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd0e40a33b0 0x7fd0e40a5870 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.636+0000 7fd0fc110640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0f4105f30 0x7fd0f4113400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.636+0000 7fd0fc110640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0f4101440 0x7fd0f410f070 secure :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8004af0 tx=0x7fd0e8030650 comp rx=0 tx=0).stop 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.636+0000 7fd0fc110640 1 --2- 172.21.15.12:0/766765217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0f4100b20 0x7fd0f410eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.636+0000 7fd0fc110640 1 -- 172.21.15.12:0/766765217 >> 172.21.15.12:0/766765217 conn(0x7fd0f40fc790 msgr2=0x7fd0f4107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.637+0000 7fd0fc110640 1 -- 172.21.15.12:0/766765217 shutdown_connections 2024-09-19T06:52:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:36.637+0000 7fd0fc110640 1 -- 172.21.15.12:0/766765217 wait complete. 2024-09-19T06:52:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.875+0000 7f44e0df1640 1 -- 172.21.15.12:0/1665232404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44dc101390 msgr2=0x7f44dc10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.875+0000 7f44e0df1640 1 --2- 172.21.15.12:0/1665232404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44dc101390 0x7f44dc10d8c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009cd0 tx=0x7f44d402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.876+0000 7f44e0df1640 1 -- 172.21.15.12:0/1665232404 shutdown_connections 2024-09-19T06:52:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.876+0000 7f44e0df1640 1 --2- 172.21.15.12:0/1665232404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44dc101390 0x7f44dc10d8c0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.876+0000 7f44e0df1640 1 --2- 172.21.15.12:0/1665232404 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44dc1009f0 0x7f44dc100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.876+0000 7f44e0df1640 1 --2- 172.21.15.12:0/1665232404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44dc106a00 0x7f44dc106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.876+0000 7f44e0df1640 1 -- 172.21.15.12:0/1665232404 >> 172.21.15.12:0/1665232404 conn(0x7f44dc0fc6b0 msgr2=0x7f44dc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.876+0000 7f44e0df1640 1 -- 172.21.15.12:0/1665232404 shutdown_connections 2024-09-19T06:52:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.876+0000 7f44e0df1640 1 -- 172.21.15.12:0/1665232404 wait complete. 2024-09-19T06:52:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.876+0000 7f44e0df1640 1 Processor -- start 2024-09-19T06:52:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.876+0000 7f44e0df1640 1 -- start start 2024-09-19T06:52:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44e0df1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44dc1009f0 0x7f44dc198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44e0df1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44dc101390 0x7f44dc1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44e0df1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44dc106a00 0x7f44dc19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44e0df1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc110e90 con 0x7f44dc101390 2024-09-19T06:52:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44e0df1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc110d10 con 0x7f44dc1009f0 2024-09-19T06:52:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44e0df1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc111010 con 0x7f44dc106a00 2024-09-19T06:52:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44d9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44dc101390 0x7f44dc1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44d9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44dc101390 0x7f44dc1988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36276/0 (socket says 172.21.15.12:36276) 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44d9d9b640 1 -- 172.21.15.12:0/711161869 learned_addr learned my addr 172.21.15.12:0/711161869 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44dad9d640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44dc106a00 0x7f44dc19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44da59c640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44dc1009f0 0x7f44dc198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44d9d9b640 1 -- 172.21.15.12:0/711161869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44dc106a00 msgr2=0x7f44dc19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44d9d9b640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44dc106a00 0x7f44dc19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44d9d9b640 1 -- 172.21.15.12:0/711161869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44dc1009f0 msgr2=0x7f44dc198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44d9d9b640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44dc1009f0 0x7f44dc198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44d9d9b640 1 -- 172.21.15.12:0/711161869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc19d380 con 0x7f44dc101390 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44d9d9b640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44dc101390 0x7f44dc1988d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f44d000d950 tx=0x7f44d000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.877+0000 7f44cb7fe640 1 -- 172.21.15.12:0/711161869 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0017070 con 0x7f44dc101390 2024-09-19T06:52:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.878+0000 7f44e0df1640 1 -- 172.21.15.12:0/711161869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44dc19d670 con 0x7f44dc101390 2024-09-19T06:52:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.878+0000 7f44cb7fe640 1 -- 172.21.15.12:0/711161869 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44d000de80 con 0x7f44dc101390 2024-09-19T06:52:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.878+0000 7f44cb7fe640 1 -- 172.21.15.12:0/711161869 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d000f620 con 0x7f44dc101390 2024-09-19T06:52:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.878+0000 7f44e0df1640 1 -- 172.21.15.12:0/711161869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44dc1a4f00 con 0x7f44dc101390 2024-09-19T06:52:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44cb7fe640 1 -- 172.21.15.12:0/711161869 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f44d0009c30 con 0x7f44dc101390 2024-09-19T06:52:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44e3c64740 1 Processor -- start 2024-09-19T06:52:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44e3c64740 1 -- start start 2024-09-19T06:52:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbd2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbdd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 0x557f2bbe00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44e3c64740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f2bb372f0 con 0x557f2bbd3410 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44e3c64740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557f2badf270 con 0x557f2bbddcb0 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44e3c64740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557f2bb332b0 con 0x557f2bbd2af0 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44da59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbdd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44da59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbdd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36278/0 (socket says 172.21.15.12:36278) 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.881+0000 7f44da59c640 1 -- 172.21.15.12:0/16741880 learned_addr learned my addr 172.21.15.12:0/16741880 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44dad9d640 1 --2- 172.21.15.12:0/16741880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbd2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44d9d9b640 1 --2- 172.21.15.12:0/16741880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 0x557f2bbe00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44da59c640 1 -- 172.21.15.12:0/16741880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 msgr2=0x557f2bbd2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44da59c640 1 --2- 172.21.15.12:0/16741880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbd2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44da59c640 1 -- 172.21.15.12:0/16741880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 msgr2=0x557f2bbe00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44da59c640 1 --2- 172.21.15.12:0/16741880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 0x557f2bbe00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44cb7fe640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44c40a3460 0x7f44c40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44da59c640 1 -- 172.21.15.12:0/16741880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f2bade340 con 0x557f2bbd3410 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44d9d9b640 1 --2- 172.21.15.12:0/16741880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 0x557f2bbe00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44dad9d640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44c40a3460 0x7f44c40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44cb7fe640 1 -- 172.21.15.12:0/711161869 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f44d00cf980 con 0x7f44dc101390 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44da59c640 1 --2- 172.21.15.12:0/16741880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbdd770 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009a70 tx=0x7f44cc009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83985fc803115a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44c8ff9640 1 -- 172.21.15.12:0/16741880 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc017070 con 0x557f2bbd3410 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44c8ff9640 1 -- 172.21.15.12:0/16741880 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44cc013470 con 0x557f2bbd3410 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.882+0000 7f44c8ff9640 1 -- 172.21.15.12:0/16741880 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0125d0 con 0x557f2bbd3410 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 -- 172.21.15.12:0/16741880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 msgr2=0x557f2bbdd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44dad9d640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44c40a3460 0x7f44c40a5920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f44d4005e30 tx=0x7f44d403d040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 --2- 172.21.15.12:0/16741880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbdd770 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009a70 tx=0x7f44cc009f30 comp rx=0 tx=0).stop 2024-09-19T06:52:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 -- 172.21.15.12:0/16741880 shutdown_connections 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 --2- 172.21.15.12:0/16741880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 0x557f2bbe00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 --2- 172.21.15.12:0/16741880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbdd770 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 --2- 172.21.15.12:0/16741880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbd2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 -- 172.21.15.12:0/16741880 >> 172.21.15.12:0/16741880 conn(0x557f2bbcf060 msgr2=0x557f2bbcf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 -- 172.21.15.12:0/16741880 shutdown_connections 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 -- 172.21.15.12:0/16741880 wait complete. 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 -- start start 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.883+0000 7f44e3c64740 1 Processor -- start 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbdab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbd3410 0x557f2bbdb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbddcb0 0x557f2bbdb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44e3c64740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f2bbe0880 con 0x557f2bbddcb0 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44e3c64740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557f2bac0290 con 0x557f2bbd3410 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44e3c64740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557f2bbe0a00 con 0x557f2bbd2af0 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44e3c64740 10 client.0 _ll_register_callbacks cb 0x557f2baf1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44dad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbddcb0 0x557f2bbdb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44dad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbddcb0 0x557f2bbdb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36294/0 (socket says 172.21.15.12:36294) 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44dad9d640 1 -- 172.21.15.12:0/2357762353 learned_addr learned my addr 172.21.15.12:0/2357762353 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44d9d9b640 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbd3410 0x557f2bbdb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44da59c640 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbdab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44dad9d640 1 -- 172.21.15.12:0/2357762353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 msgr2=0x557f2bbdab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44dad9d640 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbdab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44dad9d640 1 -- 172.21.15.12:0/2357762353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbd3410 msgr2=0x557f2bbdb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44dad9d640 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbd3410 0x557f2bbdb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44dad9d640 1 -- 172.21.15.12:0/2357762353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f2b84a210 con 0x557f2bbddcb0 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44dad9d640 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbddcb0 0x557f2bbdb580 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f44d4035000 tx=0x7f44d402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133d1666521f4284 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.884+0000 7f44c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44c1ffb640 1 -- 172.21.15.12:0/2357762353 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d4056060 con 0x557f2bbddcb0 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44c1ffb640 1 -- 172.21.15.12:0/2357762353 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f44d40305a0 con 0x557f2bbddcb0 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44e3c64740 1 -- 172.21.15.12:0/2357762353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44cc013470 con 0x557f2bbddcb0 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44c1ffb640 1 -- 172.21.15.12:0/2357762353 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f44d405d050 con 0x557f2bbddcb0 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44e3c64740 10 client.18897 fetch_fsmap learned FSMap version 47 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44e3c64740 1 -- 172.21.15.12:0/2357762353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x557f2b916620 con 0x557f2bbddcb0 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44c1ffb640 1 -- 172.21.15.12:0/2357762353 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44cc013470 con 0x557f2bbddcb0 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44c1ffb640 1 -- 172.21.15.12:0/2357762353 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f44d4030070 con 0x557f2bbddcb0 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44e3c64740 10 client.18897 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44e3c64740 10 client.18897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44e3c64740 20 client.18897 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44e3c64740 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f2bbedb30 0x557f2bbeffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44e3c64740 4 client.18897 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44e3c64740 1 -- 172.21.15.12:0/2357762353 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f2bb44a20 con 0x557f2bbedb30 2024-09-19T06:52:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.885+0000 7f44da59c640 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f2bbedb30 0x557f2bbeffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.886+0000 7f44c1ffb640 10 client.18897 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.886+0000 7f44da59c640 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f2bbedb30 0x557f2bbeffa0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a6d8ae4b1bdb1f5 server_cookie=580035bf8b91e8b8 in_seq=0 out_seq=0 2024-09-19T06:52:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.886+0000 7f44c1ffb640 1 -- 172.21.15.12:0/2357762353 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f2bb44a20 con 0x557f2bbedb30 2024-09-19T06:52:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.886+0000 7f44c1ffb640 10 client.18897 handle_command_reply: tid=0 2024-09-19T06:52:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 client.18897 shutdown 2024-09-19T06:52:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 -- 172.21.15.12:0/2357762353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbddcb0 msgr2=0x557f2bbdb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbddcb0 0x557f2bbdb580 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f44d4035000 tx=0x7f44d402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 -- 172.21.15.12:0/2357762353 shutdown_connections 2024-09-19T06:52:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f2bbedb30 0x557f2bbeffa0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbddcb0 0x557f2bbdb580 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbd3410 0x557f2bbdb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44c1ffb640 0 client.18897 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 --2- 172.21.15.12:0/2357762353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbdab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 -- 172.21.15.12:0/2357762353 >> 172.21.15.12:0/2357762353 conn(0x557f2bbcf060 msgr2=0x557f2bbd4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 -- 172.21.15.12:0/2357762353 shutdown_connections 2024-09-19T06:52:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 1 -- 172.21.15.12:0/2357762353 wait complete. 2024-09-19T06:52:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.887+0000 7f44e3c64740 20 client.18897 trim_cache size 0 max 16384 2024-09-19T06:52:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.901+0000 7f44e3c64740 1 Processor -- start 2024-09-19T06:52:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.901+0000 7f44e3c64740 1 -- start start 2024-09-19T06:52:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.901+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd2af0 0x557f2bbdb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.901+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbd3410 0x557f2bbd4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.901+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbddcb0 0x557f2bbf5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.901+0000 7f44e3c64740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc1afc70 con 0x557f2bbd2af0 2024-09-19T06:52:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.901+0000 7f44e3c64740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc1b1870 con 0x557f2bbd3410 2024-09-19T06:52:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.901+0000 7f44e3c64740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc1b0340 con 0x557f2bbddcb0 2024-09-19T06:52:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.901+0000 7f44da59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd2af0 0x557f2bbdb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44da59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd2af0 0x557f2bbdb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36302/0 (socket says 172.21.15.12:36302) 2024-09-19T06:52:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44da59c640 1 -- 172.21.15.12:0/233318545 learned_addr learned my addr 172.21.15.12:0/233318545 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44dad9d640 1 --2- 172.21.15.12:0/233318545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbddcb0 0x557f2bbf5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44da59c640 1 -- 172.21.15.12:0/233318545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbddcb0 msgr2=0x557f2bbf5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44da59c640 1 --2- 172.21.15.12:0/233318545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbddcb0 0x557f2bbf5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44da59c640 1 -- 172.21.15.12:0/233318545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbd3410 msgr2=0x557f2bbd4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44da59c640 1 --2- 172.21.15.12:0/233318545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbd3410 0x557f2bbd4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44da59c640 1 -- 172.21.15.12:0/233318545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f2bbcee90 con 0x557f2bbd2af0 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44da59c640 1 --2- 172.21.15.12:0/233318545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd2af0 0x557f2bbdb3b0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f44cc013f60 tx=0x7f44cc013f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0652fa144b41ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44c3fff640 1 -- 172.21.15.12:0/233318545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc017040 con 0x557f2bbd2af0 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44c3fff640 1 -- 172.21.15.12:0/233318545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44cc02a070 con 0x557f2bbd2af0 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.902+0000 7f44c3fff640 1 -- 172.21.15.12:0/233318545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc025c10 con 0x557f2bbd2af0 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 -- 172.21.15.12:0/233318545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd2af0 msgr2=0x557f2bbdb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 --2- 172.21.15.12:0/233318545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd2af0 0x557f2bbdb3b0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f44cc013f60 tx=0x7f44cc013f90 comp rx=0 tx=0).stop 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 -- 172.21.15.12:0/233318545 shutdown_connections 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 --2- 172.21.15.12:0/233318545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbddcb0 0x557f2bbf5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 --2- 172.21.15.12:0/233318545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbd3410 0x557f2bbd4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 --2- 172.21.15.12:0/233318545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd2af0 0x557f2bbdb3b0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 -- 172.21.15.12:0/233318545 >> 172.21.15.12:0/233318545 conn(0x557f2bbcf060 msgr2=0x557f2bbd4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 -- 172.21.15.12:0/233318545 shutdown_connections 2024-09-19T06:52:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 -- 172.21.15.12:0/233318545 wait complete. 2024-09-19T06:52:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 -- start start 2024-09-19T06:52:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 Processor -- start 2024-09-19T06:52:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbd7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbd7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 0x557f2bbd84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc1b11a0 con 0x557f2bbd3410 2024-09-19T06:52:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc1b0aa0 con 0x557f2bbddcb0 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.903+0000 7f44e3c64740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc1adc70 con 0x557f2bbd2af0 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44e3c64740 10 client.0 _ll_register_callbacks cb 0x7f44d4031430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44d9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbd7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44da59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbd7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44d9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbd7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36306/0 (socket says 172.21.15.12:36306) 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44d9d9b640 1 -- 172.21.15.12:0/3940996346 learned_addr learned my addr 172.21.15.12:0/3940996346 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44dad9d640 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 0x557f2bbd84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44d9d9b640 1 -- 172.21.15.12:0/3940996346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 msgr2=0x557f2bbd7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44d9d9b640 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbd7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44d9d9b640 1 -- 172.21.15.12:0/3940996346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 msgr2=0x557f2bbd84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44d9d9b640 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 0x557f2bbd84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44d9d9b640 1 -- 172.21.15.12:0/3940996346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f2bbe4110 con 0x557f2bbd3410 2024-09-19T06:52:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44da59c640 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbd7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44dad9d640 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 0x557f2bbd84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44d9d9b640 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbd7f60 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009610 tx=0x7f44d009b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f482e5f1a98b842 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44c1ffb640 1 -- 172.21.15.12:0/3940996346 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0020040 con 0x557f2bbd3410 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44c1ffb640 1 -- 172.21.15.12:0/3940996346 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f44d00860b0 con 0x557f2bbd3410 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44e3c64740 1 -- 172.21.15.12:0/3940996346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44cc02a070 con 0x557f2bbd3410 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44c1ffb640 1 -- 172.21.15.12:0/3940996346 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f44d00a4830 con 0x557f2bbd3410 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44e3c64740 10 client.18903 fetch_fsmap learned FSMap version 47 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.904+0000 7f44e3c64740 1 -- 172.21.15.12:0/3940996346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x557f2bc58b10 con 0x557f2bbd3410 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44c1ffb640 1 -- 172.21.15.12:0/3940996346 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44cc02a070 con 0x557f2bbd3410 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44c1ffb640 1 -- 172.21.15.12:0/3940996346 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f44d009aa80 con 0x557f2bbd3410 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44e3c64740 10 client.18903 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T06:52:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44e3c64740 10 client.18903 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44e3c64740 20 client.18903 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44e3c64740 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f2bc59230 0x557f2bc5b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44e3c64740 4 client.18903 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:52:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44e3c64740 1 -- 172.21.15.12:0/3940996346 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f2bb3ed70 con 0x557f2bc59230 2024-09-19T06:52:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44da59c640 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f2bc59230 0x557f2bc5b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44da59c640 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f2bc59230 0x557f2bc5b620 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cba893cfa26149df server_cookie=f7ea04f86a3469c4 in_seq=0 out_seq=0 2024-09-19T06:52:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.905+0000 7f44c1ffb640 10 client.18903 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44c1ffb640 1 -- 172.21.15.12:0/3940996346 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f2bb3ed70 con 0x557f2bc59230 2024-09-19T06:52:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44c1ffb640 10 client.18903 handle_command_reply: tid=0 2024-09-19T06:52:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44e3c64740 1 client.18903 shutdown 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44e3c64740 1 -- 172.21.15.12:0/3940996346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 msgr2=0x557f2bbd7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44e3c64740 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbd7f60 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009610 tx=0x7f44d009b650 comp rx=0 tx=0).stop 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44e3c64740 1 -- 172.21.15.12:0/3940996346 shutdown_connections 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44e3c64740 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557f2bc59230 0x557f2bc5b620 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44e3c64740 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557f2bbddcb0 0x557f2bbd84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44e3c64740 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f2bbd3410 0x557f2bbd7f60 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44c1ffb640 0 client.18903 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44e3c64740 1 --2- 172.21.15.12:0/3940996346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557f2bbd2af0 0x557f2bbd7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44e3c64740 1 -- 172.21.15.12:0/3940996346 >> 172.21.15.12:0/3940996346 conn(0x557f2bbcf060 msgr2=0x557f2bbdcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.915+0000 7f44e3c64740 1 -- 172.21.15.12:0/3940996346 shutdown_connections 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e3c64740 1 -- 172.21.15.12:0/3940996346 wait complete. 2024-09-19T06:52:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e3c64740 20 client.18903 trim_cache size 0 max 16384 2024-09-19T06:52:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:52:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:52:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:52:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 -- 172.21.15.12:0/711161869 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44c40a3460 msgr2=0x7f44c40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44c40a3460 0x7f44c40a5920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f44d4005e30 tx=0x7f44d403d040 comp rx=0 tx=0).stop 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 -- 172.21.15.12:0/711161869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44dc101390 msgr2=0x7f44dc1988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44dc101390 0x7f44dc1988d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f44d000d950 tx=0x7f44d000dd50 comp rx=0 tx=0).stop 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 -- 172.21.15.12:0/711161869 shutdown_connections 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44c40a3460 0x7f44c40a5920 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44dc106a00 0x7f44dc19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44dc101390 0x7f44dc1988d0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 --2- 172.21.15.12:0/711161869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44dc1009f0 0x7f44dc198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 -- 172.21.15.12:0/711161869 >> 172.21.15.12:0/711161869 conn(0x7f44dc0fc6b0 msgr2=0x7f44dc104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 -- 172.21.15.12:0/711161869 shutdown_connections 2024-09-19T06:52:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:36.916+0000 7f44e0df1640 1 -- 172.21.15.12:0/711161869 wait complete. 2024-09-19T06:52:38.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:37 smithi016 ceph-mon[34911]: pgmap v389: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 30 MiB/s wr, 2.17k op/s 2024-09-19T06:52:38.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:37 smithi173 ceph-mon[35349]: pgmap v389: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 30 MiB/s wr, 2.17k op/s 2024-09-19T06:52:38.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:37 smithi012 ceph-mon[30937]: pgmap v389: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 30 MiB/s wr, 2.17k op/s 2024-09-19T06:52:38.586 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:52:38.586 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:52:38.843 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:39.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.363+0000 7f643d94f640 1 -- 172.21.15.12:0/3155845255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6438106a80 msgr2=0x7f6438106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:39.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.363+0000 7f643d94f640 1 --2- 172.21.15.12:0/3155845255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6438106a80 0x7f6438106e60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6428009930 tx=0x7f642802a420 comp rx=0 tx=0).stop 2024-09-19T06:52:39.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.363+0000 7f643d94f640 1 -- 172.21.15.12:0/3155845255 shutdown_connections 2024-09-19T06:52:39.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.363+0000 7f643d94f640 1 --2- 172.21.15.12:0/3155845255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6438101420 0x7f643810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.363+0000 7f643d94f640 1 --2- 172.21.15.12:0/3155845255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6438100a80 0x7f6438100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.363+0000 7f643d94f640 1 --2- 172.21.15.12:0/3155845255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6438106a80 0x7f6438106e60 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.363+0000 7f643d94f640 1 -- 172.21.15.12:0/3155845255 >> 172.21.15.12:0/3155845255 conn(0x7f64380fc7a0 msgr2=0x7f64380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.363+0000 7f643d94f640 1 -- 172.21.15.12:0/3155845255 shutdown_connections 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.363+0000 7f643d94f640 1 -- 172.21.15.12:0/3155845255 wait complete. 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f643d94f640 1 Processor -- start 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f643d94f640 1 -- start start 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f643d94f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6438100a80 0x7f64381983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f643d94f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6438101420 0x7f6438198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f643d94f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6438106a80 0x7f643819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f643d94f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6438110e80 con 0x7f6438100a80 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f643d94f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6438110d00 con 0x7f6438101420 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f643d94f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6438111000 con 0x7f6438106a80 2024-09-19T06:52:39.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f6436ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6438100a80 0x7f64381983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f6436ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6438100a80 0x7f64381983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36318/0 (socket says 172.21.15.12:36318) 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.364+0000 7f6436ffd640 1 -- 172.21.15.12:0/2937461205 learned_addr learned my addr 172.21.15.12:0/2937461205 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f64377fe640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6438106a80 0x7f643819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f64367fc640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6438101420 0x7f6438198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f6436ffd640 1 -- 172.21.15.12:0/2937461205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6438106a80 msgr2=0x7f643819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f6436ffd640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6438106a80 0x7f643819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f6436ffd640 1 -- 172.21.15.12:0/2937461205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6438101420 msgr2=0x7f6438198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f6436ffd640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6438101420 0x7f6438198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f6436ffd640 1 -- 172.21.15.12:0/2937461205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643819d380 con 0x7f6438100a80 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f64367fc640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6438101420 0x7f6438198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f6436ffd640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6438100a80 0x7f64381983d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f6428009230 tx=0x7f6428004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:39.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f643c94d640 1 -- 172.21.15.12:0/2937461205 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642803f030 con 0x7f6438100a80 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f643c94d640 1 -- 172.21.15.12:0/2937461205 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6428003ad0 con 0x7f6438100a80 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f643d94f640 1 -- 172.21.15.12:0/2937461205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643819d610 con 0x7f6438100a80 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f643c94d640 1 -- 172.21.15.12:0/2937461205 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428035070 con 0x7f6438100a80 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.365+0000 7f643d94f640 1 -- 172.21.15.12:0/2937461205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64381a4f50 con 0x7f6438100a80 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.367+0000 7f643c94d640 1 -- 172.21.15.12:0/2937461205 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6428042030 con 0x7f6438100a80 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f643fd28740 1 Processor -- start 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f643fd28740 1 -- start start 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f643fd28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d61de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f643fd28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 0x559a5d62cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f643c94d640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f64200a33b0 0x7f64200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f643fd28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d62f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f643fd28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559a5d583280 con 0x559a5d61da20 2024-09-19T06:52:39.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f643fd28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559a5d52ab10 con 0x559a5d61e340 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f643fd28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559a5d57f240 con 0x559a5d62d150 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f64377fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d61de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f64377fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d61de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36334/0 (socket says 172.21.15.12:36334) 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f64377fe640 1 -- 172.21.15.12:0/482189129 learned_addr learned my addr 172.21.15.12:0/482189129 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f64367fc640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f64200a33b0 0x7f64200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f643c94d640 1 -- 172.21.15.12:0/2937461205 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f64280f03d0 con 0x7f6438100a80 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.368+0000 7f6436ffd640 1 --2- 172.21.15.12:0/482189129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 0x559a5d62cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f64377fe640 1 --2- 172.21.15.12:0/482189129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d62f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f64377fe640 1 -- 172.21.15.12:0/482189129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 msgr2=0x559a5d62f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f64377fe640 1 --2- 172.21.15.12:0/482189129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d62f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f64377fe640 1 -- 172.21.15.12:0/482189129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 msgr2=0x559a5d62cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f64377fe640 1 --2- 172.21.15.12:0/482189129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 0x559a5d62cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f64377fe640 1 -- 172.21.15.12:0/482189129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5d5371f0 con 0x559a5d61da20 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f64377fe640 1 --2- 172.21.15.12:0/482189129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d61de00 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f64300137c0 tx=0x7f6430009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20442f52b7ed89be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f64367fc640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f64200a33b0 0x7f64200a5870 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f643806b7e0 tx=0x7f642c005d90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f641dffb640 1 -- 172.21.15.12:0/482189129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430013e00 con 0x559a5d61da20 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f641dffb640 1 -- 172.21.15.12:0/482189129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6430013110 con 0x559a5d61da20 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.369+0000 7f641dffb640 1 -- 172.21.15.12:0/482189129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430011b30 con 0x559a5d61da20 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.370+0000 7f643fd28740 1 -- 172.21.15.12:0/482189129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 msgr2=0x559a5d61de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.370+0000 7f643fd28740 1 --2- 172.21.15.12:0/482189129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d61de00 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f64300137c0 tx=0x7f6430009870 comp rx=0 tx=0).stop 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.370+0000 7f643fd28740 1 -- 172.21.15.12:0/482189129 shutdown_connections 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.370+0000 7f643fd28740 1 --2- 172.21.15.12:0/482189129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d62f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.370+0000 7f643fd28740 1 --2- 172.21.15.12:0/482189129 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 0x559a5d62cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.370+0000 7f643fd28740 1 --2- 172.21.15.12:0/482189129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d61de00 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.370+0000 7f643fd28740 1 -- 172.21.15.12:0/482189129 >> 172.21.15.12:0/482189129 conn(0x559a5d61a0f0 msgr2=0x559a5d61a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:39.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.370+0000 7f643fd28740 1 -- 172.21.15.12:0/482189129 shutdown_connections 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.370+0000 7f643fd28740 1 -- 172.21.15.12:0/482189129 wait complete. 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.370+0000 7f643fd28740 1 -- start start 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f643fd28740 1 Processor -- start 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f643fd28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d62a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f643fd28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d61e340 0x559a5d62a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f643fd28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d62d150 0x559a5d62ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f643fd28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559a5d62fd20 con 0x559a5d61da20 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f643fd28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559a5d53df10 con 0x559a5d62d150 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f643fd28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559a5d62fea0 con 0x559a5d61e340 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f643fd28740 10 client.0 _ll_register_callbacks cb 0x559a5d506a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f6436ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d62a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f6436ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d62a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36340/0 (socket says 172.21.15.12:36340) 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f64367fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d61e340 0x559a5d62a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f6436ffd640 1 -- 172.21.15.12:0/1861233776 learned_addr learned my addr 172.21.15.12:0/1861233776 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f64377fe640 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d62d150 0x559a5d62ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f6436ffd640 1 -- 172.21.15.12:0/1861233776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d61e340 msgr2=0x559a5d62a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f6436ffd640 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d61e340 0x559a5d62a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f6436ffd640 1 -- 172.21.15.12:0/1861233776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d62d150 msgr2=0x559a5d62ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f6436ffd640 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d62d150 0x559a5d62ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f6436ffd640 1 -- 172.21.15.12:0/1861233776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5d2f46a0 con 0x559a5d61da20 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f64377fe640 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d62d150 0x559a5d62ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f6436ffd640 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d62a090 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f64280b8f80 tx=0x7f64280bccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce340f923f2e118 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.371+0000 7f6416ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f6416ffd640 1 -- 172.21.15.12:0/1861233776 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280ef070 con 0x559a5d61da20 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f6416ffd640 1 -- 172.21.15.12:0/1861233776 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f6428003c80 con 0x559a5d61da20 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f643fd28740 1 -- 172.21.15.12:0/1861233776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6430013110 con 0x559a5d61da20 2024-09-19T06:52:39.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f6416ffd640 1 -- 172.21.15.12:0/1861233776 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f6428049040 con 0x559a5d61da20 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f643fd28740 10 client.18915 fetch_fsmap learned FSMap version 47 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f643fd28740 1 -- 172.21.15.12:0/1861233776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x559a5d63b9c0 con 0x559a5d61da20 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f6416ffd640 1 -- 172.21.15.12:0/1861233776 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6430013110 con 0x559a5d61da20 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f6416ffd640 1 -- 172.21.15.12:0/1861233776 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f64280d91d0 con 0x559a5d61da20 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f643fd28740 10 client.18915 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f643fd28740 10 client.18915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f643fd28740 20 client.18915 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f643fd28740 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559a5d63cd60 0x559a5d63f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f643fd28740 4 client.18915 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f643fd28740 1 -- 172.21.15.12:0/1861233776 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a5d5907f0 con 0x559a5d63cd60 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.372+0000 7f64367fc640 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559a5d63cd60 0x559a5d63f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.373+0000 7f6416ffd640 10 client.18915 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:39.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.373+0000 7f64367fc640 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559a5d63cd60 0x559a5d63f170 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a63c8c83896aa038 server_cookie=6d9e26649d5e3f3c in_seq=0 out_seq=0 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.373+0000 7f6416ffd640 1 -- 172.21.15.12:0/1861233776 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a5d5907f0 con 0x559a5d63cd60 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.373+0000 7f6416ffd640 10 client.18915 handle_command_reply: tid=0 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 client.18915 shutdown 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 -- 172.21.15.12:0/1861233776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 msgr2=0x559a5d62a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d62a090 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f64280b8f80 tx=0x7f64280bccb0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 -- 172.21.15.12:0/1861233776 shutdown_connections 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559a5d63cd60 0x559a5d63f170 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d62d150 0x559a5d62ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d61e340 0x559a5d62a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 --2- 172.21.15.12:0/1861233776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d62a090 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f6416ffd640 0 client.18915 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 -- 172.21.15.12:0/1861233776 >> 172.21.15.12:0/1861233776 conn(0x559a5d61a0f0 msgr2=0x559a5d61fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:39.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 -- 172.21.15.12:0/1861233776 shutdown_connections 2024-09-19T06:52:39.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 1 -- 172.21.15.12:0/1861233776 wait complete. 2024-09-19T06:52:39.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.374+0000 7f643fd28740 20 client.18915 trim_cache size 0 max 16384 2024-09-19T06:52:39.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f643fd28740 1 Processor -- start 2024-09-19T06:52:39.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f643fd28740 1 -- start start 2024-09-19T06:52:39.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f643fd28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61da20 0x559a5d644a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f643fd28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61e340 0x559a5d644f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f643fd28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d6272f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f643fd28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f64381ab8b0 con 0x559a5d61e340 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f643fd28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f64381ad4b0 con 0x559a5d61da20 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f643fd28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f64381abf80 con 0x559a5d62d150 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f64367fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61e340 0x559a5d644f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f64367fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61e340 0x559a5d644f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36350/0 (socket says 172.21.15.12:36350) 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f64367fc640 1 -- 172.21.15.12:0/3629392998 learned_addr learned my addr 172.21.15.12:0/3629392998 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f64377fe640 1 --2- 172.21.15.12:0/3629392998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d6272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.392+0000 7f6436ffd640 1 --2- 172.21.15.12:0/3629392998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61da20 0x559a5d644a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.393+0000 7f64367fc640 1 -- 172.21.15.12:0/3629392998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 msgr2=0x559a5d6272f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.393+0000 7f64367fc640 1 --2- 172.21.15.12:0/3629392998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d6272f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.393+0000 7f64367fc640 1 -- 172.21.15.12:0/3629392998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61da20 msgr2=0x559a5d644a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:39.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.393+0000 7f64367fc640 1 --2- 172.21.15.12:0/3629392998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61da20 0x559a5d644a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.393+0000 7f64367fc640 1 -- 172.21.15.12:0/3629392998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5d629040 con 0x559a5d61e340 2024-09-19T06:52:39.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.393+0000 7f64367fc640 1 --2- 172.21.15.12:0/3629392998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61e340 0x559a5d644f80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f642c005fd0 tx=0x7f642c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa04fc6f52a1d953 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:39.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.393+0000 7f641d7fa640 1 -- 172.21.15.12:0/3629392998 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c005020 con 0x559a5d61e340 2024-09-19T06:52:39.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.393+0000 7f641d7fa640 1 -- 172.21.15.12:0/3629392998 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f642c0047a0 con 0x559a5d61e340 2024-09-19T06:52:39.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.393+0000 7f641d7fa640 1 -- 172.21.15.12:0/3629392998 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c026610 con 0x559a5d61e340 2024-09-19T06:52:39.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 -- 172.21.15.12:0/3629392998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61e340 msgr2=0x559a5d644f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:39.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 --2- 172.21.15.12:0/3629392998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61e340 0x559a5d644f80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f642c005fd0 tx=0x7f642c013000 comp rx=0 tx=0).stop 2024-09-19T06:52:39.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 -- 172.21.15.12:0/3629392998 shutdown_connections 2024-09-19T06:52:39.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 --2- 172.21.15.12:0/3629392998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d6272f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 --2- 172.21.15.12:0/3629392998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61e340 0x559a5d644f80 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 --2- 172.21.15.12:0/3629392998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61da20 0x559a5d644a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 -- 172.21.15.12:0/3629392998 >> 172.21.15.12:0/3629392998 conn(0x559a5d61a0f0 msgr2=0x559a5d62c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 -- 172.21.15.12:0/3629392998 shutdown_connections 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 -- 172.21.15.12:0/3629392998 wait complete. 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 -- start start 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.394+0000 7f643fd28740 1 Processor -- start 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f643fd28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d6315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f643fd28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 0x559a5d631b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f643fd28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d6a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f643fd28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f64381acde0 con 0x559a5d61da20 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f643fd28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f64381ac6e0 con 0x559a5d61e340 2024-09-19T06:52:39.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f643fd28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f64381a98b0 con 0x559a5d62d150 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f643fd28740 10 client.0 _ll_register_callbacks cb 0x7f64280bc380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6436ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d6315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6436ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d6315e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36360/0 (socket says 172.21.15.12:36360) 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6436ffd640 1 -- 172.21.15.12:0/1248428899 learned_addr learned my addr 172.21.15.12:0/1248428899 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f64377fe640 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d6a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f64367fc640 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 0x559a5d631b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6436ffd640 1 -- 172.21.15.12:0/1248428899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 msgr2=0x559a5d6a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6436ffd640 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d6a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6436ffd640 1 -- 172.21.15.12:0/1248428899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 msgr2=0x559a5d631b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6436ffd640 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 0x559a5d631b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6436ffd640 1 -- 172.21.15.12:0/1248428899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5d6a6f80 con 0x559a5d61da20 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f64367fc640 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 0x559a5d631b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6436ffd640 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d6315e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f64280c4cf0 tx=0x7f64280b8e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e122363595a4c508 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:39.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6416ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6416ffd640 1 -- 172.21.15.12:0/1248428899 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280ef070 con 0x559a5d61da20 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f6416ffd640 1 -- 172.21.15.12:0/1248428899 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f6428031dd0 con 0x559a5d61da20 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.395+0000 7f643fd28740 1 -- 172.21.15.12:0/1248428899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f642c0047a0 con 0x559a5d61da20 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f6416ffd640 1 -- 172.21.15.12:0/1248428899 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f64280bc0f0 con 0x559a5d61da20 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f643fd28740 10 client.18921 fetch_fsmap learned FSMap version 47 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f643fd28740 1 -- 172.21.15.12:0/1248428899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x559a5d6a82d0 con 0x559a5d61da20 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f6416ffd640 1 -- 172.21.15.12:0/1248428899 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f642c0047a0 con 0x559a5d61da20 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f6416ffd640 1 -- 172.21.15.12:0/1248428899 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f64280c4d90 con 0x559a5d61da20 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f643fd28740 10 client.18921 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f643fd28740 10 client.18921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f643fd28740 20 client.18921 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f643fd28740 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559a5d6a88c0 0x559a5d6aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f643fd28740 4 client.18921 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:52:39.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f643fd28740 1 -- 172.21.15.12:0/1248428899 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559a5d58ad00 con 0x559a5d6a88c0 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.396+0000 7f64367fc640 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559a5d6a88c0 0x559a5d6aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.397+0000 7f64367fc640 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559a5d6a88c0 0x559a5d6aace0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3049ffc15344a744 server_cookie=9350aa395c6f03c6 in_seq=0 out_seq=0 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.397+0000 7f6416ffd640 10 client.18921 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f6416ffd640 1 -- 172.21.15.12:0/1248428899 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559a5d58ad00 con 0x559a5d6a88c0 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f6416ffd640 10 client.18921 handle_command_reply: tid=0 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 client.18921 shutdown 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 -- 172.21.15.12:0/1248428899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 msgr2=0x559a5d6315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d6315e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f64280c4cf0 tx=0x7f64280b8e50 comp rx=0 tx=0).stop 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 -- 172.21.15.12:0/1248428899 shutdown_connections 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559a5d6a88c0 0x559a5d6aace0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559a5d62d150 0x559a5d6a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559a5d61e340 0x559a5d631b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 --2- 172.21.15.12:0/1248428899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559a5d61da20 0x559a5d6315e0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 -- 172.21.15.12:0/1248428899 >> 172.21.15.12:0/1248428899 conn(0x559a5d61a0f0 msgr2=0x559a5d61f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f6416ffd640 0 client.18921 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 -- 172.21.15.12:0/1248428899 shutdown_connections 2024-09-19T06:52:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 1 -- 172.21.15.12:0/1248428899 wait complete. 2024-09-19T06:52:39.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.398+0000 7f643fd28740 20 client.18921 trim_cache size 0 max 16384 2024-09-19T06:52:39.404 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:52:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:52:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "5a6c2f07-fd92-4303-8d63-77ea94ae5e69", 2024-09-19T06:52:39.404 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:52:39.404 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:52:39.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 -- 172.21.15.12:0/2937461205 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f64200a33b0 msgr2=0x7f64200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:39.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f64200a33b0 0x7f64200a5870 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f643806b7e0 tx=0x7f642c005d90 comp rx=0 tx=0).stop 2024-09-19T06:52:39.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 -- 172.21.15.12:0/2937461205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6438100a80 msgr2=0x7f64381983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:39.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6438100a80 0x7f64381983d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f6428009230 tx=0x7f6428004270 comp rx=0 tx=0).stop 2024-09-19T06:52:39.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 -- 172.21.15.12:0/2937461205 shutdown_connections 2024-09-19T06:52:39.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f64200a33b0 0x7f64200a5870 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6438106a80 0x7f643819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6438101420 0x7f6438198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 --2- 172.21.15.12:0/2937461205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6438100a80 0x7f64381983d0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:39.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 -- 172.21.15.12:0/2937461205 >> 172.21.15.12:0/2937461205 conn(0x7f64380fc7a0 msgr2=0x7f6438104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:39.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 -- 172.21.15.12:0/2937461205 shutdown_connections 2024-09-19T06:52:39.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:39.399+0000 7f643d94f640 1 -- 172.21.15.12:0/2937461205 wait complete. 2024-09-19T06:52:39.758 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: 2024-09-19T06:52:39.410+0000 7f466df5b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [...14,head] /volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans/ auth{1=1,2=1,3=1,4=1} v2068 ap=2 f(v24 m2024-09-19T06:52:27.402904+0000 1=1+0) n(v45 rc2024-09-19T06:52:27.402904+0000 2=1+1) old_inodes=6 (inest sync->mix g=1,2,3,4) mcw={2=AsLsXsFs,4=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55a161e61180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v310>,<0x10000000005/data v119>,<0x100000001fb/postgres v23>,<0x100000001fa/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 v38>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v2068>,<0x10000000005/data v903>,<0x100000001fb/postgres v519>,<0x100000001fa/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 v550>,<0x10000000001/sv_1 v558>,<0x10000000000/qa v565>,<0x1/volumes v510>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:52:27.378904+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:52:27.402904+0000 2=1+1)","memory_value.dirstat":"f(v24 m2024-09-19T06:52:27.402904+0000 1=1+0)","memory_value.rstat":"n(v45 rc2024-09-19T06:52:27.402904+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-19T06:52:40.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: pgmap v390: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-19T06:52:40.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:52:40.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:52:40.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:52:40.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:52:40.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:52:40.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:52:40.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:52:40.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:39 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: pgmap v390: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-19T06:52:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:52:40.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:52:40.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:52:40.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:52:40.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:52:40.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:52:40.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:52:40.260 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:39 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:52:40.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: pgmap v390: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:52:40.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:39 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:40.695 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:40.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 715.0 s, 592.8 tps, lat 171.454 ms stddev 735.393 2024-09-19T06:52:41.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:40 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:52:41.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:40 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:40 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:52:41.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:40 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:52:41.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:40 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:40 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:40 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:40 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:52:41.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:40 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:40 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:52:41.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:40 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:52:41.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:40 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:40 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:40 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.325+0000 7f7f12e25640 1 -- 172.21.15.12:0/324150096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f0c06dba0 msgr2=0x7f7f0c06df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:41.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.325+0000 7f7f12e25640 1 --2- 172.21.15.12:0/324150096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f0c06dba0 0x7f7f0c06df80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009be0 tx=0x7f7f0402a710 comp rx=0 tx=0).stop 2024-09-19T06:52:41.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.327+0000 7f7f12e25640 1 -- 172.21.15.12:0/324150096 shutdown_connections 2024-09-19T06:52:41.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.327+0000 7f7f12e25640 1 --2- 172.21.15.12:0/324150096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f0c11b210 0x7f7f0c11d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.327+0000 7f7f12e25640 1 --2- 172.21.15.12:0/324150096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f0c06e4c0 0x7f7f0c11acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.327+0000 7f7f12e25640 1 --2- 172.21.15.12:0/324150096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f0c06dba0 0x7f7f0c06df80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.327+0000 7f7f12e25640 1 -- 172.21.15.12:0/324150096 >> 172.21.15.12:0/324150096 conn(0x7f7f0c06cdc0 msgr2=0x7f7f0c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:41.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.327+0000 7f7f12e25640 1 -- 172.21.15.12:0/324150096 shutdown_connections 2024-09-19T06:52:41.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.327+0000 7f7f12e25640 1 -- 172.21.15.12:0/324150096 wait complete. 2024-09-19T06:52:41.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.328+0000 7f7f12e25640 1 Processor -- start 2024-09-19T06:52:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.328+0000 7f7f12e25640 1 -- start start 2024-09-19T06:52:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.329+0000 7f7f12e25640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f0c06dba0 0x7f7f0c11a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.329+0000 7f7f12e25640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f0c06e4c0 0x7f7f0c113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.329+0000 7f7f12e25640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f0c11b210 0x7f7f0c113db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.329+0000 7f7f0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f0c06e4c0 0x7f7f0c113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.329+0000 7f7f0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f0c06e4c0 0x7f7f0c113870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49584/0 (socket says 172.21.15.12:49584) 2024-09-19T06:52:41.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.329+0000 7f7f10bc1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f0c06dba0 0x7f7f0c11a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.329+0000 7f7f10bc1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f0c06dba0 0x7f7f0c11a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53508/0 (socket says 172.21.15.12:53508) 2024-09-19T06:52:41.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.330+0000 7f7f113c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f0c11b210 0x7f7f0c113db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.330+0000 7f7f113c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f0c11b210 0x7f7f0c113db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:51048/0 (socket says 172.21.15.12:51048) 2024-09-19T06:52:41.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.330+0000 7f7f12e25640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c120e20 con 0x7f7f0c06dba0 2024-09-19T06:52:41.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.330+0000 7f7f12e25640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c120ca0 con 0x7f7f0c06e4c0 2024-09-19T06:52:41.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.330+0000 7f7f12e25640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c120fa0 con 0x7f7f0c11b210 2024-09-19T06:52:41.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.330+0000 7f7f0bfff640 1 -- 172.21.15.12:0/4138594095 learned_addr learned my addr 172.21.15.12:0/4138594095 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:41.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:40 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:52:41.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:40 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:40 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:52:41.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:40 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:52:41.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:40 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:40 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:40 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:52:41.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.330+0000 7f7f0bfff640 1 -- 172.21.15.12:0/4138594095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f0c11b210 msgr2=0x7f7f0c113db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:41.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.330+0000 7f7f0bfff640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f0c11b210 0x7f7f0c113db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.330+0000 7f7f0bfff640 1 -- 172.21.15.12:0/4138594095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f0c06dba0 msgr2=0x7f7f0c11a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:41.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.330+0000 7f7f0bfff640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f0c06dba0 0x7f7f0c11a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.331+0000 7f7f0bfff640 1 -- 172.21.15.12:0/4138594095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c114370 con 0x7f7f0c06e4c0 2024-09-19T06:52:41.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.331+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f0c06dba0 0x7f7f0c11a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-19T06:52:41.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.331+0000 7f7f113c2640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f0c11b210 0x7f7f0c113db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-19T06:52:41.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.331+0000 7f7f0bfff640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f0c06e4c0 0x7f7f0c113870 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00d950 tx=0x7f7efc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:41.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.331+0000 7f7f09ffb640 1 -- 172.21.15.12:0/4138594095 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc017070 con 0x7f7f0c06e4c0 2024-09-19T06:52:41.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.331+0000 7f7f09ffb640 1 -- 172.21.15.12:0/4138594095 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7efc009c30 con 0x7f7f0c06e4c0 2024-09-19T06:52:41.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.331+0000 7f7f09ffb640 1 -- 172.21.15.12:0/4138594095 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00f690 con 0x7f7f0c06e4c0 2024-09-19T06:52:41.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.332+0000 7f7f12e25640 1 -- 172.21.15.12:0/4138594095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c114660 con 0x7f7f0c06e4c0 2024-09-19T06:52:41.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.332+0000 7f7f12e25640 1 -- 172.21.15.12:0/4138594095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c118630 con 0x7f7f0c06e4c0 2024-09-19T06:52:41.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.336+0000 7f7f151fe740 1 Processor -- start 2024-09-19T06:52:41.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.336+0000 7f7f151fe740 1 -- start start 2024-09-19T06:52:41.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.337+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.337+0000 7f7f113c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.337+0000 7f7f113c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:51058/0 (socket says 172.21.15.12:51058) 2024-09-19T06:52:41.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.337+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 0x56514c1d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.337+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 0x56514c1d5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.337+0000 7f7f151fe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56514c12e2e0 con 0x56514c1c8dc0 2024-09-19T06:52:41.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.337+0000 7f7f151fe740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56514c0d5ce0 con 0x56514c1d3680 2024-09-19T06:52:41.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.337+0000 7f7f151fe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56514c12a2a0 con 0x56514c1c84a0 2024-09-19T06:52:41.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.337+0000 7f7f113c2640 1 -- 172.21.15.12:0/1056415290 learned_addr learned my addr 172.21.15.12:0/1056415290 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:41.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.337+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 0x56514c1d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.338+0000 7f7f09ffb640 1 -- 172.21.15.12:0/4138594095 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7efc0109d0 con 0x7f7f0c06e4c0 2024-09-19T06:52:41.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.339+0000 7f7f0bfff640 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 0x56514c1d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.339+0000 7f7f113c2640 1 -- 172.21.15.12:0/1056415290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 msgr2=0x56514c1d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:41.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.339+0000 7f7f09ffb640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7ef40a3540 0x7f7ef40a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.339+0000 7f7f113c2640 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 0x56514c1d5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.339+0000 7f7f113c2640 1 -- 172.21.15.12:0/1056415290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 msgr2=0x56514c1d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:41.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.339+0000 7f7f113c2640 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 0x56514c1d3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.339+0000 7f7f113c2640 1 -- 172.21.15.12:0/1056415290 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514c0ba440 con 0x56514c1c84a0 2024-09-19T06:52:41.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.339+0000 7f7f0bfff640 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 0x56514c1d5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:41.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.339+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 0x56514c1d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:41.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.339+0000 7f7f09ffb640 1 -- 172.21.15.12:0/4138594095 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f7efc0cf9d0 con 0x7f7f0c06e4c0 2024-09-19T06:52:41.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.340+0000 7f7f113c2640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7ef40a3540 0x7f7ef40a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.340+0000 7f7f113c2640 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1c8880 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000a920 tx=0x7f7f0000ade0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f80cd43245e325 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:41.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.340+0000 7f7ef2ffd640 1 -- 172.21.15.12:0/1056415290 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0001d670 con 0x56514c1c84a0 2024-09-19T06:52:41.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.340+0000 7f7ef2ffd640 1 -- 172.21.15.12:0/1056415290 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f00015050 con 0x56514c1c84a0 2024-09-19T06:52:41.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.340+0000 7f7ef2ffd640 1 -- 172.21.15.12:0/1056415290 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00023070 con 0x56514c1c84a0 2024-09-19T06:52:41.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.340+0000 7f7f113c2640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7ef40a3540 0x7f7ef40a5a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f0001c000 tx=0x7f7f0001f000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:41.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.341+0000 7f7f151fe740 1 -- 172.21.15.12:0/1056415290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 msgr2=0x56514c1c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:41.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.341+0000 7f7f151fe740 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1c8880 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000a920 tx=0x7f7f0000ade0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.341+0000 7f7f151fe740 1 -- 172.21.15.12:0/1056415290 shutdown_connections 2024-09-19T06:52:41.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.341+0000 7f7f151fe740 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 0x56514c1d5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.341+0000 7f7f151fe740 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 0x56514c1d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.341+0000 7f7f151fe740 1 --2- 172.21.15.12:0/1056415290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1c8880 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.341+0000 7f7f151fe740 1 -- 172.21.15.12:0/1056415290 >> 172.21.15.12:0/1056415290 conn(0x56514c1c4a30 msgr2=0x56514c1c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:41.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.341+0000 7f7f151fe740 1 -- 172.21.15.12:0/1056415290 shutdown_connections 2024-09-19T06:52:41.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.341+0000 7f7f151fe740 1 -- 172.21.15.12:0/1056415290 wait complete. 2024-09-19T06:52:41.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.342+0000 7f7f151fe740 1 -- start start 2024-09-19T06:52:41.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.342+0000 7f7f151fe740 1 Processor -- start 2024-09-19T06:52:41.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.342+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c84a0 0x56514c1d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.342+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 0x56514c1d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.342+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1d3680 0x56514c1d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f151fe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56514c1d6250 con 0x56514c1c84a0 2024-09-19T06:52:41.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 0x56514c1d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f151fe740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56514c0e9050 con 0x56514c1c8dc0 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 0x56514c1d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49608/0 (socket says 172.21.15.12:49608) 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f0bfff640 1 -- 172.21.15.12:0/2803311190 learned_addr learned my addr 172.21.15.12:0/2803311190 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f113c2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1d3680 0x56514c1d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f151fe740 1 -- 172.21.15.12:0/2803311190 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56514c1d63d0 con 0x56514c1d3680 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c84a0 0x56514c1d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f151fe740 10 client.0 _ll_register_callbacks cb 0x56514c129160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f113c2640 1 -- 172.21.15.12:0/2803311190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 msgr2=0x56514c1d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f113c2640 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 0x56514c1d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f113c2640 1 -- 172.21.15.12:0/2803311190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c84a0 msgr2=0x56514c1d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f113c2640 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c84a0 0x56514c1d2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f113c2640 1 -- 172.21.15.12:0/2803311190 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56514be9f3c0 con 0x56514c1d3680 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f151fe740 1 -- 172.21.15.12:0/2803311190 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f00015050 con 0x56514c1d3680 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f0bfff640 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 0x56514c1d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7f113c2640 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1d3680 0x56514c1d0800 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000afd0 tx=0x7f7f00006c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64b77026fb6f655 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.343+0000 7f7eebfff640 10 client.28207 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.344+0000 7f7eebfff640 1 -- 172.21.15.12:0/2803311190 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00038050 con 0x56514c1d3680 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.344+0000 7f7eebfff640 1 -- 172.21.15.12:0/2803311190 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f7f0001d670 con 0x56514c1d3680 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.344+0000 7f7eebfff640 1 -- 172.21.15.12:0/2803311190 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f7f0002e070 con 0x56514c1d3680 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.344+0000 7f7f151fe740 10 client.28207 fetch_fsmap learned FSMap version 47 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.344+0000 7f7f151fe740 1 -- 172.21.15.12:0/2803311190 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=47}) -- 0x56514c1e1b40 con 0x56514c1d3680 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.344+0000 7f7eebfff640 1 -- 172.21.15.12:0/2803311190 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f7f0003b020 con 0x56514c1d3680 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.344+0000 7f7f151fe740 10 client.28207 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.344+0000 7f7f151fe740 10 client.28207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.344+0000 7f7f151fe740 20 client.28207 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:41.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.344+0000 7f7f151fe740 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56514c1e2e90 0x56514c1e5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.345+0000 7f7f151fe740 4 client.28207 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:41.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.345+0000 7f7f151fe740 1 -- 172.21.15.12:0/2803311190 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56514c13b850 con 0x56514c1e2e90 2024-09-19T06:52:41.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.345+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56514c1e2e90 0x56514c1e5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.345+0000 7f7eebfff640 10 client.28207 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:41.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.345+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56514c1e2e90 0x56514c1e5280 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2a6e9270d911eb7 server_cookie=d2ac2d9e8120b3e7 in_seq=0 out_seq=0 2024-09-19T06:52:41.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7eebfff640 1 -- 172.21.15.12:0/2803311190 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56514c13b850 con 0x56514c1e2e90 2024-09-19T06:52:41.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7eebfff640 10 client.28207 handle_command_reply: tid=0 2024-09-19T06:52:41.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7f151fe740 1 client.28207 shutdown 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7f151fe740 1 -- 172.21.15.12:0/2803311190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1d3680 msgr2=0x56514c1d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7f151fe740 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1d3680 0x56514c1d0800 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000afd0 tx=0x7f7f00006c70 comp rx=0 tx=0).stop 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7f151fe740 1 -- 172.21.15.12:0/2803311190 shutdown_connections 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7f151fe740 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56514c1e2e90 0x56514c1e5280 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7f151fe740 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1d3680 0x56514c1d0800 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7eebfff640 0 client.28207 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7f151fe740 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 0x56514c1d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7f151fe740 1 --2- 172.21.15.12:0/2803311190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c84a0 0x56514c1d2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.346+0000 7f7f151fe740 1 -- 172.21.15.12:0/2803311190 >> 172.21.15.12:0/2803311190 conn(0x56514c1c4a30 msgr2=0x56514c1ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.347+0000 7f7f151fe740 1 -- 172.21.15.12:0/2803311190 shutdown_connections 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.347+0000 7f7f151fe740 1 -- 172.21.15.12:0/2803311190 wait complete. 2024-09-19T06:52:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.347+0000 7f7f151fe740 20 client.28207 trim_cache size 0 max 16384 2024-09-19T06:52:41.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.370+0000 7f7f151fe740 1 Processor -- start 2024-09-19T06:52:41.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.370+0000 7f7f151fe740 1 -- start start 2024-09-19T06:52:41.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.371+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1df4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.371+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 0x56514c1ea820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f10bc1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1df4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f10bc1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1df4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:51086/0 (socket says 172.21.15.12:51086) 2024-09-19T06:52:41.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1d3680 0x56514c1ead60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f151fe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c1c52b0 con 0x56514c1d3680 2024-09-19T06:52:41.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f151fe740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c1c6eb0 con 0x56514c1c8dc0 2024-09-19T06:52:41.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f151fe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c1c5980 con 0x56514c1c84a0 2024-09-19T06:52:41.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f10bc1640 1 -- 172.21.15.12:0/1513157581 learned_addr learned my addr 172.21.15.12:0/1513157581 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:41.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f113c2640 1 --2- 172.21.15.12:0/1513157581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1d3680 0x56514c1ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f10bc1640 1 -- 172.21.15.12:0/1513157581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 msgr2=0x56514c1ea820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:41.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/1513157581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 0x56514c1ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f10bc1640 1 -- 172.21.15.12:0/1513157581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1d3680 msgr2=0x56514c1ead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:41.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/1513157581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1d3680 0x56514c1ead60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.372+0000 7f7f10bc1640 1 -- 172.21.15.12:0/1513157581 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56514c1d6340 con 0x56514c1c84a0 2024-09-19T06:52:41.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.373+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/1513157581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1df4b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009be0 tx=0x7f7f04030f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de8cacdc51224202 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:41.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.373+0000 7f7ef27fc640 1 -- 172.21.15.12:0/1513157581 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04036040 con 0x56514c1c84a0 2024-09-19T06:52:41.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.373+0000 7f7ef27fc640 1 -- 172.21.15.12:0/1513157581 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f04037040 con 0x56514c1c84a0 2024-09-19T06:52:41.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.373+0000 7f7ef27fc640 1 -- 172.21.15.12:0/1513157581 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04004260 con 0x56514c1c84a0 2024-09-19T06:52:41.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.374+0000 7f7f151fe740 1 -- 172.21.15.12:0/1513157581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 msgr2=0x56514c1df4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:41.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.374+0000 7f7f151fe740 1 --2- 172.21.15.12:0/1513157581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1df4b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009be0 tx=0x7f7f04030f60 comp rx=0 tx=0).stop 2024-09-19T06:52:41.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.374+0000 7f7f151fe740 1 -- 172.21.15.12:0/1513157581 shutdown_connections 2024-09-19T06:52:41.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.374+0000 7f7f151fe740 1 --2- 172.21.15.12:0/1513157581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1d3680 0x56514c1ead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.374+0000 7f7f151fe740 1 --2- 172.21.15.12:0/1513157581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1c8dc0 0x56514c1ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.374+0000 7f7f151fe740 1 --2- 172.21.15.12:0/1513157581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1df4b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.374+0000 7f7f151fe740 1 -- 172.21.15.12:0/1513157581 >> 172.21.15.12:0/1513157581 conn(0x56514c1c4a30 msgr2=0x56514c1cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:41.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.374+0000 7f7f151fe740 1 -- 172.21.15.12:0/1513157581 shutdown_connections 2024-09-19T06:52:41.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.375+0000 7f7f151fe740 1 -- 172.21.15.12:0/1513157581 wait complete. 2024-09-19T06:52:41.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.375+0000 7f7f151fe740 1 -- start start 2024-09-19T06:52:41.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.375+0000 7f7f151fe740 1 Processor -- start 2024-09-19T06:52:41.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.375+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1d8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.375+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 0x56514c1d9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.375+0000 7f7f151fe740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 0x56514c2447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.375+0000 7f7f151fe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c1c67e0 con 0x56514c1c8dc0 2024-09-19T06:52:41.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.375+0000 7f7f151fe740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c1c60e0 con 0x56514c1d3680 2024-09-19T06:52:41.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.375+0000 7f7f151fe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c1c32b0 con 0x56514c1c84a0 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f151fe740 10 client.0 _ll_register_callbacks cb 0x7f7f04034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f10bc1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1d8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f0bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 0x56514c1d9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f10bc1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1d8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:51092/0 (socket says 172.21.15.12:51092) 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f10bc1640 1 -- 172.21.15.12:0/550928602 learned_addr learned my addr 172.21.15.12:0/550928602 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f113c2640 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 0x56514c2447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f10bc1640 1 -- 172.21.15.12:0/550928602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 msgr2=0x56514c2447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 0x56514c2447b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f10bc1640 1 -- 172.21.15.12:0/550928602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 msgr2=0x56514c1d9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 0x56514c1d9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f10bc1640 1 -- 172.21.15.12:0/550928602 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56514c244df0 con 0x56514c1c84a0 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f10bc1640 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1d8e50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7f04034040 tx=0x7f7f04009280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1122c7f840624a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7eebfff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:52:41.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7eebfff640 1 -- 172.21.15.12:0/550928602 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f04053020 con 0x56514c1c84a0 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7f151fe740 1 -- 172.21.15.12:0/550928602 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f04037040 con 0x56514c1c84a0 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.376+0000 7f7eebfff640 1 -- 172.21.15.12:0/550928602 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f7f04003cc0 con 0x56514c1c84a0 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7eebfff640 1 -- 172.21.15.12:0/550928602 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f7f04036070 con 0x56514c1c84a0 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7f151fe740 10 client.28213 fetch_fsmap learned FSMap version 47 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7f151fe740 1 -- 172.21.15.12:0/550928602 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x56514c24d3b0 con 0x56514c1c84a0 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7eebfff640 1 -- 172.21.15.12:0/550928602 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f04037040 con 0x56514c1c84a0 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7eebfff640 1 -- 172.21.15.12:0/550928602 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f7f0403c040 con 0x56514c1c84a0 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7f151fe740 10 client.28213 fetch_fsmap finished waiting for FSMap version 47 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7f151fe740 10 client.28213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7f151fe740 20 client.28213 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7f151fe740 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56514c1e2e90 0x56514c24fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7f151fe740 4 client.28213 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7f151fe740 1 -- 172.21.15.12:0/550928602 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56514c135d60 con 0x56514c1e2e90 2024-09-19T06:52:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.377+0000 7f7f0bfff640 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56514c1e2e90 0x56514c24fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7eebfff640 10 client.28213 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f0bfff640 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56514c1e2e90 0x56514c24fa80 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45297690b5a984cf server_cookie=51ac7a765e876421 in_seq=0 out_seq=0 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7eebfff640 1 -- 172.21.15.12:0/550928602 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56514c135d60 con 0x56514c1e2e90 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7eebfff640 10 client.28213 handle_command_reply: tid=0 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f151fe740 1 client.28213 shutdown 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f151fe740 1 -- 172.21.15.12:0/550928602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 msgr2=0x56514c1d8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f151fe740 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1d8e50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7f04034040 tx=0x7f7f04009280 comp rx=0 tx=0).stop 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f151fe740 1 -- 172.21.15.12:0/550928602 shutdown_connections 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f151fe740 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56514c1e2e90 0x56514c24fa80 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f151fe740 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56514c1d3680 0x56514c2447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f151fe740 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56514c1c8dc0 0x56514c1d9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7eebfff640 0 client.28213 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:41.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f151fe740 1 --2- 172.21.15.12:0/550928602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56514c1c84a0 0x56514c1d8e50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f151fe740 1 -- 172.21.15.12:0/550928602 >> 172.21.15.12:0/550928602 conn(0x56514c1c4a30 msgr2=0x56514c1d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:41.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.378+0000 7f7f151fe740 1 -- 172.21.15.12:0/550928602 shutdown_connections 2024-09-19T06:52:41.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.379+0000 7f7f151fe740 1 -- 172.21.15.12:0/550928602 wait complete. 2024-09-19T06:52:41.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.379+0000 7f7f151fe740 20 client.28213 trim_cache size 0 max 16384 2024-09-19T06:52:41.385 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:52:41.385 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:52:41.385 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:52:41.386 INFO:teuthology.orchestra.run.smithi012.stdout: "5a6c2f07-fd92-4303-8d63-77ea94ae5e69": { 2024-09-19T06:52:41.386 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:52:41.386 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "5a6c2f07-fd92-4303-8d63-77ea94ae5e69", 2024-09-19T06:52:41.386 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:52:41.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:52:41.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:52:41.386 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 -- 172.21.15.12:0/4138594095 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7ef40a3540 msgr2=0x7f7ef40a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7ef40a3540 0x7f7ef40a5a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7f0001c000 tx=0x7f7f0001f000 comp rx=0 tx=0).stop 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 -- 172.21.15.12:0/4138594095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f0c06e4c0 msgr2=0x7f7f0c113870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f0c06e4c0 0x7f7f0c113870 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00d950 tx=0x7f7efc00de10 comp rx=0 tx=0).stop 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 -- 172.21.15.12:0/4138594095 shutdown_connections 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7ef40a3540 0x7f7ef40a5a00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7f0c11b210 0x7f7f0c113db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f0c06e4c0 0x7f7f0c113870 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 --2- 172.21.15.12:0/4138594095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f0c06dba0 0x7f7f0c11a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 -- 172.21.15.12:0/4138594095 >> 172.21.15.12:0/4138594095 conn(0x7f7f0c06cdc0 msgr2=0x7f7f0c11b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 -- 172.21.15.12:0/4138594095 shutdown_connections 2024-09-19T06:52:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:41.380+0000 7f7f12e25640 1 -- 172.21.15.12:0/4138594095 wait complete. 2024-09-19T06:52:42.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:41 smithi012 ceph-mon[30937]: pgmap v391: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-09-19T06:52:42.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:41 smithi016 ceph-mon[34911]: pgmap v391: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-09-19T06:52:42.307 INFO:tasks.cephfs.filesystem:scrub status for tag:5a6c2f07-fd92-4303-8d63-77ea94ae5e69 - {'path': '/', 'tag': '5a6c2f07-fd92-4303-8d63-77ea94ae5e69', 'options': 'recursive,force'} 2024-09-19T06:52:42.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:41 smithi173 ceph-mon[35349]: pgmap v391: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-09-19T06:52:44.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:43 smithi016 ceph-mon[34911]: pgmap v392: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.1 MiB/s wr, 571 op/s 2024-09-19T06:52:44.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:43 smithi173 ceph-mon[35349]: pgmap v392: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.1 MiB/s wr, 571 op/s 2024-09-19T06:52:44.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:43 smithi012 ceph-mon[30937]: pgmap v392: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.1 MiB/s wr, 571 op/s 2024-09-19T06:52:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 720.0 s, 2243.2 tps, lat 44.612 ms stddev 51.652 2024-09-19T06:52:46.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:45 smithi016 ceph-mon[34911]: pgmap v393: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 7.5 MiB/s wr, 598 op/s 2024-09-19T06:52:46.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:45 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:52:46.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:45 smithi173 ceph-mon[35349]: pgmap v393: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 7.5 MiB/s wr, 598 op/s 2024-09-19T06:52:46.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:45 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:52:46.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:45 smithi012 ceph-mon[30937]: pgmap v393: 97 pgs: 97 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 7.5 MiB/s wr, 598 op/s 2024-09-19T06:52:46.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:45 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:52:48.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:47 smithi016 ceph-mon[34911]: pgmap v394: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 10 MiB/s wr, 865 op/s 2024-09-19T06:52:48.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:47 smithi173 ceph-mon[35349]: pgmap v394: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 10 MiB/s wr, 865 op/s 2024-09-19T06:52:48.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:47 smithi012 ceph-mon[30937]: pgmap v394: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 10 MiB/s wr, 865 op/s 2024-09-19T06:52:49.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:48 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:52:49.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:48 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:52:49.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:48 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:52:49.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:48 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:52:49.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:48 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:52:49.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:48 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:52:49.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:48 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:52:49.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:48 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:52:49.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:48 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:52:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.046+0000 7f0154542640 1 -- 172.21.15.12:0/2918967115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f014c1009b0 msgr2=0x7f014c100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.046+0000 7f0154542640 1 --2- 172.21.15.12:0/2918967115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f014c1009b0 0x7f014c100e10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f013c009860 tx=0x7f013c02a360 comp rx=0 tx=0).stop 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.046+0000 7f0154542640 1 -- 172.21.15.12:0/2918967115 shutdown_connections 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.046+0000 7f0154542640 1 --2- 172.21.15.12:0/2918967115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f014c101350 0x7f014c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.046+0000 7f0154542640 1 --2- 172.21.15.12:0/2918967115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f014c1009b0 0x7f014c100e10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.046+0000 7f0154542640 1 --2- 172.21.15.12:0/2918967115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c1069c0 0x7f014c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.046+0000 7f0154542640 1 -- 172.21.15.12:0/2918967115 >> 172.21.15.12:0/2918967115 conn(0x7f014c077990 msgr2=0x7f014c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.046+0000 7f0154542640 1 -- 172.21.15.12:0/2918967115 shutdown_connections 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.046+0000 7f0154542640 1 -- 172.21.15.12:0/2918967115 wait complete. 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0154542640 1 Processor -- start 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0154542640 1 -- start start 2024-09-19T06:52:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0154542640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f014c1009b0 0x7f014c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0154542640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c101350 0x7f014c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0154542640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f014c1069c0 0x7f014c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0154542640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f014c110e50 con 0x7f014c1069c0 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0154542640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f014c110cd0 con 0x7f014c1009b0 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0154542640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f014c110fd0 con 0x7f014c101350 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0152adf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f014c1069c0 0x7f014c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f01522de640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f014c1009b0 0x7f014c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0152adf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f014c1069c0 0x7f014c19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53556/0 (socket says 172.21.15.12:53556) 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f0152adf640 1 -- 172.21.15.12:0/4069633905 learned_addr learned my addr 172.21.15.12:0/4069633905 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.047+0000 7f01522de640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f014c1009b0 0x7f014c198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49642/0 (socket says 172.21.15.12:49642) 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f0151add640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c101350 0x7f014c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f01522de640 1 -- 172.21.15.12:0/4069633905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c101350 msgr2=0x7f014c1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f01522de640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c101350 0x7f014c1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f01522de640 1 -- 172.21.15.12:0/4069633905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f014c1069c0 msgr2=0x7f014c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f01522de640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f014c1069c0 0x7f014c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f01522de640 1 -- 172.21.15.12:0/4069633905 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014c19d370 con 0x7f014c1009b0 2024-09-19T06:52:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f01522de640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f014c1009b0 0x7f014c198380 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f014800d6d0 tx=0x7f014800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f01437fe640 1 -- 172.21.15.12:0/4069633905 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0148017070 con 0x7f014c1009b0 2024-09-19T06:52:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f01437fe640 1 -- 172.21.15.12:0/4069633905 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0148009820 con 0x7f014c1009b0 2024-09-19T06:52:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f0154542640 1 -- 172.21.15.12:0/4069633905 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014c19d660 con 0x7f014c1009b0 2024-09-19T06:52:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f01437fe640 1 -- 172.21.15.12:0/4069633905 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0148004d00 con 0x7f014c1009b0 2024-09-19T06:52:50.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.048+0000 7f0154542640 1 -- 172.21.15.12:0/4069633905 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f014c1a4ef0 con 0x7f014c1009b0 2024-09-19T06:52:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.051+0000 7f01437fe640 1 -- 172.21.15.12:0/4069633905 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f01480099d0 con 0x7f014c1009b0 2024-09-19T06:52:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f01572dc740 1 Processor -- start 2024-09-19T06:52:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f01572dc740 1 -- start start 2024-09-19T06:52:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f01572dc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426afaf0 0x55fe426afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f01572dc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426b0410 0x55fe426ba770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f01572dc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f01437fe640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01380a34b0 0x7f01380a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f01572dc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fe426142f0 con 0x55fe426b0410 2024-09-19T06:52:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f01572dc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fe425bc270 con 0x55fe426bacb0 2024-09-19T06:52:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f01572dc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fe426102b0 con 0x55fe426afaf0 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f0151add640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f0151add640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426bd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49652/0 (socket says 172.21.15.12:49652) 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f0151add640 1 -- 172.21.15.12:0/1488154523 learned_addr learned my addr 172.21.15.12:0/1488154523 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.052+0000 7f01522de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426b0410 0x55fe426ba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0152adf640 1 --2- 172.21.15.12:0/1488154523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426afaf0 0x55fe426afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0152adf640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01380a34b0 0x7f01380a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f01437fe640 1 -- 172.21.15.12:0/4069633905 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f01480cf8b0 con 0x7f014c1009b0 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0151add640 1 -- 172.21.15.12:0/1488154523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426afaf0 msgr2=0x55fe426afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0151add640 1 --2- 172.21.15.12:0/1488154523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426afaf0 0x55fe426afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0151add640 1 -- 172.21.15.12:0/1488154523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426b0410 msgr2=0x55fe426ba770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0151add640 1 --2- 172.21.15.12:0/1488154523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426b0410 0x55fe426ba770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0151add640 1 -- 172.21.15.12:0/1488154523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe425bb340 con 0x55fe426bacb0 2024-09-19T06:52:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0151add640 1 --2- 172.21.15.12:0/1488154523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426bd0a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f013c009780 tx=0x7f013c0094f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=970c40d2eeb91c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0152adf640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01380a34b0 0x7f01380a5970 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0144009a70 tx=0x7f01440095c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0140bfe640 1 -- 172.21.15.12:0/1488154523 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c037040 con 0x55fe426bacb0 2024-09-19T06:52:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0140bfe640 1 -- 172.21.15.12:0/1488154523 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013c030590 con 0x55fe426bacb0 2024-09-19T06:52:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.053+0000 7f0140bfe640 1 -- 172.21.15.12:0/1488154523 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c005380 con 0x55fe426bacb0 2024-09-19T06:52:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.054+0000 7f01572dc740 1 -- 172.21.15.12:0/1488154523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 msgr2=0x55fe426bd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.054+0000 7f01572dc740 1 --2- 172.21.15.12:0/1488154523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426bd0a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f013c009780 tx=0x7f013c0094f0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.054+0000 7f01572dc740 1 -- 172.21.15.12:0/1488154523 shutdown_connections 2024-09-19T06:52:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.054+0000 7f01572dc740 1 --2- 172.21.15.12:0/1488154523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426bd0a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.054+0000 7f01572dc740 1 --2- 172.21.15.12:0/1488154523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426b0410 0x55fe426ba770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.054+0000 7f01572dc740 1 --2- 172.21.15.12:0/1488154523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426afaf0 0x55fe426afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.054+0000 7f01572dc740 1 -- 172.21.15.12:0/1488154523 >> 172.21.15.12:0/1488154523 conn(0x55fe426ac060 msgr2=0x55fe426ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.054+0000 7f01572dc740 1 -- 172.21.15.12:0/1488154523 shutdown_connections 2024-09-19T06:52:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.055+0000 7f01572dc740 1 -- 172.21.15.12:0/1488154523 wait complete. 2024-09-19T06:52:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.055+0000 7f01572dc740 1 -- start start 2024-09-19T06:52:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.055+0000 7f01572dc740 1 Processor -- start 2024-09-19T06:52:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.057+0000 7f01572dc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426afaf0 0x55fe426b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.057+0000 7f01572dc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426b0410 0x55fe426b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.057+0000 7f01572dc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426b84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f01572dc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fe426c1c90 con 0x55fe426b0410 2024-09-19T06:52:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f0152adf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426b84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f0152adf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426b84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49654/0 (socket says 172.21.15.12:49654) 2024-09-19T06:52:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f0152adf640 1 -- 172.21.15.12:0/430988878 learned_addr learned my addr 172.21.15.12:0/430988878 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f01572dc740 1 -- 172.21.15.12:0/430988878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fe4259d290 con 0x55fe426bacb0 2024-09-19T06:52:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f01572dc740 1 -- 172.21.15.12:0/430988878 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fe426c1e10 con 0x55fe426afaf0 2024-09-19T06:52:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f01522de640 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426afaf0 0x55fe426b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f0151add640 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426b0410 0x55fe426b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f01572dc740 10 client.0 _ll_register_callbacks cb 0x55fe425ce140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f0152adf640 1 -- 172.21.15.12:0/430988878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426afaf0 msgr2=0x55fe426b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f0152adf640 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426afaf0 0x55fe426b7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f0152adf640 1 -- 172.21.15.12:0/430988878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426b0410 msgr2=0x55fe426b7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f0152adf640 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426b0410 0x55fe426b7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.058+0000 7f0152adf640 1 -- 172.21.15.12:0/430988878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe42327210 con 0x55fe426bacb0 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.059+0000 7f0152adf640 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426b84d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f014401ea40 tx=0x7f0144004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e99f2678f8b4cbc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.059+0000 7f0135ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.059+0000 7f01572dc740 1 -- 172.21.15.12:0/430988878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f013c030590 con 0x55fe426bacb0 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.059+0000 7f0135ffb640 1 -- 172.21.15.12:0/430988878 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014402e060 con 0x55fe426bacb0 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.059+0000 7f0135ffb640 1 -- 172.21.15.12:0/430988878 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f014400ee00 con 0x55fe426bacb0 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.059+0000 7f0135ffb640 1 -- 172.21.15.12:0/430988878 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0144035050 con 0x55fe426bacb0 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.059+0000 7f01572dc740 10 client.28283 fetch_fsmap learned FSMap version 48 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.059+0000 7f01572dc740 1 -- 172.21.15.12:0/430988878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55fe423f3620 con 0x55fe426bacb0 2024-09-19T06:52:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.060+0000 7f0135ffb640 1 -- 172.21.15.12:0/430988878 <== mon.2 v2:172.21.15.16:3300/0 4 ==== fsmap(e 48) ==== 8390+0+0 (secure 0 0 0) 0x7f014400b040 con 0x55fe426bacb0 2024-09-19T06:52:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.060+0000 7f01572dc740 10 client.28283 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T06:52:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.060+0000 7f01572dc740 10 client.28283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.060+0000 7f01572dc740 20 client.28283 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.060+0000 7f01572dc740 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fe426ced30 0x55fe426d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.060+0000 7f01572dc740 4 client.28283 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:52:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.060+0000 7f01572dc740 1 -- 172.21.15.12:0/430988878 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe42621a20 con 0x55fe426ced30 2024-09-19T06:52:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.060+0000 7f01522de640 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fe426ced30 0x55fe426d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f0135ffb640 10 client.28283 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01522de640 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fe426ced30 0x55fe426d1160 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f082068e0ef457e2 server_cookie=d756d4d9ae088264 in_seq=0 out_seq=0 2024-09-19T06:52:50.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f0135ffb640 1 -- 172.21.15.12:0/430988878 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe42621a20 con 0x55fe426ced30 2024-09-19T06:52:50.065 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f0135ffb640 10 client.28283 handle_command_reply: tid=0 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01572dc740 1 client.28283 shutdown 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01572dc740 1 -- 172.21.15.12:0/430988878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 msgr2=0x55fe426b84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01572dc740 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426b84d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f014401ea40 tx=0x7f0144004ab0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01572dc740 1 -- 172.21.15.12:0/430988878 shutdown_connections 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01572dc740 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fe426ced30 0x55fe426d1160 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f0135ffb640 0 client.28283 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01572dc740 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426bacb0 0x55fe426b84d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01572dc740 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426b0410 0x55fe426b7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01572dc740 1 --2- 172.21.15.12:0/430988878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426afaf0 0x55fe426b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01572dc740 1 -- 172.21.15.12:0/430988878 >> 172.21.15.12:0/430988878 conn(0x55fe426ac060 msgr2=0x55fe426b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.061+0000 7f01572dc740 1 -- 172.21.15.12:0/430988878 shutdown_connections 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.062+0000 7f01572dc740 1 -- 172.21.15.12:0/430988878 wait complete. 2024-09-19T06:52:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.062+0000 7f01572dc740 20 client.28283 trim_cache size 0 max 16384 2024-09-19T06:52:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.080+0000 7f01572dc740 1 Processor -- start 2024-09-19T06:52:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.080+0000 7f01572dc740 1 -- start start 2024-09-19T06:52:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.080+0000 7f01572dc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426b7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.080+0000 7f01572dc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426d6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.080+0000 7f01572dc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 0x55fe426d6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.080+0000 7f01572dc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1ab840 con 0x55fe426afaf0 2024-09-19T06:52:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.080+0000 7f01572dc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1ad4d0 con 0x55fe426b0410 2024-09-19T06:52:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.080+0000 7f01572dc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1abf10 con 0x55fe426bacb0 2024-09-19T06:52:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.080+0000 7f01522de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0151add640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426d6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f01522de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426b7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53568/0 (socket says 172.21.15.12:53568) 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f01522de640 1 -- 172.21.15.12:0/920602872 learned_addr learned my addr 172.21.15.12:0/920602872 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0151add640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426d6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49656/0 (socket says 172.21.15.12:49656) 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0152adf640 1 --2- 172.21.15.12:0/920602872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 0x55fe426d6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0151add640 1 -- 172.21.15.12:0/920602872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 msgr2=0x55fe426d6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0151add640 1 --2- 172.21.15.12:0/920602872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 0x55fe426d6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0151add640 1 -- 172.21.15.12:0/920602872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 msgr2=0x55fe426b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0151add640 1 --2- 172.21.15.12:0/920602872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0151add640 1 -- 172.21.15.12:0/920602872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe426abe90 con 0x55fe426b0410 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f01522de640 1 --2- 172.21.15.12:0/920602872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0152adf640 1 --2- 172.21.15.12:0/920602872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 0x55fe426d6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0151add640 1 --2- 172.21.15.12:0/920602872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426d6a70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f013c035040 tx=0x7f013c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cce3157c6da64e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0137fff640 1 -- 172.21.15.12:0/920602872 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c04b070 con 0x55fe426b0410 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0137fff640 1 -- 172.21.15.12:0/920602872 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013c030740 con 0x55fe426b0410 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.081+0000 7f0137fff640 1 -- 172.21.15.12:0/920602872 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c037040 con 0x55fe426b0410 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.082+0000 7f01572dc740 1 -- 172.21.15.12:0/920602872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 msgr2=0x55fe426d6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.082+0000 7f01572dc740 1 --2- 172.21.15.12:0/920602872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426d6a70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f013c035040 tx=0x7f013c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.082+0000 7f01572dc740 1 -- 172.21.15.12:0/920602872 shutdown_connections 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.082+0000 7f01572dc740 1 --2- 172.21.15.12:0/920602872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 0x55fe426d6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.082+0000 7f01572dc740 1 --2- 172.21.15.12:0/920602872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426d6a70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.082+0000 7f01572dc740 1 --2- 172.21.15.12:0/920602872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.082+0000 7f01572dc740 1 -- 172.21.15.12:0/920602872 >> 172.21.15.12:0/920602872 conn(0x55fe426ac060 msgr2=0x55fe426ab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.082+0000 7f01572dc740 1 -- 172.21.15.12:0/920602872 shutdown_connections 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.082+0000 7f01572dc740 1 -- 172.21.15.12:0/920602872 wait complete. 2024-09-19T06:52:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.083+0000 7f01572dc740 1 -- start start 2024-09-19T06:52:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.083+0000 7f01572dc740 1 Processor -- start 2024-09-19T06:52:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.084+0000 7f01572dc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426c7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.084+0000 7f01572dc740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.084+0000 7f01572dc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 0x55fe426b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.084+0000 7f01572dc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1ace00 con 0x55fe426afaf0 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.084+0000 7f01572dc740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1ac670 con 0x55fe426b0410 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.084+0000 7f0151add640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.084+0000 7f0151add640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49672/0 (socket says 172.21.15.12:49672) 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.084+0000 7f01572dc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1a9840 con 0x55fe426bacb0 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.084+0000 7f0151add640 1 -- 172.21.15.12:0/881343422 learned_addr learned my addr 172.21.15.12:0/881343422 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.084+0000 7f0152adf640 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 0x55fe426b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f01572dc740 10 client.0 _ll_register_callbacks cb 0x7f014401e6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f01522de640 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f0151add640 1 -- 172.21.15.12:0/881343422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 msgr2=0x55fe426b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f0151add640 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 0x55fe426b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f0151add640 1 -- 172.21.15.12:0/881343422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 msgr2=0x55fe426c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f0151add640 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f0151add640 1 -- 172.21.15.12:0/881343422 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe426b5660 con 0x55fe426b0410 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f01572dc740 1 -- 172.21.15.12:0/881343422 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f013c030740 con 0x55fe426b0410 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f0151add640 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426b4850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f013c009780 tx=0x7f013c005160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=499eb9b600eb22b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f01522de640 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f0135ffb640 10 client.28289 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.085+0000 7f0135ffb640 1 -- 172.21.15.12:0/881343422 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c04b070 con 0x55fe426b0410 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f0135ffb640 1 -- 172.21.15.12:0/881343422 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f013c004030 con 0x55fe426b0410 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f0135ffb640 1 -- 172.21.15.12:0/881343422 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f013c037040 con 0x55fe426b0410 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f01572dc740 10 client.28289 fetch_fsmap learned FSMap version 48 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f01572dc740 1 -- 172.21.15.12:0/881343422 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55fe42739a40 con 0x55fe426b0410 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f0135ffb640 1 -- 172.21.15.12:0/881343422 <== mon.2 v2:172.21.15.16:3300/0 4 ==== fsmap(e 48) ==== 8390+0+0 (secure 0 0 0) 0x7f013c004290 con 0x55fe426b0410 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f01572dc740 10 client.28289 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T06:52:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f01572dc740 10 client.28289 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:52:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f01572dc740 20 client.28289 populate_metadata read hostname 'smithi012' 2024-09-19T06:52:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f01572dc740 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fe426ced30 0x55fe4273bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f01572dc740 4 client.28289 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:52:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.086+0000 7f01572dc740 1 -- 172.21.15.12:0/881343422 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe4261bd70 con 0x55fe426ced30 2024-09-19T06:52:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.087+0000 7f01522de640 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fe426ced30 0x55fe4273bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.087+0000 7f0135ffb640 10 client.28289 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.087+0000 7f01522de640 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fe426ced30 0x55fe4273bc20 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c574eda5696b7bb9 server_cookie=8dbf6598ea53062b in_seq=0 out_seq=0 2024-09-19T06:52:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f0135ffb640 1 -- 172.21.15.12:0/881343422 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe4261bd70 con 0x55fe426ced30 2024-09-19T06:52:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f0135ffb640 10 client.28289 handle_command_reply: tid=0 2024-09-19T06:52:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 client.28289 shutdown 2024-09-19T06:52:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 -- 172.21.15.12:0/881343422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 msgr2=0x55fe426b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426b4850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f013c009780 tx=0x7f013c005160 comp rx=0 tx=0).stop 2024-09-19T06:52:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 -- 172.21.15.12:0/881343422 shutdown_connections 2024-09-19T06:52:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fe426ced30 0x55fe4273bc20 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fe426bacb0 0x55fe426b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f0135ffb640 0 client.28289 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:52:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fe426b0410 0x55fe426b4850 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 --2- 172.21.15.12:0/881343422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fe426afaf0 0x55fe426c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 -- 172.21.15.12:0/881343422 >> 172.21.15.12:0/881343422 conn(0x55fe426ac060 msgr2=0x55fe426aa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 -- 172.21.15.12:0/881343422 shutdown_connections 2024-09-19T06:52:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 1 -- 172.21.15.12:0/881343422 wait complete. 2024-09-19T06:52:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.102+0000 7f01572dc740 20 client.28289 trim_cache size 0 max 16384 2024-09-19T06:52:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:52:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:52:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:52:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:52:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 -- 172.21.15.12:0/4069633905 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01380a34b0 msgr2=0x7f01380a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01380a34b0 0x7f01380a5970 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0144009a70 tx=0x7f01440095c0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 -- 172.21.15.12:0/4069633905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f014c1009b0 msgr2=0x7f014c198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f014c1009b0 0x7f014c198380 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f014800d6d0 tx=0x7f014800db90 comp rx=0 tx=0).stop 2024-09-19T06:52:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 -- 172.21.15.12:0/4069633905 shutdown_connections 2024-09-19T06:52:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f014c1069c0 0x7f014c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f01380a34b0 0x7f01380a5970 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f014c101350 0x7f014c1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 --2- 172.21.15.12:0/4069633905 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f014c1009b0 0x7f014c198380 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 -- 172.21.15.12:0/4069633905 >> 172.21.15.12:0/4069633905 conn(0x7f014c077990 msgr2=0x7f014c069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 -- 172.21.15.12:0/4069633905 shutdown_connections 2024-09-19T06:52:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:52:50.103+0000 7f0154542640 1 -- 172.21.15.12:0/4069633905 wait complete. 2024-09-19T06:52:50.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:49 smithi016 ceph-mon[34911]: pgmap v395: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 6.7 MiB/s wr, 619 op/s 2024-09-19T06:52:50.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:49 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:52:50.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:49 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:52:50.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:49 smithi173 ceph-mon[35349]: pgmap v395: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 6.7 MiB/s wr, 619 op/s 2024-09-19T06:52:50.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:49 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:52:50.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:49 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:52:50.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:49 smithi012 ceph-mon[30937]: pgmap v395: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 6.7 MiB/s wr, 619 op/s 2024-09-19T06:52:50.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:49 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:52:50.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:49 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:52:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 725.0 s, 2032.8 tps, lat 48.912 ms stddev 57.579 2024-09-19T06:52:52.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:52 smithi016 ceph-mon[34911]: pgmap v396: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 10 MiB/s wr, 897 op/s 2024-09-19T06:52:52.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:52 smithi173 ceph-mon[35349]: pgmap v396: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 10 MiB/s wr, 897 op/s 2024-09-19T06:52:52.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:52 smithi012 ceph-mon[30937]: pgmap v396: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 10 MiB/s wr, 897 op/s 2024-09-19T06:52:54.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:54 smithi016 ceph-mon[34911]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.5 MiB/s wr, 603 op/s 2024-09-19T06:52:54.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:54 smithi173 ceph-mon[35349]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.5 MiB/s wr, 603 op/s 2024-09-19T06:52:54.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:54 smithi012 ceph-mon[30937]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.5 MiB/s wr, 603 op/s 2024-09-19T06:52:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 730.0 s, 2986.4 tps, lat 33.682 ms stddev 38.134 2024-09-19T06:52:56.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:56 smithi016 ceph-mon[34911]: pgmap v398: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.6 MiB/s wr, 610 op/s 2024-09-19T06:52:56.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:56 smithi173 ceph-mon[35349]: pgmap v398: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.6 MiB/s wr, 610 op/s 2024-09-19T06:52:56.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:56 smithi012 ceph-mon[30937]: pgmap v398: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.6 MiB/s wr, 610 op/s 2024-09-19T06:52:58.244 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T06:52:58.244 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-09-19T06:52:58.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:52:58.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:52:58 smithi012 ceph-mon[30937]: pgmap v399: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 11 MiB/s wr, 874 op/s 2024-09-19T06:52:58.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:52:58 smithi173 ceph-mon[35349]: pgmap v399: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 11 MiB/s wr, 874 op/s 2024-09-19T06:52:58.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:52:58 smithi016 ceph-mon[34911]: pgmap v399: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 11 MiB/s wr, 874 op/s 2024-09-19T06:52:58.664 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:52:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.227+0000 7fcfa2373640 1 -- 172.21.15.12:0/1666897896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf9c101360 msgr2=0x7fcf9c10df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.227+0000 7fcfa2373640 1 --2- 172.21.15.12:0/1666897896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf9c101360 0x7fcf9c10df90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009900 tx=0x7fcf9002a400 comp rx=0 tx=0).stop 2024-09-19T06:52:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.228+0000 7fcfa2373640 1 -- 172.21.15.12:0/1666897896 shutdown_connections 2024-09-19T06:52:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.228+0000 7fcfa2373640 1 --2- 172.21.15.12:0/1666897896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c10e4d0 0x7fcf9c1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.228+0000 7fcfa2373640 1 --2- 172.21.15.12:0/1666897896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf9c101360 0x7fcf9c10df90 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.228+0000 7fcfa2373640 1 --2- 172.21.15.12:0/1666897896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf9c1009b0 0x7fcf9c100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.228+0000 7fcfa2373640 1 -- 172.21.15.12:0/1666897896 >> 172.21.15.12:0/1666897896 conn(0x7fcf9c0fc7d0 msgr2=0x7fcf9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.228+0000 7fcfa2373640 1 -- 172.21.15.12:0/1666897896 shutdown_connections 2024-09-19T06:52:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.228+0000 7fcfa2373640 1 -- 172.21.15.12:0/1666897896 wait complete. 2024-09-19T06:52:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.228+0000 7fcfa2373640 1 Processor -- start 2024-09-19T06:52:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.228+0000 7fcfa2373640 1 -- start start 2024-09-19T06:52:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcfa2373640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf9c1009b0 0x7fcf9c19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcfa2373640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf9c101360 0x7fcf9c19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcfa2373640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c10e4d0 0x7fcf9c19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcfa2373640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c114200 con 0x7fcf9c101360 2024-09-19T06:52:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcfa2373640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c114080 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcfa2373640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c114380 con 0x7fcf9c1009b0 2024-09-19T06:52:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcf9b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf9c101360 0x7fcf9c19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcfa0910640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c10e4d0 0x7fcf9c19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcf9b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf9c101360 0x7fcf9c19ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39544/0 (socket says 172.21.15.12:39544) 2024-09-19T06:52:59.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcfa0910640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c10e4d0 0x7fcf9c19eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47844/0 (socket says 172.21.15.12:47844) 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcf9b7fe640 1 -- 172.21.15.12:0/562839028 learned_addr learned my addr 172.21.15.12:0/562839028 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.229+0000 7fcf9bfff640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf9c1009b0 0x7fcf9c19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.230+0000 7fcfa0910640 1 -- 172.21.15.12:0/562839028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf9c1009b0 msgr2=0x7fcf9c19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.230+0000 7fcfa0910640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf9c1009b0 0x7fcf9c19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.230+0000 7fcfa0910640 1 -- 172.21.15.12:0/562839028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf9c101360 msgr2=0x7fcf9c19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.230+0000 7fcfa0910640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf9c101360 0x7fcf9c19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.230+0000 7fcfa0910640 1 -- 172.21.15.12:0/562839028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c19f6d0 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.230+0000 7fcf9b7fe640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf9c101360 0x7fcf9c19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.230+0000 7fcfa0910640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c10e4d0 0x7fcf9c19eff0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009fd0 tx=0x7fcf9400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.230+0000 7fcf997fa640 1 -- 172.21.15.12:0/562839028 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400ce20 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.230+0000 7fcf997fa640 1 -- 172.21.15.12:0/562839028 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf94005020 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.230+0000 7fcf997fa640 1 -- 172.21.15.12:0/562839028 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94010720 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.231+0000 7fcfa2373640 1 -- 172.21.15.12:0/562839028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9c19f9c0 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.231+0000 7fcfa2373640 1 -- 172.21.15.12:0/562839028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9c1a72a0 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.233+0000 7fcfa2373640 1 -- 172.21.15.12:0/562839028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf9c100d90 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.234+0000 7fcf997fa640 1 -- 172.21.15.12:0/562839028 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcf94005540 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.235+0000 7fcf997fa640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf840a3580 0x7fcf840a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:59.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.235+0000 7fcf997fa640 1 -- 172.21.15.12:0/562839028 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7fcf940d0460 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.235+0000 7fcf9bfff640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf840a3580 0x7fcf840a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:59.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.236+0000 7fcf9bfff640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf840a3580 0x7fcf840a5a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c005d00 tx=0x7fcf8c00b410 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:59.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.244+0000 7fcf997fa640 1 -- 172.21.15.12:0/562839028 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf9409cd40 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.587+0000 7fcfa2373640 1 -- 172.21.15.12:0/562839028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf9c109660 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.587+0000 7fcf997fa640 1 -- 172.21.15.12:0/562839028 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11983 (secure 0 0 0) 0x7fcf94098020 con 0x7fcf9c10e4d0 2024-09-19T06:52:59.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:52:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":48,"btime":"2024-09-19T06:52:44:976428+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:52:44.574294+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:52:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 48 2024-09-19T06:52:59.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 -- 172.21.15.12:0/562839028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf840a3580 msgr2=0x7fcf840a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf840a3580 0x7fcf840a5a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c005d00 tx=0x7fcf8c00b410 comp rx=0 tx=0).stop 2024-09-19T06:52:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 -- 172.21.15.12:0/562839028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c10e4d0 msgr2=0x7fcf9c19eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c10e4d0 0x7fcf9c19eff0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009fd0 tx=0x7fcf9400ef10 comp rx=0 tx=0).stop 2024-09-19T06:52:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 -- 172.21.15.12:0/562839028 shutdown_connections 2024-09-19T06:52:59.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9c10e4d0 0x7fcf9c19eff0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf9c101360 0x7fcf9c19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf840a3580 0x7fcf840a5a40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 --2- 172.21.15.12:0/562839028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf9c1009b0 0x7fcf9c19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 -- 172.21.15.12:0/562839028 >> 172.21.15.12:0/562839028 conn(0x7fcf9c0fc7d0 msgr2=0x7fcf9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 -- 172.21.15.12:0/562839028 shutdown_connections 2024-09-19T06:52:59.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:52:59.590+0000 7fcfa2373640 1 -- 172.21.15.12:0/562839028 wait complete. 2024-09-19T06:53:00.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:00 smithi173 ceph-mon[35349]: pgmap v400: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.6 MiB/s wr, 575 op/s 2024-09-19T06:53:00.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:00 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/562839028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:00 smithi012 ceph-mon[30937]: pgmap v400: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.6 MiB/s wr, 575 op/s 2024-09-19T06:53:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:00 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/562839028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:00.422 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-09-19T06:53:00.422 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-09-19T06:53:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:00 smithi016 ceph-mon[34911]: pgmap v400: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.6 MiB/s wr, 575 op/s 2024-09-19T06:53:00.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:00 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/562839028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:00.736 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 735.0 s, 1534.2 tps, lat 61.849 ms stddev 73.445 2024-09-19T06:53:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3402480957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb794102dd0 msgr2=0x7fb7941031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 --2- 172.21.15.12:0/3402480957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb794102dd0 0x7fb7941031b0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb784009900 tx=0x7fb78402a480 comp rx=0 tx=0).stop 2024-09-19T06:53:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3402480957 shutdown_connections 2024-09-19T06:53:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 --2- 172.21.15.12:0/3402480957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb79410c170 0x7fb79410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 --2- 172.21.15.12:0/3402480957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7941036f0 0x7fb79410bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 --2- 172.21.15.12:0/3402480957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb794102dd0 0x7fb7941031b0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3402480957 >> 172.21.15.12:0/3402480957 conn(0x7fb7940fc7d0 msgr2=0x7fb7940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3402480957 shutdown_connections 2024-09-19T06:53:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3402480957 wait complete. 2024-09-19T06:53:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 Processor -- start 2024-09-19T06:53:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.237+0000 7fb79a6ce640 1 -- start start 2024-09-19T06:53:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb79a6ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb794102dd0 0x7fb79419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb79a6ce640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7941036f0 0x7fb79419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb79a6ce640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb79410c170 0x7fb79419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb79a6ce640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb794111f20 con 0x7fb794102dd0 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb79a6ce640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb794111da0 con 0x7fb7941036f0 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb79a6ce640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941120a0 con 0x7fb79410c170 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb793fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb794102dd0 0x7fb79419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb793fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb794102dd0 0x7fb79419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50646/0 (socket says 172.21.15.12:50646) 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb78bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7941036f0 0x7fb79419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb793fff640 1 -- 172.21.15.12:0/3193765050 learned_addr learned my addr 172.21.15.12:0/3193765050 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb798c6b640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb79410c170 0x7fb79419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb793fff640 1 -- 172.21.15.12:0/3193765050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb79410c170 msgr2=0x7fb79419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb793fff640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb79410c170 0x7fb79419ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb793fff640 1 -- 172.21.15.12:0/3193765050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7941036f0 msgr2=0x7fb79419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb793fff640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7941036f0 0x7fb79419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb793fff640 1 -- 172.21.15.12:0/3193765050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79419f610 con 0x7fb794102dd0 2024-09-19T06:53:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb78bfff640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7941036f0 0x7fb79419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.238+0000 7fb793fff640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb794102dd0 0x7fb79419a660 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fb784006010 tx=0x7fb784004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.239+0000 7fb791ffb640 1 -- 172.21.15.12:0/3193765050 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78403f030 con 0x7fb794102dd0 2024-09-19T06:53:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.239+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3193765050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79419f8a0 con 0x7fb794102dd0 2024-09-19T06:53:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.239+0000 7fb791ffb640 1 -- 172.21.15.12:0/3193765050 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb784004440 con 0x7fb794102dd0 2024-09-19T06:53:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.239+0000 7fb791ffb640 1 -- 172.21.15.12:0/3193765050 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784035070 con 0x7fb794102dd0 2024-09-19T06:53:01.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.239+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3193765050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7941a71e0 con 0x7fb794102dd0 2024-09-19T06:53:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.241+0000 7fb791ffb640 1 -- 172.21.15.12:0/3193765050 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb784042030 con 0x7fb794102dd0 2024-09-19T06:53:01.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.241+0000 7fb79caa7740 1 Processor -- start 2024-09-19T06:53:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb79caa7740 1 -- start start 2024-09-19T06:53:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587795760 0x55e587795b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587796080 0x55e5877a0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5877a0940 0x55e5877a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb79caa7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e5876fb2a0 con 0x55e5877a0940 2024-09-19T06:53:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb79caa7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e5876a2b10 con 0x55e587796080 2024-09-19T06:53:01.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb79caa7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e5876f7260 con 0x55e587795760 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb798c6b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587795760 0x55e587795b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb798c6b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587795760 0x55e587795b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:59388/0 (socket says 172.21.15.12:59388) 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb798c6b640 1 -- 172.21.15.12:0/3028463532 learned_addr learned my addr 172.21.15.12:0/3028463532 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb793fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587796080 0x55e5877a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb791ffb640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb7800a3430 0x7fb7800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb78bfff640 1 --2- 172.21.15.12:0/3028463532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5877a0940 0x55e5877a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb798c6b640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb7800a3430 0x7fb7800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb793fff640 1 -- 172.21.15.12:0/3028463532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587795760 msgr2=0x55e587795b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb793fff640 1 --2- 172.21.15.12:0/3028463532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587795760 0x55e587795b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb793fff640 1 -- 172.21.15.12:0/3028463532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5877a0940 msgr2=0x55e5877a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb793fff640 1 --2- 172.21.15.12:0/3028463532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5877a0940 0x55e5877a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb793fff640 1 -- 172.21.15.12:0/3028463532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e58746cb90 con 0x55e587796080 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.242+0000 7fb798c6b640 1 --2- 172.21.15.12:0/3028463532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587795760 0x55e587795b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.243+0000 7fb791ffb640 1 -- 172.21.15.12:0/3193765050 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7fb7840f0130 con 0x7fb794102dd0 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.243+0000 7fb793fff640 1 --2- 172.21.15.12:0/3028463532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587796080 0x55e5877a0400 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb7840ed7e0 tx=0x7fb78407c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf653d8021f2624 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.243+0000 7fb798c6b640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb7800a3430 0x7fb7800a58f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009fd0 tx=0x7fb78c004ab0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.243+0000 7fb78a7fc640 1 -- 172.21.15.12:0/3028463532 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7840c50a0 con 0x55e587796080 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.243+0000 7fb78a7fc640 1 -- 172.21.15.12:0/3028463532 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb784003e20 con 0x55e587796080 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.243+0000 7fb78a7fc640 1 -- 172.21.15.12:0/3028463532 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7840eda60 con 0x55e587796080 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 -- 172.21.15.12:0/3028463532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587796080 msgr2=0x55e5877a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3028463532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587796080 0x55e5877a0400 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb7840ed7e0 tx=0x7fb78407c4b0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 -- 172.21.15.12:0/3028463532 shutdown_connections 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3028463532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5877a0940 0x55e5877a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3028463532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587796080 0x55e5877a0400 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3028463532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587795760 0x55e587795b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 -- 172.21.15.12:0/3028463532 >> 172.21.15.12:0/3028463532 conn(0x55e587791cf0 msgr2=0x55e5877920d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 -- 172.21.15.12:0/3028463532 shutdown_connections 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 -- 172.21.15.12:0/3028463532 wait complete. 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 -- start start 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.244+0000 7fb79caa7740 1 Processor -- start 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587795760 0x55e58779d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587796080 0x55e58779dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5877a0940 0x55e58779e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb79caa7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e5877a32d0 con 0x55e587795760 2024-09-19T06:53:01.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb79caa7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e5876836e0 con 0x55e5877a0940 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb79caa7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e5877a3450 con 0x55e587796080 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb79caa7740 10 client.0 _ll_register_callbacks cb 0x55e5876a7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb793fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587795760 0x55e58779d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb793fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587795760 0x55e58779d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50664/0 (socket says 172.21.15.12:50664) 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb793fff640 1 -- 172.21.15.12:0/3930640326 learned_addr learned my addr 172.21.15.12:0/3930640326 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb78bfff640 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587796080 0x55e58779dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb798c6b640 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5877a0940 0x55e58779e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb793fff640 1 -- 172.21.15.12:0/3930640326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587796080 msgr2=0x55e58779dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb793fff640 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587796080 0x55e58779dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb793fff640 1 -- 172.21.15.12:0/3930640326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5877a0940 msgr2=0x55e58779e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb793fff640 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5877a0940 0x55e58779e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb793fff640 1 -- 172.21.15.12:0/3930640326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5877ac6e0 con 0x55e587795760 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb793fff640 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587795760 0x55e58779d7c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fb7840edde0 tx=0x7fb7840edc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb285277bbf6aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb7737fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb7737fe640 1 -- 172.21.15.12:0/3930640326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784049040 con 0x55e587795760 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb7737fe640 1 -- 172.21.15.12:0/3930640326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7fb784031bd0 con 0x55e587795760 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.245+0000 7fb79caa7740 1 -- 172.21.15.12:0/3930640326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e5877089d0 con 0x55e587795760 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb7737fe640 1 -- 172.21.15.12:0/3930640326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb7840c50a0 con 0x55e587795760 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb79caa7740 10 client.18966 fetch_fsmap learned FSMap version 48 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb79caa7740 1 -- 172.21.15.12:0/3930640326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55e5877a32d0 con 0x55e587795760 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb7737fe640 1 -- 172.21.15.12:0/3930640326 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e5877089d0 con 0x55e587795760 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb7737fe640 1 -- 172.21.15.12:0/3930640326 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 48) ==== 8390+0+0 (secure 0 0 0) 0x7fb7840c6070 con 0x55e587795760 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb79caa7740 10 client.18966 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T06:53:01.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb79caa7740 10 client.18966 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb79caa7740 20 client.18966 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5877b01d0 0x55e5877b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb79caa7740 4 client.18966 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb79caa7740 1 -- 172.21.15.12:0/3930640326 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e587702d20 con 0x55e5877b01d0 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.246+0000 7fb78bfff640 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5877b01d0 0x55e5877b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.247+0000 7fb7737fe640 10 client.18966 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.247+0000 7fb78bfff640 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5877b01d0 0x55e5877b25c0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecae84e338765787 server_cookie=bd7cbae599b4880b in_seq=0 out_seq=0 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb7737fe640 1 -- 172.21.15.12:0/3930640326 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e587702d20 con 0x55e5877b01d0 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb7737fe640 10 client.18966 handle_command_reply: tid=0 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 client.18966 shutdown 2024-09-19T06:53:01.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 -- 172.21.15.12:0/3930640326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587795760 msgr2=0x55e58779d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587795760 0x55e58779d7c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fb7840edde0 tx=0x7fb7840edc90 comp rx=0 tx=0).stop 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 -- 172.21.15.12:0/3930640326 shutdown_connections 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5877b01d0 0x55e5877b25c0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb7737fe640 0 client.18966 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e5877a0940 0x55e58779e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587796080 0x55e58779dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3930640326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587795760 0x55e58779d7c0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 -- 172.21.15.12:0/3930640326 >> 172.21.15.12:0/3930640326 conn(0x55e587791cf0 msgr2=0x55e587797a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 -- 172.21.15.12:0/3930640326 shutdown_connections 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 1 -- 172.21.15.12:0/3930640326 wait complete. 2024-09-19T06:53:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.248+0000 7fb79caa7740 20 client.18966 trim_cache size 0 max 16384 2024-09-19T06:53:01.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb79caa7740 1 Processor -- start 2024-09-19T06:53:01.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb79caa7740 1 -- start start 2024-09-19T06:53:01.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877b7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587796080 0x55e5877b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5877a0940 0x55e58779aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb79caa7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941afe20 con 0x55e5877a0940 2024-09-19T06:53:01.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb79caa7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941b1ab0 con 0x55e587795760 2024-09-19T06:53:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb79caa7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941b04f0 con 0x55e587796080 2024-09-19T06:53:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb798c6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5877a0940 0x55e58779aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb793fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877b7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb793fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877b7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47486/0 (socket says 172.21.15.12:47486) 2024-09-19T06:53:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb793fff640 1 -- 172.21.15.12:0/3182034601 learned_addr learned my addr 172.21.15.12:0/3182034601 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.267+0000 7fb78bfff640 1 --2- 172.21.15.12:0/3182034601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587796080 0x55e5877b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.268+0000 7fb793fff640 1 -- 172.21.15.12:0/3182034601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587796080 msgr2=0x55e5877b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.268+0000 7fb793fff640 1 --2- 172.21.15.12:0/3182034601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587796080 0x55e5877b82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.268+0000 7fb793fff640 1 -- 172.21.15.12:0/3182034601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5877a0940 msgr2=0x55e58779aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:01.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.268+0000 7fb793fff640 1 --2- 172.21.15.12:0/3182034601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5877a0940 0x55e58779aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.268+0000 7fb793fff640 1 -- 172.21.15.12:0/3182034601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e587791b20 con 0x55e587795760 2024-09-19T06:53:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.268+0000 7fb793fff640 1 --2- 172.21.15.12:0/3182034601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877b7d70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb784005d00 tx=0x7fb7840d52a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f76e9e5ca106ec2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.268+0000 7fb789ffb640 1 -- 172.21.15.12:0/3182034601 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784049070 con 0x55e587795760 2024-09-19T06:53:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.268+0000 7fb789ffb640 1 -- 172.21.15.12:0/3182034601 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7840cfb20 con 0x55e587795760 2024-09-19T06:53:01.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.268+0000 7fb789ffb640 1 -- 172.21.15.12:0/3182034601 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7840bb980 con 0x55e587795760 2024-09-19T06:53:01.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 -- 172.21.15.12:0/3182034601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 msgr2=0x55e5877b7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:01.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3182034601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877b7d70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb784005d00 tx=0x7fb7840d52a0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 -- 172.21.15.12:0/3182034601 shutdown_connections 2024-09-19T06:53:01.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3182034601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e5877a0940 0x55e58779aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3182034601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e587796080 0x55e5877b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 --2- 172.21.15.12:0/3182034601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877b7d70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 -- 172.21.15.12:0/3182034601 >> 172.21.15.12:0/3182034601 conn(0x55e587791cf0 msgr2=0x55e58779c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 -- 172.21.15.12:0/3182034601 shutdown_connections 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 -- 172.21.15.12:0/3182034601 wait complete. 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 -- start start 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.269+0000 7fb79caa7740 1 Processor -- start 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587796080 0x55e5877a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb79caa7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5877a0940 0x55e5877a5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb79caa7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941b13e0 con 0x55e587796080 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb79caa7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941b0c50 con 0x55e587795760 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb79caa7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb7941ade20 con 0x55e5877a0940 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb79caa7740 10 client.0 _ll_register_callbacks cb 0x7fb7840bd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:01.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb793fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb78bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587796080 0x55e5877a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb793fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:47498/0 (socket says 172.21.15.12:47498) 2024-09-19T06:53:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb793fff640 1 -- 172.21.15.12:0/1267593392 learned_addr learned my addr 172.21.15.12:0/1267593392 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb798c6b640 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5877a0940 0x55e5877a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb793fff640 1 -- 172.21.15.12:0/1267593392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5877a0940 msgr2=0x55e5877a5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb793fff640 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5877a0940 0x55e5877a5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb793fff640 1 -- 172.21.15.12:0/1267593392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587796080 msgr2=0x55e5877a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb793fff640 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587796080 0x55e5877a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb793fff640 1 -- 172.21.15.12:0/1267593392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e58778d260 con 0x55e587795760 2024-09-19T06:53:01.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb793fff640 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877a84b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb7840c4b70 tx=0x7fb7840d54a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65c4a34d0a694be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.270+0000 7fb7737fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb7737fe640 1 -- 172.21.15.12:0/1267593392 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784049070 con 0x55e587795760 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb7737fe640 1 -- 172.21.15.12:0/1267593392 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7fb7840bbb40 con 0x55e587795760 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb79caa7740 1 -- 172.21.15.12:0/1267593392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7840cfb20 con 0x55e587795760 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb7737fe640 1 -- 172.21.15.12:0/1267593392 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb7840b8230 con 0x55e587795760 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb79caa7740 10 client.28313 fetch_fsmap learned FSMap version 48 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb79caa7740 1 -- 172.21.15.12:0/1267593392 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55e58778d260 con 0x55e587795760 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb7737fe640 1 -- 172.21.15.12:0/1267593392 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7840cfb20 con 0x55e587795760 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb7737fe640 1 -- 172.21.15.12:0/1267593392 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 48) ==== 8390+0+0 (secure 0 0 0) 0x7fb7840c6070 con 0x55e587795760 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb79caa7740 10 client.28313 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb79caa7740 10 client.28313 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb79caa7740 20 client.28313 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:01.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb79caa7740 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5877b01d0 0x55e58781d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb79caa7740 4 client.28313 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-09-19T06:53:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.271+0000 7fb79caa7740 1 -- 172.21.15.12:0/1267593392 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x55e58767eec0 con 0x55e5877b01d0 2024-09-19T06:53:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.272+0000 7fb78bfff640 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5877b01d0 0x55e58781d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.272+0000 7fb7737fe640 10 client.28313 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:01.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.272+0000 7fb78bfff640 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5877b01d0 0x55e58781d600 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=608be457fe4ab4b7 server_cookie=98c31cba001be401 in_seq=0 out_seq=0 2024-09-19T06:53:01.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.451+0000 7fb7737fe640 1 -- 172.21.15.12:0/1267593392 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e58767eec0 con 0x55e5877b01d0 2024-09-19T06:53:01.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.451+0000 7fb7737fe640 10 client.28313 handle_command_reply: tid=0 2024-09-19T06:53:01.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.451+0000 7fb79caa7740 1 client.28313 shutdown 2024-09-19T06:53:01.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.451+0000 7fb79caa7740 1 -- 172.21.15.12:0/1267593392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 msgr2=0x55e5877a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:01.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.451+0000 7fb79caa7740 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877a84b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb7840c4b70 tx=0x7fb7840d54a0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79caa7740 1 -- 172.21.15.12:0/1267593392 shutdown_connections 2024-09-19T06:53:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79caa7740 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e5877b01d0 0x55e58781d600 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79caa7740 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e5877a0940 0x55e5877a5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79caa7740 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e587796080 0x55e5877a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb7737fe640 0 client.28313 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79caa7740 1 --2- 172.21.15.12:0/1267593392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e587795760 0x55e5877a84b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79caa7740 1 -- 172.21.15.12:0/1267593392 >> 172.21.15.12:0/1267593392 conn(0x55e587791cf0 msgr2=0x55e5877971b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79caa7740 1 -- 172.21.15.12:0/1267593392 shutdown_connections 2024-09-19T06:53:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79caa7740 1 -- 172.21.15.12:0/1267593392 wait complete. 2024-09-19T06:53:01.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79caa7740 20 client.28313 trim_cache size 0 max 16384 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 48, 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 42, 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: "b17f4ae5": { 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 42, 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:53:01.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 142.2, 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:01.456 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:01.457 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:53:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3193765050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb7800a3430 msgr2=0x7fb7800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79a6ce640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb7800a3430 0x7fb7800a58f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009fd0 tx=0x7fb78c004ab0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3193765050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb794102dd0 msgr2=0x7fb79419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79a6ce640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb794102dd0 0x7fb79419a660 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fb784006010 tx=0x7fb784004040 comp rx=0 tx=0).stop 2024-09-19T06:53:01.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3193765050 shutdown_connections 2024-09-19T06:53:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79a6ce640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb7800a3430 0x7fb7800a58f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.452+0000 7fb79a6ce640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb79410c170 0x7fb79419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.453+0000 7fb79a6ce640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7941036f0 0x7fb79419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.453+0000 7fb79a6ce640 1 --2- 172.21.15.12:0/3193765050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb794102dd0 0x7fb79419a660 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.453+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3193765050 >> 172.21.15.12:0/3193765050 conn(0x7fb7940fc7d0 msgr2=0x7fb79410d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.453+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3193765050 shutdown_connections 2024-09-19T06:53:01.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:01.453+0000 7fb79a6ce640 1 -- 172.21.15.12:0/3193765050 wait complete. 2024-09-19T06:53:02.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:02 smithi012 ceph-mon[30937]: pgmap v401: 97 pgs: 97 active+clean; 4.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 835 op/s 2024-09-19T06:53:02.156 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b17f4ae5', quiesce took 3.9 seconds. Will release after: 18.3 2024-09-19T06:53:02.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:02 smithi173 ceph-mon[35349]: pgmap v401: 97 pgs: 97 active+clean; 4.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 835 op/s 2024-09-19T06:53:02.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:02 smithi016 ceph-mon[34911]: pgmap v401: 97 pgs: 97 active+clean; 4.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 835 op/s 2024-09-19T06:53:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.208+0000 7f8f15e1e640 1 -- 172.21.15.12:0/3344850592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1010c110 msgr2=0x7f8f1010e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.208+0000 7f8f15e1e640 1 --2- 172.21.15.12:0/3344850592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1010c110 0x7f8f1010e590 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009ca0 tx=0x7f8f0802a950 comp rx=0 tx=0).stop 2024-09-19T06:53:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.208+0000 7f8f15e1e640 1 -- 172.21.15.12:0/3344850592 shutdown_connections 2024-09-19T06:53:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.208+0000 7f8f15e1e640 1 --2- 172.21.15.12:0/3344850592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1010c110 0x7f8f1010e590 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.208+0000 7f8f15e1e640 1 --2- 172.21.15.12:0/3344850592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f101035e0 0x7f8f1010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.208+0000 7f8f15e1e640 1 --2- 172.21.15.12:0/3344850592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f10102cc0 0x7f8f101030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.208+0000 7f8f15e1e640 1 -- 172.21.15.12:0/3344850592 >> 172.21.15.12:0/3344850592 conn(0x7f8f100fc6b0 msgr2=0x7f8f100fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.208+0000 7f8f15e1e640 1 -- 172.21.15.12:0/3344850592 shutdown_connections 2024-09-19T06:53:03.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.208+0000 7f8f15e1e640 1 -- 172.21.15.12:0/3344850592 wait complete. 2024-09-19T06:53:03.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f15e1e640 1 Processor -- start 2024-09-19T06:53:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f15e1e640 1 -- start start 2024-09-19T06:53:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f15e1e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f10102cc0 0x7f8f1019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f15e1e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f101035e0 0x7f8f1019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f15e1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1010c110 0x7f8f1019ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f15e1e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10111eb0 con 0x7f8f1010c110 2024-09-19T06:53:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f15e1e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10111d30 con 0x7f8f10102cc0 2024-09-19T06:53:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f15e1e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f10112030 con 0x7f8f101035e0 2024-09-19T06:53:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1010c110 0x7f8f1019ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1010c110 0x7f8f1019ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50704/0 (socket says 172.21.15.12:50704) 2024-09-19T06:53:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.209+0000 7f8f0ffff640 1 -- 172.21.15.12:0/4189201771 learned_addr learned my addr 172.21.15.12:0/4189201771 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f10102cc0 0x7f8f1019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0effd640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f101035e0 0x7f8f1019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0ffff640 1 -- 172.21.15.12:0/4189201771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f101035e0 msgr2=0x7f8f1019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0ffff640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f101035e0 0x7f8f1019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0ffff640 1 -- 172.21.15.12:0/4189201771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f10102cc0 msgr2=0x7f8f1019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0ffff640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f10102cc0 0x7f8f1019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0ffff640 1 -- 172.21.15.12:0/4189201771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1019f570 con 0x7f8f1010c110 2024-09-19T06:53:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0ffff640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1010c110 0x7f8f1019ee40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f8f0802ae70 tx=0x7f8f0802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0cff9640 1 -- 172.21.15.12:0/4189201771 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08034040 con 0x7f8f1010c110 2024-09-19T06:53:03.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0cff9640 1 -- 172.21.15.12:0/4189201771 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f08030920 con 0x7f8f1010c110 2024-09-19T06:53:03.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f15e1e640 1 -- 172.21.15.12:0/4189201771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1019f800 con 0x7f8f1010c110 2024-09-19T06:53:03.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f0cff9640 1 -- 172.21.15.12:0/4189201771 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08045480 con 0x7f8f1010c110 2024-09-19T06:53:03.215 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.210+0000 7f8f15e1e640 1 -- 172.21.15.12:0/4189201771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f101a70f0 con 0x7f8f1010c110 2024-09-19T06:53:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.213+0000 7f8f0cff9640 1 -- 172.21.15.12:0/4189201771 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8f08037020 con 0x7f8f1010c110 2024-09-19T06:53:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.213+0000 7f8f18c8b740 1 Processor -- start 2024-09-19T06:53:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.213+0000 7f8f18c8b740 1 -- start start 2024-09-19T06:53:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.213+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 0x55f6909d9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.213+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 0x55f6909e4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.213+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909e4cb0 0x55f6909e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.213+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f69093e2f0 con 0x55f6909e4cb0 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.213+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f6908e6270 con 0x55f6909da410 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.213+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f69093a2b0 con 0x55f6909d9af0 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909e4cb0 0x55f6909e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 0x55f6909d9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 0x55f6909d9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:59438/0 (socket says 172.21.15.12:59438) 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0effd640 1 -- 172.21.15.12:0/3429033403 learned_addr learned my addr 172.21.15.12:0/3429033403 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 0x55f6909e4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0cff9640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ef80a3460 0x7f8ef80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0ffff640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ef80a3460 0x7f8ef80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0effd640 1 -- 172.21.15.12:0/3429033403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 msgr2=0x55f6909d9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0effd640 1 --2- 172.21.15.12:0/3429033403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 0x55f6909d9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0effd640 1 -- 172.21.15.12:0/3429033403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 msgr2=0x55f6909e4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0effd640 1 --2- 172.21.15.12:0/3429033403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 0x55f6909e4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0effd640 1 -- 172.21.15.12:0/3429033403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6908e5340 con 0x55f6909e4cb0 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/3429033403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 0x55f6909e4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0cff9640 1 -- 172.21.15.12:0/4189201771 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f8f080f0c10 con 0x7f8f1010c110 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8f0effd640 1 --2- 172.21.15.12:0/3429033403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909e4cb0 0x55f6909e70a0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f8f04014930 tx=0x7f8f04005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcba383f589f8fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.214+0000 7f8ef5ffb640 1 -- 172.21.15.12:0/3429033403 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f040142d0 con 0x55f6909e4cb0 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8ef5ffb640 1 -- 172.21.15.12:0/3429033403 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f0400c6d0 con 0x55f6909e4cb0 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8ef5ffb640 1 -- 172.21.15.12:0/3429033403 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04003830 con 0x55f6909e4cb0 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8f18c8b740 1 -- 172.21.15.12:0/3429033403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909e4cb0 msgr2=0x55f6909e70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/3429033403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909e4cb0 0x55f6909e70a0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f8f04014930 tx=0x7f8f04005d10 comp rx=0 tx=0).stop 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8f0ffff640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ef80a3460 0x7f8ef80a5920 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8f080bcc00 tx=0x7f8f0804e000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8f18c8b740 1 -- 172.21.15.12:0/3429033403 shutdown_connections 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/3429033403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909e4cb0 0x55f6909e70a0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/3429033403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 0x55f6909e4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/3429033403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 0x55f6909d9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8f18c8b740 1 -- 172.21.15.12:0/3429033403 >> 172.21.15.12:0/3429033403 conn(0x55f6909d6060 msgr2=0x55f6909d6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8f18c8b740 1 -- 172.21.15.12:0/3429033403 shutdown_connections 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.215+0000 7f8f18c8b740 1 -- 172.21.15.12:0/3429033403 wait complete. 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f18c8b740 1 -- start start 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f18c8b740 1 Processor -- start 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909d9af0 0x55f6909e1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 0x55f6909e20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909e4cb0 0x55f6909e2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f6909e7880 con 0x55f6909d9af0 2024-09-19T06:53:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f6908c7290 con 0x55f6909da410 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f6909e7a00 con 0x55f6909e4cb0 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f18c8b740 10 client.0 _ll_register_callbacks cb 0x55f6908f8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f0effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909d9af0 0x55f6909e1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f0effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909d9af0 0x55f6909e1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50716/0 (socket says 172.21.15.12:50716) 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.216+0000 7f8f0effd640 1 -- 172.21.15.12:0/2580547487 learned_addr learned my addr 172.21.15.12:0/2580547487 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 0x55f6909e20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f0effd640 1 -- 172.21.15.12:0/2580547487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909e4cb0 msgr2=0x55f6909e2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909e4cb0 0x55f6909e2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f0effd640 1 -- 172.21.15.12:0/2580547487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 msgr2=0x55f6909e20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 0x55f6909e20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f0effd640 1 -- 172.21.15.12:0/2580547487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f690651210 con 0x55f6909d9af0 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 0x55f6909e20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909d9af0 0x55f6909e1bb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f8f04001eb0 tx=0x7f8f0400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c908ef86af2a6f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8eeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2580547487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f040142d0 con 0x55f6909d9af0 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2580547487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f8f04014470 con 0x55f6909d9af0 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2580547487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f0400c6d0 con 0x55f6909d9af0 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2580547487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f8f04005040 con 0x55f6909d9af0 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f18c8b740 10 client.18984 fetch_fsmap learned FSMap version 48 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2580547487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55f69071d620 con 0x55f6909d9af0 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.217+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2580547487 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f0400c6d0 con 0x55f6909d9af0 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.218+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2580547487 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 48) ==== 8390+0+0 (secure 0 0 0) 0x7f8f04021440 con 0x55f6909d9af0 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.218+0000 7f8f18c8b740 10 client.18984 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.218+0000 7f8f18c8b740 10 client.18984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.218+0000 7f8f18c8b740 20 client.18984 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.218+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f6909f4b40 0x55f6909f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.218+0000 7f8f18c8b740 4 client.18984 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.218+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2580547487 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f69094ba20 con 0x55f6909f4b40 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.218+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f6909f4b40 0x55f6909f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.218+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f6909f4b40 0x55f6909f6f30 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3119fa54fc9c913c server_cookie=2674a4554dcfaa50 in_seq=0 out_seq=0 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.218+0000 7f8eeeffd640 10 client.18984 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2580547487 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f69094ba20 con 0x55f6909f4b40 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8eeeffd640 10 client.18984 handle_command_reply: tid=0 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8f18c8b740 1 client.18984 shutdown 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2580547487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909d9af0 msgr2=0x55f6909e1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909d9af0 0x55f6909e1bb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f8f04001eb0 tx=0x7f8f0400c910 comp rx=0 tx=0).stop 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2580547487 shutdown_connections 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f6909f4b40 0x55f6909f6f30 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909e4cb0 0x55f6909e2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909da410 0x55f6909e20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8eeeffd640 0 client.18984 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2580547487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909d9af0 0x55f6909e1bb0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2580547487 >> 172.21.15.12:0/2580547487 conn(0x55f6909d6060 msgr2=0x55f6909dbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.219+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2580547487 shutdown_connections 2024-09-19T06:53:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.220+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2580547487 wait complete. 2024-09-19T06:53:03.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.220+0000 7f8f18c8b740 20 client.18984 trim_cache size 0 max 16384 2024-09-19T06:53:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.234+0000 7f8f18c8b740 1 Processor -- start 2024-09-19T06:53:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.234+0000 7f8f18c8b740 1 -- start start 2024-09-19T06:53:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.234+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 0x55f6909e3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.234+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909e2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.234+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909e4cb0 0x55f6909fc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.234+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8f101afc80 con 0x55f6909da410 2024-09-19T06:53:03.240 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.234+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8f101b1910 con 0x55f6909e4cb0 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.234+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f101b0350 con 0x55f6909d9af0 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909e2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909e2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50726/0 (socket says 172.21.15.12:50726) 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0f7fe640 1 -- 172.21.15.12:0/2811863002 learned_addr learned my addr 172.21.15.12:0/2811863002 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2811863002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909e4cb0 0x55f6909fc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2811863002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 0x55f6909e3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0f7fe640 1 -- 172.21.15.12:0/2811863002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 msgr2=0x55f6909e3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/2811863002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 0x55f6909e3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0f7fe640 1 -- 172.21.15.12:0/2811863002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909e4cb0 msgr2=0x55f6909fc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/2811863002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909e4cb0 0x55f6909fc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0f7fe640 1 -- 172.21.15.12:0/2811863002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6909da240 con 0x55f6909da410 2024-09-19T06:53:03.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2811863002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909e4cb0 0x55f6909fc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/2811863002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909e2460 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f8f00004650 tx=0x7f8f0000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3d1f12d0940fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8ef57fa640 1 -- 172.21.15.12:0/2811863002 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f00003f00 con 0x55f6909da410 2024-09-19T06:53:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8ef57fa640 1 -- 172.21.15.12:0/2811863002 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f00011920 con 0x55f6909da410 2024-09-19T06:53:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.235+0000 7f8ef57fa640 1 -- 172.21.15.12:0/2811863002 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0001dac0 con 0x55f6909da410 2024-09-19T06:53:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.236+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2811863002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 msgr2=0x55f6909e2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.236+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2811863002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909e2460 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f8f00004650 tx=0x7f8f0000bf50 comp rx=0 tx=0).stop 2024-09-19T06:53:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.236+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2811863002 shutdown_connections 2024-09-19T06:53:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.236+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2811863002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909e4cb0 0x55f6909fc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.236+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2811863002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909e2460 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.236+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2811863002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909d9af0 0x55f6909e3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.236+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2811863002 >> 172.21.15.12:0/2811863002 conn(0x55f6909d6060 msgr2=0x55f6909e0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.236+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2811863002 shutdown_connections 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.236+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2811863002 wait complete. 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.236+0000 7f8f18c8b740 1 -- start start 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f18c8b740 1 Processor -- start 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909d9af0 0x55f6909eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f18c8b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909e4cb0 0x55f6909de430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8f101b1240 con 0x55f6909da410 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8f101b0ab0 con 0x55f6909d9af0 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f18c8b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f101adc80 con 0x55f6909e4cb0 2024-09-19T06:53:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f18c8b740 10 client.0 _ll_register_callbacks cb 0x7f8f0000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909ed3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50728/0 (socket says 172.21.15.12:50728) 2024-09-19T06:53:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0f7fe640 1 -- 172.21.15.12:0/2754888273 learned_addr learned my addr 172.21.15.12:0/2754888273 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909d9af0 0x55f6909eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909e4cb0 0x55f6909de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0f7fe640 1 -- 172.21.15.12:0/2754888273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909e4cb0 msgr2=0x55f6909de430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909e4cb0 0x55f6909de430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0f7fe640 1 -- 172.21.15.12:0/2754888273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909d9af0 msgr2=0x55f6909eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909d9af0 0x55f6909eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0f7fe640 1 -- 172.21.15.12:0/2754888273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6909dec30 con 0x55f6909da410 2024-09-19T06:53:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909d9af0 0x55f6909eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.237+0000 7f8f0f7fe640 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909ed3f0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8f0001d640 tx=0x7f8f0001d500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7553ec99df04ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8eeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2754888273 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f00011640 con 0x55f6909da410 2024-09-19T06:53:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2754888273 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8687+0+0 (secure 0 0 0) 0x7f8f00011ad0 con 0x55f6909da410 2024-09-19T06:53:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2754888273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f00011920 con 0x55f6909da410 2024-09-19T06:53:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2754888273 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f8f00011cd0 con 0x55f6909da410 2024-09-19T06:53:03.245 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8f18c8b740 10 client.18990 fetch_fsmap learned FSMap version 48 2024-09-19T06:53:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2754888273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55f690a5efe0 con 0x55f6909da410 2024-09-19T06:53:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2754888273 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f00011920 con 0x55f6909da410 2024-09-19T06:53:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2754888273 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 48) ==== 8390+0+0 (secure 0 0 0) 0x7f8f0002d070 con 0x55f6909da410 2024-09-19T06:53:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8f18c8b740 10 client.18990 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T06:53:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8f18c8b740 10 client.18990 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8f18c8b740 20 client.18990 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f690a5f670 0x55f690a61a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8f18c8b740 4 client.18990 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:53:03.246 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.238+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2754888273 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f690945d70 con 0x55f690a5f670 2024-09-19T06:53:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.239+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f690a5f670 0x55f690a61a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.239+0000 7f8eeeffd640 10 client.18990 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:03.247 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.239+0000 7f8f0effd640 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f690a5f670 0x55f690a61a90 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3641a869c829a798 server_cookie=8dd1bed2d3497f02 in_seq=0 out_seq=0 2024-09-19T06:53:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.253+0000 7f8eeeffd640 1 -- 172.21.15.12:0/2754888273 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f690945d70 con 0x55f690a5f670 2024-09-19T06:53:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.253+0000 7f8eeeffd640 10 client.18990 handle_command_reply: tid=0 2024-09-19T06:53:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.253+0000 7f8f18c8b740 1 client.18990 shutdown 2024-09-19T06:53:03.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2754888273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 msgr2=0x55f6909ed3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909ed3f0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8f0001d640 tx=0x7f8f0001d500 comp rx=0 tx=0).stop 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2754888273 shutdown_connections 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55f690a5f670 0x55f690a61a90 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f6909e4cb0 0x55f6909de430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8eeeffd640 0 client.18990 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f6909da410 0x55f6909ed3f0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 1 --2- 172.21.15.12:0/2754888273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f6909d9af0 0x55f6909eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2754888273 >> 172.21.15.12:0/2754888273 conn(0x55f6909d6060 msgr2=0x55f6909d49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2754888273 shutdown_connections 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 1 -- 172.21.15.12:0/2754888273 wait complete. 2024-09-19T06:53:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f18c8b740 20 client.18990 trim_cache size 0 max 16384 2024-09-19T06:53:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:53:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:53:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:53:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:53:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f15e1e640 1 -- 172.21.15.12:0/4189201771 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ef80a3460 msgr2=0x7f8ef80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f15e1e640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ef80a3460 0x7f8ef80a5920 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8f080bcc00 tx=0x7f8f0804e000 comp rx=0 tx=0).stop 2024-09-19T06:53:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f15e1e640 1 -- 172.21.15.12:0/4189201771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1010c110 msgr2=0x7f8f1019ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f15e1e640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1010c110 0x7f8f1019ee40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f8f0802ae70 tx=0x7f8f0802f5b0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f15e1e640 1 -- 172.21.15.12:0/4189201771 shutdown_connections 2024-09-19T06:53:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f15e1e640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1010c110 0x7f8f1019ee40 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f15e1e640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ef80a3460 0x7f8ef80a5920 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f15e1e640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f101035e0 0x7f8f1019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f15e1e640 1 --2- 172.21.15.12:0/4189201771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f10102cc0 0x7f8f1019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.254+0000 7f8f15e1e640 1 -- 172.21.15.12:0/4189201771 >> 172.21.15.12:0/4189201771 conn(0x7f8f100fc6b0 msgr2=0x7f8f1010d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.255+0000 7f8f15e1e640 1 -- 172.21.15.12:0/4189201771 shutdown_connections 2024-09-19T06:53:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:03.255+0000 7f8f15e1e640 1 -- 172.21.15.12:0/4189201771 wait complete. 2024-09-19T06:53:04.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:04 smithi173 ceph-mon[35349]: pgmap v402: 97 pgs: 97 active+clean; 4.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.9 MiB/s wr, 557 op/s 2024-09-19T06:53:04.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:04 smithi012 ceph-mon[30937]: pgmap v402: 97 pgs: 97 active+clean; 4.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.9 MiB/s wr, 557 op/s 2024-09-19T06:53:04.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:04 smithi016 ceph-mon[34911]: pgmap v402: 97 pgs: 97 active+clean; 4.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.9 MiB/s wr, 557 op/s 2024-09-19T06:53:05.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:05 smithi173 ceph-mon[35349]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T06:53:05.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:05 smithi012 ceph-mon[30937]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T06:53:05.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:05 smithi016 ceph-mon[34911]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T06:53:05.811 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 740.0 s, 27.2 tps, lat 341.636 ms stddev 195.264 2024-09-19T06:53:06.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:06 smithi173 ceph-mon[35349]: pgmap v404: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.2 MiB/s wr, 665 op/s 2024-09-19T06:53:06.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:06 smithi012 ceph-mon[30937]: pgmap v404: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.2 MiB/s wr, 665 op/s 2024-09-19T06:53:06.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:06 smithi016 ceph-mon[34911]: pgmap v404: 97 pgs: 97 active+clean; 4.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.2 MiB/s wr, 665 op/s 2024-09-19T06:53:08.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:08 smithi173 ceph-mon[35349]: pgmap v405: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 4.4 MiB/s wr, 425 op/s 2024-09-19T06:53:08.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:08 smithi012 ceph-mon[30937]: pgmap v405: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 4.4 MiB/s wr, 425 op/s 2024-09-19T06:53:08.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:08 smithi016 ceph-mon[34911]: pgmap v405: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 4.4 MiB/s wr, 425 op/s 2024-09-19T06:53:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:10 smithi173 ceph-mon[35349]: pgmap v406: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 4.4 MiB/s wr, 425 op/s 2024-09-19T06:53:10.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:10 smithi173 ceph-mon[35349]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T06:53:10.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:10 smithi012 ceph-mon[30937]: pgmap v406: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 4.4 MiB/s wr, 425 op/s 2024-09-19T06:53:10.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:10 smithi012 ceph-mon[30937]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T06:53:10.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:10 smithi016 ceph-mon[34911]: pgmap v406: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 4.4 MiB/s wr, 425 op/s 2024-09-19T06:53:10.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:10 smithi016 ceph-mon[34911]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T06:53:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:53:12.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:53:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:12 smithi173 ceph-mon[35349]: pgmap v408: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 2.1 MiB/s wr, 225 op/s 2024-09-19T06:53:12.377 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:12 smithi012 ceph-mon[30937]: pgmap v408: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 2.1 MiB/s wr, 225 op/s 2024-09-19T06:53:12.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:12 smithi016 ceph-mon[34911]: pgmap v408: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 2.1 MiB/s wr, 225 op/s 2024-09-19T06:53:12.859 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:13.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.515+0000 7f850e2f5640 1 -- 172.21.15.12:0/2922994992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85081009d0 msgr2=0x7f8508100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:13.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.515+0000 7f850e2f5640 1 --2- 172.21.15.12:0/2922994992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85081009d0 0x7f8508100db0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009900 tx=0x7f84f802a410 comp rx=0 tx=0).stop 2024-09-19T06:53:13.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.515+0000 7f850e2f5640 1 -- 172.21.15.12:0/2922994992 shutdown_connections 2024-09-19T06:53:13.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.515+0000 7f850e2f5640 1 --2- 172.21.15.12:0/2922994992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f850810e4f0 0x7f8508110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.515+0000 7f850e2f5640 1 --2- 172.21.15.12:0/2922994992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8508101380 0x7f850810dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.515+0000 7f850e2f5640 1 --2- 172.21.15.12:0/2922994992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85081009d0 0x7f8508100db0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.515+0000 7f850e2f5640 1 -- 172.21.15.12:0/2922994992 >> 172.21.15.12:0/2922994992 conn(0x7f85080fc7d0 msgr2=0x7f85080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:13.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.515+0000 7f850e2f5640 1 -- 172.21.15.12:0/2922994992 shutdown_connections 2024-09-19T06:53:13.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.515+0000 7f850e2f5640 1 -- 172.21.15.12:0/2922994992 wait complete. 2024-09-19T06:53:13.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.515+0000 7f850e2f5640 1 Processor -- start 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f850e2f5640 1 -- start start 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f850e2f5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85081009d0 0x7f85081a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f850e2f5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8508101380 0x7f85081a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f850e2f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f850810e4f0 0x7f850819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f850e2f5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8508114250 con 0x7f85081009d0 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f850e2f5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f85081140d0 con 0x7f850810e4f0 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f850e2f5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f85081143d0 con 0x7f8508101380 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f8507fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85081009d0 0x7f85081a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f8507fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85081009d0 0x7f85081a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44464/0 (socket says 172.21.15.12:44464) 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f8507fff640 1 -- 172.21.15.12:0/3612512631 learned_addr learned my addr 172.21.15.12:0/3612512631 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f84fffff640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8508101380 0x7f85081a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f850c892640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f850810e4f0 0x7f850819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f8507fff640 1 -- 172.21.15.12:0/3612512631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8508101380 msgr2=0x7f85081a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f8507fff640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8508101380 0x7f85081a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f8507fff640 1 -- 172.21.15.12:0/3612512631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f850810e4f0 msgr2=0x7f850819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f8507fff640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f850810e4f0 0x7f850819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.516+0000 7f8507fff640 1 -- 172.21.15.12:0/3612512631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850819acc0 con 0x7f85081009d0 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.517+0000 7f8507fff640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85081009d0 0x7f85081a03d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f84f8006010 tx=0x7f84f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.517+0000 7f8505ffb640 1 -- 172.21.15.12:0/3612512631 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f803f030 con 0x7f85081009d0 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.517+0000 7f850e2f5640 1 -- 172.21.15.12:0/3612512631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850819af50 con 0x7f85081009d0 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.517+0000 7f8505ffb640 1 -- 172.21.15.12:0/3612512631 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84f8003ce0 con 0x7f85081009d0 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.517+0000 7f8505ffb640 1 -- 172.21.15.12:0/3612512631 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8035070 con 0x7f85081009d0 2024-09-19T06:53:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.517+0000 7f850e2f5640 1 -- 172.21.15.12:0/3612512631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85081a72a0 con 0x7f85081009d0 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.519+0000 7f8505ffb640 1 -- 172.21.15.12:0/3612512631 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f84f8042030 con 0x7f85081009d0 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f85106ce740 1 Processor -- start 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f85106ce740 1 -- start start 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f85106ce740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 0x562718bf6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f85106ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c01140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f85106ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718c01680 0x562718c03a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f85106ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562718b5c2e0 con 0x562718bf6dc0 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f85106ce740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562718b03ce0 con 0x562718bf64a0 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f85106ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562718b582a0 con 0x562718c01680 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f8507fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c01140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f8507fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c01140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44468/0 (socket says 172.21.15.12:44468) 2024-09-19T06:53:13.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f8505ffb640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84f40a3430 0x7f84f40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f8507fff640 1 -- 172.21.15.12:0/3634907406 learned_addr learned my addr 172.21.15.12:0/3634907406 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.520+0000 7f850c892640 1 --2- 172.21.15.12:0/3634907406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 0x562718bf6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f84fffff640 1 --2- 172.21.15.12:0/3634907406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718c01680 0x562718c03a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f850c892640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84f40a3430 0x7f84f40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f8505ffb640 1 -- 172.21.15.12:0/3612512631 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f84f80f01f0 con 0x7f85081009d0 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f850c892640 1 -- 172.21.15.12:0/3634907406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718c01680 msgr2=0x562718c03a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f850c892640 1 --2- 172.21.15.12:0/3634907406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718c01680 0x562718c03a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f850c892640 1 -- 172.21.15.12:0/3634907406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 msgr2=0x562718c01140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f850c892640 1 --2- 172.21.15.12:0/3634907406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c01140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f850c892640 1 -- 172.21.15.12:0/3634907406 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562718ae8440 con 0x562718bf64a0 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f850c892640 1 --2- 172.21.15.12:0/3634907406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 0x562718bf6880 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f850000a780 tx=0x7f8500013d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26be7196272d4266 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:13.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f84fe7fc640 1 -- 172.21.15.12:0/3634907406 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500013250 con 0x562718bf64a0 2024-09-19T06:53:13.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f84fe7fc640 1 -- 172.21.15.12:0/3634907406 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850001dcd0 con 0x562718bf64a0 2024-09-19T06:53:13.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.521+0000 7f84fe7fc640 1 -- 172.21.15.12:0/3634907406 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500012b70 con 0x562718bf64a0 2024-09-19T06:53:13.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.522+0000 7f85106ce740 1 -- 172.21.15.12:0/3634907406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 msgr2=0x562718bf6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.522+0000 7f850c892640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84f40a3430 0x7f84f40a58f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8500020000 tx=0x7f850001e000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.522+0000 7f85106ce740 1 --2- 172.21.15.12:0/3634907406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 0x562718bf6880 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f850000a780 tx=0x7f8500013d80 comp rx=0 tx=0).stop 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.522+0000 7f85106ce740 1 -- 172.21.15.12:0/3634907406 shutdown_connections 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.522+0000 7f85106ce740 1 --2- 172.21.15.12:0/3634907406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718c01680 0x562718c03a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.522+0000 7f85106ce740 1 --2- 172.21.15.12:0/3634907406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c01140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.522+0000 7f85106ce740 1 --2- 172.21.15.12:0/3634907406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 0x562718bf6880 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.522+0000 7f85106ce740 1 -- 172.21.15.12:0/3634907406 >> 172.21.15.12:0/3634907406 conn(0x562718bf2a30 msgr2=0x562718bf2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.522+0000 7f85106ce740 1 -- 172.21.15.12:0/3634907406 shutdown_connections 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.522+0000 7f85106ce740 1 -- 172.21.15.12:0/3634907406 wait complete. 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f85106ce740 1 -- start start 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f85106ce740 1 Processor -- start 2024-09-19T06:53:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f85106ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 0x562718c00f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f85106ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718bfe210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f85106ce740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718c01680 0x562718bfe750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f85106ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562718c04250 con 0x562718bf6dc0 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f85106ce740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562718b17050 con 0x562718c01680 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f85106ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562718c043d0 con 0x562718bf64a0 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f84fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718bfe210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f84fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718bfe210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44472/0 (socket says 172.21.15.12:44472) 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f84fffff640 1 -- 172.21.15.12:0/3371672389 learned_addr learned my addr 172.21.15.12:0/3371672389 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f8507fff640 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 0x562718c00f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f85106ce740 10 client.0 _ll_register_callbacks cb 0x562718b57160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.523+0000 7f850c892640 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718c01680 0x562718bfe750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f8507fff640 1 -- 172.21.15.12:0/3371672389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718c01680 msgr2=0x562718bfe750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f8507fff640 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718c01680 0x562718bfe750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f8507fff640 1 -- 172.21.15.12:0/3371672389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 msgr2=0x562718bfe210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f8507fff640 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718bfe210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f8507fff640 1 -- 172.21.15.12:0/3371672389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627188cd3c0 con 0x562718bf64a0 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f84fffff640 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718bfe210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f850c892640 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718c01680 0x562718bfe750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f8507fff640 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 0x562718c00f60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f84f80bc2a0 tx=0x7f84f8005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0bc46e0ceb5170d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f84e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f84e77fe640 1 -- 172.21.15.12:0/3371672389 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8049070 con 0x562718bf64a0 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f84e77fe640 1 -- 172.21.15.12:0/3371672389 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f84f80b82f0 con 0x562718bf64a0 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f85106ce740 1 -- 172.21.15.12:0/3371672389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f850001dcd0 con 0x562718bf64a0 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f84e77fe640 1 -- 172.21.15.12:0/3371672389 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f84f80bc0e0 con 0x562718bf64a0 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f85106ce740 10 client.28279 fetch_fsmap learned FSMap version 48 2024-09-19T06:53:13.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f85106ce740 1 -- 172.21.15.12:0/3371672389 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x562718c04250 con 0x562718bf64a0 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.524+0000 7f84e77fe640 1 -- 172.21.15.12:0/3371672389 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850001dcd0 con 0x562718bf64a0 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.525+0000 7f84e77fe640 1 -- 172.21.15.12:0/3371672389 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 48) ==== 8390+0+0 (secure 0 0 0) 0x7f84f80b6040 con 0x562718bf64a0 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.525+0000 7f85106ce740 10 client.28279 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.525+0000 7f85106ce740 10 client.28279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.525+0000 7f85106ce740 20 client.28279 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.525+0000 7f85106ce740 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562718c11030 0x562718c13480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.525+0000 7f85106ce740 4 client.28279 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.525+0000 7f85106ce740 1 -- 172.21.15.12:0/3371672389 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562718b69850 con 0x562718c11030 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.525+0000 7f84fffff640 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562718c11030 0x562718c13480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f84e77fe640 10 client.28279 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f84fffff640 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562718c11030 0x562718c13480 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402abf2fec31daa5 server_cookie=298132541c1a3627 in_seq=0 out_seq=0 2024-09-19T06:53:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f84e77fe640 1 -- 172.21.15.12:0/3371672389 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562718b69850 con 0x562718c11030 2024-09-19T06:53:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f84e77fe640 10 client.28279 handle_command_reply: tid=0 2024-09-19T06:53:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f85106ce740 1 client.28279 shutdown 2024-09-19T06:53:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f85106ce740 1 -- 172.21.15.12:0/3371672389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 msgr2=0x562718c00f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f85106ce740 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 0x562718c00f60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f84f80bc2a0 tx=0x7f84f8005c90 comp rx=0 tx=0).stop 2024-09-19T06:53:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f85106ce740 1 -- 172.21.15.12:0/3371672389 shutdown_connections 2024-09-19T06:53:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f85106ce740 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562718c11030 0x562718c13480 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f85106ce740 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718c01680 0x562718bfe750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f85106ce740 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718bfe210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f85106ce740 1 --2- 172.21.15.12:0/3371672389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 0x562718c00f60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.526+0000 7f85106ce740 1 -- 172.21.15.12:0/3371672389 >> 172.21.15.12:0/3371672389 conn(0x562718bf2a30 msgr2=0x562718bf8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:13.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.527+0000 7f84e77fe640 0 client.28279 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:13.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.527+0000 7f85106ce740 1 -- 172.21.15.12:0/3371672389 shutdown_connections 2024-09-19T06:53:13.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.527+0000 7f85106ce740 1 -- 172.21.15.12:0/3371672389 wait complete. 2024-09-19T06:53:13.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.527+0000 7f85106ce740 20 client.28279 trim_cache size 0 max 16384 2024-09-19T06:53:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.544+0000 7f85106ce740 1 Processor -- start 2024-09-19T06:53:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.544+0000 7f85106ce740 1 -- start start 2024-09-19T06:53:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f85106ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf2a30 0x562718bfefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f85106ce740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 0x562718c18d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f85106ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c192d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f85106ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f85081afd60 con 0x562718bf6dc0 2024-09-19T06:53:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f85106ce740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f85081b19f0 con 0x562718bf64a0 2024-09-19T06:53:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f85106ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f85081b0430 con 0x562718bf2a30 2024-09-19T06:53:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f850c892640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f850c892640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c192d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44478/0 (socket says 172.21.15.12:44478) 2024-09-19T06:53:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f850c892640 1 -- 172.21.15.12:0/3204824230 learned_addr learned my addr 172.21.15.12:0/3204824230 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f8507fff640 1 --2- 172.21.15.12:0/3204824230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf2a30 0x562718bfefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f84fffff640 1 --2- 172.21.15.12:0/3204824230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 0x562718c18d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f850c892640 1 -- 172.21.15.12:0/3204824230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf2a30 msgr2=0x562718bfefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f850c892640 1 --2- 172.21.15.12:0/3204824230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf2a30 0x562718bfefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f850c892640 1 -- 172.21.15.12:0/3204824230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 msgr2=0x562718c18d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f850c892640 1 --2- 172.21.15.12:0/3204824230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 0x562718c18d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f850c892640 1 -- 172.21.15.12:0/3204824230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562718c01290 con 0x562718bf6dc0 2024-09-19T06:53:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f84fffff640 1 --2- 172.21.15.12:0/3204824230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 0x562718c18d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:13.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.545+0000 7f850c892640 1 --2- 172.21.15.12:0/3204824230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c192d0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f850000a780 tx=0x7f8500012830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2f9e9f57f03bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f84fdffb640 1 -- 172.21.15.12:0/3204824230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850000a860 con 0x562718bf6dc0 2024-09-19T06:53:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f84fdffb640 1 -- 172.21.15.12:0/3204824230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8500003e50 con 0x562718bf6dc0 2024-09-19T06:53:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f84fdffb640 1 -- 172.21.15.12:0/3204824230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500013380 con 0x562718bf6dc0 2024-09-19T06:53:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f85106ce740 1 -- 172.21.15.12:0/3204824230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 msgr2=0x562718c192d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f85106ce740 1 --2- 172.21.15.12:0/3204824230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c192d0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f850000a780 tx=0x7f8500012830 comp rx=0 tx=0).stop 2024-09-19T06:53:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f85106ce740 1 -- 172.21.15.12:0/3204824230 shutdown_connections 2024-09-19T06:53:13.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f85106ce740 1 --2- 172.21.15.12:0/3204824230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c192d0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f85106ce740 1 --2- 172.21.15.12:0/3204824230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf64a0 0x562718c18d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f85106ce740 1 --2- 172.21.15.12:0/3204824230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf2a30 0x562718bfefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f85106ce740 1 -- 172.21.15.12:0/3204824230 >> 172.21.15.12:0/3204824230 conn(0x562718bfe8b0 msgr2=0x562718bfcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f85106ce740 1 -- 172.21.15.12:0/3204824230 shutdown_connections 2024-09-19T06:53:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.546+0000 7f85106ce740 1 -- 172.21.15.12:0/3204824230 wait complete. 2024-09-19T06:53:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f85106ce740 1 -- start start 2024-09-19T06:53:13.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f85106ce740 1 Processor -- start 2024-09-19T06:53:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f85106ce740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf2a30 0x562718c07450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f85106ce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 0x562718c07990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f85106ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c07ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f85106ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f85081b1320 con 0x562718bf6dc0 2024-09-19T06:53:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f85106ce740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f85081b0b90 con 0x562718bf2a30 2024-09-19T06:53:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f85106ce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f85081add60 con 0x562718bf64a0 2024-09-19T06:53:13.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f850c892640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c07ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f85106ce740 10 client.0 _ll_register_callbacks cb 0x7f84f80b8200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f850c892640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c07ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44488/0 (socket says 172.21.15.12:44488) 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.547+0000 7f850c892640 1 -- 172.21.15.12:0/3384306957 learned_addr learned my addr 172.21.15.12:0/3384306957 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f8507fff640 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf2a30 0x562718c07450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f84fffff640 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 0x562718c07990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f850c892640 1 -- 172.21.15.12:0/3384306957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 msgr2=0x562718c07990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f850c892640 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 0x562718c07990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f850c892640 1 -- 172.21.15.12:0/3384306957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf2a30 msgr2=0x562718c07450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f850c892640 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf2a30 0x562718c07450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f850c892640 1 -- 172.21.15.12:0/3384306957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562718c83630 con 0x562718bf6dc0 2024-09-19T06:53:13.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f84fffff640 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 0x562718c07990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f850c892640 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c07ed0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f850000adb0 tx=0x7f8500012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9ccc5eede80d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f84e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f84e77fe640 1 -- 172.21.15.12:0/3384306957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500003970 con 0x562718bf6dc0 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f84e77fe640 1 -- 172.21.15.12:0/3384306957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f8500037040 con 0x562718bf6dc0 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f85106ce740 1 -- 172.21.15.12:0/3384306957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8500003e50 con 0x562718bf6dc0 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f84e77fe640 1 -- 172.21.15.12:0/3384306957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f8500048050 con 0x562718bf6dc0 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f85106ce740 10 client.19008 fetch_fsmap learned FSMap version 48 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.548+0000 7f85106ce740 1 -- 172.21.15.12:0/3384306957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x562718c84920 con 0x562718bf6dc0 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f84e77fe640 1 -- 172.21.15.12:0/3384306957 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8500003e50 con 0x562718bf6dc0 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f84e77fe640 1 -- 172.21.15.12:0/3384306957 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 48) ==== 8390+0+0 (secure 0 0 0) 0x7f850001db90 con 0x562718bf6dc0 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f85106ce740 10 client.19008 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T06:53:13.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f85106ce740 10 client.19008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f85106ce740 20 client.19008 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f85106ce740 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562718c01680 0x562718c86ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f85106ce740 4 client.19008 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f85106ce740 1 -- 172.21.15.12:0/3384306957 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562718b63d60 con 0x562718c01680 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f8507fff640 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562718c01680 0x562718c86ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f84e77fe640 10 client.19008 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.549+0000 7f8507fff640 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562718c01680 0x562718c86ea0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edd667f3f72faea1 server_cookie=36743a8d3790108f in_seq=0 out_seq=0 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f84e77fe640 1 -- 172.21.15.12:0/3384306957 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562718b63d60 con 0x562718c01680 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f84e77fe640 10 client.19008 handle_command_reply: tid=0 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 client.19008 shutdown 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 -- 172.21.15.12:0/3384306957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 msgr2=0x562718c07ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:13.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c07ed0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f850000adb0 tx=0x7f8500012f90 comp rx=0 tx=0).stop 2024-09-19T06:53:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 -- 172.21.15.12:0/3384306957 shutdown_connections 2024-09-19T06:53:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562718c01680 0x562718c86ea0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562718bf6dc0 0x562718c07ed0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562718bf64a0 0x562718c07990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 --2- 172.21.15.12:0/3384306957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562718bf2a30 0x562718c07450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f84e77fe640 0 client.19008 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 -- 172.21.15.12:0/3384306957 >> 172.21.15.12:0/3384306957 conn(0x562718bfe8b0 msgr2=0x562718bffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 -- 172.21.15.12:0/3384306957 shutdown_connections 2024-09-19T06:53:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 1 -- 172.21.15.12:0/3384306957 wait complete. 2024-09-19T06:53:13.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f85106ce740 20 client.19008 trim_cache size 0 max 16384 2024-09-19T06:53:13.560 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:53:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:53:13.560 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:53:13.560 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:53:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f850e2f5640 1 -- 172.21.15.12:0/3612512631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84f40a3430 msgr2=0x7f84f40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f850e2f5640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84f40a3430 0x7f84f40a58f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8500020000 tx=0x7f850001e000 comp rx=0 tx=0).stop 2024-09-19T06:53:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f850e2f5640 1 -- 172.21.15.12:0/3612512631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85081009d0 msgr2=0x7f85081a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.550+0000 7f850e2f5640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85081009d0 0x7f85081a03d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f84f8006010 tx=0x7f84f80042f0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.551+0000 7f850e2f5640 1 -- 172.21.15.12:0/3612512631 shutdown_connections 2024-09-19T06:53:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.551+0000 7f850e2f5640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f850810e4f0 0x7f850819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.551+0000 7f850e2f5640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f84f40a3430 0x7f84f40a58f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.551+0000 7f850e2f5640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8508101380 0x7f85081a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.551+0000 7f850e2f5640 1 --2- 172.21.15.12:0/3612512631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85081009d0 0x7f85081a03d0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.551+0000 7f850e2f5640 1 -- 172.21.15.12:0/3612512631 >> 172.21.15.12:0/3612512631 conn(0x7f85080fc7d0 msgr2=0x7f85080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.551+0000 7f850e2f5640 1 -- 172.21.15.12:0/3612512631 shutdown_connections 2024-09-19T06:53:13.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:13.551+0000 7f850e2f5640 1 -- 172.21.15.12:0/3612512631 wait complete. 2024-09-19T06:53:14.277 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:53:14.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:53:14.301 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:14 smithi012 ceph-mon[30937]: pgmap v409: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 2.0 MiB/s wr, 216 op/s 2024-09-19T06:53:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:14 smithi173 ceph-mon[35349]: pgmap v409: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 2.0 MiB/s wr, 216 op/s 2024-09-19T06:53:14.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:14 smithi016 ceph-mon[34911]: pgmap v409: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 2.0 MiB/s wr, 216 op/s 2024-09-19T06:53:14.541 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:15.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.010+0000 7f3471e78640 1 -- 172.21.15.12:0/4202240711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c10c170 msgr2=0x7f346c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.010+0000 7f3471e78640 1 --2- 172.21.15.12:0/4202240711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c10c170 0x7f346c10e610 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f3464009ca0 tx=0x7f346402a950 comp rx=0 tx=0).stop 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.010+0000 7f3471e78640 1 -- 172.21.15.12:0/4202240711 shutdown_connections 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.010+0000 7f3471e78640 1 --2- 172.21.15.12:0/4202240711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c10c170 0x7f346c10e610 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.010+0000 7f3471e78640 1 --2- 172.21.15.12:0/4202240711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f346c103660 0x7f346c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.010+0000 7f3471e78640 1 --2- 172.21.15.12:0/4202240711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f346c102d40 0x7f346c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.010+0000 7f3471e78640 1 -- 172.21.15.12:0/4202240711 >> 172.21.15.12:0/4202240711 conn(0x7f346c0fc7a0 msgr2=0x7f346c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.010+0000 7f3471e78640 1 -- 172.21.15.12:0/4202240711 shutdown_connections 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.010+0000 7f3471e78640 1 -- 172.21.15.12:0/4202240711 wait complete. 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.010+0000 7f3471e78640 1 Processor -- start 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f3471e78640 1 -- start start 2024-09-19T06:53:15.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f3471e78640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f346c102d40 0x7f346c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f3471e78640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c103660 0x7f346c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f3471e78640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f346c10c170 0x7f346c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f3471e78640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f346c111f70 con 0x7f346c103660 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f3471e78640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f346c111df0 con 0x7f346c102d40 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f3471e78640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f346c1120f0 con 0x7f346c10c170 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c103660 0x7f346c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c103660 0x7f346c198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44504/0 (socket says 172.21.15.12:44504) 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346affd640 1 -- 172.21.15.12:0/2907304641 learned_addr learned my addr 172.21.15.12:0/2907304641 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346b7fe640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f346c102d40 0x7f346c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346bfff640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f346c10c170 0x7f346c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346affd640 1 -- 172.21.15.12:0/2907304641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f346c10c170 msgr2=0x7f346c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346affd640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f346c10c170 0x7f346c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:15.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346affd640 1 -- 172.21.15.12:0/2907304641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f346c102d40 msgr2=0x7f346c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346affd640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f346c102d40 0x7f346c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346affd640 1 -- 172.21.15.12:0/2907304641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c19d3a0 con 0x7f346c103660 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346b7fe640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f346c102d40 0x7f346c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.011+0000 7f346affd640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c103660 0x7f346c198930 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f346000e9f0 tx=0x7f346000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.012+0000 7f3468ff9640 1 -- 172.21.15.12:0/2907304641 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346000ccc0 con 0x7f346c103660 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.012+0000 7f3468ff9640 1 -- 172.21.15.12:0/2907304641 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f346000ce60 con 0x7f346c103660 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.012+0000 7f3471e78640 1 -- 172.21.15.12:0/2907304641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346c19d690 con 0x7f346c103660 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.012+0000 7f3468ff9640 1 -- 172.21.15.12:0/2907304641 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460010690 con 0x7f346c103660 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.012+0000 7f3471e78640 1 -- 172.21.15.12:0/2907304641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f346c1a4f70 con 0x7f346c103660 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.013+0000 7f3471e78640 1 -- 172.21.15.12:0/2907304641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346c103120 con 0x7f346c103660 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.014+0000 7f3468ff9640 1 -- 172.21.15.12:0/2907304641 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f34600046c0 con 0x7f346c103660 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.015+0000 7f3468ff9640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34540a3430 0x7f34540a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:15.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.015+0000 7f346b7fe640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34540a3430 0x7f34540a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:15.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.015+0000 7f3468ff9640 1 -- 172.21.15.12:0/2907304641 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f34600d00b0 con 0x7f346c103660 2024-09-19T06:53:15.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.016+0000 7f346b7fe640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34540a3430 0x7f34540a58f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f345c009fc0 tx=0x7f345c005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:15.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.019+0000 7f3468ff9640 1 -- 172.21.15.12:0/2907304641 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f346009c990 con 0x7f346c103660 2024-09-19T06:53:15.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.235+0000 7f3471e78640 1 -- 172.21.15.12:0/2907304641 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f346c02d7c0 con 0x7f346c103660 2024-09-19T06:53:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.236+0000 7f3468ff9640 1 -- 172.21.15.12:0/2907304641 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11979 (secure 0 0 0) 0x7f346009c290 con 0x7f346c103660 2024-09-19T06:53:15.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:53:15.237 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"btime":"2024-09-19T06:53:15:066450+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:53:14.418167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:53:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2024-09-19T06:53:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 -- 172.21.15.12:0/2907304641 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34540a3430 msgr2=0x7f34540a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34540a3430 0x7f34540a58f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f345c009fc0 tx=0x7f345c005f90 comp rx=0 tx=0).stop 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 -- 172.21.15.12:0/2907304641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c103660 msgr2=0x7f346c198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c103660 0x7f346c198930 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f346000e9f0 tx=0x7f346000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 -- 172.21.15.12:0/2907304641 shutdown_connections 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f34540a3430 0x7f34540a58f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f346c10c170 0x7f346c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c103660 0x7f346c198930 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 --2- 172.21.15.12:0/2907304641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f346c102d40 0x7f346c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 -- 172.21.15.12:0/2907304641 >> 172.21.15.12:0/2907304641 conn(0x7f346c0fc7a0 msgr2=0x7f346c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 -- 172.21.15.12:0/2907304641 shutdown_connections 2024-09-19T06:53:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:15.238+0000 7f3471e78640 1 -- 172.21.15.12:0/2907304641 wait complete. 2024-09-19T06:53:15.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:53:15.842 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:53:16.151 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:16 smithi173 ceph-mon[35349]: pgmap v410: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 2.7 MiB/s wr, 222 op/s 2024-09-19T06:53:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:16 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:53:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:16 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2907304641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.346+0000 7f40b9465640 1 -- 172.21.15.12:0/3504354810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40b4101250 msgr2=0x7f40b4107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.346+0000 7f40b9465640 1 --2- 172.21.15.12:0/3504354810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40b4101250 0x7f40b4107990 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f409c009900 tx=0x7f409c02a410 comp rx=0 tx=0).stop 2024-09-19T06:53:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.346+0000 7f40b9465640 1 -- 172.21.15.12:0/3504354810 shutdown_connections 2024-09-19T06:53:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.346+0000 7f40b9465640 1 --2- 172.21.15.12:0/3504354810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40b41080f0 0x7f40b410e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.346+0000 7f40b9465640 1 --2- 172.21.15.12:0/3504354810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40b4101250 0x7f40b4107990 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.346+0000 7f40b9465640 1 --2- 172.21.15.12:0/3504354810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40b41008a0 0x7f40b4100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.346+0000 7f40b9465640 1 -- 172.21.15.12:0/3504354810 >> 172.21.15.12:0/3504354810 conn(0x7f40b4075e20 msgr2=0x7f40b4076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.346+0000 7f40b9465640 1 -- 172.21.15.12:0/3504354810 shutdown_connections 2024-09-19T06:53:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.346+0000 7f40b9465640 1 -- 172.21.15.12:0/3504354810 wait complete. 2024-09-19T06:53:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b9465640 1 Processor -- start 2024-09-19T06:53:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b9465640 1 -- start start 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b9465640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40b41008a0 0x7f40b4198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b9465640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40b41080f0 0x7f40b4198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b9465640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40b419cc10 0x7f40b419d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b9465640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40b4111f00 con 0x7f40b41008a0 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b9465640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40b4111d80 con 0x7f40b41080f0 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b9465640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40b4112080 con 0x7f40b419cc10 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40b41008a0 0x7f40b4198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40b41008a0 0x7f40b4198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44510/0 (socket says 172.21.15.12:44510) 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b2ffd640 1 -- 172.21.15.12:0/2638184919 learned_addr learned my addr 172.21.15.12:0/2638184919 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b37fe640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40b419cc10 0x7f40b419d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b27fc640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40b41080f0 0x7f40b4198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b2ffd640 1 -- 172.21.15.12:0/2638184919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40b419cc10 msgr2=0x7f40b419d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40b419cc10 0x7f40b419d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b2ffd640 1 -- 172.21.15.12:0/2638184919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40b41080f0 msgr2=0x7f40b4198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40b41080f0 0x7f40b4198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.347+0000 7f40b2ffd640 1 -- 172.21.15.12:0/2638184919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b419d700 con 0x7f40b41008a0 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.348+0000 7f40b37fe640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40b419cc10 0x7f40b419d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.348+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40b41008a0 0x7f40b4198350 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f40a400e9f0 tx=0x7f40a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.348+0000 7f40abfff640 1 -- 172.21.15.12:0/2638184919 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a400cd80 con 0x7f40b41008a0 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.348+0000 7f40b9465640 1 -- 172.21.15.12:0/2638184919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b419d9f0 con 0x7f40b41008a0 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.348+0000 7f40abfff640 1 -- 172.21.15.12:0/2638184919 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40a4010910 con 0x7f40b41008a0 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.348+0000 7f40abfff640 1 -- 172.21.15.12:0/2638184919 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a40188f0 con 0x7f40b41008a0 2024-09-19T06:53:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.348+0000 7f40b9465640 1 -- 172.21.15.12:0/2638184919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b41a51d0 con 0x7f40b41008a0 2024-09-19T06:53:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.350+0000 7f40abfff640 1 -- 172.21.15.12:0/2638184919 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f40a4010ac0 con 0x7f40b41008a0 2024-09-19T06:53:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40bc206740 1 Processor -- start 2024-09-19T06:53:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40bc206740 1 -- start start 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40bc206740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee2956ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40bc206740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 0x564ee2961770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40bc206740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee29640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40abfff640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40a00a3460 0x7f40a00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40bc206740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564ee28bb2f0 con 0x564ee2961cb0 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40bc206740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564ee2863270 con 0x564ee2957410 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40bc206740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564ee28b72b0 con 0x564ee2956af0 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40b27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee29640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40b37fe640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40a00a3460 0x7f40a00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40b27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee29640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44518/0 (socket says 172.21.15.12:44518) 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40b27fc640 1 -- 172.21.15.12:0/1096045810 learned_addr learned my addr 172.21.15.12:0/1096045810 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40abfff640 1 -- 172.21.15.12:0/2638184919 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f40a40d0330 con 0x7f40b41008a0 2024-09-19T06:53:16.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/1096045810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 0x564ee2961770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.351+0000 7f40b37fe640 1 --2- 172.21.15.12:0/1096045810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee2956ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40b27fc640 1 -- 172.21.15.12:0/1096045810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 msgr2=0x564ee2956ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40b27fc640 1 --2- 172.21.15.12:0/1096045810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee2956ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40b27fc640 1 -- 172.21.15.12:0/1096045810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 msgr2=0x564ee2961770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40b27fc640 1 --2- 172.21.15.12:0/1096045810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 0x564ee2961770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40b27fc640 1 -- 172.21.15.12:0/1096045810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee2862340 con 0x564ee2961cb0 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/1096045810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 0x564ee2961770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40b37fe640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40a00a3460 0x7f40a00a5920 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f40ac005c40 tx=0x7f40ac012a50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40b27fc640 1 --2- 172.21.15.12:0/1096045810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee29640a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f409c006010 tx=0x7f409c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82dc06a1eb00e0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40a97fa640 1 -- 172.21.15.12:0/1096045810 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c03f070 con 0x564ee2961cb0 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40a97fa640 1 -- 172.21.15.12:0/1096045810 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f409c004030 con 0x564ee2961cb0 2024-09-19T06:53:16.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.352+0000 7f40a97fa640 1 -- 172.21.15.12:0/1096045810 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c035070 con 0x564ee2961cb0 2024-09-19T06:53:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 -- 172.21.15.12:0/1096045810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 msgr2=0x564ee29640a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 --2- 172.21.15.12:0/1096045810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee29640a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f409c006010 tx=0x7f409c005dd0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 -- 172.21.15.12:0/1096045810 shutdown_connections 2024-09-19T06:53:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 --2- 172.21.15.12:0/1096045810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee29640a0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 --2- 172.21.15.12:0/1096045810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 0x564ee2961770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 --2- 172.21.15.12:0/1096045810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee2956ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 -- 172.21.15.12:0/1096045810 >> 172.21.15.12:0/1096045810 conn(0x564ee2953060 msgr2=0x564ee2953440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 -- 172.21.15.12:0/1096045810 shutdown_connections 2024-09-19T06:53:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 -- 172.21.15.12:0/1096045810 wait complete. 2024-09-19T06:53:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 -- start start 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 Processor -- start 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee295eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 0x564ee295f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee295f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564ee2964880 con 0x564ee2961cb0 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564ee2844290 con 0x564ee2957410 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.353+0000 7f40bc206740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564ee2964a00 con 0x564ee2956af0 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40bc206740 10 client.0 _ll_register_callbacks cb 0x564ee2875140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee295f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee295f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44532/0 (socket says 172.21.15.12:44532) 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b37fe640 1 -- 172.21.15.12:0/1251332256 learned_addr learned my addr 172.21.15.12:0/1251332256 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee295eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b27fc640 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 0x564ee295f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b37fe640 1 -- 172.21.15.12:0/1251332256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 msgr2=0x564ee295eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b37fe640 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee295eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b37fe640 1 -- 172.21.15.12:0/1251332256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 msgr2=0x564ee295f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b37fe640 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 0x564ee295f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b37fe640 1 -- 172.21.15.12:0/1251332256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee25ce210 con 0x564ee2961cb0 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b27fc640 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 0x564ee295f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40b37fe640 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee295f5c0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f40ac010a70 tx=0x7f40ac005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d5f172e2676141 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f409a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f409a7fc640 1 -- 172.21.15.12:0/1251332256 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac023030 con 0x564ee2961cb0 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f409a7fc640 1 -- 172.21.15.12:0/1251332256 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f40ac01cc30 con 0x564ee2961cb0 2024-09-19T06:53:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40bc206740 1 -- 172.21.15.12:0/1251332256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f409c004030 con 0x564ee2961cb0 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f409a7fc640 1 -- 172.21.15.12:0/1251332256 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f40ac01ce30 con 0x564ee2961cb0 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40bc206740 10 client.19026 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.354+0000 7f40bc206740 1 -- 172.21.15.12:0/1251332256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x564ee269a620 con 0x564ee2961cb0 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.355+0000 7f409a7fc640 1 -- 172.21.15.12:0/1251332256 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f409c004030 con 0x564ee2961cb0 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.355+0000 7f409a7fc640 1 -- 172.21.15.12:0/1251332256 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f40ac02f630 con 0x564ee2961cb0 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.355+0000 7f40bc206740 10 client.19026 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.355+0000 7f40bc206740 10 client.19026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.355+0000 7f40bc206740 20 client.19026 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.355+0000 7f40bc206740 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ee2971bf0 0x564ee2974060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.355+0000 7f40bc206740 4 client.19026 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.355+0000 7f40bc206740 1 -- 172.21.15.12:0/1251332256 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ee28c8a20 con 0x564ee2971bf0 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.355+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ee2971bf0 0x564ee2974060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ee2971bf0 0x564ee2974060 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c1d321ab115c24d server_cookie=e92aff816730e13e in_seq=0 out_seq=0 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f409a7fc640 10 client.19026 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f409a7fc640 1 -- 172.21.15.12:0/1251332256 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ee28c8a20 con 0x564ee2971bf0 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f409a7fc640 10 client.19026 handle_command_reply: tid=0 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f40bc206740 1 client.19026 shutdown 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f40bc206740 1 -- 172.21.15.12:0/1251332256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 msgr2=0x564ee295f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f40bc206740 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee295f5c0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f40ac010a70 tx=0x7f40ac005bd0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f40bc206740 1 -- 172.21.15.12:0/1251332256 shutdown_connections 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f40bc206740 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ee2971bf0 0x564ee2974060 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f40bc206740 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2961cb0 0x564ee295f5c0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f40bc206740 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2957410 0x564ee295f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f409a7fc640 0 client.19026 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f40bc206740 1 --2- 172.21.15.12:0/1251332256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee295eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.356+0000 7f40bc206740 1 -- 172.21.15.12:0/1251332256 >> 172.21.15.12:0/1251332256 conn(0x564ee2953060 msgr2=0x564ee2958d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.357+0000 7f40bc206740 1 -- 172.21.15.12:0/1251332256 shutdown_connections 2024-09-19T06:53:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.357+0000 7f40bc206740 1 -- 172.21.15.12:0/1251332256 wait complete. 2024-09-19T06:53:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.357+0000 7f40bc206740 20 client.19026 trim_cache size 0 max 16384 2024-09-19T06:53:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.371+0000 7f40bc206740 1 Processor -- start 2024-09-19T06:53:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.371+0000 7f40bc206740 1 -- start start 2024-09-19T06:53:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40bc206740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2956af0 0x564ee295f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40bc206740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee29799c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40bc206740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2961cb0 0x564ee2979f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40bc206740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40b41adaa0 con 0x564ee2957410 2024-09-19T06:53:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40bc206740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40b41af6d0 con 0x564ee2956af0 2024-09-19T06:53:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40bc206740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40b41ae170 con 0x564ee2961cb0 2024-09-19T06:53:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee29799c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee29799c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44540/0 (socket says 172.21.15.12:44540) 2024-09-19T06:53:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b27fc640 1 -- 172.21.15.12:0/3554334535 learned_addr learned my addr 172.21.15.12:0/3554334535 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/3554334535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2956af0 0x564ee295f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b37fe640 1 --2- 172.21.15.12:0/3554334535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2961cb0 0x564ee2979f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b27fc640 1 -- 172.21.15.12:0/3554334535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2961cb0 msgr2=0x564ee2979f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b27fc640 1 --2- 172.21.15.12:0/3554334535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2961cb0 0x564ee2979f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b27fc640 1 -- 172.21.15.12:0/3554334535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2956af0 msgr2=0x564ee295f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b27fc640 1 --2- 172.21.15.12:0/3554334535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2956af0 0x564ee295f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b27fc640 1 -- 172.21.15.12:0/3554334535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee2952e90 con 0x564ee2957410 2024-09-19T06:53:16.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b37fe640 1 --2- 172.21.15.12:0/3554334535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2961cb0 0x564ee2979f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:16.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40b27fc640 1 --2- 172.21.15.12:0/3554334535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee29799c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x564ee2959690 tx=0x7f409c032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca815704b8edd502 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40a8ff9640 1 -- 172.21.15.12:0/3554334535 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c03f070 con 0x564ee2957410 2024-09-19T06:53:16.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.372+0000 7f40a8ff9640 1 -- 172.21.15.12:0/3554334535 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f409c0317b0 con 0x564ee2957410 2024-09-19T06:53:16.376 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.373+0000 7f40a8ff9640 1 -- 172.21.15.12:0/3554334535 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c035040 con 0x564ee2957410 2024-09-19T06:53:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.373+0000 7f40bc206740 1 -- 172.21.15.12:0/3554334535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 msgr2=0x564ee29799c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.373+0000 7f40bc206740 1 --2- 172.21.15.12:0/3554334535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee29799c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x564ee2959690 tx=0x7f409c032d30 comp rx=0 tx=0).stop 2024-09-19T06:53:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.373+0000 7f40bc206740 1 -- 172.21.15.12:0/3554334535 shutdown_connections 2024-09-19T06:53:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.373+0000 7f40bc206740 1 --2- 172.21.15.12:0/3554334535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2961cb0 0x564ee2979f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.373+0000 7f40bc206740 1 --2- 172.21.15.12:0/3554334535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee29799c0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.373+0000 7f40bc206740 1 --2- 172.21.15.12:0/3554334535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2956af0 0x564ee295f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.373+0000 7f40bc206740 1 -- 172.21.15.12:0/3554334535 >> 172.21.15.12:0/3554334535 conn(0x564ee2953060 msgr2=0x564ee2960bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.373+0000 7f40bc206740 1 -- 172.21.15.12:0/3554334535 shutdown_connections 2024-09-19T06:53:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.373+0000 7f40bc206740 1 -- 172.21.15.12:0/3554334535 wait complete. 2024-09-19T06:53:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40bc206740 1 -- start start 2024-09-19T06:53:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40bc206740 1 Processor -- start 2024-09-19T06:53:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40bc206740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee296a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40bc206740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee295b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40bc206740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2961cb0 0x564ee295bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40bc206740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40b41af000 con 0x564ee2957410 2024-09-19T06:53:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40bc206740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40b41ae870 con 0x564ee2961cb0 2024-09-19T06:53:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40bc206740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40b41abaa0 con 0x564ee2956af0 2024-09-19T06:53:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40bc206740 10 client.0 _ll_register_callbacks cb 0x7f40ac0097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40b27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee295b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40b27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee295b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44556/0 (socket says 172.21.15.12:44556) 2024-09-19T06:53:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40b27fc640 1 -- 172.21.15.12:0/2520133861 learned_addr learned my addr 172.21.15.12:0/2520133861 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40b37fe640 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2961cb0 0x564ee295bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee296a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40b27fc640 1 -- 172.21.15.12:0/2520133861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 msgr2=0x564ee296a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40b27fc640 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee296a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40b27fc640 1 -- 172.21.15.12:0/2520133861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2961cb0 msgr2=0x564ee295bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40b27fc640 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2961cb0 0x564ee295bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.374+0000 7f40b27fc640 1 -- 172.21.15.12:0/2520133861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee295c340 con 0x564ee2957410 2024-09-19T06:53:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f40b27fc640 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee295b740 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f409c031550 tx=0x7f409c0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ba39a23b5539b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f409a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f409a7fc640 1 -- 172.21.15.12:0/2520133861 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c03f070 con 0x564ee2957410 2024-09-19T06:53:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f409a7fc640 1 -- 172.21.15.12:0/2520133861 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f409c03b870 con 0x564ee2957410 2024-09-19T06:53:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f40bc206740 1 -- 172.21.15.12:0/2520133861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f409c0317b0 con 0x564ee2957410 2024-09-19T06:53:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f409a7fc640 1 -- 172.21.15.12:0/2520133861 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f409c035040 con 0x564ee2957410 2024-09-19T06:53:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f40bc206740 10 client.19032 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f40bc206740 1 -- 172.21.15.12:0/2520133861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x564ee29dc800 con 0x564ee2957410 2024-09-19T06:53:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f409a7fc640 1 -- 172.21.15.12:0/2520133861 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f409c0317b0 con 0x564ee2957410 2024-09-19T06:53:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f409a7fc640 1 -- 172.21.15.12:0/2520133861 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f409c004140 con 0x564ee2957410 2024-09-19T06:53:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f40bc206740 10 client.19032 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f40bc206740 10 client.19032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f40bc206740 20 client.19032 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f40bc206740 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ee29dcad0 0x564ee29deec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f40bc206740 4 client.19032 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:53:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.375+0000 7f40bc206740 1 -- 172.21.15.12:0/2520133861 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ee28c2d70 con 0x564ee29dcad0 2024-09-19T06:53:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.376+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ee29dcad0 0x564ee29deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.376+0000 7f409a7fc640 10 client.19032 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.376+0000 7f40b2ffd640 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ee29dcad0 0x564ee29deec0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6d6ffe0ff19767d server_cookie=c2d12365d5948429 in_seq=0 out_seq=0 2024-09-19T06:53:16.385 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:16 smithi012 ceph-mon[30937]: pgmap v410: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 2.7 MiB/s wr, 222 op/s 2024-09-19T06:53:16.385 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:16 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:53:16.385 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:16 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2907304641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.392+0000 7f409a7fc640 1 -- 172.21.15.12:0/2520133861 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ee28c2d70 con 0x564ee29dcad0 2024-09-19T06:53:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.392+0000 7f409a7fc640 10 client.19032 handle_command_reply: tid=0 2024-09-19T06:53:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 client.19032 shutdown 2024-09-19T06:53:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 -- 172.21.15.12:0/2520133861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 msgr2=0x564ee295b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee295b740 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f409c031550 tx=0x7f409c0095f0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 -- 172.21.15.12:0/2520133861 shutdown_connections 2024-09-19T06:53:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564ee29dcad0 0x564ee29deec0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564ee2961cb0 0x564ee295bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564ee2957410 0x564ee295b740 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 --2- 172.21.15.12:0/2520133861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564ee2956af0 0x564ee296a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 -- 172.21.15.12:0/2520133861 >> 172.21.15.12:0/2520133861 conn(0x564ee2953060 msgr2=0x564ee2960bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f409a7fc640 0 client.19032 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 -- 172.21.15.12:0/2520133861 shutdown_connections 2024-09-19T06:53:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.393+0000 7f40bc206740 1 -- 172.21.15.12:0/2520133861 wait complete. 2024-09-19T06:53:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40bc206740 20 client.19032 trim_cache size 0 max 16384 2024-09-19T06:53:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:53:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:53:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:53:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:53:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 -- 172.21.15.12:0/2638184919 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40a00a3460 msgr2=0x7f40a00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40a00a3460 0x7f40a00a5920 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f40ac005c40 tx=0x7f40ac012a50 comp rx=0 tx=0).stop 2024-09-19T06:53:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 -- 172.21.15.12:0/2638184919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40b41008a0 msgr2=0x7f40b4198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40b41008a0 0x7f40b4198350 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f40a400e9f0 tx=0x7f40a400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 -- 172.21.15.12:0/2638184919 shutdown_connections 2024-09-19T06:53:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40a00a3460 0x7f40a00a5920 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40b419cc10 0x7f40b419d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40b41080f0 0x7f40b4198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 --2- 172.21.15.12:0/2638184919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40b41008a0 0x7f40b4198350 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 -- 172.21.15.12:0/2638184919 >> 172.21.15.12:0/2638184919 conn(0x7f40b4075e20 msgr2=0x7f40b40ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 -- 172.21.15.12:0/2638184919 shutdown_connections 2024-09-19T06:53:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:16.394+0000 7f40b9465640 1 -- 172.21.15.12:0/2638184919 wait complete. 2024-09-19T06:53:16.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:16 smithi016 ceph-mon[34911]: pgmap v410: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 2.7 MiB/s wr, 222 op/s 2024-09-19T06:53:16.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:16 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:53:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:16 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2907304641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.619+0000 7fcc11cf0640 1 -- 172.21.15.12:0/1599422839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0c102ef0 msgr2=0x7fcc0c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.619+0000 7fcc11cf0640 1 --2- 172.21.15.12:0/1599422839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0c102ef0 0x7fcc0c10da40 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009ca0 tx=0x7fcc0402a950 comp rx=0 tx=0).stop 2024-09-19T06:53:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.619+0000 7fcc11cf0640 1 -- 172.21.15.12:0/1599422839 shutdown_connections 2024-09-19T06:53:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.619+0000 7fcc11cf0640 1 --2- 172.21.15.12:0/1599422839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0c102ef0 0x7fcc0c10da40 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.619+0000 7fcc11cf0640 1 --2- 172.21.15.12:0/1599422839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc0c102570 0x7fcc0c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.619+0000 7fcc11cf0640 1 --2- 172.21.15.12:0/1599422839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc0c100e20 0x7fcc0c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.619+0000 7fcc11cf0640 1 -- 172.21.15.12:0/1599422839 >> 172.21.15.12:0/1599422839 conn(0x7fcc0c0fc7d0 msgr2=0x7fcc0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.619+0000 7fcc11cf0640 1 -- 172.21.15.12:0/1599422839 shutdown_connections 2024-09-19T06:53:16.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.619+0000 7fcc11cf0640 1 -- 172.21.15.12:0/1599422839 wait complete. 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc11cf0640 1 Processor -- start 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc11cf0640 1 -- start start 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc11cf0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0c100e20 0x7fcc0c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc11cf0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc0c102570 0x7fcc0c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc11cf0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc0c102ef0 0x7fcc0c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc11cf0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c110f80 con 0x7fcc0c100e20 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc11cf0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c110e00 con 0x7fcc0c102ef0 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc11cf0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c111100 con 0x7fcc0c102570 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0c100e20 0x7fcc0c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0c100e20 0x7fcc0c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44568/0 (socket says 172.21.15.12:44568) 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/2839884422 learned_addr learned my addr 172.21.15.12:0/2839884422 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:16.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc02ffd640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc0c102570 0x7fcc0c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.620+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc0c102ef0 0x7fcc0c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/2839884422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc0c102570 msgr2=0x7fcc0c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc0c102570 0x7fcc0c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/2839884422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc0c102ef0 msgr2=0x7fcc0c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc0c102ef0 0x7fcc0c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/2839884422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0c1a69c0 con 0x7fcc0c100e20 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc0c102ef0 0x7fcc0c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0c100e20 0x7fcc0c0fcc80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00d950 tx=0x7fcbfc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc097fa640 1 -- 172.21.15.12:0/2839884422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc017030 con 0x7fcc0c100e20 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc097fa640 1 -- 172.21.15.12:0/2839884422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbfc004020 con 0x7fcc0c100e20 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc097fa640 1 -- 172.21.15.12:0/2839884422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0047a0 con 0x7fcc0c100e20 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc11cf0640 1 -- 172.21.15.12:0/2839884422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0c1a6cb0 con 0x7fcc0c100e20 2024-09-19T06:53:16.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.621+0000 7fcc11cf0640 1 -- 172.21.15.12:0/2839884422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc0c1a71a0 con 0x7fcc0c100e20 2024-09-19T06:53:16.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc097fa640 1 -- 172.21.15.12:0/2839884422 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcbfc0041d0 con 0x7fcc0c100e20 2024-09-19T06:53:16.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc140c9740 1 Processor -- start 2024-09-19T06:53:16.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc140c9740 1 -- start start 2024-09-19T06:53:16.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d0234b40 0x5640d0233090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d0233a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 0x5640d0240760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc140c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5640d01992f0 con 0x5640d02335d0 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc140c9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5640d0140cf0 con 0x5640d0234b40 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc140c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5640d01952b0 con 0x5640d023e370 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d0233a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d0233a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44570/0 (socket says 172.21.15.12:44570) 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.624+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/4075155168 learned_addr learned my addr 172.21.15.12:0/4075155168 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc02ffd640 1 --2- 172.21.15.12:0/4075155168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 0x5640d0240760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/4075155168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d0234b40 0x5640d0233090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/4075155168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 msgr2=0x5640d0240760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/4075155168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 0x5640d0240760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/4075155168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d0234b40 msgr2=0x5640d0233090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/4075155168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d0234b40 0x5640d0233090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/4075155168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d01253a0 con 0x5640d02335d0 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc02ffd640 1 --2- 172.21.15.12:0/4075155168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 0x5640d0240760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc097fa640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbf80a3430 0x7fcbf80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/4075155168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d0233a10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0ccd40 tx=0x7fcbfc0d5f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44aa21d2e8a6918 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbf80a3430 0x7fcbf80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc097fa640 1 -- 172.21.15.12:0/2839884422 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fcbfc0cf720 con 0x7fcc0c100e20 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc01ffb640 1 -- 172.21.15.12:0/4075155168 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc097c00 con 0x5640d02335d0 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc01ffb640 1 -- 172.21.15.12:0/4075155168 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbfc09c060 con 0x5640d02335d0 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.625+0000 7fcc01ffb640 1 -- 172.21.15.12:0/4075155168 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc09b2c0 con 0x5640d02335d0 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.626+0000 7fcc140c9740 1 -- 172.21.15.12:0/4075155168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 msgr2=0x5640d0233a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.626+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbf80a3430 0x7fcbf80a58f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcc04005cc0 tx=0x7fcc04005c50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.626+0000 7fcc140c9740 1 --2- 172.21.15.12:0/4075155168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d0233a10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0ccd40 tx=0x7fcbfc0d5f10 comp rx=0 tx=0).stop 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.626+0000 7fcc140c9740 1 -- 172.21.15.12:0/4075155168 shutdown_connections 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.626+0000 7fcc140c9740 1 --2- 172.21.15.12:0/4075155168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 0x5640d0240760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.626+0000 7fcc140c9740 1 --2- 172.21.15.12:0/4075155168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d0233a10 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.626+0000 7fcc140c9740 1 --2- 172.21.15.12:0/4075155168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d0234b40 0x5640d0233090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.626+0000 7fcc140c9740 1 -- 172.21.15.12:0/4075155168 >> 172.21.15.12:0/4075155168 conn(0x5640d01fc310 msgr2=0x5640d022fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.626+0000 7fcc140c9740 1 -- 172.21.15.12:0/4075155168 shutdown_connections 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.626+0000 7fcc140c9740 1 -- 172.21.15.12:0/4075155168 wait complete. 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc140c9740 1 -- start start 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc140c9740 1 Processor -- start 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d023dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d0234b40 0x5640d023af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 0x5640d023b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc140c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5640d0241010 con 0x5640d02335d0 2024-09-19T06:53:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc140c9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5640d0154060 con 0x5640d0234b40 2024-09-19T06:53:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc140c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5640d0241190 con 0x5640d023e370 2024-09-19T06:53:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc140c9740 10 client.0 _ll_register_callbacks cb 0x5640cfea78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d023dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d023dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44586/0 (socket says 172.21.15.12:44586) 2024-09-19T06:53:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/3627042923 learned_addr learned my addr 172.21.15.12:0/3627042923 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.627+0000 7fcc02ffd640 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d0234b40 0x5640d023af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 0x5640d023b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/3627042923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 msgr2=0x5640d023b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 0x5640d023b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/3627042923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d0234b40 msgr2=0x5640d023af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d0234b40 0x5640d023af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/3627042923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640cff0a3c0 con 0x5640d02335d0 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 0x5640d023b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d023dce0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0cd3d0 tx=0x7fcbfc0d5320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51de387a615e93b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcbeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcbeaffd640 1 -- 172.21.15.12:0/3627042923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc09b4a0 con 0x5640d02335d0 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcbeaffd640 1 -- 172.21.15.12:0/3627042923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fcbfc0860c0 con 0x5640d02335d0 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc140c9740 1 -- 172.21.15.12:0/3627042923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbfc09c060 con 0x5640d02335d0 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcbeaffd640 1 -- 172.21.15.12:0/3627042923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fcbfc09b730 con 0x5640d02335d0 2024-09-19T06:53:16.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc140c9740 10 client.19044 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:16.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcc140c9740 1 -- 172.21.15.12:0/3627042923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5640d0241010 con 0x5640d02335d0 2024-09-19T06:53:16.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.628+0000 7fcbeaffd640 1 -- 172.21.15.12:0/3627042923 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbfc09c060 con 0x5640d02335d0 2024-09-19T06:53:16.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.629+0000 7fcbeaffd640 1 -- 172.21.15.12:0/3627042923 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7fcbfc097fd0 con 0x5640d02335d0 2024-09-19T06:53:16.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.629+0000 7fcc140c9740 10 client.19044 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:16.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.629+0000 7fcc140c9740 10 client.19044 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:53:16.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.629+0000 7fcc140c9740 20 client.19044 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:16.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.629+0000 7fcc140c9740 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5640d024dc00 0x5640d024fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.629+0000 7fcc140c9740 4 client.19044 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:16.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.629+0000 7fcc140c9740 1 -- 172.21.15.12:0/3627042923 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640d01a6860 con 0x5640d024dc00 2024-09-19T06:53:16.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.629+0000 7fcc02ffd640 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5640d024dc00 0x5640d024fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.629+0000 7fcc02ffd640 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5640d024dc00 0x5640d024fff0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d4d901869285af32 server_cookie=ee523513f4f05a60 in_seq=0 out_seq=0 2024-09-19T06:53:16.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.629+0000 7fcbeaffd640 10 client.19044 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:53:16.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcbeaffd640 1 -- 172.21.15.12:0/3627042923 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640d01a6860 con 0x5640d024dc00 2024-09-19T06:53:16.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcbeaffd640 10 client.19044 handle_command_reply: tid=0 2024-09-19T06:53:16.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 client.19044 shutdown 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 -- 172.21.15.12:0/3627042923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 msgr2=0x5640d023dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d023dce0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0cd3d0 tx=0x7fcbfc0d5320 comp rx=0 tx=0).stop 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 -- 172.21.15.12:0/3627042923 shutdown_connections 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5640d024dc00 0x5640d024fff0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d023e370 0x5640d023b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d0234b40 0x5640d023af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 --2- 172.21.15.12:0/3627042923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d023dce0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 -- 172.21.15.12:0/3627042923 >> 172.21.15.12:0/3627042923 conn(0x5640d01fc310 msgr2=0x5640d0235930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcbeaffd640 0 client.19044 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 -- 172.21.15.12:0/3627042923 shutdown_connections 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.630+0000 7fcc140c9740 1 -- 172.21.15.12:0/3627042923 wait complete. 2024-09-19T06:53:16.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.631+0000 7fcc140c9740 20 client.19044 trim_cache size 0 max 16384 2024-09-19T06:53:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc140c9740 1 Processor -- start 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc140c9740 1 -- start start 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d024a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d0234b40 0x5640d022fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d023e370 0x5640d023cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc140c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c1afea0 con 0x5640d02335d0 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc140c9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c1b1ad0 con 0x5640d023e370 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc140c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c1b0570 con 0x5640d0234b40 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d024a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc0b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d024a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44588/0 (socket says 172.21.15.12:44588) 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/4016128536 learned_addr learned my addr 172.21.15.12:0/4016128536 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc02ffd640 1 --2- 172.21.15.12:0/4016128536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d0234b40 0x5640d022fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/4016128536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d023e370 0x5640d023cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/4016128536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d0234b40 msgr2=0x5640d022fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/4016128536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d0234b40 0x5640d022fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/4016128536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d023e370 msgr2=0x5640d023cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/4016128536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d023e370 0x5640d023cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc0b7fe640 1 -- 172.21.15.12:0/4016128536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d023d900 con 0x5640d02335d0 2024-09-19T06:53:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.644+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/4016128536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d024a310 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009610 tx=0x7fcbfc099e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa198246b90c778c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc017fa640 1 -- 172.21.15.12:0/4016128536 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc09b4a0 con 0x5640d02335d0 2024-09-19T06:53:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc017fa640 1 -- 172.21.15.12:0/4016128536 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbfc09c060 con 0x5640d02335d0 2024-09-19T06:53:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc017fa640 1 -- 172.21.15.12:0/4016128536 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc097c00 con 0x5640d02335d0 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc140c9740 1 -- 172.21.15.12:0/4016128536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 msgr2=0x5640d024a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc140c9740 1 --2- 172.21.15.12:0/4016128536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d024a310 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009610 tx=0x7fcbfc099e70 comp rx=0 tx=0).stop 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc140c9740 1 -- 172.21.15.12:0/4016128536 shutdown_connections 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc140c9740 1 --2- 172.21.15.12:0/4016128536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d023e370 0x5640d023cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc140c9740 1 --2- 172.21.15.12:0/4016128536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d0234b40 0x5640d022fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc140c9740 1 --2- 172.21.15.12:0/4016128536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d02335d0 0x5640d024a310 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc140c9740 1 -- 172.21.15.12:0/4016128536 >> 172.21.15.12:0/4016128536 conn(0x5640d01fc310 msgr2=0x5640d023c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc140c9740 1 -- 172.21.15.12:0/4016128536 shutdown_connections 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.645+0000 7fcc140c9740 1 -- 172.21.15.12:0/4016128536 wait complete. 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc140c9740 1 -- start start 2024-09-19T06:53:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc140c9740 1 Processor -- start 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d02335d0 0x5640d02466f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d0234b40 0x5640d0246c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc140c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d023e370 0x5640d0237860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc140c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c1b1400 con 0x5640d023e370 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc140c9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c1b0c70 con 0x5640d02335d0 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc140c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0c1adea0 con 0x5640d0234b40 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc0bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d023e370 0x5640d0237860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc0bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d023e370 0x5640d0237860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44602/0 (socket says 172.21.15.12:44602) 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc0bfff640 1 -- 172.21.15.12:0/2823626859 learned_addr learned my addr 172.21.15.12:0/2823626859 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.646+0000 7fcc140c9740 10 client.0 _ll_register_callbacks cb 0x7fcbfc0d5900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc02ffd640 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d0234b40 0x5640d0246c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d02335d0 0x5640d02466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc0bfff640 1 -- 172.21.15.12:0/2823626859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d0234b40 msgr2=0x5640d0246c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d0234b40 0x5640d0246c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc0bfff640 1 -- 172.21.15.12:0/2823626859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d02335d0 msgr2=0x5640d02466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d02335d0 0x5640d02466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc0bfff640 1 -- 172.21.15.12:0/2823626859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640d0238090 con 0x5640d023e370 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc0bfff640 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d023e370 0x5640d0237860 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009ca0 tx=0x7fcc0402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bfaa187d746bca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcbeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcbeaffd640 1 -- 172.21.15.12:0/2823626859 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04034040 con 0x5640d023e370 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcbeaffd640 1 -- 172.21.15.12:0/2823626859 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fcc04041030 con 0x5640d023e370 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc140c9740 1 -- 172.21.15.12:0/2823626859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbfc09c060 con 0x5640d023e370 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcbeaffd640 1 -- 172.21.15.12:0/2823626859 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fcc04004040 con 0x5640d023e370 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc140c9740 10 client.19050 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.647+0000 7fcc140c9740 1 -- 172.21.15.12:0/2823626859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5640d02b8270 con 0x5640d023e370 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcbeaffd640 1 -- 172.21.15.12:0/2823626859 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbfc09c060 con 0x5640d023e370 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcbeaffd640 1 -- 172.21.15.12:0/2823626859 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7fcc040309a0 con 0x5640d023e370 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcc140c9740 10 client.19050 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcc140c9740 10 client.19050 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcc140c9740 20 client.19050 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcc140c9740 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5640d02b8a40 0x5640d02bae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcc140c9740 4 client.19050 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcc140c9740 1 -- 172.21.15.12:0/2823626859 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5640d0250520 con 0x5640d02b8a40 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5640d02b8a40 0x5640d02bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcc0b7fe640 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5640d02b8a40 0x5640d02bae60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f5deeb9ca504ff13 server_cookie=78aa47c903f65f1e in_seq=0 out_seq=0 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.648+0000 7fcbeaffd640 10 client.19050 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcbeaffd640 1 -- 172.21.15.12:0/2823626859 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5640d0250520 con 0x5640d02b8a40 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcbeaffd640 10 client.19050 handle_command_reply: tid=0 2024-09-19T06:53:16.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 client.19050 shutdown 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 -- 172.21.15.12:0/2823626859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d023e370 msgr2=0x5640d0237860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d023e370 0x5640d0237860 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009ca0 tx=0x7fcc0402a950 comp rx=0 tx=0).stop 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 -- 172.21.15.12:0/2823626859 shutdown_connections 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5640d02b8a40 0x5640d02bae60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640d023e370 0x5640d0237860 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640d0234b40 0x5640d0246c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 --2- 172.21.15.12:0/2823626859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640d02335d0 0x5640d02466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 -- 172.21.15.12:0/2823626859 >> 172.21.15.12:0/2823626859 conn(0x5640d01fc310 msgr2=0x5640d023d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcbeaffd640 0 client.19050 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 -- 172.21.15.12:0/2823626859 shutdown_connections 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 1 -- 172.21.15.12:0/2823626859 wait complete. 2024-09-19T06:53:16.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.649+0000 7fcc140c9740 20 client.19050 trim_cache size 0 max 16384 2024-09-19T06:53:16.656 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:53:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 -- 172.21.15.12:0/2839884422 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbf80a3430 msgr2=0x7fcbf80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbf80a3430 0x7fcbf80a58f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcc04005cc0 tx=0x7fcc04005c50 comp rx=0 tx=0).stop 2024-09-19T06:53:16.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 -- 172.21.15.12:0/2839884422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0c100e20 msgr2=0x7fcc0c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0c100e20 0x7fcc0c0fcc80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00d950 tx=0x7fcbfc00de10 comp rx=0 tx=0).stop 2024-09-19T06:53:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 -- 172.21.15.12:0/2839884422 shutdown_connections 2024-09-19T06:53:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc0c102ef0 0x7fcc0c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcbf80a3430 0x7fcbf80a58f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc0c102570 0x7fcc0c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 --2- 172.21.15.12:0/2839884422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0c100e20 0x7fcc0c0fcc80 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 -- 172.21.15.12:0/2839884422 >> 172.21.15.12:0/2839884422 conn(0x7fcc0c0fc7d0 msgr2=0x7fcc0c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 -- 172.21.15.12:0/2839884422 shutdown_connections 2024-09-19T06:53:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:16.650+0000 7fcc11cf0640 1 -- 172.21.15.12:0/2839884422 wait complete. 2024-09-19T06:53:17.728 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:53:17.991 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:18 smithi173 ceph-mon[35349]: pgmap v411: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 1.34k op/s 2024-09-19T06:53:18.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:18 smithi012 ceph-mon[30937]: pgmap v411: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 1.34k op/s 2024-09-19T06:53:18.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:18 smithi016 ceph-mon[34911]: pgmap v411: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 1.34k op/s 2024-09-19T06:53:18.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.525+0000 7f367ddc1640 1 -- 172.21.15.12:0/2525956026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3678100ca0 msgr2=0x7f3678106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.525+0000 7f367ddc1640 1 --2- 172.21.15.12:0/2525956026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3678100ca0 0x7f3678106840 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f366c009930 tx=0x7f366c02a420 comp rx=0 tx=0).stop 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.525+0000 7f367ddc1640 1 -- 172.21.15.12:0/2525956026 shutdown_connections 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.525+0000 7f367ddc1640 1 --2- 172.21.15.12:0/2525956026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3678106f50 0x7f367810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.525+0000 7f367ddc1640 1 --2- 172.21.15.12:0/2525956026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3678100ca0 0x7f3678106840 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.525+0000 7f367ddc1640 1 --2- 172.21.15.12:0/2525956026 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36781002f0 0x7f36781006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.525+0000 7f367ddc1640 1 -- 172.21.15.12:0/2525956026 >> 172.21.15.12:0/2525956026 conn(0x7f3678077210 msgr2=0x7f36780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.525+0000 7f367ddc1640 1 -- 172.21.15.12:0/2525956026 shutdown_connections 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.525+0000 7f367ddc1640 1 -- 172.21.15.12:0/2525956026 wait complete. 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.526+0000 7f367ddc1640 1 Processor -- start 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.526+0000 7f367ddc1640 1 -- start start 2024-09-19T06:53:18.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f367ddc1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36781002f0 0x7f3678198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f367ddc1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3678100ca0 0x7f3678198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f367ddc1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3678106f50 0x7f367819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f367ddc1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3678112060 con 0x7f3678100ca0 2024-09-19T06:53:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f367ddc1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3678111ee0 con 0x7f3678106f50 2024-09-19T06:53:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f367ddc1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f36781121e0 con 0x7f36781002f0 2024-09-19T06:53:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f3676ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3678100ca0 0x7f3678198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f3676ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3678100ca0 0x7f3678198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44626/0 (socket says 172.21.15.12:44626) 2024-09-19T06:53:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f3676ffd640 1 -- 172.21.15.12:0/1833509597 learned_addr learned my addr 172.21.15.12:0/1833509597 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f3677fff640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3678106f50 0x7f367819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f36777fe640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36781002f0 0x7f3678198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f3676ffd640 1 -- 172.21.15.12:0/1833509597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36781002f0 msgr2=0x7f3678198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f3676ffd640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36781002f0 0x7f3678198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f3676ffd640 1 -- 172.21.15.12:0/1833509597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3678106f50 msgr2=0x7f367819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f3676ffd640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3678106f50 0x7f367819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f3676ffd640 1 -- 172.21.15.12:0/1833509597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367819d5d0 con 0x7f3678100ca0 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f36777fe640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36781002f0 0x7f3678198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.527+0000 7f3676ffd640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3678100ca0 0x7f3678198b60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f366c009230 tx=0x7f366c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.528+0000 7f3674ff9640 1 -- 172.21.15.12:0/1833509597 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c03f030 con 0x7f3678100ca0 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.528+0000 7f367ddc1640 1 -- 172.21.15.12:0/1833509597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367819d860 con 0x7f3678100ca0 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.528+0000 7f3674ff9640 1 -- 172.21.15.12:0/1833509597 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f366c003ce0 con 0x7f3678100ca0 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.528+0000 7f3674ff9640 1 -- 172.21.15.12:0/1833509597 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c035070 con 0x7f3678100ca0 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.528+0000 7f367ddc1640 1 -- 172.21.15.12:0/1833509597 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36781a51a0 con 0x7f3678100ca0 2024-09-19T06:53:18.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.530+0000 7f3674ff9640 1 -- 172.21.15.12:0/1833509597 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f366c042030 con 0x7f3678100ca0 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.530+0000 7f368019a740 1 Processor -- start 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.530+0000 7f368019a740 1 -- start start 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f368019a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 0x56497b895090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f368019a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b895a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f368019a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b8a2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f368019a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56497b7fb2f0 con 0x56497b8a0370 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f368019a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56497b7a2cf0 con 0x56497b896b40 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f368019a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56497b7f72b0 con 0x56497b8955d0 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3676ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b8a2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3676ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b8a2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44636/0 (socket says 172.21.15.12:44636) 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3676ffd640 1 -- 172.21.15.12:0/325563813 learned_addr learned my addr 172.21.15.12:0/325563813 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3677fff640 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 0x56497b895090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f36777fe640 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b895a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3674ff9640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36600a33b0 0x7f36600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3677fff640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36600a33b0 0x7f36600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3676ffd640 1 -- 172.21.15.12:0/325563813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 msgr2=0x56497b895a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3676ffd640 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b895a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3676ffd640 1 -- 172.21.15.12:0/325563813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 msgr2=0x56497b895090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3676ffd640 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 0x56497b895090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3674ff9640 1 -- 172.21.15.12:0/1833509597 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f366c0f03e0 con 0x7f3678100ca0 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3676ffd640 1 -- 172.21.15.12:0/325563813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497b7873a0 con 0x56497b8a0370 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f36777fe640 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b895a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.531+0000 7f3677fff640 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 0x56497b895090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f3676ffd640 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b8a2760 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f366c0bc2c0 tx=0x7f366c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1a07e465939973 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f365dffb640 1 -- 172.21.15.12:0/325563813 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c049070 con 0x56497b8a0370 2024-09-19T06:53:18.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f3677fff640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36600a33b0 0x7f36600a5870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3670009fd0 tx=0x7f3670004a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f365dffb640 1 -- 172.21.15.12:0/325563813 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f366c0ef070 con 0x56497b8a0370 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f365dffb640 1 -- 172.21.15.12:0/325563813 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0c0970 con 0x56497b8a0370 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f368019a740 1 -- 172.21.15.12:0/325563813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 msgr2=0x56497b8a2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f368019a740 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b8a2760 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f366c0bc2c0 tx=0x7f366c009260 comp rx=0 tx=0).stop 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f368019a740 1 -- 172.21.15.12:0/325563813 shutdown_connections 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f368019a740 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b8a2760 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f368019a740 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b895a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f368019a740 1 --2- 172.21.15.12:0/325563813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 0x56497b895090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.532+0000 7f368019a740 1 -- 172.21.15.12:0/325563813 >> 172.21.15.12:0/325563813 conn(0x56497b85e310 msgr2=0x56497b891c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 1 -- 172.21.15.12:0/325563813 shutdown_connections 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 1 -- 172.21.15.12:0/325563813 wait complete. 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 1 -- start start 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 1 Processor -- start 2024-09-19T06:53:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b8955d0 0x56497b89fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b896b40 0x56497b89cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b89d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56497b8a2e30 con 0x56497b8a0370 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56497b7b6060 con 0x56497b8955d0 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56497b8a2fb0 con 0x56497b896b40 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.533+0000 7f368019a740 10 client.0 _ll_register_callbacks cb 0x56497b5098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3677fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b89d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3677fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b89d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44648/0 (socket says 172.21.15.12:44648) 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3677fff640 1 -- 172.21.15.12:0/2182832632 learned_addr learned my addr 172.21.15.12:0/2182832632 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3676ffd640 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b896b40 0x56497b89cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f36777fe640 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b8955d0 0x56497b89fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3677fff640 1 -- 172.21.15.12:0/2182832632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b896b40 msgr2=0x56497b89cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3677fff640 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b896b40 0x56497b89cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3677fff640 1 -- 172.21.15.12:0/2182832632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b8955d0 msgr2=0x56497b89fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3677fff640 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b8955d0 0x56497b89fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3677fff640 1 -- 172.21.15.12:0/2182832632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497b56c3c0 con 0x56497b8a0370 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3677fff640 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b89d530 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f367000af30 tx=0x7f3670004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6cbd34a240cba15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3656ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3656ffd640 1 -- 172.21.15.12:0/2182832632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670023610 con 0x56497b8a0370 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3656ffd640 1 -- 172.21.15.12:0/2182832632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f36700237b0 con 0x56497b8a0370 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f368019a740 1 -- 172.21.15.12:0/2182832632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f366c0ef070 con 0x56497b8a0370 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f3656ffd640 1 -- 172.21.15.12:0/2182832632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f3670031050 con 0x56497b8a0370 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f368019a740 10 client.19062 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.534+0000 7f368019a740 1 -- 172.21.15.12:0/2182832632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x56497b8ae7b0 con 0x56497b8a0370 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.535+0000 7f3656ffd640 1 -- 172.21.15.12:0/2182832632 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f366c0ef070 con 0x56497b8a0370 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.535+0000 7f3656ffd640 1 -- 172.21.15.12:0/2182832632 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f367002c840 con 0x56497b8a0370 2024-09-19T06:53:18.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.535+0000 7f368019a740 10 client.19062 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.535+0000 7f368019a740 10 client.19062 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.535+0000 7f368019a740 20 client.19062 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.535+0000 7f368019a740 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x56497b8afc70 0x56497b8b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.535+0000 7f368019a740 4 client.19062 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.535+0000 7f368019a740 1 -- 172.21.15.12:0/2182832632 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56497b808860 con 0x56497b8afc70 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.535+0000 7f36777fe640 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x56497b8afc70 0x56497b8b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.536+0000 7f36777fe640 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x56497b8afc70 0x56497b8b20f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=72dd7605876aac28 server_cookie=d24c560fda1e78d4 in_seq=0 out_seq=0 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.536+0000 7f3656ffd640 10 client.19062 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.536+0000 7f3656ffd640 1 -- 172.21.15.12:0/2182832632 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56497b808860 con 0x56497b8afc70 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.536+0000 7f3656ffd640 10 client.19062 handle_command_reply: tid=0 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 client.19062 shutdown 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 -- 172.21.15.12:0/2182832632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 msgr2=0x56497b89d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b89d530 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f367000af30 tx=0x7f3670004b50 comp rx=0 tx=0).stop 2024-09-19T06:53:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 -- 172.21.15.12:0/2182832632 shutdown_connections 2024-09-19T06:53:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x56497b8afc70 0x56497b8b20f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b89d530 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f3656ffd640 0 client.19062 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:53:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b896b40 0x56497b89cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 --2- 172.21.15.12:0/2182832632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b8955d0 0x56497b89fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 -- 172.21.15.12:0/2182832632 >> 172.21.15.12:0/2182832632 conn(0x56497b85e310 msgr2=0x56497b897960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 -- 172.21.15.12:0/2182832632 shutdown_connections 2024-09-19T06:53:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 1 -- 172.21.15.12:0/2182832632 wait complete. 2024-09-19T06:53:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.537+0000 7f368019a740 20 client.19062 trim_cache size 0 max 16384 2024-09-19T06:53:18.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.550+0000 7f368019a740 1 Processor -- start 2024-09-19T06:53:18.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.550+0000 7f368019a740 1 -- start start 2024-09-19T06:53:18.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.550+0000 7f368019a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b8ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.550+0000 7f368019a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 0x56497b896300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.550+0000 7f368019a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b88cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.550+0000 7f368019a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36781add10 con 0x56497b8a0370 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.550+0000 7f368019a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f36781af940 con 0x56497b896b40 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.550+0000 7f368019a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f36781ae3e0 con 0x56497b8955d0 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f3677fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b88cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f3677fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b88cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44654/0 (socket says 172.21.15.12:44654) 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f3677fff640 1 -- 172.21.15.12:0/3482612644 learned_addr learned my addr 172.21.15.12:0/3482612644 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f3676ffd640 1 --2- 172.21.15.12:0/3482612644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 0x56497b896300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f36777fe640 1 --2- 172.21.15.12:0/3482612644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b8ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f3677fff640 1 -- 172.21.15.12:0/3482612644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 msgr2=0x56497b8ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f3677fff640 1 --2- 172.21.15.12:0/3482612644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b8ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f3677fff640 1 -- 172.21.15.12:0/3482612644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 msgr2=0x56497b896300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:18.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f3677fff640 1 --2- 172.21.15.12:0/3482612644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 0x56497b896300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f3677fff640 1 -- 172.21.15.12:0/3482612644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497b89d790 con 0x56497b8a0370 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f3677fff640 1 --2- 172.21.15.12:0/3482612644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b88cab0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f3670015a20 tx=0x7f3670015a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4507e1257c7e92bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f365d7fa640 1 -- 172.21.15.12:0/3482612644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367003a070 con 0x56497b8a0370 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f365d7fa640 1 -- 172.21.15.12:0/3482612644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3670028070 con 0x56497b8a0370 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.551+0000 7f365d7fa640 1 -- 172.21.15.12:0/3482612644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670018ad0 con 0x56497b8a0370 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.552+0000 7f368019a740 1 -- 172.21.15.12:0/3482612644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 msgr2=0x56497b88cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.552+0000 7f368019a740 1 --2- 172.21.15.12:0/3482612644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b88cab0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f3670015a20 tx=0x7f3670015a50 comp rx=0 tx=0).stop 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.552+0000 7f368019a740 1 -- 172.21.15.12:0/3482612644 shutdown_connections 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.552+0000 7f368019a740 1 --2- 172.21.15.12:0/3482612644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b8a0370 0x56497b88cab0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.552+0000 7f368019a740 1 --2- 172.21.15.12:0/3482612644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b896b40 0x56497b896300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.552+0000 7f368019a740 1 --2- 172.21.15.12:0/3482612644 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b8ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.552+0000 7f368019a740 1 -- 172.21.15.12:0/3482612644 >> 172.21.15.12:0/3482612644 conn(0x56497b85e310 msgr2=0x56497b89b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:18.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.552+0000 7f368019a740 1 -- 172.21.15.12:0/3482612644 shutdown_connections 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.552+0000 7f368019a740 1 -- 172.21.15.12:0/3482612644 wait complete. 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.552+0000 7f368019a740 1 -- start start 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f368019a740 1 Processor -- start 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f368019a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b8a3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f368019a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b896b40 0x56497b8a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f368019a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b8a0370 0x56497b9189d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f368019a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36781af270 con 0x56497b896b40 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f368019a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f36781aeae0 con 0x56497b8a0370 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f368019a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f36781abd10 con 0x56497b8955d0 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f368019a740 10 client.0 _ll_register_callbacks cb 0x7f3670015d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f3676ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b896b40 0x56497b8a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f3676ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b896b40 0x56497b8a38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44670/0 (socket says 172.21.15.12:44670) 2024-09-19T06:53:18.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f3676ffd640 1 -- 172.21.15.12:0/2554434853 learned_addr learned my addr 172.21.15.12:0/2554434853 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f36777fe640 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b8a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f3677fff640 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b8a0370 0x56497b9189d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f3676ffd640 1 -- 172.21.15.12:0/2554434853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 msgr2=0x56497b8a3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f3676ffd640 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b8a3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f3676ffd640 1 -- 172.21.15.12:0/2554434853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b8a0370 msgr2=0x56497b9189d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f3676ffd640 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b8a0370 0x56497b9189d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.553+0000 7f3676ffd640 1 -- 172.21.15.12:0/2554434853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497b8a4180 con 0x56497b896b40 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f3676ffd640 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b896b40 0x56497b8a38d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f366c0bc550 tx=0x7f366c0b8230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b61d4e3ba38f61e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f3656ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f3656ffd640 1 -- 172.21.15.12:0/2554434853 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0d4020 con 0x56497b896b40 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f3656ffd640 1 -- 172.21.15.12:0/2554434853 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f366c04ade0 con 0x56497b896b40 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f368019a740 1 -- 172.21.15.12:0/2554434853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3670028070 con 0x56497b896b40 2024-09-19T06:53:18.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f3656ffd640 1 -- 172.21.15.12:0/2554434853 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f366c049040 con 0x56497b896b40 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f368019a740 10 client.19068 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f368019a740 1 -- 172.21.15.12:0/2554434853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x56497b919ff0 con 0x56497b896b40 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f3656ffd640 1 -- 172.21.15.12:0/2554434853 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3670028070 con 0x56497b896b40 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f3656ffd640 1 -- 172.21.15.12:0/2554434853 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f366c003800 con 0x56497b896b40 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f368019a740 10 client.19068 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f368019a740 10 client.19068 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f368019a740 20 client.19068 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f368019a740 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x56497b8afc70 0x56497b91c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f368019a740 4 client.19068 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.554+0000 7f368019a740 1 -- 172.21.15.12:0/2554434853 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56497b802d70 con 0x56497b8afc70 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f36777fe640 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x56497b8afc70 0x56497b91c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f36777fe640 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x56497b8afc70 0x56497b91c580 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1f895908e643b99a server_cookie=d475197555e3e6e2 in_seq=0 out_seq=0 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f3656ffd640 10 client.19068 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:53:18.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f3656ffd640 1 -- 172.21.15.12:0/2554434853 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56497b802d70 con 0x56497b8afc70 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f3656ffd640 10 client.19068 handle_command_reply: tid=0 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f368019a740 1 client.19068 shutdown 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f368019a740 1 -- 172.21.15.12:0/2554434853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b896b40 msgr2=0x56497b8a38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f368019a740 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b896b40 0x56497b8a38d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f366c0bc550 tx=0x7f366c0b8230 comp rx=0 tx=0).stop 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f368019a740 1 -- 172.21.15.12:0/2554434853 shutdown_connections 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f368019a740 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x56497b8afc70 0x56497b91c580 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f368019a740 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56497b8a0370 0x56497b9189d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f368019a740 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56497b896b40 0x56497b8a38d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f368019a740 1 --2- 172.21.15.12:0/2554434853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56497b8955d0 0x56497b8a3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.555+0000 7f368019a740 1 -- 172.21.15.12:0/2554434853 >> 172.21.15.12:0/2554434853 conn(0x56497b85e310 msgr2=0x56497b8904e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f3656ffd640 0 client.19068 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f368019a740 1 -- 172.21.15.12:0/2554434853 shutdown_connections 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f368019a740 1 -- 172.21.15.12:0/2554434853 wait complete. 2024-09-19T06:53:18.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f368019a740 20 client.19068 trim_cache size 0 max 16384 2024-09-19T06:53:18.568 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:53:18.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f367ddc1640 1 -- 172.21.15.12:0/1833509597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36600a33b0 msgr2=0x7f36600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:18.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f367ddc1640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36600a33b0 0x7f36600a5870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3670009fd0 tx=0x7f3670004a40 comp rx=0 tx=0).stop 2024-09-19T06:53:18.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f367ddc1640 1 -- 172.21.15.12:0/1833509597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3678100ca0 msgr2=0x7f3678198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:18.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f367ddc1640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3678100ca0 0x7f3678198b60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f366c009230 tx=0x7f366c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f367ddc1640 1 -- 172.21.15.12:0/1833509597 shutdown_connections 2024-09-19T06:53:18.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f367ddc1640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3678106f50 0x7f367819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f367ddc1640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3678100ca0 0x7f3678198b60 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f367ddc1640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f36600a33b0 0x7f36600a5870 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f367ddc1640 1 --2- 172.21.15.12:0/1833509597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f36781002f0 0x7f3678198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:18.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.556+0000 7f367ddc1640 1 -- 172.21.15.12:0/1833509597 >> 172.21.15.12:0/1833509597 conn(0x7f3678077210 msgr2=0x7f3678105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:18.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.557+0000 7f367ddc1640 1 -- 172.21.15.12:0/1833509597 shutdown_connections 2024-09-19T06:53:18.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:18.557+0000 7f367ddc1640 1 -- 172.21.15.12:0/1833509597 wait complete. 2024-09-19T06:53:19.465 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:53:19.728 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.149+0000 7f43dbdd1640 1 -- 172.21.15.12:0/2967204646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43d4101de0 msgr2=0x7f43d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.149+0000 7f43dbdd1640 1 --2- 172.21.15.12:0/2967204646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43d4101de0 0x7f43d41021c0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009900 tx=0x7f43d002a410 comp rx=0 tx=0).stop 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.149+0000 7f43dbdd1640 1 -- 172.21.15.12:0/2967204646 shutdown_connections 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.149+0000 7f43dbdd1640 1 --2- 172.21.15.12:0/2967204646 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d4106f10 0x7f43d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.149+0000 7f43dbdd1640 1 --2- 172.21.15.12:0/2967204646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d4102790 0x7f43d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.149+0000 7f43dbdd1640 1 --2- 172.21.15.12:0/2967204646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43d4101de0 0x7f43d41021c0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.149+0000 7f43dbdd1640 1 -- 172.21.15.12:0/2967204646 >> 172.21.15.12:0/2967204646 conn(0x7f43d40fd8c0 msgr2=0x7f43d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.149+0000 7f43dbdd1640 1 -- 172.21.15.12:0/2967204646 shutdown_connections 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.149+0000 7f43dbdd1640 1 -- 172.21.15.12:0/2967204646 wait complete. 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43dbdd1640 1 Processor -- start 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43dbdd1640 1 -- start start 2024-09-19T06:53:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43dbdd1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d4101de0 0x7f43d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43dbdd1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43d4102790 0x7f43d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43dbdd1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d4106f10 0x7f43d4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43dbdd1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f43d4111fb0 con 0x7f43d4102790 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43dbdd1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f43d4111e30 con 0x7f43d4106f10 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43dbdd1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f43d4112130 con 0x7f43d4101de0 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43d936c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43d4102790 0x7f43d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43d936c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43d4102790 0x7f43d4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44690/0 (socket says 172.21.15.12:44690) 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.150+0000 7f43d936c640 1 -- 172.21.15.12:0/580233457 learned_addr learned my addr 172.21.15.12:0/580233457 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43da36e640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d4106f10 0x7f43d4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d4101de0 0x7f43d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43d936c640 1 -- 172.21.15.12:0/580233457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d4101de0 msgr2=0x7f43d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43d936c640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d4101de0 0x7f43d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43d936c640 1 -- 172.21.15.12:0/580233457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d4106f10 msgr2=0x7f43d4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43d936c640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d4106f10 0x7f43d4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43d936c640 1 -- 172.21.15.12:0/580233457 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d41a69d0 con 0x7f43d4102790 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43da36e640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d4106f10 0x7f43d4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43d936c640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43d4102790 0x7f43d4074a30 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f43c400b4a0 tx=0x7f43c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43caffd640 1 -- 172.21.15.12:0/580233457 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4014070 con 0x7f43d4102790 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43dbdd1640 1 -- 172.21.15.12:0/580233457 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d41a6cc0 con 0x7f43d4102790 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43caffd640 1 -- 172.21.15.12:0/580233457 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43c4010af0 con 0x7f43d4102790 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43dbdd1640 1 -- 172.21.15.12:0/580233457 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d41a71f0 con 0x7f43d4102790 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.151+0000 7f43caffd640 1 -- 172.21.15.12:0/580233457 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c401e060 con 0x7f43d4102790 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.153+0000 7f43caffd640 1 -- 172.21.15.12:0/580233457 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f43c4017070 con 0x7f43d4102790 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43de1aa740 1 Processor -- start 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43de1aa740 1 -- start start 2024-09-19T06:53:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d63090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d63a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d70760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43de1aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564581cc92f0 con 0x564581d635d0 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43de1aa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564581c70cf0 con 0x564581d6e370 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43de1aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564581cc52b0 con 0x564581d64b40 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43d9b6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d63a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43d9b6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d63a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44700/0 (socket says 172.21.15.12:44700) 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.154+0000 7f43d9b6d640 1 -- 172.21.15.12:0/931445371 learned_addr learned my addr 172.21.15.12:0/931445371 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43da36e640 1 --2- 172.21.15.12:0/931445371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d63090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43d936c640 1 --2- 172.21.15.12:0/931445371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d70760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43d9b6d640 1 -- 172.21.15.12:0/931445371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 msgr2=0x564581d63090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/931445371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d63090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43d9b6d640 1 -- 172.21.15.12:0/931445371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 msgr2=0x564581d70760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/931445371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d70760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43d9b6d640 1 -- 172.21.15.12:0/931445371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564581c553a0 con 0x564581d635d0 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43d936c640 1 --2- 172.21.15.12:0/931445371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d70760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43caffd640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43c00a33b0 0x7f43c00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43da36e640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43c00a33b0 0x7f43c00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/931445371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d63a10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f43d0033000 tx=0x7f43d0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6bbbc9ec401b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43caffd640 1 -- 172.21.15.12:0/580233457 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f43c40cf460 con 0x7f43d4102790 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43bffff640 1 -- 172.21.15.12:0/931445371 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d003f070 con 0x564581d635d0 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43bffff640 1 -- 172.21.15.12:0/931445371 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d00317b0 con 0x564581d635d0 2024-09-19T06:53:20.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.155+0000 7f43bffff640 1 -- 172.21.15.12:0/931445371 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0035070 con 0x564581d635d0 2024-09-19T06:53:20.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.156+0000 7f43de1aa740 1 -- 172.21.15.12:0/931445371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 msgr2=0x564581d63a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:20.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.156+0000 7f43da36e640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43c00a33b0 0x7f43c00a5870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f43cc005fd0 tx=0x7f43cc009800 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.156+0000 7f43de1aa740 1 --2- 172.21.15.12:0/931445371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d63a10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f43d0033000 tx=0x7f43d0032ce0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.156+0000 7f43de1aa740 1 -- 172.21.15.12:0/931445371 shutdown_connections 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.156+0000 7f43de1aa740 1 --2- 172.21.15.12:0/931445371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d70760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.156+0000 7f43de1aa740 1 --2- 172.21.15.12:0/931445371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d63a10 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.156+0000 7f43de1aa740 1 --2- 172.21.15.12:0/931445371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d63090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.156+0000 7f43de1aa740 1 -- 172.21.15.12:0/931445371 >> 172.21.15.12:0/931445371 conn(0x564581d2c310 msgr2=0x564581d5fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.156+0000 7f43de1aa740 1 -- 172.21.15.12:0/931445371 shutdown_connections 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.156+0000 7f43de1aa740 1 -- 172.21.15.12:0/931445371 wait complete. 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43de1aa740 1 -- start start 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43de1aa740 1 Processor -- start 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d635d0 0x564581d6dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d64b40 0x564581d6afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d6b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43de1aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564581d71010 con 0x564581d64b40 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43de1aa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564581c84060 con 0x564581d6e370 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43de1aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564581d71190 con 0x564581d635d0 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43de1aa740 10 client.0 _ll_register_callbacks cb 0x5645819d78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43d936c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d64b40 0x564581d6afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43d936c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d64b40 0x564581d6afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44704/0 (socket says 172.21.15.12:44704) 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.157+0000 7f43d936c640 1 -- 172.21.15.12:0/2679165013 learned_addr learned my addr 172.21.15.12:0/2679165013 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d635d0 0x564581d6dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43da36e640 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d6b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43d936c640 1 -- 172.21.15.12:0/2679165013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d635d0 msgr2=0x564581d6dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43d936c640 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d635d0 0x564581d6dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43d936c640 1 -- 172.21.15.12:0/2679165013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 msgr2=0x564581d6b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43d936c640 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d6b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43d936c640 1 -- 172.21.15.12:0/2679165013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564581a3a3c0 con 0x564581d64b40 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43d936c640 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d64b40 0x564581d6afc0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009420 tx=0x7f43c40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c0b79629a9877e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43bd7fa640 1 -- 172.21.15.12:0/2679165013 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c409b110 con 0x564581d64b40 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43bd7fa640 1 -- 172.21.15.12:0/2679165013 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f43c40ccd90 con 0x564581d64b40 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43de1aa740 1 -- 172.21.15.12:0/2679165013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d00317b0 con 0x564581d64b40 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43bd7fa640 1 -- 172.21.15.12:0/2679165013 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f43c409beb0 con 0x564581d64b40 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43de1aa740 10 client.19080 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43de1aa740 1 -- 172.21.15.12:0/2679165013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x564581d7cb10 con 0x564581d64b40 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.158+0000 7f43bd7fa640 1 -- 172.21.15.12:0/2679165013 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d00317b0 con 0x564581d64b40 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.159+0000 7f43bd7fa640 1 -- 172.21.15.12:0/2679165013 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f43c4097e20 con 0x564581d64b40 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.159+0000 7f43de1aa740 10 client.19080 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:20.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.159+0000 7f43de1aa740 10 client.19080 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.159+0000 7f43de1aa740 20 client.19080 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.159+0000 7f43de1aa740 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564581d7dfd0 0x564581d803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.159+0000 7f43de1aa740 4 client.19080 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.159+0000 7f43de1aa740 1 -- 172.21.15.12:0/2679165013 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564581cd6860 con 0x564581d7dfd0 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.159+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564581d7dfd0 0x564581d803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.159+0000 7f43bd7fa640 10 client.19080 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.159+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564581d7dfd0 0x564581d803c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bda67a00029013b9 server_cookie=da8bc68032fe934f in_seq=0 out_seq=0 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43bd7fa640 1 -- 172.21.15.12:0/2679165013 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564581cd6860 con 0x564581d7dfd0 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43bd7fa640 10 client.19080 handle_command_reply: tid=0 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43de1aa740 1 client.19080 shutdown 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43de1aa740 1 -- 172.21.15.12:0/2679165013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d64b40 msgr2=0x564581d6afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43de1aa740 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d64b40 0x564581d6afc0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009420 tx=0x7f43c40047d0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43de1aa740 1 -- 172.21.15.12:0/2679165013 shutdown_connections 2024-09-19T06:53:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43de1aa740 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564581d7dfd0 0x564581d803c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43de1aa740 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d6b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43de1aa740 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d64b40 0x564581d6afc0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43de1aa740 1 --2- 172.21.15.12:0/2679165013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d635d0 0x564581d6dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43bd7fa640 0 client.19080 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:53:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.160+0000 7f43de1aa740 1 -- 172.21.15.12:0/2679165013 >> 172.21.15.12:0/2679165013 conn(0x564581d2c310 msgr2=0x564581d65960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.161+0000 7f43de1aa740 1 -- 172.21.15.12:0/2679165013 shutdown_connections 2024-09-19T06:53:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.161+0000 7f43de1aa740 1 -- 172.21.15.12:0/2679165013 wait complete. 2024-09-19T06:53:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.161+0000 7f43de1aa740 20 client.19080 trim_cache size 0 max 16384 2024-09-19T06:53:20.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43de1aa740 1 Processor -- start 2024-09-19T06:53:20.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43de1aa740 1 -- start start 2024-09-19T06:53:20.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d635d0 0x564581d7a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d6cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d6e370 0x564581d85c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43de1aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f43d41afdc0 con 0x564581d6e370 2024-09-19T06:53:20.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43de1aa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f43d41b19f0 con 0x564581d635d0 2024-09-19T06:53:20.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43de1aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f43d41b0490 con 0x564581d64b40 2024-09-19T06:53:20.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43da36e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d6e370 0x564581d85c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43da36e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d6e370 0x564581d85c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44718/0 (socket says 172.21.15.12:44718) 2024-09-19T06:53:20.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43da36e640 1 -- 172.21.15.12:0/1277128760 learned_addr learned my addr 172.21.15.12:0/1277128760 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:20.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/1277128760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d635d0 0x564581d7a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43d936c640 1 --2- 172.21.15.12:0/1277128760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d6cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43da36e640 1 -- 172.21.15.12:0/1277128760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 msgr2=0x564581d6cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:20.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43da36e640 1 --2- 172.21.15.12:0/1277128760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d6cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43da36e640 1 -- 172.21.15.12:0/1277128760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d635d0 msgr2=0x564581d7a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:20.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43da36e640 1 --2- 172.21.15.12:0/1277128760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d635d0 0x564581d7a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43da36e640 1 -- 172.21.15.12:0/1277128760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564581d80a20 con 0x564581d6e370 2024-09-19T06:53:20.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.174+0000 7f43d936c640 1 --2- 172.21.15.12:0/1277128760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d6cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:20.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43da36e640 1 --2- 172.21.15.12:0/1277128760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d6e370 0x564581d85c70 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f43cc011690 tx=0x7f43cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589756240cd4b3e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:20.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43bf7fe640 1 -- 172.21.15.12:0/1277128760 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc004b20 con 0x564581d6e370 2024-09-19T06:53:20.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43bf7fe640 1 -- 172.21.15.12:0/1277128760 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43cc004cc0 con 0x564581d6e370 2024-09-19T06:53:20.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43bf7fe640 1 -- 172.21.15.12:0/1277128760 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc01f7b0 con 0x564581d6e370 2024-09-19T06:53:20.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43de1aa740 1 -- 172.21.15.12:0/1277128760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d6e370 msgr2=0x564581d85c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:20.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43de1aa740 1 --2- 172.21.15.12:0/1277128760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d6e370 0x564581d85c70 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f43cc011690 tx=0x7f43cc016000 comp rx=0 tx=0).stop 2024-09-19T06:53:20.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43de1aa740 1 -- 172.21.15.12:0/1277128760 shutdown_connections 2024-09-19T06:53:20.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43de1aa740 1 --2- 172.21.15.12:0/1277128760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d6e370 0x564581d85c70 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43de1aa740 1 --2- 172.21.15.12:0/1277128760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d6cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43de1aa740 1 --2- 172.21.15.12:0/1277128760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d635d0 0x564581d7a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43de1aa740 1 -- 172.21.15.12:0/1277128760 >> 172.21.15.12:0/1277128760 conn(0x564581d2c310 msgr2=0x564581d6c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:20.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.175+0000 7f43de1aa740 1 -- 172.21.15.12:0/1277128760 shutdown_connections 2024-09-19T06:53:20.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43de1aa740 1 -- 172.21.15.12:0/1277128760 wait complete. 2024-09-19T06:53:20.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43de1aa740 1 -- start start 2024-09-19T06:53:20.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43de1aa740 1 Processor -- start 2024-09-19T06:53:20.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d76720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d76c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43de1aa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d73510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43de1aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f43d41b1320 con 0x564581d635d0 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43de1aa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f43d41b0b90 con 0x564581d6e370 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43de1aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f43d41addc0 con 0x564581d64b40 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43de1aa740 10 client.0 _ll_register_callbacks cb 0x7f43c4017630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43d9b6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d76720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43d9b6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d76720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44722/0 (socket says 172.21.15.12:44722) 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.176+0000 7f43d9b6d640 1 -- 172.21.15.12:0/1933242946 learned_addr learned my addr 172.21.15.12:0/1933242946 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43da36e640 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d73510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43d936c640 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d76c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43d9b6d640 1 -- 172.21.15.12:0/1933242946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 msgr2=0x564581d76c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:20.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d76c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43d9b6d640 1 -- 172.21.15.12:0/1933242946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 msgr2=0x564581d73510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:20.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d73510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43d9b6d640 1 -- 172.21.15.12:0/1933242946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564581d73d10 con 0x564581d635d0 2024-09-19T06:53:20.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43d9b6d640 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d76720 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009900 tx=0x7f43d0032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d98d518c339c43d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:20.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:20.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43bd7fa640 1 -- 172.21.15.12:0/1933242946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d003f040 con 0x564581d635d0 2024-09-19T06:53:20.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43bd7fa640 1 -- 172.21.15.12:0/1933242946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f43d0031750 con 0x564581d635d0 2024-09-19T06:53:20.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43de1aa740 1 -- 172.21.15.12:0/1933242946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43cc004cc0 con 0x564581d635d0 2024-09-19T06:53:20.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43bd7fa640 1 -- 172.21.15.12:0/1933242946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f43d0035040 con 0x564581d635d0 2024-09-19T06:53:20.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43de1aa740 10 client.19086 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:20.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43de1aa740 1 -- 172.21.15.12:0/1933242946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x564581de97e0 con 0x564581d635d0 2024-09-19T06:53:20.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.177+0000 7f43bd7fa640 1 -- 172.21.15.12:0/1933242946 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43cc004cc0 con 0x564581d635d0 2024-09-19T06:53:20.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.178+0000 7f43bd7fa640 1 -- 172.21.15.12:0/1933242946 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f43d0003b80 con 0x564581d635d0 2024-09-19T06:53:20.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.178+0000 7f43de1aa740 10 client.19086 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:20.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.178+0000 7f43de1aa740 10 client.19086 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:53:20.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.178+0000 7f43de1aa740 20 client.19086 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:20.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.178+0000 7f43de1aa740 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564581de9b30 0x564581debf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:20.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.178+0000 7f43de1aa740 4 client.19086 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:53:20.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.178+0000 7f43de1aa740 1 -- 172.21.15.12:0/1933242946 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564581cd0d70 con 0x564581de9b30 2024-09-19T06:53:20.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.178+0000 7f43d936c640 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564581de9b30 0x564581debf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:20.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.178+0000 7f43d936c640 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564581de9b30 0x564581debf20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ac72e88ca6502ba server_cookie=486de900ae01ec89 in_seq=0 out_seq=0 2024-09-19T06:53:20.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.178+0000 7f43bd7fa640 10 client.19086 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:53:20.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43bd7fa640 1 -- 172.21.15.12:0/1933242946 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564581cd0d70 con 0x564581de9b30 2024-09-19T06:53:20.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43bd7fa640 10 client.19086 handle_command_reply: tid=0 2024-09-19T06:53:20.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 client.19086 shutdown 2024-09-19T06:53:20.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 -- 172.21.15.12:0/1933242946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 msgr2=0x564581d76720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:20.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d76720 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009900 tx=0x7f43d0032f60 comp rx=0 tx=0).stop 2024-09-19T06:53:20.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 -- 172.21.15.12:0/1933242946 shutdown_connections 2024-09-19T06:53:20.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x564581de9b30 0x564581debf20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564581d6e370 0x564581d73510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564581d64b40 0x564581d76c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 --2- 172.21.15.12:0/1933242946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564581d635d0 0x564581d76720 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43bd7fa640 0 client.19086 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:53:20.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 -- 172.21.15.12:0/1933242946 >> 172.21.15.12:0/1933242946 conn(0x564581d2c310 msgr2=0x564581d6d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:20.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 -- 172.21.15.12:0/1933242946 shutdown_connections 2024-09-19T06:53:20.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 1 -- 172.21.15.12:0/1933242946 wait complete. 2024-09-19T06:53:20.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.179+0000 7f43de1aa740 20 client.19086 trim_cache size 0 max 16384 2024-09-19T06:53:20.192 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:53:20.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 -- 172.21.15.12:0/580233457 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43c00a33b0 msgr2=0x7f43c00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:20.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43c00a33b0 0x7f43c00a5870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f43cc005fd0 tx=0x7f43cc009800 comp rx=0 tx=0).stop 2024-09-19T06:53:20.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 -- 172.21.15.12:0/580233457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43d4102790 msgr2=0x7f43d4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:20.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43d4102790 0x7f43d4074a30 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f43c400b4a0 tx=0x7f43c400b960 comp rx=0 tx=0).stop 2024-09-19T06:53:20.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 -- 172.21.15.12:0/580233457 shutdown_connections 2024-09-19T06:53:20.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d4106f10 0x7f43d4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43d4102790 0x7f43d4074a30 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f43c00a33b0 0x7f43c00a5870 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 --2- 172.21.15.12:0/580233457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43d4101de0 0x7f43d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:20.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 -- 172.21.15.12:0/580233457 >> 172.21.15.12:0/580233457 conn(0x7f43d40fd8c0 msgr2=0x7f43d40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:20.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 -- 172.21.15.12:0/580233457 shutdown_connections 2024-09-19T06:53:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:20.180+0000 7f43dbdd1640 1 -- 172.21.15.12:0/580233457 wait complete. 2024-09-19T06:53:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:20 smithi173 ceph-mon[35349]: pgmap v412: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 1.34k op/s 2024-09-19T06:53:20.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:20 smithi012 ceph-mon[30937]: pgmap v412: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 1.34k op/s 2024-09-19T06:53:20.457 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:53:20.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:20 smithi016 ceph-mon[34911]: pgmap v412: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 1.34k op/s 2024-09-19T06:53:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:53:20.932 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:53:21.059 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:21.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.553+0000 7f75ca15f640 1 -- 172.21.15.12:0/3793637767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c4106f10 msgr2=0x7f75c410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:21.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.553+0000 7f75ca15f640 1 --2- 172.21.15.12:0/3793637767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c4106f10 0x7f75c410ea90 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009ca0 tx=0x7f75bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:53:21.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.553+0000 7f75ca15f640 1 -- 172.21.15.12:0/3793637767 shutdown_connections 2024-09-19T06:53:21.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.554+0000 7f75ca15f640 1 --2- 172.21.15.12:0/3793637767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c4106f10 0x7f75c410ea90 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:21.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.554+0000 7f75ca15f640 1 --2- 172.21.15.12:0/3793637767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4102790 0x7f75c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:21.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.554+0000 7f75ca15f640 1 --2- 172.21.15.12:0/3793637767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75c4101de0 0x7f75c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:21.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.554+0000 7f75ca15f640 1 -- 172.21.15.12:0/3793637767 >> 172.21.15.12:0/3793637767 conn(0x7f75c40fd8c0 msgr2=0x7f75c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.554+0000 7f75ca15f640 1 -- 172.21.15.12:0/3793637767 shutdown_connections 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.554+0000 7f75ca15f640 1 -- 172.21.15.12:0/3793637767 wait complete. 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.554+0000 7f75ca15f640 1 Processor -- start 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75ca15f640 1 -- start start 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75ca15f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4101de0 0x7f75c41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75ca15f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75c4102790 0x7f75c4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75ca15f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c4106f10 0x7f75c419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75ca15f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4111f70 con 0x7f75c4106f10 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75ca15f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4111df0 con 0x7f75c4102790 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75ca15f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41120f0 con 0x7f75c4101de0 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c4106f10 0x7f75c419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c4106f10 0x7f75c419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48778/0 (socket says 172.21.15.12:48778) 2024-09-19T06:53:21.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c3fff640 1 -- 172.21.15.12:0/2438674351 learned_addr learned my addr 172.21.15.12:0/2438674351 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c37fe640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4101de0 0x7f75c41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c2ffd640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75c4102790 0x7f75c4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c3fff640 1 -- 172.21.15.12:0/2438674351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4101de0 msgr2=0x7f75c41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c3fff640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4101de0 0x7f75c41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c3fff640 1 -- 172.21.15.12:0/2438674351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75c4102790 msgr2=0x7f75c4198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c3fff640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75c4102790 0x7f75c4198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c3fff640 1 -- 172.21.15.12:0/2438674351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c419d3a0 con 0x7f75c4106f10 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.555+0000 7f75c2ffd640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75c4102790 0x7f75c4198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.556+0000 7f75c3fff640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c4106f10 0x7f75c419ccc0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f75bc031a20 tx=0x7f75bc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.556+0000 7f75c0ff9640 1 -- 172.21.15.12:0/2438674351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc003c30 con 0x7f75c4106f10 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.556+0000 7f75ca15f640 1 -- 172.21.15.12:0/2438674351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c419d630 con 0x7f75c4106f10 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.556+0000 7f75c0ff9640 1 -- 172.21.15.12:0/2438674351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75bc003dd0 con 0x7f75c4106f10 2024-09-19T06:53:21.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.556+0000 7f75c0ff9640 1 -- 172.21.15.12:0/2438674351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc02fc40 con 0x7f75c4106f10 2024-09-19T06:53:21.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.556+0000 7f75ca15f640 1 -- 172.21.15.12:0/2438674351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c41a4f70 con 0x7f75c4106f10 2024-09-19T06:53:21.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.557+0000 7f75ca15f640 1 -- 172.21.15.12:0/2438674351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c41021c0 con 0x7f75c4106f10 2024-09-19T06:53:21.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.558+0000 7f75c0ff9640 1 -- 172.21.15.12:0/2438674351 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f75bc004050 con 0x7f75c4106f10 2024-09-19T06:53:21.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.559+0000 7f75c0ff9640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75ac0a33b0 0x7f75ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:21.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.559+0000 7f75c37fe640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75ac0a33b0 0x7f75ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:21.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.559+0000 7f75c0ff9640 1 -- 172.21.15.12:0/2438674351 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f75bc0f1190 con 0x7f75c4106f10 2024-09-19T06:53:21.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.559+0000 7f75c37fe640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75ac0a33b0 0x7f75ac0a5870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009b60 tx=0x7f75b4005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:21.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.562+0000 7f75c0ff9640 1 -- 172.21.15.12:0/2438674351 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f75bc004730 con 0x7f75c4106f10 2024-09-19T06:53:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:21.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.798+0000 7f75ca15f640 1 -- 172.21.15.12:0/2438674351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75c410a150 con 0x7f75c4106f10 2024-09-19T06:53:21.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.798+0000 7f75c0ff9640 1 -- 172.21.15.12:0/2438674351 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11979 (secure 0 0 0) 0x7f75bc0bdc10 con 0x7f75c4106f10 2024-09-19T06:53:21.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:53:21.800 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"btime":"2024-09-19T06:53:15:066450+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:53:14.418167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:53:21.800 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 -- 172.21.15.12:0/2438674351 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75ac0a33b0 msgr2=0x7f75ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75ac0a33b0 0x7f75ac0a5870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009b60 tx=0x7f75b4005f90 comp rx=0 tx=0).stop 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 -- 172.21.15.12:0/2438674351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c4106f10 msgr2=0x7f75c419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c4106f10 0x7f75c419ccc0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f75bc031a20 tx=0x7f75bc031a50 comp rx=0 tx=0).stop 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 -- 172.21.15.12:0/2438674351 shutdown_connections 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c4106f10 0x7f75c419ccc0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75c4102790 0x7f75c4198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f75ac0a33b0 0x7f75ac0a5870 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 --2- 172.21.15.12:0/2438674351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4101de0 0x7f75c41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 -- 172.21.15.12:0/2438674351 >> 172.21.15.12:0/2438674351 conn(0x7f75c40fd8c0 msgr2=0x7f75c40feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:21.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 -- 172.21.15.12:0/2438674351 shutdown_connections 2024-09-19T06:53:21.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:21.801+0000 7f75ca15f640 1 -- 172.21.15.12:0/2438674351 wait complete. 2024-09-19T06:53:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:22 smithi012 ceph-mon[30937]: pgmap v413: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 1.23k op/s 2024-09-19T06:53:22.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:22 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2438674351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:22.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:22 smithi016 ceph-mon[34911]: pgmap v413: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 1.23k op/s 2024-09-19T06:53:22.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:22 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2438674351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:22.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:22 smithi173 ceph-mon[35349]: pgmap v413: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 1.23k op/s 2024-09-19T06:53:22.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:22 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2438674351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:22.601 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id b17f4ae5 --release --await' 2024-09-19T06:53:22.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id b17f4ae5 --release --await 2024-09-19T06:53:22.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.807+0000 7fa1e51ec640 1 -- 172.21.15.12:0/2029265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1e0102570 msgr2=0x7fa1e01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.807+0000 7fa1e51ec640 1 --2- 172.21.15.12:0/2029265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1e0102570 0x7fa1e01029b0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009900 tx=0x7fa1d402a480 comp rx=0 tx=0).stop 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.808+0000 7fa1e51ec640 1 -- 172.21.15.12:0/2029265 shutdown_connections 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.808+0000 7fa1e51ec640 1 --2- 172.21.15.12:0/2029265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1e0102ef0 0x7fa1e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.808+0000 7fa1e51ec640 1 --2- 172.21.15.12:0/2029265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1e0102570 0x7fa1e01029b0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.808+0000 7fa1e51ec640 1 --2- 172.21.15.12:0/2029265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1e0100e20 0x7fa1e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.808+0000 7fa1e51ec640 1 -- 172.21.15.12:0/2029265 >> 172.21.15.12:0/2029265 conn(0x7fa1e00fc7d0 msgr2=0x7fa1e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.808+0000 7fa1e51ec640 1 -- 172.21.15.12:0/2029265 shutdown_connections 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.808+0000 7fa1e51ec640 1 -- 172.21.15.12:0/2029265 wait complete. 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.808+0000 7fa1e51ec640 1 Processor -- start 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1e51ec640 1 -- start start 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1e51ec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1e0100e20 0x7fa1e01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1e51ec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1e0102570 0x7fa1e01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1e51ec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1e0102ef0 0x7fa1e019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1e51ec640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e0110f80 con 0x7fa1e0102ef0 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1e51ec640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e0110e00 con 0x7fa1e0100e20 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1e51ec640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e0111100 con 0x7fa1e0102570 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1df59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1e0102ef0 0x7fa1e019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1df59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1e0102ef0 0x7fa1e019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48788/0 (socket says 172.21.15.12:48788) 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1df59e640 1 -- 172.21.15.12:0/718328696 learned_addr learned my addr 172.21.15.12:0/718328696 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1e0100e20 0x7fa1e01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.809+0000 7fa1de59c640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1e0102570 0x7fa1e01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1df59e640 1 -- 172.21.15.12:0/718328696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1e0102570 msgr2=0x7fa1e01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1df59e640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1e0102570 0x7fa1e01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1df59e640 1 -- 172.21.15.12:0/718328696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1e0100e20 msgr2=0x7fa1e01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1df59e640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1e0100e20 0x7fa1e01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1df59e640 1 -- 172.21.15.12:0/718328696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e019d460 con 0x7fa1e0102ef0 2024-09-19T06:53:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1e0100e20 0x7fa1e01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1df59e640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1e0102ef0 0x7fa1e019cd80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800eb10 tx=0x7fa1d800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1c7fff640 1 -- 172.21.15.12:0/718328696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8004b20 con 0x7fa1e0102ef0 2024-09-19T06:53:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1e51ec640 1 -- 172.21.15.12:0/718328696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e019d750 con 0x7fa1e0102ef0 2024-09-19T06:53:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1c7fff640 1 -- 172.21.15.12:0/718328696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d8004cc0 con 0x7fa1e0102ef0 2024-09-19T06:53:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1c7fff640 1 -- 172.21.15.12:0/718328696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8010760 con 0x7fa1e0102ef0 2024-09-19T06:53:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.810+0000 7fa1e51ec640 1 -- 172.21.15.12:0/718328696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e01a5030 con 0x7fa1e0102ef0 2024-09-19T06:53:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1e75c5740 1 Processor -- start 2024-09-19T06:53:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1c7fff640 1 -- 172.21.15.12:0/718328696 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa1d8010900 con 0x7fa1e0102ef0 2024-09-19T06:53:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1e75c5740 1 -- start start 2024-09-19T06:53:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127db40 0x56258127c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x56258127ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x562581289760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5625811e22f0 con 0x56258127c5d0 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562581189cf0 con 0x56258127db40 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5625811de2b0 con 0x562581287370 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1ded9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x56258127ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.813+0000 7fa1de59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127db40 0x56258127c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1de59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127db40 0x56258127c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45928/0 (socket says 172.21.15.12:45928) 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1de59c640 1 -- 172.21.15.12:0/2655775509 learned_addr learned my addr 172.21.15.12:0/2655775509 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1de59c640 1 --2- 172.21.15.12:0/2655775509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x562581289760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1c7fff640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa1c80a3430 0x7fa1c80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1ded9d640 1 -- 172.21.15.12:0/2655775509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 msgr2=0x562581289760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/2655775509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x562581289760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1ded9d640 1 -- 172.21.15.12:0/2655775509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127db40 msgr2=0x56258127c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/2655775509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127db40 0x56258127c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1ded9d640 1 -- 172.21.15.12:0/2655775509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258116e3a0 con 0x56258127c5d0 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1de59c640 1 --2- 172.21.15.12:0/2655775509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127db40 0x56258127c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1c7fff640 1 -- 172.21.15.12:0/718328696 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fa1d80d04b0 con 0x7fa1e0102ef0 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/2655775509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x56258127ca10 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000bc80 tx=0x7fa1d000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f4b5517f866749 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.814+0000 7fa1c57fa640 1 -- 172.21.15.12:0/2655775509 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0015070 con 0x56258127c5d0 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.815+0000 7fa1df59e640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa1c80a3430 0x7fa1c80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.815+0000 7fa1c57fa640 1 -- 172.21.15.12:0/2655775509 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d001a940 con 0x56258127c5d0 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.815+0000 7fa1c57fa640 1 -- 172.21.15.12:0/2655775509 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00118e0 con 0x56258127c5d0 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2655775509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 msgr2=0x56258127ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2655775509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x56258127ca10 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000bc80 tx=0x7fa1d000f730 comp rx=0 tx=0).stop 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1df59e640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa1c80a3430 0x7fa1c80a58f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80cdc10 tx=0x7fa1d8014000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2655775509 shutdown_connections 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2655775509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x562581289760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2655775509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x56258127ca10 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2655775509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127db40 0x56258127c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2655775509 >> 172.21.15.12:0/2655775509 conn(0x562581245310 msgr2=0x562581278c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2655775509 shutdown_connections 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2655775509 wait complete. 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 -- start start 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.816+0000 7fa1e75c5740 1 Processor -- start 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 0x562581286d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x562581283ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x5625812845e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56258128a0c0 con 0x56258127db40 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56258119d060 con 0x56258127c5d0 2024-09-19T06:53:22.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56258128a240 con 0x562581287370 2024-09-19T06:53:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1e75c5740 10 client.0 _ll_register_callbacks cb 0x562580ef08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1ded9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x562581283ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1ded9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x562581283ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48808/0 (socket says 172.21.15.12:48808) 2024-09-19T06:53:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1ded9d640 1 -- 172.21.15.12:0/4008033668 learned_addr learned my addr 172.21.15.12:0/4008033668 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1de59c640 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 0x562581286d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1de59c640 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x5625812845e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1ded9d640 1 -- 172.21.15.12:0/4008033668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 msgr2=0x5625812845e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x5625812845e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1ded9d640 1 -- 172.21.15.12:0/4008033668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 msgr2=0x562581286d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 0x562581286d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1ded9d640 1 -- 172.21.15.12:0/4008033668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562580f533c0 con 0x56258127db40 2024-09-19T06:53:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.817+0000 7fa1de59c640 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 0x562581286d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x562581283ff0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0005890 tx=0x7fa1d000bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c4c65e54671a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/4008033668 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0015070 con 0x56258127db40 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/4008033668 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fa1d001ad80 con 0x56258127db40 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1e75c5740 1 -- 172.21.15.12:0/4008033668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1d001a940 con 0x56258127db40 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/4008033668 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fa1d001a460 con 0x56258127db40 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1e75c5740 10 client.19104 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1e75c5740 1 -- 172.21.15.12:0/4008033668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x56258129e340 con 0x56258127db40 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/4008033668 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d001a940 con 0x56258127db40 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/4008033668 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7fa1d0005410 con 0x56258127db40 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1e75c5740 10 client.19104 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.818+0000 7fa1e75c5740 10 client.19104 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.819+0000 7fa1e75c5740 20 client.19104 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.819+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56258129f690 0x5625812a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.819+0000 7fa1e75c5740 4 client.19104 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.819+0000 7fa1e75c5740 1 -- 172.21.15.12:0/4008033668 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625811ef860 con 0x56258129f690 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.819+0000 7fa1de59c640 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56258129f690 0x5625812a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.819+0000 7fa1de59c640 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56258129f690 0x5625812a1a80 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=120f50260e70f129 server_cookie=35863368a51a0fe8 in_seq=0 out_seq=0 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.819+0000 7fa1c2ff5640 10 client.19104 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/4008033668 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625811ef860 con 0x56258129f690 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1c2ff5640 10 client.19104 handle_command_reply: tid=0 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 client.19104 shutdown 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 -- 172.21.15.12:0/4008033668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 msgr2=0x562581283ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x562581283ff0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0005890 tx=0x7fa1d000bfa0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 -- 172.21.15.12:0/4008033668 shutdown_connections 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56258129f690 0x5625812a1a80 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x5625812845e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x562581283ff0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1c2ff5640 0 client.19104 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:53:22.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/4008033668 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 0x562581286d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 -- 172.21.15.12:0/4008033668 >> 172.21.15.12:0/4008033668 conn(0x562581245310 msgr2=0x56258127e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:22.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 -- 172.21.15.12:0/4008033668 shutdown_connections 2024-09-19T06:53:22.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 1 -- 172.21.15.12:0/4008033668 wait complete. 2024-09-19T06:53:22.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.820+0000 7fa1e75c5740 20 client.19104 trim_cache size 0 max 16384 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1e75c5740 1 Processor -- start 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1e75c5740 1 -- start start 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x5625812a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56258127db40 0x5625812838b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562581287370 0x562581285f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01ab910 con 0x56258127c5d0 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01ad540 con 0x562581287370 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01abfe0 con 0x56258127db40 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1de59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x5625812a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1de59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x5625812a1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48816/0 (socket says 172.21.15.12:48816) 2024-09-19T06:53:22.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.838+0000 7fa1de59c640 1 -- 172.21.15.12:0/2121704577 learned_addr learned my addr 172.21.15.12:0/2121704577 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:22.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.839+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/2121704577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56258127db40 0x5625812838b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.839+0000 7fa1de59c640 1 -- 172.21.15.12:0/2121704577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56258127db40 msgr2=0x5625812838b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:22.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.839+0000 7fa1de59c640 1 --2- 172.21.15.12:0/2121704577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56258127db40 0x5625812838b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.839+0000 7fa1de59c640 1 -- 172.21.15.12:0/2121704577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562581287370 msgr2=0x562581285f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:22.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.839+0000 7fa1de59c640 1 --2- 172.21.15.12:0/2121704577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562581287370 0x562581285f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.839+0000 7fa1de59c640 1 -- 172.21.15.12:0/2121704577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562581284950 con 0x56258127c5d0 2024-09-19T06:53:22.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.839+0000 7fa1de59c640 1 --2- 172.21.15.12:0/2121704577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x5625812a1a80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4006010 tx=0x7fa1d4040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae7164ec738a626 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:22.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.839+0000 7fa1c4ff9640 1 -- 172.21.15.12:0/2121704577 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4059070 con 0x56258127c5d0 2024-09-19T06:53:22.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.839+0000 7fa1c4ff9640 1 -- 172.21.15.12:0/2121704577 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d4032b90 con 0x56258127c5d0 2024-09-19T06:53:22.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.839+0000 7fa1c4ff9640 1 -- 172.21.15.12:0/2121704577 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4035040 con 0x56258127c5d0 2024-09-19T06:53:22.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.840+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2121704577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 msgr2=0x5625812a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:22.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.840+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2121704577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x5625812a1a80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4006010 tx=0x7fa1d4040040 comp rx=0 tx=0).stop 2024-09-19T06:53:22.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.840+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2121704577 shutdown_connections 2024-09-19T06:53:22.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.840+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2121704577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562581287370 0x562581285f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.840+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2121704577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56258127db40 0x5625812838b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.840+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2121704577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127c5d0 0x5625812a1a80 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.840+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2121704577 >> 172.21.15.12:0/2121704577 conn(0x562581245310 msgr2=0x562581285850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.840+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2121704577 shutdown_connections 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.840+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2121704577 wait complete. 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.840+0000 7fa1e75c5740 1 -- start start 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1e75c5740 1 Processor -- start 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 0x5625812934a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x5625812939e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1e75c5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x562581308180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01ace70 con 0x56258127db40 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01ac6e0 con 0x56258127c5d0 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1e75c5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01a9910 con 0x562581287370 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1e75c5740 10 client.0 _ll_register_callbacks cb 0x7fa1d80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:22.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1ded9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x5625812939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1ded9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x5625812939e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48826/0 (socket says 172.21.15.12:48826) 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1ded9d640 1 -- 172.21.15.12:0/2614613817 learned_addr learned my addr 172.21.15.12:0/2614613817 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1de59c640 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 0x5625812934a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1de59c640 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x562581308180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1ded9d640 1 -- 172.21.15.12:0/2614613817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 msgr2=0x562581308180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x562581308180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1ded9d640 1 -- 172.21.15.12:0/2614613817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 msgr2=0x5625812934a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 0x5625812934a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1ded9d640 1 -- 172.21.15.12:0/2614613817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562581308870 con 0x56258127db40 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.841+0000 7fa1de59c640 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x562581308180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1ded9d640 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x5625812939e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0006010 tx=0x7fa1d0011510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9f65ea2b3d4602 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:22.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/2614613817 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0015040 con 0x56258127db40 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2614613817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1d4032b90 con 0x56258127db40 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/2614613817 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fa1d000b520 con 0x56258127db40 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/2614613817 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fa1d000b7c0 con 0x56258127db40 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1e75c5740 10 client.19110 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2614613817 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x562581309b50 con 0x56258127db40 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/2614613817 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d4032b90 con 0x56258127db40 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/2614613817 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7fa1d0031030 con 0x56258127db40 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1e75c5740 10 client.19110 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1e75c5740 10 client.19110 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.842+0000 7fa1e75c5740 20 client.19110 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.843+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56258130a300 0x56258130c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.843+0000 7fa1e75c5740 4 client.19110 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.843+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2614613817 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5625811e9d70 con 0x56258130a300 2024-09-19T06:53:22.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.843+0000 7fa1de59c640 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56258130a300 0x56258130c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.843+0000 7fa1de59c640 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56258130a300 0x56258130c720 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=185cf8741e03882c server_cookie=82286b1d4e811e6f in_seq=0 out_seq=0 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.843+0000 7fa1c2ff5640 10 client.19110 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1c2ff5640 1 -- 172.21.15.12:0/2614613817 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5625811e9d70 con 0x56258130a300 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1c2ff5640 10 client.19110 handle_command_reply: tid=0 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 client.19110 shutdown 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2614613817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 msgr2=0x5625812939e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x5625812939e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0006010 tx=0x7fa1d0011510 comp rx=0 tx=0).stop 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2614613817 shutdown_connections 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x56258130a300 0x56258130c720 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562581287370 0x562581308180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56258127db40 0x5625812939e0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 --2- 172.21.15.12:0/2614613817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56258127c5d0 0x5625812934a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2614613817 >> 172.21.15.12:0/2614613817 conn(0x562581245310 msgr2=0x562581286070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:22.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1c2ff5640 0 client.19110 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:53:22.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2614613817 shutdown_connections 2024-09-19T06:53:22.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 1 -- 172.21.15.12:0/2614613817 wait complete. 2024-09-19T06:53:22.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.844+0000 7fa1e75c5740 20 client.19110 trim_cache size 0 max 16384 2024-09-19T06:53:22.850 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 -- 172.21.15.12:0/718328696 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa1c80a3430 msgr2=0x7fa1c80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa1c80a3430 0x7fa1c80a58f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80cdc10 tx=0x7fa1d8014000 comp rx=0 tx=0).stop 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 -- 172.21.15.12:0/718328696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1e0102ef0 msgr2=0x7fa1e019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1e0102ef0 0x7fa1e019cd80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800eb10 tx=0x7fa1d800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 -- 172.21.15.12:0/718328696 shutdown_connections 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1e0102ef0 0x7fa1e019cd80 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa1c80a3430 0x7fa1c80a58f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1e0102570 0x7fa1e01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 --2- 172.21.15.12:0/718328696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1e0100e20 0x7fa1e01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 -- 172.21.15.12:0/718328696 >> 172.21.15.12:0/718328696 conn(0x7fa1e00fc7d0 msgr2=0x7fa1e006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:22.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 -- 172.21.15.12:0/718328696 shutdown_connections 2024-09-19T06:53:22.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:22.845+0000 7fa1e51ec640 1 -- 172.21.15.12:0/718328696 wait complete. 2024-09-19T06:53:23.106 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:23.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:53:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.180+0000 7f1d1fa66640 1 -- 172.21.15.12:0/3787818630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d18102d40 msgr2=0x7f1d18103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.180+0000 7f1d1fa66640 1 --2- 172.21.15.12:0/3787818630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d18102d40 0x7f1d18103120 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009ca0 tx=0x7f1d0802a950 comp rx=0 tx=0).stop 2024-09-19T06:53:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.180+0000 7f1d1fa66640 1 -- 172.21.15.12:0/3787818630 shutdown_connections 2024-09-19T06:53:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.180+0000 7f1d1fa66640 1 --2- 172.21.15.12:0/3787818630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d1810c170 0x7f1d1810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.180+0000 7f1d1fa66640 1 --2- 172.21.15.12:0/3787818630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d18103660 0x7f1d1810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.180+0000 7f1d1fa66640 1 --2- 172.21.15.12:0/3787818630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d18102d40 0x7f1d18103120 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.180+0000 7f1d1fa66640 1 -- 172.21.15.12:0/3787818630 >> 172.21.15.12:0/3787818630 conn(0x7f1d180fc7a0 msgr2=0x7f1d180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.180+0000 7f1d1fa66640 1 -- 172.21.15.12:0/3787818630 shutdown_connections 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.180+0000 7f1d1fa66640 1 -- 172.21.15.12:0/3787818630 wait complete. 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.180+0000 7f1d1fa66640 1 Processor -- start 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1fa66640 1 -- start start 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1fa66640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d18102d40 0x7f1d181009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1fa66640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d18103660 0x7f1d18100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1fa66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d1810c170 0x7f1d18101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1fa66640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1d18111f70 con 0x7f1d1810c170 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1fa66640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1d18111df0 con 0x7f1d18102d40 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1fa66640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d181120f0 con 0x7f1d18103660 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1e003640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d1810c170 0x7f1d18101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1e003640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d1810c170 0x7f1d18101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48844/0 (socket says 172.21.15.12:48844) 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1e003640 1 -- 172.21.15.12:0/628475643 learned_addr learned my addr 172.21.15.12:0/628475643 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1d802640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d18102d40 0x7f1d181009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1d001640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d18103660 0x7f1d18100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1e003640 1 -- 172.21.15.12:0/628475643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d18103660 msgr2=0x7f1d18100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1e003640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d18103660 0x7f1d18100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1e003640 1 -- 172.21.15.12:0/628475643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d18102d40 msgr2=0x7f1d181009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1e003640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d18102d40 0x7f1d181009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1e003640 1 -- 172.21.15.12:0/628475643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d181a6910 con 0x7f1d1810c170 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1d001640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d18103660 0x7f1d18100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.181+0000 7f1d1e003640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d1810c170 0x7f1d18101420 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00e970 tx=0x7f1d0c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.182+0000 7f1d16ffd640 1 -- 172.21.15.12:0/628475643 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c00ccc0 con 0x7f1d1810c170 2024-09-19T06:53:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.182+0000 7f1d16ffd640 1 -- 172.21.15.12:0/628475643 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d0c00ce60 con 0x7f1d1810c170 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.182+0000 7f1d16ffd640 1 -- 172.21.15.12:0/628475643 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c010490 con 0x7f1d1810c170 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.182+0000 7f1d1fa66640 1 -- 172.21.15.12:0/628475643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d181a6c00 con 0x7f1d1810c170 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.182+0000 7f1d1fa66640 1 -- 172.21.15.12:0/628475643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d181a70f0 con 0x7f1d1810c170 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.184+0000 7f1d16ffd640 1 -- 172.21.15.12:0/628475643 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1d0c005020 con 0x7f1d1810c170 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.184+0000 7f1d21e3f740 1 Processor -- start 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.184+0000 7f1d21e3f740 1 -- start start 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cef3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cefdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf00630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55998ce58620 con 0x55998cefe240 2024-09-19T06:53:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55998cdffe50 con 0x55998cef3980 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55998ce545e0 con 0x55998cef3060 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d001640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf00630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d001640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf00630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48850/0 (socket says 172.21.15.12:48850) 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d001640 1 -- 172.21.15.12:0/3357112073 learned_addr learned my addr 172.21.15.12:0/3357112073 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d802640 1 --2- 172.21.15.12:0/3357112073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cefdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d001640 1 --2- 172.21.15.12:0/3357112073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cef3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d16ffd640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1d000a33b0 0x7f1d000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d001640 1 -- 172.21.15.12:0/3357112073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 msgr2=0x55998cef3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d001640 1 --2- 172.21.15.12:0/3357112073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cef3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d001640 1 -- 172.21.15.12:0/3357112073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 msgr2=0x55998cefdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d001640 1 --2- 172.21.15.12:0/3357112073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cefdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d001640 1 -- 172.21.15.12:0/3357112073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55998cdf0d40 con 0x55998cefe240 2024-09-19T06:53:24.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1d802640 1 --2- 172.21.15.12:0/3357112073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cefdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:24.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d1e003640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1d000a33b0 0x7f1d000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.185+0000 7f1d16ffd640 1 -- 172.21.15.12:0/628475643 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f1d0c0d01b0 con 0x7f1d1810c170 2024-09-19T06:53:24.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.186+0000 7f1d1d001640 1 --2- 172.21.15.12:0/3357112073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf00630 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f1d10014910 tx=0x7f1d100096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d7e8a3f875e3e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.186+0000 7f1cfffff640 1 -- 172.21.15.12:0/3357112073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10004030 con 0x55998cefe240 2024-09-19T06:53:24.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.186+0000 7f1d1e003640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1d000a33b0 0x7f1d000a5870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0cd9b0 tx=0x7f1d0c066dd0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.186+0000 7f1cfffff640 1 -- 172.21.15.12:0/3357112073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d1000fc40 con 0x55998cefe240 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.186+0000 7f1cfffff640 1 -- 172.21.15.12:0/3357112073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10003850 con 0x55998cefe240 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 -- 172.21.15.12:0/3357112073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 msgr2=0x55998cf00630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/3357112073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf00630 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f1d10014910 tx=0x7f1d100096f0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 -- 172.21.15.12:0/3357112073 shutdown_connections 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/3357112073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf00630 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/3357112073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cefdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/3357112073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cef3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 -- 172.21.15.12:0/3357112073 >> 172.21.15.12:0/3357112073 conn(0x55998ceef5f0 msgr2=0x55998ceef9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 -- 172.21.15.12:0/3357112073 shutdown_connections 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 -- 172.21.15.12:0/3357112073 wait complete. 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 -- start start 2024-09-19T06:53:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.187+0000 7f1d21e3f740 1 Processor -- start 2024-09-19T06:53:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cefb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cefb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cefbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55998cf00e10 con 0x55998cefe240 2024-09-19T06:53:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55998cde0f10 con 0x55998cef3980 2024-09-19T06:53:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55998cf00f90 con 0x55998cef3060 2024-09-19T06:53:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d21e3f740 10 client.0 _ll_register_callbacks cb 0x55998ce04db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d001640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cefbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d001640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cefbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48864/0 (socket says 172.21.15.12:48864) 2024-09-19T06:53:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d001640 1 -- 172.21.15.12:0/638199803 learned_addr learned my addr 172.21.15.12:0/638199803 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d802640 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cefb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d001640 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cefb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d802640 1 -- 172.21.15.12:0/638199803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 msgr2=0x55998cefb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d802640 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cefb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d802640 1 -- 172.21.15.12:0/638199803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 msgr2=0x55998cefbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d802640 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cefbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d802640 1 -- 172.21.15.12:0/638199803 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55998cb67580 con 0x55998cef3980 2024-09-19T06:53:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d001640 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cefbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1d1d802640 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cefb650 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1d0802ae70 tx=0x7f1d0802ffe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44bee09e0c1f14c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.188+0000 7f1cfd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:53:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.189+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/638199803 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08049060 con 0x55998cef3980 2024-09-19T06:53:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.189+0000 7f1d21e3f740 1 -- 172.21.15.12:0/638199803 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d1000fc40 con 0x55998cef3980 2024-09-19T06:53:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.189+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/638199803 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f1d08003970 con 0x55998cef3980 2024-09-19T06:53:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.189+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/638199803 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1d08050050 con 0x55998cef3980 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.189+0000 7f1d21e3f740 10 client.28445 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.189+0000 7f1d21e3f740 1 -- 172.21.15.12:0/638199803 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55998cc31960 con 0x55998cef3980 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.189+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/638199803 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d1000fc40 con 0x55998cef3980 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.189+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/638199803 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f1d08030440 con 0x55998cef3980 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.190+0000 7f1d21e3f740 10 client.28445 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.190+0000 7f1d21e3f740 10 client.28445 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.190+0000 7f1d21e3f740 20 client.28445 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.190+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55998cf0dd30 0x55998cf10160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.190+0000 7f1d21e3f740 4 client.28445 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.190+0000 7f1d21e3f740 1 -- 172.21.15.12:0/638199803 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55998ce65b90 con 0x55998cf0dd30 2024-09-19T06:53:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.190+0000 7f1d1d001640 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55998cf0dd30 0x55998cf10160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.190+0000 7f1d1d001640 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55998cf0dd30 0x55998cf10160 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a163e7ec469180f4 server_cookie=bb687be5a39d4fe9 in_seq=0 out_seq=0 2024-09-19T06:53:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.190+0000 7f1cfd7fa640 10 client.28445 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/638199803 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55998ce65b90 con 0x55998cf0dd30 2024-09-19T06:53:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1cfd7fa640 10 client.28445 handle_command_reply: tid=0 2024-09-19T06:53:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 client.28445 shutdown 2024-09-19T06:53:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 -- 172.21.15.12:0/638199803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 msgr2=0x55998cefb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cefb650 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1d0802ae70 tx=0x7f1d0802ffe0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 -- 172.21.15.12:0/638199803 shutdown_connections 2024-09-19T06:53:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55998cf0dd30 0x55998cf10160 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cefbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cefb650 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/638199803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cefb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1cfd7fa640 0 client.28445 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 -- 172.21.15.12:0/638199803 >> 172.21.15.12:0/638199803 conn(0x55998ceef5f0 msgr2=0x55998cef52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 -- 172.21.15.12:0/638199803 shutdown_connections 2024-09-19T06:53:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 1 -- 172.21.15.12:0/638199803 wait complete. 2024-09-19T06:53:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.191+0000 7f1d21e3f740 20 client.28445 trim_cache size 0 max 16384 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.209+0000 7f1d21e3f740 1 Processor -- start 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.209+0000 7f1d21e3f740 1 -- start start 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cf15a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cef3980 0x55998cf15f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cefe240 0x55998cef8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1d181afd80 con 0x55998cef3980 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1d181b19b0 con 0x55998cefe240 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d181b0450 con 0x55998cef3060 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d802640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cef3980 0x55998cf15f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d802640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cef3980 0x55998cf15f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48868/0 (socket says 172.21.15.12:48868) 2024-09-19T06:53:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d802640 1 -- 172.21.15.12:0/557081072 learned_addr learned my addr 172.21.15.12:0/557081072 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d001640 1 --2- 172.21.15.12:0/557081072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cefe240 0x55998cef8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d802640 1 -- 172.21.15.12:0/557081072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 msgr2=0x55998cf15a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d001640 1 --2- 172.21.15.12:0/557081072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cf15a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d802640 1 --2- 172.21.15.12:0/557081072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cf15a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d802640 1 -- 172.21.15.12:0/557081072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cefe240 msgr2=0x55998cef8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d802640 1 --2- 172.21.15.12:0/557081072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cefe240 0x55998cef8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d802640 1 -- 172.21.15.12:0/557081072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55998ceedbb0 con 0x55998cef3980 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d001640 1 --2- 172.21.15.12:0/557081072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cf15a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.210+0000 7f1d1d802640 1 --2- 172.21.15.12:0/557081072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cef3980 0x55998cf15f70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f1d0804e040 tx=0x7f1d0802f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913c0873b3b06fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.211+0000 7f1cff7fe640 1 -- 172.21.15.12:0/557081072 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08059070 con 0x55998cef3980 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.211+0000 7f1cff7fe640 1 -- 172.21.15.12:0/557081072 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d08030640 con 0x55998cef3980 2024-09-19T06:53:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.211+0000 7f1cff7fe640 1 -- 172.21.15.12:0/557081072 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08049040 con 0x55998cef3980 2024-09-19T06:53:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.212+0000 7f1d21e3f740 1 -- 172.21.15.12:0/557081072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cef3980 msgr2=0x55998cf15f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.212+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/557081072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cef3980 0x55998cf15f70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f1d0804e040 tx=0x7f1d0802f8a0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.212+0000 7f1d21e3f740 1 -- 172.21.15.12:0/557081072 shutdown_connections 2024-09-19T06:53:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.212+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/557081072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cefe240 0x55998cef8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.212+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/557081072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cef3980 0x55998cf15f70 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.212+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/557081072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cf15a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.212+0000 7f1d21e3f740 1 -- 172.21.15.12:0/557081072 >> 172.21.15.12:0/557081072 conn(0x55998ceef5f0 msgr2=0x55998cefc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.212+0000 7f1d21e3f740 1 -- 172.21.15.12:0/557081072 shutdown_connections 2024-09-19T06:53:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.212+0000 7f1d21e3f740 1 -- 172.21.15.12:0/557081072 wait complete. 2024-09-19T06:53:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.213+0000 7f1d21e3f740 1 -- start start 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.213+0000 7f1d21e3f740 1 Processor -- start 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cf02660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cf02ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d21e3f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf77a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1d181b12e0 con 0x55998cefe240 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1d181b0b50 con 0x55998cef3980 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d21e3f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d181add80 con 0x55998cef3060 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d21e3f740 10 client.0 _ll_register_callbacks cb 0x7f1d0802fea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d1d001640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf77a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d1d001640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf77a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48870/0 (socket says 172.21.15.12:48870) 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d1d001640 1 -- 172.21.15.12:0/2451801807 learned_addr learned my addr 172.21.15.12:0/2451801807 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d1d001640 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cf02660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d1d802640 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cf02ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d1d001640 1 -- 172.21.15.12:0/2451801807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 msgr2=0x55998cf02660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d1d001640 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cf02660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d1d001640 1 -- 172.21.15.12:0/2451801807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 msgr2=0x55998cf02ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d1d001640 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cf02ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.214+0000 7f1d1d001640 1 -- 172.21.15.12:0/2451801807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55998cf77f40 con 0x55998cefe240 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.215+0000 7f1d1d001640 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf77a00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009460 tx=0x7f1d10009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2c82e101da58ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.215+0000 7f1cfd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.215+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/2451801807 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10014190 con 0x55998cefe240 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.215+0000 7f1d21e3f740 1 -- 172.21.15.12:0/2451801807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d08030640 con 0x55998cefe240 2024-09-19T06:53:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.215+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/2451801807 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f1d1000fa40 con 0x55998cefe240 2024-09-19T06:53:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.215+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/2451801807 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1d1003e050 con 0x55998cefe240 2024-09-19T06:53:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.215+0000 7f1d21e3f740 10 client.19128 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.215+0000 7f1d21e3f740 1 -- 172.21.15.12:0/2451801807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55998cf791c0 con 0x55998cefe240 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.216+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/2451801807 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d08030640 con 0x55998cefe240 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.216+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/2451801807 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f1d10012450 con 0x55998cefe240 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.216+0000 7f1d21e3f740 10 client.19128 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.216+0000 7f1d21e3f740 10 client.19128 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.216+0000 7f1d21e3f740 20 client.19128 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.216+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55998cf79700 0x55998cf7bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.216+0000 7f1d21e3f740 4 client.19128 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b17f4ae5", "release": true, "await": true}] 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.216+0000 7f1d21e3f740 1 -- 172.21.15.12:0/2451801807 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b17f4ae5", "release": true, "await": true}) -- 0x55998ce600a0 con 0x55998cf79700 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.216+0000 7f1d1d802640 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55998cf79700 0x55998cf7bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.217+0000 7f1cfd7fa640 10 client.19128 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.217+0000 7f1d1d802640 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55998cf79700 0x55998cf7bb20 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=408b9b6818e26cde server_cookie=f0b38ab673e5454a in_seq=0 out_seq=0 2024-09-19T06:53:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.253+0000 7f1cfd7fa640 1 -- 172.21.15.12:0/2451801807 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55998ce600a0 con 0x55998cf79700 2024-09-19T06:53:24.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.253+0000 7f1cfd7fa640 10 client.19128 handle_command_reply: tid=0 2024-09-19T06:53:24.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.253+0000 7f1d21e3f740 1 client.19128 shutdown 2024-09-19T06:53:24.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.253+0000 7f1d21e3f740 1 -- 172.21.15.12:0/2451801807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 msgr2=0x55998cf77a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.253+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf77a00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009460 tx=0x7f1d10009b30 comp rx=0 tx=0).stop 2024-09-19T06:53:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.257+0000 7f1d21e3f740 1 -- 172.21.15.12:0/2451801807 shutdown_connections 2024-09-19T06:53:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.257+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55998cf79700 0x55998cf7bb20 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.257+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55998cefe240 0x55998cf77a00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.257+0000 7f1cfd7fa640 0 client.19128 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.257+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55998cef3980 0x55998cf02ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.257+0000 7f1d21e3f740 1 --2- 172.21.15.12:0/2451801807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55998cef3060 0x55998cf02660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.257+0000 7f1d21e3f740 1 -- 172.21.15.12:0/2451801807 >> 172.21.15.12:0/2451801807 conn(0x55998ceef5f0 msgr2=0x55998ceedf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.257+0000 7f1d21e3f740 1 -- 172.21.15.12:0/2451801807 shutdown_connections 2024-09-19T06:53:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.257+0000 7f1d21e3f740 1 -- 172.21.15.12:0/2451801807 wait complete. 2024-09-19T06:53:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.258+0000 7f1d21e3f740 20 client.19128 trim_cache size 0 max 16384 2024-09-19T06:53:24.261 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 49, 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 44, 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "b17f4ae5": { 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 44, 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:53:24.262 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 142.2, 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:24.263 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:53:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.266+0000 7f1d1fa66640 1 -- 172.21.15.12:0/628475643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1d000a33b0 msgr2=0x7f1d000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.266+0000 7f1d1fa66640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1d000a33b0 0x7f1d000a5870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0cd9b0 tx=0x7f1d0c066dd0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.266+0000 7f1d1fa66640 1 -- 172.21.15.12:0/628475643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d1810c170 msgr2=0x7f1d18101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.266+0000 7f1d1fa66640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d1810c170 0x7f1d18101420 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00e970 tx=0x7f1d0c00ed70 comp rx=0 tx=0).stop 2024-09-19T06:53:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.266+0000 7f1d1fa66640 1 -- 172.21.15.12:0/628475643 shutdown_connections 2024-09-19T06:53:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.266+0000 7f1d1fa66640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d1810c170 0x7f1d18101420 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.266+0000 7f1d1fa66640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1d000a33b0 0x7f1d000a5870 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.266+0000 7f1d1fa66640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d18103660 0x7f1d18100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.266+0000 7f1d1fa66640 1 --2- 172.21.15.12:0/628475643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d18102d40 0x7f1d181009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.266+0000 7f1d1fa66640 1 -- 172.21.15.12:0/628475643 >> 172.21.15.12:0/628475643 conn(0x7f1d180fc7a0 msgr2=0x7f1d180fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:24.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.267+0000 7f1d1fa66640 1 -- 172.21.15.12:0/628475643 shutdown_connections 2024-09-19T06:53:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:24.271+0000 7f1d1fa66640 1 -- 172.21.15.12:0/628475643 wait complete. 2024-09-19T06:53:24.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:24 smithi012 ceph-mon[30937]: pgmap v414: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 MiB/s wr, 1.07k op/s 2024-09-19T06:53:24.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:24 smithi016 ceph-mon[34911]: pgmap v414: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 MiB/s wr, 1.07k op/s 2024-09-19T06:53:24.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:24 smithi173 ceph-mon[35349]: pgmap v414: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 MiB/s wr, 1.07k op/s 2024-09-19T06:53:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.186+0000 7f8c0426a640 1 -- 172.21.15.12:0/1792410337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc101470 msgr2=0x7f8bfc101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.186+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1792410337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc101470 0x7f8bfc101850 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009900 tx=0x7f8bf802a410 comp rx=0 tx=0).stop 2024-09-19T06:53:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.186+0000 7f8c0426a640 1 -- 172.21.15.12:0/1792410337 shutdown_connections 2024-09-19T06:53:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.186+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1792410337 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bfc105de0 0x7f8bfc10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.186+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1792410337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc101e20 0x7f8bfc1056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.186+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1792410337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc101470 0x7f8bfc101850 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.186+0000 7f8c0426a640 1 -- 172.21.15.12:0/1792410337 >> 172.21.15.12:0/1792410337 conn(0x7f8bfc077230 msgr2=0x7f8bfc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.186+0000 7f8c0426a640 1 -- 172.21.15.12:0/1792410337 shutdown_connections 2024-09-19T06:53:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.187+0000 7f8c0426a640 1 -- 172.21.15.12:0/1792410337 wait complete. 2024-09-19T06:53:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.188+0000 7f8c0426a640 1 Processor -- start 2024-09-19T06:53:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.188+0000 7f8c0426a640 1 -- start start 2024-09-19T06:53:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.189+0000 7f8c0426a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc101470 0x7f8bfc1962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.189+0000 7f8c0426a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc101e20 0x7f8bfc1967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.189+0000 7f8c02006640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc101470 0x7f8bfc1962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.189+0000 7f8c02006640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc101470 0x7f8bfc1962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46036/0 (socket says 172.21.15.12:46036) 2024-09-19T06:53:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.189+0000 7f8c02006640 1 -- 172.21.15.12:0/1847938154 learned_addr learned my addr 172.21.15.12:0/1847938154 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.189+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bfc105de0 0x7f8bfc19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.190+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc10fd80 con 0x7f8bfc101e20 2024-09-19T06:53:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.190+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc10fc00 con 0x7f8bfc101470 2024-09-19T06:53:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.190+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc10ff00 con 0x7f8bfc105de0 2024-09-19T06:53:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.190+0000 7f8c02807640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bfc105de0 0x7f8bfc19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.190+0000 7f8c01805640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc101e20 0x7f8bfc1967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.190+0000 7f8c02006640 1 -- 172.21.15.12:0/1847938154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bfc105de0 msgr2=0x7f8bfc19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.190+0000 7f8c02006640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bfc105de0 0x7f8bfc19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.190+0000 7f8c02006640 1 -- 172.21.15.12:0/1847938154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc101e20 msgr2=0x7f8bfc1967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.190+0000 7f8c02006640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc101e20 0x7f8bfc1967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.190+0000 7f8c02006640 1 -- 172.21.15.12:0/1847938154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc19b250 con 0x7f8bfc101470 2024-09-19T06:53:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.191+0000 7f8c02006640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc101470 0x7f8bfc1962a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8004770 tx=0x7f8bf8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.191+0000 7f8bf37fe640 1 -- 172.21.15.12:0/1847938154 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf803f070 con 0x7f8bfc101470 2024-09-19T06:53:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.192+0000 7f8bf37fe640 1 -- 172.21.15.12:0/1847938154 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf8031ca0 con 0x7f8bfc101470 2024-09-19T06:53:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.192+0000 7f8bf37fe640 1 -- 172.21.15.12:0/1847938154 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8035030 con 0x7f8bfc101470 2024-09-19T06:53:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.192+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bfc19b4e0 con 0x7f8bfc101470 2024-09-19T06:53:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.192+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bfc1a2e20 con 0x7f8bfc101470 2024-09-19T06:53:25.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.194+0000 7f8bf37fe640 1 -- 172.21.15.12:0/1847938154 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8bf8042070 con 0x7f8bfc101470 2024-09-19T06:53:25.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.195+0000 7f8bf37fe640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8be80a3500 0x7f8be80a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.195+0000 7f8c06643740 1 Processor -- start 2024-09-19T06:53:25.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.195+0000 7f8bf37fe640 1 -- 172.21.15.12:0/1847938154 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f8bf80f0340 con 0x7f8bfc101470 2024-09-19T06:53:25.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.195+0000 7f8c01805640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8be80a3500 0x7f8be80a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.195+0000 7f8c06643740 1 -- start start 2024-09-19T06:53:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c06643740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65addb40 0x55cb65adc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c06643740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65adca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c06643740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65ae7370 0x55cb65ae9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c06643740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cb65a422f0 con 0x55cb65adc5d0 2024-09-19T06:53:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c06643740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55cb659e9cf0 con 0x55cb65addb40 2024-09-19T06:53:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c06643740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55cb65a3e2b0 con 0x55cb65ae7370 2024-09-19T06:53:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c02807640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65ae7370 0x55cb65ae9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c02807640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65ae7370 0x55cb65ae9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:51570/0 (socket says 172.21.15.12:51570) 2024-09-19T06:53:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c02807640 1 -- 172.21.15.12:0/2571745019 learned_addr learned my addr 172.21.15.12:0/2571745019 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c02006640 1 --2- 172.21.15.12:0/2571745019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65addb40 0x55cb65adc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c01805640 1 --2- 172.21.15.12:0/2571745019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65adca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c01805640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8be80a3500 0x7f8be80a59c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0095f0 tx=0x7f8bec005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c02807640 1 -- 172.21.15.12:0/2571745019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65addb40 msgr2=0x55cb65adc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c02807640 1 --2- 172.21.15.12:0/2571745019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65addb40 0x55cb65adc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c02807640 1 -- 172.21.15.12:0/2571745019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 msgr2=0x55cb65adca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c02807640 1 --2- 172.21.15.12:0/2571745019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65adca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c02807640 1 -- 172.21.15.12:0/2571745019 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb659ce3a0 con 0x55cb65ae7370 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.196+0000 7f8c02807640 1 --2- 172.21.15.12:0/2571745019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65ae7370 0x55cb65ae9760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009f70 tx=0x7f8bf4010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e1c2f9480811bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.197+0000 7f8bf0dea640 1 -- 172.21.15.12:0/2571745019 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4016070 con 0x55cb65ae7370 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.197+0000 7f8bf0dea640 1 -- 172.21.15.12:0/2571745019 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf4004d20 con 0x55cb65ae7370 2024-09-19T06:53:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.197+0000 7f8bf0dea640 1 -- 172.21.15.12:0/2571745019 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4012910 con 0x55cb65ae7370 2024-09-19T06:53:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.197+0000 7f8c06643740 1 -- 172.21.15.12:0/2571745019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65ae7370 msgr2=0x55cb65ae9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.197+0000 7f8c06643740 1 --2- 172.21.15.12:0/2571745019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65ae7370 0x55cb65ae9760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009f70 tx=0x7f8bf4010800 comp rx=0 tx=0).stop 2024-09-19T06:53:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.198+0000 7f8c06643740 1 -- 172.21.15.12:0/2571745019 shutdown_connections 2024-09-19T06:53:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.198+0000 7f8c06643740 1 --2- 172.21.15.12:0/2571745019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65ae7370 0x55cb65ae9760 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.198+0000 7f8c06643740 1 --2- 172.21.15.12:0/2571745019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65adca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.198+0000 7f8c06643740 1 --2- 172.21.15.12:0/2571745019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65addb40 0x55cb65adc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.198+0000 7f8c06643740 1 -- 172.21.15.12:0/2571745019 >> 172.21.15.12:0/2571745019 conn(0x55cb65aa5310 msgr2=0x55cb65ad8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.198+0000 7f8c06643740 1 -- 172.21.15.12:0/2571745019 shutdown_connections 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.198+0000 7f8c06643740 1 -- 172.21.15.12:0/2571745019 wait complete. 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.198+0000 7f8c06643740 1 -- start start 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.198+0000 7f8c06643740 1 Processor -- start 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.199+0000 7f8c06643740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65ae6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.199+0000 7f8c06643740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65ae4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.199+0000 7f8c06643740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 0x55cb65ae45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.199+0000 7f8c06643740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cb65aea070 con 0x55cb65adc5d0 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.199+0000 7f8c06643740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55cb659fd060 con 0x55cb65ae7370 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.199+0000 7f8c06643740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55cb65aea1f0 con 0x55cb65addb40 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.199+0000 7f8c06643740 10 client.0 _ll_register_callbacks cb 0x55cb657508c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.200+0000 7f8c01805640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65ae4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.200+0000 7f8c01805640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65ae4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:51586/0 (socket says 172.21.15.12:51586) 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.200+0000 7f8c01805640 1 -- 172.21.15.12:0/2997306485 learned_addr learned my addr 172.21.15.12:0/2997306485 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.200+0000 7f8c02807640 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 0x55cb65ae45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.200+0000 7f8c02807640 1 -- 172.21.15.12:0/2997306485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 msgr2=0x55cb65ae4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.200+0000 7f8c02807640 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65ae4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.200+0000 7f8c02807640 1 -- 172.21.15.12:0/2997306485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 msgr2=0x55cb65ae6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.200+0000 7f8c02807640 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65ae6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.200+0000 7f8c02807640 1 -- 172.21.15.12:0/2997306485 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb657b33c0 con 0x55cb65ae7370 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.201+0000 7f8c02807640 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 0x55cb65ae45d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009f70 tx=0x7f8bf4004c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633a655e90c256d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.201+0000 7f8be5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.201+0000 7f8be5ffb640 1 -- 172.21.15.12:0/2997306485 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4029060 con 0x55cb65ae7370 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.201+0000 7f8c06643740 1 -- 172.21.15.12:0/2997306485 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bf4004d20 con 0x55cb65ae7370 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.201+0000 7f8be5ffb640 1 -- 172.21.15.12:0/2997306485 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f8bf40050e0 con 0x55cb65ae7370 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.201+0000 7f8be5ffb640 1 -- 172.21.15.12:0/2997306485 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f8bf4030050 con 0x55cb65ae7370 2024-09-19T06:53:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.201+0000 7f8c06643740 10 client.28463 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.201+0000 7f8c06643740 1 -- 172.21.15.12:0/2997306485 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55cb65afe330 con 0x55cb65ae7370 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.202+0000 7f8be5ffb640 1 -- 172.21.15.12:0/2997306485 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf4004d20 con 0x55cb65ae7370 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.202+0000 7f8be5ffb640 1 -- 172.21.15.12:0/2997306485 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f8bf400f040 con 0x55cb65ae7370 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.203+0000 7f8c06643740 10 client.28463 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.203+0000 7f8c06643740 10 client.28463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.203+0000 7f8c06643740 20 client.28463 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.203+0000 7f8c06643740 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cb65affaf0 0x55cb65b01fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.203+0000 7f8c06643740 4 client.28463 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.203+0000 7f8c06643740 1 -- 172.21.15.12:0/2997306485 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb65a4f860 con 0x55cb65affaf0 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.203+0000 7f8c02006640 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cb65affaf0 0x55cb65b01fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.204+0000 7f8c02006640 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cb65affaf0 0x55cb65b01fb0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbebefe80dfbec4 server_cookie=8baaf71f5be2e86a in_seq=0 out_seq=0 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.204+0000 7f8be5ffb640 10 client.28463 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8be5ffb640 1 -- 172.21.15.12:0/2997306485 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb65a4f860 con 0x55cb65affaf0 2024-09-19T06:53:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8be5ffb640 10 client.28463 handle_command_reply: tid=0 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 client.28463 shutdown 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 -- 172.21.15.12:0/2997306485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 msgr2=0x55cb65ae45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 0x55cb65ae45d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009f70 tx=0x7f8bf4004c70 comp rx=0 tx=0).stop 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 -- 172.21.15.12:0/2997306485 shutdown_connections 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cb65affaf0 0x55cb65b01fb0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 0x55cb65ae45d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8be5ffb640 0 client.28463 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65ae4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 --2- 172.21.15.12:0/2997306485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65ae6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 -- 172.21.15.12:0/2997306485 >> 172.21.15.12:0/2997306485 conn(0x55cb65aa5310 msgr2=0x55cb65ade930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 -- 172.21.15.12:0/2997306485 shutdown_connections 2024-09-19T06:53:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.205+0000 7f8c06643740 1 -- 172.21.15.12:0/2997306485 wait complete. 2024-09-19T06:53:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.206+0000 7f8c06643740 20 client.28463 trim_cache size 0 max 16384 2024-09-19T06:53:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.229+0000 7f8c06643740 1 Processor -- start 2024-09-19T06:53:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.229+0000 7f8c06643740 1 -- start start 2024-09-19T06:53:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.229+0000 7f8c06643740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65ae28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.229+0000 7f8c06643740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65ae2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.229+0000 7f8c06643740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 0x55cb65ae12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.229+0000 7f8c06643740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1ab9d0 con 0x55cb65adc5d0 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.229+0000 7f8c06643740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1ad600 con 0x55cb65ae7370 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.229+0000 7f8c06643740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1ac0a0 con 0x55cb65addb40 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c02006640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65ae28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c02006640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65ae28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48920/0 (socket says 172.21.15.12:48920) 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c02006640 1 -- 172.21.15.12:0/3068521187 learned_addr learned my addr 172.21.15.12:0/3068521187 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c02807640 1 --2- 172.21.15.12:0/3068521187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 0x55cb65ae12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c01805640 1 --2- 172.21.15.12:0/3068521187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65ae2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c02006640 1 -- 172.21.15.12:0/3068521187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 msgr2=0x55cb65ae2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c02006640 1 --2- 172.21.15.12:0/3068521187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65ae2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c02006640 1 -- 172.21.15.12:0/3068521187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 msgr2=0x55cb65ae12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c02006640 1 --2- 172.21.15.12:0/3068521187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 0x55cb65ae12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c02006640 1 -- 172.21.15.12:0/3068521187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb65ad9960 con 0x55cb65adc5d0 2024-09-19T06:53:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.230+0000 7f8c02006640 1 --2- 172.21.15.12:0/3068521187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65ae28f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80edff0 tx=0x7f8bf803d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc36b7fe67fb3951 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.231+0000 7f8be7fff640 1 -- 172.21.15.12:0/3068521187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80da070 con 0x55cb65adc5d0 2024-09-19T06:53:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.231+0000 7f8be7fff640 1 -- 172.21.15.12:0/3068521187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf80c0930 con 0x55cb65adc5d0 2024-09-19T06:53:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.231+0000 7f8be7fff640 1 -- 172.21.15.12:0/3068521187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8049040 con 0x55cb65adc5d0 2024-09-19T06:53:25.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 -- 172.21.15.12:0/3068521187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 msgr2=0x55cb65ae28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 --2- 172.21.15.12:0/3068521187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65ae28f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80edff0 tx=0x7f8bf803d040 comp rx=0 tx=0).stop 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 -- 172.21.15.12:0/3068521187 shutdown_connections 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 --2- 172.21.15.12:0/3068521187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65ae7370 0x55cb65ae12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 --2- 172.21.15.12:0/3068521187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65ae2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 --2- 172.21.15.12:0/3068521187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65adc5d0 0x55cb65ae28f0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 -- 172.21.15.12:0/3068521187 >> 172.21.15.12:0/3068521187 conn(0x55cb65aa5310 msgr2=0x55cb65ae3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 -- 172.21.15.12:0/3068521187 shutdown_connections 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 -- 172.21.15.12:0/3068521187 wait complete. 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 -- start start 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.232+0000 7f8c06643740 1 Processor -- start 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c06643740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65adc5d0 0x55cb65b04d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c06643740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65b05260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c06643740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65ae7370 0x55cb65b687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c06643740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1acf30 con 0x55cb65ae7370 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c06643740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1ac7a0 con 0x55cb65adc5d0 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c06643740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1a99d0 con 0x55cb65addb40 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c06643740 10 client.0 _ll_register_callbacks cb 0x7f8bf8031e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c02807640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65ae7370 0x55cb65b687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c02807640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65ae7370 0x55cb65b687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48932/0 (socket says 172.21.15.12:48932) 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c02807640 1 -- 172.21.15.12:0/1881589853 learned_addr learned my addr 172.21.15.12:0/1881589853 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c02006640 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65adc5d0 0x55cb65b04d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c01805640 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65b05260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c02006640 1 -- 172.21.15.12:0/1881589853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 msgr2=0x55cb65b05260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c02006640 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65b05260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c02006640 1 -- 172.21.15.12:0/1881589853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65ae7370 msgr2=0x55cb65b687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:25.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c02006640 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65ae7370 0x55cb65b687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.233+0000 7f8c02006640 1 -- 172.21.15.12:0/1881589853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb65adf120 con 0x55cb65adc5d0 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.234+0000 7f8c02006640 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65adc5d0 0x55cb65b04d20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8031550 tx=0x7f8bf803b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc4b5312f96198a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.234+0000 7f8be5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.234+0000 7f8be5ffb640 1 -- 172.21.15.12:0/1881589853 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80da070 con 0x55cb65adc5d0 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.234+0000 7f8c06643740 1 -- 172.21.15.12:0/1881589853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bf80c0930 con 0x55cb65adc5d0 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.234+0000 7f8be5ffb640 1 -- 172.21.15.12:0/1881589853 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f8bf80b8ca0 con 0x55cb65adc5d0 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.234+0000 7f8be5ffb640 1 -- 172.21.15.12:0/1881589853 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f8bf8049040 con 0x55cb65adc5d0 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.234+0000 7f8c06643740 10 client.28469 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.234+0000 7f8c06643740 1 -- 172.21.15.12:0/1881589853 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55cb65b69d40 con 0x55cb65adc5d0 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.235+0000 7f8be5ffb640 1 -- 172.21.15.12:0/1881589853 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf80c0930 con 0x55cb65adc5d0 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.235+0000 7f8be5ffb640 1 -- 172.21.15.12:0/1881589853 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f8bf80c4d60 con 0x55cb65adc5d0 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.235+0000 7f8c06643740 10 client.28469 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:25.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.235+0000 7f8c06643740 10 client.28469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.235+0000 7f8c06643740 20 client.28469 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.235+0000 7f8c06643740 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cb65affaf0 0x55cb65b6c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.235+0000 7f8c06643740 4 client.28469 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.235+0000 7f8c06643740 1 -- 172.21.15.12:0/1881589853 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cb65a49d70 con 0x55cb65affaf0 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.235+0000 7f8c01805640 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cb65affaf0 0x55cb65b6c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8be5ffb640 10 client.28469 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8c01805640 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cb65affaf0 0x55cb65b6c450 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77c4e3945f92496 server_cookie=7584a50a58cdd553 in_seq=0 out_seq=0 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8be5ffb640 1 -- 172.21.15.12:0/1881589853 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cb65a49d70 con 0x55cb65affaf0 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8be5ffb640 10 client.28469 handle_command_reply: tid=0 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8c06643740 1 client.28469 shutdown 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8c06643740 1 -- 172.21.15.12:0/1881589853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65adc5d0 msgr2=0x55cb65b04d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8c06643740 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65adc5d0 0x55cb65b04d20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8031550 tx=0x7f8bf803b460 comp rx=0 tx=0).stop 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8c06643740 1 -- 172.21.15.12:0/1881589853 shutdown_connections 2024-09-19T06:53:25.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8c06643740 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55cb65affaf0 0x55cb65b6c450 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8c06643740 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb65ae7370 0x55cb65b687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8c06643740 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55cb65addb40 0x55cb65b05260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8c06643740 1 --2- 172.21.15.12:0/1881589853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55cb65adc5d0 0x55cb65b04d20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8c06643740 1 -- 172.21.15.12:0/1881589853 >> 172.21.15.12:0/1881589853 conn(0x55cb65aa5310 msgr2=0x55cb65ae2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.236+0000 7f8be5ffb640 0 client.28469 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.237+0000 7f8c06643740 1 -- 172.21.15.12:0/1881589853 shutdown_connections 2024-09-19T06:53:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.237+0000 7f8c06643740 1 -- 172.21.15.12:0/1881589853 wait complete. 2024-09-19T06:53:25.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.237+0000 7f8c06643740 20 client.28469 trim_cache size 0 max 16384 2024-09-19T06:53:25.243 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:53:25.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.237+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8be80a3500 msgr2=0x7f8be80a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:25.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.237+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8be80a3500 0x7f8be80a59c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0095f0 tx=0x7f8bec005f90 comp rx=0 tx=0).stop 2024-09-19T06:53:25.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.237+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc101470 msgr2=0x7f8bfc1962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:25.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.237+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc101470 0x7f8bfc1962a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8004770 tx=0x7f8bf8003c10 comp rx=0 tx=0).stop 2024-09-19T06:53:25.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.238+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 shutdown_connections 2024-09-19T06:53:25.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.238+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8be80a3500 0x7f8be80a59c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.238+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8bfc105de0 0x7f8bfc19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.238+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc101e20 0x7f8bfc1967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.238+0000 7f8c0426a640 1 --2- 172.21.15.12:0/1847938154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bfc101470 0x7f8bfc1962a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:25.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.238+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 >> 172.21.15.12:0/1847938154 conn(0x7f8bfc077230 msgr2=0x7f8bfc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:25.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.238+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 shutdown_connections 2024-09-19T06:53:25.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:25.238+0000 7f8c0426a640 1 -- 172.21.15.12:0/1847938154 wait complete. 2024-09-19T06:53:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 760.0 s, 569.2 tps, lat 871.004 ms stddev 4293.524 2024-09-19T06:53:25.831 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b17f4ae5', total seconds elapsed: 27.6 2024-09-19T06:53:25.832 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-09-19T06:53:25.832 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:53:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:26 smithi012 ceph-mon[30937]: pgmap v415: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 MiB/s wr, 1.07k op/s 2024-09-19T06:53:26.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:26 smithi016 ceph-mon[34911]: pgmap v415: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 MiB/s wr, 1.07k op/s 2024-09-19T06:53:26.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:26 smithi173 ceph-mon[35349]: pgmap v415: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 MiB/s wr, 1.07k op/s 2024-09-19T06:53:26.738 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.349+0000 7f5be4f12640 1 -- 172.21.15.12:0/4210957941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5be01082a0 msgr2=0x7f5be010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.349+0000 7f5be4f12640 1 --2- 172.21.15.12:0/4210957941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5be01082a0 0x7f5be010ec40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009930 tx=0x7f5bd402a420 comp rx=0 tx=0).stop 2024-09-19T06:53:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.349+0000 7f5be4f12640 1 -- 172.21.15.12:0/4210957941 shutdown_connections 2024-09-19T06:53:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.349+0000 7f5be4f12640 1 --2- 172.21.15.12:0/4210957941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5be01082a0 0x7f5be010ec40 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.349+0000 7f5be4f12640 1 --2- 172.21.15.12:0/4210957941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5be01036e0 0x7f5be0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.349+0000 7f5be4f12640 1 --2- 172.21.15.12:0/4210957941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be0102d30 0x7f5be0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.349+0000 7f5be4f12640 1 -- 172.21.15.12:0/4210957941 >> 172.21.15.12:0/4210957941 conn(0x7f5be00fc7d0 msgr2=0x7f5be00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.350+0000 7f5be4f12640 1 -- 172.21.15.12:0/4210957941 shutdown_connections 2024-09-19T06:53:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.350+0000 7f5be4f12640 1 -- 172.21.15.12:0/4210957941 wait complete. 2024-09-19T06:53:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.350+0000 7f5be4f12640 1 Processor -- start 2024-09-19T06:53:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.350+0000 7f5be4f12640 1 -- start start 2024-09-19T06:53:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5be4f12640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be0102d30 0x7f5be0198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5be4f12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5be01036e0 0x7f5be0198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:27.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5be4f12640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5be01082a0 0x7f5be019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5be4f12640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01120f0 con 0x7f5be01036e0 2024-09-19T06:53:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5be4f12640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0111f70 con 0x7f5be0102d30 2024-09-19T06:53:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5be4f12640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0112270 con 0x7f5be01082a0 2024-09-19T06:53:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5bde59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be0102d30 0x7f5be0198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5bddd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5be01036e0 0x7f5be0198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5bde59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be0102d30 0x7f5be0198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46078/0 (socket says 172.21.15.12:46078) 2024-09-19T06:53:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5bde59c640 1 -- 172.21.15.12:0/3156374614 learned_addr learned my addr 172.21.15.12:0/3156374614 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:27.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.352+0000 7f5bded9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5be01082a0 0x7f5be019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:27.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.353+0000 7f5bde59c640 1 -- 172.21.15.12:0/3156374614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5be01082a0 msgr2=0x7f5be019cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:27.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.353+0000 7f5bde59c640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5be01082a0 0x7f5be019cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:27.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.353+0000 7f5bde59c640 1 -- 172.21.15.12:0/3156374614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5be01036e0 msgr2=0x7f5be0198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:27.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.353+0000 7f5bde59c640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5be01036e0 0x7f5be0198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:27.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.353+0000 7f5bde59c640 1 -- 172.21.15.12:0/3156374614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be019d5e0 con 0x7f5be0102d30 2024-09-19T06:53:27.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.353+0000 7f5bde59c640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be0102d30 0x7f5be0198630 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000e9f0 tx=0x7f5bd000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:27.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.353+0000 7f5bcf7fe640 1 -- 172.21.15.12:0/3156374614 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000cd80 con 0x7f5be0102d30 2024-09-19T06:53:27.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.354+0000 7f5be4f12640 1 -- 172.21.15.12:0/3156374614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be019d8d0 con 0x7f5be0102d30 2024-09-19T06:53:27.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.354+0000 7f5bcf7fe640 1 -- 172.21.15.12:0/3156374614 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bd0010910 con 0x7f5be0102d30 2024-09-19T06:53:27.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.354+0000 7f5bcf7fe640 1 -- 172.21.15.12:0/3156374614 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00188f0 con 0x7f5be0102d30 2024-09-19T06:53:27.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.354+0000 7f5be4f12640 1 -- 172.21.15.12:0/3156374614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be01008c0 con 0x7f5be0102d30 2024-09-19T06:53:27.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.355+0000 7f5be4f12640 1 -- 172.21.15.12:0/3156374614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be0103110 con 0x7f5be0102d30 2024-09-19T06:53:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.356+0000 7f5bcf7fe640 1 -- 172.21.15.12:0/3156374614 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5bd0010430 con 0x7f5be0102d30 2024-09-19T06:53:27.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.357+0000 7f5bcf7fe640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5bc80a33b0 0x7f5bc80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:27.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.357+0000 7f5bcf7fe640 1 -- 172.21.15.12:0/3156374614 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f5bd00d0220 con 0x7f5be0102d30 2024-09-19T06:53:27.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.357+0000 7f5bddd9b640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5bc80a33b0 0x7f5bc80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:27.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.358+0000 7f5bddd9b640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5bc80a33b0 0x7f5bc80a5870 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5be0107440 tx=0x7f5bd8009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:27.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.361+0000 7f5bcf7fe640 1 -- 172.21.15.12:0/3156374614 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5bd009cb60 con 0x7f5be0102d30 2024-09-19T06:53:27.671 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:53:27.672 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:53:27.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.720+0000 7f5be4f12640 1 -- 172.21.15.12:0/3156374614 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5be010a2b0 con 0x7f5be0102d30 2024-09-19T06:53:27.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:53:27.723 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"btime":"2024-09-19T06:53:15:066450+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:53:14.418167+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:53:27.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.721+0000 7f5bcf7fe640 1 -- 172.21.15.12:0/3156374614 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11979 (secure 0 0 0) 0x7f5bd009c460 con 0x7f5be0102d30 2024-09-19T06:53:27.723 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2024-09-19T06:53:27.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.725+0000 7f5be4f12640 1 -- 172.21.15.12:0/3156374614 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5bc80a33b0 msgr2=0x7f5bc80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:27.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.725+0000 7f5be4f12640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5bc80a33b0 0x7f5bc80a5870 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5be0107440 tx=0x7f5bd8009500 comp rx=0 tx=0).stop 2024-09-19T06:53:27.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.725+0000 7f5be4f12640 1 -- 172.21.15.12:0/3156374614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be0102d30 msgr2=0x7f5be0198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:27.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.725+0000 7f5be4f12640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be0102d30 0x7f5be0198630 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000e9f0 tx=0x7f5bd000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:53:27.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.727+0000 7f5be4f12640 1 -- 172.21.15.12:0/3156374614 shutdown_connections 2024-09-19T06:53:27.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.727+0000 7f5be4f12640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5bc80a33b0 0x7f5bc80a5870 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:27.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.727+0000 7f5be4f12640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5be01082a0 0x7f5be019cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:27.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.727+0000 7f5be4f12640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5be01036e0 0x7f5be0198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:27.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.727+0000 7f5be4f12640 1 --2- 172.21.15.12:0/3156374614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5be0102d30 0x7f5be0198630 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:27.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.727+0000 7f5be4f12640 1 -- 172.21.15.12:0/3156374614 >> 172.21.15.12:0/3156374614 conn(0x7f5be00fc7d0 msgr2=0x7f5be00fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:27.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.727+0000 7f5be4f12640 1 -- 172.21.15.12:0/3156374614 shutdown_connections 2024-09-19T06:53:27.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:27.728+0000 7f5be4f12640 1 -- 172.21.15.12:0/3156374614 wait complete. 2024-09-19T06:53:28.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:28 smithi012 ceph-mon[30937]: pgmap v416: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-09-19T06:53:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:28 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3156374614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:28.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:28 smithi016 ceph-mon[34911]: pgmap v416: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-09-19T06:53:28.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:28 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3156374614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:28.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:28 smithi173 ceph-mon[35349]: pgmap v416: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 22 MiB/s wr, 1.06k op/s 2024-09-19T06:53:28.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:28 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3156374614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:28.608 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-09-19T06:53:28.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-09-19T06:53:28.670 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:29.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.334+0000 7fb9e6c48640 1 -- 172.21.15.12:0/2716484453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9e0102ef0 msgr2=0x7fb9e010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.334+0000 7fb9e6c48640 1 --2- 172.21.15.12:0/2716484453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9e0102ef0 0x7fb9e010da40 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009ca0 tx=0x7fb9d802a960 comp rx=0 tx=0).stop 2024-09-19T06:53:29.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.334+0000 7fb9e6c48640 1 -- 172.21.15.12:0/2716484453 shutdown_connections 2024-09-19T06:53:29.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.334+0000 7fb9e6c48640 1 --2- 172.21.15.12:0/2716484453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9e0102ef0 0x7fb9e010da40 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.334+0000 7fb9e6c48640 1 --2- 172.21.15.12:0/2716484453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e0102570 0x7fb9e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.334+0000 7fb9e6c48640 1 --2- 172.21.15.12:0/2716484453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e0100e20 0x7fb9e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.334+0000 7fb9e6c48640 1 -- 172.21.15.12:0/2716484453 >> 172.21.15.12:0/2716484453 conn(0x7fb9e00fc7d0 msgr2=0x7fb9e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.335+0000 7fb9e6c48640 1 -- 172.21.15.12:0/2716484453 shutdown_connections 2024-09-19T06:53:29.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.336+0000 7fb9e6c48640 1 -- 172.21.15.12:0/2716484453 wait complete. 2024-09-19T06:53:29.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.336+0000 7fb9e6c48640 1 Processor -- start 2024-09-19T06:53:29.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.337+0000 7fb9e6c48640 1 -- start start 2024-09-19T06:53:29.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.337+0000 7fb9e6c48640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e0102570 0x7fb9e00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.337+0000 7fb9e6c48640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9e0102ef0 0x7fb9e00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9e6c48640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e00fe910 0x7fb9e00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9e6c48640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0110fc0 con 0x7fb9e0102ef0 2024-09-19T06:53:29.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9e6c48640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0110e40 con 0x7fb9e00fe910 2024-09-19T06:53:29.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9e6c48640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e0111140 con 0x7fb9e0102570 2024-09-19T06:53:29.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9e51e5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e00fe910 0x7fb9e00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9e51e5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e00fe910 0x7fb9e00fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46092/0 (socket says 172.21.15.12:46092) 2024-09-19T06:53:29.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9e51e5640 1 -- 172.21.15.12:0/3797925732 learned_addr learned my addr 172.21.15.12:0/3797925732 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:29.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9e49e4640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e0102570 0x7fb9e00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9dffff640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9e0102ef0 0x7fb9e00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9dffff640 1 -- 172.21.15.12:0/3797925732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e0102570 msgr2=0x7fb9e00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9dffff640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e0102570 0x7fb9e00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9dffff640 1 -- 172.21.15.12:0/3797925732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e00fe910 msgr2=0x7fb9e00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.338+0000 7fb9dffff640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e00fe910 0x7fb9e00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.339+0000 7fb9dffff640 1 -- 172.21.15.12:0/3797925732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e019c950 con 0x7fb9e0102ef0 2024-09-19T06:53:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.339+0000 7fb9dffff640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9e0102ef0 0x7fb9e00fd1c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000d6d0 tx=0x7fb9d000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.339+0000 7fb9ddffb640 1 -- 172.21.15.12:0/3797925732 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0017070 con 0x7fb9e0102ef0 2024-09-19T06:53:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.339+0000 7fb9e6c48640 1 -- 172.21.15.12:0/3797925732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e019cc40 con 0x7fb9e0102ef0 2024-09-19T06:53:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.340+0000 7fb9e6c48640 1 -- 172.21.15.12:0/3797925732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e019d180 con 0x7fb9e0102ef0 2024-09-19T06:53:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.340+0000 7fb9ddffb640 1 -- 172.21.15.12:0/3797925732 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d0009820 con 0x7fb9e0102ef0 2024-09-19T06:53:29.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.340+0000 7fb9ddffb640 1 -- 172.21.15.12:0/3797925732 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0004ce0 con 0x7fb9e0102ef0 2024-09-19T06:53:29.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.343+0000 7fb9e9021740 1 Processor -- start 2024-09-19T06:53:29.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.345+0000 7fb9e9021740 1 -- start start 2024-09-19T06:53:29.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.345+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d3ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.345+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 0x5616d1d49800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e51e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d3ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e51e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d3ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48958/0 (socket says 172.21.15.12:48958) 2024-09-19T06:53:29.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d49d40 0x5616d1d4c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e9021740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5616d1ca4280 con 0x5616d1d3eb60 2024-09-19T06:53:29.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e9021740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5616d1c4bb10 con 0x5616d1d3f480 2024-09-19T06:53:29.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e9021740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5616d1ca0240 con 0x5616d1d49d40 2024-09-19T06:53:29.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1319875787 learned_addr learned my addr 172.21.15.12:0/1319875787 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:29.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1319875787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d49d40 msgr2=0x5616d1d4c130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:53:29.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/1319875787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d49d40 0x5616d1d4c130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1319875787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 msgr2=0x5616d1d49800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:53:29.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/1319875787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 0x5616d1d49800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.346+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1319875787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d1c581f0 con 0x5616d1d3eb60 2024-09-19T06:53:29.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.347+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/1319875787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d3ef40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802f680 tx=0x7fb9d802f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2235bcd763523c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.348+0000 7fb9ddffb640 1 -- 172.21.15.12:0/3797925732 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb9d0005220 con 0x7fb9e0102ef0 2024-09-19T06:53:29.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.349+0000 7fb9ddffb640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9cc0a35c0 0x7fb9cc0a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.349+0000 7fb9ddffb640 1 -- 172.21.15.12:0/3797925732 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fb9d00cf540 con 0x7fb9e0102ef0 2024-09-19T06:53:29.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.350+0000 7fb9d6ffd640 1 -- 172.21.15.12:0/1319875787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8049070 con 0x5616d1d3eb60 2024-09-19T06:53:29.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.350+0000 7fb9d6ffd640 1 -- 172.21.15.12:0/1319875787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d802f7d0 con 0x5616d1d3eb60 2024-09-19T06:53:29.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.351+0000 7fb9d6ffd640 1 -- 172.21.15.12:0/1319875787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8034040 con 0x5616d1d3eb60 2024-09-19T06:53:29.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.351+0000 7fb9e9021740 1 -- 172.21.15.12:0/1319875787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 msgr2=0x5616d1d3ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.351+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1319875787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d3ef40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802f680 tx=0x7fb9d802f6b0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.352+0000 7fb9e9021740 1 -- 172.21.15.12:0/1319875787 shutdown_connections 2024-09-19T06:53:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.352+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1319875787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d49d40 0x5616d1d4c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.352+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1319875787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 0x5616d1d49800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.352+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1319875787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d3ef40 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.352+0000 7fb9e9021740 1 -- 172.21.15.12:0/1319875787 >> 172.21.15.12:0/1319875787 conn(0x5616d1d3b0f0 msgr2=0x5616d1d3b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.359+0000 7fb9e49e4640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9cc0a35c0 0x7fb9cc0a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.361+0000 7fb9e9021740 1 -- 172.21.15.12:0/1319875787 shutdown_connections 2024-09-19T06:53:29.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.362+0000 7fb9e9021740 1 -- 172.21.15.12:0/1319875787 wait complete. 2024-09-19T06:53:29.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.362+0000 7fb9e9021740 1 -- start start 2024-09-19T06:53:29.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.362+0000 7fb9e9021740 1 Processor -- start 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.363+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d3eb60 0x5616d1d46be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.363+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3f480 0x5616d1d47120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.363+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d47660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.363+0000 7fb9e9021740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5616d1d4c960 con 0x5616d1d3f480 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.363+0000 7fb9e9021740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5616d1c5ef10 con 0x5616d1d49d40 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.363+0000 7fb9e9021740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5616d1d4cae0 con 0x5616d1d3eb60 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.364+0000 7fb9dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3f480 0x5616d1d47120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.364+0000 7fb9dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3f480 0x5616d1d47120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48964/0 (socket says 172.21.15.12:48964) 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.364+0000 7fb9dffff640 1 -- 172.21.15.12:0/362712100 learned_addr learned my addr 172.21.15.12:0/362712100 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.364+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d47660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.364+0000 7fb9e9021740 10 client.0 _ll_register_callbacks cb 0x5616d1c27a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:29.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.364+0000 7fb9e51e5640 1 -- 172.21.15.12:0/362712100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d3eb60 msgr2=0x5616d1d46be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.364+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d3eb60 0x5616d1d46be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.364+0000 7fb9e51e5640 1 -- 172.21.15.12:0/362712100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3f480 msgr2=0x5616d1d47120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.364+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3f480 0x5616d1d47120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.364+0000 7fb9e51e5640 1 -- 172.21.15.12:0/362712100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616d1a156a0 con 0x5616d1d49d40 2024-09-19T06:53:29.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.366+0000 7fb9e49e4640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9cc0a35c0 0x7fb9cc0a5a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5616d1d3bf50 tx=0x7fb9c80090e0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.370 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:29 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:53:29.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.368+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d47660 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8006010 tx=0x7fb9d8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e3620268e19b154 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.368+0000 7fb9bffff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:53:29.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.372+0000 7fb9bffff640 1 -- 172.21.15.12:0/362712100 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8049070 con 0x5616d1d49d40 2024-09-19T06:53:29.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.373+0000 7fb9bffff640 1 -- 172.21.15.12:0/362712100 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fb9d80306d0 con 0x5616d1d49d40 2024-09-19T06:53:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.373+0000 7fb9e9021740 1 -- 172.21.15.12:0/362712100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d802f7d0 con 0x5616d1d49d40 2024-09-19T06:53:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.374+0000 7fb9bffff640 1 -- 172.21.15.12:0/362712100 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb9d8034040 con 0x5616d1d49d40 2024-09-19T06:53:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.374+0000 7fb9e9021740 10 client.28481 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.374+0000 7fb9e9021740 1 -- 172.21.15.12:0/362712100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5616d1d58590 con 0x5616d1d49d40 2024-09-19T06:53:29.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.375+0000 7fb9bffff640 1 -- 172.21.15.12:0/362712100 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d802f7d0 con 0x5616d1d49d40 2024-09-19T06:53:29.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.375+0000 7fb9bffff640 1 -- 172.21.15.12:0/362712100 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7fb9d8044470 con 0x5616d1d49d40 2024-09-19T06:53:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.376+0000 7fb9e9021740 10 client.28481 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.376+0000 7fb9e9021740 10 client.28481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.376+0000 7fb9e9021740 20 client.28481 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.376+0000 7fb9e9021740 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616d1d598e0 0x5616d1d5bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.376+0000 7fb9e9021740 4 client.28481 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.376+0000 7fb9e9021740 1 -- 172.21.15.12:0/362712100 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616d1cb17f0 con 0x5616d1d598e0 2024-09-19T06:53:29.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.377+0000 7fb9e49e4640 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616d1d598e0 0x5616d1d5bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.378+0000 7fb9e49e4640 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616d1d598e0 0x5616d1d5bcd0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3354916a9cdc403c server_cookie=316bc2236d7efec1 in_seq=0 out_seq=0 2024-09-19T06:53:29.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.378+0000 7fb9bffff640 10 client.28481 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:29.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.379+0000 7fb9bffff640 1 -- 172.21.15.12:0/362712100 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616d1cb17f0 con 0x5616d1d598e0 2024-09-19T06:53:29.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.379+0000 7fb9bffff640 10 client.28481 handle_command_reply: tid=0 2024-09-19T06:53:29.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.379+0000 7fb9e9021740 1 client.28481 shutdown 2024-09-19T06:53:29.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.379+0000 7fb9e9021740 1 -- 172.21.15.12:0/362712100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 msgr2=0x5616d1d47660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.380+0000 7fb9e9021740 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d47660 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8006010 tx=0x7fb9d8009840 comp rx=0 tx=0).stop 2024-09-19T06:53:29.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.380+0000 7fb9e9021740 1 -- 172.21.15.12:0/362712100 shutdown_connections 2024-09-19T06:53:29.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.380+0000 7fb9e9021740 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616d1d598e0 0x5616d1d5bcd0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.380+0000 7fb9e9021740 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d47660 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.380+0000 7fb9e9021740 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3f480 0x5616d1d47120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.380+0000 7fb9e9021740 1 --2- 172.21.15.12:0/362712100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d3eb60 0x5616d1d46be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.380+0000 7fb9e9021740 1 -- 172.21.15.12:0/362712100 >> 172.21.15.12:0/362712100 conn(0x5616d1d3b0f0 msgr2=0x5616d1d40e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.380+0000 7fb9bffff640 0 client.28481 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:29.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.382+0000 7fb9e9021740 1 -- 172.21.15.12:0/362712100 shutdown_connections 2024-09-19T06:53:29.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.383+0000 7fb9e9021740 1 -- 172.21.15.12:0/362712100 wait complete. 2024-09-19T06:53:29.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.383+0000 7fb9e9021740 20 client.28481 trim_cache size 0 max 16384 2024-09-19T06:53:29.402 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.411+0000 7fb9e9021740 1 Processor -- start 2024-09-19T06:53:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.411+0000 7fb9e9021740 1 -- start start 2024-09-19T06:53:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.412+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d474b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.412+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d3f480 0x5616d1d5ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.412+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d5f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.412+0000 7fb9e9021740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c000eb20 con 0x5616d1d3eb60 2024-09-19T06:53:29.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.412+0000 7fb9e9021740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c0010750 con 0x5616d1d49d40 2024-09-19T06:53:29.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.412+0000 7fb9e9021740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c000f1f0 con 0x5616d1d3f480 2024-09-19T06:53:29.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.412+0000 7fb9e51e5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d5f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.413+0000 7fb9e51e5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d5f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46120/0 (socket says 172.21.15.12:46120) 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.413+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1780543725 learned_addr learned my addr 172.21.15.12:0/1780543725 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.413+0000 7fb9dffff640 1 --2- 172.21.15.12:0/1780543725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d3f480 0x5616d1d5ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.413+0000 7fb9e49e4640 1 --2- 172.21.15.12:0/1780543725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.413+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1780543725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d3f480 msgr2=0x5616d1d5ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.413+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/1780543725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d3f480 0x5616d1d5ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.413+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1780543725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 msgr2=0x5616d1d474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.413+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/1780543725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.413+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1780543725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d1d491e0 con 0x5616d1d49d40 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.413+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/1780543725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d5f230 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802f510 tx=0x7fb9d8044d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceb61263ec0de16e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.414+0000 7fb9d67fc640 1 -- 172.21.15.12:0/1780543725 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8049040 con 0x5616d1d49d40 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.414+0000 7fb9d67fc640 1 -- 172.21.15.12:0/1780543725 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d8054030 con 0x5616d1d49d40 2024-09-19T06:53:29.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.414+0000 7fb9d67fc640 1 -- 172.21.15.12:0/1780543725 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8003fc0 con 0x5616d1d49d40 2024-09-19T06:53:29.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.414+0000 7fb9e9021740 1 -- 172.21.15.12:0/1780543725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 msgr2=0x5616d1d5f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.414+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1780543725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d5f230 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802f510 tx=0x7fb9d8044d70 comp rx=0 tx=0).stop 2024-09-19T06:53:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.415+0000 7fb9e9021740 1 -- 172.21.15.12:0/1780543725 shutdown_connections 2024-09-19T06:53:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.415+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1780543725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d49d40 0x5616d1d5f230 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.415+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1780543725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d3f480 0x5616d1d5ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.415+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1780543725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.415+0000 7fb9e9021740 1 -- 172.21.15.12:0/1780543725 >> 172.21.15.12:0/1780543725 conn(0x5616d1d3b0f0 msgr2=0x5616d1d55630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.415+0000 7fb9e9021740 1 -- 172.21.15.12:0/1780543725 shutdown_connections 2024-09-19T06:53:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.415+0000 7fb9e9021740 1 -- 172.21.15.12:0/1780543725 wait complete. 2024-09-19T06:53:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.415+0000 7fb9e9021740 1 -- start start 2024-09-19T06:53:29.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.415+0000 7fb9e9021740 1 Processor -- start 2024-09-19T06:53:29.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d5cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 0x5616d1d5d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9e9021740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d49d40 0x5616d1d5d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9e9021740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c0010080 con 0x5616d1d3eb60 2024-09-19T06:53:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9e9021740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c000f8f0 con 0x5616d1d3f480 2024-09-19T06:53:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9e9021740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c000cb20 con 0x5616d1d49d40 2024-09-19T06:53:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9e9021740 10 client.0 _ll_register_callbacks cb 0x7fb9d8047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 0x5616d1d5d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9e49e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d5cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 0x5616d1d5d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46136/0 (socket says 172.21.15.12:46136) 2024-09-19T06:53:29.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9dffff640 1 -- 172.21.15.12:0/1453609796 learned_addr learned my addr 172.21.15.12:0/1453609796 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9e49e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d5cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48986/0 (socket says 172.21.15.12:48986) 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.416+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d49d40 0x5616d1d5d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.417+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1453609796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 msgr2=0x5616d1d5d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.417+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 0x5616d1d5d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.417+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1453609796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 msgr2=0x5616d1d5cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.417+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d5cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.417+0000 7fb9e51e5640 1 -- 172.21.15.12:0/1453609796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616d1dc3380 con 0x5616d1d49d40 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.417+0000 7fb9dffff640 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 0x5616d1d5d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.417+0000 7fb9e51e5640 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d49d40 0x5616d1d5d650 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8002230 tx=0x7fb9d8030890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98d2b6d00079ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.417+0000 7fb9bffff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.417+0000 7fb9bffff640 1 -- 172.21.15.12:0/1453609796 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8049050 con 0x5616d1d49d40 2024-09-19T06:53:29.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.417+0000 7fb9bffff640 1 -- 172.21.15.12:0/1453609796 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fb9d8030c10 con 0x5616d1d49d40 2024-09-19T06:53:29.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.418+0000 7fb9e9021740 1 -- 172.21.15.12:0/1453609796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d8054030 con 0x5616d1d49d40 2024-09-19T06:53:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.418+0000 7fb9bffff640 1 -- 172.21.15.12:0/1453609796 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fb9d802f7e0 con 0x5616d1d49d40 2024-09-19T06:53:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.418+0000 7fb9e9021740 10 client.28411 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.418+0000 7fb9e9021740 1 -- 172.21.15.12:0/1453609796 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5616d1dc4680 con 0x5616d1d49d40 2024-09-19T06:53:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.419+0000 7fb9bffff640 1 -- 172.21.15.12:0/1453609796 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d8054030 con 0x5616d1d49d40 2024-09-19T06:53:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.419+0000 7fb9bffff640 1 -- 172.21.15.12:0/1453609796 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7fb9d8004600 con 0x5616d1d49d40 2024-09-19T06:53:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.420+0000 7fb9e9021740 10 client.28411 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:29.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.420+0000 7fb9e9021740 10 client.28411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.420+0000 7fb9e9021740 20 client.28411 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.420+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616d1dc4ba0 0x5616d1dc6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.420+0000 7fb9e9021740 4 client.28411 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:53:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.420+0000 7fb9e9021740 1 -- 172.21.15.12:0/1453609796 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5616d1cabd00 con 0x5616d1dc4ba0 2024-09-19T06:53:29.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.421+0000 7fb9e49e4640 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616d1dc4ba0 0x5616d1dc6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.421+0000 7fb9e49e4640 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616d1dc4ba0 0x5616d1dc6f90 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13a9667dde6a703e server_cookie=28375356efa448b3 in_seq=0 out_seq=0 2024-09-19T06:53:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.421+0000 7fb9bffff640 10 client.28411 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.422+0000 7fb9bffff640 1 -- 172.21.15.12:0/1453609796 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5616d1cabd00 con 0x5616d1dc4ba0 2024-09-19T06:53:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.422+0000 7fb9bffff640 10 client.28411 handle_command_reply: tid=0 2024-09-19T06:53:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.422+0000 7fb9e9021740 1 client.28411 shutdown 2024-09-19T06:53:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.422+0000 7fb9e9021740 1 -- 172.21.15.12:0/1453609796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d49d40 msgr2=0x5616d1d5d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.422+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d49d40 0x5616d1d5d650 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8002230 tx=0x7fb9d8030890 comp rx=0 tx=0).stop 2024-09-19T06:53:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.422+0000 7fb9e9021740 1 -- 172.21.15.12:0/1453609796 shutdown_connections 2024-09-19T06:53:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.422+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5616d1dc4ba0 0x5616d1dc6f90 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.423+0000 7fb9bffff640 0 client.28411 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.423+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616d1d49d40 0x5616d1d5d650 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.423+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5616d1d3f480 0x5616d1d5d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.423+0000 7fb9e9021740 1 --2- 172.21.15.12:0/1453609796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616d1d3eb60 0x5616d1d5cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.423+0000 7fb9e9021740 1 -- 172.21.15.12:0/1453609796 >> 172.21.15.12:0/1453609796 conn(0x5616d1d3b0f0 msgr2=0x5616d1d39a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.423+0000 7fb9e9021740 1 -- 172.21.15.12:0/1453609796 shutdown_connections 2024-09-19T06:53:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.423+0000 7fb9e9021740 1 -- 172.21.15.12:0/1453609796 wait complete. 2024-09-19T06:53:29.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.423+0000 7fb9e9021740 20 client.28411 trim_cache size 0 max 16384 2024-09-19T06:53:29.426 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:53:29.426 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:53:29.426 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "e9b26a99-c6c3-44a3-93c0-42361559aec6", 2024-09-19T06:53:29.426 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:53:29.426 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:53:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 -- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9cc0a35c0 msgr2=0x7fb9cc0a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9cc0a35c0 0x7fb9cc0a5a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5616d1d3bf50 tx=0x7fb9c80090e0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 -- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9e0102ef0 msgr2=0x7fb9e00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9e0102ef0 0x7fb9e00fd1c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000d6d0 tx=0x7fb9d000db90 comp rx=0 tx=0).stop 2024-09-19T06:53:29.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 -- 172.21.15.12:0/3797925732 shutdown_connections 2024-09-19T06:53:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e00fe910 0x7fb9e00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9e0102ef0 0x7fb9e00fd1c0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb9cc0a35c0 0x7fb9cc0a5a80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 --2- 172.21.15.12:0/3797925732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9e0102570 0x7fb9e00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 -- 172.21.15.12:0/3797925732 >> 172.21.15.12:0/3797925732 conn(0x7fb9e00fc7d0 msgr2=0x7fb9e006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 -- 172.21.15.12:0/3797925732 shutdown_connections 2024-09-19T06:53:29.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:29.424+0000 7fb9e6c48640 1 -- 172.21.15.12:0/3797925732 wait complete. 2024-09-19T06:53:29.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:29 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:53:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.563+0000 7fdbb17d8640 1 -- 172.21.15.12:0/2960817302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbac11b140 msgr2=0x7fdbac11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.563+0000 7fdbb17d8640 1 --2- 172.21.15.12:0/2960817302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbac11b140 0x7fdbac11d530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009c10 tx=0x7fdba402a720 comp rx=0 tx=0).stop 2024-09-19T06:53:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.565+0000 7fdbb17d8640 1 -- 172.21.15.12:0/2960817302 shutdown_connections 2024-09-19T06:53:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.565+0000 7fdbb17d8640 1 --2- 172.21.15.12:0/2960817302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbac11b140 0x7fdbac11d530 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.565+0000 7fdbb17d8640 1 --2- 172.21.15.12:0/2960817302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbac1095d0 0x7fdbac109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.565+0000 7fdbb17d8640 1 --2- 172.21.15.12:0/2960817302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac1091f0 0x7fdbac110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.565+0000 7fdbb17d8640 1 -- 172.21.15.12:0/2960817302 >> 172.21.15.12:0/2960817302 conn(0x7fdbac06ce00 msgr2=0x7fdbac06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.573+0000 7fdbb17d8640 1 -- 172.21.15.12:0/2960817302 shutdown_connections 2024-09-19T06:53:29.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.575+0000 7fdbb17d8640 1 -- 172.21.15.12:0/2960817302 wait complete. 2024-09-19T06:53:29.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.576+0000 7fdbb17d8640 1 Processor -- start 2024-09-19T06:53:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.576+0000 7fdbb17d8640 1 -- start start 2024-09-19T06:53:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.576+0000 7fdbb17d8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbac1091f0 0x7fdbac11a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.576+0000 7fdbb17d8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbac1095d0 0x7fdbac114900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.576+0000 7fdbb17d8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac11b140 0x7fdbac114e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.576+0000 7fdbb17d8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac111370 con 0x7fdbac11b140 2024-09-19T06:53:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.576+0000 7fdbb17d8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1111f0 con 0x7fdbac1095d0 2024-09-19T06:53:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.576+0000 7fdbb17d8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1114f0 con 0x7fdbac1091f0 2024-09-19T06:53:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.577+0000 7fdbab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac11b140 0x7fdbac114e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.577+0000 7fdbab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac11b140 0x7fdbac114e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49006/0 (socket says 172.21.15.12:49006) 2024-09-19T06:53:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.577+0000 7fdbab7fe640 1 -- 172.21.15.12:0/4090327288 learned_addr learned my addr 172.21.15.12:0/4090327288 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.577+0000 7fdbaa7fc640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbac1095d0 0x7fdbac114900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.577+0000 7fdbab7fe640 1 -- 172.21.15.12:0/4090327288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbac1091f0 msgr2=0x7fdbac11a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.577+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbac1091f0 0x7fdbac11a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.577+0000 7fdbab7fe640 1 -- 172.21.15.12:0/4090327288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbac1095d0 msgr2=0x7fdbac114900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.577+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbac1095d0 0x7fdbac114900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.578+0000 7fdbab7fe640 1 -- 172.21.15.12:0/4090327288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbac115570 con 0x7fdbac11b140 2024-09-19T06:53:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.578+0000 7fdbaa7fc640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbac1095d0 0x7fdbac114900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.578+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac11b140 0x7fdbac114e40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdba4034040 tx=0x7fdba4032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.579+0000 7fdb93fff640 1 -- 172.21.15.12:0/4090327288 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4041020 con 0x7fdbac11b140 2024-09-19T06:53:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.579+0000 7fdbb17d8640 1 -- 172.21.15.12:0/4090327288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbac1bc000 con 0x7fdbac11b140 2024-09-19T06:53:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.579+0000 7fdb93fff640 1 -- 172.21.15.12:0/4090327288 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdba4030ea0 con 0x7fdbac11b140 2024-09-19T06:53:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.579+0000 7fdb93fff640 1 -- 172.21.15.12:0/4090327288 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4041020 con 0x7fdbac11b140 2024-09-19T06:53:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.579+0000 7fdbb17d8640 1 -- 172.21.15.12:0/4090327288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbac1bc3b0 con 0x7fdbac11b140 2024-09-19T06:53:29.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:29 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:53:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.583+0000 7fdbb464d740 1 Processor -- start 2024-09-19T06:53:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.583+0000 7fdb93fff640 1 -- 172.21.15.12:0/4090327288 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fdba4044020 con 0x7fdbac11b140 2024-09-19T06:53:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.583+0000 7fdbb464d740 1 -- start start 2024-09-19T06:53:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.584+0000 7fdb93fff640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb940a3940 0x7fdb940a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.584+0000 7fdb93fff640 1 -- 172.21.15.12:0/4090327288 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fdba4003970 con 0x7fdbac11b140 2024-09-19T06:53:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.584+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d4724ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.584+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 0x55c2d472f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.584+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 0x55c2d47320a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.584+0000 7fdbb464d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c2d46892f0 con 0x55c2d4724af0 2024-09-19T06:53:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.584+0000 7fdbb464d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c2d4631270 con 0x55c2d4725410 2024-09-19T06:53:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.584+0000 7fdbb464d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c2d46852b0 con 0x55c2d472fcb0 2024-09-19T06:53:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.585+0000 7fdbaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d4724ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.585+0000 7fdbaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d4724ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49016/0 (socket says 172.21.15.12:49016) 2024-09-19T06:53:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.585+0000 7fdbaaffd640 1 -- 172.21.15.12:0/1902215475 learned_addr learned my addr 172.21.15.12:0/1902215475 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.585+0000 7fdbaa7fc640 1 --2- 172.21.15.12:0/1902215475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 0x55c2d472f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.585+0000 7fdbaa7fc640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb940a3940 0x7fdb940a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.585+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/1902215475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 0x55c2d47320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.586+0000 7fdbab7fe640 1 -- 172.21.15.12:0/1902215475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 msgr2=0x55c2d472f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.586+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/1902215475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 0x55c2d472f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.586+0000 7fdbab7fe640 1 -- 172.21.15.12:0/1902215475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 msgr2=0x55c2d4724ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.586+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/1902215475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d4724ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.586+0000 7fdbab7fe640 1 -- 172.21.15.12:0/1902215475 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d4630340 con 0x55c2d472fcb0 2024-09-19T06:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.586+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/1902215475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 0x55c2d47320a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdba40ed930 tx=0x7fdba40bc000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d7d8e730630c89d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.586+0000 7fdbaa7fc640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb940a3940 0x7fdb940a5e00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdba0006fd0 tx=0x7fdba000b160 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.586+0000 7fdb917fa640 1 -- 172.21.15.12:0/1902215475 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4041070 con 0x55c2d472fcb0 2024-09-19T06:53:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.586+0000 7fdb917fa640 1 -- 172.21.15.12:0/1902215475 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdba40bc4c0 con 0x55c2d472fcb0 2024-09-19T06:53:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.587+0000 7fdbb464d740 1 -- 172.21.15.12:0/1902215475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 msgr2=0x55c2d47320a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.587+0000 7fdbb464d740 1 --2- 172.21.15.12:0/1902215475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 0x55c2d47320a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdba40ed930 tx=0x7fdba40bc000 comp rx=0 tx=0).stop 2024-09-19T06:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.588+0000 7fdbb464d740 1 -- 172.21.15.12:0/1902215475 shutdown_connections 2024-09-19T06:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.588+0000 7fdbb464d740 1 --2- 172.21.15.12:0/1902215475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 0x55c2d47320a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.588+0000 7fdbb464d740 1 --2- 172.21.15.12:0/1902215475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 0x55c2d472f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.588+0000 7fdbb464d740 1 --2- 172.21.15.12:0/1902215475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d4724ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.588+0000 7fdbb464d740 1 -- 172.21.15.12:0/1902215475 >> 172.21.15.12:0/1902215475 conn(0x55c2d4721060 msgr2=0x55c2d4721440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.588+0000 7fdbb464d740 1 -- 172.21.15.12:0/1902215475 shutdown_connections 2024-09-19T06:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.588+0000 7fdbb464d740 1 -- 172.21.15.12:0/1902215475 wait complete. 2024-09-19T06:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.588+0000 7fdbb464d740 1 -- start start 2024-09-19T06:53:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.589+0000 7fdbb464d740 1 Processor -- start 2024-09-19T06:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.589+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4724af0 0x55c2d472f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.589+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 0x55c2d472c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.589+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d472fcb0 0x55c2d472d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.589+0000 7fdbaaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4724af0 0x55c2d472f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.589+0000 7fdbaaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4724af0 0x55c2d472f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46178/0 (socket says 172.21.15.12:46178) 2024-09-19T06:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbaa7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 0x55c2d472c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbaa7fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 0x55c2d472c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:51678/0 (socket says 172.21.15.12:51678) 2024-09-19T06:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbaaffd640 1 -- 172.21.15.12:0/1299092764 learned_addr learned my addr 172.21.15.12:0/1299092764 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d472fcb0 0x55c2d472d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c2d4732640 con 0x55c2d472fcb0 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c2d4612290 con 0x55c2d4724af0 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c2d47327c0 con 0x55c2d4725410 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbab7fe640 1 -- 172.21.15.12:0/1299092764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 msgr2=0x55c2d472c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 0x55c2d472c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbab7fe640 1 -- 172.21.15.12:0/1299092764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4724af0 msgr2=0x55c2d472f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4724af0 0x55c2d472f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbab7fe640 1 -- 172.21.15.12:0/1299092764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d439c210 con 0x55c2d472fcb0 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.591+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d472fcb0 0x55c2d472d140 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fdba40098b0 tx=0x7fdba4043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c994d4bf6de6dd1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.591+0000 7fdb8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.590+0000 7fdbb464d740 10 client.0 _ll_register_callbacks cb 0x55c2d4643140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.591+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdba40bc4c0 con 0x55c2d472fcb0 2024-09-19T06:53:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.591+0000 7fdb8eff5640 1 -- 172.21.15.12:0/1299092764 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba40da060 con 0x55c2d472fcb0 2024-09-19T06:53:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.591+0000 7fdb8eff5640 1 -- 172.21.15.12:0/1299092764 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fdba40d5460 con 0x55c2d472fcb0 2024-09-19T06:53:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.592+0000 7fdb8eff5640 1 -- 172.21.15.12:0/1299092764 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fdba4041070 con 0x55c2d472fcb0 2024-09-19T06:53:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.592+0000 7fdbb464d740 10 client.19176 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.592+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({fsmap=49}) -- 0x55c2d4468620 con 0x55c2d472fcb0 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.592+0000 7fdb8eff5640 1 -- 172.21.15.12:0/1299092764 <== mon.0 v2:172.21.15.12:3300/0 4 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7fdba4087170 con 0x55c2d472fcb0 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.592+0000 7fdbb464d740 10 client.19176 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.592+0000 7fdbb464d740 10 client.19176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.592+0000 7fdbb464d740 20 client.19176 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.592+0000 7fdbb464d740 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2d473f530 0x55c2d4741920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.592+0000 7fdbb464d740 4 client.19176 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.592+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdba40b8cc0 con 0x55c2d473f530 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.593+0000 7fdbaaffd640 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2d473f530 0x55c2d4741920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.593+0000 7fdb8eff5640 10 client.19176 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.593+0000 7fdbaaffd640 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2d473f530 0x55c2d4741920 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c2f2d7909e9d79a server_cookie=752ff97e6c8b9a84 in_seq=0 out_seq=0 2024-09-19T06:53:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdb8eff5640 1 -- 172.21.15.12:0/1299092764 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fdba40b8cc0 con 0x55c2d473f530 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdb8eff5640 10 client.19176 handle_command_reply: tid=0 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdbb464d740 1 client.19176 shutdown 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d472fcb0 msgr2=0x55c2d472d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdbb464d740 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d472fcb0 0x55c2d472d140 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fdba40098b0 tx=0x7fdba4043000 comp rx=0 tx=0).stop 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 shutdown_connections 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdbb464d740 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2d473f530 0x55c2d4741920 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdb8eff5640 0 client.19176 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdbb464d740 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d472fcb0 0x55c2d472d140 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdbb464d740 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 0x55c2d472c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdbb464d740 1 --2- 172.21.15.12:0/1299092764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4724af0 0x55c2d472f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.594+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 >> 172.21.15.12:0/1299092764 conn(0x55c2d4721060 msgr2=0x55c2d4726dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.595+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 shutdown_connections 2024-09-19T06:53:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.595+0000 7fdbb464d740 1 -- 172.21.15.12:0/1299092764 wait complete. 2024-09-19T06:53:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.595+0000 7fdbb464d740 20 client.19176 trim_cache size 0 max 16384 2024-09-19T06:53:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbb464d740 1 Processor -- start 2024-09-19T06:53:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbb464d740 1 -- start start 2024-09-19T06:53:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 0x55c2d472c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d472fcb0 0x55c2d4747150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbb464d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9800eaa0 con 0x55c2d4724af0 2024-09-19T06:53:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbb464d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdb980106d0 con 0x55c2d472fcb0 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbb464d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9800f170 con 0x55c2d4725410 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49038/0 (socket says 172.21.15.12:49038) 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.615+0000 7fdbaaffd640 1 -- 172.21.15.12:0/3912319417 learned_addr learned my addr 172.21.15.12:0/3912319417 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.616+0000 7fdbaa7fc640 1 --2- 172.21.15.12:0/3912319417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 0x55c2d472c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.616+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/3912319417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d472fcb0 0x55c2d4747150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.616+0000 7fdbaaffd640 1 -- 172.21.15.12:0/3912319417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 msgr2=0x55c2d472c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.616+0000 7fdbaaffd640 1 --2- 172.21.15.12:0/3912319417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 0x55c2d472c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.616+0000 7fdbaaffd640 1 -- 172.21.15.12:0/3912319417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d472fcb0 msgr2=0x55c2d4747150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.616+0000 7fdbaaffd640 1 --2- 172.21.15.12:0/3912319417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d472fcb0 0x55c2d4747150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.616+0000 7fdbaaffd640 1 -- 172.21.15.12:0/3912319417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d4741ec0 con 0x55c2d4724af0 2024-09-19T06:53:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.616+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/3912319417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d472fcb0 0x55c2d4747150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.617+0000 7fdbaaffd640 1 --2- 172.21.15.12:0/3912319417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472c250 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c004140 tx=0x7fdb9c00b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5facabe483e147ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.617+0000 7fdb90ff9640 1 -- 172.21.15.12:0/3912319417 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c01e070 con 0x55c2d4724af0 2024-09-19T06:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.617+0000 7fdb90ff9640 1 -- 172.21.15.12:0/3912319417 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb9c005500 con 0x55c2d4724af0 2024-09-19T06:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.617+0000 7fdb90ff9640 1 -- 172.21.15.12:0/3912319417 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c004e40 con 0x55c2d4724af0 2024-09-19T06:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.618+0000 7fdbb464d740 1 -- 172.21.15.12:0/3912319417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 msgr2=0x55c2d472c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.618+0000 7fdbb464d740 1 --2- 172.21.15.12:0/3912319417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472c250 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c004140 tx=0x7fdb9c00b3e0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.618+0000 7fdbb464d740 1 -- 172.21.15.12:0/3912319417 shutdown_connections 2024-09-19T06:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.618+0000 7fdbb464d740 1 --2- 172.21.15.12:0/3912319417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d472fcb0 0x55c2d4747150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.618+0000 7fdbb464d740 1 --2- 172.21.15.12:0/3912319417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d4725410 0x55c2d472c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.618+0000 7fdbb464d740 1 --2- 172.21.15.12:0/3912319417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472c250 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.618+0000 7fdbb464d740 1 -- 172.21.15.12:0/3912319417 >> 172.21.15.12:0/3912319417 conn(0x55c2d4721060 msgr2=0x55c2d4721440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.618+0000 7fdbb464d740 1 -- 172.21.15.12:0/3912319417 shutdown_connections 2024-09-19T06:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.618+0000 7fdbb464d740 1 -- 172.21.15.12:0/3912319417 wait complete. 2024-09-19T06:53:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.619+0000 7fdbb464d740 1 -- start start 2024-09-19T06:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.619+0000 7fdbb464d740 1 Processor -- start 2024-09-19T06:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.619+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.619+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 0x55c2d4737ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.619+0000 7fdbb464d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 0x55c2d4737ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.619+0000 7fdbaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49044/0 (socket says 172.21.15.12:49044) 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 0x55c2d4737ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaa7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 0x55c2d4737ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:46192/0 (socket says 172.21.15.12:46192) 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaaffd640 1 -- 172.21.15.12:0/741641191 learned_addr learned my addr 172.21.15.12:0/741641191 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdb98010000 con 0x55c2d4724af0 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9800f870 con 0x55c2d4725410 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9800caa0 con 0x55c2d472fcb0 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 0x55c2d4737ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbb464d740 10 client.0 _ll_register_callbacks cb 0x7fdba000b860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaaffd640 1 -- 172.21.15.12:0/741641191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 msgr2=0x55c2d4737ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaaffd640 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 0x55c2d4737ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaaffd640 1 -- 172.21.15.12:0/741641191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 msgr2=0x55c2d4737ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaaffd640 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 0x55c2d4737ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaaffd640 1 -- 172.21.15.12:0/741641191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d4729040 con 0x55c2d4724af0 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaa7fc640 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 0x55c2d4737ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbab7fe640 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 0x55c2d4737ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdbaaffd640 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472a4e0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c004a70 tx=0x7fdb9c004aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff3e4140a36cddb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.620+0000 7fdb8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdb8eff5640 1 -- 172.21.15.12:0/741641191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c031060 con 0x55c2d4724af0 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdb8eff5640 1 -- 172.21.15.12:0/741641191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fdb9c004d90 con 0x55c2d4724af0 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb9c005500 con 0x55c2d4724af0 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdb8eff5640 1 -- 172.21.15.12:0/741641191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fdb9c038050 con 0x55c2d4724af0 2024-09-19T06:53:29.627 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdbb464d740 10 client.19182 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55c2d47aa300 con 0x55c2d4724af0 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdb8eff5640 1 -- 172.21.15.12:0/741641191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb9c0043e0 con 0x55c2d4724af0 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdb8eff5640 1 -- 172.21.15.12:0/741641191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7fdb9c011740 con 0x55c2d4724af0 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdbb464d740 10 client.19182 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdbb464d740 10 client.19182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdbb464d740 20 client.19182 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdbb464d740 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2d473f530 0x55c2d47ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdbb464d740 4 client.19182 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.621+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fdb9c005500 con 0x55c2d473f530 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.622+0000 7fdbaa7fc640 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2d473f530 0x55c2d47ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.622+0000 7fdbaa7fc640 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2d473f530 0x55c2d47ac9a0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35aaddcb72e3f9ac server_cookie=a5104e4b0ec9b92f in_seq=0 out_seq=0 2024-09-19T06:53:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.622+0000 7fdb8eff5640 10 client.19182 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.634+0000 7fdb8eff5640 1 -- 172.21.15.12:0/741641191 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fdb9c005500 con 0x55c2d473f530 2024-09-19T06:53:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.634+0000 7fdb8eff5640 10 client.19182 handle_command_reply: tid=0 2024-09-19T06:53:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.634+0000 7fdbb464d740 1 client.19182 shutdown 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 msgr2=0x55c2d472a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472a4e0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c004a70 tx=0x7fdb9c004aa0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 shutdown_connections 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c2d473f530 0x55c2d47ac9a0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c2d472fcb0 0x55c2d4737ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c2d4725410 0x55c2d4737ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdb8eff5640 0 client.19182 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 1 --2- 172.21.15.12:0/741641191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c2d4724af0 0x55c2d472a4e0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 >> 172.21.15.12:0/741641191 conn(0x55c2d4721060 msgr2=0x55c2d472ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 shutdown_connections 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 1 -- 172.21.15.12:0/741641191 wait complete. 2024-09-19T06:53:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.635+0000 7fdbb464d740 20 client.19182 trim_cache size 0 max 16384 2024-09-19T06:53:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:53:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:53:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:53:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:53:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.636+0000 7fdbb17d8640 1 -- 172.21.15.12:0/4090327288 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb940a3940 msgr2=0x7fdb940a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.636+0000 7fdbb17d8640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb940a3940 0x7fdb940a5e00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdba0006fd0 tx=0x7fdba000b160 comp rx=0 tx=0).stop 2024-09-19T06:53:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.636+0000 7fdbb17d8640 1 -- 172.21.15.12:0/4090327288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac11b140 msgr2=0x7fdbac114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.636+0000 7fdbb17d8640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac11b140 0x7fdbac114e40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdba4034040 tx=0x7fdba4032e20 comp rx=0 tx=0).stop 2024-09-19T06:53:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.636+0000 7fdbb17d8640 1 -- 172.21.15.12:0/4090327288 shutdown_connections 2024-09-19T06:53:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.636+0000 7fdbb17d8640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbac11b140 0x7fdbac114e40 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.636+0000 7fdbb17d8640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbac1095d0 0x7fdbac114900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.636+0000 7fdbb17d8640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fdb940a3940 0x7fdb940a5e00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.636+0000 7fdbb17d8640 1 --2- 172.21.15.12:0/4090327288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbac1091f0 0x7fdbac11a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.636+0000 7fdbb17d8640 1 -- 172.21.15.12:0/4090327288 >> 172.21.15.12:0/4090327288 conn(0x7fdbac06ce00 msgr2=0x7fdbac070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.638+0000 7fdbb17d8640 1 -- 172.21.15.12:0/4090327288 shutdown_connections 2024-09-19T06:53:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:29.638+0000 7fdbb17d8640 1 -- 172.21.15.12:0/4090327288 wait complete. 2024-09-19T06:53:30.134 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:53:30.299 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: pgmap v417: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 287 KiB/s wr, 32 op/s 2024-09-19T06:53:30.299 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:53:30.299 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.301 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:30 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: pgmap v417: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 287 KiB/s wr, 32 op/s 2024-09-19T06:53:30.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:30 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: pgmap v417: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 287 KiB/s wr, 32 op/s 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:30 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:30.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.746+0000 7f1126463640 1 -- 172.21.15.12:0/4120859856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1120102570 msgr2=0x7f11201029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.746+0000 7f1126463640 1 --2- 172.21.15.12:0/4120859856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1120102570 0x7f11201029b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1114009890 tx=0x7f111402a410 comp rx=0 tx=0).stop 2024-09-19T06:53:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.746+0000 7f1126463640 1 -- 172.21.15.12:0/4120859856 shutdown_connections 2024-09-19T06:53:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.746+0000 7f1126463640 1 --2- 172.21.15.12:0/4120859856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1120102ef0 0x7f112010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.746+0000 7f1126463640 1 --2- 172.21.15.12:0/4120859856 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1120102570 0x7f11201029b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.746+0000 7f1126463640 1 --2- 172.21.15.12:0/4120859856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1120100e20 0x7f1120101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.746+0000 7f1126463640 1 -- 172.21.15.12:0/4120859856 >> 172.21.15.12:0/4120859856 conn(0x7f11200fc7d0 msgr2=0x7f11200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.746+0000 7f1126463640 1 -- 172.21.15.12:0/4120859856 shutdown_connections 2024-09-19T06:53:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.747+0000 7f1126463640 1 -- 172.21.15.12:0/4120859856 wait complete. 2024-09-19T06:53:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.748+0000 7f1126463640 1 Processor -- start 2024-09-19T06:53:30.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.748+0000 7f1126463640 1 -- start start 2024-09-19T06:53:30.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.748+0000 7f1126463640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1120100e20 0x7f1120073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.749+0000 7f1126463640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1120102570 0x7f112006db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.749+0000 7f1126463640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1120102ef0 0x7f112006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.749+0000 7f1126463640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1120110f50 con 0x7f1120102570 2024-09-19T06:53:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.749+0000 7f1126463640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1120110dd0 con 0x7f1120100e20 2024-09-19T06:53:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.749+0000 7f1126463640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11201110d0 con 0x7f1120102ef0 2024-09-19T06:53:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.749+0000 7f111ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1120100e20 0x7f1120073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.749+0000 7f111ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1120100e20 0x7f1120073ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:52224/0 (socket says 172.21.15.12:52224) 2024-09-19T06:53:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.749+0000 7f111ffff640 1 -- 172.21.15.12:0/1104791878 learned_addr learned my addr 172.21.15.12:0/1104791878 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.749+0000 7f111f7fe640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1120102570 0x7f112006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.749+0000 7f1124a00640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1120102ef0 0x7f112006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.750+0000 7f111f7fe640 1 -- 172.21.15.12:0/1104791878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1120102ef0 msgr2=0x7f112006e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.750+0000 7f111f7fe640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1120102ef0 0x7f112006e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.750+0000 7f111f7fe640 1 -- 172.21.15.12:0/1104791878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1120100e20 msgr2=0x7f1120073ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.750+0000 7f111f7fe640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1120100e20 0x7f1120073ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.750+0000 7f111f7fe640 1 -- 172.21.15.12:0/1104791878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112006e770 con 0x7f1120102570 2024-09-19T06:53:30.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.750+0000 7f111f7fe640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1120102570 0x7f112006db50 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f1114034000 tx=0x7f11140305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.750+0000 7f111d7fa640 1 -- 172.21.15.12:0/1104791878 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114005460 con 0x7f1120102570 2024-09-19T06:53:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.751+0000 7f111d7fa640 1 -- 172.21.15.12:0/1104791878 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11140308b0 con 0x7f1120102570 2024-09-19T06:53:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.751+0000 7f111d7fa640 1 -- 172.21.15.12:0/1104791878 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114004c30 con 0x7f1120102570 2024-09-19T06:53:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.751+0000 7f1126463640 1 -- 172.21.15.12:0/1104791878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11201ad440 con 0x7f1120102570 2024-09-19T06:53:30.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.751+0000 7f1126463640 1 -- 172.21.15.12:0/1104791878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11201ad7e0 con 0x7f1120102570 2024-09-19T06:53:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.755+0000 7f112883c740 1 Processor -- start 2024-09-19T06:53:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.755+0000 7f112883c740 1 -- start start 2024-09-19T06:53:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.755+0000 7f111d7fa640 1 -- 172.21.15.12:0/1104791878 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1114039040 con 0x7f1120102570 2024-09-19T06:53:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.755+0000 7f112883c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd0760 0x55e304dd0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.755+0000 7f112883c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd1080 0x55e304ddb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.755+0000 7f112883c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304ddb940 0x55e304dddd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f112883c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e304d362a0 con 0x55e304dd1080 2024-09-19T06:53:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f112883c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e304cddb10 con 0x55e304dd0760 2024-09-19T06:53:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f112883c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e304d32260 con 0x55e304ddb940 2024-09-19T06:53:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f111f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304ddb940 0x55e304dddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f111f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304ddb940 0x55e304dddd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:59638/0 (socket says 172.21.15.12:59638) 2024-09-19T06:53:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f111f7fe640 1 -- 172.21.15.12:0/1577471470 learned_addr learned my addr 172.21.15.12:0/1577471470 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f111ffff640 1 --2- 172.21.15.12:0/1577471470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd1080 0x55e304ddb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f1124a00640 1 --2- 172.21.15.12:0/1577471470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd0760 0x55e304dd0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f111f7fe640 1 -- 172.21.15.12:0/1577471470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd0760 msgr2=0x55e304dd0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f111f7fe640 1 --2- 172.21.15.12:0/1577471470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd0760 0x55e304dd0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f111f7fe640 1 -- 172.21.15.12:0/1577471470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd1080 msgr2=0x55e304ddb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f111f7fe640 1 --2- 172.21.15.12:0/1577471470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd1080 0x55e304ddb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.756+0000 7f111f7fe640 1 -- 172.21.15.12:0/1577471470 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e304aa7b90 con 0x55e304ddb940 2024-09-19T06:53:30.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.757+0000 7f111f7fe640 1 --2- 172.21.15.12:0/1577471470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304ddb940 0x55e304dddd30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11140ee020 tx=0x7f11140f4b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6b4c23bcfa7a1f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.757+0000 7f11067fc640 1 -- 172.21.15.12:0/1577471470 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11140fb040 con 0x55e304ddb940 2024-09-19T06:53:30.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.757+0000 7f11067fc640 1 -- 172.21.15.12:0/1577471470 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11141008c0 con 0x55e304ddb940 2024-09-19T06:53:30.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.757+0000 7f11067fc640 1 -- 172.21.15.12:0/1577471470 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11140fd9f0 con 0x55e304ddb940 2024-09-19T06:53:30.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.757+0000 7f111d7fa640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f11080a3580 0x7f11080a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.757+0000 7f111d7fa640 1 -- 172.21.15.12:0/1104791878 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f11140f0a90 con 0x7f1120102570 2024-09-19T06:53:30.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.758+0000 7f1124a00640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f11080a3580 0x7f11080a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.758+0000 7f112883c740 1 -- 172.21.15.12:0/1577471470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304ddb940 msgr2=0x55e304dddd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.758+0000 7f112883c740 1 --2- 172.21.15.12:0/1577471470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304ddb940 0x55e304dddd30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11140ee020 tx=0x7f11140f4b90 comp rx=0 tx=0).stop 2024-09-19T06:53:30.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.759+0000 7f112883c740 1 -- 172.21.15.12:0/1577471470 shutdown_connections 2024-09-19T06:53:30.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.759+0000 7f112883c740 1 --2- 172.21.15.12:0/1577471470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304ddb940 0x55e304dddd30 secure :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11140ee020 tx=0x7f11140f4b90 comp rx=0 tx=0).stop 2024-09-19T06:53:30.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.759+0000 7f112883c740 1 --2- 172.21.15.12:0/1577471470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd1080 0x55e304ddb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.759+0000 7f112883c740 1 --2- 172.21.15.12:0/1577471470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd0760 0x55e304dd0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.759+0000 7f112883c740 1 -- 172.21.15.12:0/1577471470 >> 172.21.15.12:0/1577471470 conn(0x55e304dcccf0 msgr2=0x55e304dcd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.759+0000 7f1124a00640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f11080a3580 0x7f11080a5a40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1118005fd0 tx=0x7f1118009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.760+0000 7f112883c740 1 -- 172.21.15.12:0/1577471470 shutdown_connections 2024-09-19T06:53:30.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.760+0000 7f112883c740 1 -- 172.21.15.12:0/1577471470 wait complete. 2024-09-19T06:53:30.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.761+0000 7f112883c740 1 -- start start 2024-09-19T06:53:30.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.761+0000 7f112883c740 1 Processor -- start 2024-09-19T06:53:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.762+0000 7f112883c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 0x55e304dd8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.762+0000 7f112883c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dd1080 0x55e304dd8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.762+0000 7f111ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 0x55e304dd8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.762+0000 7f111ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 0x55e304dd8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34242/0 (socket says 172.21.15.12:34242) 2024-09-19T06:53:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.762+0000 7f111ffff640 1 -- 172.21.15.12:0/811663977 learned_addr learned my addr 172.21.15.12:0/811663977 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.762+0000 7f112883c740 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd9480 0x55e304de76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.763+0000 7f111f7fe640 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dd1080 0x55e304dd8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.763+0000 7f1124a00640 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd9480 0x55e304de76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.763+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e304dde2d0 con 0x55e304dd0760 2024-09-19T06:53:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.763+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e304cbe6e0 con 0x55e304dd9480 2024-09-19T06:53:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.763+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e304dde450 con 0x55e304dd1080 2024-09-19T06:53:30.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.763+0000 7f112883c740 10 client.0 _ll_register_callbacks cb 0x55e304ce2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.764+0000 7f111ffff640 1 -- 172.21.15.12:0/811663977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dd1080 msgr2=0x55e304dd8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.764+0000 7f111ffff640 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dd1080 0x55e304dd8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.764+0000 7f111ffff640 1 -- 172.21.15.12:0/811663977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd9480 msgr2=0x55e304de76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.764+0000 7f111ffff640 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd9480 0x55e304de76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.764+0000 7f111ffff640 1 -- 172.21.15.12:0/811663977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e304de7cf0 con 0x55e304dd0760 2024-09-19T06:53:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.764+0000 7f111ffff640 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 0x55e304dd8a00 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1110012740 tx=0x7f1110012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12da62df33b90673 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.764+0000 7f10ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:30.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.764+0000 7f10ff7fe640 1 -- 172.21.15.12:0/811663977 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110011bb0 con 0x55e304dd0760 2024-09-19T06:53:30.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.765+0000 7f10ff7fe640 1 -- 172.21.15.12:0/811663977 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f1110011d50 con 0x55e304dd0760 2024-09-19T06:53:30.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.765+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11141008c0 con 0x55e304dd0760 2024-09-19T06:53:30.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.765+0000 7f10ff7fe640 1 -- 172.21.15.12:0/811663977 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1110004020 con 0x55e304dd0760 2024-09-19T06:53:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.765+0000 7f112883c740 10 client.19194 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.765+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e304dea6e0 con 0x55e304dd0760 2024-09-19T06:53:30.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.766+0000 7f10ff7fe640 1 -- 172.21.15.12:0/811663977 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11141008c0 con 0x55e304dd0760 2024-09-19T06:53:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.766+0000 7f10ff7fe640 1 -- 172.21.15.12:0/811663977 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f111001c470 con 0x55e304dd0760 2024-09-19T06:53:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.766+0000 7f112883c740 10 client.19194 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.766+0000 7f112883c740 10 client.19194 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:53:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.766+0000 7f112883c740 20 client.19194 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.766+0000 7f112883c740 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e304debba0 0x55e304dedff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.766+0000 7f112883c740 4 client.19194 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.766+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e304d439d0 con 0x55e304debba0 2024-09-19T06:53:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.766+0000 7f111f7fe640 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e304debba0 0x55e304dedff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.767+0000 7f10ff7fe640 10 client.19194 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:30.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.768+0000 7f111f7fe640 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e304debba0 0x55e304dedff0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6023953d7fa94723 server_cookie=76a18be5754aa2c5 in_seq=0 out_seq=0 2024-09-19T06:53:30.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.768+0000 7f10ff7fe640 1 -- 172.21.15.12:0/811663977 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e304d439d0 con 0x55e304debba0 2024-09-19T06:53:30.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.768+0000 7f10ff7fe640 10 client.19194 handle_command_reply: tid=0 2024-09-19T06:53:30.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.769+0000 7f112883c740 1 client.19194 shutdown 2024-09-19T06:53:30.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.770+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 msgr2=0x55e304dd8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.770+0000 7f112883c740 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 0x55e304dd8a00 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1110012740 tx=0x7f1110012c00 comp rx=0 tx=0).stop 2024-09-19T06:53:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.770+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 shutdown_connections 2024-09-19T06:53:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.770+0000 7f112883c740 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e304debba0 0x55e304dedff0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.770+0000 7f112883c740 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd9480 0x55e304de76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.770+0000 7f112883c740 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dd1080 0x55e304dd8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.770+0000 7f112883c740 1 --2- 172.21.15.12:0/811663977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 0x55e304dd8a00 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.770+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 >> 172.21.15.12:0/811663977 conn(0x55e304dcccf0 msgr2=0x55e304dd2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.770+0000 7f10ff7fe640 0 client.19194 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:30.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.771+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 shutdown_connections 2024-09-19T06:53:30.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.771+0000 7f112883c740 1 -- 172.21.15.12:0/811663977 wait complete. 2024-09-19T06:53:30.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.771+0000 7f112883c740 20 client.19194 trim_cache size 0 max 16384 2024-09-19T06:53:30.776 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:30.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.800+0000 7f112883c740 1 Processor -- start 2024-09-19T06:53:30.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.804+0000 7f112883c740 1 -- start start 2024-09-19T06:53:30.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.804+0000 7f112883c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd7eb0 0x55e304dd89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.805+0000 7f112883c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dcccf0 0x55e304de7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.805+0000 7f112883c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dd0760 0x55e304dda970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.805+0000 7f112883c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f11201b6380 con 0x55e304dd7eb0 2024-09-19T06:53:30.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.805+0000 7f112883c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f11201b7fb0 con 0x55e304dcccf0 2024-09-19T06:53:30.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.805+0000 7f112883c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11201b6a50 con 0x55e304dd0760 2024-09-19T06:53:30.808 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 765.0 s, 1854.6 tps, lat 54.141 ms stddev 69.826 2024-09-19T06:53:30.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.807+0000 7f1124a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dd0760 0x55e304dda970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.807+0000 7f111ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd7eb0 0x55e304dd89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.807+0000 7f111ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd7eb0 0x55e304dd89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34252/0 (socket says 172.21.15.12:34252) 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.807+0000 7f111ffff640 1 -- 172.21.15.12:0/594235643 learned_addr learned my addr 172.21.15.12:0/594235643 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.807+0000 7f111f7fe640 1 --2- 172.21.15.12:0/594235643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dcccf0 0x55e304de7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.808+0000 7f111ffff640 1 -- 172.21.15.12:0/594235643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dd0760 msgr2=0x55e304dda970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.808+0000 7f111ffff640 1 --2- 172.21.15.12:0/594235643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dd0760 0x55e304dda970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.808+0000 7f111ffff640 1 -- 172.21.15.12:0/594235643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dcccf0 msgr2=0x55e304de7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.808+0000 7f111ffff640 1 --2- 172.21.15.12:0/594235643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dcccf0 0x55e304de7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.808+0000 7f111ffff640 1 -- 172.21.15.12:0/594235643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e304dd79f0 con 0x55e304dd7eb0 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.808+0000 7f111f7fe640 1 --2- 172.21.15.12:0/594235643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dcccf0 0x55e304de7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.808+0000 7f111ffff640 1 --2- 172.21.15.12:0/594235643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd7eb0 0x55e304dd89c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f111001cd80 tx=0x7f111001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2d59b1860280c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.809+0000 7f1105ffb640 1 -- 172.21.15.12:0/594235643 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111001c470 con 0x55e304dd7eb0 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.809+0000 7f1105ffb640 1 -- 172.21.15.12:0/594235643 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1110012e50 con 0x55e304dd7eb0 2024-09-19T06:53:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.809+0000 7f1105ffb640 1 -- 172.21.15.12:0/594235643 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11100041c0 con 0x55e304dd7eb0 2024-09-19T06:53:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.810+0000 7f112883c740 1 -- 172.21.15.12:0/594235643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd7eb0 msgr2=0x55e304dd89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.810+0000 7f112883c740 1 --2- 172.21.15.12:0/594235643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd7eb0 0x55e304dd89c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f111001cd80 tx=0x7f111001cdb0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.812+0000 7f112883c740 1 -- 172.21.15.12:0/594235643 shutdown_connections 2024-09-19T06:53:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.812+0000 7f112883c740 1 --2- 172.21.15.12:0/594235643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dd0760 0x55e304dda970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.812+0000 7f112883c740 1 --2- 172.21.15.12:0/594235643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dcccf0 0x55e304de7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.812+0000 7f112883c740 1 --2- 172.21.15.12:0/594235643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd7eb0 0x55e304dd89c0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.812+0000 7f112883c740 1 -- 172.21.15.12:0/594235643 >> 172.21.15.12:0/594235643 conn(0x55e304dd90a0 msgr2=0x55e304dda260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.812+0000 7f112883c740 1 -- 172.21.15.12:0/594235643 shutdown_connections 2024-09-19T06:53:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.813+0000 7f112883c740 1 -- 172.21.15.12:0/594235643 wait complete. 2024-09-19T06:53:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.813+0000 7f112883c740 1 -- start start 2024-09-19T06:53:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.814+0000 7f112883c740 1 Processor -- start 2024-09-19T06:53:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.814+0000 7f112883c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dcccf0 0x55e304de35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.814+0000 7f112883c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 0x55e304de3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.814+0000 7f112883c740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd7eb0 0x55e304de0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.814+0000 7f112883c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f11201b78e0 con 0x55e304dd0760 2024-09-19T06:53:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.814+0000 7f112883c740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f11201b7150 con 0x55e304dd7eb0 2024-09-19T06:53:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.814+0000 7f112883c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11201b4380 con 0x55e304dcccf0 2024-09-19T06:53:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.814+0000 7f112883c740 10 client.0 _ll_register_callbacks cb 0x7f1110009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.815+0000 7f111ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dcccf0 0x55e304de35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.815+0000 7f111ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dcccf0 0x55e304de35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:59670/0 (socket says 172.21.15.12:59670) 2024-09-19T06:53:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.815+0000 7f111ffff640 1 -- 172.21.15.12:0/932464698 learned_addr learned my addr 172.21.15.12:0/932464698 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.815+0000 7f111ffff640 1 -- 172.21.15.12:0/932464698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd7eb0 msgr2=0x55e304de0580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:53:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.815+0000 7f111ffff640 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd7eb0 0x55e304de0580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.815+0000 7f111ffff640 1 -- 172.21.15.12:0/932464698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 msgr2=0x55e304de3af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:53:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.816+0000 7f111ffff640 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 0x55e304de3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.816+0000 7f111ffff640 1 -- 172.21.15.12:0/932464698 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e304de0ac0 con 0x55e304dcccf0 2024-09-19T06:53:30.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.820+0000 7f111ffff640 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dcccf0 0x55e304de35b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1110012c40 tx=0x7f11100093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec515784ef501ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:30.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.823+0000 7f10ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:53:30.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.823+0000 7f10ff7fe640 1 -- 172.21.15.12:0/932464698 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110039020 con 0x55e304dcccf0 2024-09-19T06:53:30.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.823+0000 7f112883c740 1 -- 172.21.15.12:0/932464698 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1110012e50 con 0x55e304dcccf0 2024-09-19T06:53:30.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.823+0000 7f10ff7fe640 1 -- 172.21.15.12:0/932464698 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f1110032040 con 0x55e304dcccf0 2024-09-19T06:53:30.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.823+0000 7f10ff7fe640 1 -- 172.21.15.12:0/932464698 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1110044050 con 0x55e304dcccf0 2024-09-19T06:53:30.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.823+0000 7f112883c740 10 client.28441 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:30.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.823+0000 7f112883c740 1 -- 172.21.15.12:0/932464698 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e304e57000 con 0x55e304dcccf0 2024-09-19T06:53:30.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.825+0000 7f10ff7fe640 1 -- 172.21.15.12:0/932464698 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1110012e50 con 0x55e304dcccf0 2024-09-19T06:53:30.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.825+0000 7f10ff7fe640 1 -- 172.21.15.12:0/932464698 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7f111000f460 con 0x55e304dcccf0 2024-09-19T06:53:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.825+0000 7f112883c740 10 client.28441 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.825+0000 7f112883c740 10 client.28441 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:53:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.825+0000 7f112883c740 20 client.28441 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.825+0000 7f112883c740 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e304dd1080 0x55e304e59750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.825+0000 7f112883c740 4 client.28441 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-09-19T06:53:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.825+0000 7f112883c740 1 -- 172.21.15.12:0/932464698 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x55e304d3dd20 con 0x55e304dd1080 2024-09-19T06:53:30.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.827+0000 7f111f7fe640 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e304dd1080 0x55e304e59750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:30.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.828+0000 7f111f7fe640 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e304dd1080 0x55e304e59750 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fd527ddc7068faa server_cookie=356adbbd9f56375e in_seq=0 out_seq=0 2024-09-19T06:53:30.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.828+0000 7f10ff7fe640 10 client.28441 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:30.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.986+0000 7f10ff7fe640 1 -- 172.21.15.12:0/932464698 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e304d3dd20 con 0x55e304dd1080 2024-09-19T06:53:30.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.986+0000 7f10ff7fe640 10 client.28441 handle_command_reply: tid=0 2024-09-19T06:53:30.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.986+0000 7f112883c740 1 client.28441 shutdown 2024-09-19T06:53:30.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 1 -- 172.21.15.12:0/932464698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dcccf0 msgr2=0x55e304de35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dcccf0 0x55e304de35b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1110012c40 tx=0x7f11100093d0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 1 -- 172.21.15.12:0/932464698 shutdown_connections 2024-09-19T06:53:30.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e304dd1080 0x55e304e59750 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e304dd7eb0 0x55e304de0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f10ff7fe640 0 client.28441 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:30.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e304dd0760 0x55e304de3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 1 --2- 172.21.15.12:0/932464698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e304dcccf0 0x55e304de35b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 1 -- 172.21.15.12:0/932464698 >> 172.21.15.12:0/932464698 conn(0x55e304dd90a0 msgr2=0x55e304ddaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 1 -- 172.21.15.12:0/932464698 shutdown_connections 2024-09-19T06:53:30.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 1 -- 172.21.15.12:0/932464698 wait complete. 2024-09-19T06:53:30.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.987+0000 7f112883c740 20 client.28441 trim_cache size 0 max 16384 2024-09-19T06:53:30.990 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:53:30.990 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 49, 2024-09-19T06:53:30.990 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:53:30.990 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 46, 2024-09-19T06:53:30.991 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:53:30.991 INFO:teuthology.orchestra.run.smithi012.stdout: "8c07e0f0": { 2024-09-19T06:53:30.991 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 46, 2024-09-19T06:53:30.991 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:53:30.991 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:53:30.991 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:53:30.991 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:53:30.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:53:30.991 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 142.2, 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:30.992 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:30.993 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:53:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 -- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f11080a3580 msgr2=0x7f11080a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f11080a3580 0x7f11080a5a40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1118005fd0 tx=0x7f1118009500 comp rx=0 tx=0).stop 2024-09-19T06:53:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 -- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1120102570 msgr2=0x7f112006db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:30.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1120102570 0x7f112006db50 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f1114034000 tx=0x7f11140305d0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 -- 172.21.15.12:0/1104791878 shutdown_connections 2024-09-19T06:53:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f11080a3580 0x7f11080a5a40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1120102ef0 0x7f112006e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1120102570 0x7f112006db50 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 --2- 172.21.15.12:0/1104791878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1120100e20 0x7f1120073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 -- 172.21.15.12:0/1104791878 >> 172.21.15.12:0/1104791878 conn(0x7f11200fc7d0 msgr2=0x7f1120069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 -- 172.21.15.12:0/1104791878 shutdown_connections 2024-09-19T06:53:30.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:30.988+0000 7f1126463640 1 -- 172.21.15.12:0/1104791878 wait complete. 2024-09-19T06:53:31.178 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:31 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:53:31.178 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:31 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:31.178 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:31 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:53:31.178 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:31 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:31.178 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:31 smithi012 ceph-mon[30937]: pgmap v418: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 3.5 MiB/s wr, 360 op/s 2024-09-19T06:53:31.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:31 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:53:31.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:31 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:31.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:31 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:53:31.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:31 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:31.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:31 smithi016 ceph-mon[34911]: pgmap v418: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 3.5 MiB/s wr, 360 op/s 2024-09-19T06:53:31.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:31 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:53:31.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:31 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:31.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:31 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:53:31.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:31 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:53:31.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:31 smithi173 ceph-mon[35349]: pgmap v418: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 3.5 MiB/s wr, 360 op/s 2024-09-19T06:53:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.609+0000 7fc806c1c640 1 -- 172.21.15.12:0/1478739911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc80010c170 msgr2=0x7fc80010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.609+0000 7fc806c1c640 1 --2- 172.21.15.12:0/1478739911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc80010c170 0x7fc80010e610 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009ca0 tx=0x7fc7f802a950 comp rx=0 tx=0).stop 2024-09-19T06:53:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.609+0000 7fc806c1c640 1 -- 172.21.15.12:0/1478739911 shutdown_connections 2024-09-19T06:53:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.609+0000 7fc806c1c640 1 --2- 172.21.15.12:0/1478739911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc80010c170 0x7fc80010e610 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.609+0000 7fc806c1c640 1 --2- 172.21.15.12:0/1478739911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc800103660 0x7fc80010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.609+0000 7fc806c1c640 1 --2- 172.21.15.12:0/1478739911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc800102d40 0x7fc800103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.609+0000 7fc806c1c640 1 -- 172.21.15.12:0/1478739911 >> 172.21.15.12:0/1478739911 conn(0x7fc8000fc7a0 msgr2=0x7fc8000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.609+0000 7fc806c1c640 1 -- 172.21.15.12:0/1478739911 shutdown_connections 2024-09-19T06:53:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.609+0000 7fc806c1c640 1 -- 172.21.15.12:0/1478739911 wait complete. 2024-09-19T06:53:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc806c1c640 1 Processor -- start 2024-09-19T06:53:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc806c1c640 1 -- start start 2024-09-19T06:53:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc806c1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc800102d40 0x7fc800198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc806c1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc800103660 0x7fc800198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc806c1c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc80010c170 0x7fc80019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc806c1c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc800111f30 con 0x7fc800103660 2024-09-19T06:53:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc806c1c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc800111db0 con 0x7fc800102d40 2024-09-19T06:53:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc806c1c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8001120b0 con 0x7fc80010c170 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc7fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc800103660 0x7fc800198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc7fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc800103660 0x7fc800198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34282/0 (socket says 172.21.15.12:34282) 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc7fffff640 1 -- 172.21.15.12:0/2920959654 learned_addr learned my addr 172.21.15.12:0/2920959654 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.610+0000 7fc8051b9640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc80010c170 0x7fc80019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc8049b8640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc800102d40 0x7fc800198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc7fffff640 1 -- 172.21.15.12:0/2920959654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc80010c170 msgr2=0x7fc80019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc7fffff640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc80010c170 0x7fc80019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc7fffff640 1 -- 172.21.15.12:0/2920959654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc800102d40 msgr2=0x7fc800198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc7fffff640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc800102d40 0x7fc800198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc7fffff640 1 -- 172.21.15.12:0/2920959654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80019d3f0 con 0x7fc800103660 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc7fffff640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc800103660 0x7fc800198980 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00d740 tx=0x7fc7ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc7fdffb640 1 -- 172.21.15.12:0/2920959654 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec017070 con 0x7fc800103660 2024-09-19T06:53:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc806c1c640 1 -- 172.21.15.12:0/2920959654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80019d6e0 con 0x7fc800103660 2024-09-19T06:53:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc7fdffb640 1 -- 172.21.15.12:0/2920959654 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7ec00de50 con 0x7fc800103660 2024-09-19T06:53:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc7fdffb640 1 -- 172.21.15.12:0/2920959654 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00f620 con 0x7fc800103660 2024-09-19T06:53:31.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.611+0000 7fc806c1c640 1 -- 172.21.15.12:0/2920959654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8001a4fc0 con 0x7fc800103660 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.614+0000 7fc7fdffb640 1 -- 172.21.15.12:0/2920959654 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc7ec009c30 con 0x7fc800103660 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.614+0000 7fc808ff5740 1 Processor -- start 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.614+0000 7fc808ff5740 1 -- start start 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.614+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6b360 0x55fa1ac6b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.614+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac7a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.614+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac7ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.614+0000 7fc808ff5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fa1abd12e0 con 0x55fa1ac6bc80 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.614+0000 7fc808ff5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fa1ab78ce0 con 0x55fa1ac6b360 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.614+0000 7fc808ff5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fa1abcd2a0 con 0x55fa1ac7aa90 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc7fdffb640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7f00a33b0 0x7fc7f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8049b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac7a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8049b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac7a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34284/0 (socket says 172.21.15.12:34284) 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8049b8640 1 -- 172.21.15.12:0/4151793353 learned_addr learned my addr 172.21.15.12:0/4151793353 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8051b9640 1 --2- 172.21.15.12:0/4151793353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6b360 0x55fa1ac6b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc7fffff640 1 --2- 172.21.15.12:0/4151793353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac7ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8051b9640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7f00a33b0 0x7fc7f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8049b8640 1 -- 172.21.15.12:0/4151793353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 msgr2=0x55fa1ac7ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8049b8640 1 --2- 172.21.15.12:0/4151793353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac7ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8049b8640 1 -- 172.21.15.12:0/4151793353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6b360 msgr2=0x55fa1ac6b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc7fdffb640 1 -- 172.21.15.12:0/2920959654 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fc7ec0cf900 con 0x7fc800103660 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8049b8640 1 --2- 172.21.15.12:0/4151793353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6b360 0x55fa1ac6b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8049b8640 1 -- 172.21.15.12:0/4151793353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa1ab5d440 con 0x55fa1ac6bc80 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8051b9640 1 --2- 172.21.15.12:0/4151793353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6b360 0x55fa1ac6b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8049b8640 1 --2- 172.21.15.12:0/4151793353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac7a550 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400bd10 tx=0x7fc7f40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecebaca115ac103 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc7eaffd640 1 -- 172.21.15.12:0/4151793353 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4004030 con 0x55fa1ac6bc80 2024-09-19T06:53:31.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc8051b9640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7f00a33b0 0x7fc7f00a5870 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009430 tx=0x7fc7f8005c50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc7eaffd640 1 -- 172.21.15.12:0/4151793353 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7f40041d0 con 0x55fa1ac6bc80 2024-09-19T06:53:31.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.615+0000 7fc7eaffd640 1 -- 172.21.15.12:0/4151793353 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4011820 con 0x55fa1ac6bc80 2024-09-19T06:53:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.616+0000 7fc808ff5740 1 -- 172.21.15.12:0/4151793353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6bc80 msgr2=0x55fa1ac7a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.616+0000 7fc808ff5740 1 --2- 172.21.15.12:0/4151793353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac7a550 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400bd10 tx=0x7fc7f40107a0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.616+0000 7fc808ff5740 1 -- 172.21.15.12:0/4151793353 shutdown_connections 2024-09-19T06:53:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.616+0000 7fc808ff5740 1 --2- 172.21.15.12:0/4151793353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac7ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.616+0000 7fc808ff5740 1 --2- 172.21.15.12:0/4151793353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac7a550 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.616+0000 7fc808ff5740 1 --2- 172.21.15.12:0/4151793353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6b360 0x55fa1ac6b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.616+0000 7fc808ff5740 1 -- 172.21.15.12:0/4151793353 >> 172.21.15.12:0/4151793353 conn(0x55fa1ac67a30 msgr2=0x55fa1ac67e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.616+0000 7fc808ff5740 1 -- 172.21.15.12:0/4151793353 shutdown_connections 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.616+0000 7fc808ff5740 1 -- 172.21.15.12:0/4151793353 wait complete. 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc808ff5740 1 -- start start 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc808ff5740 1 Processor -- start 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac7a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac77720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac77cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc808ff5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fa1ac7d660 con 0x55fa1ac6b360 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc808ff5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55fa1ab8c050 con 0x55fa1ac7aa90 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc808ff5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fa1ac7d7e0 con 0x55fa1ac6bc80 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc8049b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac7a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc808ff5740 10 client.0 _ll_register_callbacks cb 0x55fa1abcc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc8049b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac7a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34300/0 (socket says 172.21.15.12:34300) 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc8049b8640 1 -- 172.21.15.12:0/2131395840 learned_addr learned my addr 172.21.15.12:0/2131395840 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc8051b9640 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac77cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.617+0000 7fc7fffff640 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac77720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc8049b8640 1 -- 172.21.15.12:0/2131395840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac6bc80 msgr2=0x55fa1ac77720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc8049b8640 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac77720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc8049b8640 1 -- 172.21.15.12:0/2131395840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac7aa90 msgr2=0x55fa1ac77cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc8049b8640 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac77cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc8049b8640 1 -- 172.21.15.12:0/2131395840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa1a9423c0 con 0x55fa1ac6b360 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc7fffff640 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac77720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc8049b8640 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac7a470 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4010ca0 tx=0x7fc7f4004140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241bdcccb20b20f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc7dffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc7dffff640 1 -- 172.21.15.12:0/2131395840 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4029060 con 0x55fa1ac6b360 2024-09-19T06:53:31.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc7dffff640 1 -- 172.21.15.12:0/2131395840 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fc7f40035f0 con 0x55fa1ac6b360 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc808ff5740 1 -- 172.21.15.12:0/2131395840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7f40041d0 con 0x55fa1ac6b360 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc7dffff640 1 -- 172.21.15.12:0/2131395840 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fc7f4030050 con 0x55fa1ac6b360 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc808ff5740 10 client.19209 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc808ff5740 1 -- 172.21.15.12:0/2131395840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55fa1ac890e0 con 0x55fa1ac6b360 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.618+0000 7fc7dffff640 1 -- 172.21.15.12:0/2131395840 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7f40041d0 con 0x55fa1ac6b360 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.619+0000 7fc7dffff640 1 -- 172.21.15.12:0/2131395840 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7fc7f40047e0 con 0x55fa1ac6b360 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.619+0000 7fc808ff5740 10 client.19209 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.619+0000 7fc808ff5740 10 client.19209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.619+0000 7fc808ff5740 20 client.19209 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.619+0000 7fc808ff5740 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa1ac8a4e0 0x55fa1ac8c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.619+0000 7fc808ff5740 4 client.19209 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.619+0000 7fc808ff5740 1 -- 172.21.15.12:0/2131395840 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa1abde850 con 0x55fa1ac8a4e0 2024-09-19T06:53:31.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.619+0000 7fc7fffff640 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa1ac8a4e0 0x55fa1ac8c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.619+0000 7fc7fffff640 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa1ac8a4e0 0x55fa1ac8c8d0 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35ddafbf83048668 server_cookie=80c28e2dc700b145 in_seq=0 out_seq=0 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.619+0000 7fc7dffff640 10 client.19209 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc7dffff640 1 -- 172.21.15.12:0/2131395840 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa1abde850 con 0x55fa1ac8a4e0 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc7dffff640 10 client.19209 handle_command_reply: tid=0 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 client.19209 shutdown 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 -- 172.21.15.12:0/2131395840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 msgr2=0x55fa1ac7a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac7a470 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4010ca0 tx=0x7fc7f4004140 comp rx=0 tx=0).stop 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 -- 172.21.15.12:0/2131395840 shutdown_connections 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa1ac8a4e0 0x55fa1ac8c8d0 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc7dffff640 0 client.19209 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac77cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac77720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 --2- 172.21.15.12:0/2131395840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac7a470 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 -- 172.21.15.12:0/2131395840 >> 172.21.15.12:0/2131395840 conn(0x55fa1ac67a30 msgr2=0x55fa1ac6d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 -- 172.21.15.12:0/2131395840 shutdown_connections 2024-09-19T06:53:31.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.620+0000 7fc808ff5740 1 -- 172.21.15.12:0/2131395840 wait complete. 2024-09-19T06:53:31.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.621+0000 7fc808ff5740 20 client.19209 trim_cache size 0 max 16384 2024-09-19T06:53:31.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc808ff5740 1 Processor -- start 2024-09-19T06:53:31.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc808ff5740 1 -- start start 2024-09-19T06:53:31.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac86900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac91e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac923b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc808ff5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc8001ab9e0 con 0x55fa1ac6b360 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc808ff5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc8001ad610 con 0x55fa1ac6bc80 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc808ff5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8001ac0b0 con 0x55fa1ac7aa90 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc8049b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac86900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc8049b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac86900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34314/0 (socket says 172.21.15.12:34314) 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc8049b8640 1 -- 172.21.15.12:0/4074083247 learned_addr learned my addr 172.21.15.12:0/4074083247 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc8051b9640 1 --2- 172.21.15.12:0/4074083247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc7fffff640 1 --2- 172.21.15.12:0/4074083247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac91e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc8049b8640 1 -- 172.21.15.12:0/4074083247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 msgr2=0x55fa1ac923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc8049b8640 1 --2- 172.21.15.12:0/4074083247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac923b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc8049b8640 1 -- 172.21.15.12:0/4074083247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 msgr2=0x55fa1ac91e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc8049b8640 1 --2- 172.21.15.12:0/4074083247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac91e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc8049b8640 1 -- 172.21.15.12:0/4074083247 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa1ac78060 con 0x55fa1ac6b360 2024-09-19T06:53:31.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.638+0000 7fc7fffff640 1 --2- 172.21.15.12:0/4074083247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac91e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc8049b8640 1 --2- 172.21.15.12:0/4074083247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac86900 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4004be0 tx=0x7fc7f4003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bacbff126320c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc7ea7fc640 1 -- 172.21.15.12:0/4074083247 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4029070 con 0x55fa1ac6b360 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc7ea7fc640 1 -- 172.21.15.12:0/4074083247 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7f4011440 con 0x55fa1ac6b360 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc7ea7fc640 1 -- 172.21.15.12:0/4074083247 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4011730 con 0x55fa1ac6b360 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc808ff5740 1 -- 172.21.15.12:0/4074083247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 msgr2=0x55fa1ac86900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc808ff5740 1 --2- 172.21.15.12:0/4074083247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac86900 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4004be0 tx=0x7fc7f4003d70 comp rx=0 tx=0).stop 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc808ff5740 1 -- 172.21.15.12:0/4074083247 shutdown_connections 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc808ff5740 1 --2- 172.21.15.12:0/4074083247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc808ff5740 1 --2- 172.21.15.12:0/4074083247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac91e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc808ff5740 1 --2- 172.21.15.12:0/4074083247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac86900 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.639+0000 7fc808ff5740 1 -- 172.21.15.12:0/4074083247 >> 172.21.15.12:0/4074083247 conn(0x55fa1ac67a30 msgr2=0x55fa1ac72d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.640+0000 7fc808ff5740 1 -- 172.21.15.12:0/4074083247 shutdown_connections 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.640+0000 7fc808ff5740 1 -- 172.21.15.12:0/4074083247 wait complete. 2024-09-19T06:53:31.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.640+0000 7fc808ff5740 1 -- start start 2024-09-19T06:53:31.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.640+0000 7fc808ff5740 1 Processor -- start 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.640+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac82fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.640+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac742a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.640+0000 7fc808ff5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac747e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.640+0000 7fc808ff5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc8001acf40 con 0x55fa1ac6b360 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.640+0000 7fc808ff5740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc8001ac7b0 con 0x55fa1ac6bc80 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc808ff5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8001a99e0 con 0x55fa1ac7aa90 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc808ff5740 10 client.0 _ll_register_callbacks cb 0x7fc7f400bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc8049b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac82fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc8049b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac82fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34328/0 (socket says 172.21.15.12:34328) 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc8049b8640 1 -- 172.21.15.12:0/926764332 learned_addr learned my addr 172.21.15.12:0/926764332 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc7fffff640 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac742a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc8051b9640 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc8049b8640 1 -- 172.21.15.12:0/926764332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 msgr2=0x55fa1ac747e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc8049b8640 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac747e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc8049b8640 1 -- 172.21.15.12:0/926764332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 msgr2=0x55fa1ac742a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc8049b8640 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac742a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc8049b8640 1 -- 172.21.15.12:0/926764332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa1ac74e20 con 0x55fa1ac6b360 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc7fffff640 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac742a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc8049b8640 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac82fc0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4000c00 tx=0x7fc7f4005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5a5d468fdbc144 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc7dffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc7dffff640 1 -- 172.21.15.12:0/926764332 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4029040 con 0x55fa1ac6b360 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc7dffff640 1 -- 172.21.15.12:0/926764332 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fc7f4003870 con 0x55fa1ac6b360 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.641+0000 7fc808ff5740 1 -- 172.21.15.12:0/926764332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7f4011440 con 0x55fa1ac6b360 2024-09-19T06:53:31.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc7dffff640 1 -- 172.21.15.12:0/926764332 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fc7f4004190 con 0x55fa1ac6b360 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc808ff5740 10 client.19215 fetch_fsmap learned FSMap version 49 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc808ff5740 1 -- 172.21.15.12:0/926764332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55fa1acf4c80 con 0x55fa1ac6b360 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc7dffff640 1 -- 172.21.15.12:0/926764332 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7f4011440 con 0x55fa1ac6b360 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc7dffff640 1 -- 172.21.15.12:0/926764332 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8382+0+0 (secure 0 0 0) 0x7fc7f4011cd0 con 0x55fa1ac6b360 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc808ff5740 10 client.19215 fetch_fsmap finished waiting for FSMap version 49 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc808ff5740 10 client.19215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc808ff5740 20 client.19215 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc808ff5740 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa1acf52d0 0x55fa1acf76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc808ff5740 4 client.19215 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc808ff5740 1 -- 172.21.15.12:0/926764332 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fa1abd8d60 con 0x55fa1acf52d0 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.642+0000 7fc7fffff640 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa1acf52d0 0x55fa1acf76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc7fffff640 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa1acf52d0 0x55fa1acf76f0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e5fa614f9c55e0 server_cookie=2c522352d7d46d0 in_seq=0 out_seq=0 2024-09-19T06:53:31.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc7dffff640 10 client.19215 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc7dffff640 1 -- 172.21.15.12:0/926764332 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55fa1abd8d60 con 0x55fa1acf52d0 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc7dffff640 10 client.19215 handle_command_reply: tid=0 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 client.19215 shutdown 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 -- 172.21.15.12:0/926764332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 msgr2=0x55fa1ac82fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac82fc0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4000c00 tx=0x7fc7f4005d40 comp rx=0 tx=0).stop 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 -- 172.21.15.12:0/926764332 shutdown_connections 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55fa1acf52d0 0x55fa1acf76f0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fa1ac7aa90 0x55fa1ac747e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55fa1ac6bc80 0x55fa1ac742a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 --2- 172.21.15.12:0/926764332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa1ac6b360 0x55fa1ac82fc0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 -- 172.21.15.12:0/926764332 >> 172.21.15.12:0/926764332 conn(0x55fa1ac67a30 msgr2=0x55fa1ac66350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc7dffff640 0 client.19215 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:31.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 -- 172.21.15.12:0/926764332 shutdown_connections 2024-09-19T06:53:31.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 1 -- 172.21.15.12:0/926764332 wait complete. 2024-09-19T06:53:31.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.643+0000 7fc808ff5740 20 client.19215 trim_cache size 0 max 16384 2024-09-19T06:53:31.651 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:53:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:53:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:53:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "e9b26a99-c6c3-44a3-93c0-42361559aec6": { 2024-09-19T06:53:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:53:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "e9b26a99-c6c3-44a3-93c0-42361559aec6", 2024-09-19T06:53:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:53:31.651 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:31.652 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:31.652 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 -- 172.21.15.12:0/2920959654 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7f00a33b0 msgr2=0x7fc7f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7f00a33b0 0x7fc7f00a5870 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009430 tx=0x7fc7f8005c50 comp rx=0 tx=0).stop 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 -- 172.21.15.12:0/2920959654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc800103660 msgr2=0x7fc800198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc800103660 0x7fc800198980 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00d740 tx=0x7fc7ec00dc00 comp rx=0 tx=0).stop 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 -- 172.21.15.12:0/2920959654 shutdown_connections 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc7f00a33b0 0x7fc7f00a5870 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc80010c170 0x7fc80019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc800103660 0x7fc800198980 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 --2- 172.21.15.12:0/2920959654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc800102d40 0x7fc800198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 -- 172.21.15.12:0/2920959654 >> 172.21.15.12:0/2920959654 conn(0x7fc8000fc7a0 msgr2=0x7fc8000fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 -- 172.21.15.12:0/2920959654 shutdown_connections 2024-09-19T06:53:31.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:31.644+0000 7fc806c1c640 1 -- 172.21.15.12:0/2920959654 wait complete. 2024-09-19T06:53:32.453 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8c07e0f0', quiesce took 6.6 seconds. Will release after: 15.6 2024-09-19T06:53:32.971 INFO:tasks.cephfs.filesystem:scrub status for tag:e9b26a99-c6c3-44a3-93c0-42361559aec6 - {'path': '/', 'tag': 'e9b26a99-c6c3-44a3-93c0-42361559aec6', 'options': 'recursive,force'} 2024-09-19T06:53:33.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:33 smithi016 ceph-mon[34911]: pgmap v419: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 3.5 MiB/s wr, 352 op/s 2024-09-19T06:53:33.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:33 smithi173 ceph-mon[35349]: pgmap v419: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 3.5 MiB/s wr, 352 op/s 2024-09-19T06:53:33.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:33 smithi012 ceph-mon[30937]: pgmap v419: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 3.5 MiB/s wr, 352 op/s 2024-09-19T06:53:35.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:35 smithi016 ceph-mon[34911]: pgmap v420: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 3.5 MiB/s wr, 362 op/s 2024-09-19T06:53:35.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 770.0 s, 10.2 tps, lat 71.442 ms stddev 48.082 2024-09-19T06:53:35.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:35 smithi173 ceph-mon[35349]: pgmap v420: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 3.5 MiB/s wr, 362 op/s 2024-09-19T06:53:35.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:35 smithi012 ceph-mon[30937]: pgmap v420: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 3.5 MiB/s wr, 362 op/s 2024-09-19T06:53:37.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:37 smithi016 ceph-mon[34911]: pgmap v421: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.2 MiB/s wr, 453 op/s 2024-09-19T06:53:37.810 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:37 smithi012 ceph-mon[30937]: pgmap v421: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.2 MiB/s wr, 453 op/s 2024-09-19T06:53:37.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:37 smithi173 ceph-mon[35349]: pgmap v421: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.2 MiB/s wr, 453 op/s 2024-09-19T06:53:39.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:39 smithi016 ceph-mon[34911]: pgmap v422: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.0 MiB/s wr, 429 op/s 2024-09-19T06:53:39.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:39 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:53:39.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:39 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:53:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:39 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:53:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:39 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:53:39.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:39 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:53:39.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:39 smithi173 ceph-mon[35349]: pgmap v422: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.0 MiB/s wr, 429 op/s 2024-09-19T06:53:39.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:39 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:53:39.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:39 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:53:39.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:39 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:53:39.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:39 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:53:39.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:39 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:53:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:39 smithi012 ceph-mon[30937]: pgmap v422: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.0 MiB/s wr, 429 op/s 2024-09-19T06:53:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:39 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:53:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:39 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:53:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:39 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:53:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:39 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:53:39.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:39 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:53:40.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:40 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:53:40.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:53:40.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:40 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:53:40.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:40 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:53:41.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:41 smithi016 ceph-mon[34911]: pgmap v423: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 4.7 MiB/s wr, 520 op/s 2024-09-19T06:53:41.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:41 smithi173 ceph-mon[35349]: pgmap v423: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 4.7 MiB/s wr, 520 op/s 2024-09-19T06:53:41.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:41 smithi012 ceph-mon[30937]: pgmap v423: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 4.7 MiB/s wr, 520 op/s 2024-09-19T06:53:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.742+0000 7fe2673cf640 1 -- 172.21.15.12:0/1142891875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe260105540 msgr2=0x7fe26010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.742+0000 7fe2673cf640 1 --2- 172.21.15.12:0/1142891875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe260105540 0x7fe26010d090 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fe258009ca0 tx=0x7fe25802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.742+0000 7fe2673cf640 1 -- 172.21.15.12:0/1142891875 shutdown_connections 2024-09-19T06:53:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.742+0000 7fe2673cf640 1 --2- 172.21.15.12:0/1142891875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe260105540 0x7fe26010d090 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.742+0000 7fe2673cf640 1 --2- 172.21.15.12:0/1142891875 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe260101200 0x7fe260104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.742+0000 7fe2673cf640 1 --2- 172.21.15.12:0/1142891875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe260100850 0x7fe260100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.742+0000 7fe2673cf640 1 -- 172.21.15.12:0/1142891875 >> 172.21.15.12:0/1142891875 conn(0x7fe260075db0 msgr2=0x7fe2600761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.742+0000 7fe2673cf640 1 -- 172.21.15.12:0/1142891875 shutdown_connections 2024-09-19T06:53:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.742+0000 7fe2673cf640 1 -- 172.21.15.12:0/1142891875 wait complete. 2024-09-19T06:53:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe2673cf640 1 Processor -- start 2024-09-19T06:53:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe2673cf640 1 -- start start 2024-09-19T06:53:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe2673cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe260100850 0x7fe26010e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe2673cf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe260105540 0x7fe26010ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe2673cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe26010f230 0x7fe2601a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe2673cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe260111f30 con 0x7fe260100850 2024-09-19T06:53:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe2673cf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe260111db0 con 0x7fe26010f230 2024-09-19T06:53:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe2673cf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601120b0 con 0x7fe260105540 2024-09-19T06:53:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe26516b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe260100850 0x7fe26010e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe26516b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe260100850 0x7fe26010e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47700/0 (socket says 172.21.15.12:47700) 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe26516b640 1 -- 172.21.15.12:0/3480193648 learned_addr learned my addr 172.21.15.12:0/3480193648 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe26596c640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe26010f230 0x7fe2601a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe26516b640 1 -- 172.21.15.12:0/3480193648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe260105540 msgr2=0x7fe26010ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe26516b640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe260105540 0x7fe26010ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe26516b640 1 -- 172.21.15.12:0/3480193648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe26010f230 msgr2=0x7fe2601a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.743+0000 7fe26516b640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe26010f230 0x7fe2601a6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.744+0000 7fe26516b640 1 -- 172.21.15.12:0/3480193648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2601a6c20 con 0x7fe260100850 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.744+0000 7fe26516b640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe260100850 0x7fe26010e7b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00d950 tx=0x7fe25c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.744+0000 7fe2527fc640 1 -- 172.21.15.12:0/3480193648 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c017030 con 0x7fe260100850 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.744+0000 7fe2527fc640 1 -- 172.21.15.12:0/3480193648 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe25c004020 con 0x7fe260100850 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.744+0000 7fe2673cf640 1 -- 172.21.15.12:0/3480193648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2601a6f10 con 0x7fe260100850 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.744+0000 7fe2527fc640 1 -- 172.21.15.12:0/3480193648 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0047a0 con 0x7fe260100850 2024-09-19T06:53:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.744+0000 7fe2673cf640 1 -- 172.21.15.12:0/3480193648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2601a7420 con 0x7fe260100850 2024-09-19T06:53:42.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.746+0000 7fe2527fc640 1 -- 172.21.15.12:0/3480193648 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe25c0041d0 con 0x7fe260100850 2024-09-19T06:53:42.750 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26a243740 1 Processor -- start 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26a243740 1 -- start start 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26a243740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c45aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26a243740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c465770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26a243740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 0x563c1c4680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26a243740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563c1c3bf2f0 con 0x563c1c45b410 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26a243740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563c1c367270 con 0x563c1c465cb0 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe2527fc640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe24c0a3510 0x7fe24c0a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26a243740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563c1c3bb2b0 con 0x563c1c45aaf0 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26516b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c465770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26516b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c465770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47710/0 (socket says 172.21.15.12:47710) 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26516b640 1 -- 172.21.15.12:0/2151444185 learned_addr learned my addr 172.21.15.12:0/2151444185 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.747+0000 7fe26596c640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe24c0a3510 0x7fe24c0a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe26496a640 1 --2- 172.21.15.12:0/2151444185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 0x563c1c4680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe26596c640 1 --2- 172.21.15.12:0/2151444185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c45aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe2527fc640 1 -- 172.21.15.12:0/3480193648 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fe25c0cf7d0 con 0x7fe260100850 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe26516b640 1 -- 172.21.15.12:0/2151444185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 msgr2=0x563c1c45aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe26516b640 1 --2- 172.21.15.12:0/2151444185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c45aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe26516b640 1 -- 172.21.15.12:0/2151444185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 msgr2=0x563c1c4680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe26516b640 1 --2- 172.21.15.12:0/2151444185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 0x563c1c4680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe26516b640 1 -- 172.21.15.12:0/2151444185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c1c366340 con 0x563c1c45b410 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe26496a640 1 --2- 172.21.15.12:0/2151444185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 0x563c1c4680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe26516b640 1 --2- 172.21.15.12:0/2151444185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c465770 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0ccd60 tx=0x7fe25c09b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56edf37ae49fc14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe26596c640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe24c0a3510 0x7fe24c0a59d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe25802f540 tx=0x7fe25802f310 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe24b7fe640 1 -- 172.21.15.12:0/2151444185 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c09c0b0 con 0x563c1c45b410 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe24b7fe640 1 -- 172.21.15.12:0/2151444185 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe25c09b9b0 con 0x563c1c45b410 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.748+0000 7fe24b7fe640 1 -- 172.21.15.12:0/2151444185 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0cd0a0 con 0x563c1c45b410 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 -- 172.21.15.12:0/2151444185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 msgr2=0x563c1c465770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 --2- 172.21.15.12:0/2151444185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c465770 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0ccd60 tx=0x7fe25c09b780 comp rx=0 tx=0).stop 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 -- 172.21.15.12:0/2151444185 shutdown_connections 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 --2- 172.21.15.12:0/2151444185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 0x563c1c4680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 --2- 172.21.15.12:0/2151444185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c465770 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 --2- 172.21.15.12:0/2151444185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c45aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 -- 172.21.15.12:0/2151444185 >> 172.21.15.12:0/2151444185 conn(0x563c1c457060 msgr2=0x563c1c457440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 -- 172.21.15.12:0/2151444185 shutdown_connections 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 -- 172.21.15.12:0/2151444185 wait complete. 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 -- start start 2024-09-19T06:53:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.749+0000 7fe26a243740 1 Processor -- start 2024-09-19T06:53:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26a243740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c462af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26a243740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45b410 0x563c1c463030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26a243740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c463570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26a243740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563c1c468880 con 0x563c1c465cb0 2024-09-19T06:53:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26a243740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563c1c348290 con 0x563c1c45b410 2024-09-19T06:53:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26a243740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563c1c468a00 con 0x563c1c45aaf0 2024-09-19T06:53:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26a243740 10 client.0 _ll_register_callbacks cb 0x563c1c379140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:42.757 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26596c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c463570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26596c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c463570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47716/0 (socket says 172.21.15.12:47716) 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26596c640 1 -- 172.21.15.12:0/172539643 learned_addr learned my addr 172.21.15.12:0/172539643 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26516b640 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c462af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26496a640 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45b410 0x563c1c463030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26596c640 1 -- 172.21.15.12:0/172539643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 msgr2=0x563c1c462af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26596c640 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c462af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26596c640 1 -- 172.21.15.12:0/172539643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45b410 msgr2=0x563c1c463030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26596c640 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45b410 0x563c1c463030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26596c640 1 -- 172.21.15.12:0/172539643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c1c0d2210 con 0x563c1c465cb0 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.750+0000 7fe26516b640 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c462af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe26596c640 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c463570 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fe25802afe0 tx=0x7fe258046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365ef1edcd3f73de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe248ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe248ff9640 1 -- 172.21.15.12:0/172539643 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe258052070 con 0x563c1c465cb0 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe248ff9640 1 -- 172.21.15.12:0/172539643 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fe258003970 con 0x563c1c465cb0 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe26a243740 1 -- 172.21.15.12:0/172539643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe25c09b9b0 con 0x563c1c465cb0 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe248ff9640 1 -- 172.21.15.12:0/172539643 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe25805d050 con 0x563c1c465cb0 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe26a243740 10 client.19227 fetch_fsmap learned FSMap version 50 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe26a243740 1 -- 172.21.15.12:0/172539643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563c1c19e620 con 0x563c1c465cb0 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe248ff9640 1 -- 172.21.15.12:0/172539643 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe25c09b9b0 con 0x563c1c465cb0 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe248ff9640 1 -- 172.21.15.12:0/172539643 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fe2580305c0 con 0x563c1c465cb0 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe26a243740 10 client.19227 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.751+0000 7fe26a243740 10 client.19227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.752+0000 7fe26a243740 20 client.19227 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.752+0000 7fe26a243740 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c1c475bb0 0x563c1c477fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.752+0000 7fe26a243740 4 client.19227 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.752+0000 7fe26a243740 1 -- 172.21.15.12:0/172539643 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c1c3cca20 con 0x563c1c475bb0 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.752+0000 7fe26516b640 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c1c475bb0 0x563c1c477fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.752+0000 7fe26516b640 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c1c475bb0 0x563c1c477fe0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=276264803bdf38b2 server_cookie=1746eb4684e56f68 in_seq=0 out_seq=0 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.752+0000 7fe248ff9640 10 client.19227 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe248ff9640 1 -- 172.21.15.12:0/172539643 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c1c3cca20 con 0x563c1c475bb0 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe248ff9640 10 client.19227 handle_command_reply: tid=0 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 client.19227 shutdown 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 -- 172.21.15.12:0/172539643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 msgr2=0x563c1c463570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c463570 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fe25802afe0 tx=0x7fe258046000 comp rx=0 tx=0).stop 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 -- 172.21.15.12:0/172539643 shutdown_connections 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c1c475bb0 0x563c1c477fe0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c463570 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45b410 0x563c1c463030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe248ff9640 0 client.19227 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 --2- 172.21.15.12:0/172539643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c462af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 -- 172.21.15.12:0/172539643 >> 172.21.15.12:0/172539643 conn(0x563c1c457060 msgr2=0x563c1c45cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 -- 172.21.15.12:0/172539643 shutdown_connections 2024-09-19T06:53:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 1 -- 172.21.15.12:0/172539643 wait complete. 2024-09-19T06:53:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.753+0000 7fe26a243740 20 client.19227 trim_cache size 0 max 16384 2024-09-19T06:53:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26a243740 1 Processor -- start 2024-09-19T06:53:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26a243740 1 -- start start 2024-09-19T06:53:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26a243740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c4633a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26a243740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c47d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26a243740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 0x563c1c47de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26a243740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601afda0 con 0x563c1c45b410 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26a243740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601b19a0 con 0x563c1c465cb0 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26a243740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601b0470 con 0x563c1c45aaf0 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26496a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c47d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26496a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c47d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47726/0 (socket says 172.21.15.12:47726) 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.768+0000 7fe26496a640 1 -- 172.21.15.12:0/3736585289 learned_addr learned my addr 172.21.15.12:0/3736585289 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe26596c640 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 0x563c1c47de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe26496a640 1 -- 172.21.15.12:0/3736585289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 msgr2=0x563c1c4633a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe26516b640 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c4633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe26496a640 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c4633a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe26496a640 1 -- 172.21.15.12:0/3736585289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 msgr2=0x563c1c47de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:42.772 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe26496a640 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 0x563c1c47de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe26496a640 1 -- 172.21.15.12:0/3736585289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c1c456e90 con 0x563c1c45b410 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe26516b640 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c4633a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe26596c640 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 0x563c1c47de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe26496a640 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c47d8f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fe26006bbe0 tx=0x7fe254012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86df69414f9cd26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe24affd640 1 -- 172.21.15.12:0/3736585289 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2540121d0 con 0x563c1c45b410 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe24affd640 1 -- 172.21.15.12:0/3736585289 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe254012b50 con 0x563c1c45b410 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.769+0000 7fe24affd640 1 -- 172.21.15.12:0/3736585289 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254003cd0 con 0x563c1c45b410 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 -- 172.21.15.12:0/3736585289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 msgr2=0x563c1c47d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c47d8f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fe26006bbe0 tx=0x7fe254012450 comp rx=0 tx=0).stop 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 -- 172.21.15.12:0/3736585289 shutdown_connections 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c465cb0 0x563c1c47de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c45b410 0x563c1c47d8f0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 --2- 172.21.15.12:0/3736585289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45aaf0 0x563c1c4633a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.773 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 -- 172.21.15.12:0/3736585289 >> 172.21.15.12:0/3736585289 conn(0x563c1c457060 msgr2=0x563c1c464b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:42.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 -- 172.21.15.12:0/3736585289 shutdown_connections 2024-09-19T06:53:42.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 -- 172.21.15.12:0/3736585289 wait complete. 2024-09-19T06:53:42.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 -- start start 2024-09-19T06:53:42.774 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.770+0000 7fe26a243740 1 Processor -- start 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26a243740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45aaf0 0x563c1c46e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26a243740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45b410 0x563c1c45f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26a243740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c45fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26a243740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601b12d0 con 0x563c1c465cb0 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26a243740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601b0b40 con 0x563c1c45aaf0 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26a243740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601adda0 con 0x563c1c45b410 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26a243740 10 client.0 _ll_register_callbacks cb 0x7fe258031830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26596c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c45fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26596c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c45fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47738/0 (socket says 172.21.15.12:47738) 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26596c640 1 -- 172.21.15.12:0/1868281811 learned_addr learned my addr 172.21.15.12:0/1868281811 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26516b640 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45aaf0 0x563c1c46e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26496a640 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45b410 0x563c1c45f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26596c640 1 -- 172.21.15.12:0/1868281811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45b410 msgr2=0x563c1c45f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26596c640 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45b410 0x563c1c45f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26596c640 1 -- 172.21.15.12:0/1868281811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45aaf0 msgr2=0x563c1c46e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26596c640 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45aaf0 0x563c1c46e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26596c640 1 -- 172.21.15.12:0/1868281811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c1c4601e0 con 0x563c1c465cb0 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26496a640 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45b410 0x563c1c45f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26516b640 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45aaf0 0x563c1c46e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26596c640 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c45fb70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fe258009a60 tx=0x7fe25802fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb4370102402ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe248ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe248ff9640 1 -- 172.21.15.12:0/1868281811 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe258052040 con 0x563c1c465cb0 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe248ff9640 1 -- 172.21.15.12:0/1868281811 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fe258003970 con 0x563c1c465cb0 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.771+0000 7fe26a243740 1 -- 172.21.15.12:0/1868281811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe254012b50 con 0x563c1c465cb0 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe248ff9640 1 -- 172.21.15.12:0/1868281811 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe258030d70 con 0x563c1c465cb0 2024-09-19T06:53:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe26a243740 10 client.19233 fetch_fsmap learned FSMap version 50 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe26a243740 1 -- 172.21.15.12:0/1868281811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563c1c4e06f0 con 0x563c1c465cb0 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe248ff9640 1 -- 172.21.15.12:0/1868281811 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe254012b50 con 0x563c1c465cb0 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe248ff9640 1 -- 172.21.15.12:0/1868281811 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fe258004620 con 0x563c1c465cb0 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe26a243740 10 client.19233 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe26a243740 10 client.19233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe26a243740 20 client.19233 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe26a243740 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c1c4e0e90 0x563c1c4e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe26a243740 4 client.19233 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe26a243740 1 -- 172.21.15.12:0/1868281811 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c1c3c6d70 con 0x563c1c4e0e90 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.772+0000 7fe26516b640 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c1c4e0e90 0x563c1c4e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.773+0000 7fe26516b640 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c1c4e0e90 0x563c1c4e32d0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb7bd2006e44b954 server_cookie=8288ba7332f10fae in_seq=0 out_seq=0 2024-09-19T06:53:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.773+0000 7fe248ff9640 10 client.19233 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe248ff9640 1 -- 172.21.15.12:0/1868281811 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c1c3c6d70 con 0x563c1c4e0e90 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe248ff9640 10 client.19233 handle_command_reply: tid=0 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 client.19233 shutdown 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 -- 172.21.15.12:0/1868281811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 msgr2=0x563c1c45fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c45fb70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fe258009a60 tx=0x7fe25802fa60 comp rx=0 tx=0).stop 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 -- 172.21.15.12:0/1868281811 shutdown_connections 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563c1c4e0e90 0x563c1c4e32d0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563c1c465cb0 0x563c1c45fb70 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c1c45b410 0x563c1c45f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe248ff9640 0 client.19233 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:42.788 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 --2- 172.21.15.12:0/1868281811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563c1c45aaf0 0x563c1c46e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 -- 172.21.15.12:0/1868281811 >> 172.21.15.12:0/1868281811 conn(0x563c1c457060 msgr2=0x563c1c464b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 -- 172.21.15.12:0/1868281811 shutdown_connections 2024-09-19T06:53:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 1 -- 172.21.15.12:0/1868281811 wait complete. 2024-09-19T06:53:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.786+0000 7fe26a243740 20 client.19233 trim_cache size 0 max 16384 2024-09-19T06:53:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:53:42.789 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:53:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:53:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:53:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 -- 172.21.15.12:0/3480193648 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe24c0a3510 msgr2=0x7fe24c0a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe24c0a3510 0x7fe24c0a59d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe25802f540 tx=0x7fe25802f310 comp rx=0 tx=0).stop 2024-09-19T06:53:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 -- 172.21.15.12:0/3480193648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe260100850 msgr2=0x7fe26010e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe260100850 0x7fe26010e7b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00d950 tx=0x7fe25c00de10 comp rx=0 tx=0).stop 2024-09-19T06:53:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 -- 172.21.15.12:0/3480193648 shutdown_connections 2024-09-19T06:53:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe26010f230 0x7fe2601a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe24c0a3510 0x7fe24c0a59d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe260105540 0x7fe26010ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 --2- 172.21.15.12:0/3480193648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe260100850 0x7fe26010e7b0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 -- 172.21.15.12:0/3480193648 >> 172.21.15.12:0/3480193648 conn(0x7fe260075db0 msgr2=0x7fe2600fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:42.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 -- 172.21.15.12:0/3480193648 shutdown_connections 2024-09-19T06:53:42.794 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:42.787+0000 7fe2673cf640 1 -- 172.21.15.12:0/3480193648 wait complete. 2024-09-19T06:53:43.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:43 smithi016 ceph-mon[34911]: pgmap v424: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 1.5 MiB/s wr, 192 op/s 2024-09-19T06:53:43.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:43 smithi173 ceph-mon[35349]: pgmap v424: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 1.5 MiB/s wr, 192 op/s 2024-09-19T06:53:43.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:43 smithi012 ceph-mon[30937]: pgmap v424: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 1.5 MiB/s wr, 192 op/s 2024-09-19T06:53:45.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:45 smithi016 ceph-mon[34911]: pgmap v425: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 1.5 MiB/s wr, 193 op/s 2024-09-19T06:53:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:53:45.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:45 smithi173 ceph-mon[35349]: pgmap v425: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 1.5 MiB/s wr, 193 op/s 2024-09-19T06:53:45.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:45 smithi012 ceph-mon[30937]: pgmap v425: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 1.5 MiB/s wr, 193 op/s 2024-09-19T06:53:47.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:47 smithi016 ceph-mon[34911]: pgmap v426: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.6 MiB/s wr, 201 op/s 2024-09-19T06:53:47.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:47 smithi173 ceph-mon[35349]: pgmap v426: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.6 MiB/s wr, 201 op/s 2024-09-19T06:53:47.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:47 smithi012 ceph-mon[30937]: pgmap v426: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.6 MiB/s wr, 201 op/s 2024-09-19T06:53:48.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:53:48.328 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:48.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.785+0000 7fa0df919640 1 -- 172.21.15.12:0/2062777419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0d81036e0 msgr2=0x7fa0d8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.785+0000 7fa0df919640 1 --2- 172.21.15.12:0/2062777419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0d81036e0 0x7fa0d8107b90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009cd0 tx=0x7fa0cc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:53:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.785+0000 7fa0df919640 1 -- 172.21.15.12:0/2062777419 shutdown_connections 2024-09-19T06:53:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.785+0000 7fa0df919640 1 --2- 172.21.15.12:0/2062777419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0d81082a0 0x7fa0d810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.785+0000 7fa0df919640 1 --2- 172.21.15.12:0/2062777419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0d81036e0 0x7fa0d8107b90 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.785+0000 7fa0df919640 1 --2- 172.21.15.12:0/2062777419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0d8102d30 0x7fa0d8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.785+0000 7fa0df919640 1 -- 172.21.15.12:0/2062777419 >> 172.21.15.12:0/2062777419 conn(0x7fa0d80fc7d0 msgr2=0x7fa0d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.785+0000 7fa0df919640 1 -- 172.21.15.12:0/2062777419 shutdown_connections 2024-09-19T06:53:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.785+0000 7fa0df919640 1 -- 172.21.15.12:0/2062777419 wait complete. 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0df919640 1 Processor -- start 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0df919640 1 -- start start 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0df919640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0d8102d30 0x7fa0d8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0df919640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0d81036e0 0x7fa0d8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0df919640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0d81082a0 0x7fa0d8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0df919640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d8112060 con 0x7fa0d81082a0 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0df919640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d8111ee0 con 0x7fa0d81036e0 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0df919640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d81121e0 con 0x7fa0d8102d30 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0ddeb6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0d81082a0 0x7fa0d8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0ddeb6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0d81082a0 0x7fa0d8101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47758/0 (socket says 172.21.15.12:47758) 2024-09-19T06:53:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0ddeb6640 1 -- 172.21.15.12:0/2219033711 learned_addr learned my addr 172.21.15.12:0/2219033711 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0dd6b5640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0d8102d30 0x7fa0d8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0dceb4640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0d81036e0 0x7fa0d8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0ddeb6640 1 -- 172.21.15.12:0/2219033711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0d8102d30 msgr2=0x7fa0d8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0ddeb6640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0d8102d30 0x7fa0d8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0ddeb6640 1 -- 172.21.15.12:0/2219033711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0d81036e0 msgr2=0x7fa0d8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0ddeb6640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0d81036e0 0x7fa0d8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0ddeb6640 1 -- 172.21.15.12:0/2219033711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d81a6ac0 con 0x7fa0d81082a0 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.786+0000 7fa0dd6b5640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0d8102d30 0x7fa0d8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.787+0000 7fa0ddeb6640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0d81082a0 0x7fa0d8101410 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c970 tx=0x7fa0d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.787+0000 7fa0d67fc640 1 -- 172.21.15.12:0/2219033711 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0007bb0 con 0x7fa0d81082a0 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.787+0000 7fa0d67fc640 1 -- 172.21.15.12:0/2219033711 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0d0007d50 con 0x7fa0d81082a0 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.787+0000 7fa0df919640 1 -- 172.21.15.12:0/2219033711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d81a6db0 con 0x7fa0d81082a0 2024-09-19T06:53:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.787+0000 7fa0d67fc640 1 -- 172.21.15.12:0/2219033711 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d000f450 con 0x7fa0d81082a0 2024-09-19T06:53:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.787+0000 7fa0df919640 1 -- 172.21.15.12:0/2219033711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d81a72c0 con 0x7fa0d81082a0 2024-09-19T06:53:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.788+0000 7fa0df919640 1 -- 172.21.15.12:0/2219033711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d8103110 con 0x7fa0d81082a0 2024-09-19T06:53:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.789+0000 7fa0d67fc640 1 -- 172.21.15.12:0/2219033711 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa0d0004f60 con 0x7fa0d81082a0 2024-09-19T06:53:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.790+0000 7fa0d67fc640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0c00a3430 0x7fa0c00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.790+0000 7fa0dd6b5640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0c00a3430 0x7fa0c00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.790+0000 7fa0d67fc640 1 -- 172.21.15.12:0/2219033711 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7fa0d00cfaa0 con 0x7fa0d81082a0 2024-09-19T06:53:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.790+0000 7fa0dd6b5640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0c00a3430 0x7fa0c00a58f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80058c0 tx=0x7fa0c8005850 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:48.794+0000 7fa0d67fc640 1 -- 172.21.15.12:0/2219033711 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa0d0014030 con 0x7fa0d81082a0 2024-09-19T06:53:49.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.008+0000 7fa0df919640 1 -- 172.21.15.12:0/2219033711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0d810a2b0 con 0x7fa0d81082a0 2024-09-19T06:53:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.009+0000 7fa0d67fc640 1 -- 172.21.15.12:0/2219033711 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11978 (secure 0 0 0) 0x7fa0d009c3e0 con 0x7fa0d81082a0 2024-09-19T06:53:49.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:53:49.010 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":50,"btime":"2024-09-19T06:53:39:430697+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:53:39.419389+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:53:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 50 2024-09-19T06:53:49.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 -- 172.21.15.12:0/2219033711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0c00a3430 msgr2=0x7fa0c00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0c00a3430 0x7fa0c00a58f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80058c0 tx=0x7fa0c8005850 comp rx=0 tx=0).stop 2024-09-19T06:53:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 -- 172.21.15.12:0/2219033711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0d81082a0 msgr2=0x7fa0d8101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0d81082a0 0x7fa0d8101410 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000c970 tx=0x7fa0d000ce30 comp rx=0 tx=0).stop 2024-09-19T06:53:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 -- 172.21.15.12:0/2219033711 shutdown_connections 2024-09-19T06:53:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0d81082a0 0x7fa0d8101410 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0d81036e0 0x7fa0d8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0c00a3430 0x7fa0c00a58f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 --2- 172.21.15.12:0/2219033711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0d8102d30 0x7fa0d8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 -- 172.21.15.12:0/2219033711 >> 172.21.15.12:0/2219033711 conn(0x7fa0d80fc7d0 msgr2=0x7fa0d8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:49.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.011+0000 7fa0df919640 1 -- 172.21.15.12:0/2219033711 shutdown_connections 2024-09-19T06:53:49.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:49.012+0000 7fa0df919640 1 -- 172.21.15.12:0/2219033711 wait complete. 2024-09-19T06:53:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:49 smithi012 ceph-mon[30937]: pgmap v427: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 901 KiB/s wr, 109 op/s 2024-09-19T06:53:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:49 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2219033711' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:49 smithi016 ceph-mon[34911]: pgmap v427: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 901 KiB/s wr, 109 op/s 2024-09-19T06:53:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:49 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2219033711' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:49.793 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 8c07e0f0 --release --await' 2024-09-19T06:53:49.794 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 8c07e0f0 --release --await 2024-09-19T06:53:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:49 smithi173 ceph-mon[35349]: pgmap v427: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 901 KiB/s wr, 109 op/s 2024-09-19T06:53:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:49 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2219033711' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:53:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:53:50.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.545+0000 7f99a953d640 1 -- 172.21.15.12:0/3135445218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99a4101430 msgr2=0x7f99a410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.545+0000 7f99a953d640 1 --2- 172.21.15.12:0/3135445218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99a4101430 0x7f99a410d960 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f999c009cd0 tx=0x7f999c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.545+0000 7f99a953d640 1 -- 172.21.15.12:0/3135445218 shutdown_connections 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.545+0000 7f99a953d640 1 --2- 172.21.15.12:0/3135445218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99a4101430 0x7f99a410d960 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.545+0000 7f99a953d640 1 --2- 172.21.15.12:0/3135445218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99a4100a90 0x7f99a4100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.545+0000 7f99a953d640 1 --2- 172.21.15.12:0/3135445218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99a4106a90 0x7f99a4106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.545+0000 7f99a953d640 1 -- 172.21.15.12:0/3135445218 >> 172.21.15.12:0/3135445218 conn(0x7f99a40fc7d0 msgr2=0x7f99a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.545+0000 7f99a953d640 1 -- 172.21.15.12:0/3135445218 shutdown_connections 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.545+0000 7f99a953d640 1 -- 172.21.15.12:0/3135445218 wait complete. 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a953d640 1 Processor -- start 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a953d640 1 -- start start 2024-09-19T06:53:50.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a953d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99a4100a90 0x7f99a4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a953d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99a4101430 0x7f99a4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a953d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99a4106a90 0x7f99a419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a953d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4110eb0 con 0x7f99a4106a90 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a953d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4110d30 con 0x7f99a4101430 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a953d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4111030 con 0x7f99a4100a90 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99a4106a90 0x7f99a419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99a4106a90 0x7f99a419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49072/0 (socket says 172.21.15.12:49072) 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a37fe640 1 -- 172.21.15.12:0/1895216478 learned_addr learned my addr 172.21.15.12:0/1895216478 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.546+0000 7f99a27fc640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99a4101430 0x7f99a4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99a4100a90 0x7f99a4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f99a37fe640 1 -- 172.21.15.12:0/1895216478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99a4100a90 msgr2=0x7f99a4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:50.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f99a37fe640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99a4100a90 0x7f99a4198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f99a37fe640 1 -- 172.21.15.12:0/1895216478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99a4101430 msgr2=0x7f99a4198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f99a37fe640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99a4101430 0x7f99a4198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f99a37fe640 1 -- 172.21.15.12:0/1895216478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a419d3e0 con 0x7f99a4106a90 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f99a37fe640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99a4106a90 0x7f99a419cd00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f999c006010 tx=0x7f999c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f998bfff640 1 -- 172.21.15.12:0/1895216478 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c004450 con 0x7f99a4106a90 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f99a953d640 1 -- 172.21.15.12:0/1895216478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a419d670 con 0x7f99a4106a90 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f998bfff640 1 -- 172.21.15.12:0/1895216478 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f999c003e10 con 0x7f99a4106a90 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f998bfff640 1 -- 172.21.15.12:0/1895216478 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c046480 con 0x7f99a4106a90 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.547+0000 7f99a953d640 1 -- 172.21.15.12:0/1895216478 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a41a4fb0 con 0x7f99a4106a90 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.549+0000 7f998bfff640 1 -- 172.21.15.12:0/1895216478 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f999c0045f0 con 0x7f99a4106a90 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99ab916740 1 Processor -- start 2024-09-19T06:53:50.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99ab916740 1 -- start start 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99ab916740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 0x557a523f8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99ab916740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a52407110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99ab916740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a52407650 0x557a52409a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99ab916740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557a5235d620 con 0x557a523f8860 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99ab916740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557a52304e50 con 0x557a52407650 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99ab916740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557a523595e0 con 0x557a523f7f40 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f998bfff640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f998c0a33b0 0x7f998c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99a2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a52407110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99a2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a52407110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49080/0 (socket says 172.21.15.12:49080) 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99a2ffd640 1 -- 172.21.15.12:0/2017950335 learned_addr learned my addr 172.21.15.12:0/2017950335 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99a27fc640 1 --2- 172.21.15.12:0/2017950335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a52407650 0x557a52409a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99a37fe640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f998c0a33b0 0x7f998c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99a27fc640 1 --2- 172.21.15.12:0/2017950335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 0x557a523f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f998bfff640 1 -- 172.21.15.12:0/1895216478 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f999c02e030 con 0x7f99a4106a90 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99a2ffd640 1 -- 172.21.15.12:0/2017950335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 msgr2=0x557a523f8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.550+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/2017950335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 0x557a523f8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.551+0000 7f99a2ffd640 1 -- 172.21.15.12:0/2017950335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a52407650 msgr2=0x557a52409a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.551+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/2017950335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a52407650 0x557a52409a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.551+0000 7f99a2ffd640 1 -- 172.21.15.12:0/2017950335 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a522f5d40 con 0x557a523f8860 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.551+0000 7f99a27fc640 1 --2- 172.21.15.12:0/2017950335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 0x557a523f8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.551+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/2017950335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a52407110 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f999400ac20 tx=0x7f999400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a2641d702dd96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.551+0000 7f99a37fe640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f998c0a33b0 0x7f998c0a5870 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f999c0b9ae0 tx=0x7f999c08f400 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.551+0000 7f99897fa640 1 -- 172.21.15.12:0/2017950335 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999401d070 con 0x557a523f8860 2024-09-19T06:53:50.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.551+0000 7f99897fa640 1 -- 172.21.15.12:0/2017950335 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9994018b20 con 0x557a523f8860 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.551+0000 7f99897fa640 1 -- 172.21.15.12:0/2017950335 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994010c00 con 0x557a523f8860 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 -- 172.21.15.12:0/2017950335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 msgr2=0x557a52407110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 --2- 172.21.15.12:0/2017950335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a52407110 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f999400ac20 tx=0x7f999400f790 comp rx=0 tx=0).stop 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 -- 172.21.15.12:0/2017950335 shutdown_connections 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 --2- 172.21.15.12:0/2017950335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a52407650 0x557a52409a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 --2- 172.21.15.12:0/2017950335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a52407110 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 --2- 172.21.15.12:0/2017950335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 0x557a523f8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 -- 172.21.15.12:0/2017950335 >> 172.21.15.12:0/2017950335 conn(0x557a523f45f0 msgr2=0x557a523f49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 -- 172.21.15.12:0/2017950335 shutdown_connections 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 -- 172.21.15.12:0/2017950335 wait complete. 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 -- start start 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 Processor -- start 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f7f40 0x557a52404580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f8860 0x557a52404ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a52407650 0x557a52405000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557a5240a220 con 0x557a523f7f40 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557a522e5f10 con 0x557a52407650 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557a5240a3a0 con 0x557a523f8860 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99ab916740 10 client.0 _ll_register_callbacks cb 0x557a52309db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.552+0000 7f99a27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f7f40 0x557a52404580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f7f40 0x557a52404580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49090/0 (socket says 172.21.15.12:49090) 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a27fc640 1 -- 172.21.15.12:0/1684559780 learned_addr learned my addr 172.21.15.12:0/1684559780 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a27fc640 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a52407650 0x557a52405000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f8860 0x557a52404ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a27fc640 1 -- 172.21.15.12:0/1684559780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f8860 msgr2=0x557a52404ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a27fc640 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f8860 0x557a52404ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a27fc640 1 -- 172.21.15.12:0/1684559780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a52407650 msgr2=0x557a52405000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a27fc640 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a52407650 0x557a52405000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a27fc640 1 -- 172.21.15.12:0/1684559780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a5206c580 con 0x557a523f7f40 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f8860 0x557a52404ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99a27fc640 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f7f40 0x557a52404580 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f999801aae0 tx=0x7f99980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155e570b73d06365 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f9986ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f9986ff5640 1 -- 172.21.15.12:0/1684559780 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998015a40 con 0x557a523f7f40 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99ab916740 1 -- 172.21.15.12:0/1684559780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9994018b20 con 0x557a523f7f40 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f9986ff5640 1 -- 172.21.15.12:0/1684559780 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f9998015be0 con 0x557a523f7f40 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f9986ff5640 1 -- 172.21.15.12:0/1684559780 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9998029050 con 0x557a523f7f40 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99ab916740 10 client.19251 fetch_fsmap learned FSMap version 50 2024-09-19T06:53:50.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.553+0000 7f99ab916740 1 -- 172.21.15.12:0/1684559780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x557a52136960 con 0x557a523f7f40 2024-09-19T06:53:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.554+0000 7f9986ff5640 1 -- 172.21.15.12:0/1684559780 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9994018b20 con 0x557a523f7f40 2024-09-19T06:53:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.554+0000 7f9986ff5640 1 -- 172.21.15.12:0/1684559780 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f9998017440 con 0x557a523f7f40 2024-09-19T06:53:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.554+0000 7f99ab916740 10 client.19251 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:53:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.554+0000 7f99ab916740 10 client.19251 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:53:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.554+0000 7f99ab916740 20 client.19251 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.554+0000 7f99ab916740 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557a524172e0 0x557a52419730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.554+0000 7f99ab916740 4 client.19251 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.554+0000 7f99ab916740 1 -- 172.21.15.12:0/1684559780 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a5236ab90 con 0x557a524172e0 2024-09-19T06:53:50.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.554+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557a524172e0 0x557a52419730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.555+0000 7f9986ff5640 10 client.19251 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.555+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557a524172e0 0x557a52419730 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=960d3817a388a2c0 server_cookie=ac3fa2b75aabad6b in_seq=0 out_seq=0 2024-09-19T06:53:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.555+0000 7f9986ff5640 1 -- 172.21.15.12:0/1684559780 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a5236ab90 con 0x557a524172e0 2024-09-19T06:53:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.555+0000 7f9986ff5640 10 client.19251 handle_command_reply: tid=0 2024-09-19T06:53:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 client.19251 shutdown 2024-09-19T06:53:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 -- 172.21.15.12:0/1684559780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f7f40 msgr2=0x557a52404580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f7f40 0x557a52404580 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f999801aae0 tx=0x7f99980046c0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 -- 172.21.15.12:0/1684559780 shutdown_connections 2024-09-19T06:53:50.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557a524172e0 0x557a52419730 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a52407650 0x557a52405000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f8860 0x557a52404ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 --2- 172.21.15.12:0/1684559780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f7f40 0x557a52404580 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 -- 172.21.15.12:0/1684559780 >> 172.21.15.12:0/1684559780 conn(0x557a523f45f0 msgr2=0x557a523fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f9986ff5640 0 client.19251 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 -- 172.21.15.12:0/1684559780 shutdown_connections 2024-09-19T06:53:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 1 -- 172.21.15.12:0/1684559780 wait complete. 2024-09-19T06:53:50.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.556+0000 7f99ab916740 20 client.19251 trim_cache size 0 max 16384 2024-09-19T06:53:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99ab916740 1 Processor -- start 2024-09-19T06:53:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99ab916740 1 -- start start 2024-09-19T06:53:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99ab916740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a523f7f40 0x557a523f3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99ab916740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a5241f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99ab916740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a52407650 0x557a5241f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99ab916740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41ab890 con 0x557a523f8860 2024-09-19T06:53:50.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99ab916740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41ad490 con 0x557a523f7f40 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99ab916740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41abf60 con 0x557a52407650 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99a2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a5241f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99a2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a5241f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49092/0 (socket says 172.21.15.12:49092) 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.573+0000 7f99a2ffd640 1 -- 172.21.15.12:0/3838648990 learned_addr learned my addr 172.21.15.12:0/3838648990 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f99a27fc640 1 --2- 172.21.15.12:0/3838648990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a523f7f40 0x557a523f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f99a2ffd640 1 -- 172.21.15.12:0/3838648990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a52407650 msgr2=0x557a5241f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f99a27fc640 1 --2- 172.21.15.12:0/3838648990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a52407650 0x557a5241f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/3838648990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a52407650 0x557a5241f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f99a2ffd640 1 -- 172.21.15.12:0/3838648990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a523f7f40 msgr2=0x557a523f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/3838648990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a523f7f40 0x557a523f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f99a2ffd640 1 -- 172.21.15.12:0/3838648990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a52415e80 con 0x557a523f8860 2024-09-19T06:53:50.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f99a27fc640 1 --2- 172.21.15.12:0/3838648990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a52407650 0x557a5241f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/3838648990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a5241f000 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f999400ac20 tx=0x7f99940106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a197c070dd59e4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f9988ff9640 1 -- 172.21.15.12:0/3838648990 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994032070 con 0x557a523f8860 2024-09-19T06:53:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f9988ff9640 1 -- 172.21.15.12:0/3838648990 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f999401e040 con 0x557a523f8860 2024-09-19T06:53:50.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.574+0000 7f9988ff9640 1 -- 172.21.15.12:0/3838648990 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999401d040 con 0x557a523f8860 2024-09-19T06:53:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 -- 172.21.15.12:0/3838648990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 msgr2=0x557a5241f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 --2- 172.21.15.12:0/3838648990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a5241f000 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f999400ac20 tx=0x7f99940106e0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 -- 172.21.15.12:0/3838648990 shutdown_connections 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 --2- 172.21.15.12:0/3838648990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a52407650 0x557a5241f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 --2- 172.21.15.12:0/3838648990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a523f8860 0x557a5241f000 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 --2- 172.21.15.12:0/3838648990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a523f7f40 0x557a523f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 -- 172.21.15.12:0/3838648990 >> 172.21.15.12:0/3838648990 conn(0x557a523f45f0 msgr2=0x557a523f2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 -- 172.21.15.12:0/3838648990 shutdown_connections 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 -- 172.21.15.12:0/3838648990 wait complete. 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 -- start start 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.575+0000 7f99ab916740 1 Processor -- start 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99ab916740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 0x557a523fb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99ab916740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a523f8860 0x557a523fbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99ab916740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a52407650 0x557a5240e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99ab916740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41acdc0 con 0x557a52407650 2024-09-19T06:53:50.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99ab916740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41ac630 con 0x557a523f8860 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99ab916740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41a98b0 con 0x557a523f7f40 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99ab916740 10 client.0 _ll_register_callbacks cb 0x7f999801a6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a52407650 0x557a5240e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a52407650 0x557a5240e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49102/0 (socket says 172.21.15.12:49102) 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a27fc640 1 -- 172.21.15.12:0/1274212918 learned_addr learned my addr 172.21.15.12:0/1274212918 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a27fc640 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 0x557a523fb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a523f8860 0x557a523fbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a27fc640 1 -- 172.21.15.12:0/1274212918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 msgr2=0x557a523fb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a27fc640 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 0x557a523fb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a27fc640 1 -- 172.21.15.12:0/1274212918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a523f8860 msgr2=0x557a523fbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a27fc640 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a523f8860 0x557a523fbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a27fc640 1 -- 172.21.15.12:0/1274212918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a5240eb60 con 0x557a52407650 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f99a27fc640 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a52407650 0x557a5240e620 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f999800b010 tx=0x7f99980098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ecb22077936a24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f9986ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f9986ff5640 1 -- 172.21.15.12:0/1274212918 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99980095d0 con 0x557a52407650 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f99ab916740 1 -- 172.21.15.12:0/1274212918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f999401e040 con 0x557a52407650 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.576+0000 7f9986ff5640 1 -- 172.21.15.12:0/1274212918 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f9998017c30 con 0x557a52407650 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f9986ff5640 1 -- 172.21.15.12:0/1274212918 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9998017e30 con 0x557a52407650 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f99ab916740 10 client.19257 fetch_fsmap learned FSMap version 50 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f99ab916740 1 -- 172.21.15.12:0/1274212918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x557a5240fe70 con 0x557a52407650 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f9986ff5640 1 -- 172.21.15.12:0/1274212918 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f999401e040 con 0x557a52407650 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f9986ff5640 1 -- 172.21.15.12:0/1274212918 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f9998018a20 con 0x557a52407650 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f99ab916740 10 client.19257 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f99ab916740 10 client.19257 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:53:50.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f99ab916740 20 client.19257 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:50.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f99ab916740 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557a52486810 0x557a52488c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:50.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f99ab916740 4 client.19257 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8c07e0f0", "release": true, "await": true}] 2024-09-19T06:53:50.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f99ab916740 1 -- 172.21.15.12:0/1274212918 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8c07e0f0", "release": true, "await": true}) -- 0x557a523650a0 con 0x557a52486810 2024-09-19T06:53:50.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.577+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557a52486810 0x557a52488c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:50.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.578+0000 7f9986ff5640 10 client.19257 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:50.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.578+0000 7f99a2ffd640 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557a52486810 0x557a52488c30 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc8e6966a11d9f80 server_cookie=e976508a076da780 in_seq=0 out_seq=0 2024-09-19T06:53:50.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f9986ff5640 1 -- 172.21.15.12:0/1274212918 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557a523650a0 con 0x557a52486810 2024-09-19T06:53:50.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f9986ff5640 10 client.19257 handle_command_reply: tid=0 2024-09-19T06:53:50.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 client.19257 shutdown 2024-09-19T06:53:50.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 -- 172.21.15.12:0/1274212918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a52407650 msgr2=0x557a5240e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:50.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a52407650 0x557a5240e620 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f999800b010 tx=0x7f99980098f0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 -- 172.21.15.12:0/1274212918 shutdown_connections 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x557a52486810 0x557a52488c30 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557a52407650 0x557a5240e620 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f9986ff5640 0 client.19257 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557a523f8860 0x557a523fbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 --2- 172.21.15.12:0/1274212918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557a523f7f40 0x557a523fb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 -- 172.21.15.12:0/1274212918 >> 172.21.15.12:0/1274212918 conn(0x557a523f45f0 msgr2=0x557a52404d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 -- 172.21.15.12:0/1274212918 shutdown_connections 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 1 -- 172.21.15.12:0/1274212918 wait complete. 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.634+0000 7f99ab916740 20 client.19257 trim_cache size 0 max 16384 2024-09-19T06:53:50.637 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:53:50.638 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 50, 2024-09-19T06:53:50.638 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:53:50.638 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 48, 2024-09-19T06:53:50.638 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:53:50.638 INFO:teuthology.orchestra.run.smithi012.stdout: "8c07e0f0": { 2024-09-19T06:53:50.638 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 48, 2024-09-19T06:53:50.638 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:53:50.638 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:53:50.638 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:53:50.639 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:53:50.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:53:50.639 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:53:50.639 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 142.2, 2024-09-19T06:53:50.639 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:53:50.639 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:53:50.639 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:53:50.639 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:53:50.640 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:53:50.640 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:53:50.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:50.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:50.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:50.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:50.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:53:50.640 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:53:50.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.635+0000 7f99a953d640 1 -- 172.21.15.12:0/1895216478 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f998c0a33b0 msgr2=0x7f998c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:50.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.635+0000 7f99a953d640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f998c0a33b0 0x7f998c0a5870 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f999c0b9ae0 tx=0x7f999c08f400 comp rx=0 tx=0).stop 2024-09-19T06:53:50.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.635+0000 7f99a953d640 1 -- 172.21.15.12:0/1895216478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99a4106a90 msgr2=0x7f99a419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:50.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.635+0000 7f99a953d640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99a4106a90 0x7f99a419cd00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f999c006010 tx=0x7f999c003c20 comp rx=0 tx=0).stop 2024-09-19T06:53:50.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.635+0000 7f99a953d640 1 -- 172.21.15.12:0/1895216478 shutdown_connections 2024-09-19T06:53:50.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.635+0000 7f99a953d640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99a4106a90 0x7f99a419cd00 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.635+0000 7f99a953d640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99a4101430 0x7f99a4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.635+0000 7f99a953d640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f998c0a33b0 0x7f998c0a5870 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.635+0000 7f99a953d640 1 --2- 172.21.15.12:0/1895216478 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99a4100a90 0x7f99a4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:50.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.635+0000 7f99a953d640 1 -- 172.21.15.12:0/1895216478 >> 172.21.15.12:0/1895216478 conn(0x7f99a40fc7d0 msgr2=0x7f99a4104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:50.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.636+0000 7f99a953d640 1 -- 172.21.15.12:0/1895216478 shutdown_connections 2024-09-19T06:53:50.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:53:50.636+0000 7f99a953d640 1 -- 172.21.15.12:0/1895216478 wait complete. 2024-09-19T06:53:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 785.0 s, 77.7 tps, lat 4941.364 ms stddev 8573.039 2024-09-19T06:53:51.475 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8c07e0f0', total seconds elapsed: 25.6 2024-09-19T06:53:51.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:51 smithi016 ceph-mon[34911]: pgmap v428: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 907 KiB/s wr, 114 op/s 2024-09-19T06:53:51.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:51 smithi173 ceph-mon[35349]: pgmap v428: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 907 KiB/s wr, 114 op/s 2024-09-19T06:53:51.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:51 smithi012 ceph-mon[30937]: pgmap v428: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 907 KiB/s wr, 114 op/s 2024-09-19T06:53:53.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:53 smithi016 ceph-mon[34911]: pgmap v429: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 112 KiB/s wr, 23 op/s 2024-09-19T06:53:53.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:53 smithi173 ceph-mon[35349]: pgmap v429: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 112 KiB/s wr, 23 op/s 2024-09-19T06:53:53.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:53 smithi012 ceph-mon[30937]: pgmap v429: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 112 KiB/s wr, 23 op/s 2024-09-19T06:53:55.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:55 smithi016 ceph-mon[34911]: pgmap v430: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 147 KiB/s wr, 28 op/s 2024-09-19T06:53:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 790.0 s, 2754.4 tps, lat 42.079 ms stddev 345.353 2024-09-19T06:53:55.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:55 smithi173 ceph-mon[35349]: pgmap v430: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 147 KiB/s wr, 28 op/s 2024-09-19T06:53:55.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:55 smithi012 ceph-mon[30937]: pgmap v430: 97 pgs: 97 active+clean; 4.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 147 KiB/s wr, 28 op/s 2024-09-19T06:53:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.911+0000 7f3e86437640 1 -- 172.21.15.12:0/1386864465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e80104910 msgr2=0x7f3e80108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.911+0000 7f3e86437640 1 --2- 172.21.15.12:0/1386864465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e80104910 0x7f3e80108950 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009900 tx=0x7f3e7402a410 comp rx=0 tx=0).stop 2024-09-19T06:53:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.911+0000 7f3e86437640 1 -- 172.21.15.12:0/1386864465 shutdown_connections 2024-09-19T06:53:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.911+0000 7f3e86437640 1 --2- 172.21.15.12:0/1386864465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e801090b0 0x7f3e80110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.911+0000 7f3e86437640 1 --2- 172.21.15.12:0/1386864465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e80104910 0x7f3e80108950 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.911+0000 7f3e86437640 1 --2- 172.21.15.12:0/1386864465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e80103f60 0x7f3e80104340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.911+0000 7f3e86437640 1 -- 172.21.15.12:0/1386864465 >> 172.21.15.12:0/1386864465 conn(0x7f3e800ff9b0 msgr2=0x7f3e80101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.914+0000 7f3e86437640 1 -- 172.21.15.12:0/1386864465 shutdown_connections 2024-09-19T06:53:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.914+0000 7f3e86437640 1 -- 172.21.15.12:0/1386864465 wait complete. 2024-09-19T06:53:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.915+0000 7f3e86437640 1 Processor -- start 2024-09-19T06:53:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.915+0000 7f3e86437640 1 -- start start 2024-09-19T06:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.915+0000 7f3e86437640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e80103f60 0x7f3e8019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.915+0000 7f3e86437640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e801090b0 0x7f3e8019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.915+0000 7f3e86437640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8019ee50 0x7f3e8019f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.915+0000 7f3e86437640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3e80114120 con 0x7f3e8019ee50 2024-09-19T06:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.915+0000 7f3e86437640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3e80113fa0 con 0x7f3e801090b0 2024-09-19T06:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.915+0000 7f3e86437640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3e801142a0 con 0x7f3e80103f60 2024-09-19T06:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.916+0000 7f3e7f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e801090b0 0x7f3e8019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.916+0000 7f3e7ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e80103f60 0x7f3e8019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.916+0000 7f3e7f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e801090b0 0x7f3e8019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49580/0 (socket says 172.21.15.12:49580) 2024-09-19T06:53:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.916+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/2398136837 learned_addr learned my addr 172.21.15.12:0/2398136837 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.916+0000 7f3e849d4640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8019ee50 0x7f3e8019f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.916+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/2398136837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e80103f60 msgr2=0x7f3e8019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.916+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e80103f60 0x7f3e8019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.916+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/2398136837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8019ee50 msgr2=0x7f3e8019f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.916+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8019ee50 0x7f3e8019f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.916+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/2398136837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8019f940 con 0x7f3e801090b0 2024-09-19T06:53:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.917+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e801090b0 0x7f3e8019aad0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3e7402a930 tx=0x7f3e74003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.917+0000 7f3e7d7fa640 1 -- 172.21.15.12:0/2398136837 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7403f070 con 0x7f3e801090b0 2024-09-19T06:53:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.917+0000 7f3e7d7fa640 1 -- 172.21.15.12:0/2398136837 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e74031c90 con 0x7f3e801090b0 2024-09-19T06:53:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.917+0000 7f3e86437640 1 -- 172.21.15.12:0/2398136837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8019fbd0 con 0x7f3e801090b0 2024-09-19T06:53:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.917+0000 7f3e7d7fa640 1 -- 172.21.15.12:0/2398136837 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e74035030 con 0x7f3e801090b0 2024-09-19T06:53:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.917+0000 7f3e86437640 1 -- 172.21.15.12:0/2398136837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e801a7330 con 0x7f3e801090b0 2024-09-19T06:53:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.919+0000 7f3e7d7fa640 1 -- 172.21.15.12:0/2398136837 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3e74042070 con 0x7f3e801090b0 2024-09-19T06:53:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.920+0000 7f3e891cf740 1 Processor -- start 2024-09-19T06:53:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.922+0000 7f3e7d7fa640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e680a34e0 0x7f3e680a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.922+0000 7f3e7d7fa640 1 -- 172.21.15.12:0/2398136837 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f3e740f03d0 con 0x7f3e801090b0 2024-09-19T06:53:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.922+0000 7f3e849d4640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e680a34e0 0x7f3e680a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.922+0000 7f3e891cf740 1 -- start start 2024-09-19T06:53:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.923+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115deaf0 0x5643115deed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.923+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115df410 0x5643115e9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.923+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115e9cb0 0x5643115ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.923+0000 7f3e891cf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5643115432f0 con 0x5643115df410 2024-09-19T06:53:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.923+0000 7f3e891cf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5643114eb270 con 0x5643115e9cb0 2024-09-19T06:53:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.923+0000 7f3e891cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56431153f2b0 con 0x5643115deaf0 2024-09-19T06:53:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.923+0000 7f3e7f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115df410 0x5643115e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.923+0000 7f3e849d4640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e680a34e0 0x7f3e680a59a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3e78005fd0 tx=0x7f3e78009500 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.923+0000 7f3e7f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115df410 0x5643115e9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49134/0 (socket says 172.21.15.12:49134) 2024-09-19T06:53:55.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.923+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/2298815925 learned_addr learned my addr 172.21.15.12:0/2298815925 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.924+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/2298815925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115deaf0 msgr2=0x5643115deed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:53:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.924+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/2298815925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115deaf0 0x5643115deed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.924+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/2298815925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115e9cb0 msgr2=0x5643115ec0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:53:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.924+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/2298815925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115e9cb0 0x5643115ec0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.924+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/2298815925 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643114ea340 con 0x5643115df410 2024-09-19T06:53:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.924+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/2298815925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115df410 0x5643115e9770 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f3e740b8a70 tx=0x7f3e7402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ba1fc746130dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.926+0000 7f3e667fc640 1 -- 172.21.15.12:0/2298815925 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e740d5070 con 0x5643115df410 2024-09-19T06:53:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.926+0000 7f3e667fc640 1 -- 172.21.15.12:0/2298815925 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e740bcd10 con 0x5643115df410 2024-09-19T06:53:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.926+0000 7f3e667fc640 1 -- 172.21.15.12:0/2298815925 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e74049070 con 0x5643115df410 2024-09-19T06:53:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.932+0000 7f3e891cf740 1 -- 172.21.15.12:0/2298815925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115df410 msgr2=0x5643115e9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.932+0000 7f3e891cf740 1 --2- 172.21.15.12:0/2298815925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115df410 0x5643115e9770 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f3e740b8a70 tx=0x7f3e7402a410 comp rx=0 tx=0).stop 2024-09-19T06:53:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.936+0000 7f3e891cf740 1 -- 172.21.15.12:0/2298815925 shutdown_connections 2024-09-19T06:53:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.936+0000 7f3e891cf740 1 --2- 172.21.15.12:0/2298815925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115e9cb0 0x5643115ec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.936+0000 7f3e891cf740 1 --2- 172.21.15.12:0/2298815925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115df410 0x5643115e9770 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.936+0000 7f3e891cf740 1 --2- 172.21.15.12:0/2298815925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115deaf0 0x5643115deed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.936+0000 7f3e891cf740 1 -- 172.21.15.12:0/2298815925 >> 172.21.15.12:0/2298815925 conn(0x5643115db060 msgr2=0x5643115db440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.953+0000 7f3e891cf740 1 -- 172.21.15.12:0/2298815925 shutdown_connections 2024-09-19T06:53:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.959+0000 7f3e891cf740 1 -- 172.21.15.12:0/2298815925 wait complete. 2024-09-19T06:53:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.959+0000 7f3e891cf740 1 -- start start 2024-09-19T06:53:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.959+0000 7f3e891cf740 1 Processor -- start 2024-09-19T06:53:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.960+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115deaf0 0x5643115e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.960+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x5643115e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.960+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 0x5643115e7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.960+0000 7f3e891cf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5643115ec640 con 0x5643115deaf0 2024-09-19T06:53:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.960+0000 7f3e891cf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5643114cc290 con 0x5643115df410 2024-09-19T06:53:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.960+0000 7f3e891cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5643115ec7c0 con 0x5643115e9cb0 2024-09-19T06:53:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.960+0000 7f3e891cf740 10 client.0 _ll_register_callbacks cb 0x5643114fd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.960+0000 7f3e849d4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 0x5643115e7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.960+0000 7f3e849d4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 0x5643115e7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43490/0 (socket says 172.21.15.12:43490) 2024-09-19T06:53:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.960+0000 7f3e849d4640 1 -- 172.21.15.12:0/2979549990 learned_addr learned my addr 172.21.15.12:0/2979549990 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.962+0000 7f3e849d4640 1 -- 172.21.15.12:0/2979549990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 msgr2=0x5643115e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.962+0000 7f3e849d4640 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x5643115e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.962+0000 7f3e849d4640 1 -- 172.21.15.12:0/2979549990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115deaf0 msgr2=0x5643115e6da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:53:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.962+0000 7f3e849d4640 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115deaf0 0x5643115e6da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.962+0000 7f3e849d4640 1 -- 172.21.15.12:0/2979549990 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564311256210 con 0x5643115e9cb0 2024-09-19T06:53:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.965+0000 7f3e849d4640 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 0x5643115e7820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3e78011c30 tx=0x7f3e78004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f4f44049cd5948 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.966+0000 7f3e5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:53:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.968+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/2979549990 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78011e60 con 0x5643115e9cb0 2024-09-19T06:53:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.968+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/2979549990 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f3e7801e420 con 0x5643115e9cb0 2024-09-19T06:53:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.970+0000 7f3e891cf740 1 -- 172.21.15.12:0/2979549990 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e740bcd10 con 0x5643115e9cb0 2024-09-19T06:53:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.971+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/2979549990 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f3e7801e620 con 0x5643115e9cb0 2024-09-19T06:53:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.979+0000 7f3e891cf740 10 client.28495 fetch_fsmap learned FSMap version 50 2024-09-19T06:53:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.979+0000 7f3e891cf740 1 -- 172.21.15.12:0/2979549990 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x564311322620 con 0x5643115e9cb0 2024-09-19T06:53:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.982+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/2979549990 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e7801eca0 con 0x5643115e9cb0 2024-09-19T06:53:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.982+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/2979549990 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f3e78030ac0 con 0x5643115e9cb0 2024-09-19T06:53:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.983+0000 7f3e891cf740 10 client.28495 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:53:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.983+0000 7f3e891cf740 10 client.28495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.983+0000 7f3e891cf740 20 client.28495 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.983+0000 7f3e891cf740 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56431160aba0 0x56431160cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.983+0000 7f3e891cf740 4 client.28495 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:53:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.983+0000 7f3e891cf740 1 -- 172.21.15.12:0/2979549990 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3e740bcd10 con 0x56431160aba0 2024-09-19T06:53:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.986+0000 7f3e7ffff640 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56431160aba0 0x56431160cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.991+0000 7f3e7ffff640 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56431160aba0 0x56431160cf90 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7e6dfca0d447c57 server_cookie=3a66f2790fd6c12e in_seq=0 out_seq=0 2024-09-19T06:53:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.992+0000 7f3e5f7fe640 10 client.28495 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.992+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/2979549990 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f3e740bcd10 con 0x56431160aba0 2024-09-19T06:53:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.993+0000 7f3e5f7fe640 10 client.28495 handle_command_reply: tid=0 2024-09-19T06:53:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.993+0000 7f3e891cf740 1 client.28495 shutdown 2024-09-19T06:53:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.996+0000 7f3e891cf740 1 -- 172.21.15.12:0/2979549990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 msgr2=0x5643115e7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.996+0000 7f3e891cf740 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 0x5643115e7820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3e78011c30 tx=0x7f3e78004ab0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.997+0000 7f3e891cf740 1 -- 172.21.15.12:0/2979549990 shutdown_connections 2024-09-19T06:53:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.997+0000 7f3e891cf740 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56431160aba0 0x56431160cf90 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.997+0000 7f3e891cf740 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 0x5643115e7820 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.997+0000 7f3e891cf740 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x5643115e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.997+0000 7f3e891cf740 1 --2- 172.21.15.12:0/2979549990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115deaf0 0x5643115e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.997+0000 7f3e891cf740 1 -- 172.21.15.12:0/2979549990 >> 172.21.15.12:0/2979549990 conn(0x5643115db060 msgr2=0x5643115e0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.998+0000 7f3e5f7fe640 0 client.28495 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:55.999+0000 7f3e891cf740 1 -- 172.21.15.12:0/2979549990 shutdown_connections 2024-09-19T06:53:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.000+0000 7f3e891cf740 1 -- 172.21.15.12:0/2979549990 wait complete. 2024-09-19T06:53:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.000+0000 7f3e891cf740 20 client.28495 trim_cache size 0 max 16384 2024-09-19T06:53:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e891cf740 1 Processor -- start 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e891cf740 1 -- start start 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115deaf0 0x5643115e7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x564311612830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 0x564311612d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e891cf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3e801ab9f0 con 0x5643115deaf0 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e891cf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3e801ad5f0 con 0x5643115df410 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e891cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3e801ac0c0 con 0x5643115e9cb0 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e7f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x564311612830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e7ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115deaf0 0x5643115e7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e7f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x564311612830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49598/0 (socket says 172.21.15.12:49598) 2024-09-19T06:53:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.027+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/1982861988 learned_addr learned my addr 172.21.15.12:0/1982861988 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e849d4640 1 --2- 172.21.15.12:0/1982861988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 0x564311612d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/1982861988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 msgr2=0x564311612d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/1982861988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 0x564311612d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/1982861988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115deaf0 msgr2=0x5643115e7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/1982861988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115deaf0 0x5643115e7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/1982861988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643115d62d0 con 0x5643115df410 2024-09-19T06:53:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e7ffff640 1 --2- 172.21.15.12:0/1982861988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115deaf0 0x5643115e7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:53:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/1982861988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x564311612830 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3e740ee080 tx=0x7f3e740057b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a10b94427a395375 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e65ffb640 1 -- 172.21.15.12:0/1982861988 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e74049050 con 0x5643115df410 2024-09-19T06:53:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e65ffb640 1 -- 172.21.15.12:0/1982861988 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e740b8040 con 0x5643115df410 2024-09-19T06:53:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.028+0000 7f3e65ffb640 1 -- 172.21.15.12:0/1982861988 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e740d5040 con 0x5643115df410 2024-09-19T06:53:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.030+0000 7f3e891cf740 1 -- 172.21.15.12:0/1982861988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 msgr2=0x564311612830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.030+0000 7f3e891cf740 1 --2- 172.21.15.12:0/1982861988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x564311612830 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3e740ee080 tx=0x7f3e740057b0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.030+0000 7f3e891cf740 1 -- 172.21.15.12:0/1982861988 shutdown_connections 2024-09-19T06:53:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.030+0000 7f3e891cf740 1 --2- 172.21.15.12:0/1982861988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115e9cb0 0x564311612d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.031+0000 7f3e891cf740 1 --2- 172.21.15.12:0/1982861988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x564311612830 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.031+0000 7f3e891cf740 1 --2- 172.21.15.12:0/1982861988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115deaf0 0x5643115e7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.031+0000 7f3e891cf740 1 -- 172.21.15.12:0/1982861988 >> 172.21.15.12:0/1982861988 conn(0x5643115db060 msgr2=0x5643115e8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.031+0000 7f3e891cf740 1 -- 172.21.15.12:0/1982861988 shutdown_connections 2024-09-19T06:53:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.031+0000 7f3e891cf740 1 -- 172.21.15.12:0/1982861988 wait complete. 2024-09-19T06:53:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.031+0000 7f3e891cf740 1 -- start start 2024-09-19T06:53:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.031+0000 7f3e891cf740 1 Processor -- start 2024-09-19T06:53:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115deaf0 0x5643115f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x5643115ee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e891cf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115e9cb0 0x5643115eef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e891cf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3e801acf20 con 0x5643115e9cb0 2024-09-19T06:53:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e891cf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3e801ac790 con 0x5643115df410 2024-09-19T06:53:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e891cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3e801a99f0 con 0x5643115deaf0 2024-09-19T06:53:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e891cf740 10 client.0 _ll_register_callbacks cb 0x7f3e78009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:53:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e7f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x5643115ee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e7ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115deaf0 0x5643115f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e7f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x5643115ee9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:49602/0 (socket says 172.21.15.12:49602) 2024-09-19T06:53:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/1669436994 learned_addr learned my addr 172.21.15.12:0/1669436994 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:53:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e849d4640 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115e9cb0 0x5643115eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/1669436994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115deaf0 msgr2=0x5643115f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:56.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115deaf0 0x5643115f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/1669436994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115e9cb0 msgr2=0x5643115eef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115e9cb0 0x5643115eef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e7f7fe640 1 -- 172.21.15.12:0/1669436994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643115ef790 con 0x5643115df410 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e7f7fe640 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x5643115ee9e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3e740b8fe0 tx=0x7f3e74031490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2369ae8751084b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.032+0000 7f3e5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/1669436994 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e740a4060 con 0x5643115df410 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e891cf740 1 -- 172.21.15.12:0/1669436994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e740b8040 con 0x5643115df410 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/1669436994 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f3e740bc870 con 0x5643115df410 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/1669436994 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f3e74049030 con 0x5643115df410 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e891cf740 10 client.28577 fetch_fsmap learned FSMap version 50 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e891cf740 1 -- 172.21.15.12:0/1669436994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x564311675870 con 0x5643115df410 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/1669436994 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e740b8040 con 0x5643115df410 2024-09-19T06:53:56.038 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/1669436994 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f3e740c4df0 con 0x5643115df410 2024-09-19T06:53:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e891cf740 10 client.28577 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:53:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e891cf740 10 client.28577 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:53:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e891cf740 20 client.28577 populate_metadata read hostname 'smithi012' 2024-09-19T06:53:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e891cf740 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564311675aa0 0x564311677e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e891cf740 4 client.28577 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:53:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.033+0000 7f3e891cf740 1 -- 172.21.15.12:0/1669436994 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564311550a20 con 0x564311675aa0 2024-09-19T06:53:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.034+0000 7f3e7ffff640 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564311675aa0 0x564311677e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.034+0000 7f3e5f7fe640 10 client.28577 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.035+0000 7f3e7ffff640 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564311675aa0 0x564311677e90 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2a9e28c940c2691 server_cookie=ed84854a78876cce in_seq=0 out_seq=0 2024-09-19T06:53:56.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.046+0000 7f3e5f7fe640 1 -- 172.21.15.12:0/1669436994 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564311550a20 con 0x564311675aa0 2024-09-19T06:53:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.046+0000 7f3e5f7fe640 10 client.28577 handle_command_reply: tid=0 2024-09-19T06:53:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.046+0000 7f3e891cf740 1 client.28577 shutdown 2024-09-19T06:53:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e891cf740 1 -- 172.21.15.12:0/1669436994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 msgr2=0x5643115ee9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e891cf740 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x5643115ee9e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3e740b8fe0 tx=0x7f3e74031490 comp rx=0 tx=0).stop 2024-09-19T06:53:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e891cf740 1 -- 172.21.15.12:0/1669436994 shutdown_connections 2024-09-19T06:53:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e891cf740 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564311675aa0 0x564311677e90 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e891cf740 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643115e9cb0 0x5643115eef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e891cf740 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5643115df410 0x5643115ee9e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e891cf740 1 --2- 172.21.15.12:0/1669436994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643115deaf0 0x5643115f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e5f7fe640 0 client.28577 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:53:56.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e891cf740 1 -- 172.21.15.12:0/1669436994 >> 172.21.15.12:0/1669436994 conn(0x5643115db060 msgr2=0x5643115da1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e891cf740 1 -- 172.21.15.12:0/1669436994 shutdown_connections 2024-09-19T06:53:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.047+0000 7f3e891cf740 1 -- 172.21.15.12:0/1669436994 wait complete. 2024-09-19T06:53:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e891cf740 20 client.28577 trim_cache size 0 max 16384 2024-09-19T06:53:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:53:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:53:56.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:53:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:53:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e86437640 1 -- 172.21.15.12:0/2398136837 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e680a34e0 msgr2=0x7f3e680a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e86437640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e680a34e0 0x7f3e680a59a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3e78005fd0 tx=0x7f3e78009500 comp rx=0 tx=0).stop 2024-09-19T06:53:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e86437640 1 -- 172.21.15.12:0/2398136837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e801090b0 msgr2=0x7f3e8019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e86437640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e801090b0 0x7f3e8019aad0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3e7402a930 tx=0x7f3e74003b20 comp rx=0 tx=0).stop 2024-09-19T06:53:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e86437640 1 -- 172.21.15.12:0/2398136837 shutdown_connections 2024-09-19T06:53:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e86437640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8019ee50 0x7f3e8019f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e86437640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e801090b0 0x7f3e8019aad0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e86437640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f3e680a34e0 0x7f3e680a59a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e86437640 1 --2- 172.21.15.12:0/2398136837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e80103f60 0x7f3e8019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.048+0000 7f3e86437640 1 -- 172.21.15.12:0/2398136837 >> 172.21.15.12:0/2398136837 conn(0x7f3e800ff9b0 msgr2=0x7f3e80100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.049+0000 7f3e86437640 1 -- 172.21.15.12:0/2398136837 shutdown_connections 2024-09-19T06:53:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:53:56.049+0000 7f3e86437640 1 -- 172.21.15.12:0/2398136837 wait complete. 2024-09-19T06:53:57.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:57 smithi016 ceph-mon[34911]: pgmap v431: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.8 MiB/s wr, 260 op/s 2024-09-19T06:53:57.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:57 smithi173 ceph-mon[35349]: pgmap v431: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.8 MiB/s wr, 260 op/s 2024-09-19T06:53:57.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:57 smithi012 ceph-mon[30937]: pgmap v431: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.8 MiB/s wr, 260 op/s 2024-09-19T06:53:59.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:53:59 smithi016 ceph-mon[34911]: pgmap v432: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.7 MiB/s wr, 242 op/s 2024-09-19T06:53:59.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:53:59 smithi173 ceph-mon[35349]: pgmap v432: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.7 MiB/s wr, 242 op/s 2024-09-19T06:53:59.880 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:53:59 smithi012 ceph-mon[30937]: pgmap v432: 97 pgs: 97 active+clean; 4.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.7 MiB/s wr, 242 op/s 2024-09-19T06:54:00.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 795.0 s, 1962.6 tps, lat 49.490 ms stddev 55.448 2024-09-19T06:54:01.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:01 smithi016 ceph-mon[34911]: pgmap v433: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 5.6 MiB/s wr, 521 op/s 2024-09-19T06:54:01.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:01 smithi173 ceph-mon[35349]: pgmap v433: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 5.6 MiB/s wr, 521 op/s 2024-09-19T06:54:01.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:01 smithi012 ceph-mon[30937]: pgmap v433: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 5.6 MiB/s wr, 521 op/s 2024-09-19T06:54:02.972 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:54:03.265 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:03.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:03 smithi012 ceph-mon[30937]: pgmap v434: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.6 MiB/s wr, 516 op/s 2024-09-19T06:54:03.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:03 smithi016 ceph-mon[34911]: pgmap v434: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.6 MiB/s wr, 516 op/s 2024-09-19T06:54:03.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.808+0000 7f0724ee2640 1 -- 172.21.15.12:0/34769889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0720101400 msgr2=0x7f072010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:03.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.808+0000 7f0724ee2640 1 --2- 172.21.15.12:0/34769889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0720101400 0x7f072010d930 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f0718009cd0 tx=0x7f071802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.808+0000 7f0724ee2640 1 -- 172.21.15.12:0/34769889 shutdown_connections 2024-09-19T06:54:03.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.808+0000 7f0724ee2640 1 --2- 172.21.15.12:0/34769889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0720101400 0x7f072010d930 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.808+0000 7f0724ee2640 1 --2- 172.21.15.12:0/34769889 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0720100a60 0x7f0720100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.808+0000 7f0724ee2640 1 --2- 172.21.15.12:0/34769889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0720106a60 0x7f0720106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.808+0000 7f0724ee2640 1 -- 172.21.15.12:0/34769889 >> 172.21.15.12:0/34769889 conn(0x7f07200fc780 msgr2=0x7f07200feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:03.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.808+0000 7f0724ee2640 1 -- 172.21.15.12:0/34769889 shutdown_connections 2024-09-19T06:54:03.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.808+0000 7f0724ee2640 1 -- 172.21.15.12:0/34769889 wait complete. 2024-09-19T06:54:03.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f0724ee2640 1 Processor -- start 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f0724ee2640 1 -- start start 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f0724ee2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0720100a60 0x7f07201983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f0724ee2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0720101400 0x7f0720198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f0724ee2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0720106a60 0x7f072019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f0724ee2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0720110e60 con 0x7f0720101400 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f0724ee2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0720110ce0 con 0x7f0720106a60 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f0724ee2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0720110fe0 con 0x7f0720100a60 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f071dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0720101400 0x7f0720198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f071dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0720101400 0x7f0720198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40320/0 (socket says 172.21.15.12:40320) 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f071dd9b640 1 -- 172.21.15.12:0/3536687841 learned_addr learned my addr 172.21.15.12:0/3536687841 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.809+0000 7f071e59c640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0720100a60 0x7f07201983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f071ed9d640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0720106a60 0x7f072019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f071dd9b640 1 -- 172.21.15.12:0/3536687841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0720100a60 msgr2=0x7f07201983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f071dd9b640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0720100a60 0x7f07201983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f071dd9b640 1 -- 172.21.15.12:0/3536687841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0720106a60 msgr2=0x7f072019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f071dd9b640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0720106a60 0x7f072019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f071dd9b640 1 -- 172.21.15.12:0/3536687841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072019d3a0 con 0x7f0720101400 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f071ed9d640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0720106a60 0x7f072019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f071dd9b640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0720101400 0x7f0720198930 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f071400e9f0 tx=0x7f071400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f070f7fe640 1 -- 172.21.15.12:0/3536687841 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071400cd80 con 0x7f0720101400 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f0724ee2640 1 -- 172.21.15.12:0/3536687841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072019d690 con 0x7f0720101400 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f070f7fe640 1 -- 172.21.15.12:0/3536687841 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0714010910 con 0x7f0720101400 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f070f7fe640 1 -- 172.21.15.12:0/3536687841 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714018990 con 0x7f0720101400 2024-09-19T06:54:03.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.810+0000 7f0724ee2640 1 -- 172.21.15.12:0/3536687841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07201a4f70 con 0x7f0720101400 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.813+0000 7f070f7fe640 1 -- 172.21.15.12:0/3536687841 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0714010ac0 con 0x7f0720101400 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.813+0000 7f07272bb740 1 Processor -- start 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.813+0000 7f07272bb740 1 -- start start 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.813+0000 7f07272bb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 0x564495430760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.813+0000 7f07272bb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.813+0000 7f07272bb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 0x564495441e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.813+0000 7f070f7fe640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f07080a33b0 0x7f07080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.813+0000 7f07272bb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5644953962e0 con 0x564495430ca0 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.813+0000 7f07272bb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56449533dce0 con 0x564495430380 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.813+0000 7f07272bb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5644953922a0 con 0x56449543fa90 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 0x564495430760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 0x564495430760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56218/0 (socket says 172.21.15.12:56218) 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071ed9d640 1 -- 172.21.15.12:0/1724196137 learned_addr learned my addr 172.21.15.12:0/1724196137 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071dd9b640 1 --2- 172.21.15.12:0/1724196137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 0x564495441e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071ed9d640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f07080a33b0 0x7f07080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f070f7fe640 1 -- 172.21.15.12:0/3536687841 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f07140d0130 con 0x7f0720101400 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071e59c640 1 -- 172.21.15.12:0/1724196137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 msgr2=0x564495441e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071e59c640 1 --2- 172.21.15.12:0/1724196137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 0x564495441e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071e59c640 1 -- 172.21.15.12:0/1724196137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 msgr2=0x564495430760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071e59c640 1 --2- 172.21.15.12:0/1724196137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 0x564495430760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071e59c640 1 -- 172.21.15.12:0/1724196137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564495322440 con 0x564495430ca0 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071dd9b640 1 --2- 172.21.15.12:0/1724196137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 0x564495441e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071e59c640 1 --2- 172.21.15.12:0/1724196137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543f550 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f071000bb70 tx=0x7f07100107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e93f7eeeeaa281 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f071ed9d640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f07080a33b0 0x7f07080a5870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0718005fe0 tx=0x7f07180317e0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:03.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.814+0000 7f070cff9640 1 -- 172.21.15.12:0/1724196137 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710004030 con 0x564495430ca0 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.815+0000 7f070cff9640 1 -- 172.21.15.12:0/1724196137 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07100041d0 con 0x564495430ca0 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.815+0000 7f070cff9640 1 -- 172.21.15.12:0/1724196137 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710011640 con 0x564495430ca0 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.815+0000 7f07272bb740 1 -- 172.21.15.12:0/1724196137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 msgr2=0x56449543f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.815+0000 7f07272bb740 1 --2- 172.21.15.12:0/1724196137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543f550 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f071000bb70 tx=0x7f07100107a0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 -- 172.21.15.12:0/1724196137 shutdown_connections 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 --2- 172.21.15.12:0/1724196137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 0x564495441e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 --2- 172.21.15.12:0/1724196137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543f550 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 --2- 172.21.15.12:0/1724196137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 0x564495430760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 -- 172.21.15.12:0/1724196137 >> 172.21.15.12:0/1724196137 conn(0x56449542ca30 msgr2=0x56449542ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 -- 172.21.15.12:0/1724196137 shutdown_connections 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 -- 172.21.15.12:0/1724196137 wait complete. 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 -- start start 2024-09-19T06:54:03.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 Processor -- start 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564495430380 0x56449543f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56449543fa90 0x56449543cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.816+0000 7f07272bb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564495442660 con 0x564495430ca0 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f07272bb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564495351050 con 0x56449543fa90 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f07272bb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5644954427e0 con 0x564495430380 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f07272bb740 10 client.0 _ll_register_callbacks cb 0x564495391160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071dd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40340/0 (socket says 172.21.15.12:40340) 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071dd9b640 1 -- 172.21.15.12:0/196891437 learned_addr learned my addr 172.21.15.12:0/196891437 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071ed9d640 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56449543fa90 0x56449543cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071e59c640 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564495430380 0x56449543f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071dd9b640 1 -- 172.21.15.12:0/196891437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564495430380 msgr2=0x56449543f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071dd9b640 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564495430380 0x56449543f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071dd9b640 1 -- 172.21.15.12:0/196891437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56449543fa90 msgr2=0x56449543cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071dd9b640 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56449543fa90 0x56449543cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071dd9b640 1 -- 172.21.15.12:0/196891437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644951073c0 con 0x564495430ca0 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f071dd9b640 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543c690 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f071400e9c0 tx=0x7f071409c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bb54972e73c984 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f0705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f0705ffb640 1 -- 172.21.15.12:0/196891437 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714026040 con 0x564495430ca0 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f0705ffb640 1 -- 172.21.15.12:0/196891437 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f071409a6c0 con 0x564495430ca0 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.817+0000 7f07272bb740 1 -- 172.21.15.12:0/196891437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07100041d0 con 0x564495430ca0 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f0705ffb640 1 -- 172.21.15.12:0/196891437 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f07140a1bd0 con 0x564495430ca0 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f07272bb740 10 client.19284 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f07272bb740 1 -- 172.21.15.12:0/196891437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56449544e070 con 0x564495430ca0 2024-09-19T06:54:03.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f0705ffb640 1 -- 172.21.15.12:0/196891437 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07100041d0 con 0x564495430ca0 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f0705ffb640 1 -- 172.21.15.12:0/196891437 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f07140bc0e0 con 0x564495430ca0 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f07272bb740 10 client.19284 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f07272bb740 10 client.19284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f07272bb740 20 client.19284 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f07272bb740 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56449544f4d0 0x5644954518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f07272bb740 4 client.19284 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f07272bb740 1 -- 172.21.15.12:0/196891437 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644953a3850 con 0x56449544f4d0 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.818+0000 7f071e59c640 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56449544f4d0 0x5644954518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.819+0000 7f0705ffb640 10 client.19284 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.819+0000 7f071e59c640 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56449544f4d0 0x5644954518e0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=473caea7a4eb8296 server_cookie=de8ef8f9febf5b0b in_seq=0 out_seq=0 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.819+0000 7f0705ffb640 1 -- 172.21.15.12:0/196891437 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644953a3850 con 0x56449544f4d0 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.819+0000 7f0705ffb640 10 client.19284 handle_command_reply: tid=0 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 client.19284 shutdown 2024-09-19T06:54:03.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 -- 172.21.15.12:0/196891437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 msgr2=0x56449543c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543c690 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f071400e9c0 tx=0x7f071409c3c0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 -- 172.21.15.12:0/196891437 shutdown_connections 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56449544f4d0 0x5644954518e0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56449543fa90 0x56449543cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f0705ffb640 0 client.19284 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430ca0 0x56449543c690 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 --2- 172.21.15.12:0/196891437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564495430380 0x56449543f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 -- 172.21.15.12:0/196891437 >> 172.21.15.12:0/196891437 conn(0x56449542ca30 msgr2=0x564495432790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 -- 172.21.15.12:0/196891437 shutdown_connections 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 1 -- 172.21.15.12:0/196891437 wait complete. 2024-09-19T06:54:03.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.820+0000 7f07272bb740 20 client.19284 trim_cache size 0 max 16384 2024-09-19T06:54:03.842 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:03 smithi173 ceph-mon[35349]: pgmap v434: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.6 MiB/s wr, 516 op/s 2024-09-19T06:54:03.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f07272bb740 1 Processor -- start 2024-09-19T06:54:03.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f07272bb740 1 -- start start 2024-09-19T06:54:03.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f07272bb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 0x56449544b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f07272bb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564495430ca0 0x56449543af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f07272bb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56449543fa90 0x564495457180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f07272bb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f07201ab9c0 con 0x56449543fa90 2024-09-19T06:54:03.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f07272bb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f07201ad5c0 con 0x564495430380 2024-09-19T06:54:03.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f07272bb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f07201ac090 con 0x564495430ca0 2024-09-19T06:54:03.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f071ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56449543fa90 0x564495457180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f071ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56449543fa90 0x564495457180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40352/0 (socket says 172.21.15.12:40352) 2024-09-19T06:54:03.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f071ed9d640 1 -- 172.21.15.12:0/1962373732 learned_addr learned my addr 172.21.15.12:0/1962373732 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:03.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f071dd9b640 1 --2- 172.21.15.12:0/1962373732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564495430ca0 0x56449543af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.844+0000 7f071e59c640 1 --2- 172.21.15.12:0/1962373732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 0x56449544b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.845+0000 7f071ed9d640 1 -- 172.21.15.12:0/1962373732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564495430ca0 msgr2=0x56449543af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:03.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.845+0000 7f071ed9d640 1 --2- 172.21.15.12:0/1962373732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564495430ca0 0x56449543af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.845+0000 7f071ed9d640 1 -- 172.21.15.12:0/1962373732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 msgr2=0x56449544b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:03.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.845+0000 7f071ed9d640 1 --2- 172.21.15.12:0/1962373732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 0x56449544b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.845+0000 7f071ed9d640 1 -- 172.21.15.12:0/1962373732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56449543b640 con 0x56449543fa90 2024-09-19T06:54:03.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.845+0000 7f071e59c640 1 --2- 172.21.15.12:0/1962373732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 0x56449544b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.845+0000 7f071ed9d640 1 --2- 172.21.15.12:0/1962373732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56449543fa90 0x564495457180 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f0718009430 tx=0x7f0718009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5ce5f7c88be293 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.845+0000 7f0707fff640 1 -- 172.21.15.12:0/1962373732 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07180305a0 con 0x56449543fa90 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.845+0000 7f0707fff640 1 -- 172.21.15.12:0/1962373732 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0718036070 con 0x56449543fa90 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.845+0000 7f0707fff640 1 -- 172.21.15.12:0/1962373732 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071804c9d0 con 0x56449543fa90 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 -- 172.21.15.12:0/1962373732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56449543fa90 msgr2=0x564495457180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 --2- 172.21.15.12:0/1962373732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56449543fa90 0x564495457180 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f0718009430 tx=0x7f0718009360 comp rx=0 tx=0).stop 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 -- 172.21.15.12:0/1962373732 shutdown_connections 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 --2- 172.21.15.12:0/1962373732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56449543fa90 0x564495457180 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 --2- 172.21.15.12:0/1962373732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564495430ca0 0x56449543af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 --2- 172.21.15.12:0/1962373732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430380 0x56449544b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 -- 172.21.15.12:0/1962373732 >> 172.21.15.12:0/1962373732 conn(0x56449542ca30 msgr2=0x564495437d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 -- 172.21.15.12:0/1962373732 shutdown_connections 2024-09-19T06:54:03.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 -- 172.21.15.12:0/1962373732 wait complete. 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 -- start start 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.846+0000 7f07272bb740 1 Processor -- start 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f07272bb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430380 0x564495448380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f07272bb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430ca0 0x564495439520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f07272bb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 0x564495439c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f07272bb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f07201acef0 con 0x564495430380 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f07272bb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f07201ac760 con 0x564495430ca0 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f07272bb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f07201a99c0 con 0x56449543fa90 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430ca0 0x564495439520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071dd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430ca0 0x564495439520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56240/0 (socket says 172.21.15.12:56240) 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071dd9b640 1 -- 172.21.15.12:0/512127347 learned_addr learned my addr 172.21.15.12:0/512127347 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f07272bb740 10 client.0 _ll_register_callbacks cb 0x7f071409bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:03.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071ed9d640 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 0x564495439c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071e59c640 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430380 0x564495448380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071dd9b640 1 -- 172.21.15.12:0/512127347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 msgr2=0x564495439c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:03.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071dd9b640 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 0x564495439c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071dd9b640 1 -- 172.21.15.12:0/512127347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430380 msgr2=0x564495448380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:03.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071dd9b640 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430380 0x564495448380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071dd9b640 1 -- 172.21.15.12:0/512127347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644954b9150 con 0x564495430ca0 2024-09-19T06:54:03.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f071dd9b640 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430ca0 0x564495439520 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f071409c350 tx=0x7f0714098730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2674d9c9e939fd23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:03.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.847+0000 7f0705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:54:03.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f0705ffb640 1 -- 172.21.15.12:0/512127347 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071406f040 con 0x564495430ca0 2024-09-19T06:54:03.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f0705ffb640 1 -- 172.21.15.12:0/512127347 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f071409b810 con 0x564495430ca0 2024-09-19T06:54:03.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f07272bb740 1 -- 172.21.15.12:0/512127347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0718036070 con 0x564495430ca0 2024-09-19T06:54:03.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f0705ffb640 1 -- 172.21.15.12:0/512127347 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f07140cdc00 con 0x564495430ca0 2024-09-19T06:54:03.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f07272bb740 10 client.28595 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:03.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f07272bb740 1 -- 172.21.15.12:0/512127347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5644954ba2c0 con 0x564495430ca0 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f0705ffb640 1 -- 172.21.15.12:0/512127347 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0718036070 con 0x564495430ca0 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f0705ffb640 1 -- 172.21.15.12:0/512127347 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f0714018c30 con 0x564495430ca0 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f07272bb740 10 client.28595 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f07272bb740 10 client.28595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f07272bb740 20 client.28595 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f07272bb740 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56449544f4d0 0x5644954bca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f07272bb740 4 client.28595 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.848+0000 7f07272bb740 1 -- 172.21.15.12:0/512127347 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56449539dd60 con 0x56449544f4d0 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.849+0000 7f071e59c640 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56449544f4d0 0x5644954bca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.849+0000 7f071e59c640 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56449544f4d0 0x5644954bca80 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b6e235bca21f42 server_cookie=bceffbd36b3ed4a1 in_seq=0 out_seq=0 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.849+0000 7f0705ffb640 10 client.28595 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.849+0000 7f0705ffb640 1 -- 172.21.15.12:0/512127347 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56449539dd60 con 0x56449544f4d0 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.849+0000 7f0705ffb640 10 client.28595 handle_command_reply: tid=0 2024-09-19T06:54:03.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.849+0000 7f07272bb740 1 client.28595 shutdown 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 1 -- 172.21.15.12:0/512127347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430ca0 msgr2=0x564495439520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430ca0 0x564495439520 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f071409c350 tx=0x7f0714098730 comp rx=0 tx=0).stop 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 1 -- 172.21.15.12:0/512127347 shutdown_connections 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56449544f4d0 0x5644954bca80 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56449543fa90 0x564495439c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564495430ca0 0x564495439520 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f0705ffb640 0 client.28595 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 1 --2- 172.21.15.12:0/512127347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564495430380 0x564495448380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 1 -- 172.21.15.12:0/512127347 >> 172.21.15.12:0/512127347 conn(0x56449542ca30 msgr2=0x564495437d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 1 -- 172.21.15.12:0/512127347 shutdown_connections 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 1 -- 172.21.15.12:0/512127347 wait complete. 2024-09-19T06:54:03.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.850+0000 7f07272bb740 20 client.28595 trim_cache size 0 max 16384 2024-09-19T06:54:03.856 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:54:03.856 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:54:03.856 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:54:03.856 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 -- 172.21.15.12:0/3536687841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f07080a33b0 msgr2=0x7f07080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f07080a33b0 0x7f07080a5870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0718005fe0 tx=0x7f07180317e0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 -- 172.21.15.12:0/3536687841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0720101400 msgr2=0x7f0720198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0720101400 0x7f0720198930 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f071400e9f0 tx=0x7f071400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 -- 172.21.15.12:0/3536687841 shutdown_connections 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0720106a60 0x7f072019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0720101400 0x7f0720198930 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f07080a33b0 0x7f07080a5870 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 --2- 172.21.15.12:0/3536687841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0720100a60 0x7f07201983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 -- 172.21.15.12:0/3536687841 >> 172.21.15.12:0/3536687841 conn(0x7f07200fc780 msgr2=0x7f072006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:03.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 -- 172.21.15.12:0/3536687841 shutdown_connections 2024-09-19T06:54:03.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:03.851+0000 7f0724ee2640 1 -- 172.21.15.12:0/3536687841 wait complete. 2024-09-19T06:54:04.787 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:54:04.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:54:05.083 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.621+0000 7f37f6155640 1 -- 172.21.15.12:0/1868932859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f0101360 msgr2=0x7f37f010df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.621+0000 7f37f6155640 1 --2- 172.21.15.12:0/1868932859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f0101360 0x7f37f010df90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009900 tx=0x7f37e402a410 comp rx=0 tx=0).stop 2024-09-19T06:54:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.621+0000 7f37f6155640 1 -- 172.21.15.12:0/1868932859 shutdown_connections 2024-09-19T06:54:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.621+0000 7f37f6155640 1 --2- 172.21.15.12:0/1868932859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37f010e4d0 0x7f37f01108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.621+0000 7f37f6155640 1 --2- 172.21.15.12:0/1868932859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f0101360 0x7f37f010df90 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.621+0000 7f37f6155640 1 --2- 172.21.15.12:0/1868932859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37f01009b0 0x7f37f0100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.621+0000 7f37f6155640 1 -- 172.21.15.12:0/1868932859 >> 172.21.15.12:0/1868932859 conn(0x7f37f00fc7d0 msgr2=0x7f37f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.622+0000 7f37f6155640 1 -- 172.21.15.12:0/1868932859 shutdown_connections 2024-09-19T06:54:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.622+0000 7f37f6155640 1 -- 172.21.15.12:0/1868932859 wait complete. 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.622+0000 7f37f6155640 1 Processor -- start 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37f6155640 1 -- start start 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37f6155640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37f01009b0 0x7f37f01a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37f6155640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37f0101360 0x7f37f01a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37f6155640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f010e4d0 0x7f37f019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37f6155640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f37f0114270 con 0x7f37f010e4d0 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37f6155640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f37f01140f0 con 0x7f37f01009b0 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37f6155640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f37f01143f0 con 0x7f37f0101360 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f010e4d0 0x7f37f019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37ef7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37f01009b0 0x7f37f01a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37effff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f010e4d0 0x7f37f019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40370/0 (socket says 172.21.15.12:40370) 2024-09-19T06:54:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37effff640 1 -- 172.21.15.12:0/3284632910 learned_addr learned my addr 172.21.15.12:0/3284632910 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37eeffd640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37f0101360 0x7f37f01a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37ef7fe640 1 -- 172.21.15.12:0/3284632910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37f0101360 msgr2=0x7f37f01a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37ef7fe640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37f0101360 0x7f37f01a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37ef7fe640 1 -- 172.21.15.12:0/3284632910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f010e4d0 msgr2=0x7f37f019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37ef7fe640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f010e4d0 0x7f37f019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37ef7fe640 1 -- 172.21.15.12:0/3284632910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f019acc0 con 0x7f37f01009b0 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.623+0000 7f37eeffd640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37f0101360 0x7f37f01a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.624+0000 7f37ef7fe640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37f01009b0 0x7f37f01a03d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f37e000e9f0 tx=0x7f37e000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.624+0000 7f37ecff9640 1 -- 172.21.15.12:0/3284632910 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e000ccc0 con 0x7f37f01009b0 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.624+0000 7f37f6155640 1 -- 172.21.15.12:0/3284632910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f019afb0 con 0x7f37f01009b0 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.624+0000 7f37ecff9640 1 -- 172.21.15.12:0/3284632910 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37e0010910 con 0x7f37f01009b0 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.624+0000 7f37ecff9640 1 -- 172.21.15.12:0/3284632910 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0018960 con 0x7f37f01009b0 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.624+0000 7f37f6155640 1 -- 172.21.15.12:0/3284632910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f01a72a0 con 0x7f37f01009b0 2024-09-19T06:54:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.625+0000 7f37f6155640 1 -- 172.21.15.12:0/3284632910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f0100d90 con 0x7f37f01009b0 2024-09-19T06:54:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.627+0000 7f37ecff9640 1 -- 172.21.15.12:0/3284632910 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f37e0010ac0 con 0x7f37f01009b0 2024-09-19T06:54:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.627+0000 7f37ecff9640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37d80a33b0 0x7f37d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.627+0000 7f37eeffd640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37d80a33b0 0x7f37d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.627+0000 7f37ecff9640 1 -- 172.21.15.12:0/3284632910 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f37e00d0610 con 0x7f37f01009b0 2024-09-19T06:54:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.628+0000 7f37eeffd640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37d80a33b0 0x7f37d80a5870 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f37e4000c00 tx=0x7f37e4031510 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.631+0000 7f37ecff9640 1 -- 172.21.15.12:0/3284632910 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37e009c900 con 0x7f37f01009b0 2024-09-19T06:54:05.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:05 smithi016 ceph-mon[34911]: pgmap v435: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.6 MiB/s wr, 520 op/s 2024-09-19T06:54:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 800.0 s, 305.6 tps, lat 320.418 ms stddev 193.864 2024-09-19T06:54:05.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:05 smithi173 ceph-mon[35349]: pgmap v435: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.6 MiB/s wr, 520 op/s 2024-09-19T06:54:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.877+0000 7f37f6155640 1 -- 172.21.15.12:0/3284632910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37f0109660 con 0x7f37f01009b0 2024-09-19T06:54:05.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:05 smithi012 ceph-mon[30937]: pgmap v435: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.6 MiB/s wr, 520 op/s 2024-09-19T06:54:05.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.877+0000 7f37ecff9640 1 -- 172.21.15.12:0/3284632910 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11978 (secure 0 0 0) 0x7f37e00a0c00 con 0x7f37f01009b0 2024-09-19T06:54:05.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:54:05.879 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":50,"btime":"2024-09-19T06:53:39:430697+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:53:39.419389+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:54:05.879 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 50 2024-09-19T06:54:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.879+0000 7f37f6155640 1 -- 172.21.15.12:0/3284632910 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37d80a33b0 msgr2=0x7f37d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.879+0000 7f37f6155640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37d80a33b0 0x7f37d80a5870 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f37e4000c00 tx=0x7f37e4031510 comp rx=0 tx=0).stop 2024-09-19T06:54:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.880+0000 7f37f6155640 1 -- 172.21.15.12:0/3284632910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37f01009b0 msgr2=0x7f37f01a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.880+0000 7f37f6155640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37f01009b0 0x7f37f01a03d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f37e000e9f0 tx=0x7f37e000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.880+0000 7f37f6155640 1 -- 172.21.15.12:0/3284632910 shutdown_connections 2024-09-19T06:54:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.880+0000 7f37f6155640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f010e4d0 0x7f37f019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.880+0000 7f37f6155640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f37d80a33b0 0x7f37d80a5870 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.880+0000 7f37f6155640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37f0101360 0x7f37f01a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.880+0000 7f37f6155640 1 --2- 172.21.15.12:0/3284632910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37f01009b0 0x7f37f01a03d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.880+0000 7f37f6155640 1 -- 172.21.15.12:0/3284632910 >> 172.21.15.12:0/3284632910 conn(0x7f37f00fc7d0 msgr2=0x7f37f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.880+0000 7f37f6155640 1 -- 172.21.15.12:0/3284632910 shutdown_connections 2024-09-19T06:54:05.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:05.880+0000 7f37f6155640 1 -- 172.21.15.12:0/3284632910 wait complete. 2024-09-19T06:54:06.568 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:54:06.760 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:06 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3284632910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:06.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:06 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3284632910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:06.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:06 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3284632910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:07.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.357+0000 7f286884f640 1 -- 172.21.15.12:0/3704090412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2864106a70 msgr2=0x7f2864106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.357+0000 7f286884f640 1 --2- 172.21.15.12:0/3704090412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2864106a70 0x7f2864106e50 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f2854009930 tx=0x7f285402a420 comp rx=0 tx=0).stop 2024-09-19T06:54:07.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.357+0000 7f286884f640 1 -- 172.21.15.12:0/3704090412 shutdown_connections 2024-09-19T06:54:07.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.357+0000 7f286884f640 1 --2- 172.21.15.12:0/3704090412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2864101410 0x7f286410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.357+0000 7f286884f640 1 --2- 172.21.15.12:0/3704090412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2864100a70 0x7f2864100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.357+0000 7f286884f640 1 --2- 172.21.15.12:0/3704090412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2864106a70 0x7f2864106e50 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.357+0000 7f286884f640 1 -- 172.21.15.12:0/3704090412 >> 172.21.15.12:0/3704090412 conn(0x7f28640fc790 msgr2=0x7f28640febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.358+0000 7f286884f640 1 -- 172.21.15.12:0/3704090412 shutdown_connections 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.358+0000 7f286884f640 1 -- 172.21.15.12:0/3704090412 wait complete. 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.358+0000 7f286884f640 1 Processor -- start 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.358+0000 7f286884f640 1 -- start start 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f286884f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2864100a70 0x7f2864102640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f286884f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2864101410 0x7f2864102b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f286884f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2864106a70 0x7f28641030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f286884f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2864110e30 con 0x7f2864101410 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f285bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2864101410 0x7f2864102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f286884f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2864110cb0 con 0x7f2864100a70 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f286884f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2864110fb0 con 0x7f2864106a70 2024-09-19T06:54:07.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f285bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2864101410 0x7f2864102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40384/0 (socket says 172.21.15.12:40384) 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f286259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2864100a70 0x7f2864102640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f285bfff640 1 -- 172.21.15.12:0/1953256886 learned_addr learned my addr 172.21.15.12:0/1953256886 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f2862d9d640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2864106a70 0x7f28641030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f285bfff640 1 -- 172.21.15.12:0/1953256886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2864106a70 msgr2=0x7f28641030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f285bfff640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2864106a70 0x7f28641030c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f285bfff640 1 -- 172.21.15.12:0/1953256886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2864100a70 msgr2=0x7f2864102640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f285bfff640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2864100a70 0x7f2864102640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f285bfff640 1 -- 172.21.15.12:0/1953256886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28641a68d0 con 0x7f2864101410 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.359+0000 7f286259c640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2864100a70 0x7f2864102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.360+0000 7f285bfff640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2864101410 0x7f2864102b80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f284c00d950 tx=0x7f284c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.360+0000 7f285b7fe640 1 -- 172.21.15.12:0/1953256886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c017030 con 0x7f2864101410 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.360+0000 7f286884f640 1 -- 172.21.15.12:0/1953256886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28641a6bc0 con 0x7f2864101410 2024-09-19T06:54:07.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.360+0000 7f285b7fe640 1 -- 172.21.15.12:0/1953256886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f284c004020 con 0x7f2864101410 2024-09-19T06:54:07.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.360+0000 7f286884f640 1 -- 172.21.15.12:0/1953256886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28641a7150 con 0x7f2864101410 2024-09-19T06:54:07.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.360+0000 7f285b7fe640 1 -- 172.21.15.12:0/1953256886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c0047a0 con 0x7f2864101410 2024-09-19T06:54:07.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.363+0000 7f286ac28740 1 Processor -- start 2024-09-19T06:54:07.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.363+0000 7f286ac28740 1 -- start start 2024-09-19T06:54:07.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.363+0000 7f286ac28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.363+0000 7f286ac28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 0x5653033c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.363+0000 7f286ac28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.363+0000 7f286ac28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5653033272f0 con 0x5653033c15d0 2024-09-19T06:54:07.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.363+0000 7f286ac28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5653032cecf0 con 0x5653033cc370 2024-09-19T06:54:07.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.363+0000 7f286ac28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5653033232b0 con 0x5653033c2b40 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f286259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 0x5653033c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f286259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 0x5653033c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40390/0 (socket says 172.21.15.12:40390) 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f286259c640 1 -- 172.21.15.12:0/3441987399 learned_addr learned my addr 172.21.15.12:0/3441987399 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f2862d9d640 1 --2- 172.21.15.12:0/3441987399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f285b7fe640 1 -- 172.21.15.12:0/1953256886 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f284c0041d0 con 0x7f2864101410 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f286259c640 1 -- 172.21.15.12:0/3441987399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 msgr2=0x5653033c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f286259c640 1 --2- 172.21.15.12:0/3441987399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f286259c640 1 -- 172.21.15.12:0/3441987399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 msgr2=0x5653033ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f286259c640 1 --2- 172.21.15.12:0/3441987399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f286259c640 1 -- 172.21.15.12:0/3441987399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653032b33a0 con 0x5653033c15d0 2024-09-19T06:54:07.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f2862d9d640 1 --2- 172.21.15.12:0/3441987399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f286259c640 1 --2- 172.21.15.12:0/3441987399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 0x5653033c1a10 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2854000c00 tx=0x7f2854005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3729aec2467ac79b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f2858ff9640 1 -- 172.21.15.12:0/3441987399 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854035040 con 0x5653033c15d0 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.364+0000 7f2858ff9640 1 -- 172.21.15.12:0/3441987399 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28540319f0 con 0x5653033c15d0 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f285b7fe640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f28500a33b0 0x7f28500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f285b7fe640 1 -- 172.21.15.12:0/1953256886 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f284c0cf750 con 0x7f2864101410 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f2862d9d640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f28500a33b0 0x7f28500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f2858ff9640 1 -- 172.21.15.12:0/3441987399 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285403c440 con 0x5653033c15d0 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f286ac28740 1 -- 172.21.15.12:0/3441987399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 msgr2=0x5653033c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f286ac28740 1 --2- 172.21.15.12:0/3441987399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 0x5653033c1a10 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2854000c00 tx=0x7f2854005e80 comp rx=0 tx=0).stop 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f2862d9d640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f28500a33b0 0x7f28500a5870 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f285c005fd0 tx=0x7f285c009600 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f286ac28740 1 -- 172.21.15.12:0/3441987399 shutdown_connections 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f286ac28740 1 --2- 172.21.15.12:0/3441987399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f286ac28740 1 --2- 172.21.15.12:0/3441987399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 0x5653033c1a10 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f286ac28740 1 --2- 172.21.15.12:0/3441987399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.365+0000 7f286ac28740 1 -- 172.21.15.12:0/3441987399 >> 172.21.15.12:0/3441987399 conn(0x56530338a310 msgr2=0x5653033bdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 1 -- 172.21.15.12:0/3441987399 shutdown_connections 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 1 -- 172.21.15.12:0/3441987399 wait complete. 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 1 -- start start 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 1 Processor -- start 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 0x5653033cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5653033cf060 con 0x5653033c15d0 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5653032e2060 con 0x5653033cc370 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5653033cf1e0 con 0x5653033c2b40 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.366+0000 7f286ac28740 10 client.0 _ll_register_callbacks cb 0x5653030358c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:07.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f285bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f285bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43768/0 (socket says 172.21.15.12:43768) 2024-09-19T06:54:07.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f285bfff640 1 -- 172.21.15.12:0/2365300231 learned_addr learned my addr 172.21.15.12:0/2365300231 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:07.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f286259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 0x5653033cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f2862d9d640 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f285bfff640 1 -- 172.21.15.12:0/2365300231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 msgr2=0x5653033c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:07.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f285bfff640 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f285bfff640 1 -- 172.21.15.12:0/2365300231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 msgr2=0x5653033cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:07.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f285bfff640 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 0x5653033cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f285bfff640 1 -- 172.21.15.12:0/2365300231 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653030983c0 con 0x5653033c2b40 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f285bfff640 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c8ee0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f284c009610 tx=0x7f284c09b350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2256d3255b259e37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f2849ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f2849ffb640 1 -- 172.21.15.12:0/2365300231 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c014070 con 0x5653033c2b40 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f286ac28740 1 -- 172.21.15.12:0/2365300231 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28540319f0 con 0x5653033c2b40 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f2849ffb640 1 -- 172.21.15.12:0/2365300231 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f284c0cd020 con 0x5653033c2b40 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f2849ffb640 1 -- 172.21.15.12:0/2365300231 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f284c09fce0 con 0x5653033c2b40 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f286ac28740 10 client.28537 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.367+0000 7f286ac28740 1 -- 172.21.15.12:0/2365300231 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5653033dab20 con 0x5653033c2b40 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.368+0000 7f2849ffb640 1 -- 172.21.15.12:0/2365300231 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28540319f0 con 0x5653033c2b40 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.368+0000 7f2849ffb640 1 -- 172.21.15.12:0/2365300231 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f284c0cfb40 con 0x5653033c2b40 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.368+0000 7f286ac28740 10 client.28537 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.368+0000 7f286ac28740 10 client.28537 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:54:07.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.368+0000 7f286ac28740 20 client.28537 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.368+0000 7f286ac28740 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5653033dbfe0 0x5653033de3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.368+0000 7f286ac28740 4 client.28537 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.368+0000 7f286ac28740 1 -- 172.21.15.12:0/2365300231 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565303334860 con 0x5653033dbfe0 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.368+0000 7f286259c640 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5653033dbfe0 0x5653033de3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.369+0000 7f286259c640 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5653033dbfe0 0x5653033de3d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=47920e876da8d9ae server_cookie=8c07c2247299273b in_seq=0 out_seq=0 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.369+0000 7f2849ffb640 10 client.28537 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.369+0000 7f2849ffb640 1 -- 172.21.15.12:0/2365300231 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565303334860 con 0x5653033dbfe0 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.369+0000 7f2849ffb640 10 client.28537 handle_command_reply: tid=0 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.369+0000 7f286ac28740 1 client.28537 shutdown 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.369+0000 7f286ac28740 1 -- 172.21.15.12:0/2365300231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 msgr2=0x5653033c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f286ac28740 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c8ee0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f284c009610 tx=0x7f284c09b350 comp rx=0 tx=0).stop 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f286ac28740 1 -- 172.21.15.12:0/2365300231 shutdown_connections 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f286ac28740 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x5653033dbfe0 0x5653033de3d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f286ac28740 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f286ac28740 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c2b40 0x5653033c8ee0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f286ac28740 1 --2- 172.21.15.12:0/2365300231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c15d0 0x5653033cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f286ac28740 1 -- 172.21.15.12:0/2365300231 >> 172.21.15.12:0/2365300231 conn(0x56530338a310 msgr2=0x5653033c3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f2849ffb640 0 client.28537 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:54:07.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f286ac28740 1 -- 172.21.15.12:0/2365300231 shutdown_connections 2024-09-19T06:54:07.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f286ac28740 1 -- 172.21.15.12:0/2365300231 wait complete. 2024-09-19T06:54:07.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.370+0000 7f286ac28740 20 client.28537 trim_cache size 0 max 16384 2024-09-19T06:54:07.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.384+0000 7f286ac28740 1 Processor -- start 2024-09-19T06:54:07.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.384+0000 7f286ac28740 1 -- start start 2024-09-19T06:54:07.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.384+0000 7f286ac28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033c15d0 0x5653033d8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.384+0000 7f286ac28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.384+0000 7f286ac28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033cc370 0x5653033e3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.384+0000 7f286ac28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f28641afd90 con 0x5653033c2b40 2024-09-19T06:54:07.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.384+0000 7f286ac28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f28641b1990 con 0x5653033c15d0 2024-09-19T06:54:07.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.384+0000 7f286ac28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f28641b0460 con 0x5653033cc370 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f285bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f286259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033c15d0 0x5653033d8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f285bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40400/0 (socket says 172.21.15.12:40400) 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f285bfff640 1 -- 172.21.15.12:0/3862596562 learned_addr learned my addr 172.21.15.12:0/3862596562 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f286259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033c15d0 0x5653033d8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56302/0 (socket says 172.21.15.12:56302) 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f2862d9d640 1 --2- 172.21.15.12:0/3862596562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033cc370 0x5653033e3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f2862d9d640 1 -- 172.21.15.12:0/3862596562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033c15d0 msgr2=0x5653033d8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f2862d9d640 1 --2- 172.21.15.12:0/3862596562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033c15d0 0x5653033d8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f2862d9d640 1 -- 172.21.15.12:0/3862596562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 msgr2=0x5653033c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f2862d9d640 1 --2- 172.21.15.12:0/3862596562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f2862d9d640 1 -- 172.21.15.12:0/3862596562 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653033c2530 con 0x5653033cc370 2024-09-19T06:54:07.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f285bfff640 1 --2- 172.21.15.12:0/3862596562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:07.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.385+0000 7f2862d9d640 1 --2- 172.21.15.12:0/3862596562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033cc370 0x5653033e3c30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x5653033cc340 tx=0x7f285c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d312bd2d9a4660f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f284bfff640 1 -- 172.21.15.12:0/3862596562 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c02d070 con 0x5653033cc370 2024-09-19T06:54:07.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f284bfff640 1 -- 172.21.15.12:0/3862596562 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f285c0288f0 con 0x5653033cc370 2024-09-19T06:54:07.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f284bfff640 1 -- 172.21.15.12:0/3862596562 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c01f8b0 con 0x5653033cc370 2024-09-19T06:54:07.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f286ac28740 1 -- 172.21.15.12:0/3862596562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033cc370 msgr2=0x5653033e3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f286ac28740 1 --2- 172.21.15.12:0/3862596562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033cc370 0x5653033e3c30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x5653033cc340 tx=0x7f285c016000 comp rx=0 tx=0).stop 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f286ac28740 1 -- 172.21.15.12:0/3862596562 shutdown_connections 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f286ac28740 1 --2- 172.21.15.12:0/3862596562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033cc370 0x5653033e3c30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f286ac28740 1 --2- 172.21.15.12:0/3862596562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f286ac28740 1 --2- 172.21.15.12:0/3862596562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033c15d0 0x5653033d8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f286ac28740 1 -- 172.21.15.12:0/3862596562 >> 172.21.15.12:0/3862596562 conn(0x56530338a310 msgr2=0x5653033c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f286ac28740 1 -- 172.21.15.12:0/3862596562 shutdown_connections 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.386+0000 7f286ac28740 1 -- 172.21.15.12:0/3862596562 wait complete. 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286ac28740 1 -- start start 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286ac28740 1 Processor -- start 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286ac28740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c15d0 0x5653033d4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286ac28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286ac28740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286ac28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f28641b12c0 con 0x5653033c2b40 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286ac28740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f28641b0b30 con 0x5653033cc370 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286ac28740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f28641add90 con 0x5653033c15d0 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286ac28740 10 client.0 _ll_register_callbacks cb 0x7f284c097ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c15d0 0x5653033d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f285bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c15d0 0x5653033d4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43784/0 (socket says 172.21.15.12:43784) 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f2862d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.387+0000 7f286259c640 1 -- 172.21.15.12:0/3687264541 learned_addr learned my addr 172.21.15.12:0/3687264541 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f286259c640 1 -- 172.21.15.12:0/3687264541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 msgr2=0x5653033c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f286259c640 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f286259c640 1 -- 172.21.15.12:0/3687264541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 msgr2=0x5653033d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f286259c640 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033d4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f286259c640 1 -- 172.21.15.12:0/3687264541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653033c6060 con 0x5653033c15d0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f2862d9d640 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f285bfff640 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f286259c640 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c15d0 0x5653033d4780 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2854005c40 tx=0x7f2854031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=241dd1a0b2e4623d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f2849ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f2849ffb640 1 -- 172.21.15.12:0/3687264541 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854035040 con 0x5653033c15d0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f2849ffb640 1 -- 172.21.15.12:0/3687264541 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8687+0+0 (secure 0 0 0) 0x7f2854031e00 con 0x5653033c15d0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f286ac28740 1 -- 172.21.15.12:0/3687264541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f285c0288f0 con 0x5653033c15d0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.388+0000 7f2849ffb640 1 -- 172.21.15.12:0/3687264541 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f2854062050 con 0x5653033c15d0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f286ac28740 10 client.28543 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f286ac28740 1 -- 172.21.15.12:0/3687264541 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5653034467c0 con 0x5653033c15d0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f2849ffb640 1 -- 172.21.15.12:0/3687264541 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f285c0288f0 con 0x5653033c15d0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f2849ffb640 1 -- 172.21.15.12:0/3687264541 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f285403c6e0 con 0x5653033c15d0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f286ac28740 10 client.28543 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f286ac28740 10 client.28543 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f286ac28740 20 client.28543 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f286ac28740 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x565303446b00 0x565303448ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f286ac28740 4 client.28543 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f286ac28740 1 -- 172.21.15.12:0/3687264541 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56530332ed70 con 0x565303446b00 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.389+0000 7f285bfff640 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x565303446b00 0x565303448ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f2849ffb640 10 client.28543 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f285bfff640 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x565303446b00 0x565303448ef0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b5e2d04d242a6504 server_cookie=fbfdb327aa07162e in_seq=0 out_seq=0 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f2849ffb640 1 -- 172.21.15.12:0/3687264541 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56530332ed70 con 0x565303446b00 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f2849ffb640 10 client.28543 handle_command_reply: tid=0 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 client.28543 shutdown 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 -- 172.21.15.12:0/3687264541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c15d0 msgr2=0x5653033d4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c15d0 0x5653033d4780 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2854005c40 tx=0x7f2854031400 comp rx=0 tx=0).stop 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 -- 172.21.15.12:0/3687264541 shutdown_connections 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x565303446b00 0x565303448ef0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5653033cc370 0x5653033c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5653033c2b40 0x5653033d4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 --2- 172.21.15.12:0/3687264541 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5653033c15d0 0x5653033d4780 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 -- 172.21.15.12:0/3687264541 >> 172.21.15.12:0/3687264541 conn(0x56530338a310 msgr2=0x5653033c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f2849ffb640 0 client.28543 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:54:07.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 -- 172.21.15.12:0/3687264541 shutdown_connections 2024-09-19T06:54:07.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 1 -- 172.21.15.12:0/3687264541 wait complete. 2024-09-19T06:54:07.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.390+0000 7f286ac28740 20 client.28543 trim_cache size 0 max 16384 2024-09-19T06:54:07.397 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:54:07.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 -- 172.21.15.12:0/1953256886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f28500a33b0 msgr2=0x7f28500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f28500a33b0 0x7f28500a5870 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f285c005fd0 tx=0x7f285c009600 comp rx=0 tx=0).stop 2024-09-19T06:54:07.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 -- 172.21.15.12:0/1953256886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2864101410 msgr2=0x7f2864102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2864101410 0x7f2864102b80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f284c00d950 tx=0x7f284c00de10 comp rx=0 tx=0).stop 2024-09-19T06:54:07.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 -- 172.21.15.12:0/1953256886 shutdown_connections 2024-09-19T06:54:07.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f28500a33b0 0x7f28500a5870 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2864106a70 0x7f28641030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2864101410 0x7f2864102b80 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 --2- 172.21.15.12:0/1953256886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2864100a70 0x7f2864102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 -- 172.21.15.12:0/1953256886 >> 172.21.15.12:0/1953256886 conn(0x7f28640fc790 msgr2=0x7f2864104820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 -- 172.21.15.12:0/1953256886 shutdown_connections 2024-09-19T06:54:07.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:07.391+0000 7f286884f640 1 -- 172.21.15.12:0/1953256886 wait complete. 2024-09-19T06:54:07.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:07 smithi012 ceph-mon[30937]: pgmap v436: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.0 MiB/s wr, 698 op/s 2024-09-19T06:54:07.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:07 smithi016 ceph-mon[34911]: pgmap v436: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.0 MiB/s wr, 698 op/s 2024-09-19T06:54:07.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:07 smithi173 ceph-mon[35349]: pgmap v436: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.0 MiB/s wr, 698 op/s 2024-09-19T06:54:08.124 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:54:08.403 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.099+0000 7f61c207b640 1 -- 172.21.15.12:0/885562356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61bc101290 msgr2=0x7f61bc10df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.099+0000 7f61c207b640 1 --2- 172.21.15.12:0/885562356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61bc101290 0x7f61bc10df50 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009900 tx=0x7f61b002a410 comp rx=0 tx=0).stop 2024-09-19T06:54:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.099+0000 7f61c207b640 1 -- 172.21.15.12:0/885562356 shutdown_connections 2024-09-19T06:54:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.099+0000 7f61c207b640 1 --2- 172.21.15.12:0/885562356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61bc10e490 0x7f61bc110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.099+0000 7f61c207b640 1 --2- 172.21.15.12:0/885562356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61bc101290 0x7f61bc10df50 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.099+0000 7f61c207b640 1 --2- 172.21.15.12:0/885562356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61bc1008e0 0x7f61bc100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.099+0000 7f61c207b640 1 -- 172.21.15.12:0/885562356 >> 172.21.15.12:0/885562356 conn(0x7f61bc0fc7d0 msgr2=0x7f61bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.099+0000 7f61c207b640 1 -- 172.21.15.12:0/885562356 shutdown_connections 2024-09-19T06:54:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.099+0000 7f61c207b640 1 -- 172.21.15.12:0/885562356 wait complete. 2024-09-19T06:54:09.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.100+0000 7f61c207b640 1 Processor -- start 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.100+0000 7f61c207b640 1 -- start start 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.100+0000 7f61c207b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61bc1008e0 0x7f61bc19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.100+0000 7f61c207b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61bc101290 0x7f61bc19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.100+0000 7f61c207b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61bc10e490 0x7f61bc19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.100+0000 7f61c207b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc1141b0 con 0x7f61bc10e490 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.100+0000 7f61c207b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc114030 con 0x7f61bc1008e0 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.100+0000 7f61c207b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc114330 con 0x7f61bc101290 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61bb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61bc1008e0 0x7f61bc19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61bc10e490 0x7f61bc19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61bb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61bc1008e0 0x7f61bc19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56334/0 (socket says 172.21.15.12:56334) 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61bb7fe640 1 -- 172.21.15.12:0/3234762197 learned_addr learned my addr 172.21.15.12:0/3234762197 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:09.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61baffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61bc101290 0x7f61bc19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61bb7fe640 1 -- 172.21.15.12:0/3234762197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61bc101290 msgr2=0x7f61bc19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61bc101290 0x7f61bc19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61bb7fe640 1 -- 172.21.15.12:0/3234762197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61bc10e490 msgr2=0x7f61bc19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61bc10e490 0x7f61bc19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61bb7fe640 1 -- 172.21.15.12:0/3234762197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc19f6a0 con 0x7f61bc1008e0 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61bc1008e0 0x7f61bc19a6f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00e9f0 tx=0x7f61ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61b8ff9640 1 -- 172.21.15.12:0/3234762197 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac00cd80 con 0x7f61bc1008e0 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61b8ff9640 1 -- 172.21.15.12:0/3234762197 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61ac010910 con 0x7f61bc1008e0 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61c207b640 1 -- 172.21.15.12:0/3234762197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61bc19f990 con 0x7f61bc1008e0 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.101+0000 7f61b8ff9640 1 -- 172.21.15.12:0/3234762197 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac018990 con 0x7f61bc1008e0 2024-09-19T06:54:09.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.102+0000 7f61c207b640 1 -- 172.21.15.12:0/3234762197 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61bc1a7270 con 0x7f61bc1008e0 2024-09-19T06:54:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.105+0000 7f61b8ff9640 1 -- 172.21.15.12:0/3234762197 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f61ac018b30 con 0x7f61bc1008e0 2024-09-19T06:54:09.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.105+0000 7f61c4454740 1 Processor -- start 2024-09-19T06:54:09.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.105+0000 7f61c4454740 1 -- start start 2024-09-19T06:54:09.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.105+0000 7f61c4454740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56158033bb40 0x56158033a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.105+0000 7f61c4454740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 0x56158033aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.105+0000 7f61c4454740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561580345370 0x561580347760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61c4454740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5615802a02f0 con 0x56158033bb40 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61c4454740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561580247cf0 con 0x561580345370 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61c4454740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56158029c2b0 con 0x56158033a5d0 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56158033bb40 0x56158033a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56158033bb40 0x56158033a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40430/0 (socket says 172.21.15.12:40430) 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61bbfff640 1 -- 172.21.15.12:0/3553190706 learned_addr learned my addr 172.21.15.12:0/3553190706 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61b8ff9640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f61a40a3430 0x7f61a40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61baffd640 1 --2- 172.21.15.12:0/3553190706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561580345370 0x561580347760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61b8ff9640 1 -- 172.21.15.12:0/3234762197 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7f61ac0d00e0 con 0x7f61bc1008e0 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61bbfff640 1 -- 172.21.15.12:0/3553190706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 msgr2=0x56158033aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:54:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/3553190706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 0x56158033aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61bbfff640 1 --2- 172.21.15.12:0/3553190706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 0x56158033aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61bbfff640 1 -- 172.21.15.12:0/3553190706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561580345370 msgr2=0x561580347760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61bbfff640 1 --2- 172.21.15.12:0/3553190706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561580345370 0x561580347760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61bbfff640 1 -- 172.21.15.12:0/3553190706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56158022c3a0 con 0x56158033bb40 2024-09-19T06:54:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.106+0000 7f61bbfff640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f61a40a3430 0x7f61a40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.107+0000 7f61bbfff640 1 --2- 172.21.15.12:0/3553190706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56158033bb40 0x56158033a090 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f61b4011470 tx=0x7f61b4011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0633811a262e1dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.107+0000 7f61baffd640 1 --2- 172.21.15.12:0/3553190706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561580345370 0x561580347760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.107+0000 7f61a1ffb640 1 -- 172.21.15.12:0/3553190706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4017070 con 0x56158033bb40 2024-09-19T06:54:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.107+0000 7f61a1ffb640 1 -- 172.21.15.12:0/3553190706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61b400fc20 con 0x56158033bb40 2024-09-19T06:54:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.107+0000 7f61bbfff640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f61a40a3430 0x7f61a40a58f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f61b4023000 tx=0x7f61b4024000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61a1ffb640 1 -- 172.21.15.12:0/3553190706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b401ca50 con 0x56158033bb40 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61c4454740 1 -- 172.21.15.12:0/3553190706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56158033bb40 msgr2=0x56158033a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61c4454740 1 --2- 172.21.15.12:0/3553190706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56158033bb40 0x56158033a090 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f61b4011470 tx=0x7f61b4011930 comp rx=0 tx=0).stop 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61c4454740 1 -- 172.21.15.12:0/3553190706 shutdown_connections 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61c4454740 1 --2- 172.21.15.12:0/3553190706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561580345370 0x561580347760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61c4454740 1 --2- 172.21.15.12:0/3553190706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 0x56158033aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61c4454740 1 --2- 172.21.15.12:0/3553190706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56158033bb40 0x56158033a090 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61c4454740 1 -- 172.21.15.12:0/3553190706 >> 172.21.15.12:0/3553190706 conn(0x561580303310 msgr2=0x561580336c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61c4454740 1 -- 172.21.15.12:0/3553190706 shutdown_connections 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61c4454740 1 -- 172.21.15.12:0/3553190706 wait complete. 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.108+0000 7f61c4454740 1 -- start start 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61c4454740 1 Processor -- start 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61c4454740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580344c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61c4454740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 0x561580341eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61c4454740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x5615803423f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61c4454740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561580348110 con 0x561580345370 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61c4454740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56158025b060 con 0x56158033a5d0 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61c4454740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561580348290 con 0x56158033bb40 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61c4454740 10 client.0 _ll_register_callbacks cb 0x56157ffae8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61bb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580344c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61bb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580344c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56354/0 (socket says 172.21.15.12:56354) 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61bb7fe640 1 -- 172.21.15.12:0/2063112485 learned_addr learned my addr 172.21.15.12:0/2063112485 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61bbfff640 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x5615803423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.109+0000 7f61baffd640 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 0x561580341eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f61bb7fe640 1 -- 172.21.15.12:0/2063112485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 msgr2=0x561580341eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 0x561580341eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f61bb7fe640 1 -- 172.21.15.12:0/2063112485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 msgr2=0x5615803423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x5615803423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f61bb7fe640 1 -- 172.21.15.12:0/2063112485 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615800113c0 con 0x56158033a5d0 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f61bbfff640 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x5615803423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580344c00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0cd7c0 tx=0x7f61ac09bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55d61a725f6d9b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f619affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f619affd640 1 -- 172.21.15.12:0/2063112485 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac09b7f0 con 0x56158033a5d0 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f619affd640 1 -- 172.21.15.12:0/2063112485 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7f61ac09b990 con 0x56158033a5d0 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.110+0000 7f61c4454740 1 -- 172.21.15.12:0/2063112485 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b400fc20 con 0x56158033a5d0 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f619affd640 1 -- 172.21.15.12:0/2063112485 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f61ac0b5120 con 0x56158033a5d0 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f61c4454740 10 client.28628 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f61c4454740 1 -- 172.21.15.12:0/2063112485 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x561580353b60 con 0x56158033a5d0 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f619affd640 1 -- 172.21.15.12:0/2063112485 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61b400fc20 con 0x56158033a5d0 2024-09-19T06:54:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f619affd640 1 -- 172.21.15.12:0/2063112485 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f61ac0bc070 con 0x56158033a5d0 2024-09-19T06:54:09.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f61c4454740 10 client.28628 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:09.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f61c4454740 10 client.28628 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:54:09.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f61c4454740 20 client.28628 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:09.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f61c4454740 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561580355010 0x561580357480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f61c4454740 4 client.28628 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:09.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f61c4454740 1 -- 172.21.15.12:0/2063112485 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615802ad860 con 0x561580355010 2024-09-19T06:54:09.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.111+0000 7f61baffd640 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561580355010 0x561580357480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.112+0000 7f61baffd640 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561580355010 0x561580357480 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8153641c0e57944b server_cookie=8b7b183f4eff99d3 in_seq=0 out_seq=0 2024-09-19T06:54:09.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.112+0000 7f619affd640 10 client.28628 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:54:09.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.112+0000 7f619affd640 1 -- 172.21.15.12:0/2063112485 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615802ad860 con 0x561580355010 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.112+0000 7f619affd640 10 client.28628 handle_command_reply: tid=0 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 client.28628 shutdown 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 -- 172.21.15.12:0/2063112485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 msgr2=0x561580344c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580344c00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0cd7c0 tx=0x7f61ac09bdf0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 -- 172.21.15.12:0/2063112485 shutdown_connections 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x561580355010 0x561580357480 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x5615803423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 0x561580341eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 --2- 172.21.15.12:0/2063112485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580344c00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f619affd640 0 client.28628 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 -- 172.21.15.12:0/2063112485 >> 172.21.15.12:0/2063112485 conn(0x561580303310 msgr2=0x56158033c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 -- 172.21.15.12:0/2063112485 shutdown_connections 2024-09-19T06:54:09.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 1 -- 172.21.15.12:0/2063112485 wait complete. 2024-09-19T06:54:09.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.113+0000 7f61c4454740 20 client.28628 trim_cache size 0 max 16384 2024-09-19T06:54:09.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61c4454740 1 Processor -- start 2024-09-19T06:54:09.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61c4454740 1 -- start start 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61c4454740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 0x561580335c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61c4454740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033bb40 0x561580336150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61c4454740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x56158033d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61c4454740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc1afe00 con 0x561580345370 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61c4454740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc1b1a00 con 0x56158033bb40 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61c4454740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc1b04d0 con 0x56158033a5d0 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x56158033d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x56158033d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40448/0 (socket says 172.21.15.12:40448) 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61bbfff640 1 -- 172.21.15.12:0/2571429862 learned_addr learned my addr 172.21.15.12:0/2571429862 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 0x561580335c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.128+0000 7f61baffd640 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033bb40 0x561580336150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61baffd640 1 -- 172.21.15.12:0/2571429862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 msgr2=0x561580335c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61baffd640 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 0x561580335c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61baffd640 1 -- 172.21.15.12:0/2571429862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 msgr2=0x56158033d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61baffd640 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x56158033d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61baffd640 1 -- 172.21.15.12:0/2571429862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561580335310 con 0x56158033bb40 2024-09-19T06:54:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61bbfff640 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x56158033d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 0x561580335c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61baffd640 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033bb40 0x561580336150 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f61b0005940 tx=0x7f61b0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73773674615519dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61a17fa640 1 -- 172.21.15.12:0/2571429862 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0035040 con 0x56158033bb40 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61a17fa640 1 -- 172.21.15.12:0/2571429862 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61b0005500 con 0x56158033bb40 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.129+0000 7f61a17fa640 1 -- 172.21.15.12:0/2571429862 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0004c00 con 0x56158033bb40 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.130+0000 7f61c4454740 1 -- 172.21.15.12:0/2571429862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033bb40 msgr2=0x561580336150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.130+0000 7f61c4454740 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033bb40 0x561580336150 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f61b0005940 tx=0x7f61b0000bc0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.130+0000 7f61c4454740 1 -- 172.21.15.12:0/2571429862 shutdown_connections 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.130+0000 7f61c4454740 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x56158033d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.130+0000 7f61c4454740 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033bb40 0x561580336150 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.130+0000 7f61c4454740 1 --2- 172.21.15.12:0/2571429862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033a5d0 0x561580335c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.130+0000 7f61c4454740 1 -- 172.21.15.12:0/2571429862 >> 172.21.15.12:0/2571429862 conn(0x561580303310 msgr2=0x561580335500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.131+0000 7f61c4454740 1 -- 172.21.15.12:0/2571429862 shutdown_connections 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.131+0000 7f61c4454740 1 -- 172.21.15.12:0/2571429862 wait complete. 2024-09-19T06:54:09.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.131+0000 7f61c4454740 1 -- start start 2024-09-19T06:54:09.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.131+0000 7f61c4454740 1 Processor -- start 2024-09-19T06:54:09.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61c4454740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580349390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61c4454740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 0x5615803498d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61c4454740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x561580349e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61c4454740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc1b1330 con 0x561580345370 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61c4454740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc1b0ba0 con 0x56158033a5d0 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61c4454740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc1ade00 con 0x56158033bb40 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61c4454740 10 client.0 _ll_register_callbacks cb 0x7f61ac00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61baffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 0x5615803498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61bb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580349390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61baffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 0x5615803498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43846/0 (socket says 172.21.15.12:43846) 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61baffd640 1 -- 172.21.15.12:0/3865396089 learned_addr learned my addr 172.21.15.12:0/3865396089 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61bb7fe640 1 -- 172.21.15.12:0/3865396089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 msgr2=0x5615803498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61bbfff640 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x561580349e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 0x5615803498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.132+0000 7f61bb7fe640 1 -- 172.21.15.12:0/3865396089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 msgr2=0x561580349e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.133+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x561580349e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.133+0000 7f61bb7fe640 1 -- 172.21.15.12:0/3865396089 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615803371a0 con 0x56158033a5d0 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.133+0000 7f61bbfff640 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x561580349e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.133+0000 7f61bb7fe640 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580349390 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f61ac09a650 tx=0x7f61ac00c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51524e8b1ffd2f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.133+0000 7f619affd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.133+0000 7f619affd640 1 -- 172.21.15.12:0/3865396089 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac098640 con 0x56158033a5d0 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.133+0000 7f619affd640 1 -- 172.21.15.12:0/3865396089 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7f61ac09b7f0 con 0x56158033a5d0 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.133+0000 7f61c4454740 1 -- 172.21.15.12:0/3865396089 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b0005500 con 0x56158033a5d0 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.133+0000 7f619affd640 1 -- 172.21.15.12:0/3865396089 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f61ac09bee0 con 0x56158033a5d0 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.134+0000 7f61c4454740 10 client.28634 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:09.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.134+0000 7f61c4454740 1 -- 172.21.15.12:0/3865396089 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5615803bfee0 con 0x56158033a5d0 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.134+0000 7f619affd640 1 -- 172.21.15.12:0/3865396089 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61b0005500 con 0x56158033a5d0 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.134+0000 7f619affd640 1 -- 172.21.15.12:0/3865396089 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f61ac09b260 con 0x56158033a5d0 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.134+0000 7f61c4454740 10 client.28634 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.134+0000 7f61c4454740 10 client.28634 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.134+0000 7f61c4454740 20 client.28634 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.134+0000 7f61c4454740 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5615803c0660 0x5615803c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.134+0000 7f61c4454740 4 client.28634 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.134+0000 7f61c4454740 1 -- 172.21.15.12:0/3865396089 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5615802a7d70 con 0x5615803c0660 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.135+0000 7f61baffd640 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5615803c0660 0x5615803c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.135+0000 7f619affd640 10 client.28634 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.135+0000 7f61baffd640 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5615803c0660 0x5615803c2aa0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=78de070a0dc9eb1d server_cookie=abe3ed3a524a3feb in_seq=0 out_seq=0 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f619affd640 1 -- 172.21.15.12:0/3865396089 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5615802a7d70 con 0x5615803c0660 2024-09-19T06:54:09.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f619affd640 10 client.28634 handle_command_reply: tid=0 2024-09-19T06:54:09.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 client.28634 shutdown 2024-09-19T06:54:09.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 -- 172.21.15.12:0/3865396089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 msgr2=0x561580349390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580349390 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f61ac09a650 tx=0x7f61ac00c840 comp rx=0 tx=0).stop 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 -- 172.21.15.12:0/3865396089 shutdown_connections 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5615803c0660 0x5615803c2aa0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561580345370 0x561580349e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56158033bb40 0x5615803498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 --2- 172.21.15.12:0/3865396089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56158033a5d0 0x561580349390 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 -- 172.21.15.12:0/3865396089 >> 172.21.15.12:0/3865396089 conn(0x561580303310 msgr2=0x561580335d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f619affd640 0 client.28634 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 -- 172.21.15.12:0/3865396089 shutdown_connections 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.136+0000 7f61c4454740 1 -- 172.21.15.12:0/3865396089 wait complete. 2024-09-19T06:54:09.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.137+0000 7f61c4454740 20 client.28634 trim_cache size 0 max 16384 2024-09-19T06:54:09.142 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:54:09.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 -- 172.21.15.12:0/3234762197 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f61a40a3430 msgr2=0x7f61a40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f61a40a3430 0x7f61a40a58f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f61b4023000 tx=0x7f61b4024000 comp rx=0 tx=0).stop 2024-09-19T06:54:09.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 -- 172.21.15.12:0/3234762197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61bc1008e0 msgr2=0x7f61bc19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61bc1008e0 0x7f61bc19a6f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00e9f0 tx=0x7f61ac00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 -- 172.21.15.12:0/3234762197 shutdown_connections 2024-09-19T06:54:09.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61bc10e490 0x7f61bc19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f61a40a3430 0x7f61a40a58f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61bc101290 0x7f61bc19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 --2- 172.21.15.12:0/3234762197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61bc1008e0 0x7f61bc19a6f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 -- 172.21.15.12:0/3234762197 >> 172.21.15.12:0/3234762197 conn(0x7f61bc0fc7d0 msgr2=0x7f61bc10f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 -- 172.21.15.12:0/3234762197 shutdown_connections 2024-09-19T06:54:09.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:09.138+0000 7f61c207b640 1 -- 172.21.15.12:0/3234762197 wait complete. 2024-09-19T06:54:09.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.167+0000 7fe55a8d0640 1 -- 172.21.15.12:0/3102497582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe554101ad0 msgr2=0x7fe554101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.167+0000 7fe55a8d0640 1 --2- 172.21.15.12:0/3102497582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe554101ad0 0x7fe554101f30 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe548009930 tx=0x7fe54802a420 comp rx=0 tx=0).stop 2024-09-19T06:54:09.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.167+0000 7fe55a8d0640 1 -- 172.21.15.12:0/3102497582 shutdown_connections 2024-09-19T06:54:09.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.167+0000 7fe55a8d0640 1 --2- 172.21.15.12:0/3102497582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe554102470 0x7fe55410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.167+0000 7fe55a8d0640 1 --2- 172.21.15.12:0/3102497582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe554101ad0 0x7fe554101f30 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.167+0000 7fe55a8d0640 1 --2- 172.21.15.12:0/3102497582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe554107b70 0x7fe554107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.167+0000 7fe55a8d0640 1 -- 172.21.15.12:0/3102497582 >> 172.21.15.12:0/3102497582 conn(0x7fe5540fd7b0 msgr2=0x7fe5540ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.167+0000 7fe55a8d0640 1 -- 172.21.15.12:0/3102497582 shutdown_connections 2024-09-19T06:54:09.169 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.167+0000 7fe55a8d0640 1 -- 172.21.15.12:0/3102497582 wait complete. 2024-09-19T06:54:09.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.168+0000 7fe55a8d0640 1 Processor -- start 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.168+0000 7fe55a8d0640 1 -- start start 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.168+0000 7fe55a8d0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe554101ad0 0x7fe5541983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe55a8d0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe554102470 0x7fe554198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe55a8d0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe554107b70 0x7fe55419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe553fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe554101ad0 0x7fe5541983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe553fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe554101ad0 0x7fe5541983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43862/0 (socket says 172.21.15.12:43862) 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe5537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe554102470 0x7fe554198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe5537fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe554102470 0x7fe554198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40474/0 (socket says 172.21.15.12:40474) 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe553fff640 1 -- 172.21.15.12:0/678173510 learned_addr learned my addr 172.21.15.12:0/678173510 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe554111f20 con 0x7fe554102470 2024-09-19T06:54:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe554111da0 con 0x7fe554107b70 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe5541120a0 con 0x7fe554101ad0 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe558e6d640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe554107b70 0x7fe55419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe553fff640 1 -- 172.21.15.12:0/678173510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe554107b70 msgr2=0x7fe55419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe553fff640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe554107b70 0x7fe55419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe553fff640 1 -- 172.21.15.12:0/678173510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe554102470 msgr2=0x7fe554198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe553fff640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe554102470 0x7fe554198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.169+0000 7fe553fff640 1 -- 172.21.15.12:0/678173510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55419d3e0 con 0x7fe554101ad0 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.170+0000 7fe553fff640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe554101ad0 0x7fe5541983f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe54400e9f0 tx=0x7fe54400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.170+0000 7fe5517fa640 1 -- 172.21.15.12:0/678173510 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54400ccc0 con 0x7fe554101ad0 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.170+0000 7fe5517fa640 1 -- 172.21.15.12:0/678173510 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe54400ce60 con 0x7fe554101ad0 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.170+0000 7fe5517fa640 1 -- 172.21.15.12:0/678173510 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544010690 con 0x7fe554101ad0 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.170+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55419d6d0 con 0x7fe554101ad0 2024-09-19T06:54:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.170+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5541a4f60 con 0x7fe554101ad0 2024-09-19T06:54:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.174+0000 7fe5517fa640 1 -- 172.21.15.12:0/678173510 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe5440046c0 con 0x7fe554101ad0 2024-09-19T06:54:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.174+0000 7fe55d66b740 1 Processor -- start 2024-09-19T06:54:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.174+0000 7fe55d66b740 1 -- start start 2024-09-19T06:54:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.174+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008fa8cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.174+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8d2b0 0x56008fa9bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.174+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 0x56008fa9e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.174+0000 7fe55d66b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56008f9f12f0 con 0x56008fa8d2b0 2024-09-19T06:54:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.174+0000 7fe55d66b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56008f999270 con 0x56008fa8c990 2024-09-19T06:54:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.174+0000 7fe55d66b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56008f9ed2b0 con 0x56008fa9c0c0 2024-09-19T06:54:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe553fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8d2b0 0x56008fa9bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe558e6d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008fa8cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe5537fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 0x56008fa9e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe553fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8d2b0 0x56008fa9bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40478/0 (socket says 172.21.15.12:40478) 2024-09-19T06:54:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe553fff640 1 -- 172.21.15.12:0/2443127607 learned_addr learned my addr 172.21.15.12:0/2443127607 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe5517fa640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe53c0a34e0 0x7fe53c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe5537fe640 1 -- 172.21.15.12:0/2443127607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 msgr2=0x56008fa8cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe5537fe640 1 --2- 172.21.15.12:0/2443127607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008fa8cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe5537fe640 1 -- 172.21.15.12:0/2443127607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8d2b0 msgr2=0x56008fa9bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe5537fe640 1 --2- 172.21.15.12:0/2443127607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8d2b0 0x56008fa9bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe5537fe640 1 -- 172.21.15.12:0/2443127607 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008f998340 con 0x56008fa9c0c0 2024-09-19T06:54:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe558e6d640 1 --2- 172.21.15.12:0/2443127607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008fa8cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe5517fa640 1 -- 172.21.15.12:0/678173510 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7fe5440d0140 con 0x7fe554101ad0 2024-09-19T06:54:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe558e6d640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe53c0a34e0 0x7fe53c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.175+0000 7fe5537fe640 1 --2- 172.21.15.12:0/2443127607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 0x56008fa9e4b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe548005940 tx=0x7fe548005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56124d233ec4d5a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.176+0000 7fe53a7fc640 1 -- 172.21.15.12:0/2443127607 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548040070 con 0x56008fa9c0c0 2024-09-19T06:54:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.176+0000 7fe53a7fc640 1 -- 172.21.15.12:0/2443127607 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe548031870 con 0x56008fa9c0c0 2024-09-19T06:54:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.176+0000 7fe53a7fc640 1 -- 172.21.15.12:0/2443127607 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548035040 con 0x56008fa9c0c0 2024-09-19T06:54:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe55d66b740 1 -- 172.21.15.12:0/2443127607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 msgr2=0x56008fa9e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe55d66b740 1 --2- 172.21.15.12:0/2443127607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 0x56008fa9e4b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe548005940 tx=0x7fe548005bd0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe558e6d640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe53c0a34e0 0x7fe53c0a59a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe54c005fd0 tx=0x7fe54c004ab0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe55d66b740 1 -- 172.21.15.12:0/2443127607 shutdown_connections 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe55d66b740 1 --2- 172.21.15.12:0/2443127607 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 0x56008fa9e4b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe55d66b740 1 --2- 172.21.15.12:0/2443127607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8d2b0 0x56008fa9bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe55d66b740 1 --2- 172.21.15.12:0/2443127607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008fa8cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe55d66b740 1 -- 172.21.15.12:0/2443127607 >> 172.21.15.12:0/2443127607 conn(0x56008fa89060 msgr2=0x56008fa89440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe55d66b740 1 -- 172.21.15.12:0/2443127607 shutdown_connections 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe55d66b740 1 -- 172.21.15.12:0/2443127607 wait complete. 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.177+0000 7fe55d66b740 1 -- start start 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.178+0000 7fe55d66b740 1 Processor -- start 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.178+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8c990 0x56008fa95260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8d2b0 0x56008fa957a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe553fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8c990 0x56008fa95260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe553fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8c990 0x56008fa95260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40492/0 (socket says 172.21.15.12:40492) 2024-09-19T06:54:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe553fff640 1 -- 172.21.15.12:0/680184709 learned_addr learned my addr 172.21.15.12:0/680184709 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe55d66b740 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 0x56008fa99af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56008fa8f8f0 con 0x56008fa8c990 2024-09-19T06:54:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe5537fe640 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8d2b0 0x56008fa957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56008f97a290 con 0x56008fa8d2b0 2024-09-19T06:54:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56008fa8fa70 con 0x56008fa9c0c0 2024-09-19T06:54:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe558e6d640 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 0x56008fa99af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.179+0000 7fe55d66b740 10 client.0 _ll_register_callbacks cb 0x56008f9ab140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe558e6d640 1 -- 172.21.15.12:0/680184709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8d2b0 msgr2=0x56008fa957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe558e6d640 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8d2b0 0x56008fa957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe558e6d640 1 -- 172.21.15.12:0/680184709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8c990 msgr2=0x56008fa95260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe558e6d640 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8c990 0x56008fa95260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe558e6d640 1 -- 172.21.15.12:0/680184709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008f704210 con 0x56008fa9c0c0 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe558e6d640 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 0x56008fa99af0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00ff00 tx=0x7fe54c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179a3662bc6b0a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe5337fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe5337fe640 1 -- 172.21.15.12:0/680184709 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c02e060 con 0x56008fa9c0c0 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe548031870 con 0x56008fa9c0c0 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe5337fe640 1 -- 172.21.15.12:0/680184709 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7fe54c029410 con 0x56008fa9c0c0 2024-09-19T06:54:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe5337fe640 1 -- 172.21.15.12:0/680184709 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe54c035050 con 0x56008fa9c0c0 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe55d66b740 10 client.28570 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.180+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56008f7d0620 con 0x56008fa9c0c0 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.181+0000 7fe5337fe640 1 -- 172.21.15.12:0/680184709 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe54c029af0 con 0x56008fa9c0c0 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.181+0000 7fe5337fe640 1 -- 172.21.15.12:0/680184709 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fe54c01e870 con 0x56008fa9c0c0 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.181+0000 7fe55d66b740 10 client.28570 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.181+0000 7fe55d66b740 10 client.28570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.181+0000 7fe55d66b740 20 client.28570 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.181+0000 7fe55d66b740 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56008fab04f0 0x56008fab28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.181+0000 7fe55d66b740 4 client.28570 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.181+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe548031870 con 0x56008fab04f0 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.182+0000 7fe553fff640 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56008fab04f0 0x56008fab28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.182+0000 7fe5337fe640 10 client.28570 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.182+0000 7fe553fff640 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56008fab04f0 0x56008fab28e0 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f68ee4756439f982 server_cookie=4a70dec8c6a25269 in_seq=0 out_seq=0 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe5337fe640 1 -- 172.21.15.12:0/680184709 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe548031870 con 0x56008fab04f0 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe5337fe640 10 client.28570 handle_command_reply: tid=0 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 client.28570 shutdown 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 msgr2=0x56008fa99af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 0x56008fa99af0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00ff00 tx=0x7fe54c004a40 comp rx=0 tx=0).stop 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 shutdown_connections 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56008fab04f0 0x56008fab28e0 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa9c0c0 0x56008fa99af0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8d2b0 0x56008fa957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 --2- 172.21.15.12:0/680184709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa8c990 0x56008fa95260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 >> 172.21.15.12:0/680184709 conn(0x56008fa89060 msgr2=0x56008fa8ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe5337fe640 0 client.28570 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 shutdown_connections 2024-09-19T06:54:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 1 -- 172.21.15.12:0/680184709 wait complete. 2024-09-19T06:54:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.183+0000 7fe55d66b740 20 client.28570 trim_cache size 0 max 16384 2024-09-19T06:54:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.201+0000 7fe55d66b740 1 Processor -- start 2024-09-19T06:54:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.201+0000 7fe55d66b740 1 -- start start 2024-09-19T06:54:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.201+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008fa99ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.201+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa8d2b0 0x56008fab81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.201+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008fab86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.201+0000 7fe55d66b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe5541ab950 con 0x56008fa9c0c0 2024-09-19T06:54:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe553fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008fa99ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe55d66b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe5541ad550 con 0x56008fa8c990 2024-09-19T06:54:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe553fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008fa99ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56444/0 (socket says 172.21.15.12:56444) 2024-09-19T06:54:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe553fff640 1 -- 172.21.15.12:0/3521930523 learned_addr learned my addr 172.21.15.12:0/3521930523 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe558e6d640 1 --2- 172.21.15.12:0/3521930523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008fab86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe55d66b740 1 -- 172.21.15.12:0/3521930523 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe5541ac020 con 0x56008fa8d2b0 2024-09-19T06:54:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe5537fe640 1 --2- 172.21.15.12:0/3521930523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa8d2b0 0x56008fab81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe558e6d640 1 -- 172.21.15.12:0/3521930523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa8d2b0 msgr2=0x56008fab81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe558e6d640 1 --2- 172.21.15.12:0/3521930523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa8d2b0 0x56008fab81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe558e6d640 1 -- 172.21.15.12:0/3521930523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 msgr2=0x56008fa99ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe558e6d640 1 --2- 172.21.15.12:0/3521930523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008fa99ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe558e6d640 1 -- 172.21.15.12:0/3521930523 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008faaf0e0 con 0x56008fa9c0c0 2024-09-19T06:54:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe558e6d640 1 --2- 172.21.15.12:0/3521930523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008fab86e0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe54c000f80 tx=0x7fe54c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581f97b4a3c4da50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe539ffb640 1 -- 172.21.15.12:0/3521930523 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c01a040 con 0x56008fa9c0c0 2024-09-19T06:54:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe539ffb640 1 -- 172.21.15.12:0/3521930523 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe54c00fcf0 con 0x56008fa9c0c0 2024-09-19T06:54:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.202+0000 7fe539ffb640 1 -- 172.21.15.12:0/3521930523 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c004430 con 0x56008fa9c0c0 2024-09-19T06:54:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.203+0000 7fe55d66b740 1 -- 172.21.15.12:0/3521930523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 msgr2=0x56008fab86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.203+0000 7fe55d66b740 1 --2- 172.21.15.12:0/3521930523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008fab86e0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe54c000f80 tx=0x7fe54c005bd0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.203+0000 7fe55d66b740 1 -- 172.21.15.12:0/3521930523 shutdown_connections 2024-09-19T06:54:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.203+0000 7fe55d66b740 1 --2- 172.21.15.12:0/3521930523 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008fab86e0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.203+0000 7fe55d66b740 1 --2- 172.21.15.12:0/3521930523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa8d2b0 0x56008fab81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.203+0000 7fe55d66b740 1 --2- 172.21.15.12:0/3521930523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008fa99ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.203+0000 7fe55d66b740 1 -- 172.21.15.12:0/3521930523 >> 172.21.15.12:0/3521930523 conn(0x56008fa89060 msgr2=0x56008fa881c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.203+0000 7fe55d66b740 1 -- 172.21.15.12:0/3521930523 shutdown_connections 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.203+0000 7fe55d66b740 1 -- 172.21.15.12:0/3521930523 wait complete. 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe55d66b740 1 -- start start 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe55d66b740 1 Processor -- start 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008faa8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa8d2b0 0x56008faa8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe55d66b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008faa8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe55d66b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe5541ace80 con 0x56008fa9c0c0 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe55d66b740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe5541ac6f0 con 0x56008fa8c990 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe55d66b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe5541a9950 con 0x56008fa8d2b0 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe55d66b740 10 client.0 _ll_register_callbacks cb 0x7fe54c0115d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe558e6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008faa8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe558e6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008faa8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40506/0 (socket says 172.21.15.12:40506) 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe558e6d640 1 -- 172.21.15.12:0/2675457650 learned_addr learned my addr 172.21.15.12:0/2675457650 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe5537fe640 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa8d2b0 0x56008faa8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe553fff640 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008faa8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe558e6d640 1 -- 172.21.15.12:0/2675457650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa8d2b0 msgr2=0x56008faa8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe558e6d640 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa8d2b0 0x56008faa8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.204+0000 7fe558e6d640 1 -- 172.21.15.12:0/2675457650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 msgr2=0x56008faa8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.205+0000 7fe558e6d640 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008faa8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.205+0000 7fe558e6d640 1 -- 172.21.15.12:0/2675457650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008fb1a170 con 0x56008fa9c0c0 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.205+0000 7fe558e6d640 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008faa8fe0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0114e0 tx=0x7fe54c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e575fe3bb537ad34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.205+0000 7fe5337fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.205+0000 7fe5337fe640 1 -- 172.21.15.12:0/2675457650 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c01a040 con 0x56008fa9c0c0 2024-09-19T06:54:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.205+0000 7fe5337fe640 1 -- 172.21.15.12:0/2675457650 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7fe54c01e8c0 con 0x56008fa9c0c0 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.205+0000 7fe55d66b740 1 -- 172.21.15.12:0/2675457650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56008f9fea20 con 0x56008fa9c0c0 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.205+0000 7fe5337fe640 1 -- 172.21.15.12:0/2675457650 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe54c003f90 con 0x56008fa9c0c0 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.205+0000 7fe55d66b740 10 client.19341 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.205+0000 7fe55d66b740 1 -- 172.21.15.12:0/2675457650 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56008fb1b430 con 0x56008fa9c0c0 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.206+0000 7fe5337fe640 1 -- 172.21.15.12:0/2675457650 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56008f9fea20 con 0x56008fa9c0c0 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.206+0000 7fe5337fe640 1 -- 172.21.15.12:0/2675457650 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fe54c039830 con 0x56008fa9c0c0 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.206+0000 7fe55d66b740 10 client.19341 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.206+0000 7fe55d66b740 10 client.19341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.206+0000 7fe55d66b740 20 client.19341 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.206+0000 7fe55d66b740 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56008fb1ba30 0x56008fb1de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.206+0000 7fe55d66b740 4 client.19341 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:54:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.206+0000 7fe55d66b740 1 -- 172.21.15.12:0/2675457650 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56008f9f8d70 con 0x56008fb1ba30 2024-09-19T06:54:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.206+0000 7fe553fff640 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56008fb1ba30 0x56008fb1de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.207+0000 7fe5337fe640 10 client.19341 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.207+0000 7fe553fff640 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56008fb1ba30 0x56008fb1de20 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d95d10337439583 server_cookie=5a5de0a029167330 in_seq=0 out_seq=0 2024-09-19T06:54:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.218+0000 7fe5337fe640 1 -- 172.21.15.12:0/2675457650 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56008f9f8d70 con 0x56008fb1ba30 2024-09-19T06:54:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.218+0000 7fe5337fe640 10 client.19341 handle_command_reply: tid=0 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.218+0000 7fe55d66b740 1 client.19341 shutdown 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 1 -- 172.21.15.12:0/2675457650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 msgr2=0x56008faa8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008faa8fe0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0114e0 tx=0x7fe54c003ce0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 1 -- 172.21.15.12:0/2675457650 shutdown_connections 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56008fb1ba30 0x56008fb1de20 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56008fa9c0c0 0x56008faa8fe0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56008fa8d2b0 0x56008faa8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe5337fe640 0 client.19341 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 1 --2- 172.21.15.12:0/2675457650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56008fa8c990 0x56008faa8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 1 -- 172.21.15.12:0/2675457650 >> 172.21.15.12:0/2675457650 conn(0x56008fa89060 msgr2=0x56008fa8e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 1 -- 172.21.15.12:0/2675457650 shutdown_connections 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 1 -- 172.21.15.12:0/2675457650 wait complete. 2024-09-19T06:54:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.219+0000 7fe55d66b740 20 client.19341 trim_cache size 0 max 16384 2024-09-19T06:54:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:54:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:54:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:54:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:54:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe53c0a34e0 msgr2=0x7fe53c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe53c0a34e0 0x7fe53c0a59a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe54c005fd0 tx=0x7fe54c004ab0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe554101ad0 msgr2=0x7fe5541983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe554101ad0 0x7fe5541983f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe54400e9f0 tx=0x7fe54400edf0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 shutdown_connections 2024-09-19T06:54:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe554107b70 0x7fe55419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe554102470 0x7fe554198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fe53c0a34e0 0x7fe53c0a59a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 --2- 172.21.15.12:0/678173510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe554101ad0 0x7fe5541983f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 >> 172.21.15.12:0/678173510 conn(0x7fe5540fd7b0 msgr2=0x7fe5540fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 shutdown_connections 2024-09-19T06:54:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:09.220+0000 7fe55a8d0640 1 -- 172.21.15.12:0/678173510 wait complete. 2024-09-19T06:54:09.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:09 smithi016 ceph-mon[34911]: pgmap v437: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 4.3 MiB/s wr, 465 op/s 2024-09-19T06:54:09.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:09 smithi016 ceph-mon[34911]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T06:54:09.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:09 smithi173 ceph-mon[35349]: pgmap v437: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 4.3 MiB/s wr, 465 op/s 2024-09-19T06:54:09.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:09 smithi173 ceph-mon[35349]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T06:54:09.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:09 smithi012 ceph-mon[30937]: pgmap v437: 97 pgs: 97 active+clean; 4.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 4.3 MiB/s wr, 465 op/s 2024-09-19T06:54:09.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:09 smithi012 ceph-mon[30937]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T06:54:10.003 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:54:10.355 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 805.0 s, 239.2 tps, lat 378.294 ms stddev 239.192 2024-09-19T06:54:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.978+0000 7fa09b4a8640 1 -- 172.21.15.12:0/2587640375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094105ec0 msgr2=0x7fa094106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.978+0000 7fa09b4a8640 1 --2- 172.21.15.12:0/2587640375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094105ec0 0x7fa094106340 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009cd0 tx=0x7fa08c02a930 comp rx=0 tx=0).stop 2024-09-19T06:54:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.978+0000 7fa09b4a8640 1 -- 172.21.15.12:0/2587640375 shutdown_connections 2024-09-19T06:54:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.978+0000 7fa09b4a8640 1 --2- 172.21.15.12:0/2587640375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa094105ec0 0x7fa094106340 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.978+0000 7fa09b4a8640 1 --2- 172.21.15.12:0/2587640375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0941011e0 0x7fa094105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.978+0000 7fa09b4a8640 1 --2- 172.21.15.12:0/2587640375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0941008c0 0x7fa094100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.978+0000 7fa09b4a8640 1 -- 172.21.15.12:0/2587640375 >> 172.21.15.12:0/2587640375 conn(0x7fa0940fc7d0 msgr2=0x7fa0940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.979+0000 7fa09b4a8640 1 -- 172.21.15.12:0/2587640375 shutdown_connections 2024-09-19T06:54:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.981+0000 7fa09b4a8640 1 -- 172.21.15.12:0/2587640375 wait complete. 2024-09-19T06:54:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.982+0000 7fa09b4a8640 1 Processor -- start 2024-09-19T06:54:10.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.982+0000 7fa09b4a8640 1 -- start start 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.982+0000 7fa09b4a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0941008c0 0x7fa094114b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.982+0000 7fa09b4a8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0941011e0 0x7fa094115050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.982+0000 7fa09b4a8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa094105ec0 0x7fa09410dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.982+0000 7fa09b4a8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa094118690 con 0x7fa0941008c0 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.982+0000 7fa09b4a8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa094118510 con 0x7fa094105ec0 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.982+0000 7fa09b4a8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa094118810 con 0x7fa0941011e0 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.983+0000 7fa099244640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0941008c0 0x7fa094114b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.983+0000 7fa099244640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0941008c0 0x7fa094114b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50930/0 (socket says 172.21.15.12:50930) 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.983+0000 7fa099244640 1 -- 172.21.15.12:0/4171855870 learned_addr learned my addr 172.21.15.12:0/4171855870 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.983+0000 7fa099244640 1 -- 172.21.15.12:0/4171855870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0941011e0 msgr2=0x7fa094115050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.983+0000 7fa099244640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0941011e0 0x7fa094115050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.983+0000 7fa099244640 1 -- 172.21.15.12:0/4171855870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa094105ec0 msgr2=0x7fa09410dc00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:54:10.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.983+0000 7fa099244640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa094105ec0 0x7fa09410dc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.983+0000 7fa099244640 1 -- 172.21.15.12:0/4171855870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09410e4c0 con 0x7fa0941008c0 2024-09-19T06:54:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.984+0000 7fa099244640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0941008c0 0x7fa094114b10 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fa09000b4a0 tx=0x7fa09000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.984+0000 7fa08a7fc640 1 -- 172.21.15.12:0/4171855870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090014070 con 0x7fa0941008c0 2024-09-19T06:54:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.984+0000 7fa09b4a8640 1 -- 172.21.15.12:0/4171855870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09410e7b0 con 0x7fa0941008c0 2024-09-19T06:54:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.984+0000 7fa09b4a8640 1 -- 172.21.15.12:0/4171855870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa094112810 con 0x7fa0941008c0 2024-09-19T06:54:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.984+0000 7fa08a7fc640 1 -- 172.21.15.12:0/4171855870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa090010af0 con 0x7fa0941008c0 2024-09-19T06:54:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.984+0000 7fa08a7fc640 1 -- 172.21.15.12:0/4171855870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090017c70 con 0x7fa0941008c0 2024-09-19T06:54:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.988+0000 7fa09d881740 1 Processor -- start 2024-09-19T06:54:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.988+0000 7fa09d881740 1 -- start start 2024-09-19T06:54:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.988+0000 7fa09d881740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b8b40 0x555d958b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.988+0000 7fa09d881740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958b75d0 0x555d958b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.988+0000 7fa09d881740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958c2370 0x555d958c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.988+0000 7fa09d881740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555d9581d2f0 con 0x555d958c2370 2024-09-19T06:54:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.988+0000 7fa09d881740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555d957c4cf0 con 0x555d958b8b40 2024-09-19T06:54:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.988+0000 7fa09d881740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555d958192b0 con 0x555d958b75d0 2024-09-19T06:54:10.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.992+0000 7fa099a45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b8b40 0x555d958b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.992+0000 7fa099a45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b8b40 0x555d958b7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:59190/0 (socket says 172.21.15.12:59190) 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.992+0000 7fa099a45640 1 -- 172.21.15.12:0/837309554 learned_addr learned my addr 172.21.15.12:0/837309554 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.993+0000 7fa099a45640 1 -- 172.21.15.12:0/837309554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958b75d0 msgr2=0x555d958b7a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.993+0000 7fa099a45640 1 --2- 172.21.15.12:0/837309554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958b75d0 0x555d958b7a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.993+0000 7fa099a45640 1 -- 172.21.15.12:0/837309554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958c2370 msgr2=0x555d958c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.993+0000 7fa099a45640 1 --2- 172.21.15.12:0/837309554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958c2370 0x555d958c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.993+0000 7fa099a45640 1 -- 172.21.15.12:0/837309554 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d957a93a0 con 0x555d958b8b40 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.993+0000 7fa099a45640 1 --2- 172.21.15.12:0/837309554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b8b40 0x555d958b7090 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa08c004af0 tx=0x7fa08c001110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a17f29dc41306070 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.994+0000 7fa08a7fc640 1 -- 172.21.15.12:0/4171855870 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa090017070 con 0x7fa0941008c0 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.995+0000 7fa08a7fc640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0800a35c0 0x7fa0800a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.995+0000 7fa08a7fc640 1 -- 172.21.15.12:0/4171855870 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7fa0900cf080 con 0x7fa0941008c0 2024-09-19T06:54:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.996+0000 7fa099244640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0800a35c0 0x7fa0800a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.998+0000 7fa07f7fe640 1 -- 172.21.15.12:0/837309554 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c031d20 con 0x555d958b8b40 2024-09-19T06:54:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.998+0000 7fa07f7fe640 1 -- 172.21.15.12:0/837309554 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa08c03f070 con 0x555d958b8b40 2024-09-19T06:54:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.999+0000 7fa09d881740 1 -- 172.21.15.12:0/837309554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b8b40 msgr2=0x555d958b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.999+0000 7fa09d881740 1 --2- 172.21.15.12:0/837309554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b8b40 0x555d958b7090 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa08c004af0 tx=0x7fa08c001110 comp rx=0 tx=0).stop 2024-09-19T06:54:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.999+0000 7fa09d881740 1 -- 172.21.15.12:0/837309554 shutdown_connections 2024-09-19T06:54:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.999+0000 7fa09d881740 1 --2- 172.21.15.12:0/837309554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958c2370 0x555d958c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.999+0000 7fa09d881740 1 --2- 172.21.15.12:0/837309554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958b75d0 0x555d958b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.999+0000 7fa09d881740 1 --2- 172.21.15.12:0/837309554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b8b40 0x555d958b7090 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.999+0000 7fa09d881740 1 -- 172.21.15.12:0/837309554 >> 172.21.15.12:0/837309554 conn(0x555d95880310 msgr2=0x555d958b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:10.999+0000 7fa09d881740 1 -- 172.21.15.12:0/837309554 shutdown_connections 2024-09-19T06:54:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.000+0000 7fa09d881740 1 -- 172.21.15.12:0/837309554 wait complete. 2024-09-19T06:54:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.000+0000 7fa09d881740 1 -- start start 2024-09-19T06:54:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.000+0000 7fa09d881740 1 Processor -- start 2024-09-19T06:54:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.001+0000 7fa09d881740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 0x555d958c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.001+0000 7fa09d881740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 0x555d958bee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.001+0000 7fa09d881740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958bf390 0x555d958bf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.001+0000 7fa09d881740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555d958c5060 con 0x555d958b75d0 2024-09-19T06:54:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.001+0000 7fa09d881740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x555d957d8060 con 0x555d958bf390 2024-09-19T06:54:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.001+0000 7fa09d881740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555d958c51e0 con 0x555d958c2370 2024-09-19T06:54:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.001+0000 7fa09d881740 10 client.0 _ll_register_callbacks cb 0x555d9552b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.001+0000 7fa098a43640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 0x555d958bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.002+0000 7fa098a43640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 0x555d958bee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58300/0 (socket says 172.21.15.12:58300) 2024-09-19T06:54:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.002+0000 7fa098a43640 1 -- 172.21.15.12:0/3374865584 learned_addr learned my addr 172.21.15.12:0/3374865584 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.002+0000 7fa099a45640 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958bf390 0x555d958bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.002+0000 7fa098a43640 1 -- 172.21.15.12:0/3374865584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958bf390 msgr2=0x555d958bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.002+0000 7fa098a43640 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958bf390 0x555d958bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.002+0000 7fa098a43640 1 -- 172.21.15.12:0/3374865584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 msgr2=0x555d958c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.002+0000 7fa098a43640 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 0x555d958c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.002+0000 7fa098a43640 1 -- 172.21.15.12:0/3374865584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d9558e3c0 con 0x555d958c2370 2024-09-19T06:54:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.003+0000 7fa098a43640 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 0x555d958bee50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa08400bbf0 tx=0x7fa08400d6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caeef31b6f7cb919 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.003+0000 7fa07cff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.003+0000 7fa07cff9640 1 -- 172.21.15.12:0/3374865584 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084016070 con 0x555d958c2370 2024-09-19T06:54:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.003+0000 7fa09d881740 1 -- 172.21.15.12:0/3374865584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555d9582a860 con 0x555d958c2370 2024-09-19T06:54:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.003+0000 7fa07cff9640 1 -- 172.21.15.12:0/3374865584 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7fa084005220 con 0x555d958c2370 2024-09-19T06:54:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.003+0000 7fa07cff9640 1 -- 172.21.15.12:0/3374865584 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fa084021050 con 0x555d958c2370 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.003+0000 7fa09d881740 10 client.28582 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.003+0000 7fa09d881740 1 -- 172.21.15.12:0/3374865584 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555d958d0f30 con 0x555d958c2370 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.004+0000 7fa07cff9640 1 -- 172.21.15.12:0/3374865584 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555d9582a860 con 0x555d958c2370 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.004+0000 7fa07cff9640 1 -- 172.21.15.12:0/3374865584 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fa084010570 con 0x555d958c2370 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.004+0000 7fa09d881740 10 client.28582 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.004+0000 7fa09d881740 10 client.28582 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.004+0000 7fa09d881740 20 client.28582 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.004+0000 7fa09d881740 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555d958d27c0 0x555d958d4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.004+0000 7fa09d881740 4 client.28582 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.004+0000 7fa09d881740 1 -- 172.21.15.12:0/3374865584 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d95824d70 con 0x555d958d27c0 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.005+0000 7fa099244640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0800a35c0 0x7fa0800a5a80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x555d958b4ac0 tx=0x7fa09000bf90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.005+0000 7fa099a45640 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555d958d27c0 0x555d958d4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.006+0000 7fa07cff9640 10 client.28582 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:54:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.007+0000 7fa099a45640 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555d958d27c0 0x555d958d4c20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe141c23bc3a652a server_cookie=753c0ecf1ef1f555 in_seq=0 out_seq=0 2024-09-19T06:54:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.008+0000 7fa07cff9640 1 -- 172.21.15.12:0/3374865584 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d95824d70 con 0x555d958d27c0 2024-09-19T06:54:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.008+0000 7fa07cff9640 10 client.28582 handle_command_reply: tid=0 2024-09-19T06:54:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.009+0000 7fa09d881740 1 client.28582 shutdown 2024-09-19T06:54:11.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.010+0000 7fa09d881740 1 -- 172.21.15.12:0/3374865584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 msgr2=0x555d958bee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.010+0000 7fa09d881740 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 0x555d958bee50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa08400bbf0 tx=0x7fa08400d6b0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.010+0000 7fa09d881740 1 -- 172.21.15.12:0/3374865584 shutdown_connections 2024-09-19T06:54:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.010+0000 7fa09d881740 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555d958d27c0 0x555d958d4c20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.010+0000 7fa09d881740 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958bf390 0x555d958bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.010+0000 7fa09d881740 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 0x555d958bee50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.010+0000 7fa09d881740 1 --2- 172.21.15.12:0/3374865584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 0x555d958c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.010+0000 7fa09d881740 1 -- 172.21.15.12:0/3374865584 >> 172.21.15.12:0/3374865584 conn(0x555d95880310 msgr2=0x555d958b9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.010+0000 7fa07cff9640 0 client.28582 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:54:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.014+0000 7fa09d881740 1 -- 172.21.15.12:0/3374865584 shutdown_connections 2024-09-19T06:54:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.014+0000 7fa09d881740 1 -- 172.21.15.12:0/3374865584 wait complete. 2024-09-19T06:54:11.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.014+0000 7fa09d881740 20 client.28582 trim_cache size 0 max 16384 2024-09-19T06:54:11.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.042+0000 7fa09d881740 1 Processor -- start 2024-09-19T06:54:11.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.043+0000 7fa09d881740 1 -- start start 2024-09-19T06:54:11.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.043+0000 7fa09d881740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b75d0 0x555d958bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.043+0000 7fa09d881740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958bf390 0x555d958c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.044+0000 7fa099a45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b75d0 0x555d958bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.044+0000 7fa099a45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b75d0 0x555d958bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:59212/0 (socket says 172.21.15.12:59212) 2024-09-19T06:54:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.044+0000 7fa098a43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958bf390 0x555d958c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.044+0000 7fa098a43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958bf390 0x555d958c0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50952/0 (socket says 172.21.15.12:50952) 2024-09-19T06:54:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.044+0000 7fa099a45640 1 -- 172.21.15.12:0/3070079227 learned_addr learned my addr 172.21.15.12:0/3070079227 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.044+0000 7fa09d881740 1 --2- 172.21.15.12:0/3070079227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 0x555d958ba120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.044+0000 7fa09d881740 1 -- 172.21.15.12:0/3070079227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa07800ec60 con 0x555d958bf390 2024-09-19T06:54:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.044+0000 7fa09d881740 1 -- 172.21.15.12:0/3070079227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa078010860 con 0x555d958b75d0 2024-09-19T06:54:11.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.044+0000 7fa09d881740 1 -- 172.21.15.12:0/3070079227 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa07800f330 con 0x555d958c2370 2024-09-19T06:54:11.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.046+0000 7fa098a43640 1 -- 172.21.15.12:0/3070079227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 msgr2=0x555d958ba120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:54:11.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.046+0000 7fa098a43640 1 --2- 172.21.15.12:0/3070079227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 0x555d958ba120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.046+0000 7fa098a43640 1 -- 172.21.15.12:0/3070079227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b75d0 msgr2=0x555d958bdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.046+0000 7fa098a43640 1 --2- 172.21.15.12:0/3070079227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b75d0 0x555d958bdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.046+0000 7fa098a43640 1 -- 172.21.15.12:0/3070079227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d958b41a0 con 0x555d958bf390 2024-09-19T06:54:11.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.046+0000 7fa098a43640 1 --2- 172.21.15.12:0/3070079227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958bf390 0x555d958c0dc0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fa084010910 tx=0x7fa084005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7077896d2de23c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:11.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.053+0000 7fa07effd640 1 -- 172.21.15.12:0/3070079227 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08402a070 con 0x555d958bf390 2024-09-19T06:54:11.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.053+0000 7fa07effd640 1 -- 172.21.15.12:0/3070079227 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa08401e030 con 0x555d958bf390 2024-09-19T06:54:11.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.053+0000 7fa07effd640 1 -- 172.21.15.12:0/3070079227 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084016070 con 0x555d958bf390 2024-09-19T06:54:11.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.054+0000 7fa09d881740 1 -- 172.21.15.12:0/3070079227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958bf390 msgr2=0x555d958c0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.054+0000 7fa09d881740 1 --2- 172.21.15.12:0/3070079227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958bf390 0x555d958c0dc0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fa084010910 tx=0x7fa084005e50 comp rx=0 tx=0).stop 2024-09-19T06:54:11.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.054+0000 7fa09d881740 1 -- 172.21.15.12:0/3070079227 shutdown_connections 2024-09-19T06:54:11.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.054+0000 7fa09d881740 1 --2- 172.21.15.12:0/3070079227 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958c2370 0x555d958ba120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.054+0000 7fa09d881740 1 --2- 172.21.15.12:0/3070079227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958bf390 0x555d958c0dc0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.054+0000 7fa09d881740 1 --2- 172.21.15.12:0/3070079227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958b75d0 0x555d958bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.054+0000 7fa09d881740 1 -- 172.21.15.12:0/3070079227 >> 172.21.15.12:0/3070079227 conn(0x555d95880310 msgr2=0x555d958c06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.055+0000 7fa09d881740 1 -- 172.21.15.12:0/3070079227 shutdown_connections 2024-09-19T06:54:11.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.055+0000 7fa09d881740 1 -- 172.21.15.12:0/3070079227 wait complete. 2024-09-19T06:54:11.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.056+0000 7fa09d881740 1 -- start start 2024-09-19T06:54:11.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.056+0000 7fa09d881740 1 Processor -- start 2024-09-19T06:54:11.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.057+0000 7fa09d881740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 0x555d958ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.057+0000 7fa09d881740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958c2370 0x555d958cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.057+0000 7fa09d881740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958bb8a0 0x555d958bbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.057+0000 7fa09d881740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa078010190 con 0x555d958b75d0 2024-09-19T06:54:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.057+0000 7fa099a45640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 0x555d958ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.058+0000 7fa099a45640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 0x555d958ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50962/0 (socket says 172.21.15.12:50962) 2024-09-19T06:54:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.058+0000 7fa099a45640 1 -- 172.21.15.12:0/4135109330 learned_addr learned my addr 172.21.15.12:0/4135109330 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.058+0000 7fa09d881740 1 -- 172.21.15.12:0/4135109330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa07800fa00 con 0x555d958c2370 2024-09-19T06:54:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.058+0000 7fa09d881740 1 -- 172.21.15.12:0/4135109330 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa07800cc60 con 0x555d958bb8a0 2024-09-19T06:54:11.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.058+0000 7fa09d881740 10 client.0 _ll_register_callbacks cb 0x7fa08400b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:11.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.058+0000 7fa098a43640 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958c2370 0x555d958cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.059+0000 7fa098a43640 1 -- 172.21.15.12:0/4135109330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958bb8a0 msgr2=0x555d958bbd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:54:11.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.059+0000 7fa098a43640 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958bb8a0 0x555d958bbd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.059+0000 7fa098a43640 1 -- 172.21.15.12:0/4135109330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 msgr2=0x555d958ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:11.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.059+0000 7fa098a43640 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 0x555d958ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.059+0000 7fa098a43640 1 -- 172.21.15.12:0/4135109330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d958bc550 con 0x555d958c2370 2024-09-19T06:54:11.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.060+0000 7fa099a45640 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 0x555d958ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:11.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.060+0000 7fa098a43640 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958c2370 0x555d958cae70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x555d958d0f00 tx=0x7fa084010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c86571a3d687e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:11.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.060+0000 7fa07cff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:54:11.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.060+0000 7fa07cff9640 1 -- 172.21.15.12:0/4135109330 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08402a070 con 0x555d958c2370 2024-09-19T06:54:11.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.060+0000 7fa07cff9640 1 -- 172.21.15.12:0/4135109330 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7fa084005040 con 0x555d958c2370 2024-09-19T06:54:11.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.060+0000 7fa09d881740 1 -- 172.21.15.12:0/4135109330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa08401e030 con 0x555d958c2370 2024-09-19T06:54:11.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.061+0000 7fa07cff9640 1 -- 172.21.15.12:0/4135109330 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fa084016040 con 0x555d958c2370 2024-09-19T06:54:11.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.062+0000 7fa09d881740 10 client.28667 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:11.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.062+0000 7fa09d881740 1 -- 172.21.15.12:0/4135109330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555d9593d550 con 0x555d958c2370 2024-09-19T06:54:11.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.063+0000 7fa07cff9640 1 -- 172.21.15.12:0/4135109330 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa08401e030 con 0x555d958c2370 2024-09-19T06:54:11.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.063+0000 7fa07cff9640 1 -- 172.21.15.12:0/4135109330 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fa084003ba0 con 0x555d958c2370 2024-09-19T06:54:11.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.063+0000 7fa09d881740 10 client.28667 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:11.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.063+0000 7fa09d881740 10 client.28667 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:54:11.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.064+0000 7fa09d881740 20 client.28667 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:11.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.064+0000 7fa09d881740 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555d9593db10 0x555d9593ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:11.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.064+0000 7fa09d881740 4 client.28667 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:54:11.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.064+0000 7fa09d881740 1 -- 172.21.15.12:0/4135109330 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d957a1170 con 0x555d9593db10 2024-09-19T06:54:11.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.065+0000 7fa099a45640 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555d9593db10 0x555d9593ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.066+0000 7fa099a45640 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555d9593db10 0x555d9593ff20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=139dee277c8563b1 server_cookie=3a3516de7e0d36d2 in_seq=0 out_seq=0 2024-09-19T06:54:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.066+0000 7fa07cff9640 10 client.28667 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:54:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.068+0000 7fa07cff9640 1 -- 172.21.15.12:0/4135109330 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d957a1170 con 0x555d9593db10 2024-09-19T06:54:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.068+0000 7fa07cff9640 10 client.28667 handle_command_reply: tid=0 2024-09-19T06:54:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.068+0000 7fa09d881740 1 client.28667 shutdown 2024-09-19T06:54:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.069+0000 7fa09d881740 1 -- 172.21.15.12:0/4135109330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958c2370 msgr2=0x555d958cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.069+0000 7fa09d881740 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958c2370 0x555d958cae70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x555d958d0f00 tx=0x7fa084010830 comp rx=0 tx=0).stop 2024-09-19T06:54:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.069+0000 7fa09d881740 1 -- 172.21.15.12:0/4135109330 shutdown_connections 2024-09-19T06:54:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.069+0000 7fa09d881740 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x555d9593db10 0x555d9593ff20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.069+0000 7fa09d881740 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555d958bb8a0 0x555d958bbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.070+0000 7fa09d881740 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x555d958c2370 0x555d958cae70 secure :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0x555d958d0f00 tx=0x7fa084010830 comp rx=0 tx=0).stop 2024-09-19T06:54:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.070+0000 7fa09d881740 1 --2- 172.21.15.12:0/4135109330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d958b75d0 0x555d958ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.070+0000 7fa09d881740 1 -- 172.21.15.12:0/4135109330 >> 172.21.15.12:0/4135109330 conn(0x555d95880310 msgr2=0x555d958c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.070+0000 7fa07cff9640 0 client.28667 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:54:11.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.071+0000 7fa09d881740 1 -- 172.21.15.12:0/4135109330 shutdown_connections 2024-09-19T06:54:11.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.072+0000 7fa09d881740 1 -- 172.21.15.12:0/4135109330 wait complete. 2024-09-19T06:54:11.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.072+0000 7fa09d881740 20 client.28667 trim_cache size 0 max 16384 2024-09-19T06:54:11.076 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:54:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.079+0000 7fa09b4a8640 1 -- 172.21.15.12:0/4171855870 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0800a35c0 msgr2=0x7fa0800a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.079+0000 7fa09b4a8640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0800a35c0 0x7fa0800a5a80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x555d958b4ac0 tx=0x7fa09000bf90 comp rx=0 tx=0).stop 2024-09-19T06:54:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.080+0000 7fa09b4a8640 1 -- 172.21.15.12:0/4171855870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0941008c0 msgr2=0x7fa094114b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.080+0000 7fa09b4a8640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0941008c0 0x7fa094114b10 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fa09000b4a0 tx=0x7fa09000b960 comp rx=0 tx=0).stop 2024-09-19T06:54:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.080+0000 7fa09b4a8640 1 -- 172.21.15.12:0/4171855870 shutdown_connections 2024-09-19T06:54:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.080+0000 7fa09b4a8640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa094105ec0 0x7fa09410dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.080+0000 7fa09b4a8640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa0800a35c0 0x7fa0800a5a80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.080+0000 7fa09b4a8640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0941011e0 0x7fa094115050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.080+0000 7fa09b4a8640 1 --2- 172.21.15.12:0/4171855870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0941008c0 0x7fa094114b10 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.080+0000 7fa09b4a8640 1 -- 172.21.15.12:0/4171855870 >> 172.21.15.12:0/4171855870 conn(0x7fa0940fc7d0 msgr2=0x7fa0940fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.081+0000 7fa09b4a8640 1 -- 172.21.15.12:0/4171855870 shutdown_connections 2024-09-19T06:54:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:11.081+0000 7fa09b4a8640 1 -- 172.21.15.12:0/4171855870 wait complete. 2024-09-19T06:54:11.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:11 smithi173 ceph-mon[35349]: pgmap v439: 97 pgs: 97 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.6 MiB/s wr, 385 op/s 2024-09-19T06:54:11.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:11 smithi012 ceph-mon[30937]: pgmap v439: 97 pgs: 97 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.6 MiB/s wr, 385 op/s 2024-09-19T06:54:11.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:54:12.008 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:11 smithi016 ceph-mon[34911]: pgmap v439: 97 pgs: 97 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.6 MiB/s wr, 385 op/s 2024-09-19T06:54:12.387 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.981+0000 7f10668b1640 1 -- 172.21.15.12:0/4109896368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1060100b40 msgr2=0x7f1060100f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.981+0000 7f10668b1640 1 --2- 172.21.15.12:0/4109896368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1060100b40 0x7f1060100f20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1054009860 tx=0x7f105402a3b0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.981+0000 7f10668b1640 1 -- 172.21.15.12:0/4109896368 shutdown_connections 2024-09-19T06:54:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.981+0000 7f10668b1640 1 --2- 172.21.15.12:0/4109896368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1060105f50 0x7f10601063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.981+0000 7f10668b1640 1 --2- 172.21.15.12:0/4109896368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1060101460 0x7f1060105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.981+0000 7f10668b1640 1 --2- 172.21.15.12:0/4109896368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1060100b40 0x7f1060100f20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.981+0000 7f10668b1640 1 -- 172.21.15.12:0/4109896368 >> 172.21.15.12:0/4109896368 conn(0x7f10600fc7d0 msgr2=0x7f10600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.981+0000 7f10668b1640 1 -- 172.21.15.12:0/4109896368 shutdown_connections 2024-09-19T06:54:12.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.981+0000 7f10668b1640 1 -- 172.21.15.12:0/4109896368 wait complete. 2024-09-19T06:54:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f10668b1640 1 Processor -- start 2024-09-19T06:54:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f10668b1640 1 -- start start 2024-09-19T06:54:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f10668b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1060100b40 0x7f1060073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f10668b1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1060101460 0x7f106006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f10668b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1060105f50 0x7f106006c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f10668b1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1060118560 con 0x7f1060105f50 2024-09-19T06:54:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f10668b1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10601183e0 con 0x7f1060100b40 2024-09-19T06:54:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f10668b1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10601186e0 con 0x7f1060101460 2024-09-19T06:54:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f1064e4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1060105f50 0x7f106006c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f1064e4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1060105f50 0x7f106006c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50976/0 (socket says 172.21.15.12:50976) 2024-09-19T06:54:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f1064e4e640 1 -- 172.21.15.12:0/363415196 learned_addr learned my addr 172.21.15.12:0/363415196 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f105ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1060100b40 0x7f1060073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.982+0000 7f105f7fe640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1060101460 0x7f106006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.983+0000 7f1064e4e640 1 -- 172.21.15.12:0/363415196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1060101460 msgr2=0x7f106006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.983+0000 7f1064e4e640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1060101460 0x7f106006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.983+0000 7f1064e4e640 1 -- 172.21.15.12:0/363415196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1060100b40 msgr2=0x7f1060073d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.983+0000 7f1064e4e640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1060100b40 0x7f1060073d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.983+0000 7f1064e4e640 1 -- 172.21.15.12:0/363415196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106006ca40 con 0x7f1060105f50 2024-09-19T06:54:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.984+0000 7f1064e4e640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1060105f50 0x7f106006c220 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f105800eaa0 tx=0x7f105800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.985+0000 7f105d7fa640 1 -- 172.21.15.12:0/363415196 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105800cdb0 con 0x7f1060105f50 2024-09-19T06:54:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.985+0000 7f105d7fa640 1 -- 172.21.15.12:0/363415196 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1058005020 con 0x7f1060105f50 2024-09-19T06:54:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.985+0000 7f105d7fa640 1 -- 172.21.15.12:0/363415196 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10580116d0 con 0x7f1060105f50 2024-09-19T06:54:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.985+0000 7f10668b1640 1 -- 172.21.15.12:0/363415196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10601b38d0 con 0x7f1060105f50 2024-09-19T06:54:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.985+0000 7f10668b1640 1 -- 172.21.15.12:0/363415196 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10601b3dc0 con 0x7f1060105f50 2024-09-19T06:54:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.988+0000 7f1068c8a740 1 Processor -- start 2024-09-19T06:54:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.988+0000 7f105d7fa640 1 -- 172.21.15.12:0/363415196 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1058005540 con 0x7f1060105f50 2024-09-19T06:54:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.988+0000 7f1068c8a740 1 -- start start 2024-09-19T06:54:12.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578ee370 0x55f4578f0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f1068c8a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4578492f0 con 0x55f4578e35d0 2024-09-19T06:54:12.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f1068c8a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f4577f0cf0 con 0x55f4578ee370 2024-09-19T06:54:12.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f1068c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f4578452b0 con 0x55f4578e4b40 2024-09-19T06:54:12.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105d7fa640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10480a3430 0x7f10480a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578e3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50984/0 (socket says 172.21.15.12:50984) 2024-09-19T06:54:12.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578e3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58324/0 (socket says 172.21.15.12:58324) 2024-09-19T06:54:12.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105ffff640 1 -- 172.21.15.12:0/3028856564 learned_addr learned my addr 172.21.15.12:0/3028856564 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:12.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105f7fe640 1 --2- 172.21.15.12:0/3028856564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578ee370 0x55f4578f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105d7fa640 1 -- 172.21.15.12:0/363415196 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7f10580cff80 con 0x7f1060105f50 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105f7fe640 1 -- 172.21.15.12:0/3028856564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578ee370 msgr2=0x55f4578f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105f7fe640 1 --2- 172.21.15.12:0/3028856564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578ee370 0x55f4578f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105f7fe640 1 -- 172.21.15.12:0/3028856564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 msgr2=0x55f4578e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105f7fe640 1 --2- 172.21.15.12:0/3028856564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.989+0000 7f105f7fe640 1 -- 172.21.15.12:0/3028856564 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4577d53a0 con 0x55f4578e4b40 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.990+0000 7f1064e4e640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10480a3430 0x7f10480a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.990+0000 7f105f7fe640 1 --2- 172.21.15.12:0/3028856564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578e3090 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f106006d4a0 tx=0x7f1050009720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69d7f9769d177491 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.990+0000 7f10467fc640 1 -- 172.21.15.12:0/3028856564 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105000f450 con 0x55f4578e4b40 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.990+0000 7f10467fc640 1 -- 172.21.15.12:0/3028856564 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f105000fad0 con 0x55f4578e4b40 2024-09-19T06:54:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.990+0000 7f10467fc640 1 -- 172.21.15.12:0/3028856564 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105001ead0 con 0x55f4578e4b40 2024-09-19T06:54:12.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.991+0000 7f1068c8a740 1 -- 172.21.15.12:0/3028856564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 msgr2=0x55f4578e3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:12.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.991+0000 7f1064e4e640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10480a3430 0x7f10480a58f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1058098b60 tx=0x7f1058009270 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:12.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.991+0000 7f1068c8a740 1 --2- 172.21.15.12:0/3028856564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578e3090 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f106006d4a0 tx=0x7f1050009720 comp rx=0 tx=0).stop 2024-09-19T06:54:12.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.991+0000 7f1068c8a740 1 -- 172.21.15.12:0/3028856564 shutdown_connections 2024-09-19T06:54:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.991+0000 7f1068c8a740 1 --2- 172.21.15.12:0/3028856564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578ee370 0x55f4578f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.991+0000 7f1068c8a740 1 --2- 172.21.15.12:0/3028856564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.991+0000 7f1068c8a740 1 --2- 172.21.15.12:0/3028856564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578e3090 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.991+0000 7f1068c8a740 1 -- 172.21.15.12:0/3028856564 >> 172.21.15.12:0/3028856564 conn(0x55f4578ac310 msgr2=0x55f4578dfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.992+0000 7f1068c8a740 1 -- 172.21.15.12:0/3028856564 shutdown_connections 2024-09-19T06:54:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.992+0000 7f1068c8a740 1 -- 172.21.15.12:0/3028856564 wait complete. 2024-09-19T06:54:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.992+0000 7f1068c8a740 1 -- start start 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f1068c8a740 1 Processor -- start 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578edd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578eafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578ee370 0x55f4578eb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f1068c8a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4578f1010 con 0x55f4578e35d0 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f1068c8a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55f457804060 con 0x55f4578ee370 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f1068c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f4578f1190 con 0x55f4578e4b40 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f1068c8a740 10 client.0 _ll_register_callbacks cb 0x55f4575578c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f105ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578eafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f105ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578eafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58332/0 (socket says 172.21.15.12:58332) 2024-09-19T06:54:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f105ffff640 1 -- 172.21.15.12:0/1791164849 learned_addr learned my addr 172.21.15.12:0/1791164849 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.993+0000 7f105f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578ee370 0x55f4578eb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f105f7fe640 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f105ffff640 1 -- 172.21.15.12:0/1791164849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578ee370 msgr2=0x55f4578eb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f105ffff640 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578ee370 0x55f4578eb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f105ffff640 1 -- 172.21.15.12:0/1791164849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 msgr2=0x55f4578edd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f105ffff640 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578edd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f105ffff640 1 -- 172.21.15.12:0/1791164849 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4575ba3c0 con 0x55f4578e4b40 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f105f7fe640 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578edd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f105ffff640 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578eafd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1054035040 tx=0x7f1054030430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acd3843031cb8457 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f103f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f103f7fe640 1 -- 172.21.15.12:0/1791164849 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1054037040 con 0x55f4578e4b40 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f103f7fe640 1 -- 172.21.15.12:0/1791164849 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7f10540035f0 con 0x55f4578e4b40 2024-09-19T06:54:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.994+0000 7f1068c8a740 1 -- 172.21.15.12:0/1791164849 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f105000fad0 con 0x55f4578e4b40 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f103f7fe640 1 -- 172.21.15.12:0/1791164849 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f105404c050 con 0x55f4578e4b40 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f1068c8a740 10 client.28594 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f1068c8a740 1 -- 172.21.15.12:0/1791164849 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55f4578fca40 con 0x55f4578e4b40 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f103f7fe640 1 -- 172.21.15.12:0/1791164849 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f105000fad0 con 0x55f4578e4b40 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f103f7fe640 1 -- 172.21.15.12:0/1791164849 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f1054030b80 con 0x55f4578e4b40 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f1068c8a740 10 client.28594 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f1068c8a740 10 client.28594 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f1068c8a740 20 client.28594 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55f4578fe2d0 0x55f4579006c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f1068c8a740 4 client.28594 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f1068c8a740 1 -- 172.21.15.12:0/1791164849 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f457856860 con 0x55f4578fe2d0 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.995+0000 7f105f7fe640 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55f4578fe2d0 0x55f4579006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.996+0000 7f105f7fe640 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55f4578fe2d0 0x55f4579006c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=694e579707794ae9 server_cookie=62d13a6ea1631d0c in_seq=0 out_seq=0 2024-09-19T06:54:13.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.996+0000 7f103f7fe640 10 client.28594 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:54:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.997+0000 7f103f7fe640 1 -- 172.21.15.12:0/1791164849 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f457856860 con 0x55f4578fe2d0 2024-09-19T06:54:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.997+0000 7f103f7fe640 10 client.28594 handle_command_reply: tid=0 2024-09-19T06:54:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.997+0000 7f1068c8a740 1 client.28594 shutdown 2024-09-19T06:54:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.998+0000 7f1068c8a740 1 -- 172.21.15.12:0/1791164849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 msgr2=0x55f4578eafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.998+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578eafd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1054035040 tx=0x7f1054030430 comp rx=0 tx=0).stop 2024-09-19T06:54:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.998+0000 7f1068c8a740 1 -- 172.21.15.12:0/1791164849 shutdown_connections 2024-09-19T06:54:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.998+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55f4578fe2d0 0x55f4579006c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.998+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578ee370 0x55f4578eb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.998+0000 7f103f7fe640 0 client.28594 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:54:13.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.998+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e4b40 0x55f4578eafd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.998+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1791164849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578edd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.998+0000 7f1068c8a740 1 -- 172.21.15.12:0/1791164849 >> 172.21.15.12:0/1791164849 conn(0x55f4578ac310 msgr2=0x55f4578e5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:13.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.999+0000 7f1068c8a740 1 -- 172.21.15.12:0/1791164849 shutdown_connections 2024-09-19T06:54:13.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.999+0000 7f1068c8a740 1 -- 172.21.15.12:0/1791164849 wait complete. 2024-09-19T06:54:13.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:12.999+0000 7f1068c8a740 20 client.28594 trim_cache size 0 max 16384 2024-09-19T06:54:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.018+0000 7f1068c8a740 1 Processor -- start 2024-09-19T06:54:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f1068c8a740 1 -- start start 2024-09-19T06:54:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e35d0 0x55f4578fa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 0x55f457905d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578ee370 0x55f457906290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f1068c8a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f10601bca40 con 0x55f4578ee370 2024-09-19T06:54:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f1068c8a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10601be640 con 0x55f4578e4b40 2024-09-19T06:54:13.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f1068c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10601bd110 con 0x55f4578e35d0 2024-09-19T06:54:13.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f105ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 0x55f457905d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f105f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e35d0 0x55f4578fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f105ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 0x55f457905d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:59270/0 (socket says 172.21.15.12:59270) 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f105ffff640 1 -- 172.21.15.12:0/546724711 learned_addr learned my addr 172.21.15.12:0/546724711 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f105f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e35d0 0x55f4578fa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58340/0 (socket says 172.21.15.12:58340) 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.019+0000 7f105f7fe640 1 --2- 172.21.15.12:0/546724711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578ee370 0x55f457906290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.020+0000 7f105f7fe640 1 -- 172.21.15.12:0/546724711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 msgr2=0x55f457905d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.020+0000 7f105f7fe640 1 --2- 172.21.15.12:0/546724711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 0x55f457905d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.020+0000 7f105f7fe640 1 -- 172.21.15.12:0/546724711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578ee370 msgr2=0x55f457906290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.020+0000 7f105f7fe640 1 --2- 172.21.15.12:0/546724711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578ee370 0x55f457906290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.020+0000 7f105f7fe640 1 -- 172.21.15.12:0/546724711 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4578eb8e0 con 0x55f4578e35d0 2024-09-19T06:54:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.020+0000 7f105ffff640 1 --2- 172.21.15.12:0/546724711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 0x55f457905d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:13.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.020+0000 7f105f7fe640 1 --2- 172.21.15.12:0/546724711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e35d0 0x55f4578fa2b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55f457900cf0 tx=0x7f105001e650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b9abbad28c4669f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:13.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.020+0000 7f1045ffb640 1 -- 172.21.15.12:0/546724711 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10500050d0 con 0x55f4578e35d0 2024-09-19T06:54:13.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.020+0000 7f1045ffb640 1 -- 172.21.15.12:0/546724711 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f105001ece0 con 0x55f4578e35d0 2024-09-19T06:54:13.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.020+0000 7f1045ffb640 1 -- 172.21.15.12:0/546724711 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050003970 con 0x55f4578e35d0 2024-09-19T06:54:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.021+0000 7f1068c8a740 1 -- 172.21.15.12:0/546724711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e35d0 msgr2=0x55f4578fa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.021+0000 7f1068c8a740 1 --2- 172.21.15.12:0/546724711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e35d0 0x55f4578fa2b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55f457900cf0 tx=0x7f105001e650 comp rx=0 tx=0).stop 2024-09-19T06:54:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.021+0000 7f1068c8a740 1 -- 172.21.15.12:0/546724711 shutdown_connections 2024-09-19T06:54:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.021+0000 7f1068c8a740 1 --2- 172.21.15.12:0/546724711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578ee370 0x55f457906290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.021+0000 7f1068c8a740 1 --2- 172.21.15.12:0/546724711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 0x55f457905d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.021+0000 7f1068c8a740 1 --2- 172.21.15.12:0/546724711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578e35d0 0x55f4578fa2b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.021+0000 7f1068c8a740 1 -- 172.21.15.12:0/546724711 >> 172.21.15.12:0/546724711 conn(0x55f4578ac310 msgr2=0x55f4578e98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.021+0000 7f1068c8a740 1 -- 172.21.15.12:0/546724711 shutdown_connections 2024-09-19T06:54:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.021+0000 7f1068c8a740 1 -- 172.21.15.12:0/546724711 wait complete. 2024-09-19T06:54:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.021+0000 7f1068c8a740 1 -- start start 2024-09-19T06:54:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.022+0000 7f1068c8a740 1 Processor -- start 2024-09-19T06:54:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.022+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.022+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 0x55f4578f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.022+0000 7f1068c8a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578ee370 0x55f4578f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.022+0000 7f1068c8a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f10601bdf70 con 0x55f4578e35d0 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.022+0000 7f1068c8a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10601bd7e0 con 0x55f4578e4b40 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.022+0000 7f1068c8a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10601baa40 con 0x55f4578ee370 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.022+0000 7f1068c8a740 10 client.0 _ll_register_callbacks cb 0x7f10540096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.023+0000 7f105f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578ee370 0x55f4578f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.023+0000 7f105f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.023+0000 7f105f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578f6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51018/0 (socket says 172.21.15.12:51018) 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.023+0000 7f105f7fe640 1 -- 172.21.15.12:0/1827698013 learned_addr learned my addr 172.21.15.12:0/1827698013 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.023+0000 7f105f7fe640 1 -- 172.21.15.12:0/1827698013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578ee370 msgr2=0x55f4578f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.023+0000 7f105f7fe640 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578ee370 0x55f4578f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.023+0000 7f105f7fe640 1 -- 172.21.15.12:0/1827698013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 msgr2=0x55f4578f1e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.023+0000 7f105f7fe640 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 0x55f4578f1e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.023+0000 7f105f7fe640 1 -- 172.21.15.12:0/1827698013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4578f2b70 con 0x55f4578e35d0 2024-09-19T06:54:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.023+0000 7f105f7fe640 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578f6b30 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f105001e4a0 tx=0x7f1050009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd8daa18e93ee53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.024+0000 7f103f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:54:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.024+0000 7f103f7fe640 1 -- 172.21.15.12:0/1827698013 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050005430 con 0x55f4578e35d0 2024-09-19T06:54:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.024+0000 7f1068c8a740 1 -- 172.21.15.12:0/1827698013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f105001ece0 con 0x55f4578e35d0 2024-09-19T06:54:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.024+0000 7f103f7fe640 1 -- 172.21.15.12:0/1827698013 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8731+0+0 (secure 0 0 0) 0x7f105001e6c0 con 0x55f4578e35d0 2024-09-19T06:54:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.024+0000 7f103f7fe640 1 -- 172.21.15.12:0/1827698013 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f105001e8c0 con 0x55f4578e35d0 2024-09-19T06:54:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.024+0000 7f1068c8a740 10 client.19365 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.024+0000 7f1068c8a740 1 -- 172.21.15.12:0/1827698013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55f457967d20 con 0x55f4578e35d0 2024-09-19T06:54:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.025+0000 7f103f7fe640 1 -- 172.21.15.12:0/1827698013 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f105001ece0 con 0x55f4578e35d0 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.025+0000 7f103f7fe640 1 -- 172.21.15.12:0/1827698013 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f105000f450 con 0x55f4578e35d0 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.025+0000 7f1068c8a740 10 client.19365 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.025+0000 7f1068c8a740 10 client.19365 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.025+0000 7f1068c8a740 20 client.19365 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.026+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55f4578fe2d0 0x55f45796a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.026+0000 7f1068c8a740 4 client.19365 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.026+0000 7f1068c8a740 1 -- 172.21.15.12:0/1827698013 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f457850d70 con 0x55f4578fe2d0 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.026+0000 7f105ffff640 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55f4578fe2d0 0x55f45796a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.026+0000 7f103f7fe640 10 client.19365 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.026+0000 7f105ffff640 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55f4578fe2d0 0x55f45796a300 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2be3cd02420216 server_cookie=88102e2c1c5033d4 in_seq=0 out_seq=0 2024-09-19T06:54:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.026+0000 7f103f7fe640 1 -- 172.21.15.12:0/1827698013 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f457850d70 con 0x55f4578fe2d0 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.026+0000 7f103f7fe640 10 client.19365 handle_command_reply: tid=0 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 client.19365 shutdown 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 -- 172.21.15.12:0/1827698013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 msgr2=0x55f4578f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578f6b30 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f105001e4a0 tx=0x7f1050009e60 comp rx=0 tx=0).stop 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 -- 172.21.15.12:0/1827698013 shutdown_connections 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55f4578fe2d0 0x55f45796a300 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f4578ee370 0x55f4578f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f4578e4b40 0x55f4578f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 --2- 172.21.15.12:0/1827698013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4578e35d0 0x55f4578f6b30 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f103f7fe640 0 client.19365 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 -- 172.21.15.12:0/1827698013 >> 172.21.15.12:0/1827698013 conn(0x55f4578ac310 msgr2=0x55f4578ed050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 -- 172.21.15.12:0/1827698013 shutdown_connections 2024-09-19T06:54:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 1 -- 172.21.15.12:0/1827698013 wait complete. 2024-09-19T06:54:13.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.027+0000 7f1068c8a740 20 client.19365 trim_cache size 0 max 16384 2024-09-19T06:54:13.033 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:54:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 -- 172.21.15.12:0/363415196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10480a3430 msgr2=0x7f10480a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10480a3430 0x7f10480a58f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1058098b60 tx=0x7f1058009270 comp rx=0 tx=0).stop 2024-09-19T06:54:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 -- 172.21.15.12:0/363415196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1060105f50 msgr2=0x7f106006c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1060105f50 0x7f106006c220 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f105800eaa0 tx=0x7f105800ef60 comp rx=0 tx=0).stop 2024-09-19T06:54:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 -- 172.21.15.12:0/363415196 shutdown_connections 2024-09-19T06:54:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1060105f50 0x7f106006c220 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f10480a3430 0x7f10480a58f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1060101460 0x7f106006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 --2- 172.21.15.12:0/363415196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1060100b40 0x7f1060073d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:13.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 -- 172.21.15.12:0/363415196 >> 172.21.15.12:0/363415196 conn(0x7f10600fc7d0 msgr2=0x7f10600fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:13.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.028+0000 7f10668b1640 1 -- 172.21.15.12:0/363415196 shutdown_connections 2024-09-19T06:54:13.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:13.029+0000 7f10668b1640 1 -- 172.21.15.12:0/363415196 wait complete. 2024-09-19T06:54:13.810 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:13 smithi016 ceph-mon[34911]: pgmap v440: 97 pgs: 97 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.6 MiB/s wr, 385 op/s 2024-09-19T06:54:13.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:13 smithi173 ceph-mon[35349]: pgmap v440: 97 pgs: 97 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.6 MiB/s wr, 385 op/s 2024-09-19T06:54:13.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:13 smithi012 ceph-mon[30937]: pgmap v440: 97 pgs: 97 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.6 MiB/s wr, 385 op/s 2024-09-19T06:54:13.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:54:14.368 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:14.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.932+0000 7f0b99010640 1 -- 172.21.15.12:0/47173815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b94100a80 msgr2=0x7f0b94100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.932+0000 7f0b99010640 1 --2- 172.21.15.12:0/47173815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b94100a80 0x7f0b94100ee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009900 tx=0x7f0b7c02a400 comp rx=0 tx=0).stop 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.932+0000 7f0b99010640 1 -- 172.21.15.12:0/47173815 shutdown_connections 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.932+0000 7f0b99010640 1 --2- 172.21.15.12:0/47173815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94101420 0x7f0b9410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.932+0000 7f0b99010640 1 --2- 172.21.15.12:0/47173815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b94100a80 0x7f0b94100ee0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.932+0000 7f0b99010640 1 --2- 172.21.15.12:0/47173815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b94106a80 0x7f0b94106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.932+0000 7f0b99010640 1 -- 172.21.15.12:0/47173815 >> 172.21.15.12:0/47173815 conn(0x7f0b940fc7a0 msgr2=0x7f0b940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.932+0000 7f0b99010640 1 -- 172.21.15.12:0/47173815 shutdown_connections 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.932+0000 7f0b99010640 1 -- 172.21.15.12:0/47173815 wait complete. 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.933+0000 7f0b99010640 1 Processor -- start 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.933+0000 7f0b99010640 1 -- start start 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.933+0000 7f0b99010640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94100a80 0x7f0b9419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.934+0000 7f0b99010640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b94101420 0x7f0b9419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.934+0000 7f0b92d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94100a80 0x7f0b9419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.934+0000 7f0b92d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94100a80 0x7f0b9419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51032/0 (socket says 172.21.15.12:51032) 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.934+0000 7f0b99010640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b94106a80 0x7f0b9419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.934+0000 7f0b92d9d640 1 -- 172.21.15.12:0/367291107 learned_addr learned my addr 172.21.15.12:0/367291107 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.934+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9410fdd0 con 0x7f0b94100a80 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.934+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9410fc50 con 0x7f0b94106a80 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.934+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b94101420 0x7f0b9419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.934+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9410ff50 con 0x7f0b94101420 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.934+0000 7f0b9359e640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b94106a80 0x7f0b9419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.935+0000 7f0b92d9d640 1 -- 172.21.15.12:0/367291107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b94101420 msgr2=0x7f0b9419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.935+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b94101420 0x7f0b9419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.935+0000 7f0b92d9d640 1 -- 172.21.15.12:0/367291107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b94106a80 msgr2=0x7f0b9419edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:14.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.935+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b94106a80 0x7f0b9419edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.935+0000 7f0b92d9d640 1 -- 172.21.15.12:0/367291107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9419f4d0 con 0x7f0b94100a80 2024-09-19T06:54:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.935+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94100a80 0x7f0b9419a520 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400c920 tx=0x7f0b8400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.936+0000 7f0b90d99640 1 -- 172.21.15.12:0/367291107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84007c70 con 0x7f0b94100a80 2024-09-19T06:54:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.936+0000 7f0b90d99640 1 -- 172.21.15.12:0/367291107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b84007e10 con 0x7f0b94100a80 2024-09-19T06:54:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.936+0000 7f0b90d99640 1 -- 172.21.15.12:0/367291107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84018960 con 0x7f0b94100a80 2024-09-19T06:54:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.936+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9419f7c0 con 0x7f0b94100a80 2024-09-19T06:54:14.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.936+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b941a70a0 con 0x7f0b94100a80 2024-09-19T06:54:14.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.939+0000 7f0b9b3e9740 1 Processor -- start 2024-09-19T06:54:14.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.939+0000 7f0b9b3e9740 1 -- start start 2024-09-19T06:54:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.940+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de449350 0x5559de4478a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.940+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de448220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.940+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 0x5559de454f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.940+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5559de3a52f0 con 0x5559de447de0 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.940+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5559de34ccf0 con 0x5559de449350 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.940+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5559de3a12b0 con 0x5559de452b80 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.940+0000 7f0b92d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de448220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.940+0000 7f0b92d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de448220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51040/0 (socket says 172.21.15.12:51040) 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.940+0000 7f0b8bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 0x5559de454f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.940+0000 7f0b92d9d640 1 -- 172.21.15.12:0/2411073044 learned_addr learned my addr 172.21.15.12:0/2411073044 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.941+0000 7f0b9359e640 1 --2- 172.21.15.12:0/2411073044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de449350 0x5559de4478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.941+0000 7f0b92d9d640 1 -- 172.21.15.12:0/2411073044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 msgr2=0x5559de454f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.941+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/2411073044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 0x5559de454f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.941+0000 7f0b92d9d640 1 -- 172.21.15.12:0/2411073044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de449350 msgr2=0x5559de4478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.941+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/2411073044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de449350 0x5559de4478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.941+0000 7f0b92d9d640 1 -- 172.21.15.12:0/2411073044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559de3313a0 con 0x5559de447de0 2024-09-19T06:54:14.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.942+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/2411073044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de448220 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005e80 tx=0x7f0b8400f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed85837bfb0a714 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:14.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.945+0000 7f0b897fa640 1 -- 172.21.15.12:0/2411073044 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84031070 con 0x5559de447de0 2024-09-19T06:54:14.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.946+0000 7f0b897fa640 1 -- 172.21.15.12:0/2411073044 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b8402c460 con 0x5559de447de0 2024-09-19T06:54:14.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.947+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/2411073044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 msgr2=0x5559de448220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:14.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.947+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/2411073044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de448220 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005e80 tx=0x7f0b8400f450 comp rx=0 tx=0).stop 2024-09-19T06:54:14.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.947+0000 7f0b90d99640 1 -- 172.21.15.12:0/367291107 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0b8402a070 con 0x7f0b94100a80 2024-09-19T06:54:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.947+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/2411073044 shutdown_connections 2024-09-19T06:54:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.947+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/2411073044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 0x5559de454f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.947+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/2411073044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de448220 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.947+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/2411073044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de449350 0x5559de4478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.947+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/2411073044 >> 172.21.15.12:0/2411073044 conn(0x5559de408310 msgr2=0x5559de444470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.947+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/2411073044 shutdown_connections 2024-09-19T06:54:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.948+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/2411073044 wait complete. 2024-09-19T06:54:14.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.948+0000 7f0b90d99640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b800a32f0 0x7f0b800a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.948+0000 7f0b9b3e9740 1 -- start start 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.948+0000 7f0b90d99640 1 -- 172.21.15.12:0/367291107 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f0b840d40e0 con 0x7f0b94100a80 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9b3e9740 1 Processor -- start 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b800a32f0 0x7f0b800a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de447de0 0x5559de452490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de449350 0x5559de44f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de452b80 0x5559de44fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5559de455820 con 0x5559de452b80 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5559de360060 con 0x5559de447de0 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5559de4559a0 con 0x5559de449350 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9b3e9740 10 client.0 _ll_register_callbacks cb 0x5559de0b38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b8bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de449350 0x5559de44f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de452b80 0x5559de44fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b92d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de447de0 0x5559de452490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de452b80 0x5559de44fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51052/0 (socket says 172.21.15.12:51052) 2024-09-19T06:54:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b92d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de447de0 0x5559de452490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:59322/0 (socket says 172.21.15.12:59322) 2024-09-19T06:54:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b9359e640 1 -- 172.21.15.12:0/1436462589 learned_addr learned my addr 172.21.15.12:0/1436462589 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.949+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de449350 0x5559de44f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58398/0 (socket says 172.21.15.12:58398) 2024-09-19T06:54:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.950+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b800a32f0 0x7f0b800a57b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c000c00 tx=0x7f0b7c005b50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.950+0000 7f0b92d9d640 1 -- 172.21.15.12:0/1436462589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de449350 msgr2=0x5559de44f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.950+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de449350 0x5559de44f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.950+0000 7f0b92d9d640 1 -- 172.21.15.12:0/1436462589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de452b80 msgr2=0x5559de44fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.950+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de452b80 0x5559de44fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.950+0000 7f0b92d9d640 1 -- 172.21.15.12:0/1436462589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559de1163c0 con 0x5559de447de0 2024-09-19T06:54:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.950+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de447de0 0x5559de452490 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0b840d1730 tx=0x7f0b8409c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6ad5a7e836eb33b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.950+0000 7f0b7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:54:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.950+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/1436462589 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8409ff50 con 0x5559de447de0 2024-09-19T06:54:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.950+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/1436462589 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f0b840a0850 con 0x5559de447de0 2024-09-19T06:54:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.951+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1436462589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b8402c460 con 0x5559de447de0 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.951+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/1436462589 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f0b840d1bb0 con 0x5559de447de0 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.951+0000 7f0b9b3e9740 10 client.28694 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.951+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1436462589 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5559de4611e0 con 0x5559de447de0 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.951+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/1436462589 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b8402c460 con 0x5559de447de0 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.952+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/1436462589 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f0b84020030 con 0x5559de447de0 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.952+0000 7f0b9b3e9740 10 client.28694 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.952+0000 7f0b9b3e9740 10 client.28694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.952+0000 7f0b9b3e9740 20 client.28694 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.952+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5559de462530 0x5559de464920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.952+0000 7f0b9b3e9740 4 client.28694 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.952+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1436462589 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559de3b2860 con 0x5559de462530 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.952+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5559de462530 0x5559de464920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.953+0000 7f0b7a7fc640 10 client.28694 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.953+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5559de462530 0x5559de464920 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427e84d1f68b2582 server_cookie=74f22c73bac1f5bc in_seq=0 out_seq=0 2024-09-19T06:54:14.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.953+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/1436462589 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559de3b2860 con 0x5559de462530 2024-09-19T06:54:14.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.953+0000 7f0b7a7fc640 10 client.28694 handle_command_reply: tid=0 2024-09-19T06:54:14.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.953+0000 7f0b9b3e9740 1 client.28694 shutdown 2024-09-19T06:54:14.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.953+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1436462589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de447de0 msgr2=0x5559de452490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:14.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.953+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de447de0 0x5559de452490 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0b840d1730 tx=0x7f0b8409c890 comp rx=0 tx=0).stop 2024-09-19T06:54:14.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.954+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1436462589 shutdown_connections 2024-09-19T06:54:14.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.954+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5559de462530 0x5559de464920 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.954+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de452b80 0x5559de44fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.954+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de449350 0x5559de44f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.954+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/1436462589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de447de0 0x5559de452490 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.954+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1436462589 >> 172.21.15.12:0/1436462589 conn(0x5559de408310 msgr2=0x5559de44a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:14.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.954+0000 7f0b7a7fc640 0 client.28694 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:14.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.954+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1436462589 shutdown_connections 2024-09-19T06:54:14.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.954+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1436462589 wait complete. 2024-09-19T06:54:14.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.954+0000 7f0b9b3e9740 20 client.28694 trim_cache size 0 max 16384 2024-09-19T06:54:14.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.978+0000 7f0b9b3e9740 1 Processor -- start 2024-09-19T06:54:14.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.979+0000 7f0b9b3e9740 1 -- start start 2024-09-19T06:54:14.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.979+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de447de0 0x5559de44a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.979+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de449350 0x5559de44ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.979+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de452b80 0x5559de467560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.979+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0b941ab950 con 0x5559de449350 2024-09-19T06:54:14.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.979+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0b941ad550 con 0x5559de452b80 2024-09-19T06:54:14.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.979+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0b941ac020 con 0x5559de447de0 2024-09-19T06:54:14.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.980+0000 7f0b92d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de447de0 0x5559de44a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.980+0000 7f0b92d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de447de0 0x5559de44a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58414/0 (socket says 172.21.15.12:58414) 2024-09-19T06:54:14.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.980+0000 7f0b92d9d640 1 -- 172.21.15.12:0/1774687734 learned_addr learned my addr 172.21.15.12:0/1774687734 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:14.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.980+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/1774687734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de449350 0x5559de44ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.981+0000 7f0b8bfff640 1 -- 172.21.15.12:0/1774687734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de447de0 msgr2=0x5559de44a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:14.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.981+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/1774687734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de447de0 0x5559de44a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.981+0000 7f0b8bfff640 1 -- 172.21.15.12:0/1774687734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de452b80 msgr2=0x5559de467560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:14.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.981+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/1774687734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de452b80 0x5559de467560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.981+0000 7f0b8bfff640 1 -- 172.21.15.12:0/1774687734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559de44dcb0 con 0x5559de449350 2024-09-19T06:54:14.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.981+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/1774687734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de449350 0x5559de44ae70 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c02a9f0 tx=0x7f0b7c043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7b8a418976cf75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:14.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.988+0000 7f0b88ff9640 1 -- 172.21.15.12:0/1774687734 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c056070 con 0x5559de449350 2024-09-19T06:54:14.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.988+0000 7f0b88ff9640 1 -- 172.21.15.12:0/1774687734 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b7c031ce0 con 0x5559de449350 2024-09-19T06:54:14.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.988+0000 7f0b88ff9640 1 -- 172.21.15.12:0/1774687734 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c035040 con 0x5559de449350 2024-09-19T06:54:14.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.989+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1774687734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de449350 msgr2=0x5559de44ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:14.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.989+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/1774687734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de449350 0x5559de44ae70 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c02a9f0 tx=0x7f0b7c043000 comp rx=0 tx=0).stop 2024-09-19T06:54:14.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.993+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1774687734 shutdown_connections 2024-09-19T06:54:14.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.993+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/1774687734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de452b80 0x5559de467560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.993+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/1774687734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de449350 0x5559de44ae70 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.993+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/1774687734 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de447de0 0x5559de44a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:14.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.993+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1774687734 >> 172.21.15.12:0/1774687734 conn(0x5559de408310 msgr2=0x5559de44e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:14.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.995+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1774687734 shutdown_connections 2024-09-19T06:54:14.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.995+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/1774687734 wait complete. 2024-09-19T06:54:14.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.995+0000 7f0b9b3e9740 1 -- start start 2024-09-19T06:54:14.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.995+0000 7f0b9b3e9740 1 Processor -- start 2024-09-19T06:54:14.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.996+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de467860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.996+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de449350 0x5559de467da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.996+0000 7f0b9b3e9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 0x5559de462670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:14.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.996+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0b941ace80 con 0x5559de447de0 2024-09-19T06:54:14.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.996+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0b941ac6f0 con 0x5559de449350 2024-09-19T06:54:14.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.996+0000 7f0b9b3e9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0b941a9970 con 0x5559de452b80 2024-09-19T06:54:14.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.996+0000 7f0b9b3e9740 10 client.0 _ll_register_callbacks cb 0x7f0b8400fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:14.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.996+0000 7f0b92d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de467860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:14.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.996+0000 7f0b92d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de467860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51074/0 (socket says 172.21.15.12:51074) 2024-09-19T06:54:14.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.996+0000 7f0b92d9d640 1 -- 172.21.15.12:0/3196723118 learned_addr learned my addr 172.21.15.12:0/3196723118 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:15.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.997+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de449350 0x5559de467da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:15.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.998+0000 7f0b9359e640 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 0x5559de462670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:15.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.998+0000 7f0b92d9d640 1 -- 172.21.15.12:0/3196723118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 msgr2=0x5559de462670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:15.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.998+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 0x5559de462670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.998+0000 7f0b92d9d640 1 -- 172.21.15.12:0/3196723118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de449350 msgr2=0x5559de467da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:15.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.998+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de449350 0x5559de467da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.998+0000 7f0b92d9d640 1 -- 172.21.15.12:0/3196723118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559de462e40 con 0x5559de447de0 2024-09-19T06:54:15.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.998+0000 7f0b9359e640 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 0x5559de462670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:15.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.999+0000 7f0b92d9d640 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de467860 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0b8409ca50 tx=0x7f0b8400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9e40ab76d7d8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:15.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:14.999+0000 7f0b7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:54:15.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.000+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/3196723118 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b840be080 con 0x5559de447de0 2024-09-19T06:54:15.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.000+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/3196723118 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f0b8409fc40 con 0x5559de447de0 2024-09-19T06:54:15.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.000+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/3196723118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b7c031ce0 con 0x5559de447de0 2024-09-19T06:54:15.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.000+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/3196723118 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f0b8400fba0 con 0x5559de447de0 2024-09-19T06:54:15.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.000+0000 7f0b9b3e9740 10 client.19380 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:15.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.000+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/3196723118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5559de4410d0 con 0x5559de447de0 2024-09-19T06:54:15.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.001+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/3196723118 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b7c031ce0 con 0x5559de447de0 2024-09-19T06:54:15.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.001+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/3196723118 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f0b84081020 con 0x5559de447de0 2024-09-19T06:54:15.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.001+0000 7f0b9b3e9740 10 client.19380 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:15.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.001+0000 7f0b9b3e9740 10 client.19380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:15.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.001+0000 7f0b9b3e9740 20 client.19380 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:15.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.001+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5559de441640 0x5559de4d7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:15.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.001+0000 7f0b9b3e9740 4 client.19380 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:54:15.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.001+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/3196723118 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5559de450030 con 0x5559de441640 2024-09-19T06:54:15.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.001+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5559de441640 0x5559de4d7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:15.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.004+0000 7f0b7a7fc640 10 client.19380 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:15.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.004+0000 7f0b8bfff640 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5559de441640 0x5559de4d7e40 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9be7057348941959 server_cookie=683a3fefef8ffe88 in_seq=0 out_seq=0 2024-09-19T06:54:15.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.005+0000 7f0b7a7fc640 1 -- 172.21.15.12:0/3196723118 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5559de450030 con 0x5559de441640 2024-09-19T06:54:15.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.005+0000 7f0b7a7fc640 10 client.19380 handle_command_reply: tid=0 2024-09-19T06:54:15.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.005+0000 7f0b9b3e9740 1 client.19380 shutdown 2024-09-19T06:54:15.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.005+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/3196723118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 msgr2=0x5559de467860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:15.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.005+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de467860 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0b8409ca50 tx=0x7f0b8400cf50 comp rx=0 tx=0).stop 2024-09-19T06:54:15.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.008+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/3196723118 shutdown_connections 2024-09-19T06:54:15.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.008+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5559de441640 0x5559de4d7e40 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.008+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559de452b80 0x5559de462670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.008+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559de449350 0x5559de467da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.008+0000 7f0b9b3e9740 1 --2- 172.21.15.12:0/3196723118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559de447de0 0x5559de467860 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.008+0000 7f0b7a7fc640 0 client.19380 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:15.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.008+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/3196723118 >> 172.21.15.12:0/3196723118 conn(0x5559de408310 msgr2=0x5559de450fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:15.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.009+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/3196723118 shutdown_connections 2024-09-19T06:54:15.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.009+0000 7f0b9b3e9740 1 -- 172.21.15.12:0/3196723118 wait complete. 2024-09-19T06:54:15.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.010+0000 7f0b9b3e9740 20 client.19380 trim_cache size 0 max 16384 2024-09-19T06:54:15.012 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:54:15.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.010+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b800a32f0 msgr2=0x7f0b800a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:15.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.010+0000 7f0b99010640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b800a32f0 0x7f0b800a57b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c000c00 tx=0x7f0b7c005b50 comp rx=0 tx=0).stop 2024-09-19T06:54:15.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.010+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94100a80 msgr2=0x7f0b9419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:15.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.010+0000 7f0b99010640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94100a80 0x7f0b9419a520 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400c920 tx=0x7f0b8400cde0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.011+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 shutdown_connections 2024-09-19T06:54:15.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.011+0000 7f0b99010640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b94106a80 0x7f0b9419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.011+0000 7f0b99010640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0b800a32f0 0x7f0b800a57b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.011+0000 7f0b99010640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0b94101420 0x7f0b9419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.011+0000 7f0b99010640 1 --2- 172.21.15.12:0/367291107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b94100a80 0x7f0b9419a520 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:15.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.011+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 >> 172.21.15.12:0/367291107 conn(0x7f0b940fc7a0 msgr2=0x7f0b940fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:15.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.011+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 shutdown_connections 2024-09-19T06:54:15.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:15.011+0000 7f0b99010640 1 -- 172.21.15.12:0/367291107 wait complete. 2024-09-19T06:54:15.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 810.0 s, 1743.3 tps, lat 65.358 ms stddev 173.555 2024-09-19T06:54:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:15 smithi016 ceph-mon[34911]: pgmap v441: 97 pgs: 97 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 3.4 MiB/s wr, 433 op/s 2024-09-19T06:54:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:15 smithi016 ceph-mon[34911]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T06:54:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:15 smithi173 ceph-mon[35349]: pgmap v441: 97 pgs: 97 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 3.4 MiB/s wr, 433 op/s 2024-09-19T06:54:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:15 smithi173 ceph-mon[35349]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T06:54:16.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:15 smithi012 ceph-mon[30937]: pgmap v441: 97 pgs: 97 active+clean; 3.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 3.4 MiB/s wr, 433 op/s 2024-09-19T06:54:16.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:15 smithi012 ceph-mon[30937]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T06:54:17.449 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:54:17.449 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:54:17.839 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:18.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:17 smithi016 ceph-mon[34911]: pgmap v443: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 31 MiB/s wr, 2.12k op/s 2024-09-19T06:54:18.298 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:17 smithi012 ceph-mon[30937]: pgmap v443: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 31 MiB/s wr, 2.12k op/s 2024-09-19T06:54:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:17 smithi173 ceph-mon[35349]: pgmap v443: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 31 MiB/s wr, 2.12k op/s 2024-09-19T06:54:18.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.422+0000 7f18ca129640 1 -- 172.21.15.12:0/2367422054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18c4102d50 msgr2=0x7f18c4103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:18.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.422+0000 7f18ca129640 1 --2- 172.21.15.12:0/2367422054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18c4102d50 0x7f18c4103130 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009860 tx=0x7f18b402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.422+0000 7f18ca129640 1 -- 172.21.15.12:0/2367422054 shutdown_connections 2024-09-19T06:54:18.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.422+0000 7f18ca129640 1 --2- 172.21.15.12:0/2367422054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c410c180 0x7f18c410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.422+0000 7f18ca129640 1 --2- 172.21.15.12:0/2367422054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18c4103670 0x7f18c410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.422+0000 7f18ca129640 1 --2- 172.21.15.12:0/2367422054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18c4102d50 0x7f18c4103130 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.422+0000 7f18ca129640 1 -- 172.21.15.12:0/2367422054 >> 172.21.15.12:0/2367422054 conn(0x7f18c40fc7d0 msgr2=0x7f18c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.422+0000 7f18ca129640 1 -- 172.21.15.12:0/2367422054 shutdown_connections 2024-09-19T06:54:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.422+0000 7f18ca129640 1 -- 172.21.15.12:0/2367422054 wait complete. 2024-09-19T06:54:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18ca129640 1 Processor -- start 2024-09-19T06:54:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18ca129640 1 -- start start 2024-09-19T06:54:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18ca129640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18c4102d50 0x7f18c4108600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18ca129640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18c4103670 0x7f18c4108b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18ca129640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c410c180 0x7f18c41a4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18ca129640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f18c4101d30 con 0x7f18c4102d50 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18ca129640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18c4101bb0 con 0x7f18c4103670 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18ca129640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f18c4101eb0 con 0x7f18c410c180 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18c4102d50 0x7f18c4108600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18baffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18c4103670 0x7f18c4108b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18c4102d50 0x7f18c4108600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51080/0 (socket says 172.21.15.12:51080) 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18c37fe640 1 -- 172.21.15.12:0/656749554 learned_addr learned my addr 172.21.15.12:0/656749554 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.423+0000 7f18c3fff640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c410c180 0x7f18c41a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18baffd640 1 -- 172.21.15.12:0/656749554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c410c180 msgr2=0x7f18c41a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18baffd640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c410c180 0x7f18c41a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18baffd640 1 -- 172.21.15.12:0/656749554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18c4102d50 msgr2=0x7f18c4108600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18baffd640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18c4102d50 0x7f18c4108600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18baffd640 1 -- 172.21.15.12:0/656749554 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c41a4c40 con 0x7f18c4103670 2024-09-19T06:54:18.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18baffd640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18c4103670 0x7f18c4108b40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00e6c0 tx=0x7f18ac00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:18.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18c17fa640 1 -- 172.21.15.12:0/656749554 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00cab0 con 0x7f18c4103670 2024-09-19T06:54:18.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18c17fa640 1 -- 172.21.15.12:0/656749554 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18ac00cc50 con 0x7f18c4103670 2024-09-19T06:54:18.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18c17fa640 1 -- 172.21.15.12:0/656749554 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac018840 con 0x7f18c4103670 2024-09-19T06:54:18.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18ca129640 1 -- 172.21.15.12:0/656749554 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c41a4f30 con 0x7f18c4103670 2024-09-19T06:54:18.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.424+0000 7f18ca129640 1 -- 172.21.15.12:0/656749554 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c41ab5f0 con 0x7f18c4103670 2024-09-19T06:54:18.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.427+0000 7f18c17fa640 1 -- 172.21.15.12:0/656749554 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f18ac0189e0 con 0x7f18c4103670 2024-09-19T06:54:18.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.427+0000 7f18cc502740 1 Processor -- start 2024-09-19T06:54:18.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.427+0000 7f18cc502740 1 -- start start 2024-09-19T06:54:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18cc502740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 0x556ddd37cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18cc502740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 0x556ddd387800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18cc502740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 0x556ddd38a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18cc502740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556ddd2e2280 con 0x556ddd387d40 2024-09-19T06:54:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18cc502740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556ddd289b10 con 0x556ddd37cb60 2024-09-19T06:54:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18cc502740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556ddd2de240 con 0x556ddd37d480 2024-09-19T06:54:18.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18baffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 0x556ddd38a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18c37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 0x556ddd387800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18c3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 0x556ddd37cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18c37fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 0x556ddd387800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58432/0 (socket says 172.21.15.12:58432) 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18c37fe640 1 -- 172.21.15.12:0/4113508004 learned_addr learned my addr 172.21.15.12:0/4113508004 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.428+0000 7f18c17fa640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b00a33b0 0x7f18b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18baffd640 1 -- 172.21.15.12:0/4113508004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 msgr2=0x556ddd387800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18baffd640 1 --2- 172.21.15.12:0/4113508004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 0x556ddd387800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18baffd640 1 -- 172.21.15.12:0/4113508004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 msgr2=0x556ddd37cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18baffd640 1 --2- 172.21.15.12:0/4113508004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 0x556ddd37cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18baffd640 1 -- 172.21.15.12:0/4113508004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ddd2961f0 con 0x556ddd387d40 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18c3fff640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b00a33b0 0x7f18b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18baffd640 1 --2- 172.21.15.12:0/4113508004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 0x556ddd38a130 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0cd560 tx=0x7f18ac0ab930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ecba235bafb6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:18.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18c17fa640 1 -- 172.21.15.12:0/656749554 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f18ac0cff10 con 0x7f18c4103670 2024-09-19T06:54:18.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18b9ffb640 1 -- 172.21.15.12:0/4113508004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac026030 con 0x556ddd387d40 2024-09-19T06:54:18.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18c37fe640 1 --2- 172.21.15.12:0/4113508004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 0x556ddd387800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:18.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18b9ffb640 1 -- 172.21.15.12:0/4113508004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18ac00ce00 con 0x556ddd387d40 2024-09-19T06:54:18.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.429+0000 7f18b9ffb640 1 -- 172.21.15.12:0/4113508004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac098090 con 0x556ddd387d40 2024-09-19T06:54:18.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.430+0000 7f18cc502740 1 -- 172.21.15.12:0/4113508004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 msgr2=0x556ddd38a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.430+0000 7f18cc502740 1 --2- 172.21.15.12:0/4113508004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 0x556ddd38a130 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0cd560 tx=0x7f18ac0ab930 comp rx=0 tx=0).stop 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.430+0000 7f18c3fff640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b00a33b0 0x7f18b00a5870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18bc005fd0 tx=0x7f18bc004a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.430+0000 7f18cc502740 1 -- 172.21.15.12:0/4113508004 shutdown_connections 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.430+0000 7f18cc502740 1 --2- 172.21.15.12:0/4113508004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 0x556ddd38a130 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.430+0000 7f18cc502740 1 --2- 172.21.15.12:0/4113508004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 0x556ddd387800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.430+0000 7f18cc502740 1 --2- 172.21.15.12:0/4113508004 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 0x556ddd37cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.430+0000 7f18cc502740 1 -- 172.21.15.12:0/4113508004 >> 172.21.15.12:0/4113508004 conn(0x556ddd3790f0 msgr2=0x556ddd3794d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.431+0000 7f18cc502740 1 -- 172.21.15.12:0/4113508004 shutdown_connections 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.431+0000 7f18cc502740 1 -- 172.21.15.12:0/4113508004 wait complete. 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.431+0000 7f18cc502740 1 -- start start 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.431+0000 7f18cc502740 1 Processor -- start 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.432+0000 7f18cc502740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd387800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.432+0000 7f18cc502740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 0x556ddd384b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.432+0000 7f18cc502740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd387d40 0x556ddd3852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.432+0000 7f18cc502740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556ddd38a910 con 0x556ddd37cb60 2024-09-19T06:54:18.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.432+0000 7f18c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd387800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.432+0000 7f18c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd387800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51094/0 (socket says 172.21.15.12:51094) 2024-09-19T06:54:18.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.432+0000 7f18c37fe640 1 -- 172.21.15.12:0/3060230287 learned_addr learned my addr 172.21.15.12:0/3060230287 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:18.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.432+0000 7f18cc502740 1 -- 172.21.15.12:0/3060230287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x556ddd29cf10 con 0x556ddd37d480 2024-09-19T06:54:18.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.432+0000 7f18baffd640 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 0x556ddd384b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.435+0000 7f18c3fff640 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd387d40 0x556ddd3852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.435+0000 7f18cc502740 1 -- 172.21.15.12:0/3060230287 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556ddd38aa90 con 0x556ddd387d40 2024-09-19T06:54:18.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.435+0000 7f18cc502740 10 client.0 _ll_register_callbacks cb 0x556ddd265a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.435+0000 7f18baffd640 1 -- 172.21.15.12:0/3060230287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd387d40 msgr2=0x556ddd3852e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.435+0000 7f18baffd640 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd387d40 0x556ddd3852e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.435+0000 7f18baffd640 1 -- 172.21.15.12:0/3060230287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 msgr2=0x556ddd387800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.435+0000 7f18baffd640 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd387800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.435+0000 7f18baffd640 1 -- 172.21.15.12:0/3060230287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ddd0536a0 con 0x556ddd37d480 2024-09-19T06:54:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.436+0000 7f18baffd640 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 0x556ddd384b50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x556ddd37a470 tx=0x7f18ac0d3560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d83b9ee30398cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.436+0000 7f18a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:54:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.436+0000 7f18a2ffd640 1 -- 172.21.15.12:0/3060230287 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac09bf70 con 0x556ddd37d480 2024-09-19T06:54:18.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.437+0000 7f18a2ffd640 1 -- 172.21.15.12:0/3060230287 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f18ac0b1bd0 con 0x556ddd37d480 2024-09-19T06:54:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.437+0000 7f18cc502740 1 -- 172.21.15.12:0/3060230287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ddd2ef7f0 con 0x556ddd37d480 2024-09-19T06:54:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.437+0000 7f18a2ffd640 1 -- 172.21.15.12:0/3060230287 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f18ac09bb00 con 0x556ddd37d480 2024-09-19T06:54:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.437+0000 7f18cc502740 10 client.28709 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.437+0000 7f18cc502740 1 -- 172.21.15.12:0/3060230287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x556ddd396460 con 0x556ddd37d480 2024-09-19T06:54:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.438+0000 7f18a2ffd640 1 -- 172.21.15.12:0/3060230287 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18ac098090 con 0x556ddd37d480 2024-09-19T06:54:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.438+0000 7f18a2ffd640 1 -- 172.21.15.12:0/3060230287 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f18ac0a0100 con 0x556ddd37d480 2024-09-19T06:54:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.438+0000 7f18cc502740 10 client.28709 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.438+0000 7f18cc502740 10 client.28709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.438+0000 7f18cc502740 20 client.28709 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.438+0000 7f18cc502740 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ddd3977b0 0x556ddd399ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.438+0000 7f18cc502740 4 client.28709 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.438+0000 7f18cc502740 1 -- 172.21.15.12:0/3060230287 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ddd2ef7f0 con 0x556ddd3977b0 2024-09-19T06:54:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.439+0000 7f18c37fe640 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ddd3977b0 0x556ddd399ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.440+0000 7f18c37fe640 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ddd3977b0 0x556ddd399ba0 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c726a7fc592a7d5 server_cookie=f03cc05087fc9154 in_seq=0 out_seq=0 2024-09-19T06:54:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.440+0000 7f18a2ffd640 10 client.28709 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:18.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18a2ffd640 1 -- 172.21.15.12:0/3060230287 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ddd2ef7f0 con 0x556ddd3977b0 2024-09-19T06:54:18.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18a2ffd640 10 client.28709 handle_command_reply: tid=0 2024-09-19T06:54:18.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18cc502740 1 client.28709 shutdown 2024-09-19T06:54:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18cc502740 1 -- 172.21.15.12:0/3060230287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 msgr2=0x556ddd384b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18cc502740 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 0x556ddd384b50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x556ddd37a470 tx=0x7f18ac0d3560 comp rx=0 tx=0).stop 2024-09-19T06:54:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18cc502740 1 -- 172.21.15.12:0/3060230287 shutdown_connections 2024-09-19T06:54:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18cc502740 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ddd3977b0 0x556ddd399ba0 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18cc502740 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd387d40 0x556ddd3852e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18cc502740 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 0x556ddd384b50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18cc502740 1 --2- 172.21.15.12:0/3060230287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd387800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18cc502740 1 -- 172.21.15.12:0/3060230287 >> 172.21.15.12:0/3060230287 conn(0x556ddd3790f0 msgr2=0x556ddd37ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:18.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.442+0000 7f18a2ffd640 0 client.28709 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:18.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.443+0000 7f18cc502740 1 -- 172.21.15.12:0/3060230287 shutdown_connections 2024-09-19T06:54:18.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.443+0000 7f18cc502740 1 -- 172.21.15.12:0/3060230287 wait complete. 2024-09-19T06:54:18.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.444+0000 7f18cc502740 20 client.28709 trim_cache size 0 max 16384 2024-09-19T06:54:18.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.468+0000 7f18cc502740 1 Processor -- start 2024-09-19T06:54:18.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.468+0000 7f18cc502740 1 -- start start 2024-09-19T06:54:18.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18cc502740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd383b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18cc502740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 0x556ddd39f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd383b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18cc502740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd387d40 0x556ddd39f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd383b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51100/0 (socket says 172.21.15.12:51100) 2024-09-19T06:54:18.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18cc502740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f18c41b4230 con 0x556ddd37cb60 2024-09-19T06:54:18.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18cc502740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18c41b5e30 con 0x556ddd37d480 2024-09-19T06:54:18.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18cc502740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f18c41b4900 con 0x556ddd387d40 2024-09-19T06:54:18.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18c37fe640 1 -- 172.21.15.12:0/4246031986 learned_addr learned my addr 172.21.15.12:0/4246031986 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:18.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18baffd640 1 --2- 172.21.15.12:0/4246031986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 0x556ddd39f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.469+0000 7f18c3fff640 1 --2- 172.21.15.12:0/4246031986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd387d40 0x556ddd39f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.470+0000 7f18baffd640 1 -- 172.21.15.12:0/4246031986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd387d40 msgr2=0x556ddd39f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.470+0000 7f18baffd640 1 --2- 172.21.15.12:0/4246031986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd387d40 0x556ddd39f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.470+0000 7f18baffd640 1 -- 172.21.15.12:0/4246031986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 msgr2=0x556ddd383b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.470+0000 7f18baffd640 1 --2- 172.21.15.12:0/4246031986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd383b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.470+0000 7f18baffd640 1 -- 172.21.15.12:0/4246031986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ddd374830 con 0x556ddd37d480 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.470+0000 7f18c37fe640 1 --2- 172.21.15.12:0/4246031986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd383b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.470+0000 7f18baffd640 1 --2- 172.21.15.12:0/4246031986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 0x556ddd39f140 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f18ac000c00 tx=0x7f18ac0d39c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baf3f4b860c1f3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.470+0000 7f18b97fa640 1 -- 172.21.15.12:0/4246031986 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac09bce0 con 0x556ddd37d480 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.470+0000 7f18b97fa640 1 -- 172.21.15.12:0/4246031986 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18ac098090 con 0x556ddd37d480 2024-09-19T06:54:18.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.470+0000 7f18b97fa640 1 -- 172.21.15.12:0/4246031986 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0b1bd0 con 0x556ddd37d480 2024-09-19T06:54:18.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.471+0000 7f18cc502740 1 -- 172.21.15.12:0/4246031986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 msgr2=0x556ddd39f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:18.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.471+0000 7f18cc502740 1 --2- 172.21.15.12:0/4246031986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 0x556ddd39f140 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f18ac000c00 tx=0x7f18ac0d39c0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.471+0000 7f18cc502740 1 -- 172.21.15.12:0/4246031986 shutdown_connections 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.471+0000 7f18cc502740 1 --2- 172.21.15.12:0/4246031986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd387d40 0x556ddd39f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.471+0000 7f18cc502740 1 --2- 172.21.15.12:0/4246031986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37d480 0x556ddd39f140 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.471+0000 7f18cc502740 1 --2- 172.21.15.12:0/4246031986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd37cb60 0x556ddd383b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.471+0000 7f18cc502740 1 -- 172.21.15.12:0/4246031986 >> 172.21.15.12:0/4246031986 conn(0x556ddd3790f0 msgr2=0x556ddd383420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.471+0000 7f18cc502740 1 -- 172.21.15.12:0/4246031986 shutdown_connections 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.471+0000 7f18cc502740 1 -- 172.21.15.12:0/4246031986 wait complete. 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.472+0000 7f18cc502740 1 -- start start 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.472+0000 7f18cc502740 1 Processor -- start 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.472+0000 7f18cc502740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 0x556ddd38b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18cc502740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 0x556ddd38bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18cc502740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 0x556ddd38c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18c37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 0x556ddd38b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18cc502740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f18c41b5760 con 0x556ddd387d40 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18cc502740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18c41b4fd0 con 0x556ddd37cb60 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18cc502740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f18c41b2210 con 0x556ddd37d480 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18c37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 0x556ddd38b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:59418/0 (socket says 172.21.15.12:59418) 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18c37fe640 1 -- 172.21.15.12:0/1332836976 learned_addr learned my addr 172.21.15.12:0/1332836976 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18baffd640 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 0x556ddd38bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18c3fff640 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 0x556ddd38c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18cc502740 10 client.0 _ll_register_callbacks cb 0x7f18bc009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18c37fe640 1 -- 172.21.15.12:0/1332836976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 msgr2=0x556ddd38bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18c37fe640 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 0x556ddd38bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18c37fe640 1 -- 172.21.15.12:0/1332836976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 msgr2=0x556ddd38c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18c37fe640 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 0x556ddd38c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.473+0000 7f18c37fe640 1 -- 172.21.15.12:0/1332836976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ddd387b70 con 0x556ddd37cb60 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.474+0000 7f18c37fe640 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 0x556ddd38b9c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f18b4030f50 tx=0x7f18b4030f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cbe266a9ca30d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.474+0000 7f18a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.474+0000 7f18a2ffd640 1 -- 172.21.15.12:0/1332836976 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4030870 con 0x556ddd37cb60 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.474+0000 7f18a2ffd640 1 -- 172.21.15.12:0/1332836976 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f18b4004030 con 0x556ddd37cb60 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.474+0000 7f18cc502740 1 -- 172.21.15.12:0/1332836976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18ac098090 con 0x556ddd37cb60 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.474+0000 7f18a2ffd640 1 -- 172.21.15.12:0/1332836976 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f18b4059050 con 0x556ddd37cb60 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.474+0000 7f18cc502740 10 client.28715 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.474+0000 7f18cc502740 1 -- 172.21.15.12:0/1332836976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x556ddd402180 con 0x556ddd37cb60 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.474+0000 7f18a2ffd640 1 -- 172.21.15.12:0/1332836976 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18b4005520 con 0x556ddd37cb60 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.475+0000 7f18a2ffd640 1 -- 172.21.15.12:0/1332836976 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f18b4050070 con 0x556ddd37cb60 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.475+0000 7f18cc502740 10 client.28715 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.475+0000 7f18cc502740 10 client.28715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:18.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.475+0000 7f18cc502740 20 client.28715 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:18.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.475+0000 7f18cc502740 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ddd402900 0x556ddd404d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:18.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.475+0000 7f18cc502740 4 client.28715 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:54:18.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.475+0000 7f18cc502740 1 -- 172.21.15.12:0/1332836976 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f18ac098090 con 0x556ddd402900 2024-09-19T06:54:18.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.475+0000 7f18baffd640 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ddd402900 0x556ddd404d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:18.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.475+0000 7f18baffd640 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ddd402900 0x556ddd404d20 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10306301f0a6f6d6 server_cookie=d4cabb8040905f68 in_seq=0 out_seq=0 2024-09-19T06:54:18.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.475+0000 7f18a2ffd640 10 client.28715 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:18.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.476+0000 7f18a2ffd640 1 -- 172.21.15.12:0/1332836976 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f18ac098090 con 0x556ddd402900 2024-09-19T06:54:18.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.476+0000 7f18a2ffd640 10 client.28715 handle_command_reply: tid=0 2024-09-19T06:54:18.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.476+0000 7f18cc502740 1 client.28715 shutdown 2024-09-19T06:54:18.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.476+0000 7f18cc502740 1 -- 172.21.15.12:0/1332836976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 msgr2=0x556ddd38b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.476+0000 7f18cc502740 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 0x556ddd38b9c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f18b4030f50 tx=0x7f18b4030f80 comp rx=0 tx=0).stop 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.477+0000 7f18cc502740 1 -- 172.21.15.12:0/1332836976 shutdown_connections 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.477+0000 7f18cc502740 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x556ddd402900 0x556ddd404d20 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.477+0000 7f18cc502740 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556ddd387d40 0x556ddd38c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.477+0000 7f18cc502740 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556ddd37d480 0x556ddd38bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.477+0000 7f18cc502740 1 --2- 172.21.15.12:0/1332836976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x556ddd37cb60 0x556ddd38b9c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.477+0000 7f18cc502740 1 -- 172.21.15.12:0/1332836976 >> 172.21.15.12:0/1332836976 conn(0x556ddd3790f0 msgr2=0x556ddd383c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.477+0000 7f18a2ffd640 0 client.28715 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.477+0000 7f18cc502740 1 -- 172.21.15.12:0/1332836976 shutdown_connections 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.478+0000 7f18cc502740 1 -- 172.21.15.12:0/1332836976 wait complete. 2024-09-19T06:54:18.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.478+0000 7f18cc502740 20 client.28715 trim_cache size 0 max 16384 2024-09-19T06:54:18.484 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:54:18.484 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:54:18.484 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "358db63a-33c9-4d78-8edb-f910733749da", 2024-09-19T06:54:18.484 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:54:18.484 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:54:18.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 -- 172.21.15.12:0/656749554 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b00a33b0 msgr2=0x7f18b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:18.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b00a33b0 0x7f18b00a5870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f18bc005fd0 tx=0x7f18bc004a40 comp rx=0 tx=0).stop 2024-09-19T06:54:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 -- 172.21.15.12:0/656749554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18c4103670 msgr2=0x7f18c4108b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18c4103670 0x7f18c4108b40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00e6c0 tx=0x7f18ac00eb80 comp rx=0 tx=0).stop 2024-09-19T06:54:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 -- 172.21.15.12:0/656749554 shutdown_connections 2024-09-19T06:54:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b00a33b0 0x7f18b00a5870 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18c410c180 0x7f18c41a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18c4103670 0x7f18c4108b40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 --2- 172.21.15.12:0/656749554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18c4102d50 0x7f18c4108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 -- 172.21.15.12:0/656749554 >> 172.21.15.12:0/656749554 conn(0x7f18c40fc7d0 msgr2=0x7f18c40fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 -- 172.21.15.12:0/656749554 shutdown_connections 2024-09-19T06:54:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:18.479+0000 7f18ca129640 1 -- 172.21.15.12:0/656749554 wait complete. 2024-09-19T06:54:19.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:18 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:54:19.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:18 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:18 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:54:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:18 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:54:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:18 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:18 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:54:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:18 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:54:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:18 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:18 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:18 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:54:19.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:18 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:18 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:54:19.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:18 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:54:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:18 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:18 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:54:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:18 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:54:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:18 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:18 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.352 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:18 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:54:19.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:18 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:18 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:54:19.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:18 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:54:19.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:18 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:18 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:54:19.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:18 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:54:19.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:18 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.353 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:18 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:19.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:54:19.783 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:20.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:19 smithi016 ceph-mon[34911]: pgmap v444: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 25 MiB/s wr, 1.72k op/s 2024-09-19T06:54:20.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:19 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:54:20.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:19 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:54:20.261 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:19 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:19 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:19 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:19 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:19 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:19 smithi012 ceph-mon[30937]: pgmap v444: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 25 MiB/s wr, 1.72k op/s 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:19 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:19 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:19 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:19 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:19 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:19 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.262 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:19 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:19 smithi173 ceph-mon[35349]: pgmap v444: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 25 MiB/s wr, 1.72k op/s 2024-09-19T06:54:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:19 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:54:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:19 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:54:20.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:19 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:19 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:54:20.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:19 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:19 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:19 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:54:20.688 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:54:20.689 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:54:20.689 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:54:20.689 INFO:teuthology.orchestra.run.smithi012.stdout: "358db63a-33c9-4d78-8edb-f910733749da": { 2024-09-19T06:54:20.689 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:54:20.689 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "358db63a-33c9-4d78-8edb-f910733749da", 2024-09-19T06:54:20.689 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:54:20.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:54:20.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:54:20.690 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:54:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.383+0000 7f9be41a4640 1 -- 172.21.15.12:0/1084226569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bdc1036e0 msgr2=0x7f9bdc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.383+0000 7f9be41a4640 1 --2- 172.21.15.12:0/1084226569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bdc1036e0 0x7f9bdc107b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009900 tx=0x7f9bcc02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.384+0000 7f9be41a4640 1 -- 172.21.15.12:0/1084226569 shutdown_connections 2024-09-19T06:54:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.384+0000 7f9be41a4640 1 --2- 172.21.15.12:0/1084226569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bdc1082a0 0x7f9bdc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.384+0000 7f9be41a4640 1 --2- 172.21.15.12:0/1084226569 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bdc1036e0 0x7f9bdc107b90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.384+0000 7f9be41a4640 1 --2- 172.21.15.12:0/1084226569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bdc102d30 0x7f9bdc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.384+0000 7f9be41a4640 1 -- 172.21.15.12:0/1084226569 >> 172.21.15.12:0/1084226569 conn(0x7f9bdc0fc7d0 msgr2=0x7f9bdc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.384+0000 7f9be41a4640 1 -- 172.21.15.12:0/1084226569 shutdown_connections 2024-09-19T06:54:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.384+0000 7f9be41a4640 1 -- 172.21.15.12:0/1084226569 wait complete. 2024-09-19T06:54:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.384+0000 7f9be41a4640 1 Processor -- start 2024-09-19T06:54:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.385+0000 7f9be41a4640 1 -- start start 2024-09-19T06:54:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.385+0000 7f9be41a4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bdc102d30 0x7f9bdc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.385+0000 7f9be41a4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bdc1036e0 0x7f9bdc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.385+0000 7f9be41a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bdc1082a0 0x7f9bdc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.385+0000 7f9be1f40640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bdc102d30 0x7f9bdc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.385+0000 7f9be1f40640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bdc102d30 0x7f9bdc100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58492/0 (socket says 172.21.15.12:58492) 2024-09-19T06:54:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.385+0000 7f9be1f40640 1 -- 172.21.15.12:0/1005083533 learned_addr learned my addr 172.21.15.12:0/1005083533 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:20.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.386+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1120b0 con 0x7f9bdc1082a0 2024-09-19T06:54:20.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.386+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc111f30 con 0x7f9bdc1036e0 2024-09-19T06:54:20.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.386+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc112230 con 0x7f9bdc102d30 2024-09-19T06:54:20.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.386+0000 7f9be173f640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bdc1036e0 0x7f9bdc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.387+0000 7f9be1f40640 1 -- 172.21.15.12:0/1005083533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bdc1036e0 msgr2=0x7f9bdc100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:20.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.387+0000 7f9be1f40640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bdc1036e0 0x7f9bdc100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.387+0000 7f9be1f40640 1 -- 172.21.15.12:0/1005083533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bdc1082a0 msgr2=0x7f9bdc101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:20.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.387+0000 7f9be1f40640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bdc1082a0 0x7f9bdc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.387+0000 7f9be1f40640 1 -- 172.21.15.12:0/1005083533 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc198390 con 0x7f9bdc102d30 2024-09-19T06:54:20.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.387+0000 7f9be1f40640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bdc102d30 0x7f9bdc100990 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800e9f0 tx=0x7f9bd800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:20.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.387+0000 7f9bd2ffd640 1 -- 172.21.15.12:0/1005083533 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd800cd80 con 0x7f9bdc102d30 2024-09-19T06:54:20.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.387+0000 7f9bd2ffd640 1 -- 172.21.15.12:0/1005083533 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bd8010910 con 0x7f9bdc102d30 2024-09-19T06:54:20.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.387+0000 7f9bd2ffd640 1 -- 172.21.15.12:0/1005083533 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8018980 con 0x7f9bdc102d30 2024-09-19T06:54:20.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.388+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc198680 con 0x7f9bdc102d30 2024-09-19T06:54:20.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.388+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bdc198a80 con 0x7f9bdc102d30 2024-09-19T06:54:20.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.392+0000 7f9be657d740 1 Processor -- start 2024-09-19T06:54:20.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.392+0000 7f9bd2ffd640 1 -- 172.21.15.12:0/1005083533 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9bd8010430 con 0x7f9bdc102d30 2024-09-19T06:54:20.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.392+0000 7f9be657d740 1 -- start start 2024-09-19T06:54:20.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be657d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634ea880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be657d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634eadc0 0x5587634f5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be657d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be657d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5587634502e0 con 0x5587634f5680 2024-09-19T06:54:20.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be657d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5587633f7ce0 con 0x5587634eadc0 2024-09-19T06:54:20.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be657d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55876344c2a0 con 0x5587634ea4a0 2024-09-19T06:54:20.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be1f40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634eadc0 0x5587634f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be173f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be2741640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634ea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be173f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51140/0 (socket says 172.21.15.12:51140) 2024-09-19T06:54:20.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be2741640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634ea880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58502/0 (socket says 172.21.15.12:58502) 2024-09-19T06:54:20.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be173f640 1 -- 172.21.15.12:0/265929865 learned_addr learned my addr 172.21.15.12:0/265929865 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:20.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be173f640 1 -- 172.21.15.12:0/265929865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 msgr2=0x5587634ea880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:20.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be173f640 1 --2- 172.21.15.12:0/265929865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634ea880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be173f640 1 -- 172.21.15.12:0/265929865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634eadc0 msgr2=0x5587634f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:20.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be173f640 1 --2- 172.21.15.12:0/265929865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634eadc0 0x5587634f5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be173f640 1 -- 172.21.15.12:0/265929865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587633dc440 con 0x5587634f5680 2024-09-19T06:54:20.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.393+0000 7f9be2741640 1 --2- 172.21.15.12:0/265929865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634ea880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:20.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.394+0000 7f9bd2ffd640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bc80a34b0 0x7f9bc80a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.394+0000 7f9bd2ffd640 1 -- 172.21.15.12:0/1005083533 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f9bd80d0190 con 0x7f9bdc102d30 2024-09-19T06:54:20.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.394+0000 7f9be173f640 1 --2- 172.21.15.12:0/265929865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f7a70 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009900 tx=0x7f9bcc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea7c093d40a19f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:20.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.396+0000 7f9be2741640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bc80a34b0 0x7f9bc80a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.396+0000 7f9bc7fff640 1 -- 172.21.15.12:0/265929865 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc035040 con 0x5587634f5680 2024-09-19T06:54:20.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.396+0000 7f9bc7fff640 1 -- 172.21.15.12:0/265929865 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bcc005520 con 0x5587634f5680 2024-09-19T06:54:20.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.396+0000 7f9bc7fff640 1 -- 172.21.15.12:0/265929865 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0035f0 con 0x5587634f5680 2024-09-19T06:54:20.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.397+0000 7f9be657d740 1 -- 172.21.15.12:0/265929865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 msgr2=0x5587634f7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:20.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.397+0000 7f9be657d740 1 --2- 172.21.15.12:0/265929865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f7a70 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009900 tx=0x7f9bcc005fd0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.397+0000 7f9be2741640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bc80a34b0 0x7f9bc80a5970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4005c40 tx=0x7f9bd4005bd0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:20.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.397+0000 7f9be657d740 1 -- 172.21.15.12:0/265929865 shutdown_connections 2024-09-19T06:54:20.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.397+0000 7f9be657d740 1 --2- 172.21.15.12:0/265929865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f7a70 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.397+0000 7f9be657d740 1 --2- 172.21.15.12:0/265929865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634eadc0 0x5587634f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.397+0000 7f9be657d740 1 --2- 172.21.15.12:0/265929865 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634ea880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.397+0000 7f9be657d740 1 -- 172.21.15.12:0/265929865 >> 172.21.15.12:0/265929865 conn(0x5587634e6a30 msgr2=0x5587634e6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:20.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.399+0000 7f9be657d740 1 -- 172.21.15.12:0/265929865 shutdown_connections 2024-09-19T06:54:20.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.399+0000 7f9be657d740 1 -- 172.21.15.12:0/265929865 wait complete. 2024-09-19T06:54:20.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.399+0000 7f9be657d740 1 -- start start 2024-09-19T06:54:20.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.399+0000 7f9be657d740 1 Processor -- start 2024-09-19T06:54:20.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be657d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587634f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be657d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634eadc0 0x5587634f2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be657d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be657d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5587634f8250 con 0x5587634f5680 2024-09-19T06:54:20.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be657d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55876340b050 con 0x5587634ea4a0 2024-09-19T06:54:20.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be657d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5587634f83d0 con 0x5587634eadc0 2024-09-19T06:54:20.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be657d740 10 client.0 _ll_register_callbacks cb 0x55876344b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:20.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be173f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634eadc0 0x5587634f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be1f40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587634f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be2741640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be1f40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587634f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:59458/0 (socket says 172.21.15.12:59458) 2024-09-19T06:54:20.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.400+0000 7f9be1f40640 1 -- 172.21.15.12:0/2282130423 learned_addr learned my addr 172.21.15.12:0/2282130423 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:20.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.401+0000 7f9be2741640 1 -- 172.21.15.12:0/2282130423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634eadc0 msgr2=0x5587634f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:20.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.401+0000 7f9be2741640 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634eadc0 0x5587634f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.401+0000 7f9be2741640 1 -- 172.21.15.12:0/2282130423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 msgr2=0x5587634f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:20.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.401+0000 7f9be2741640 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587634f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.401+0000 7f9be2741640 1 -- 172.21.15.12:0/2282130423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587631c13c0 con 0x5587634f5680 2024-09-19T06:54:20.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.401+0000 7f9be1f40640 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587634f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:20.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.401+0000 7f9be2741640 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f2790 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4005fd0 tx=0x7f9bd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614177069cd66762 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.401+0000 7f9bc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.402+0000 7f9bc57fa640 1 -- 172.21.15.12:0/2282130423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4022070 con 0x5587634f5680 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.402+0000 7f9bc57fa640 1 -- 172.21.15.12:0/2282130423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f9bd400e910 con 0x5587634f5680 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.402+0000 7f9be657d740 1 -- 172.21.15.12:0/2282130423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bcc005520 con 0x5587634f5680 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.402+0000 7f9bc57fa640 1 -- 172.21.15.12:0/2282130423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9bd402e050 con 0x5587634f5680 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.402+0000 7f9be657d740 10 client.19407 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.402+0000 7f9be657d740 1 -- 172.21.15.12:0/2282130423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558763503c30 con 0x5587634f5680 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.404+0000 7f9bc57fa640 1 -- 172.21.15.12:0/2282130423 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bd4003e40 con 0x5587634f5680 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.404+0000 7f9bc57fa640 1 -- 172.21.15.12:0/2282130423 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f9bd401e420 con 0x5587634f5680 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.404+0000 7f9be657d740 10 client.19407 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.404+0000 7f9be657d740 10 client.19407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.404+0000 7f9be657d740 20 client.19407 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:20.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.404+0000 7f9be657d740 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558763505040 0x558763507490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.404+0000 7f9be657d740 4 client.19407 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.404+0000 7f9be657d740 1 -- 172.21.15.12:0/2282130423 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9bcc005520 con 0x558763505040 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.405+0000 7f9be1f40640 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558763505040 0x558763507490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.405+0000 7f9bc57fa640 10 client.19407 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.405+0000 7f9be1f40640 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558763505040 0x558763507490 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41e795bc0e91c68b server_cookie=86eb829403e7d0b8 in_seq=0 out_seq=0 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9bc57fa640 1 -- 172.21.15.12:0/2282130423 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9bcc005520 con 0x558763505040 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9bc57fa640 10 client.19407 handle_command_reply: tid=0 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9be657d740 1 client.19407 shutdown 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9be657d740 1 -- 172.21.15.12:0/2282130423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 msgr2=0x5587634f2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9be657d740 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f2790 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4005fd0 tx=0x7f9bd4004a40 comp rx=0 tx=0).stop 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9be657d740 1 -- 172.21.15.12:0/2282130423 shutdown_connections 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9be657d740 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558763505040 0x558763507490 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9bc57fa640 0 client.19407 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9be657d740 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634f5680 0x5587634f2790 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9be657d740 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634eadc0 0x5587634f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9be657d740 1 --2- 172.21.15.12:0/2282130423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587634f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9be657d740 1 -- 172.21.15.12:0/2282130423 >> 172.21.15.12:0/2282130423 conn(0x5587634e6a30 msgr2=0x5587634ec710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.406+0000 7f9be657d740 1 -- 172.21.15.12:0/2282130423 shutdown_connections 2024-09-19T06:54:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.407+0000 7f9be657d740 1 -- 172.21.15.12:0/2282130423 wait complete. 2024-09-19T06:54:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.407+0000 7f9be657d740 20 client.19407 trim_cache size 0 max 16384 2024-09-19T06:54:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.438+0000 7f9be657d740 1 Processor -- start 2024-09-19T06:54:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.438+0000 7f9be657d740 1 -- start start 2024-09-19T06:54:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be657d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587635014b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be657d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 0x5587634f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be657d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634f5680 0x55876350cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be1f40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587635014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be1f40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587635014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:59462/0 (socket says 172.21.15.12:59462) 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be1f40640 1 -- 172.21.15.12:0/2160259557 learned_addr learned my addr 172.21.15.12:0/2160259557 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be657d740 1 -- 172.21.15.12:0/2160259557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b4160 con 0x5587634eadc0 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be657d740 1 -- 172.21.15.12:0/2160259557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b5d60 con 0x5587634ea4a0 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be657d740 1 -- 172.21.15.12:0/2160259557 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b4830 con 0x5587634f5680 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be173f640 1 --2- 172.21.15.12:0/2160259557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 0x5587634f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be1f40640 1 -- 172.21.15.12:0/2160259557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634f5680 msgr2=0x55876350cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be1f40640 1 --2- 172.21.15.12:0/2160259557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634f5680 0x55876350cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be1f40640 1 -- 172.21.15.12:0/2160259557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 msgr2=0x5587634f0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:20.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be1f40640 1 --2- 172.21.15.12:0/2160259557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 0x5587634f0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be1f40640 1 -- 172.21.15.12:0/2160259557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587634f1200 con 0x5587634ea4a0 2024-09-19T06:54:20.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.439+0000 7f9be173f640 1 --2- 172.21.15.12:0/2160259557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 0x5587634f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:20.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.440+0000 7f9be1f40640 1 --2- 172.21.15.12:0/2160259557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587635014b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9bd809c070 tx=0x7f9bd80bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52f8b1bb3f0513 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:20.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.440+0000 7f9bc77fe640 1 -- 172.21.15.12:0/2160259557 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd809beb0 con 0x5587634ea4a0 2024-09-19T06:54:20.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.440+0000 7f9bc77fe640 1 -- 172.21.15.12:0/2160259557 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bd809ca70 con 0x5587634ea4a0 2024-09-19T06:54:20.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.440+0000 7f9bc77fe640 1 -- 172.21.15.12:0/2160259557 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd809bcd0 con 0x5587634ea4a0 2024-09-19T06:54:20.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.441+0000 7f9be657d740 1 -- 172.21.15.12:0/2160259557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 msgr2=0x5587635014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:20.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.441+0000 7f9be657d740 1 --2- 172.21.15.12:0/2160259557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587635014b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9bd809c070 tx=0x7f9bd80bc040 comp rx=0 tx=0).stop 2024-09-19T06:54:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.441+0000 7f9be657d740 1 -- 172.21.15.12:0/2160259557 shutdown_connections 2024-09-19T06:54:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.441+0000 7f9be657d740 1 --2- 172.21.15.12:0/2160259557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634f5680 0x55876350cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.441+0000 7f9be657d740 1 --2- 172.21.15.12:0/2160259557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 0x5587634f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.441+0000 7f9be657d740 1 --2- 172.21.15.12:0/2160259557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634ea4a0 0x5587635014b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.441+0000 7f9be657d740 1 -- 172.21.15.12:0/2160259557 >> 172.21.15.12:0/2160259557 conn(0x5587634e6a30 msgr2=0x5587634ed850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.442+0000 7f9be657d740 1 -- 172.21.15.12:0/2160259557 shutdown_connections 2024-09-19T06:54:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.442+0000 7f9be657d740 1 -- 172.21.15.12:0/2160259557 wait complete. 2024-09-19T06:54:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.442+0000 7f9be657d740 1 -- start start 2024-09-19T06:54:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.442+0000 7f9be657d740 1 Processor -- start 2024-09-19T06:54:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be657d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be657d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 0x5587634fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be1f40640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be1f40640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634f9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58410/0 (socket says 172.21.15.12:58410) 2024-09-19T06:54:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be657d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634f5680 0x55876356ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be657d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b5690 con 0x5587634eadc0 2024-09-19T06:54:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be657d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b4f00 con 0x5587634f5680 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be657d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b2160 con 0x5587634ea4a0 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be657d740 10 client.0 _ll_register_callbacks cb 0x7f9bd40099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be1f40640 1 -- 172.21.15.12:0/698079900 learned_addr learned my addr 172.21.15.12:0/698079900 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be173f640 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 0x5587634fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be2741640 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634f5680 0x55876356ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be1f40640 1 -- 172.21.15.12:0/698079900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634f5680 msgr2=0x55876356ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be1f40640 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634f5680 0x55876356ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be1f40640 1 -- 172.21.15.12:0/698079900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 msgr2=0x5587634fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.443+0000 7f9be1f40640 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 0x5587634fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.444+0000 7f9be1f40640 1 -- 172.21.15.12:0/698079900 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587634eabf0 con 0x5587634ea4a0 2024-09-19T06:54:20.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.444+0000 7f9be173f640 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 0x5587634fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:20.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.444+0000 7f9be1f40640 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634f9ac0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80a4ab0 tx=0x7f9bd809c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1fb05016621fab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:20.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.444+0000 7f9bc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:20.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.444+0000 7f9bc57fa640 1 -- 172.21.15.12:0/698079900 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8010720 con 0x5587634ea4a0 2024-09-19T06:54:20.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.444+0000 7f9bc57fa640 1 -- 172.21.15.12:0/698079900 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f9bd809b7c0 con 0x5587634ea4a0 2024-09-19T06:54:20.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.444+0000 7f9be657d740 1 -- 172.21.15.12:0/698079900 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bd809ca70 con 0x5587634ea4a0 2024-09-19T06:54:20.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.444+0000 7f9bc57fa640 1 -- 172.21.15.12:0/698079900 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9bd809b9c0 con 0x5587634ea4a0 2024-09-19T06:54:20.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9be657d740 10 client.28648 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:20.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9be657d740 1 -- 172.21.15.12:0/698079900 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558763570310 con 0x5587634ea4a0 2024-09-19T06:54:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9bc57fa640 1 -- 172.21.15.12:0/698079900 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bd80b5200 con 0x5587634ea4a0 2024-09-19T06:54:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9bc57fa640 1 -- 172.21.15.12:0/698079900 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f9bd809b230 con 0x5587634ea4a0 2024-09-19T06:54:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9be657d740 10 client.28648 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9be657d740 10 client.28648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9be657d740 20 client.28648 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9be657d740 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558763505040 0x558763572920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9be657d740 4 client.28648 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:54:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9be657d740 1 -- 172.21.15.12:0/698079900 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f9bd809ca70 con 0x558763505040 2024-09-19T06:54:20.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.445+0000 7f9be173f640 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558763505040 0x558763572920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:20.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.446+0000 7f9bc57fa640 10 client.28648 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:20.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.446+0000 7f9be173f640 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558763505040 0x558763572920 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c2881f3fe5ee34 server_cookie=699e39407f0a42ba in_seq=0 out_seq=0 2024-09-19T06:54:20.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.446+0000 7f9bc57fa640 1 -- 172.21.15.12:0/698079900 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f9bd809ca70 con 0x558763505040 2024-09-19T06:54:20.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.446+0000 7f9bc57fa640 10 client.28648 handle_command_reply: tid=0 2024-09-19T06:54:20.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.446+0000 7f9be657d740 1 client.28648 shutdown 2024-09-19T06:54:20.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.447+0000 7f9be657d740 1 -- 172.21.15.12:0/698079900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 msgr2=0x5587634f9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:20.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.447+0000 7f9be657d740 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634f9ac0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80a4ab0 tx=0x7f9bd809c460 comp rx=0 tx=0).stop 2024-09-19T06:54:20.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.448+0000 7f9be657d740 1 -- 172.21.15.12:0/698079900 shutdown_connections 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.448+0000 7f9be657d740 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x558763505040 0x558763572920 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.448+0000 7f9be657d740 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5587634f5680 0x55876356ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.448+0000 7f9bc57fa640 0 client.28648 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.448+0000 7f9be657d740 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5587634eadc0 0x5587634fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.448+0000 7f9be657d740 1 --2- 172.21.15.12:0/698079900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5587634ea4a0 0x5587634f9ac0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.448+0000 7f9be657d740 1 -- 172.21.15.12:0/698079900 >> 172.21.15.12:0/698079900 conn(0x5587634e6a30 msgr2=0x5587634f42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.448+0000 7f9be657d740 1 -- 172.21.15.12:0/698079900 shutdown_connections 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.449+0000 7f9be657d740 1 -- 172.21.15.12:0/698079900 wait complete. 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.449+0000 7f9be657d740 20 client.28648 trim_cache size 0 max 16384 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.449+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bc80a34b0 msgr2=0x7f9bc80a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:20.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.449+0000 7f9be41a4640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bc80a34b0 0x7f9bc80a5970 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4005c40 tx=0x7f9bd4005bd0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.449+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bdc102d30 msgr2=0x7f9bdc100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.449+0000 7f9be41a4640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bdc102d30 0x7f9bdc100990 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800e9f0 tx=0x7f9bd800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.449+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 shutdown_connections 2024-09-19T06:54:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.450+0000 7f9be41a4640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bdc1082a0 0x7f9bdc101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.450+0000 7f9be41a4640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bdc1036e0 0x7f9bdc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.450+0000 7f9be41a4640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9bc80a34b0 0x7f9bc80a5970 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.450+0000 7f9be41a4640 1 --2- 172.21.15.12:0/1005083533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bdc102d30 0x7f9bdc100990 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.450+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 >> 172.21.15.12:0/1005083533 conn(0x7f9bdc0fc7d0 msgr2=0x7f9bdc106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.450+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 shutdown_connections 2024-09-19T06:54:20.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:20.450+0000 7f9be41a4640 1 -- 172.21.15.12:0/1005083533 wait complete. 2024-09-19T06:54:20.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 815.0 s, 2041.2 tps, lat 49.437 ms stddev 54.869 2024-09-19T06:54:21.958 INFO:tasks.cephfs.filesystem:scrub status for tag:358db63a-33c9-4d78-8edb-f910733749da - {'path': '/', 'tag': '358db63a-33c9-4d78-8edb-f910733749da', 'options': 'recursive,force'} 2024-09-19T06:54:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:21 smithi016 ceph-mon[34911]: pgmap v445: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 27 MiB/s wr, 1.95k op/s 2024-09-19T06:54:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:21 smithi173 ceph-mon[35349]: pgmap v445: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 27 MiB/s wr, 1.95k op/s 2024-09-19T06:54:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.354+0000 7f5af505e640 1 -- 172.21.15.12:0/1469594468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5af01048f0 msgr2=0x7f5af0108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.354+0000 7f5af505e640 1 --2- 172.21.15.12:0/1469594468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5af01048f0 0x7f5af0108930 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009900 tx=0x7f5ae402a420 comp rx=0 tx=0).stop 2024-09-19T06:54:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.354+0000 7f5af505e640 1 -- 172.21.15.12:0/1469594468 shutdown_connections 2024-09-19T06:54:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.354+0000 7f5af505e640 1 --2- 172.21.15.12:0/1469594468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af0109090 0x7f5af0110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.354+0000 7f5af505e640 1 --2- 172.21.15.12:0/1469594468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5af01048f0 0x7f5af0108930 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.354+0000 7f5af505e640 1 --2- 172.21.15.12:0/1469594468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af0103f40 0x7f5af0104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.354+0000 7f5af505e640 1 -- 172.21.15.12:0/1469594468 >> 172.21.15.12:0/1469594468 conn(0x7f5af00ff9b0 msgr2=0x7f5af0101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.355+0000 7f5af505e640 1 -- 172.21.15.12:0/1469594468 shutdown_connections 2024-09-19T06:54:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.355+0000 7f5af505e640 1 -- 172.21.15.12:0/1469594468 wait complete. 2024-09-19T06:54:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.356+0000 7f5af505e640 1 Processor -- start 2024-09-19T06:54:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.357+0000 7f5af505e640 1 -- start start 2024-09-19T06:54:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.357+0000 7f5af505e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af0103f40 0x7f5af019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5af505e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af0109090 0x7f5af019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.427 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5af505e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5af019ecb0 0x7f5af019f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5af505e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0114160 con 0x7f5af0103f40 2024-09-19T06:54:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5af505e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0113fe0 con 0x7f5af019ecb0 2024-09-19T06:54:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5af505e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01142e0 con 0x7f5af0109090 2024-09-19T06:54:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aeed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af0103f40 0x7f5af019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aee59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af0109090 0x7f5af019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aeed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af0103f40 0x7f5af019a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60212/0 (socket says 172.21.15.12:60212) 2024-09-19T06:54:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aeed9d640 1 -- 172.21.15.12:0/2100169868 learned_addr learned my addr 172.21.15.12:0/2100169868 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aef59e640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5af019ecb0 0x7f5af019f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aeed9d640 1 -- 172.21.15.12:0/2100169868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af0109090 msgr2=0x7f5af019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aeed9d640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af0109090 0x7f5af019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aeed9d640 1 -- 172.21.15.12:0/2100169868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5af019ecb0 msgr2=0x7f5af019f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aeed9d640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5af019ecb0 0x7f5af019f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aeed9d640 1 -- 172.21.15.12:0/2100169868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af019f7a0 con 0x7f5af0103f40 2024-09-19T06:54:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aee59c640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af0109090 0x7f5af019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.358+0000 7f5aef59e640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5af019ecb0 0x7f5af019f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.359+0000 7f5aeed9d640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af0103f40 0x7f5af019a3f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000d950 tx=0x7f5ae000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.359+0000 7f5ad7fff640 1 -- 172.21.15.12:0/2100169868 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0017070 con 0x7f5af0103f40 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.359+0000 7f5ad7fff640 1 -- 172.21.15.12:0/2100169868 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae0009c30 con 0x7f5af0103f40 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.359+0000 7f5af505e640 1 -- 172.21.15.12:0/2100169868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af019fa90 con 0x7f5af0103f40 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.359+0000 7f5ad7fff640 1 -- 172.21.15.12:0/2100169868 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae000f6b0 con 0x7f5af0103f40 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.359+0000 7f5af505e640 1 -- 172.21.15.12:0/2100169868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af01a7240 con 0x7f5af0103f40 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.363+0000 7f5af7dfa740 1 Processor -- start 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.363+0000 7f5af7dfa740 1 -- start start 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.363+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050baaf0 0x5638050baed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.363+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 0x5638050c5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.363+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 0x5638050c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.363+0000 7f5af7dfa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56380501f2f0 con 0x5638050c5cb0 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.363+0000 7f5af7dfa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563804fc7270 con 0x5638050baaf0 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.363+0000 7f5af7dfa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56380501b2b0 con 0x5638050bb410 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.363+0000 7f5aee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 0x5638050c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.364+0000 7f5aee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 0x5638050c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60220/0 (socket says 172.21.15.12:60220) 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.364+0000 7f5aee59c640 1 -- 172.21.15.12:0/2251162678 learned_addr learned my addr 172.21.15.12:0/2251162678 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.364+0000 7f5aef59e640 1 --2- 172.21.15.12:0/2251162678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050baaf0 0x5638050baed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.364+0000 7f5ad7fff640 1 -- 172.21.15.12:0/2100169868 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5ae00109d0 con 0x7f5af0103f40 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.364+0000 7f5aee59c640 1 -- 172.21.15.12:0/2251162678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 msgr2=0x5638050c5770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.364+0000 7f5aee59c640 1 --2- 172.21.15.12:0/2251162678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 0x5638050c5770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.364+0000 7f5aee59c640 1 -- 172.21.15.12:0/2251162678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050baaf0 msgr2=0x5638050baed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.364+0000 7f5aee59c640 1 --2- 172.21.15.12:0/2251162678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050baaf0 0x5638050baed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.364+0000 7f5aee59c640 1 -- 172.21.15.12:0/2251162678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563804fc6340 con 0x5638050c5cb0 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.364+0000 7f5aef59e640 1 --2- 172.21.15.12:0/2251162678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050baaf0 0x5638050baed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.365+0000 7f5aee59c640 1 --2- 172.21.15.12:0/2251162678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 0x5638050c80a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f5af0076090 tx=0x7f5ae400b100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9de23bca6837b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.365+0000 7f5ad57fa640 1 -- 172.21.15.12:0/2251162678 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4040070 con 0x5638050c5cb0 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.366+0000 7f5ad57fa640 1 -- 172.21.15.12:0/2251162678 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae4032e50 con 0x5638050c5cb0 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.366+0000 7f5ad7fff640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a34e0 0x7f5ad80a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.366+0000 7f5ad7fff640 1 -- 172.21.15.12:0/2100169868 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f5ae00cfc10 con 0x7f5af0103f40 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.367+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2251162678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 msgr2=0x5638050c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.367+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/2251162678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 0x5638050c80a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f5af0076090 tx=0x7f5ae400b100 comp rx=0 tx=0).stop 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.368+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2251162678 shutdown_connections 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.368+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/2251162678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 0x5638050c80a0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.368+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/2251162678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 0x5638050c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.368+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/2251162678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050baaf0 0x5638050baed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.368+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2251162678 >> 172.21.15.12:0/2251162678 conn(0x5638050b7060 msgr2=0x5638050b7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.371+0000 7f5aef59e640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a34e0 0x7f5ad80a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.372+0000 7f5aef59e640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a34e0 0x7f5ad80a59a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800a870 tx=0x7f5ae800d040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:22.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:21 smithi012 ceph-mon[30937]: pgmap v445: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 27 MiB/s wr, 1.95k op/s 2024-09-19T06:54:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.376+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2251162678 shutdown_connections 2024-09-19T06:54:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.377+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2251162678 wait complete. 2024-09-19T06:54:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.377+0000 7f5af7dfa740 1 -- start start 2024-09-19T06:54:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.378+0000 7f5af7dfa740 1 Processor -- start 2024-09-19T06:54:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.378+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050baaf0 0x5638050c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.378+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 0x5638050c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050c5cb0 0x5638050c3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5af7dfa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5638050c88d0 con 0x5638050baaf0 2024-09-19T06:54:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5aee59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 0x5638050c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5aee59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 0x5638050c30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58434/0 (socket says 172.21.15.12:58434) 2024-09-19T06:54:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5aee59c640 1 -- 172.21.15.12:0/145106799 learned_addr learned my addr 172.21.15.12:0/145106799 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5af7dfa740 1 -- 172.21.15.12:0/145106799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563804fa8290 con 0x5638050c5cb0 2024-09-19T06:54:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5af7dfa740 1 -- 172.21.15.12:0/145106799 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5638050c8a50 con 0x5638050bb410 2024-09-19T06:54:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5aef59e640 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050c5cb0 0x5638050c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5af7dfa740 10 client.0 _ll_register_callbacks cb 0x563804fd9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5aee59c640 1 -- 172.21.15.12:0/145106799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050c5cb0 msgr2=0x5638050c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5aee59c640 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050c5cb0 0x5638050c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5aee59c640 1 -- 172.21.15.12:0/145106799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050baaf0 msgr2=0x5638050c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5aee59c640 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050baaf0 0x5638050c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.379+0000 7f5aee59c640 1 -- 172.21.15.12:0/145106799 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563804d32210 con 0x5638050bb410 2024-09-19T06:54:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.380+0000 7f5aee59c640 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 0x5638050c30d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4032ba0 tx=0x7f5ae4005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e3f662e2f9db59f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.380+0000 7f5ad2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.380+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/145106799 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4040070 con 0x5638050bb410 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.380+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/145106799 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f5ae4004b90 con 0x5638050bb410 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.380+0000 7f5af7dfa740 1 -- 172.21.15.12:0/145106799 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae4032e50 con 0x5638050bb410 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.381+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/145106799 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5ae4004d90 con 0x5638050bb410 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.383+0000 7f5af7dfa740 10 client.28657 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.383+0000 7f5af7dfa740 1 -- 172.21.15.12:0/145106799 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563804dfe620 con 0x5638050bb410 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.389+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/145106799 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae40035f0 con 0x5638050bb410 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.389+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/145106799 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f5ae405a020 con 0x5638050bb410 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.389+0000 7f5af7dfa740 10 client.28657 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.389+0000 7f5af7dfa740 10 client.28657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.389+0000 7f5af7dfa740 20 client.28657 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.389+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5638050d5b00 0x5638050d7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.389+0000 7f5af7dfa740 4 client.28657 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.389+0000 7f5af7dfa740 1 -- 172.21.15.12:0/145106799 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5ae4032e50 con 0x5638050d5b00 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.392+0000 7f5aeed9d640 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5638050d5b00 0x5638050d7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.398+0000 7f5ad2ff5640 10 client.28657 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.398+0000 7f5aeed9d640 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5638050d5b00 0x5638050d7ef0 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b26533b05ab706b3 server_cookie=b44ac78de1be1f2c in_seq=0 out_seq=0 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.400+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/145106799 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5ae4032e50 con 0x5638050d5b00 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.400+0000 7f5ad2ff5640 10 client.28657 handle_command_reply: tid=0 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.401+0000 7f5af7dfa740 1 client.28657 shutdown 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.415+0000 7f5af7dfa740 1 -- 172.21.15.12:0/145106799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 msgr2=0x5638050c30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.415+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 0x5638050c30d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4032ba0 tx=0x7f5ae4005fd0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.425+0000 7f5af7dfa740 1 -- 172.21.15.12:0/145106799 shutdown_connections 2024-09-19T06:54:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.425+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5638050d5b00 0x5638050d7ef0 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.425+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050c5cb0 0x5638050c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.425+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050bb410 0x5638050c30d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.425+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/145106799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050baaf0 0x5638050c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.425+0000 7f5af7dfa740 1 -- 172.21.15.12:0/145106799 >> 172.21.15.12:0/145106799 conn(0x5638050b7060 msgr2=0x5638050bcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.426+0000 7f5ad2ff5640 0 client.28657 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.427+0000 7f5af7dfa740 1 -- 172.21.15.12:0/145106799 shutdown_connections 2024-09-19T06:54:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.427+0000 7f5af7dfa740 1 -- 172.21.15.12:0/145106799 wait complete. 2024-09-19T06:54:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.429+0000 7f5af7dfa740 20 client.28657 trim_cache size 0 max 16384 2024-09-19T06:54:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.459+0000 7f5af7dfa740 1 Processor -- start 2024-09-19T06:54:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.459+0000 7f5af7dfa740 1 -- start start 2024-09-19T06:54:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.459+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050baaf0 0x5638050bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.460+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 0x5638050c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.460+0000 7f5aeed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050baaf0 0x5638050bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.460+0000 7f5aeed9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050baaf0 0x5638050bd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:58436/0 (socket says 172.21.15.12:58436) 2024-09-19T06:54:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.460+0000 7f5aeed9d640 1 -- 172.21.15.12:0/2313812687 learned_addr learned my addr 172.21.15.12:0/2313812687 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.460+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/2313812687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 0x5638050c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.460+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2313812687 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01afe60 con 0x5638050c5cb0 2024-09-19T06:54:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.460+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2313812687 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01b1a60 con 0x5638050bb410 2024-09-19T06:54:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.460+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2313812687 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01b0530 con 0x5638050baaf0 2024-09-19T06:54:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.460+0000 7f5aee59c640 1 --2- 172.21.15.12:0/2313812687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 0x5638050c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.461+0000 7f5aee59c640 1 -- 172.21.15.12:0/2313812687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050baaf0 msgr2=0x5638050bd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.461+0000 7f5aee59c640 1 --2- 172.21.15.12:0/2313812687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050baaf0 0x5638050bd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.461+0000 7f5aee59c640 1 -- 172.21.15.12:0/2313812687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 msgr2=0x5638050c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.461+0000 7f5aee59c640 1 --2- 172.21.15.12:0/2313812687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 0x5638050c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.461+0000 7f5aee59c640 1 -- 172.21.15.12:0/2313812687 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638050c8760 con 0x5638050bb410 2024-09-19T06:54:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.461+0000 7f5aee59c640 1 --2- 172.21.15.12:0/2313812687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 0x5638050c3440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x5638050c4140 tx=0x7f5ae402a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=412c212c6bbd6ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.462+0000 7f5ad4ff9640 1 -- 172.21.15.12:0/2313812687 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4048070 con 0x5638050bb410 2024-09-19T06:54:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.462+0000 7f5ad4ff9640 1 -- 172.21.15.12:0/2313812687 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae4004a70 con 0x5638050bb410 2024-09-19T06:54:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.462+0000 7f5ad4ff9640 1 -- 172.21.15.12:0/2313812687 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4040070 con 0x5638050bb410 2024-09-19T06:54:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.463+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2313812687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 msgr2=0x5638050c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.463+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/2313812687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 0x5638050c3440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x5638050c4140 tx=0x7f5ae402a420 comp rx=0 tx=0).stop 2024-09-19T06:54:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.463+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2313812687 shutdown_connections 2024-09-19T06:54:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.464+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/2313812687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050c5cb0 0x5638050c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.464+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/2313812687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 0x5638050c3440 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.464+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/2313812687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050baaf0 0x5638050bd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.464+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2313812687 >> 172.21.15.12:0/2313812687 conn(0x5638050b7060 msgr2=0x5638050c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.464+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2313812687 shutdown_connections 2024-09-19T06:54:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.464+0000 7f5af7dfa740 1 -- 172.21.15.12:0/2313812687 wait complete. 2024-09-19T06:54:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.465+0000 7f5af7dfa740 1 -- start start 2024-09-19T06:54:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.465+0000 7f5af7dfa740 1 Processor -- start 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050baaf0 0x5638050daf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 0x5638050d8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5af7dfa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050c5cb0 0x5638050d87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5aee59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 0x5638050d8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5aee59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 0x5638050d8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:57844/0 (socket says 172.21.15.12:57844) 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5af7dfa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01b1390 con 0x5638050baaf0 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5af7dfa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01b0c00 con 0x5638050bb410 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5af7dfa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01ade60 con 0x5638050c5cb0 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5aee59c640 1 -- 172.21.15.12:0/699990842 learned_addr learned my addr 172.21.15.12:0/699990842 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5af7dfa740 10 client.0 _ll_register_callbacks cb 0x7f5ae400b050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.466+0000 7f5aef59e640 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050c5cb0 0x5638050d87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.467+0000 7f5aef59e640 1 -- 172.21.15.12:0/699990842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 msgr2=0x5638050d8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:22.470 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.467+0000 7f5aef59e640 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 0x5638050d8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.467+0000 7f5aef59e640 1 -- 172.21.15.12:0/699990842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050baaf0 msgr2=0x5638050daf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.467+0000 7f5aeed9d640 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050baaf0 0x5638050daf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.467+0000 7f5aef59e640 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050baaf0 0x5638050daf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.467+0000 7f5aef59e640 1 -- 172.21.15.12:0/699990842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638050d8d00 con 0x5638050c5cb0 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.467+0000 7f5aeed9d640 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050baaf0 0x5638050daf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.467+0000 7f5aef59e640 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050c5cb0 0x5638050d87c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800a650 tx=0x7f5ae8009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13a0dbf97d109868 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.467+0000 7f5ad2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.468+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/699990842 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8015690 con 0x5638050c5cb0 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.468+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/699990842 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f5ae8015830 con 0x5638050c5cb0 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.468+0000 7f5af7dfa740 1 -- 172.21.15.12:0/699990842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae4004a70 con 0x5638050c5cb0 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.468+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/699990842 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5ae8015a30 con 0x5638050c5cb0 2024-09-19T06:54:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.468+0000 7f5af7dfa740 10 client.28663 fetch_fsmap learned FSMap version 50 2024-09-19T06:54:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.468+0000 7f5af7dfa740 1 -- 172.21.15.12:0/699990842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563805140150 con 0x5638050c5cb0 2024-09-19T06:54:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.468+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/699990842 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae4004a70 con 0x5638050c5cb0 2024-09-19T06:54:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.469+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/699990842 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f5ae802c3b0 con 0x5638050c5cb0 2024-09-19T06:54:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.470+0000 7f5af7dfa740 10 client.28663 fetch_fsmap finished waiting for FSMap version 50 2024-09-19T06:54:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.470+0000 7f5af7dfa740 10 client.28663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.470+0000 7f5af7dfa740 20 client.28663 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.470+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563805140880 0x563805142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.470+0000 7f5af7dfa740 4 client.28663 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:54:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.470+0000 7f5af7dfa740 1 -- 172.21.15.12:0/699990842 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56380502ca20 con 0x563805140880 2024-09-19T06:54:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.471+0000 7f5aeed9d640 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563805140880 0x563805142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.471+0000 7f5aeed9d640 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563805140880 0x563805142ca0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebcc5b49bbccc3c0 server_cookie=5da27741b3fea5b9 in_seq=0 out_seq=0 2024-09-19T06:54:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.471+0000 7f5ad2ff5640 10 client.28663 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.488+0000 7f5ad2ff5640 1 -- 172.21.15.12:0/699990842 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56380502ca20 con 0x563805140880 2024-09-19T06:54:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.488+0000 7f5ad2ff5640 10 client.28663 handle_command_reply: tid=0 2024-09-19T06:54:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.488+0000 7f5af7dfa740 1 client.28663 shutdown 2024-09-19T06:54:22.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.489+0000 7f5af7dfa740 1 -- 172.21.15.12:0/699990842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050c5cb0 msgr2=0x5638050d87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:22.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.489+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050c5cb0 0x5638050d87c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800a650 tx=0x7f5ae8009650 comp rx=0 tx=0).stop 2024-09-19T06:54:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.489+0000 7f5af7dfa740 1 -- 172.21.15.12:0/699990842 shutdown_connections 2024-09-19T06:54:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.489+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563805140880 0x563805142ca0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.490+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638050c5cb0 0x5638050d87c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.490+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5638050bb410 0x5638050d8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.490+0000 7f5af7dfa740 1 --2- 172.21.15.12:0/699990842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5638050baaf0 0x5638050daf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.490+0000 7f5af7dfa740 1 -- 172.21.15.12:0/699990842 >> 172.21.15.12:0/699990842 conn(0x5638050b7060 msgr2=0x5638050b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.490+0000 7f5ad2ff5640 0 client.28663 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.490+0000 7f5af7dfa740 1 -- 172.21.15.12:0/699990842 shutdown_connections 2024-09-19T06:54:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.490+0000 7f5af7dfa740 1 -- 172.21.15.12:0/699990842 wait complete. 2024-09-19T06:54:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.490+0000 7f5af7dfa740 20 client.28663 trim_cache size 0 max 16384 2024-09-19T06:54:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:54:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:54:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:54:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:54:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.490+0000 7f5af505e640 1 -- 172.21.15.12:0/2100169868 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a34e0 msgr2=0x7f5ad80a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.490+0000 7f5af505e640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a34e0 0x7f5ad80a59a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800a870 tx=0x7f5ae800d040 comp rx=0 tx=0).stop 2024-09-19T06:54:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.491+0000 7f5af505e640 1 -- 172.21.15.12:0/2100169868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af0103f40 msgr2=0x7f5af019a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.491+0000 7f5af505e640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af0103f40 0x7f5af019a3f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000d950 tx=0x7f5ae000de10 comp rx=0 tx=0).stop 2024-09-19T06:54:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.491+0000 7f5af505e640 1 -- 172.21.15.12:0/2100169868 shutdown_connections 2024-09-19T06:54:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.491+0000 7f5af505e640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5af019ecb0 0x7f5af019f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.491+0000 7f5af505e640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5ad80a34e0 0x7f5ad80a59a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.491+0000 7f5af505e640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af0109090 0x7f5af019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.491+0000 7f5af505e640 1 --2- 172.21.15.12:0/2100169868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af0103f40 0x7f5af019a3f0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.491+0000 7f5af505e640 1 -- 172.21.15.12:0/2100169868 >> 172.21.15.12:0/2100169868 conn(0x7f5af00ff9b0 msgr2=0x7f5af01001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.491+0000 7f5af505e640 1 -- 172.21.15.12:0/2100169868 shutdown_connections 2024-09-19T06:54:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:22.491+0000 7f5af505e640 1 -- 172.21.15.12:0/2100169868 wait complete. 2024-09-19T06:54:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:23 smithi016 ceph-mon[34911]: pgmap v446: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 27 MiB/s wr, 1.95k op/s 2024-09-19T06:54:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:23 smithi173 ceph-mon[35349]: pgmap v446: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 27 MiB/s wr, 1.95k op/s 2024-09-19T06:54:24.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:23 smithi012 ceph-mon[30937]: pgmap v446: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 27 MiB/s wr, 1.95k op/s 2024-09-19T06:54:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 820.0 s, 3084.2 tps, lat 32.315 ms stddev 38.583 2024-09-19T06:54:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:25 smithi016 ceph-mon[34911]: pgmap v447: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 26 MiB/s wr, 1.91k op/s 2024-09-19T06:54:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:25 smithi173 ceph-mon[35349]: pgmap v447: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 26 MiB/s wr, 1.91k op/s 2024-09-19T06:54:26.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:25 smithi012 ceph-mon[30937]: pgmap v447: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 26 MiB/s wr, 1.91k op/s 2024-09-19T06:54:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:27 smithi016 ceph-mon[34911]: pgmap v448: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 8.6 MiB/s wr, 832 op/s 2024-09-19T06:54:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:27 smithi173 ceph-mon[35349]: pgmap v448: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 8.6 MiB/s wr, 832 op/s 2024-09-19T06:54:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:27 smithi012 ceph-mon[30937]: pgmap v448: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 8.6 MiB/s wr, 832 op/s 2024-09-19T06:54:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:28 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:54:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:28 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:54:29.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:28 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:54:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:28 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:54:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:28 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:54:29.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:28 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:54:29.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:28 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:54:29.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:28 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:54:29.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:28 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:54:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:29 smithi016 ceph-mon[34911]: pgmap v449: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 5.8 MiB/s wr, 652 op/s 2024-09-19T06:54:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:29 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:54:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:29 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:54:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:29 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:54:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:29 smithi173 ceph-mon[35349]: pgmap v449: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 5.8 MiB/s wr, 652 op/s 2024-09-19T06:54:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:29 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:54:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:29 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:54:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:29 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:54:30.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:29 smithi012 ceph-mon[30937]: pgmap v449: 97 pgs: 97 active+clean; 3.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 5.8 MiB/s wr, 652 op/s 2024-09-19T06:54:30.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:29 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:54:30.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:29 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:54:30.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:29 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:54:30.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 825.0 s, 1613.8 tps, lat 61.811 ms stddev 62.168 2024-09-19T06:54:31.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:30 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:54:31.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:30 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:54:31.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:30 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:54:31.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:30 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:54:31.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:30 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:54:31.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:30 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:54:31.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:30 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:54:31.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:30 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:54:31.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:30 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:54:31.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:30 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:54:31.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:30 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:54:31.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:30 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:54:32.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:32 smithi012 ceph-mon[30937]: pgmap v450: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 8.9 MiB/s wr, 984 op/s 2024-09-19T06:54:32.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:32 smithi016 ceph-mon[34911]: pgmap v450: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 8.9 MiB/s wr, 984 op/s 2024-09-19T06:54:32.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:32 smithi173 ceph-mon[35349]: pgmap v450: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 8.9 MiB/s wr, 984 op/s 2024-09-19T06:54:34.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:34 smithi012 ceph-mon[30937]: pgmap v451: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 638 op/s 2024-09-19T06:54:34.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:34 smithi016 ceph-mon[34911]: pgmap v451: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 638 op/s 2024-09-19T06:54:34.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:34 smithi173 ceph-mon[35349]: pgmap v451: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 638 op/s 2024-09-19T06:54:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.641+0000 7ff0b362e640 1 -- 172.21.15.12:0/3497929068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0ac1069e0 msgr2=0x7ff0ac106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.641+0000 7ff0b362e640 1 --2- 172.21.15.12:0/3497929068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0ac1069e0 0x7ff0ac106dc0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009930 tx=0x7ff0a802a420 comp rx=0 tx=0).stop 2024-09-19T06:54:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.641+0000 7ff0b362e640 1 -- 172.21.15.12:0/3497929068 shutdown_connections 2024-09-19T06:54:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.641+0000 7ff0b362e640 1 --2- 172.21.15.12:0/3497929068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0ac101370 0x7ff0ac10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.641+0000 7ff0b362e640 1 --2- 172.21.15.12:0/3497929068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac1009d0 0x7ff0ac100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.641+0000 7ff0b362e640 1 --2- 172.21.15.12:0/3497929068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0ac1069e0 0x7ff0ac106dc0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.641+0000 7ff0b362e640 1 -- 172.21.15.12:0/3497929068 >> 172.21.15.12:0/3497929068 conn(0x7ff0ac0fc6b0 msgr2=0x7ff0ac0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.641+0000 7ff0b362e640 1 -- 172.21.15.12:0/3497929068 shutdown_connections 2024-09-19T06:54:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.641+0000 7ff0b362e640 1 -- 172.21.15.12:0/3497929068 wait complete. 2024-09-19T06:54:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.642+0000 7ff0b362e640 1 Processor -- start 2024-09-19T06:54:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.642+0000 7ff0b362e640 1 -- start start 2024-09-19T06:54:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.642+0000 7ff0b362e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac1009d0 0x7ff0ac197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.642+0000 7ff0b362e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0ac101370 0x7ff0ac1977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.642+0000 7ff0b362e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0ac1069e0 0x7ff0ac19bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.642+0000 7ff0b362e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac110e70 con 0x7ff0ac1069e0 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.642+0000 7ff0b362e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac110cf0 con 0x7ff0ac1009d0 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.642+0000 7ff0b362e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac110ff0 con 0x7ff0ac101370 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b1bcb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0ac1069e0 0x7ff0ac19bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b0bc9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0ac101370 0x7ff0ac1977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b13ca640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac1009d0 0x7ff0ac197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b1bcb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0ac1069e0 0x7ff0ac19bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53802/0 (socket says 172.21.15.12:53802) 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b1bcb640 1 -- 172.21.15.12:0/2951176028 learned_addr learned my addr 172.21.15.12:0/2951176028 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/2951176028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac1009d0 msgr2=0x7ff0ac197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac1009d0 0x7ff0ac197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/2951176028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0ac1069e0 msgr2=0x7ff0ac19bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0ac1069e0 0x7ff0ac19bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/2951176028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac19c270 con 0x7ff0ac101370 2024-09-19T06:54:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b13ca640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac1009d0 0x7ff0ac197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b1bcb640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0ac1069e0 0x7ff0ac19bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0ac101370 0x7ff0ac1977c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00e9f0 tx=0x7ff09c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0a27fc640 1 -- 172.21.15.12:0/2951176028 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00ccc0 con 0x7ff0ac101370 2024-09-19T06:54:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0a27fc640 1 -- 172.21.15.12:0/2951176028 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff09c010910 con 0x7ff0ac101370 2024-09-19T06:54:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.643+0000 7ff0b362e640 1 -- 172.21.15.12:0/2951176028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ac19c560 con 0x7ff0ac101370 2024-09-19T06:54:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.644+0000 7ff0a27fc640 1 -- 172.21.15.12:0/2951176028 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c018960 con 0x7ff0ac101370 2024-09-19T06:54:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.644+0000 7ff0b362e640 1 -- 172.21.15.12:0/2951176028 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ac06a0c0 con 0x7ff0ac101370 2024-09-19T06:54:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.647+0000 7ff0b63c9740 1 Processor -- start 2024-09-19T06:54:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.647+0000 7ff0b63c9740 1 -- start start 2024-09-19T06:54:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c0ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c18770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c1b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b63c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5560e9b722f0 con 0x5560e9c0daf0 2024-09-19T06:54:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b63c9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5560e9b1a270 con 0x5560e9c18cb0 2024-09-19T06:54:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b63c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5560e9b6e2b0 con 0x5560e9c0e410 2024-09-19T06:54:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b1bcb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c0ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b1bcb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c0ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53818/0 (socket says 172.21.15.12:53818) 2024-09-19T06:54:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b13ca640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c18770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b1bcb640 1 -- 172.21.15.12:0/1500500927 learned_addr learned my addr 172.21.15.12:0/1500500927 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0a27fc640 1 -- 172.21.15.12:0/2951176028 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff09c010ac0 con 0x7ff0ac101370 2024-09-19T06:54:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.648+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/1500500927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c1b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0b1bcb640 1 -- 172.21.15.12:0/1500500927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 msgr2=0x5560e9c18770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0b1bcb640 1 --2- 172.21.15.12:0/1500500927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c18770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0b1bcb640 1 -- 172.21.15.12:0/1500500927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 msgr2=0x5560e9c1b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0b1bcb640 1 --2- 172.21.15.12:0/1500500927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c1b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0b1bcb640 1 -- 172.21.15.12:0/1500500927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e9b19340 con 0x5560e9c0daf0 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0b13ca640 1 --2- 172.21.15.12:0/1500500927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c18770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0a27fc640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0980a34e0 0x7ff0980a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0b1bcb640 1 --2- 172.21.15.12:0/1500500927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c0ded0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400e8f0 tx=0x7ff0a4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df778030bf33e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0b13ca640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0980a34e0 0x7ff0980a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0a27fc640 1 -- 172.21.15.12:0/2951176028 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7ff09c0d01b0 con 0x7ff0ac101370 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0977fe640 1 -- 172.21.15.12:0/1500500927 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a400ba20 con 0x5560e9c0daf0 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0977fe640 1 -- 172.21.15.12:0/1500500927 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0a400bbc0 con 0x5560e9c0daf0 2024-09-19T06:54:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.649+0000 7ff0977fe640 1 -- 172.21.15.12:0/1500500927 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40175c0 con 0x5560e9c0daf0 2024-09-19T06:54:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.651+0000 7ff0b63c9740 1 -- 172.21.15.12:0/1500500927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 msgr2=0x5560e9c0ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.651+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/1500500927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c0ded0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400e8f0 tx=0x7ff0a4009500 comp rx=0 tx=0).stop 2024-09-19T06:54:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.651+0000 7ff0b13ca640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0980a34e0 0x7ff0980a59a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8006010 tx=0x7ff0a8031510 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.651+0000 7ff0b63c9740 1 -- 172.21.15.12:0/1500500927 shutdown_connections 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.651+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/1500500927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c1b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.651+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/1500500927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c18770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.651+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/1500500927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c0ded0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.651+0000 7ff0b63c9740 1 -- 172.21.15.12:0/1500500927 >> 172.21.15.12:0/1500500927 conn(0x5560e9c0a060 msgr2=0x5560e9c0a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.652+0000 7ff0b63c9740 1 -- 172.21.15.12:0/1500500927 shutdown_connections 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.652+0000 7ff0b63c9740 1 -- 172.21.15.12:0/1500500927 wait complete. 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.652+0000 7ff0b63c9740 1 -- start start 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.652+0000 7ff0b63c9740 1 Processor -- start 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c15c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c16170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c166b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b63c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5560e9c1b880 con 0x5560e9c0daf0 2024-09-19T06:54:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b13ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c15c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b0bc9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c16170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b1bcb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c166b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b0bc9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c16170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:43000/0 (socket says 172.21.15.12:43000) 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b1bcb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c166b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:54076/0 (socket says 172.21.15.12:54076) 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/3911225979 learned_addr learned my addr 172.21.15.12:0/3911225979 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b63c9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5560e9afb290 con 0x5560e9c18cb0 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b63c9740 1 -- 172.21.15.12:0/3911225979 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5560e9c1ba00 con 0x5560e9c0e410 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b63c9740 10 client.0 _ll_register_callbacks cb 0x5560e9b2c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/3911225979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 msgr2=0x5560e9c166b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c166b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/3911225979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 msgr2=0x5560e9c15c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c15c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.653+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/3911225979 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560e9885210 con 0x5560e9c0e410 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c16170 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff09c09c140 tx=0x7ff09c0cd860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75663a97bf8a789b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff094ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff094ff9640 1 -- 172.21.15.12:0/3911225979 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c09bf80 con 0x5560e9c0e410 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff094ff9640 1 -- 172.21.15.12:0/3911225979 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7ff09c09b890 con 0x5560e9c0e410 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff0b63c9740 1 -- 172.21.15.12:0/3911225979 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0a400bbc0 con 0x5560e9c0e410 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff094ff9640 1 -- 172.21.15.12:0/3911225979 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff09c09bda0 con 0x5560e9c0e410 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff0b63c9740 10 client.28675 fetch_fsmap learned FSMap version 51 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff0b63c9740 1 -- 172.21.15.12:0/3911225979 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5560e9951620 con 0x5560e9c0e410 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff094ff9640 1 -- 172.21.15.12:0/3911225979 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0a400bbc0 con 0x5560e9c0e410 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff094ff9640 1 -- 172.21.15.12:0/3911225979 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7ff09c098190 con 0x5560e9c0e410 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff0b63c9740 10 client.28675 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T06:54:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff0b63c9740 10 client.28675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff0b63c9740 20 client.28675 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5560e9c28c40 0x5560e9c2b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff0b63c9740 4 client.28675 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.654+0000 7ff0b63c9740 1 -- 172.21.15.12:0/3911225979 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560e9b7fa20 con 0x5560e9c28c40 2024-09-19T06:54:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.655+0000 7ff0b13ca640 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5560e9c28c40 0x5560e9c2b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.656+0000 7ff0b13ca640 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5560e9c28c40 0x5560e9c2b030 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25803766736a20e5 server_cookie=85a8da4f0a87dc7b in_seq=0 out_seq=0 2024-09-19T06:54:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.657+0000 7ff094ff9640 10 client.28675 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.657+0000 7ff094ff9640 1 -- 172.21.15.12:0/3911225979 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560e9b7fa20 con 0x5560e9c28c40 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.657+0000 7ff094ff9640 10 client.28675 handle_command_reply: tid=0 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.657+0000 7ff0b63c9740 1 client.28675 shutdown 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 1 -- 172.21.15.12:0/3911225979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 msgr2=0x5560e9c16170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c16170 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff09c09c140 tx=0x7ff09c0cd860 comp rx=0 tx=0).stop 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 1 -- 172.21.15.12:0/3911225979 shutdown_connections 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5560e9c28c40 0x5560e9c2b030 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c166b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c16170 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/3911225979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c15c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff094ff9640 0 client.28675 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 1 -- 172.21.15.12:0/3911225979 >> 172.21.15.12:0/3911225979 conn(0x5560e9c0a060 msgr2=0x5560e9c0fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:35.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 1 -- 172.21.15.12:0/3911225979 shutdown_connections 2024-09-19T06:54:35.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 1 -- 172.21.15.12:0/3911225979 wait complete. 2024-09-19T06:54:35.663 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.658+0000 7ff0b63c9740 20 client.28675 trim_cache size 0 max 16384 2024-09-19T06:54:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.677+0000 7ff0b63c9740 1 Processor -- start 2024-09-19T06:54:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.677+0000 7ff0b63c9740 1 -- start start 2024-09-19T06:54:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c0daf0 0x5560e9c164e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c308b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c18cb0 0x5560e9c30df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b63c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac1ab8c0 con 0x5560e9c18cb0 2024-09-19T06:54:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b63c9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac1ad490 con 0x5560e9c0daf0 2024-09-19T06:54:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b63c9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac1abf90 con 0x5560e9c0e410 2024-09-19T06:54:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b1bcb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c18cb0 0x5560e9c30df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b13ca640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c0daf0 0x5560e9c164e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b0bc9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b1bcb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c18cb0 0x5560e9c30df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53840/0 (socket says 172.21.15.12:53840) 2024-09-19T06:54:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b1bcb640 1 -- 172.21.15.12:0/2136825012 learned_addr learned my addr 172.21.15.12:0/2136825012 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/2136825012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c0daf0 msgr2=0x5560e9c164e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/2136825012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c0daf0 0x5560e9c164e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/2136825012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c18cb0 msgr2=0x5560e9c30df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/2136825012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c18cb0 0x5560e9c30df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/2136825012 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e9c09e90 con 0x5560e9c0e410 2024-09-19T06:54:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b13ca640 1 --2- 172.21.15.12:0/2136825012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c0daf0 0x5560e9c164e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b1bcb640 1 --2- 172.21.15.12:0/2136825012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c18cb0 0x5560e9c30df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.678+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/2136825012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c308b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff09c098e10 tx=0x7ff09c098640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e518fff304371260 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.679+0000 7ff096ffd640 1 -- 172.21.15.12:0/2136825012 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c09c440 con 0x5560e9c0e410 2024-09-19T06:54:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.679+0000 7ff096ffd640 1 -- 172.21.15.12:0/2136825012 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff09c0a0740 con 0x5560e9c0e410 2024-09-19T06:54:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.679+0000 7ff096ffd640 1 -- 172.21.15.12:0/2136825012 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c09b890 con 0x5560e9c0e410 2024-09-19T06:54:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.679+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2136825012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 msgr2=0x5560e9c308b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.679+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/2136825012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c308b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff09c098e10 tx=0x7ff09c098640 comp rx=0 tx=0).stop 2024-09-19T06:54:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.680+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2136825012 shutdown_connections 2024-09-19T06:54:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.680+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/2136825012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c18cb0 0x5560e9c30df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.680+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/2136825012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c308b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.680+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/2136825012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c0daf0 0x5560e9c164e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.680+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2136825012 >> 172.21.15.12:0/2136825012 conn(0x5560e9c0a060 msgr2=0x5560e9c17cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.680+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2136825012 shutdown_connections 2024-09-19T06:54:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.680+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2136825012 wait complete. 2024-09-19T06:54:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.680+0000 7ff0b63c9740 1 -- start start 2024-09-19T06:54:35.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.680+0000 7ff0b63c9740 1 Processor -- start 2024-09-19T06:54:35.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c21370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c1c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b63c9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c1cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.687 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b13ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c21370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b13ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c21370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53852/0 (socket says 172.21.15.12:53852) 2024-09-19T06:54:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b13ca640 1 -- 172.21.15.12:0/2481320930 learned_addr learned my addr 172.21.15.12:0/2481320930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac1acdc0 con 0x5560e9c0daf0 2024-09-19T06:54:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac1ac660 con 0x5560e9c18cb0 2024-09-19T06:54:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac1a98c0 con 0x5560e9c0e410 2024-09-19T06:54:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c1c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b1bcb640 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c1cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.682+0000 7ff0b63c9740 10 client.0 _ll_register_callbacks cb 0x7ff09c00ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/2481320930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 msgr2=0x5560e9c1cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c1cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/2481320930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 msgr2=0x5560e9c21370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c21370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff0b0bc9640 1 -- 172.21.15.12:0/2481320930 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560e9c0d920 con 0x5560e9c0e410 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff0b0bc9640 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c1c690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x5560e9c0d890 tx=0x7ff09c0d3c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f9ef1a5b99a908b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff094ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff094ff9640 1 -- 172.21.15.12:0/2481320930 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c09b660 con 0x5560e9c0e410 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff09c0a0740 con 0x5560e9c0e410 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff094ff9640 1 -- 172.21.15.12:0/2481320930 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7ff09c09b890 con 0x5560e9c0e410 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff094ff9640 1 -- 172.21.15.12:0/2481320930 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff09c09c440 con 0x5560e9c0e410 2024-09-19T06:54:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff0b63c9740 10 client.28681 fetch_fsmap learned FSMap version 51 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5560e9c93640 con 0x5560e9c0e410 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.683+0000 7ff094ff9640 1 -- 172.21.15.12:0/2481320930 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff09c0a0740 con 0x5560e9c0e410 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.684+0000 7ff094ff9640 1 -- 172.21.15.12:0/2481320930 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7ff09c0a0350 con 0x5560e9c0e410 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.684+0000 7ff0b63c9740 10 client.28681 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.684+0000 7ff0b63c9740 10 client.28681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.684+0000 7ff0b63c9740 20 client.28681 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.684+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5560e9c28c40 0x5560e9c95b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.684+0000 7ff0b63c9740 4 client.28681 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.684+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5560e9b79d70 con 0x5560e9c28c40 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.684+0000 7ff0b13ca640 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5560e9c28c40 0x5560e9c95b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.684+0000 7ff094ff9640 10 client.28681 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.684+0000 7ff0b13ca640 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5560e9c28c40 0x5560e9c95b40 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1fc7a110574af43 server_cookie=64c86d8fb201c99a in_seq=0 out_seq=0 2024-09-19T06:54:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.702+0000 7ff094ff9640 1 -- 172.21.15.12:0/2481320930 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5560e9b79d70 con 0x5560e9c28c40 2024-09-19T06:54:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.702+0000 7ff094ff9640 10 client.28681 handle_command_reply: tid=0 2024-09-19T06:54:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.702+0000 7ff0b63c9740 1 client.28681 shutdown 2024-09-19T06:54:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 msgr2=0x5560e9c1c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c1c690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x5560e9c0d890 tx=0x7ff09c0d3c70 comp rx=0 tx=0).stop 2024-09-19T06:54:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 shutdown_connections 2024-09-19T06:54:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5560e9c28c40 0x5560e9c95b40 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff094ff9640 0 client.28681 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5560e9c18cb0 0x5560e9c1cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5560e9c0e410 0x5560e9c1c690 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 1 --2- 172.21.15.12:0/2481320930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5560e9c0daf0 0x5560e9c21370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 >> 172.21.15.12:0/2481320930 conn(0x5560e9c0a060 msgr2=0x5560e9c089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 shutdown_connections 2024-09-19T06:54:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 1 -- 172.21.15.12:0/2481320930 wait complete. 2024-09-19T06:54:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.703+0000 7ff0b63c9740 20 client.28681 trim_cache size 0 max 16384 2024-09-19T06:54:35.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:54:35.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:54:35.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:54:35.707 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 -- 172.21.15.12:0/2951176028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0980a34e0 msgr2=0x7ff0980a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0980a34e0 0x7ff0980a59a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8006010 tx=0x7ff0a8031510 comp rx=0 tx=0).stop 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 -- 172.21.15.12:0/2951176028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0ac101370 msgr2=0x7ff0ac1977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0ac101370 0x7ff0ac1977c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00e9f0 tx=0x7ff09c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 -- 172.21.15.12:0/2951176028 shutdown_connections 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0ac1069e0 0x7ff0ac19bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0980a34e0 0x7ff0980a59a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0ac101370 0x7ff0ac1977c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 --2- 172.21.15.12:0/2951176028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac1009d0 0x7ff0ac197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 -- 172.21.15.12:0/2951176028 >> 172.21.15.12:0/2951176028 conn(0x7ff0ac0fc6b0 msgr2=0x7ff0ac0fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 -- 172.21.15.12:0/2951176028 shutdown_connections 2024-09-19T06:54:35.709 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:35.704+0000 7ff0b362e640 1 -- 172.21.15.12:0/2951176028 wait complete. 2024-09-19T06:54:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 830.0 s, 2668.8 tps, lat 37.538 ms stddev 50.688 2024-09-19T06:54:36.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:35 smithi016 ceph-mon[34911]: pgmap v452: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 723 op/s 2024-09-19T06:54:36.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:35 smithi173 ceph-mon[35349]: pgmap v452: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 723 op/s 2024-09-19T06:54:36.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:35 smithi012 ceph-mon[30937]: pgmap v452: 97 pgs: 97 active+clean; 4.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 723 op/s 2024-09-19T06:54:38.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:37 smithi016 ceph-mon[34911]: pgmap v453: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.7 MiB/s wr, 924 op/s 2024-09-19T06:54:38.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:37 smithi173 ceph-mon[35349]: pgmap v453: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.7 MiB/s wr, 924 op/s 2024-09-19T06:54:38.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:37 smithi012 ceph-mon[30937]: pgmap v453: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.7 MiB/s wr, 924 op/s 2024-09-19T06:54:40.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:39 smithi016 ceph-mon[34911]: pgmap v454: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.5 MiB/s wr, 627 op/s 2024-09-19T06:54:40.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:39 smithi173 ceph-mon[35349]: pgmap v454: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.5 MiB/s wr, 627 op/s 2024-09-19T06:54:40.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:39 smithi012 ceph-mon[30937]: pgmap v454: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.5 MiB/s wr, 627 op/s 2024-09-19T06:54:40.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 835.0 s, 2456.8 tps, lat 40.916 ms stddev 46.764 2024-09-19T06:54:42.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:41 smithi016 ceph-mon[34911]: pgmap v455: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.6 MiB/s wr, 952 op/s 2024-09-19T06:54:42.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:41 smithi173 ceph-mon[35349]: pgmap v455: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.6 MiB/s wr, 952 op/s 2024-09-19T06:54:42.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:41 smithi012 ceph-mon[30937]: pgmap v455: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.6 MiB/s wr, 952 op/s 2024-09-19T06:54:44.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:43 smithi016 ceph-mon[34911]: pgmap v456: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.5 MiB/s wr, 620 op/s 2024-09-19T06:54:44.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:43 smithi173 ceph-mon[35349]: pgmap v456: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.5 MiB/s wr, 620 op/s 2024-09-19T06:54:44.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:43 smithi012 ceph-mon[30937]: pgmap v456: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.5 MiB/s wr, 620 op/s 2024-09-19T06:54:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 840.0 s, 2990.8 tps, lat 33.124 ms stddev 38.236 2024-09-19T06:54:46.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:45 smithi016 ceph-mon[34911]: pgmap v457: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.5 MiB/s wr, 627 op/s 2024-09-19T06:54:46.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:45 smithi173 ceph-mon[35349]: pgmap v457: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.5 MiB/s wr, 627 op/s 2024-09-19T06:54:46.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:45 smithi012 ceph-mon[30937]: pgmap v457: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.5 MiB/s wr, 627 op/s 2024-09-19T06:54:48.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:47 smithi016 ceph-mon[34911]: pgmap v458: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.5 MiB/s wr, 842 op/s 2024-09-19T06:54:48.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:47 smithi173 ceph-mon[35349]: pgmap v458: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.5 MiB/s wr, 842 op/s 2024-09-19T06:54:48.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:47 smithi012 ceph-mon[30937]: pgmap v458: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.5 MiB/s wr, 842 op/s 2024-09-19T06:54:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.846+0000 7ff5d4378640 1 -- 172.21.15.12:0/1885546392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5cc1069c0 msgr2=0x7ff5cc106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.846+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1885546392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5cc1069c0 0x7ff5cc106da0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009cd0 tx=0x7ff5c402a910 comp rx=0 tx=0).stop 2024-09-19T06:54:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.847+0000 7ff5d4378640 1 -- 172.21.15.12:0/1885546392 shutdown_connections 2024-09-19T06:54:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.847+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1885546392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5cc101350 0x7ff5cc10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.847+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1885546392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5cc1009b0 0x7ff5cc100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.847+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1885546392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5cc1069c0 0x7ff5cc106da0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.847+0000 7ff5d4378640 1 -- 172.21.15.12:0/1885546392 >> 172.21.15.12:0/1885546392 conn(0x7ff5cc077990 msgr2=0x7ff5cc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.847+0000 7ff5d4378640 1 -- 172.21.15.12:0/1885546392 shutdown_connections 2024-09-19T06:54:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.847+0000 7ff5d4378640 1 -- 172.21.15.12:0/1885546392 wait complete. 2024-09-19T06:54:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.848+0000 7ff5d4378640 1 Processor -- start 2024-09-19T06:54:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.848+0000 7ff5d4378640 1 -- start start 2024-09-19T06:54:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.848+0000 7ff5d4378640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5cc1009b0 0x7ff5cc1970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.848+0000 7ff5d4378640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5cc101350 0x7ff5cc197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.849+0000 7ff5d2114640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5cc1009b0 0x7ff5cc1970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.849+0000 7ff5d2114640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5cc1009b0 0x7ff5cc1970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33166/0 (socket says 172.21.15.12:33166) 2024-09-19T06:54:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.849+0000 7ff5d2114640 1 -- 172.21.15.12:0/1041076884 learned_addr learned my addr 172.21.15.12:0/1041076884 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.849+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5cc1069c0 0x7ff5cc19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.849+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc110e50 con 0x7ff5cc1069c0 2024-09-19T06:54:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.849+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc110cd0 con 0x7ff5cc101350 2024-09-19T06:54:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.849+0000 7ff5d1913640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5cc101350 0x7ff5cc197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.849+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc110fd0 con 0x7ff5cc1009b0 2024-09-19T06:54:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.849+0000 7ff5d2915640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5cc1069c0 0x7ff5cc19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5d2114640 1 -- 172.21.15.12:0/1041076884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5cc101350 msgr2=0x7ff5cc197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5d2114640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5cc101350 0x7ff5cc197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5d2114640 1 -- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5cc1069c0 msgr2=0x7ff5cc19b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5d2114640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5cc1069c0 0x7ff5cc19b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5d2114640 1 -- 172.21.15.12:0/1041076884 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc19c0c0 con 0x7ff5cc1009b0 2024-09-19T06:54:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5d2114640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5cc1009b0 0x7ff5cc1970d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4033040 tx=0x7ff5c4003f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5c37fe640 1 -- 172.21.15.12:0/1041076884 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40317e0 con 0x7ff5cc1009b0 2024-09-19T06:54:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5cc19c350 con 0x7ff5cc1009b0 2024-09-19T06:54:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5c37fe640 1 -- 172.21.15.12:0/1041076884 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c4031980 con 0x7ff5cc1009b0 2024-09-19T06:54:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5cc0698a0 con 0x7ff5cc1009b0 2024-09-19T06:54:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.850+0000 7ff5c37fe640 1 -- 172.21.15.12:0/1041076884 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c402f620 con 0x7ff5cc1009b0 2024-09-19T06:54:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.854+0000 7ff5d71f0740 1 Processor -- start 2024-09-19T06:54:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.854+0000 7ff5d71f0740 1 -- start start 2024-09-19T06:54:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.855+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56516123ea10 0x56516123edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.855+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x565161251f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.855+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651612524c0 0x5651612548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.855+0000 7ff5d71f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5651611a32f0 con 0x5651612524c0 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.855+0000 7ff5d71f0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56516114b270 con 0x56516123ea10 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.855+0000 7ff5d71f0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56516119f2b0 con 0x56516123f330 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5c37fe640 1 -- 172.21.15.12:0/1041076884 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff5c402f7c0 con 0x7ff5cc1009b0 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d2114640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x565161251f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d2114640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x565161251f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:33182/0 (socket says 172.21.15.12:33182) 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d2114640 1 -- 172.21.15.12:0/3835509595 learned_addr learned my addr 172.21.15.12:0/3835509595 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d2915640 1 --2- 172.21.15.12:0/3835509595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56516123ea10 0x56516123edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d1913640 1 --2- 172.21.15.12:0/3835509595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651612524c0 0x5651612548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d2114640 1 -- 172.21.15.12:0/3835509595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56516123ea10 msgr2=0x56516123edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:48.858 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d2114640 1 --2- 172.21.15.12:0/3835509595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56516123ea10 0x56516123edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d2114640 1 -- 172.21.15.12:0/3835509595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651612524c0 msgr2=0x5651612548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d2114640 1 --2- 172.21.15.12:0/3835509595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651612524c0 0x5651612548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d2114640 1 -- 172.21.15.12:0/3835509595 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56516114a340 con 0x56516123f330 2024-09-19T06:54:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.856+0000 7ff5d2915640 1 --2- 172.21.15.12:0/3835509595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56516123ea10 0x56516123edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.857+0000 7ff5d2114640 1 --2- 172.21.15.12:0/3835509595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x565161251f80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40f3160 tx=0x7ff5c403f8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c6b07d4bc2067a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.857+0000 7ff5c0bfe640 1 -- 172.21.15.12:0/3835509595 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c403fd20 con 0x56516123f330 2024-09-19T06:54:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.857+0000 7ff5c0bfe640 1 -- 172.21.15.12:0/3835509595 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c403e0d0 con 0x56516123f330 2024-09-19T06:54:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.857+0000 7ff5c0bfe640 1 -- 172.21.15.12:0/3835509595 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c403cd10 con 0x56516123f330 2024-09-19T06:54:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.858+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3835509595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 msgr2=0x565161251f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.858+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3835509595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x565161251f80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40f3160 tx=0x7ff5c403f8c0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.858+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3835509595 shutdown_connections 2024-09-19T06:54:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.858+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3835509595 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651612524c0 0x5651612548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.858+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3835509595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x565161251f80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.858+0000 7ff5c37fe640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff5b80a35b0 0x7ff5b80a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.858+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3835509595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56516123ea10 0x56516123edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.859+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3835509595 >> 172.21.15.12:0/3835509595 conn(0x56516123b060 msgr2=0x56516123b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.859+0000 7ff5d2915640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff5b80a35b0 0x7ff5b80a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.859+0000 7ff5c37fe640 1 -- 172.21.15.12:0/1041076884 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7ff5c40f5ac0 con 0x7ff5cc1009b0 2024-09-19T06:54:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.859+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3835509595 shutdown_connections 2024-09-19T06:54:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.859+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3835509595 wait complete. 2024-09-19T06:54:48.867 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.859+0000 7ff5d2915640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff5b80a35b0 0x7ff5b80a5a70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0093a0 tx=0x7ff5bc009450 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d71f0740 1 -- start start 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d71f0740 1 Processor -- start 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516124bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x56516124c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x565161251a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d2114640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516124bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d71f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x565161241770 con 0x56516123ea10 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d2114640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516124bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45378/0 (socket says 172.21.15.12:45378) 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d2114640 1 -- 172.21.15.12:0/2625151123 learned_addr learned my addr 172.21.15.12:0/2625151123 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d71f0740 1 -- 172.21.15.12:0/2625151123 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56516112c290 con 0x5651612524c0 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.860+0000 7ff5d71f0740 1 -- 172.21.15.12:0/2625151123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5651612418f0 con 0x56516123f330 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5d71f0740 10 client.0 _ll_register_callbacks cb 0x56516115d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5d1913640 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x56516124c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5d2915640 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x565161251a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5d1913640 1 -- 172.21.15.12:0/2625151123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 msgr2=0x565161251a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5d1913640 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x565161251a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5d1913640 1 -- 172.21.15.12:0/2625151123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 msgr2=0x56516124bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5d1913640 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516124bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5d1913640 1 -- 172.21.15.12:0/2625151123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565160eb6210 con 0x56516123f330 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5d1913640 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x56516124c2a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8006fd0 tx=0x7ff5c8011630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1143565ef2a9e7d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/2625151123 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8019070 con 0x56516123f330 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/2625151123 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7ff5c8015660 con 0x56516123f330 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5d71f0740 1 -- 172.21.15.12:0/2625151123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5c403e0d0 con 0x56516123f330 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.861+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/2625151123 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff5c8025050 con 0x56516123f330 2024-09-19T06:54:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5d71f0740 10 client.28693 fetch_fsmap learned FSMap version 51 2024-09-19T06:54:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5d71f0740 1 -- 172.21.15.12:0/2625151123 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x565160f82620 con 0x56516123f330 2024-09-19T06:54:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/2625151123 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c8015d40 con 0x56516123f330 2024-09-19T06:54:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/2625151123 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7ff5c8014c90 con 0x56516123f330 2024-09-19T06:54:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5d71f0740 10 client.28693 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T06:54:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5d71f0740 10 client.28693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5d71f0740 20 client.28693 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56516126af10 0x56516126d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5d71f0740 4 client.28693 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5d71f0740 1 -- 172.21.15.12:0/2625151123 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff5c403e0d0 con 0x56516126af10 2024-09-19T06:54:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.862+0000 7ff5d2114640 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56516126af10 0x56516126d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.863+0000 7ff5d2114640 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56516126af10 0x56516126d330 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=face7a2ea83931fd server_cookie=7707e99174d0bae6 in_seq=0 out_seq=0 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.863+0000 7ff5b5ffb640 10 client.28693 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.863+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/2625151123 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff5c403e0d0 con 0x56516126af10 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.863+0000 7ff5b5ffb640 10 client.28693 handle_command_reply: tid=0 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.863+0000 7ff5d71f0740 1 client.28693 shutdown 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 1 -- 172.21.15.12:0/2625151123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 msgr2=0x56516124c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x56516124c2a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8006fd0 tx=0x7ff5c8011630 comp rx=0 tx=0).stop 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 1 -- 172.21.15.12:0/2625151123 shutdown_connections 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56516126af10 0x56516126d330 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x565161251a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x56516124c2a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5b5ffb640 0 client.28693 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/2625151123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516124bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 1 -- 172.21.15.12:0/2625151123 >> 172.21.15.12:0/2625151123 conn(0x56516123b060 msgr2=0x565161240d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 1 -- 172.21.15.12:0/2625151123 shutdown_connections 2024-09-19T06:54:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 1 -- 172.21.15.12:0/2625151123 wait complete. 2024-09-19T06:54:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.864+0000 7ff5d71f0740 20 client.28693 trim_cache size 0 max 16384 2024-09-19T06:54:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d71f0740 1 Processor -- start 2024-09-19T06:54:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d71f0740 1 -- start start 2024-09-19T06:54:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x5651612519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.884 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x565161272c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x565161273140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d71f0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc1ab6b0 con 0x56516123ea10 2024-09-19T06:54:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d71f0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc1ad280 con 0x5651612524c0 2024-09-19T06:54:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d2114640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x5651612519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d71f0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc1abd80 con 0x56516123f330 2024-09-19T06:54:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d2114640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x5651612519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45382/0 (socket says 172.21.15.12:45382) 2024-09-19T06:54:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.882+0000 7ff5d2114640 1 -- 172.21.15.12:0/3374633907 learned_addr learned my addr 172.21.15.12:0/3374633907 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.883+0000 7ff5d1913640 1 --2- 172.21.15.12:0/3374633907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x565161272c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.883+0000 7ff5d2915640 1 --2- 172.21.15.12:0/3374633907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x565161273140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.883+0000 7ff5d2114640 1 -- 172.21.15.12:0/3374633907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 msgr2=0x565161272c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.883+0000 7ff5d2114640 1 --2- 172.21.15.12:0/3374633907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x565161272c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.883+0000 7ff5d2114640 1 -- 172.21.15.12:0/3374633907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 msgr2=0x565161273140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.883+0000 7ff5d2114640 1 --2- 172.21.15.12:0/3374633907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x565161273140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.883+0000 7ff5d2114640 1 -- 172.21.15.12:0/3374633907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56516123ae90 con 0x56516123ea10 2024-09-19T06:54:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.884+0000 7ff5d2114640 1 --2- 172.21.15.12:0/3374633907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x5651612519d0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7ff5c403f9f0 tx=0x7ff5c403c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79631baacdd04530 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:48.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.884+0000 7ff5b7fff640 1 -- 172.21.15.12:0/3374633907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40be130 con 0x56516123ea10 2024-09-19T06:54:48.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.884+0000 7ff5b7fff640 1 -- 172.21.15.12:0/3374633907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c40c5020 con 0x56516123ea10 2024-09-19T06:54:48.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.884+0000 7ff5b7fff640 1 -- 172.21.15.12:0/3374633907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40c17f0 con 0x56516123ea10 2024-09-19T06:54:48.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.886+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3374633907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 msgr2=0x5651612519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:48.887 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.886+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3374633907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x5651612519d0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7ff5c403f9f0 tx=0x7ff5c403c870 comp rx=0 tx=0).stop 2024-09-19T06:54:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.887+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3374633907 shutdown_connections 2024-09-19T06:54:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.887+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3374633907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x565161273140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.887+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3374633907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x565161272c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.887+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3374633907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x5651612519d0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.887+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3374633907 >> 172.21.15.12:0/3374633907 conn(0x56516123b060 msgr2=0x565161246140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.888+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3374633907 shutdown_connections 2024-09-19T06:54:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.888+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3374633907 wait complete. 2024-09-19T06:54:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.888+0000 7ff5d71f0740 1 -- start start 2024-09-19T06:54:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.888+0000 7ff5d71f0740 1 Processor -- start 2024-09-19T06:54:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.888+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516127ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.888+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x56516127a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d71f0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x56516127a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d2114640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516127ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d2114640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516127ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45398/0 (socket says 172.21.15.12:45398) 2024-09-19T06:54:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d2114640 1 -- 172.21.15.12:0/3364242535 learned_addr learned my addr 172.21.15.12:0/3364242535 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc1acbb0 con 0x56516123ea10 2024-09-19T06:54:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc1ac450 con 0x5651612524c0 2024-09-19T06:54:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc1a96b0 con 0x56516123f330 2024-09-19T06:54:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d2915640 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x56516127a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d1913640 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x56516127a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d71f0740 10 client.0 _ll_register_callbacks cb 0x7ff5c8009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d2114640 1 -- 172.21.15.12:0/3364242535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 msgr2=0x56516127a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d2114640 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x56516127a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d2114640 1 -- 172.21.15.12:0/3364242535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 msgr2=0x56516127a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d2114640 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x56516127a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d2114640 1 -- 172.21.15.12:0/3364242535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651612362d0 con 0x56516123ea10 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.889+0000 7ff5d2915640 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x56516127a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.890+0000 7ff5d2114640 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516127ef40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40f5040 tx=0x7ff5c4040130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a48cb43593d130 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.890+0000 7ff5b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.890+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/3364242535 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40c19d0 con 0x56516123ea10 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.890+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/3364242535 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7ff5c403c530 con 0x56516123ea10 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.890+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5c40c5020 con 0x56516123ea10 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.890+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/3364242535 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff5c40c1c60 con 0x56516123ea10 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.890+0000 7ff5d71f0740 10 client.19452 fetch_fsmap learned FSMap version 51 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.890+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5651612d56f0 con 0x56516123ea10 2024-09-19T06:54:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.890+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/3364242535 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5c4036040 con 0x56516123ea10 2024-09-19T06:54:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.891+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/3364242535 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7ff5c40f3390 con 0x56516123ea10 2024-09-19T06:54:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.891+0000 7ff5d71f0740 10 client.19452 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T06:54:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.891+0000 7ff5d71f0740 10 client.19452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.891+0000 7ff5d71f0740 20 client.19452 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.891+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5651612d5800 0x5651612d7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.891+0000 7ff5d71f0740 4 client.19452 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:54:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.891+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7ff5c40c5020 con 0x5651612d5800 2024-09-19T06:54:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.891+0000 7ff5d1913640 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5651612d5800 0x5651612d7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.891+0000 7ff5b5ffb640 10 client.19452 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.891+0000 7ff5d1913640 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5651612d5800 0x5651612d7bf0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bedbadb69567acdd server_cookie=c9612ba96f71ba8d in_seq=0 out_seq=0 2024-09-19T06:54:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.908+0000 7ff5b5ffb640 1 -- 172.21.15.12:0/3364242535 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7ff5c40c5020 con 0x5651612d5800 2024-09-19T06:54:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.908+0000 7ff5b5ffb640 10 client.19452 handle_command_reply: tid=0 2024-09-19T06:54:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.908+0000 7ff5d71f0740 1 client.19452 shutdown 2024-09-19T06:54:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.908+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 msgr2=0x56516127ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.908+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516127ef40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40f5040 tx=0x7ff5c4040130 comp rx=0 tx=0).stop 2024-09-19T06:54:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.909+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 shutdown_connections 2024-09-19T06:54:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.909+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5651612d5800 0x5651612d7bf0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.909+0000 7ff5b5ffb640 0 client.19452 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.909+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5651612524c0 0x56516127a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.909+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56516123f330 0x56516127a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.909+0000 7ff5d71f0740 1 --2- 172.21.15.12:0/3364242535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56516123ea10 0x56516127ef40 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.909+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 >> 172.21.15.12:0/3364242535 conn(0x56516123b060 msgr2=0x5651612399a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.909+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 shutdown_connections 2024-09-19T06:54:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.909+0000 7ff5d71f0740 1 -- 172.21.15.12:0/3364242535 wait complete. 2024-09-19T06:54:48.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.909+0000 7ff5d71f0740 20 client.19452 trim_cache size 0 max 16384 2024-09-19T06:54:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:54:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:54:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:54:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:54:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.910+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff5b80a35b0 msgr2=0x7ff5b80a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.910+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff5b80a35b0 0x7ff5b80a5a70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0093a0 tx=0x7ff5bc009450 comp rx=0 tx=0).stop 2024-09-19T06:54:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.910+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5cc1009b0 msgr2=0x7ff5cc1970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.910+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5cc1009b0 0x7ff5cc1970d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4033040 tx=0x7ff5c4003f80 comp rx=0 tx=0).stop 2024-09-19T06:54:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.912+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 shutdown_connections 2024-09-19T06:54:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.912+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5cc1069c0 0x7ff5cc19b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.912+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5cc101350 0x7ff5cc197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.912+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff5b80a35b0 0x7ff5b80a5a70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.912+0000 7ff5d4378640 1 --2- 172.21.15.12:0/1041076884 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5cc1009b0 0x7ff5cc1970d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.912+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 >> 172.21.15.12:0/1041076884 conn(0x7ff5cc077990 msgr2=0x7ff5cc103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.913+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 shutdown_connections 2024-09-19T06:54:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:54:48.913+0000 7ff5d4378640 1 -- 172.21.15.12:0/1041076884 wait complete. 2024-09-19T06:54:50.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:49 smithi016 ceph-mon[34911]: pgmap v459: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.4 MiB/s wr, 632 op/s 2024-09-19T06:54:50.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:49 smithi173 ceph-mon[35349]: pgmap v459: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.4 MiB/s wr, 632 op/s 2024-09-19T06:54:50.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:49 smithi012 ceph-mon[30937]: pgmap v459: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.4 MiB/s wr, 632 op/s 2024-09-19T06:54:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 845.0 s, 1851.8 tps, lat 54.031 ms stddev 61.532 2024-09-19T06:54:51.960 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:54:52.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:51 smithi016 ceph-mon[34911]: pgmap v460: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 9.2 MiB/s wr, 917 op/s 2024-09-19T06:54:52.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:51 smithi173 ceph-mon[35349]: pgmap v460: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 9.2 MiB/s wr, 917 op/s 2024-09-19T06:54:52.365 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:52.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:51 smithi012 ceph-mon[30937]: pgmap v460: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 9.2 MiB/s wr, 917 op/s 2024-09-19T06:54:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.946+0000 7f41922c7640 1 -- 172.21.15.12:0/1025813267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c103670 msgr2=0x7f418c10bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.946+0000 7f41922c7640 1 --2- 172.21.15.12:0/1025813267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c103670 0x7f418c10bb60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4180009860 tx=0x7f418002a3d0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.946+0000 7f41922c7640 1 -- 172.21.15.12:0/1025813267 shutdown_connections 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.946+0000 7f41922c7640 1 --2- 172.21.15.12:0/1025813267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f418c10c180 0x7f418c10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.946+0000 7f41922c7640 1 --2- 172.21.15.12:0/1025813267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c103670 0x7f418c10bb60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.946+0000 7f41922c7640 1 --2- 172.21.15.12:0/1025813267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f418c102d50 0x7f418c103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.946+0000 7f41922c7640 1 -- 172.21.15.12:0/1025813267 >> 172.21.15.12:0/1025813267 conn(0x7f418c0fc7d0 msgr2=0x7f418c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.947+0000 7f41922c7640 1 -- 172.21.15.12:0/1025813267 shutdown_connections 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.947+0000 7f41922c7640 1 -- 172.21.15.12:0/1025813267 wait complete. 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.947+0000 7f41922c7640 1 Processor -- start 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.947+0000 7f41922c7640 1 -- start start 2024-09-19T06:54:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f41922c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c102d50 0x7f418c1009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f41922c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f418c103670 0x7f418c100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f41922c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f418c10c180 0x7f418c101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f41922c7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f418c111f80 con 0x7f418c103670 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f41922c7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f418c111e00 con 0x7f418c10c180 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f41922c7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f418c112100 con 0x7f418c102d50 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f418c103670 0x7f418c100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f4190864640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f418c10c180 0x7f418c101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f418bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c102d50 0x7f418c1009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f418c103670 0x7f418c100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59092/0 (socket says 172.21.15.12:59092) 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f4190864640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f418c10c180 0x7f418c101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:57276/0 (socket says 172.21.15.12:57276) 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f418b7fe640 1 -- 172.21.15.12:0/3366011878 learned_addr learned my addr 172.21.15.12:0/3366011878 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f418bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c102d50 0x7f418c1009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:35230/0 (socket says 172.21.15.12:35230) 2024-09-19T06:54:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f4190864640 1 -- 172.21.15.12:0/3366011878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c102d50 msgr2=0x7f418c1009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:52.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f4190864640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c102d50 0x7f418c1009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f4190864640 1 -- 172.21.15.12:0/3366011878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f418c103670 msgr2=0x7f418c100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:52.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f4190864640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f418c103670 0x7f418c100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.948+0000 7f4190864640 1 -- 172.21.15.12:0/3366011878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c1a68d0 con 0x7f418c10c180 2024-09-19T06:54:52.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.949+0000 7f4190864640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f418c10c180 0x7f418c101430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f418400ef00 tx=0x7f418400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:52.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.949+0000 7f41897fa640 1 -- 172.21.15.12:0/3366011878 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184004b20 con 0x7f418c10c180 2024-09-19T06:54:52.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.949+0000 7f41897fa640 1 -- 172.21.15.12:0/3366011878 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4184003e50 con 0x7f418c10c180 2024-09-19T06:54:52.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.949+0000 7f41897fa640 1 -- 172.21.15.12:0/3366011878 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418400b570 con 0x7f418c10c180 2024-09-19T06:54:52.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.949+0000 7f41922c7640 1 -- 172.21.15.12:0/3366011878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418c1a6bc0 con 0x7f418c10c180 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.949+0000 7f41922c7640 1 -- 172.21.15.12:0/3366011878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f418c1a70b0 con 0x7f418c10c180 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41897fa640 1 -- 172.21.15.12:0/3366011878 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f418401d020 con 0x7f418c10c180 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41946a0740 1 Processor -- start 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41946a0740 1 -- start start 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41946a0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 0x56298bebb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41946a0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebbdc0 0x56298bec6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41897fa640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41740a3500 0x7f41740a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41946a0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bec8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41946a0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56298be212e0 con 0x56298bebb4a0 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41946a0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56298bdc8ce0 con 0x56298bec6680 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41946a0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56298be1d2a0 con 0x56298bebbdc0 2024-09-19T06:54:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 0x56298bebb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 0x56298bebb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59096/0 (socket says 172.21.15.12:59096) 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f418bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebbdc0 0x56298bec6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f41897fa640 1 -- 172.21.15.12:0/3366011878 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f41840cfae0 con 0x7f418c10c180 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f418b7fe640 1 -- 172.21.15.12:0/4247046068 learned_addr learned my addr 172.21.15.12:0/4247046068 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.952+0000 7f4190864640 1 --2- 172.21.15.12:0/4247046068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bec8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.953+0000 7f418bfff640 1 -- 172.21.15.12:0/4247046068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 msgr2=0x56298bec8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.953+0000 7f418bfff640 1 --2- 172.21.15.12:0/4247046068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bec8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.953+0000 7f418bfff640 1 -- 172.21.15.12:0/4247046068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 msgr2=0x56298bebb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.953+0000 7f418bfff640 1 --2- 172.21.15.12:0/4247046068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 0x56298bebb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.953+0000 7f418bfff640 1 -- 172.21.15.12:0/4247046068 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298bdad440 con 0x56298bebbdc0 2024-09-19T06:54:52.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.953+0000 7f418bfff640 1 --2- 172.21.15.12:0/4247046068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebbdc0 0x56298bec6140 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f417c009c20 tx=0x7f417c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aacf44356fdd516 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.954+0000 7f41727fc640 1 -- 172.21.15.12:0/4247046068 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c009d10 con 0x56298bebbdc0 2024-09-19T06:54:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.954+0000 7f41727fc640 1 -- 172.21.15.12:0/4247046068 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417c005020 con 0x56298bebbdc0 2024-09-19T06:54:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.954+0000 7f41727fc640 1 -- 172.21.15.12:0/4247046068 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c004b60 con 0x56298bebbdc0 2024-09-19T06:54:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.954+0000 7f418b7fe640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41740a3500 0x7f41740a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 -- 172.21.15.12:0/4247046068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebbdc0 msgr2=0x56298bec6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f418b7fe640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41740a3500 0x7f41740a59c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f41800095f0 tx=0x7f418002a3d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 --2- 172.21.15.12:0/4247046068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebbdc0 0x56298bec6140 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f417c009c20 tx=0x7f417c011810 comp rx=0 tx=0).stop 2024-09-19T06:54:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 -- 172.21.15.12:0/4247046068 shutdown_connections 2024-09-19T06:54:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 --2- 172.21.15.12:0/4247046068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bec8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 --2- 172.21.15.12:0/4247046068 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebbdc0 0x56298bec6140 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 --2- 172.21.15.12:0/4247046068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 0x56298bebb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 -- 172.21.15.12:0/4247046068 >> 172.21.15.12:0/4247046068 conn(0x56298beb7a30 msgr2=0x56298beb7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 -- 172.21.15.12:0/4247046068 shutdown_connections 2024-09-19T06:54:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 -- 172.21.15.12:0/4247046068 wait complete. 2024-09-19T06:54:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 -- start start 2024-09-19T06:54:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.956+0000 7f41946a0740 1 Processor -- start 2024-09-19T06:54:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f41946a0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 0x56298bec5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f41946a0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298bec31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f41946a0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bec3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f41946a0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56298bec9250 con 0x56298bebbdc0 2024-09-19T06:54:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f41946a0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56298bddc050 con 0x56298bec6680 2024-09-19T06:54:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f41946a0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56298bec93d0 con 0x56298bebb4a0 2024-09-19T06:54:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f41946a0740 10 client.0 _ll_register_callbacks cb 0x56298be1c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f418bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 0x56298bec5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298bec31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f418bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 0x56298bec5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:35256/0 (socket says 172.21.15.12:35256) 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.957+0000 7f418bfff640 1 -- 172.21.15.12:0/1118892962 learned_addr learned my addr 172.21.15.12:0/1118892962 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f418bfff640 1 -- 172.21.15.12:0/1118892962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 msgr2=0x56298bec3730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f418bfff640 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bec3730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f418bfff640 1 -- 172.21.15.12:0/1118892962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 msgr2=0x56298bec31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f418bfff640 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298bec31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f418bfff640 1 -- 172.21.15.12:0/1118892962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298bb923c0 con 0x56298bebb4a0 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f418b7fe640 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298bec31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f418bfff640 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 0x56298bec5f40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f417c01b040 tx=0x7f417c0053e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=601448fca737f949 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f416b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:52.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f416b7fe640 1 -- 172.21.15.12:0/1118892962 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c029020 con 0x56298bebb4a0 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f41946a0740 1 -- 172.21.15.12:0/1118892962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f417c005020 con 0x56298bebb4a0 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f416b7fe640 1 -- 172.21.15.12:0/1118892962 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f417c004ab0 con 0x56298bebb4a0 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f416b7fe640 1 -- 172.21.15.12:0/1118892962 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f417c034050 con 0x56298bebb4a0 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f41946a0740 10 client.28711 fetch_fsmap learned FSMap version 51 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.958+0000 7f41946a0740 1 -- 172.21.15.12:0/1118892962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56298bed4ba0 con 0x56298bebb4a0 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.959+0000 7f416b7fe640 1 -- 172.21.15.12:0/1118892962 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417c005020 con 0x56298bebb4a0 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.959+0000 7f416b7fe640 1 -- 172.21.15.12:0/1118892962 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f417c023420 con 0x56298bebb4a0 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.959+0000 7f41946a0740 10 client.28711 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.959+0000 7f41946a0740 10 client.28711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.959+0000 7f41946a0740 20 client.28711 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.959+0000 7f41946a0740 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56298bed6000 0x56298bed83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.959+0000 7f41946a0740 4 client.28711 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.959+0000 7f41946a0740 1 -- 172.21.15.12:0/1118892962 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56298be2e850 con 0x56298bed6000 2024-09-19T06:54:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.959+0000 7f418b7fe640 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56298bed6000 0x56298bed83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f416b7fe640 10 client.28711 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f418b7fe640 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56298bed6000 0x56298bed83f0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34063e89bbcf6a8e server_cookie=be9e9e8544faf3cf in_seq=0 out_seq=0 2024-09-19T06:54:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f416b7fe640 1 -- 172.21.15.12:0/1118892962 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56298be2e850 con 0x56298bed6000 2024-09-19T06:54:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f416b7fe640 10 client.28711 handle_command_reply: tid=0 2024-09-19T06:54:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f41946a0740 1 client.28711 shutdown 2024-09-19T06:54:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f41946a0740 1 -- 172.21.15.12:0/1118892962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 msgr2=0x56298bec5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f41946a0740 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 0x56298bec5f40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f417c01b040 tx=0x7f417c0053e0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f41946a0740 1 -- 172.21.15.12:0/1118892962 shutdown_connections 2024-09-19T06:54:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f41946a0740 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56298bed6000 0x56298bed83f0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f41946a0740 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bec3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f41946a0740 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298bec31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f41946a0740 1 --2- 172.21.15.12:0/1118892962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 0x56298bec5f40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f416b7fe640 0 client.28711 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:52.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.960+0000 7f41946a0740 1 -- 172.21.15.12:0/1118892962 >> 172.21.15.12:0/1118892962 conn(0x56298beb7a30 msgr2=0x56298beb6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:52.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.961+0000 7f41946a0740 1 -- 172.21.15.12:0/1118892962 shutdown_connections 2024-09-19T06:54:52.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.961+0000 7f41946a0740 1 -- 172.21.15.12:0/1118892962 wait complete. 2024-09-19T06:54:52.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.961+0000 7f41946a0740 20 client.28711 trim_cache size 0 max 16384 2024-09-19T06:54:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.983+0000 7f41946a0740 1 Processor -- start 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.983+0000 7f41946a0740 1 -- start start 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.983+0000 7f41946a0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 0x56298bed24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.983+0000 7f41946a0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298beddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f41946a0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bede130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f41946a0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1afd50 con 0x56298bebbdc0 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f41946a0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1b1920 con 0x56298bec6680 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f41946a0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1b0420 con 0x56298bebb4a0 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298beddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f418b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298beddbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59106/0 (socket says 172.21.15.12:59106) 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f418b7fe640 1 -- 172.21.15.12:0/1545512278 learned_addr learned my addr 172.21.15.12:0/1545512278 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f418bfff640 1 --2- 172.21.15.12:0/1545512278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 0x56298bed24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f4190864640 1 --2- 172.21.15.12:0/1545512278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bede130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f418b7fe640 1 -- 172.21.15.12:0/1545512278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 msgr2=0x56298bed24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:52.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f418b7fe640 1 --2- 172.21.15.12:0/1545512278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 0x56298bed24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f418b7fe640 1 -- 172.21.15.12:0/1545512278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 msgr2=0x56298bede130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:52.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f418b7fe640 1 --2- 172.21.15.12:0/1545512278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bede130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f418b7fe640 1 -- 172.21.15.12:0/1545512278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298bebbbf0 con 0x56298bebbdc0 2024-09-19T06:54:52.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f418b7fe640 1 --2- 172.21.15.12:0/1545512278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298beddbf0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f4180005e00 tx=0x7f4180042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc96177ff19531d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:52.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f4171ffb640 1 -- 172.21.15.12:0/1545512278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180059070 con 0x56298bebbdc0 2024-09-19T06:54:52.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f4171ffb640 1 -- 172.21.15.12:0/1545512278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4180005520 con 0x56298bebbdc0 2024-09-19T06:54:52.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.984+0000 7f4171ffb640 1 -- 172.21.15.12:0/1545512278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180004e10 con 0x56298bebbdc0 2024-09-19T06:54:52.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.985+0000 7f41946a0740 1 -- 172.21.15.12:0/1545512278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 msgr2=0x56298beddbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:52.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.985+0000 7f41946a0740 1 --2- 172.21.15.12:0/1545512278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298beddbf0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f4180005e00 tx=0x7f4180042000 comp rx=0 tx=0).stop 2024-09-19T06:54:52.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.985+0000 7f41946a0740 1 -- 172.21.15.12:0/1545512278 shutdown_connections 2024-09-19T06:54:52.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.985+0000 7f41946a0740 1 --2- 172.21.15.12:0/1545512278 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bec6680 0x56298bede130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.985+0000 7f41946a0740 1 --2- 172.21.15.12:0/1545512278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebbdc0 0x56298beddbf0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.985+0000 7f41946a0740 1 --2- 172.21.15.12:0/1545512278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bebb4a0 0x56298bed24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.985+0000 7f41946a0740 1 -- 172.21.15.12:0/1545512278 >> 172.21.15.12:0/1545512278 conn(0x56298beb7a30 msgr2=0x56298bec22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:52.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.985+0000 7f41946a0740 1 -- 172.21.15.12:0/1545512278 shutdown_connections 2024-09-19T06:54:52.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.985+0000 7f41946a0740 1 -- 172.21.15.12:0/1545512278 wait complete. 2024-09-19T06:54:52.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f41946a0740 1 -- start start 2024-09-19T06:54:52.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f41946a0740 1 Processor -- start 2024-09-19T06:54:52.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f41946a0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 0x56298beced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f41946a0740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bebbdc0 0x56298beca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f41946a0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bec6680 0x56298beca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f41946a0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1b1250 con 0x56298bebb4a0 2024-09-19T06:54:52.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f41946a0740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1b0af0 con 0x56298bebbdc0 2024-09-19T06:54:52.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f41946a0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1add50 con 0x56298bec6680 2024-09-19T06:54:52.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f41946a0740 10 client.0 _ll_register_callbacks cb 0x7f417c009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:52.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f418bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 0x56298beced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f418bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 0x56298beced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59114/0 (socket says 172.21.15.12:59114) 2024-09-19T06:54:52.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f418bfff640 1 -- 172.21.15.12:0/565559410 learned_addr learned my addr 172.21.15.12:0/565559410 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:52.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f418b7fe640 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bebbdc0 0x56298beca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.986+0000 7f4190864640 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bec6680 0x56298beca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.988+0000 7f4190864640 1 -- 172.21.15.12:0/565559410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bebbdc0 msgr2=0x56298beca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.988+0000 7f4190864640 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bebbdc0 0x56298beca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.988+0000 7f4190864640 1 -- 172.21.15.12:0/565559410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 msgr2=0x56298beced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.989+0000 7f4190864640 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 0x56298beced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.989+0000 7f4190864640 1 -- 172.21.15.12:0/565559410 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298becae00 con 0x56298bec6680 2024-09-19T06:54:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.989+0000 7f4190864640 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bec6680 0x56298beca5d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f41840cd130 tx=0x7f418409c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b17ef47747f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.989+0000 7f416b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.989+0000 7f416b7fe640 1 -- 172.21.15.12:0/565559410 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418401a040 con 0x56298bec6680 2024-09-19T06:54:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.989+0000 7f416b7fe640 1 -- 172.21.15.12:0/565559410 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f4184099fc0 con 0x56298bec6680 2024-09-19T06:54:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.989+0000 7f41946a0740 1 -- 172.21.15.12:0/565559410 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4180005520 con 0x56298bec6680 2024-09-19T06:54:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.989+0000 7f416b7fe640 1 -- 172.21.15.12:0/565559410 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f41840a0070 con 0x56298bec6680 2024-09-19T06:54:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.989+0000 7f41946a0740 10 client.28717 fetch_fsmap learned FSMap version 51 2024-09-19T06:54:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.989+0000 7f41946a0740 1 -- 172.21.15.12:0/565559410 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56298bf40c20 con 0x56298bec6680 2024-09-19T06:54:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f416b7fe640 1 -- 172.21.15.12:0/565559410 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41840a4930 con 0x56298bec6680 2024-09-19T06:54:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f416b7fe640 1 -- 172.21.15.12:0/565559410 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f418400b040 con 0x56298bec6680 2024-09-19T06:54:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f41946a0740 10 client.28717 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f41946a0740 10 client.28717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f41946a0740 20 client.28717 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f41946a0740 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56298bf41340 0x56298bf43730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f41946a0740 4 client.28717 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f41946a0740 1 -- 172.21.15.12:0/565559410 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f4180005520 con 0x56298bf41340 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f418bfff640 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56298bf41340 0x56298bf43730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f416b7fe640 10 client.28717 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.990+0000 7f418bfff640 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56298bf41340 0x56298bf43730 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c505c255e61f47cc server_cookie=9b4bc39fa903d717 in_seq=0 out_seq=0 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f416b7fe640 1 -- 172.21.15.12:0/565559410 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f4180005520 con 0x56298bf41340 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f416b7fe640 10 client.28717 handle_command_reply: tid=0 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 client.28717 shutdown 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 -- 172.21.15.12:0/565559410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bec6680 msgr2=0x56298beca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bec6680 0x56298beca5d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f41840cd130 tx=0x7f418409c480 comp rx=0 tx=0).stop 2024-09-19T06:54:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 -- 172.21.15.12:0/565559410 shutdown_connections 2024-09-19T06:54:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x56298bf41340 0x56298bf43730 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56298bec6680 0x56298beca5d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56298bebbdc0 0x56298beca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 --2- 172.21.15.12:0/565559410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56298bebb4a0 0x56298beced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f416b7fe640 0 client.28717 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:54:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 -- 172.21.15.12:0/565559410 >> 172.21.15.12:0/565559410 conn(0x56298beb7a30 msgr2=0x56298beb6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 -- 172.21.15.12:0/565559410 shutdown_connections 2024-09-19T06:54:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 1 -- 172.21.15.12:0/565559410 wait complete. 2024-09-19T06:54:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.991+0000 7f41946a0740 20 client.28717 trim_cache size 0 max 16384 2024-09-19T06:54:52.998 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:54:52.998 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:54:52.998 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:54:52.998 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:54:52.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 -- 172.21.15.12:0/3366011878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41740a3500 msgr2=0x7f41740a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:52.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41740a3500 0x7f41740a59c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f41800095f0 tx=0x7f418002a3d0 comp rx=0 tx=0).stop 2024-09-19T06:54:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 -- 172.21.15.12:0/3366011878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f418c10c180 msgr2=0x7f418c101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f418c10c180 0x7f418c101430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f418400ef00 tx=0x7f418400c740 comp rx=0 tx=0).stop 2024-09-19T06:54:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 -- 172.21.15.12:0/3366011878 shutdown_connections 2024-09-19T06:54:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f418c10c180 0x7f418c101430 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f418c103670 0x7f418c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41740a3500 0x7f41740a59c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 --2- 172.21.15.12:0/3366011878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f418c102d50 0x7f418c1009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 -- 172.21.15.12:0/3366011878 >> 172.21.15.12:0/3366011878 conn(0x7f418c0fc7d0 msgr2=0x7f418c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 -- 172.21.15.12:0/3366011878 shutdown_connections 2024-09-19T06:54:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:52.992+0000 7f41922c7640 1 -- 172.21.15.12:0/3366011878 wait complete. 2024-09-19T06:54:53.956 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:54:53.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:54:54.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:53 smithi016 ceph-mon[34911]: pgmap v461: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.1 MiB/s wr, 592 op/s 2024-09-19T06:54:54.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:53 smithi173 ceph-mon[35349]: pgmap v461: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.1 MiB/s wr, 592 op/s 2024-09-19T06:54:54.375 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:54.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:53 smithi012 ceph-mon[30937]: pgmap v461: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.1 MiB/s wr, 592 op/s 2024-09-19T06:54:54.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:54.993+0000 7f45664b1640 1 -- 172.21.15.12:0/3149079730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4560109830 msgr2=0x7f4560109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:54.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:54.993+0000 7f45664b1640 1 --2- 172.21.15.12:0/3149079730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4560109830 0x7f4560109c90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4554009860 tx=0x7f455402a340 comp rx=0 tx=0).stop 2024-09-19T06:54:54.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:54.998+0000 7f45664b1640 1 -- 172.21.15.12:0/3149079730 shutdown_connections 2024-09-19T06:54:54.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:54.998+0000 7f45664b1640 1 --2- 172.21.15.12:0/3149079730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456011b140 0x7f456011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:54.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:54.998+0000 7f45664b1640 1 --2- 172.21.15.12:0/3149079730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4560109830 0x7f4560109c90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:54.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:54.998+0000 7f45664b1640 1 --2- 172.21.15.12:0/3149079730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560109450 0x7f4560110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:54.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:54.998+0000 7f45664b1640 1 -- 172.21.15.12:0/3149079730 >> 172.21.15.12:0/3149079730 conn(0x7f456006e140 msgr2=0x7f456006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:54.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:54.998+0000 7f45664b1640 1 -- 172.21.15.12:0/3149079730 shutdown_connections 2024-09-19T06:54:55.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:54.999+0000 7f45664b1640 1 -- 172.21.15.12:0/3149079730 wait complete. 2024-09-19T06:54:55.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.000+0000 7f45664b1640 1 Processor -- start 2024-09-19T06:54:55.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.000+0000 7f45664b1640 1 -- start start 2024-09-19T06:54:55.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.001+0000 7f45664b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560109450 0x7f456011a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:55.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.001+0000 7f45664b1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4560109830 0x7f45601168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:55.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.002+0000 7f455ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560109450 0x7f456011a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:55.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.002+0000 7f455ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560109450 0x7f456011a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:57314/0 (socket says 172.21.15.12:57314) 2024-09-19T06:54:55.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.002+0000 7f455ffff640 1 -- 172.21.15.12:0/3587196234 learned_addr learned my addr 172.21.15.12:0/3587196234 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:55.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.002+0000 7f45664b1640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456011b140 0x7f4560116e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.002+0000 7f45664b1640 1 -- 172.21.15.12:0/3587196234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4560113300 con 0x7f456011b140 2024-09-19T06:54:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.002+0000 7f45664b1640 1 -- 172.21.15.12:0/3587196234 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4560113180 con 0x7f4560109450 2024-09-19T06:54:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.002+0000 7f45664b1640 1 -- 172.21.15.12:0/3587196234 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4560113480 con 0x7f4560109830 2024-09-19T06:54:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.002+0000 7f455f7fe640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4560109830 0x7f45601168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:55.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.003+0000 7f455f7fe640 1 -- 172.21.15.12:0/3587196234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560109450 msgr2=0x7f456011a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:55.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.003+0000 7f455f7fe640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560109450 0x7f456011a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:55.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.003+0000 7f455f7fe640 1 -- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456011b140 msgr2=0x7f4560116e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:54:55.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.004+0000 7f4564a4e640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456011b140 0x7f4560116e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:55.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.004+0000 7f455f7fe640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456011b140 0x7f4560116e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:55.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.004+0000 7f455f7fe640 1 -- 172.21.15.12:0/3587196234 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4560117530 con 0x7f4560109830 2024-09-19T06:54:55.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.005+0000 7f455f7fe640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4560109830 0x7f45601168c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4554035040 tx=0x7f4554033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:55.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.005+0000 7f455d7fa640 1 -- 172.21.15.12:0/3587196234 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554037040 con 0x7f4560109830 2024-09-19T06:54:55.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.005+0000 7f455d7fa640 1 -- 172.21.15.12:0/3587196234 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4554030550 con 0x7f4560109830 2024-09-19T06:54:55.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.005+0000 7f45664b1640 1 -- 172.21.15.12:0/3587196234 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45601ab170 con 0x7f4560109830 2024-09-19T06:54:55.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.006+0000 7f45664b1640 1 -- 172.21.15.12:0/3587196234 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45601ab510 con 0x7f4560109830 2024-09-19T06:54:55.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.006+0000 7f455d7fa640 1 -- 172.21.15.12:0/3587196234 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554003af0 con 0x7f4560109830 2024-09-19T06:54:55.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.008+0000 7f4546ffd640 1 -- 172.21.15.12:0/3587196234 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4560073b00 con 0x7f4560109830 2024-09-19T06:54:55.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.009+0000 7f455d7fa640 1 -- 172.21.15.12:0/3587196234 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4554042020 con 0x7f4560109830 2024-09-19T06:54:55.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.010+0000 7f455d7fa640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45480a3500 0x7f45480a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:55.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.011+0000 7f455d7fa640 1 -- 172.21.15.12:0/3587196234 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f45540ef2e0 con 0x7f4560109830 2024-09-19T06:54:55.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.012+0000 7f455ffff640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45480a3500 0x7f45480a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:55.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.013+0000 7f455ffff640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45480a3500 0x7f45480a59c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f45500058c0 tx=0x7f455001a270 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:55.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.015+0000 7f455d7fa640 1 -- 172.21.15.12:0/3587196234 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4554049020 con 0x7f4560109830 2024-09-19T06:54:55.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.359+0000 7f4546ffd640 1 -- 172.21.15.12:0/3587196234 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4560117df0 con 0x7f4560109830 2024-09-19T06:54:55.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.361+0000 7f455d7fa640 1 -- 172.21.15.12:0/3587196234 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11976 (secure 0 0 0) 0x7f45540bbcd0 con 0x7f4560109830 2024-09-19T06:54:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:54:55.362 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":51,"btime":"2024-09-19T06:54:29:986061+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:54:29.576365+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:54:55.363 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 51 2024-09-19T06:54:55.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 -- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45480a3500 msgr2=0x7f45480a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:55.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45480a3500 0x7f45480a59c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f45500058c0 tx=0x7f455001a270 comp rx=0 tx=0).stop 2024-09-19T06:54:55.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 -- 172.21.15.12:0/3587196234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4560109830 msgr2=0x7f45601168c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4560109830 0x7f45601168c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4554035040 tx=0x7f4554033d10 comp rx=0 tx=0).stop 2024-09-19T06:54:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 -- 172.21.15.12:0/3587196234 shutdown_connections 2024-09-19T06:54:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f456011b140 0x7f4560116e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f45480a3500 0x7f45480a59c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4560109830 0x7f45601168c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 --2- 172.21.15.12:0/3587196234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4560109450 0x7f456011a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 -- 172.21.15.12:0/3587196234 >> 172.21.15.12:0/3587196234 conn(0x7f456006e140 msgr2=0x7f4560070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.369+0000 7f4546ffd640 1 -- 172.21.15.12:0/3587196234 shutdown_connections 2024-09-19T06:54:55.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:55.370+0000 7f4546ffd640 1 -- 172.21.15.12:0/3587196234 wait complete. 2024-09-19T06:54:55.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 850.0 s, 2403.4 tps, lat 41.701 ms stddev 48.215 2024-09-19T06:54:56.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:54:56.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:55 smithi016 ceph-mon[34911]: pgmap v462: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.2 MiB/s wr, 600 op/s 2024-09-19T06:54:56.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:55 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3587196234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:56.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:55 smithi173 ceph-mon[35349]: pgmap v462: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.2 MiB/s wr, 600 op/s 2024-09-19T06:54:56.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:55 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3587196234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:56.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:55 smithi012 ceph-mon[30937]: pgmap v462: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.2 MiB/s wr, 600 op/s 2024-09-19T06:54:56.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:55 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3587196234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:54:56.594 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.221+0000 7f1e5e226640 1 -- 172.21.15.12:0/4103717034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58102790 msgr2=0x7f1e581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.221+0000 7f1e5e226640 1 --2- 172.21.15.12:0/4103717034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58102790 0x7f1e581067e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009900 tx=0x7f1e4802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.221+0000 7f1e5e226640 1 -- 172.21.15.12:0/4103717034 shutdown_connections 2024-09-19T06:54:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.221+0000 7f1e5e226640 1 --2- 172.21.15.12:0/4103717034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e58106f10 0x7f1e5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.221+0000 7f1e5e226640 1 --2- 172.21.15.12:0/4103717034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58102790 0x7f1e581067e0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.221+0000 7f1e5e226640 1 --2- 172.21.15.12:0/4103717034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e58101de0 0x7f1e581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.221+0000 7f1e5e226640 1 -- 172.21.15.12:0/4103717034 >> 172.21.15.12:0/4103717034 conn(0x7f1e580fd8e0 msgr2=0x7f1e580ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.221+0000 7f1e5e226640 1 -- 172.21.15.12:0/4103717034 shutdown_connections 2024-09-19T06:54:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.222+0000 7f1e5e226640 1 -- 172.21.15.12:0/4103717034 wait complete. 2024-09-19T06:54:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.222+0000 7f1e5e226640 1 Processor -- start 2024-09-19T06:54:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.222+0000 7f1e5e226640 1 -- start start 2024-09-19T06:54:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.223+0000 7f1e5e226640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e58101de0 0x7f1e58198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.223+0000 7f1e5e226640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e58102790 0x7f1e58198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.223+0000 7f1e5e226640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58106f10 0x7f1e5819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.223+0000 7f1e5e226640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58111f80 con 0x7f1e58106f10 2024-09-19T06:54:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.223+0000 7f1e5e226640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58111e00 con 0x7f1e58101de0 2024-09-19T06:54:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.223+0000 7f1e5e226640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58112100 con 0x7f1e58102790 2024-09-19T06:54:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.223+0000 7f1e4ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e58102790 0x7f1e58198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.223+0000 7f1e4ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e58102790 0x7f1e58198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:35310/0 (socket says 172.21.15.12:35310) 2024-09-19T06:54:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.223+0000 7f1e4ffff640 1 -- 172.21.15.12:0/1348562934 learned_addr learned my addr 172.21.15.12:0/1348562934 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.224+0000 7f1e57fff640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58106f10 0x7f1e5819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.224+0000 7f1e577fe640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e58101de0 0x7f1e58198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.224+0000 7f1e577fe640 1 -- 172.21.15.12:0/1348562934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e58102790 msgr2=0x7f1e58198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.224+0000 7f1e577fe640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e58102790 0x7f1e58198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.224+0000 7f1e577fe640 1 -- 172.21.15.12:0/1348562934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58106f10 msgr2=0x7f1e5819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.224+0000 7f1e577fe640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58106f10 0x7f1e5819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.224+0000 7f1e577fe640 1 -- 172.21.15.12:0/1348562934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5819d510 con 0x7f1e58101de0 2024-09-19T06:54:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.225+0000 7f1e577fe640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e58101de0 0x7f1e58198560 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000e9f0 tx=0x7f1e4000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.225+0000 7f1e557fa640 1 -- 172.21.15.12:0/1348562934 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000ccc0 con 0x7f1e58101de0 2024-09-19T06:54:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.225+0000 7f1e557fa640 1 -- 172.21.15.12:0/1348562934 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e40010910 con 0x7f1e58101de0 2024-09-19T06:54:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.225+0000 7f1e557fa640 1 -- 172.21.15.12:0/1348562934 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40018960 con 0x7f1e58101de0 2024-09-19T06:54:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.225+0000 7f1e5e226640 1 -- 172.21.15.12:0/1348562934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5819d800 con 0x7f1e58101de0 2024-09-19T06:54:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.226+0000 7f1e5e226640 1 -- 172.21.15.12:0/1348562934 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e58074420 con 0x7f1e58101de0 2024-09-19T06:54:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.230+0000 7f1e605ff740 1 Processor -- start 2024-09-19T06:54:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.230+0000 7f1e605ff740 1 -- start start 2024-09-19T06:54:57.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.230+0000 7f1e557fa640 1 -- 172.21.15.12:0/1348562934 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1e40010ac0 con 0x7f1e58101de0 2024-09-19T06:54:57.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.230+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd35090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.230+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd355d0 0x55b4abd35a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.230+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd40370 0x55b4abd42760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.230+0000 7f1e605ff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b4abc9b2f0 con 0x55b4abd36b40 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.230+0000 7f1e605ff740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b4abc42cf0 con 0x55b4abd40370 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.230+0000 7f1e605ff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b4abc972b0 con 0x55b4abd355d0 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.231+0000 7f1e57fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd35090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.231+0000 7f1e57fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd35090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59172/0 (socket says 172.21.15.12:59172) 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.231+0000 7f1e57fff640 1 -- 172.21.15.12:0/3077614758 learned_addr learned my addr 172.21.15.12:0/3077614758 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.231+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/3077614758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd40370 0x55b4abd42760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.231+0000 7f1e577fe640 1 --2- 172.21.15.12:0/3077614758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd355d0 0x55b4abd35a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.231+0000 7f1e57fff640 1 -- 172.21.15.12:0/3077614758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd355d0 msgr2=0x55b4abd35a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.231+0000 7f1e57fff640 1 --2- 172.21.15.12:0/3077614758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd355d0 0x55b4abd35a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.231+0000 7f1e57fff640 1 -- 172.21.15.12:0/3077614758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd40370 msgr2=0x55b4abd42760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.231+0000 7f1e57fff640 1 --2- 172.21.15.12:0/3077614758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd40370 0x55b4abd42760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.231+0000 7f1e57fff640 1 -- 172.21.15.12:0/3077614758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4abc273a0 con 0x55b4abd36b40 2024-09-19T06:54:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.232+0000 7f1e577fe640 1 --2- 172.21.15.12:0/3077614758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd355d0 0x55b4abd35a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.232+0000 7f1e57fff640 1 --2- 172.21.15.12:0/3077614758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd35090 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009f70 tx=0x7f1e50010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b197c87801781e0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.232+0000 7f1e4dffb640 1 -- 172.21.15.12:0/3077614758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50016070 con 0x55b4abd36b40 2024-09-19T06:54:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.232+0000 7f1e4dffb640 1 -- 172.21.15.12:0/3077614758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e50004d20 con 0x55b4abd36b40 2024-09-19T06:54:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.232+0000 7f1e4dffb640 1 -- 172.21.15.12:0/3077614758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50012950 con 0x55b4abd36b40 2024-09-19T06:54:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.232+0000 7f1e557fa640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1e440a3480 0x7f1e440a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.233+0000 7f1e577fe640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1e440a3480 0x7f1e440a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.233+0000 7f1e557fa640 1 -- 172.21.15.12:0/1348562934 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f1e400d0110 con 0x7f1e58101de0 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.233+0000 7f1e605ff740 1 -- 172.21.15.12:0/3077614758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 msgr2=0x55b4abd35090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.233+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3077614758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd35090 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009f70 tx=0x7f1e50010800 comp rx=0 tx=0).stop 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.233+0000 7f1e605ff740 1 -- 172.21.15.12:0/3077614758 shutdown_connections 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.233+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3077614758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd40370 0x55b4abd42760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.233+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3077614758 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd355d0 0x55b4abd35a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.233+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3077614758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd35090 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.233+0000 7f1e605ff740 1 -- 172.21.15.12:0/3077614758 >> 172.21.15.12:0/3077614758 conn(0x55b4abcfe310 msgr2=0x55b4abd31c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.234+0000 7f1e577fe640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1e440a3480 0x7f1e440a5940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55b4abd32ac0 tx=0x7f1e40098040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.234+0000 7f1e605ff740 1 -- 172.21.15.12:0/3077614758 shutdown_connections 2024-09-19T06:54:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.234+0000 7f1e605ff740 1 -- 172.21.15.12:0/3077614758 wait complete. 2024-09-19T06:54:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.235+0000 7f1e605ff740 1 -- start start 2024-09-19T06:54:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.235+0000 7f1e605ff740 1 Processor -- start 2024-09-19T06:54:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd355d0 0x55b4abd3fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd36b40 0x55b4abd3d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e57fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd355d0 0x55b4abd3fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e57fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd355d0 0x55b4abd3fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:57356/0 (socket says 172.21.15.12:57356) 2024-09-19T06:54:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e57fff640 1 -- 172.21.15.12:0/3315635837 learned_addr learned my addr 172.21.15.12:0/3315635837 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd40370 0x55b4abd3d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b4abd43070 con 0x55b4abd40370 2024-09-19T06:54:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b4abc56060 con 0x55b4abd355d0 2024-09-19T06:54:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b4abd431f0 con 0x55b4abd36b40 2024-09-19T06:54:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e605ff740 10 client.0 _ll_register_callbacks cb 0x55b4ab9a98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.236+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd36b40 0x55b4abd3d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.237+0000 7f1e57fff640 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd40370 0x55b4abd3d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.237+0000 7f1e57fff640 1 -- 172.21.15.12:0/3315635837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd36b40 msgr2=0x55b4abd3d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.237+0000 7f1e57fff640 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd36b40 0x55b4abd3d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.237+0000 7f1e57fff640 1 -- 172.21.15.12:0/3315635837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd40370 msgr2=0x55b4abd3d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.237+0000 7f1e57fff640 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd40370 0x55b4abd3d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.237+0000 7f1e57fff640 1 -- 172.21.15.12:0/3315635837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4aba0c3c0 con 0x55b4abd355d0 2024-09-19T06:54:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.237+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd36b40 0x55b4abd3d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.237+0000 7f1e57fff640 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd355d0 0x55b4abd3fda0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1e50005ab0 tx=0x7f1e50012450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a918ef5fa3b5cabf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.238+0000 7f1e36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:54:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.238+0000 7f1e36ffd640 1 -- 172.21.15.12:0/3315635837 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50016030 con 0x55b4abd355d0 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.238+0000 7f1e36ffd640 1 -- 172.21.15.12:0/3315635837 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f1e50003970 con 0x55b4abd355d0 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.238+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e50004d20 con 0x55b4abd355d0 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.238+0000 7f1e36ffd640 1 -- 172.21.15.12:0/3315635837 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f1e50031050 con 0x55b4abd355d0 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.238+0000 7f1e605ff740 10 client.28817 fetch_fsmap learned FSMap version 51 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.238+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55b4abd4eaf0 con 0x55b4abd355d0 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.239+0000 7f1e36ffd640 1 -- 172.21.15.12:0/3315635837 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e50025040 con 0x55b4abd355d0 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.239+0000 7f1e36ffd640 1 -- 172.21.15.12:0/3315635837 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f1e5000f040 con 0x55b4abd355d0 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.239+0000 7f1e605ff740 10 client.28817 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.239+0000 7f1e605ff740 10 client.28817 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.239+0000 7f1e605ff740 20 client.28817 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.239+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b4abd4ff50 0x55b4abd52340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.239+0000 7f1e605ff740 4 client.28817 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.239+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1e50004d20 con 0x55b4abd4ff50 2024-09-19T06:54:57.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.239+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b4abd4ff50 0x55b4abd52340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.240+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b4abd4ff50 0x55b4abd52340 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=28f4b967919e3bba server_cookie=f9e0ab27b28ac403 in_seq=0 out_seq=0 2024-09-19T06:54:57.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.240+0000 7f1e36ffd640 10 client.28817 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e36ffd640 1 -- 172.21.15.12:0/3315635837 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1e50004d20 con 0x55b4abd4ff50 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e36ffd640 10 client.28817 handle_command_reply: tid=0 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e605ff740 1 client.28817 shutdown 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd355d0 msgr2=0x55b4abd3fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd355d0 0x55b4abd3fda0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1e50005ab0 tx=0x7f1e50012450 comp rx=0 tx=0).stop 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 shutdown_connections 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b4abd4ff50 0x55b4abd52340 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd40370 0x55b4abd3d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd36b40 0x55b4abd3d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3315635837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd355d0 0x55b4abd3fda0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 >> 172.21.15.12:0/3315635837 conn(0x55b4abcfe310 msgr2=0x55b4abd37930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:57.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e36ffd640 0 client.28817 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:54:57.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.241+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 shutdown_connections 2024-09-19T06:54:57.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.242+0000 7f1e605ff740 1 -- 172.21.15.12:0/3315635837 wait complete. 2024-09-19T06:54:57.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.242+0000 7f1e605ff740 20 client.28817 trim_cache size 0 max 16384 2024-09-19T06:54:57.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.265+0000 7f1e605ff740 1 Processor -- start 2024-09-19T06:54:57.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.265+0000 7f1e605ff740 1 -- start start 2024-09-19T06:54:57.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.265+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd355d0 0x55b4abd3c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.265+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd31510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.265+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd40370 0x55b4abd31a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.265+0000 7f1e605ff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1e581afff0 con 0x55b4abd36b40 2024-09-19T06:54:57.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.265+0000 7f1e605ff740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1e581b1bc0 con 0x55b4abd40370 2024-09-19T06:54:57.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.265+0000 7f1e605ff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1e581b06c0 con 0x55b4abd355d0 2024-09-19T06:54:57.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.265+0000 7f1e4ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd31510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.266+0000 7f1e4ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd31510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59190/0 (socket says 172.21.15.12:59190) 2024-09-19T06:54:57.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.266+0000 7f1e4ffff640 1 -- 172.21.15.12:0/3406177787 learned_addr learned my addr 172.21.15.12:0/3406177787 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:57.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.266+0000 7f1e4ffff640 1 -- 172.21.15.12:0/3406177787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd355d0 msgr2=0x55b4abd3c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:57.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.266+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/3406177787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd355d0 0x55b4abd3c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.266+0000 7f1e4ffff640 1 -- 172.21.15.12:0/3406177787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd40370 msgr2=0x55b4abd31a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:57.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.266+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/3406177787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd40370 0x55b4abd31a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.267+0000 7f1e4ffff640 1 -- 172.21.15.12:0/3406177787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4abd4c820 con 0x55b4abd36b40 2024-09-19T06:54:57.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.267+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/3406177787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd31510 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1e4802a960 tx=0x7f1e4802a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747e90a8f09e0b97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:57.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.272+0000 7f1e4d7fa640 1 -- 172.21.15.12:0/3406177787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48035040 con 0x55b4abd36b40 2024-09-19T06:54:57.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.272+0000 7f1e4d7fa640 1 -- 172.21.15.12:0/3406177787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e4804a070 con 0x55b4abd36b40 2024-09-19T06:54:57.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.272+0000 7f1e4d7fa640 1 -- 172.21.15.12:0/3406177787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e480317f0 con 0x55b4abd36b40 2024-09-19T06:54:57.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.273+0000 7f1e605ff740 1 -- 172.21.15.12:0/3406177787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 msgr2=0x55b4abd31510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:57.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.273+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3406177787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd31510 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1e4802a960 tx=0x7f1e4802a8f0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.278+0000 7f1e605ff740 1 -- 172.21.15.12:0/3406177787 shutdown_connections 2024-09-19T06:54:57.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.278+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3406177787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd40370 0x55b4abd31a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.278+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3406177787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd36b40 0x55b4abd31510 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.278+0000 7f1e605ff740 1 --2- 172.21.15.12:0/3406177787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd355d0 0x55b4abd3c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.278+0000 7f1e605ff740 1 -- 172.21.15.12:0/3406177787 >> 172.21.15.12:0/3406177787 conn(0x55b4abcfe310 msgr2=0x55b4abd3b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:57.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.278+0000 7f1e605ff740 1 -- 172.21.15.12:0/3406177787 shutdown_connections 2024-09-19T06:54:57.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.279+0000 7f1e605ff740 1 -- 172.21.15.12:0/3406177787 wait complete. 2024-09-19T06:54:57.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.279+0000 7f1e605ff740 1 -- start start 2024-09-19T06:54:57.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.280+0000 7f1e605ff740 1 Processor -- start 2024-09-19T06:54:57.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.280+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd355d0 0x55b4abd527a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.281+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd36b40 0x55b4abd52ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.281+0000 7f1e605ff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd40370 0x55b4abd54d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.281+0000 7f1e605ff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1e581b14f0 con 0x55b4abd355d0 2024-09-19T06:54:57.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.281+0000 7f1e4ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd36b40 0x55b4abd52ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.281+0000 7f1e4ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd36b40 0x55b4abd52ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:57366/0 (socket says 172.21.15.12:57366) 2024-09-19T06:54:57.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.281+0000 7f1e4ffff640 1 -- 172.21.15.12:0/549637357 learned_addr learned my addr 172.21.15.12:0/549637357 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:57.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.281+0000 7f1e57fff640 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd355d0 0x55b4abd527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.281+0000 7f1e605ff740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1e581b0d90 con 0x55b4abd36b40 2024-09-19T06:54:57.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.281+0000 7f1e605ff740 1 -- 172.21.15.12:0/549637357 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1e581adff0 con 0x55b4abd40370 2024-09-19T06:54:57.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.281+0000 7f1e605ff740 10 client.0 _ll_register_callbacks cb 0x7f1e48009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:57.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.282+0000 7f1e4ffff640 1 -- 172.21.15.12:0/549637357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd40370 msgr2=0x55b4abd54d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:57.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.282+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd40370 0x55b4abd54d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.282+0000 7f1e4ffff640 1 -- 172.21.15.12:0/549637357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd355d0 msgr2=0x55b4abd527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:57.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.282+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd355d0 0x55b4abd527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.282+0000 7f1e4ffff640 1 -- 172.21.15.12:0/549637357 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4abd553d0 con 0x55b4abd36b40 2024-09-19T06:54:57.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.282+0000 7f1e57fff640 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd355d0 0x55b4abd527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:57.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.283+0000 7f1e4ffff640 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd36b40 0x55b4abd52ce0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1e48005400 tx=0x7f1e48009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8999fda99353682f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:57.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.283+0000 7f1e36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:54:57.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.286+0000 7f1e36ffd640 1 -- 172.21.15.12:0/549637357 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48052070 con 0x55b4abd36b40 2024-09-19T06:54:57.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.286+0000 7f1e36ffd640 1 -- 172.21.15.12:0/549637357 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f1e48004960 con 0x55b4abd36b40 2024-09-19T06:54:57.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.288+0000 7f1e605ff740 1 -- 172.21.15.12:0/549637357 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e4804a070 con 0x55b4abd36b40 2024-09-19T06:54:57.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.289+0000 7f1e36ffd640 1 -- 172.21.15.12:0/549637357 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f1e48035050 con 0x55b4abd36b40 2024-09-19T06:54:57.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.289+0000 7f1e605ff740 10 client.28820 fetch_fsmap learned FSMap version 51 2024-09-19T06:54:57.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.289+0000 7f1e605ff740 1 -- 172.21.15.12:0/549637357 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55b4abdba3f0 con 0x55b4abd36b40 2024-09-19T06:54:57.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.292+0000 7f1e36ffd640 1 -- 172.21.15.12:0/549637357 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e480315b0 con 0x55b4abd36b40 2024-09-19T06:54:57.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.292+0000 7f1e36ffd640 1 -- 172.21.15.12:0/549637357 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f1e4803c5e0 con 0x55b4abd36b40 2024-09-19T06:54:57.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.292+0000 7f1e605ff740 10 client.28820 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T06:54:57.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.292+0000 7f1e605ff740 10 client.28820 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:54:57.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.292+0000 7f1e605ff740 20 client.28820 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:57.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.292+0000 7f1e605ff740 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b4abdbaa50 0x55b4abdbce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:57.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.292+0000 7f1e605ff740 4 client.28820 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:54:57.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.292+0000 7f1e605ff740 1 -- 172.21.15.12:0/549637357 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f1e4804a070 con 0x55b4abdbaa50 2024-09-19T06:54:57.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.293+0000 7f1e57fff640 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b4abdbaa50 0x55b4abdbce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:57.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.296+0000 7f1e57fff640 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b4abdbaa50 0x55b4abdbce70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6df9ee0eaf158be server_cookie=5d4a5cc804fa901a in_seq=0 out_seq=0 2024-09-19T06:54:57.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.296+0000 7f1e36ffd640 10 client.28820 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:54:57.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.296+0000 7f1e36ffd640 1 -- 172.21.15.12:0/549637357 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f1e4804a070 con 0x55b4abdbaa50 2024-09-19T06:54:57.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.296+0000 7f1e36ffd640 10 client.28820 handle_command_reply: tid=0 2024-09-19T06:54:57.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.296+0000 7f1e605ff740 1 client.28820 shutdown 2024-09-19T06:54:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.302+0000 7f1e605ff740 1 -- 172.21.15.12:0/549637357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd36b40 msgr2=0x55b4abd52ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:57.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.302+0000 7f1e605ff740 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd36b40 0x55b4abd52ce0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1e48005400 tx=0x7f1e48009680 comp rx=0 tx=0).stop 2024-09-19T06:54:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.302+0000 7f1e605ff740 1 -- 172.21.15.12:0/549637357 shutdown_connections 2024-09-19T06:54:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.302+0000 7f1e605ff740 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55b4abdbaa50 0x55b4abdbce70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.302+0000 7f1e605ff740 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b4abd40370 0x55b4abd54d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.302+0000 7f1e36ffd640 0 client.28820 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:54:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.302+0000 7f1e605ff740 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b4abd36b40 0x55b4abd52ce0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.302+0000 7f1e605ff740 1 --2- 172.21.15.12:0/549637357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b4abd355d0 0x55b4abd527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.302+0000 7f1e605ff740 1 -- 172.21.15.12:0/549637357 >> 172.21.15.12:0/549637357 conn(0x55b4abcfe310 msgr2=0x55b4abd37110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:57.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.302+0000 7f1e605ff740 1 -- 172.21.15.12:0/549637357 shutdown_connections 2024-09-19T06:54:57.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.303+0000 7f1e605ff740 1 -- 172.21.15.12:0/549637357 wait complete. 2024-09-19T06:54:57.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.303+0000 7f1e605ff740 20 client.28820 trim_cache size 0 max 16384 2024-09-19T06:54:57.305 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 -- 172.21.15.12:0/1348562934 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1e440a3480 msgr2=0x7f1e440a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1e440a3480 0x7f1e440a5940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55b4abd32ac0 tx=0x7f1e40098040 comp rx=0 tx=0).stop 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 -- 172.21.15.12:0/1348562934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e58101de0 msgr2=0x7f1e58198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e58101de0 0x7f1e58198560 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000e9f0 tx=0x7f1e4000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 -- 172.21.15.12:0/1348562934 shutdown_connections 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e58106f10 0x7f1e5819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1e440a3480 0x7f1e440a5940 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55b4abd32ac0 tx=0x7f1e40098040 comp rx=0 tx=0).stop 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e58102790 0x7f1e58198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 --2- 172.21.15.12:0/1348562934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e58101de0 0x7f1e58198560 secure :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000e9f0 tx=0x7f1e4000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 -- 172.21.15.12:0/1348562934 >> 172.21.15.12:0/1348562934 conn(0x7f1e580fd8e0 msgr2=0x7f1e580fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 -- 172.21.15.12:0/1348562934 shutdown_connections 2024-09-19T06:54:57.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:57.304+0000 7f1e5e226640 1 -- 172.21.15.12:0/1348562934 wait complete. 2024-09-19T06:54:58.054 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:57 smithi012 ceph-mon[30937]: pgmap v463: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.6 MiB/s wr, 853 op/s 2024-09-19T06:54:58.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:57 smithi016 ceph-mon[34911]: pgmap v463: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.6 MiB/s wr, 853 op/s 2024-09-19T06:54:58.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:57 smithi173 ceph-mon[35349]: pgmap v463: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.6 MiB/s wr, 853 op/s 2024-09-19T06:54:58.632 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:54:59.096 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:54:59.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.651+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/248847966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b08106f20 msgr2=0x7f5b0810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:59.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.651+0000 7f5b0f2d1640 1 --2- 172.21.15.12:0/248847966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b08106f20 0x7f5b0810eaa0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009ca0 tx=0x7f5b0002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.651+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/248847966 shutdown_connections 2024-09-19T06:54:59.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.651+0000 7f5b0f2d1640 1 --2- 172.21.15.12:0/248847966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b08106f20 0x7f5b0810eaa0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.651+0000 7f5b0f2d1640 1 --2- 172.21.15.12:0/248847966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b081027a0 0x7f5b081067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.651+0000 7f5b0f2d1640 1 --2- 172.21.15.12:0/248847966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b08101df0 0x7f5b081021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.651+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/248847966 >> 172.21.15.12:0/248847966 conn(0x7f5b080fd8b0 msgr2=0x7f5b080ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:59.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.652+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/248847966 shutdown_connections 2024-09-19T06:54:59.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.652+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/248847966 wait complete. 2024-09-19T06:54:59.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0f2d1640 1 Processor -- start 2024-09-19T06:54:59.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0f2d1640 1 -- start start 2024-09-19T06:54:59.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0f2d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b08101df0 0x7f5b081983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0f2d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b081027a0 0x7f5b081988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0f2d1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b08106f20 0x7f5b0819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0c86c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b081027a0 0x7f5b081988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0c86c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b081027a0 0x7f5b081988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59238/0 (socket says 172.21.15.12:59238) 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0f2d1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08111fd0 con 0x7f5b081027a0 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0f2d1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08111e50 con 0x7f5b08101df0 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0f2d1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08112150 con 0x7f5b08106f20 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.653+0000 7f5b0c86c640 1 -- 172.21.15.12:0/4232594617 learned_addr learned my addr 172.21.15.12:0/4232594617 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.654+0000 7f5b0d86e640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b08106f20 0x7f5b0819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.654+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b08101df0 0x7f5b081983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.654+0000 7f5b0c86c640 1 -- 172.21.15.12:0/4232594617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b08106f20 msgr2=0x7f5b0819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.654+0000 7f5b0c86c640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b08106f20 0x7f5b0819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.654+0000 7f5b0c86c640 1 -- 172.21.15.12:0/4232594617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b08101df0 msgr2=0x7f5b081983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:59.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.654+0000 7f5b0c86c640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b08101df0 0x7f5b081983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.654+0000 7f5b0c86c640 1 -- 172.21.15.12:0/4232594617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0819d360 con 0x7f5b081027a0 2024-09-19T06:54:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.654+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b08101df0 0x7f5b081983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.654+0000 7f5b0c86c640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b081027a0 0x7f5b081988f0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f5af800e9f0 tx=0x7f5af800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.655+0000 7f5afe7fc640 1 -- 172.21.15.12:0/4232594617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af800cd80 con 0x7f5b081027a0 2024-09-19T06:54:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.655+0000 7f5afe7fc640 1 -- 172.21.15.12:0/4232594617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5af8010910 con 0x7f5b081027a0 2024-09-19T06:54:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.655+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/4232594617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0819d650 con 0x7f5b081027a0 2024-09-19T06:54:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.655+0000 7f5afe7fc640 1 -- 172.21.15.12:0/4232594617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af80188f0 con 0x7f5b081027a0 2024-09-19T06:54:59.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.655+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/4232594617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b081a4f30 con 0x7f5b081027a0 2024-09-19T06:54:59.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.658+0000 7f5afe7fc640 1 -- 172.21.15.12:0/4232594617 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5af8010ac0 con 0x7f5b081027a0 2024-09-19T06:54:59.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.658+0000 7f5b116aa740 1 Processor -- start 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.658+0000 7f5b116aa740 1 -- start start 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.658+0000 7f5afe7fc640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5af40a3430 0x7f5af40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810bb40 0x5618e810a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810a5d0 0x5618e810aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5afe7fc640 1 -- 172.21.15.12:0/4232594617 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f5af80d0070 con 0x7f5b081027a0 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e8119780 0x5618e811bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b116aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5618e80702f0 con 0x5618e810a5d0 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b116aa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5618e8017cf0 con 0x5618e810bb40 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b116aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5618e806c2b0 con 0x5618e8119780 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0d86e640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5af40a3430 0x7f5af40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0c86c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810a5d0 0x5618e810aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0d06d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810bb40 0x5618e810a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0c86c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810a5d0 0x5618e810aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59252/0 (socket says 172.21.15.12:59252) 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0c86c640 1 -- 172.21.15.12:0/2574652693 learned_addr learned my addr 172.21.15.12:0/2574652693 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0d06d640 1 -- 172.21.15.12:0/2574652693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e8119780 msgr2=0x5618e811bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/2574652693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e8119780 0x5618e811bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0d06d640 1 -- 172.21.15.12:0/2574652693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810a5d0 msgr2=0x5618e810aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/2574652693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810a5d0 0x5618e810aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0d06d640 1 -- 172.21.15.12:0/2574652693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e7ffc3a0 con 0x5618e810bb40 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.659+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/2574652693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810bb40 0x5618e810a090 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009fd0 tx=0x7f5b04011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5820d6ca49ef10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.660+0000 7f5af37fe640 1 -- 172.21.15.12:0/2574652693 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04004230 con 0x5618e810bb40 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.660+0000 7f5af37fe640 1 -- 172.21.15.12:0/2574652693 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b040043d0 con 0x5618e810bb40 2024-09-19T06:54:59.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.660+0000 7f5af37fe640 1 -- 172.21.15.12:0/2574652693 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b040035f0 con 0x5618e810bb40 2024-09-19T06:54:59.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.660+0000 7f5b116aa740 1 -- 172.21.15.12:0/2574652693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810bb40 msgr2=0x5618e810a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:59.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.660+0000 7f5b116aa740 1 --2- 172.21.15.12:0/2574652693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810bb40 0x5618e810a090 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009fd0 tx=0x7f5b04011810 comp rx=0 tx=0).stop 2024-09-19T06:54:59.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.662+0000 7f5b0d86e640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5af40a3430 0x7f5af40a58f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006010 tx=0x7f5b00005ef0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:59.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.662+0000 7f5b116aa740 1 -- 172.21.15.12:0/2574652693 shutdown_connections 2024-09-19T06:54:59.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.662+0000 7f5b116aa740 1 --2- 172.21.15.12:0/2574652693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e8119780 0x5618e811bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.662+0000 7f5b116aa740 1 --2- 172.21.15.12:0/2574652693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810a5d0 0x5618e810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.662+0000 7f5b116aa740 1 --2- 172.21.15.12:0/2574652693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810bb40 0x5618e810a090 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.662+0000 7f5b116aa740 1 -- 172.21.15.12:0/2574652693 >> 172.21.15.12:0/2574652693 conn(0x5618e80d3310 msgr2=0x5618e8106c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:59.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.663+0000 7f5b116aa740 1 -- 172.21.15.12:0/2574652693 shutdown_connections 2024-09-19T06:54:59.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.663+0000 7f5b116aa740 1 -- 172.21.15.12:0/2574652693 wait complete. 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b116aa740 1 -- start start 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b116aa740 1 Processor -- start 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 0x5618e8119110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 0x5618e81163c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e8119780 0x5618e8116940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b116aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5618e811c480 con 0x5618e810bb40 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b116aa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5618e802b060 con 0x5618e810a5d0 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b116aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5618e811c600 con 0x5618e8119780 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b116aa740 10 client.0 _ll_register_callbacks cb 0x5618e7d7e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b0c86c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 0x5618e81163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b0c86c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 0x5618e81163c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59266/0 (socket says 172.21.15.12:59266) 2024-09-19T06:54:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b0c86c640 1 -- 172.21.15.12:0/2267958468 learned_addr learned my addr 172.21.15.12:0/2267958468 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 0x5618e8119110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.664+0000 7f5b0d86e640 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e8119780 0x5618e8116940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5b0c86c640 1 -- 172.21.15.12:0/2267958468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e8119780 msgr2=0x5618e8116940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5b0c86c640 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e8119780 0x5618e8116940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5b0c86c640 1 -- 172.21.15.12:0/2267958468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 msgr2=0x5618e8119110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5b0c86c640 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 0x5618e8119110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5b0c86c640 1 -- 172.21.15.12:0/2267958468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e7de13c0 con 0x5618e810bb40 2024-09-19T06:54:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5b0c86c640 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 0x5618e81163c0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f5af801e000 tx=0x7f5af809c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4698627664d06e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5af0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5af0ff9640 1 -- 172.21.15.12:0/2267958468 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af80bc2e0 con 0x5618e810bb40 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5af0ff9640 1 -- 172.21.15.12:0/2267958468 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f5af80a0260 con 0x5618e810bb40 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5b116aa740 1 -- 172.21.15.12:0/2267958468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b040043d0 con 0x5618e810bb40 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5af0ff9640 1 -- 172.21.15.12:0/2267958468 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5af80a0460 con 0x5618e810bb40 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5b116aa740 10 client.19500 fetch_fsmap learned FSMap version 51 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.665+0000 7f5b116aa740 1 -- 172.21.15.12:0/2267958468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5618e8127eb0 con 0x5618e810bb40 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.666+0000 7f5af0ff9640 1 -- 172.21.15.12:0/2267958468 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5af809b7b0 con 0x5618e810bb40 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.666+0000 7f5af0ff9640 1 -- 172.21.15.12:0/2267958468 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f5af80980b0 con 0x5618e810bb40 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.666+0000 7f5b116aa740 10 client.19500 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.666+0000 7f5b116aa740 10 client.19500 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.666+0000 7f5b116aa740 20 client.19500 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.666+0000 7f5b116aa740 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5618e81292c0 0x5618e812b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.666+0000 7f5b116aa740 4 client.19500 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.666+0000 7f5b116aa740 1 -- 172.21.15.12:0/2267958468 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5b040043d0 con 0x5618e81292c0 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.666+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5618e81292c0 0x5618e812b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.667+0000 7f5af0ff9640 10 client.19500 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.667+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5618e81292c0 0x5618e812b6b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3e2e623e35af24a6 server_cookie=212931e42a70bd38 in_seq=0 out_seq=0 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.667+0000 7f5af0ff9640 1 -- 172.21.15.12:0/2267958468 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5b040043d0 con 0x5618e81292c0 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.667+0000 7f5af0ff9640 10 client.19500 handle_command_reply: tid=0 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 client.19500 shutdown 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 -- 172.21.15.12:0/2267958468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 msgr2=0x5618e81163c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 0x5618e81163c0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f5af801e000 tx=0x7f5af809c240 comp rx=0 tx=0).stop 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 -- 172.21.15.12:0/2267958468 shutdown_connections 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5618e81292c0 0x5618e812b6b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e8119780 0x5618e8116940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 0x5618e81163c0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 --2- 172.21.15.12:0/2267958468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 0x5618e8119110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5af0ff9640 0 client.19500 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:54:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 -- 172.21.15.12:0/2267958468 >> 172.21.15.12:0/2267958468 conn(0x5618e80d3310 msgr2=0x5618e810c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 -- 172.21.15.12:0/2267958468 shutdown_connections 2024-09-19T06:54:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 1 -- 172.21.15.12:0/2267958468 wait complete. 2024-09-19T06:54:59.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.668+0000 7f5b116aa740 20 client.19500 trim_cache size 0 max 16384 2024-09-19T06:54:59.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b116aa740 1 Processor -- start 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b116aa740 1 -- start start 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 0x5618e8125720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810bb40 0x5618e8115c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e8119780 0x5618e8105bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b116aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ab910 con 0x5618e8119780 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b0d06d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 0x5618e8125720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b116aa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ad4e0 con 0x5618e810a5d0 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b0d06d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 0x5618e8125720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:57402/0 (socket says 172.21.15.12:57402) 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b0d06d640 1 -- 172.21.15.12:0/1441558517 learned_addr learned my addr 172.21.15.12:0/1441558517 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.688+0000 7f5b116aa740 1 -- 172.21.15.12:0/1441558517 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081abfe0 con 0x5618e810bb40 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.689+0000 7f5b0d86e640 1 --2- 172.21.15.12:0/1441558517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e8119780 0x5618e8105bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.689+0000 7f5b0c86c640 1 --2- 172.21.15.12:0/1441558517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810bb40 0x5618e8115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.689+0000 7f5b0d06d640 1 -- 172.21.15.12:0/1441558517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810bb40 msgr2=0x5618e8115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.689+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/1441558517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810bb40 0x5618e8115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.689+0000 7f5b0d06d640 1 -- 172.21.15.12:0/1441558517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e8119780 msgr2=0x5618e8105bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.689+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/1441558517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e8119780 0x5618e8105bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.689+0000 7f5b0d06d640 1 -- 172.21.15.12:0/1441558517 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e810d120 con 0x5618e810a5d0 2024-09-19T06:54:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.689+0000 7f5b0d86e640 1 --2- 172.21.15.12:0/1441558517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e8119780 0x5618e8105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.689+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/1441558517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 0x5618e8125720 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5b04011d10 tx=0x7f5b04004b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21014e8db593c28e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.689+0000 7f5af2ffd640 1 -- 172.21.15.12:0/1441558517 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04032070 con 0x5618e810a5d0 2024-09-19T06:54:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.690+0000 7f5af2ffd640 1 -- 172.21.15.12:0/1441558517 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b0401f040 con 0x5618e810a5d0 2024-09-19T06:54:59.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.690+0000 7f5af2ffd640 1 -- 172.21.15.12:0/1441558517 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04032070 con 0x5618e810a5d0 2024-09-19T06:54:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.690+0000 7f5b116aa740 1 -- 172.21.15.12:0/1441558517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 msgr2=0x5618e8125720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.690+0000 7f5b116aa740 1 --2- 172.21.15.12:0/1441558517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 0x5618e8125720 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5b04011d10 tx=0x7f5b04004b60 comp rx=0 tx=0).stop 2024-09-19T06:54:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.690+0000 7f5b116aa740 1 -- 172.21.15.12:0/1441558517 shutdown_connections 2024-09-19T06:54:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.690+0000 7f5b116aa740 1 --2- 172.21.15.12:0/1441558517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e8119780 0x5618e8105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.690+0000 7f5b116aa740 1 --2- 172.21.15.12:0/1441558517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810bb40 0x5618e8115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.690+0000 7f5b116aa740 1 --2- 172.21.15.12:0/1441558517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e810a5d0 0x5618e8125720 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.690+0000 7f5b116aa740 1 -- 172.21.15.12:0/1441558517 >> 172.21.15.12:0/1441558517 conn(0x5618e80d3310 msgr2=0x5618e81054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.690+0000 7f5b116aa740 1 -- 172.21.15.12:0/1441558517 shutdown_connections 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.691+0000 7f5b116aa740 1 -- 172.21.15.12:0/1441558517 wait complete. 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.691+0000 7f5b116aa740 1 -- start start 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.691+0000 7f5b116aa740 1 Processor -- start 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810a5d0 0x5618e811e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 0x5618e811e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b116aa740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e8119780 0x5618e818bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b116aa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ace10 con 0x5618e810bb40 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b116aa740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ac6b0 con 0x5618e8119780 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b116aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081a9910 con 0x5618e810a5d0 2024-09-19T06:54:59.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b116aa740 10 client.0 _ll_register_callbacks cb 0x7f5af800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:54:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b0d06d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810a5d0 0x5618e811e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b0d06d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810a5d0 0x5618e811e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:35382/0 (socket says 172.21.15.12:35382) 2024-09-19T06:54:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b0d06d640 1 -- 172.21.15.12:0/1913637960 learned_addr learned my addr 172.21.15.12:0/1913637960 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:54:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.692+0000 7f5b0d86e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e8119780 0x5618e818bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.693+0000 7f5b0d06d640 1 -- 172.21.15.12:0/1913637960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e8119780 msgr2=0x5618e818bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.693+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e8119780 0x5618e818bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.693+0000 7f5b0d06d640 1 -- 172.21.15.12:0/1913637960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 msgr2=0x5618e811e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:54:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.693+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 0x5618e811e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.693+0000 7f5b0d06d640 1 -- 172.21.15.12:0/1913637960 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e818c740 con 0x5618e810a5d0 2024-09-19T06:54:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.693+0000 7f5b0d06d640 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810a5d0 0x5618e811e210 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009d60 tx=0x7f5b04005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2425ca6dc9bb5d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.693+0000 7f5af0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:54:59.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.694+0000 7f5af0ff9640 1 -- 172.21.15.12:0/1913637960 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0403b020 con 0x5618e810a5d0 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.694+0000 7f5af0ff9640 1 -- 172.21.15.12:0/1913637960 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f5b04004240 con 0x5618e810a5d0 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.694+0000 7f5b116aa740 1 -- 172.21.15.12:0/1913637960 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b0401f040 con 0x5618e810a5d0 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.694+0000 7f5af0ff9640 1 -- 172.21.15.12:0/1913637960 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5b04032050 con 0x5618e810a5d0 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.695+0000 7f5b116aa740 10 client.28747 fetch_fsmap learned FSMap version 51 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.695+0000 7f5b116aa740 1 -- 172.21.15.12:0/1913637960 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5618e8194a90 con 0x5618e810a5d0 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.695+0000 7f5af0ff9640 1 -- 172.21.15.12:0/1913637960 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b0401f040 con 0x5618e810a5d0 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.695+0000 7f5af0ff9640 1 -- 172.21.15.12:0/1913637960 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f5b04024040 con 0x5618e810a5d0 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.695+0000 7f5b116aa740 10 client.28747 fetch_fsmap finished waiting for FSMap version 51 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.695+0000 7f5b116aa740 10 client.28747 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.695+0000 7f5b116aa740 20 client.28747 populate_metadata read hostname 'smithi012' 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.695+0000 7f5b116aa740 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5618e8195000 0x5618e81973f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.695+0000 7f5b116aa740 4 client.28747 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:54:59.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.695+0000 7f5b116aa740 1 -- 172.21.15.12:0/1913637960 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5618e807d860 con 0x5618e8195000 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b0c86c640 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5618e8195000 0x5618e81973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5af0ff9640 10 client.28747 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b0c86c640 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5618e8195000 0x5618e81973f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1640edcda8758007 server_cookie=6d32a23279a4725a in_seq=0 out_seq=0 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5af0ff9640 1 -- 172.21.15.12:0/1913637960 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5618e807d860 con 0x5618e8195000 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5af0ff9640 10 client.28747 handle_command_reply: tid=0 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b116aa740 1 client.28747 shutdown 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b116aa740 1 -- 172.21.15.12:0/1913637960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810a5d0 msgr2=0x5618e811e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b116aa740 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810a5d0 0x5618e811e210 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009d60 tx=0x7f5b04005fb0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b116aa740 1 -- 172.21.15.12:0/1913637960 shutdown_connections 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b116aa740 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5618e8195000 0x5618e81973f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b116aa740 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5618e8119780 0x5618e818bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b116aa740 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5618e810bb40 0x5618e811e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b116aa740 1 --2- 172.21.15.12:0/1913637960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5618e810a5d0 0x5618e811e210 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5b116aa740 1 -- 172.21.15.12:0/1913637960 >> 172.21.15.12:0/1913637960 conn(0x5618e80d3310 msgr2=0x5618e810c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:59.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.696+0000 7f5af0ff9640 0 client.28747 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:54:59.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.697+0000 7f5b116aa740 1 -- 172.21.15.12:0/1913637960 shutdown_connections 2024-09-19T06:54:59.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.697+0000 7f5b116aa740 1 -- 172.21.15.12:0/1913637960 wait complete. 2024-09-19T06:54:59.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.697+0000 7f5b116aa740 20 client.28747 trim_cache size 0 max 16384 2024-09-19T06:54:59.701 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:54:59.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/4232594617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5af40a3430 msgr2=0x7f5af40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:59.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5af40a3430 0x7f5af40a58f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5b00006010 tx=0x7f5b00005ef0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/4232594617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b081027a0 msgr2=0x7f5b081988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:59.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b081027a0 0x7f5b081988f0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f5af800e9f0 tx=0x7f5af800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/4232594617 shutdown_connections 2024-09-19T06:54:59.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5af40a3430 0x7f5af40a58f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b08106f20 0x7f5b0819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b081027a0 0x7f5b081988f0 secure :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f5af800e9f0 tx=0x7f5af800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 --2- 172.21.15.12:0/4232594617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b08101df0 0x7f5b081983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/4232594617 >> 172.21.15.12:0/4232594617 conn(0x7f5b080fd8b0 msgr2=0x7f5b080feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/4232594617 shutdown_connections 2024-09-19T06:54:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:54:59.698+0000 7f5b0f2d1640 1 -- 172.21.15.12:0/4232594617 wait complete. 2024-09-19T06:55:00.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:54:59 smithi016 ceph-mon[34911]: pgmap v464: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.4 MiB/s wr, 552 op/s 2024-09-19T06:55:00.259 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:54:59 smithi012 ceph-mon[30937]: pgmap v464: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.4 MiB/s wr, 552 op/s 2024-09-19T06:55:00.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:54:59 smithi173 ceph-mon[35349]: pgmap v464: 97 pgs: 97 active+clean; 4.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.4 MiB/s wr, 552 op/s 2024-09-19T06:55:00.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:55:00.809 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 855.0 s, 2615.0 tps, lat 37.413 ms stddev 47.792 2024-09-19T06:55:00.870 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:01.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:01 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:55:01.292 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:01 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:55:01.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:01 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:55:01.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.381+0000 7f42fd6fe640 1 -- 172.21.15.12:0/3981112246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f8106a80 msgr2=0x7f42f8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.381+0000 7f42fd6fe640 1 --2- 172.21.15.12:0/3981112246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f8106a80 0x7f42f8106e60 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009930 tx=0x7f42e802a420 comp rx=0 tx=0).stop 2024-09-19T06:55:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.382+0000 7f42fd6fe640 1 -- 172.21.15.12:0/3981112246 shutdown_connections 2024-09-19T06:55:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.382+0000 7f42fd6fe640 1 --2- 172.21.15.12:0/3981112246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42f8101420 0x7f42f810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.382+0000 7f42fd6fe640 1 --2- 172.21.15.12:0/3981112246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42f8100a80 0x7f42f8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.382+0000 7f42fd6fe640 1 --2- 172.21.15.12:0/3981112246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f8106a80 0x7f42f8106e60 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.382+0000 7f42fd6fe640 1 -- 172.21.15.12:0/3981112246 >> 172.21.15.12:0/3981112246 conn(0x7f42f80fc7c0 msgr2=0x7f42f80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.382+0000 7f42fd6fe640 1 -- 172.21.15.12:0/3981112246 shutdown_connections 2024-09-19T06:55:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.382+0000 7f42fd6fe640 1 -- 172.21.15.12:0/3981112246 wait complete. 2024-09-19T06:55:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.382+0000 7f42fd6fe640 1 Processor -- start 2024-09-19T06:55:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.382+0000 7f42fd6fe640 1 -- start start 2024-09-19T06:55:01.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42fd6fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42f8100a80 0x7f42f8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42fd6fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42f8101420 0x7f42f8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42fd6fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f8106a80 0x7f42f819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42fd6fe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8110e40 con 0x7f42f8106a80 2024-09-19T06:55:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42fd6fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8110cc0 con 0x7f42f8100a80 2024-09-19T06:55:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42fd6fe640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8110fc0 con 0x7f42f8101420 2024-09-19T06:55:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f8106a80 0x7f42f819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42f8100a80 0x7f42f8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f67fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42f8101420 0x7f42f8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f8106a80 0x7f42f819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36960/0 (socket says 172.21.15.12:36960) 2024-09-19T06:55:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f77fe640 1 -- 172.21.15.12:0/143036196 learned_addr learned my addr 172.21.15.12:0/143036196 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f6ffd640 1 -- 172.21.15.12:0/143036196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42f8101420 msgr2=0x7f42f8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f6ffd640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42f8101420 0x7f42f8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f6ffd640 1 -- 172.21.15.12:0/143036196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f8106a80 msgr2=0x7f42f819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f6ffd640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f8106a80 0x7f42f819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f6ffd640 1 -- 172.21.15.12:0/143036196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f819d400 con 0x7f42f8100a80 2024-09-19T06:55:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.383+0000 7f42f67fc640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42f8101420 0x7f42f8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.384+0000 7f42f6ffd640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42f8100a80 0x7f42f8198450 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f42e8005940 tx=0x7f42e8031b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.384+0000 7f42dffff640 1 -- 172.21.15.12:0/143036196 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e803f070 con 0x7f42f8100a80 2024-09-19T06:55:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.384+0000 7f42fd6fe640 1 -- 172.21.15.12:0/143036196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f819d690 con 0x7f42f8100a80 2024-09-19T06:55:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.384+0000 7f42dffff640 1 -- 172.21.15.12:0/143036196 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42e8003ad0 con 0x7f42f8100a80 2024-09-19T06:55:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.384+0000 7f42fd6fe640 1 -- 172.21.15.12:0/143036196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f81a4fd0 con 0x7f42f8100a80 2024-09-19T06:55:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.384+0000 7f42dffff640 1 -- 172.21.15.12:0/143036196 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8048060 con 0x7f42f8100a80 2024-09-19T06:55:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.386+0000 7f42ffad7740 1 Processor -- start 2024-09-19T06:55:01.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.386+0000 7f42ffad7740 1 -- start start 2024-09-19T06:55:01.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e390956090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e3909565d0 0x55e390956a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e390963760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42ffad7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e3908bc2f0 con 0x55e390961370 2024-09-19T06:55:01.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42ffad7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e390863cf0 con 0x55e390957b40 2024-09-19T06:55:01.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42ffad7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e3908b82b0 con 0x55e3909565d0 2024-09-19T06:55:01.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42dffff640 1 -- 172.21.15.12:0/143036196 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f42e8043400 con 0x7f42f8100a80 2024-09-19T06:55:01.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e390956090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e390963760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e390956090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:33176/0 (socket says 172.21.15.12:33176) 2024-09-19T06:55:01.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f77fe640 1 -- 172.21.15.12:0/4111406533 learned_addr learned my addr 172.21.15.12:0/4111406533 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:01.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f6ffd640 1 --2- 172.21.15.12:0/4111406533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e3909565d0 0x55e390956a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f77fe640 1 -- 172.21.15.12:0/4111406533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e3909565d0 msgr2=0x55e390956a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:01.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f77fe640 1 --2- 172.21.15.12:0/4111406533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e3909565d0 0x55e390956a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f77fe640 1 -- 172.21.15.12:0/4111406533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 msgr2=0x55e390963760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:01.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f77fe640 1 --2- 172.21.15.12:0/4111406533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e390963760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f77fe640 1 -- 172.21.15.12:0/4111406533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3908483a0 con 0x55e390957b40 2024-09-19T06:55:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.387+0000 7f42f77fe640 1 --2- 172.21.15.12:0/4111406533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e390956090 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f42f0011470 tx=0x7f42f0011930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b598ba09255b2910 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42dd7fa640 1 -- 172.21.15.12:0/4111406533 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0004b20 con 0x55e390957b40 2024-09-19T06:55:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42dd7fa640 1 -- 172.21.15.12:0/4111406533 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42f0004cc0 con 0x55e390957b40 2024-09-19T06:55:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42dd7fa640 1 -- 172.21.15.12:0/4111406533 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f00053c0 con 0x55e390957b40 2024-09-19T06:55:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42dffff640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f42e00a33b0 0x7f42e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42f6ffd640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f42e00a33b0 0x7f42e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42dffff640 1 -- 172.21.15.12:0/143036196 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f42e80f0500 con 0x7f42f8100a80 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42ffad7740 1 -- 172.21.15.12:0/4111406533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 msgr2=0x55e390956090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42ffad7740 1 --2- 172.21.15.12:0/4111406533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e390956090 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f42f0011470 tx=0x7f42f0011930 comp rx=0 tx=0).stop 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42f6ffd640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f42e00a33b0 0x7f42e00a5870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f42e80edc60 tx=0x7f42e802a420 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42ffad7740 1 -- 172.21.15.12:0/4111406533 shutdown_connections 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42ffad7740 1 --2- 172.21.15.12:0/4111406533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e390963760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42ffad7740 1 --2- 172.21.15.12:0/4111406533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e3909565d0 0x55e390956a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42ffad7740 1 --2- 172.21.15.12:0/4111406533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e390956090 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.388+0000 7f42ffad7740 1 -- 172.21.15.12:0/4111406533 >> 172.21.15.12:0/4111406533 conn(0x55e39091f310 msgr2=0x55e390952c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 1 -- 172.21.15.12:0/4111406533 shutdown_connections 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 1 -- 172.21.15.12:0/4111406533 wait complete. 2024-09-19T06:55:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 1 -- start start 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 1 Processor -- start 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3909565d0 0x55e390960c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e39095dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390961370 0x55e39095e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e390964070 con 0x55e3909565d0 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e390877060 con 0x55e390957b40 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e3909641f0 con 0x55e390961370 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42ffad7740 10 client.0 _ll_register_callbacks cb 0x55e3905ca8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3909565d0 0x55e390960c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3909565d0 0x55e390960c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36984/0 (socket says 172.21.15.12:36984) 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42f77fe640 1 -- 172.21.15.12:0/1520739862 learned_addr learned my addr 172.21.15.12:0/1520739862 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.389+0000 7f42f67fc640 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e39095dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42f77fe640 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390961370 0x55e39095e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42f67fc640 1 -- 172.21.15.12:0/1520739862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390961370 msgr2=0x55e39095e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42f67fc640 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390961370 0x55e39095e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42f67fc640 1 -- 172.21.15.12:0/1520739862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3909565d0 msgr2=0x55e390960c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42f67fc640 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3909565d0 0x55e390960c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42f67fc640 1 -- 172.21.15.12:0/1520739862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e39062d3c0 con 0x55e390957b40 2024-09-19T06:55:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42f77fe640 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3909565d0 0x55e390960c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42f67fc640 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e39095dee0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f42f806b7e0 tx=0x7f42ec00e780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edf10f61a2911ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42daff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:55:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42daff5640 1 -- 172.21.15.12:0/1520739862 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec004250 con 0x55e390957b40 2024-09-19T06:55:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42ffad7740 1 -- 172.21.15.12:0/1520739862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42f0004cc0 con 0x55e390957b40 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42daff5640 1 -- 172.21.15.12:0/1520739862 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f42ec0043f0 con 0x55e390957b40 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42daff5640 1 -- 172.21.15.12:0/1520739862 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f42ec02b050 con 0x55e390957b40 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42ffad7740 10 client.28850 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.390+0000 7f42ffad7740 1 -- 172.21.15.12:0/1520739862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55e39096fab0 con 0x55e390957b40 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42daff5640 1 -- 172.21.15.12:0/1520739862 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42f0004cc0 con 0x55e390957b40 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42daff5640 1 -- 172.21.15.12:0/1520739862 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f42ec01d7a0 con 0x55e390957b40 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42ffad7740 10 client.28850 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42ffad7740 10 client.28850 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42ffad7740 20 client.28850 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42ffad7740 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55e390970ec0 0x55e390973340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42ffad7740 4 client.28850 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42ffad7740 1 -- 172.21.15.12:0/1520739862 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3908c9860 con 0x55e390970ec0 2024-09-19T06:55:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42f77fe640 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55e390970ec0 0x55e390973340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42f77fe640 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55e390970ec0 0x55e390973340 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d2fb9c4abdb8f796 server_cookie=d81e65158686a6e3 in_seq=0 out_seq=0 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.391+0000 7f42daff5640 10 client.28850 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42daff5640 1 -- 172.21.15.12:0/1520739862 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3908c9860 con 0x55e390970ec0 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42daff5640 10 client.28850 handle_command_reply: tid=0 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 client.28850 shutdown 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 -- 172.21.15.12:0/1520739862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 msgr2=0x55e39095dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e39095dee0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f42f806b7e0 tx=0x7f42ec00e780 comp rx=0 tx=0).stop 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 -- 172.21.15.12:0/1520739862 shutdown_connections 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55e390970ec0 0x55e390973340 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390961370 0x55e39095e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e39095dee0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42daff5640 0 client.28850 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:55:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 --2- 172.21.15.12:0/1520739862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e3909565d0 0x55e390960c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 -- 172.21.15.12:0/1520739862 >> 172.21.15.12:0/1520739862 conn(0x55e39091f310 msgr2=0x55e390958960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:01.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 -- 172.21.15.12:0/1520739862 shutdown_connections 2024-09-19T06:55:01.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.392+0000 7f42ffad7740 1 -- 172.21.15.12:0/1520739862 wait complete. 2024-09-19T06:55:01.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.393+0000 7f42ffad7740 20 client.28850 trim_cache size 0 max 16384 2024-09-19T06:55:01.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42ffad7740 1 Processor -- start 2024-09-19T06:55:01.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42ffad7740 1 -- start start 2024-09-19T06:55:01.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e3909565d0 0x55e39096d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390957b40 0x55e390959120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e390959660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42ffad7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81ab9b0 con 0x55e390961370 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42ffad7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81ad520 con 0x55e3909565d0 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42ffad7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81ac080 con 0x55e390957b40 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e390959660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e390959660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36994/0 (socket says 172.21.15.12:36994) 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42f77fe640 1 -- 172.21.15.12:0/3962723975 learned_addr learned my addr 172.21.15.12:0/3962723975 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42f67fc640 1 --2- 172.21.15.12:0/3962723975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390957b40 0x55e390959120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42f77fe640 1 --2- 172.21.15.12:0/3962723975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e3909565d0 0x55e39096d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42f67fc640 1 -- 172.21.15.12:0/3962723975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e3909565d0 msgr2=0x55e39096d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42f67fc640 1 --2- 172.21.15.12:0/3962723975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e3909565d0 0x55e39096d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.410+0000 7f42f67fc640 1 -- 172.21.15.12:0/3962723975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 msgr2=0x55e390959660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.411+0000 7f42f67fc640 1 --2- 172.21.15.12:0/3962723975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e390959660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.411+0000 7f42f67fc640 1 -- 172.21.15.12:0/3962723975 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e39095c470 con 0x55e390957b40 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.411+0000 7f42f67fc640 1 --2- 172.21.15.12:0/3962723975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390957b40 0x55e390959120 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f42ec01dc40 tx=0x7f42ec013bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3223f234e382fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.411+0000 7f42dcff9640 1 -- 172.21.15.12:0/3962723975 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec01d600 con 0x55e390957b40 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.411+0000 7f42dcff9640 1 -- 172.21.15.12:0/3962723975 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42ec033030 con 0x55e390957b40 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.411+0000 7f42dcff9640 1 -- 172.21.15.12:0/3962723975 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec003a50 con 0x55e390957b40 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 -- 172.21.15.12:0/3962723975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390957b40 msgr2=0x55e390959120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 --2- 172.21.15.12:0/3962723975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390957b40 0x55e390959120 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f42ec01dc40 tx=0x7f42ec013bd0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 -- 172.21.15.12:0/3962723975 shutdown_connections 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 --2- 172.21.15.12:0/3962723975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e390959660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 --2- 172.21.15.12:0/3962723975 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e390957b40 0x55e390959120 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 --2- 172.21.15.12:0/3962723975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e3909565d0 0x55e39096d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 -- 172.21.15.12:0/3962723975 >> 172.21.15.12:0/3962723975 conn(0x55e39091f310 msgr2=0x55e39095d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:01.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 -- 172.21.15.12:0/3962723975 shutdown_connections 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 -- 172.21.15.12:0/3962723975 wait complete. 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 -- start start 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.412+0000 7f42ffad7740 1 Processor -- start 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e3909565d0 0x55e390969c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e39095acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42ffad7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e39095b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42ffad7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81ace50 con 0x55e390961370 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42ffad7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81ac750 con 0x55e390957b40 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42ffad7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81a99b0 con 0x55e3909565d0 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42ffad7740 10 client.0 _ll_register_callbacks cb 0x7f42ec013c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e39095b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e39095b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37006/0 (socket says 172.21.15.12:37006) 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42f77fe640 1 -- 172.21.15.12:0/3458781283 learned_addr learned my addr 172.21.15.12:0/3458781283 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42f67fc640 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e39095acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42f77fe640 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e3909565d0 0x55e390969c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42f67fc640 1 -- 172.21.15.12:0/3458781283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e3909565d0 msgr2=0x55e390969c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42f67fc640 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e3909565d0 0x55e390969c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42f67fc640 1 -- 172.21.15.12:0/3458781283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 msgr2=0x55e39095b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42f67fc640 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e39095b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.413+0000 7f42f67fc640 1 -- 172.21.15.12:0/3458781283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e39095ba20 con 0x55e390957b40 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.414+0000 7f42f67fc640 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e39095acb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009250 tx=0x7f42ec003670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0af0f6f6783eb47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.414+0000 7f42daff5640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:55:01.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.414+0000 7f42daff5640 1 -- 172.21.15.12:0/3458781283 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec01d850 con 0x55e390957b40 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.414+0000 7f42daff5640 1 -- 172.21.15.12:0/3458781283 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f42ec0050b0 con 0x55e390957b40 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.414+0000 7f42ffad7740 1 -- 172.21.15.12:0/3458781283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42ec033030 con 0x55e390957b40 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.414+0000 7f42daff5640 1 -- 172.21.15.12:0/3458781283 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f42ec044050 con 0x55e390957b40 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.414+0000 7f42ffad7740 10 client.28856 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.414+0000 7f42ffad7740 1 -- 172.21.15.12:0/3458781283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55e3909dbc40 con 0x55e390957b40 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.414+0000 7f42daff5640 1 -- 172.21.15.12:0/3458781283 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42ec033030 con 0x55e390957b40 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.415+0000 7f42daff5640 1 -- 172.21.15.12:0/3458781283 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f42ec038420 con 0x55e390957b40 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.415+0000 7f42ffad7740 10 client.28856 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.415+0000 7f42ffad7740 10 client.28856 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.415+0000 7f42ffad7740 20 client.28856 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.415+0000 7f42ffad7740 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55e3909dc240 0x55e3909de660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.415+0000 7f42ffad7740 4 client.28856 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.415+0000 7f42ffad7740 1 -- 172.21.15.12:0/3458781283 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e3908c3d70 con 0x55e3909dc240 2024-09-19T06:55:01.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.415+0000 7f42f77fe640 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55e3909dc240 0x55e3909de660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.415+0000 7f42daff5640 10 client.28856 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.415+0000 7f42f77fe640 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55e3909dc240 0x55e3909de660 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8082b71f09801b53 server_cookie=b6efec91a76be10b in_seq=0 out_seq=0 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42daff5640 1 -- 172.21.15.12:0/3458781283 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e3908c3d70 con 0x55e3909dc240 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42daff5640 10 client.28856 handle_command_reply: tid=0 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 client.28856 shutdown 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 -- 172.21.15.12:0/3458781283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 msgr2=0x55e39095acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e39095acb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009250 tx=0x7f42ec003670 comp rx=0 tx=0).stop 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 -- 172.21.15.12:0/3458781283 shutdown_connections 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55e3909dc240 0x55e3909de660 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e390961370 0x55e39095b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e390957b40 0x55e39095acb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 --2- 172.21.15.12:0/3458781283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e3909565d0 0x55e390969c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 -- 172.21.15.12:0/3458781283 >> 172.21.15.12:0/3458781283 conn(0x55e39091f310 msgr2=0x55e39095f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:01.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42daff5640 0 client.28856 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:55:01.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 -- 172.21.15.12:0/3458781283 shutdown_connections 2024-09-19T06:55:01.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 1 -- 172.21.15.12:0/3458781283 wait complete. 2024-09-19T06:55:01.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.416+0000 7f42ffad7740 20 client.28856 trim_cache size 0 max 16384 2024-09-19T06:55:01.440 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:55:01.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 -- 172.21.15.12:0/143036196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f42e00a33b0 msgr2=0x7f42e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:01.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f42e00a33b0 0x7f42e00a5870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f42e80edc60 tx=0x7f42e802a420 comp rx=0 tx=0).stop 2024-09-19T06:55:01.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 -- 172.21.15.12:0/143036196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42f8100a80 msgr2=0x7f42f8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:01.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42f8100a80 0x7f42f8198450 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f42e8005940 tx=0x7f42e8031b50 comp rx=0 tx=0).stop 2024-09-19T06:55:01.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 -- 172.21.15.12:0/143036196 shutdown_connections 2024-09-19T06:55:01.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f8106a80 0x7f42f819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f42e00a33b0 0x7f42e00a5870 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f42f8101420 0x7f42f8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 --2- 172.21.15.12:0/143036196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42f8100a80 0x7f42f8198450 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:01.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 -- 172.21.15.12:0/143036196 >> 172.21.15.12:0/143036196 conn(0x7f42f80fc7c0 msgr2=0x7f42f81048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:01.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 -- 172.21.15.12:0/143036196 shutdown_connections 2024-09-19T06:55:01.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:01.417+0000 7f42fd6fe640 1 -- 172.21.15.12:0/143036196 wait complete. 2024-09-19T06:55:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.009+0000 7fde560f8640 1 -- 172.21.15.12:0/2947122812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde501048f0 msgr2=0x7fde50108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.009+0000 7fde560f8640 1 --2- 172.21.15.12:0/2947122812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde501048f0 0x7fde50108930 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fde38009900 tx=0x7fde3802a410 comp rx=0 tx=0).stop 2024-09-19T06:55:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.010+0000 7fde560f8640 1 -- 172.21.15.12:0/2947122812 shutdown_connections 2024-09-19T06:55:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.010+0000 7fde560f8640 1 --2- 172.21.15.12:0/2947122812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde50109090 0x7fde50110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.010+0000 7fde560f8640 1 --2- 172.21.15.12:0/2947122812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde501048f0 0x7fde50108930 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.010+0000 7fde560f8640 1 --2- 172.21.15.12:0/2947122812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50103f40 0x7fde50104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.010+0000 7fde560f8640 1 -- 172.21.15.12:0/2947122812 >> 172.21.15.12:0/2947122812 conn(0x7fde500ff9b0 msgr2=0x7fde50101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.010+0000 7fde560f8640 1 -- 172.21.15.12:0/2947122812 shutdown_connections 2024-09-19T06:55:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.010+0000 7fde560f8640 1 -- 172.21.15.12:0/2947122812 wait complete. 2024-09-19T06:55:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.010+0000 7fde560f8640 1 Processor -- start 2024-09-19T06:55:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.010+0000 7fde560f8640 1 -- start start 2024-09-19T06:55:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde560f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50103f40 0x7fde5019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde560f8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde50109090 0x7fde5019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde560f8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5019ee30 0x7fde5019f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde560f8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fde501140b0 con 0x7fde50109090 2024-09-19T06:55:02.014 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde560f8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fde50113f30 con 0x7fde50103f40 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde560f8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fde50114230 con 0x7fde5019ee30 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde47fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde50109090 0x7fde5019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde47fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde50109090 0x7fde5019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37024/0 (socket says 172.21.15.12:37024) 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde47fff640 1 -- 172.21.15.12:0/1284053055 learned_addr learned my addr 172.21.15.12:0/1284053055 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde4ffff640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5019ee30 0x7fde5019f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50103f40 0x7fde5019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde4f7fe640 1 -- 172.21.15.12:0/1284053055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5019ee30 msgr2=0x7fde5019f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5019ee30 0x7fde5019f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde4f7fe640 1 -- 172.21.15.12:0/1284053055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde50109090 msgr2=0x7fde5019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde50109090 0x7fde5019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde4f7fe640 1 -- 172.21.15.12:0/1284053055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5019f920 con 0x7fde50103f40 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde47fff640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde50109090 0x7fde5019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:02.015 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.011+0000 7fde4ffff640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5019ee30 0x7fde5019f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.012+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50103f40 0x7fde5019a570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fde4000d6d0 tx=0x7fde4000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.013+0000 7fde4d7fa640 1 -- 172.21.15.12:0/1284053055 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40017070 con 0x7fde50103f40 2024-09-19T06:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.013+0000 7fde4d7fa640 1 -- 172.21.15.12:0/1284053055 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde40009820 con 0x7fde50103f40 2024-09-19T06:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.013+0000 7fde4d7fa640 1 -- 172.21.15.12:0/1284053055 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40004d00 con 0x7fde50103f40 2024-09-19T06:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.013+0000 7fde560f8640 1 -- 172.21.15.12:0/1284053055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5019fc10 con 0x7fde50103f40 2024-09-19T06:55:02.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.013+0000 7fde560f8640 1 -- 172.21.15.12:0/1284053055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde501a7400 con 0x7fde50103f40 2024-09-19T06:55:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.015+0000 7fde4d7fa640 1 -- 172.21.15.12:0/1284053055 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fde40005220 con 0x7fde50103f40 2024-09-19T06:55:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.015+0000 7fde4d7fa640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fde3c0a34e0 0x7fde3c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.015+0000 7fde58e95740 1 Processor -- start 2024-09-19T06:55:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde47fff640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fde3c0a34e0 0x7fde3c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde58e95740 1 -- start start 2024-09-19T06:55:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4d7fa640 1 -- 172.21.15.12:0/1284053055 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7fde400cf890 con 0x7fde50103f40 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde58e95740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 0x561fe17e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde58e95740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17f0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde58e95740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde58e95740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561fe174a2f0 con 0x561fe17f0cb0 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde58e95740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561fe16f2270 con 0x561fe17e6410 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde58e95740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561fe17462b0 con 0x561fe17e5af0 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 0x561fe17e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37040/0 (socket says 172.21.15.12:37040) 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4ffff640 1 -- 172.21.15.12:0/3036599082 learned_addr learned my addr 172.21.15.12:0/3036599082 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde47fff640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fde3c0a34e0 0x7fde3c0a59a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fde380096c0 tx=0x7fde380058d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde47fff640 1 --2- 172.21.15.12:0/3036599082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3036599082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 msgr2=0x561fe17f0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3036599082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17f0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3036599082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 msgr2=0x561fe17f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3036599082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3036599082 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fe16f1340 con 0x561fe17e5af0 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde4ffff640 1 --2- 172.21.15.12:0/3036599082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.016+0000 7fde47fff640 1 --2- 172.21.15.12:0/3036599082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17f0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.017+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3036599082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 0x561fe17e5ed0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fde400ccee0 tx=0x7fde4009bc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ccfe04533dcd0fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.017+0000 7fde45ffb640 1 -- 172.21.15.12:0/3036599082 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40020070 con 0x561fe17e5af0 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.017+0000 7fde45ffb640 1 -- 172.21.15.12:0/3036599082 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde40009d40 con 0x561fe17e5af0 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.017+0000 7fde45ffb640 1 -- 172.21.15.12:0/3036599082 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde400860b0 con 0x561fe17e5af0 2024-09-19T06:55:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 -- 172.21.15.12:0/3036599082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 msgr2=0x561fe17e5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 --2- 172.21.15.12:0/3036599082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 0x561fe17e5ed0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fde400ccee0 tx=0x7fde4009bc60 comp rx=0 tx=0).stop 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 -- 172.21.15.12:0/3036599082 shutdown_connections 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 --2- 172.21.15.12:0/3036599082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 --2- 172.21.15.12:0/3036599082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17f0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 --2- 172.21.15.12:0/3036599082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 0x561fe17e5ed0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 -- 172.21.15.12:0/3036599082 >> 172.21.15.12:0/3036599082 conn(0x561fe17e2060 msgr2=0x561fe17e2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 -- 172.21.15.12:0/3036599082 shutdown_connections 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 -- 172.21.15.12:0/3036599082 wait complete. 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 -- start start 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.018+0000 7fde58e95740 1 Processor -- start 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde58e95740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 0x561fe17edc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde58e95740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17ee180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde58e95740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde58e95740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561fe17f3880 con 0x561fe17f0cb0 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde58e95740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x561fe16d3290 con 0x561fe17e6410 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde58e95740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561fe17f3a00 con 0x561fe17e5af0 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde58e95740 10 client.0 _ll_register_callbacks cb 0x561fe1704140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 0x561fe17edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde47fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17ee6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37044/0 (socket says 172.21.15.12:37044) 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4ffff640 1 -- 172.21.15.12:0/3526311974 learned_addr learned my addr 172.21.15.12:0/3526311974 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4ffff640 1 -- 172.21.15.12:0/3526311974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 msgr2=0x561fe17edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4ffff640 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 0x561fe17edc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4ffff640 1 -- 172.21.15.12:0/3526311974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 msgr2=0x561fe17ee180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4ffff640 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17ee180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4ffff640 1 -- 172.21.15.12:0/3526311974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fe145d210 con 0x561fe17f0cb0 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 0x561fe17edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde47fff640 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde4ffff640 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17ee6c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fde4800fe20 tx=0x7fde48012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dede12e40fef7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde2effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.019+0000 7fde2effd640 1 -- 172.21.15.12:0/3526311974 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48004b20 con 0x561fe17f0cb0 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde2effd640 1 -- 172.21.15.12:0/3526311974 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7fde48004cc0 con 0x561fe17f0cb0 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde58e95740 1 -- 172.21.15.12:0/3526311974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde40009d40 con 0x561fe17f0cb0 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde2effd640 1 -- 172.21.15.12:0/3526311974 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fde4801c470 con 0x561fe17f0cb0 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde58e95740 10 client.19533 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde58e95740 1 -- 172.21.15.12:0/3526311974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x561fe1529620 con 0x561fe17f0cb0 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde2effd640 1 -- 172.21.15.12:0/3526311974 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde40009d40 con 0x561fe17f0cb0 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde2effd640 1 -- 172.21.15.12:0/3526311974 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7fde48010680 con 0x561fe17f0cb0 2024-09-19T06:55:02.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde58e95740 10 client.19533 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde58e95740 10 client.19533 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde58e95740 20 client.19533 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde58e95740 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561fe1800c60 0x561fe1803050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde58e95740 4 client.19533 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde58e95740 1 -- 172.21.15.12:0/3526311974 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fe1757a20 con 0x561fe1800c60 2024-09-19T06:55:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.020+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561fe1800c60 0x561fe1803050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.021+0000 7fde2effd640 10 client.19533 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:02.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.021+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561fe1800c60 0x561fe1803050 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77141d8db718b06 server_cookie=f85b4b1401d2c0ab in_seq=0 out_seq=0 2024-09-19T06:55:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.021+0000 7fde2effd640 1 -- 172.21.15.12:0/3526311974 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fe1757a20 con 0x561fe1800c60 2024-09-19T06:55:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.021+0000 7fde2effd640 10 client.19533 handle_command_reply: tid=0 2024-09-19T06:55:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 client.19533 shutdown 2024-09-19T06:55:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 -- 172.21.15.12:0/3526311974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 msgr2=0x561fe17ee6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17ee6c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fde4800fe20 tx=0x7fde48012820 comp rx=0 tx=0).stop 2024-09-19T06:55:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 -- 172.21.15.12:0/3526311974 shutdown_connections 2024-09-19T06:55:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561fe1800c60 0x561fe1803050 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17f0cb0 0x561fe17ee6c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 --2- 172.21.15.12:0/3526311974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17e5af0 0x561fe17edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde2effd640 0 client.19533 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 -- 172.21.15.12:0/3526311974 >> 172.21.15.12:0/3526311974 conn(0x561fe17e2060 msgr2=0x561fe17e7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 -- 172.21.15.12:0/3526311974 shutdown_connections 2024-09-19T06:55:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 1 -- 172.21.15.12:0/3526311974 wait complete. 2024-09-19T06:55:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.022+0000 7fde58e95740 20 client.19533 trim_cache size 0 max 16384 2024-09-19T06:55:02.045 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.037+0000 7fde58e95740 1 Processor -- start 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.037+0000 7fde58e95740 1 -- start start 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.037+0000 7fde58e95740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17e1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.037+0000 7fde58e95740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.037+0000 7fde58e95740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 0x561fe17e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.037+0000 7fde58e95740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fde501afe00 con 0x561fe17e5af0 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.037+0000 7fde58e95740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fde501b1970 con 0x561fe17e6410 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.037+0000 7fde58e95740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fde501b04d0 con 0x561fe17f0cb0 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.037+0000 7fde4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17e1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 0x561fe17e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17e1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37048/0 (socket says 172.21.15.12:37048) 2024-09-19T06:55:02.046 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde47fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3642130382 learned_addr learned my addr 172.21.15.12:0/3642130382 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3642130382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 msgr2=0x561fe17e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3642130382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 0x561fe17e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3642130382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 msgr2=0x561fe17ee4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3642130382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17ee4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3642130382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fe17ec170 con 0x561fe17e5af0 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde4ffff640 1 --2- 172.21.15.12:0/3642130382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 0x561fe17e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3642130382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17e1b00 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fde40009fd0 tx=0x7fde400aff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9a4f379b25a1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde457fa640 1 -- 172.21.15.12:0/3642130382 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40020040 con 0x561fe17e5af0 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde457fa640 1 -- 172.21.15.12:0/3642130382 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde400ba070 con 0x561fe17e5af0 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.038+0000 7fde457fa640 1 -- 172.21.15.12:0/3642130382 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde400860b0 con 0x561fe17e5af0 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.039+0000 7fde58e95740 1 -- 172.21.15.12:0/3642130382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 msgr2=0x561fe17e1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:02.047 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.039+0000 7fde58e95740 1 --2- 172.21.15.12:0/3642130382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17e1b00 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fde40009fd0 tx=0x7fde400aff90 comp rx=0 tx=0).stop 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.039+0000 7fde58e95740 1 -- 172.21.15.12:0/3642130382 shutdown_connections 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.039+0000 7fde58e95740 1 --2- 172.21.15.12:0/3642130382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 0x561fe17e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.039+0000 7fde58e95740 1 --2- 172.21.15.12:0/3642130382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17ee4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.039+0000 7fde58e95740 1 --2- 172.21.15.12:0/3642130382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17e1b00 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.039+0000 7fde58e95740 1 -- 172.21.15.12:0/3642130382 >> 172.21.15.12:0/3642130382 conn(0x561fe17e2060 msgr2=0x561fe17e7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.039+0000 7fde58e95740 1 -- 172.21.15.12:0/3642130382 shutdown_connections 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.039+0000 7fde58e95740 1 -- 172.21.15.12:0/3642130382 wait complete. 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.039+0000 7fde58e95740 1 -- start start 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde58e95740 1 Processor -- start 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde58e95740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17f4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde58e95740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17f4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde58e95740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 0x561fe18638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.048 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde58e95740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fde501b12a0 con 0x561fe17e5af0 2024-09-19T06:55:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde58e95740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fde501b0ba0 con 0x561fe17e6410 2024-09-19T06:55:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde58e95740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fde501ade00 con 0x561fe17f0cb0 2024-09-19T06:55:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde58e95740 10 client.0 _ll_register_callbacks cb 0x7fde4800f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17f4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37052/0 (socket says 172.21.15.12:37052) 2024-09-19T06:55:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3222542918 learned_addr learned my addr 172.21.15.12:0/3222542918 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde47fff640 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde4ffff640 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 0x561fe18638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.049 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3222542918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 msgr2=0x561fe18638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 0x561fe18638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3222542918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 msgr2=0x561fe17f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde4f7fe640 1 -- 172.21.15.12:0/3222542918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fe1863f60 con 0x561fe17e5af0 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.040+0000 7fde47fff640 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde4f7fe640 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17f4400 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fde40009610 tx=0x7fde40097ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7623b7676d2ebbd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde2effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde2effd640 1 -- 172.21.15.12:0/3222542918 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40080020 con 0x561fe17e5af0 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde2effd640 1 -- 172.21.15.12:0/3222542918 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7fde40009d40 con 0x561fe17e5af0 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde58e95740 1 -- 172.21.15.12:0/3222542918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde400ba070 con 0x561fe17e5af0 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde2effd640 1 -- 172.21.15.12:0/3222542918 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fde40020040 con 0x561fe17e5af0 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde58e95740 10 client.19539 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:02.050 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde58e95740 1 -- 172.21.15.12:0/3222542918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x561fe186b2f0 con 0x561fe17e5af0 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde2effd640 1 -- 172.21.15.12:0/3222542918 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde400ba070 con 0x561fe17e5af0 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde2effd640 1 -- 172.21.15.12:0/3222542918 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7fde40083020 con 0x561fe17e5af0 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde58e95740 10 client.19539 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde58e95740 10 client.19539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde58e95740 20 client.19539 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde58e95740 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561fe186b5c0 0x561fe186d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde58e95740 4 client.19539 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.041+0000 7fde58e95740 1 -- 172.21.15.12:0/3222542918 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561fe1751d70 con 0x561fe186b5c0 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.042+0000 7fde47fff640 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561fe186b5c0 0x561fe186d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.042+0000 7fde47fff640 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561fe186b5c0 0x561fe186d9b0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51f6c109761d03eb server_cookie=4b3dd4586389fedc in_seq=0 out_seq=0 2024-09-19T06:55:02.051 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.042+0000 7fde2effd640 10 client.19539 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.057+0000 7fde2effd640 1 -- 172.21.15.12:0/3222542918 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561fe1751d70 con 0x561fe186b5c0 2024-09-19T06:55:02.059 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.057+0000 7fde2effd640 10 client.19539 handle_command_reply: tid=0 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.057+0000 7fde58e95740 1 client.19539 shutdown 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 1 -- 172.21.15.12:0/3222542918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 msgr2=0x561fe17f4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17f4400 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fde40009610 tx=0x7fde40097ec0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 1 -- 172.21.15.12:0/3222542918 shutdown_connections 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x561fe186b5c0 0x561fe186d9b0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561fe17f0cb0 0x561fe18638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde2effd640 0 client.19539 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561fe17e6410 0x561fe17f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 1 --2- 172.21.15.12:0/3222542918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561fe17e5af0 0x561fe17f4400 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 1 -- 172.21.15.12:0/3222542918 >> 172.21.15.12:0/3222542918 conn(0x561fe17e2060 msgr2=0x561fe17e7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 1 -- 172.21.15.12:0/3222542918 shutdown_connections 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 1 -- 172.21.15.12:0/3222542918 wait complete. 2024-09-19T06:55:02.060 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.058+0000 7fde58e95740 20 client.19539 trim_cache size 0 max 16384 2024-09-19T06:55:02.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:55:02.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:55:02.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:55:02.061 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 -- 172.21.15.12:0/1284053055 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fde3c0a34e0 msgr2=0x7fde3c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fde3c0a34e0 0x7fde3c0a59a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fde380096c0 tx=0x7fde380058d0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 -- 172.21.15.12:0/1284053055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50103f40 msgr2=0x7fde5019a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50103f40 0x7fde5019a570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fde4000d6d0 tx=0x7fde4000db90 comp rx=0 tx=0).stop 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 -- 172.21.15.12:0/1284053055 shutdown_connections 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fde3c0a34e0 0x7fde3c0a59a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde5019ee30 0x7fde5019f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde50109090 0x7fde5019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 --2- 172.21.15.12:0/1284053055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50103f40 0x7fde5019a570 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 -- 172.21.15.12:0/1284053055 >> 172.21.15.12:0/1284053055 conn(0x7fde500ff9b0 msgr2=0x7fde50100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 -- 172.21.15.12:0/1284053055 shutdown_connections 2024-09-19T06:55:02.062 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:02.059+0000 7fde560f8640 1 -- 172.21.15.12:0/1284053055 wait complete. 2024-09-19T06:55:02.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:02 smithi012 ceph-mon[30937]: pgmap v465: 97 pgs: 97 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.8 MiB/s wr, 893 op/s 2024-09-19T06:55:02.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:55:02.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:02 smithi173 ceph-mon[35349]: pgmap v465: 97 pgs: 97 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.8 MiB/s wr, 893 op/s 2024-09-19T06:55:02.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:02 smithi016 ceph-mon[34911]: pgmap v465: 97 pgs: 97 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.8 MiB/s wr, 893 op/s 2024-09-19T06:55:02.578 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:03.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.191+0000 7f775cae6640 1 -- 172.21.15.12:0/1578885608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7758100a80 msgr2=0x7f7758100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.191+0000 7f775cae6640 1 --2- 172.21.15.12:0/1578885608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7758100a80 0x7f7758100ee0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f774c009930 tx=0x7f774c02a420 comp rx=0 tx=0).stop 2024-09-19T06:55:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.191+0000 7f775cae6640 1 -- 172.21.15.12:0/1578885608 shutdown_connections 2024-09-19T06:55:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.191+0000 7f775cae6640 1 --2- 172.21.15.12:0/1578885608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7758101420 0x7f775810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.191+0000 7f775cae6640 1 --2- 172.21.15.12:0/1578885608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7758100a80 0x7f7758100ee0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.191+0000 7f775cae6640 1 --2- 172.21.15.12:0/1578885608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7758106a80 0x7f7758106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.191+0000 7f775cae6640 1 -- 172.21.15.12:0/1578885608 >> 172.21.15.12:0/1578885608 conn(0x7f77580fc7a0 msgr2=0x7f77580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.191+0000 7f775cae6640 1 -- 172.21.15.12:0/1578885608 shutdown_connections 2024-09-19T06:55:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.191+0000 7f775cae6640 1 -- 172.21.15.12:0/1578885608 wait complete. 2024-09-19T06:55:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.192+0000 7f775cae6640 1 Processor -- start 2024-09-19T06:55:03.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.192+0000 7f775cae6640 1 -- start start 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775cae6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7758100a80 0x7f7758198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775cae6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7758101420 0x7f7758198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775cae6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7758106a80 0x7f775819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775cae6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7758111f50 con 0x7f7758100a80 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775cae6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7758111dd0 con 0x7f7758106a80 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775cae6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f77581120d0 con 0x7f7758101420 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7758100a80 0x7f7758198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7758100a80 0x7f7758198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37060/0 (socket says 172.21.15.12:37060) 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775659c640 1 -- 172.21.15.12:0/4216512037 learned_addr learned my addr 172.21.15.12:0/4216512037 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f7756d9d640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7758106a80 0x7f775819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f7755d9b640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7758101420 0x7f7758198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775659c640 1 -- 172.21.15.12:0/4216512037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7758101420 msgr2=0x7f7758198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:03.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775659c640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7758101420 0x7f7758198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775659c640 1 -- 172.21.15.12:0/4216512037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7758106a80 msgr2=0x7f775819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775659c640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7758106a80 0x7f775819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.193+0000 7f775659c640 1 -- 172.21.15.12:0/4216512037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775819d400 con 0x7f7758100a80 2024-09-19T06:55:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.194+0000 7f775659c640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7758100a80 0x7f7758198450 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f774800e9f0 tx=0x7f774800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.194+0000 7f77477fe640 1 -- 172.21.15.12:0/4216512037 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774800cd80 con 0x7f7758100a80 2024-09-19T06:55:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.194+0000 7f775cae6640 1 -- 172.21.15.12:0/4216512037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775819d6f0 con 0x7f7758100a80 2024-09-19T06:55:03.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.194+0000 7f77477fe640 1 -- 172.21.15.12:0/4216512037 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7748010910 con 0x7f7758100a80 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.194+0000 7f77477fe640 1 -- 172.21.15.12:0/4216512037 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77480188f0 con 0x7f7758100a80 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.194+0000 7f775cae6640 1 -- 172.21.15.12:0/4216512037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77581a4fd0 con 0x7f7758100a80 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.196+0000 7f77477fe640 1 -- 172.21.15.12:0/4216512037 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7748010ac0 con 0x7f7758100a80 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f775eebf740 1 Processor -- start 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f775eebf740 1 -- start start 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f775eebf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b35090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f775eebf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b355d0 0x55b6b4b35a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f775eebf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b40370 0x55b6b4b42760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f775eebf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b6b4a9b2f0 con 0x55b6b4b36b40 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f775eebf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b6b4a42cf0 con 0x55b6b4b40370 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f775eebf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b6b4a972b0 con 0x55b6b4b355d0 2024-09-19T06:55:03.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f7756d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b35090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f7756d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b35090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37072/0 (socket says 172.21.15.12:37072) 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.197+0000 7f7756d9d640 1 -- 172.21.15.12:0/479251136 learned_addr learned my addr 172.21.15.12:0/479251136 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f775659c640 1 --2- 172.21.15.12:0/479251136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b355d0 0x55b6b4b35a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f7755d9b640 1 --2- 172.21.15.12:0/479251136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b40370 0x55b6b4b42760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f77477fe640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f77400a33b0 0x7f77400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f7755d9b640 1 -- 172.21.15.12:0/479251136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b355d0 msgr2=0x55b6b4b35a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f7755d9b640 1 --2- 172.21.15.12:0/479251136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b355d0 0x55b6b4b35a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f7755d9b640 1 -- 172.21.15.12:0/479251136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 msgr2=0x55b6b4b35090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f7755d9b640 1 --2- 172.21.15.12:0/479251136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b35090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f7755d9b640 1 -- 172.21.15.12:0/479251136 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b4a273a0 con 0x55b6b4b40370 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f7756d9d640 1 --2- 172.21.15.12:0/479251136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b35090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f77477fe640 1 -- 172.21.15.12:0/4216512037 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f77480d0240 con 0x7f7758100a80 2024-09-19T06:55:03.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f7756d9d640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f77400a33b0 0x7f77400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f7755d9b640 1 --2- 172.21.15.12:0/479251136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b40370 0x55b6b4b42760 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f774c009900 tx=0x7f774c005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b9c5f399fefa9bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.198+0000 7f7756d9d640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f77400a33b0 0x7f77400a5870 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7750003df0 tx=0x7f7750004a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.199+0000 7f7744ff9640 1 -- 172.21.15.12:0/479251136 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c03f070 con 0x55b6b4b40370 2024-09-19T06:55:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.199+0000 7f7744ff9640 1 -- 172.21.15.12:0/479251136 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774c004030 con 0x55b6b4b40370 2024-09-19T06:55:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.199+0000 7f7744ff9640 1 -- 172.21.15.12:0/479251136 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c035070 con 0x55b6b4b40370 2024-09-19T06:55:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 -- 172.21.15.12:0/479251136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b40370 msgr2=0x55b6b4b42760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 --2- 172.21.15.12:0/479251136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b40370 0x55b6b4b42760 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f774c009900 tx=0x7f774c005dd0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 -- 172.21.15.12:0/479251136 shutdown_connections 2024-09-19T06:55:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 --2- 172.21.15.12:0/479251136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b40370 0x55b6b4b42760 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 --2- 172.21.15.12:0/479251136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b355d0 0x55b6b4b35a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 --2- 172.21.15.12:0/479251136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b35090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 -- 172.21.15.12:0/479251136 >> 172.21.15.12:0/479251136 conn(0x55b6b4afe310 msgr2=0x55b6b4b31c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 -- 172.21.15.12:0/479251136 shutdown_connections 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 -- 172.21.15.12:0/479251136 wait complete. 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 -- start start 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 Processor -- start 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b3d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b40370 0x55b6b4b3d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b6b4b43010 con 0x55b6b4b36b40 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b6b4a56060 con 0x55b6b4b355d0 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.200+0000 7f775eebf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b6b4b43190 con 0x55b6b4b40370 2024-09-19T06:55:03.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f775eebf740 10 client.0 _ll_register_callbacks cb 0x55b6b47a98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:03.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f775659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f7755d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b3d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f7755d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b3d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37084/0 (socket says 172.21.15.12:37084) 2024-09-19T06:55:03.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f7755d9b640 1 -- 172.21.15.12:0/1113266362 learned_addr learned my addr 172.21.15.12:0/1113266362 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:03.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f775659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:33278/0 (socket says 172.21.15.12:33278) 2024-09-19T06:55:03.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f7756d9d640 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b40370 0x55b6b4b3d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f775659c640 1 -- 172.21.15.12:0/1113266362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b40370 msgr2=0x55b6b4b3d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:03.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f775659c640 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b40370 0x55b6b4b3d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f775659c640 1 -- 172.21.15.12:0/1113266362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 msgr2=0x55b6b4b3d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f775659c640 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b3d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f775659c640 1 -- 172.21.15.12:0/1113266362 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b480c3c0 con 0x55b6b4b355d0 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f7755d9b640 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b3d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f775659c640 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3fd70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f77480cd890 tx=0x7f7748009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941424df9cb36a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f773dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f773dffb640 1 -- 172.21.15.12:0/1113266362 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77480cdd20 con 0x55b6b4b355d0 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f773dffb640 1 -- 172.21.15.12:0/1113266362 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f774809ba70 con 0x55b6b4b355d0 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.201+0000 7f775eebf740 1 -- 172.21.15.12:0/1113266362 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f774c004030 con 0x55b6b4b355d0 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f773dffb640 1 -- 172.21.15.12:0/1113266362 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f77480a5090 con 0x55b6b4b355d0 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f775eebf740 10 client.28883 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f775eebf740 1 -- 172.21.15.12:0/1113266362 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55b6b4b4eb10 con 0x55b6b4b355d0 2024-09-19T06:55:03.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f773dffb640 1 -- 172.21.15.12:0/1113266362 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f774c004030 con 0x55b6b4b355d0 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f773dffb640 1 -- 172.21.15.12:0/1113266362 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f774809b2e0 con 0x55b6b4b355d0 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f775eebf740 10 client.28883 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f775eebf740 10 client.28883 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f775eebf740 20 client.28883 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f775eebf740 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55b6b4b50020 0x55b6b4b52470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f775eebf740 4 client.28883 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f775eebf740 1 -- 172.21.15.12:0/1113266362 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6b4aa8860 con 0x55b6b4b50020 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.202+0000 7f7755d9b640 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55b6b4b50020 0x55b6b4b52470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.203+0000 7f7755d9b640 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55b6b4b50020 0x55b6b4b52470 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e3b76f52b116ab9 server_cookie=ef82f1bf3d926606 in_seq=0 out_seq=0 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.203+0000 7f773dffb640 10 client.28883 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.203+0000 7f773dffb640 1 -- 172.21.15.12:0/1113266362 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6b4aa8860 con 0x55b6b4b50020 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.203+0000 7f773dffb640 10 client.28883 handle_command_reply: tid=0 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.203+0000 7f775eebf740 1 client.28883 shutdown 2024-09-19T06:55:03.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 1 -- 172.21.15.12:0/1113266362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 msgr2=0x55b6b4b3fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3fd70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f77480cd890 tx=0x7f7748009310 comp rx=0 tx=0).stop 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 1 -- 172.21.15.12:0/1113266362 shutdown_connections 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55b6b4b50020 0x55b6b4b52470 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b40370 0x55b6b4b3d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b36b40 0x55b6b4b3d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f773dffb640 0 client.28883 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 1 --2- 172.21.15.12:0/1113266362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3fd70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 1 -- 172.21.15.12:0/1113266362 >> 172.21.15.12:0/1113266362 conn(0x55b6b4afe310 msgr2=0x55b6b4b37960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 1 -- 172.21.15.12:0/1113266362 shutdown_connections 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 1 -- 172.21.15.12:0/1113266362 wait complete. 2024-09-19T06:55:03.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.204+0000 7f775eebf740 20 client.28883 trim_cache size 0 max 16384 2024-09-19T06:55:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.219+0000 7f775eebf740 1 Processor -- start 2024-09-19T06:55:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.219+0000 7f775eebf740 1 -- start start 2024-09-19T06:55:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.219+0000 7f775eebf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.219+0000 7f775eebf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 0x55b6b4b4c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.219+0000 7f775eebf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b57d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.219+0000 7f775eebf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f77581adc30 con 0x55b6b4b40370 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.219+0000 7f775eebf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f77581af7a0 con 0x55b6b4b355d0 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.219+0000 7f775eebf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f77581ae300 con 0x55b6b4b36b40 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f7756d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b57d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f775659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f7756d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b57d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37096/0 (socket says 172.21.15.12:37096) 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f7756d9d640 1 -- 172.21.15.12:0/2893636716 learned_addr learned my addr 172.21.15.12:0/2893636716 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f7755d9b640 1 --2- 172.21.15.12:0/2893636716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 0x55b6b4b4c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f7756d9d640 1 -- 172.21.15.12:0/2893636716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 msgr2=0x55b6b4b4c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f7756d9d640 1 --2- 172.21.15.12:0/2893636716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 0x55b6b4b4c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f7756d9d640 1 -- 172.21.15.12:0/2893636716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 msgr2=0x55b6b4b3c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:03.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f7756d9d640 1 --2- 172.21.15.12:0/2893636716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f7756d9d640 1 -- 172.21.15.12:0/2893636716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b4b32960 con 0x55b6b4b40370 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f775659c640 1 --2- 172.21.15.12:0/2893636716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.220+0000 7f7755d9b640 1 --2- 172.21.15.12:0/2893636716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 0x55b6b4b4c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.221+0000 7f7756d9d640 1 --2- 172.21.15.12:0/2893636716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b57d80 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7750011600 tx=0x7f7750019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d275f3b131e5fda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.221+0000 7f773ffff640 1 -- 172.21.15.12:0/2893636716 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775002e070 con 0x55b6b4b40370 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.221+0000 7f773ffff640 1 -- 172.21.15.12:0/2893636716 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f775001e9e0 con 0x55b6b4b40370 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.221+0000 7f773ffff640 1 -- 172.21.15.12:0/2893636716 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750029a90 con 0x55b6b4b40370 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 -- 172.21.15.12:0/2893636716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 msgr2=0x55b6b4b57d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 --2- 172.21.15.12:0/2893636716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b57d80 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7750011600 tx=0x7f7750019000 comp rx=0 tx=0).stop 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 -- 172.21.15.12:0/2893636716 shutdown_connections 2024-09-19T06:55:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 --2- 172.21.15.12:0/2893636716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b57d80 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 --2- 172.21.15.12:0/2893636716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 0x55b6b4b4c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 --2- 172.21.15.12:0/2893636716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4b3c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 -- 172.21.15.12:0/2893636716 >> 172.21.15.12:0/2893636716 conn(0x55b6b4afe310 msgr2=0x55b6b4b3b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 -- 172.21.15.12:0/2893636716 shutdown_connections 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 -- 172.21.15.12:0/2893636716 wait complete. 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 -- start start 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 Processor -- start 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4bb6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.222+0000 7f775eebf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 0x55b6b4b48420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f775eebf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b48960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f775eebf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f77581af0d0 con 0x55b6b4b40370 2024-09-19T06:55:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f775eebf740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f77581ae9d0 con 0x55b6b4b355d0 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f775eebf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f77581abc30 con 0x55b6b4b36b40 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f775eebf740 10 client.0 _ll_register_callbacks cb 0x7f7748009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f7756d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b48960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f775659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4bb6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f7756d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b48960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37108/0 (socket says 172.21.15.12:37108) 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f775659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4bb6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:33286/0 (socket says 172.21.15.12:33286) 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f7756d9d640 1 -- 172.21.15.12:0/1134668131 learned_addr learned my addr 172.21.15.12:0/1134668131 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f7755d9b640 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 0x55b6b4b48420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f7756d9d640 1 -- 172.21.15.12:0/1134668131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 msgr2=0x55b6b4b48420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f7756d9d640 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 0x55b6b4b48420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f7756d9d640 1 -- 172.21.15.12:0/1134668131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 msgr2=0x55b6b4bb6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:03.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f7756d9d640 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4bb6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f7756d9d640 1 -- 172.21.15.12:0/1134668131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b4b4c7f0 con 0x55b6b4b40370 2024-09-19T06:55:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f7756d9d640 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b48960 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7750014040 tx=0x7f7750005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29aa4c37b03b1c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.223+0000 7f773dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f773dffb640 1 -- 172.21.15.12:0/1134668131 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775002e040 con 0x55b6b4b40370 2024-09-19T06:55:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f775eebf740 1 -- 172.21.15.12:0/1134668131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f775001e9e0 con 0x55b6b4b40370 2024-09-19T06:55:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f773dffb640 1 -- 172.21.15.12:0/1134668131 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8687+0+0 (secure 0 0 0) 0x7f775001e190 con 0x55b6b4b40370 2024-09-19T06:55:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f773dffb640 1 -- 172.21.15.12:0/1134668131 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f7750042050 con 0x55b6b4b40370 2024-09-19T06:55:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f775eebf740 10 client.19557 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f775eebf740 1 -- 172.21.15.12:0/1134668131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55b6b4bbf160 con 0x55b6b4b40370 2024-09-19T06:55:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f773dffb640 1 -- 172.21.15.12:0/1134668131 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f775001e9e0 con 0x55b6b4b40370 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f773dffb640 1 -- 172.21.15.12:0/1134668131 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f7750031030 con 0x55b6b4b40370 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f775eebf740 10 client.19557 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f775eebf740 10 client.19557 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f775eebf740 20 client.19557 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f775eebf740 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55b6b4bbf770 0x55b6b4bc1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f775eebf740 4 client.19557 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f775eebf740 1 -- 172.21.15.12:0/1134668131 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b6b4aa2d70 con 0x55b6b4bbf770 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.224+0000 7f775659c640 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55b6b4bbf770 0x55b6b4bc1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f773dffb640 10 client.19557 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775659c640 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55b6b4bbf770 0x55b6b4bc1b90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e1b321c1e817246 server_cookie=f8e05b813fb1895b in_seq=0 out_seq=0 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f773dffb640 1 -- 172.21.15.12:0/1134668131 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b6b4aa2d70 con 0x55b6b4bbf770 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f773dffb640 10 client.19557 handle_command_reply: tid=0 2024-09-19T06:55:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 client.19557 shutdown 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 -- 172.21.15.12:0/1134668131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 msgr2=0x55b6b4b48960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b48960 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7750014040 tx=0x7f7750005ee0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 -- 172.21.15.12:0/1134668131 shutdown_connections 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x55b6b4bbf770 0x55b6b4bc1b90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6b4b40370 0x55b6b4b48960 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b6b4b36b40 0x55b6b4b48420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 --2- 172.21.15.12:0/1134668131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b6b4b355d0 0x55b6b4bb6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 -- 172.21.15.12:0/1134668131 >> 172.21.15.12:0/1134668131 conn(0x55b6b4afe310 msgr2=0x55b6b4b37110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f773dffb640 0 client.19557 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 -- 172.21.15.12:0/1134668131 shutdown_connections 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.225+0000 7f775eebf740 1 -- 172.21.15.12:0/1134668131 wait complete. 2024-09-19T06:55:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775eebf740 20 client.19557 trim_cache size 0 max 16384 2024-09-19T06:55:03.236 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 -- 172.21.15.12:0/4216512037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f77400a33b0 msgr2=0x7f77400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f77400a33b0 0x7f77400a5870 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7750003df0 tx=0x7f7750004a40 comp rx=0 tx=0).stop 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 -- 172.21.15.12:0/4216512037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7758100a80 msgr2=0x7f7758198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7758100a80 0x7f7758198450 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f774800e9f0 tx=0x7f774800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 -- 172.21.15.12:0/4216512037 shutdown_connections 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7758106a80 0x7f775819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f77400a33b0 0x7f77400a5870 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7758101420 0x7f7758198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 --2- 172.21.15.12:0/4216512037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7758100a80 0x7f7758198450 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 -- 172.21.15.12:0/4216512037 >> 172.21.15.12:0/4216512037 conn(0x7f77580fc7a0 msgr2=0x7f77580fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:03.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 -- 172.21.15.12:0/4216512037 shutdown_connections 2024-09-19T06:55:03.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:03.226+0000 7f775cae6640 1 -- 172.21.15.12:0/4216512037 wait complete. 2024-09-19T06:55:04.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:04 smithi012 ceph-mon[30937]: pgmap v466: 97 pgs: 97 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 608 op/s 2024-09-19T06:55:04.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:04 smithi173 ceph-mon[35349]: pgmap v466: 97 pgs: 97 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 608 op/s 2024-09-19T06:55:04.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:55:04.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:04 smithi016 ceph-mon[34911]: pgmap v466: 97 pgs: 97 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 608 op/s 2024-09-19T06:55:04.638 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:05.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.254+0000 7f2a0684c640 1 -- 172.21.15.12:0/3042989085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a00106f20 msgr2=0x7f2a0010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.254+0000 7f2a0684c640 1 --2- 172.21.15.12:0/3042989085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a00106f20 0x7f2a0010eaa0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009ca0 tx=0x7f29f802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.254+0000 7f2a0684c640 1 -- 172.21.15.12:0/3042989085 shutdown_connections 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.254+0000 7f2a0684c640 1 --2- 172.21.15.12:0/3042989085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a00106f20 0x7f2a0010eaa0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.254+0000 7f2a0684c640 1 --2- 172.21.15.12:0/3042989085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a001027a0 0x7f2a001067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.254+0000 7f2a0684c640 1 --2- 172.21.15.12:0/3042989085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a00101df0 0x7f2a001021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.254+0000 7f2a0684c640 1 -- 172.21.15.12:0/3042989085 >> 172.21.15.12:0/3042989085 conn(0x7f2a000fd8b0 msgr2=0x7f2a000ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.254+0000 7f2a0684c640 1 -- 172.21.15.12:0/3042989085 shutdown_connections 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.254+0000 7f2a0684c640 1 -- 172.21.15.12:0/3042989085 wait complete. 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f2a0684c640 1 Processor -- start 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f2a0684c640 1 -- start start 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f2a0684c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a00101df0 0x7f2a00198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f2a0684c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a001027a0 0x7f2a001988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f2a0684c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a00106f20 0x7f2a0019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f2a0684c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00111f80 con 0x7f2a00101df0 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f2a0684c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00111e00 con 0x7f2a001027a0 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f2a0684c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00112100 con 0x7f2a00106f20 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f29fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a00101df0 0x7f2a00198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f29fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a00101df0 0x7f2a00198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37126/0 (socket says 172.21.15.12:37126) 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f29fffff640 1 -- 172.21.15.12:0/1542230631 learned_addr learned my addr 172.21.15.12:0/1542230631 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a001027a0 0x7f2a001988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.255+0000 7f2a04de9640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a00106f20 0x7f2a0019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f29fffff640 1 -- 172.21.15.12:0/1542230631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a00106f20 msgr2=0x7f2a0019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f29fffff640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a00106f20 0x7f2a0019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f29fffff640 1 -- 172.21.15.12:0/1542230631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a001027a0 msgr2=0x7f2a001988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:05.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f29fffff640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a001027a0 0x7f2a001988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f29fffff640 1 -- 172.21.15.12:0/1542230631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0019d330 con 0x7f2a00101df0 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a001027a0 0x7f2a001988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f29fffff640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a00101df0 0x7f2a00198380 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f29f000e9f0 tx=0x7f29f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f29fdffb640 1 -- 172.21.15.12:0/1542230631 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f000cd80 con 0x7f2a00101df0 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f29fdffb640 1 -- 172.21.15.12:0/1542230631 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29f0005500 con 0x7f2a00101df0 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f2a0684c640 1 -- 172.21.15.12:0/1542230631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0019d620 con 0x7f2a00101df0 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f29fdffb640 1 -- 172.21.15.12:0/1542230631 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0010690 con 0x7f2a00101df0 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.256+0000 7f2a0684c640 1 -- 172.21.15.12:0/1542230631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a001a4f00 con 0x7f2a00101df0 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f29fdffb640 1 -- 172.21.15.12:0/1542230631 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f29f00046c0 con 0x7f2a00101df0 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a08c25740 1 Processor -- start 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a08c25740 1 -- start start 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f5b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5b5d0 0x559055f5ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 0x559055f68760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a08c25740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559055ec12f0 con 0x559055f5cb40 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a08c25740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559055e68cf0 con 0x559055f66370 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a08c25740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559055ebd2b0 con 0x559055f5b5d0 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a04de9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f5b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f29fffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5b5d0 0x559055f5ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a04de9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f5b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37136/0 (socket says 172.21.15.12:37136) 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f2a04de9640 1 -- 172.21.15.12:0/1369218027 learned_addr learned my addr 172.21.15.12:0/1369218027 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.259+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1369218027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 0x559055f68760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f29fdffb640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29ec0a3430 0x7f29ec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f2a04de9640 1 -- 172.21.15.12:0/1369218027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5b5d0 msgr2=0x559055f5ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f2a04de9640 1 --2- 172.21.15.12:0/1369218027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5b5d0 0x559055f5ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f2a04de9640 1 -- 172.21.15.12:0/1369218027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 msgr2=0x559055f68760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f2a04de9640 1 --2- 172.21.15.12:0/1369218027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 0x559055f68760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f2a04de9640 1 -- 172.21.15.12:0/1369218027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559055e4d3a0 con 0x559055f5cb40 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1369218027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 0x559055f68760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f29fdffb640 1 -- 172.21.15.12:0/1542230631 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8731+0+0 (secure 0 0 0) 0x7f29f00d01d0 con 0x7f2a00101df0 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f2a04de9640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29ec0a3430 0x7f29ec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f2a04de9640 1 --2- 172.21.15.12:0/1369218027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f5b090 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009ca0 tx=0x7f29f8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cac325387bb418 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f29f67fc640 1 -- 172.21.15.12:0/1369218027 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8042040 con 0x559055f5cb40 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f29f67fc640 1 -- 172.21.15.12:0/1369218027 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29f8036040 con 0x559055f5cb40 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f2a04de9640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29ec0a3430 0x7f29ec0a58f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f29f804d000 tx=0x7f29f804e000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.260+0000 7f29f67fc640 1 -- 172.21.15.12:0/1369218027 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f802f8f0 con 0x559055f5cb40 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.261+0000 7f2a08c25740 1 -- 172.21.15.12:0/1369218027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 msgr2=0x559055f5b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.261+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1369218027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f5b090 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009ca0 tx=0x7f29f8009800 comp rx=0 tx=0).stop 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.261+0000 7f2a08c25740 1 -- 172.21.15.12:0/1369218027 shutdown_connections 2024-09-19T06:55:05.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.261+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1369218027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 0x559055f68760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.261+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1369218027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5b5d0 0x559055f5ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.261+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1369218027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f5b090 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.261+0000 7f2a08c25740 1 -- 172.21.15.12:0/1369218027 >> 172.21.15.12:0/1369218027 conn(0x559055f24310 msgr2=0x559055f57c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.261+0000 7f2a08c25740 1 -- 172.21.15.12:0/1369218027 shutdown_connections 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.261+0000 7f2a08c25740 1 -- 172.21.15.12:0/1369218027 wait complete. 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.262+0000 7f2a08c25740 1 -- start start 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.262+0000 7f2a08c25740 1 Processor -- start 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.262+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5b5d0 0x559055f65d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.262+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 0x559055f63010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.262+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 0x559055f63600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.262+0000 7f2a08c25740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559055f69070 con 0x559055f5b5d0 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f29fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5b5d0 0x559055f65d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f2a04de9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 0x559055f63600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f29f7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 0x559055f63010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f29fffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5b5d0 0x559055f65d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37138/0 (socket says 172.21.15.12:37138) 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f29fffff640 1 -- 172.21.15.12:0/2485380432 learned_addr learned my addr 172.21.15.12:0/2485380432 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f2a08c25740 1 -- 172.21.15.12:0/2485380432 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559055e7c060 con 0x559055f66370 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f2a08c25740 1 -- 172.21.15.12:0/2485380432 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559055f691f0 con 0x559055f5cb40 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f2a08c25740 10 client.0 _ll_register_callbacks cb 0x559055bcf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f2a04de9640 1 -- 172.21.15.12:0/2485380432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 msgr2=0x559055f63010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f2a04de9640 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 0x559055f63010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f2a04de9640 1 -- 172.21.15.12:0/2485380432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5b5d0 msgr2=0x559055f65d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f2a04de9640 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5b5d0 0x559055f65d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f2a04de9640 1 -- 172.21.15.12:0/2485380432 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559055c323c0 con 0x559055f66370 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f2a04de9640 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 0x559055f63600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f29f8006010 tx=0x7f29f80048c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcc097869d38b0d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:05.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.263+0000 7f29df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:55:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.264+0000 7f29df7fe640 1 -- 172.21.15.12:0/2485380432 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8059020 con 0x559055f66370 2024-09-19T06:55:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.264+0000 7f29df7fe640 1 -- 172.21.15.12:0/2485380432 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8731+0+0 (secure 0 0 0) 0x7f29f802fe00 con 0x559055f66370 2024-09-19T06:55:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.264+0000 7f2a08c25740 1 -- 172.21.15.12:0/2485380432 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29f8036040 con 0x559055f66370 2024-09-19T06:55:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f29df7fe640 1 -- 172.21.15.12:0/2485380432 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f29f8042050 con 0x559055f66370 2024-09-19T06:55:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f2a08c25740 10 client.28901 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:05.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f2a08c25740 1 -- 172.21.15.12:0/2485380432 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x559055f69070 con 0x559055f66370 2024-09-19T06:55:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f29df7fe640 1 -- 172.21.15.12:0/2485380432 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29f8036040 con 0x559055f66370 2024-09-19T06:55:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f29df7fe640 1 -- 172.21.15.12:0/2485380432 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f29f80305c0 con 0x559055f66370 2024-09-19T06:55:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f2a08c25740 10 client.28901 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f2a08c25740 10 client.28901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f2a08c25740 20 client.28901 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f2a08c25740 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559055f75c50 0x559055f78040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f2a08c25740 4 client.28901 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f2a08c25740 1 -- 172.21.15.12:0/2485380432 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559055ece860 con 0x559055f75c50 2024-09-19T06:55:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.265+0000 7f29fffff640 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559055f75c50 0x559055f78040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.266+0000 7f29df7fe640 10 client.28901 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.266+0000 7f29fffff640 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559055f75c50 0x559055f78040 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e95efa510f9575e server_cookie=47a1a5f86ca97368 in_seq=0 out_seq=0 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.266+0000 7f29df7fe640 1 -- 172.21.15.12:0/2485380432 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559055ece860 con 0x559055f75c50 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.266+0000 7f29df7fe640 10 client.28901 handle_command_reply: tid=0 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.266+0000 7f2a08c25740 1 client.28901 shutdown 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 1 -- 172.21.15.12:0/2485380432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 msgr2=0x559055f63600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 0x559055f63600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f29f8006010 tx=0x7f29f80048c0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 1 -- 172.21.15.12:0/2485380432 shutdown_connections 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559055f75c50 0x559055f78040 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f66370 0x559055f63600 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 0x559055f63010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f29df7fe640 0 client.28901 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 1 --2- 172.21.15.12:0/2485380432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5b5d0 0x559055f65d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 1 -- 172.21.15.12:0/2485380432 >> 172.21.15.12:0/2485380432 conn(0x559055f24310 msgr2=0x559055f5d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 1 -- 172.21.15.12:0/2485380432 shutdown_connections 2024-09-19T06:55:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 1 -- 172.21.15.12:0/2485380432 wait complete. 2024-09-19T06:55:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.267+0000 7f2a08c25740 20 client.28901 trim_cache size 0 max 16384 2024-09-19T06:55:05.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.281+0000 7f2a08c25740 1 Processor -- start 2024-09-19T06:55:05.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.281+0000 7f2a08c25740 1 -- start start 2024-09-19T06:55:05.283 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:05 smithi012 ceph-mon[30937]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T06:55:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 0x559055f64f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 0x559055f5e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f66370 0x559055f5e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f2a08c25740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001adb40 con 0x559055f66370 2024-09-19T06:55:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f2a08c25740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001af6b0 con 0x559055f5b5d0 2024-09-19T06:55:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f2a08c25740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001ae210 con 0x559055f5cb40 2024-09-19T06:55:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f2a04de9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f66370 0x559055f5e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f29f7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 0x559055f5e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f2a04de9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f66370 0x559055f5e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37154/0 (socket says 172.21.15.12:37154) 2024-09-19T06:55:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f29f7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 0x559055f5e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54310/0 (socket says 172.21.15.12:54310) 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f2a04de9640 1 -- 172.21.15.12:0/1213240081 learned_addr learned my addr 172.21.15.12:0/1213240081 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f29fffff640 1 --2- 172.21.15.12:0/1213240081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 0x559055f64f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f29f7fff640 1 -- 172.21.15.12:0/1213240081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 msgr2=0x559055f64f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1213240081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 0x559055f64f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f29f7fff640 1 -- 172.21.15.12:0/1213240081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f66370 msgr2=0x559055f5e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1213240081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f66370 0x559055f5e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f29f7fff640 1 -- 172.21.15.12:0/1213240081 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559055f660d0 con 0x559055f5cb40 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.282+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1213240081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 0x559055f5e120 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x559055f628c0 tx=0x7f29e8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85201602e68bf851 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.283+0000 7f29f5ffb640 1 -- 172.21.15.12:0/1213240081 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8004050 con 0x559055f5cb40 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.283+0000 7f29f5ffb640 1 -- 172.21.15.12:0/1213240081 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e8020030 con 0x559055f5cb40 2024-09-19T06:55:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.283+0000 7f29f5ffb640 1 -- 172.21.15.12:0/1213240081 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8003850 con 0x559055f5cb40 2024-09-19T06:55:05.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.284+0000 7f2a08c25740 1 -- 172.21.15.12:0/1213240081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 msgr2=0x559055f5e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:05.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.284+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1213240081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 0x559055f5e120 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x559055f628c0 tx=0x7f29e8005f90 comp rx=0 tx=0).stop 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.284+0000 7f2a08c25740 1 -- 172.21.15.12:0/1213240081 shutdown_connections 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.284+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1213240081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f66370 0x559055f5e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.284+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1213240081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f5cb40 0x559055f5e120 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.284+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1213240081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 0x559055f64f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.284+0000 7f2a08c25740 1 -- 172.21.15.12:0/1213240081 >> 172.21.15.12:0/1213240081 conn(0x559055f24310 msgr2=0x559055f64870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.284+0000 7f2a08c25740 1 -- 172.21.15.12:0/1213240081 shutdown_connections 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.284+0000 7f2a08c25740 1 -- 172.21.15.12:0/1213240081 wait complete. 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.284+0000 7f2a08c25740 1 -- start start 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a08c25740 1 Processor -- start 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 0x559055f6e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f6e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a08c25740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f66370 0x559055f6b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a08c25740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001aefe0 con 0x559055f5cb40 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a08c25740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001ae8e0 con 0x559055f5b5d0 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a08c25740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2a001abb40 con 0x559055f66370 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a08c25740 10 client.0 _ll_register_callbacks cb 0x7f29e8009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a04de9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f66370 0x559055f6b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a04de9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f66370 0x559055f6b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54312/0 (socket says 172.21.15.12:54312) 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f2a04de9640 1 -- 172.21.15.12:0/1702358753 learned_addr learned my addr 172.21.15.12:0/1702358753 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.285+0000 7f29fffff640 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 0x559055f6e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f6e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29fffff640 1 -- 172.21.15.12:0/1702358753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f66370 msgr2=0x559055f6b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29fffff640 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f66370 0x559055f6b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29fffff640 1 -- 172.21.15.12:0/1702358753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 msgr2=0x559055f6e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29fffff640 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f6e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29fffff640 1 -- 172.21.15.12:0/1702358753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559055f6f030 con 0x559055f5b5d0 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f2a04de9640 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f66370 0x559055f6b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f6e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29fffff640 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 0x559055f6e480 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f29f0098d50 tx=0x7f29f0098750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=594fa686933e5896 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29df7fe640 1 -- 172.21.15.12:0/1702358753 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f009bec0 con 0x559055f5b5d0 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29df7fe640 1 -- 172.21.15.12:0/1702358753 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8731+0+0 (secure 0 0 0) 0x7f29f00cda70 con 0x559055f5b5d0 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f2a08c25740 1 -- 172.21.15.12:0/1702358753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e8020030 con 0x559055f5b5d0 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.286+0000 7f29df7fe640 1 -- 172.21.15.12:0/1702358753 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f29f009bce0 con 0x559055f5b5d0 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f2a08c25740 10 client.28907 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f2a08c25740 1 -- 172.21.15.12:0/1702358753 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x559055fe0d10 con 0x559055f5b5d0 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f29df7fe640 1 -- 172.21.15.12:0/1702358753 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e8020030 con 0x559055f5b5d0 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f29df7fe640 1 -- 172.21.15.12:0/1702358753 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f29f00b5120 con 0x559055f5b5d0 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f2a08c25740 10 client.28907 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:05.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f2a08c25740 10 client.28907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f2a08c25740 20 client.28907 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559055fe1490 0x559055fe38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f2a08c25740 4 client.28907 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:55:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f2a08c25740 1 -- 172.21.15.12:0/1702358753 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559055ec8d70 con 0x559055fe1490 2024-09-19T06:55:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.287+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559055fe1490 0x559055fe38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.288+0000 7f29f7fff640 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559055fe1490 0x559055fe38b0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9dfcb38dfb2490a server_cookie=62d88d72e2fc283b in_seq=0 out_seq=0 2024-09-19T06:55:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.288+0000 7f29df7fe640 10 client.28907 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.288+0000 7f29df7fe640 1 -- 172.21.15.12:0/1702358753 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559055ec8d70 con 0x559055fe1490 2024-09-19T06:55:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.288+0000 7f29df7fe640 10 client.28907 handle_command_reply: tid=0 2024-09-19T06:55:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.288+0000 7f2a08c25740 1 client.28907 shutdown 2024-09-19T06:55:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.288+0000 7f2a08c25740 1 -- 172.21.15.12:0/1702358753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 msgr2=0x559055f6e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.288+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 0x559055f6e480 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f29f0098d50 tx=0x7f29f0098750 comp rx=0 tx=0).stop 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.289+0000 7f2a08c25740 1 -- 172.21.15.12:0/1702358753 shutdown_connections 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.289+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559055fe1490 0x559055fe38b0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.289+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559055f66370 0x559055f6b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.289+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559055f5cb40 0x559055f6e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.289+0000 7f29df7fe640 0 client.28907 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.289+0000 7f2a08c25740 1 --2- 172.21.15.12:0/1702358753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559055f5b5d0 0x559055f6e480 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.289+0000 7f2a08c25740 1 -- 172.21.15.12:0/1702358753 >> 172.21.15.12:0/1702358753 conn(0x559055f24310 msgr2=0x559055f65090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.289+0000 7f2a08c25740 1 -- 172.21.15.12:0/1702358753 shutdown_connections 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.289+0000 7f2a08c25740 1 -- 172.21.15.12:0/1702358753 wait complete. 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.289+0000 7f2a08c25740 20 client.28907 trim_cache size 0 max 16384 2024-09-19T06:55:05.294 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:55:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 -- 172.21.15.12:0/1542230631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29ec0a3430 msgr2=0x7f29ec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29ec0a3430 0x7f29ec0a58f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f29f804d000 tx=0x7f29f804e000 comp rx=0 tx=0).stop 2024-09-19T06:55:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 -- 172.21.15.12:0/1542230631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a00101df0 msgr2=0x7f2a00198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a00101df0 0x7f2a00198380 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f29f000e9f0 tx=0x7f29f000edf0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 -- 172.21.15.12:0/1542230631 shutdown_connections 2024-09-19T06:55:05.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29ec0a3430 0x7f29ec0a58f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a00106f20 0x7f2a0019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a001027a0 0x7f2a001988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 --2- 172.21.15.12:0/1542230631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a00101df0 0x7f2a00198380 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:05.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 -- 172.21.15.12:0/1542230631 >> 172.21.15.12:0/1542230631 conn(0x7f2a000fd8b0 msgr2=0x7f2a000febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:05.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 -- 172.21.15.12:0/1542230631 shutdown_connections 2024-09-19T06:55:05.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:05.290+0000 7f2a0684c640 1 -- 172.21.15.12:0/1542230631 wait complete. 2024-09-19T06:55:05.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:05 smithi173 ceph-mon[35349]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T06:55:05.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:05 smithi016 ceph-mon[34911]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T06:55:05.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 860.0 s, 166.2 tps, lat 557.708 ms stddev 365.607 2024-09-19T06:55:06.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:06 smithi173 ceph-mon[35349]: pgmap v468: 97 pgs: 97 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 721 op/s 2024-09-19T06:55:06.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:06 smithi012 ceph-mon[30937]: pgmap v468: 97 pgs: 97 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 721 op/s 2024-09-19T06:55:06.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:06 smithi016 ceph-mon[34911]: pgmap v468: 97 pgs: 97 active+clean; 4.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 721 op/s 2024-09-19T06:55:07.087 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:55:07.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:55:07.383 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.919+0000 7fc4e8537640 1 -- 172.21.15.12:0/800871277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4e0106f00 msgr2=0x7fc4e010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.919+0000 7fc4e8537640 1 --2- 172.21.15.12:0/800871277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4e0106f00 0x7fc4e010ea80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009ca0 tx=0x7fc4d802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.920+0000 7fc4e8537640 1 -- 172.21.15.12:0/800871277 shutdown_connections 2024-09-19T06:55:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.920+0000 7fc4e8537640 1 --2- 172.21.15.12:0/800871277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4e0106f00 0x7fc4e010ea80 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.920+0000 7fc4e8537640 1 --2- 172.21.15.12:0/800871277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4e0102780 0x7fc4e01067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.920+0000 7fc4e8537640 1 --2- 172.21.15.12:0/800871277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e0101dd0 0x7fc4e01021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.920+0000 7fc4e8537640 1 -- 172.21.15.12:0/800871277 >> 172.21.15.12:0/800871277 conn(0x7fc4e00fd8b0 msgr2=0x7fc4e00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:07.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.920+0000 7fc4e8537640 1 -- 172.21.15.12:0/800871277 shutdown_connections 2024-09-19T06:55:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.920+0000 7fc4e8537640 1 -- 172.21.15.12:0/800871277 wait complete. 2024-09-19T06:55:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.920+0000 7fc4e8537640 1 Processor -- start 2024-09-19T06:55:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.920+0000 7fc4e8537640 1 -- start start 2024-09-19T06:55:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e8537640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e0101dd0 0x7fc4e019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e8537640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4e0102780 0x7fc4e019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e8537640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4e0106f00 0x7fc4e019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e8537640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0111f60 con 0x7fc4e0102780 2024-09-19T06:55:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e8537640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0111de0 con 0x7fc4e0106f00 2024-09-19T06:55:07.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e8537640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01120e0 con 0x7fc4e0101dd0 2024-09-19T06:55:07.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e5ad2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4e0102780 0x7fc4e019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e5ad2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4e0102780 0x7fc4e019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37182/0 (socket says 172.21.15.12:37182) 2024-09-19T06:55:07.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e5ad2640 1 -- 172.21.15.12:0/3781076123 learned_addr learned my addr 172.21.15.12:0/3781076123 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:07.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e6ad4640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4e0106f00 0x7fc4e019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e0101dd0 0x7fc4e019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e5ad2640 1 -- 172.21.15.12:0/3781076123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e0101dd0 msgr2=0x7fc4e019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:07.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e0101dd0 0x7fc4e019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e5ad2640 1 -- 172.21.15.12:0/3781076123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4e0106f00 msgr2=0x7fc4e019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:07.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4e0106f00 0x7fc4e019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e5ad2640 1 -- 172.21.15.12:0/3781076123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e019f5b0 con 0x7fc4e0102780 2024-09-19T06:55:07.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.921+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4e0102780 0x7fc4e019ab40 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000e9f0 tx=0x7fc4d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:07.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.922+0000 7fc4d77fe640 1 -- 172.21.15.12:0/3781076123 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d000cd80 con 0x7fc4e0102780 2024-09-19T06:55:07.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.922+0000 7fc4e8537640 1 -- 172.21.15.12:0/3781076123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e019f8a0 con 0x7fc4e0102780 2024-09-19T06:55:07.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.922+0000 7fc4d77fe640 1 -- 172.21.15.12:0/3781076123 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4d0010910 con 0x7fc4e0102780 2024-09-19T06:55:07.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.922+0000 7fc4d77fe640 1 -- 172.21.15.12:0/3781076123 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00188f0 con 0x7fc4e0102780 2024-09-19T06:55:07.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.922+0000 7fc4e8537640 1 -- 172.21.15.12:0/3781076123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e01a7180 con 0x7fc4e0102780 2024-09-19T06:55:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.924+0000 7fc4d77fe640 1 -- 172.21.15.12:0/3781076123 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc4d0010ac0 con 0x7fc4e0102780 2024-09-19T06:55:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.925+0000 7fc4d77fe640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4cc0a33b0 0x7fc4cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.925+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4cc0a33b0 0x7fc4cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.925+0000 7fc4ea910740 1 Processor -- start 2024-09-19T06:55:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.925+0000 7fc4d77fe640 1 -- 172.21.15.12:0/3781076123 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8731+0+0 (secure 0 0 0) 0x7fc4d00d01c0 con 0x7fc4e0102780 2024-09-19T06:55:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4ea910740 1 -- start start 2024-09-19T06:55:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a942f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a94d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 0x55887a950130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4ea910740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55887a8a8280 con 0x55887a94dd40 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4ea910740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55887a84fb10 con 0x55887a942b60 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4ea910740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55887a8a4240 con 0x55887a943480 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4cc0a33b0 0x7fc4cc0a5870 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc005fd0 tx=0x7fc4dc005850 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4e6ad4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 0x55887a950130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4e6ad4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 0x55887a950130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37192/0 (socket says 172.21.15.12:37192) 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4e6ad4640 1 -- 172.21.15.12:0/3988886792 learned_addr learned my addr 172.21.15.12:0/3988886792 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a942f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.926+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a94d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4e62d3640 1 -- 172.21.15.12:0/3988886792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 msgr2=0x55887a94d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a94d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4e62d3640 1 -- 172.21.15.12:0/3988886792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 msgr2=0x55887a950130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 0x55887a950130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4e62d3640 1 -- 172.21.15.12:0/3988886792 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887a85c1f0 con 0x55887a942b60 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a94d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4e6ad4640 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 0x55887a950130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a942f40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c010 tx=0x7fc4dc012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89af9bc0a978dfeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4d4ff9640 1 -- 172.21.15.12:0/3988886792 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc022070 con 0x55887a942b60 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4d4ff9640 1 -- 172.21.15.12:0/3988886792 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4dc00fe50 con 0x55887a942b60 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.927+0000 7fc4d4ff9640 1 -- 172.21.15.12:0/3988886792 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc01da10 con 0x55887a942b60 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.928+0000 7fc4ea910740 1 -- 172.21.15.12:0/3988886792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 msgr2=0x55887a942f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.928+0000 7fc4ea910740 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a942f40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c010 tx=0x7fc4dc012000 comp rx=0 tx=0).stop 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.928+0000 7fc4ea910740 1 -- 172.21.15.12:0/3988886792 shutdown_connections 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.928+0000 7fc4ea910740 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 0x55887a950130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.928+0000 7fc4ea910740 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a94d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.928+0000 7fc4ea910740 1 --2- 172.21.15.12:0/3988886792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a942f40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.928+0000 7fc4ea910740 1 -- 172.21.15.12:0/3988886792 >> 172.21.15.12:0/3988886792 conn(0x55887a93f0f0 msgr2=0x55887a93f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.929+0000 7fc4ea910740 1 -- 172.21.15.12:0/3988886792 shutdown_connections 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.929+0000 7fc4ea910740 1 -- 172.21.15.12:0/3988886792 wait complete. 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.929+0000 7fc4ea910740 1 -- start start 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.929+0000 7fc4ea910740 1 Processor -- start 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.929+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a942b60 0x55887a94ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.929+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 0x55887a94b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.929+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a94dd40 0x55887a94b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.929+0000 7fc4ea910740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55887a950910 con 0x55887a943480 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.929+0000 7fc4ea910740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55887a862f10 con 0x55887a94dd40 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.929+0000 7fc4ea910740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55887a950a90 con 0x55887a942b60 2024-09-19T06:55:07.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4ea910740 10 client.0 _ll_register_callbacks cb 0x55887a82ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e62d3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a942b60 0x55887a94ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e62d3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a942b60 0x55887a94ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54336/0 (socket says 172.21.15.12:54336) 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e62d3640 1 -- 172.21.15.12:0/241848037 learned_addr learned my addr 172.21.15.12:0/241848037 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e6ad4640 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a94dd40 0x55887a94b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 0x55887a94b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e62d3640 1 -- 172.21.15.12:0/241848037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a94dd40 msgr2=0x55887a94b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a94dd40 0x55887a94b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e62d3640 1 -- 172.21.15.12:0/241848037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 msgr2=0x55887a94b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 0x55887a94b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e62d3640 1 -- 172.21.15.12:0/241848037 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55887a6196a0 con 0x55887a942b60 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a942b60 0x55887a94ac00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc005270 tx=0x7fc4dc0052a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=909462c0396f2b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.930+0000 7fc4c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:55:07.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/241848037 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc022030 con 0x55887a942b60 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4ea910740 1 -- 172.21.15.12:0/241848037 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4dc00fe50 con 0x55887a942b60 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/241848037 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8731+0+0 (secure 0 0 0) 0x7fc4dc01d790 con 0x55887a942b60 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/241848037 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fc4dc01d990 con 0x55887a942b60 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4ea910740 10 client.28831 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4ea910740 1 -- 172.21.15.12:0/241848037 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55887a95c550 con 0x55887a942b60 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/241848037 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4dc00fe50 con 0x55887a942b60 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/241848037 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7fc4dc004cc0 con 0x55887a942b60 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4ea910740 10 client.28831 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4ea910740 10 client.28831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4ea910740 20 client.28831 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4ea910740 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55887a95da10 0x55887a95fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4ea910740 4 client.28831 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:07.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.931+0000 7fc4ea910740 1 -- 172.21.15.12:0/241848037 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55887a8b57f0 con 0x55887a95da10 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.932+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55887a95da10 0x55887a95fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.932+0000 7fc4c9ffb640 10 client.28831 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.932+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55887a95da10 0x55887a95fe00 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88f213d2f6210c02 server_cookie=5b24e829bb79fe3b in_seq=0 out_seq=0 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/241848037 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55887a8b57f0 con 0x55887a95da10 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4c9ffb640 10 client.28831 handle_command_reply: tid=0 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 client.28831 shutdown 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 -- 172.21.15.12:0/241848037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a942b60 msgr2=0x55887a94ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a942b60 0x55887a94ac00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc005270 tx=0x7fc4dc0052a0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 -- 172.21.15.12:0/241848037 shutdown_connections 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55887a95da10 0x55887a95fe00 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a94dd40 0x55887a94b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 0x55887a94b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 --2- 172.21.15.12:0/241848037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a942b60 0x55887a94ac00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 -- 172.21.15.12:0/241848037 >> 172.21.15.12:0/241848037 conn(0x55887a93f0f0 msgr2=0x55887a93e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:07.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4c9ffb640 0 client.28831 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:07.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 -- 172.21.15.12:0/241848037 shutdown_connections 2024-09-19T06:55:07.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 1 -- 172.21.15.12:0/241848037 wait complete. 2024-09-19T06:55:07.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.933+0000 7fc4ea910740 20 client.28831 trim_cache size 0 max 16384 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.954+0000 7fc4ea910740 1 Processor -- start 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.954+0000 7fc4ea910740 1 -- start start 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.954+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a949e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.954+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 0x55887a9455c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.954+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a94dd40 0x55887a93e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.954+0000 7fc4ea910740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01afe40 con 0x55887a943480 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.954+0000 7fc4ea910740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01b19b0 con 0x55887a942b60 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.954+0000 7fc4ea910740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01b0510 con 0x55887a94dd40 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e5ad2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 0x55887a9455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e5ad2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 0x55887a9455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37212/0 (socket says 172.21.15.12:37212) 2024-09-19T06:55:07.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e5ad2640 1 -- 172.21.15.12:0/2451555973 learned_addr learned my addr 172.21.15.12:0/2451555973 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:07.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e62d3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a949e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e6ad4640 1 --2- 172.21.15.12:0/2451555973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a94dd40 0x55887a93e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e62d3640 1 -- 172.21.15.12:0/2451555973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a94dd40 msgr2=0x55887a93e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:07.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/2451555973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a94dd40 0x55887a93e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e62d3640 1 -- 172.21.15.12:0/2451555973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 msgr2=0x55887a9455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:07.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/2451555973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 0x55887a9455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e62d3640 1 -- 172.21.15.12:0/2451555973 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887a94d4d0 con 0x55887a942b60 2024-09-19T06:55:07.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.955+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/2451555973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a949e80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc012fd0 tx=0x7fc4dc005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a244d7652221a5d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:07.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.956+0000 7fc4cbfff640 1 -- 172.21.15.12:0/2451555973 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc02b070 con 0x55887a942b60 2024-09-19T06:55:07.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.956+0000 7fc4cbfff640 1 -- 172.21.15.12:0/2451555973 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4dc005310 con 0x55887a942b60 2024-09-19T06:55:07.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.956+0000 7fc4cbfff640 1 -- 172.21.15.12:0/2451555973 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc015070 con 0x55887a942b60 2024-09-19T06:55:07.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 -- 172.21.15.12:0/2451555973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 msgr2=0x55887a949e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:07.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 --2- 172.21.15.12:0/2451555973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a949e80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc012fd0 tx=0x7fc4dc005750 comp rx=0 tx=0).stop 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 -- 172.21.15.12:0/2451555973 shutdown_connections 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 --2- 172.21.15.12:0/2451555973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a94dd40 0x55887a93e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 --2- 172.21.15.12:0/2451555973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a943480 0x55887a9455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 --2- 172.21.15.12:0/2451555973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a949e80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 -- 172.21.15.12:0/2451555973 >> 172.21.15.12:0/2451555973 conn(0x55887a93f0f0 msgr2=0x55887a93da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 -- 172.21.15.12:0/2451555973 shutdown_connections 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 -- 172.21.15.12:0/2451555973 wait complete. 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 -- start start 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.957+0000 7fc4ea910740 1 Processor -- start 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a955fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a956500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4ea910740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 0x55887a947620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4ea910740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01b12e0 con 0x55887a94dd40 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4ea910740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01b0be0 con 0x55887a942b60 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4ea910740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01ade40 con 0x55887a943480 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4ea910740 10 client.0 _ll_register_callbacks cb 0x7fc4d8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e62d3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a955fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e5ad2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a956500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e5ad2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a956500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54358/0 (socket says 172.21.15.12:54358) 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e6ad4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 0x55887a947620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e5ad2640 1 -- 172.21.15.12:0/648046054 learned_addr learned my addr 172.21.15.12:0/648046054 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e62d3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a955fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:33396/0 (socket says 172.21.15.12:33396) 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e5ad2640 1 -- 172.21.15.12:0/648046054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 msgr2=0x55887a955fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a955fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e5ad2640 1 -- 172.21.15.12:0/648046054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 msgr2=0x55887a947620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 0x55887a947620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.958+0000 7fc4e5ad2640 1 -- 172.21.15.12:0/648046054 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55887a947e50 con 0x55887a943480 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4e5ad2640 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a956500 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0098830 tx=0x7fc4d00cdf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49a1e618218c1d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/648046054 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00a0780 con 0x55887a943480 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/648046054 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8731+0+0 (secure 0 0 0) 0x7fc4d0098a40 con 0x55887a943480 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4ea910740 1 -- 172.21.15.12:0/648046054 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4dc005310 con 0x55887a943480 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/648046054 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fc4d00a5040 con 0x55887a943480 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4ea910740 10 client.28837 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4ea910740 1 -- 172.21.15.12:0/648046054 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55887a9c8070 con 0x55887a943480 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/648046054 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4dc005310 con 0x55887a943480 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/648046054 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7fc4d00b03a0 con 0x55887a943480 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4ea910740 10 client.28837 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:07.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4ea910740 10 client.28837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:07.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.959+0000 7fc4ea910740 20 client.28837 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:07.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.960+0000 7fc4ea910740 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55887a9c87a0 0x55887a9cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:07.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.960+0000 7fc4ea910740 4 client.28837 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:55:07.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.960+0000 7fc4ea910740 1 -- 172.21.15.12:0/648046054 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55887a8afd00 con 0x55887a9c87a0 2024-09-19T06:55:07.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.960+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55887a9c87a0 0x55887a9cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:07.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.960+0000 7fc4e62d3640 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55887a9c87a0 0x55887a9cabc0 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=513573b953acba05 server_cookie=a98d54545504177 in_seq=0 out_seq=0 2024-09-19T06:55:07.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.960+0000 7fc4c9ffb640 10 client.28837 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:07.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.961+0000 7fc4c9ffb640 1 -- 172.21.15.12:0/648046054 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55887a8afd00 con 0x55887a9c87a0 2024-09-19T06:55:07.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.961+0000 7fc4c9ffb640 10 client.28837 handle_command_reply: tid=0 2024-09-19T06:55:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.961+0000 7fc4ea910740 1 client.28837 shutdown 2024-09-19T06:55:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 1 -- 172.21.15.12:0/648046054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 msgr2=0x55887a956500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a956500 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0098830 tx=0x7fc4d00cdf90 comp rx=0 tx=0).stop 2024-09-19T06:55:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 1 -- 172.21.15.12:0/648046054 shutdown_connections 2024-09-19T06:55:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55887a9c87a0 0x55887a9cabc0 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55887a94dd40 0x55887a947620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55887a943480 0x55887a956500 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 1 --2- 172.21.15.12:0/648046054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55887a942b60 0x55887a955fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 1 -- 172.21.15.12:0/648046054 >> 172.21.15.12:0/648046054 conn(0x55887a93f0f0 msgr2=0x55887a93e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4c9ffb640 0 client.28837 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:07.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 1 -- 172.21.15.12:0/648046054 shutdown_connections 2024-09-19T06:55:07.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 1 -- 172.21.15.12:0/648046054 wait complete. 2024-09-19T06:55:07.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4ea910740 20 client.28837 trim_cache size 0 max 16384 2024-09-19T06:55:07.969 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:55:07.969 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:55:07.969 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "dfc32b9f-0ceb-4e5a-b646-d7c4b39a45cc", 2024-09-19T06:55:07.969 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:55:07.969 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:55:07.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4e8537640 1 -- 172.21.15.12:0/3781076123 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4cc0a33b0 msgr2=0x7fc4cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:07.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.962+0000 7fc4e8537640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4cc0a33b0 0x7fc4cc0a5870 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc005fd0 tx=0x7fc4dc005850 comp rx=0 tx=0).stop 2024-09-19T06:55:07.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.963+0000 7fc4e8537640 1 -- 172.21.15.12:0/3781076123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4e0102780 msgr2=0x7fc4e019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.963+0000 7fc4e8537640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4e0102780 0x7fc4e019ab40 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000e9f0 tx=0x7fc4d000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.963+0000 7fc4e8537640 1 -- 172.21.15.12:0/3781076123 shutdown_connections 2024-09-19T06:55:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.963+0000 7fc4e8537640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4e0106f00 0x7fc4e019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.963+0000 7fc4e8537640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4e0102780 0x7fc4e019ab40 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.963+0000 7fc4e8537640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc4cc0a33b0 0x7fc4cc0a5870 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.963+0000 7fc4e8537640 1 --2- 172.21.15.12:0/3781076123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4e0101dd0 0x7fc4e019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.963+0000 7fc4e8537640 1 -- 172.21.15.12:0/3781076123 >> 172.21.15.12:0/3781076123 conn(0x7fc4e00fd8b0 msgr2=0x7fc4e00ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.963+0000 7fc4e8537640 1 -- 172.21.15.12:0/3781076123 shutdown_connections 2024-09-19T06:55:07.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:07.963+0000 7fc4e8537640 1 -- 172.21.15.12:0/3781076123 wait complete. 2024-09-19T06:55:08.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:08 smithi016 ceph-mon[34911]: pgmap v469: 97 pgs: 97 active+clean; 3.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.2 MiB/s wr, 608 op/s 2024-09-19T06:55:08.258 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:55:07 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: 2024-09-19T06:55:07.981+0000 7f466df5b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [...18,head] /volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans/ auth{1=1,2=1,3=1,4=1} v2215 ap=2 f(v26 m2024-09-19T06:54:42.296746+0000 3=3+0) n(v53 rc2024-09-19T06:54:42.296746+0000 b524288 4=3+1) old_inodes=5 (inest sync->mix g=1,2,3,4) caps={15252=pAsLsXsFs/pAsLsXsFsx@6} mcw={4=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55a161e61180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v310>,<0x10000000005/data v119>,<0x100000001fb/postgres v23>,<0x100000001fa/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 v38>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v2215>,<0x10000000005/data v1058>,<0x100000001fb/postgres v648>,<0x100000001fa/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235 v672>,<0x10000000001/sv_1 v673>,<0x10000000000/qa v673>,<0x1/volumes v620>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T06:54:14.660983+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T06:54:42.296746+0000 b524288 4=3+1)","memory_value.dirstat":"f(v26 m2024-09-19T06:54:42.296746+0000 3=3+0)","memory_value.rstat":"n(v53 rc2024-09-19T06:54:42.296746+0000 b524288 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-19T06:55:08.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:08 smithi173 ceph-mon[35349]: pgmap v469: 97 pgs: 97 active+clean; 3.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.2 MiB/s wr, 608 op/s 2024-09-19T06:55:08.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:08 smithi012 ceph-mon[30937]: pgmap v469: 97 pgs: 97 active+clean; 3.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.2 MiB/s wr, 608 op/s 2024-09-19T06:55:08.786 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:55:09.070 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:09.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:55:09.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:55:09.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:55:09.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:09 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:55:09.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.334 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:09 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:55:09.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:09 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:55:09.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.801+0000 7f0e57f30640 1 -- 172.21.15.12:0/740017693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e50102790 msgr2=0x7f0e501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.801+0000 7f0e57f30640 1 --2- 172.21.15.12:0/740017693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e50102790 0x7f0e501067e0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009900 tx=0x7f0e4002a410 comp rx=0 tx=0).stop 2024-09-19T06:55:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.801+0000 7f0e57f30640 1 -- 172.21.15.12:0/740017693 shutdown_connections 2024-09-19T06:55:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.801+0000 7f0e57f30640 1 --2- 172.21.15.12:0/740017693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e50106f10 0x7f0e5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.801+0000 7f0e57f30640 1 --2- 172.21.15.12:0/740017693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e50102790 0x7f0e501067e0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.801+0000 7f0e57f30640 1 --2- 172.21.15.12:0/740017693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e50101de0 0x7f0e501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.801+0000 7f0e57f30640 1 -- 172.21.15.12:0/740017693 >> 172.21.15.12:0/740017693 conn(0x7f0e500fd8c0 msgr2=0x7f0e500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.801+0000 7f0e57f30640 1 -- 172.21.15.12:0/740017693 shutdown_connections 2024-09-19T06:55:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.801+0000 7f0e57f30640 1 -- 172.21.15.12:0/740017693 wait complete. 2024-09-19T06:55:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e57f30640 1 Processor -- start 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e57f30640 1 -- start start 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e57f30640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e50101de0 0x7f0e50198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e57f30640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e50102790 0x7f0e50198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e57f30640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e50106f10 0x7f0e5019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e57f30640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e50111f70 con 0x7f0e50101de0 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e57f30640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e50111df0 con 0x7f0e50102790 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e57f30640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e501120f0 con 0x7f0e50106f10 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e55ccc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e50101de0 0x7f0e50198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e55ccc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e50101de0 0x7f0e50198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37252/0 (socket says 172.21.15.12:37252) 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.802+0000 7f0e55ccc640 1 -- 172.21.15.12:0/3651774021 learned_addr learned my addr 172.21.15.12:0/3651774021 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e564cd640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e50106f10 0x7f0e5019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e554cb640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e50102790 0x7f0e50198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e55ccc640 1 -- 172.21.15.12:0/3651774021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e50106f10 msgr2=0x7f0e5019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e55ccc640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e50106f10 0x7f0e5019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e55ccc640 1 -- 172.21.15.12:0/3651774021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e50102790 msgr2=0x7f0e50198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e55ccc640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e50102790 0x7f0e50198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e55ccc640 1 -- 172.21.15.12:0/3651774021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5019d4c0 con 0x7f0e50101de0 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e55ccc640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e50101de0 0x7f0e50198510 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00e9f0 tx=0x7f0e4c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e46ffd640 1 -- 172.21.15.12:0/3651774021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00cd80 con 0x7f0e50101de0 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e46ffd640 1 -- 172.21.15.12:0/3651774021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e4c005500 con 0x7f0e50101de0 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e46ffd640 1 -- 172.21.15.12:0/3651774021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c010690 con 0x7f0e50101de0 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e57f30640 1 -- 172.21.15.12:0/3651774021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5019d7b0 con 0x7f0e50101de0 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.803+0000 7f0e57f30640 1 -- 172.21.15.12:0/3651774021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e501a5090 con 0x7f0e50101de0 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.806+0000 7f0e46ffd640 1 -- 172.21.15.12:0/3651774021 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0e4c0046c0 con 0x7f0e50101de0 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.806+0000 7f0e5a309740 1 Processor -- start 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.806+0000 7f0e5a309740 1 -- start start 2024-09-19T06:55:09.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.806+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e92880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.806+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 0x559b59e9d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59e9fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e5a309740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559b59df82e0 con 0x559b59e92dc0 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e5a309740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559b59d9fce0 con 0x559b59e9d680 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e5a309740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559b59df42a0 con 0x559b59e924a0 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e564cd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e92880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e55ccc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 0x559b59e9d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e564cd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e92880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54376/0 (socket says 172.21.15.12:54376) 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e564cd640 1 -- 172.21.15.12:0/904032307 learned_addr learned my addr 172.21.15.12:0/904032307 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e554cb640 1 --2- 172.21.15.12:0/904032307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59e9fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e46ffd640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e3c0a33b0 0x7f0e3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e554cb640 1 -- 172.21.15.12:0/904032307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 msgr2=0x559b59e92880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e554cb640 1 --2- 172.21.15.12:0/904032307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e92880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e554cb640 1 -- 172.21.15.12:0/904032307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 msgr2=0x559b59e9d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e554cb640 1 --2- 172.21.15.12:0/904032307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 0x559b59e9d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e554cb640 1 -- 172.21.15.12:0/904032307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b59d84440 con 0x559b59e9d680 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e46ffd640 1 -- 172.21.15.12:0/3651774021 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8731+0+0 (secure 0 0 0) 0x7f0e4c0d01d0 con 0x7f0e50101de0 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e564cd640 1 --2- 172.21.15.12:0/904032307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e92880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e564cd640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e3c0a33b0 0x7f0e3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.807+0000 7f0e554cb640 1 --2- 172.21.15.12:0/904032307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59e9fa70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0e40005940 tx=0x7f0e40005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a606835cd31d05ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e3bfff640 1 -- 172.21.15.12:0/904032307 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40040070 con 0x559b59e9d680 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e564cd640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e3c0a33b0 0x7f0e3c0a5870 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0e48005f40 tx=0x7f0e48004a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e3bfff640 1 -- 172.21.15.12:0/904032307 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e400318f0 con 0x559b59e9d680 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e3bfff640 1 -- 172.21.15.12:0/904032307 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40035040 con 0x559b59e9d680 2024-09-19T06:55:09.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e5a309740 1 -- 172.21.15.12:0/904032307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 msgr2=0x559b59e9fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e5a309740 1 --2- 172.21.15.12:0/904032307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59e9fa70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0e40005940 tx=0x7f0e40005e00 comp rx=0 tx=0).stop 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e5a309740 1 -- 172.21.15.12:0/904032307 shutdown_connections 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e5a309740 1 --2- 172.21.15.12:0/904032307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59e9fa70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e5a309740 1 --2- 172.21.15.12:0/904032307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 0x559b59e9d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e5a309740 1 --2- 172.21.15.12:0/904032307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e92880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.808+0000 7f0e5a309740 1 -- 172.21.15.12:0/904032307 >> 172.21.15.12:0/904032307 conn(0x559b59e8ea30 msgr2=0x559b59e8ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.809+0000 7f0e5a309740 1 -- 172.21.15.12:0/904032307 shutdown_connections 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.809+0000 7f0e5a309740 1 -- 172.21.15.12:0/904032307 wait complete. 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.809+0000 7f0e5a309740 1 -- start start 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.809+0000 7f0e5a309740 1 Processor -- start 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e9cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 0x559b59e9a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59e9a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e5a309740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559b59ea0250 con 0x559b59e92dc0 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e5a309740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559b59db3050 con 0x559b59e9d680 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e5a309740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559b59ea03d0 con 0x559b59e924a0 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e5a309740 10 client.0 _ll_register_callbacks cb 0x559b59df3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e554cb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 0x559b59e9a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e554cb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 0x559b59e9a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37276/0 (socket says 172.21.15.12:37276) 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e55ccc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e9cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e554cb640 1 -- 172.21.15.12:0/2301720789 learned_addr learned my addr 172.21.15.12:0/2301720789 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e564cd640 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59e9a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e554cb640 1 -- 172.21.15.12:0/2301720789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 msgr2=0x559b59e9cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e554cb640 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e9cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e554cb640 1 -- 172.21.15.12:0/2301720789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 msgr2=0x559b59e9a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:09.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e554cb640 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59e9a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e554cb640 1 -- 172.21.15.12:0/2301720789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b59b693c0 con 0x559b59e92dc0 2024-09-19T06:55:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e55ccc640 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e9cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e564cd640 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59e9a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e554cb640 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 0x559b59e9a190 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f0e4002a930 tx=0x7f0e4002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561cb31f13f602e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e397fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.810+0000 7f0e397fa640 1 -- 172.21.15.12:0/2301720789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4004c020 con 0x559b59e92dc0 2024-09-19T06:55:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e397fa640 1 -- 172.21.15.12:0/2301720789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8731+0+0 (secure 0 0 0) 0x7f0e40004240 con 0x559b59e92dc0 2024-09-19T06:55:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e5a309740 1 -- 172.21.15.12:0/2301720789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e400318f0 con 0x559b59e92dc0 2024-09-19T06:55:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e397fa640 1 -- 172.21.15.12:0/2301720789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f0e40057050 con 0x559b59e92dc0 2024-09-19T06:55:09.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e5a309740 10 client.19605 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e5a309740 1 -- 172.21.15.12:0/2301720789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x559b59eabb20 con 0x559b59e92dc0 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e397fa640 1 -- 172.21.15.12:0/2301720789 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e400318f0 con 0x559b59e92dc0 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e397fa640 1 -- 172.21.15.12:0/2301720789 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f0e400035f0 con 0x559b59e92dc0 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e5a309740 10 client.19605 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e5a309740 10 client.19605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e5a309740 20 client.19605 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e5a309740 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b59eace70 0x559b59eaf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e5a309740 4 client.19605 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e5a309740 1 -- 172.21.15.12:0/2301720789 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b59e05850 con 0x559b59eace70 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.811+0000 7f0e55ccc640 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b59eace70 0x559b59eaf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.812+0000 7f0e55ccc640 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b59eace70 0x559b59eaf260 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=151fe4446d07609f server_cookie=31b9f6e8891e648 in_seq=0 out_seq=0 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.812+0000 7f0e397fa640 10 client.19605 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:09.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.812+0000 7f0e397fa640 1 -- 172.21.15.12:0/2301720789 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b59e05850 con 0x559b59eace70 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.812+0000 7f0e397fa640 10 client.19605 handle_command_reply: tid=0 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 client.19605 shutdown 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 -- 172.21.15.12:0/2301720789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 msgr2=0x559b59e9a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 0x559b59e9a190 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f0e4002a930 tx=0x7f0e4002a410 comp rx=0 tx=0).stop 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 -- 172.21.15.12:0/2301720789 shutdown_connections 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b59eace70 0x559b59eaf260 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59e9a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e92dc0 0x559b59e9a190 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 --2- 172.21.15.12:0/2301720789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e9cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 -- 172.21.15.12:0/2301720789 >> 172.21.15.12:0/2301720789 conn(0x559b59e8ea30 msgr2=0x559b59e94760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e397fa640 0 client.19605 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 -- 172.21.15.12:0/2301720789 shutdown_connections 2024-09-19T06:55:09.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 1 -- 172.21.15.12:0/2301720789 wait complete. 2024-09-19T06:55:09.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.813+0000 7f0e5a309740 20 client.19605 trim_cache size 0 max 16384 2024-09-19T06:55:09.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.833+0000 7f0e5a309740 1 Processor -- start 2024-09-19T06:55:09.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.833+0000 7f0e5a309740 1 -- start start 2024-09-19T06:55:09.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e8ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e92dc0 0x559b59e9c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e9d680 0x559b59eb48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e5a309740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e501adc40 con 0x559b59e9d680 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e5a309740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e501af7b0 con 0x559b59e92dc0 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e5a309740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e501ae310 con 0x559b59e924a0 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e554cb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e92dc0 0x559b59e9c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e55ccc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e8ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e564cd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e9d680 0x559b59eb48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e554cb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e92dc0 0x559b59e9c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:33442/0 (socket says 172.21.15.12:33442) 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e554cb640 1 -- 172.21.15.12:0/2236113006 learned_addr learned my addr 172.21.15.12:0/2236113006 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:09.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e554cb640 1 -- 172.21.15.12:0/2236113006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 msgr2=0x559b59e8ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e554cb640 1 --2- 172.21.15.12:0/2236113006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e8ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e554cb640 1 -- 172.21.15.12:0/2236113006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e9d680 msgr2=0x559b59eb48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e554cb640 1 --2- 172.21.15.12:0/2236113006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e9d680 0x559b59eb48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e554cb640 1 -- 172.21.15.12:0/2236113006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b59e8e860 con 0x559b59e92dc0 2024-09-19T06:55:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e55ccc640 1 --2- 172.21.15.12:0/2236113006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e8ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e564cd640 1 --2- 172.21.15.12:0/2236113006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e9d680 0x559b59eb48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.834+0000 7f0e554cb640 1 --2- 172.21.15.12:0/2236113006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e92dc0 0x559b59e9c100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0e400039f0 tx=0x7f0e40005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfc042244f6e9dee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.835+0000 7f0e3b7fe640 1 -- 172.21.15.12:0/2236113006 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4004c040 con 0x559b59e92dc0 2024-09-19T06:55:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.835+0000 7f0e3b7fe640 1 -- 172.21.15.12:0/2236113006 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e400035f0 con 0x559b59e92dc0 2024-09-19T06:55:09.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.835+0000 7f0e3b7fe640 1 -- 172.21.15.12:0/2236113006 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40040070 con 0x559b59e92dc0 2024-09-19T06:55:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.835+0000 7f0e5a309740 1 -- 172.21.15.12:0/2236113006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e92dc0 msgr2=0x559b59e9c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.835+0000 7f0e5a309740 1 --2- 172.21.15.12:0/2236113006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e92dc0 0x559b59e9c100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0e400039f0 tx=0x7f0e40005d50 comp rx=0 tx=0).stop 2024-09-19T06:55:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.836+0000 7f0e5a309740 1 -- 172.21.15.12:0/2236113006 shutdown_connections 2024-09-19T06:55:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.836+0000 7f0e5a309740 1 --2- 172.21.15.12:0/2236113006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e9d680 0x559b59eb48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.836+0000 7f0e5a309740 1 --2- 172.21.15.12:0/2236113006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e92dc0 0x559b59e9c100 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.836+0000 7f0e5a309740 1 --2- 172.21.15.12:0/2236113006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e924a0 0x559b59e8ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.836+0000 7f0e5a309740 1 -- 172.21.15.12:0/2236113006 >> 172.21.15.12:0/2236113006 conn(0x559b59e8ea30 msgr2=0x559b59e9b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.836+0000 7f0e5a309740 1 -- 172.21.15.12:0/2236113006 shutdown_connections 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.836+0000 7f0e5a309740 1 -- 172.21.15.12:0/2236113006 wait complete. 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.836+0000 7f0e5a309740 1 -- start start 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.836+0000 7f0e5a309740 1 Processor -- start 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e924a0 0x559b59ea2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e92dc0 0x559b59ea3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e5a309740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59f0e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e5a309740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e501af0e0 con 0x559b59e924a0 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e5a309740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e501ae9e0 con 0x559b59e9d680 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e5a309740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e501abc40 con 0x559b59e92dc0 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e5a309740 10 client.0 _ll_register_callbacks cb 0x7f0e4c0d3bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e554cb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e92dc0 0x559b59ea3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e55ccc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e924a0 0x559b59ea2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e564cd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59f0e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e554cb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e92dc0 0x559b59ea3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54404/0 (socket says 172.21.15.12:54404) 2024-09-19T06:55:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e554cb640 1 -- 172.21.15.12:0/3331687636 learned_addr learned my addr 172.21.15.12:0/3331687636 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e554cb640 1 -- 172.21.15.12:0/3331687636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 msgr2=0x559b59f0e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e554cb640 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59f0e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e554cb640 1 -- 172.21.15.12:0/3331687636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e924a0 msgr2=0x559b59ea2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e554cb640 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e924a0 0x559b59ea2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e554cb640 1 -- 172.21.15.12:0/3331687636 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b59f0eee0 con 0x559b59e92dc0 2024-09-19T06:55:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e554cb640 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e92dc0 0x559b59ea3400 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e4002a930 tx=0x7f0e4002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab797fda3d8e4018 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.837+0000 7f0e397fa640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e397fa640 1 -- 172.21.15.12:0/3331687636 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40040070 con 0x559b59e92dc0 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e5a309740 1 -- 172.21.15.12:0/3331687636 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e400035f0 con 0x559b59e92dc0 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e397fa640 1 -- 172.21.15.12:0/3331687636 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8731+0+0 (secure 0 0 0) 0x7f0e400037a0 con 0x559b59e92dc0 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e397fa640 1 -- 172.21.15.12:0/3331687636 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f0e4004c040 con 0x559b59e92dc0 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e5a309740 10 client.28855 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e5a309740 1 -- 172.21.15.12:0/3331687636 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x559b59f17460 con 0x559b59e92dc0 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e397fa640 1 -- 172.21.15.12:0/3331687636 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e400035f0 con 0x559b59e92dc0 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e397fa640 1 -- 172.21.15.12:0/3331687636 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f0e4003c440 con 0x559b59e92dc0 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e5a309740 10 client.28855 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e5a309740 10 client.28855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e5a309740 20 client.28855 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e5a309740 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b59f17af0 0x559b59f19f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e5a309740 4 client.28855 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:55:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.838+0000 7f0e5a309740 1 -- 172.21.15.12:0/3331687636 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559b59dffd60 con 0x559b59f17af0 2024-09-19T06:55:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e55ccc640 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b59f17af0 0x559b59f19f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e55ccc640 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b59f17af0 0x559b59f19f10 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c19f8c549cf0602 server_cookie=8c3ae6562ce6f23e in_seq=0 out_seq=0 2024-09-19T06:55:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e397fa640 10 client.28855 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e397fa640 1 -- 172.21.15.12:0/3331687636 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559b59dffd60 con 0x559b59f17af0 2024-09-19T06:55:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e397fa640 10 client.28855 handle_command_reply: tid=0 2024-09-19T06:55:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e5a309740 1 client.28855 shutdown 2024-09-19T06:55:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e5a309740 1 -- 172.21.15.12:0/3331687636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e92dc0 msgr2=0x559b59ea3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e5a309740 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e92dc0 0x559b59ea3400 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e4002a930 tx=0x7f0e4002a410 comp rx=0 tx=0).stop 2024-09-19T06:55:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e5a309740 1 -- 172.21.15.12:0/3331687636 shutdown_connections 2024-09-19T06:55:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e5a309740 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b59f17af0 0x559b59f19f10 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e5a309740 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b59e9d680 0x559b59f0e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e5a309740 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b59e92dc0 0x559b59ea3400 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e397fa640 0 client.28855 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e5a309740 1 --2- 172.21.15.12:0/3331687636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b59e924a0 0x559b59ea2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.839+0000 7f0e5a309740 1 -- 172.21.15.12:0/3331687636 >> 172.21.15.12:0/3331687636 conn(0x559b59e8ea30 msgr2=0x559b59e9c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e5a309740 1 -- 172.21.15.12:0/3331687636 shutdown_connections 2024-09-19T06:55:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e5a309740 1 -- 172.21.15.12:0/3331687636 wait complete. 2024-09-19T06:55:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e5a309740 20 client.28855 trim_cache size 0 max 16384 2024-09-19T06:55:09.848 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:55:09.848 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:55:09.848 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:55:09.848 INFO:teuthology.orchestra.run.smithi012.stdout: "dfc32b9f-0ceb-4e5a-b646-d7c4b39a45cc": { 2024-09-19T06:55:09.848 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:55:09.848 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "dfc32b9f-0ceb-4e5a-b646-d7c4b39a45cc", 2024-09-19T06:55:09.849 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:55:09.849 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:09.849 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:09.849 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:55:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e57f30640 1 -- 172.21.15.12:0/3651774021 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e3c0a33b0 msgr2=0x7f0e3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e57f30640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e3c0a33b0 0x7f0e3c0a5870 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0e48005f40 tx=0x7f0e48004a40 comp rx=0 tx=0).stop 2024-09-19T06:55:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e57f30640 1 -- 172.21.15.12:0/3651774021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e50101de0 msgr2=0x7f0e50198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e57f30640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e50101de0 0x7f0e50198510 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00e9f0 tx=0x7f0e4c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e57f30640 1 -- 172.21.15.12:0/3651774021 shutdown_connections 2024-09-19T06:55:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e57f30640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e3c0a33b0 0x7f0e3c0a5870 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e57f30640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e50106f10 0x7f0e5019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e57f30640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e50102790 0x7f0e50198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e57f30640 1 --2- 172.21.15.12:0/3651774021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e50101de0 0x7f0e50198510 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.840+0000 7f0e57f30640 1 -- 172.21.15.12:0/3651774021 >> 172.21.15.12:0/3651774021 conn(0x7f0e500fd8c0 msgr2=0x7f0e500fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.841+0000 7f0e57f30640 1 -- 172.21.15.12:0/3651774021 shutdown_connections 2024-09-19T06:55:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:09.841+0000 7f0e57f30640 1 -- 172.21.15.12:0/3651774021 wait complete. 2024-09-19T06:55:10.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:10 smithi012 ceph-mon[30937]: pgmap v470: 97 pgs: 97 active+clean; 3.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.2 MiB/s wr, 608 op/s 2024-09-19T06:55:10.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:10 smithi012 ceph-mon[30937]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T06:55:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:10 smithi173 ceph-mon[35349]: pgmap v470: 97 pgs: 97 active+clean; 3.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.2 MiB/s wr, 608 op/s 2024-09-19T06:55:10.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:10 smithi173 ceph-mon[35349]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T06:55:10.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:10 smithi016 ceph-mon[34911]: pgmap v470: 97 pgs: 97 active+clean; 3.6 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 5.2 MiB/s wr, 608 op/s 2024-09-19T06:55:10.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:10 smithi016 ceph-mon[34911]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T06:55:10.745 INFO:tasks.cephfs.filesystem:scrub status for tag:dfc32b9f-0ceb-4e5a-b646-d7c4b39a45cc - {'path': '/', 'tag': 'dfc32b9f-0ceb-4e5a-b646-d7c4b39a45cc', 'options': 'recursive,force'} 2024-09-19T06:55:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 865.0 s, 143.8 tps, lat 574.435 ms stddev 340.132 2024-09-19T06:55:12.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:12 smithi173 ceph-mon[35349]: pgmap v472: 97 pgs: 97 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 2.6 MiB/s wr, 547 op/s 2024-09-19T06:55:12.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:12 smithi012 ceph-mon[30937]: pgmap v472: 97 pgs: 97 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 2.6 MiB/s wr, 547 op/s 2024-09-19T06:55:12.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:12 smithi016 ceph-mon[34911]: pgmap v472: 97 pgs: 97 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 2.6 MiB/s wr, 547 op/s 2024-09-19T06:55:13.933 INFO:tasks.quiescer.fs.[cephfs]:Total duration (58.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T06:55:13.933 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.45 2024-09-19T06:55:13.934 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:55:14.310 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:14 smithi016 ceph-mon[34911]: pgmap v473: 97 pgs: 97 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 2.5 MiB/s wr, 522 op/s 2024-09-19T06:55:14.310 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:55:14.311 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:55:14.311 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:55:14.311 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:55:14.323 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:14 smithi173 ceph-mon[35349]: pgmap v473: 97 pgs: 97 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 2.5 MiB/s wr, 522 op/s 2024-09-19T06:55:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:55:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:55:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:55:14.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:55:14.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:14 smithi012 ceph-mon[30937]: pgmap v473: 97 pgs: 97 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 2.5 MiB/s wr, 522 op/s 2024-09-19T06:55:14.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:55:14.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:55:14.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:55:14.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:55:15.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.061+0000 7f91a51dd640 1 -- 172.21.15.12:0/226376606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a01012a0 msgr2=0x7f91a0105770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.061+0000 7f91a51dd640 1 --2- 172.21.15.12:0/226376606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a01012a0 0x7f91a0105770 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f919801acb0 tx=0x7f919803b970 comp rx=0 tx=0).stop 2024-09-19T06:55:15.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.061+0000 7f91a51dd640 1 -- 172.21.15.12:0/226376606 shutdown_connections 2024-09-19T06:55:15.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.061+0000 7f91a51dd640 1 --2- 172.21.15.12:0/226376606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a0105d90 0x7f91a0106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.061+0000 7f91a51dd640 1 --2- 172.21.15.12:0/226376606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a01012a0 0x7f91a0105770 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.061+0000 7f91a51dd640 1 --2- 172.21.15.12:0/226376606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0100980 0x7f91a0100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.061+0000 7f91a51dd640 1 -- 172.21.15.12:0/226376606 >> 172.21.15.12:0/226376606 conn(0x7f91a00fc610 msgr2=0x7f91a00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:15.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.061+0000 7f91a51dd640 1 -- 172.21.15.12:0/226376606 shutdown_connections 2024-09-19T06:55:15.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.061+0000 7f91a51dd640 1 -- 172.21.15.12:0/226376606 wait complete. 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.062+0000 7f91a51dd640 1 Processor -- start 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.063+0000 7f91a51dd640 1 -- start start 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.063+0000 7f91a51dd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a0100980 0x7f91a0114d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.063+0000 7f91a51dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a01012a0 0x7f91a0110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.063+0000 7f91a51dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0105d90 0x7f91a0111370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.063+0000 7f91a51dd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91a0109790 con 0x7f91a0105d90 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.063+0000 7f91a51dd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f91a0109610 con 0x7f91a0100980 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.063+0000 7f91a51dd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f91a0109910 con 0x7f91a01012a0 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.064+0000 7f919f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a01012a0 0x7f91a0110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.064+0000 7f919ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a0100980 0x7f91a0114d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.064+0000 7f919f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a01012a0 0x7f91a0110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54510/0 (socket says 172.21.15.12:54510) 2024-09-19T06:55:15.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.064+0000 7f919f7fe640 1 -- 172.21.15.12:0/3775265239 learned_addr learned my addr 172.21.15.12:0/3775265239 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:15.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.065+0000 7f919f7fe640 1 -- 172.21.15.12:0/3775265239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a0100980 msgr2=0x7f91a0114d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.065+0000 7f919f7fe640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a0100980 0x7f91a0114d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.065+0000 7f919f7fe640 1 -- 172.21.15.12:0/3775265239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0105d90 msgr2=0x7f91a0111370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:55:15.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.065+0000 7f919f7fe640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0105d90 0x7f91a0111370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.065+0000 7f919f7fe640 1 -- 172.21.15.12:0/3775265239 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a0111af0 con 0x7f91a01012a0 2024-09-19T06:55:15.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.065+0000 7f919f7fe640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a01012a0 0x7f91a0110e30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f919803bf60 tx=0x7f9198042f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:15.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.069+0000 7f919d7fa640 1 -- 172.21.15.12:0/3775265239 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198045030 con 0x7f91a01012a0 2024-09-19T06:55:15.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.069+0000 7f91a51dd640 1 -- 172.21.15.12:0/3775265239 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a01a27a0 con 0x7f91a01012a0 2024-09-19T06:55:15.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.069+0000 7f919d7fa640 1 -- 172.21.15.12:0/3775265239 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f919804f070 con 0x7f91a01012a0 2024-09-19T06:55:15.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.070+0000 7f919d7fa640 1 -- 172.21.15.12:0/3775265239 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198004750 con 0x7f91a01012a0 2024-09-19T06:55:15.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.070+0000 7f91a51dd640 1 -- 172.21.15.12:0/3775265239 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a01a2bf0 con 0x7f91a01012a0 2024-09-19T06:55:15.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.072+0000 7f91a51dd640 1 -- 172.21.15.12:0/3775265239 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a006a850 con 0x7f91a01012a0 2024-09-19T06:55:15.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.075+0000 7f919d7fa640 1 -- 172.21.15.12:0/3775265239 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9198048020 con 0x7f91a01012a0 2024-09-19T06:55:15.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.076+0000 7f919d7fa640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91880a35c0 0x7f91880a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.077+0000 7f919d7fa640 1 -- 172.21.15.12:0/3775265239 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f91981021f0 con 0x7f91a01012a0 2024-09-19T06:55:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.077+0000 7f919ffff640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91880a35c0 0x7f91880a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.078+0000 7f919ffff640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91880a35c0 0x7f91880a5a80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9190009990 tx=0x7f9190009110 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:15.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.081+0000 7f919d7fa640 1 -- 172.21.15.12:0/3775265239 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91980cec70 con 0x7f91a01012a0 2024-09-19T06:55:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.198+0000 7f1b5d36d640 1 -- 172.21.15.12:0/1818238678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b58101370 msgr2=0x7f1b5806a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.198+0000 7f1b5d36d640 1 --2- 172.21.15.12:0/1818238678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b58101370 0x7f1b5806a0c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009ca0 tx=0x7f1b5002a8d0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.199+0000 7f1b5d36d640 1 -- 172.21.15.12:0/1818238678 shutdown_connections 2024-09-19T06:55:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.199+0000 7f1b5d36d640 1 --2- 172.21.15.12:0/1818238678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b58101370 0x7f1b5806a0c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.199+0000 7f1b5d36d640 1 --2- 172.21.15.12:0/1818238678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b581009d0 0x7f1b58100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.199+0000 7f1b5d36d640 1 --2- 172.21.15.12:0/1818238678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b581069e0 0x7f1b58106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.200 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.199+0000 7f1b5d36d640 1 -- 172.21.15.12:0/1818238678 >> 172.21.15.12:0/1818238678 conn(0x7f1b580fc6b0 msgr2=0x7f1b580fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.199+0000 7f1b5d36d640 1 -- 172.21.15.12:0/1818238678 shutdown_connections 2024-09-19T06:55:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.199+0000 7f1b5d36d640 1 -- 172.21.15.12:0/1818238678 wait complete. 2024-09-19T06:55:15.201 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.200+0000 7f1b5d36d640 1 Processor -- start 2024-09-19T06:55:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.200+0000 7f1b5d36d640 1 -- start start 2024-09-19T06:55:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b5d36d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b581009d0 0x7f1b580738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b5d36d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b58101370 0x7f1b58073df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.203 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b5d36d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b581069e0 0x7f1b5806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b5d36d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b58114190 con 0x7f1b58101370 2024-09-19T06:55:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b5d36d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1b58114010 con 0x7f1b581009d0 2024-09-19T06:55:15.204 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b5d36d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1b58114310 con 0x7f1b581069e0 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b567fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b58101370 0x7f1b58073df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b567fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b58101370 0x7f1b58073df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44550/0 (socket says 172.21.15.12:44550) 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b581069e0 0x7f1b5806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b567fc640 1 -- 172.21.15.12:0/777509235 learned_addr learned my addr 172.21.15.12:0/777509235 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b581009d0 0x7f1b580738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b567fc640 1 -- 172.21.15.12:0/777509235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b581069e0 msgr2=0x7f1b5806ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b567fc640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b581069e0 0x7f1b5806ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b567fc640 1 -- 172.21.15.12:0/777509235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b581009d0 msgr2=0x7f1b580738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b567fc640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b581009d0 0x7f1b580738b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b567fc640 1 -- 172.21.15.12:0/777509235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5806d330 con 0x7f1b58101370 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b581009d0 0x7f1b580738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:15.205 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.201+0000 7f1b577fe640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b581069e0 0x7f1b5806ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.202+0000 7f1b567fc640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b58101370 0x7f1b58073df0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00e9f0 tx=0x7f1b4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.202+0000 7f1b3ffff640 1 -- 172.21.15.12:0/777509235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c00cd80 con 0x7f1b58101370 2024-09-19T06:55:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.202+0000 7f1b3ffff640 1 -- 172.21.15.12:0/777509235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b4c010910 con 0x7f1b58101370 2024-09-19T06:55:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.202+0000 7f1b5d36d640 1 -- 172.21.15.12:0/777509235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5806d620 con 0x7f1b58101370 2024-09-19T06:55:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.202+0000 7f1b3ffff640 1 -- 172.21.15.12:0/777509235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c018990 con 0x7f1b58101370 2024-09-19T06:55:15.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.202+0000 7f1b5d36d640 1 -- 172.21.15.12:0/777509235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b580715b0 con 0x7f1b58101370 2024-09-19T06:55:15.209 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.206+0000 7f1b601e6740 1 Processor -- start 2024-09-19T06:55:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.207+0000 7f1b3ffff640 1 -- 172.21.15.12:0/777509235 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1b4c010ac0 con 0x7f1b58101370 2024-09-19T06:55:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.208+0000 7f1b3ffff640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b400a34e0 0x7f1b400a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.208+0000 7f1b3ffff640 1 -- 172.21.15.12:0/777509235 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f1b4c0d0130 con 0x7f1b58101370 2024-09-19T06:55:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.209+0000 7f1b601e6740 1 -- start start 2024-09-19T06:55:15.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.209+0000 7f1b577fe640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b400a34e0 0x7f1b400a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.209+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224a1300 0x5593224a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.209+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1c20 0x5593224abf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.209+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224ac4c0 0x5593224ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.209+0000 7f1b601e6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5593223fd2f0 con 0x5593224a1300 2024-09-19T06:55:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.209+0000 7f1b601e6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5593223a5270 con 0x5593224a1c20 2024-09-19T06:55:15.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.209+0000 7f1b601e6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5593223f92b0 con 0x5593224ac4c0 2024-09-19T06:55:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.210+0000 7f1b567fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1c20 0x5593224abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.210+0000 7f1b567fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1c20 0x5593224abf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41832/0 (socket says 172.21.15.12:41832) 2024-09-19T06:55:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.210+0000 7f1b567fc640 1 -- 172.21.15.12:0/54865496 learned_addr learned my addr 172.21.15.12:0/54865496 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.210+0000 7f1b577fe640 1 --2- 172.21.15.12:0/54865496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224ac4c0 0x5593224ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.210+0000 7f1b567fc640 1 -- 172.21.15.12:0/54865496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224ac4c0 msgr2=0x5593224ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.210+0000 7f1b567fc640 1 --2- 172.21.15.12:0/54865496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224ac4c0 0x5593224ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.210+0000 7f1b567fc640 1 -- 172.21.15.12:0/54865496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224a1300 msgr2=0x5593224a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.210+0000 7f1b567fc640 1 --2- 172.21.15.12:0/54865496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224a1300 0x5593224a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.210+0000 7f1b567fc640 1 -- 172.21.15.12:0/54865496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593223a4340 con 0x5593224a1c20 2024-09-19T06:55:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.211+0000 7f1b577fe640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b400a34e0 0x7f1b400a59a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1b50006010 tx=0x7f1b50005d80 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.211+0000 7f1b567fc640 1 --2- 172.21.15.12:0/54865496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1c20 0x5593224abf80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0a4a50 tx=0x7f1b4c09c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3471d879eaafba5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:15.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.212+0000 7f1b3d7fa640 1 -- 172.21.15.12:0/54865496 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c098a30 con 0x5593224a1c20 2024-09-19T06:55:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.216+0000 7f1b3d7fa640 1 -- 172.21.15.12:0/54865496 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b4c0cda00 con 0x5593224a1c20 2024-09-19T06:55:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.217+0000 7f1b601e6740 1 -- 172.21.15.12:0/54865496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1c20 msgr2=0x5593224abf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.218 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.217+0000 7f1b601e6740 1 --2- 172.21.15.12:0/54865496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1c20 0x5593224abf80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0a4a50 tx=0x7f1b4c09c480 comp rx=0 tx=0).stop 2024-09-19T06:55:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.219+0000 7f1b601e6740 1 -- 172.21.15.12:0/54865496 shutdown_connections 2024-09-19T06:55:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.219+0000 7f1b601e6740 1 --2- 172.21.15.12:0/54865496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224ac4c0 0x5593224ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.219+0000 7f1b601e6740 1 --2- 172.21.15.12:0/54865496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1c20 0x5593224abf80 secure :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0a4a50 tx=0x7f1b4c09c480 comp rx=0 tx=0).stop 2024-09-19T06:55:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.219+0000 7f1b601e6740 1 --2- 172.21.15.12:0/54865496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224a1300 0x5593224a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.219+0000 7f1b601e6740 1 -- 172.21.15.12:0/54865496 >> 172.21.15.12:0/54865496 conn(0x55932249d870 msgr2=0x55932249dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:15.225 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.221+0000 7f1b601e6740 1 -- 172.21.15.12:0/54865496 shutdown_connections 2024-09-19T06:55:15.229 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.225+0000 7f1b601e6740 1 -- 172.21.15.12:0/54865496 wait complete. 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.226+0000 7f1b601e6740 1 -- start start 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.226+0000 7f1b601e6740 1 Processor -- start 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.226+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224a1300 0x5593224a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.226+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224ac4c0 0x5593224a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.226+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x55932249ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.227+0000 7f1b601e6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5593224af130 con 0x5593224aa040 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.227+0000 7f1b601e6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559322386290 con 0x5593224ac4c0 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.227+0000 7f1b601e6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5593224af2b0 con 0x5593224a1300 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.227+0000 7f1b601e6740 10 client.0 _ll_register_callbacks cb 0x5593223b7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.227+0000 7f1b56ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224a1300 0x5593224a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.228+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x55932249ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.228+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x55932249ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44556/0 (socket says 172.21.15.12:44556) 2024-09-19T06:55:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.228+0000 7f1b577fe640 1 -- 172.21.15.12:0/2681859988 learned_addr learned my addr 172.21.15.12:0/2681859988 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.229+0000 7f1b56ffd640 1 -- 172.21.15.12:0/2681859988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224ac4c0 msgr2=0x5593224a9b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:55:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.229+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224ac4c0 0x5593224a9b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.229+0000 7f1b56ffd640 1 -- 172.21.15.12:0/2681859988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 msgr2=0x55932249ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.229+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x55932249ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.229+0000 7f1b56ffd640 1 -- 172.21.15.12:0/2681859988 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559322110210 con 0x5593224a1300 2024-09-19T06:55:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.229+0000 7f1b577fe640 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x55932249ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.229+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224a1300 0x5593224a95c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1b48006fd0 tx=0x7f1b4800eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=965a796c424c04a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.231+0000 7f1b3aff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:55:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.231+0000 7f1b3aff5640 1 -- 172.21.15.12:0/2681859988 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48017070 con 0x5593224a1300 2024-09-19T06:55:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.231+0000 7f1b601e6740 1 -- 172.21.15.12:0/2681859988 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b4c0cda00 con 0x5593224a1300 2024-09-19T06:55:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.231+0000 7f1b3aff5640 1 -- 172.21.15.12:0/2681859988 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f1b4800c6b0 con 0x5593224a1300 2024-09-19T06:55:15.237 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.237+0000 7f1b3aff5640 1 -- 172.21.15.12:0/2681859988 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f1b48021050 con 0x5593224a1300 2024-09-19T06:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.238+0000 7f1b601e6740 10 client.28873 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.238+0000 7f1b601e6740 1 -- 172.21.15.12:0/2681859988 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5593221dc620 con 0x5593224a1300 2024-09-19T06:55:15.239 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.238+0000 7f1b3aff5640 1 -- 172.21.15.12:0/2681859988 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b4c0cda00 con 0x5593224a1300 2024-09-19T06:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.240+0000 7f1b3aff5640 1 -- 172.21.15.12:0/2681859988 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f1b48013c50 con 0x5593224a1300 2024-09-19T06:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.240+0000 7f1b601e6740 10 client.28873 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.240+0000 7f1b601e6740 10 client.28873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.240+0000 7f1b601e6740 20 client.28873 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:15.241 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.240+0000 7f1b601e6740 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5593224b2570 0x5593224b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.240+0000 7f1b601e6740 4 client.28873 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.240+0000 7f1b601e6740 1 -- 172.21.15.12:0/2681859988 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55932240aa20 con 0x5593224b2570 2024-09-19T06:55:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.241+0000 7f1b567fc640 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5593224b2570 0x5593224b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.248 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.247+0000 7f1b567fc640 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5593224b2570 0x5593224b49c0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7980c83185acf7af server_cookie=54a14a30ff97e292 in_seq=0 out_seq=0 2024-09-19T06:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.248+0000 7f1b3aff5640 10 client.28873 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:15.249 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.248+0000 7f1b3aff5640 1 -- 172.21.15.12:0/2681859988 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55932240aa20 con 0x5593224b2570 2024-09-19T06:55:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.249+0000 7f1b3aff5640 10 client.28873 handle_command_reply: tid=0 2024-09-19T06:55:15.250 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.249+0000 7f1b601e6740 1 client.28873 shutdown 2024-09-19T06:55:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.250+0000 7f1b601e6740 1 -- 172.21.15.12:0/2681859988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224a1300 msgr2=0x5593224a95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.251 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.250+0000 7f1b601e6740 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224a1300 0x5593224a95c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1b48006fd0 tx=0x7f1b4800eb90 comp rx=0 tx=0).stop 2024-09-19T06:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.251+0000 7f1b601e6740 1 -- 172.21.15.12:0/2681859988 shutdown_connections 2024-09-19T06:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.252+0000 7f1b601e6740 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5593224b2570 0x5593224b49c0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.252+0000 7f1b601e6740 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x55932249ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.252+0000 7f1b601e6740 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224ac4c0 0x5593224a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.252+0000 7f1b601e6740 1 --2- 172.21.15.12:0/2681859988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224a1300 0x5593224a95c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.252+0000 7f1b601e6740 1 -- 172.21.15.12:0/2681859988 >> 172.21.15.12:0/2681859988 conn(0x55932249d870 msgr2=0x5593224941c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:15.253 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.252+0000 7f1b3aff5640 0 client.28873 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.253+0000 7f1b601e6740 1 -- 172.21.15.12:0/2681859988 shutdown_connections 2024-09-19T06:55:15.254 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.253+0000 7f1b601e6740 1 -- 172.21.15.12:0/2681859988 wait complete. 2024-09-19T06:55:15.255 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.254+0000 7f1b601e6740 20 client.28873 trim_cache size 0 max 16384 2024-09-19T06:55:15.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.289+0000 7f1b601e6740 1 Processor -- start 2024-09-19T06:55:15.290 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.289+0000 7f1b601e6740 1 -- start start 2024-09-19T06:55:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.289+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 0x5593224989d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x559322498f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224ac4c0 0x5593224a6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b567fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x559322498f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b56ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 0x5593224989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b567fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x559322498f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44560/0 (socket says 172.21.15.12:44560) 2024-09-19T06:55:15.292 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b56ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 0x5593224989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:41846/0 (socket says 172.21.15.12:41846) 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b601e6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581b4120 con 0x5593224aa040 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b601e6740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581b5c90 con 0x5593224a1300 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b601e6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581b47f0 con 0x5593224ac4c0 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b567fc640 1 -- 172.21.15.12:0/2250330896 learned_addr learned my addr 172.21.15.12:0/2250330896 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b577fe640 1 --2- 172.21.15.12:0/2250330896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224ac4c0 0x5593224a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b56ffd640 1 -- 172.21.15.12:0/2250330896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224ac4c0 msgr2=0x5593224a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/2250330896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224ac4c0 0x5593224a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b56ffd640 1 -- 172.21.15.12:0/2250330896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 msgr2=0x559322498f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/2250330896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x559322498f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.290+0000 7f1b56ffd640 1 -- 172.21.15.12:0/2250330896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593224aec20 con 0x5593224a1300 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.291+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/2250330896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 0x5593224989d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009140 tx=0x7f1b4801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ba41747b55a59e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.291+0000 7f1b3cff9640 1 -- 172.21.15.12:0/2250330896 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4802a070 con 0x5593224a1300 2024-09-19T06:55:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.291+0000 7f1b3cff9640 1 -- 172.21.15.12:0/2250330896 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b48004510 con 0x5593224a1300 2024-09-19T06:55:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.291+0000 7f1b3cff9640 1 -- 172.21.15.12:0/2250330896 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48017040 con 0x5593224a1300 2024-09-19T06:55:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.292+0000 7f1b601e6740 1 -- 172.21.15.12:0/2250330896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 msgr2=0x5593224989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.292+0000 7f1b601e6740 1 --2- 172.21.15.12:0/2250330896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 0x5593224989d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009140 tx=0x7f1b4801c990 comp rx=0 tx=0).stop 2024-09-19T06:55:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.292+0000 7f1b601e6740 1 -- 172.21.15.12:0/2250330896 shutdown_connections 2024-09-19T06:55:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.292+0000 7f1b601e6740 1 --2- 172.21.15.12:0/2250330896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224ac4c0 0x5593224a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.292+0000 7f1b601e6740 1 --2- 172.21.15.12:0/2250330896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224aa040 0x559322498f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.293+0000 7f1b601e6740 1 --2- 172.21.15.12:0/2250330896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 0x5593224989d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.293+0000 7f1b601e6740 1 -- 172.21.15.12:0/2250330896 >> 172.21.15.12:0/2250330896 conn(0x55932249d870 msgr2=0x5593224a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.293+0000 7f1b601e6740 1 -- 172.21.15.12:0/2250330896 shutdown_connections 2024-09-19T06:55:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.293+0000 7f1b601e6740 1 -- 172.21.15.12:0/2250330896 wait complete. 2024-09-19T06:55:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.293+0000 7f1b601e6740 1 -- start start 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b601e6740 1 Processor -- start 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 0x559322496930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224aa040 0x559322496e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b601e6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224ac4c0 0x5593224973b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b601e6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581b55c0 con 0x5593224ac4c0 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224ac4c0 0x5593224973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b567fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224aa040 0x559322496e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b567fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224aa040 0x559322496e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:54566/0 (socket says 172.21.15.12:54566) 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b567fc640 1 -- 172.21.15.12:0/3001106486 learned_addr learned my addr 172.21.15.12:0/3001106486 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224ac4c0 0x5593224973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44574/0 (socket says 172.21.15.12:44574) 2024-09-19T06:55:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b601e6740 1 -- 172.21.15.12:0/3001106486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581b4ec0 con 0x5593224a1300 2024-09-19T06:55:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b601e6740 1 -- 172.21.15.12:0/3001106486 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1b581b2190 con 0x5593224aa040 2024-09-19T06:55:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 0x559322496930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b601e6740 10 client.0 _ll_register_callbacks cb 0x7f1b480097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b567fc640 1 -- 172.21.15.12:0/3001106486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 msgr2=0x559322496930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b567fc640 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 0x559322496930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b567fc640 1 -- 172.21.15.12:0/3001106486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224ac4c0 msgr2=0x5593224973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b567fc640 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224ac4c0 0x5593224973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b567fc640 1 -- 172.21.15.12:0/3001106486 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55932253fb20 con 0x5593224aa040 2024-09-19T06:55:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.294+0000 7f1b577fe640 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224ac4c0 0x5593224973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.295+0000 7f1b567fc640 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224aa040 0x559322496e70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0a4a50 tx=0x7f1b4c0a5100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2667e78845c031c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.295+0000 7f1b3aff5640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:55:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.295+0000 7f1b3aff5640 1 -- 172.21.15.12:0/3001106486 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0cda00 con 0x5593224aa040 2024-09-19T06:55:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.295+0000 7f1b3aff5640 1 -- 172.21.15.12:0/3001106486 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f1b4c018b30 con 0x5593224aa040 2024-09-19T06:55:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.295+0000 7f1b601e6740 1 -- 172.21.15.12:0/3001106486 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b48004510 con 0x5593224aa040 2024-09-19T06:55:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.295+0000 7f1b3aff5640 1 -- 172.21.15.12:0/3001106486 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f1b4c018d30 con 0x5593224aa040 2024-09-19T06:55:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.295+0000 7f1b601e6740 10 client.28879 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.295+0000 7f1b601e6740 1 -- 172.21.15.12:0/3001106486 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x559322540db0 con 0x5593224aa040 2024-09-19T06:55:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.295+0000 7f1b3aff5640 1 -- 172.21.15.12:0/3001106486 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b48004510 con 0x5593224aa040 2024-09-19T06:55:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.296+0000 7f1b3aff5640 1 -- 172.21.15.12:0/3001106486 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f1b4c0b0310 con 0x5593224aa040 2024-09-19T06:55:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.296+0000 7f1b601e6740 10 client.28879 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.296+0000 7f1b601e6740 10 client.28879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.296+0000 7f1b601e6740 20 client.28879 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.296+0000 7f1b601e6740 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559322541090 0x559322543480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.296+0000 7f1b601e6740 4 client.28879 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:55:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.296+0000 7f1b601e6740 1 -- 172.21.15.12:0/3001106486 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559322404d70 con 0x559322541090 2024-09-19T06:55:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.296+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559322541090 0x559322543480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:15.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.298+0000 7f1b56ffd640 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559322541090 0x559322543480 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60d9274f1de4756c server_cookie=b2cbb15eeaa7a70d in_seq=0 out_seq=0 2024-09-19T06:55:15.303 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.298+0000 7f1b3aff5640 10 client.28879 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.317+0000 7f1b3aff5640 1 -- 172.21.15.12:0/3001106486 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559322404d70 con 0x559322541090 2024-09-19T06:55:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.317+0000 7f1b3aff5640 10 client.28879 handle_command_reply: tid=0 2024-09-19T06:55:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.317+0000 7f1b601e6740 1 client.28879 shutdown 2024-09-19T06:55:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.318+0000 7f1b601e6740 1 -- 172.21.15.12:0/3001106486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224aa040 msgr2=0x559322496e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.318+0000 7f1b601e6740 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224aa040 0x559322496e70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0a4a50 tx=0x7f1b4c0a5100 comp rx=0 tx=0).stop 2024-09-19T06:55:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.318+0000 7f1b601e6740 1 -- 172.21.15.12:0/3001106486 shutdown_connections 2024-09-19T06:55:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.318+0000 7f1b601e6740 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559322541090 0x559322543480 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.319+0000 7f1b601e6740 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5593224ac4c0 0x5593224973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.319+0000 7f1b601e6740 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5593224aa040 0x559322496e70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.319+0000 7f1b3aff5640 0 client.28879 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.319+0000 7f1b601e6740 1 --2- 172.21.15.12:0/3001106486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5593224a1300 0x559322496930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.320 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.319+0000 7f1b601e6740 1 -- 172.21.15.12:0/3001106486 >> 172.21.15.12:0/3001106486 conn(0x55932249d870 msgr2=0x5593224a2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.319+0000 7f1b601e6740 1 -- 172.21.15.12:0/3001106486 shutdown_connections 2024-09-19T06:55:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.319+0000 7f1b601e6740 1 -- 172.21.15.12:0/3001106486 wait complete. 2024-09-19T06:55:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.319+0000 7f1b601e6740 20 client.28879 trim_cache size 0 max 16384 2024-09-19T06:55:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:55:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:55:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:55:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:55:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 -- 172.21.15.12:0/777509235 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b400a34e0 msgr2=0x7f1b400a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b400a34e0 0x7f1b400a59a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1b50006010 tx=0x7f1b50005d80 comp rx=0 tx=0).stop 2024-09-19T06:55:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 -- 172.21.15.12:0/777509235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b58101370 msgr2=0x7f1b58073df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b58101370 0x7f1b58073df0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00e9f0 tx=0x7f1b4c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 -- 172.21.15.12:0/777509235 shutdown_connections 2024-09-19T06:55:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f1b400a34e0 0x7f1b400a59a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b581069e0 0x7f1b5806ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b58101370 0x7f1b58073df0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 --2- 172.21.15.12:0/777509235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b581009d0 0x7f1b580738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 -- 172.21.15.12:0/777509235 >> 172.21.15.12:0/777509235 conn(0x7f1b580fc6b0 msgr2=0x7f1b58107850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 -- 172.21.15.12:0/777509235 shutdown_connections 2024-09-19T06:55:15.324 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:15.321+0000 7f1b5d36d640 1 -- 172.21.15.12:0/777509235 wait complete. 2024-09-19T06:55:15.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:15 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:55:15.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:15 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:55:15.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.441+0000 7f91a51dd640 1 -- 172.21.15.12:0/3775265239 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91a0112360 con 0x7f91a01012a0 2024-09-19T06:55:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:55:15.448 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":52,"btime":"2024-09-19T06:54:59:998268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:54:59.576996+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:55:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 52 2024-09-19T06:55:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.446+0000 7f919d7fa640 1 -- 172.21.15.12:0/3775265239 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11972 (secure 0 0 0) 0x7f91980ce570 con 0x7f91a01012a0 2024-09-19T06:55:15.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.455+0000 7f91a51dd640 1 -- 172.21.15.12:0/3775265239 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91880a35c0 msgr2=0x7f91880a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.455+0000 7f91a51dd640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91880a35c0 0x7f91880a5a80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9190009990 tx=0x7f9190009110 comp rx=0 tx=0).stop 2024-09-19T06:55:15.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.455+0000 7f91a51dd640 1 -- 172.21.15.12:0/3775265239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a01012a0 msgr2=0x7f91a0110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:15.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.455+0000 7f91a51dd640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a01012a0 0x7f91a0110e30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f919803bf60 tx=0x7f9198042f30 comp rx=0 tx=0).stop 2024-09-19T06:55:15.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.456+0000 7f91a51dd640 1 -- 172.21.15.12:0/3775265239 shutdown_connections 2024-09-19T06:55:15.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.456+0000 7f91a51dd640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a0105d90 0x7f91a0111370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.456+0000 7f91a51dd640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f91880a35c0 0x7f91880a5a80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.456+0000 7f91a51dd640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91a01012a0 0x7f91a0110e30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.456+0000 7f91a51dd640 1 --2- 172.21.15.12:0/3775265239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91a0100980 0x7f91a0114d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:15.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.456+0000 7f91a51dd640 1 -- 172.21.15.12:0/3775265239 >> 172.21.15.12:0/3775265239 conn(0x7f91a00fc610 msgr2=0x7f91a0109f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:15.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.457+0000 7f91a51dd640 1 -- 172.21.15.12:0/3775265239 shutdown_connections 2024-09-19T06:55:15.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:15.457+0000 7f91a51dd640 1 -- 172.21.15.12:0/3775265239 wait complete. 2024-09-19T06:55:15.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:15 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:55:15.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 870.0 s, 1999.8 tps, lat 63.563 ms stddev 207.649 2024-09-19T06:55:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:16 smithi173 ceph-mon[35349]: pgmap v474: 97 pgs: 97 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 6.0 MiB/s wr, 619 op/s 2024-09-19T06:55:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:16 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3775265239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:16.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:16 smithi012 ceph-mon[30937]: pgmap v474: 97 pgs: 97 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 6.0 MiB/s wr, 619 op/s 2024-09-19T06:55:16.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:16 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3775265239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:16.461 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0' 2024-09-19T06:55:16.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0 2024-09-19T06:55:16.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:16 smithi016 ceph-mon[34911]: pgmap v474: 97 pgs: 97 active+clean; 3.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 6.0 MiB/s wr, 619 op/s 2024-09-19T06:55:16.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:16 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3775265239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:16.861 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.448+0000 7f9a4d05d640 1 -- 172.21.15.12:0/3706807135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a4810ea80 msgr2=0x7f9a481154f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.448+0000 7f9a4d05d640 1 --2- 172.21.15.12:0/3706807135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a4810ea80 0x7f9a481154f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009be0 tx=0x7f9a4002a6e0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.448+0000 7f9a4d05d640 1 -- 172.21.15.12:0/3706807135 shutdown_connections 2024-09-19T06:55:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.448+0000 7f9a4d05d640 1 --2- 172.21.15.12:0/3706807135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a4810ea80 0x7f9a481154f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.448+0000 7f9a4d05d640 1 --2- 172.21.15.12:0/3706807135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a48109e00 0x7f9a4810e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.448+0000 7f9a4d05d640 1 --2- 172.21.15.12:0/3706807135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a48109450 0x7f9a48109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.448+0000 7f9a4d05d640 1 -- 172.21.15.12:0/3706807135 >> 172.21.15.12:0/3706807135 conn(0x7f9a4806e2d0 msgr2=0x7f9a4806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.448+0000 7f9a4d05d640 1 -- 172.21.15.12:0/3706807135 shutdown_connections 2024-09-19T06:55:17.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.448+0000 7f9a4d05d640 1 -- 172.21.15.12:0/3706807135 wait complete. 2024-09-19T06:55:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.449+0000 7f9a4d05d640 1 Processor -- start 2024-09-19T06:55:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.449+0000 7f9a4d05d640 1 -- start start 2024-09-19T06:55:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a4d05d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a48109450 0x7f9a481a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a4d05d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a48109e00 0x7f9a481a3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a4d05d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a4810ea80 0x7f9a481a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a4d05d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48118590 con 0x7f9a4810ea80 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a4d05d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48118410 con 0x7f9a48109450 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a4759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a4810ea80 0x7f9a481a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a4759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a4810ea80 0x7f9a481a77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44604/0 (socket says 172.21.15.12:44604) 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a4759e640 1 -- 172.21.15.12:0/1098825410 learned_addr learned my addr 172.21.15.12:0/1098825410 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a4659c640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a48109e00 0x7f9a481a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a48109450 0x7f9a481a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.450+0000 7f9a4d05d640 1 -- 172.21.15.12:0/1098825410 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48118710 con 0x7f9a48109e00 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.451+0000 7f9a4659c640 1 -- 172.21.15.12:0/1098825410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a48109450 msgr2=0x7f9a481a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.451+0000 7f9a4659c640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a48109450 0x7f9a481a2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.451+0000 7f9a4659c640 1 -- 172.21.15.12:0/1098825410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a4810ea80 msgr2=0x7f9a481a77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.451+0000 7f9a4659c640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a4810ea80 0x7f9a481a77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.451+0000 7f9a4659c640 1 -- 172.21.15.12:0/1098825410 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a481a7e90 con 0x7f9a48109e00 2024-09-19T06:55:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.451+0000 7f9a4659c640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a48109e00 0x7f9a481a3420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9a48073a60 tx=0x7f9a3800ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.451+0000 7f9a2ffff640 1 -- 172.21.15.12:0/1098825410 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38018030 con 0x7f9a48109e00 2024-09-19T06:55:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.452+0000 7f9a2ffff640 1 -- 172.21.15.12:0/1098825410 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a38007770 con 0x7f9a48109e00 2024-09-19T06:55:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.452+0000 7f9a4d05d640 1 -- 172.21.15.12:0/1098825410 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a481a8180 con 0x7f9a48109e00 2024-09-19T06:55:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.452+0000 7f9a4d05d640 1 -- 172.21.15.12:0/1098825410 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a481afa60 con 0x7f9a48109e00 2024-09-19T06:55:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.452+0000 7f9a2ffff640 1 -- 172.21.15.12:0/1098825410 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38003920 con 0x7f9a48109e00 2024-09-19T06:55:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.454+0000 7f9a2ffff640 1 -- 172.21.15.12:0/1098825410 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9a3801b070 con 0x7f9a48109e00 2024-09-19T06:55:17.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.455+0000 7f9a4f436740 1 Processor -- start 2024-09-19T06:55:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.455+0000 7f9a4f436740 1 -- start start 2024-09-19T06:55:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.455+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da03850 0x559b2da03c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.455+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da04170 0x559b2da0e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.455+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da0ea30 0x559b2da10e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.455+0000 7f9a4f436740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559b2d968160 con 0x559b2da04170 2024-09-19T06:55:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.455+0000 7f9a4f436740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559b2d90f720 con 0x559b2da03850 2024-09-19T06:55:17.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.455+0000 7f9a4f436740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559b2d964120 con 0x559b2da0ea30 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.456+0000 7f9a46d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da04170 0x559b2da0e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.456+0000 7f9a46d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da04170 0x559b2da0e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44610/0 (socket says 172.21.15.12:44610) 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.456+0000 7f9a46d9d640 1 -- 172.21.15.12:0/2046379127 learned_addr learned my addr 172.21.15.12:0/2046379127 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.456+0000 7f9a4759e640 1 --2- 172.21.15.12:0/2046379127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da03850 0x559b2da03c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.456+0000 7f9a46d9d640 1 -- 172.21.15.12:0/2046379127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da0ea30 msgr2=0x559b2da10e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.456+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/2046379127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da0ea30 0x559b2da10e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.456+0000 7f9a46d9d640 1 -- 172.21.15.12:0/2046379127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da03850 msgr2=0x559b2da03c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.456+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/2046379127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da03850 0x559b2da03c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.456+0000 7f9a46d9d640 1 -- 172.21.15.12:0/2046379127 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2d6d9ba0 con 0x559b2da04170 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.456+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/2046379127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da04170 0x559b2da0e4f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00b820 tx=0x7f9a3c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7519a66f7996eb17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.457+0000 7f9a2ffff640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9a300a3430 0x7f9a300a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.457+0000 7f9a2d7fa640 1 -- 172.21.15.12:0/2046379127 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00d950 con 0x559b2da04170 2024-09-19T06:55:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.457+0000 7f9a2d7fa640 1 -- 172.21.15.12:0/2046379127 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a3c019070 con 0x559b2da04170 2024-09-19T06:55:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.457+0000 7f9a2d7fa640 1 -- 172.21.15.12:0/2046379127 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c014e60 con 0x559b2da04170 2024-09-19T06:55:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.457+0000 7f9a2ffff640 1 -- 172.21.15.12:0/1098825410 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f9a380cf5d0 con 0x7f9a48109e00 2024-09-19T06:55:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.458+0000 7f9a4f436740 1 -- 172.21.15.12:0/2046379127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da04170 msgr2=0x559b2da0e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.458+0000 7f9a4f436740 1 --2- 172.21.15.12:0/2046379127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da04170 0x559b2da0e4f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00b820 tx=0x7f9a3c00bce0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.459+0000 7f9a4759e640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9a300a3430 0x7f9a300a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.460+0000 7f9a4f436740 1 -- 172.21.15.12:0/2046379127 shutdown_connections 2024-09-19T06:55:17.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.460+0000 7f9a4f436740 1 --2- 172.21.15.12:0/2046379127 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da0ea30 0x559b2da10e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.460+0000 7f9a4f436740 1 --2- 172.21.15.12:0/2046379127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da04170 0x559b2da0e4f0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.460+0000 7f9a4f436740 1 --2- 172.21.15.12:0/2046379127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da03850 0x559b2da03c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.460+0000 7f9a4f436740 1 -- 172.21.15.12:0/2046379127 >> 172.21.15.12:0/2046379127 conn(0x559b2d9ffde0 msgr2=0x559b2da001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.460+0000 7f9a4f436740 1 -- 172.21.15.12:0/2046379127 shutdown_connections 2024-09-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.460+0000 7f9a4f436740 1 -- 172.21.15.12:0/2046379127 wait complete. 2024-09-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.460+0000 7f9a4f436740 1 -- start start 2024-09-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.460+0000 7f9a4759e640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9a300a3430 0x7f9a300a58f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009370 tx=0x7f9a40030a50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.460+0000 7f9a4f436740 1 Processor -- start 2024-09-19T06:55:17.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da0b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 0x559b2da0be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da0ea30 0x559b2da0c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a4f436740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559b2da11600 con 0x559b2da03850 2024-09-19T06:55:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a4f436740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559b2d8f0900 con 0x559b2da04170 2024-09-19T06:55:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a4f436740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559b2da11780 con 0x559b2da0ea30 2024-09-19T06:55:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a4f436740 10 client.0 _ll_register_callbacks cb 0x559b2d8ee780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a46d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da0b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a46d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da0b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44624/0 (socket says 172.21.15.12:44624) 2024-09-19T06:55:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a46d9d640 1 -- 172.21.15.12:0/913846 learned_addr learned my addr 172.21.15.12:0/913846 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a4659c640 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 0x559b2da0be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a4759e640 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da0ea30 0x559b2da0c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a46d9d640 1 -- 172.21.15.12:0/913846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da0ea30 msgr2=0x559b2da0c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da0ea30 0x559b2da0c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a46d9d640 1 -- 172.21.15.12:0/913846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 msgr2=0x559b2da0be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 0x559b2da0be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.461+0000 7f9a46d9d640 1 -- 172.21.15.12:0/913846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2d930c50 con 0x559b2da03850 2024-09-19T06:55:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da0b910 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c014f00 tx=0x7f9a3c014f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc16fecd430bf017 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:17.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a2aff5640 1 -- 172.21.15.12:0/913846 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00db50 con 0x559b2da03850 2024-09-19T06:55:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a2aff5640 1 -- 172.21.15.12:0/913846 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f9a3c00dcf0 con 0x559b2da03850 2024-09-19T06:55:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a4f436740 1 -- 172.21.15.12:0/913846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a3c019070 con 0x559b2da03850 2024-09-19T06:55:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a2aff5640 1 -- 172.21.15.12:0/913846 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f9a3c02e050 con 0x559b2da03850 2024-09-19T06:55:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a4f436740 10 client.19638 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a4f436740 1 -- 172.21.15.12:0/913846 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x559b2da25ac0 con 0x559b2da03850 2024-09-19T06:55:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a2aff5640 1 -- 172.21.15.12:0/913846 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a3c019070 con 0x559b2da03850 2024-09-19T06:55:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a2aff5640 1 -- 172.21.15.12:0/913846 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f9a3c013070 con 0x559b2da03850 2024-09-19T06:55:17.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a4f436740 10 client.19638 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a4f436740 10 client.19638 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:55:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.462+0000 7f9a4f436740 20 client.19638 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.463+0000 7f9a4f436740 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b2da273b0 0x559b2da297e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.463+0000 7f9a4f436740 4 client.19638 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.463+0000 7f9a4f436740 1 -- 172.21.15.12:0/913846 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b2d975890 con 0x559b2da273b0 2024-09-19T06:55:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.463+0000 7f9a4659c640 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b2da273b0 0x559b2da297e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.463+0000 7f9a2aff5640 10 client.19638 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:17.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.463+0000 7f9a4659c640 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b2da273b0 0x559b2da297e0 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eb4a1afaef5e927 server_cookie=1eb6369d9e9f04d4 in_seq=0 out_seq=0 2024-09-19T06:55:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.464+0000 7f9a2aff5640 1 -- 172.21.15.12:0/913846 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b2d975890 con 0x559b2da273b0 2024-09-19T06:55:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.464+0000 7f9a2aff5640 10 client.19638 handle_command_reply: tid=0 2024-09-19T06:55:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.464+0000 7f9a4f436740 1 client.19638 shutdown 2024-09-19T06:55:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.465+0000 7f9a4f436740 1 -- 172.21.15.12:0/913846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 msgr2=0x559b2da0b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.465+0000 7f9a4f436740 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da0b910 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c014f00 tx=0x7f9a3c014f30 comp rx=0 tx=0).stop 2024-09-19T06:55:17.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.465+0000 7f9a4f436740 1 -- 172.21.15.12:0/913846 shutdown_connections 2024-09-19T06:55:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.465+0000 7f9a4f436740 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b2da273b0 0x559b2da297e0 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.465+0000 7f9a4f436740 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da0ea30 0x559b2da0c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.466+0000 7f9a4f436740 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 0x559b2da0be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.466+0000 7f9a4f436740 1 --2- 172.21.15.12:0/913846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da0b910 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.466+0000 7f9a4f436740 1 -- 172.21.15.12:0/913846 >> 172.21.15.12:0/913846 conn(0x559b2d9ffde0 msgr2=0x559b2da05b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.466+0000 7f9a2aff5640 0 client.19638 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.466+0000 7f9a4f436740 1 -- 172.21.15.12:0/913846 shutdown_connections 2024-09-19T06:55:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.466+0000 7f9a4f436740 1 -- 172.21.15.12:0/913846 wait complete. 2024-09-19T06:55:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.466+0000 7f9a4f436740 20 client.19638 trim_cache size 0 max 16384 2024-09-19T06:55:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a4f436740 1 Processor -- start 2024-09-19T06:55:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a4f436740 1 -- start start 2024-09-19T06:55:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da2f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da04170 0x559b2da2f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da0ea30 0x559b2da08b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a4f436740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9a481b4100 con 0x559b2da03850 2024-09-19T06:55:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a4f436740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9a481b5c70 con 0x559b2da0ea30 2024-09-19T06:55:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a4f436740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9a481b47d0 con 0x559b2da04170 2024-09-19T06:55:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a46d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da2f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a46d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da2f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44636/0 (socket says 172.21.15.12:44636) 2024-09-19T06:55:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a46d9d640 1 -- 172.21.15.12:0/693190834 learned_addr learned my addr 172.21.15.12:0/693190834 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a4659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da04170 0x559b2da2f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.492+0000 7f9a4759e640 1 --2- 172.21.15.12:0/693190834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da0ea30 0x559b2da08b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.493+0000 7f9a46d9d640 1 -- 172.21.15.12:0/693190834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da04170 msgr2=0x559b2da2f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.493+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/693190834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da04170 0x559b2da2f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.493+0000 7f9a46d9d640 1 -- 172.21.15.12:0/693190834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da0ea30 msgr2=0x559b2da08b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.493+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/693190834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da0ea30 0x559b2da08b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.493+0000 7f9a46d9d640 1 -- 172.21.15.12:0/693190834 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2d9fb3f0 con 0x559b2da03850 2024-09-19T06:55:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.493+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/693190834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da2f0b0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c001f70 tx=0x7f9a3c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6491ddb5369f64b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.493+0000 7f9a2cff9640 1 -- 172.21.15.12:0/693190834 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00a020 con 0x559b2da03850 2024-09-19T06:55:17.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.493+0000 7f9a2cff9640 1 -- 172.21.15.12:0/693190834 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a3c019040 con 0x559b2da03850 2024-09-19T06:55:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.493+0000 7f9a2cff9640 1 -- 172.21.15.12:0/693190834 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c004280 con 0x559b2da03850 2024-09-19T06:55:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.494+0000 7f9a4f436740 1 -- 172.21.15.12:0/693190834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 msgr2=0x559b2da2f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.494+0000 7f9a4f436740 1 --2- 172.21.15.12:0/693190834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da2f0b0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c001f70 tx=0x7f9a3c00bce0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.494+0000 7f9a4f436740 1 -- 172.21.15.12:0/693190834 shutdown_connections 2024-09-19T06:55:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.494+0000 7f9a4f436740 1 --2- 172.21.15.12:0/693190834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da0ea30 0x559b2da08b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.494+0000 7f9a4f436740 1 --2- 172.21.15.12:0/693190834 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da04170 0x559b2da2f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.494+0000 7f9a4f436740 1 --2- 172.21.15.12:0/693190834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da03850 0x559b2da2f0b0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.494+0000 7f9a4f436740 1 -- 172.21.15.12:0/693190834 >> 172.21.15.12:0/693190834 conn(0x559b2d9ffde0 msgr2=0x559b2da05a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:17.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.494+0000 7f9a4f436740 1 -- 172.21.15.12:0/693190834 shutdown_connections 2024-09-19T06:55:17.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.495+0000 7f9a4f436740 1 -- 172.21.15.12:0/693190834 wait complete. 2024-09-19T06:55:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.495+0000 7f9a4f436740 1 -- start start 2024-09-19T06:55:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.495+0000 7f9a4f436740 1 Processor -- start 2024-09-19T06:55:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da03850 0x559b2da16ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 0x559b2da171e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4f436740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da0ea30 0x559b2da12030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4f436740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9a481b55a0 con 0x559b2da0ea30 2024-09-19T06:55:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4f436740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9a481b4ea0 con 0x559b2da04170 2024-09-19T06:55:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4f436740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9a481b2100 con 0x559b2da03850 2024-09-19T06:55:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4f436740 10 client.0 _ll_register_callbacks cb 0x7f9a38005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da0ea30 0x559b2da12030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da0ea30 0x559b2da12030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44638/0 (socket says 172.21.15.12:44638) 2024-09-19T06:55:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4759e640 1 -- 172.21.15.12:0/1956702430 learned_addr learned my addr 172.21.15.12:0/1956702430 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da03850 0x559b2da16ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4659c640 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 0x559b2da171e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4759e640 1 -- 172.21.15.12:0/1956702430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da03850 msgr2=0x559b2da16ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4759e640 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da03850 0x559b2da16ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4759e640 1 -- 172.21.15.12:0/1956702430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 msgr2=0x559b2da171e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4759e640 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 0x559b2da171e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4759e640 1 -- 172.21.15.12:0/1956702430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2da12860 con 0x559b2da0ea30 2024-09-19T06:55:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.496+0000 7f9a4659c640 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 0x559b2da171e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.497+0000 7f9a4759e640 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da0ea30 0x559b2da12030 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f9a40006010 tx=0x7f9a40009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a783450e9aa80c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.499+0000 7f9a2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.499+0000 7f9a2aff5640 1 -- 172.21.15.12:0/1956702430 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40036050 con 0x559b2da0ea30 2024-09-19T06:55:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.499+0000 7f9a2aff5640 1 -- 172.21.15.12:0/1956702430 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f9a40004250 con 0x559b2da0ea30 2024-09-19T06:55:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.499+0000 7f9a4f436740 1 -- 172.21.15.12:0/1956702430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a3c019040 con 0x559b2da0ea30 2024-09-19T06:55:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a2aff5640 1 -- 172.21.15.12:0/1956702430 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f9a40004450 con 0x559b2da0ea30 2024-09-19T06:55:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a4f436740 10 client.19644 fetch_fsmap learned FSMap version 52 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a4f436740 1 -- 172.21.15.12:0/1956702430 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x559b2da91be0 con 0x559b2da0ea30 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a2aff5640 1 -- 172.21.15.12:0/1956702430 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a40037040 con 0x559b2da0ea30 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a2aff5640 1 -- 172.21.15.12:0/1956702430 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f9a4003c040 con 0x559b2da0ea30 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a4f436740 10 client.19644 fetch_fsmap finished waiting for FSMap version 52 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a4f436740 10 client.19644 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a4f436740 20 client.19644 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a4f436740 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b2da92380 0x559b2da947a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a4f436740 4 client.19644 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}] 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.500+0000 7f9a4f436740 1 -- 172.21.15.12:0/1956702430 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}) -- 0x7f9a3c019040 con 0x559b2da92380 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.501+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b2da92380 0x559b2da947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.501+0000 7f9a2aff5640 10 client.19644 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.501+0000 7f9a46d9d640 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b2da92380 0x559b2da947a0 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f0e55250feffc0 server_cookie=7a9054c3491b57a in_seq=0 out_seq=0 2024-09-19T06:55:17.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a2aff5640 1 -- 172.21.15.12:0/1956702430 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f9a3c019040 con 0x559b2da92380 2024-09-19T06:55:17.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a2aff5640 10 client.19644 handle_command_reply: tid=0 2024-09-19T06:55:17.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 client.19644 shutdown 2024-09-19T06:55:17.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 -- 172.21.15.12:0/1956702430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da0ea30 msgr2=0x559b2da12030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:17.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da0ea30 0x559b2da12030 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f9a40006010 tx=0x7f9a40009500 comp rx=0 tx=0).stop 2024-09-19T06:55:17.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 -- 172.21.15.12:0/1956702430 shutdown_connections 2024-09-19T06:55:17.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x559b2da92380 0x559b2da947a0 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a2aff5640 0 client.19644 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:17.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b2da0ea30 0x559b2da12030 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559b2da04170 0x559b2da171e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 --2- 172.21.15.12:0/1956702430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559b2da03850 0x559b2da16ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 -- 172.21.15.12:0/1956702430 >> 172.21.15.12:0/1956702430 conn(0x559b2d9ffde0 msgr2=0x559b2da0c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:17.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 -- 172.21.15.12:0/1956702430 shutdown_connections 2024-09-19T06:55:17.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.702+0000 7f9a4f436740 1 -- 172.21.15.12:0/1956702430 wait complete. 2024-09-19T06:55:17.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4f436740 20 client.19644 trim_cache size 0 max 16384 2024-09-19T06:55:17.705 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:55:17.705 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 52, 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 50, 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "d84b81be": { 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 50, 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 149.4, 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:55:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:55:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:55:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:55:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:55:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:55:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:17.707 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 -- 172.21.15.12:0/1098825410 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9a300a3430 msgr2=0x7f9a300a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9a300a3430 0x7f9a300a58f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009370 tx=0x7f9a40030a50 comp rx=0 tx=0).stop 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 -- 172.21.15.12:0/1098825410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a48109e00 msgr2=0x7f9a481a3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a48109e00 0x7f9a481a3420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9a48073a60 tx=0x7f9a3800ec60 comp rx=0 tx=0).stop 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 -- 172.21.15.12:0/1098825410 shutdown_connections 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a4810ea80 0x7f9a481a77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9a300a3430 0x7f9a300a58f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a48109e00 0x7f9a481a3420 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 --2- 172.21.15.12:0/1098825410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a48109450 0x7f9a481a2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 -- 172.21.15.12:0/1098825410 >> 172.21.15.12:0/1098825410 conn(0x7f9a4806e2d0 msgr2=0x7f9a4810a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 -- 172.21.15.12:0/1098825410 shutdown_connections 2024-09-19T06:55:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:17.703+0000 7f9a4d05d640 1 -- 172.21.15.12:0/1098825410 wait complete. 2024-09-19T06:55:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:18 smithi173 ceph-mon[35349]: pgmap v475: 97 pgs: 97 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 32 MiB/s wr, 1.72k op/s 2024-09-19T06:55:18.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:18 smithi012 ceph-mon[30937]: pgmap v475: 97 pgs: 97 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 32 MiB/s wr, 1.72k op/s 2024-09-19T06:55:18.390 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd84b81be', quiesce took 4.5 seconds. Will release after: 24.95 2024-09-19T06:55:18.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:18 smithi016 ceph-mon[34911]: pgmap v475: 97 pgs: 97 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 32 MiB/s wr, 1.72k op/s 2024-09-19T06:55:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:20 smithi173 ceph-mon[35349]: pgmap v476: 97 pgs: 97 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 32 MiB/s wr, 1.72k op/s 2024-09-19T06:55:20.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:20 smithi012 ceph-mon[30937]: pgmap v476: 97 pgs: 97 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 32 MiB/s wr, 1.72k op/s 2024-09-19T06:55:20.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:20 smithi016 ceph-mon[34911]: pgmap v476: 97 pgs: 97 active+clean; 3.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 32 MiB/s wr, 1.72k op/s 2024-09-19T06:55:20.810 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 875.0 s, 487.9 tps, lat 68.390 ms stddev 80.356 2024-09-19T06:55:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:22 smithi173 ceph-mon[35349]: pgmap v477: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 34 MiB/s wr, 1.64k op/s 2024-09-19T06:55:22.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:22 smithi012 ceph-mon[30937]: pgmap v477: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 34 MiB/s wr, 1.64k op/s 2024-09-19T06:55:22.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:22 smithi016 ceph-mon[34911]: pgmap v477: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 34 MiB/s wr, 1.64k op/s 2024-09-19T06:55:24.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:24 smithi012 ceph-mon[30937]: pgmap v478: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 30 MiB/s wr, 1.40k op/s 2024-09-19T06:55:24.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:24 smithi016 ceph-mon[34911]: pgmap v478: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 30 MiB/s wr, 1.40k op/s 2024-09-19T06:55:24.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:24 smithi173 ceph-mon[35349]: pgmap v478: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 30 MiB/s wr, 1.40k op/s 2024-09-19T06:55:25.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:55:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:26 smithi012 ceph-mon[30937]: pgmap v479: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 30 MiB/s wr, 1.48k op/s 2024-09-19T06:55:26.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:26 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:55:26.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:26 smithi016 ceph-mon[34911]: pgmap v479: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 30 MiB/s wr, 1.48k op/s 2024-09-19T06:55:26.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:26 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:55:26.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:26 smithi173 ceph-mon[35349]: pgmap v479: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 30 MiB/s wr, 1.48k op/s 2024-09-19T06:55:26.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:26 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:55:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:28 smithi012 ceph-mon[30937]: pgmap v480: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 33 MiB/s wr, 1.91k op/s 2024-09-19T06:55:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.428+0000 7f4ca8986640 1 -- 172.21.15.12:0/3011793810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca4101350 msgr2=0x7f4ca410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.428+0000 7f4ca8986640 1 --2- 172.21.15.12:0/3011793810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca4101350 0x7f4ca410d880 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009cd0 tx=0x7f4c9c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.428+0000 7f4ca8986640 1 -- 172.21.15.12:0/3011793810 shutdown_connections 2024-09-19T06:55:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.428+0000 7f4ca8986640 1 --2- 172.21.15.12:0/3011793810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca4101350 0x7f4ca410d880 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.428+0000 7f4ca8986640 1 --2- 172.21.15.12:0/3011793810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca41009b0 0x7f4ca4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.428+0000 7f4ca8986640 1 --2- 172.21.15.12:0/3011793810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca41069c0 0x7f4ca4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.428+0000 7f4ca8986640 1 -- 172.21.15.12:0/3011793810 >> 172.21.15.12:0/3011793810 conn(0x7f4ca4077990 msgr2=0x7f4ca40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.428+0000 7f4ca8986640 1 -- 172.21.15.12:0/3011793810 shutdown_connections 2024-09-19T06:55:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.428+0000 7f4ca8986640 1 -- 172.21.15.12:0/3011793810 wait complete. 2024-09-19T06:55:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.429+0000 7f4ca8986640 1 Processor -- start 2024-09-19T06:55:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.429+0000 7f4ca8986640 1 -- start start 2024-09-19T06:55:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.429+0000 7f4ca8986640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca41009b0 0x7f4ca4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.429+0000 7f4ca8986640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca4101350 0x7f4ca41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.432 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca8986640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca41069c0 0x7f4ca419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca8986640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4110e50 con 0x7f4ca41069c0 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca8986640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4110cd0 con 0x7f4ca4101350 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca8986640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4110fd0 con 0x7f4ca41009b0 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca41069c0 0x7f4ca419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca41069c0 0x7f4ca419cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36188/0 (socket says 172.21.15.12:36188) 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca2d9d640 1 -- 172.21.15.12:0/3605294436 learned_addr learned my addr 172.21.15.12:0/3605294436 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca4101350 0x7f4ca41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca259c640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca41009b0 0x7f4ca4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca2d9d640 1 -- 172.21.15.12:0/3605294436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca41009b0 msgr2=0x7f4ca4198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca2d9d640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca41009b0 0x7f4ca4198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca2d9d640 1 -- 172.21.15.12:0/3605294436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca4101350 msgr2=0x7f4ca41988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca2d9d640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca4101350 0x7f4ca41988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.433 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca2d9d640 1 -- 172.21.15.12:0/3605294436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca419d380 con 0x7f4ca41069c0 2024-09-19T06:55:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4ca2d9d640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca41069c0 0x7f4ca419cc50 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c033040 tx=0x7f4c9c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.430+0000 7f4c937fe640 1 -- 172.21.15.12:0/3605294436 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c004040 con 0x7f4ca41069c0 2024-09-19T06:55:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.431+0000 7f4c937fe640 1 -- 172.21.15.12:0/3605294436 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c9c0046c0 con 0x7f4ca41069c0 2024-09-19T06:55:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.431+0000 7f4ca8986640 1 -- 172.21.15.12:0/3605294436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca419d610 con 0x7f4ca41069c0 2024-09-19T06:55:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.431+0000 7f4c937fe640 1 -- 172.21.15.12:0/3605294436 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c030eb0 con 0x7f4ca41069c0 2024-09-19T06:55:28.434 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.431+0000 7f4ca8986640 1 -- 172.21.15.12:0/3605294436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca41027b0 con 0x7f4ca41069c0 2024-09-19T06:55:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.433+0000 7f4c937fe640 1 -- 172.21.15.12:0/3605294436 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4c9c0041e0 con 0x7f4ca41069c0 2024-09-19T06:55:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.433+0000 7f4cab7f9740 1 Processor -- start 2024-09-19T06:55:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.433+0000 7f4cab7f9740 1 -- start start 2024-09-19T06:55:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fcaf0 0x55e0416fced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.440 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 0x55e041707770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e04170a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e0416612f0 con 0x55e041707cb0 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e041609270 con 0x55e0416fd410 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e04165d2b0 con 0x55e0416fcaf0 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e04170a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e04170a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36194/0 (socket says 172.21.15.12:36194) 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/537371897 learned_addr learned my addr 172.21.15.12:0/537371897 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4c937fe640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c8c0a3460 0x7f4c8c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/537371897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fcaf0 0x55e0416fced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca259c640 1 --2- 172.21.15.12:0/537371897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 0x55e041707770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca2d9d640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c8c0a3460 0x7f4c8c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/537371897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fcaf0 msgr2=0x55e0416fced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/537371897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fcaf0 0x55e0416fced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/537371897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 msgr2=0x55e041707770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/537371897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 0x55e041707770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/537371897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e041608340 con 0x55e041707cb0 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.434+0000 7f4c937fe640 1 -- 172.21.15.12:0/3605294436 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f4c9c02e030 con 0x7f4ca41069c0 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.435+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/537371897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e04170a0a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f4c980127c0 tx=0x7f4c9800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99e4bed089ffb47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.435+0000 7f4ca2d9d640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c8c0a3460 0x7f4c8c0a5920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0ee3b0 tx=0x7f4c9c0dd040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.435+0000 7f4c90ff9640 1 -- 172.21.15.12:0/537371897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98012e00 con 0x55e041707cb0 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.435+0000 7f4c90ff9640 1 -- 172.21.15.12:0/537371897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c98010c50 con 0x55e041707cb0 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.435+0000 7f4c90ff9640 1 -- 172.21.15.12:0/537371897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9801ebc0 con 0x55e041707cb0 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 -- 172.21.15.12:0/537371897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 msgr2=0x55e04170a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/537371897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e04170a0a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f4c980127c0 tx=0x7f4c9800b7c0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 -- 172.21.15.12:0/537371897 shutdown_connections 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/537371897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e04170a0a0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/537371897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 0x55e041707770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/537371897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fcaf0 0x55e0416fced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 -- 172.21.15.12:0/537371897 >> 172.21.15.12:0/537371897 conn(0x55e0416f9060 msgr2=0x55e0416f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 -- 172.21.15.12:0/537371897 shutdown_connections 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 -- 172.21.15.12:0/537371897 wait complete. 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 -- start start 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.436+0000 7f4cab7f9740 1 Processor -- start 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fcaf0 0x55e041704bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 0x55e041705110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e041705650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e04170a880 con 0x55e041707cb0 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e0415ea290 con 0x55e0416fd410 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e04170aa00 con 0x55e0416fcaf0 2024-09-19T06:55:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4cab7f9740 10 client.0 _ll_register_callbacks cb 0x55e04161b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e041705650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 0x55e041705110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e041705650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36200/0 (socket says 172.21.15.12:36200) 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/3898086530 learned_addr learned my addr 172.21.15.12:0/3898086530 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fcaf0 0x55e041704bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/3898086530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fcaf0 msgr2=0x55e041704bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fcaf0 0x55e041704bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/3898086530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 msgr2=0x55e041705110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 0x55e041705110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/3898086530 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e041374210 con 0x55e041707cb0 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca259c640 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 0x55e041705110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e041705650 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4c98005750 tx=0x7f4c98014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6220b59f1aa1436 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.437+0000 7f4c89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4c89ffb640 1 -- 172.21.15.12:0/3898086530 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98024040 con 0x55e041707cb0 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4c89ffb640 1 -- 172.21.15.12:0/3898086530 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f4c98010950 con 0x55e041707cb0 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4cab7f9740 1 -- 172.21.15.12:0/3898086530 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c98010c50 con 0x55e041707cb0 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4c89ffb640 1 -- 172.21.15.12:0/3898086530 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f4c9801e9a0 con 0x55e041707cb0 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4cab7f9740 10 client.19656 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4cab7f9740 1 -- 172.21.15.12:0/3898086530 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55e041440620 con 0x55e041707cb0 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4c89ffb640 1 -- 172.21.15.12:0/3898086530 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c98010c50 con 0x55e041707cb0 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4c89ffb640 1 -- 172.21.15.12:0/3898086530 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f4c9802a040 con 0x55e041707cb0 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4cab7f9740 10 client.19656 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4cab7f9740 10 client.19656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.438+0000 7f4cab7f9740 20 client.19656 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.439+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e041717be0 0x55e041719fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.439+0000 7f4cab7f9740 4 client.19656 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.439+0000 7f4cab7f9740 1 -- 172.21.15.12:0/3898086530 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e04166ea20 con 0x55e041717be0 2024-09-19T06:55:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.439+0000 7f4ca259c640 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e041717be0 0x55e041719fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.439+0000 7f4c89ffb640 10 client.19656 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.439+0000 7f4ca259c640 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e041717be0 0x55e041719fd0 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82b3825aa39a4f45 server_cookie=1057a4d892b0c27f in_seq=0 out_seq=0 2024-09-19T06:55:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4c89ffb640 1 -- 172.21.15.12:0/3898086530 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e04166ea20 con 0x55e041717be0 2024-09-19T06:55:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4c89ffb640 10 client.19656 handle_command_reply: tid=0 2024-09-19T06:55:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 client.19656 shutdown 2024-09-19T06:55:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 -- 172.21.15.12:0/3898086530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 msgr2=0x55e041705650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e041705650 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4c98005750 tx=0x7f4c98014040 comp rx=0 tx=0).stop 2024-09-19T06:55:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 -- 172.21.15.12:0/3898086530 shutdown_connections 2024-09-19T06:55:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e041717be0 0x55e041719fd0 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e041707cb0 0x55e041705650 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e0416fd410 0x55e041705110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4c89ffb640 0 client.19656 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/3898086530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fcaf0 0x55e041704bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 -- 172.21.15.12:0/3898086530 >> 172.21.15.12:0/3898086530 conn(0x55e0416f9060 msgr2=0x55e0416fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 -- 172.21.15.12:0/3898086530 shutdown_connections 2024-09-19T06:55:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 1 -- 172.21.15.12:0/3898086530 wait complete. 2024-09-19T06:55:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.440+0000 7f4cab7f9740 20 client.19656 trim_cache size 0 max 16384 2024-09-19T06:55:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4cab7f9740 1 Processor -- start 2024-09-19T06:55:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4cab7f9740 1 -- start start 2024-09-19T06:55:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e041703480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 0x55e041705480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e041707cb0 0x55e04171f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41afc10 con 0x55e0416fcaf0 2024-09-19T06:55:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41b1750 con 0x55e041707cb0 2024-09-19T06:55:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41b02e0 con 0x55e0416fd410 2024-09-19T06:55:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4ca1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e041703480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4ca1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e041703480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36216/0 (socket says 172.21.15.12:36216) 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/2433336297 learned_addr learned my addr 172.21.15.12:0/2433336297 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4ca259c640 1 --2- 172.21.15.12:0/2433336297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 0x55e041705480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/2433336297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e041707cb0 0x55e04171f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/2433336297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 msgr2=0x55e041705480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.455+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/2433336297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 0x55e041705480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.456+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/2433336297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e041707cb0 msgr2=0x55e04171f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.456+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/2433336297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e041707cb0 0x55e04171f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.456+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/2433336297 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0416f8e90 con 0x55e0416fcaf0 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.456+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/2433336297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e041703480 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800b820 tx=0x7f4c98000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d5cec2d89cfc6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.456+0000 7f4c8bfff640 1 -- 172.21.15.12:0/2433336297 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800bad0 con 0x55e0416fcaf0 2024-09-19T06:55:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.456+0000 7f4c8bfff640 1 -- 172.21.15.12:0/2433336297 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c98016040 con 0x55e0416fcaf0 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.456+0000 7f4c8bfff640 1 -- 172.21.15.12:0/2433336297 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98010bb0 con 0x55e0416fcaf0 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 -- 172.21.15.12:0/2433336297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 msgr2=0x55e041703480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/2433336297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e041703480 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800b820 tx=0x7f4c98000bc0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 -- 172.21.15.12:0/2433336297 shutdown_connections 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/2433336297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e041707cb0 0x55e04171f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/2433336297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 0x55e041705480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/2433336297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e041703480 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 -- 172.21.15.12:0/2433336297 >> 172.21.15.12:0/2433336297 conn(0x55e0416f9060 msgr2=0x55e041706c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 -- 172.21.15.12:0/2433336297 shutdown_connections 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 -- 172.21.15.12:0/2433336297 wait complete. 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 -- start start 2024-09-19T06:55:28.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 Processor -- start 2024-09-19T06:55:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e04170b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 0x55e04170b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e041707cb0 0x55e04177a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41b1080 con 0x55e0416fcaf0 2024-09-19T06:55:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41b09b0 con 0x55e041707cb0 2024-09-19T06:55:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.457+0000 7f4cab7f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca41adc10 con 0x55e0416fd410 2024-09-19T06:55:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4cab7f9740 10 client.0 _ll_register_callbacks cb 0x7f4c940093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e04170b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e04170b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36232/0 (socket says 172.21.15.12:36232) 2024-09-19T06:55:28.464 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/937887926 learned_addr learned my addr 172.21.15.12:0/937887926 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e041707cb0 0x55e04177a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca259c640 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 0x55e04170b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/937887926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 msgr2=0x55e04170b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 0x55e04170b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/937887926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e041707cb0 msgr2=0x55e04177a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e041707cb0 0x55e04177a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca1d9b640 1 -- 172.21.15.12:0/937887926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e04177ad30 con 0x55e0416fcaf0 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca259c640 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 0x55e04170b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4ca1d9b640 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e04170b400 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f4c98004ae0 tx=0x7f4c9801e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab390417abb9140 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4c89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4c89ffb640 1 -- 172.21.15.12:0/937887926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9801eb40 con 0x55e0416fcaf0 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4c89ffb640 1 -- 172.21.15.12:0/937887926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f4c98012e00 con 0x55e0416fcaf0 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.458+0000 7f4cab7f9740 1 -- 172.21.15.12:0/937887926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c98016040 con 0x55e0416fcaf0 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4c89ffb640 1 -- 172.21.15.12:0/937887926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f4c9804e050 con 0x55e0416fcaf0 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4cab7f9740 10 client.19662 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4cab7f9740 1 -- 172.21.15.12:0/937887926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55e0417820f0 con 0x55e0416fcaf0 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4c89ffb640 1 -- 172.21.15.12:0/937887926 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c98016040 con 0x55e0416fcaf0 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4c89ffb640 1 -- 172.21.15.12:0/937887926 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f4c9802a040 con 0x55e0416fcaf0 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4cab7f9740 10 client.19662 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4cab7f9740 10 client.19662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4cab7f9740 20 client.19662 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e041782680 0x55e041784aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4cab7f9740 4 client.19662 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:55:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4cab7f9740 1 -- 172.21.15.12:0/937887926 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e041668d70 con 0x55e041782680 2024-09-19T06:55:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.459+0000 7f4ca259c640 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e041782680 0x55e041784aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.460+0000 7f4ca259c640 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e041782680 0x55e041784aa0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9b4d892b91c9f2c server_cookie=8084b6ee8ffb3bd0 in_seq=0 out_seq=0 2024-09-19T06:55:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.460+0000 7f4c89ffb640 10 client.19662 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4c89ffb640 1 -- 172.21.15.12:0/937887926 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e041668d70 con 0x55e041782680 2024-09-19T06:55:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4c89ffb640 10 client.19662 handle_command_reply: tid=0 2024-09-19T06:55:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 client.19662 shutdown 2024-09-19T06:55:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 -- 172.21.15.12:0/937887926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 msgr2=0x55e04170b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e04170b400 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f4c98004ae0 tx=0x7f4c9801e3c0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 -- 172.21.15.12:0/937887926 shutdown_connections 2024-09-19T06:55:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55e041782680 0x55e041784aa0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e041707cb0 0x55e04177a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e0416fd410 0x55e04170b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 --2- 172.21.15.12:0/937887926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0416fcaf0 0x55e04170b400 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4c89ffb640 0 client.19662 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 -- 172.21.15.12:0/937887926 >> 172.21.15.12:0/937887926 conn(0x55e0416f9060 msgr2=0x55e041706430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 -- 172.21.15.12:0/937887926 shutdown_connections 2024-09-19T06:55:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 1 -- 172.21.15.12:0/937887926 wait complete. 2024-09-19T06:55:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.476+0000 7f4cab7f9740 20 client.19662 trim_cache size 0 max 16384 2024-09-19T06:55:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:55:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:55:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:55:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 -- 172.21.15.12:0/3605294436 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c8c0a3460 msgr2=0x7f4c8c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c8c0a3460 0x7f4c8c0a5920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0ee3b0 tx=0x7f4c9c0dd040 comp rx=0 tx=0).stop 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 -- 172.21.15.12:0/3605294436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca41069c0 msgr2=0x7f4ca419cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca41069c0 0x7f4ca419cc50 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c033040 tx=0x7f4c9c003970 comp rx=0 tx=0).stop 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 -- 172.21.15.12:0/3605294436 shutdown_connections 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca41069c0 0x7f4ca419cc50 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca4101350 0x7f4ca41988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4c8c0a3460 0x7f4c8c0a5920 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 --2- 172.21.15.12:0/3605294436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca41009b0 0x7f4ca4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 -- 172.21.15.12:0/3605294436 >> 172.21.15.12:0/3605294436 conn(0x7f4ca4077990 msgr2=0x7f4ca41049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 -- 172.21.15.12:0/3605294436 shutdown_connections 2024-09-19T06:55:28.482 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:28.477+0000 7f4ca8986640 1 -- 172.21.15.12:0/3605294436 wait complete. 2024-09-19T06:55:28.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:28 smithi016 ceph-mon[34911]: pgmap v480: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 33 MiB/s wr, 1.91k op/s 2024-09-19T06:55:28.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:28 smithi173 ceph-mon[35349]: pgmap v480: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 33 MiB/s wr, 1.91k op/s 2024-09-19T06:55:30.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:30 smithi012 ceph-mon[30937]: pgmap v481: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.6 MiB/s wr, 821 op/s 2024-09-19T06:55:30.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:30 smithi016 ceph-mon[34911]: pgmap v481: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.6 MiB/s wr, 821 op/s 2024-09-19T06:55:30.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:30 smithi173 ceph-mon[35349]: pgmap v481: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.6 MiB/s wr, 821 op/s 2024-09-19T06:55:30.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:55:31.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:31 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:55:31.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:31 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:55:31.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:31 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:55:31.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:31 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:55:31.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:31 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:55:31.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:31 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:55:31.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:31 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:55:31.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:31 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:55:31.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:31 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:55:31.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:31 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:55:31.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:31 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:55:31.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:31 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:55:32.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:32 smithi012 ceph-mon[30937]: pgmap v482: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 9.9 MiB/s wr, 862 op/s 2024-09-19T06:55:32.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:32 smithi016 ceph-mon[34911]: pgmap v482: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 9.9 MiB/s wr, 862 op/s 2024-09-19T06:55:32.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:32 smithi173 ceph-mon[35349]: pgmap v482: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 9.9 MiB/s wr, 862 op/s 2024-09-19T06:55:34.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:34 smithi012 ceph-mon[30937]: pgmap v483: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.4 MiB/s wr, 699 op/s 2024-09-19T06:55:34.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:34 smithi016 ceph-mon[34911]: pgmap v483: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.4 MiB/s wr, 699 op/s 2024-09-19T06:55:34.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:34 smithi173 ceph-mon[35349]: pgmap v483: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.4 MiB/s wr, 699 op/s 2024-09-19T06:55:35.812 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:55:36.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:36 smithi012 ceph-mon[30937]: pgmap v484: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.4 MiB/s wr, 699 op/s 2024-09-19T06:55:36.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:36 smithi016 ceph-mon[34911]: pgmap v484: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.4 MiB/s wr, 699 op/s 2024-09-19T06:55:36.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:36 smithi173 ceph-mon[35349]: pgmap v484: 97 pgs: 97 active+clean; 3.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.4 MiB/s wr, 699 op/s 2024-09-19T06:55:38.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:38 smithi012 ceph-mon[30937]: pgmap v485: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.7 MiB/s wr, 627 op/s 2024-09-19T06:55:38.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:38 smithi016 ceph-mon[34911]: pgmap v485: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.7 MiB/s wr, 627 op/s 2024-09-19T06:55:38.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:38 smithi173 ceph-mon[35349]: pgmap v485: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.7 MiB/s wr, 627 op/s 2024-09-19T06:55:40.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:40 smithi012 ceph-mon[30937]: pgmap v486: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 318 KiB/s wr, 47 op/s 2024-09-19T06:55:40.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:40 smithi016 ceph-mon[34911]: pgmap v486: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 318 KiB/s wr, 47 op/s 2024-09-19T06:55:40.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:40 smithi173 ceph-mon[35349]: pgmap v486: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 318 KiB/s wr, 47 op/s 2024-09-19T06:55:40.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:55:40.811 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:55:41.018 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:41.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.443+0000 7f4b67c46640 1 -- 172.21.15.12:0/3734099164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b60100e20 msgr2=0x7f4b60101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.443+0000 7f4b67c46640 1 --2- 172.21.15.12:0/3734099164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b60100e20 0x7f4b60101200 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009ca0 tx=0x7f4b5c02a950 comp rx=0 tx=0).stop 2024-09-19T06:55:41.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.443+0000 7f4b67c46640 1 -- 172.21.15.12:0/3734099164 shutdown_connections 2024-09-19T06:55:41.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.443+0000 7f4b67c46640 1 --2- 172.21.15.12:0/3734099164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60102ef0 0x7f4b6010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.443+0000 7f4b67c46640 1 --2- 172.21.15.12:0/3734099164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b60102570 0x7f4b601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.443+0000 7f4b67c46640 1 --2- 172.21.15.12:0/3734099164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b60100e20 0x7f4b60101200 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.443+0000 7f4b67c46640 1 -- 172.21.15.12:0/3734099164 >> 172.21.15.12:0/3734099164 conn(0x7f4b600fc7d0 msgr2=0x7f4b600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.443+0000 7f4b67c46640 1 -- 172.21.15.12:0/3734099164 shutdown_connections 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.443+0000 7f4b67c46640 1 -- 172.21.15.12:0/3734099164 wait complete. 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b67c46640 1 Processor -- start 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b67c46640 1 -- start start 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b67c46640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b60100e20 0x7f4b601970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b67c46640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60102570 0x7f4b60197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b67c46640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b60102ef0 0x7f4b60197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b67c46640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60110f50 con 0x7f4b60100e20 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b67c46640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60110dd0 con 0x7f4b60102570 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b67c46640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601110d0 con 0x7f4b60102ef0 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b659e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b60100e20 0x7f4b601970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b659e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b60100e20 0x7f4b601970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36902/0 (socket says 172.21.15.12:36902) 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b659e2640 1 -- 172.21.15.12:0/4056671822 learned_addr learned my addr 172.21.15.12:0/4056671822 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b651e1640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60102570 0x7f4b60197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b661e3640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b60102ef0 0x7f4b60197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b659e2640 1 -- 172.21.15.12:0/4056671822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b60102ef0 msgr2=0x7f4b60197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b659e2640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b60102ef0 0x7f4b60197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b659e2640 1 -- 172.21.15.12:0/4056671822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60102570 msgr2=0x7f4b60197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b659e2640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60102570 0x7f4b60197630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.444+0000 7f4b659e2640 1 -- 172.21.15.12:0/4056671822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b601a6960 con 0x7f4b60100e20 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.445+0000 7f4b659e2640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b60100e20 0x7f4b601970f0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c005cc0 tx=0x7f4b5c02f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.445+0000 7f4b52ffd640 1 -- 172.21.15.12:0/4056671822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c034040 con 0x7f4b60100e20 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.445+0000 7f4b67c46640 1 -- 172.21.15.12:0/4056671822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b601a6bf0 con 0x7f4b60100e20 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.445+0000 7f4b52ffd640 1 -- 172.21.15.12:0/4056671822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b5c030920 con 0x7f4b60100e20 2024-09-19T06:55:41.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.445+0000 7f4b52ffd640 1 -- 172.21.15.12:0/4056671822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c045480 con 0x7f4b60100e20 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.445+0000 7f4b67c46640 1 -- 172.21.15.12:0/4056671822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b601a7120 con 0x7f4b60100e20 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.447+0000 7f4b52ffd640 1 -- 172.21.15.12:0/4056671822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4b5c037020 con 0x7f4b60100e20 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.448+0000 7f4b52ffd640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b4c0a33b0 0x7f4b4c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.448+0000 7f4b651e1640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b4c0a33b0 0x7f4b4c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.448+0000 7f4b52ffd640 1 -- 172.21.15.12:0/4056671822 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f4b5c0f0f20 con 0x7f4b60100e20 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.448+0000 7f4b651e1640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b4c0a33b0 0x7f4b4c0a5870 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4b60199250 tx=0x7f4b5400a2d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b6a01f740 1 Processor -- start 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b6a01f740 1 -- start start 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57c4a0 0x5640cb57c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb587140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 0x5640cb589a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5640cb4e22e0 con 0x5640cb57cdc0 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5640cb489ce0 con 0x5640cb57c4a0 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5640cb4de2a0 con 0x5640cb587680 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b651e1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb587140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b651e1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb587140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36912/0 (socket says 172.21.15.12:36912) 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b651e1640 1 -- 172.21.15.12:0/1301319666 learned_addr learned my addr 172.21.15.12:0/1301319666 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.449+0000 7f4b659e2640 1 --2- 172.21.15.12:0/1301319666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57c4a0 0x5640cb57c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b661e3640 1 --2- 172.21.15.12:0/1301319666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 0x5640cb589a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b651e1640 1 -- 172.21.15.12:0/1301319666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 msgr2=0x5640cb589a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b651e1640 1 --2- 172.21.15.12:0/1301319666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 0x5640cb589a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b651e1640 1 -- 172.21.15.12:0/1301319666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57c4a0 msgr2=0x5640cb57c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b651e1640 1 --2- 172.21.15.12:0/1301319666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57c4a0 0x5640cb57c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b651e1640 1 -- 172.21.15.12:0/1301319666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640cb46e440 con 0x5640cb57cdc0 2024-09-19T06:55:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b661e3640 1 --2- 172.21.15.12:0/1301319666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 0x5640cb589a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b651e1640 1 --2- 172.21.15.12:0/1301319666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb587140 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400ff90 tx=0x7f4b54012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75df54895ad28d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b4bfff640 1 -- 172.21.15.12:0/1301319666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b54016070 con 0x5640cb57cdc0 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b4bfff640 1 -- 172.21.15.12:0/1301319666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b5401b900 con 0x5640cb57cdc0 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.450+0000 7f4b4bfff640 1 -- 172.21.15.12:0/1301319666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5401c8e0 con 0x5640cb57cdc0 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.451+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1301319666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 msgr2=0x5640cb587140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.451+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1301319666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb587140 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400ff90 tx=0x7f4b54012000 comp rx=0 tx=0).stop 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.451+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1301319666 shutdown_connections 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.451+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1301319666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 0x5640cb589a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.451+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1301319666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb587140 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.451+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1301319666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57c4a0 0x5640cb57c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.451+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1301319666 >> 172.21.15.12:0/1301319666 conn(0x5640cb578a30 msgr2=0x5640cb578e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.451+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1301319666 shutdown_connections 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.451+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1301319666 wait complete. 2024-09-19T06:55:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b6a01f740 1 -- start start 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b6a01f740 1 Processor -- start 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb586f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57cdc0 0x5640cb584240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 0x5640cb584780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5640cb58a250 con 0x5640cb57c4a0 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5640cb49d050 con 0x5640cb57cdc0 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5640cb58a3d0 con 0x5640cb587680 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b6a01f740 10 client.0 _ll_register_callbacks cb 0x5640cb4dd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b659e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb586f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b659e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb586f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36926/0 (socket says 172.21.15.12:36926) 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b659e2640 1 -- 172.21.15.12:0/2089568373 learned_addr learned my addr 172.21.15.12:0/2089568373 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b661e3640 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 0x5640cb584780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.452+0000 7f4b651e1640 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57cdc0 0x5640cb584240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b659e2640 1 -- 172.21.15.12:0/2089568373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 msgr2=0x5640cb584780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b659e2640 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 0x5640cb584780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b659e2640 1 -- 172.21.15.12:0/2089568373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57cdc0 msgr2=0x5640cb584240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b659e2640 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57cdc0 0x5640cb584240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b659e2640 1 -- 172.21.15.12:0/2089568373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640cb2533c0 con 0x5640cb57c4a0 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b651e1640 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57cdc0 0x5640cb584240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b661e3640 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 0x5640cb584780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b659e2640 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb586f90 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0b9be0 tx=0x7f4b5c0bcb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8088437f61efcf18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b497fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b497fa640 1 -- 172.21.15.12:0/2089568373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c02c040 con 0x5640cb57c4a0 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b497fa640 1 -- 172.21.15.12:0/2089568373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f4b5c0b9880 con 0x5640cb57c4a0 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b6a01f740 1 -- 172.21.15.12:0/2089568373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b5401b900 con 0x5640cb57c4a0 2024-09-19T06:55:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b497fa640 1 -- 172.21.15.12:0/2089568373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f4b5c0bd210 con 0x5640cb57c4a0 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b6a01f740 10 client.19674 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b6a01f740 1 -- 172.21.15.12:0/2089568373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5640cb595b70 con 0x5640cb57c4a0 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b497fa640 1 -- 172.21.15.12:0/2089568373 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b5401b900 con 0x5640cb57c4a0 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.453+0000 7f4b497fa640 1 -- 172.21.15.12:0/2089568373 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f4b5c04d030 con 0x5640cb57c4a0 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.454+0000 7f4b6a01f740 10 client.19674 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.454+0000 7f4b6a01f740 10 client.19674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.454+0000 7f4b6a01f740 20 client.19674 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.454+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5640cb596fd0 0x5640cb599400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.454+0000 7f4b6a01f740 4 client.19674 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.454+0000 7f4b6a01f740 1 -- 172.21.15.12:0/2089568373 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640cb4ef850 con 0x5640cb596fd0 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.454+0000 7f4b651e1640 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5640cb596fd0 0x5640cb599400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.454+0000 7f4b497fa640 10 client.19674 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.454+0000 7f4b651e1640 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5640cb596fd0 0x5640cb599400 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40415e8a06473a66 server_cookie=c3839f9bdebc0e7c in_seq=0 out_seq=0 2024-09-19T06:55:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b497fa640 1 -- 172.21.15.12:0/2089568373 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640cb4ef850 con 0x5640cb596fd0 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b497fa640 10 client.19674 handle_command_reply: tid=0 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b6a01f740 1 client.19674 shutdown 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b6a01f740 1 -- 172.21.15.12:0/2089568373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 msgr2=0x5640cb586f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb586f90 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0b9be0 tx=0x7f4b5c0bcb70 comp rx=0 tx=0).stop 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b6a01f740 1 -- 172.21.15.12:0/2089568373 shutdown_connections 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5640cb596fd0 0x5640cb599400 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb587680 0x5640cb584780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb57cdc0 0x5640cb584240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b497fa640 0 client.19674 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/2089568373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb586f90 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b6a01f740 1 -- 172.21.15.12:0/2089568373 >> 172.21.15.12:0/2089568373 conn(0x5640cb578a30 msgr2=0x5640cb57e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.455+0000 7f4b6a01f740 1 -- 172.21.15.12:0/2089568373 shutdown_connections 2024-09-19T06:55:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.456+0000 7f4b6a01f740 1 -- 172.21.15.12:0/2089568373 wait complete. 2024-09-19T06:55:41.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.456+0000 7f4b6a01f740 20 client.19674 trim_cache size 0 max 16384 2024-09-19T06:55:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.486+0000 7f4b6a01f740 1 Processor -- start 2024-09-19T06:55:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.486+0000 7f4b6a01f740 1 -- start start 2024-09-19T06:55:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb57c4a0 0x5640cb577a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb59ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 0x5640cb59f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601afc10 con 0x5640cb57cdc0 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601b1750 con 0x5640cb587680 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601b02e0 con 0x5640cb57c4a0 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b651e1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb59ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b651e1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb59ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36934/0 (socket says 172.21.15.12:36934) 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b651e1640 1 -- 172.21.15.12:0/1946365764 learned_addr learned my addr 172.21.15.12:0/1946365764 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b661e3640 1 --2- 172.21.15.12:0/1946365764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 0x5640cb59f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b659e2640 1 --2- 172.21.15.12:0/1946365764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb57c4a0 0x5640cb577a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b651e1640 1 -- 172.21.15.12:0/1946365764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb57c4a0 msgr2=0x5640cb577a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b651e1640 1 --2- 172.21.15.12:0/1946365764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb57c4a0 0x5640cb577a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b651e1640 1 -- 172.21.15.12:0/1946365764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 msgr2=0x5640cb59f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b651e1640 1 --2- 172.21.15.12:0/1946365764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 0x5640cb59f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b651e1640 1 -- 172.21.15.12:0/1946365764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640cb5796c0 con 0x5640cb57cdc0 2024-09-19T06:55:41.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.487+0000 7f4b651e1640 1 --2- 172.21.15.12:0/1946365764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb59ecb0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400fbd0 tx=0x7f4b5400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32eed2f16efb45da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.488+0000 7f4b4b7fe640 1 -- 172.21.15.12:0/1946365764 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b54016070 con 0x5640cb57cdc0 2024-09-19T06:55:41.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.488+0000 7f4b4b7fe640 1 -- 172.21.15.12:0/1946365764 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b54035030 con 0x5640cb57cdc0 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.488+0000 7f4b4b7fe640 1 -- 172.21.15.12:0/1946365764 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5402a040 con 0x5640cb57cdc0 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.488+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1946365764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 msgr2=0x5640cb59ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.488+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1946365764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb59ecb0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400fbd0 tx=0x7f4b5400fce0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.488+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1946365764 shutdown_connections 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.488+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1946365764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 0x5640cb59f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.488+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1946365764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57cdc0 0x5640cb59ecb0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.488+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1946365764 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb57c4a0 0x5640cb577a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.488+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1946365764 >> 172.21.15.12:0/1946365764 conn(0x5640cb578a30 msgr2=0x5640cb577350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.489+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1946365764 shutdown_connections 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.489+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1946365764 wait complete. 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.489+0000 7f4b6a01f740 1 -- start start 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.489+0000 7f4b6a01f740 1 Processor -- start 2024-09-19T06:55:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb58d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb57cdc0 0x5640cb58d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b6a01f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 0x5640cb58ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601b1080 con 0x5640cb57c4a0 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601b09b0 con 0x5640cb587680 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b6a01f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601adc10 con 0x5640cb57cdc0 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b659e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb58d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b6a01f740 10 client.0 _ll_register_callbacks cb 0x7f4b5c0bcfe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b659e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb58d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36948/0 (socket says 172.21.15.12:36948) 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b659e2640 1 -- 172.21.15.12:0/1895201946 learned_addr learned my addr 172.21.15.12:0/1895201946 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b661e3640 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 0x5640cb58ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b651e1640 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb57cdc0 0x5640cb58d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b659e2640 1 -- 172.21.15.12:0/1895201946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb57cdc0 msgr2=0x5640cb58d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b659e2640 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb57cdc0 0x5640cb58d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b659e2640 1 -- 172.21.15.12:0/1895201946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 msgr2=0x5640cb58ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b659e2640 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 0x5640cb58ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b659e2640 1 -- 172.21.15.12:0/1895201946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640cb600c90 con 0x5640cb57c4a0 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.490+0000 7f4b661e3640 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 0x5640cb58ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.491+0000 7f4b659e2640 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb58d330 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0bd3d0 tx=0x7f4b5c0bcca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b258fcbb17162e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.491+0000 7f4b497fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.491+0000 7f4b497fa640 1 -- 172.21.15.12:0/1895201946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0c11b0 con 0x5640cb57c4a0 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.491+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1895201946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b54035030 con 0x5640cb57c4a0 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.491+0000 7f4b497fa640 1 -- 172.21.15.12:0/1895201946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f4b5c0dd280 con 0x5640cb57c4a0 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.491+0000 7f4b497fa640 1 -- 172.21.15.12:0/1895201946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f4b5c0c15c0 con 0x5640cb57c4a0 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.491+0000 7f4b6a01f740 10 client.19680 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.491+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1895201946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5640cb601ee0 con 0x5640cb57c4a0 2024-09-19T06:55:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.491+0000 7f4b497fa640 1 -- 172.21.15.12:0/1895201946 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b54035030 con 0x5640cb57c4a0 2024-09-19T06:55:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.492+0000 7f4b497fa640 1 -- 172.21.15.12:0/1895201946 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f4b5c04d070 con 0x5640cb57c4a0 2024-09-19T06:55:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.492+0000 7f4b6a01f740 10 client.19680 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.492+0000 7f4b6a01f740 10 client.19680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.492+0000 7f4b6a01f740 20 client.19680 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.492+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5640cb6024a0 0x5640cb6048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.492+0000 7f4b6a01f740 4 client.19680 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:55:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.492+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1895201946 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5640cb584b10 con 0x5640cb6024a0 2024-09-19T06:55:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.492+0000 7f4b651e1640 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5640cb6024a0 0x5640cb6048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b651e1640 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5640cb6024a0 0x5640cb6048c0 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3adfec139a893979 server_cookie=c948eaf1ff511ee9 in_seq=0 out_seq=0 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b497fa640 10 client.19680 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b497fa640 1 -- 172.21.15.12:0/1895201946 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5640cb584b10 con 0x5640cb6024a0 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b497fa640 10 client.19680 handle_command_reply: tid=0 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b6a01f740 1 client.19680 shutdown 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1895201946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 msgr2=0x5640cb58d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb58d330 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0bd3d0 tx=0x7f4b5c0bcca0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1895201946 shutdown_connections 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5640cb6024a0 0x5640cb6048c0 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5640cb587680 0x5640cb58ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5640cb57cdc0 0x5640cb58d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b6a01f740 1 --2- 172.21.15.12:0/1895201946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5640cb57c4a0 0x5640cb58d330 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b497fa640 0 client.19680 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.493+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1895201946 >> 172.21.15.12:0/1895201946 conn(0x5640cb578a30 msgr2=0x5640cb577350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.494+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1895201946 shutdown_connections 2024-09-19T06:55:41.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.494+0000 7f4b6a01f740 1 -- 172.21.15.12:0/1895201946 wait complete. 2024-09-19T06:55:41.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.494+0000 7f4b6a01f740 20 client.19680 trim_cache size 0 max 16384 2024-09-19T06:55:41.500 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:55:41.500 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:55:41.500 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:55:41.500 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:55:41.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.494+0000 7f4b67c46640 1 -- 172.21.15.12:0/4056671822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b4c0a33b0 msgr2=0x7f4b4c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.494+0000 7f4b67c46640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b4c0a33b0 0x7f4b4c0a5870 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4b60199250 tx=0x7f4b5400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.494+0000 7f4b67c46640 1 -- 172.21.15.12:0/4056671822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b60100e20 msgr2=0x7f4b601970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.494+0000 7f4b67c46640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b60100e20 0x7f4b601970f0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c005cc0 tx=0x7f4b5c02f6c0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.494+0000 7f4b67c46640 1 -- 172.21.15.12:0/4056671822 shutdown_connections 2024-09-19T06:55:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.495+0000 7f4b67c46640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b4c0a33b0 0x7f4b4c0a5870 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.495+0000 7f4b67c46640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b60102ef0 0x7f4b60197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.495+0000 7f4b67c46640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b60102570 0x7f4b60197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.495+0000 7f4b67c46640 1 --2- 172.21.15.12:0/4056671822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b60100e20 0x7f4b601970f0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.495+0000 7f4b67c46640 1 -- 172.21.15.12:0/4056671822 >> 172.21.15.12:0/4056671822 conn(0x7f4b600fc7d0 msgr2=0x7f4b600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.495+0000 7f4b67c46640 1 -- 172.21.15.12:0/4056671822 shutdown_connections 2024-09-19T06:55:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:41.495+0000 7f4b67c46640 1 -- 172.21.15.12:0/4056671822 wait complete. 2024-09-19T06:55:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.571+0000 7f928cfdf640 1 -- 172.21.15.12:0/1433014150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9288102d00 msgr2=0x7f92881030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.571+0000 7f928cfdf640 1 --2- 172.21.15.12:0/1433014150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9288102d00 0x7f92881030e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9278009900 tx=0x7f927802a480 comp rx=0 tx=0).stop 2024-09-19T06:55:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.571+0000 7f928cfdf640 1 -- 172.21.15.12:0/1433014150 shutdown_connections 2024-09-19T06:55:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.571+0000 7f928cfdf640 1 --2- 172.21.15.12:0/1433014150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f928810c0d0 0x7f928810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.571+0000 7f928cfdf640 1 --2- 172.21.15.12:0/1433014150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9288103620 0x7f928810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.571+0000 7f928cfdf640 1 --2- 172.21.15.12:0/1433014150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9288102d00 0x7f92881030e0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.571+0000 7f928cfdf640 1 -- 172.21.15.12:0/1433014150 >> 172.21.15.12:0/1433014150 conn(0x7f9288077990 msgr2=0x7f92880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.571+0000 7f928cfdf640 1 -- 172.21.15.12:0/1433014150 shutdown_connections 2024-09-19T06:55:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.571+0000 7f928cfdf640 1 -- 172.21.15.12:0/1433014150 wait complete. 2024-09-19T06:55:41.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.572+0000 7f928cfdf640 1 Processor -- start 2024-09-19T06:55:41.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.572+0000 7f928cfdf640 1 -- start start 2024-09-19T06:55:41.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928cfdf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9288102d00 0x7f92881982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928cfdf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9288103620 0x7f9288198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.575 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928cfdf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f928810c0d0 0x7f928819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928cfdf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9288111eb0 con 0x7f9288102d00 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928cfdf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9288111d30 con 0x7f928810c0d0 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928cfdf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9288112030 con 0x7f9288103620 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9288102d00 0x7f92881982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9288102d00 0x7f92881982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36968/0 (socket says 172.21.15.12:36968) 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928659c640 1 -- 172.21.15.12:0/3589399633 learned_addr learned my addr 172.21.15.12:0/3589399633 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f9285d9b640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9288103620 0x7f9288198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f9286d9d640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f928810c0d0 0x7f928819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928659c640 1 -- 172.21.15.12:0/3589399633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9288103620 msgr2=0x7f9288198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928659c640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9288103620 0x7f9288198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928659c640 1 -- 172.21.15.12:0/3589399633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f928810c0d0 msgr2=0x7f928819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.576 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928659c640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f928810c0d0 0x7f928819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928659c640 1 -- 172.21.15.12:0/3589399633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928819d2c0 con 0x7f9288102d00 2024-09-19T06:55:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928659c640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9288102d00 0x7f92881982d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f9278005ab0 tx=0x7f9278004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f927f7fe640 1 -- 172.21.15.12:0/3589399633 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927803f030 con 0x7f9288102d00 2024-09-19T06:55:41.577 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f928cfdf640 1 -- 172.21.15.12:0/3589399633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928819d550 con 0x7f9288102d00 2024-09-19T06:55:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.573+0000 7f927f7fe640 1 -- 172.21.15.12:0/3589399633 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9278003ce0 con 0x7f9288102d00 2024-09-19T06:55:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.574+0000 7f927f7fe640 1 -- 172.21.15.12:0/3589399633 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278035070 con 0x7f9288102d00 2024-09-19T06:55:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.574+0000 7f928cfdf640 1 -- 172.21.15.12:0/3589399633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92881a4e40 con 0x7f9288102d00 2024-09-19T06:55:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.576+0000 7f927f7fe640 1 -- 172.21.15.12:0/3589399633 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9278042030 con 0x7f9288102d00 2024-09-19T06:55:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.576+0000 7f927f7fe640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92740a3460 0x7f92740a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.577+0000 7f9285d9b640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92740a3460 0x7f92740a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.577+0000 7f927f7fe640 1 -- 172.21.15.12:0/3589399633 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f92780f06d0 con 0x7f9288102d00 2024-09-19T06:55:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.577+0000 7f9285d9b640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92740a3460 0x7f92740a5920 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f92880ffe60 tx=0x7f927000a2d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.577+0000 7f928fe54740 1 Processor -- start 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.577+0000 7f928fe54740 1 -- start start 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928fe54740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e09faf0 0x563e7e09fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928fe54740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 0x563e7e0aa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928fe54740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928fe54740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563e7e0042f0 con 0x563e7e09faf0 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928fe54740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563e7dfac270 con 0x563e7e0a0410 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928fe54740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563e7e0002b0 con 0x563e7e0aacb0 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e09faf0 0x563e7e09fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e09faf0 0x563e7e09fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36972/0 (socket says 172.21.15.12:36972) 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928659c640 1 -- 172.21.15.12:0/1128534447 learned_addr learned my addr 172.21.15.12:0/1128534447 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f9285d9b640 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 0x563e7e0aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f9286d9d640 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928659c640 1 -- 172.21.15.12:0/1128534447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 msgr2=0x563e7e0ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928659c640 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928659c640 1 -- 172.21.15.12:0/1128534447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 msgr2=0x563e7e0aa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928659c640 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 0x563e7e0aa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928659c640 1 -- 172.21.15.12:0/1128534447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e7dfab340 con 0x563e7e09faf0 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f9285d9b640 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 0x563e7e0aa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f9286d9d640 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f928659c640 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e09faf0 0x563e7e09fed0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f92780bc8a0 tx=0x7f92780bc510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21cd19fdb9c8e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f927cff9640 1 -- 172.21.15.12:0/1128534447 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278049070 con 0x563e7e09faf0 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f927cff9640 1 -- 172.21.15.12:0/1128534447 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92780bc910 con 0x563e7e09faf0 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.578+0000 7f927cff9640 1 -- 172.21.15.12:0/1128534447 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927803b4f0 con 0x563e7e09faf0 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.579+0000 7f928fe54740 1 -- 172.21.15.12:0/1128534447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e09faf0 msgr2=0x563e7e09fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.588 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.579+0000 7f928fe54740 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e09faf0 0x563e7e09fed0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f92780bc8a0 tx=0x7f92780bc510 comp rx=0 tx=0).stop 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.579+0000 7f928fe54740 1 -- 172.21.15.12:0/1128534447 shutdown_connections 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.579+0000 7f928fe54740 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.579+0000 7f928fe54740 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 0x563e7e0aa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.579+0000 7f928fe54740 1 --2- 172.21.15.12:0/1128534447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e09faf0 0x563e7e09fed0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.579+0000 7f928fe54740 1 -- 172.21.15.12:0/1128534447 >> 172.21.15.12:0/1128534447 conn(0x563e7e09c060 msgr2=0x563e7e09c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.579+0000 7f928fe54740 1 -- 172.21.15.12:0/1128534447 shutdown_connections 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.579+0000 7f928fe54740 1 -- 172.21.15.12:0/1128534447 wait complete. 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f928fe54740 1 -- start start 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f928fe54740 1 Processor -- start 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f928fe54740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 0x563e7e0a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f928fe54740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f928fe54740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0a8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.589 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f928fe54740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563e7e0ad640 con 0x563e7e0a0410 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f928fe54740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x563e7df8d290 con 0x563e7e09faf0 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f928fe54740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563e7e0ad7c0 con 0x563e7e0aacb0 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f928fe54740 10 client.0 _ll_register_callbacks cb 0x563e7dfbe140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f9285d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f9285d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36988/0 (socket says 172.21.15.12:36988) 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.580+0000 7f9285d9b640 1 -- 172.21.15.12:0/4032062540 learned_addr learned my addr 172.21.15.12:0/4032062540 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f928659c640 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 0x563e7e0a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f9285d9b640 1 -- 172.21.15.12:0/4032062540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 msgr2=0x563e7e0a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f9286d9d640 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f9285d9b640 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0a8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f9285d9b640 1 -- 172.21.15.12:0/4032062540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 msgr2=0x563e7e0a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f9285d9b640 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 0x563e7e0a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.590 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f9285d9b640 1 -- 172.21.15.12:0/4032062540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e7dd17210 con 0x563e7e0a0410 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f928659c640 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 0x563e7e0a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f9286d9d640 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f9285d9b640 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a80d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9270010b40 tx=0x7f9270004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3db1867baeec10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f926dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f926dffb640 1 -- 172.21.15.12:0/4032062540 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270029060 con 0x563e7e0a0410 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f926dffb640 1 -- 172.21.15.12:0/4032062540 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f927001ca70 con 0x563e7e0a0410 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f928fe54740 1 -- 172.21.15.12:0/4032062540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92780bc910 con 0x563e7e0a0410 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f926dffb640 1 -- 172.21.15.12:0/4032062540 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f9270030050 con 0x563e7e0a0410 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f928fe54740 10 client.19692 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f928fe54740 1 -- 172.21.15.12:0/4032062540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x563e7dde3620 con 0x563e7e0a0410 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.581+0000 7f926dffb640 1 -- 172.21.15.12:0/4032062540 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92780bc910 con 0x563e7e0a0410 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.582+0000 7f926dffb640 1 -- 172.21.15.12:0/4032062540 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f9270023030 con 0x563e7e0a0410 2024-09-19T06:55:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.582+0000 7f928fe54740 10 client.19692 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.582+0000 7f928fe54740 10 client.19692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.582+0000 7f928fe54740 20 client.19692 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.582+0000 7f928fe54740 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563e7e0ba8c0 0x563e7e0bcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.582+0000 7f928fe54740 4 client.19692 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.582+0000 7f928fe54740 1 -- 172.21.15.12:0/4032062540 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e7e011a20 con 0x563e7e0ba8c0 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.582+0000 7f928659c640 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563e7e0ba8c0 0x563e7e0bcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.583+0000 7f928659c640 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563e7e0ba8c0 0x563e7e0bcd10 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=868be2fbf998e666 server_cookie=9781cdb9b7ce0cb8 in_seq=0 out_seq=0 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.583+0000 7f926dffb640 10 client.19692 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.583+0000 7f926dffb640 1 -- 172.21.15.12:0/4032062540 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e7e011a20 con 0x563e7e0ba8c0 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.583+0000 7f926dffb640 10 client.19692 handle_command_reply: tid=0 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.583+0000 7f928fe54740 1 client.19692 shutdown 2024-09-19T06:55:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.583+0000 7f928fe54740 1 -- 172.21.15.12:0/4032062540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 msgr2=0x563e7e0a80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.583+0000 7f928fe54740 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a80d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9270010b40 tx=0x7f9270004730 comp rx=0 tx=0).stop 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.583+0000 7f928fe54740 1 -- 172.21.15.12:0/4032062540 shutdown_connections 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.583+0000 7f928fe54740 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563e7e0ba8c0 0x563e7e0bcd10 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.583+0000 7f928fe54740 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.584+0000 7f928fe54740 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a80d0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.584+0000 7f928fe54740 1 --2- 172.21.15.12:0/4032062540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 0x563e7e0a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.584+0000 7f926dffb640 0 client.19692 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.584+0000 7f928fe54740 1 -- 172.21.15.12:0/4032062540 >> 172.21.15.12:0/4032062540 conn(0x563e7e09c060 msgr2=0x563e7e0a1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.584+0000 7f928fe54740 1 -- 172.21.15.12:0/4032062540 shutdown_connections 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.584+0000 7f928fe54740 1 -- 172.21.15.12:0/4032062540 wait complete. 2024-09-19T06:55:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.584+0000 7f928fe54740 20 client.19692 trim_cache size 0 max 16384 2024-09-19T06:55:41.603 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.598+0000 7f928fe54740 1 Processor -- start 2024-09-19T06:55:41.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.598+0000 7f928fe54740 1 -- start start 2024-09-19T06:55:41.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.598+0000 7f928fe54740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 0x563e7e0a8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.598+0000 7f928fe54740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f928fe54740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0c2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f928fe54740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f92881ada70 con 0x563e7e0a0410 2024-09-19T06:55:41.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f928fe54740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f92881af5b0 con 0x563e7e09faf0 2024-09-19T06:55:41.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f928fe54740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f92881ae140 con 0x563e7e0aacb0 2024-09-19T06:55:41.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9285d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9285d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36998/0 (socket says 172.21.15.12:36998) 2024-09-19T06:55:41.604 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9285d9b640 1 -- 172.21.15.12:0/147638516 learned_addr learned my addr 172.21.15.12:0/147638516 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f928659c640 1 --2- 172.21.15.12:0/147638516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 0x563e7e0a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9286d9d640 1 --2- 172.21.15.12:0/147638516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9285d9b640 1 -- 172.21.15.12:0/147638516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 msgr2=0x563e7e0c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9285d9b640 1 --2- 172.21.15.12:0/147638516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0c2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9285d9b640 1 -- 172.21.15.12:0/147638516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 msgr2=0x563e7e0a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9285d9b640 1 --2- 172.21.15.12:0/147638516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 0x563e7e0a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9285d9b640 1 -- 172.21.15.12:0/147638516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e7e0a6b20 con 0x563e7e0a0410 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9286d9d640 1 --2- 172.21.15.12:0/147638516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f9285d9b640 1 --2- 172.21.15.12:0/147638516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a9b00 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f9270010b10 tx=0x7f927000a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a58ba4884f94f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f926ffff640 1 -- 172.21.15.12:0/147638516 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270038020 con 0x563e7e0a0410 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f926ffff640 1 -- 172.21.15.12:0/147638516 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f927001cd50 con 0x563e7e0a0410 2024-09-19T06:55:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.599+0000 7f926ffff640 1 -- 172.21.15.12:0/147638516 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270016070 con 0x563e7e0a0410 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.600+0000 7f928fe54740 1 -- 172.21.15.12:0/147638516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 msgr2=0x563e7e0a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.600+0000 7f928fe54740 1 --2- 172.21.15.12:0/147638516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a9b00 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f9270010b10 tx=0x7f927000a9a0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.600+0000 7f928fe54740 1 -- 172.21.15.12:0/147638516 shutdown_connections 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.600+0000 7f928fe54740 1 --2- 172.21.15.12:0/147638516 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e0aacb0 0x563e7e0c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.600+0000 7f928fe54740 1 --2- 172.21.15.12:0/147638516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0a0410 0x563e7e0a9b00 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.600+0000 7f928fe54740 1 --2- 172.21.15.12:0/147638516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e09faf0 0x563e7e0a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.600+0000 7f928fe54740 1 -- 172.21.15.12:0/147638516 >> 172.21.15.12:0/147638516 conn(0x563e7e09c060 msgr2=0x563e7e0a93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.600+0000 7f928fe54740 1 -- 172.21.15.12:0/147638516 shutdown_connections 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.600+0000 7f928fe54740 1 -- 172.21.15.12:0/147638516 wait complete. 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.600+0000 7f928fe54740 1 -- start start 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f928fe54740 1 Processor -- start 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f928fe54740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e09faf0 0x563e7e0b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f928fe54740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 0x563e7e0ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f928fe54740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0aacb0 0x563e7e0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f928fe54740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f92881aeee0 con 0x563e7e0aacb0 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f928fe54740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f92881ae810 con 0x563e7e0a0410 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f928fe54740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f92881aba70 con 0x563e7e09faf0 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f928fe54740 10 client.0 _ll_register_callbacks cb 0x7f927000a870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f9286d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0aacb0 0x563e7e0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f9286d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0aacb0 0x563e7e0aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37008/0 (socket says 172.21.15.12:37008) 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f9286d9d640 1 -- 172.21.15.12:0/1969123620 learned_addr learned my addr 172.21.15.12:0/1969123620 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f928659c640 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e09faf0 0x563e7e0b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f9285d9b640 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 0x563e7e0ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f9286d9d640 1 -- 172.21.15.12:0/1969123620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e09faf0 msgr2=0x563e7e0b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.607 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f9286d9d640 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e09faf0 0x563e7e0b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f9286d9d640 1 -- 172.21.15.12:0/1969123620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 msgr2=0x563e7e0ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f9286d9d640 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 0x563e7e0ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.601+0000 7f9286d9d640 1 -- 172.21.15.12:0/1969123620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e7e0a0240 con 0x563e7e0aacb0 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f9286d9d640 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0aacb0 0x563e7e0aedf0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9280011ab0 tx=0x7f9280011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249e7a792e7bfad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f926dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f926dffb640 1 -- 172.21.15.12:0/1969123620 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928001e060 con 0x563e7e0aacb0 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f926dffb640 1 -- 172.21.15.12:0/1969123620 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f9280003970 con 0x563e7e0aacb0 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f928fe54740 1 -- 172.21.15.12:0/1969123620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f927001cd50 con 0x563e7e0aacb0 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f926dffb640 1 -- 172.21.15.12:0/1969123620 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f9280025050 con 0x563e7e0aacb0 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f928fe54740 10 client.19698 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f928fe54740 1 -- 172.21.15.12:0/1969123620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x563e7e1255e0 con 0x563e7e0aacb0 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f926dffb640 1 -- 172.21.15.12:0/1969123620 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f927001cd50 con 0x563e7e0aacb0 2024-09-19T06:55:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f926dffb640 1 -- 172.21.15.12:0/1969123620 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f928000d3a0 con 0x563e7e0aacb0 2024-09-19T06:55:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f928fe54740 10 client.19698 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f928fe54740 10 client.19698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f928fe54740 20 client.19698 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f928fe54740 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563e7e125d00 0x563e7e1280f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f928fe54740 4 client.19698 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:55:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.602+0000 7f928fe54740 1 -- 172.21.15.12:0/1969123620 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563e7e00bd70 con 0x563e7e125d00 2024-09-19T06:55:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.603+0000 7f928659c640 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563e7e125d00 0x563e7e1280f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.603+0000 7f928659c640 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563e7e125d00 0x563e7e1280f0 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce356d1af249bed0 server_cookie=f833fa1458029828 in_seq=0 out_seq=0 2024-09-19T06:55:41.610 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.603+0000 7f926dffb640 10 client.19698 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f926dffb640 1 -- 172.21.15.12:0/1969123620 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563e7e00bd70 con 0x563e7e125d00 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f926dffb640 10 client.19698 handle_command_reply: tid=0 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 client.19698 shutdown 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 -- 172.21.15.12:0/1969123620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0aacb0 msgr2=0x563e7e0aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0aacb0 0x563e7e0aedf0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9280011ab0 tx=0x7f9280011f70 comp rx=0 tx=0).stop 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 -- 172.21.15.12:0/1969123620 shutdown_connections 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x563e7e125d00 0x563e7e1280f0 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563e7e0aacb0 0x563e7e0aedf0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x563e7e0a0410 0x563e7e0ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f926dffb640 0 client.19698 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 --2- 172.21.15.12:0/1969123620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563e7e09faf0 0x563e7e0b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 -- 172.21.15.12:0/1969123620 >> 172.21.15.12:0/1969123620 conn(0x563e7e09c060 msgr2=0x563e7e09b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 -- 172.21.15.12:0/1969123620 shutdown_connections 2024-09-19T06:55:41.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 1 -- 172.21.15.12:0/1969123620 wait complete. 2024-09-19T06:55:41.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.618+0000 7f928fe54740 20 client.19698 trim_cache size 0 max 16384 2024-09-19T06:55:41.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:55:41.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:55:41.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:55:41.621 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:55:41.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 -- 172.21.15.12:0/3589399633 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92740a3460 msgr2=0x7f92740a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92740a3460 0x7f92740a5920 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f92880ffe60 tx=0x7f927000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 -- 172.21.15.12:0/3589399633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9288102d00 msgr2=0x7f92881982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:41.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9288102d00 0x7f92881982d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f9278005ab0 tx=0x7f9278004360 comp rx=0 tx=0).stop 2024-09-19T06:55:41.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 -- 172.21.15.12:0/3589399633 shutdown_connections 2024-09-19T06:55:41.622 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f928810c0d0 0x7f928819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f92740a3460 0x7f92740a5920 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9288103620 0x7f9288198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 --2- 172.21.15.12:0/3589399633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9288102d00 0x7f92881982d0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:41.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 -- 172.21.15.12:0/3589399633 >> 172.21.15.12:0/3589399633 conn(0x7f9288077990 msgr2=0x7f92880fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:41.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 -- 172.21.15.12:0/3589399633 shutdown_connections 2024-09-19T06:55:41.623 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:41.619+0000 7f928cfdf640 1 -- 172.21.15.12:0/3589399633 wait complete. 2024-09-19T06:55:42.244 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:55:42.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:55:42.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:42 smithi012 ceph-mon[30937]: pgmap v487: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 321 KiB/s wr, 52 op/s 2024-09-19T06:55:42.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:42 smithi016 ceph-mon[34911]: pgmap v487: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 321 KiB/s wr, 52 op/s 2024-09-19T06:55:42.510 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:42.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:42 smithi173 ceph-mon[35349]: pgmap v487: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 321 KiB/s wr, 52 op/s 2024-09-19T06:55:42.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.946+0000 7f74d37f4640 1 -- 172.21.15.12:0/3008345054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74cc106f10 msgr2=0x7f74cc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.946+0000 7f74d37f4640 1 --2- 172.21.15.12:0/3008345054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74cc106f10 0x7f74cc10ea90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009900 tx=0x7f74c402a410 comp rx=0 tx=0).stop 2024-09-19T06:55:42.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.946+0000 7f74d37f4640 1 -- 172.21.15.12:0/3008345054 shutdown_connections 2024-09-19T06:55:42.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.946+0000 7f74d37f4640 1 --2- 172.21.15.12:0/3008345054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74cc106f10 0x7f74cc10ea90 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.946+0000 7f74d37f4640 1 --2- 172.21.15.12:0/3008345054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74cc102790 0x7f74cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.946+0000 7f74d37f4640 1 --2- 172.21.15.12:0/3008345054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc101de0 0x7f74cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.946+0000 7f74d37f4640 1 -- 172.21.15.12:0/3008345054 >> 172.21.15.12:0/3008345054 conn(0x7f74cc0fd8c0 msgr2=0x7f74cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:42.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.947+0000 7f74d37f4640 1 -- 172.21.15.12:0/3008345054 shutdown_connections 2024-09-19T06:55:42.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.947+0000 7f74d37f4640 1 -- 172.21.15.12:0/3008345054 wait complete. 2024-09-19T06:55:42.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.947+0000 7f74d37f4640 1 Processor -- start 2024-09-19T06:55:42.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.947+0000 7f74d37f4640 1 -- start start 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.947+0000 7f74d37f4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74cc101de0 0x7f74cc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.947+0000 7f74d37f4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc102790 0x7f74cc198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.947+0000 7f74d37f4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74cc106f10 0x7f74cc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.947+0000 7f74d37f4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc111f90 con 0x7f74cc101de0 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.947+0000 7f74d37f4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc111e10 con 0x7f74cc106f10 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.947+0000 7f74d37f4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f74cc112110 con 0x7f74cc102790 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d1590640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74cc101de0 0x7f74cc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d1590640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74cc101de0 0x7f74cc198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37020/0 (socket says 172.21.15.12:37020) 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d1590640 1 -- 172.21.15.12:0/1624919399 learned_addr learned my addr 172.21.15.12:0/1624919399 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d0d8f640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc102790 0x7f74cc198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d1d91640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74cc106f10 0x7f74cc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d1590640 1 -- 172.21.15.12:0/1624919399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc102790 msgr2=0x7f74cc198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d1590640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc102790 0x7f74cc198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d1590640 1 -- 172.21.15.12:0/1624919399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74cc106f10 msgr2=0x7f74cc19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d1590640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74cc106f10 0x7f74cc19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d1590640 1 -- 172.21.15.12:0/1624919399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74cc19d3c0 con 0x7f74cc101de0 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d0d8f640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc102790 0x7f74cc198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d1590640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74cc101de0 0x7f74cc198410 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00ba50 tx=0x7f74bc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74ca7fc640 1 -- 172.21.15.12:0/1624919399 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc019070 con 0x7f74cc101de0 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74ca7fc640 1 -- 172.21.15.12:0/1624919399 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74bc00cbe0 con 0x7f74cc101de0 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d37f4640 1 -- 172.21.15.12:0/1624919399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74cc19d6b0 con 0x7f74cc101de0 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74ca7fc640 1 -- 172.21.15.12:0/1624919399 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc0076e0 con 0x7f74cc101de0 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.948+0000 7f74d37f4640 1 -- 172.21.15.12:0/1624919399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74cc1a4f90 con 0x7f74cc101de0 2024-09-19T06:55:42.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.949+0000 7f74d37f4640 1 -- 172.21.15.12:0/1624919399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74cc1021c0 con 0x7f74cc101de0 2024-09-19T06:55:42.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.951+0000 7f74ca7fc640 1 -- 172.21.15.12:0/1624919399 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f74bc01c070 con 0x7f74cc101de0 2024-09-19T06:55:42.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.952+0000 7f74ca7fc640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f74b40a3430 0x7f74b40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:42.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.952+0000 7f74d0d8f640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f74b40a3430 0x7f74b40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:42.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.952+0000 7f74ca7fc640 1 -- 172.21.15.12:0/1624919399 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f74bc0cf270 con 0x7f74cc101de0 2024-09-19T06:55:42.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.952+0000 7f74d0d8f640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f74b40a3430 0x7f74b40a58f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0ff790 tx=0x7f74c000a5c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:42.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:42.956+0000 7f74ca7fc640 1 -- 172.21.15.12:0/1624919399 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f74bc09bcc0 con 0x7f74cc101de0 2024-09-19T06:55:43.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.170+0000 7f74d37f4640 1 -- 172.21.15.12:0/1624919399 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74cc1a51c0 con 0x7f74cc101de0 2024-09-19T06:55:43.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.171+0000 7f74ca7fc640 1 -- 172.21.15.12:0/1624919399 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11971 (secure 0 0 0) 0x7f74bc09b5c0 con 0x7f74cc101de0 2024-09-19T06:55:43.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:55:43.173 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":53,"btime":"2024-09-19T06:55:25:083918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:55:24.579713+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:55:43.173 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 53 2024-09-19T06:55:43.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 -- 172.21.15.12:0/1624919399 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f74b40a3430 msgr2=0x7f74b40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f74b40a3430 0x7f74b40a58f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0ff790 tx=0x7f74c000a5c0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 -- 172.21.15.12:0/1624919399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74cc101de0 msgr2=0x7f74cc198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74cc101de0 0x7f74cc198410 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00ba50 tx=0x7f74bc00bf10 comp rx=0 tx=0).stop 2024-09-19T06:55:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 -- 172.21.15.12:0/1624919399 shutdown_connections 2024-09-19T06:55:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74cc106f10 0x7f74cc19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f74b40a3430 0x7f74b40a58f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74cc102790 0x7f74cc198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 --2- 172.21.15.12:0/1624919399 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74cc101de0 0x7f74cc198410 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 -- 172.21.15.12:0/1624919399 >> 172.21.15.12:0/1624919399 conn(0x7f74cc0fd8c0 msgr2=0x7f74cc0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 -- 172.21.15.12:0/1624919399 shutdown_connections 2024-09-19T06:55:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:43.173+0000 7f74d37f4640 1 -- 172.21.15.12:0/1624919399 wait complete. 2024-09-19T06:55:43.341 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:55:43.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:55:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:44.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:44 smithi012 ceph-mon[30937]: pgmap v488: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-19T06:55:44.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:44 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1624919399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.327+0000 7f878cad6640 1 -- 172.21.15.12:0/3325915359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8788101420 msgr2=0x7f878810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.327+0000 7f878cad6640 1 --2- 172.21.15.12:0/3325915359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8788101420 0x7f878810d950 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f8780009cd0 tx=0x7f878002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.327+0000 7f878cad6640 1 -- 172.21.15.12:0/3325915359 shutdown_connections 2024-09-19T06:55:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.327+0000 7f878cad6640 1 --2- 172.21.15.12:0/3325915359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8788101420 0x7f878810d950 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.327+0000 7f878cad6640 1 --2- 172.21.15.12:0/3325915359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8788100a80 0x7f8788100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.327+0000 7f878cad6640 1 --2- 172.21.15.12:0/3325915359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8788106a80 0x7f8788106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.327+0000 7f878cad6640 1 -- 172.21.15.12:0/3325915359 >> 172.21.15.12:0/3325915359 conn(0x7f87880fc7a0 msgr2=0x7f87880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.327+0000 7f878cad6640 1 -- 172.21.15.12:0/3325915359 shutdown_connections 2024-09-19T06:55:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.327+0000 7f878cad6640 1 -- 172.21.15.12:0/3325915359 wait complete. 2024-09-19T06:55:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.328+0000 7f878cad6640 1 Processor -- start 2024-09-19T06:55:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.328+0000 7f878cad6640 1 -- start start 2024-09-19T06:55:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.328+0000 7f878cad6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8788100a80 0x7f87881973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.328+0000 7f878cad6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8788101420 0x7f87881978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.328+0000 7f878cad6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8788106a80 0x7f878819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.328+0000 7f878cad6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8788110ec0 con 0x7f8788106a80 2024-09-19T06:55:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.328+0000 7f878cad6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8788110d40 con 0x7f8788101420 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.328+0000 7f878cad6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8788111040 con 0x7f8788100a80 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.328+0000 7f8786d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8788106a80 0x7f878819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.328+0000 7f8786d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8788106a80 0x7f878819bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37030/0 (socket says 172.21.15.12:37030) 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f8786d9d640 1 -- 172.21.15.12:0/4073717801 learned_addr learned my addr 172.21.15.12:0/4073717801 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f8785d9b640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8788101420 0x7f87881978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f878659c640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8788100a80 0x7f87881973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f8786d9d640 1 -- 172.21.15.12:0/4073717801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8788100a80 msgr2=0x7f87881973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f8786d9d640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8788100a80 0x7f87881973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f8786d9d640 1 -- 172.21.15.12:0/4073717801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8788101420 msgr2=0x7f87881978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f8786d9d640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8788101420 0x7f87881978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f8786d9d640 1 -- 172.21.15.12:0/4073717801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878819c350 con 0x7f8788106a80 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f8786d9d640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8788106a80 0x7f878819bc70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f8780006010 tx=0x7f8780003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f87777fe640 1 -- 172.21.15.12:0/4073717801 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8780004450 con 0x7f8788106a80 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f878cad6640 1 -- 172.21.15.12:0/4073717801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f878819c5e0 con 0x7f8788106a80 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f87777fe640 1 -- 172.21.15.12:0/4073717801 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8780003e10 con 0x7f8788106a80 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f87777fe640 1 -- 172.21.15.12:0/4073717801 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8780046480 con 0x7f8788106a80 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.329+0000 7f878cad6640 1 -- 172.21.15.12:0/4073717801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87881a3f20 con 0x7f8788106a80 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.330+0000 7f878cad6640 1 -- 172.21.15.12:0/4073717801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8788100ee0 con 0x7f8788106a80 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.331+0000 7f87777fe640 1 -- 172.21.15.12:0/4073717801 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f87800045f0 con 0x7f8788106a80 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.332+0000 7f87777fe640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87700a33b0 0x7f87700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.332+0000 7f878659c640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87700a33b0 0x7f87700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.332+0000 7f87777fe640 1 -- 172.21.15.12:0/4073717801 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f878002e030 con 0x7f8788106a80 2024-09-19T06:55:44.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.333+0000 7f878659c640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87700a33b0 0x7f87700a5870 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f87780058c0 tx=0x7f877800a250 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:44.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.336+0000 7f87777fe640 1 -- 172.21.15.12:0/4073717801 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f878004b060 con 0x7f8788106a80 2024-09-19T06:55:44.392 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:44.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:44 smithi016 ceph-mon[34911]: pgmap v488: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-19T06:55:44.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:44 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1624919399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.559+0000 7f878cad6640 1 -- 172.21.15.12:0/4073717801 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8788109010 con 0x7f8788106a80 2024-09-19T06:55:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.559+0000 7f87777fe640 1 -- 172.21.15.12:0/4073717801 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11971 (secure 0 0 0) 0x7f87800bdfc0 con 0x7f8788106a80 2024-09-19T06:55:44.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:55:44.561 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":53,"btime":"2024-09-19T06:55:25:083918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:55:24.579713+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:55:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 53 2024-09-19T06:55:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.562+0000 7f878cad6640 1 -- 172.21.15.12:0/4073717801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87700a33b0 msgr2=0x7f87700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.562+0000 7f878cad6640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87700a33b0 0x7f87700a5870 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f87780058c0 tx=0x7f877800a250 comp rx=0 tx=0).stop 2024-09-19T06:55:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.562+0000 7f878cad6640 1 -- 172.21.15.12:0/4073717801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8788106a80 msgr2=0x7f878819bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.562+0000 7f878cad6640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8788106a80 0x7f878819bc70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f8780006010 tx=0x7f8780003c20 comp rx=0 tx=0).stop 2024-09-19T06:55:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.562+0000 7f878cad6640 1 -- 172.21.15.12:0/4073717801 shutdown_connections 2024-09-19T06:55:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.562+0000 7f878cad6640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8788106a80 0x7f878819bc70 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.562+0000 7f878cad6640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8788101420 0x7f87881978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.562+0000 7f878cad6640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f87700a33b0 0x7f87700a5870 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.562+0000 7f878cad6640 1 --2- 172.21.15.12:0/4073717801 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8788100a80 0x7f87881973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.562+0000 7f878cad6640 1 -- 172.21.15.12:0/4073717801 >> 172.21.15.12:0/4073717801 conn(0x7f87880fc7a0 msgr2=0x7f87880fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.563+0000 7f878cad6640 1 -- 172.21.15.12:0/4073717801 shutdown_connections 2024-09-19T06:55:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:44.563+0000 7f878cad6640 1 -- 172.21.15.12:0/4073717801 wait complete. 2024-09-19T06:55:44.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:44 smithi173 ceph-mon[35349]: pgmap v488: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-19T06:55:44.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:44 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1624919399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:45.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:45 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/4073717801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:45.442 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id d84b81be --release --await' 2024-09-19T06:55:45.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id d84b81be --release --await 2024-09-19T06:55:45.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:45 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/4073717801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:45.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:45 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/4073717801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.673+0000 7eff55a30640 1 -- 172.21.15.12:0/3685410405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff50101ba0 msgr2=0x7eff5010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.673+0000 7eff55a30640 1 --2- 172.21.15.12:0/3685410405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff50101ba0 0x7eff5010d970 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7eff48009ca0 tx=0x7eff4802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.674+0000 7eff55a30640 1 -- 172.21.15.12:0/3685410405 shutdown_connections 2024-09-19T06:55:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.674+0000 7eff55a30640 1 --2- 172.21.15.12:0/3685410405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff50101ba0 0x7eff5010d970 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.674+0000 7eff55a30640 1 --2- 172.21.15.12:0/3685410405 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff50101200 0x7eff50101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.674+0000 7eff55a30640 1 --2- 172.21.15.12:0/3685410405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff50105ad0 0x7eff50105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.674+0000 7eff55a30640 1 -- 172.21.15.12:0/3685410405 >> 172.21.15.12:0/3685410405 conn(0x7eff50077210 msgr2=0x7eff500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.674+0000 7eff55a30640 1 -- 172.21.15.12:0/3685410405 shutdown_connections 2024-09-19T06:55:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.674+0000 7eff55a30640 1 -- 172.21.15.12:0/3685410405 wait complete. 2024-09-19T06:55:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.674+0000 7eff55a30640 1 Processor -- start 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff55a30640 1 -- start start 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff55a30640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff50101200 0x7eff500fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff55a30640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff50101ba0 0x7eff500fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff55a30640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff50105ad0 0x7eff500fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff55a30640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff50110ef0 con 0x7eff50101ba0 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff55a30640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff50110d70 con 0x7eff50101200 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff55a30640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7eff50111070 con 0x7eff50105ad0 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff47fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff50101ba0 0x7eff500fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff47fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff50101ba0 0x7eff500fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37046/0 (socket says 172.21.15.12:37046) 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff47fff640 1 -- 172.21.15.12:0/2484365989 learned_addr learned my addr 172.21.15.12:0/2484365989 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff4effd640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff50101200 0x7eff500fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff4f7fe640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff50105ad0 0x7eff500fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff47fff640 1 -- 172.21.15.12:0/2484365989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff50105ad0 msgr2=0x7eff500fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff47fff640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff50105ad0 0x7eff500fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff47fff640 1 -- 172.21.15.12:0/2484365989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff50101200 msgr2=0x7eff500fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff47fff640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff50101200 0x7eff500fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff47fff640 1 -- 172.21.15.12:0/2484365989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff501a6890 con 0x7eff50101ba0 2024-09-19T06:55:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff4effd640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff50101200 0x7eff500fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.675+0000 7eff47fff640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff50101ba0 0x7eff500fcbd0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7eff3800d950 tx=0x7eff3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.676+0000 7eff54a2e640 1 -- 172.21.15.12:0/2484365989 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38017030 con 0x7eff50101ba0 2024-09-19T06:55:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.676+0000 7eff55a30640 1 -- 172.21.15.12:0/2484365989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff501a6b80 con 0x7eff50101ba0 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.676+0000 7eff54a2e640 1 -- 172.21.15.12:0/2484365989 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff38004020 con 0x7eff50101ba0 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.676+0000 7eff54a2e640 1 -- 172.21.15.12:0/2484365989 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff380047a0 con 0x7eff50101ba0 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.676+0000 7eff55a30640 1 -- 172.21.15.12:0/2484365989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff501a7110 con 0x7eff50101ba0 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.678+0000 7eff54a2e640 1 -- 172.21.15.12:0/2484365989 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7eff380041d0 con 0x7eff50101ba0 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff57e09740 1 Processor -- start 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff57e09740 1 -- start start 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff57e09740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff57e09740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1a5d0 0x56147ce1aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff57e09740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff57e09740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56147cd802f0 con 0x56147ce25370 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff57e09740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56147cd27cf0 con 0x56147ce1a5d0 2024-09-19T06:55:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff57e09740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56147cd7c2b0 con 0x56147ce1bb40 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff54a2e640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff3c0a33b0 0x7eff3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff47fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff47fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce27760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37062/0 (socket says 172.21.15.12:37062) 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff47fff640 1 -- 172.21.15.12:0/3960674635 learned_addr learned my addr 172.21.15.12:0/3960674635 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff4f7fe640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff3c0a33b0 0x7eff3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff4effd640 1 --2- 172.21.15.12:0/3960674635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1a5d0 0x56147ce1aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff4f7fe640 1 --2- 172.21.15.12:0/3960674635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.679+0000 7eff54a2e640 1 -- 172.21.15.12:0/2484365989 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7eff380cf8b0 con 0x7eff50101ba0 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.680+0000 7eff47fff640 1 -- 172.21.15.12:0/3960674635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 msgr2=0x56147ce1a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.680+0000 7eff47fff640 1 --2- 172.21.15.12:0/3960674635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce1a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.680+0000 7eff47fff640 1 -- 172.21.15.12:0/3960674635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1a5d0 msgr2=0x56147ce1aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.680+0000 7eff47fff640 1 --2- 172.21.15.12:0/3960674635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1a5d0 0x56147ce1aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.680+0000 7eff47fff640 1 -- 172.21.15.12:0/3960674635 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56147cd0c3a0 con 0x56147ce25370 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.680+0000 7eff47fff640 1 --2- 172.21.15.12:0/3960674635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce27760 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7eff38098460 tx=0x7eff3809b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5a99d7cced659f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.680+0000 7eff45ffb640 1 -- 172.21.15.12:0/3960674635 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3809c190 con 0x56147ce25370 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.680+0000 7eff4f7fe640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff3c0a33b0 0x7eff3c0a5870 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7eff48005cc0 tx=0x7eff4802f490 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.680+0000 7eff45ffb640 1 -- 172.21.15.12:0/3960674635 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff3809ba90 con 0x56147ce25370 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.680+0000 7eff45ffb640 1 -- 172.21.15.12:0/3960674635 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38098290 con 0x56147ce25370 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 -- 172.21.15.12:0/3960674635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 msgr2=0x56147ce27760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 --2- 172.21.15.12:0/3960674635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce27760 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7eff38098460 tx=0x7eff3809b990 comp rx=0 tx=0).stop 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 -- 172.21.15.12:0/3960674635 shutdown_connections 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 --2- 172.21.15.12:0/3960674635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce27760 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 --2- 172.21.15.12:0/3960674635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1a5d0 0x56147ce1aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 --2- 172.21.15.12:0/3960674635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 -- 172.21.15.12:0/3960674635 >> 172.21.15.12:0/3960674635 conn(0x56147cde3310 msgr2=0x56147ce16c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 -- 172.21.15.12:0/3960674635 shutdown_connections 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 -- 172.21.15.12:0/3960674635 wait complete. 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 -- start start 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.681+0000 7eff57e09740 1 Processor -- start 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff57e09740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce24dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff57e09740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce22080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff57e09740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce25370 0x56147ce22810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff57e09740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56147ce28010 con 0x56147ce1a5d0 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff57e09740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x56147cd3b060 con 0x56147ce25370 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff57e09740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56147ce28190 con 0x56147ce1bb40 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff57e09740 10 client.0 _ll_register_callbacks cb 0x56147ca8e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff4effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce24dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff4effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce24dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37068/0 (socket says 172.21.15.12:37068) 2024-09-19T06:55:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff4effd640 1 -- 172.21.15.12:0/3005689790 learned_addr learned my addr 172.21.15.12:0/3005689790 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff4f7fe640 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce25370 0x56147ce22810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff4effd640 1 -- 172.21.15.12:0/3005689790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 msgr2=0x56147ce22080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff4effd640 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce22080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff4effd640 1 -- 172.21.15.12:0/3005689790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce25370 msgr2=0x56147ce22810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff4effd640 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce25370 0x56147ce22810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff4effd640 1 -- 172.21.15.12:0/3005689790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56147caf13c0 con 0x56147ce1a5d0 2024-09-19T06:55:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff4effd640 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce24dd0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7eff4000bfb0 tx=0x7eff4000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fa06594d86ac06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff2effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff2effd640 1 -- 172.21.15.12:0/3005689790 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40018020 con 0x56147ce1a5d0 2024-09-19T06:55:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff2effd640 1 -- 172.21.15.12:0/3005689790 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7eff40014870 con 0x56147ce1a5d0 2024-09-19T06:55:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.682+0000 7eff57e09740 1 -- 172.21.15.12:0/3005689790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff3809ba90 con 0x56147ce1a5d0 2024-09-19T06:55:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff2effd640 1 -- 172.21.15.12:0/3005689790 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7eff40023050 con 0x56147ce1a5d0 2024-09-19T06:55:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff57e09740 10 client.19722 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff57e09740 1 -- 172.21.15.12:0/3005689790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x56147ce33c10 con 0x56147ce1a5d0 2024-09-19T06:55:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff2effd640 1 -- 172.21.15.12:0/3005689790 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff3809ba90 con 0x56147ce1a5d0 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff2effd640 1 -- 172.21.15.12:0/3005689790 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7eff40013b10 con 0x56147ce1a5d0 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff57e09740 10 client.19722 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff57e09740 10 client.19722 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff57e09740 20 client.19722 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff57e09740 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56147ce350d0 0x56147ce37590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff57e09740 4 client.19722 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff57e09740 1 -- 172.21.15.12:0/3005689790 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56147cd8d860 con 0x56147ce350d0 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.683+0000 7eff47fff640 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56147ce350d0 0x56147ce37590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.684+0000 7eff47fff640 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56147ce350d0 0x56147ce37590 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1cd5674489884687 server_cookie=e54403159340a205 in_seq=0 out_seq=0 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.684+0000 7eff2effd640 10 client.19722 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:55:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.684+0000 7eff2effd640 1 -- 172.21.15.12:0/3005689790 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56147cd8d860 con 0x56147ce350d0 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.684+0000 7eff2effd640 10 client.19722 handle_command_reply: tid=0 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 client.19722 shutdown 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 -- 172.21.15.12:0/3005689790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 msgr2=0x56147ce24dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce24dd0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7eff4000bfb0 tx=0x7eff4000f670 comp rx=0 tx=0).stop 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 -- 172.21.15.12:0/3005689790 shutdown_connections 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56147ce350d0 0x56147ce37590 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce25370 0x56147ce22810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce22080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 --2- 172.21.15.12:0/3005689790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce24dd0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff2effd640 0 client.19722 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 -- 172.21.15.12:0/3005689790 >> 172.21.15.12:0/3005689790 conn(0x56147cde3310 msgr2=0x56147ce1c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 -- 172.21.15.12:0/3005689790 shutdown_connections 2024-09-19T06:55:45.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 1 -- 172.21.15.12:0/3005689790 wait complete. 2024-09-19T06:55:45.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.685+0000 7eff57e09740 20 client.19722 trim_cache size 0 max 16384 2024-09-19T06:55:45.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff57e09740 1 Processor -- start 2024-09-19T06:55:45.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff57e09740 1 -- start start 2024-09-19T06:55:45.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff57e09740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff57e09740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce16700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff57e09740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce25370 0x56147ce16c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff57e09740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff501afde0 con 0x56147ce1a5d0 2024-09-19T06:55:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff57e09740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff501b1920 con 0x56147ce25370 2024-09-19T06:55:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff57e09740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7eff501b04b0 con 0x56147ce1bb40 2024-09-19T06:55:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff4effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff4effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce374c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37078/0 (socket says 172.21.15.12:37078) 2024-09-19T06:55:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.699+0000 7eff4effd640 1 -- 172.21.15.12:0/2028844813 learned_addr learned my addr 172.21.15.12:0/2028844813 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff47fff640 1 --2- 172.21.15.12:0/2028844813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce16700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff4f7fe640 1 --2- 172.21.15.12:0/2028844813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce25370 0x56147ce16c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff4effd640 1 -- 172.21.15.12:0/2028844813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 msgr2=0x56147ce16700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff4effd640 1 --2- 172.21.15.12:0/2028844813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce16700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff4effd640 1 -- 172.21.15.12:0/2028844813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce25370 msgr2=0x56147ce16c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff4effd640 1 --2- 172.21.15.12:0/2028844813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce25370 0x56147ce16c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff4effd640 1 -- 172.21.15.12:0/2028844813 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56147ce17180 con 0x56147ce1a5d0 2024-09-19T06:55:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff47fff640 1 --2- 172.21.15.12:0/2028844813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce16700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff4effd640 1 --2- 172.21.15.12:0/2028844813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce374c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7eff40014040 tx=0x7eff400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f5d45c64bcbb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff457fa640 1 -- 172.21.15.12:0/2028844813 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4002b070 con 0x56147ce1a5d0 2024-09-19T06:55:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff457fa640 1 -- 172.21.15.12:0/2028844813 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff4000fb70 con 0x56147ce1a5d0 2024-09-19T06:55:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.700+0000 7eff457fa640 1 -- 172.21.15.12:0/2028844813 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40018050 con 0x56147ce1a5d0 2024-09-19T06:55:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.701+0000 7eff57e09740 1 -- 172.21.15.12:0/2028844813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 msgr2=0x56147ce374c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.701+0000 7eff57e09740 1 --2- 172.21.15.12:0/2028844813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce374c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7eff40014040 tx=0x7eff400046c0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.701+0000 7eff57e09740 1 -- 172.21.15.12:0/2028844813 shutdown_connections 2024-09-19T06:55:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.701+0000 7eff57e09740 1 --2- 172.21.15.12:0/2028844813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce25370 0x56147ce16c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.701+0000 7eff57e09740 1 --2- 172.21.15.12:0/2028844813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1bb40 0x56147ce16700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.701+0000 7eff57e09740 1 --2- 172.21.15.12:0/2028844813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce1a5d0 0x56147ce374c0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.701+0000 7eff57e09740 1 -- 172.21.15.12:0/2028844813 >> 172.21.15.12:0/2028844813 conn(0x56147cde3310 msgr2=0x56147ce11a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.701+0000 7eff57e09740 1 -- 172.21.15.12:0/2028844813 shutdown_connections 2024-09-19T06:55:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.701+0000 7eff57e09740 1 -- 172.21.15.12:0/2028844813 wait complete. 2024-09-19T06:55:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff57e09740 1 -- start start 2024-09-19T06:55:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff57e09740 1 Processor -- start 2024-09-19T06:55:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff57e09740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1a5d0 0x56147ce2dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff57e09740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1bb40 0x56147ce1eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff57e09740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce1f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff57e09740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff501b1250 con 0x56147ce25370 2024-09-19T06:55:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff57e09740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff501b0b80 con 0x56147ce1bb40 2024-09-19T06:55:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff57e09740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7eff501adde0 con 0x56147ce1a5d0 2024-09-19T06:55:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff57e09740 10 client.0 _ll_register_callbacks cb 0x7eff4000b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce1f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff4f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce1f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37084/0 (socket says 172.21.15.12:37084) 2024-09-19T06:55:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff4f7fe640 1 -- 172.21.15.12:0/2350387777 learned_addr learned my addr 172.21.15.12:0/2350387777 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.702+0000 7eff47fff640 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1bb40 0x56147ce1eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff4effd640 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1a5d0 0x56147ce2dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff4f7fe640 1 -- 172.21.15.12:0/2350387777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1a5d0 msgr2=0x56147ce2dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff4f7fe640 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1a5d0 0x56147ce2dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff4f7fe640 1 -- 172.21.15.12:0/2350387777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1bb40 msgr2=0x56147ce1eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff4f7fe640 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1bb40 0x56147ce1eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff4f7fe640 1 -- 172.21.15.12:0/2350387777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56147ce1fd10 con 0x56147ce25370 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff47fff640 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1bb40 0x56147ce1eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff4f7fe640 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce1f4e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7eff50106710 tx=0x7eff48046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86c3b6691b15914 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff2effd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff2effd640 1 -- 172.21.15.12:0/2350387777 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48031860 con 0x56147ce25370 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff2effd640 1 -- 172.21.15.12:0/2350387777 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7eff48004040 con 0x56147ce25370 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.703+0000 7eff57e09740 1 -- 172.21.15.12:0/2350387777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff4000fb70 con 0x56147ce25370 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff2effd640 1 -- 172.21.15.12:0/2350387777 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7eff48004240 con 0x56147ce25370 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff57e09740 10 client.19728 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff57e09740 1 -- 172.21.15.12:0/2350387777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x56147ce9ffb0 con 0x56147ce25370 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff2effd640 1 -- 172.21.15.12:0/2350387777 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff4000fb70 con 0x56147ce25370 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff2effd640 1 -- 172.21.15.12:0/2350387777 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7eff48030ad0 con 0x56147ce25370 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff57e09740 10 client.19728 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff57e09740 10 client.19728 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff57e09740 20 client.19728 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff57e09740 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56147cea0700 0x56147cea2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff57e09740 4 client.19728 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.704+0000 7eff57e09740 1 -- 172.21.15.12:0/2350387777 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56147cd87d70 con 0x56147cea0700 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.705+0000 7eff4effd640 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56147cea0700 0x56147cea2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.705+0000 7eff4effd640 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56147cea0700 0x56147cea2b20 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=704f855028363492 server_cookie=8e45c5085400ab70 in_seq=0 out_seq=0 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.705+0000 7eff2effd640 10 client.19728 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.705+0000 7eff2effd640 1 -- 172.21.15.12:0/2350387777 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56147cd87d70 con 0x56147cea0700 2024-09-19T06:55:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.705+0000 7eff2effd640 10 client.19728 handle_command_reply: tid=0 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.705+0000 7eff57e09740 1 client.19728 shutdown 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 1 -- 172.21.15.12:0/2350387777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 msgr2=0x56147ce1f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce1f4e0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7eff50106710 tx=0x7eff48046000 comp rx=0 tx=0).stop 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 1 -- 172.21.15.12:0/2350387777 shutdown_connections 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x56147cea0700 0x56147cea2b20 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56147ce25370 0x56147ce1f4e0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56147ce1bb40 0x56147ce1eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 1 --2- 172.21.15.12:0/2350387777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56147ce1a5d0 0x56147ce2dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 1 -- 172.21.15.12:0/2350387777 >> 172.21.15.12:0/2350387777 conn(0x56147cde3310 msgr2=0x56147ce16700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff2effd640 0 client.19728 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 1 -- 172.21.15.12:0/2350387777 shutdown_connections 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 1 -- 172.21.15.12:0/2350387777 wait complete. 2024-09-19T06:55:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.706+0000 7eff57e09740 20 client.19728 trim_cache size 0 max 16384 2024-09-19T06:55:45.714 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:55:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 -- 172.21.15.12:0/2484365989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff3c0a33b0 msgr2=0x7eff3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff3c0a33b0 0x7eff3c0a5870 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7eff48005cc0 tx=0x7eff4802f490 comp rx=0 tx=0).stop 2024-09-19T06:55:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 -- 172.21.15.12:0/2484365989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff50101ba0 msgr2=0x7eff500fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff50101ba0 0x7eff500fcbd0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7eff3800d950 tx=0x7eff3800de10 comp rx=0 tx=0).stop 2024-09-19T06:55:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 -- 172.21.15.12:0/2484365989 shutdown_connections 2024-09-19T06:55:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff3c0a33b0 0x7eff3c0a5870 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff50105ad0 0x7eff500fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff50101ba0 0x7eff500fcbd0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 --2- 172.21.15.12:0/2484365989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff50101200 0x7eff500fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 -- 172.21.15.12:0/2484365989 >> 172.21.15.12:0/2484365989 conn(0x7eff50077210 msgr2=0x7eff50100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 -- 172.21.15.12:0/2484365989 shutdown_connections 2024-09-19T06:55:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:45.707+0000 7eff55a30640 1 -- 172.21.15.12:0/2484365989 wait complete. 2024-09-19T06:55:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:progress: 900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-19T06:55:45.966 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:46.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:46 smithi012 ceph-mon[30937]: pgmap v489: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-19T06:55:46.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:55:46.483 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:46 smithi173 ceph-mon[35349]: pgmap v489: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-19T06:55:46.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:46 smithi016 ceph-mon[34911]: pgmap v489: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-19T06:55:47.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.039+0000 7f35f3838640 1 -- 172.21.15.12:0/2882604197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35ec101de0 msgr2=0x7f35ec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:47.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.039+0000 7f35f3838640 1 --2- 172.21.15.12:0/2882604197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35ec101de0 0x7f35ec1021c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009900 tx=0x7f35e802a410 comp rx=0 tx=0).stop 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 53, 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 52, 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "d84b81be": { 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 52, 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:55:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 149.4, 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:47.177 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:47.177 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:47.177 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:55:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.039+0000 7f35f3838640 1 -- 172.21.15.12:0/2882604197 shutdown_connections 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.039+0000 7f35f3838640 1 --2- 172.21.15.12:0/2882604197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35ec106f10 0x7f35ec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.039+0000 7f35f3838640 1 --2- 172.21.15.12:0/2882604197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35ec102790 0x7f35ec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.039+0000 7f35f3838640 1 --2- 172.21.15.12:0/2882604197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35ec101de0 0x7f35ec1021c0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.039+0000 7f35f3838640 1 -- 172.21.15.12:0/2882604197 >> 172.21.15.12:0/2882604197 conn(0x7f35ec0fd8c0 msgr2=0x7f35ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.039+0000 7f35f3838640 1 -- 172.21.15.12:0/2882604197 shutdown_connections 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.039+0000 7f35f3838640 1 -- 172.21.15.12:0/2882604197 wait complete. 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.040+0000 7f35f3838640 1 Processor -- start 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.040+0000 7f35f3838640 1 -- start start 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f3838640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35ec101de0 0x7f35ec198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f3838640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35ec102790 0x7f35ec198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f3838640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35ec106f10 0x7f35ec19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f3838640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec111f70 con 0x7f35ec106f10 2024-09-19T06:55:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f3838640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec111df0 con 0x7f35ec102790 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f3838640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1120f0 con 0x7f35ec101de0 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f1dd5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35ec106f10 0x7f35ec19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f1dd5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35ec106f10 0x7f35ec19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37100/0 (socket says 172.21.15.12:37100) 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f1dd5640 1 -- 172.21.15.12:0/1601384535 learned_addr learned my addr 172.21.15.12:0/1601384535 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35ec102790 0x7f35ec198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f15d4640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35ec101de0 0x7f35ec198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f1dd5640 1 -- 172.21.15.12:0/1601384535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35ec101de0 msgr2=0x7f35ec198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f1dd5640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35ec101de0 0x7f35ec198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f1dd5640 1 -- 172.21.15.12:0/1601384535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35ec102790 msgr2=0x7f35ec198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f1dd5640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35ec102790 0x7f35ec198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f1dd5640 1 -- 172.21.15.12:0/1601384535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ec19d3f0 con 0x7f35ec106f10 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.041+0000 7f35f1dd5640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35ec106f10 0x7f35ec19cd10 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f35e400eaa0 tx=0x7f35e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.042+0000 7f35e27fc640 1 -- 172.21.15.12:0/1601384535 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e400cdb0 con 0x7f35ec106f10 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.042+0000 7f35f3838640 1 -- 172.21.15.12:0/1601384535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ec19d6e0 con 0x7f35ec106f10 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.042+0000 7f35e27fc640 1 -- 172.21.15.12:0/1601384535 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35e4005020 con 0x7f35ec106f10 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.042+0000 7f35e27fc640 1 -- 172.21.15.12:0/1601384535 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e40116b0 con 0x7f35ec106f10 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.042+0000 7f35f3838640 1 -- 172.21.15.12:0/1601384535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec1a4fc0 con 0x7f35ec106f10 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.044+0000 7f35e27fc640 1 -- 172.21.15.12:0/1601384535 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f35e4005560 con 0x7f35ec106f10 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.044+0000 7f35f5c11740 1 Processor -- start 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f5c11740 1 -- start start 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13a4060 0x5633c13a4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4980 0x5633c13aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13af240 0x5633c13b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f5c11740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5633c1309620 con 0x5633c13af240 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f5c11740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5633c12b0e50 con 0x5633c13a4060 2024-09-19T06:55:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f5c11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5633c13055e0 con 0x5633c13a4980 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35e27fc640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35d80a33b0 0x7f35d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f0dd3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13af240 0x5633c13b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f0dd3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13af240 0x5633c13b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37102/0 (socket says 172.21.15.12:37102) 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f0dd3640 1 -- 172.21.15.12:0/2603755368 learned_addr learned my addr 172.21.15.12:0/2603755368 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/2603755368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13a4060 0x5633c13a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f1dd5640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35d80a33b0 0x7f35d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f15d4640 1 --2- 172.21.15.12:0/2603755368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4980 0x5633c13aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35e27fc640 1 -- 172.21.15.12:0/1601384535 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f35e40cff60 con 0x7f35ec106f10 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f0dd3640 1 -- 172.21.15.12:0/2603755368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4980 msgr2=0x5633c13aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/2603755368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4980 0x5633c13aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.045+0000 7f35f0dd3640 1 -- 172.21.15.12:0/2603755368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13a4060 msgr2=0x5633c13a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.046+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/2603755368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13a4060 0x5633c13a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.046+0000 7f35f0dd3640 1 -- 172.21.15.12:0/2603755368 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c12a1d40 con 0x5633c13af240 2024-09-19T06:55:47.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.046+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/2603755368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13af240 0x5633c13b1630 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0127a0 tx=0x7f35dc00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58aa6bc8d66ef53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.046+0000 7f35f1dd5640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35d80a33b0 0x7f35d80a5870 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f35e409bef0 tx=0x7f35e4053040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.046+0000 7f35d77fe640 1 -- 172.21.15.12:0/2603755368 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc012de0 con 0x5633c13af240 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.046+0000 7f35d77fe640 1 -- 172.21.15.12:0/2603755368 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35dc010c50 con 0x5633c13af240 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.046+0000 7f35d77fe640 1 -- 172.21.15.12:0/2603755368 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc01eac0 con 0x5633c13af240 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 -- 172.21.15.12:0/2603755368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13af240 msgr2=0x5633c13b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 --2- 172.21.15.12:0/2603755368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13af240 0x5633c13b1630 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0127a0 tx=0x7f35dc00b760 comp rx=0 tx=0).stop 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 -- 172.21.15.12:0/2603755368 shutdown_connections 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 --2- 172.21.15.12:0/2603755368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13af240 0x5633c13b1630 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 --2- 172.21.15.12:0/2603755368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4980 0x5633c13aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 --2- 172.21.15.12:0/2603755368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13a4060 0x5633c13a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 -- 172.21.15.12:0/2603755368 >> 172.21.15.12:0/2603755368 conn(0x5633c13a05f0 msgr2=0x5633c13a09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 -- 172.21.15.12:0/2603755368 shutdown_connections 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 -- 172.21.15.12:0/2603755368 wait complete. 2024-09-19T06:55:47.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 -- start start 2024-09-19T06:55:47.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.047+0000 7f35f5c11740 1 Processor -- start 2024-09-19T06:55:47.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4060 0x5633c13ac100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13a4980 0x5633c13ac640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13af240 0x5633c13acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f5c11740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5633c13b6220 con 0x5633c13a4060 2024-09-19T06:55:47.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f5c11740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5633c1291f10 con 0x5633c13a4980 2024-09-19T06:55:47.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f5c11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5633c13b63a0 con 0x5633c13af240 2024-09-19T06:55:47.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f5c11740 10 client.0 _ll_register_callbacks cb 0x5633c12b5db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:47.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f0dd3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4060 0x5633c13ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f0dd3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4060 0x5633c13ac100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37112/0 (socket says 172.21.15.12:37112) 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f0dd3640 1 -- 172.21.15.12:0/3720012952 learned_addr learned my addr 172.21.15.12:0/3720012952 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f15d4640 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13a4980 0x5633c13ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f0dd3640 1 -- 172.21.15.12:0/3720012952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13af240 msgr2=0x5633c13acb80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13af240 0x5633c13acb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f0dd3640 1 -- 172.21.15.12:0/3720012952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13a4980 msgr2=0x5633c13ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13a4980 0x5633c13ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f0dd3640 1 -- 172.21.15.12:0/3720012952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633c1018580 con 0x5633c13a4060 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4060 0x5633c13ac100 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f35dc012560 tx=0x7f35dc0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf3d6161b0b2d65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.048+0000 7f35d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3720012952 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc02e060 con 0x5633c13a4060 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3720012952 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f35dc01e840 con 0x5633c13a4060 2024-09-19T06:55:47.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35f5c11740 1 -- 172.21.15.12:0/3720012952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35dc010c50 con 0x5633c13a4060 2024-09-19T06:55:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3720012952 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f35dc010e00 con 0x5633c13a4060 2024-09-19T06:55:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35f5c11740 10 client.19740 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35f5c11740 1 -- 172.21.15.12:0/3720012952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5633c10e2960 con 0x5633c13a4060 2024-09-19T06:55:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3720012952 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35dc010c50 con 0x5633c13a4060 2024-09-19T06:55:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3720012952 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f35dc01fb20 con 0x5633c13a4060 2024-09-19T06:55:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35f5c11740 10 client.19740 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35f5c11740 10 client.19740 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:55:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35f5c11740 20 client.19740 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5633c13c30d0 0x5633c13c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35f5c11740 4 client.19740 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.049+0000 7f35f5c11740 1 -- 172.21.15.12:0/3720012952 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633c1316b90 con 0x5633c13c30d0 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.050+0000 7f35f15d4640 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5633c13c30d0 0x5633c13c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.050+0000 7f35d4ff9640 10 client.19740 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.050+0000 7f35f15d4640 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5633c13c30d0 0x5633c13c54c0 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45b2628f6e013a12 server_cookie=14399d18540b48fb in_seq=0 out_seq=0 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3720012952 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633c1316b90 con 0x5633c13c30d0 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35d4ff9640 10 client.19740 handle_command_reply: tid=0 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 client.19740 shutdown 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 -- 172.21.15.12:0/3720012952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4060 msgr2=0x5633c13ac100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4060 0x5633c13ac100 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f35dc012560 tx=0x7f35dc0056d0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 -- 172.21.15.12:0/3720012952 shutdown_connections 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5633c13c30d0 0x5633c13c54c0 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13af240 0x5633c13acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35d4ff9640 0 client.19740 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13a4980 0x5633c13ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3720012952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4060 0x5633c13ac100 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 -- 172.21.15.12:0/3720012952 >> 172.21.15.12:0/3720012952 conn(0x5633c13a05f0 msgr2=0x5633c13a62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 -- 172.21.15.12:0/3720012952 shutdown_connections 2024-09-19T06:55:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 1 -- 172.21.15.12:0/3720012952 wait complete. 2024-09-19T06:55:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.051+0000 7f35f5c11740 20 client.19740 trim_cache size 0 max 16384 2024-09-19T06:55:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f5c11740 1 Processor -- start 2024-09-19T06:55:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f5c11740 1 -- start start 2024-09-19T06:55:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4060 0x5633c13a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13af240 0x5633c13cb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f5c11740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1ab9e0 con 0x5633c13a4980 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f5c11740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1ad520 con 0x5633c13af240 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f5c11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1ac0b0 con 0x5633c13a4060 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f15d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f15d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37118/0 (socket says 172.21.15.12:37118) 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f15d4640 1 -- 172.21.15.12:0/4077729385 learned_addr learned my addr 172.21.15.12:0/4077729385 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/4077729385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4060 0x5633c13a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f15d4640 1 -- 172.21.15.12:0/4077729385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4060 msgr2=0x5633c13a61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f15d4640 1 --2- 172.21.15.12:0/4077729385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4060 0x5633c13a61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f15d4640 1 -- 172.21.15.12:0/4077729385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13af240 msgr2=0x5633c13cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f15d4640 1 --2- 172.21.15.12:0/4077729385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13af240 0x5633c13cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f15d4640 1 -- 172.21.15.12:0/4077729385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c13a0420 con 0x5633c13a4980 2024-09-19T06:55:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.070+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/4077729385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4060 0x5633c13a61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35f15d4640 1 --2- 172.21.15.12:0/4077729385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13caaf0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009230 tx=0x7f35e80058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f8a9b624badf66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35d6ffd640 1 -- 172.21.15.12:0/4077729385 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8049070 con 0x5633c13a4980 2024-09-19T06:55:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35d6ffd640 1 -- 172.21.15.12:0/4077729385 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35e8005500 con 0x5633c13a4980 2024-09-19T06:55:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35d6ffd640 1 -- 172.21.15.12:0/4077729385 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8035040 con 0x5633c13a4980 2024-09-19T06:55:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35f5c11740 1 -- 172.21.15.12:0/4077729385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 msgr2=0x5633c13caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35f5c11740 1 --2- 172.21.15.12:0/4077729385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13caaf0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009230 tx=0x7f35e80058d0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35f5c11740 1 -- 172.21.15.12:0/4077729385 shutdown_connections 2024-09-19T06:55:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35f5c11740 1 --2- 172.21.15.12:0/4077729385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13af240 0x5633c13cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35f5c11740 1 --2- 172.21.15.12:0/4077729385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13caaf0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35f5c11740 1 --2- 172.21.15.12:0/4077729385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4060 0x5633c13a61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35f5c11740 1 -- 172.21.15.12:0/4077729385 >> 172.21.15.12:0/4077729385 conn(0x5633c13a05f0 msgr2=0x5633c13a5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35f5c11740 1 -- 172.21.15.12:0/4077729385 shutdown_connections 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.071+0000 7f35f5c11740 1 -- 172.21.15.12:0/4077729385 wait complete. 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.072+0000 7f35f5c11740 1 -- start start 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.072+0000 7f35f5c11740 1 Processor -- start 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.072+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4060 0x5633c13bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.072+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.072+0000 7f35f5c11740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13af240 0x5633c13b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.072+0000 7f35f5c11740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1ace50 con 0x5633c13a4980 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.072+0000 7f35f5c11740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1ac780 con 0x5633c13af240 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.072+0000 7f35f5c11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1a99e0 con 0x5633c13a4060 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.072+0000 7f35f5c11740 10 client.0 _ll_register_callbacks cb 0x7f35dc005970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.072+0000 7f35f15d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f15d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13b85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37134/0 (socket says 172.21.15.12:37134) 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f15d4640 1 -- 172.21.15.12:0/3098818611 learned_addr learned my addr 172.21.15.12:0/3098818611 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13af240 0x5633c13b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f15d4640 1 -- 172.21.15.12:0/3098818611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4060 msgr2=0x5633c13bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f15d4640 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4060 0x5633c13bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f15d4640 1 -- 172.21.15.12:0/3098818611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13af240 msgr2=0x5633c13b8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f15d4640 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13af240 0x5633c13b8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f15d4640 1 -- 172.21.15.12:0/3098818611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633c13ad0d0 con 0x5633c13a4980 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f15d4640 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13b85c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f35e802a930 tx=0x7f35e8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff98563d562e3e97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3098818611 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8049050 con 0x5633c13a4980 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3098818611 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f35e80052e0 con 0x5633c13a4980 2024-09-19T06:55:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f5c11740 1 -- 172.21.15.12:0/3098818611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35e8005500 con 0x5633c13a4980 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3098818611 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f35e8035040 con 0x5633c13a4980 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f5c11740 10 client.19746 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.073+0000 7f35f5c11740 1 -- 172.21.15.12:0/3098818611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5633c13a6ed0 con 0x5633c13a4980 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3098818611 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35e8005500 con 0x5633c13a4980 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3098818611 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f35e80035f0 con 0x5633c13a4980 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35f5c11740 10 client.19746 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35f5c11740 10 client.19746 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35f5c11740 20 client.19746 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5633c142ee30 0x5633c1431250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35f5c11740 4 client.19746 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d84b81be", "release": true, "await": true}] 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35f5c11740 1 -- 172.21.15.12:0/3098818611 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d84b81be", "release": true, "await": true}) -- 0x5633c13110a0 con 0x5633c142ee30 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5633c142ee30 0x5633c1431250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35d4ff9640 10 client.19746 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.074+0000 7f35f0dd3640 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5633c142ee30 0x5633c1431250 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f1105c0d0de205e server_cookie=351e1c32c322f987 in_seq=0 out_seq=0 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35d4ff9640 1 -- 172.21.15.12:0/3098818611 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5633c13110a0 con 0x5633c142ee30 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35d4ff9640 10 client.19746 handle_command_reply: tid=0 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 client.19746 shutdown 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 -- 172.21.15.12:0/3098818611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 msgr2=0x5633c13b85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13b85c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f35e802a930 tx=0x7f35e8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 -- 172.21.15.12:0/3098818611 shutdown_connections 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5633c142ee30 0x5633c1431250 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5633c13af240 0x5633c13b8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5633c13a4980 0x5633c13b85c0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35d4ff9640 0 client.19746 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 --2- 172.21.15.12:0/3098818611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5633c13a4060 0x5633c13bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 -- 172.21.15.12:0/3098818611 >> 172.21.15.12:0/3098818611 conn(0x5633c13a05f0 msgr2=0x5633c13ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 -- 172.21.15.12:0/3098818611 shutdown_connections 2024-09-19T06:55:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 1 -- 172.21.15.12:0/3098818611 wait complete. 2024-09-19T06:55:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.127+0000 7f35f5c11740 20 client.19746 trim_cache size 0 max 16384 2024-09-19T06:55:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.128+0000 7f35f3838640 1 -- 172.21.15.12:0/1601384535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35d80a33b0 msgr2=0x7f35d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.128+0000 7f35f3838640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35d80a33b0 0x7f35d80a5870 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f35e409bef0 tx=0x7f35e4053040 comp rx=0 tx=0).stop 2024-09-19T06:55:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.128+0000 7f35f3838640 1 -- 172.21.15.12:0/1601384535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35ec106f10 msgr2=0x7f35ec19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.128+0000 7f35f3838640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35ec106f10 0x7f35ec19cd10 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f35e400eaa0 tx=0x7f35e400ef60 comp rx=0 tx=0).stop 2024-09-19T06:55:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.128+0000 7f35f3838640 1 -- 172.21.15.12:0/1601384535 shutdown_connections 2024-09-19T06:55:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.128+0000 7f35f3838640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35ec106f10 0x7f35ec19cd10 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.128+0000 7f35f3838640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35ec102790 0x7f35ec198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.128+0000 7f35f3838640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f35d80a33b0 0x7f35d80a5870 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.128+0000 7f35f3838640 1 --2- 172.21.15.12:0/1601384535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35ec101de0 0x7f35ec198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:47.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.128+0000 7f35f3838640 1 -- 172.21.15.12:0/1601384535 >> 172.21.15.12:0/1601384535 conn(0x7f35ec0fd8c0 msgr2=0x7f35ec0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:47.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.129+0000 7f35f3838640 1 -- 172.21.15.12:0/1601384535 shutdown_connections 2024-09-19T06:55:47.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:47.129+0000 7f35f3838640 1 -- 172.21.15.12:0/1601384535 wait complete. 2024-09-19T06:55:47.266 INFO:teuthology.orchestra.run.smithi012.stdout:transaction type: 2024-09-19T06:55:47.266 INFO:teuthology.orchestra.run.smithi012.stdout:scaling factor: 32 2024-09-19T06:55:47.266 INFO:teuthology.orchestra.run.smithi012.stdout:query mode: simple 2024-09-19T06:55:47.267 INFO:teuthology.orchestra.run.smithi012.stdout:number of clients: 100 2024-09-19T06:55:47.267 INFO:teuthology.orchestra.run.smithi012.stdout:number of threads: 4 2024-09-19T06:55:47.267 INFO:teuthology.orchestra.run.smithi012.stdout:duration: 900 s 2024-09-19T06:55:47.267 INFO:teuthology.orchestra.run.smithi012.stdout:number of transactions actually processed: 1827699 2024-09-19T06:55:47.267 INFO:teuthology.orchestra.run.smithi012.stdout:latency average = 49.309 ms 2024-09-19T06:55:47.267 INFO:teuthology.orchestra.run.smithi012.stdout:latency stddev = 636.184 ms 2024-09-19T06:55:47.267 INFO:teuthology.orchestra.run.smithi012.stdout:tps = 2027.489055 (including connections establishing) 2024-09-19T06:55:47.267 INFO:teuthology.orchestra.run.smithi012.stdout:tps = 2027.495406 (excluding connections establishing) 2024-09-19T06:55:47.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-19T06:55:47.292 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:47 smithi012 ceph-mon[30937]: pgmap v490: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-19T06:55:47.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:47 smithi016 ceph-mon[34911]: pgmap v490: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-19T06:55:47.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:47 smithi173 ceph-mon[35349]: pgmap v490: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-19T06:55:48.060 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd84b81be', total seconds elapsed: 34.1 2024-09-19T06:55:48.060 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.45 2024-09-19T06:55:48.060 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:55:48.067 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.745+0000 7fa662c51640 1 -- 172.21.15.12:0/4002318744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa65c11b140 msgr2=0x7fa65c11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.745+0000 7fa662c51640 1 --2- 172.21.15.12:0/4002318744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa65c11b140 0x7fa65c11d530 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa650009860 tx=0x7fa65002a380 comp rx=0 tx=0).stop 2024-09-19T06:55:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.745+0000 7fa662c51640 1 -- 172.21.15.12:0/4002318744 shutdown_connections 2024-09-19T06:55:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.745+0000 7fa662c51640 1 --2- 172.21.15.12:0/4002318744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa65c11b140 0x7fa65c11d530 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.745+0000 7fa662c51640 1 --2- 172.21.15.12:0/4002318744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65c109830 0x7fa65c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.745+0000 7fa662c51640 1 --2- 172.21.15.12:0/4002318744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa65c109450 0x7fa65c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.745+0000 7fa662c51640 1 -- 172.21.15.12:0/4002318744 >> 172.21.15.12:0/4002318744 conn(0x7fa65c06e140 msgr2=0x7fa65c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.746+0000 7fa662c51640 1 -- 172.21.15.12:0/4002318744 shutdown_connections 2024-09-19T06:55:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.746+0000 7fa662c51640 1 -- 172.21.15.12:0/4002318744 wait complete. 2024-09-19T06:55:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.747+0000 7fa662c51640 1 Processor -- start 2024-09-19T06:55:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.747+0000 7fa662c51640 1 -- start start 2024-09-19T06:55:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.747+0000 7fa662c51640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa65c109450 0x7fa65c1a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.747+0000 7fa662c51640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa65c109830 0x7fa65c1a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.747+0000 7fa662c51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65c118f60 0x7fa65c1193e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.747+0000 7fa662c51640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c113300 con 0x7fa65c118f60 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.747+0000 7fa662c51640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c113180 con 0x7fa65c109450 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.747+0000 7fa662c51640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c113480 con 0x7fa65c109830 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.748+0000 7fa6611ee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65c118f60 0x7fa65c1193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.748+0000 7fa6611ee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65c118f60 0x7fa65c1193e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37156/0 (socket says 172.21.15.12:37156) 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.748+0000 7fa6611ee640 1 -- 172.21.15.12:0/3384713550 learned_addr learned my addr 172.21.15.12:0/3384713550 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.748+0000 7fa6611ee640 1 -- 172.21.15.12:0/3384713550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa65c109830 msgr2=0x7fa65c1a4a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.748+0000 7fa6611ee640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa65c109830 0x7fa65c1a4a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.748+0000 7fa6611ee640 1 -- 172.21.15.12:0/3384713550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa65c109450 msgr2=0x7fa65c1a44e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.748+0000 7fa6611ee640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa65c109450 0x7fa65c1a44e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.748+0000 7fa6611ee640 1 -- 172.21.15.12:0/3384713550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65c119b10 con 0x7fa65c118f60 2024-09-19T06:55:48.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.749+0000 7fa6611ee640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65c118f60 0x7fa65c1193e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fa650004250 tx=0x7fa650004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:48.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.751+0000 7fa659ffb640 1 -- 172.21.15.12:0/3384713550 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650037040 con 0x7fa65c118f60 2024-09-19T06:55:48.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.751+0000 7fa662c51640 1 -- 172.21.15.12:0/3384713550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65c119da0 con 0x7fa65c118f60 2024-09-19T06:55:48.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.752+0000 7fa662c51640 1 -- 172.21.15.12:0/3384713550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa65c1cd5b0 con 0x7fa65c118f60 2024-09-19T06:55:48.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.752+0000 7fa659ffb640 1 -- 172.21.15.12:0/3384713550 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa650040070 con 0x7fa65c118f60 2024-09-19T06:55:48.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.752+0000 7fa659ffb640 1 -- 172.21.15.12:0/3384713550 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650032b20 con 0x7fa65c118f60 2024-09-19T06:55:48.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.757+0000 7fa66502a740 1 Processor -- start 2024-09-19T06:55:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.761+0000 7fa659ffb640 1 -- 172.21.15.12:0/3384713550 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa650032cc0 con 0x7fa65c118f60 2024-09-19T06:55:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.762+0000 7fa659ffb640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa6440a35c0 0x7fa6440a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.762+0000 7fa66502a740 1 -- start start 2024-09-19T06:55:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.762+0000 7fa659ffb640 1 -- 172.21.15.12:0/3384713550 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7fa6500efb10 con 0x7fa65c118f60 2024-09-19T06:55:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.762+0000 7fa66502a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e069090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.762+0000 7fa66502a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e069a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.762+0000 7fa66502a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e076760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.762+0000 7fa66502a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a36dfcf2f0 con 0x55a36e0695d0 2024-09-19T06:55:48.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.762+0000 7fa66502a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a36df76cf0 con 0x55a36e06ab40 2024-09-19T06:55:48.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.762+0000 7fa66502a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a36dfcb2b0 con 0x55a36e074370 2024-09-19T06:55:48.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.763+0000 7fa6609ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e069090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.763+0000 7fa6609ed640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e069090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34756/0 (socket says 172.21.15.12:34756) 2024-09-19T06:55:48.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.763+0000 7fa6609ed640 1 -- 172.21.15.12:0/2133930920 learned_addr learned my addr 172.21.15.12:0/2133930920 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:48.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.767+0000 7fa6611ee640 1 --2- 172.21.15.12:0/2133930920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.767+0000 7fa65bfff640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa6440a35c0 0x7fa6440a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.767+0000 7fa65bfff640 1 --2- 172.21.15.12:0/2133930920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e069a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.768+0000 7fa65bfff640 1 -- 172.21.15.12:0/2133930920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 msgr2=0x55a36e076760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:48.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.768+0000 7fa65bfff640 1 --2- 172.21.15.12:0/2133930920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e076760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.768+0000 7fa65bfff640 1 -- 172.21.15.12:0/2133930920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 msgr2=0x55a36e069090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:48.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.768+0000 7fa65bfff640 1 --2- 172.21.15.12:0/2133930920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e069090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.768+0000 7fa65bfff640 1 -- 172.21.15.12:0/2133930920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36df5b3a0 con 0x55a36e0695d0 2024-09-19T06:55:48.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.769+0000 7fa65bfff640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa6440a35c0 0x7fa6440a5a80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa65401afd0 tx=0x7fa65401ad20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:48.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.769+0000 7fa65bfff640 1 --2- 172.21.15.12:0/2133930920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e069a10 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fa65401a5a0 tx=0x7fa654017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219b565c341a3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:48.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.769+0000 7fa642ffd640 1 -- 172.21.15.12:0/2133930920 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65401cb70 con 0x55a36e0695d0 2024-09-19T06:55:48.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.770+0000 7fa642ffd640 1 -- 172.21.15.12:0/2133930920 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa65401cd10 con 0x55a36e0695d0 2024-09-19T06:55:48.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.770+0000 7fa642ffd640 1 -- 172.21.15.12:0/2133930920 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654004030 con 0x55a36e0695d0 2024-09-19T06:55:48.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.774+0000 7fa66502a740 1 -- 172.21.15.12:0/2133930920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 msgr2=0x55a36e069a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:48.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.774+0000 7fa66502a740 1 --2- 172.21.15.12:0/2133930920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e069a10 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fa65401a5a0 tx=0x7fa654017000 comp rx=0 tx=0).stop 2024-09-19T06:55:48.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.775+0000 7fa66502a740 1 -- 172.21.15.12:0/2133930920 shutdown_connections 2024-09-19T06:55:48.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.775+0000 7fa66502a740 1 --2- 172.21.15.12:0/2133930920 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e076760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.775+0000 7fa66502a740 1 --2- 172.21.15.12:0/2133930920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e069a10 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.775+0000 7fa66502a740 1 --2- 172.21.15.12:0/2133930920 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e069090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.775+0000 7fa66502a740 1 -- 172.21.15.12:0/2133930920 >> 172.21.15.12:0/2133930920 conn(0x55a36e032310 msgr2=0x55a36e065c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:48.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.775+0000 7fa66502a740 1 -- 172.21.15.12:0/2133930920 shutdown_connections 2024-09-19T06:55:48.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.775+0000 7fa66502a740 1 -- 172.21.15.12:0/2133930920 wait complete. 2024-09-19T06:55:48.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.776+0000 7fa66502a740 1 -- start start 2024-09-19T06:55:48.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.776+0000 7fa66502a740 1 Processor -- start 2024-09-19T06:55:48.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.777+0000 7fa66502a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.777+0000 7fa66502a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.777+0000 7fa66502a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.777+0000 7fa66502a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a36e077010 con 0x55a36e0695d0 2024-09-19T06:55:48.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.777+0000 7fa66502a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a36df8a060 con 0x55a36e06ab40 2024-09-19T06:55:48.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.777+0000 7fa66502a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a36e077190 con 0x55a36e074370 2024-09-19T06:55:48.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.777+0000 7fa66502a740 10 client.0 _ll_register_callbacks cb 0x55a36dcdd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:48.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.777+0000 7fa6611ee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.777+0000 7fa6611ee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e0714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41876/0 (socket says 172.21.15.12:41876) 2024-09-19T06:55:48.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.777+0000 7fa6611ee640 1 -- 172.21.15.12:0/31060871 learned_addr learned my addr 172.21.15.12:0/31060871 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:48.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.778+0000 7fa65bfff640 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.779+0000 7fa6609ed640 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.779+0000 7fa6611ee640 1 -- 172.21.15.12:0/31060871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 msgr2=0x55a36e070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:48.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.779+0000 7fa6611ee640 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.779+0000 7fa6611ee640 1 -- 172.21.15.12:0/31060871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 msgr2=0x55a36e073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:48.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.779+0000 7fa6611ee640 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.779+0000 7fa6611ee640 1 -- 172.21.15.12:0/31060871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a36dd403c0 con 0x55a36e074370 2024-09-19T06:55:48.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.780+0000 7fa6611ee640 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e0714e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa6500b8670 tx=0x7fa6500ba800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94656334c7153015 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:48.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.780+0000 7fa63bfff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:55:48.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.780+0000 7fa63bfff640 1 -- 172.21.15.12:0/31060871 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6500d4020 con 0x55a36e074370 2024-09-19T06:55:48.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.780+0000 7fa63bfff640 1 -- 172.21.15.12:0/31060871 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7fa6500037f0 con 0x55a36e074370 2024-09-19T06:55:48.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.780+0000 7fa66502a740 1 -- 172.21.15.12:0/31060871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa65401cd10 con 0x55a36e074370 2024-09-19T06:55:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.788+0000 7fa65bfff640 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.792+0000 7fa63bfff640 1 -- 172.21.15.12:0/31060871 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fa6500039f0 con 0x55a36e074370 2024-09-19T06:55:48.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.797+0000 7fa66502a740 10 client.28963 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:48.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.797+0000 7fa66502a740 1 -- 172.21.15.12:0/31060871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55a36e077010 con 0x55a36e074370 2024-09-19T06:55:48.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.799+0000 7fa63bfff640 1 -- 172.21.15.12:0/31060871 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa65401cd10 con 0x55a36e074370 2024-09-19T06:55:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.799+0000 7fa63bfff640 1 -- 172.21.15.12:0/31060871 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7fa65003a070 con 0x55a36e074370 2024-09-19T06:55:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.799+0000 7fa66502a740 10 client.28963 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.799+0000 7fa66502a740 10 client.28963 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:55:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.799+0000 7fa66502a740 20 client.28963 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.799+0000 7fa66502a740 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55a36e0840d0 0x55a36e086530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.799+0000 7fa66502a740 4 client.28963 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.799+0000 7fa66502a740 1 -- 172.21.15.12:0/31060871 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a36dfdc860 con 0x55a36e0840d0 2024-09-19T06:55:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.799+0000 7fa6609ed640 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55a36e0840d0 0x55a36e086530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.808+0000 7fa63bfff640 10 client.28963 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:55:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.808+0000 7fa6609ed640 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55a36e0840d0 0x55a36e086530 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e9bb1b2e4f04761 server_cookie=fffc91fe3dbb47c8 in_seq=0 out_seq=0 2024-09-19T06:55:48.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.811+0000 7fa63bfff640 1 -- 172.21.15.12:0/31060871 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a36dfdc860 con 0x55a36e0840d0 2024-09-19T06:55:48.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.811+0000 7fa63bfff640 10 client.28963 handle_command_reply: tid=0 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.812+0000 7fa66502a740 1 client.28963 shutdown 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.812+0000 7fa66502a740 1 -- 172.21.15.12:0/31060871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 msgr2=0x55a36e0714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.812+0000 7fa66502a740 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e0714e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa6500b8670 tx=0x7fa6500ba800 comp rx=0 tx=0).stop 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.812+0000 7fa66502a740 1 -- 172.21.15.12:0/31060871 shutdown_connections 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.812+0000 7fa66502a740 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55a36e0840d0 0x55a36e086530 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.812+0000 7fa66502a740 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e0714e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.812+0000 7fa66502a740 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.812+0000 7fa66502a740 1 --2- 172.21.15.12:0/31060871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.812+0000 7fa66502a740 1 -- 172.21.15.12:0/31060871 >> 172.21.15.12:0/31060871 conn(0x55a36e032310 msgr2=0x55a36e06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.812+0000 7fa63bfff640 0 client.28963 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.813+0000 7fa66502a740 1 -- 172.21.15.12:0/31060871 shutdown_connections 2024-09-19T06:55:48.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.813+0000 7fa66502a740 1 -- 172.21.15.12:0/31060871 wait complete. 2024-09-19T06:55:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.813+0000 7fa66502a740 20 client.28963 trim_cache size 0 max 16384 2024-09-19T06:55:48.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.852+0000 7fa66502a740 1 Processor -- start 2024-09-19T06:55:48.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.852+0000 7fa66502a740 1 -- start start 2024-09-19T06:55:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.853+0000 7fa66502a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e065e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.853+0000 7fa66502a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e080360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.853+0000 7fa66502a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e08be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.853+0000 7fa66502a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa64800eb20 con 0x55a36e0695d0 2024-09-19T06:55:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa66502a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa648010660 con 0x55a36e06ab40 2024-09-19T06:55:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa6611ee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e08be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa6611ee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e08be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:41882/0 (socket says 172.21.15.12:41882) 2024-09-19T06:55:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa6611ee640 1 -- 172.21.15.12:0/3520081039 learned_addr learned my addr 172.21.15.12:0/3520081039 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:48.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa66502a740 1 -- 172.21.15.12:0/3520081039 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa64800f1f0 con 0x55a36e074370 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa6609ed640 1 --2- 172.21.15.12:0/3520081039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e065e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa6611ee640 1 -- 172.21.15.12:0/3520081039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 msgr2=0x55a36e080360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa6611ee640 1 --2- 172.21.15.12:0/3520081039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e080360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa6611ee640 1 -- 172.21.15.12:0/3520081039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 msgr2=0x55a36e065e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa6611ee640 1 --2- 172.21.15.12:0/3520081039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e065e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.854+0000 7fa6611ee640 1 -- 172.21.15.12:0/3520081039 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36e066dd0 con 0x55a36e074370 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.855+0000 7fa6611ee640 1 --2- 172.21.15.12:0/3520081039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e08be40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa6500b8c30 tx=0x7fa650005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16722320e4f86337 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.858+0000 7fa6427fc640 1 -- 172.21.15.12:0/3520081039 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6500bbc50 con 0x55a36e074370 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.858+0000 7fa6427fc640 1 -- 172.21.15.12:0/3520081039 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6500bc2f0 con 0x55a36e074370 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.859+0000 7fa66502a740 1 -- 172.21.15.12:0/3520081039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 msgr2=0x55a36e08be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.859+0000 7fa66502a740 1 --2- 172.21.15.12:0/3520081039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e08be40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa6500b8c30 tx=0x7fa650005f10 comp rx=0 tx=0).stop 2024-09-19T06:55:48.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.859+0000 7fa66502a740 1 -- 172.21.15.12:0/3520081039 shutdown_connections 2024-09-19T06:55:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.859+0000 7fa66502a740 1 --2- 172.21.15.12:0/3520081039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e074370 0x55a36e08be40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.859+0000 7fa66502a740 1 --2- 172.21.15.12:0/3520081039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e080360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.859+0000 7fa66502a740 1 --2- 172.21.15.12:0/3520081039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e0695d0 0x55a36e065e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.859+0000 7fa66502a740 1 -- 172.21.15.12:0/3520081039 >> 172.21.15.12:0/3520081039 conn(0x55a36e032310 msgr2=0x55a36e065700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:48.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.860+0000 7fa66502a740 1 -- 172.21.15.12:0/3520081039 shutdown_connections 2024-09-19T06:55:48.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.862+0000 7fa66502a740 1 -- 172.21.15.12:0/3520081039 wait complete. 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.862+0000 7fa66502a740 1 -- start start 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.862+0000 7fa66502a740 1 Processor -- start 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.863+0000 7fa66502a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e0695d0 0x55a36e07c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.863+0000 7fa66502a740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e077ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.863+0000 7fa66502a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e074370 0x55a36e078220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.863+0000 7fa66502a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa64800ff90 con 0x55a36e074370 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.863+0000 7fa66502a740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa64800f8c0 con 0x55a36e06ab40 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.863+0000 7fa66502a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa64800cb20 con 0x55a36e0695d0 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.863+0000 7fa66502a740 10 client.0 _ll_register_callbacks cb 0x7fa6500bbe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.863+0000 7fa65bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e077ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.864+0000 7fa65bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e077ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34776/0 (socket says 172.21.15.12:34776) 2024-09-19T06:55:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.864+0000 7fa65bfff640 1 -- 172.21.15.12:0/2298170650 learned_addr learned my addr 172.21.15.12:0/2298170650 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.864+0000 7fa6609ed640 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e0695d0 0x55a36e07c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.864+0000 7fa65bfff640 1 -- 172.21.15.12:0/2298170650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e0695d0 msgr2=0x55a36e07c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:48.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.864+0000 7fa65bfff640 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e0695d0 0x55a36e07c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.864+0000 7fa65bfff640 1 -- 172.21.15.12:0/2298170650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e074370 msgr2=0x55a36e078220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:55:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.864+0000 7fa65bfff640 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e074370 0x55a36e078220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.864+0000 7fa65bfff640 1 -- 172.21.15.12:0/2298170650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a36e078760 con 0x55a36e06ab40 2024-09-19T06:55:48.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.868+0000 7fa65bfff640 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e077ce0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55a36e066ac0 tx=0x7fa65401cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31685028a92c9b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:48.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.868+0000 7fa63bfff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:55:48.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.869+0000 7fa63bfff640 1 -- 172.21.15.12:0/2298170650 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654012720 con 0x55a36e06ab40 2024-09-19T06:55:48.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.869+0000 7fa66502a740 1 -- 172.21.15.12:0/2298170650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6500bc2f0 con 0x55a36e06ab40 2024-09-19T06:55:48.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.869+0000 7fa63bfff640 1 -- 172.21.15.12:0/2298170650 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7fa654024070 con 0x55a36e06ab40 2024-09-19T06:55:48.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.869+0000 7fa63bfff640 1 -- 172.21.15.12:0/2298170650 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fa654038050 con 0x55a36e06ab40 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.873+0000 7fa66502a740 10 client.29057 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.873+0000 7fa66502a740 1 -- 172.21.15.12:0/2298170650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55a36e0eeb60 con 0x55a36e06ab40 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.873+0000 7fa63bfff640 1 -- 172.21.15.12:0/2298170650 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6500bc2f0 con 0x55a36e06ab40 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.874+0000 7fa63bfff640 1 -- 172.21.15.12:0/2298170650 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7fa654005580 con 0x55a36e06ab40 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.874+0000 7fa66502a740 10 client.29057 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.874+0000 7fa66502a740 10 client.29057 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.874+0000 7fa66502a740 20 client.29057 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.874+0000 7fa66502a740 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55a36e0ef270 0x55a36e0f1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.874+0000 7fa66502a740 4 client.29057 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.874+0000 7fa66502a740 1 -- 172.21.15.12:0/2298170650 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a36dfd6d70 con 0x55a36e0ef270 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.875+0000 7fa6609ed640 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55a36e0ef270 0x55a36e0f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:48.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa6609ed640 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55a36e0ef270 0x55a36e0f1690 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ce5d865902cbc4e5 server_cookie=d17b37a81b1c75ed in_seq=0 out_seq=0 2024-09-19T06:55:48.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa63bfff640 10 client.29057 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa63bfff640 1 -- 172.21.15.12:0/2298170650 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a36dfd6d70 con 0x55a36e0ef270 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa63bfff640 10 client.29057 handle_command_reply: tid=0 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa66502a740 1 client.29057 shutdown 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa66502a740 1 -- 172.21.15.12:0/2298170650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 msgr2=0x55a36e077ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa66502a740 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e077ce0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55a36e066ac0 tx=0x7fa65401cd80 comp rx=0 tx=0).stop 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa66502a740 1 -- 172.21.15.12:0/2298170650 shutdown_connections 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa66502a740 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x55a36e0ef270 0x55a36e0f1690 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa66502a740 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a36e074370 0x55a36e078220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa66502a740 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a36e06ab40 0x55a36e077ce0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa66502a740 1 --2- 172.21.15.12:0/2298170650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a36e0695d0 0x55a36e07c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.877+0000 7fa66502a740 1 -- 172.21.15.12:0/2298170650 >> 172.21.15.12:0/2298170650 conn(0x55a36e032310 msgr2=0x55a36e06f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:48.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.878+0000 7fa63bfff640 0 client.29057 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:55:48.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.881+0000 7fa66502a740 1 -- 172.21.15.12:0/2298170650 shutdown_connections 2024-09-19T06:55:48.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.881+0000 7fa66502a740 1 -- 172.21.15.12:0/2298170650 wait complete. 2024-09-19T06:55:48.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.881+0000 7fa66502a740 20 client.29057 trim_cache size 0 max 16384 2024-09-19T06:55:48.884 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:55:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.883+0000 7fa662c51640 1 -- 172.21.15.12:0/3384713550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa6440a35c0 msgr2=0x7fa6440a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:48.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.883+0000 7fa662c51640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa6440a35c0 0x7fa6440a5a80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa65401afd0 tx=0x7fa65401ad20 comp rx=0 tx=0).stop 2024-09-19T06:55:48.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.883+0000 7fa662c51640 1 -- 172.21.15.12:0/3384713550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65c118f60 msgr2=0x7fa65c1193e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:48.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.883+0000 7fa662c51640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65c118f60 0x7fa65c1193e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fa650004250 tx=0x7fa650004280 comp rx=0 tx=0).stop 2024-09-19T06:55:48.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.883+0000 7fa662c51640 1 -- 172.21.15.12:0/3384713550 shutdown_connections 2024-09-19T06:55:48.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.883+0000 7fa662c51640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa65c118f60 0x7fa65c1193e0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.883+0000 7fa662c51640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fa6440a35c0 0x7fa6440a5a80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.883+0000 7fa662c51640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa65c109830 0x7fa65c1a4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.883+0000 7fa662c51640 1 --2- 172.21.15.12:0/3384713550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa65c109450 0x7fa65c1a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:48.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.883+0000 7fa662c51640 1 -- 172.21.15.12:0/3384713550 >> 172.21.15.12:0/3384713550 conn(0x7fa65c06e140 msgr2=0x7fa65c10e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:48.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.884+0000 7fa662c51640 1 -- 172.21.15.12:0/3384713550 shutdown_connections 2024-09-19T06:55:48.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:48.884+0000 7fa662c51640 1 -- 172.21.15.12:0/3384713550 wait complete. 2024-09-19T06:55:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:49.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:49 smithi012 ceph-mon[30937]: pgmap v491: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-19T06:55:49.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:49 smithi016 ceph-mon[34911]: pgmap v491: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-19T06:55:49.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:55:49.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:49 smithi173 ceph-mon[35349]: pgmap v491: 97 pgs: 97 active+clean; 4.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-19T06:55:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.365+0000 7f59a3dee640 1 -- 172.21.15.12:0/1289793094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f599c109450 msgr2=0x7f599c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.365+0000 7f59a3dee640 1 --2- 172.21.15.12:0/1289793094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f599c109450 0x7f599c110250 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f598c009900 tx=0x7f598c02a440 comp rx=0 tx=0).stop 2024-09-19T06:55:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.368+0000 7f59a3dee640 1 -- 172.21.15.12:0/1289793094 shutdown_connections 2024-09-19T06:55:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.368+0000 7f59a3dee640 1 --2- 172.21.15.12:0/1289793094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c11b140 0x7f599c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.368+0000 7f59a3dee640 1 --2- 172.21.15.12:0/1289793094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f599c109830 0x7f599c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.368+0000 7f59a3dee640 1 --2- 172.21.15.12:0/1289793094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f599c109450 0x7f599c110250 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.368+0000 7f59a3dee640 1 -- 172.21.15.12:0/1289793094 >> 172.21.15.12:0/1289793094 conn(0x7f599c06e140 msgr2=0x7f599c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.369+0000 7f59a3dee640 1 -- 172.21.15.12:0/1289793094 shutdown_connections 2024-09-19T06:55:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.369+0000 7f59a3dee640 1 -- 172.21.15.12:0/1289793094 wait complete. 2024-09-19T06:55:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.370+0000 7f59a3dee640 1 Processor -- start 2024-09-19T06:55:50.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.375+0000 7f59a3dee640 1 -- start start 2024-09-19T06:55:50.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.376+0000 7f59a3dee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c109450 0x7f599c11a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:50.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.376+0000 7f59a3dee640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f599c109830 0x7f599c114930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:50.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.376+0000 7f59a3dee640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f599c11b140 0x7f599c114e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:50.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.376+0000 7f59a3dee640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f599c111350 con 0x7f599c109450 2024-09-19T06:55:50.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.376+0000 7f59a3dee640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1111d0 con 0x7f599c109830 2024-09-19T06:55:50.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.376+0000 7f59a3dee640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1114d0 con 0x7f599c11b140 2024-09-19T06:55:50.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.377+0000 7f59a1389640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f599c109830 0x7f599c114930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:50.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.377+0000 7f59a1389640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f599c109830 0x7f599c114930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:34782/0 (socket says 172.21.15.12:34782) 2024-09-19T06:55:50.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.377+0000 7f59a1389640 1 -- 172.21.15.12:0/3915220999 learned_addr learned my addr 172.21.15.12:0/3915220999 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:50.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.377+0000 7f59a1b8a640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c109450 0x7f599c11a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:50.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.381+0000 7f59a1389640 1 -- 172.21.15.12:0/3915220999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f599c11b140 msgr2=0x7f599c114e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:55:50.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.381+0000 7f59a1389640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f599c11b140 0x7f599c114e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:50.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.381+0000 7f59a1389640 1 -- 172.21.15.12:0/3915220999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c109450 msgr2=0x7f599c11a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:50.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.381+0000 7f59a1389640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c109450 0x7f599c11a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:50.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.381+0000 7f59a1389640 1 -- 172.21.15.12:0/3915220999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c1155c0 con 0x7f599c109830 2024-09-19T06:55:50.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.384+0000 7f59a1389640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f599c109830 0x7f599c114930 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f599400ebc0 tx=0x7f599400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:50.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.388+0000 7f5992ffd640 1 -- 172.21.15.12:0/3915220999 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994010630 con 0x7f599c109830 2024-09-19T06:55:50.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.388+0000 7f5992ffd640 1 -- 172.21.15.12:0/3915220999 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5994010cb0 con 0x7f599c109830 2024-09-19T06:55:50.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.388+0000 7f5992ffd640 1 -- 172.21.15.12:0/3915220999 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994018c40 con 0x7f599c109830 2024-09-19T06:55:50.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.389+0000 7f59a3dee640 1 -- 172.21.15.12:0/3915220999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c1bc130 con 0x7f599c109830 2024-09-19T06:55:50.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.389+0000 7f59a3dee640 1 -- 172.21.15.12:0/3915220999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c1bc590 con 0x7f599c109830 2024-09-19T06:55:50.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.391+0000 7f5990ff9640 1 -- 172.21.15.12:0/3915220999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c073b00 con 0x7f599c109830 2024-09-19T06:55:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.394+0000 7f5992ffd640 1 -- 172.21.15.12:0/3915220999 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f59940107d0 con 0x7f599c109830 2024-09-19T06:55:50.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.395+0000 7f5992ffd640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59880a35c0 0x7f59880a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:50.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.395+0000 7f5992ffd640 1 -- 172.21.15.12:0/3915220999 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f59940d04d0 con 0x7f599c109830 2024-09-19T06:55:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.396+0000 7f59a1b8a640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59880a35c0 0x7f59880a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:50.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.397+0000 7f59a1b8a640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59880a35c0 0x7f59880a5a80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f598c02aa30 tx=0x7f598c005850 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:50.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.403+0000 7f5992ffd640 1 -- 172.21.15.12:0/3915220999 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f599409cdb0 con 0x7f599c109830 2024-09-19T06:55:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.853+0000 7f5990ff9640 1 -- 172.21.15.12:0/3915220999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f599c115e60 con 0x7f599c109830 2024-09-19T06:55:50.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.857+0000 7f5992ffd640 1 -- 172.21.15.12:0/3915220999 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11971 (secure 0 0 0) 0x7f599409c6b0 con 0x7f599c109830 2024-09-19T06:55:50.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:55:50.858 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":53,"btime":"2024-09-19T06:55:25:083918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:55:24.579713+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:55:50.859 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 53 2024-09-19T06:55:50.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.865+0000 7f5990ff9640 1 -- 172.21.15.12:0/3915220999 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59880a35c0 msgr2=0x7f59880a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:50.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.865+0000 7f5990ff9640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59880a35c0 0x7f59880a5a80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f598c02aa30 tx=0x7f598c005850 comp rx=0 tx=0).stop 2024-09-19T06:55:50.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.865+0000 7f5990ff9640 1 -- 172.21.15.12:0/3915220999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f599c109830 msgr2=0x7f599c114930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:50.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.865+0000 7f5990ff9640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f599c109830 0x7f599c114930 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f599400ebc0 tx=0x7f599400c6a0 comp rx=0 tx=0).stop 2024-09-19T06:55:50.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.865+0000 7f5990ff9640 1 -- 172.21.15.12:0/3915220999 shutdown_connections 2024-09-19T06:55:50.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.865+0000 7f5990ff9640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f59880a35c0 0x7f59880a5a80 secure :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f598c02aa30 tx=0x7f598c005850 comp rx=0 tx=0).stop 2024-09-19T06:55:50.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.865+0000 7f5990ff9640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f599c11b140 0x7f599c114e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:50.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.865+0000 7f5990ff9640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f599c109830 0x7f599c114930 secure :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f599400ebc0 tx=0x7f599400c6a0 comp rx=0 tx=0).stop 2024-09-19T06:55:50.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.865+0000 7f5990ff9640 1 --2- 172.21.15.12:0/3915220999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f599c109450 0x7f599c11a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:50.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.865+0000 7f5990ff9640 1 -- 172.21.15.12:0/3915220999 >> 172.21.15.12:0/3915220999 conn(0x7f599c06e140 msgr2=0x7f599c070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:50.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.867+0000 7f5990ff9640 1 -- 172.21.15.12:0/3915220999 shutdown_connections 2024-09-19T06:55:50.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:50.872+0000 7f5990ff9640 1 -- 172.21.15.12:0/3915220999 wait complete. 2024-09-19T06:55:51.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.401+0000 7f500f6e4640 1 -- 172.21.15.12:0/1856012521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5008102ef0 msgr2=0x7f500810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:51.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.401+0000 7f500f6e4640 1 --2- 172.21.15.12:0/1856012521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5008102ef0 0x7f500810da40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009890 tx=0x7f4ff802a440 comp rx=0 tx=0).stop 2024-09-19T06:55:51.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.405+0000 7f500f6e4640 1 -- 172.21.15.12:0/1856012521 shutdown_connections 2024-09-19T06:55:51.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.405+0000 7f500f6e4640 1 --2- 172.21.15.12:0/1856012521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5008102ef0 0x7f500810da40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.405+0000 7f500f6e4640 1 --2- 172.21.15.12:0/1856012521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008102570 0x7f50081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.405+0000 7f500f6e4640 1 --2- 172.21.15.12:0/1856012521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5008100e20 0x7f5008101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.405+0000 7f500f6e4640 1 -- 172.21.15.12:0/1856012521 >> 172.21.15.12:0/1856012521 conn(0x7f50080fc7d0 msgr2=0x7f50080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:51.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.405+0000 7f500f6e4640 1 -- 172.21.15.12:0/1856012521 shutdown_connections 2024-09-19T06:55:51.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.405+0000 7f500f6e4640 1 -- 172.21.15.12:0/1856012521 wait complete. 2024-09-19T06:55:51.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.406+0000 7f500f6e4640 1 Processor -- start 2024-09-19T06:55:51.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.406+0000 7f500f6e4640 1 -- start start 2024-09-19T06:55:51.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.406+0000 7f500f6e4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5008100e20 0x7f5008072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.406+0000 7f500f6e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5008102570 0x7f5008073300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.406+0000 7f500f6e4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008102ef0 0x7f500806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.406+0000 7f500f6e4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f500806a760 con 0x7f5008102570 2024-09-19T06:55:51.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.406+0000 7f500f6e4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f500806a5e0 con 0x7f5008100e20 2024-09-19T06:55:51.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.406+0000 7f500f6e4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f500806a8e0 con 0x7f5008102ef0 2024-09-19T06:55:51.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.406+0000 7f500d480640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5008100e20 0x7f5008072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.407+0000 7f500d480640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5008100e20 0x7f5008072dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45112/0 (socket says 172.21.15.12:45112) 2024-09-19T06:55:51.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.407+0000 7f500d480640 1 -- 172.21.15.12:0/4043278949 learned_addr learned my addr 172.21.15.12:0/4043278949 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:51.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.407+0000 7f500dc81640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008102ef0 0x7f500806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.407+0000 7f500d480640 1 -- 172.21.15.12:0/4043278949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008102ef0 msgr2=0x7f500806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:51.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.407+0000 7f500d480640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008102ef0 0x7f500806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.407+0000 7f500d480640 1 -- 172.21.15.12:0/4043278949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5008102570 msgr2=0x7f5008073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:51.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.407+0000 7f500d480640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5008102570 0x7f5008073300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.407+0000 7f500d480640 1 -- 172.21.15.12:0/4043278949 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500806e7a0 con 0x7f5008100e20 2024-09-19T06:55:51.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.407+0000 7f500d480640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5008100e20 0x7f5008072dc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f500000cce0 tx=0x7f500000a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:51.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.410+0000 7f4ffe7fc640 1 -- 172.21.15.12:0/4043278949 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000004b20 con 0x7f5008100e20 2024-09-19T06:55:51.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.410+0000 7f4ffe7fc640 1 -- 172.21.15.12:0/4043278949 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5000004cc0 con 0x7f5008100e20 2024-09-19T06:55:51.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.411+0000 7f4ffe7fc640 1 -- 172.21.15.12:0/4043278949 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500000f7d0 con 0x7f5008100e20 2024-09-19T06:55:51.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.414+0000 7f500f6e4640 1 -- 172.21.15.12:0/4043278949 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500806ea90 con 0x7f5008100e20 2024-09-19T06:55:51.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.414+0000 7f500f6e4640 1 -- 172.21.15.12:0/4043278949 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500810e800 con 0x7f5008100e20 2024-09-19T06:55:51.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.418+0000 7f5011abd740 1 Processor -- start 2024-09-19T06:55:51.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.418+0000 7f5011abd740 1 -- start start 2024-09-19T06:55:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.419+0000 7f5011abd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bdb40 0x55b84b9bc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.419+0000 7f5011abd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 0x55b84b9bca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.419+0000 7f5011abd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 0x55b84b9c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.419+0000 7f5011abd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b84b9222f0 con 0x55b84b9c7370 2024-09-19T06:55:51.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.419+0000 7f5011abd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b84b8c9cf0 con 0x55b84b9bc5d0 2024-09-19T06:55:51.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.419+0000 7f5011abd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b84b91e2b0 con 0x55b84b9bdb40 2024-09-19T06:55:51.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.419+0000 7f500cc7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 0x55b84b9c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.420+0000 7f500cc7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 0x55b84b9c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60942/0 (socket says 172.21.15.12:60942) 2024-09-19T06:55:51.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.420+0000 7f500cc7f640 1 -- 172.21.15.12:0/1705129234 learned_addr learned my addr 172.21.15.12:0/1705129234 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:51.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.420+0000 7f500dc81640 1 --2- 172.21.15.12:0/1705129234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bdb40 0x55b84b9bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.421+0000 7f4ffe7fc640 1 -- 172.21.15.12:0/4043278949 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f500000f970 con 0x7f5008100e20 2024-09-19T06:55:51.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.421+0000 7f500cc7f640 1 -- 172.21.15.12:0/1705129234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bdb40 msgr2=0x55b84b9bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:51.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.421+0000 7f500cc7f640 1 --2- 172.21.15.12:0/1705129234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bdb40 0x55b84b9bc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.421+0000 7f500cc7f640 1 -- 172.21.15.12:0/1705129234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 msgr2=0x55b84b9bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:51.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.422+0000 7f500d480640 1 --2- 172.21.15.12:0/1705129234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 0x55b84b9bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.422+0000 7f500cc7f640 1 --2- 172.21.15.12:0/1705129234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 0x55b84b9bca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.422+0000 7f500cc7f640 1 -- 172.21.15.12:0/1705129234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84b8ae3a0 con 0x55b84b9c7370 2024-09-19T06:55:51.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.423+0000 7f4ffe7fc640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ff40a34a0 0x7f4ff40a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.423+0000 7f4ffe7fc640 1 -- 172.21.15.12:0/4043278949 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f50000d0060 con 0x7f5008100e20 2024-09-19T06:55:51.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.426+0000 7f500cc7f640 1 --2- 172.21.15.12:0/1705129234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 0x55b84b9c9760 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f500401ab30 tx=0x7f500401f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc786e5c1b4d1159 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:51.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.426+0000 7f500dc81640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ff40a34a0 0x7f4ff40a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.426+0000 7f4ff37fe640 1 -- 172.21.15.12:0/1705129234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500401fd20 con 0x55b84b9c7370 2024-09-19T06:55:51.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.427+0000 7f4ff37fe640 1 -- 172.21.15.12:0/1705129234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5004005020 con 0x55b84b9c7370 2024-09-19T06:55:51.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.428+0000 7f5011abd740 1 -- 172.21.15.12:0/1705129234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 msgr2=0x55b84b9c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:51.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.428+0000 7f5011abd740 1 --2- 172.21.15.12:0/1705129234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 0x55b84b9c9760 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f500401ab30 tx=0x7f500401f360 comp rx=0 tx=0).stop 2024-09-19T06:55:51.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.429+0000 7f500dc81640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ff40a34a0 0x7f4ff40a5960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8031000 tx=0x7f4ff802a940 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:51.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.433+0000 7f5011abd740 1 -- 172.21.15.12:0/1705129234 shutdown_connections 2024-09-19T06:55:51.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.433+0000 7f5011abd740 1 --2- 172.21.15.12:0/1705129234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 0x55b84b9c9760 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.433+0000 7f5011abd740 1 --2- 172.21.15.12:0/1705129234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 0x55b84b9bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.433+0000 7f5011abd740 1 --2- 172.21.15.12:0/1705129234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bdb40 0x55b84b9bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.433+0000 7f5011abd740 1 -- 172.21.15.12:0/1705129234 >> 172.21.15.12:0/1705129234 conn(0x55b84b985310 msgr2=0x55b84b9b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.433+0000 7f5011abd740 1 -- 172.21.15.12:0/1705129234 shutdown_connections 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.434+0000 7f5011abd740 1 -- 172.21.15.12:0/1705129234 wait complete. 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.434+0000 7f5011abd740 1 -- start start 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.434+0000 7f5011abd740 1 Processor -- start 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.435+0000 7f5011abd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.435+0000 7f5011abd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bdb40 0x55b84b9c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.435+0000 7f5011abd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 0x55b84b9c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.435+0000 7f5011abd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b84b9ca110 con 0x55b84b9c7370 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.435+0000 7f5011abd740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b84b8dd060 con 0x55b84b9bdb40 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.435+0000 7f5011abd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b84b9ca290 con 0x55b84b9bc5d0 2024-09-19T06:55:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.435+0000 7f5011abd740 10 client.0 _ll_register_callbacks cb 0x55b84b6308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.436+0000 7f500d480640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.436+0000 7f500d480640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40016/0 (socket says 172.21.15.12:40016) 2024-09-19T06:55:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.436+0000 7f500d480640 1 -- 172.21.15.12:0/4238970027 learned_addr learned my addr 172.21.15.12:0/4238970027 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.436+0000 7f500cc7f640 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bdb40 0x55b84b9c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.436+0000 7f500d480640 1 -- 172.21.15.12:0/4238970027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bdb40 msgr2=0x55b84b9c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.436+0000 7f500d480640 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bdb40 0x55b84b9c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.436+0000 7f500d480640 1 -- 172.21.15.12:0/4238970027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 msgr2=0x55b84b9c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.436+0000 7f500d480640 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 0x55b84b9c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.436+0000 7f500d480640 1 -- 172.21.15.12:0/4238970027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84b6933c0 con 0x55b84b9bc5d0 2024-09-19T06:55:51.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.437+0000 7f500d480640 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9c6b50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5000007910 tx=0x7f500009bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd80841b8ac353ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:51.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.438+0000 7f4ff0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:55:51.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.439+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/4238970027 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500009c2c0 con 0x55b84b9bc5d0 2024-09-19T06:55:51.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.439+0000 7f5011abd740 1 -- 172.21.15.12:0/4238970027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5004005020 con 0x55b84b9bc5d0 2024-09-19T06:55:51.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.440+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/4238970027 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f50000d20d0 con 0x55b84b9bc5d0 2024-09-19T06:55:51.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.440+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/4238970027 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f50000d22d0 con 0x55b84b9bc5d0 2024-09-19T06:55:51.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.440+0000 7f5011abd740 10 client.28984 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:51.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.440+0000 7f5011abd740 1 -- 172.21.15.12:0/4238970027 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55b84b9f7a60 con 0x55b84b9bc5d0 2024-09-19T06:55:51.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.442+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/4238970027 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5004005020 con 0x55b84b9bc5d0 2024-09-19T06:55:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.443+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/4238970027 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f500009b710 con 0x55b84b9bc5d0 2024-09-19T06:55:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.443+0000 7f5011abd740 10 client.28984 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.443+0000 7f5011abd740 10 client.28984 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:55:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.443+0000 7f5011abd740 20 client.28984 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.443+0000 7f5011abd740 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55b84b9f8e70 0x55b84b9fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.443+0000 7f5011abd740 4 client.28984 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.443+0000 7f5011abd740 1 -- 172.21.15.12:0/4238970027 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b84b92f860 con 0x55b84b9f8e70 2024-09-19T06:55:51.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.445+0000 7f500cc7f640 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55b84b9f8e70 0x55b84b9fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.454+0000 7f500cc7f640 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55b84b9f8e70 0x55b84b9fb2c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=506da48f5ae85914 server_cookie=6dc8c6a0f9af8665 in_seq=0 out_seq=0 2024-09-19T06:55:51.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.454+0000 7f4ff0ff9640 10 client.28984 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:55:51.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.455+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/4238970027 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b84b92f860 con 0x55b84b9f8e70 2024-09-19T06:55:51.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.455+0000 7f4ff0ff9640 10 client.28984 handle_command_reply: tid=0 2024-09-19T06:55:51.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.455+0000 7f5011abd740 1 client.28984 shutdown 2024-09-19T06:55:51.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.458+0000 7f5011abd740 1 -- 172.21.15.12:0/4238970027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 msgr2=0x55b84b9c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:51.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.458+0000 7f5011abd740 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9c6b50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5000007910 tx=0x7f500009bec0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.459+0000 7f5011abd740 1 -- 172.21.15.12:0/4238970027 shutdown_connections 2024-09-19T06:55:51.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.459+0000 7f5011abd740 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55b84b9f8e70 0x55b84b9fb2c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.459+0000 7f5011abd740 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9c7370 0x55b84b9c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.459+0000 7f5011abd740 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bdb40 0x55b84b9c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.459+0000 7f5011abd740 1 --2- 172.21.15.12:0/4238970027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9c6b50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.459+0000 7f5011abd740 1 -- 172.21.15.12:0/4238970027 >> 172.21.15.12:0/4238970027 conn(0x55b84b985310 msgr2=0x55b84b9be960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:51.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.459+0000 7f4ff0ff9640 0 client.28984 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:55:51.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.459+0000 7f5011abd740 1 -- 172.21.15.12:0/4238970027 shutdown_connections 2024-09-19T06:55:51.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.459+0000 7f5011abd740 1 -- 172.21.15.12:0/4238970027 wait complete. 2024-09-19T06:55:51.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.459+0000 7f5011abd740 20 client.28984 trim_cache size 0 max 16384 2024-09-19T06:55:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.488+0000 7f5011abd740 1 Processor -- start 2024-09-19T06:55:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.488+0000 7f5011abd740 1 -- start start 2024-09-19T06:55:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.489+0000 7f5011abd740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 0x55b84ba00b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.489+0000 7f5011abd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9bdb40 0x55b84ba01070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.489+0000 7f5011abd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9c7370 0x55b84b9c1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.489+0000 7f500d480640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 0x55b84ba00b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.489+0000 7f500d480640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 0x55b84ba00b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45140/0 (socket says 172.21.15.12:45140) 2024-09-19T06:55:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.489+0000 7f500d480640 1 -- 172.21.15.12:0/8595119 learned_addr learned my addr 172.21.15.12:0/8595119 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.490+0000 7f500dc81640 1 --2- 172.21.15.12:0/8595119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9c7370 0x55b84b9c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.490+0000 7f5011abd740 1 -- 172.21.15.12:0/8595119 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f50081a2ff0 con 0x55b84b9bdb40 2024-09-19T06:55:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.490+0000 7f5011abd740 1 -- 172.21.15.12:0/8595119 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f50081a4b30 con 0x55b84b9bc5d0 2024-09-19T06:55:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.490+0000 7f5011abd740 1 -- 172.21.15.12:0/8595119 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f50081a36c0 con 0x55b84b9c7370 2024-09-19T06:55:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.490+0000 7f500dc81640 1 -- 172.21.15.12:0/8595119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 msgr2=0x55b84ba00b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.490+0000 7f500dc81640 1 --2- 172.21.15.12:0/8595119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 0x55b84ba00b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.490+0000 7f500dc81640 1 -- 172.21.15.12:0/8595119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9bdb40 msgr2=0x55b84ba01070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.490+0000 7f500dc81640 1 --2- 172.21.15.12:0/8595119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9bdb40 0x55b84ba01070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.490+0000 7f500dc81640 1 -- 172.21.15.12:0/8595119 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84b9b91a0 con 0x55b84b9c7370 2024-09-19T06:55:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.491+0000 7f500dc81640 1 --2- 172.21.15.12:0/8595119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9c7370 0x55b84b9c1080 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4ff802aa30 tx=0x7f4ff8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4b416578380960d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.491+0000 7f4ff2ffd640 1 -- 172.21.15.12:0/8595119 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8030520 con 0x55b84b9c7370 2024-09-19T06:55:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.491+0000 7f4ff2ffd640 1 -- 172.21.15.12:0/8595119 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ff8042070 con 0x55b84b9c7370 2024-09-19T06:55:51.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.493+0000 7f5011abd740 1 -- 172.21.15.12:0/8595119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9c7370 msgr2=0x55b84b9c1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:51.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.493+0000 7f5011abd740 1 --2- 172.21.15.12:0/8595119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9c7370 0x55b84b9c1080 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4ff802aa30 tx=0x7f4ff8005f90 comp rx=0 tx=0).stop 2024-09-19T06:55:51.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.493+0000 7f5011abd740 1 -- 172.21.15.12:0/8595119 shutdown_connections 2024-09-19T06:55:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.493+0000 7f5011abd740 1 --2- 172.21.15.12:0/8595119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9c7370 0x55b84b9c1080 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.493+0000 7f5011abd740 1 --2- 172.21.15.12:0/8595119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9bdb40 0x55b84ba01070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.493+0000 7f5011abd740 1 --2- 172.21.15.12:0/8595119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9bc5d0 0x55b84ba00b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.493+0000 7f5011abd740 1 -- 172.21.15.12:0/8595119 >> 172.21.15.12:0/8595119 conn(0x55b84b985310 msgr2=0x55b84b9c26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:51.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:51 smithi012 ceph-mon[30937]: pgmap v492: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.7 MiB/s wr, 303 op/s 2024-09-19T06:55:51.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:51 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3915220999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:51.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.494+0000 7f5011abd740 1 -- 172.21.15.12:0/8595119 shutdown_connections 2024-09-19T06:55:51.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.494+0000 7f5011abd740 1 -- 172.21.15.12:0/8595119 wait complete. 2024-09-19T06:55:51.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.494+0000 7f5011abd740 1 -- start start 2024-09-19T06:55:51.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.494+0000 7f5011abd740 1 Processor -- start 2024-09-19T06:55:51.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.495+0000 7f5011abd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.496+0000 7f5011abd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9bdb40 0x55b84b9c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.496+0000 7f500d480640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.497+0000 7f500d480640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40036/0 (socket says 172.21.15.12:40036) 2024-09-19T06:55:51.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.497+0000 7f500d480640 1 -- 172.21.15.12:0/226014989 learned_addr learned my addr 172.21.15.12:0/226014989 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:51.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.497+0000 7f5011abd740 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9c0c30 0x55b84b9c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.497+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f50081a4460 con 0x55b84b9bdb40 2024-09-19T06:55:51.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.497+0000 7f500dc81640 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9c0c30 0x55b84b9c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.498+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f50081a3d90 con 0x55b84b9c0c30 2024-09-19T06:55:51.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.498+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f500806ec60 con 0x55b84b9bc5d0 2024-09-19T06:55:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.498+0000 7f500d480640 1 -- 172.21.15.12:0/226014989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9c0c30 msgr2=0x55b84b9c10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.498+0000 7f500d480640 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9c0c30 0x55b84b9c10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.498+0000 7f500d480640 1 -- 172.21.15.12:0/226014989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9bdb40 msgr2=0x55b84b9c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.498+0000 7f500d480640 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9bdb40 0x55b84b9c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.498+0000 7f500d480640 1 -- 172.21.15.12:0/226014989 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84b9d0180 con 0x55b84b9bc5d0 2024-09-19T06:55:51.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.499+0000 7f500d480640 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9cf990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f500009a810 tx=0x7f50000a0590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8aab9ba5e677dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:51.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.499+0000 7f5011abd740 10 client.0 _ll_register_callbacks cb 0x7f500009c090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:51.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.500+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b84b929d70 con 0x55b84b9bc5d0 2024-09-19T06:55:51.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.500+0000 7f4ff0ff9640 10 client.28990 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:55:51.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.500+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/226014989 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50000a0670 con 0x55b84b9bc5d0 2024-09-19T06:55:51.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.500+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/226014989 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f50000cde00 con 0x55b84b9bc5d0 2024-09-19T06:55:51.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.501+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/226014989 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f50000a4f30 con 0x55b84b9bc5d0 2024-09-19T06:55:51.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.504+0000 7f5011abd740 10 client.28990 fetch_fsmap learned FSMap version 53 2024-09-19T06:55:51.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.504+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({fsmap=53}) -- 0x55b84ba639b0 con 0x55b84b9bc5d0 2024-09-19T06:55:51.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.504+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/226014989 <== mon.1 v2:172.21.15.173:3300/0 4 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7f5000098010 con 0x55b84b9bc5d0 2024-09-19T06:55:51.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.504+0000 7f5011abd740 10 client.28990 fetch_fsmap finished waiting for FSMap version 53 2024-09-19T06:55:51.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.504+0000 7f5011abd740 10 client.28990 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:55:51.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.504+0000 7f5011abd740 20 client.28990 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:51.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.504+0000 7f5011abd740 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55b84ba63e30 0x55b84ba662a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:51.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.504+0000 7f5011abd740 4 client.28990 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:55:51.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.504+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b84b929d70 con 0x55b84ba63e30 2024-09-19T06:55:51.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.505+0000 7f500cc7f640 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55b84ba63e30 0x55b84ba662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:51.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f500cc7f640 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55b84ba63e30 0x55b84ba662a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84a661f77c3edc3 server_cookie=d67ad8d7dc7ca2ee in_seq=0 out_seq=0 2024-09-19T06:55:51.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f4ff0ff9640 10 client.28990 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:55:51.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f4ff0ff9640 1 -- 172.21.15.12:0/226014989 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b84b929d70 con 0x55b84ba63e30 2024-09-19T06:55:51.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f4ff0ff9640 10 client.28990 handle_command_reply: tid=0 2024-09-19T06:55:51.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f5011abd740 1 client.28990 shutdown 2024-09-19T06:55:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 msgr2=0x55b84b9cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f5011abd740 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9cf990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f500009a810 tx=0x7f50000a0590 comp rx=0 tx=0).stop 2024-09-19T06:55:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 shutdown_connections 2024-09-19T06:55:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f5011abd740 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55b84ba63e30 0x55b84ba662a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f5011abd740 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b84b9c0c30 0x55b84b9c10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f5011abd740 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b84b9bdb40 0x55b84b9c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f5011abd740 1 --2- 172.21.15.12:0/226014989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b84b9bc5d0 0x55b84b9cf990 secure :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f500009a810 tx=0x7f50000a0590 comp rx=0 tx=0).stop 2024-09-19T06:55:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.506+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 >> 172.21.15.12:0/226014989 conn(0x55b84b985310 msgr2=0x55b84b9b7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.507+0000 7f4ff0ff9640 0 client.28990 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:55:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.507+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 shutdown_connections 2024-09-19T06:55:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.507+0000 7f5011abd740 1 -- 172.21.15.12:0/226014989 wait complete. 2024-09-19T06:55:51.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.510+0000 7f5011abd740 20 client.28990 trim_cache size 0 max 16384 2024-09-19T06:55:51.515 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:55:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.516+0000 7f500f6e4640 1 -- 172.21.15.12:0/4043278949 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ff40a34a0 msgr2=0x7f4ff40a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.516+0000 7f500f6e4640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ff40a34a0 0x7f4ff40a5960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8031000 tx=0x7f4ff802a940 comp rx=0 tx=0).stop 2024-09-19T06:55:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.516+0000 7f500f6e4640 1 -- 172.21.15.12:0/4043278949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5008100e20 msgr2=0x7f5008072dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.516+0000 7f500f6e4640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5008100e20 0x7f5008072dc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f500000cce0 tx=0x7f500000a620 comp rx=0 tx=0).stop 2024-09-19T06:55:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.516+0000 7f500f6e4640 1 -- 172.21.15.12:0/4043278949 shutdown_connections 2024-09-19T06:55:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.516+0000 7f500f6e4640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4ff40a34a0 0x7f4ff40a5960 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.516+0000 7f500f6e4640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5008102ef0 0x7f500806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.516+0000 7f500f6e4640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5008102570 0x7f5008073300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.517+0000 7f500f6e4640 1 --2- 172.21.15.12:0/4043278949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5008100e20 0x7f5008072dc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.517+0000 7f500f6e4640 1 -- 172.21.15.12:0/4043278949 >> 172.21.15.12:0/4043278949 conn(0x7f50080fc7d0 msgr2=0x7f5008103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.517+0000 7f500f6e4640 1 -- 172.21.15.12:0/4043278949 shutdown_connections 2024-09-19T06:55:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:51.517+0000 7f500f6e4640 1 -- 172.21.15.12:0/4043278949 wait complete. 2024-09-19T06:55:51.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:51 smithi016 ceph-mon[34911]: pgmap v492: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.7 MiB/s wr, 303 op/s 2024-09-19T06:55:51.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:51 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3915220999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:51.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:51 smithi173 ceph-mon[35349]: pgmap v492: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.7 MiB/s wr, 303 op/s 2024-09-19T06:55:51.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:51 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3915220999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:55:52.128 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0' 2024-09-19T06:55:52.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0 2024-09-19T06:55:52.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:55:53.090 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:53.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:53 smithi012 ceph-mon[30937]: pgmap v493: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 3.2 MiB/s wr, 353 op/s 2024-09-19T06:55:53.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:53 smithi016 ceph-mon[34911]: pgmap v493: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 3.2 MiB/s wr, 353 op/s 2024-09-19T06:55:53.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.794+0000 7fd4a694a640 1 -- 172.21.15.12:0/1348204302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a01027a0 msgr2=0x7fd4a01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:53.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.794+0000 7fd4a694a640 1 --2- 172.21.15.12:0/1348204302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a01027a0 0x7fd4a01067f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd48801a910 tx=0x7fd48803b450 comp rx=0 tx=0).stop 2024-09-19T06:55:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.798+0000 7fd4a694a640 1 -- 172.21.15.12:0/1348204302 shutdown_connections 2024-09-19T06:55:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.798+0000 7fd4a694a640 1 --2- 172.21.15.12:0/1348204302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4a0106f20 0x7fd4a010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.798+0000 7fd4a694a640 1 --2- 172.21.15.12:0/1348204302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a01027a0 0x7fd4a01067f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.798+0000 7fd4a694a640 1 --2- 172.21.15.12:0/1348204302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a0101df0 0x7fd4a01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.798+0000 7fd4a694a640 1 -- 172.21.15.12:0/1348204302 >> 172.21.15.12:0/1348204302 conn(0x7fd4a00fd8f0 msgr2=0x7fd4a00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:53.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.799+0000 7fd4a694a640 1 -- 172.21.15.12:0/1348204302 shutdown_connections 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.799+0000 7fd4a694a640 1 -- 172.21.15.12:0/1348204302 wait complete. 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.800+0000 7fd4a694a640 1 Processor -- start 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.800+0000 7fd4a694a640 1 -- start start 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.800+0000 7fd4a694a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a0101df0 0x7fd4a0075e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.800+0000 7fd4a694a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a01027a0 0x7fd4a0074420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.800+0000 7fd4a694a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4a0106f20 0x7fd4a0074960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.800+0000 7fd4a694a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a006e630 con 0x7fd4a0106f20 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.800+0000 7fd4a694a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a006e4b0 con 0x7fd4a0101df0 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.800+0000 7fd4a694a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a006e7b0 con 0x7fd4a01027a0 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.801+0000 7fd4a4ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4a0106f20 0x7fd4a0074960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.801+0000 7fd4a4ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4a0106f20 0x7fd4a0074960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60992/0 (socket says 172.21.15.12:60992) 2024-09-19T06:55:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.801+0000 7fd4a4ee7640 1 -- 172.21.15.12:0/2522371362 learned_addr learned my addr 172.21.15.12:0/2522371362 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.801+0000 7fd497fff640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a01027a0 0x7fd4a0074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.802+0000 7fd49ffff640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a0101df0 0x7fd4a0075e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.802+0000 7fd4a4ee7640 1 -- 172.21.15.12:0/2522371362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a01027a0 msgr2=0x7fd4a0074420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.802+0000 7fd4a4ee7640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a01027a0 0x7fd4a0074420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.802+0000 7fd4a4ee7640 1 -- 172.21.15.12:0/2522371362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a0101df0 msgr2=0x7fd4a0075e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.802+0000 7fd4a4ee7640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a0101df0 0x7fd4a0075e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.802+0000 7fd4a4ee7640 1 -- 172.21.15.12:0/2522371362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a0074fd0 con 0x7fd4a0106f20 2024-09-19T06:55:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.802+0000 7fd49ffff640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a0101df0 0x7fd4a0075e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.803+0000 7fd4a4ee7640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4a0106f20 0x7fd4a0074960 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fd49800eb10 tx=0x7fd49800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:53.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.804+0000 7fd49dffb640 1 -- 172.21.15.12:0/2522371362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498004b20 con 0x7fd4a0106f20 2024-09-19T06:55:53.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.804+0000 7fd49dffb640 1 -- 172.21.15.12:0/2522371362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd498004cc0 con 0x7fd4a0106f20 2024-09-19T06:55:53.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.804+0000 7fd49dffb640 1 -- 172.21.15.12:0/2522371362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498010760 con 0x7fd4a0106f20 2024-09-19T06:55:53.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.804+0000 7fd4a694a640 1 -- 172.21.15.12:0/2522371362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a0194300 con 0x7fd4a0106f20 2024-09-19T06:55:53.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.804+0000 7fd4a694a640 1 -- 172.21.15.12:0/2522371362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a01947c0 con 0x7fd4a0106f20 2024-09-19T06:55:53.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.808+0000 7fd4a8d23740 1 Processor -- start 2024-09-19T06:55:53.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.809+0000 7fd49dffb640 1 -- 172.21.15.12:0/2522371362 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd498010900 con 0x7fd4a0106f20 2024-09-19T06:55:53.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.810+0000 7fd4a8d23740 1 -- start start 2024-09-19T06:55:53.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.811+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c6f850 0x560a04c6fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.811+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c70170 0x560a04c7a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.811+0000 7fd49dffb640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd48c0a3540 0x7fd48c0a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.811+0000 7fd49dffb640 1 -- 172.21.15.12:0/2522371362 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7fd4980d0190 con 0x7fd4a0106f20 2024-09-19T06:55:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.812+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c7ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.812+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560a04bd4160 con 0x560a04c7aa30 2024-09-19T06:55:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.812+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560a04b7b720 con 0x560a04c70170 2024-09-19T06:55:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.812+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560a04bd0120 con 0x560a04c6f850 2024-09-19T06:55:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.812+0000 7fd497fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c6f850 0x560a04c6fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.812+0000 7fd497fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c6f850 0x560a04c6fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40062/0 (socket says 172.21.15.12:40062) 2024-09-19T06:55:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.812+0000 7fd497fff640 1 -- 172.21.15.12:0/982197095 learned_addr learned my addr 172.21.15.12:0/982197095 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.813+0000 7fd4a4ee7640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd48c0a3540 0x7fd48c0a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.813+0000 7fd497fff640 1 --2- 172.21.15.12:0/982197095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c7ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.813+0000 7fd497fff640 1 -- 172.21.15.12:0/982197095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c70170 msgr2=0x560a04c7a4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:55:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.813+0000 7fd497fff640 1 --2- 172.21.15.12:0/982197095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c70170 0x560a04c7a4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.813+0000 7fd497fff640 1 -- 172.21.15.12:0/982197095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 msgr2=0x560a04c7ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.813+0000 7fd497fff640 1 --2- 172.21.15.12:0/982197095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c7ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.813+0000 7fd497fff640 1 -- 172.21.15.12:0/982197095 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a04945ba0 con 0x560a04c6f850 2024-09-19T06:55:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.814+0000 7fd497fff640 1 --2- 172.21.15.12:0/982197095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c6f850 0x560a04c6fc30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd48801a860 tx=0x7fd488040550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7527ec49cb75ebcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.814+0000 7fd4967fc640 1 -- 172.21.15.12:0/982197095 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488054020 con 0x560a04c6f850 2024-09-19T06:55:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.814+0000 7fd4967fc640 1 -- 172.21.15.12:0/982197095 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd488040c50 con 0x560a04c6f850 2024-09-19T06:55:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.815+0000 7fd4967fc640 1 -- 172.21.15.12:0/982197095 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488046030 con 0x560a04c6f850 2024-09-19T06:55:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.815+0000 7fd4a8d23740 1 -- 172.21.15.12:0/982197095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c6f850 msgr2=0x560a04c6fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.815+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/982197095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c6f850 0x560a04c6fc30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd48801a860 tx=0x7fd488040550 comp rx=0 tx=0).stop 2024-09-19T06:55:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.815+0000 7fd4a4ee7640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd48c0a3540 0x7fd48c0a5a00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd4980cd990 tx=0x7fd498009a70 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.815+0000 7fd4a8d23740 1 -- 172.21.15.12:0/982197095 shutdown_connections 2024-09-19T06:55:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.815+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/982197095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c7ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.815+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/982197095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c70170 0x560a04c7a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.815+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/982197095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c6f850 0x560a04c6fc30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.816+0000 7fd4a8d23740 1 -- 172.21.15.12:0/982197095 >> 172.21.15.12:0/982197095 conn(0x560a04c6bde0 msgr2=0x560a04c6c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.816+0000 7fd4a8d23740 1 -- 172.21.15.12:0/982197095 shutdown_connections 2024-09-19T06:55:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.816+0000 7fd4a8d23740 1 -- 172.21.15.12:0/982197095 wait complete. 2024-09-19T06:55:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.817+0000 7fd4a8d23740 1 -- start start 2024-09-19T06:55:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.817+0000 7fd4a8d23740 1 Processor -- start 2024-09-19T06:55:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.818+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.818+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c70170 0x560a04c77e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.818+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c78350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.818+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560a04c7d650 con 0x560a04c7aa30 2024-09-19T06:55:53.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.818+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x560a04b5c900 con 0x560a04c6f850 2024-09-19T06:55:53.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.819+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560a04c7d7d0 con 0x560a04c70170 2024-09-19T06:55:53.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.819+0000 7fd4a8d23740 10 client.0 _ll_register_callbacks cb 0x560a04b5a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:53.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.819+0000 7fd497fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.819+0000 7fd497fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c778d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45194/0 (socket says 172.21.15.12:45194) 2024-09-19T06:55:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.819+0000 7fd497fff640 1 -- 172.21.15.12:0/1869271651 learned_addr learned my addr 172.21.15.12:0/1869271651 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.819+0000 7fd497fff640 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c78350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.820+0000 7fd497fff640 1 -- 172.21.15.12:0/1869271651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c70170 msgr2=0x560a04c77e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:55:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.820+0000 7fd497fff640 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c70170 0x560a04c77e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.820+0000 7fd497fff640 1 -- 172.21.15.12:0/1869271651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 msgr2=0x560a04c78350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.820+0000 7fd497fff640 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c78350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.820+0000 7fd497fff640 1 -- 172.21.15.12:0/1869271651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a04b9cc50 con 0x560a04c6f850 2024-09-19T06:55:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.820+0000 7fd497fff640 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c778d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd48801a910 tx=0x7fd4880053b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ab681c55d2b59b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.820+0000 7fd47f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:55:53.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.820+0000 7fd47f7fe640 1 -- 172.21.15.12:0/1869271651 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488054070 con 0x560a04c6f850 2024-09-19T06:55:53.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.821+0000 7fd47f7fe640 1 -- 172.21.15.12:0/1869271651 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7fd488004030 con 0x560a04c6f850 2024-09-19T06:55:53.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.821+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1869271651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd488040c50 con 0x560a04c6f850 2024-09-19T06:55:53.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.821+0000 7fd47f7fe640 1 -- 172.21.15.12:0/1869271651 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd488046070 con 0x560a04c6f850 2024-09-19T06:55:53.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.821+0000 7fd4a8d23740 10 client.29084 fetch_fsmap learned FSMap version 54 2024-09-19T06:55:53.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.821+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1869271651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x560a04c89390 con 0x560a04c6f850 2024-09-19T06:55:53.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.822+0000 7fd47f7fe640 1 -- 172.21.15.12:0/1869271651 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd488004230 con 0x560a04c6f850 2024-09-19T06:55:53.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.822+0000 7fd47f7fe640 1 -- 172.21.15.12:0/1869271651 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 54) ==== 8366+0+0 (secure 0 0 0) 0x7fd48804b040 con 0x560a04c6f850 2024-09-19T06:55:53.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.822+0000 7fd4a8d23740 10 client.29084 fetch_fsmap finished waiting for FSMap version 54 2024-09-19T06:55:53.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.822+0000 7fd4a8d23740 10 client.29084 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:55:53.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.822+0000 7fd4a8d23740 20 client.29084 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:53.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.822+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560a04c8a6e0 0x560a04c8cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.822+0000 7fd4a8d23740 4 client.29084 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:53.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.822+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1869271651 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd488040c50 con 0x560a04c8a6e0 2024-09-19T06:55:53.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.823+0000 7fd49ffff640 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560a04c8a6e0 0x560a04c8cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.824+0000 7fd47f7fe640 10 client.29084 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:53.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.824+0000 7fd49ffff640 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560a04c8a6e0 0x560a04c8cad0 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a6d668a9f1bf42 server_cookie=d2c7a5fb97a915e5 in_seq=0 out_seq=0 2024-09-19T06:55:53.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.825+0000 7fd47f7fe640 1 -- 172.21.15.12:0/1869271651 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd488040c50 con 0x560a04c8a6e0 2024-09-19T06:55:53.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.825+0000 7fd47f7fe640 10 client.29084 handle_command_reply: tid=0 2024-09-19T06:55:53.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.825+0000 7fd4a8d23740 1 client.29084 shutdown 2024-09-19T06:55:53.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.826+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1869271651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 msgr2=0x560a04c778d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:53.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.826+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c778d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd48801a910 tx=0x7fd4880053b0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.827+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1869271651 shutdown_connections 2024-09-19T06:55:53.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.827+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560a04c8a6e0 0x560a04c8cad0 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.827+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c78350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.827+0000 7fd47f7fe640 0 client.29084 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:53.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.827+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c70170 0x560a04c77e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.827+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/1869271651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c778d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.827+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1869271651 >> 172.21.15.12:0/1869271651 conn(0x560a04c6bde0 msgr2=0x560a04c71b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:53.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.827+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1869271651 shutdown_connections 2024-09-19T06:55:53.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.827+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1869271651 wait complete. 2024-09-19T06:55:53.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.828+0000 7fd4a8d23740 20 client.29084 trim_cache size 0 max 16384 2024-09-19T06:55:53.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:53 smithi173 ceph-mon[35349]: pgmap v493: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 3.2 MiB/s wr, 353 op/s 2024-09-19T06:55:53.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.863+0000 7fd4a8d23740 1 Processor -- start 2024-09-19T06:55:53.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd4a8d23740 1 -- start start 2024-09-19T06:55:53.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c70170 0x560a04c781a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c8faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd48000ead0 con 0x560a04c7aa30 2024-09-19T06:55:53.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd497fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd480010640 con 0x560a04c6f850 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd48000f1a0 con 0x560a04c70170 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd497fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45196/0 (socket says 172.21.15.12:45196) 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd497fff640 1 -- 172.21.15.12:0/1171285255 learned_addr learned my addr 172.21.15.12:0/1171285255 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.864+0000 7fd49ffff640 1 --2- 172.21.15.12:0/1171285255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c70170 0x560a04c781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.865+0000 7fd497fff640 1 -- 172.21.15.12:0/1171285255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c70170 msgr2=0x560a04c781a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.865+0000 7fd497fff640 1 --2- 172.21.15.12:0/1171285255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c70170 0x560a04c781a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.865+0000 7fd497fff640 1 -- 172.21.15.12:0/1171285255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 msgr2=0x560a04c8faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.865+0000 7fd497fff640 1 --2- 172.21.15.12:0/1171285255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c8faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.865+0000 7fd497fff640 1 -- 172.21.15.12:0/1171285255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a04c7d190 con 0x560a04c6f850 2024-09-19T06:55:53.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.865+0000 7fd497fff640 1 --2- 172.21.15.12:0/1171285255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c722b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd488003c30 tx=0x7fd488040be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea832efceafda10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.866+0000 7fd495ffb640 1 -- 172.21.15.12:0/1171285255 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488054040 con 0x560a04c6f850 2024-09-19T06:55:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.866+0000 7fd495ffb640 1 -- 172.21.15.12:0/1171285255 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd488040850 con 0x560a04c6f850 2024-09-19T06:55:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.866+0000 7fd495ffb640 1 -- 172.21.15.12:0/1171285255 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4880044d0 con 0x560a04c6f850 2024-09-19T06:55:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.866+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1171285255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 msgr2=0x560a04c722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.866+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/1171285255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c722b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd488003c30 tx=0x7fd488040be0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.867+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1171285255 shutdown_connections 2024-09-19T06:55:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.867+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/1171285255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c7aa30 0x560a04c8faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.867+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/1171285255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c70170 0x560a04c781a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.867+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/1171285255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c6f850 0x560a04c722b0 secure :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd488003c30 tx=0x7fd488040be0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.867+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1171285255 >> 172.21.15.12:0/1171285255 conn(0x560a04c6bde0 msgr2=0x560a04c86320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:53.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.867+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1171285255 shutdown_connections 2024-09-19T06:55:53.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.867+0000 7fd4a8d23740 1 -- 172.21.15.12:0/1171285255 wait complete. 2024-09-19T06:55:53.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.867+0000 7fd4a8d23740 1 -- start start 2024-09-19T06:55:53.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.868+0000 7fd4a8d23740 1 Processor -- start 2024-09-19T06:55:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.868+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c70170 0x560a04c8da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.868+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c7aa30 0x560a04c8df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.868+0000 7fd4a8d23740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c8e480 0x560a04cf4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.868+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd48000ff40 con 0x560a04c70170 2024-09-19T06:55:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.868+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd48000f870 con 0x560a04c7aa30 2024-09-19T06:55:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.868+0000 7fd4a8d23740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd48000cad0 con 0x560a04c8e480 2024-09-19T06:55:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.868+0000 7fd4a8d23740 10 client.0 _ll_register_callbacks cb 0x7fd488040b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:53.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.869+0000 7fd49ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c7aa30 0x560a04c8df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.869+0000 7fd49ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c7aa30 0x560a04c8df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45212/0 (socket says 172.21.15.12:45212) 2024-09-19T06:55:53.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.869+0000 7fd49ffff640 1 -- 172.21.15.12:0/3572763107 learned_addr learned my addr 172.21.15.12:0/3572763107 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:53.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.869+0000 7fd497fff640 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c8e480 0x560a04cf4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.871+0000 7fd497fff640 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c70170 0x560a04c8da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.871+0000 7fd49ffff640 1 -- 172.21.15.12:0/3572763107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c8e480 msgr2=0x560a04cf4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.871+0000 7fd49ffff640 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c8e480 0x560a04cf4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.871+0000 7fd49ffff640 1 -- 172.21.15.12:0/3572763107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c70170 msgr2=0x560a04c8da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.871+0000 7fd49ffff640 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c70170 0x560a04c8da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:53.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.871+0000 7fd49ffff640 1 -- 172.21.15.12:0/3572763107 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a04cf45e0 con 0x560a04c7aa30 2024-09-19T06:55:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.872+0000 7fd49ffff640 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c7aa30 0x560a04c8df40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x560a04c78f10 tx=0x7fd49000aeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a40d2d3829feab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.872+0000 7fd47f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:55:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.872+0000 7fd47f7fe640 1 -- 172.21.15.12:0/3572763107 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490015bb0 con 0x560a04c7aa30 2024-09-19T06:55:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.872+0000 7fd47f7fe640 1 -- 172.21.15.12:0/3572763107 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7fd490015d50 con 0x560a04c7aa30 2024-09-19T06:55:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.872+0000 7fd4a8d23740 1 -- 172.21.15.12:0/3572763107 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd488040850 con 0x560a04c7aa30 2024-09-19T06:55:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.873+0000 7fd47f7fe640 1 -- 172.21.15.12:0/3572763107 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd490027450 con 0x560a04c7aa30 2024-09-19T06:55:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.873+0000 7fd4a8d23740 10 client.29090 fetch_fsmap learned FSMap version 54 2024-09-19T06:55:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.873+0000 7fd4a8d23740 1 -- 172.21.15.12:0/3572763107 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x560a04cf58d0 con 0x560a04c7aa30 2024-09-19T06:55:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.873+0000 7fd47f7fe640 1 -- 172.21.15.12:0/3572763107 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd490022070 con 0x560a04c7aa30 2024-09-19T06:55:53.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.873+0000 7fd47f7fe640 1 -- 172.21.15.12:0/3572763107 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 54) ==== 8366+0+0 (secure 0 0 0) 0x7fd49001d7f0 con 0x560a04c7aa30 2024-09-19T06:55:53.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.874+0000 7fd4a8d23740 10 client.29090 fetch_fsmap finished waiting for FSMap version 54 2024-09-19T06:55:53.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.874+0000 7fd4a8d23740 10 client.29090 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:55:53.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.874+0000 7fd4a8d23740 20 client.29090 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:53.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.874+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560a04cf6140 0x560a04cf8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:53.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.874+0000 7fd4a8d23740 4 client.29090 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}] 2024-09-19T06:55:53.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.874+0000 7fd4a8d23740 1 -- 172.21.15.12:0/3572763107 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}) -- 0x7fd488040850 con 0x560a04cf6140 2024-09-19T06:55:53.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.874+0000 7fd497fff640 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560a04cf6140 0x560a04cf8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:53.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.874+0000 7fd497fff640 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560a04cf6140 0x560a04cf8560 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a12cf4d29a1a9f server_cookie=4863befc7791bb57 in_seq=0 out_seq=0 2024-09-19T06:55:53.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:53.875+0000 7fd47f7fe640 10 client.29090 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.026+0000 7fd47f7fe640 1 -- 172.21.15.12:0/3572763107 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fd488040850 con 0x560a04cf6140 2024-09-19T06:55:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.026+0000 7fd47f7fe640 10 client.29090 handle_command_reply: tid=0 2024-09-19T06:55:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.026+0000 7fd4a8d23740 1 client.29090 shutdown 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 1 -- 172.21.15.12:0/3572763107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c7aa30 msgr2=0x560a04c8df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c7aa30 0x560a04c8df40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x560a04c78f10 tx=0x7fd49000aeb0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 1 -- 172.21.15.12:0/3572763107 shutdown_connections 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x560a04cf6140 0x560a04cf8560 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a04c8e480 0x560a04cf4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560a04c7aa30 0x560a04c8df40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd47f7fe640 0 client.29090 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 1 --2- 172.21.15.12:0/3572763107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560a04c70170 0x560a04c8da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 1 -- 172.21.15.12:0/3572763107 >> 172.21.15.12:0/3572763107 conn(0x560a04c6bde0 msgr2=0x560a04c6a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 1 -- 172.21.15.12:0/3572763107 shutdown_connections 2024-09-19T06:55:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 1 -- 172.21.15.12:0/3572763107 wait complete. 2024-09-19T06:55:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a8d23740 20 client.29090 trim_cache size 0 max 16384 2024-09-19T06:55:54.030 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:55:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 54, 2024-09-19T06:55:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:55:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 54, 2024-09-19T06:55:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:55:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "183c19bc": { 2024-09-19T06:55:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 54, 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 149.4, 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:55:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:55:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-09-19T06:55:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:55:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:54.032 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:55:54.032 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a694a640 1 -- 172.21.15.12:0/2522371362 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd48c0a3540 msgr2=0x7fd48c0a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a694a640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd48c0a3540 0x7fd48c0a5a00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd4980cd990 tx=0x7fd498009a70 comp rx=0 tx=0).stop 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a694a640 1 -- 172.21.15.12:0/2522371362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4a0106f20 msgr2=0x7fd4a0074960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.027+0000 7fd4a694a640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4a0106f20 0x7fd4a0074960 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fd49800eb10 tx=0x7fd49800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.028+0000 7fd4a694a640 1 -- 172.21.15.12:0/2522371362 shutdown_connections 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.028+0000 7fd4a694a640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4a0106f20 0x7fd4a0074960 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.028+0000 7fd4a694a640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd48c0a3540 0x7fd48c0a5a00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.028+0000 7fd4a694a640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4a01027a0 0x7fd4a0074420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.028+0000 7fd4a694a640 1 --2- 172.21.15.12:0/2522371362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4a0101df0 0x7fd4a0075e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.028+0000 7fd4a694a640 1 -- 172.21.15.12:0/2522371362 >> 172.21.15.12:0/2522371362 conn(0x7fd4a00fd8f0 msgr2=0x7fd4a00fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.028+0000 7fd4a694a640 1 -- 172.21.15.12:0/2522371362 shutdown_connections 2024-09-19T06:55:54.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:54.028+0000 7fd4a694a640 1 -- 172.21.15.12:0/2522371362 wait complete. 2024-09-19T06:55:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.708+0000 7f29ddfd8640 1 -- 172.21.15.12:0/3429357402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29d81009f0 msgr2=0x7f29d8100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.708+0000 7f29ddfd8640 1 --2- 172.21.15.12:0/3429357402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29d81009f0 0x7f29d8100e50 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009930 tx=0x7f29cc02a420 comp rx=0 tx=0).stop 2024-09-19T06:55:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.708+0000 7f29ddfd8640 1 -- 172.21.15.12:0/3429357402 shutdown_connections 2024-09-19T06:55:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.708+0000 7f29ddfd8640 1 --2- 172.21.15.12:0/3429357402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29d8101390 0x7f29d810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.708+0000 7f29ddfd8640 1 --2- 172.21.15.12:0/3429357402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29d81009f0 0x7f29d8100e50 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.708+0000 7f29ddfd8640 1 --2- 172.21.15.12:0/3429357402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29d8106a00 0x7f29d8106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.708+0000 7f29ddfd8640 1 -- 172.21.15.12:0/3429357402 >> 172.21.15.12:0/3429357402 conn(0x7f29d80fc6b0 msgr2=0x7f29d80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.708+0000 7f29ddfd8640 1 -- 172.21.15.12:0/3429357402 shutdown_connections 2024-09-19T06:55:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.708+0000 7f29ddfd8640 1 -- 172.21.15.12:0/3429357402 wait complete. 2024-09-19T06:55:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.709+0000 7f29ddfd8640 1 Processor -- start 2024-09-19T06:55:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.709+0000 7f29ddfd8640 1 -- start start 2024-09-19T06:55:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.709+0000 7f29ddfd8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29d81009f0 0x7f29d8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.713 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.709+0000 7f29ddfd8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29d8101390 0x7f29d81988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.709+0000 7f29ddfd8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29d8106a00 0x7f29d819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.709+0000 7f29ddfd8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29d8110e90 con 0x7f29d8106a00 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.709+0000 7f29ddfd8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f29d8110d10 con 0x7f29d8101390 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.709+0000 7f29ddfd8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29d8111010 con 0x7f29d81009f0 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.709+0000 7f29d7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29d8106a00 0x7f29d819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29d8106a00 0x7f29d819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32812/0 (socket says 172.21.15.12:32812) 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d7fff640 1 -- 172.21.15.12:0/1652074189 learned_addr learned my addr 172.21.15.12:0/1652074189 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d77fe640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29d81009f0 0x7f29d8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29d8101390 0x7f29d81988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d7fff640 1 -- 172.21.15.12:0/1652074189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29d81009f0 msgr2=0x7f29d8198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d7fff640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29d81009f0 0x7f29d8198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.714 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d7fff640 1 -- 172.21.15.12:0/1652074189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29d8101390 msgr2=0x7f29d81988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d7fff640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29d8101390 0x7f29d81988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d7fff640 1 -- 172.21.15.12:0/1652074189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d819d380 con 0x7f29d8106a00 2024-09-19T06:55:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d7fff640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29d8106a00 0x7f29d819cc50 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f29d000eaa0 tx=0x7f29d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d4ff9640 1 -- 172.21.15.12:0/1652074189 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d000cdb0 con 0x7f29d8106a00 2024-09-19T06:55:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29ddfd8640 1 -- 172.21.15.12:0/1652074189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d819d670 con 0x7f29d8106a00 2024-09-19T06:55:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d4ff9640 1 -- 172.21.15.12:0/1652074189 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29d0005020 con 0x7f29d8106a00 2024-09-19T06:55:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29d4ff9640 1 -- 172.21.15.12:0/1652074189 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d00116b0 con 0x7f29d8106a00 2024-09-19T06:55:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.710+0000 7f29ddfd8640 1 -- 172.21.15.12:0/1652074189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d81a4f00 con 0x7f29d8106a00 2024-09-19T06:55:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29d4ff9640 1 -- 172.21.15.12:0/1652074189 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f29d0005560 con 0x7f29d8106a00 2024-09-19T06:55:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29e0e4d740 1 Processor -- start 2024-09-19T06:55:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29e0e4d740 1 -- start start 2024-09-19T06:55:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886347dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b886356b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b8863594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b8862ac2f0 con 0x55b8863479f0 2024-09-19T06:55:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b886254270 con 0x55b8863570c0 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b8862a82b0 con 0x55b886348310 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886347dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886347dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32816/0 (socket says 172.21.15.12:32816) 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.713+0000 7f29d6ffd640 1 -- 172.21.15.12:0/799006433 learned_addr learned my addr 172.21.15.12:0/799006433 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d77fe640 1 --2- 172.21.15.12:0/799006433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b886356b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d4ff9640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29c00a3460 0x7f29c00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/799006433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b8863594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d6ffd640 1 -- 172.21.15.12:0/799006433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 msgr2=0x55b886356b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/799006433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b886356b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d6ffd640 1 -- 172.21.15.12:0/799006433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 msgr2=0x55b8863594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/799006433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b8863594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.722 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d6ffd640 1 -- 172.21.15.12:0/799006433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b886253340 con 0x55b8863479f0 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d7fff640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29c00a3460 0x7f29c00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d4ff9640 1 -- 172.21.15.12:0/1652074189 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f29d00cff60 con 0x7f29d8106a00 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/799006433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886347dd0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f29cc005ec0 tx=0x7f29cc009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb728f286e9607c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29bdffb640 1 -- 172.21.15.12:0/799006433 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc044020 con 0x55b8863479f0 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29bdffb640 1 -- 172.21.15.12:0/799006433 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29cc004700 con 0x55b8863479f0 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.714+0000 7f29bdffb640 1 -- 172.21.15.12:0/799006433 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc035040 con 0x55b8863479f0 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29e0e4d740 1 -- 172.21.15.12:0/799006433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 msgr2=0x55b886347dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29d7fff640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29c00a3460 0x7f29c00a5920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009270 tx=0x7f29d00bc040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/799006433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886347dd0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f29cc005ec0 tx=0x7f29cc009610 comp rx=0 tx=0).stop 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29e0e4d740 1 -- 172.21.15.12:0/799006433 shutdown_connections 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/799006433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b8863594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/799006433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b886356b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/799006433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886347dd0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29e0e4d740 1 -- 172.21.15.12:0/799006433 >> 172.21.15.12:0/799006433 conn(0x55b886344060 msgr2=0x55b886344440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29e0e4d740 1 -- 172.21.15.12:0/799006433 shutdown_connections 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29e0e4d740 1 -- 172.21.15.12:0/799006433 wait complete. 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.715+0000 7f29e0e4d740 1 -- start start 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29e0e4d740 1 Processor -- start 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863479f0 0x55b886354020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b886354560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863570c0 0x55b886354aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b886359cc0 con 0x55b8863570c0 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55b886235290 con 0x55b8863479f0 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b886359e40 con 0x55b886348310 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29e0e4d740 10 client.0 _ll_register_callbacks cb 0x55b886266140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863570c0 0x55b886354aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863570c0 0x55b886354aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32828/0 (socket says 172.21.15.12:32828) 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d6ffd640 1 -- 172.21.15.12:0/1046391286 learned_addr learned my addr 172.21.15.12:0/1046391286 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d77fe640 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b886354560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863479f0 0x55b886354020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d6ffd640 1 -- 172.21.15.12:0/1046391286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 msgr2=0x55b886354560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b886354560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d6ffd640 1 -- 172.21.15.12:0/1046391286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863479f0 msgr2=0x55b886354020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863479f0 0x55b886354020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d6ffd640 1 -- 172.21.15.12:0/1046391286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b885fbf210 con 0x55b8863570c0 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863570c0 0x55b886354aa0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f29cc005330 tx=0x7f29cc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601ba7266e886dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.716+0000 7f29b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29b6ffd640 1 -- 172.21.15.12:0/1046391286 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc044070 con 0x55b8863570c0 2024-09-19T06:55:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29b6ffd640 1 -- 172.21.15.12:0/1046391286 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f29cc004ab0 con 0x55b8863570c0 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29e0e4d740 1 -- 172.21.15.12:0/1046391286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29cc004700 con 0x55b8863570c0 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29b6ffd640 1 -- 172.21.15.12:0/1046391286 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f29cc035040 con 0x55b8863570c0 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29e0e4d740 10 client.19791 fetch_fsmap learned FSMap version 54 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29e0e4d740 1 -- 172.21.15.12:0/1046391286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55b88608b620 con 0x55b8863570c0 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29b6ffd640 1 -- 172.21.15.12:0/1046391286 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29cc004700 con 0x55b8863570c0 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29b6ffd640 1 -- 172.21.15.12:0/1046391286 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 54) ==== 8366+0+0 (secure 0 0 0) 0x7f29cc031640 con 0x55b8863570c0 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29e0e4d740 10 client.19791 fetch_fsmap finished waiting for FSMap version 54 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29e0e4d740 10 client.19791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29e0e4d740 20 client.19791 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b886366f40 0x55b886369330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29e0e4d740 4 client.19791 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.717+0000 7f29e0e4d740 1 -- 172.21.15.12:0/1046391286 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8862b9a20 con 0x55b886366f40 2024-09-19T06:55:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.718+0000 7f29d77fe640 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b886366f40 0x55b886369330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.718+0000 7f29b6ffd640 10 client.19791 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.718+0000 7f29d77fe640 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b886366f40 0x55b886369330 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e423eab4537fb02e server_cookie=4f80135304ea6723 in_seq=0 out_seq=0 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29b6ffd640 1 -- 172.21.15.12:0/1046391286 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8862b9a20 con 0x55b886366f40 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29b6ffd640 10 client.19791 handle_command_reply: tid=0 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 client.19791 shutdown 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 -- 172.21.15.12:0/1046391286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863570c0 msgr2=0x55b886354aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863570c0 0x55b886354aa0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f29cc005330 tx=0x7f29cc005850 comp rx=0 tx=0).stop 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 -- 172.21.15.12:0/1046391286 shutdown_connections 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b886366f40 0x55b886369330 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863570c0 0x55b886354aa0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b886354560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/1046391286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863479f0 0x55b886354020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29b6ffd640 0 client.19791 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 -- 172.21.15.12:0/1046391286 >> 172.21.15.12:0/1046391286 conn(0x55b886344060 msgr2=0x55b886349d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 -- 172.21.15.12:0/1046391286 shutdown_connections 2024-09-19T06:55:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 1 -- 172.21.15.12:0/1046391286 wait complete. 2024-09-19T06:55:54.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.719+0000 7f29e0e4d740 20 client.19791 trim_cache size 0 max 16384 2024-09-19T06:55:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.733+0000 7f29e0e4d740 1 Processor -- start 2024-09-19T06:55:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.733+0000 7f29e0e4d740 1 -- start start 2024-09-19T06:55:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.733+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886355f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.733+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b88636c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.733+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b88636c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.733+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29d81ab800 con 0x55b8863479f0 2024-09-19T06:55:54.736 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.733+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f29d81ad370 con 0x55b8863570c0 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.733+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29d81abed0 con 0x55b886348310 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886355f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886355f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32836/0 (socket says 172.21.15.12:32836) 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d6ffd640 1 -- 172.21.15.12:0/2623431855 learned_addr learned my addr 172.21.15.12:0/2623431855 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d77fe640 1 --2- 172.21.15.12:0/2623431855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b88636c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d6ffd640 1 -- 172.21.15.12:0/2623431855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 msgr2=0x55b88636c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/2623431855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b88636c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d6ffd640 1 -- 172.21.15.12:0/2623431855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 msgr2=0x55b88636c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/2623431855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b88636c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d6ffd640 1 -- 172.21.15.12:0/2623431855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b886348dc0 con 0x55b8863479f0 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d77fe640 1 --2- 172.21.15.12:0/2623431855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b88636c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/2623431855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886355f90 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f29cc031a40 tx=0x7f29cc004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff146c592f5d798 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:54.737 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29bd7fa640 1 -- 172.21.15.12:0/2623431855 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc044070 con 0x55b8863479f0 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29bd7fa640 1 -- 172.21.15.12:0/2623431855 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29cc0315b0 con 0x55b8863479f0 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.734+0000 7f29bd7fa640 1 -- 172.21.15.12:0/2623431855 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0038b0 con 0x55b8863479f0 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 -- 172.21.15.12:0/2623431855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 msgr2=0x55b886355f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/2623431855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886355f90 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f29cc031a40 tx=0x7f29cc004550 comp rx=0 tx=0).stop 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 -- 172.21.15.12:0/2623431855 shutdown_connections 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/2623431855 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b88636c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/2623431855 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b88636c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/2623431855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b886355f90 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 -- 172.21.15.12:0/2623431855 >> 172.21.15.12:0/2623431855 conn(0x55b886344060 msgr2=0x55b886355880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 -- 172.21.15.12:0/2623431855 shutdown_connections 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 -- 172.21.15.12:0/2623431855 wait complete. 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 -- start start 2024-09-19T06:55:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 Processor -- start 2024-09-19T06:55:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b88636a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b88636a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b88636ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29d81acc70 con 0x55b8863479f0 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f29d81ac5a0 con 0x55b8863570c0 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.735+0000 7f29e0e4d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29d81a9800 con 0x55b886348310 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29e0e4d740 10 client.0 _ll_register_callbacks cb 0x7f29c800a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b88636a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b88636a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32838/0 (socket says 172.21.15.12:32838) 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d6ffd640 1 -- 172.21.15.12:0/3435458717 learned_addr learned my addr 172.21.15.12:0/3435458717 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b88636ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d77fe640 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b88636a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d6ffd640 1 -- 172.21.15.12:0/3435458717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 msgr2=0x55b88636a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b88636a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d6ffd640 1 -- 172.21.15.12:0/3435458717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 msgr2=0x55b88636ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b88636ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d6ffd640 1 -- 172.21.15.12:0/3435458717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8863d0980 con 0x55b8863479f0 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29d6ffd640 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b88636a1d0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0092a0 tx=0x7f29cc004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a68c31ffe228676 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29b6ffd640 1 -- 172.21.15.12:0/3435458717 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc044040 con 0x55b8863479f0 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29b6ffd640 1 -- 172.21.15.12:0/3435458717 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f29cc0546b0 con 0x55b8863479f0 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.736+0000 7f29e0e4d740 1 -- 172.21.15.12:0/3435458717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29cc0315b0 con 0x55b8863479f0 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29b6ffd640 1 -- 172.21.15.12:0/3435458717 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f29cc004b00 con 0x55b8863479f0 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29e0e4d740 10 client.19797 fetch_fsmap learned FSMap version 54 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29e0e4d740 1 -- 172.21.15.12:0/3435458717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55b8863d1be0 con 0x55b8863479f0 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29b6ffd640 1 -- 172.21.15.12:0/3435458717 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29cc0315b0 con 0x55b8863479f0 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29b6ffd640 1 -- 172.21.15.12:0/3435458717 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 54) ==== 8366+0+0 (secure 0 0 0) 0x7f29cc068070 con 0x55b8863479f0 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29e0e4d740 10 client.19797 fetch_fsmap finished waiting for FSMap version 54 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29e0e4d740 10 client.19797 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29e0e4d740 20 client.19797 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b8863d21e0 0x55b8863d45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29e0e4d740 4 client.19797 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:55:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29e0e4d740 1 -- 172.21.15.12:0/3435458717 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b8862b3d70 con 0x55b8863d21e0 2024-09-19T06:55:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.737+0000 7f29d77fe640 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b8863d21e0 0x55b8863d45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.738+0000 7f29d77fe640 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b8863d21e0 0x55b8863d45d0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82b3454f844c0917 server_cookie=9e62a1fec16abeb8 in_seq=0 out_seq=0 2024-09-19T06:55:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.738+0000 7f29b6ffd640 10 client.19797 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:54 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:55:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29b6ffd640 1 -- 172.21.15.12:0/3435458717 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b8862b3d70 con 0x55b8863d21e0 2024-09-19T06:55:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29b6ffd640 10 client.19797 handle_command_reply: tid=0 2024-09-19T06:55:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 client.19797 shutdown 2024-09-19T06:55:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 -- 172.21.15.12:0/3435458717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 msgr2=0x55b88636a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b88636a1d0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0092a0 tx=0x7f29cc004d70 comp rx=0 tx=0).stop 2024-09-19T06:55:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 -- 172.21.15.12:0/3435458717 shutdown_connections 2024-09-19T06:55:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55b8863d21e0 0x55b8863d45d0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55b8863570c0 0x55b88636ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29b6ffd640 0 client.19797 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b886348310 0x55b88636a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 --2- 172.21.15.12:0/3435458717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b8863479f0 0x55b88636a1d0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 -- 172.21.15.12:0/3435458717 >> 172.21.15.12:0/3435458717 conn(0x55b886344060 msgr2=0x55b8863431c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 -- 172.21.15.12:0/3435458717 shutdown_connections 2024-09-19T06:55:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 1 -- 172.21.15.12:0/3435458717 wait complete. 2024-09-19T06:55:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29e0e4d740 20 client.19797 trim_cache size 0 max 16384 2024-09-19T06:55:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:55:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:55:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:55:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:55:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 -- 172.21.15.12:0/1652074189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29c00a3460 msgr2=0x7f29c00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29c00a3460 0x7f29c00a5920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009270 tx=0x7f29d00bc040 comp rx=0 tx=0).stop 2024-09-19T06:55:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 -- 172.21.15.12:0/1652074189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29d8106a00 msgr2=0x7f29d819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29d8106a00 0x7f29d819cc50 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f29d000eaa0 tx=0x7f29d000ef60 comp rx=0 tx=0).stop 2024-09-19T06:55:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 -- 172.21.15.12:0/1652074189 shutdown_connections 2024-09-19T06:55:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29d8106a00 0x7f29d819cc50 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29d8101390 0x7f29d81988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f29c00a3460 0x7f29c00a5920 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 --2- 172.21.15.12:0/1652074189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29d81009f0 0x7f29d8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 -- 172.21.15.12:0/1652074189 >> 172.21.15.12:0/1652074189 conn(0x7f29d80fc6b0 msgr2=0x7f29d806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 -- 172.21.15.12:0/1652074189 shutdown_connections 2024-09-19T06:55:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:55:54.766+0000 7f29ddfd8640 1 -- 172.21.15.12:0/1652074189 wait complete. 2024-09-19T06:55:54.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:54 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:55:54.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:54 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:55:54.915 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '183c19bc', quiesce took 6.9 seconds. Will release after: 22.549999999999997 2024-09-19T06:55:55.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.139+0000 7f4cebcb7640 1 -- 172.21.15.12:0/852165631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ce4102ef0 msgr2=0x7f4ce410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:55.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.139+0000 7f4cebcb7640 1 --2- 172.21.15.12:0/852165631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ce4102ef0 0x7f4ce410da40 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009ca0 tx=0x7f4cdc02a950 comp rx=0 tx=0).stop 2024-09-19T06:55:55.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.139+0000 7f4cebcb7640 1 -- 172.21.15.12:0/852165631 shutdown_connections 2024-09-19T06:55:55.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.139+0000 7f4cebcb7640 1 --2- 172.21.15.12:0/852165631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ce4102ef0 0x7f4ce410da40 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.139+0000 7f4cebcb7640 1 --2- 172.21.15.12:0/852165631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce4102570 0x7f4ce41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.139+0000 7f4cebcb7640 1 --2- 172.21.15.12:0/852165631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ce4100e20 0x7f4ce4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.139+0000 7f4cebcb7640 1 -- 172.21.15.12:0/852165631 >> 172.21.15.12:0/852165631 conn(0x7f4ce40fc7d0 msgr2=0x7f4ce40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:55.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.139+0000 7f4cebcb7640 1 -- 172.21.15.12:0/852165631 shutdown_connections 2024-09-19T06:55:55.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.139+0000 7f4cebcb7640 1 -- 172.21.15.12:0/852165631 wait complete. 2024-09-19T06:55:55.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.139+0000 7f4cebcb7640 1 Processor -- start 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4cebcb7640 1 -- start start 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4cebcb7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ce4100e20 0x7f4ce40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4cebcb7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ce4102570 0x7f4ce40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4cebcb7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce4102ef0 0x7f4ce40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4cebcb7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4110f80 con 0x7f4ce4100e20 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4cebcb7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4110e00 con 0x7f4ce4102ef0 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4cebcb7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4111100 con 0x7f4ce4102570 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4ce9a53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ce4100e20 0x7f4ce40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4ce9a53640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ce4100e20 0x7f4ce40fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32862/0 (socket says 172.21.15.12:32862) 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4ce9a53640 1 -- 172.21.15.12:0/1854631852 learned_addr learned my addr 172.21.15.12:0/1854631852 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4cea254640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce4102ef0 0x7f4ce40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4ce9252640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ce4102570 0x7f4ce40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4ce9a53640 1 -- 172.21.15.12:0/1854631852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ce4102570 msgr2=0x7f4ce40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4ce9a53640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ce4102570 0x7f4ce40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4ce9a53640 1 -- 172.21.15.12:0/1854631852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce4102ef0 msgr2=0x7f4ce40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4ce9a53640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce4102ef0 0x7f4ce40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4ce9a53640 1 -- 172.21.15.12:0/1854631852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce41a6890 con 0x7f4ce4100e20 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4cea254640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce4102ef0 0x7f4ce40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4ce9a53640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ce4100e20 0x7f4ce40fcc80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000c920 tx=0x7f4ce000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.140+0000 7f4cdaffd640 1 -- 172.21.15.12:0/1854631852 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0007c70 con 0x7f4ce4100e20 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.141+0000 7f4cebcb7640 1 -- 172.21.15.12:0/1854631852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce41a6b80 con 0x7f4ce4100e20 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.141+0000 7f4cdaffd640 1 -- 172.21.15.12:0/1854631852 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ce0007e10 con 0x7f4ce4100e20 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.141+0000 7f4cdaffd640 1 -- 172.21.15.12:0/1854631852 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0018890 con 0x7f4ce4100e20 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.141+0000 7f4cebcb7640 1 -- 172.21.15.12:0/1854631852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce41a7110 con 0x7f4ce4100e20 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.143+0000 7f4cee090740 1 Processor -- start 2024-09-19T06:55:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.143+0000 7f4cdaffd640 1 -- 172.21.15.12:0/1854631852 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4ce0018b30 con 0x7f4ce4100e20 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.143+0000 7f4cee090740 1 -- start start 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cee090740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846228b40 0x557846227090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cee090740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 0x557846227a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cee090740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846232370 0x557846234760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cee090740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55784618d2f0 con 0x557846228b40 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cee090740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557846134cf0 con 0x5578462275d0 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cee090740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5578461892b0 con 0x557846232370 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cea254640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846228b40 0x557846227090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cea254640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846228b40 0x557846227090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32876/0 (socket says 172.21.15.12:32876) 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cea254640 1 -- 172.21.15.12:0/2328456757 learned_addr learned my addr 172.21.15.12:0/2328456757 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4ce9a53640 1 --2- 172.21.15.12:0/2328456757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 0x557846227a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4ce9252640 1 --2- 172.21.15.12:0/2328456757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846232370 0x557846234760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cea254640 1 -- 172.21.15.12:0/2328456757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846232370 msgr2=0x557846234760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cea254640 1 --2- 172.21.15.12:0/2328456757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846232370 0x557846234760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cea254640 1 -- 172.21.15.12:0/2328456757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 msgr2=0x557846227a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cea254640 1 --2- 172.21.15.12:0/2328456757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 0x557846227a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cea254640 1 -- 172.21.15.12:0/2328456757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578461193a0 con 0x557846228b40 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4ce9a53640 1 --2- 172.21.15.12:0/2328456757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 0x557846227a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.144+0000 7f4cdaffd640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4cd00a33b0 0x7f4cd00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.145+0000 7f4cea254640 1 --2- 172.21.15.12:0/2328456757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846228b40 0x557846227090 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009a20 tx=0x7f4cdc02f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca961bdf5fad9f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.145+0000 7f4ce9a53640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4cd00a33b0 0x7f4cd00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.145+0000 7f4cdaffd640 1 -- 172.21.15.12:0/1854631852 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f4ce00cff90 con 0x7f4ce4100e20 2024-09-19T06:55:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.145+0000 7f4ccffff640 1 -- 172.21.15.12:0/2328456757 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc034040 con 0x557846228b40 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.145+0000 7f4ccffff640 1 -- 172.21.15.12:0/2328456757 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cdc003970 con 0x557846228b40 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.145+0000 7f4ccffff640 1 -- 172.21.15.12:0/2328456757 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc0046a0 con 0x557846228b40 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 -- 172.21.15.12:0/2328456757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846228b40 msgr2=0x557846227090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 --2- 172.21.15.12:0/2328456757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846228b40 0x557846227090 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009a20 tx=0x7f4cdc02f930 comp rx=0 tx=0).stop 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4ce9a53640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4cd00a33b0 0x7f4cd00a5870 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00cd6f0 tx=0x7f4ce00d3ae0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 -- 172.21.15.12:0/2328456757 shutdown_connections 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 --2- 172.21.15.12:0/2328456757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846232370 0x557846234760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 --2- 172.21.15.12:0/2328456757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 0x557846227a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 --2- 172.21.15.12:0/2328456757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846228b40 0x557846227090 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 -- 172.21.15.12:0/2328456757 >> 172.21.15.12:0/2328456757 conn(0x5578461f0310 msgr2=0x557846223c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 -- 172.21.15.12:0/2328456757 shutdown_connections 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 -- 172.21.15.12:0/2328456757 wait complete. 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 -- start start 2024-09-19T06:55:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.146+0000 7f4cee090740 1 Processor -- start 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cee090740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 0x557846231cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cee090740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 0x55784622ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cee090740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x55784622f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cee090740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557846235010 con 0x557846232370 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cee090740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x557846148060 con 0x5578462275d0 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cee090740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557846235190 con 0x557846228b40 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cee090740 10 client.0 _ll_register_callbacks cb 0x557845e9b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cea254640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x55784622f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cea254640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x55784622f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32880/0 (socket says 172.21.15.12:32880) 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cea254640 1 -- 172.21.15.12:0/1768176251 learned_addr learned my addr 172.21.15.12:0/1768176251 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cea254640 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 0x557846231cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4ce9252640 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 0x55784622ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cea254640 1 -- 172.21.15.12:0/1768176251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 msgr2=0x55784622ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cea254640 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 0x55784622ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cea254640 1 -- 172.21.15.12:0/1768176251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 msgr2=0x557846231cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cea254640 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 0x557846231cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.147+0000 7f4cea254640 1 -- 172.21.15.12:0/1768176251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557845efe3c0 con 0x557846232370 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4cea254640 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x55784622f4d0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc004180 tx=0x7f4cdc004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325bad4e782ffb25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4ccd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/1768176251 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc004630 con 0x557846232370 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/1768176251 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f4cdc02f3a0 con 0x557846232370 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4cee090740 1 -- 172.21.15.12:0/1768176251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cdc003970 con 0x557846232370 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/1768176251 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4cdc02f5a0 con 0x557846232370 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4cee090740 10 client.19809 fetch_fsmap learned FSMap version 54 2024-09-19T06:55:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4cee090740 1 -- 172.21.15.12:0/1768176251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x557846235010 con 0x557846232370 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/1768176251 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cdc003970 con 0x557846232370 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/1768176251 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 54) ==== 8366+0+0 (secure 0 0 0) 0x7f4cdc04f040 con 0x557846232370 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4cee090740 10 client.19809 fetch_fsmap finished waiting for FSMap version 54 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4cee090740 10 client.19809 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4cee090740 20 client.19809 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4cee090740 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x557846241ba0 0x557846243f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4cee090740 4 client.19809 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.148+0000 7f4cee090740 1 -- 172.21.15.12:0/1768176251 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55784619a860 con 0x557846241ba0 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.149+0000 7f4ce9252640 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x557846241ba0 0x557846243f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.149+0000 7f4ccd7fa640 10 client.19809 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.149+0000 7f4ce9252640 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x557846241ba0 0x557846243f90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=173595d7212aae9b server_cookie=68cad6dc16966354 in_seq=0 out_seq=0 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.150+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/1768176251 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55784619a860 con 0x557846241ba0 2024-09-19T06:55:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.150+0000 7f4ccd7fa640 10 client.19809 handle_command_reply: tid=0 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.150+0000 7f4cee090740 1 client.19809 shutdown 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.150+0000 7f4cee090740 1 -- 172.21.15.12:0/1768176251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 msgr2=0x55784622f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.150+0000 7f4cee090740 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x55784622f4d0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc004180 tx=0x7f4cdc004280 comp rx=0 tx=0).stop 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.151+0000 7f4cee090740 1 -- 172.21.15.12:0/1768176251 shutdown_connections 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.151+0000 7f4cee090740 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x557846241ba0 0x557846243f90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.151+0000 7f4cee090740 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x55784622f4d0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.151+0000 7f4cee090740 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 0x55784622ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.151+0000 7f4ccd7fa640 0 client.19809 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.151+0000 7f4cee090740 1 --2- 172.21.15.12:0/1768176251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5578462275d0 0x557846231cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.151+0000 7f4cee090740 1 -- 172.21.15.12:0/1768176251 >> 172.21.15.12:0/1768176251 conn(0x5578461f0310 msgr2=0x557846229930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.151+0000 7f4cee090740 1 -- 172.21.15.12:0/1768176251 shutdown_connections 2024-09-19T06:55:55.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.151+0000 7f4cee090740 1 -- 172.21.15.12:0/1768176251 wait complete. 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.151+0000 7f4cee090740 20 client.19809 trim_cache size 0 max 16384 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cee090740 1 Processor -- start 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cee090740 1 -- start start 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cee090740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578462275d0 0x55784623e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cee090740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557846228b40 0x5578462496d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cee090740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x557846249c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cee090740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce41afcd0 con 0x557846232370 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cee090740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce41b1840 con 0x557846228b40 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cee090740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce41b03a0 con 0x5578462275d0 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cea254640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x557846249c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cea254640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x557846249c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32884/0 (socket says 172.21.15.12:32884) 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cea254640 1 -- 172.21.15.12:0/549726678 learned_addr learned my addr 172.21.15.12:0/549726678 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cea254640 1 --2- 172.21.15.12:0/549726678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578462275d0 0x55784623e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4ce9252640 1 --2- 172.21.15.12:0/549726678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557846228b40 0x5578462496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cea254640 1 -- 172.21.15.12:0/549726678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578462275d0 msgr2=0x55784623e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cea254640 1 --2- 172.21.15.12:0/549726678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578462275d0 0x55784623e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cea254640 1 -- 172.21.15.12:0/549726678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557846228b40 msgr2=0x5578462496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cea254640 1 --2- 172.21.15.12:0/549726678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557846228b40 0x5578462496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cea254640 1 -- 172.21.15.12:0/549726678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557846223510 con 0x557846232370 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.164+0000 7f4cea254640 1 --2- 172.21.15.12:0/549726678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x557846249c10 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc047040 tx=0x7f4cdc009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3618d962da6d3a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4ccf7fe640 1 -- 172.21.15.12:0/549726678 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc03e040 con 0x557846232370 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4ccf7fe640 1 -- 172.21.15.12:0/549726678 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cdc003970 con 0x557846232370 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4ccf7fe640 1 -- 172.21.15.12:0/549726678 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc02f930 con 0x557846232370 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4cee090740 1 -- 172.21.15.12:0/549726678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 msgr2=0x557846249c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4cee090740 1 --2- 172.21.15.12:0/549726678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x557846249c10 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc047040 tx=0x7f4cdc009360 comp rx=0 tx=0).stop 2024-09-19T06:55:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4cee090740 1 -- 172.21.15.12:0/549726678 shutdown_connections 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4cee090740 1 --2- 172.21.15.12:0/549726678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557846232370 0x557846249c10 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4cee090740 1 --2- 172.21.15.12:0/549726678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557846228b40 0x5578462496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4cee090740 1 --2- 172.21.15.12:0/549726678 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5578462275d0 0x55784623e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4cee090740 1 -- 172.21.15.12:0/549726678 >> 172.21.15.12:0/549726678 conn(0x5578461f0310 msgr2=0x557846230ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4cee090740 1 -- 172.21.15.12:0/549726678 shutdown_connections 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4cee090740 1 -- 172.21.15.12:0/549726678 wait complete. 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.165+0000 7f4cee090740 1 -- start start 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cee090740 1 Processor -- start 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cee090740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5578462275d0 0x557846236190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cee090740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 0x5578462366d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cee090740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557846232370 0x557846236c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cee090740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce41b1140 con 0x5578462275d0 2024-09-19T06:55:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cee090740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce41b0a70 con 0x557846232370 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cee090740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce41adcd0 con 0x557846228b40 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cee090740 10 client.0 _ll_register_callbacks cb 0x7f4ce00d39b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cea254640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5578462275d0 0x557846236190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cea254640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5578462275d0 0x557846236190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32898/0 (socket says 172.21.15.12:32898) 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cea254640 1 -- 172.21.15.12:0/2444232911 learned_addr learned my addr 172.21.15.12:0/2444232911 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cea254640 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557846232370 0x557846236c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4ce9252640 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 0x5578462366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cea254640 1 -- 172.21.15.12:0/2444232911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 msgr2=0x5578462366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cea254640 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 0x5578462366d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cea254640 1 -- 172.21.15.12:0/2444232911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557846232370 msgr2=0x557846236c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cea254640 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557846232370 0x557846236c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4cea254640 1 -- 172.21.15.12:0/2444232911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578462ab6d0 con 0x5578462275d0 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.166+0000 7f4ce9252640 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 0x5578462366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4cea254640 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5578462275d0 0x557846236190 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc054040 tx=0x7f4cdc030720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9534e8b338296 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4ccd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/2444232911 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc069060 con 0x5578462275d0 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/2444232911 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f4cdc02f3a0 con 0x5578462275d0 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4cee090740 1 -- 172.21.15.12:0/2444232911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cdc003970 con 0x5578462275d0 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/2444232911 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4cdc03e030 con 0x5578462275d0 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4cee090740 10 client.19815 fetch_fsmap learned FSMap version 54 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4cee090740 1 -- 172.21.15.12:0/2444232911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5578462ac990 con 0x5578462275d0 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/2444232911 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cdc003970 con 0x5578462275d0 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/2444232911 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 54) ==== 8366+0+0 (secure 0 0 0) 0x7f4cdc062040 con 0x5578462275d0 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4cee090740 10 client.19815 fetch_fsmap finished waiting for FSMap version 54 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4cee090740 10 client.19815 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4cee090740 20 client.19815 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4cee090740 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5578462ace00 0x5578462af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4cee090740 4 client.19815 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.167+0000 7f4cee090740 1 -- 172.21.15.12:0/2444232911 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557846194d70 con 0x5578462ace00 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4ce9252640 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5578462ace00 0x5578462af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4ccd7fa640 10 client.19815 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4ce9252640 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5578462ace00 0x5578462af1f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ff01f4e7b709761 server_cookie=f489a13c1d4e1c50 in_seq=0 out_seq=0 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4ccd7fa640 1 -- 172.21.15.12:0/2444232911 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557846194d70 con 0x5578462ace00 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4ccd7fa640 10 client.19815 handle_command_reply: tid=0 2024-09-19T06:55:55.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4cee090740 1 client.19815 shutdown 2024-09-19T06:55:55.466 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:55:55.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4cee090740 1 -- 172.21.15.12:0/2444232911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5578462275d0 msgr2=0x557846236190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:55.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4cee090740 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5578462275d0 0x557846236190 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc054040 tx=0x7f4cdc030720 comp rx=0 tx=0).stop 2024-09-19T06:55:55.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4cee090740 1 -- 172.21.15.12:0/2444232911 shutdown_connections 2024-09-19T06:55:55.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4cee090740 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5578462ace00 0x5578462af1f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4cee090740 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x557846232370 0x557846236c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4cee090740 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557846228b40 0x5578462366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4cee090740 1 --2- 172.21.15.12:0/2444232911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5578462275d0 0x557846236190 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4ccd7fa640 0 client.19815 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.168+0000 7f4cee090740 1 -- 172.21.15.12:0/2444232911 >> 172.21.15.12:0/2444232911 conn(0x5578461f0310 msgr2=0x5578462307d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cee090740 1 -- 172.21.15.12:0/2444232911 shutdown_connections 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cee090740 1 -- 172.21.15.12:0/2444232911 wait complete. 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cee090740 20 client.19815 trim_cache size 0 max 16384 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 -- 172.21.15.12:0/1854631852 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4cd00a33b0 msgr2=0x7f4cd00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4cd00a33b0 0x7f4cd00a5870 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00cd6f0 tx=0x7f4ce00d3ae0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 -- 172.21.15.12:0/1854631852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ce4100e20 msgr2=0x7f4ce40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ce4100e20 0x7f4ce40fcc80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000c920 tx=0x7f4ce000cde0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 -- 172.21.15.12:0/1854631852 shutdown_connections 2024-09-19T06:55:55.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce4102ef0 0x7f4ce40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4cd00a33b0 0x7f4cd00a5870 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ce4102570 0x7f4ce40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 --2- 172.21.15.12:0/1854631852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ce4100e20 0x7f4ce40fcc80 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:55.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 -- 172.21.15.12:0/1854631852 >> 172.21.15.12:0/1854631852 conn(0x7f4ce40fc7d0 msgr2=0x7f4ce406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:55.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 -- 172.21.15.12:0/1854631852 shutdown_connections 2024-09-19T06:55:55.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:55.169+0000 7f4cebcb7640 1 -- 172.21.15.12:0/1854631852 wait complete. 2024-09-19T06:55:55.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:55 smithi016 ceph-mon[34911]: pgmap v494: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 3.8 MiB/s wr, 414 op/s 2024-09-19T06:55:55.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:55 smithi173 ceph-mon[35349]: pgmap v494: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 3.8 MiB/s wr, 414 op/s 2024-09-19T06:55:55.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:55 smithi012 ceph-mon[30937]: pgmap v494: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 3.8 MiB/s wr, 414 op/s 2024-09-19T06:55:56.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:55:57.037 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:55:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.525+0000 7f977c956640 1 -- 172.21.15.12:0/2451624309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97781009b0 msgr2=0x7f9778100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.525+0000 7f977c956640 1 --2- 172.21.15.12:0/2451624309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97781009b0 0x7f9778100d90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f9768009900 tx=0x7f976802a410 comp rx=0 tx=0).stop 2024-09-19T06:55:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.525+0000 7f977c956640 1 -- 172.21.15.12:0/2451624309 shutdown_connections 2024-09-19T06:55:57.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.525+0000 7f977c956640 1 --2- 172.21.15.12:0/2451624309 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977810e4d0 0x7f97781108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.525+0000 7f977c956640 1 --2- 172.21.15.12:0/2451624309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9778101360 0x7f977810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.525+0000 7f977c956640 1 --2- 172.21.15.12:0/2451624309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97781009b0 0x7f9778100d90 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.525+0000 7f977c956640 1 -- 172.21.15.12:0/2451624309 >> 172.21.15.12:0/2451624309 conn(0x7f97780fc7d0 msgr2=0x7f97780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:57.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.525+0000 7f977c956640 1 -- 172.21.15.12:0/2451624309 shutdown_connections 2024-09-19T06:55:57.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.525+0000 7f977c956640 1 -- 172.21.15.12:0/2451624309 wait complete. 2024-09-19T06:55:57.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.526+0000 7f977c956640 1 Processor -- start 2024-09-19T06:55:57.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.526+0000 7f977c956640 1 -- start start 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.526+0000 7f977c956640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97781009b0 0x7f97781a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.526+0000 7f977c956640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9778101360 0x7f97781a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f977c956640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977810e4d0 0x7f977819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f977c956640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f97781142d0 con 0x7f977810e4d0 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f977c956640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9778114150 con 0x7f9778101360 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f977c956640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9778114450 con 0x7f97781009b0 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f977659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97781009b0 0x7f97781a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f9776d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977810e4d0 0x7f977819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f9775d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9778101360 0x7f97781a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f977659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97781009b0 0x7f97781a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:40210/0 (socket says 172.21.15.12:40210) 2024-09-19T06:55:57.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f9776d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977810e4d0 0x7f977819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32906/0 (socket says 172.21.15.12:32906) 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f977659c640 1 -- 172.21.15.12:0/4189259440 learned_addr learned my addr 172.21.15.12:0/4189259440 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f9775d9b640 1 -- 172.21.15.12:0/4189259440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97781009b0 msgr2=0x7f97781a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f9775d9b640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97781009b0 0x7f97781a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f9775d9b640 1 -- 172.21.15.12:0/4189259440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977810e4d0 msgr2=0x7f977819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f9775d9b640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977810e4d0 0x7f977819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f9775d9b640 1 -- 172.21.15.12:0/4189259440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977819acc0 con 0x7f9778101360 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f9775d9b640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9778101360 0x7f97781a0910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f976000e9f0 tx=0x7f976000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.527+0000 7f976f7fe640 1 -- 172.21.15.12:0/4189259440 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976000ccc0 con 0x7f9778101360 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.528+0000 7f977c956640 1 -- 172.21.15.12:0/4189259440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f977819afb0 con 0x7f9778101360 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.528+0000 7f976f7fe640 1 -- 172.21.15.12:0/4189259440 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9760010910 con 0x7f9778101360 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.528+0000 7f976f7fe640 1 -- 172.21.15.12:0/4189259440 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9760018960 con 0x7f9778101360 2024-09-19T06:55:57.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.528+0000 7f977c956640 1 -- 172.21.15.12:0/4189259440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97781a72a0 con 0x7f9778101360 2024-09-19T06:55:57.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.530+0000 7f976f7fe640 1 -- 172.21.15.12:0/4189259440 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9760010ac0 con 0x7f9778101360 2024-09-19T06:55:57.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.530+0000 7f977ed2f740 1 Processor -- start 2024-09-19T06:55:57.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.530+0000 7f977ed2f740 1 -- start start 2024-09-19T06:55:57.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1db40 0x5628c4a1c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1c5d0 0x5628c4a1ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a27370 0x5628c4a29760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f977ed2f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5628c49822f0 con 0x5628c4a27370 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f977ed2f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5628c4929cf0 con 0x5628c4a1db40 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f977ed2f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5628c497e2b0 con 0x5628c4a1c5d0 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f9775d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a27370 0x5628c4a29760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f9776d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1db40 0x5628c4a1c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f9776d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1db40 0x5628c4a1c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45340/0 (socket says 172.21.15.12:45340) 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f9776d9d640 1 -- 172.21.15.12:0/1634525342 learned_addr learned my addr 172.21.15.12:0/1634525342 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f977659c640 1 --2- 172.21.15.12:0/1634525342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1c5d0 0x5628c4a1ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f9776d9d640 1 -- 172.21.15.12:0/1634525342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1c5d0 msgr2=0x5628c4a1ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f9776d9d640 1 --2- 172.21.15.12:0/1634525342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1c5d0 0x5628c4a1ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f9776d9d640 1 -- 172.21.15.12:0/1634525342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a27370 msgr2=0x5628c4a29760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:57.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f9776d9d640 1 --2- 172.21.15.12:0/1634525342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a27370 0x5628c4a29760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f9776d9d640 1 -- 172.21.15.12:0/1634525342 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628c490e3a0 con 0x5628c4a1db40 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f976f7fe640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f97640a33b0 0x7f97640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f977659c640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f97640a33b0 0x7f97640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.531+0000 7f976f7fe640 1 -- 172.21.15.12:0/4189259440 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f97600d0150 con 0x7f9778101360 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.532+0000 7f9776d9d640 1 --2- 172.21.15.12:0/1634525342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1db40 0x5628c4a1c090 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f977000a430 tx=0x7f9770009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a118aed232a1df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.532+0000 7f976cff9640 1 -- 172.21.15.12:0/1634525342 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770013790 con 0x5628c4a1db40 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.532+0000 7f976cff9640 1 -- 172.21.15.12:0/1634525342 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9770019070 con 0x5628c4a1db40 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.532+0000 7f976cff9640 1 -- 172.21.15.12:0/1634525342 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770014d80 con 0x5628c4a1db40 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 -- 172.21.15.12:0/1634525342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1db40 msgr2=0x5628c4a1c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977659c640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f97640a33b0 0x7f97640a5870 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x5628c4a19ac0 tx=0x7f97680046c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 --2- 172.21.15.12:0/1634525342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1db40 0x5628c4a1c090 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f977000a430 tx=0x7f9770009650 comp rx=0 tx=0).stop 2024-09-19T06:55:57.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 -- 172.21.15.12:0/1634525342 shutdown_connections 2024-09-19T06:55:57.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 --2- 172.21.15.12:0/1634525342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a27370 0x5628c4a29760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 --2- 172.21.15.12:0/1634525342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1c5d0 0x5628c4a1ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 --2- 172.21.15.12:0/1634525342 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1db40 0x5628c4a1c090 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 -- 172.21.15.12:0/1634525342 >> 172.21.15.12:0/1634525342 conn(0x5628c49e5310 msgr2=0x5628c4a18c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:57.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 -- 172.21.15.12:0/1634525342 shutdown_connections 2024-09-19T06:55:57.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 -- 172.21.15.12:0/1634525342 wait complete. 2024-09-19T06:55:57.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 -- start start 2024-09-19T06:55:57.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.533+0000 7f977ed2f740 1 Processor -- start 2024-09-19T06:55:57.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1c5d0 0x5628c4a26d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a23fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a27370 0x5628c4a24560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977ed2f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5628c4a2a070 con 0x5628c4a1db40 2024-09-19T06:55:57.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977ed2f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5628c493d060 con 0x5628c4a1c5d0 2024-09-19T06:55:57.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977ed2f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5628c4a2a1f0 con 0x5628c4a27370 2024-09-19T06:55:57.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977ed2f740 10 client.0 _ll_register_callbacks cb 0x5628c46908c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:57.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1c5d0 0x5628c4a26d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f9775d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a23fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1c5d0 0x5628c4a26d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:45356/0 (socket says 172.21.15.12:45356) 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f9775d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a23fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32916/0 (socket says 172.21.15.12:32916) 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977659c640 1 -- 172.21.15.12:0/2933888583 learned_addr learned my addr 172.21.15.12:0/2933888583 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f9776d9d640 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a27370 0x5628c4a24560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977659c640 1 -- 172.21.15.12:0/2933888583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a27370 msgr2=0x5628c4a24560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977659c640 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a27370 0x5628c4a24560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977659c640 1 -- 172.21.15.12:0/2933888583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 msgr2=0x5628c4a23fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977659c640 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a23fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f977659c640 1 -- 172.21.15.12:0/2933888583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628c46f33c0 con 0x5628c4a1c5d0 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.534+0000 7f9775d9b640 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a23fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.535+0000 7f977659c640 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1c5d0 0x5628c4a26d10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9768006010 tx=0x7f9768009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e0b48d9558bb206 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:57.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.535+0000 7f975dffb640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:55:57.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.535+0000 7f975dffb640 1 -- 172.21.15.12:0/2933888583 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976804e070 con 0x5628c4a1c5d0 2024-09-19T06:55:57.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.535+0000 7f977ed2f740 1 -- 172.21.15.12:0/2933888583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9770019070 con 0x5628c4a1c5d0 2024-09-19T06:55:57.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.535+0000 7f975dffb640 1 -- 172.21.15.12:0/2933888583 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f97680035f0 con 0x5628c4a1c5d0 2024-09-19T06:55:57.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.535+0000 7f975dffb640 1 -- 172.21.15.12:0/2933888583 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f976805a050 con 0x5628c4a1c5d0 2024-09-19T06:55:57.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.535+0000 7f977ed2f740 10 client.29132 fetch_fsmap learned FSMap version 54 2024-09-19T06:55:57.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.535+0000 7f977ed2f740 1 -- 172.21.15.12:0/2933888583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5628c4a35ac0 con 0x5628c4a1c5d0 2024-09-19T06:55:57.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.535+0000 7f975dffb640 1 -- 172.21.15.12:0/2933888583 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9770019070 con 0x5628c4a1c5d0 2024-09-19T06:55:57.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.535+0000 7f975dffb640 1 -- 172.21.15.12:0/2933888583 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 54) ==== 8366+0+0 (secure 0 0 0) 0x7f976804a890 con 0x5628c4a1c5d0 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.536+0000 7f977ed2f740 10 client.29132 fetch_fsmap finished waiting for FSMap version 54 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.536+0000 7f977ed2f740 10 client.29132 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.536+0000 7f977ed2f740 20 client.29132 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.536+0000 7f977ed2f740 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5628c4a36f20 0x5628c4a39350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.536+0000 7f977ed2f740 4 client.29132 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.536+0000 7f977ed2f740 1 -- 172.21.15.12:0/2933888583 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628c498f860 con 0x5628c4a36f20 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.536+0000 7f9775d9b640 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5628c4a36f20 0x5628c4a39350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.536+0000 7f9775d9b640 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5628c4a36f20 0x5628c4a39350 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4483916ca173dbbd server_cookie=bdebc2800ab0caa6 in_seq=0 out_seq=0 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.536+0000 7f975dffb640 10 client.29132 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f975dffb640 1 -- 172.21.15.12:0/2933888583 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628c498f860 con 0x5628c4a36f20 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f975dffb640 10 client.29132 handle_command_reply: tid=0 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 client.29132 shutdown 2024-09-19T06:55:57.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 -- 172.21.15.12:0/2933888583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1c5d0 msgr2=0x5628c4a26d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1c5d0 0x5628c4a26d10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9768006010 tx=0x7f9768009260 comp rx=0 tx=0).stop 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 -- 172.21.15.12:0/2933888583 shutdown_connections 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5628c4a36f20 0x5628c4a39350 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a27370 0x5628c4a24560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f975dffb640 0 client.29132 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a23fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 --2- 172.21.15.12:0/2933888583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a1c5d0 0x5628c4a26d10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 -- 172.21.15.12:0/2933888583 >> 172.21.15.12:0/2933888583 conn(0x5628c49e5310 msgr2=0x5628c4a1e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 -- 172.21.15.12:0/2933888583 shutdown_connections 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.537+0000 7f977ed2f740 1 -- 172.21.15.12:0/2933888583 wait complete. 2024-09-19T06:55:57.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.538+0000 7f977ed2f740 20 client.29132 trim_cache size 0 max 16384 2024-09-19T06:55:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.550+0000 7f977ed2f740 1 Processor -- start 2024-09-19T06:55:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f977ed2f740 1 -- start start 2024-09-19T06:55:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1c5d0 0x5628c4a33310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a17bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 0x5628c4a18130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f977ed2f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f97781afd90 con 0x5628c4a1db40 2024-09-19T06:55:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f977ed2f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97781b1900 con 0x5628c4a27370 2024-09-19T06:55:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f977ed2f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f97781b0460 con 0x5628c4a1c5d0 2024-09-19T06:55:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f9775d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a17bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f9775d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a17bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32918/0 (socket says 172.21.15.12:32918) 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f9775d9b640 1 -- 172.21.15.12:0/3239291294 learned_addr learned my addr 172.21.15.12:0/3239291294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f977659c640 1 --2- 172.21.15.12:0/3239291294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1c5d0 0x5628c4a33310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f9776d9d640 1 --2- 172.21.15.12:0/3239291294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 0x5628c4a18130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f9775d9b640 1 -- 172.21.15.12:0/3239291294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1c5d0 msgr2=0x5628c4a33310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f9775d9b640 1 --2- 172.21.15.12:0/3239291294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1c5d0 0x5628c4a33310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f9775d9b640 1 -- 172.21.15.12:0/3239291294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 msgr2=0x5628c4a18130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f9775d9b640 1 --2- 172.21.15.12:0/3239291294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 0x5628c4a18130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.551+0000 7f9775d9b640 1 -- 172.21.15.12:0/3239291294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628c4a1d300 con 0x5628c4a1db40 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.552+0000 7f9775d9b640 1 --2- 172.21.15.12:0/3239291294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a17bf0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f97600bafd0 tx=0x7f97600d2660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de392a637d3a9fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.552+0000 7f975ffff640 1 -- 172.21.15.12:0/3239291294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976009c210 con 0x5628c4a1db40 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.552+0000 7f975ffff640 1 -- 172.21.15.12:0/3239291294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97600d3e50 con 0x5628c4a1db40 2024-09-19T06:55:57.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.552+0000 7f975ffff640 1 -- 172.21.15.12:0/3239291294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976009bda0 con 0x5628c4a1db40 2024-09-19T06:55:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 -- 172.21.15.12:0/3239291294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 msgr2=0x5628c4a17bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 --2- 172.21.15.12:0/3239291294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a17bf0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f97600bafd0 tx=0x7f97600d2660 comp rx=0 tx=0).stop 2024-09-19T06:55:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 -- 172.21.15.12:0/3239291294 shutdown_connections 2024-09-19T06:55:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 --2- 172.21.15.12:0/3239291294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 0x5628c4a18130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 --2- 172.21.15.12:0/3239291294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1db40 0x5628c4a17bf0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 --2- 172.21.15.12:0/3239291294 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1c5d0 0x5628c4a33310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 -- 172.21.15.12:0/3239291294 >> 172.21.15.12:0/3239291294 conn(0x5628c49e5310 msgr2=0x5628c4a174e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 -- 172.21.15.12:0/3239291294 shutdown_connections 2024-09-19T06:55:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 -- 172.21.15.12:0/3239291294 wait complete. 2024-09-19T06:55:57.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 -- start start 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.553+0000 7f977ed2f740 1 Processor -- start 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1c5d0 0x5628c4a2f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1db40 0x5628c4a2fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977ed2f740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 0x5628c4a2c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977ed2f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f97781b1200 con 0x5628c4a1c5d0 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977ed2f740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f97781b0b30 con 0x5628c4a27370 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977ed2f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f97781add90 con 0x5628c4a1db40 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977ed2f740 10 client.0 _ll_register_callbacks cb 0x7f9768004370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1c5d0 0x5628c4a2f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1c5d0 0x5628c4a2f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32930/0 (socket says 172.21.15.12:32930) 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977659c640 1 -- 172.21.15.12:0/1282474768 learned_addr learned my addr 172.21.15.12:0/1282474768 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:55:57.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f9775d9b640 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1db40 0x5628c4a2fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f9776d9d640 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 0x5628c4a2c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977659c640 1 -- 172.21.15.12:0/1282474768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1db40 msgr2=0x5628c4a2fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977659c640 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1db40 0x5628c4a2fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977659c640 1 -- 172.21.15.12:0/1282474768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 msgr2=0x5628c4a2c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977659c640 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 0x5628c4a2c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977659c640 1 -- 172.21.15.12:0/1282474768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628c4a2ccc0 con 0x5628c4a1c5d0 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f9776d9d640 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 0x5628c4a2c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f9775d9b640 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1db40 0x5628c4a2fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977659c640 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1c5d0 0x5628c4a2f660 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f97680096c0 tx=0x7f976804a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b2b91ce266c92d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f975dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f975dffb640 1 -- 172.21.15.12:0/1282474768 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9768062070 con 0x5628c4a1c5d0 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f977ed2f740 1 -- 172.21.15.12:0/1282474768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97600d3e50 con 0x5628c4a1c5d0 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.554+0000 7f975dffb640 1 -- 172.21.15.12:0/1282474768 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f976803d650 con 0x5628c4a1c5d0 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f975dffb640 1 -- 172.21.15.12:0/1282474768 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f976806e050 con 0x5628c4a1c5d0 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f977ed2f740 10 client.19833 fetch_fsmap learned FSMap version 54 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f977ed2f740 1 -- 172.21.15.12:0/1282474768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5628c4aa2760 con 0x5628c4a1c5d0 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f975dffb640 1 -- 172.21.15.12:0/1282474768 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97600d3e50 con 0x5628c4a1c5d0 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f975dffb640 1 -- 172.21.15.12:0/1282474768 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 54) ==== 8366+0+0 (secure 0 0 0) 0x7f97680536b0 con 0x5628c4a1c5d0 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f977ed2f740 10 client.19833 fetch_fsmap finished waiting for FSMap version 54 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f977ed2f740 10 client.19833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f977ed2f740 20 client.19833 populate_metadata read hostname 'smithi012' 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f977ed2f740 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5628c4aa2e20 0x5628c4aa5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f977ed2f740 4 client.19833 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f977ed2f740 1 -- 172.21.15.12:0/1282474768 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628c4989d70 con 0x5628c4aa2e20 2024-09-19T06:55:57.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.555+0000 7f9775d9b640 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5628c4aa2e20 0x5628c4aa5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f975dffb640 10 client.19833 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f9775d9b640 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5628c4aa2e20 0x5628c4aa5210 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f906a3326177fd4 server_cookie=efc1c1b4742523be in_seq=0 out_seq=0 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f975dffb640 1 -- 172.21.15.12:0/1282474768 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628c4989d70 con 0x5628c4aa2e20 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f975dffb640 10 client.19833 handle_command_reply: tid=0 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f977ed2f740 1 client.19833 shutdown 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f977ed2f740 1 -- 172.21.15.12:0/1282474768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1c5d0 msgr2=0x5628c4a2f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f977ed2f740 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1c5d0 0x5628c4a2f660 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f97680096c0 tx=0x7f976804a680 comp rx=0 tx=0).stop 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f977ed2f740 1 -- 172.21.15.12:0/1282474768 shutdown_connections 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f977ed2f740 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5628c4aa2e20 0x5628c4aa5210 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f977ed2f740 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5628c4a27370 0x5628c4a2c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f977ed2f740 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5628c4a1db40 0x5628c4a2fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f975dffb640 0 client.19833 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:55:57.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f977ed2f740 1 --2- 172.21.15.12:0/1282474768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5628c4a1c5d0 0x5628c4a2f660 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f977ed2f740 1 -- 172.21.15.12:0/1282474768 >> 172.21.15.12:0/1282474768 conn(0x5628c49e5310 msgr2=0x5628c4a174e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:57.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.556+0000 7f977ed2f740 1 -- 172.21.15.12:0/1282474768 shutdown_connections 2024-09-19T06:55:57.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977ed2f740 1 -- 172.21.15.12:0/1282474768 wait complete. 2024-09-19T06:55:57.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977ed2f740 20 client.19833 trim_cache size 0 max 16384 2024-09-19T06:55:57.563 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 -- 172.21.15.12:0/4189259440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f97640a33b0 msgr2=0x7f97640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f97640a33b0 0x7f97640a5870 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x5628c4a19ac0 tx=0x7f97680046c0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 -- 172.21.15.12:0/4189259440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9778101360 msgr2=0x7f97781a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9778101360 0x7f97781a0910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f976000e9f0 tx=0x7f976000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 -- 172.21.15.12:0/4189259440 shutdown_connections 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f977810e4d0 0x7f977819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9778101360 0x7f97781a0910 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f97640a33b0 0x7f97640a5870 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 --2- 172.21.15.12:0/4189259440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97781009b0 0x7f97781a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 -- 172.21.15.12:0/4189259440 >> 172.21.15.12:0/4189259440 conn(0x7f97780fc7d0 msgr2=0x7f97780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:57.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 -- 172.21.15.12:0/4189259440 shutdown_connections 2024-09-19T06:55:57.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:55:57.557+0000 7f977c956640 1 -- 172.21.15.12:0/4189259440 wait complete. 2024-09-19T06:55:58.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:55:58 smithi016 ceph-mon[34911]: pgmap v495: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.2 MiB/s wr, 760 op/s 2024-09-19T06:55:58.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:55:58 smithi173 ceph-mon[35349]: pgmap v495: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.2 MiB/s wr, 760 op/s 2024-09-19T06:55:58.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:55:58 smithi012 ceph-mon[30937]: pgmap v495: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.2 MiB/s wr, 760 op/s 2024-09-19T06:55:59.384 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:55:59.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:55:59.661 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.146+0000 7f40d1c4e640 1 -- 172.21.15.12:0/1041951974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40cc102ef0 msgr2=0x7f40cc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.146+0000 7f40d1c4e640 1 --2- 172.21.15.12:0/1041951974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40cc102ef0 0x7f40cc10da40 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009900 tx=0x7f40c402a480 comp rx=0 tx=0).stop 2024-09-19T06:56:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.146+0000 7f40d1c4e640 1 -- 172.21.15.12:0/1041951974 shutdown_connections 2024-09-19T06:56:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.146+0000 7f40d1c4e640 1 --2- 172.21.15.12:0/1041951974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40cc102ef0 0x7f40cc10da40 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.146+0000 7f40d1c4e640 1 --2- 172.21.15.12:0/1041951974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40cc102570 0x7f40cc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.146+0000 7f40d1c4e640 1 --2- 172.21.15.12:0/1041951974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40cc100e20 0x7f40cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.146+0000 7f40d1c4e640 1 -- 172.21.15.12:0/1041951974 >> 172.21.15.12:0/1041951974 conn(0x7f40cc0fc7d0 msgr2=0x7f40cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.146+0000 7f40d1c4e640 1 -- 172.21.15.12:0/1041951974 shutdown_connections 2024-09-19T06:56:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.146+0000 7f40d1c4e640 1 -- 172.21.15.12:0/1041951974 wait complete. 2024-09-19T06:56:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.146+0000 7f40d1c4e640 1 Processor -- start 2024-09-19T06:56:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40d1c4e640 1 -- start start 2024-09-19T06:56:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40d1c4e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40cc100e20 0x7f40cc1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40d1c4e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40cc102570 0x7f40cc198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40d1c4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40cc102ef0 0x7f40cc19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40d1c4e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc110f80 con 0x7f40cc102ef0 2024-09-19T06:56:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40d1c4e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc110e00 con 0x7f40cc100e20 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40d1c4e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc111100 con 0x7f40cc102570 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40cc102ef0 0x7f40cc19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40caffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40cc102570 0x7f40cc198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40cc102ef0 0x7f40cc19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32954/0 (socket says 172.21.15.12:32954) 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40cbfff640 1 -- 172.21.15.12:0/3729714452 learned_addr learned my addr 172.21.15.12:0/3729714452 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40cc100e20 0x7f40cc1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40cbfff640 1 -- 172.21.15.12:0/3729714452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40cc102570 msgr2=0x7f40cc198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40cbfff640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40cc102570 0x7f40cc198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40cbfff640 1 -- 172.21.15.12:0/3729714452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40cc100e20 msgr2=0x7f40cc1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40cbfff640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40cc100e20 0x7f40cc1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.147+0000 7f40cbfff640 1 -- 172.21.15.12:0/3729714452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40cc19d470 con 0x7f40cc102ef0 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.148+0000 7f40cbfff640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40cc102ef0 0x7f40cc19cd90 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f40c4004770 tx=0x7f40c4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.148+0000 7f40c8ff9640 1 -- 172.21.15.12:0/3729714452 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c403f070 con 0x7f40cc102ef0 2024-09-19T06:56:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.148+0000 7f40d1c4e640 1 -- 172.21.15.12:0/3729714452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40cc19d700 con 0x7f40cc102ef0 2024-09-19T06:56:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.148+0000 7f40d1c4e640 1 -- 172.21.15.12:0/3729714452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40cc1a5040 con 0x7f40cc102ef0 2024-09-19T06:56:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.148+0000 7f40c8ff9640 1 -- 172.21.15.12:0/3729714452 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40c4031c30 con 0x7f40cc102ef0 2024-09-19T06:56:00.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.148+0000 7f40c8ff9640 1 -- 172.21.15.12:0/3729714452 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4035030 con 0x7f40cc102ef0 2024-09-19T06:56:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.150+0000 7f40c8ff9640 1 -- 172.21.15.12:0/3729714452 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f40c4042070 con 0x7f40cc102ef0 2024-09-19T06:56:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40d4027740 1 Processor -- start 2024-09-19T06:56:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40d4027740 1 -- start start 2024-09-19T06:56:00.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40c8ff9640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40b40a3430 0x7f40b40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40d4027740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbdcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40d4027740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 0x55606cbe7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40d4027740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbe7d40 0x55606cbea130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40d4027740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55606cb42280 con 0x55606cbdcb60 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40d4027740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55606cae9b10 con 0x55606cbdd480 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40d4027740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55606cb3e240 con 0x55606cbe7d40 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40caffd640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40b40a3430 0x7f40b40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40c8ff9640 1 -- 172.21.15.12:0/3729714452 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f40c40f0710 con 0x7f40cc102ef0 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40cb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbdcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40cb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbdcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32970/0 (socket says 172.21.15.12:32970) 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40cb7fe640 1 -- 172.21.15.12:0/417925885 learned_addr learned my addr 172.21.15.12:0/417925885 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.151+0000 7f40cbfff640 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbe7d40 0x55606cbea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40caffd640 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 0x55606cbe7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40cb7fe640 1 -- 172.21.15.12:0/417925885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbe7d40 msgr2=0x55606cbea130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbe7d40 0x55606cbea130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40cb7fe640 1 -- 172.21.15.12:0/417925885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 msgr2=0x55606cbe7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 0x55606cbe7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40cb7fe640 1 -- 172.21.15.12:0/417925885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55606caf61f0 con 0x55606cbdcb60 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40cbfff640 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbe7d40 0x55606cbea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40caffd640 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 0x55606cbe7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40caffd640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40b40a3430 0x7f40b40a58f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f40cc105290 tx=0x7f40c00097c0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbdcf40 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f40bc003a20 tx=0x7f40bc003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7f61bf3fda1073 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40b1ffb640 1 -- 172.21.15.12:0/417925885 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc004860 con 0x55606cbdcb60 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40b1ffb640 1 -- 172.21.15.12:0/417925885 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40bc015030 con 0x55606cbdcb60 2024-09-19T06:56:00.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.152+0000 7f40b1ffb640 1 -- 172.21.15.12:0/417925885 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc010a70 con 0x55606cbdcb60 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 -- 172.21.15.12:0/417925885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 msgr2=0x55606cbdcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbdcf40 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f40bc003a20 tx=0x7f40bc003ee0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 -- 172.21.15.12:0/417925885 shutdown_connections 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbe7d40 0x55606cbea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 0x55606cbe7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 --2- 172.21.15.12:0/417925885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbdcf40 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 -- 172.21.15.12:0/417925885 >> 172.21.15.12:0/417925885 conn(0x55606cbd90f0 msgr2=0x55606cbd94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 -- 172.21.15.12:0/417925885 shutdown_connections 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 -- 172.21.15.12:0/417925885 wait complete. 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 -- start start 2024-09-19T06:56:00.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.153+0000 7f40d4027740 1 Processor -- start 2024-09-19T06:56:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40d4027740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 0x55606cbe7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40d4027740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 0x55606cbe4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40d4027740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbe7d40 0x55606cbe50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40d4027740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55606cbea910 con 0x55606cbe7d40 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40d4027740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55606cafcf10 con 0x55606cbdd480 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40d4027740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55606cbeaa90 con 0x55606cbdcb60 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40d4027740 10 client.0 _ll_register_callbacks cb 0x55606cac5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbe7d40 0x55606cbe50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbe7d40 0x55606cbe50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32978/0 (socket says 172.21.15.12:32978) 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40cbfff640 1 -- 172.21.15.12:0/1026193879 learned_addr learned my addr 172.21.15.12:0/1026193879 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40caffd640 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 0x55606cbe4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 0x55606cbe7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40cbfff640 1 -- 172.21.15.12:0/1026193879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 msgr2=0x55606cbe7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40cbfff640 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 0x55606cbe7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40cbfff640 1 -- 172.21.15.12:0/1026193879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 msgr2=0x55606cbe4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40cbfff640 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 0x55606cbe4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40cbfff640 1 -- 172.21.15.12:0/1026193879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55606c8b36a0 con 0x55606cbe7d40 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40caffd640 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 0x55606cbe4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.154+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 0x55606cbe7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40cbfff640 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbe7d40 0x55606cbe50c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f40c40bc6a0 tx=0x7f40c40bc4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5052c35291e10656 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40aaffd640 1 -- 172.21.15.12:0/1026193879 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4049070 con 0x55606cbe7d40 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40aaffd640 1 -- 172.21.15.12:0/1026193879 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f40c40b9010 con 0x55606cbe7d40 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40d4027740 1 -- 172.21.15.12:0/1026193879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40bc015030 con 0x55606cbe7d40 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40aaffd640 1 -- 172.21.15.12:0/1026193879 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f40c40330d0 con 0x55606cbe7d40 2024-09-19T06:56:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40d4027740 10 client.19845 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40d4027740 1 -- 172.21.15.12:0/1026193879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55606cbf63a0 con 0x55606cbe7d40 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40aaffd640 1 -- 172.21.15.12:0/1026193879 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40bc015030 con 0x55606cbe7d40 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40aaffd640 1 -- 172.21.15.12:0/1026193879 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7f40c403b460 con 0x55606cbe7d40 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40d4027740 10 client.19845 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40d4027740 10 client.19845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40d4027740 20 client.19845 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40d4027740 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55606cbf7830 0x55606cbf9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40d4027740 4 client.19845 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.155+0000 7f40d4027740 1 -- 172.21.15.12:0/1026193879 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55606cb4f7f0 con 0x55606cbf7830 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.156+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55606cbf7830 0x55606cbf9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.156+0000 7f40aaffd640 10 client.19845 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.156+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55606cbf7830 0x55606cbf9cd0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa7cac14941af77e server_cookie=1a858abc0098ab33 in_seq=0 out_seq=0 2024-09-19T06:56:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40aaffd640 1 -- 172.21.15.12:0/1026193879 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55606cb4f7f0 con 0x55606cbf7830 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40aaffd640 10 client.19845 handle_command_reply: tid=0 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40d4027740 1 client.19845 shutdown 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40d4027740 1 -- 172.21.15.12:0/1026193879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbe7d40 msgr2=0x55606cbe50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40d4027740 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbe7d40 0x55606cbe50c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f40c40bc6a0 tx=0x7f40c40bc4e0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40d4027740 1 -- 172.21.15.12:0/1026193879 shutdown_connections 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40d4027740 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55606cbf7830 0x55606cbf9cd0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40d4027740 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbe7d40 0x55606cbe50c0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40d4027740 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbdd480 0x55606cbe4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40d4027740 1 --2- 172.21.15.12:0/1026193879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 0x55606cbe7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40aaffd640 0 client.19845 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.157+0000 7f40d4027740 1 -- 172.21.15.12:0/1026193879 >> 172.21.15.12:0/1026193879 conn(0x55606cbd90f0 msgr2=0x55606cbd8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.158+0000 7f40d4027740 1 -- 172.21.15.12:0/1026193879 shutdown_connections 2024-09-19T06:56:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.158+0000 7f40d4027740 1 -- 172.21.15.12:0/1026193879 wait complete. 2024-09-19T06:56:00.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.158+0000 7f40d4027740 20 client.19845 trim_cache size 0 max 16384 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40d4027740 1 Processor -- start 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40d4027740 1 -- start start 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40d4027740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 0x55606cbf3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40d4027740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdd480 0x55606cbe6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40d4027740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbe7d40 0x55606cbff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40d4027740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40b800e920 con 0x55606cbdd480 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40d4027740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40b8010520 con 0x55606cbe7d40 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40d4027740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40b800eff0 con 0x55606cbdcb60 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40caffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdd480 0x55606cbe6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40caffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdd480 0x55606cbe6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32986/0 (socket says 172.21.15.12:32986) 2024-09-19T06:56:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40caffd640 1 -- 172.21.15.12:0/616604165 learned_addr learned my addr 172.21.15.12:0/616604165 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40cbfff640 1 --2- 172.21.15.12:0/616604165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbe7d40 0x55606cbff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/616604165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 0x55606cbf3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40caffd640 1 -- 172.21.15.12:0/616604165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 msgr2=0x55606cbf3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40caffd640 1 --2- 172.21.15.12:0/616604165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 0x55606cbf3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40caffd640 1 -- 172.21.15.12:0/616604165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbe7d40 msgr2=0x55606cbff5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40caffd640 1 --2- 172.21.15.12:0/616604165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbe7d40 0x55606cbff5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40caffd640 1 -- 172.21.15.12:0/616604165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55606cbd4830 con 0x55606cbdd480 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.175+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/616604165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 0x55606cbf3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.176+0000 7f40caffd640 1 --2- 172.21.15.12:0/616604165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdd480 0x55606cbe6910 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009f00 tx=0x7f40c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbe2982283689db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.176+0000 7f40b17fa640 1 -- 172.21.15.12:0/616604165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0003b70 con 0x55606cbdd480 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.176+0000 7f40b17fa640 1 -- 172.21.15.12:0/616604165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40c0003d10 con 0x55606cbdd480 2024-09-19T06:56:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.176+0000 7f40b17fa640 1 -- 172.21.15.12:0/616604165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c001f630 con 0x55606cbdd480 2024-09-19T06:56:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.176+0000 7f40d4027740 1 -- 172.21.15.12:0/616604165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdd480 msgr2=0x55606cbe6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.176+0000 7f40d4027740 1 --2- 172.21.15.12:0/616604165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdd480 0x55606cbe6910 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009f00 tx=0x7f40c0016000 comp rx=0 tx=0).stop 2024-09-19T06:56:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 -- 172.21.15.12:0/616604165 shutdown_connections 2024-09-19T06:56:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 --2- 172.21.15.12:0/616604165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbe7d40 0x55606cbff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 --2- 172.21.15.12:0/616604165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdd480 0x55606cbe6910 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 --2- 172.21.15.12:0/616604165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdcb60 0x55606cbf3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 -- 172.21.15.12:0/616604165 >> 172.21.15.12:0/616604165 conn(0x55606cbd90f0 msgr2=0x55606cbe6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 -- 172.21.15.12:0/616604165 shutdown_connections 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 -- 172.21.15.12:0/616604165 wait complete. 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 -- start start 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 Processor -- start 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbefd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdd480 0x55606cbf02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbe7d40 0x55606cbead30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40b800fd90 con 0x55606cbdcb60 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f40b800f6c0 con 0x55606cbe7d40 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.177+0000 7f40d4027740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f40b800c920 con 0x55606cbdd480 2024-09-19T06:56:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40d4027740 10 client.0 _ll_register_callbacks cb 0x7f40c4005b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40cb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbefd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40cb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbefd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33002/0 (socket says 172.21.15.12:33002) 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40cb7fe640 1 -- 172.21.15.12:0/489610165 learned_addr learned my addr 172.21.15.12:0/489610165 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40caffd640 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdd480 0x55606cbf02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40cbfff640 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbe7d40 0x55606cbead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40cb7fe640 1 -- 172.21.15.12:0/489610165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdd480 msgr2=0x55606cbf02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdd480 0x55606cbf02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40cb7fe640 1 -- 172.21.15.12:0/489610165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbe7d40 msgr2=0x55606cbead30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbe7d40 0x55606cbead30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40cb7fe640 1 -- 172.21.15.12:0/489610165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55606cbe7ad0 con 0x55606cbdcb60 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40cb7fe640 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbefd80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0044d0 tx=0x7f40bc0097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbc82d405710ee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40aaffd640 1 -- 172.21.15.12:0/489610165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc004c70 con 0x55606cbdcb60 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40aaffd640 1 -- 172.21.15.12:0/489610165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f40bc010740 con 0x55606cbdcb60 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.178+0000 7f40d4027740 1 -- 172.21.15.12:0/489610165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40c0003d10 con 0x55606cbdcb60 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40aaffd640 1 -- 172.21.15.12:0/489610165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f40bc004e10 con 0x55606cbdcb60 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40d4027740 10 client.19851 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40d4027740 1 -- 172.21.15.12:0/489610165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55606cc66de0 con 0x55606cbdcb60 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40aaffd640 1 -- 172.21.15.12:0/489610165 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40c0003d10 con 0x55606cbdcb60 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40aaffd640 1 -- 172.21.15.12:0/489610165 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7f40bc005570 con 0x55606cbdcb60 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40d4027740 10 client.19851 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40d4027740 10 client.19851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40d4027740 20 client.19851 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40d4027740 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55606cc67280 0x55606cc696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40d4027740 4 client.19851 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:56:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40d4027740 1 -- 172.21.15.12:0/489610165 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55606cb49d00 con 0x55606cc67280 2024-09-19T06:56:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.179+0000 7f40caffd640 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55606cc67280 0x55606cc696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.180+0000 7f40aaffd640 10 client.19851 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.180+0000 7f40caffd640 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55606cc67280 0x55606cc696a0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14845142a3d4db6b server_cookie=558f875a2dc1ce06 in_seq=0 out_seq=0 2024-09-19T06:56:00.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40aaffd640 1 -- 172.21.15.12:0/489610165 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55606cb49d00 con 0x55606cc67280 2024-09-19T06:56:00.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40aaffd640 10 client.19851 handle_command_reply: tid=0 2024-09-19T06:56:00.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 client.19851 shutdown 2024-09-19T06:56:00.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 -- 172.21.15.12:0/489610165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 msgr2=0x55606cbefd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:00.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbefd80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0044d0 tx=0x7f40bc0097f0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 -- 172.21.15.12:0/489610165 shutdown_connections 2024-09-19T06:56:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55606cc67280 0x55606cc696a0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55606cbe7d40 0x55606cbead30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55606cbdd480 0x55606cbf02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40aaffd640 0 client.19851 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 --2- 172.21.15.12:0/489610165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55606cbdcb60 0x55606cbefd80 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 -- 172.21.15.12:0/489610165 >> 172.21.15.12:0/489610165 conn(0x55606cbd90f0 msgr2=0x55606cbd8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 -- 172.21.15.12:0/489610165 shutdown_connections 2024-09-19T06:56:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 1 -- 172.21.15.12:0/489610165 wait complete. 2024-09-19T06:56:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.181+0000 7f40d4027740 20 client.19851 trim_cache size 0 max 16384 2024-09-19T06:56:00.187 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:56:00.188 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-19T06:56:00.188 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "8f67ff7b-a0a0-4791-a787-505c7328a7dc", 2024-09-19T06:56:00.188 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-19T06:56:00.188 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 -- 172.21.15.12:0/3729714452 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40b40a3430 msgr2=0x7f40b40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40b40a3430 0x7f40b40a58f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f40cc105290 tx=0x7f40c00097c0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 -- 172.21.15.12:0/3729714452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40cc102ef0 msgr2=0x7f40cc19cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40cc102ef0 0x7f40cc19cd90 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f40c4004770 tx=0x7f40c4003c10 comp rx=0 tx=0).stop 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 -- 172.21.15.12:0/3729714452 shutdown_connections 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40cc102ef0 0x7f40cc19cd90 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f40b40a3430 0x7f40b40a58f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40cc102570 0x7f40cc198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 --2- 172.21.15.12:0/3729714452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40cc100e20 0x7f40cc1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 -- 172.21.15.12:0/3729714452 >> 172.21.15.12:0/3729714452 conn(0x7f40cc0fc7d0 msgr2=0x7f40cc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 -- 172.21.15.12:0/3729714452 shutdown_connections 2024-09-19T06:56:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:00.182+0000 7f40d1c4e640 1 -- 172.21.15.12:0/3729714452 wait complete. 2024-09-19T06:56:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:00 smithi012 ceph-mon[30937]: pgmap v496: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.2 MiB/s wr, 752 op/s 2024-09-19T06:56:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:00 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:56:00.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:00 smithi016 ceph-mon[34911]: pgmap v496: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.2 MiB/s wr, 752 op/s 2024-09-19T06:56:00.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:00 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:56:00.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:00 smithi173 ceph-mon[35349]: pgmap v496: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.2 MiB/s wr, 752 op/s 2024-09-19T06:56:00.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:00 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:56:00.982 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:56:01.240 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:01.479 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub queued for path: / 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:56:01.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.481 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: active paths [/] 2024-09-19T06:56:01.481 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.481 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.481 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.481 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.481 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:01 smithi012 ceph-mon[30937]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub queued for path: / 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: active paths [/] 2024-09-19T06:56:01.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:01 smithi016 ceph-mon[34911]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub queued for path: / 2024-09-19T06:56:01.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:56:01.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: active paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.583 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:01 smithi173 ceph-mon[35349]: scrub summary: idle+waiting paths [/] 2024-09-19T06:56:01.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.683+0000 7fc9806f8640 1 -- 172.21.15.12:0/122796201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc978100310 msgr2=0x7fc9781006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.683+0000 7fc9806f8640 1 --2- 172.21.15.12:0/122796201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc978100310 0x7fc9781006f0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fc974009900 tx=0x7fc97402a410 comp rx=0 tx=0).stop 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.683+0000 7fc9806f8640 1 -- 172.21.15.12:0/122796201 shutdown_connections 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.683+0000 7fc9806f8640 1 --2- 172.21.15.12:0/122796201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc978106f30 0x7fc97810eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.683+0000 7fc9806f8640 1 --2- 172.21.15.12:0/122796201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978100cc0 0x7fc978106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.683+0000 7fc9806f8640 1 --2- 172.21.15.12:0/122796201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc978100310 0x7fc9781006f0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.683+0000 7fc9806f8640 1 -- 172.21.15.12:0/122796201 >> 172.21.15.12:0/122796201 conn(0x7fc978077210 msgr2=0x7fc9780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.683+0000 7fc9806f8640 1 -- 172.21.15.12:0/122796201 shutdown_connections 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.683+0000 7fc9806f8640 1 -- 172.21.15.12:0/122796201 wait complete. 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc9806f8640 1 Processor -- start 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc9806f8640 1 -- start start 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc9806f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978100310 0x7fc978198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc9806f8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc978100cc0 0x7fc978198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc9806f8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc978106f30 0x7fc97819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc9806f8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc978111f50 con 0x7fc978106f30 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc9806f8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc978111dd0 con 0x7fc978100310 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc9806f8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781120d0 con 0x7fc978100cc0 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc97ec95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc978106f30 0x7fc97819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc97ec95640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc978106f30 0x7fc97819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37158/0 (socket says 172.21.15.12:37158) 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.684+0000 7fc97ec95640 1 -- 172.21.15.12:0/569782701 learned_addr learned my addr 172.21.15.12:0/569782701 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc97e494640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978100310 0x7fc978198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc97dc93640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc978100cc0 0x7fc978198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc97ec95640 1 -- 172.21.15.12:0/569782701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc978100cc0 msgr2=0x7fc978198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc97ec95640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc978100cc0 0x7fc978198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc97ec95640 1 -- 172.21.15.12:0/569782701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978100310 msgr2=0x7fc978198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:01.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc97ec95640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978100310 0x7fc978198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc97ec95640 1 -- 172.21.15.12:0/569782701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97819d400 con 0x7fc978106f30 2024-09-19T06:56:01.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc97ec95640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc978106f30 0x7fc97819cd20 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fc97000eaa0 tx=0x7fc97000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:01.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc96f7fe640 1 -- 172.21.15.12:0/569782701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97000cdb0 con 0x7fc978106f30 2024-09-19T06:56:01.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc96f7fe640 1 -- 172.21.15.12:0/569782701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc970005020 con 0x7fc978106f30 2024-09-19T06:56:01.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc9806f8640 1 -- 172.21.15.12:0/569782701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97819d6f0 con 0x7fc978106f30 2024-09-19T06:56:01.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc96f7fe640 1 -- 172.21.15.12:0/569782701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9700116b0 con 0x7fc978106f30 2024-09-19T06:56:01.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.685+0000 7fc9806f8640 1 -- 172.21.15.12:0/569782701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9781a4fd0 con 0x7fc978106f30 2024-09-19T06:56:01.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc96f7fe640 1 -- 172.21.15.12:0/569782701 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc970005560 con 0x7fc978106f30 2024-09-19T06:56:01.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc982ad1740 1 Processor -- start 2024-09-19T06:56:01.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc982ad1740 1 -- start start 2024-09-19T06:56:01.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8b3380 0x55653a8b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3ca0 0x55653a8c2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8c2a90 0x55653a8c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc982ad1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55653a8192e0 con 0x55653a8c2a90 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc982ad1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55653a7c0ce0 con 0x55653a8b3ca0 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc982ad1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55653a8152a0 con 0x55653a8b3380 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc97dc93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8c2a90 0x55653a8c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc97dc93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8c2a90 0x55653a8c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37170/0 (socket says 172.21.15.12:37170) 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.688+0000 7fc97dc93640 1 -- 172.21.15.12:0/2357958197 learned_addr learned my addr 172.21.15.12:0/2357958197 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc96f7fe640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9640a3430 0x7fc9640a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc97e494640 1 --2- 172.21.15.12:0/2357958197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3ca0 0x55653a8c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc97ec95640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9640a3430 0x7fc9640a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc97dc93640 1 -- 172.21.15.12:0/2357958197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8b3380 msgr2=0x55653a8b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:01.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc97dc93640 1 --2- 172.21.15.12:0/2357958197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8b3380 0x55653a8b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc97dc93640 1 -- 172.21.15.12:0/2357958197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3ca0 msgr2=0x55653a8c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc97dc93640 1 --2- 172.21.15.12:0/2357958197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3ca0 0x55653a8c2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc97dc93640 1 -- 172.21.15.12:0/2357958197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653a7a5440 con 0x55653a8c2a90 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc96f7fe640 1 -- 172.21.15.12:0/569782701 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7fc9700d0000 con 0x7fc978106f30 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc97dc93640 1 --2- 172.21.15.12:0/2357958197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8c2a90 0x55653a8c4e80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fc96800cd30 tx=0x7fc9680117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3f71c0c190279c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc96cff9640 1 -- 172.21.15.12:0/2357958197 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968012650 con 0x55653a8c2a90 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc97ec95640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9640a3430 0x7fc9640a58f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc9700a4980 tx=0x7fc9700916d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc96cff9640 1 -- 172.21.15.12:0/2357958197 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc96800ce20 con 0x55653a8c2a90 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.689+0000 7fc96cff9640 1 -- 172.21.15.12:0/2357958197 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96800fc00 con 0x55653a8c2a90 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.690+0000 7fc982ad1740 1 -- 172.21.15.12:0/2357958197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8c2a90 msgr2=0x55653a8c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.690+0000 7fc982ad1740 1 --2- 172.21.15.12:0/2357958197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8c2a90 0x55653a8c4e80 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fc96800cd30 tx=0x7fc9680117b0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.690+0000 7fc982ad1740 1 -- 172.21.15.12:0/2357958197 shutdown_connections 2024-09-19T06:56:01.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.690+0000 7fc982ad1740 1 --2- 172.21.15.12:0/2357958197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8c2a90 0x55653a8c4e80 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.690+0000 7fc982ad1740 1 --2- 172.21.15.12:0/2357958197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3ca0 0x55653a8c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.690+0000 7fc982ad1740 1 --2- 172.21.15.12:0/2357958197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8b3380 0x55653a8b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.690+0000 7fc982ad1740 1 -- 172.21.15.12:0/2357958197 >> 172.21.15.12:0/2357958197 conn(0x55653a8afa30 msgr2=0x55653a8afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:01.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.690+0000 7fc982ad1740 1 -- 172.21.15.12:0/2357958197 shutdown_connections 2024-09-19T06:56:01.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.690+0000 7fc982ad1740 1 -- 172.21.15.12:0/2357958197 wait complete. 2024-09-19T06:56:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc982ad1740 1 -- start start 2024-09-19T06:56:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc982ad1740 1 Processor -- start 2024-09-19T06:56:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8b3380 0x55653a8c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8c2a90 0x55653a8bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc982ad1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55653a8c5660 con 0x55653a8b3ca0 2024-09-19T06:56:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc982ad1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55653a7d4050 con 0x55653a8c2a90 2024-09-19T06:56:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc982ad1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55653a8c57e0 con 0x55653a8b3380 2024-09-19T06:56:01.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc982ad1740 10 client.0 _ll_register_callbacks cb 0x55653a814160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc97e494640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc97e494640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8bf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37178/0 (socket says 172.21.15.12:37178) 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc97e494640 1 -- 172.21.15.12:0/309631375 learned_addr learned my addr 172.21.15.12:0/309631375 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc97dc93640 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8c2a90 0x55653a8bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.691+0000 7fc97dc93640 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8b3380 0x55653a8c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc97e494640 1 -- 172.21.15.12:0/309631375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8b3380 msgr2=0x55653a8c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc97e494640 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8b3380 0x55653a8c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc97e494640 1 -- 172.21.15.12:0/309631375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8c2a90 msgr2=0x55653a8bfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc97e494640 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8c2a90 0x55653a8bfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc97e494640 1 -- 172.21.15.12:0/309631375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653a58a3c0 con 0x55653a8b3ca0 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc97dc93640 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8c2a90 0x55653a8bfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc97e494640 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8bf720 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fc974009900 tx=0x7fc974031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3456652b56e8003 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:01.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc961ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc961ffb640 1 -- 172.21.15.12:0/309631375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974035040 con 0x55653a8b3ca0 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc961ffb640 1 -- 172.21.15.12:0/309631375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7fc974004240 con 0x55653a8b3ca0 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc982ad1740 1 -- 172.21.15.12:0/309631375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc96800ce20 con 0x55653a8b3ca0 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc961ffb640 1 -- 172.21.15.12:0/309631375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fc974004440 con 0x55653a8b3ca0 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc982ad1740 10 client.19863 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc982ad1740 1 -- 172.21.15.12:0/309631375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55653a8d10f0 con 0x55653a8b3ca0 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.692+0000 7fc961ffb640 1 -- 172.21.15.12:0/309631375 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc96800ce20 con 0x55653a8b3ca0 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.693+0000 7fc961ffb640 1 -- 172.21.15.12:0/309631375 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7fc974004b10 con 0x55653a8b3ca0 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.693+0000 7fc982ad1740 10 client.19863 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.693+0000 7fc982ad1740 10 client.19863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.693+0000 7fc982ad1740 20 client.19863 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.693+0000 7fc982ad1740 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653a8d26b0 0x55653a8d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.693+0000 7fc982ad1740 4 client.19863 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.693+0000 7fc982ad1740 1 -- 172.21.15.12:0/309631375 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55653a826850 con 0x55653a8d26b0 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.693+0000 7fc97dc93640 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653a8d26b0 0x55653a8d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.693+0000 7fc961ffb640 10 client.19863 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.693+0000 7fc97dc93640 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653a8d26b0 0x55653a8d4b10 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9450fe1451974db server_cookie=2961cfaa838af488 in_seq=0 out_seq=0 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc961ffb640 1 -- 172.21.15.12:0/309631375 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55653a826850 con 0x55653a8d26b0 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc961ffb640 10 client.19863 handle_command_reply: tid=0 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 client.19863 shutdown 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 -- 172.21.15.12:0/309631375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 msgr2=0x55653a8bf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8bf720 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fc974009900 tx=0x7fc974031850 comp rx=0 tx=0).stop 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 -- 172.21.15.12:0/309631375 shutdown_connections 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653a8d26b0 0x55653a8d4b10 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8c2a90 0x55653a8bfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8bf720 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc961ffb640 0 client.19863 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 --2- 172.21.15.12:0/309631375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8b3380 0x55653a8c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 -- 172.21.15.12:0/309631375 >> 172.21.15.12:0/309631375 conn(0x55653a8afa30 msgr2=0x55653a8b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 -- 172.21.15.12:0/309631375 shutdown_connections 2024-09-19T06:56:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.694+0000 7fc982ad1740 1 -- 172.21.15.12:0/309631375 wait complete. 2024-09-19T06:56:01.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.695+0000 7fc982ad1740 20 client.19863 trim_cache size 0 max 16384 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc982ad1740 1 Processor -- start 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc982ad1740 1 -- start start 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 0x55653a8ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8befe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8c2a90 0x55653a8bada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc982ad1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781ab9f0 con 0x55653a8b3ca0 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc982ad1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781ad5f0 con 0x55653a8b3380 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc982ad1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781ac0c0 con 0x55653a8c2a90 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc97e494640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8befe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc97e494640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8befe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37180/0 (socket says 172.21.15.12:37180) 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc97e494640 1 -- 172.21.15.12:0/2866749422 learned_addr learned my addr 172.21.15.12:0/2866749422 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc97dc93640 1 --2- 172.21.15.12:0/2866749422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 0x55653a8ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc97dc93640 1 --2- 172.21.15.12:0/2866749422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8c2a90 0x55653a8bada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc97e494640 1 -- 172.21.15.12:0/2866749422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8c2a90 msgr2=0x55653a8bada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.712+0000 7fc97e494640 1 --2- 172.21.15.12:0/2866749422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8c2a90 0x55653a8bada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.713+0000 7fc97e494640 1 -- 172.21.15.12:0/2866749422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 msgr2=0x55653a8ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.713+0000 7fc97e494640 1 --2- 172.21.15.12:0/2866749422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 0x55653a8ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.713+0000 7fc97e494640 1 -- 172.21.15.12:0/2866749422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653a8bb2e0 con 0x55653a8b3ca0 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.713+0000 7fc97dc93640 1 --2- 172.21.15.12:0/2866749422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 0x55653a8ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.713+0000 7fc97e494640 1 --2- 172.21.15.12:0/2866749422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8befe0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fc974003690 tx=0x7fc974005920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78abdbfa534089ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.713+0000 7fc963fff640 1 -- 172.21.15.12:0/2866749422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974035030 con 0x55653a8b3ca0 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.713+0000 7fc963fff640 1 -- 172.21.15.12:0/2866749422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc974003910 con 0x55653a8b3ca0 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.713+0000 7fc963fff640 1 -- 172.21.15.12:0/2866749422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974003b70 con 0x55653a8b3ca0 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 -- 172.21.15.12:0/2866749422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 msgr2=0x55653a8befe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 --2- 172.21.15.12:0/2866749422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8befe0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fc974003690 tx=0x7fc974005920 comp rx=0 tx=0).stop 2024-09-19T06:56:01.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 -- 172.21.15.12:0/2866749422 shutdown_connections 2024-09-19T06:56:01.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 --2- 172.21.15.12:0/2866749422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8c2a90 0x55653a8bada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 --2- 172.21.15.12:0/2866749422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8befe0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 --2- 172.21.15.12:0/2866749422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 0x55653a8ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 -- 172.21.15.12:0/2866749422 >> 172.21.15.12:0/2866749422 conn(0x55653a8afa30 msgr2=0x55653a8afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:01.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 -- 172.21.15.12:0/2866749422 shutdown_connections 2024-09-19T06:56:01.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 -- 172.21.15.12:0/2866749422 wait complete. 2024-09-19T06:56:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 -- start start 2024-09-19T06:56:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 Processor -- start 2024-09-19T06:56:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 0x55653a8c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8c2a90 0x55653a9353e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781ace60 con 0x55653a8b3ca0 2024-09-19T06:56:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781ac790 con 0x55653a8b3380 2024-09-19T06:56:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.714+0000 7fc982ad1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc9781a99f0 con 0x55653a8c2a90 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc982ad1740 10 client.0 _ll_register_callbacks cb 0x7fc9740314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97e494640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97e494640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37184/0 (socket says 172.21.15.12:37184) 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97e494640 1 -- 172.21.15.12:0/1326914471 learned_addr learned my addr 172.21.15.12:0/1326914471 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97dc93640 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8c2a90 0x55653a9353e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97dc93640 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 0x55653a8c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97e494640 1 -- 172.21.15.12:0/1326914471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8c2a90 msgr2=0x55653a9353e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97e494640 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8c2a90 0x55653a9353e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97e494640 1 -- 172.21.15.12:0/1326914471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 msgr2=0x55653a8c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97e494640 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 0x55653a8c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97e494640 1 -- 172.21.15.12:0/1326914471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653a935a80 con 0x55653a8b3ca0 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc97e494640 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8c66b0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fc974009900 tx=0x7fc974005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf35e10917f0603 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc961ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc961ffb640 1 -- 172.21.15.12:0/1326914471 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974035040 con 0x55653a8b3ca0 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc982ad1740 1 -- 172.21.15.12:0/1326914471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc974003910 con 0x55653a8b3ca0 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.715+0000 7fc961ffb640 1 -- 172.21.15.12:0/1326914471 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7fc9740048d0 con 0x55653a8b3ca0 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc961ffb640 1 -- 172.21.15.12:0/1326914471 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fc974004b10 con 0x55653a8b3ca0 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc982ad1740 10 client.19869 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc982ad1740 1 -- 172.21.15.12:0/1326914471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55653a93ce20 con 0x55653a8b3ca0 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc961ffb640 1 -- 172.21.15.12:0/1326914471 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc974003910 con 0x55653a8b3ca0 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc961ffb640 1 -- 172.21.15.12:0/1326914471 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7fc974053020 con 0x55653a8b3ca0 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc982ad1740 10 client.19869 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc982ad1740 10 client.19869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc982ad1740 20 client.19869 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc982ad1740 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653a93d540 0x55653a93f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc982ad1740 4 client.19869 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc982ad1740 1 -- 172.21.15.12:0/1326914471 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55653a820d60 con 0x55653a93d540 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.716+0000 7fc97dc93640 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653a93d540 0x55653a93f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc97dc93640 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653a93d540 0x55653a93f960 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cd36922e3eaa285 server_cookie=92fe96aac4b370c1 in_seq=0 out_seq=0 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc961ffb640 10 client.19869 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc961ffb640 1 -- 172.21.15.12:0/1326914471 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55653a820d60 con 0x55653a93d540 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc961ffb640 10 client.19869 handle_command_reply: tid=0 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 client.19869 shutdown 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 -- 172.21.15.12:0/1326914471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 msgr2=0x55653a8c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8c66b0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fc974009900 tx=0x7fc974005990 comp rx=0 tx=0).stop 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 -- 172.21.15.12:0/1326914471 shutdown_connections 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55653a93d540 0x55653a93f960 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc961ffb640 0 client.19869 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55653a8c2a90 0x55653a9353e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55653a8b3ca0 0x55653a8c66b0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 --2- 172.21.15.12:0/1326914471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55653a8b3380 0x55653a8c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 -- 172.21.15.12:0/1326914471 >> 172.21.15.12:0/1326914471 conn(0x55653a8afa30 msgr2=0x55653a8aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:01.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 -- 172.21.15.12:0/1326914471 shutdown_connections 2024-09-19T06:56:01.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 1 -- 172.21.15.12:0/1326914471 wait complete. 2024-09-19T06:56:01.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.717+0000 7fc982ad1740 20 client.19869 trim_cache size 0 max 16384 2024-09-19T06:56:01.724 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:56:01.724 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:56:01.724 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-19T06:56:01.724 INFO:teuthology.orchestra.run.smithi012.stdout: "8f67ff7b-a0a0-4791-a787-505c7328a7dc": { 2024-09-19T06:56:01.725 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-19T06:56:01.725 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "8f67ff7b-a0a0-4791-a787-505c7328a7dc", 2024-09-19T06:56:01.725 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-19T06:56:01.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:01.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:01.725 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 -- 172.21.15.12:0/569782701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9640a3430 msgr2=0x7fc9640a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9640a3430 0x7fc9640a58f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc9700a4980 tx=0x7fc9700916d0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 -- 172.21.15.12:0/569782701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc978106f30 msgr2=0x7fc97819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc978106f30 0x7fc97819cd20 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fc97000eaa0 tx=0x7fc97000ef60 comp rx=0 tx=0).stop 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 -- 172.21.15.12:0/569782701 shutdown_connections 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc978106f30 0x7fc97819cd20 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc9640a3430 0x7fc9640a58f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc978100cc0 0x7fc978198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 --2- 172.21.15.12:0/569782701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978100310 0x7fc978198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 -- 172.21.15.12:0/569782701 >> 172.21.15.12:0/569782701 conn(0x7fc978077210 msgr2=0x7fc978105890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 -- 172.21.15.12:0/569782701 shutdown_connections 2024-09-19T06:56:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:01.718+0000 7fc9806f8640 1 -- 172.21.15.12:0/569782701 wait complete. 2024-09-19T06:56:02.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:02 smithi012 ceph-mon[30937]: pgmap v497: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.2 MiB/s wr, 775 op/s 2024-09-19T06:56:02.494 INFO:tasks.cephfs.filesystem:scrub status for tag:8f67ff7b-a0a0-4791-a787-505c7328a7dc - {'path': '/', 'tag': '8f67ff7b-a0a0-4791-a787-505c7328a7dc', 'options': 'recursive,force'} 2024-09-19T06:56:02.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:02 smithi016 ceph-mon[34911]: pgmap v497: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.2 MiB/s wr, 775 op/s 2024-09-19T06:56:02.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:02 smithi173 ceph-mon[35349]: pgmap v497: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.2 MiB/s wr, 775 op/s 2024-09-19T06:56:03.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:03 smithi016 ceph-mon[34911]: pgmap v498: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.6 MiB/s wr, 485 op/s 2024-09-19T06:56:03.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:03 smithi173 ceph-mon[35349]: pgmap v498: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.6 MiB/s wr, 485 op/s 2024-09-19T06:56:03.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:03 smithi012 ceph-mon[30937]: pgmap v498: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.6 MiB/s wr, 485 op/s 2024-09-19T06:56:05.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:05 smithi016 ceph-mon[34911]: pgmap v499: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 4.1 MiB/s wr, 441 op/s 2024-09-19T06:56:05.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:05 smithi173 ceph-mon[35349]: pgmap v499: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 4.1 MiB/s wr, 441 op/s 2024-09-19T06:56:05.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:05 smithi012 ceph-mon[30937]: pgmap v499: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 4.1 MiB/s wr, 441 op/s 2024-09-19T06:56:07.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:07 smithi016 ceph-mon[34911]: pgmap v500: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 3.5 MiB/s wr, 470 op/s 2024-09-19T06:56:07.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:07 smithi173 ceph-mon[35349]: pgmap v500: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 3.5 MiB/s wr, 470 op/s 2024-09-19T06:56:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.867+0000 7f0e2c223640 1 -- 172.21.15.12:0/1204791996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e241069c0 msgr2=0x7f0e24106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.867+0000 7f0e2c223640 1 --2- 172.21.15.12:0/1204791996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e241069c0 0x7f0e24106da0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009930 tx=0x7f0e2002a420 comp rx=0 tx=0).stop 2024-09-19T06:56:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.867+0000 7f0e2c223640 1 -- 172.21.15.12:0/1204791996 shutdown_connections 2024-09-19T06:56:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.867+0000 7f0e2c223640 1 --2- 172.21.15.12:0/1204791996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e24101350 0x7f0e2410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.867+0000 7f0e2c223640 1 --2- 172.21.15.12:0/1204791996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e241009b0 0x7f0e24100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.867+0000 7f0e2c223640 1 --2- 172.21.15.12:0/1204791996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e241069c0 0x7f0e24106da0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.867+0000 7f0e2c223640 1 -- 172.21.15.12:0/1204791996 >> 172.21.15.12:0/1204791996 conn(0x7f0e24077990 msgr2=0x7f0e240fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.867+0000 7f0e2c223640 1 -- 172.21.15.12:0/1204791996 shutdown_connections 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.867+0000 7f0e2c223640 1 -- 172.21.15.12:0/1204791996 wait complete. 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e2c223640 1 Processor -- start 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e2c223640 1 -- start start 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e2c223640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e241009b0 0x7f0e241972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e2c223640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e24101350 0x7f0e24197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e2c223640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e241069c0 0x7f0e2419bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e2c223640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24110e00 con 0x7f0e241009b0 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e2c223640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24110c80 con 0x7f0e241069c0 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e2c223640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24110f80 con 0x7f0e24101350 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e29fbf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e241009b0 0x7f0e241972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e29fbf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e241009b0 0x7f0e241972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37192/0 (socket says 172.21.15.12:37192) 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e29fbf640 1 -- 172.21.15.12:0/3512945168 learned_addr learned my addr 172.21.15.12:0/3512945168 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e241069c0 0x7f0e2419bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e29fbf640 1 -- 172.21.15.12:0/3512945168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e24101350 msgr2=0x7f0e24197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e29fbf640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e24101350 0x7f0e24197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e29fbf640 1 -- 172.21.15.12:0/3512945168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e241069c0 msgr2=0x7f0e2419bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e29fbf640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e241069c0 0x7f0e2419bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.868+0000 7f0e29fbf640 1 -- 172.21.15.12:0/3512945168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2419c2c0 con 0x7f0e241009b0 2024-09-19T06:56:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.869+0000 7f0e29fbf640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e241009b0 0x7f0e241972d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009230 tx=0x7f0e20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.869+0000 7f0e1affd640 1 -- 172.21.15.12:0/3512945168 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2003f030 con 0x7f0e241009b0 2024-09-19T06:56:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.869+0000 7f0e1affd640 1 -- 172.21.15.12:0/3512945168 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e20003ad0 con 0x7f0e241009b0 2024-09-19T06:56:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.869+0000 7f0e2c223640 1 -- 172.21.15.12:0/3512945168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2419c550 con 0x7f0e241009b0 2024-09-19T06:56:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.869+0000 7f0e1affd640 1 -- 172.21.15.12:0/3512945168 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20035070 con 0x7f0e241009b0 2024-09-19T06:56:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.869+0000 7f0e2c223640 1 -- 172.21.15.12:0/3512945168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e241a3e40 con 0x7f0e241009b0 2024-09-19T06:56:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.872+0000 7f0e1affd640 1 -- 172.21.15.12:0/3512945168 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0e20042030 con 0x7f0e241009b0 2024-09-19T06:56:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.872+0000 7f0e2efbe740 1 Processor -- start 2024-09-19T06:56:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.872+0000 7f0e2efbe740 1 -- start start 2024-09-19T06:56:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece52d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece53250 0x564aece5f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece5fec0 0x564aece622b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564aecdb72f0 con 0x564aece52930 2024-09-19T06:56:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564aecd5f270 con 0x564aece5fec0 2024-09-19T06:56:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564aecdb32b0 con 0x564aece53250 2024-09-19T06:56:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2a7c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece52d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2a7c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece52d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37198/0 (socket says 172.21.15.12:37198) 2024-09-19T06:56:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/2974725578 learned_addr learned my addr 172.21.15.12:0/2974725578 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e297be640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece5fec0 0x564aece622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e29fbf640 1 --2- 172.21.15.12:0/2974725578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece53250 0x564aece5f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/2974725578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece53250 msgr2=0x564aece5f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/2974725578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece53250 0x564aece5f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/2974725578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece5fec0 msgr2=0x564aece622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/2974725578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece5fec0 0x564aece622b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/2974725578 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aecd5e340 con 0x564aece52930 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e1affd640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e100a34e0 0x7f0e100a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e29fbf640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e100a34e0 0x7f0e100a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/2974725578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece52d10 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009e90 tx=0x7f0e1c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13be0b6ff4c9f447 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.873+0000 7f0e1affd640 1 -- 172.21.15.12:0/3512945168 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f0e200eff80 con 0x7f0e241009b0 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e0ffff640 1 -- 172.21.15.12:0/2974725578 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c016070 con 0x564aece52930 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e0ffff640 1 -- 172.21.15.12:0/2974725578 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e1c004d20 con 0x564aece52930 2024-09-19T06:56:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e0ffff640 1 -- 172.21.15.12:0/2974725578 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c012810 con 0x564aece52930 2024-09-19T06:56:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e2efbe740 1 -- 172.21.15.12:0/2974725578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 msgr2=0x564aece52d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/2974725578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece52d10 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009e90 tx=0x7f0e1c010740 comp rx=0 tx=0).stop 2024-09-19T06:56:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e29fbf640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e100a34e0 0x7f0e100a59a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0e200ed6e0 tx=0x7f0e200f3ad0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e2efbe740 1 -- 172.21.15.12:0/2974725578 shutdown_connections 2024-09-19T06:56:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/2974725578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece5fec0 0x564aece622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/2974725578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece53250 0x564aece5f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/2974725578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece52d10 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.874+0000 7f0e2efbe740 1 -- 172.21.15.12:0/2974725578 >> 172.21.15.12:0/2974725578 conn(0x564aece4f060 msgr2=0x564aece4f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.875+0000 7f0e2efbe740 1 -- 172.21.15.12:0/2974725578 shutdown_connections 2024-09-19T06:56:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.875+0000 7f0e2efbe740 1 -- 172.21.15.12:0/2974725578 wait complete. 2024-09-19T06:56:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.875+0000 7f0e2efbe740 1 -- start start 2024-09-19T06:56:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.875+0000 7f0e2efbe740 1 Processor -- start 2024-09-19T06:56:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.875+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece52930 0x564aece5ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.875+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece53250 0x564aece5d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece5fec0 0x564aece5d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564aece62a90 con 0x564aece53250 2024-09-19T06:56:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564aecd40290 con 0x564aece5fec0 2024-09-19T06:56:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564aece62c10 con 0x564aece52930 2024-09-19T06:56:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e2efbe740 10 client.0 _ll_register_callbacks cb 0x564aecd71140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e297be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece53250 0x564aece5d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e297be640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece53250 0x564aece5d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37212/0 (socket says 172.21.15.12:37212) 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e297be640 1 -- 172.21.15.12:0/1062656316 learned_addr learned my addr 172.21.15.12:0/1062656316 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece5fec0 0x564aece5d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece52930 0x564aece5ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e297be640 1 -- 172.21.15.12:0/1062656316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece52930 msgr2=0x564aece5ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e297be640 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece52930 0x564aece5ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e297be640 1 -- 172.21.15.12:0/1062656316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece5fec0 msgr2=0x564aece5d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e297be640 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece5fec0 0x564aece5d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e297be640 1 -- 172.21.15.12:0/1062656316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564aecaca210 con 0x564aece53250 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e297be640 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece53250 0x564aece5d3f0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f0e140038a0 tx=0x7f0e14003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681a1523705cf9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/1062656316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1401a470 con 0x564aece53250 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/1062656316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f0e1401a610 con 0x564aece53250 2024-09-19T06:56:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.876+0000 7f0e2efbe740 1 -- 172.21.15.12:0/1062656316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e1c004d20 con 0x564aece53250 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/1062656316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f0e1401a810 con 0x564aece53250 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e2efbe740 10 client.19881 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e2efbe740 1 -- 172.21.15.12:0/1062656316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x564aecb96620 con 0x564aece53250 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/1062656316 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e1c004d20 con 0x564aece53250 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/1062656316 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7f0e14011c00 con 0x564aece53250 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e2efbe740 10 client.19881 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e2efbe740 10 client.19881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e2efbe740 20 client.19881 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aece700c0 0x564aece724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e2efbe740 4 client.19881 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e2efbe740 1 -- 172.21.15.12:0/1062656316 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564aecdc4a20 con 0x564aece700c0 2024-09-19T06:56:07.884 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:07 smithi012 ceph-mon[30937]: pgmap v500: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 3.5 MiB/s wr, 470 op/s 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.877+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aece700c0 0x564aece724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.878+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aece700c0 0x564aece724e0 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ffd152a2136a12 server_cookie=3cda576751d7fc23 in_seq=0 out_seq=0 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.878+0000 7f0e0d7fa640 10 client.19881 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.878+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/1062656316 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564aecdc4a20 con 0x564aece700c0 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.878+0000 7f0e0d7fa640 10 client.19881 handle_command_reply: tid=0 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 client.19881 shutdown 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 -- 172.21.15.12:0/1062656316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece53250 msgr2=0x564aece5d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece53250 0x564aece5d3f0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f0e140038a0 tx=0x7f0e14003d60 comp rx=0 tx=0).stop 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 -- 172.21.15.12:0/1062656316 shutdown_connections 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aece700c0 0x564aece724e0 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece5fec0 0x564aece5d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece53250 0x564aece5d3f0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/1062656316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece52930 0x564aece5ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e0d7fa640 0 client.19881 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 -- 172.21.15.12:0/1062656316 >> 172.21.15.12:0/1062656316 conn(0x564aece4f060 msgr2=0x564aece54dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 -- 172.21.15.12:0/1062656316 shutdown_connections 2024-09-19T06:56:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 1 -- 172.21.15.12:0/1062656316 wait complete. 2024-09-19T06:56:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.879+0000 7f0e2efbe740 20 client.19881 trim_cache size 0 max 16384 2024-09-19T06:56:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2efbe740 1 Processor -- start 2024-09-19T06:56:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2efbe740 1 -- start start 2024-09-19T06:56:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece52930 0x564aece4e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece53250 0x564aece5d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece5fec0 0x564aece77d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241ab950 con 0x564aece5fec0 2024-09-19T06:56:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241ad550 con 0x564aece52930 2024-09-19T06:56:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241ac020 con 0x564aece53250 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2a7c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece5fec0 0x564aece77d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2a7c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece5fec0 0x564aece77d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37216/0 (socket says 172.21.15.12:37216) 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/3650050503 learned_addr learned my addr 172.21.15.12:0/3650050503 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/3650050503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece52930 0x564aece4e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e297be640 1 --2- 172.21.15.12:0/3650050503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece53250 0x564aece5d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/3650050503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece53250 msgr2=0x564aece5d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/3650050503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece53250 0x564aece5d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/3650050503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece52930 msgr2=0x564aece4e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/3650050503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece52930 0x564aece4e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.894+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/3650050503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aece5b3e0 con 0x564aece5fec0 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/3650050503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece5fec0 0x564aece77d90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c010c40 tx=0x7f0e1c012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f335f88debce4ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e0f7fe640 1 -- 172.21.15.12:0/3650050503 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c02e030 con 0x564aece5fec0 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e0f7fe640 1 -- 172.21.15.12:0/3650050503 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e1c02a830 con 0x564aece5fec0 2024-09-19T06:56:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e0f7fe640 1 -- 172.21.15.12:0/3650050503 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c016040 con 0x564aece5fec0 2024-09-19T06:56:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e2efbe740 1 -- 172.21.15.12:0/3650050503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece5fec0 msgr2=0x564aece77d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/3650050503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece5fec0 0x564aece77d90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c010c40 tx=0x7f0e1c012450 comp rx=0 tx=0).stop 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e2efbe740 1 -- 172.21.15.12:0/3650050503 shutdown_connections 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/3650050503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece5fec0 0x564aece77d90 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/3650050503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece53250 0x564aece5d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/3650050503 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece52930 0x564aece4e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e2efbe740 1 -- 172.21.15.12:0/3650050503 >> 172.21.15.12:0/3650050503 conn(0x564aece4f060 msgr2=0x564aece6b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e2efbe740 1 -- 172.21.15.12:0/3650050503 shutdown_connections 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.895+0000 7f0e2efbe740 1 -- 172.21.15.12:0/3650050503 wait complete. 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2efbe740 1 -- start start 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2efbe740 1 Processor -- start 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece64370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece53250 0x564aece648b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.901 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2efbe740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece5fec0 0x564aeced9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241acdc0 con 0x564aece52930 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241ac6f0 con 0x564aece53250 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2efbe740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e241a9950 con 0x564aece5fec0 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2efbe740 10 client.0 _ll_register_callbacks cb 0x7f0e14004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2a7c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece64370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2a7c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece64370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37218/0 (socket says 172.21.15.12:37218) 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.896+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/28729609 learned_addr learned my addr 172.21.15.12:0/28729609 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e297be640 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece53250 0x564aece648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece5fec0 0x564aeced9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/28729609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece5fec0 msgr2=0x564aeced9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece5fec0 0x564aeced9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/28729609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece53250 msgr2=0x564aece648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece53250 0x564aece648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e2a7c0640 1 -- 172.21.15.12:0/28729609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564aeceda2a0 con 0x564aece52930 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e2a7c0640 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece64370 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c005d70 tx=0x7f0e1c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28da2d2f745bdec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/28729609 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c02e040 con 0x564aece52930 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/28729609 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8687+0+0 (secure 0 0 0) 0x7f0e1c02ae80 con 0x564aece52930 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e2efbe740 1 -- 172.21.15.12:0/28729609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e1c02a830 con 0x564aece52930 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/28729609 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f0e1c016040 con 0x564aece52930 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e2efbe740 10 client.19887 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.897+0000 7f0e2efbe740 1 -- 172.21.15.12:0/28729609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x564aecedb580 con 0x564aece52930 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/28729609 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e1c02a830 con 0x564aece52930 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/28729609 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7f0e1c028030 con 0x564aece52930 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e2efbe740 10 client.19887 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e2efbe740 10 client.19887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e2efbe740 20 client.19887 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aecedbb00 0x564aeceddf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e2efbe740 4 client.19887 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:56:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e2efbe740 1 -- 172.21.15.12:0/28729609 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564aecdbed70 con 0x564aecedbb00 2024-09-19T06:56:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e297be640 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aecedbb00 0x564aeceddf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e0d7fa640 10 client.19887 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.898+0000 7f0e297be640 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aecedbb00 0x564aeceddf20 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=881229742078aea6 server_cookie=a17ce1739579f8b9 in_seq=0 out_seq=0 2024-09-19T06:56:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e0d7fa640 1 -- 172.21.15.12:0/28729609 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564aecdbed70 con 0x564aecedbb00 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e0d7fa640 10 client.19887 handle_command_reply: tid=0 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 client.19887 shutdown 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 -- 172.21.15.12:0/28729609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 msgr2=0x564aece64370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece64370 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c005d70 tx=0x7f0e1c005b00 comp rx=0 tx=0).stop 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 -- 172.21.15.12:0/28729609 shutdown_connections 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x564aecedbb00 0x564aeceddf20 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564aece5fec0 0x564aeced9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e0d7fa640 0 client.19887 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x564aece53250 0x564aece648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 --2- 172.21.15.12:0/28729609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564aece52930 0x564aece64370 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 -- 172.21.15.12:0/28729609 >> 172.21.15.12:0/28729609 conn(0x564aece4f060 msgr2=0x564aece544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 -- 172.21.15.12:0/28729609 shutdown_connections 2024-09-19T06:56:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.914+0000 7f0e2efbe740 1 -- 172.21.15.12:0/28729609 wait complete. 2024-09-19T06:56:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2efbe740 20 client.19887 trim_cache size 0 max 16384 2024-09-19T06:56:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:56:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:56:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:56:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:56:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2c223640 1 -- 172.21.15.12:0/3512945168 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e100a34e0 msgr2=0x7f0e100a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2c223640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e100a34e0 0x7f0e100a59a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0e200ed6e0 tx=0x7f0e200f3ad0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2c223640 1 -- 172.21.15.12:0/3512945168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e241009b0 msgr2=0x7f0e241972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2c223640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e241009b0 0x7f0e241972d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009230 tx=0x7f0e20004270 comp rx=0 tx=0).stop 2024-09-19T06:56:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2c223640 1 -- 172.21.15.12:0/3512945168 shutdown_connections 2024-09-19T06:56:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2c223640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e241069c0 0x7f0e2419bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2c223640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f0e100a34e0 0x7f0e100a59a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2c223640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e24101350 0x7f0e24197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2c223640 1 --2- 172.21.15.12:0/3512945168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e241009b0 0x7f0e241972d0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:07.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.915+0000 7f0e2c223640 1 -- 172.21.15.12:0/3512945168 >> 172.21.15.12:0/3512945168 conn(0x7f0e24077990 msgr2=0x7f0e240ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:07.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.916+0000 7f0e2c223640 1 -- 172.21.15.12:0/3512945168 shutdown_connections 2024-09-19T06:56:07.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:07.916+0000 7f0e2c223640 1 -- 172.21.15.12:0/3512945168 wait complete. 2024-09-19T06:56:09.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:09 smithi016 ceph-mon[34911]: pgmap v501: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 114 KiB/s wr, 124 op/s 2024-09-19T06:56:09.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:09 smithi016 ceph-mon[34911]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T06:56:09.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:09 smithi173 ceph-mon[35349]: pgmap v501: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 114 KiB/s wr, 124 op/s 2024-09-19T06:56:09.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:09 smithi173 ceph-mon[35349]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T06:56:09.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:09 smithi012 ceph-mon[30937]: pgmap v501: 97 pgs: 97 active+clean; 4.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 114 KiB/s wr, 124 op/s 2024-09-19T06:56:09.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:09 smithi012 ceph-mon[30937]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T06:56:11.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:11 smithi016 ceph-mon[34911]: pgmap v503: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 82 KiB/s wr, 132 op/s 2024-09-19T06:56:11.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:11 smithi173 ceph-mon[35349]: pgmap v503: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 82 KiB/s wr, 132 op/s 2024-09-19T06:56:11.881 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:11 smithi012 ceph-mon[30937]: pgmap v503: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 82 KiB/s wr, 132 op/s 2024-09-19T06:56:13.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:13 smithi016 ceph-mon[34911]: pgmap v504: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 82 KiB/s wr, 132 op/s 2024-09-19T06:56:13.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:13 smithi173 ceph-mon[35349]: pgmap v504: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 82 KiB/s wr, 132 op/s 2024-09-19T06:56:13.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:13 smithi012 ceph-mon[30937]: pgmap v504: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 82 KiB/s wr, 132 op/s 2024-09-19T06:56:14.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:56:14.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:56:14.758 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:56:14.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:56:14.759 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:14 smithi016 ceph-mon[34911]: scrub summary: idle 2024-09-19T06:56:14.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:56:14.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:56:14.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:56:14.832 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:56:14.833 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:14 smithi173 ceph-mon[35349]: scrub summary: idle 2024-09-19T06:56:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:56:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:56:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:56:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:56:14.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:14 smithi012 ceph-mon[30937]: scrub summary: idle 2024-09-19T06:56:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:15 smithi016 ceph-mon[34911]: pgmap v505: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 82 KiB/s wr, 118 op/s 2024-09-19T06:56:16.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:15 smithi016 ceph-mon[34911]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T06:56:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:15 smithi173 ceph-mon[35349]: pgmap v505: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 82 KiB/s wr, 118 op/s 2024-09-19T06:56:16.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:15 smithi173 ceph-mon[35349]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T06:56:16.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:15 smithi012 ceph-mon[30937]: pgmap v505: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 82 KiB/s wr, 118 op/s 2024-09-19T06:56:16.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:15 smithi012 ceph-mon[30937]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T06:56:17.466 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:56:17.740 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:18.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:17 smithi012 ceph-mon[30937]: pgmap v507: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 20 op/s 2024-09-19T06:56:18.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.190+0000 7f71451cc640 1 -- 172.21.15.12:0/1659683066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7140102570 msgr2=0x7f71401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:18.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.190+0000 7f71451cc640 1 --2- 172.21.15.12:0/1659683066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7140102570 0x7f71401029b0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f7128009900 tx=0x7f712802a480 comp rx=0 tx=0).stop 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.191+0000 7f71451cc640 1 -- 172.21.15.12:0/1659683066 shutdown_connections 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.191+0000 7f71451cc640 1 --2- 172.21.15.12:0/1659683066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7140102ef0 0x7f714010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.191+0000 7f71451cc640 1 --2- 172.21.15.12:0/1659683066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7140102570 0x7f71401029b0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.191+0000 7f71451cc640 1 --2- 172.21.15.12:0/1659683066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7140100e20 0x7f7140101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.191+0000 7f71451cc640 1 -- 172.21.15.12:0/1659683066 >> 172.21.15.12:0/1659683066 conn(0x7f71400fc7d0 msgr2=0x7f71400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.191+0000 7f71451cc640 1 -- 172.21.15.12:0/1659683066 shutdown_connections 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.191+0000 7f71451cc640 1 -- 172.21.15.12:0/1659683066 wait complete. 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f71451cc640 1 Processor -- start 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f71451cc640 1 -- start start 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f71451cc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7140100e20 0x7f71401993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:18.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f71451cc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7140102570 0x7f7140199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f71451cc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7140102ef0 0x7f71401a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f71451cc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7140110fa0 con 0x7f7140102570 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f71451cc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7140110e20 con 0x7f7140100e20 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f71451cc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7140111120 con 0x7f7140102ef0 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f713659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7140102570 0x7f7140199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f713659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7140102570 0x7f7140199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51978/0 (socket says 172.21.15.12:51978) 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f713659c640 1 -- 172.21.15.12:0/975552883 learned_addr learned my addr 172.21.15.12:0/975552883 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.192+0000 7f713ed9d640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7140100e20 0x7f71401993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713f59e640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7140102ef0 0x7f71401a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713659c640 1 -- 172.21.15.12:0/975552883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7140102ef0 msgr2=0x7f71401a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713659c640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7140102ef0 0x7f71401a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713659c640 1 -- 172.21.15.12:0/975552883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7140100e20 msgr2=0x7f71401993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:18.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713659c640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7140100e20 0x7f71401993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713659c640 1 -- 172.21.15.12:0/975552883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71401a4990 con 0x7f7140102570 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713f59e640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7140102ef0 0x7f71401a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713659c640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7140102570 0x7f7140199910 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7128006010 tx=0x7f7128003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713cd99640 1 -- 172.21.15.12:0/975552883 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712803f070 con 0x7f7140102570 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f71451cc640 1 -- 172.21.15.12:0/975552883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71401a4b60 con 0x7f7140102570 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713cd99640 1 -- 172.21.15.12:0/975552883 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7128031e30 con 0x7f7140102570 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f713cd99640 1 -- 172.21.15.12:0/975552883 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128035030 con 0x7f7140102570 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.193+0000 7f71451cc640 1 -- 172.21.15.12:0/975552883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71401a5010 con 0x7f7140102570 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.194+0000 7f71451cc640 1 -- 172.21.15.12:0/975552883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7140101200 con 0x7f7140102570 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.196+0000 7f713cd99640 1 -- 172.21.15.12:0/975552883 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7128042070 con 0x7f7140102570 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.196+0000 7f713cd99640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f712c0a33b0 0x7f712c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.196+0000 7f713ed9d640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f712c0a33b0 0x7f712c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:18.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.196+0000 7f713cd99640 1 -- 172.21.15.12:0/975552883 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f71280f06b0 con 0x7f7140102570 2024-09-19T06:56:18.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.197+0000 7f713ed9d640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f712c0a33b0 0x7f712c0a5870 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7130009990 tx=0x7f7130009110 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:18.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.200+0000 7f713cd99640 1 -- 172.21.15.12:0/975552883 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f71280bcff0 con 0x7f7140102570 2024-09-19T06:56:18.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:17 smithi016 ceph-mon[34911]: pgmap v507: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 20 op/s 2024-09-19T06:56:18.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:17 smithi173 ceph-mon[35349]: pgmap v507: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 20 op/s 2024-09-19T06:56:18.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.412+0000 7f71451cc640 1 -- 172.21.15.12:0/975552883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7140109090 con 0x7f7140102570 2024-09-19T06:56:18.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.413+0000 7f713cd99640 1 -- 172.21.15.12:0/975552883 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11978 (secure 0 0 0) 0x7f71280bc8f0 con 0x7f7140102570 2024-09-19T06:56:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:18.416 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":55,"btime":"2024-09-19T06:55:59:136308+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:55:58.436603+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:56:18.416 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 55 2024-09-19T06:56:18.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.415+0000 7f71451cc640 1 -- 172.21.15.12:0/975552883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f712c0a33b0 msgr2=0x7f712c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:18.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.415+0000 7f71451cc640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f712c0a33b0 0x7f712c0a5870 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7130009990 tx=0x7f7130009110 comp rx=0 tx=0).stop 2024-09-19T06:56:18.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.415+0000 7f71451cc640 1 -- 172.21.15.12:0/975552883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7140102570 msgr2=0x7f7140199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:18.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.415+0000 7f71451cc640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7140102570 0x7f7140199910 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7128006010 tx=0x7f7128003c80 comp rx=0 tx=0).stop 2024-09-19T06:56:18.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.415+0000 7f71451cc640 1 -- 172.21.15.12:0/975552883 shutdown_connections 2024-09-19T06:56:18.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.415+0000 7f71451cc640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f712c0a33b0 0x7f712c0a5870 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:18.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.415+0000 7f71451cc640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7140102ef0 0x7f71401a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:18.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.415+0000 7f71451cc640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7140102570 0x7f7140199910 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:18.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.415+0000 7f71451cc640 1 --2- 172.21.15.12:0/975552883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7140100e20 0x7f71401993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:18.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.415+0000 7f71451cc640 1 -- 172.21.15.12:0/975552883 >> 172.21.15.12:0/975552883 conn(0x7f71400fc7d0 msgr2=0x7f71401068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:18.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.416+0000 7f71451cc640 1 -- 172.21.15.12:0/975552883 shutdown_connections 2024-09-19T06:56:18.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:18.416+0000 7f71451cc640 1 -- 172.21.15.12:0/975552883 wait complete. 2024-09-19T06:56:19.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:18 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/975552883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:19.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:18 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/975552883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:19.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:18 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/975552883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:19.348 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 183c19bc --release --await' 2024-09-19T06:56:19.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 183c19bc --release --await 2024-09-19T06:56:19.608 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:20.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.090+0000 7f14a76d4640 1 -- 172.21.15.12:0/3263722740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a0101df0 msgr2=0x7f14a01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:20.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.090+0000 7f14a76d4640 1 --2- 172.21.15.12:0/3263722740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a0101df0 0x7f14a01021d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f149c009900 tx=0x7f149c02a410 comp rx=0 tx=0).stop 2024-09-19T06:56:20.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.091+0000 7f14a76d4640 1 -- 172.21.15.12:0/3263722740 shutdown_connections 2024-09-19T06:56:20.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.091+0000 7f14a76d4640 1 --2- 172.21.15.12:0/3263722740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14a0106f20 0x7f14a010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.091+0000 7f14a76d4640 1 --2- 172.21.15.12:0/3263722740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14a01027a0 0x7f14a01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.091+0000 7f14a76d4640 1 --2- 172.21.15.12:0/3263722740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a0101df0 0x7f14a01021d0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.091+0000 7f14a76d4640 1 -- 172.21.15.12:0/3263722740 >> 172.21.15.12:0/3263722740 conn(0x7f14a00fd8f0 msgr2=0x7f14a00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:20.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.091+0000 7f14a76d4640 1 -- 172.21.15.12:0/3263722740 shutdown_connections 2024-09-19T06:56:20.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.091+0000 7f14a76d4640 1 -- 172.21.15.12:0/3263722740 wait complete. 2024-09-19T06:56:20.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.091+0000 7f14a76d4640 1 Processor -- start 2024-09-19T06:56:20.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.091+0000 7f14a76d4640 1 -- start start 2024-09-19T06:56:20.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a76d4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14a0101df0 0x7f14a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a76d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a01027a0 0x7f14a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a76d4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14a0106f20 0x7f14a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a76d4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f14a0111f40 con 0x7f14a01027a0 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a76d4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f14a0111dc0 con 0x7f14a0106f20 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a76d4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14a01120c0 con 0x7f14a0101df0 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a4c6f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a01027a0 0x7f14a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a4c6f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a01027a0 0x7f14a0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52002/0 (socket says 172.21.15.12:52002) 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a4c6f640 1 -- 172.21.15.12:0/3749550 learned_addr learned my addr 172.21.15.12:0/3749550 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a5470640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14a0101df0 0x7f14a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a5c71640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14a0106f20 0x7f14a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a4c6f640 1 -- 172.21.15.12:0/3749550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14a0101df0 msgr2=0x7f14a00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a4c6f640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14a0101df0 0x7f14a00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a4c6f640 1 -- 172.21.15.12:0/3749550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14a0106f20 msgr2=0x7f14a0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:20.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a4c6f640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14a0106f20 0x7f14a0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a4c6f640 1 -- 172.21.15.12:0/3749550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a01a68c0 con 0x7f14a01027a0 2024-09-19T06:56:20.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.092+0000 7f14a4c6f640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a01027a0 0x7f14a0074a30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f149000e9f0 tx=0x7f149000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:20.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.093+0000 7f14967fc640 1 -- 172.21.15.12:0/3749550 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149000cd80 con 0x7f14a01027a0 2024-09-19T06:56:20.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.093+0000 7f14967fc640 1 -- 172.21.15.12:0/3749550 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1490010910 con 0x7f14a01027a0 2024-09-19T06:56:20.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.093+0000 7f14a76d4640 1 -- 172.21.15.12:0/3749550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a01a6bb0 con 0x7f14a01027a0 2024-09-19T06:56:20.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.093+0000 7f14967fc640 1 -- 172.21.15.12:0/3749550 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490018990 con 0x7f14a01027a0 2024-09-19T06:56:20.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.093+0000 7f14a76d4640 1 -- 172.21.15.12:0/3749550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a01a70f0 con 0x7f14a01027a0 2024-09-19T06:56:20.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.095+0000 7f14967fc640 1 -- 172.21.15.12:0/3749550 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1490010ac0 con 0x7f14a01027a0 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.095+0000 7f14a9aad740 1 Processor -- start 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.095+0000 7f14a9aad740 1 -- start start 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f1191440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191980 0x5635f119bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 0x5635f119e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a9aad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5635f10f6620 con 0x5635f1191980 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a9aad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5635f109de50 con 0x5635f119c240 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a9aad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5635f10f25e0 con 0x5635f1191060 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a5470640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191980 0x5635f119bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a5470640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191980 0x5635f119bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52014/0 (socket says 172.21.15.12:52014) 2024-09-19T06:56:20.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a5470640 1 -- 172.21.15.12:0/3219804446 learned_addr learned my addr 172.21.15.12:0/3219804446 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a5c71640 1 --2- 172.21.15.12:0/3219804446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f1191440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a4c6f640 1 --2- 172.21.15.12:0/3219804446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 0x5635f119e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14967fc640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f148c0a33b0 0x7f148c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a5470640 1 -- 172.21.15.12:0/3219804446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 msgr2=0x5635f1191440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a5470640 1 --2- 172.21.15.12:0/3219804446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f1191440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a5470640 1 -- 172.21.15.12:0/3219804446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 msgr2=0x5635f119e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a5470640 1 --2- 172.21.15.12:0/3219804446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 0x5635f119e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a5470640 1 -- 172.21.15.12:0/3219804446 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f108ed40 con 0x5635f1191980 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a4c6f640 1 --2- 172.21.15.12:0/3219804446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 0x5635f119e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14a5c71640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f148c0a33b0 0x7f148c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.096+0000 7f14967fc640 1 -- 172.21.15.12:0/3749550 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f14900d0110 con 0x7f14a01027a0 2024-09-19T06:56:20.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.097+0000 7f14a5470640 1 --2- 172.21.15.12:0/3219804446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191980 0x5635f119bd00 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f149c009900 tx=0x7f149c005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db818120b892f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.097+0000 7f148b7fe640 1 -- 172.21.15.12:0/3219804446 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c040070 con 0x5635f1191980 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.097+0000 7f148b7fe640 1 -- 172.21.15.12:0/3219804446 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f149c031870 con 0x5635f1191980 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.097+0000 7f148b7fe640 1 -- 172.21.15.12:0/3219804446 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c035040 con 0x5635f1191980 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 -- 172.21.15.12:0/3219804446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191980 msgr2=0x5635f119bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a5c71640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f148c0a33b0 0x7f148c0a5870 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1498005c40 tx=0x7f1498004a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 --2- 172.21.15.12:0/3219804446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191980 0x5635f119bd00 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f149c009900 tx=0x7f149c005be0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 -- 172.21.15.12:0/3219804446 shutdown_connections 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 --2- 172.21.15.12:0/3219804446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 0x5635f119e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 --2- 172.21.15.12:0/3219804446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191980 0x5635f119bd00 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 --2- 172.21.15.12:0/3219804446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f1191440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 -- 172.21.15.12:0/3219804446 >> 172.21.15.12:0/3219804446 conn(0x5635f118d5f0 msgr2=0x5635f118d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 -- 172.21.15.12:0/3219804446 shutdown_connections 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 -- 172.21.15.12:0/3219804446 wait complete. 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 -- start start 2024-09-19T06:56:20.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 Processor -- start 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.098+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191060 0x5635f11990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191980 0x5635f11995e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 0x5635f1199b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a9aad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5635f119ee10 con 0x5635f1191060 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a9aad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5635f107ef10 con 0x5635f119c240 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a9aad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5635f119ef90 con 0x5635f1191980 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a9aad740 10 client.0 _ll_register_callbacks cb 0x5635f10a2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a5470640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191060 0x5635f11990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a5470640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191060 0x5635f11990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52026/0 (socket says 172.21.15.12:52026) 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a5470640 1 -- 172.21.15.12:0/1675011233 learned_addr learned my addr 172.21.15.12:0/1675011233 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a4c6f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191980 0x5635f11995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a5c71640 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 0x5635f1199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a5470640 1 -- 172.21.15.12:0/1675011233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191980 msgr2=0x5635f11995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a5470640 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191980 0x5635f11995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a5470640 1 -- 172.21.15.12:0/1675011233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 msgr2=0x5635f1199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a5470640 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 0x5635f1199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a5470640 1 -- 172.21.15.12:0/1675011233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f0e05580 con 0x5635f1191060 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a5470640 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191060 0x5635f11990a0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f149c006010 tx=0x7f149c005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4bfd99d0bfeada server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f1488ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f1488ff9640 1 -- 172.21.15.12:0/1675011233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c040030 con 0x5635f1191060 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f1488ff9640 1 -- 172.21.15.12:0/1675011233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f149c004260 con 0x5635f1191060 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.099+0000 7f14a9aad740 1 -- 172.21.15.12:0/1675011233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f149c031870 con 0x5635f1191060 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f1488ff9640 1 -- 172.21.15.12:0/1675011233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f149c056050 con 0x5635f1191060 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f14a9aad740 10 client.19905 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:20.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f14a9aad740 1 -- 172.21.15.12:0/1675011233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5635f0ecf960 con 0x5635f1191060 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f1488ff9640 1 -- 172.21.15.12:0/1675011233 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f149c031870 con 0x5635f1191060 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f1488ff9640 1 -- 172.21.15.12:0/1675011233 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7f149c003680 con 0x5635f1191060 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f14a9aad740 10 client.19905 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f14a9aad740 10 client.19905 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f14a9aad740 20 client.19905 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f14a9aad740 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5635f11abb30 0x5635f11adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f14a9aad740 4 client.19905 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.100+0000 7f14a9aad740 1 -- 172.21.15.12:0/1675011233 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635f1103b90 con 0x5635f11abb30 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.101+0000 7f14a4c6f640 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5635f11abb30 0x5635f11adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.101+0000 7f14a4c6f640 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5635f11abb30 0x5635f11adf20 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f20fb45401d4e6b6 server_cookie=40c94bffbc14ff68 in_seq=0 out_seq=0 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.101+0000 7f1488ff9640 10 client.19905 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f1488ff9640 1 -- 172.21.15.12:0/1675011233 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635f1103b90 con 0x5635f11abb30 2024-09-19T06:56:20.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f1488ff9640 10 client.19905 handle_command_reply: tid=0 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 client.19905 shutdown 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 -- 172.21.15.12:0/1675011233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191060 msgr2=0x5635f11990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191060 0x5635f11990a0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f149c006010 tx=0x7f149c005400 comp rx=0 tx=0).stop 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 -- 172.21.15.12:0/1675011233 shutdown_connections 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5635f11abb30 0x5635f11adf20 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f119c240 0x5635f1199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191980 0x5635f11995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f1488ff9640 0 client.19905 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 --2- 172.21.15.12:0/1675011233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f1191060 0x5635f11990a0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 -- 172.21.15.12:0/1675011233 >> 172.21.15.12:0/1675011233 conn(0x5635f118d5f0 msgr2=0x5635f11932d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 -- 172.21.15.12:0/1675011233 shutdown_connections 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 1 -- 172.21.15.12:0/1675011233 wait complete. 2024-09-19T06:56:20.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.102+0000 7f14a9aad740 20 client.19905 trim_cache size 0 max 16384 2024-09-19T06:56:20.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.119+0000 7f14a9aad740 1 Processor -- start 2024-09-19T06:56:20.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.119+0000 7f14a9aad740 1 -- start start 2024-09-19T06:56:20.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.119+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f1198000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.119+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 0x5635f11b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.119+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.119+0000 7f14a9aad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f14a01afd60 con 0x5635f119c240 2024-09-19T06:56:20.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.119+0000 7f14a9aad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f14a01b1960 con 0x5635f1191980 2024-09-19T06:56:20.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.119+0000 7f14a9aad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14a01b0430 con 0x5635f1191060 2024-09-19T06:56:20.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a5c71640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a4c6f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 0x5635f11b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a5c71640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52040/0 (socket says 172.21.15.12:52040) 2024-09-19T06:56:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a5c71640 1 -- 172.21.15.12:0/4037385722 learned_addr learned my addr 172.21.15.12:0/4037385722 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a5470640 1 --2- 172.21.15.12:0/4037385722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f1198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a5c71640 1 -- 172.21.15.12:0/4037385722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 msgr2=0x5635f1198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a5c71640 1 --2- 172.21.15.12:0/4037385722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f1198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a5c71640 1 -- 172.21.15.12:0/4037385722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 msgr2=0x5635f11b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a5c71640 1 --2- 172.21.15.12:0/4037385722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 0x5635f11b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a5c71640 1 -- 172.21.15.12:0/4037385722 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f118d090 con 0x5635f119c240 2024-09-19T06:56:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a4c6f640 1 --2- 172.21.15.12:0/4037385722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 0x5635f11b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f14a5c71640 1 --2- 172.21.15.12:0/4037385722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11b3bd0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f1498009270 tx=0x7f1498019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ca95f0bf4b1dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:20.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f148affd640 1 -- 172.21.15.12:0/4037385722 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498004d20 con 0x5635f119c240 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f148affd640 1 -- 172.21.15.12:0/4037385722 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1498003e50 con 0x5635f119c240 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.120+0000 7f148affd640 1 -- 172.21.15.12:0/4037385722 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498005280 con 0x5635f119c240 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 -- 172.21.15.12:0/4037385722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 msgr2=0x5635f11b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 --2- 172.21.15.12:0/4037385722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11b3bd0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f1498009270 tx=0x7f1498019000 comp rx=0 tx=0).stop 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 -- 172.21.15.12:0/4037385722 shutdown_connections 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 --2- 172.21.15.12:0/4037385722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11b3bd0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 --2- 172.21.15.12:0/4037385722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 0x5635f11b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 --2- 172.21.15.12:0/4037385722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f1198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 -- 172.21.15.12:0/4037385722 >> 172.21.15.12:0/4037385722 conn(0x5635f118d5f0 msgr2=0x5635f11932d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 -- 172.21.15.12:0/4037385722 shutdown_connections 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 -- 172.21.15.12:0/4037385722 wait complete. 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 -- start start 2024-09-19T06:56:20.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.121+0000 7f14a9aad740 1 Processor -- start 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f11a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 0x5635f11a4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a9aad740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a9aad740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f14a01b11d0 con 0x5635f119c240 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a9aad740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f14a01b0b00 con 0x5635f1191980 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a9aad740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14a01add60 con 0x5635f1191060 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a9aad740 10 client.0 _ll_register_callbacks cb 0x7f149c02ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a5c71640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a5c71640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11a11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52042/0 (socket says 172.21.15.12:52042) 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a5c71640 1 -- 172.21.15.12:0/494292726 learned_addr learned my addr 172.21.15.12:0/494292726 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a5470640 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f11a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a4c6f640 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 0x5635f11a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a5c71640 1 -- 172.21.15.12:0/494292726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 msgr2=0x5635f11a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a5c71640 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f11a41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a5c71640 1 -- 172.21.15.12:0/494292726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 msgr2=0x5635f11a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a5c71640 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 0x5635f11a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.122+0000 7f14a5c71640 1 -- 172.21.15.12:0/494292726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f11a1770 con 0x5635f119c240 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f14a5c71640 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11a11b0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f1498004690 tx=0x7f14980044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d20ef5aa609039 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f1488ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f1488ff9640 1 -- 172.21.15.12:0/494292726 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498034060 con 0x5635f119c240 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f1488ff9640 1 -- 172.21.15.12:0/494292726 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f1498003970 con 0x5635f119c240 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f14a9aad740 1 -- 172.21.15.12:0/494292726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1498003e50 con 0x5635f119c240 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f1488ff9640 1 -- 172.21.15.12:0/494292726 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f149803b050 con 0x5635f119c240 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f14a9aad740 10 client.19911 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:20.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f14a9aad740 1 -- 172.21.15.12:0/494292726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5635f121f780 con 0x5635f119c240 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f1488ff9640 1 -- 172.21.15.12:0/494292726 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1498003e50 con 0x5635f119c240 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f1488ff9640 1 -- 172.21.15.12:0/494292726 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7f149802e070 con 0x5635f119c240 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f14a9aad740 10 client.19911 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f14a9aad740 10 client.19911 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f14a9aad740 20 client.19911 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f14a9aad740 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5635f11abb30 0x5635f1221f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f14a9aad740 4 client.19911 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "183c19bc", "release": true, "await": true}] 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.123+0000 7f14a9aad740 1 -- 172.21.15.12:0/494292726 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "set_id": "183c19bc", "release": true, "await": true}) -- 0x5635f10fe0a0 con 0x5635f11abb30 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.124+0000 7f14a5470640 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5635f11abb30 0x5635f1221f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.124+0000 7f1488ff9640 10 client.19911 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:20.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.124+0000 7f14a5470640 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5635f11abb30 0x5635f1221f80 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e09adffc2d6bce0 server_cookie=3fb8df8c05d648c7 in_seq=0 out_seq=0 2024-09-19T06:56:20.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.152+0000 7f1488ff9640 1 -- 172.21.15.12:0/494292726 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5635f10fe0a0 con 0x5635f11abb30 2024-09-19T06:56:20.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.152+0000 7f1488ff9640 10 client.19911 handle_command_reply: tid=0 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 client.19911 shutdown 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 -- 172.21.15.12:0/494292726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 msgr2=0x5635f11a11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11a11b0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f1498004690 tx=0x7f14980044b0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 -- 172.21.15.12:0/494292726 shutdown_connections 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5635f11abb30 0x5635f1221f80 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5635f119c240 0x5635f11a11b0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f1488ff9640 0 client.19911 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5635f1191980 0x5635f11a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 --2- 172.21.15.12:0/494292726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5635f1191060 0x5635f11a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 -- 172.21.15.12:0/494292726 >> 172.21.15.12:0/494292726 conn(0x5635f118d5f0 msgr2=0x5635f11a7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 -- 172.21.15.12:0/494292726 shutdown_connections 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 1 -- 172.21.15.12:0/494292726 wait complete. 2024-09-19T06:56:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.153+0000 7f14a9aad740 20 client.19911 trim_cache size 0 max 16384 2024-09-19T06:56:20.157 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:56:20.157 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 55, 2024-09-19T06:56:20.157 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:56:20.157 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 56, 2024-09-19T06:56:20.157 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-09-19T06:56:20.157 INFO:teuthology.orchestra.run.smithi012.stdout: "183c19bc": { 2024-09-19T06:56:20.157 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 56, 2024-09-19T06:56:20.157 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-09-19T06:56:20.157 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 90.0, 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 149.4, 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-09-19T06:56:20.158 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-09-19T06:56:20.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:20.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:20.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:20.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:20.159 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:20.159 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:56:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 -- 172.21.15.12:0/3749550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f148c0a33b0 msgr2=0x7f148c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:20.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f148c0a33b0 0x7f148c0a5870 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1498005c40 tx=0x7f1498004a40 comp rx=0 tx=0).stop 2024-09-19T06:56:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 -- 172.21.15.12:0/3749550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a01027a0 msgr2=0x7f14a0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a01027a0 0x7f14a0074a30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f149000e9f0 tx=0x7f149000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 -- 172.21.15.12:0/3749550 shutdown_connections 2024-09-19T06:56:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14a0106f20 0x7f14a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a01027a0 0x7f14a0074a30 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f148c0a33b0 0x7f148c0a5870 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 --2- 172.21.15.12:0/3749550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f14a0101df0 0x7f14a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 -- 172.21.15.12:0/3749550 >> 172.21.15.12:0/3749550 conn(0x7f14a00fd8f0 msgr2=0x7f14a00fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 -- 172.21.15.12:0/3749550 shutdown_connections 2024-09-19T06:56:20.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:20.154+0000 7f14a76d4640 1 -- 172.21.15.12:0/3749550 wait complete. 2024-09-19T06:56:20.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:19 smithi016 ceph-mon[34911]: pgmap v508: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T06:56:20.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:19 smithi173 ceph-mon[35349]: pgmap v508: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T06:56:20.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:19 smithi012 ceph-mon[30937]: pgmap v508: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T06:56:20.792 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-19T06:56:20.871 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/: 2024-09-19T06:56:20.872 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.872 INFO:teuthology.orchestra.run.smithi012.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 . 2024-09-19T06:56:20.872 INFO:teuthology.orchestra.run.smithi012.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 .. 2024-09-19T06:56:20.872 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 data 2024-09-19T06:56:20.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.872 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data: 2024-09-19T06:56:20.873 INFO:teuthology.orchestra.run.smithi012.stdout:total 36 2024-09-19T06:56:20.873 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 . 2024-09-19T06:56:20.873 INFO:teuthology.orchestra.run.smithi012.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 .. 2024-09-19T06:56:20.873 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 06:40 base 2024-09-19T06:56:20.873 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 19 06:40 current_logfiles 2024-09-19T06:56:20.873 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 19 06:40 global 2024-09-19T06:56:20.874 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 log 2024-09-19T06:56:20.874 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_commit_ts 2024-09-19T06:56:20.874 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_dynshmem 2024-09-19T06:56:20.874 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 19 06:40 pg_hba.conf 2024-09-19T06:56:20.874 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 19 06:40 pg_ident.conf 2024-09-19T06:56:20.874 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:56 pg_logical 2024-09-19T06:56:20.874 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 pg_multixact 2024-09-19T06:56:20.875 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_notify 2024-09-19T06:56:20.875 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_replslot 2024-09-19T06:56:20.875 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_serial 2024-09-19T06:56:20.875 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_snapshots 2024-09-19T06:56:20.875 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:56 pg_stat 2024-09-19T06:56:20.875 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:56 pg_stat_tmp 2024-09-19T06:56:20.875 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:56 pg_subtrans 2024-09-19T06:56:20.876 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_tblspc 2024-09-19T06:56:20.876 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pg_twophase 2024-09-19T06:56:20.876 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 PG_VERSION 2024-09-19T06:56:20.876 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 19 06:56 pg_wal 2024-09-19T06:56:20.876 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:46 pg_xact 2024-09-19T06:56:20.876 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 19 06:40 postgresql.auto.conf 2024-09-19T06:56:20.876 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 19 06:40 postgresql.conf 2024-09-19T06:56:20.877 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 19 06:40 postmaster.opts 2024-09-19T06:56:20.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.877 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/base: 2024-09-19T06:56:20.877 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.877 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 06:40 . 2024-09-19T06:56:20.877 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.877 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 06:40 1 2024-09-19T06:56:20.878 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 06:40 13493 2024-09-19T06:56:20.878 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 19 06:44 13494 2024-09-19T06:56:20.878 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 pgsql_tmp 2024-09-19T06:56:20.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.878 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-19T06:56:20.878 INFO:teuthology.orchestra.run.smithi012.stdout:total 7777 2024-09-19T06:56:20.878 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 06:40 . 2024-09-19T06:56:20.879 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 06:40 .. 2024-09-19T06:56:20.879 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 112 2024-09-19T06:56:20.879 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 113 2024-09-19T06:56:20.879 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 1247 2024-09-19T06:56:20.879 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1247_fsm 2024-09-19T06:56:20.879 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1247_vm 2024-09-19T06:56:20.879 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 06:40 1249 2024-09-19T06:56:20.880 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1249_fsm 2024-09-19T06:56:20.880 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1249_vm 2024-09-19T06:56:20.880 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 06:40 1255 2024-09-19T06:56:20.880 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1255_fsm 2024-09-19T06:56:20.880 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1255_vm 2024-09-19T06:56:20.880 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 06:40 1259 2024-09-19T06:56:20.880 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1259_fsm 2024-09-19T06:56:20.881 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1259_vm 2024-09-19T06:56:20.881 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 06:40 13344 2024-09-19T06:56:20.881 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13344_fsm 2024-09-19T06:56:20.881 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13344_vm 2024-09-19T06:56:20.881 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13346 2024-09-19T06:56:20.881 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13348 2024-09-19T06:56:20.881 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349 2024-09-19T06:56:20.882 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13349_fsm 2024-09-19T06:56:20.882 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349_vm 2024-09-19T06:56:20.882 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13351 2024-09-19T06:56:20.882 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13353 2024-09-19T06:56:20.882 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354 2024-09-19T06:56:20.882 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13354_fsm 2024-09-19T06:56:20.882 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354_vm 2024-09-19T06:56:20.883 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13356 2024-09-19T06:56:20.883 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13358 2024-09-19T06:56:20.883 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359 2024-09-19T06:56:20.883 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13359_fsm 2024-09-19T06:56:20.883 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359_vm 2024-09-19T06:56:20.883 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13361 2024-09-19T06:56:20.883 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13363 2024-09-19T06:56:20.884 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1417 2024-09-19T06:56:20.884 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1418 2024-09-19T06:56:20.884 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 174 2024-09-19T06:56:20.884 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 175 2024-09-19T06:56:20.884 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2187 2024-09-19T06:56:20.884 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2224 2024-09-19T06:56:20.884 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2328 2024-09-19T06:56:20.885 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2336 2024-09-19T06:56:20.885 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2337 2024-09-19T06:56:20.885 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2579 2024-09-19T06:56:20.885 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2600 2024-09-19T06:56:20.885 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2600_fsm 2024-09-19T06:56:20.885 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2600_vm 2024-09-19T06:56:20.885 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601 2024-09-19T06:56:20.886 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2601_fsm 2024-09-19T06:56:20.886 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601_vm 2024-09-19T06:56:20.886 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2602 2024-09-19T06:56:20.886 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2602_fsm 2024-09-19T06:56:20.886 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2602_vm 2024-09-19T06:56:20.886 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2603 2024-09-19T06:56:20.886 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2603_fsm 2024-09-19T06:56:20.887 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2603_vm 2024-09-19T06:56:20.887 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2604 2024-09-19T06:56:20.887 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2605 2024-09-19T06:56:20.887 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2605_fsm 2024-09-19T06:56:20.887 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2605_vm 2024-09-19T06:56:20.887 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606 2024-09-19T06:56:20.887 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2606_fsm 2024-09-19T06:56:20.888 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606_vm 2024-09-19T06:56:20.888 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2607 2024-09-19T06:56:20.888 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2607_fsm 2024-09-19T06:56:20.888 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2607_vm 2024-09-19T06:56:20.888 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 06:40 2608 2024-09-19T06:56:20.888 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2608_fsm 2024-09-19T06:56:20.888 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2608_vm 2024-09-19T06:56:20.889 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 06:40 2609 2024-09-19T06:56:20.889 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2609_fsm 2024-09-19T06:56:20.889 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2609_vm 2024-09-19T06:56:20.889 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2610 2024-09-19T06:56:20.889 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2610_fsm 2024-09-19T06:56:20.893 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2610_vm 2024-09-19T06:56:20.893 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2611 2024-09-19T06:56:20.893 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612 2024-09-19T06:56:20.893 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2612_fsm 2024-09-19T06:56:20.893 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612_vm 2024-09-19T06:56:20.893 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2613 2024-09-19T06:56:20.894 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615 2024-09-19T06:56:20.894 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2615_fsm 2024-09-19T06:56:20.894 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615_vm 2024-09-19T06:56:20.894 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2616 2024-09-19T06:56:20.894 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2616_fsm 2024-09-19T06:56:20.894 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2616_vm 2024-09-19T06:56:20.895 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 06:40 2617 2024-09-19T06:56:20.897 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2617_fsm 2024-09-19T06:56:20.897 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2617_vm 2024-09-19T06:56:20.898 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 06:40 2618 2024-09-19T06:56:20.898 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2618_fsm 2024-09-19T06:56:20.898 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2618_vm 2024-09-19T06:56:20.898 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 06:40 2619 2024-09-19T06:56:20.898 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2619_fsm 2024-09-19T06:56:20.898 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2619_vm 2024-09-19T06:56:20.899 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2620 2024-09-19T06:56:20.899 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2650 2024-09-19T06:56:20.899 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2651 2024-09-19T06:56:20.899 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2652 2024-09-19T06:56:20.899 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2653 2024-09-19T06:56:20.899 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2654 2024-09-19T06:56:20.899 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2655 2024-09-19T06:56:20.900 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2656 2024-09-19T06:56:20.900 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2657 2024-09-19T06:56:20.900 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 06:40 2658 2024-09-19T06:56:20.900 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 2659 2024-09-19T06:56:20.900 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2660 2024-09-19T06:56:20.900 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2661 2024-09-19T06:56:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2662 2024-09-19T06:56:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2663 2024-09-19T06:56:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2664 2024-09-19T06:56:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2665 2024-09-19T06:56:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2666 2024-09-19T06:56:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2667 2024-09-19T06:56:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2668 2024-09-19T06:56:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2669 2024-09-19T06:56:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2670 2024-09-19T06:56:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 06:40 2673 2024-09-19T06:56:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 06:40 2674 2024-09-19T06:56:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 06:40 2675 2024-09-19T06:56:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2678 2024-09-19T06:56:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2679 2024-09-19T06:56:20.903 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2680 2024-09-19T06:56:20.903 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2681 2024-09-19T06:56:20.903 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2682 2024-09-19T06:56:20.903 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2683 2024-09-19T06:56:20.903 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2684 2024-09-19T06:56:20.903 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2685 2024-09-19T06:56:20.903 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2686 2024-09-19T06:56:20.904 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2687 2024-09-19T06:56:20.904 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2688 2024-09-19T06:56:20.904 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2689 2024-09-19T06:56:20.904 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 06:40 2690 2024-09-19T06:56:20.904 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 06:40 2691 2024-09-19T06:56:20.904 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2692 2024-09-19T06:56:20.904 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2693 2024-09-19T06:56:20.905 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2696 2024-09-19T06:56:20.905 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2699 2024-09-19T06:56:20.905 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2701 2024-09-19T06:56:20.905 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2702 2024-09-19T06:56:20.905 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2703 2024-09-19T06:56:20.905 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2704 2024-09-19T06:56:20.906 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2753 2024-09-19T06:56:20.906 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2753_fsm 2024-09-19T06:56:20.906 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2753_vm 2024-09-19T06:56:20.906 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2754 2024-09-19T06:56:20.906 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2755 2024-09-19T06:56:20.906 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2756 2024-09-19T06:56:20.906 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2757 2024-09-19T06:56:20.907 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2830 2024-09-19T06:56:20.907 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2831 2024-09-19T06:56:20.907 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2832 2024-09-19T06:56:20.907 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2833 2024-09-19T06:56:20.907 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2834 2024-09-19T06:56:20.907 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2835 2024-09-19T06:56:20.907 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2836 2024-09-19T06:56:20.908 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2837 2024-09-19T06:56:20.908 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 06:40 2838 2024-09-19T06:56:20.908 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2838_fsm 2024-09-19T06:56:20.908 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2838_vm 2024-09-19T06:56:20.908 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2839 2024-09-19T06:56:20.908 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840 2024-09-19T06:56:20.908 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840_fsm 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2840_vm 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2841 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2995 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2996 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3079_fsm 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079_vm 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3080 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3081 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3085 2024-09-19T06:56:20.909 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3118 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3119 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 06:40 3164 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3256 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3257 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3258 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3350 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3351 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3379 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3380 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3381 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3394 2024-09-19T06:56:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3394_fsm 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3394_vm 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3395 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3429 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3430 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3431 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3433 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3439 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3440 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3455 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 06:40 3456 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3456_fsm 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3456_vm 2024-09-19T06:56:20.911 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3466 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3467 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3468 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3501 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3502 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3503 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3534 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3541_fsm 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541_vm 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3542 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3574 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3575 2024-09-19T06:56:20.912 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3576 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3596 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3597 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3598 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3599 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3600_fsm 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600_vm 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3601_fsm 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601_vm 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602 2024-09-19T06:56:20.913 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3602_fsm 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602_vm 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603_fsm 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3603_vm 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3604 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3605 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3606 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3607 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3608 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 3609 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3712 2024-09-19T06:56:20.914 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3764_fsm 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764_vm 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3766 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3767 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3997 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4143 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4144 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4145 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4146 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4147 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4148 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4149 2024-09-19T06:56:20.915 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4150 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4151 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4152 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4153 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4154 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4155 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4156 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4157 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4158 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4159 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4160 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4161 2024-09-19T06:56:20.916 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4162 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4163 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4164 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4165 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4166 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4167 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4168 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4169 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4170 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4171 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4172 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4173 2024-09-19T06:56:20.917 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4174 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 5002 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 548 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 549 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6102 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6104 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6106 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6110 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6111 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6112 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6113 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6117 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 826 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 827 2024-09-19T06:56:20.918 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 828 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 06:40 pg_filenode.map 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 PG_VERSION 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:total 7777 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 19 06:40 . 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 06:40 .. 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 112 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 113 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 1247 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1247_fsm 2024-09-19T06:56:20.919 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1247_vm 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 06:40 1249 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1249_fsm 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1249_vm 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 06:40 1255 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1255_fsm 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1255_vm 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 06:40 1259 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1259_fsm 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1259_vm 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 06:40 13344 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13344_fsm 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13344_vm 2024-09-19T06:56:20.920 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13346 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13348 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13349_fsm 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349_vm 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13351 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13353 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13354_fsm 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354_vm 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13356 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13358 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13359_fsm 2024-09-19T06:56:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359_vm 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13361 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13363 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1417 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1418 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 174 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 175 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2187 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2224 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2328 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2336 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2337 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2579 2024-09-19T06:56:20.922 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2600 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2600_fsm 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2600_vm 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2601_fsm 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601_vm 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2602 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2602_fsm 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2602_vm 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2603 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2603_fsm 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2603_vm 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2604 2024-09-19T06:56:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2605 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2605_fsm 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2605_vm 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2606_fsm 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606_vm 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2607 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2607_fsm 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2607_vm 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 06:40 2608 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2608_fsm 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2608_vm 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 06:40 2609 2024-09-19T06:56:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2609_fsm 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2609_vm 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2610 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2610_fsm 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2610_vm 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2611 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2612_fsm 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612_vm 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2613 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2615_fsm 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615_vm 2024-09-19T06:56:20.925 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2616 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2616_fsm 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2616_vm 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 06:40 2617 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2617_fsm 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2617_vm 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 06:40 2618 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2618_fsm 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2618_vm 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 06:40 2619 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2619_fsm 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2619_vm 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2620 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2650 2024-09-19T06:56:20.926 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2651 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2652 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2653 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2654 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2655 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2656 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2657 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 06:40 2658 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 2659 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2660 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2661 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2662 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2663 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2664 2024-09-19T06:56:20.927 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2665 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2666 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2667 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2668 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2669 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2670 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 06:40 2673 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 06:40 2674 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 06:40 2675 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2678 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2679 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2680 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2681 2024-09-19T06:56:20.928 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2682 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2683 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2684 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2685 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2686 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2687 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2688 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2689 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 06:40 2690 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 06:40 2691 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2692 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2693 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2696 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2699 2024-09-19T06:56:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2701 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2702 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2703 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2704 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2753 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2753_fsm 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2753_vm 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2754 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2755 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2756 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2757 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2830 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2831 2024-09-19T06:56:20.930 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2832 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2833 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2834 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2835 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2836 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2837 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 06:40 2838 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2838_fsm 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2838_vm 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2839 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840_fsm 2024-09-19T06:56:20.931 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2840_vm 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2841 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2995 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2996 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3079_fsm 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079_vm 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3080 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3081 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3085 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3118 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3119 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 06:40 3164 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3256 2024-09-19T06:56:20.932 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3257 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3258 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3350 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3351 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3379 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3380 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3381 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3394 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3394_fsm 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3394_vm 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3395 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3429 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3430 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3431 2024-09-19T06:56:20.933 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3433 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3439 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3440 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3455 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 06:40 3456 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3456_fsm 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3456_vm 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3466 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3467 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3468 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3501 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3502 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3503 2024-09-19T06:56:20.934 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3534 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3541_fsm 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541_vm 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3542 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3574 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3575 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3576 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3596 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3597 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3598 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3599 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3600_fsm 2024-09-19T06:56:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600_vm 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3601_fsm 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601_vm 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3602_fsm 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602_vm 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603_fsm 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3603_vm 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3604 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3605 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3606 2024-09-19T06:56:20.936 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3607 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3608 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 3609 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3712 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3764_fsm 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764_vm 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3766 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3767 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3997 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4143 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4144 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4145 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4146 2024-09-19T06:56:20.937 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4147 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4148 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4149 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4150 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4151 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4152 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4153 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4154 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4155 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4156 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4157 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4158 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4159 2024-09-19T06:56:20.938 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4160 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4161 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4162 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4163 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4164 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4165 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4166 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4167 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4168 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4169 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4170 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4171 2024-09-19T06:56:20.939 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4172 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4173 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4174 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 5002 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 548 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 549 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6102 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6104 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6106 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6110 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6111 2024-09-19T06:56:20.942 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6112 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6113 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6117 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 826 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 827 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 828 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 06:40 pg_filenode.map 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 PG_VERSION 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:total 612374 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 19 06:44 . 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 06:40 .. 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 112 2024-09-19T06:56:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 113 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 1247 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1247_fsm 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1247_vm 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 06:40 1249 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1249_fsm 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1249_vm 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 06:40 1255 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1255_fsm 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1255_vm 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 06:55 1259 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1259_fsm 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1259_vm 2024-09-19T06:56:20.944 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 06:40 13344 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13344_fsm 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13344_vm 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13346 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13348 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13349_fsm 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13349_vm 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13351 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13353 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13354_fsm 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13354_vm 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13356 2024-09-19T06:56:20.945 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13358 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 13359_fsm 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13359_vm 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 13361 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 13363 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1417 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 1418 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 444497920 Sep 19 06:55 16396 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 19 06:55 16396_fsm 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:43 16396_vm 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 884736 Sep 19 06:55 16397 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:55 16397_fsm 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:55 16397_vm 2024-09-19T06:56:20.946 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 2318336 Sep 19 06:55 16399 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:55 16399_fsm 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:55 16399_vm 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:55 16400 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 06:55 16402 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 19 06:55 16404 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98983936 Sep 19 06:55 16406 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:55 16406_fsm 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:55 16406_vm 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 174 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 175 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2187 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2224 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2328 2024-09-19T06:56:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2336 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2337 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2579 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2600 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2600_fsm 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2600_vm 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2601_fsm 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2601_vm 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2602 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2602_fsm 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2602_vm 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2603 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2603_fsm 2024-09-19T06:56:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2603_vm 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2604 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2605 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2605_fsm 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2605_vm 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2606_fsm 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2606_vm 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2607 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2607_fsm 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2607_vm 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 06:40 2608 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2608_fsm 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2608_vm 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 06:40 2609 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2609_fsm 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2609_vm 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2610 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2610_fsm 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2610_vm 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2611 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2612_fsm 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2612_vm 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2613 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615 2024-09-19T06:56:20.950 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2615_fsm 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2615_vm 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2616 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2616_fsm 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2616_vm 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 06:40 2617 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2617_fsm 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2617_vm 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 06:40 2618 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2618_fsm 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2618_vm 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Sep 19 06:55 2619 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:43 2619_fsm 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2619_vm 2024-09-19T06:56:20.951 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2620 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2650 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2651 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2652 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2653 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2654 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2655 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2656 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2657 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 06:40 2658 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 06:40 2659 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2660 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2661 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2662 2024-09-19T06:56:20.952 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2663 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2664 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2665 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2666 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2667 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2668 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2669 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2670 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 06:40 2673 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 06:40 2674 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 06:40 2675 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2678 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2679 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2680 2024-09-19T06:56:20.953 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2681 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2682 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2683 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2684 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2685 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2686 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2687 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2688 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 06:40 2689 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 06:40 2690 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 06:40 2691 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2692 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2693 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:46 2696 2024-09-19T06:56:20.954 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2699 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2701 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2702 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2703 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 2704 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2753 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2753_fsm 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2753_vm 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2754 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2755 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2756 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 2757 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2830 2024-09-19T06:56:20.955 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2831 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2832 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2833 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2834 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2835 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2836 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2837 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 06:40 2838 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2838_fsm 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2838_vm 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2839 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2840_fsm 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2840_vm 2024-09-19T06:56:20.956 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2841 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2995 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2996 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3079_fsm 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3079_vm 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3080 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3081 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3085 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3118 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3119 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 06:40 3164 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3256 2024-09-19T06:56:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3257 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3258 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3350 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3351 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3379 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3380 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3381 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3394 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3394_fsm 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3394_vm 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3395 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3429 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3430 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3431 2024-09-19T06:56:20.958 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3433 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3439 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3440 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 06:40 3455 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 06:40 3456 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3456_fsm 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3456_vm 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3466 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3467 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3468 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3501 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3502 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3503 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3534 2024-09-19T06:56:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3541_fsm 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3541_vm 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3542 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3574 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3575 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3576 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3596 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3597 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3598 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3599 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3600_fsm 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3600_vm 2024-09-19T06:56:20.960 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3601_fsm 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3601_vm 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3602_fsm 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3602_vm 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3603_fsm 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3603_vm 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3604 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3605 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3606 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3607 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3608 2024-09-19T06:56:20.961 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 06:40 3609 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3712 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 3764_fsm 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3764_vm 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3766 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 3767 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3997 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4143 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4144 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4145 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4146 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4147 2024-09-19T06:56:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4148 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4149 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4150 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4151 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4152 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4153 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4154 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4155 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4156 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4157 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4158 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4159 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4160 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4161 2024-09-19T06:56:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4162 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4163 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4164 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4165 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4166 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4167 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4168 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4169 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4170 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4171 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4172 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4173 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4174 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 5002 2024-09-19T06:56:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 548 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 549 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6102 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6104 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6106 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6110 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6111 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6112 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6113 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6117 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 826 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 827 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 828 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 06:40 pg_filenode.map 2024-09-19T06:56:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 19 06:40 pg_internal.init 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:40 PG_VERSION 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 19 06:40 .. 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/global: 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:total 560 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 19 06:40 . 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1213 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1213_fsm 2024-09-19T06:56:20.966 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1213_vm 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1214 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1214_fsm 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1214_vm 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 1232 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 1233 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1260 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1260_fsm 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1260_vm 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1261 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1261_fsm 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1261_vm 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1262 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 1262_fsm 2024-09-19T06:56:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 1262_vm 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2396 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 06:40 2396_fsm 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2396_vm 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2397 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2671 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2672 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2676 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2677 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2694 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2695 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2697 2024-09-19T06:56:20.968 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 06:40 2698 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2846 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2847 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2964 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2965 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 2966 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 2967 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 3592 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 3593 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4060 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4061 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4175 2024-09-19T06:56:20.969 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4176 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4177 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4178 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4181 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4182 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4183 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4184 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 4185 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 4186 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6000 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6001 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6002 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 6100 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6114 2024-09-19T06:56:20.970 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 6115 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:56 pg_control 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 06:40 pg_filenode.map 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 19 06:40 pg_internal.init 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/log: 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:total 2 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 . 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1364 Sep 19 06:56 postgresql-Thu.log 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.971 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:total 1 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:56 . 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 mappings 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 06:56 replorigin_checkpoint 2024-09-19T06:56:20.972 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 snapshots 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:56 .. 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:56 .. 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.973 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 . 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 members 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 offsets 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:total 8 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 . 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 .. 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:40 0000 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-19T06:56:20.974 INFO:teuthology.orchestra.run.smithi012.stdout:total 8 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:40 . 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:40 .. 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 06:43 0000 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:total 15 2024-09-19T06:56:20.976 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 06:56 . 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 19 06:56 db_0.stat 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 19 06:56 db_13494.stat 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 19 06:56 global.stat 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:56 . 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:total 232 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 19 06:56 . 2024-09-19T06:56:20.977 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 237568 Sep 19 06:55 001B 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-19T06:56:20.978 INFO:teuthology.orchestra.run.smithi012.stdout:total 1048576 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 19 06:56 . 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:56 0000000100000000000000A1 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:47 0000000100000000000000A2 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:47 0000000100000000000000A3 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:48 0000000100000000000000A4 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:47 0000000100000000000000A5 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:47 0000000100000000000000A6 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:46 0000000100000000000000A7 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:47 0000000100000000000000A8 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:47 0000000100000000000000A9 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:48 0000000100000000000000AA 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:48 0000000100000000000000AB 2024-09-19T06:56:20.979 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:46 0000000100000000000000AC 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:48 0000000100000000000000AD 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:46 0000000100000000000000AE 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:47 0000000100000000000000AF 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:48 0000000100000000000000B0 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:46 0000000100000000000000B1 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:48 0000000100000000000000B2 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:47 0000000100000000000000B3 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:46 0000000100000000000000B4 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:48 0000000100000000000000B5 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:47 0000000100000000000000B6 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:51 0000000100000000000000B7 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:48 0000000100000000000000B8 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:51 0000000100000000000000B9 2024-09-19T06:56:20.980 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:51 0000000100000000000000BA 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:49 0000000100000000000000BB 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:47 0000000100000000000000BC 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000BD 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:51 0000000100000000000000BE 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000BF 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:54 0000000100000000000000C0 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:51 0000000100000000000000C1 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:54 0000000100000000000000C2 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:55 0000000100000000000000C3 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000C4 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:51 0000000100000000000000C5 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000C6 2024-09-19T06:56:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000C7 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000C8 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000C9 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000CA 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:54 0000000100000000000000CB 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000CC 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000CD 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000CE 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:53 0000000100000000000000CF 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000D0 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:51 0000000100000000000000D1 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:54 0000000100000000000000D2 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:51 0000000100000000000000D3 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000D4 2024-09-19T06:56:20.982 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000D5 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:51 0000000100000000000000D6 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000D7 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000D8 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000D9 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:53 0000000100000000000000DA 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000DB 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:53 0000000100000000000000DC 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000DD 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000DE 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000DF 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 06:52 0000000100000000000000E0 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 archive_status 2024-09-19T06:56:20.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout:total 0 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 06:40 . 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 19 06:56 .. 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout:total 448 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 19 06:46 . 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 19 06:56 .. 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 19 06:46 0000 2024-09-19T06:56:20.984 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 06:55 0001 2024-09-19T06:56:20.984 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T06:56:20.997 INFO:tasks.quiescer:joining Quiescers 2024-09-19T06:56:20.997 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T06:56:20.997 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:56:20.999 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '183c19bc', total seconds elapsed: 32.9 2024-09-19T06:56:21.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.005+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/4249597818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e4101390 msgr2=0x7fc1e410d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.005+0000 7fc1ea9e4640 1 --2- 172.21.15.12:0/4249597818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e4101390 0x7fc1e410d8c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009cd0 tx=0x7fc1dc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.005+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/4249597818 shutdown_connections 2024-09-19T06:56:21.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.005+0000 7fc1ea9e4640 1 --2- 172.21.15.12:0/4249597818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e4101390 0x7fc1e410d8c0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.005+0000 7fc1ea9e4640 1 --2- 172.21.15.12:0/4249597818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1e41009f0 0x7fc1e4100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.005+0000 7fc1ea9e4640 1 --2- 172.21.15.12:0/4249597818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e4106a00 0x7fc1e4106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.008 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.005+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/4249597818 >> 172.21.15.12:0/4249597818 conn(0x7fc1e40fc6b0 msgr2=0x7fc1e40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:21.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.006+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/4249597818 shutdown_connections 2024-09-19T06:56:21.009 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.006+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/4249597818 wait complete. 2024-09-19T06:56:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.006+0000 7fc1ea9e4640 1 Processor -- start 2024-09-19T06:56:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.006+0000 7fc1ea9e4640 1 -- start start 2024-09-19T06:56:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1ea9e4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e41009f0 0x7fc1e4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1ea9e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e4101390 0x7fc1e4198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1ea9e4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1e4106a00 0x7fc1e419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1ea9e4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4110e40 con 0x7fc1e4101390 2024-09-19T06:56:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1ea9e4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4110cc0 con 0x7fc1e4106a00 2024-09-19T06:56:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1ea9e4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4110fc0 con 0x7fc1e41009f0 2024-09-19T06:56:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e4101390 0x7fc1e4198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e4101390 0x7fc1e4198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42650/0 (socket says 172.21.15.12:42650) 2024-09-19T06:56:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e37fe640 1 -- 172.21.15.12:0/386467432 learned_addr learned my addr 172.21.15.12:0/386467432 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e8f81640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1e4106a00 0x7fc1e419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e41009f0 0x7fc1e4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e37fe640 1 -- 172.21.15.12:0/386467432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e41009f0 msgr2=0x7fc1e4198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e37fe640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e41009f0 0x7fc1e4198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e37fe640 1 -- 172.21.15.12:0/386467432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1e4106a00 msgr2=0x7fc1e419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e37fe640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1e4106a00 0x7fc1e419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e37fe640 1 -- 172.21.15.12:0/386467432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e419d2f0 con 0x7fc1e4101390 2024-09-19T06:56:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.007+0000 7fc1e37fe640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e4101390 0x7fc1e4198840 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800c920 tx=0x7fc1d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.008+0000 7fc1e17fa640 1 -- 172.21.15.12:0/386467432 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8007c70 con 0x7fc1e4101390 2024-09-19T06:56:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.008+0000 7fc1e17fa640 1 -- 172.21.15.12:0/386467432 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1d8007e10 con 0x7fc1e4101390 2024-09-19T06:56:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.008+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/386467432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e419d5e0 con 0x7fc1e4101390 2024-09-19T06:56:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.008+0000 7fc1e17fa640 1 -- 172.21.15.12:0/386467432 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8018890 con 0x7fc1e4101390 2024-09-19T06:56:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.008+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/386467432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e41a4e70 con 0x7fc1e4101390 2024-09-19T06:56:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.010+0000 7fc1e17fa640 1 -- 172.21.15.12:0/386467432 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc1d8018a70 con 0x7fc1e4101390 2024-09-19T06:56:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.010+0000 7fc1ed858740 1 Processor -- start 2024-09-19T06:56:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1ed858740 1 -- start start 2024-09-19T06:56:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7469f0 0x5590df746dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df747310 0x5590df755b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7560c0 0x5590df7584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1ed858740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5590df6ab2f0 con 0x5590df7560c0 2024-09-19T06:56:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1ed858740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5590df653270 con 0x5590df7469f0 2024-09-19T06:56:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1ed858740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5590df6a72b0 con 0x5590df747310 2024-09-19T06:56:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7560c0 0x5590df7584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e17fa640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc1cc0a34e0 0x7fc1cc0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df747310 0x5590df755b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7560c0 0x5590df7584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42664/0 (socket says 172.21.15.12:42664) 2024-09-19T06:56:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e37fe640 1 -- 172.21.15.12:0/3755388085 learned_addr learned my addr 172.21.15.12:0/3755388085 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e8f81640 1 --2- 172.21.15.12:0/3755388085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7469f0 0x5590df746dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e8f81640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc1cc0a34e0 0x7fc1cc0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e17fa640 1 -- 172.21.15.12:0/386467432 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7fc1d80cfe30 con 0x7fc1e4101390 2024-09-19T06:56:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e3fff640 1 -- 172.21.15.12:0/3755388085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7469f0 msgr2=0x5590df746dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/3755388085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7469f0 0x5590df746dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e3fff640 1 -- 172.21.15.12:0/3755388085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7560c0 msgr2=0x5590df7584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/3755388085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7560c0 0x5590df7584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.011+0000 7fc1e3fff640 1 -- 172.21.15.12:0/3755388085 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590df652340 con 0x5590df747310 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.012+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/3755388085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df747310 0x5590df755b80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400bb70 tx=0x7fc1d40107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8494733049dd2f69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.012+0000 7fc1e8f81640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc1cc0a34e0 0x7fc1cc0a59a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004ab0 tx=0x7fc1dc004a40 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.012+0000 7fc1ca7fc640 1 -- 172.21.15.12:0/3755388085 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4004030 con 0x5590df747310 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.012+0000 7fc1ca7fc640 1 -- 172.21.15.12:0/3755388085 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1d40041d0 con 0x5590df747310 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.012+0000 7fc1ca7fc640 1 -- 172.21.15.12:0/3755388085 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4011680 con 0x5590df747310 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 -- 172.21.15.12:0/3755388085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df747310 msgr2=0x5590df755b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 --2- 172.21.15.12:0/3755388085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df747310 0x5590df755b80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400bb70 tx=0x7fc1d40107a0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 -- 172.21.15.12:0/3755388085 shutdown_connections 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 --2- 172.21.15.12:0/3755388085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7560c0 0x5590df7584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 --2- 172.21.15.12:0/3755388085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df747310 0x5590df755b80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 --2- 172.21.15.12:0/3755388085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7469f0 0x5590df746dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 -- 172.21.15.12:0/3755388085 >> 172.21.15.12:0/3755388085 conn(0x5590df743060 msgr2=0x5590df743440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 -- 172.21.15.12:0/3755388085 shutdown_connections 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 -- 172.21.15.12:0/3755388085 wait complete. 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 -- start start 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.013+0000 7fc1ed858740 1 Processor -- start 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7469f0 0x5590df752fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df747310 0x5590df753500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 0x5590df753a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1ed858740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5590df758d20 con 0x5590df7469f0 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1ed858740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5590df634290 con 0x5590df747310 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1ed858740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5590df758ea0 con 0x5590df7560c0 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1ed858740 10 client.0 _ll_register_callbacks cb 0x5590df665140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7469f0 0x5590df752fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7469f0 0x5590df752fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42678/0 (socket says 172.21.15.12:42678) 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e3fff640 1 -- 172.21.15.12:0/3707965246 learned_addr learned my addr 172.21.15.12:0/3707965246 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e37fe640 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df747310 0x5590df753500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e8f81640 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 0x5590df753a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e37fe640 1 -- 172.21.15.12:0/3707965246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 msgr2=0x5590df753a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e37fe640 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 0x5590df753a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e37fe640 1 -- 172.21.15.12:0/3707965246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7469f0 msgr2=0x5590df752fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e37fe640 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7469f0 0x5590df752fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e37fe640 1 -- 172.21.15.12:0/3707965246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590df3be210 con 0x5590df747310 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7469f0 0x5590df752fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1e37fe640 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df747310 0x5590df753500 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8017000 tx=0x7fc1d809bc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fdce46cbebe30d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.014+0000 7fc1c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1c37fe640 1 -- 172.21.15.12:0/3707965246 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80a03c0 con 0x5590df747310 2024-09-19T06:56:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1ed858740 1 -- 172.21.15.12:0/3707965246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1d40041d0 con 0x5590df747310 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1c37fe640 1 -- 172.21.15.12:0/3707965246 <== mon.2 v2:172.21.15.16:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7fc1d8018d60 con 0x5590df747310 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1c37fe640 1 -- 172.21.15.12:0/3707965246 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fc1d80a4c80 con 0x5590df747310 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1ed858740 10 client.29210 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1ed858740 1 -- 172.21.15.12:0/3707965246 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5590df48a620 con 0x5590df747310 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1c37fe640 1 -- 172.21.15.12:0/3707965246 <== mon.2 v2:172.21.15.16:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1d40041d0 con 0x5590df747310 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1c37fe640 1 -- 172.21.15.12:0/3707965246 <== mon.2 v2:172.21.15.16:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7fc1d80b8030 con 0x5590df747310 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1ed858740 10 client.29210 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1ed858740 10 client.29210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1ed858740 20 client.29210 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1ed858740 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590df766180 0x5590df768610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1ed858740 4 client.29210 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.015+0000 7fc1ed858740 1 -- 172.21.15.12:0/3707965246 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590df6b8a20 con 0x5590df766180 2024-09-19T06:56:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.016+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590df766180 0x5590df768610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.016+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590df766180 0x5590df768610 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f76995e88c3f1ea0 server_cookie=883528f39354c825 in_seq=0 out_seq=0 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.016+0000 7fc1c37fe640 10 client.29210 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1c37fe640 1 -- 172.21.15.12:0/3707965246 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590df6b8a20 con 0x5590df766180 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1c37fe640 10 client.29210 handle_command_reply: tid=0 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 client.29210 shutdown 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 -- 172.21.15.12:0/3707965246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df747310 msgr2=0x5590df753500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df747310 0x5590df753500 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8017000 tx=0x7fc1d809bc10 comp rx=0 tx=0).stop 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 -- 172.21.15.12:0/3707965246 shutdown_connections 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590df766180 0x5590df768610 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 0x5590df753a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df747310 0x5590df753500 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1c37fe640 0 client.29210 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 --2- 172.21.15.12:0/3707965246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df7469f0 0x5590df752fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 -- 172.21.15.12:0/3707965246 >> 172.21.15.12:0/3707965246 conn(0x5590df743060 msgr2=0x5590df748dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 -- 172.21.15.12:0/3707965246 shutdown_connections 2024-09-19T06:56:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 1 -- 172.21.15.12:0/3707965246 wait complete. 2024-09-19T06:56:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.017+0000 7fc1ed858740 20 client.29210 trim_cache size 0 max 16384 2024-09-19T06:56:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.031+0000 7fc1ed858740 1 Processor -- start 2024-09-19T06:56:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1ed858740 1 -- start start 2024-09-19T06:56:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7469f0 0x5590df754f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df76df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7560c0 0x5590df76e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1ed858740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41ab910 con 0x5590df747310 2024-09-19T06:56:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1ed858740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41ad510 con 0x5590df7560c0 2024-09-19T06:56:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1ed858740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41abfe0 con 0x5590df7469f0 2024-09-19T06:56:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df76df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7469f0 0x5590df754f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df76df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42694/0 (socket says 172.21.15.12:42694) 2024-09-19T06:56:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e37fe640 1 -- 172.21.15.12:0/16060282 learned_addr learned my addr 172.21.15.12:0/16060282 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e8f81640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7560c0 0x5590df76e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e3fff640 1 -- 172.21.15.12:0/16060282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7560c0 msgr2=0x5590df76e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/16060282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7560c0 0x5590df76e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e3fff640 1 -- 172.21.15.12:0/16060282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 msgr2=0x5590df76df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/16060282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df76df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e3fff640 1 -- 172.21.15.12:0/16060282 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590df747140 con 0x5590df7469f0 2024-09-19T06:56:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e37fe640 1 --2- 172.21.15.12:0/16060282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df76df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.032+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/16060282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7469f0 0x5590df754f30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4003dc0 tx=0x7fc1d4020040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35ea2690676bd1df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.033+0000 7fc1c9ffb640 1 -- 172.21.15.12:0/16060282 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40052e0 con 0x5590df7469f0 2024-09-19T06:56:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.033+0000 7fc1c9ffb640 1 -- 172.21.15.12:0/16060282 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1d402d070 con 0x5590df7469f0 2024-09-19T06:56:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.033+0000 7fc1c9ffb640 1 -- 172.21.15.12:0/16060282 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4011440 con 0x5590df7469f0 2024-09-19T06:56:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.033+0000 7fc1ed858740 1 -- 172.21.15.12:0/16060282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7469f0 msgr2=0x5590df754f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.033+0000 7fc1ed858740 1 --2- 172.21.15.12:0/16060282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7469f0 0x5590df754f30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4003dc0 tx=0x7fc1d4020040 comp rx=0 tx=0).stop 2024-09-19T06:56:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.033+0000 7fc1ed858740 1 -- 172.21.15.12:0/16060282 shutdown_connections 2024-09-19T06:56:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.033+0000 7fc1ed858740 1 --2- 172.21.15.12:0/16060282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7560c0 0x5590df76e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.033+0000 7fc1ed858740 1 --2- 172.21.15.12:0/16060282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df76df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.033+0000 7fc1ed858740 1 --2- 172.21.15.12:0/16060282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7469f0 0x5590df754f30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.033+0000 7fc1ed858740 1 -- 172.21.15.12:0/16060282 >> 172.21.15.12:0/16060282 conn(0x5590df743060 msgr2=0x5590df754820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 1 -- 172.21.15.12:0/16060282 shutdown_connections 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 1 -- 172.21.15.12:0/16060282 wait complete. 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 1 -- start start 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 1 Processor -- start 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7469f0 0x5590df75e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df75e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 0x5590df74fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41acd80 con 0x5590df747310 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41ac6b0 con 0x5590df7469f0 2024-09-19T06:56:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41a9910 con 0x5590df7560c0 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1ed858740 10 client.0 _ll_register_callbacks cb 0x7fc1d800fe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df75e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1e8f81640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 0x5590df74fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df75e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42696/0 (socket says 172.21.15.12:42696) 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7469f0 0x5590df75e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.034+0000 7fc1e37fe640 1 -- 172.21.15.12:0/2193699992 learned_addr learned my addr 172.21.15.12:0/2193699992 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1e8f81640 1 -- 172.21.15.12:0/2193699992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7469f0 msgr2=0x5590df75e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1e8f81640 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7469f0 0x5590df75e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1e8f81640 1 -- 172.21.15.12:0/2193699992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 msgr2=0x5590df75e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1e8f81640 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df75e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1e8f81640 1 -- 172.21.15.12:0/2193699992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590df750260 con 0x5590df7560c0 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1e37fe640 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df75e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1e8f81640 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 0x5590df74fa30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009ca0 tx=0x7fc1dc02a8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f971108f762c09fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1c37fe640 1 -- 172.21.15.12:0/2193699992 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc058060 con 0x5590df7560c0 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1c37fe640 1 -- 172.21.15.12:0/2193699992 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7fc1dc0307a0 con 0x5590df7560c0 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.035+0000 7fc1ed858740 1 -- 172.21.15.12:0/2193699992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1d402d070 con 0x5590df7560c0 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1c37fe640 1 -- 172.21.15.12:0/2193699992 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fc1dc0309a0 con 0x5590df7560c0 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1ed858740 10 client.29113 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1ed858740 1 -- 172.21.15.12:0/2193699992 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5590df7d0b20 con 0x5590df7560c0 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1c37fe640 1 -- 172.21.15.12:0/2193699992 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1d402d070 con 0x5590df7560c0 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1c37fe640 1 -- 172.21.15.12:0/2193699992 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7fc1dc030070 con 0x5590df7560c0 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1ed858740 10 client.29113 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1ed858740 10 client.29113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1ed858740 20 client.29113 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1ed858740 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590df7d1300 0x5590df7d3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1ed858740 4 client.29113 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:56:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1ed858740 1 -- 172.21.15.12:0/2193699992 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5590df6b2d70 con 0x5590df7d1300 2024-09-19T06:56:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.036+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590df7d1300 0x5590df7d3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.037+0000 7fc1c37fe640 10 client.29113 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.037+0000 7fc1e3fff640 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590df7d1300 0x5590df7d3720 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0fd243592b790e2 server_cookie=3c1200061338164c in_seq=0 out_seq=0 2024-09-19T06:56:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.050+0000 7fc1c37fe640 1 -- 172.21.15.12:0/2193699992 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5590df6b2d70 con 0x5590df7d1300 2024-09-19T06:56:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.050+0000 7fc1c37fe640 10 client.29113 handle_command_reply: tid=0 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.050+0000 7fc1ed858740 1 client.29113 shutdown 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 1 -- 172.21.15.12:0/2193699992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 msgr2=0x5590df74fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 0x5590df74fa30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009ca0 tx=0x7fc1dc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 1 -- 172.21.15.12:0/2193699992 shutdown_connections 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5590df7d1300 0x5590df7d3720 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590df7560c0 0x5590df74fa30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5590df747310 0x5590df75e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 1 --2- 172.21.15.12:0/2193699992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5590df7469f0 0x5590df75e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1c37fe640 0 client.29113 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 1 -- 172.21.15.12:0/2193699992 >> 172.21.15.12:0/2193699992 conn(0x5590df743060 msgr2=0x5590df748530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 1 -- 172.21.15.12:0/2193699992 shutdown_connections 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 1 -- 172.21.15.12:0/2193699992 wait complete. 2024-09-19T06:56:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ed858740 20 client.29113 trim_cache size 0 max 16384 2024-09-19T06:56:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-09-19T06:56:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-09-19T06:56:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-09-19T06:56:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/386467432 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc1cc0a34e0 msgr2=0x7fc1cc0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ea9e4640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc1cc0a34e0 0x7fc1cc0a59a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc004ab0 tx=0x7fc1dc004a40 comp rx=0 tx=0).stop 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/386467432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e4101390 msgr2=0x7fc1e4198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.051+0000 7fc1ea9e4640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e4101390 0x7fc1e4198840 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800c920 tx=0x7fc1d800cde0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.052+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/386467432 shutdown_connections 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.052+0000 7fc1ea9e4640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1e4106a00 0x7fc1e419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.052+0000 7fc1ea9e4640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc1e4101390 0x7fc1e4198840 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.052+0000 7fc1ea9e4640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fc1cc0a34e0 0x7fc1cc0a59a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.052+0000 7fc1ea9e4640 1 --2- 172.21.15.12:0/386467432 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e41009f0 0x7fc1e4198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.052+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/386467432 >> 172.21.15.12:0/386467432 conn(0x7fc1e40fc6b0 msgr2=0x7fc1e406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.052+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/386467432 shutdown_connections 2024-09-19T06:56:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-09-19T06:56:21.052+0000 7fc1ea9e4640 1 -- 172.21.15.12:0/386467432 wait complete. 2024-09-19T06:56:21.271 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.687+0000 7fcf8e406640 1 -- 172.21.15.12:0/2990516567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf88102d40 msgr2=0x7fcf88103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.687+0000 7fcf8e406640 1 --2- 172.21.15.12:0/2990516567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf88102d40 0x7fcf88103120 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009900 tx=0x7fcf7802a480 comp rx=0 tx=0).stop 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.688+0000 7fcf8e406640 1 -- 172.21.15.12:0/2990516567 shutdown_connections 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.688+0000 7fcf8e406640 1 --2- 172.21.15.12:0/2990516567 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf8810c170 0x7fcf8810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.688+0000 7fcf8e406640 1 --2- 172.21.15.12:0/2990516567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf88103660 0x7fcf8810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.688+0000 7fcf8e406640 1 --2- 172.21.15.12:0/2990516567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf88102d40 0x7fcf88103120 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.688+0000 7fcf8e406640 1 -- 172.21.15.12:0/2990516567 >> 172.21.15.12:0/2990516567 conn(0x7fcf880fc7a0 msgr2=0x7fcf880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.688+0000 7fcf8e406640 1 -- 172.21.15.12:0/2990516567 shutdown_connections 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.688+0000 7fcf8e406640 1 -- 172.21.15.12:0/2990516567 wait complete. 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.688+0000 7fcf8e406640 1 Processor -- start 2024-09-19T06:56:21.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.688+0000 7fcf8e406640 1 -- start start 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf8e406640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf88102d40 0x7fcf881983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf8e406640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf88103660 0x7fcf88198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf8e406640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf8810c170 0x7fcf8819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf8e406640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88111f70 con 0x7fcf88102d40 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf8e406640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88111df0 con 0x7fcf88103660 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf8e406640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcf881120f0 con 0x7fcf8810c170 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf88102d40 0x7fcf881983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf88102d40 0x7fcf881983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42710/0 (socket says 172.21.15.12:42710) 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf87fff640 1 -- 172.21.15.12:0/102938599 learned_addr learned my addr 172.21.15.12:0/102938599 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf877fe640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf88103660 0x7fcf88198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf8c9a3640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf8810c170 0x7fcf8819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf87fff640 1 -- 172.21.15.12:0/102938599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf8810c170 msgr2=0x7fcf8819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf87fff640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf8810c170 0x7fcf8819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf87fff640 1 -- 172.21.15.12:0/102938599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf88103660 msgr2=0x7fcf88198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf87fff640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf88103660 0x7fcf88198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf87fff640 1 -- 172.21.15.12:0/102938599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8819d380 con 0x7fcf88102d40 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.689+0000 7fcf877fe640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf88103660 0x7fcf88198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.690+0000 7fcf87fff640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf88102d40 0x7fcf881983d0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fcf78006010 tx=0x7fcf780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.690+0000 7fcf857fa640 1 -- 172.21.15.12:0/102938599 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7803f030 con 0x7fcf88102d40 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.690+0000 7fcf8e406640 1 -- 172.21.15.12:0/102938599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8819d610 con 0x7fcf88102d40 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.690+0000 7fcf857fa640 1 -- 172.21.15.12:0/102938599 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf78003ce0 con 0x7fcf88102d40 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.690+0000 7fcf857fa640 1 -- 172.21.15.12:0/102938599 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf78035070 con 0x7fcf88102d40 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.690+0000 7fcf8e406640 1 -- 172.21.15.12:0/102938599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf881a4f50 con 0x7fcf88102d40 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.691+0000 7fcf8e406640 1 -- 172.21.15.12:0/102938599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8806b070 con 0x7fcf88102d40 2024-09-19T06:56:21.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.692+0000 7fcf857fa640 1 -- 172.21.15.12:0/102938599 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcf78042030 con 0x7fcf88102d40 2024-09-19T06:56:21.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.693+0000 7fcf857fa640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf700a33b0 0x7fcf700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:21.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.693+0000 7fcf877fe640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf700a33b0 0x7fcf700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:21.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.693+0000 7fcf857fa640 1 -- 172.21.15.12:0/102938599 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7fcf780f0530 con 0x7fcf88102d40 2024-09-19T06:56:21.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.693+0000 7fcf877fe640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf700a33b0 0x7fcf700a5870 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcf8810d540 tx=0x7fcf7c005e30 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:21.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.697+0000 7fcf857fa640 1 -- 172.21.15.12:0/102938599 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf780bcf30 con 0x7fcf88102d40 2024-09-19T06:56:21.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.913+0000 7fcf8e406640 1 -- 172.21.15.12:0/102938599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf881071e0 con 0x7fcf88102d40 2024-09-19T06:56:21.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.914+0000 7fcf857fa640 1 -- 172.21.15.12:0/102938599 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11978 (secure 0 0 0) 0x7fcf780bc830 con 0x7fcf88102d40 2024-09-19T06:56:21.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:21.917 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":55,"btime":"2024-09-19T06:55:59:136308+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:55:58.436603+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24502,24481,24439,24509,24431]},"id":1}]} 2024-09-19T06:56:21.921 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 55 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 -- 172.21.15.12:0/102938599 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf700a33b0 msgr2=0x7fcf700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf700a33b0 0x7fcf700a5870 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcf8810d540 tx=0x7fcf7c005e30 comp rx=0 tx=0).stop 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 -- 172.21.15.12:0/102938599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf88102d40 msgr2=0x7fcf881983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf88102d40 0x7fcf881983d0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fcf78006010 tx=0x7fcf780042f0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 -- 172.21.15.12:0/102938599 shutdown_connections 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fcf700a33b0 0x7fcf700a5870 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf8810c170 0x7fcf8819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf88103660 0x7fcf88198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 --2- 172.21.15.12:0/102938599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf88102d40 0x7fcf881983d0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 -- 172.21.15.12:0/102938599 >> 172.21.15.12:0/102938599 conn(0x7fcf880fc7a0 msgr2=0x7fcf880fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 -- 172.21.15.12:0/102938599 shutdown_connections 2024-09-19T06:56:21.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:21.916+0000 7fcf8e406640 1 -- 172.21.15.12:0/102938599 wait complete. 2024-09-19T06:56:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:21 smithi016 ceph-mon[34911]: pgmap v509: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 11 op/s 2024-09-19T06:56:22.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:21 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/102938599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:21 smithi173 ceph-mon[35349]: pgmap v509: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 11 op/s 2024-09-19T06:56:22.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:21 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/102938599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:22.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:21 smithi012 ceph-mon[30937]: pgmap v509: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 11 op/s 2024-09-19T06:56:22.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:21 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/102938599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:22.634 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --cancel --all' 2024-09-19T06:56:22.634 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --cancel --all 2024-09-19T06:56:22.932 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.435+0000 7eff354db640 1 -- 172.21.15.12:0/3739446845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff30101420 msgr2=0x7eff3010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.435+0000 7eff354db640 1 --2- 172.21.15.12:0/3739446845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff30101420 0x7eff3010d950 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7eff28009cd0 tx=0x7eff2802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.435+0000 7eff354db640 1 -- 172.21.15.12:0/3739446845 shutdown_connections 2024-09-19T06:56:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.435+0000 7eff354db640 1 --2- 172.21.15.12:0/3739446845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff30101420 0x7eff3010d950 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.435+0000 7eff354db640 1 --2- 172.21.15.12:0/3739446845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff30100a80 0x7eff30100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.435+0000 7eff354db640 1 --2- 172.21.15.12:0/3739446845 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff30106a80 0x7eff30106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.435+0000 7eff354db640 1 -- 172.21.15.12:0/3739446845 >> 172.21.15.12:0/3739446845 conn(0x7eff300fc7a0 msgr2=0x7eff300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.435+0000 7eff354db640 1 -- 172.21.15.12:0/3739446845 shutdown_connections 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.435+0000 7eff354db640 1 -- 172.21.15.12:0/3739446845 wait complete. 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.436+0000 7eff354db640 1 Processor -- start 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.436+0000 7eff354db640 1 -- start start 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.436+0000 7eff354db640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff30100a80 0x7eff3019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.436+0000 7eff354db640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff30101420 0x7eff3019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.436+0000 7eff354db640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff30106a80 0x7eff3019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.436+0000 7eff354db640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff30110e80 con 0x7eff30100a80 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.436+0000 7eff354db640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff30110d00 con 0x7eff30101420 2024-09-19T06:56:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.436+0000 7eff354db640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7eff30111000 con 0x7eff30106a80 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff30100a80 0x7eff3019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff30100a80 0x7eff3019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42738/0 (socket says 172.21.15.12:42738) 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2effd640 1 -- 172.21.15.12:0/1794795822 learned_addr learned my addr 172.21.15.12:0/1794795822 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff30101420 0x7eff3019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2f7fe640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff30106a80 0x7eff3019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2effd640 1 -- 172.21.15.12:0/1794795822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff30106a80 msgr2=0x7eff3019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2effd640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff30106a80 0x7eff3019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2effd640 1 -- 172.21.15.12:0/1794795822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff30101420 msgr2=0x7eff3019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2effd640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff30101420 0x7eff3019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2effd640 1 -- 172.21.15.12:0/1794795822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3019f5b0 con 0x7eff30100a80 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff30101420 0x7eff3019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff2effd640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff30100a80 0x7eff3019a600 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7eff2000c970 tx=0x7eff2000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff17fff640 1 -- 172.21.15.12:0/1794795822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20007bb0 con 0x7eff30100a80 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff17fff640 1 -- 172.21.15.12:0/1794795822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff20007d50 con 0x7eff30100a80 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff354db640 1 -- 172.21.15.12:0/1794795822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3019f8a0 con 0x7eff30100a80 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff17fff640 1 -- 172.21.15.12:0/1794795822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2000f450 con 0x7eff30100a80 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.437+0000 7eff354db640 1 -- 172.21.15.12:0/1794795822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff301a7180 con 0x7eff30100a80 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff17fff640 1 -- 172.21.15.12:0/1794795822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7eff20005020 con 0x7eff30100a80 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff378b4740 1 Processor -- start 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff378b4740 1 -- start start 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff17fff640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff180a33b0 0x7eff180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff378b4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 0x55c509371de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff378b4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c50937c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff378b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50937cbe0 0x55c50937efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff2f7fe640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff180a33b0 0x7eff180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff378b4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c5092d6200 con 0x55c509372320 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff378b4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c50927cdc0 con 0x55c509371a00 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff378b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c5092d21c0 con 0x55c50937cbe0 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.440+0000 7eff17fff640 1 -- 172.21.15.12:0/1794795822 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7eff200cfbe0 con 0x7eff30100a80 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c50937c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c50937c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42750/0 (socket says 172.21.15.12:42750) 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2e7fc640 1 -- 172.21.15.12:0/2225701093 learned_addr learned my addr 172.21.15.12:0/2225701093 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2effd640 1 --2- 172.21.15.12:0/2225701093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 0x55c509371de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2f7fe640 1 --2- 172.21.15.12:0/2225701093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50937cbe0 0x55c50937efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2e7fc640 1 -- 172.21.15.12:0/2225701093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50937cbe0 msgr2=0x55c50937efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/2225701093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50937cbe0 0x55c50937efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2e7fc640 1 -- 172.21.15.12:0/2225701093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 msgr2=0x55c509371de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/2225701093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 0x55c509371de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2e7fc640 1 -- 172.21.15.12:0/2225701093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c509047620 con 0x55c509372320 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2effd640 1 --2- 172.21.15.12:0/2225701093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 0x55c509371de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2f7fe640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff180a33b0 0x7eff180a5870 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7eff28006010 tx=0x7eff28031770 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/2225701093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c50937c6a0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7eff2400bcb0 tx=0x7eff2400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22ba985b8620b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff157fa640 1 -- 172.21.15.12:0/2225701093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24011440 con 0x55c509372320 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff157fa640 1 -- 172.21.15.12:0/2225701093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff24011ac0 con 0x55c509372320 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.441+0000 7eff157fa640 1 -- 172.21.15.12:0/2225701093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2401bb10 con 0x55c509372320 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.442+0000 7eff378b4740 1 -- 172.21.15.12:0/2225701093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 msgr2=0x55c50937c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.442+0000 7eff378b4740 1 --2- 172.21.15.12:0/2225701093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c50937c6a0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7eff2400bcb0 tx=0x7eff2400f730 comp rx=0 tx=0).stop 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.442+0000 7eff378b4740 1 -- 172.21.15.12:0/2225701093 shutdown_connections 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.442+0000 7eff378b4740 1 --2- 172.21.15.12:0/2225701093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50937cbe0 0x55c50937efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.442+0000 7eff378b4740 1 --2- 172.21.15.12:0/2225701093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c50937c6a0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.442+0000 7eff378b4740 1 --2- 172.21.15.12:0/2225701093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 0x55c509371de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.442+0000 7eff378b4740 1 -- 172.21.15.12:0/2225701093 >> 172.21.15.12:0/2225701093 conn(0x55c50936df90 msgr2=0x55c50936e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.442+0000 7eff378b4740 1 -- 172.21.15.12:0/2225701093 shutdown_connections 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.442+0000 7eff378b4740 1 -- 172.21.15.12:0/2225701093 wait complete. 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff378b4740 1 -- start start 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff378b4740 1 Processor -- start 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff378b4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 0x55c50937c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff378b4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c509379720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff378b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50937cbe0 0x55c509379c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff378b4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c50937f7b0 con 0x55c509372320 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff378b4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55c509270c50 con 0x55c509371a00 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff378b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c50937f930 con 0x55c50937cbe0 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff378b4740 10 client.0 _ll_register_callbacks cb 0x55c509282ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c509379720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c509379720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42762/0 (socket says 172.21.15.12:42762) 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2e7fc640 1 -- 172.21.15.12:0/2618398149 learned_addr learned my addr 172.21.15.12:0/2618398149 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2effd640 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 0x55c50937c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2f7fe640 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50937cbe0 0x55c509379c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2e7fc640 1 -- 172.21.15.12:0/2618398149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50937cbe0 msgr2=0x55c509379c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50937cbe0 0x55c509379c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2e7fc640 1 -- 172.21.15.12:0/2618398149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 msgr2=0x55c50937c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 0x55c50937c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2e7fc640 1 -- 172.21.15.12:0/2618398149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c50937a440 con 0x55c509372320 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.443+0000 7eff2effd640 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 0x55c50937c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c509379720 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7eff2400bfd0 tx=0x7eff2400ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff447c46d5681980 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff12ff5640 1 -- 172.21.15.12:0/2618398149 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2402a060 con 0x55c509372320 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff12ff5640 1 -- 172.21.15.12:0/2618398149 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7eff24004250 con 0x55c509372320 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff378b4740 1 -- 172.21.15.12:0/2618398149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff24011ac0 con 0x55c509372320 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff12ff5640 1 -- 172.21.15.12:0/2618398149 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7eff24031050 con 0x55c509372320 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff378b4740 10 client.19947 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff378b4740 1 -- 172.21.15.12:0/2618398149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55c50938b280 con 0x55c509372320 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff12ff5640 1 -- 172.21.15.12:0/2618398149 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff24011ac0 con 0x55c509372320 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff12ff5640 1 -- 172.21.15.12:0/2618398149 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7eff2401ba80 con 0x55c509372320 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff378b4740 10 client.19947 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff378b4740 10 client.19947 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff378b4740 20 client.19947 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff378b4740 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c50938c690 0x55c50938ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff378b4740 4 client.19947 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.444+0000 7eff378b4740 1 -- 172.21.15.12:0/2618398149 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5092e3770 con 0x55c50938c690 2024-09-19T06:56:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.445+0000 7eff2effd640 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c50938c690 0x55c50938ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.445+0000 7eff2effd640 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c50938c690 0x55c50938ea80 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c2b1b32336112a5 server_cookie=c6074334f580e7f0 in_seq=0 out_seq=0 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.445+0000 7eff12ff5640 10 client.19947 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff12ff5640 1 -- 172.21.15.12:0/2618398149 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5092e3770 con 0x55c50938c690 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff12ff5640 10 client.19947 handle_command_reply: tid=0 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 client.19947 shutdown 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 -- 172.21.15.12:0/2618398149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 msgr2=0x55c509379720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c509379720 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7eff2400bfd0 tx=0x7eff2400ffd0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 -- 172.21.15.12:0/2618398149 shutdown_connections 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c50938c690 0x55c50938ea80 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50937cbe0 0x55c509379c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509372320 0x55c509379720 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 --2- 172.21.15.12:0/2618398149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509371a00 0x55c50937c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff12ff5640 0 client.19947 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 -- 172.21.15.12:0/2618398149 >> 172.21.15.12:0/2618398149 conn(0x55c50936df90 msgr2=0x55c50936d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 -- 172.21.15.12:0/2618398149 shutdown_connections 2024-09-19T06:56:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 1 -- 172.21.15.12:0/2618398149 wait complete. 2024-09-19T06:56:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.446+0000 7eff378b4740 20 client.19947 trim_cache size 0 max 16384 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff378b4740 1 Processor -- start 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff378b4740 1 -- start start 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff378b4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c50936df90 0x55c50936d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff378b4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509377ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff378b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c509372320 0x55c509388a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff378b4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff301afe30 con 0x55c509371a00 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff378b4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff301b1a30 con 0x55c50936df90 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff378b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7eff301b0500 con 0x55c509372320 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c50936df90 0x55c50936d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509377ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c50936df90 0x55c50936d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.12:56424/0 (socket says 172.21.15.12:56424) 2024-09-19T06:56:23.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509377ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42766/0 (socket says 172.21.15.12:42766) 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2effd640 1 -- 172.21.15.12:0/2783909493 learned_addr learned my addr 172.21.15.12:0/2783909493 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2f7fe640 1 --2- 172.21.15.12:0/2783909493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c509372320 0x55c509388a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2effd640 1 -- 172.21.15.12:0/2783909493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c509372320 msgr2=0x55c509388a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2effd640 1 --2- 172.21.15.12:0/2783909493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c509372320 0x55c509388a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2effd640 1 -- 172.21.15.12:0/2783909493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 msgr2=0x55c509377ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2effd640 1 --2- 172.21.15.12:0/2783909493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509377ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2effd640 1 -- 172.21.15.12:0/2783909493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c50936ddc0 con 0x55c50936df90 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.464+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/2783909493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509377ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.465+0000 7eff2effd640 1 --2- 172.21.15.12:0/2783909493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c50936df90 0x55c50936d020 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7eff200987f0 tx=0x7eff20004a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cff1a1ccc1c3c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.465+0000 7eff14ff9640 1 -- 172.21.15.12:0/2783909493 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2001d040 con 0x55c50936df90 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.465+0000 7eff14ff9640 1 -- 172.21.15.12:0/2783909493 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff200a4a90 con 0x55c50936df90 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.465+0000 7eff14ff9640 1 -- 172.21.15.12:0/2783909493 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20005310 con 0x55c50936df90 2024-09-19T06:56:23.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 -- 172.21.15.12:0/2783909493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c50936df90 msgr2=0x55c50936d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 --2- 172.21.15.12:0/2783909493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c50936df90 0x55c50936d020 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7eff200987f0 tx=0x7eff20004a20 comp rx=0 tx=0).stop 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 -- 172.21.15.12:0/2783909493 shutdown_connections 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 --2- 172.21.15.12:0/2783909493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c509372320 0x55c509388a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 --2- 172.21.15.12:0/2783909493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509377ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 --2- 172.21.15.12:0/2783909493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c50936df90 0x55c50936d020 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 -- 172.21.15.12:0/2783909493 >> 172.21.15.12:0/2783909493 conn(0x55c509379dc0 msgr2=0x55c50937b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 -- 172.21.15.12:0/2783909493 shutdown_connections 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 -- 172.21.15.12:0/2783909493 wait complete. 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 -- start start 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 Processor -- start 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50936df90 0x55c509385310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509382700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509372320 0x55c509382c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff301b12a0 con 0x55c509371a00 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff301b0bd0 con 0x55c509372320 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7eff301ade30 con 0x55c50936df90 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.466+0000 7eff378b4740 10 client.0 _ll_register_callbacks cb 0x7eff2400bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509382700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2e7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509382700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42776/0 (socket says 172.21.15.12:42776) 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2e7fc640 1 -- 172.21.15.12:0/4051109073 learned_addr learned my addr 172.21.15.12:0/4051109073 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2f7fe640 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509372320 0x55c509382c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2effd640 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50936df90 0x55c509385310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2e7fc640 1 -- 172.21.15.12:0/4051109073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50936df90 msgr2=0x55c509385310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50936df90 0x55c509385310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2e7fc640 1 -- 172.21.15.12:0/4051109073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509372320 msgr2=0x55c509382c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509372320 0x55c509382c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2e7fc640 1 -- 172.21.15.12:0/4051109073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c509383440 con 0x55c509371a00 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff2e7fc640 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509382700 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x55c50937ad60 tx=0x7eff24005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131a2e856b601856 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff12ff5640 1 -- 172.21.15.12:0/4051109073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff240054d0 con 0x55c509371a00 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff12ff5640 1 -- 172.21.15.12:0/4051109073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7eff24021050 con 0x55c509371a00 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff378b4740 1 -- 172.21.15.12:0/4051109073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff200a4a90 con 0x55c509371a00 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff12ff5640 1 -- 172.21.15.12:0/4051109073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7eff24041050 con 0x55c509371a00 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.467+0000 7eff378b4740 10 client.19953 fetch_fsmap learned FSMap version 55 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.468+0000 7eff378b4740 1 -- 172.21.15.12:0/4051109073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55c5093f70d0 con 0x55c509371a00 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.468+0000 7eff12ff5640 1 -- 172.21.15.12:0/4051109073 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff200a4a90 con 0x55c509371a00 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.468+0000 7eff12ff5640 1 -- 172.21.15.12:0/4051109073 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 55) ==== 8378+0+0 (secure 0 0 0) 0x7eff2401b8a0 con 0x55c509371a00 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.468+0000 7eff378b4740 10 client.19953 fetch_fsmap finished waiting for FSMap version 55 2024-09-19T06:56:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.468+0000 7eff378b4740 10 client.19953 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.468+0000 7eff378b4740 20 client.19953 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.468+0000 7eff378b4740 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c50937cbe0 0x55c5093f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.468+0000 7eff378b4740 4 client.19953 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.468+0000 7eff378b4740 1 -- 172.21.15.12:0/4051109073 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55c5092ddc80 con 0x55c50937cbe0 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.468+0000 7eff2effd640 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c50937cbe0 0x55c5093f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff2effd640 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c50937cbe0 0x55c5093f98c0 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b912795ef3757d7d server_cookie=b0595fd5b5e2b64b in_seq=0 out_seq=0 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff12ff5640 10 client.19953 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff12ff5640 1 -- 172.21.15.12:0/4051109073 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55c5092ddc80 con 0x55c50937cbe0 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff12ff5640 10 client.19953 handle_command_reply: tid=0 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 client.19953 shutdown 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 -- 172.21.15.12:0/4051109073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 msgr2=0x55c509382700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509382700 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x55c50937ad60 tx=0x7eff24005c00 comp rx=0 tx=0).stop 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 -- 172.21.15.12:0/4051109073 shutdown_connections 2024-09-19T06:56:23.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x55c50937cbe0 0x55c5093f98c0 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55c509372320 0x55c509382c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c509371a00 0x55c509382700 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 --2- 172.21.15.12:0/4051109073 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c50936df90 0x55c509385310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 -- 172.21.15.12:0/4051109073 >> 172.21.15.12:0/4051109073 conn(0x55c509379dc0 msgr2=0x55c50937b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:23.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff12ff5640 0 client.19953 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:23.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 -- 172.21.15.12:0/4051109073 shutdown_connections 2024-09-19T06:56:23.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 1 -- 172.21.15.12:0/4051109073 wait complete. 2024-09-19T06:56:23.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.469+0000 7eff378b4740 20 client.19953 trim_cache size 0 max 16384 2024-09-19T06:56:23.480 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:56:23.480 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 55, 2024-09-19T06:56:23.481 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 24509, 2024-09-19T06:56:23.481 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 56, 2024-09-19T06:56:23.481 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": {} 2024-09-19T06:56:23.481 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:56:23.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 -- 172.21.15.12:0/1794795822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff180a33b0 msgr2=0x7eff180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff180a33b0 0x7eff180a5870 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7eff28006010 tx=0x7eff28031770 comp rx=0 tx=0).stop 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 -- 172.21.15.12:0/1794795822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff30100a80 msgr2=0x7eff3019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff30100a80 0x7eff3019a600 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7eff2000c970 tx=0x7eff2000ce30 comp rx=0 tx=0).stop 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 -- 172.21.15.12:0/1794795822 shutdown_connections 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7eff180a33b0 0x7eff180a5870 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7eff30106a80 0x7eff3019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff30101420 0x7eff3019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 --2- 172.21.15.12:0/1794795822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff30100a80 0x7eff3019a600 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 -- 172.21.15.12:0/1794795822 >> 172.21.15.12:0/1794795822 conn(0x7eff300fc7a0 msgr2=0x7eff3006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 -- 172.21.15.12:0/1794795822 shutdown_connections 2024-09-19T06:56:23.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:23.470+0000 7eff354db640 1 -- 172.21.15.12:0/1794795822 wait complete. 2024-09-19T06:56:24.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:23 smithi012 ceph-mon[30937]: pgmap v510: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 11 op/s 2024-09-19T06:56:24.192 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T06:56:24.192 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T06:56:24.206 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:56:24.214 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T06:56:24.224 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T06:56:24.224 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:56:24.224 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:56:24.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T06:56:24.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:23 smithi016 ceph-mon[34911]: pgmap v510: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 11 op/s 2024-09-19T06:56:24.284 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T06:56:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:23 smithi173 ceph-mon[35349]: pgmap v510: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 11 op/s 2024-09-19T06:56:24.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T06:56:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 -- 172.21.15.12:0/2382381645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301009d0 msgr2=0x7fb330100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 --2- 172.21.15.12:0/2382381645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301009d0 0x7fb330100e30 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fb324009930 tx=0x7fb32402a420 comp rx=0 tx=0).stop 2024-09-19T06:56:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 -- 172.21.15.12:0/2382381645 shutdown_connections 2024-09-19T06:56:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 --2- 172.21.15.12:0/2382381645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb330101370 0x7fb33010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 --2- 172.21.15.12:0/2382381645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301009d0 0x7fb330100e30 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 --2- 172.21.15.12:0/2382381645 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3301069e0 0x7fb330106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 -- 172.21.15.12:0/2382381645 >> 172.21.15.12:0/2382381645 conn(0x7fb3300fc6f0 msgr2=0x7fb3300feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 -- 172.21.15.12:0/2382381645 shutdown_connections 2024-09-19T06:56:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 -- 172.21.15.12:0/2382381645 wait complete. 2024-09-19T06:56:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 Processor -- start 2024-09-19T06:56:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.496+0000 7fb3359b7640 1 -- start start 2024-09-19T06:56:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb3359b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301009d0 0x7fb3301982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb3359b7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb330101370 0x7fb330198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb3359b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3301069e0 0x7fb33019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb3359b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb330110e20 con 0x7fb3301009d0 2024-09-19T06:56:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb3359b7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb330110ca0 con 0x7fb3301069e0 2024-09-19T06:56:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb3359b7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb330110fa0 con 0x7fb330101370 2024-09-19T06:56:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301009d0 0x7fb3301982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301009d0 0x7fb3301982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42790/0 (socket says 172.21.15.12:42790) 2024-09-19T06:56:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32effd640 1 -- 172.21.15.12:0/2421671006 learned_addr learned my addr 172.21.15.12:0/2421671006 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32e7fc640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb330101370 0x7fb330198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32f7fe640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3301069e0 0x7fb33019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32effd640 1 -- 172.21.15.12:0/2421671006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb330101370 msgr2=0x7fb330198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32effd640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb330101370 0x7fb330198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32effd640 1 -- 172.21.15.12:0/2421671006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3301069e0 msgr2=0x7fb33019cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32effd640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3301069e0 0x7fb33019cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32effd640 1 -- 172.21.15.12:0/2421671006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33019d2d0 con 0x7fb3301009d0 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb32effd640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301009d0 0x7fb3301982e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fb32000cce0 tx=0x7fb32000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb3349b5640 1 -- 172.21.15.12:0/2421671006 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32000f650 con 0x7fb3301009d0 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb3349b5640 1 -- 172.21.15.12:0/2421671006 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb32000fcd0 con 0x7fb3301009d0 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb3349b5640 1 -- 172.21.15.12:0/2421671006 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320018c70 con 0x7fb3301009d0 2024-09-19T06:56:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.497+0000 7fb3359b7640 1 -- 172.21.15.12:0/2421671006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33019d5c0 con 0x7fb3301009d0 2024-09-19T06:56:24.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.498+0000 7fb3359b7640 1 -- 172.21.15.12:0/2421671006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3301a4e50 con 0x7fb3301009d0 2024-09-19T06:56:24.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.498+0000 7fb3359b7640 1 -- 172.21.15.12:0/2421671006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb330100e30 con 0x7fb3301009d0 2024-09-19T06:56:24.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.500+0000 7fb3349b5640 1 -- 172.21.15.12:0/2421671006 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb32000f7f0 con 0x7fb3301009d0 2024-09-19T06:56:24.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.500+0000 7fb3349b5640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb3180a3460 0x7fb3180a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.501+0000 7fb32e7fc640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb3180a3460 0x7fb3180a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.501+0000 7fb3349b5640 1 -- 172.21.15.12:0/2421671006 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7fb3200d02d0 con 0x7fb3301009d0 2024-09-19T06:56:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.501+0000 7fb32e7fc640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb3180a3460 0x7fb3180a5920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb324000c00 tx=0x7fb324005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.505+0000 7fb3349b5640 1 -- 172.21.15.12:0/2421671006 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb320014030 con 0x7fb3301009d0 2024-09-19T06:56:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.703+0000 7fb3359b7640 1 -- 172.21.15.12:0/2421671006 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fb33006ab50 con 0x7fb3180a3460 2024-09-19T06:56:24.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.712+0000 7fb3349b5640 1 -- 172.21.15.12:0/2421671006 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fb33006ab50 con 0x7fb3180a3460 2024-09-19T06:56:24.714 INFO:teuthology.orchestra.run.smithi012.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T06:40:16", "first": "2024-09-19T06:41:00", "last": "2024-09-19T06:56:00", "last_pruned": "2024-09-19T06:56:00", "created_count": 16, "pruned_count": 10, "active": true} 2024-09-19T06:56:24.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 -- 172.21.15.12:0/2421671006 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb3180a3460 msgr2=0x7fb3180a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:24.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb3180a3460 0x7fb3180a5920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb324000c00 tx=0x7fb324005a20 comp rx=0 tx=0).stop 2024-09-19T06:56:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 -- 172.21.15.12:0/2421671006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301009d0 msgr2=0x7fb3301982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301009d0 0x7fb3301982e0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fb32000cce0 tx=0x7fb32000a620 comp rx=0 tx=0).stop 2024-09-19T06:56:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 -- 172.21.15.12:0/2421671006 shutdown_connections 2024-09-19T06:56:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3301069e0 0x7fb33019cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb3180a3460 0x7fb3180a5920 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb330101370 0x7fb330198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 --2- 172.21.15.12:0/2421671006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3301009d0 0x7fb3301982e0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 -- 172.21.15.12:0/2421671006 >> 172.21.15.12:0/2421671006 conn(0x7fb3300fc6f0 msgr2=0x7fb33006a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 -- 172.21.15.12:0/2421671006 shutdown_connections 2024-09-19T06:56:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.714+0000 7fb3359b7640 1 -- 172.21.15.12:0/2421671006 wait complete. 2024-09-19T06:56:24.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T06:56:24.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.831+0000 7f22debbd640 1 -- 172.21.15.12:0/1707451338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22d8101370 msgr2=0x7f22d810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:24.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.831+0000 7f22debbd640 1 --2- 172.21.15.12:0/1707451338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22d8101370 0x7f22d810d8a0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009cd0 tx=0x7f22d002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.831+0000 7f22debbd640 1 -- 172.21.15.12:0/1707451338 shutdown_connections 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.831+0000 7f22debbd640 1 --2- 172.21.15.12:0/1707451338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22d8101370 0x7f22d810d8a0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.831+0000 7f22debbd640 1 --2- 172.21.15.12:0/1707451338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22d81009d0 0x7f22d8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.831+0000 7f22debbd640 1 --2- 172.21.15.12:0/1707451338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d81069e0 0x7f22d8106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.831+0000 7f22debbd640 1 -- 172.21.15.12:0/1707451338 >> 172.21.15.12:0/1707451338 conn(0x7f22d80fc6f0 msgr2=0x7f22d80feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.831+0000 7f22debbd640 1 -- 172.21.15.12:0/1707451338 shutdown_connections 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.831+0000 7f22debbd640 1 -- 172.21.15.12:0/1707451338 wait complete. 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22debbd640 1 Processor -- start 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22debbd640 1 -- start start 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22debbd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22d81009d0 0x7f22d8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22debbd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22d8101370 0x7f22d8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22debbd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d81069e0 0x7f22d819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22debbd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f22d8110e20 con 0x7f22d81009d0 2024-09-19T06:56:24.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22debbd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f22d8110ca0 con 0x7f22d81069e0 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22debbd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f22d8110fa0 con 0x7f22d8101370 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22dc959640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22d81009d0 0x7f22d8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22dc959640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22d81009d0 0x7f22d8198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42810/0 (socket says 172.21.15.12:42810) 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22dc959640 1 -- 172.21.15.12:0/936298385 learned_addr learned my addr 172.21.15.12:0/936298385 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22d7fff640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22d8101370 0x7f22d8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22dd15a640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d81069e0 0x7f22d819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.832+0000 7f22dc959640 1 -- 172.21.15.12:0/936298385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22d8101370 msgr2=0x7f22d8198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22dc959640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22d8101370 0x7f22d8198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22dc959640 1 -- 172.21.15.12:0/936298385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d81069e0 msgr2=0x7f22d819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22dc959640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d81069e0 0x7f22d819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22dc959640 1 -- 172.21.15.12:0/936298385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d819d330 con 0x7f22d81009d0 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22dd15a640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d81069e0 0x7f22d819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:24.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22d7fff640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22d8101370 0x7f22d8198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:24.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22dc959640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22d81009d0 0x7f22d8198340 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00d950 tx=0x7f22cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:24.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22d5ffb640 1 -- 172.21.15.12:0/936298385 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc017030 con 0x7f22d81009d0 2024-09-19T06:56:24.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22d5ffb640 1 -- 172.21.15.12:0/936298385 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22cc004020 con 0x7f22d81009d0 2024-09-19T06:56:24.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22d5ffb640 1 -- 172.21.15.12:0/936298385 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0047a0 con 0x7f22d81009d0 2024-09-19T06:56:24.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22debbd640 1 -- 172.21.15.12:0/936298385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d819d620 con 0x7f22d81009d0 2024-09-19T06:56:24.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.833+0000 7f22debbd640 1 -- 172.21.15.12:0/936298385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d81a4eb0 con 0x7f22d81009d0 2024-09-19T06:56:24.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.834+0000 7f22debbd640 1 -- 172.21.15.12:0/936298385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d8102110 con 0x7f22d81009d0 2024-09-19T06:56:24.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.835+0000 7f22d5ffb640 1 -- 172.21.15.12:0/936298385 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f22cc0041d0 con 0x7f22d81009d0 2024-09-19T06:56:24.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.836+0000 7f22d5ffb640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f22c80a3460 0x7f22c80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:24.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.836+0000 7f22d5ffb640 1 -- 172.21.15.12:0/936298385 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f22cc0cf830 con 0x7f22d81009d0 2024-09-19T06:56:24.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.836+0000 7f22d7fff640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f22c80a3460 0x7f22c80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:24.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.837+0000 7f22d7fff640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f22c80a3460 0x7f22c80a5920 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f22c40058c0 tx=0x7f22c4005850 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:24.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:24.840+0000 7f22d5ffb640 1 -- 172.21.15.12:0/936298385 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22cc09c110 con 0x7f22d81009d0 2024-09-19T06:56:25.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.039+0000 7f22debbd640 1 -- 172.21.15.12:0/936298385 --> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f22d8062630 con 0x7f22c80a3460 2024-09-19T06:56:25.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.046+0000 7f22d5ffb640 1 -- 172.21.15.12:0/936298385 <== mgr.15243 v2:172.21.15.12:6800/743507810 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f22d8062630 con 0x7f22c80a3460 2024-09-19T06:56:25.048 INFO:teuthology.orchestra.run.smithi012.stdout:/ 1m 6m3h 2024-09-19T06:56:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 -- 172.21.15.12:0/936298385 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f22c80a3460 msgr2=0x7f22c80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f22c80a3460 0x7f22c80a5920 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f22c40058c0 tx=0x7f22c4005850 comp rx=0 tx=0).stop 2024-09-19T06:56:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 -- 172.21.15.12:0/936298385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22d81009d0 msgr2=0x7f22d8198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22d81009d0 0x7f22d8198340 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00d950 tx=0x7f22cc00de10 comp rx=0 tx=0).stop 2024-09-19T06:56:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 -- 172.21.15.12:0/936298385 shutdown_connections 2024-09-19T06:56:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d81069e0 0x7f22d819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f22c80a3460 0x7f22c80a5920 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22d8101370 0x7f22d8198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 --2- 172.21.15.12:0/936298385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22d81009d0 0x7f22d8198340 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 -- 172.21.15.12:0/936298385 >> 172.21.15.12:0/936298385 conn(0x7f22d80fc6f0 msgr2=0x7f22d806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 -- 172.21.15.12:0/936298385 shutdown_connections 2024-09-19T06:56:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:25.049+0000 7f22debbd640 1 -- 172.21.15.12:0/936298385 wait complete. 2024-09-19T06:56:25.062 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T06:56:25.072 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T06:56:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:25 smithi016 ceph-mon[34911]: pgmap v511: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 11 op/s 2024-09-19T06:56:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:25 smithi016 ceph-mon[34911]: from='client.19959 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:25 smithi016 ceph-mon[34911]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:56:26.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:25 smithi016 ceph-mon[34911]: from='client.19965 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:26.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:25 smithi012 ceph-mon[30937]: pgmap v511: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 11 op/s 2024-09-19T06:56:26.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:25 smithi012 ceph-mon[30937]: from='client.19959 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:26.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:25 smithi012 ceph-mon[30937]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:56:26.279 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:25 smithi012 ceph-mon[30937]: from='client.19965 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:25 smithi173 ceph-mon[35349]: pgmap v511: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 11 op/s 2024-09-19T06:56:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:25 smithi173 ceph-mon[35349]: from='client.19959 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:25 smithi173 ceph-mon[35349]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:56:26.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:25 smithi173 ceph-mon[35349]: from='client.19965 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:28.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:27 smithi016 ceph-mon[34911]: pgmap v512: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 124 KiB/s wr, 36 op/s 2024-09-19T06:56:28.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:27 smithi173 ceph-mon[35349]: pgmap v512: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 124 KiB/s wr, 36 op/s 2024-09-19T06:56:28.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:27 smithi012 ceph-mon[30937]: pgmap v512: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 124 KiB/s wr, 36 op/s 2024-09-19T06:56:30.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:30 smithi016 ceph-mon[34911]: pgmap v513: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 118 KiB/s wr, 34 op/s 2024-09-19T06:56:30.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:30 smithi173 ceph-mon[35349]: pgmap v513: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 118 KiB/s wr, 34 op/s 2024-09-19T06:56:30.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:30 smithi012 ceph-mon[30937]: pgmap v513: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 118 KiB/s wr, 34 op/s 2024-09-19T06:56:31.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:31 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:56:31.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:31 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:56:31.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:31 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:56:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:32 smithi016 ceph-mon[34911]: pgmap v514: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 130 KiB/s wr, 42 op/s 2024-09-19T06:56:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:32 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:56:32.258 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:32 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:56:32.259 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:32 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:56:32.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:32 smithi173 ceph-mon[35349]: pgmap v514: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 130 KiB/s wr, 42 op/s 2024-09-19T06:56:32.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:32 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:56:32.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:32 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:56:32.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:32 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:56:32.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:32 smithi012 ceph-mon[30937]: pgmap v514: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 130 KiB/s wr, 42 op/s 2024-09-19T06:56:32.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:32 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:56:32.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:32 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:56:32.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:32 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' 2024-09-19T06:56:32.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:56:32.771 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:33.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.265+0000 7f56d56f9640 1 -- 172.21.15.12:0/951721222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d010e500 msgr2=0x7f56d0110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:33.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.265+0000 7f56d56f9640 1 --2- 172.21.15.12:0/951721222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d010e500 0x7f56d0110910 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009900 tx=0x7f56c802a410 comp rx=0 tx=0).stop 2024-09-19T06:56:33.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.265+0000 7f56d56f9640 1 -- 172.21.15.12:0/951721222 shutdown_connections 2024-09-19T06:56:33.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.265+0000 7f56d56f9640 1 --2- 172.21.15.12:0/951721222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d010e500 0x7f56d0110910 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.265+0000 7f56d56f9640 1 --2- 172.21.15.12:0/951721222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56d0101440 0x7f56d010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.265+0000 7f56d56f9640 1 --2- 172.21.15.12:0/951721222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d0100b20 0x7f56d0100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.265+0000 7f56d56f9640 1 -- 172.21.15.12:0/951721222 >> 172.21.15.12:0/951721222 conn(0x7f56d00fc7d0 msgr2=0x7f56d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:33.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.265+0000 7f56d56f9640 1 -- 172.21.15.12:0/951721222 shutdown_connections 2024-09-19T06:56:33.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.265+0000 7f56d56f9640 1 -- 172.21.15.12:0/951721222 wait complete. 2024-09-19T06:56:33.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.265+0000 7f56d56f9640 1 Processor -- start 2024-09-19T06:56:33.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56d56f9640 1 -- start start 2024-09-19T06:56:33.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56d56f9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d0100b20 0x7f56d019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56d56f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d0101440 0x7f56d019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56d56f9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56d010e500 0x7f56d019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56d56f9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f56d0114250 con 0x7f56d0101440 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56d56f9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f56d01140d0 con 0x7f56d0100b20 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56d56f9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f56d01143d0 con 0x7f56d010e500 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56ce7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d0101440 0x7f56d019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56ce7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d0101440 0x7f56d019ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33814/0 (socket says 172.21.15.12:33814) 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56ce7fc640 1 -- 172.21.15.12:0/1645598590 learned_addr learned my addr 172.21.15.12:0/1645598590 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56d010e500 0x7f56d019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56ceffd640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d0100b20 0x7f56d019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56ce7fc640 1 -- 172.21.15.12:0/1645598590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56d010e500 msgr2=0x7f56d019efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56d010e500 0x7f56d019efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56ce7fc640 1 -- 172.21.15.12:0/1645598590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d0100b20 msgr2=0x7f56d019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d0100b20 0x7f56d019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.266+0000 7f56ce7fc640 1 -- 172.21.15.12:0/1645598590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d019f6c0 con 0x7f56d0101440 2024-09-19T06:56:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.267+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d0101440 0x7f56d019ac50 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f56c400d950 tx=0x7f56c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.267+0000 7f56b7fff640 1 -- 172.21.15.12:0/1645598590 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c4017070 con 0x7f56d0101440 2024-09-19T06:56:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.267+0000 7f56b7fff640 1 -- 172.21.15.12:0/1645598590 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c4009c30 con 0x7f56d0101440 2024-09-19T06:56:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.267+0000 7f56d56f9640 1 -- 172.21.15.12:0/1645598590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d019f9b0 con 0x7f56d0101440 2024-09-19T06:56:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.267+0000 7f56b7fff640 1 -- 172.21.15.12:0/1645598590 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c400f600 con 0x7f56d0101440 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.267+0000 7f56d56f9640 1 -- 172.21.15.12:0/1645598590 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d01a7290 con 0x7f56d0101440 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.269+0000 7f56b7fff640 1 -- 172.21.15.12:0/1645598590 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f56c401a070 con 0x7f56d0101440 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56d7ad2740 1 Processor -- start 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56d7ad2740 1 -- start start 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afc5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 0x562f1afd0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afd2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562f1af2b2e0 con 0x562f1afc54a0 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562f1aed2ce0 con 0x562f1afc5dc0 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562f1af272a0 con 0x562f1afd0680 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afc5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afc5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33824/0 (socket says 172.21.15.12:33824) 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56cf7fe640 1 -- 172.21.15.12:0/744572666 learned_addr learned my addr 172.21.15.12:0/744572666 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56b7fff640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56b80a33b0 0x7f56b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.270+0000 7f56ceffd640 1 --2- 172.21.15.12:0/744572666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 0x562f1afd0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56b80a33b0 0x7f56b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56b7fff640 1 -- 172.21.15.12:0/1645598590 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f56c40cf830 con 0x7f56d0101440 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/744572666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afd2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56cf7fe640 1 -- 172.21.15.12:0/744572666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 msgr2=0x562f1afd2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/744572666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afd2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56cf7fe640 1 -- 172.21.15.12:0/744572666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 msgr2=0x562f1afd0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/744572666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 0x562f1afd0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56cf7fe640 1 -- 172.21.15.12:0/744572666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f1aeb7440 con 0x562f1afc54a0 2024-09-19T06:56:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56ceffd640 1 --2- 172.21.15.12:0/744572666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 0x562f1afd0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/744572666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afc5880 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f56d0069760 tx=0x7f56c8031b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a8fa66d8fbd431 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56b57fa640 1 -- 172.21.15.12:0/744572666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8035040 con 0x562f1afc54a0 2024-09-19T06:56:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56b57fa640 1 -- 172.21.15.12:0/744572666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c804d070 con 0x562f1afc54a0 2024-09-19T06:56:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56b57fa640 1 -- 172.21.15.12:0/744572666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c803e7f0 con 0x562f1afc54a0 2024-09-19T06:56:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.271+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56b80a33b0 0x7f56b80a5870 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f56c804c000 tx=0x7f56c804a000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.272+0000 7f56d7ad2740 1 -- 172.21.15.12:0/744572666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 msgr2=0x562f1afc5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.272+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/744572666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afc5880 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f56d0069760 tx=0x7f56c8031b30 comp rx=0 tx=0).stop 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.272+0000 7f56d7ad2740 1 -- 172.21.15.12:0/744572666 shutdown_connections 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.272+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/744572666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afd2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.272+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/744572666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 0x562f1afd0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.272+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/744572666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afc5880 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.272+0000 7f56d7ad2740 1 -- 172.21.15.12:0/744572666 >> 172.21.15.12:0/744572666 conn(0x562f1afc1a30 msgr2=0x562f1afc1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.272+0000 7f56d7ad2740 1 -- 172.21.15.12:0/744572666 shutdown_connections 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.272+0000 7f56d7ad2740 1 -- 172.21.15.12:0/744572666 wait complete. 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.272+0000 7f56d7ad2740 1 -- start start 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56d7ad2740 1 Processor -- start 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc54a0 0x562f1afcffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afc5dc0 0x562f1afcd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afd0680 0x562f1afcd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562f1afd3250 con 0x562f1afd0680 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562f1aee6050 con 0x562f1afc54a0 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562f1afd33d0 con 0x562f1afc5dc0 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56d7ad2740 10 client.0 _ll_register_callbacks cb 0x562f1af26160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afd0680 0x562f1afcd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56cf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afd0680 0x562f1afcd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33836/0 (socket says 172.21.15.12:33836) 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56cf7fe640 1 -- 172.21.15.12:0/3558193423 learned_addr learned my addr 172.21.15.12:0/3558193423 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56ceffd640 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc54a0 0x562f1afcffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afc5dc0 0x562f1afcd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56cf7fe640 1 -- 172.21.15.12:0/3558193423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afc5dc0 msgr2=0x562f1afcd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afc5dc0 0x562f1afcd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56cf7fe640 1 -- 172.21.15.12:0/3558193423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc54a0 msgr2=0x562f1afcffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc54a0 0x562f1afcffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56cf7fe640 1 -- 172.21.15.12:0/3558193423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1ac9c3c0 con 0x562f1afd0680 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.273+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afc5dc0 0x562f1afcd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afd0680 0x562f1afcd790 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f56c8005e00 tx=0x7f56c8005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf50624cafb85bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56b2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56b2ff5640 1 -- 172.21.15.12:0/3558193423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c805f060 con 0x562f1afd0680 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56b2ff5640 1 -- 172.21.15.12:0/3558193423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f56c8004460 con 0x562f1afd0680 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56d7ad2740 1 -- 172.21.15.12:0/3558193423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c804d070 con 0x562f1afd0680 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56b2ff5640 1 -- 172.21.15.12:0/3558193423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f56c8066050 con 0x562f1afd0680 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56d7ad2740 10 client.19977 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56d7ad2740 1 -- 172.21.15.12:0/3558193423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x562f1afdebd0 con 0x562f1afd0680 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56b2ff5640 1 -- 172.21.15.12:0/3558193423 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c804d070 con 0x562f1afd0680 2024-09-19T06:56:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56b2ff5640 1 -- 172.21.15.12:0/3558193423 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7f56c80046c0 con 0x562f1afd0680 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56d7ad2740 10 client.19977 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56d7ad2740 10 client.19977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56d7ad2740 20 client.19977 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f1afdff20 0x562f1afe2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56d7ad2740 4 client.19977 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.274+0000 7f56d7ad2740 1 -- 172.21.15.12:0/3558193423 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f1af38850 con 0x562f1afdff20 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.275+0000 7f56ceffd640 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f1afdff20 0x562f1afe2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.275+0000 7f56ceffd640 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f1afdff20 0x562f1afe2310 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b13d334d8d07fee server_cookie=61e2f728f016d7db in_seq=0 out_seq=0 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.275+0000 7f56b2ff5640 10 client.19977 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56b2ff5640 1 -- 172.21.15.12:0/3558193423 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f1af38850 con 0x562f1afdff20 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56b2ff5640 10 client.19977 handle_command_reply: tid=0 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 client.19977 shutdown 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 -- 172.21.15.12:0/3558193423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afd0680 msgr2=0x562f1afcd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afd0680 0x562f1afcd790 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f56c8005e00 tx=0x7f56c8005e30 comp rx=0 tx=0).stop 2024-09-19T06:56:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 -- 172.21.15.12:0/3558193423 shutdown_connections 2024-09-19T06:56:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f1afdff20 0x562f1afe2310 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56b2ff5640 0 client.19977 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afd0680 0x562f1afcd790 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afc5dc0 0x562f1afcd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/3558193423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc54a0 0x562f1afcffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 -- 172.21.15.12:0/3558193423 >> 172.21.15.12:0/3558193423 conn(0x562f1afc1a30 msgr2=0x562f1afc0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 -- 172.21.15.12:0/3558193423 shutdown_connections 2024-09-19T06:56:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 1 -- 172.21.15.12:0/3558193423 wait complete. 2024-09-19T06:56:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.276+0000 7f56d7ad2740 20 client.19977 trim_cache size 0 max 16384 2024-09-19T06:56:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.293+0000 7f56d7ad2740 1 Processor -- start 2024-09-19T06:56:33.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.293+0000 7f56d7ad2740 1 -- start start 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afdc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 0x562f1afe7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afe7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f56d01afe30 con 0x562f1afc54a0 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f56d01b1a60 con 0x562f1afc5dc0 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f56d01b0500 con 0x562f1afd0680 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afdc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afdc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33852/0 (socket says 172.21.15.12:33852) 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ceffd640 1 -- 172.21.15.12:0/1708842649 learned_addr learned my addr 172.21.15.12:0/1708842649 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 0x562f1afe7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afe7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ceffd640 1 -- 172.21.15.12:0/1708842649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 msgr2=0x562f1afe7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ceffd640 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afe7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ceffd640 1 -- 172.21.15.12:0/1708842649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 msgr2=0x562f1afe7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ceffd640 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 0x562f1afe7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ceffd640 1 -- 172.21.15.12:0/1708842649 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f1afc5bf0 con 0x562f1afc54a0 2024-09-19T06:56:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 0x562f1afe7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afe7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56ceffd640 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afdc4b0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f56c0012720 tx=0x7f56c0012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4328cf334c0817 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56b4ff9640 1 -- 172.21.15.12:0/1708842649 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0004b20 con 0x562f1afc54a0 2024-09-19T06:56:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56b4ff9640 1 -- 172.21.15.12:0/1708842649 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c0003e50 con 0x562f1afc54a0 2024-09-19T06:56:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.294+0000 7f56b4ff9640 1 -- 172.21.15.12:0/1708842649 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0004280 con 0x562f1afc54a0 2024-09-19T06:56:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.295+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1708842649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 msgr2=0x562f1afdc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.295+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afdc4b0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f56c0012720 tx=0x7f56c0012be0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.295+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1708842649 shutdown_connections 2024-09-19T06:56:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.295+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afe7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.295+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc5dc0 0x562f1afe7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.295+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/1708842649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc54a0 0x562f1afdc4b0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.295+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1708842649 >> 172.21.15.12:0/1708842649 conn(0x562f1afc1a30 msgr2=0x562f1afcf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.295+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1708842649 shutdown_connections 2024-09-19T06:56:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.295+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1708842649 wait complete. 2024-09-19T06:56:33.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.295+0000 7f56d7ad2740 1 -- start start 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56d7ad2740 1 Processor -- start 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc54a0 0x562f1afd8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc5dc0 0x562f1afd5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56d7ad2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afd6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f56d01b12d0 con 0x562f1afc5dc0 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f56d01b0c00 con 0x562f1afc54a0 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56d7ad2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f56d01ade30 con 0x562f1afd0680 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56d7ad2740 10 client.0 _ll_register_callbacks cb 0x7f56c000a570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56ce7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc5dc0 0x562f1afd5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56ce7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc5dc0 0x562f1afd5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33864/0 (socket says 172.21.15.12:33864) 2024-09-19T06:56:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56ce7fc640 1 -- 172.21.15.12:0/1765673625 learned_addr learned my addr 172.21.15.12:0/1765673625 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56ceffd640 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc54a0 0x562f1afd8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afd6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56ce7fc640 1 -- 172.21.15.12:0/1765673625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 msgr2=0x562f1afd6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afd6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56ce7fc640 1 -- 172.21.15.12:0/1765673625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc54a0 msgr2=0x562f1afd8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc54a0 0x562f1afd8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56ce7fc640 1 -- 172.21.15.12:0/1765673625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1afd69c0 con 0x562f1afc5dc0 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.296+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afd6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56ce7fc640 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc5dc0 0x562f1afd5ec0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f56c4097e70 tx=0x7f56c409b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32701051ecf9595 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56b2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56b2ff5640 1 -- 172.21.15.12:0/1765673625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c4021040 con 0x562f1afc5dc0 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56b2ff5640 1 -- 172.21.15.12:0/1765673625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f56c40cd100 con 0x562f1afc5dc0 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1765673625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c0003e50 con 0x562f1afc5dc0 2024-09-19T06:56:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56b2ff5640 1 -- 172.21.15.12:0/1765673625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f56c40cd300 con 0x562f1afc5dc0 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56d7ad2740 10 client.19983 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1765673625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x562f1b04a620 con 0x562f1afc5dc0 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56b2ff5640 1 -- 172.21.15.12:0/1765673625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56c0003e50 con 0x562f1afc5dc0 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56b2ff5640 1 -- 172.21.15.12:0/1765673625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7f56c409ae60 con 0x562f1afc5dc0 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56d7ad2740 10 client.19983 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56d7ad2740 10 client.19983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56d7ad2740 20 client.19983 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f1afdff20 0x562f1b04ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56d7ad2740 4 client.19983 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.297+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1765673625 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562f1af32d60 con 0x562f1afdff20 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56ceffd640 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f1afdff20 0x562f1b04ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56ceffd640 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f1afdff20 0x562f1b04ced0 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b2e86b5ea697d8 server_cookie=d1281779799d5ca7 in_seq=0 out_seq=0 2024-09-19T06:56:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56b2ff5640 10 client.19983 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56b2ff5640 1 -- 172.21.15.12:0/1765673625 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562f1af32d60 con 0x562f1afdff20 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56b2ff5640 10 client.19983 handle_command_reply: tid=0 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56d7ad2740 1 client.19983 shutdown 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1765673625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc5dc0 msgr2=0x562f1afd5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc5dc0 0x562f1afd5ec0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f56c4097e70 tx=0x7f56c409b480 comp rx=0 tx=0).stop 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1765673625 shutdown_connections 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x562f1afdff20 0x562f1b04ced0 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f1afd0680 0x562f1afd6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562f1afc5dc0 0x562f1afd5ec0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56d7ad2740 1 --2- 172.21.15.12:0/1765673625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f1afc54a0 0x562f1afd8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1765673625 >> 172.21.15.12:0/1765673625 conn(0x562f1afc1a30 msgr2=0x562f1afc0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.298+0000 7f56b2ff5640 0 client.19983 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1765673625 shutdown_connections 2024-09-19T06:56:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d7ad2740 1 -- 172.21.15.12:0/1765673625 wait complete. 2024-09-19T06:56:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d7ad2740 20 client.19983 trim_cache size 0 max 16384 2024-09-19T06:56:33.306 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:56:33.306 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-19T06:56:33.306 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-19T06:56:33.306 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 -- 172.21.15.12:0/1645598590 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56b80a33b0 msgr2=0x7f56b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56b80a33b0 0x7f56b80a5870 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f56c804c000 tx=0x7f56c804a000 comp rx=0 tx=0).stop 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 -- 172.21.15.12:0/1645598590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d0101440 msgr2=0x7f56d019ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d0101440 0x7f56d019ac50 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f56c400d950 tx=0x7f56c400de10 comp rx=0 tx=0).stop 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 -- 172.21.15.12:0/1645598590 shutdown_connections 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56b80a33b0 0x7f56b80a5870 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56d010e500 0x7f56d019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d0101440 0x7f56d019ac50 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 --2- 172.21.15.12:0/1645598590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d0100b20 0x7f56d019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 -- 172.21.15.12:0/1645598590 >> 172.21.15.12:0/1645598590 conn(0x7f56d00fc7d0 msgr2=0x7f56d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.299+0000 7f56d56f9640 1 -- 172.21.15.12:0/1645598590 shutdown_connections 2024-09-19T06:56:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:33.300+0000 7f56d56f9640 1 -- 172.21.15.12:0/1645598590 wait complete. 2024-09-19T06:56:34.048 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:56:34.048 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:56:34.304 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:34.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:34 smithi173 ceph-mon[35349]: pgmap v515: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 129 KiB/s wr, 38 op/s 2024-09-19T06:56:34.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:34 smithi012 ceph-mon[30937]: pgmap v515: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 129 KiB/s wr, 38 op/s 2024-09-19T06:56:34.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:34 smithi016 ceph-mon[34911]: pgmap v515: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 129 KiB/s wr, 38 op/s 2024-09-19T06:56:34.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.780+0000 7f90600ba640 1 -- 172.21.15.12:0/599171082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9058100480 msgr2=0x7f9058100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.781+0000 7f90600ba640 1 --2- 172.21.15.12:0/599171082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9058100480 0x7f9058100860 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f9054009900 tx=0x7f905402a410 comp rx=0 tx=0).stop 2024-09-19T06:56:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.781+0000 7f90600ba640 1 -- 172.21.15.12:0/599171082 shutdown_connections 2024-09-19T06:56:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.781+0000 7f90600ba640 1 --2- 172.21.15.12:0/599171082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90581055b0 0x7f905810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.781+0000 7f90600ba640 1 --2- 172.21.15.12:0/599171082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9058100e30 0x7f9058104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.781+0000 7f90600ba640 1 --2- 172.21.15.12:0/599171082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9058100480 0x7f9058100860 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.781+0000 7f90600ba640 1 -- 172.21.15.12:0/599171082 >> 172.21.15.12:0/599171082 conn(0x7f9058077210 msgr2=0x7f90580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.781+0000 7f90600ba640 1 -- 172.21.15.12:0/599171082 shutdown_connections 2024-09-19T06:56:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.781+0000 7f90600ba640 1 -- 172.21.15.12:0/599171082 wait complete. 2024-09-19T06:56:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.781+0000 7f90600ba640 1 Processor -- start 2024-09-19T06:56:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.781+0000 7f90600ba640 1 -- start start 2024-09-19T06:56:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f90600ba640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9058100480 0x7f905810e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f90600ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9058100e30 0x7f905810ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f90600ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90581055b0 0x7f905810f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f90600ba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9058111f50 con 0x7f9058100e30 2024-09-19T06:56:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f90600ba640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9058111dd0 con 0x7f90581055b0 2024-09-19T06:56:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f90600ba640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f90581120d0 con 0x7f9058100480 2024-09-19T06:56:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905d655640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9058100e30 0x7f905810ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905d655640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9058100e30 0x7f905810ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33882/0 (socket says 172.21.15.12:33882) 2024-09-19T06:56:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905d655640 1 -- 172.21.15.12:0/681269220 learned_addr learned my addr 172.21.15.12:0/681269220 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:34.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905de56640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9058100480 0x7f905810e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905d655640 1 -- 172.21.15.12:0/681269220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9058100480 msgr2=0x7f905810e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905d655640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9058100480 0x7f905810e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905d655640 1 -- 172.21.15.12:0/681269220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90581055b0 msgr2=0x7f905810f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905e657640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90581055b0 0x7f905810f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905d655640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90581055b0 0x7f905810f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905d655640 1 -- 172.21.15.12:0/681269220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90581a6850 con 0x7f9058100e30 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f905d655640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9058100e30 0x7f905810ed90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f904800c920 tx=0x7f904800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f904effd640 1 -- 172.21.15.12:0/681269220 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048007c70 con 0x7f9058100e30 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f904effd640 1 -- 172.21.15.12:0/681269220 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9048007e10 con 0x7f9058100e30 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f90600ba640 1 -- 172.21.15.12:0/681269220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90581a6b40 con 0x7f9058100e30 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f904effd640 1 -- 172.21.15.12:0/681269220 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9048018890 con 0x7f9058100e30 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.782+0000 7f90600ba640 1 -- 172.21.15.12:0/681269220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90581a70d0 con 0x7f9058100e30 2024-09-19T06:56:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.783+0000 7f90600ba640 1 -- 172.21.15.12:0/681269220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9058100860 con 0x7f9058100e30 2024-09-19T06:56:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.784+0000 7f904effd640 1 -- 172.21.15.12:0/681269220 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9048018a70 con 0x7f9058100e30 2024-09-19T06:56:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.785+0000 7f904effd640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f90440a3430 0x7f90440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.786+0000 7f905de56640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f90440a3430 0x7f90440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.786+0000 7f904effd640 1 -- 172.21.15.12:0/681269220 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f90480cff20 con 0x7f9058100e30 2024-09-19T06:56:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.786+0000 7f905de56640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f90440a3430 0x7f90440a58f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9054005ab0 tx=0x7f9054005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:34.790+0000 7f904effd640 1 -- 172.21.15.12:0/681269220 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9048014030 con 0x7f9058100e30 2024-09-19T06:56:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.001+0000 7f90600ba640 1 -- 172.21.15.12:0/681269220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90581087c0 con 0x7f9058100e30 2024-09-19T06:56:35.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.001+0000 7f904effd640 1 -- 172.21.15.12:0/681269220 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11979 (secure 0 0 0) 0x7f904809c860 con 0x7f9058100e30 2024-09-19T06:56:35.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:35.003 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":56,"btime":"2024-09-19T06:56:24:987787+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:56:24.422127+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:56:35.003 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 56 2024-09-19T06:56:35.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 -- 172.21.15.12:0/681269220 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f90440a3430 msgr2=0x7f90440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:35.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f90440a3430 0x7f90440a58f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9054005ab0 tx=0x7f9054005a20 comp rx=0 tx=0).stop 2024-09-19T06:56:35.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 -- 172.21.15.12:0/681269220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9058100e30 msgr2=0x7f905810ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:35.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9058100e30 0x7f905810ed90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f904800c920 tx=0x7f904800cde0 comp rx=0 tx=0).stop 2024-09-19T06:56:35.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 -- 172.21.15.12:0/681269220 shutdown_connections 2024-09-19T06:56:35.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90581055b0 0x7f905810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:35.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9058100e30 0x7f905810ed90 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:35.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f90440a3430 0x7f90440a58f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:35.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 --2- 172.21.15.12:0/681269220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9058100480 0x7f905810e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:35.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 -- 172.21.15.12:0/681269220 >> 172.21.15.12:0/681269220 conn(0x7f9058077210 msgr2=0x7f9058103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:35.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 -- 172.21.15.12:0/681269220 shutdown_connections 2024-09-19T06:56:35.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:35.004+0000 7f90600ba640 1 -- 172.21.15.12:0/681269220 wait complete. 2024-09-19T06:56:35.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:35 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/681269220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:35.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:35 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/681269220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:35.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:35 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/681269220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:56:35.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:56:35.858 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:36.214 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:36 smithi012 ceph-mon[30937]: pgmap v516: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 129 KiB/s wr, 38 op/s 2024-09-19T06:56:36.361 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:36 smithi173 ceph-mon[35349]: pgmap v516: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 129 KiB/s wr, 38 op/s 2024-09-19T06:56:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 -- 172.21.15.12:0/2324885616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b04102790 msgr2=0x7f5b041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 --2- 172.21.15.12:0/2324885616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b04102790 0x7f5b041067e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009900 tx=0x7f5af802a410 comp rx=0 tx=0).stop 2024-09-19T06:56:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 -- 172.21.15.12:0/2324885616 shutdown_connections 2024-09-19T06:56:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 --2- 172.21.15.12:0/2324885616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b04106f10 0x7f5b0410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 --2- 172.21.15.12:0/2324885616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b04102790 0x7f5b041067e0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 --2- 172.21.15.12:0/2324885616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b04101de0 0x7f5b041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 -- 172.21.15.12:0/2324885616 >> 172.21.15.12:0/2324885616 conn(0x7f5b040fd8c0 msgr2=0x7f5b040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 -- 172.21.15.12:0/2324885616 shutdown_connections 2024-09-19T06:56:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 -- 172.21.15.12:0/2324885616 wait complete. 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 Processor -- start 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.297+0000 7f5b0a512640 1 -- start start 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b0a512640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b04101de0 0x7f5b040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b0a512640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b04102790 0x7f5b04074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b0a512640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b04106f10 0x7f5b04074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b0a512640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b04111f30 con 0x7f5b04102790 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b0a512640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5b04111db0 con 0x7f5b04101de0 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b0a512640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041120b0 con 0x7f5b04106f10 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b04102790 0x7f5b04074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b037fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b04102790 0x7f5b04074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33910/0 (socket says 172.21.15.12:33910) 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b037fe640 1 -- 172.21.15.12:0/1305534579 learned_addr learned my addr 172.21.15.12:0/1305534579 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b03fff640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b04101de0 0x7f5b040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b04106f10 0x7f5b04074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b037fe640 1 -- 172.21.15.12:0/1305534579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b04106f10 msgr2=0x7f5b04074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b037fe640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b04106f10 0x7f5b04074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b037fe640 1 -- 172.21.15.12:0/1305534579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b04101de0 msgr2=0x7f5b040744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b037fe640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b04101de0 0x7f5b040744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b037fe640 1 -- 172.21.15.12:0/1305534579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b041a6980 con 0x7f5b04102790 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.298+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b04106f10 0x7f5b04074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.299+0000 7f5b037fe640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b04102790 0x7f5b04074a30 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f5af8005ab0 tx=0x7f5af80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.299+0000 7f5b017fa640 1 -- 172.21.15.12:0/1305534579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af803f030 con 0x7f5b04102790 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.299+0000 7f5b017fa640 1 -- 172.21.15.12:0/1305534579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5af8003ce0 con 0x7f5b04102790 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.299+0000 7f5b0a512640 1 -- 172.21.15.12:0/1305534579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b041a6c10 con 0x7f5b04102790 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.299+0000 7f5b017fa640 1 -- 172.21.15.12:0/1305534579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8035070 con 0x7f5b04102790 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.299+0000 7f5b0a512640 1 -- 172.21.15.12:0/1305534579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b041a70f0 con 0x7f5b04102790 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.301+0000 7f5b017fa640 1 -- 172.21.15.12:0/1305534579 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5af8042030 con 0x7f5b04102790 2024-09-19T06:56:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b0c8eb740 1 Processor -- start 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b0c8eb740 1 -- start start 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f92a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f92aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f937760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e38f8902f0 con 0x55e38f92a5d0 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e38f837cf0 con 0x55e38f935370 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e38f88c2b0 con 0x55e38f92bb40 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b017fa640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5aec0a33b0 0x7f5aec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f92aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f92aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33926/0 (socket says 172.21.15.12:33926) 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b03fff640 1 -- 172.21.15.12:0/348824057 learned_addr learned my addr 172.21.15.12:0/348824057 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5aec0a33b0 0x7f5aec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b017fa640 1 -- 172.21.15.12:0/1305534579 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f5af80f06d0 con 0x7f5b04102790 2024-09-19T06:56:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b037fe640 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f937760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f92a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b03fff640 1 -- 172.21.15.12:0/348824057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 msgr2=0x55e38f92a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.302+0000 7f5b03fff640 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f92a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.303+0000 7f5b03fff640 1 -- 172.21.15.12:0/348824057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 msgr2=0x55e38f937760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.303+0000 7f5b03fff640 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f937760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.303+0000 7f5b03fff640 1 -- 172.21.15.12:0/348824057 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38f81c3a0 con 0x55e38f92a5d0 2024-09-19T06:56:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.303+0000 7f5b037fe640 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f937760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.303+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f92a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.303+0000 7f5b03fff640 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f92aa10 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f5af400ac20 tx=0x7f5af400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec61d1a462c6e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:36.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.303+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5aec0a33b0 0x7f5aec0a5870 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00af20 tx=0x7f5afc00a2f0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.303+0000 7f5aea7fc640 1 -- 172.21.15.12:0/348824057 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af401d070 con 0x55e38f92a5d0 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.303+0000 7f5aea7fc640 1 -- 172.21.15.12:0/348824057 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5af4018b20 con 0x55e38f92a5d0 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.303+0000 7f5aea7fc640 1 -- 172.21.15.12:0/348824057 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4010c00 con 0x55e38f92a5d0 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/348824057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 msgr2=0x55e38f92aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f92aa10 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f5af400ac20 tx=0x7f5af400f790 comp rx=0 tx=0).stop 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/348824057 shutdown_connections 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f937760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f92aa10 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/348824057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f92a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/348824057 >> 172.21.15.12:0/348824057 conn(0x55e38f8f3310 msgr2=0x55e38f926c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/348824057 shutdown_connections 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/348824057 wait complete. 2024-09-19T06:56:36.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 -- start start 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.304+0000 7f5b0c8eb740 1 Processor -- start 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f934d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f931fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f932570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e38f938070 con 0x55e38f92a5d0 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e38f84b060 con 0x55e38f935370 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e38f9381f0 con 0x55e38f92bb40 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b0c8eb740 10 client.0 _ll_register_callbacks cb 0x55e38f59e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f934d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f934d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33936/0 (socket says 172.21.15.12:33936) 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b03fff640 1 -- 172.21.15.12:0/3103611457 learned_addr learned my addr 172.21.15.12:0/3103611457 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b037fe640 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f931fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f932570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b03fff640 1 -- 172.21.15.12:0/3103611457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 msgr2=0x55e38f931fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b03fff640 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f931fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b03fff640 1 -- 172.21.15.12:0/3103611457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 msgr2=0x55e38f932570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b03fff640 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f932570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b03fff640 1 -- 172.21.15.12:0/3103611457 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e38f6013c0 con 0x55e38f92a5d0 2024-09-19T06:56:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b037fe640 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f931fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5b03fff640 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f934d20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f5af4005e90 tx=0x7f5af4018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d117d803a471a27a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.305+0000 7f5ae37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5ae37fe640 1 -- 172.21.15.12:0/3103611457 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af401d050 con 0x55e38f92a5d0 2024-09-19T06:56:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/3103611457 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5af4018b20 con 0x55e38f92a5d0 2024-09-19T06:56:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5ae37fe640 1 -- 172.21.15.12:0/3103611457 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f5af4010b00 con 0x55e38f92a5d0 2024-09-19T06:56:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5ae37fe640 1 -- 172.21.15.12:0/3103611457 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f5af4032050 con 0x55e38f92a5d0 2024-09-19T06:56:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5b0c8eb740 10 client.20001 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/3103611457 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55e38f943a30 con 0x55e38f92a5d0 2024-09-19T06:56:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5ae37fe640 1 -- 172.21.15.12:0/3103611457 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5af4018b20 con 0x55e38f92a5d0 2024-09-19T06:56:36.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5ae37fe640 1 -- 172.21.15.12:0/3103611457 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7f5af40046c0 con 0x55e38f92a5d0 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5b0c8eb740 10 client.20001 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5b0c8eb740 10 client.20001 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5b0c8eb740 20 client.20001 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e38f944de0 0x55e38f9471d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5b0c8eb740 4 client.20001 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.306+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/3103611457 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e38f89d860 con 0x55e38f944de0 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.307+0000 7f5b037fe640 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e38f944de0 0x55e38f9471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.307+0000 7f5b037fe640 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e38f944de0 0x55e38f9471d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f3d4c6addd30448b server_cookie=9c92d44c652f8f in_seq=0 out_seq=0 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.307+0000 7f5ae37fe640 10 client.20001 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5ae37fe640 1 -- 172.21.15.12:0/3103611457 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e38f89d860 con 0x55e38f944de0 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5ae37fe640 10 client.20001 handle_command_reply: tid=0 2024-09-19T06:56:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 client.20001 shutdown 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/3103611457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 msgr2=0x55e38f934d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f934d20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f5af4005e90 tx=0x7f5af4018670 comp rx=0 tx=0).stop 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/3103611457 shutdown_connections 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e38f944de0 0x55e38f9471d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f932570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f931fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/3103611457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f934d20 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/3103611457 >> 172.21.15.12:0/3103611457 conn(0x55e38f8f3310 msgr2=0x55e38f92c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5ae37fe640 0 client.20001 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/3103611457 shutdown_connections 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/3103611457 wait complete. 2024-09-19T06:56:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.308+0000 7f5b0c8eb740 20 client.20001 trim_cache size 0 max 16384 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b0c8eb740 1 Processor -- start 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b0c8eb740 1 -- start start 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92a5d0 0x55e38f941310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f92bb40 0x55e38f930e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f935370 0x55e38f936760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041afdb0 con 0x55e38f935370 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041b19e0 con 0x55e38f92bb40 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041b0480 con 0x55e38f92a5d0 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b08aaf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f935370 0x55e38f936760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b08aaf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f935370 0x55e38f936760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33952/0 (socket says 172.21.15.12:33952) 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b08aaf640 1 -- 172.21.15.12:0/2960581711 learned_addr learned my addr 172.21.15.12:0/2960581711 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b03fff640 1 --2- 172.21.15.12:0/2960581711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92a5d0 0x55e38f941310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b037fe640 1 --2- 172.21.15.12:0/2960581711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f92bb40 0x55e38f930e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b08aaf640 1 -- 172.21.15.12:0/2960581711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92a5d0 msgr2=0x55e38f941310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/2960581711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92a5d0 0x55e38f941310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.322+0000 7f5b08aaf640 1 -- 172.21.15.12:0/2960581711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f92bb40 msgr2=0x55e38f930e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.323+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/2960581711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f92bb40 0x55e38f930e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.323+0000 7f5b08aaf640 1 -- 172.21.15.12:0/2960581711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38f9328e0 con 0x55e38f935370 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.323+0000 7f5b037fe640 1 --2- 172.21.15.12:0/2960581711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f92bb40 0x55e38f930e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.323+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/2960581711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f935370 0x55e38f936760 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0125e0 tx=0x7f5afc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab8b1437c1b94bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.323+0000 7f5ae9ffb640 1 -- 172.21.15.12:0/2960581711 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc011990 con 0x55e38f935370 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.323+0000 7f5ae9ffb640 1 -- 172.21.15.12:0/2960581711 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5afc022070 con 0x55e38f935370 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.323+0000 7f5ae9ffb640 1 -- 172.21.15.12:0/2960581711 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc027e60 con 0x55e38f935370 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.323+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2960581711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f935370 msgr2=0x55e38f936760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/2960581711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f935370 0x55e38f936760 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0125e0 tx=0x7f5afc013000 comp rx=0 tx=0).stop 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2960581711 shutdown_connections 2024-09-19T06:56:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/2960581711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f935370 0x55e38f936760 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/2960581711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f92bb40 0x55e38f930e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/2960581711 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92a5d0 0x55e38f941310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2960581711 >> 172.21.15.12:0/2960581711 conn(0x55e38f8f3310 msgr2=0x55e38f930770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2960581711 shutdown_connections 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2960581711 wait complete. 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 -- start start 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 Processor -- start 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f93dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.324+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f94c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b0c8eb740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f94c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041b1250 con 0x55e38f92a5d0 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041b0b80 con 0x55e38f935370 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b0c8eb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041addb0 con 0x55e38f92bb40 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b0c8eb740 10 client.0 _ll_register_callbacks cb 0x7f5af401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f93dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b03fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f93dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33968/0 (socket says 172.21.15.12:33968) 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b03fff640 1 -- 172.21.15.12:0/2391581903 learned_addr learned my addr 172.21.15.12:0/2391581903 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b08aaf640 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f94c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b037fe640 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f94c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b03fff640 1 -- 172.21.15.12:0/2391581903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 msgr2=0x55e38f94c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b03fff640 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f94c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b03fff640 1 -- 172.21.15.12:0/2391581903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 msgr2=0x55e38f94c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b03fff640 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f94c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b03fff640 1 -- 172.21.15.12:0/2391581903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e38f94cde0 con 0x55e38f92a5d0 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b03fff640 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f93dad0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f5af400f7d0 tx=0x7f5af4010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fee34f81ff7e255 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5ae37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5ae37fe640 1 -- 172.21.15.12:0/2391581903 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af401d040 con 0x55e38f92a5d0 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5ae37fe640 1 -- 172.21.15.12:0/2391581903 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f5af4018ca0 con 0x55e38f92a5d0 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.325+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2391581903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5afc022070 con 0x55e38f92a5d0 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5ae37fe640 1 -- 172.21.15.12:0/2391581903 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f5af4047050 con 0x55e38f92a5d0 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5b0c8eb740 10 client.20007 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2391581903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55e38f9af7d0 con 0x55e38f92a5d0 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5ae37fe640 1 -- 172.21.15.12:0/2391581903 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5afc022070 con 0x55e38f92a5d0 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5ae37fe640 1 -- 172.21.15.12:0/2391581903 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7f5af40104a0 con 0x55e38f92a5d0 2024-09-19T06:56:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5b0c8eb740 10 client.20007 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5b0c8eb740 10 client.20007 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5b0c8eb740 20 client.20007 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e38f9afd80 0x55e38f9b2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5b0c8eb740 4 client.20007 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2391581903 --> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e38f897d70 con 0x55e38f9afd80 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.326+0000 7f5b037fe640 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e38f9afd80 0x55e38f9b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b037fe640 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e38f9afd80 0x55e38f9b2170 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=af08b16b0b4fcaa9 server_cookie=5dbd0aea553c8e09 in_seq=0 out_seq=0 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5ae37fe640 10 client.20007 ms_handle_connect on v2:172.21.15.16:6832/2120245692 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5ae37fe640 1 -- 172.21.15.12:0/2391581903 <== mds.4 v2:172.21.15.16:6832/2120245692 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e38f897d70 con 0x55e38f9afd80 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5ae37fe640 10 client.20007 handle_command_reply: tid=0 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 client.20007 shutdown 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2391581903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 msgr2=0x55e38f93dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f93dad0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f5af400f7d0 tx=0x7f5af4010430 comp rx=0 tx=0).stop 2024-09-19T06:56:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2391581903 shutdown_connections 2024-09-19T06:56:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.16:6832/2120245692,v1:172.21.15.16:6833/2120245692] conn(0x55e38f9afd80 0x55e38f9b2170 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e38f935370 0x55e38f94c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e38f92bb40 0x55e38f94c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 --2- 172.21.15.12:0/2391581903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e38f92a5d0 0x55e38f93dad0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2391581903 >> 172.21.15.12:0/2391581903 conn(0x55e38f8f3310 msgr2=0x55e38f92c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5ae37fe640 0 client.20007 ms_handle_reset on v2:172.21.15.16:6832/2120245692 2024-09-19T06:56:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2391581903 shutdown_connections 2024-09-19T06:56:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 1 -- 172.21.15.12:0/2391581903 wait complete. 2024-09-19T06:56:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.327+0000 7f5b0c8eb740 20 client.20007 trim_cache size 0 max 16384 2024-09-19T06:56:36.390 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:56:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 -- 172.21.15.12:0/1305534579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5aec0a33b0 msgr2=0x7f5aec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5aec0a33b0 0x7f5aec0a5870 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00af20 tx=0x7f5afc00a2f0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 -- 172.21.15.12:0/1305534579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b04102790 msgr2=0x7f5b04074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b04102790 0x7f5b04074a30 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f5af8005ab0 tx=0x7f5af80042f0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 -- 172.21.15.12:0/1305534579 shutdown_connections 2024-09-19T06:56:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f5aec0a33b0 0x7f5aec0a5870 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5b04106f10 0x7f5b04074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b04102790 0x7f5b04074a30 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 --2- 172.21.15.12:0/1305534579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b04101de0 0x7f5b040744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 -- 172.21.15.12:0/1305534579 >> 172.21.15.12:0/1305534579 conn(0x7f5b040fd8c0 msgr2=0x7f5b040fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 -- 172.21.15.12:0/1305534579 shutdown_connections 2024-09-19T06:56:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:36.328+0000 7f5b0a512640 1 -- 172.21.15.12:0/1305534579 wait complete. 2024-09-19T06:56:36.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:36 smithi016 ceph-mon[34911]: pgmap v516: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 129 KiB/s wr, 38 op/s 2024-09-19T06:56:37.157 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:56:37.417 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:37.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 -- 172.21.15.12:0/3596289740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff048102ef0 msgr2=0x7ff04810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 --2- 172.21.15.12:0/3596289740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff048102ef0 0x7ff04810da40 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7ff040009ca0 tx=0x7ff04002a950 comp rx=0 tx=0).stop 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 -- 172.21.15.12:0/3596289740 shutdown_connections 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 --2- 172.21.15.12:0/3596289740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff048102ef0 0x7ff04810da40 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 --2- 172.21.15.12:0/3596289740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff048102570 0x7ff0481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 --2- 172.21.15.12:0/3596289740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff048100e20 0x7ff048101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 -- 172.21.15.12:0/3596289740 >> 172.21.15.12:0/3596289740 conn(0x7ff0480fc7d0 msgr2=0x7ff0480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 -- 172.21.15.12:0/3596289740 shutdown_connections 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 -- 172.21.15.12:0/3596289740 wait complete. 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 Processor -- start 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.855+0000 7ff04e28b640 1 -- start start 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04e28b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff048100e20 0x7ff0481984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04e28b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff048102570 0x7ff0481989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04e28b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff048102ef0 0x7ff04819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04e28b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481120a0 con 0x7ff048102ef0 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04e28b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff048111f20 con 0x7ff048102570 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04e28b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff048112220 con 0x7ff048100e20 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04c828640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff048102ef0 0x7ff04819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04c828640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff048102ef0 0x7ff04819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34000/0 (socket says 172.21.15.12:34000) 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04c828640 1 -- 172.21.15.12:0/2980135497 learned_addr learned my addr 172.21.15.12:0/2980135497 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff03ffff640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff048102570 0x7ff0481989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff047fff640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff048100e20 0x7ff0481984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04c828640 1 -- 172.21.15.12:0/2980135497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff048100e20 msgr2=0x7ff0481984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04c828640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff048100e20 0x7ff0481984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04c828640 1 -- 172.21.15.12:0/2980135497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff048102570 msgr2=0x7ff0481989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04c828640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff048102570 0x7ff0481989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04c828640 1 -- 172.21.15.12:0/2980135497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04819d450 con 0x7ff048102ef0 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff04c828640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff048102ef0 0x7ff04819cd70 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7ff04002ae70 tx=0x7ff04002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.856+0000 7ff045ffb640 1 -- 172.21.15.12:0/2980135497 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff040034040 con 0x7ff048102ef0 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.857+0000 7ff04e28b640 1 -- 172.21.15.12:0/2980135497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04819d6e0 con 0x7ff048102ef0 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.857+0000 7ff045ffb640 1 -- 172.21.15.12:0/2980135497 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff040030920 con 0x7ff048102ef0 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.857+0000 7ff045ffb640 1 -- 172.21.15.12:0/2980135497 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff040045480 con 0x7ff048102ef0 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.857+0000 7ff04e28b640 1 -- 172.21.15.12:0/2980135497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0481a5020 con 0x7ff048102ef0 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff045ffb640 1 -- 172.21.15.12:0/2980135497 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff040037020 con 0x7ff048102ef0 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff050664740 1 Processor -- start 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff050664740 1 -- start start 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff050664740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29f7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff050664740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c29f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff050664740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a04760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff050664740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5559c295d2f0 con 0x5559c2a02370 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff050664740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5559c2904cf0 con 0x5559c29f75d0 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff050664740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5559c29592b0 con 0x5559c29f8b40 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a04760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a04760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34002/0 (socket says 172.21.15.12:34002) 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.859+0000 7ff03ffff640 1 -- 172.21.15.12:0/4238700609 learned_addr learned my addr 172.21.15.12:0/4238700609 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff047fff640 1 --2- 172.21.15.12:0/4238700609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c29f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff03ffff640 1 --2- 172.21.15.12:0/4238700609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff045ffb640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0340a33b0 0x7ff0340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff03ffff640 1 -- 172.21.15.12:0/4238700609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 msgr2=0x5559c29f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff03ffff640 1 --2- 172.21.15.12:0/4238700609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29f7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff03ffff640 1 -- 172.21.15.12:0/4238700609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 msgr2=0x5559c29f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff03ffff640 1 --2- 172.21.15.12:0/4238700609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c29f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff03ffff640 1 -- 172.21.15.12:0/4238700609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c28e93a0 con 0x5559c2a02370 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff04c828640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0340a33b0 0x7ff0340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff045ffb640 1 -- 172.21.15.12:0/2980135497 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7ff0400f0b70 con 0x7ff048102ef0 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff03ffff640 1 --2- 172.21.15.12:0/4238700609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a04760 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7ff03000baf0 tx=0x7ff030004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577e7d3f04ac68b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff03e7fc640 1 -- 172.21.15.12:0/4238700609 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030005020 con 0x5559c2a02370 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff03e7fc640 1 -- 172.21.15.12:0/4238700609 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0300047a0 con 0x5559c2a02370 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.860+0000 7ff03e7fc640 1 -- 172.21.15.12:0/4238700609 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030010780 con 0x5559c2a02370 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff050664740 1 -- 172.21.15.12:0/4238700609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 msgr2=0x5559c2a04760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff050664740 1 --2- 172.21.15.12:0/4238700609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a04760 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7ff03000baf0 tx=0x7ff030004170 comp rx=0 tx=0).stop 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff04c828640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0340a33b0 0x7ff0340a5870 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff0400ee820 tx=0x7ff0400dd040 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff050664740 1 -- 172.21.15.12:0/4238700609 shutdown_connections 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff050664740 1 --2- 172.21.15.12:0/4238700609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a04760 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff050664740 1 --2- 172.21.15.12:0/4238700609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c29f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff050664740 1 --2- 172.21.15.12:0/4238700609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff050664740 1 -- 172.21.15.12:0/4238700609 >> 172.21.15.12:0/4238700609 conn(0x5559c29c0310 msgr2=0x5559c29f3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff050664740 1 -- 172.21.15.12:0/4238700609 shutdown_connections 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff050664740 1 -- 172.21.15.12:0/4238700609 wait complete. 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.861+0000 7ff050664740 1 -- start start 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff050664740 1 Processor -- start 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff050664740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c2a01d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff050664740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29ff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff050664740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c29ff610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff050664740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5559c2a05070 con 0x5559c2a02370 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff050664740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5559c2918060 con 0x5559c29f75d0 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff050664740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5559c2a051f0 con 0x5559c29f8b40 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff050664740 10 client.0 _ll_register_callbacks cb 0x5559c266b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:37.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c29ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c29ff610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34006/0 (socket says 172.21.15.12:34006) 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff03ffff640 1 -- 172.21.15.12:0/2806516273 learned_addr learned my addr 172.21.15.12:0/2806516273 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff03ffff640 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c2a01d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff047fff640 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff03ffff640 1 -- 172.21.15.12:0/2806516273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 msgr2=0x5559c29ff020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff03ffff640 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29ff020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff03ffff640 1 -- 172.21.15.12:0/2806516273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 msgr2=0x5559c2a01d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff03ffff640 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c2a01d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.862+0000 7ff03ffff640 1 -- 172.21.15.12:0/2806516273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c26ce3c0 con 0x5559c2a02370 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.863+0000 7ff03ffff640 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c29ff610 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7ff030004650 tx=0x7ff03000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75e23800d648276 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.863+0000 7ff0277fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.863+0000 7ff0277fe640 1 -- 172.21.15.12:0/2806516273 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030026060 con 0x5559c2a02370 2024-09-19T06:56:37.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.863+0000 7ff0277fe640 1 -- 172.21.15.12:0/2806516273 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7ff030005200 con 0x5559c2a02370 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.863+0000 7ff050664740 1 -- 172.21.15.12:0/2806516273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0300047a0 con 0x5559c2a02370 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.863+0000 7ff0277fe640 1 -- 172.21.15.12:0/2806516273 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff030005400 con 0x5559c2a02370 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.863+0000 7ff050664740 10 client.20019 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.863+0000 7ff050664740 1 -- 172.21.15.12:0/2806516273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5559c2a10b10 con 0x5559c2a02370 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.864+0000 7ff0277fe640 1 -- 172.21.15.12:0/2806516273 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0300047a0 con 0x5559c2a02370 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.864+0000 7ff0277fe640 1 -- 172.21.15.12:0/2806516273 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7ff03002d470 con 0x5559c2a02370 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.864+0000 7ff050664740 10 client.20019 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.864+0000 7ff050664740 10 client.20019 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.864+0000 7ff050664740 20 client.20019 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.864+0000 7ff050664740 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5559c2a11e60 0x5559c2a14250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.864+0000 7ff050664740 4 client.20019 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.864+0000 7ff050664740 1 -- 172.21.15.12:0/2806516273 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559c296a860 con 0x5559c2a11e60 2024-09-19T06:56:37.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.864+0000 7ff047fff640 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5559c2a11e60 0x5559c2a14250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.865+0000 7ff0277fe640 10 client.20019 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.865+0000 7ff047fff640 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5559c2a11e60 0x5559c2a14250 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=388fd78674deddb2 server_cookie=65ce706f1136fdc2 in_seq=0 out_seq=0 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff0277fe640 1 -- 172.21.15.12:0/2806516273 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559c296a860 con 0x5559c2a11e60 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff0277fe640 10 client.20019 handle_command_reply: tid=0 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 client.20019 shutdown 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 -- 172.21.15.12:0/2806516273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 msgr2=0x5559c29ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c29ff610 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7ff030004650 tx=0x7ff03000b5b0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 -- 172.21.15.12:0/2806516273 shutdown_connections 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5559c2a11e60 0x5559c2a14250 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c29ff610 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29ff020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 --2- 172.21.15.12:0/2806516273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c2a01d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff0277fe640 0 client.20019 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:56:37.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 -- 172.21.15.12:0/2806516273 >> 172.21.15.12:0/2806516273 conn(0x5559c29c0310 msgr2=0x5559c29f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:37.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 -- 172.21.15.12:0/2806516273 shutdown_connections 2024-09-19T06:56:37.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 1 -- 172.21.15.12:0/2806516273 wait complete. 2024-09-19T06:56:37.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.866+0000 7ff050664740 20 client.20019 trim_cache size 0 max 16384 2024-09-19T06:56:37.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.879+0000 7ff050664740 1 Processor -- start 2024-09-19T06:56:37.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.879+0000 7ff050664740 1 -- start start 2024-09-19T06:56:37.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.879+0000 7ff050664740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c29f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.879+0000 7ff050664740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c2a0e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.879+0000 7ff050664740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a19970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.879+0000 7ff050664740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481adc30 con 0x5559c2a02370 2024-09-19T06:56:37.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.879+0000 7ff050664740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481af860 con 0x5559c29f75d0 2024-09-19T06:56:37.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.879+0000 7ff050664740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481ae300 con 0x5559c29f8b40 2024-09-19T06:56:37.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.879+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a19970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a19970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34020/0 (socket says 172.21.15.12:34020) 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03ffff640 1 -- 172.21.15.12:0/1467477680 learned_addr learned my addr 172.21.15.12:0/1467477680 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03ffff640 1 --2- 172.21.15.12:0/1467477680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c29f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff047fff640 1 --2- 172.21.15.12:0/1467477680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c2a0e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03ffff640 1 -- 172.21.15.12:0/1467477680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 msgr2=0x5559c2a0e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03ffff640 1 --2- 172.21.15.12:0/1467477680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c2a0e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03ffff640 1 -- 172.21.15.12:0/1467477680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 msgr2=0x5559c29f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03ffff640 1 --2- 172.21.15.12:0/1467477680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c29f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03ffff640 1 -- 172.21.15.12:0/1467477680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c29f8760 con 0x5559c2a02370 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff047fff640 1 --2- 172.21.15.12:0/1467477680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c2a0e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03ffff640 1 --2- 172.21.15.12:0/1467477680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a19970 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ff03000c010 tx=0x7ff0300059b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d956af062ea4a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03dffb640 1 -- 172.21.15.12:0/1467477680 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030026070 con 0x5559c2a02370 2024-09-19T06:56:37.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03dffb640 1 -- 172.21.15.12:0/1467477680 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0300047a0 con 0x5559c2a02370 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.880+0000 7ff03dffb640 1 -- 172.21.15.12:0/1467477680 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03002dbe0 con 0x5559c2a02370 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 -- 172.21.15.12:0/1467477680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 msgr2=0x5559c2a19970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 --2- 172.21.15.12:0/1467477680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a19970 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ff03000c010 tx=0x7ff0300059b0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 -- 172.21.15.12:0/1467477680 shutdown_connections 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 --2- 172.21.15.12:0/1467477680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c2a02370 0x5559c2a19970 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 --2- 172.21.15.12:0/1467477680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c2a0e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 --2- 172.21.15.12:0/1467477680 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c29f75d0 0x5559c29f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 -- 172.21.15.12:0/1467477680 >> 172.21.15.12:0/1467477680 conn(0x5559c29c0310 msgr2=0x5559c29f3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 -- 172.21.15.12:0/1467477680 shutdown_connections 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 -- 172.21.15.12:0/1467477680 wait complete. 2024-09-19T06:56:37.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 -- start start 2024-09-19T06:56:37.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.881+0000 7ff050664740 1 Processor -- start 2024-09-19T06:56:37.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff050664740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c29f75d0 0x5559c2a0ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff050664740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff050664740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c2a02370 0x5559c29fc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff050664740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481af0d0 con 0x5559c29f75d0 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff050664740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481aea00 con 0x5559c2a02370 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff050664740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481abc30 con 0x5559c29f8b40 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff050664740 10 client.0 _ll_register_callbacks cb 0x7ff03800d420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c29f75d0 0x5559c2a0ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c29f75d0 0x5559c2a0ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34034/0 (socket says 172.21.15.12:34034) 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff03ffff640 1 -- 172.21.15.12:0/3600874672 learned_addr learned my addr 172.21.15.12:0/3600874672 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff047fff640 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff03ffff640 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c2a02370 0x5559c29fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff03ffff640 1 -- 172.21.15.12:0/3600874672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 msgr2=0x5559c29fbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff03ffff640 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29fbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff03ffff640 1 -- 172.21.15.12:0/3600874672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c2a02370 msgr2=0x5559c29fc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff03ffff640 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c2a02370 0x5559c29fc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff03ffff640 1 -- 172.21.15.12:0/3600874672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c29fca00 con 0x5559c29f75d0 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff047fff640 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff03ffff640 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c29f75d0 0x5559c2a0ab00 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7ff03000b620 tx=0x7ff03000ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d04655ee33c3d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.882+0000 7ff0277fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff0277fe640 1 -- 172.21.15.12:0/3600874672 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030043060 con 0x5559c29f75d0 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff0277fe640 1 -- 172.21.15.12:0/3600874672 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7ff030005200 con 0x5559c29f75d0 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff050664740 1 -- 172.21.15.12:0/3600874672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0300047a0 con 0x5559c29f75d0 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff0277fe640 1 -- 172.21.15.12:0/3600874672 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff030026040 con 0x5559c29f75d0 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff050664740 10 client.20025 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff050664740 1 -- 172.21.15.12:0/3600874672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5559c2a80c90 con 0x5559c29f75d0 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff0277fe640 1 -- 172.21.15.12:0/3600874672 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0300047a0 con 0x5559c29f75d0 2024-09-19T06:56:37.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff0277fe640 1 -- 172.21.15.12:0/3600874672 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7ff030010a40 con 0x5559c29f75d0 2024-09-19T06:56:37.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff050664740 10 client.20025 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:37.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff050664740 10 client.20025 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-09-19T06:56:37.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff050664740 20 client.20025 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:37.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff050664740 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5559c2a812a0 0x5559c2a836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:37.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff050664740 4 client.20025 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:56:37.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.883+0000 7ff050664740 1 -- 172.21.15.12:0/3600874672 --> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5559c2964d70 con 0x5559c2a812a0 2024-09-19T06:56:37.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff047fff640 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5559c2a812a0 0x5559c2a836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:37.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff0277fe640 10 client.20025 ms_handle_connect on v2:172.21.15.173:6832/1987793831 2024-09-19T06:56:37.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff047fff640 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5559c2a812a0 0x5559c2a836c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=23564787dd8bab36 server_cookie=3d98fd2817c5a9b1 in_seq=0 out_seq=0 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff0277fe640 1 -- 172.21.15.12:0/3600874672 <== mds.3 v2:172.21.15.173:6832/1987793831 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5559c2964d70 con 0x5559c2a812a0 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff0277fe640 10 client.20025 handle_command_reply: tid=0 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff050664740 1 client.20025 shutdown 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff050664740 1 -- 172.21.15.12:0/3600874672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c29f75d0 msgr2=0x5559c2a0ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff050664740 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c29f75d0 0x5559c2a0ab00 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7ff03000b620 tx=0x7ff03000ba80 comp rx=0 tx=0).stop 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff050664740 1 -- 172.21.15.12:0/3600874672 shutdown_connections 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff050664740 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.173:6832/1987793831,v1:172.21.15.173:6833/1987793831] conn(0x5559c2a812a0 0x5559c2a836c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff050664740 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5559c2a02370 0x5559c29fc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff050664740 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5559c29f8b40 0x5559c29fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff050664740 1 --2- 172.21.15.12:0/3600874672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5559c29f75d0 0x5559c2a0ab00 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff050664740 1 -- 172.21.15.12:0/3600874672 >> 172.21.15.12:0/3600874672 conn(0x5559c29c0310 msgr2=0x5559c29f9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:37.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.884+0000 7ff0277fe640 0 client.20025 ms_handle_reset on v2:172.21.15.173:6832/1987793831 2024-09-19T06:56:37.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff050664740 1 -- 172.21.15.12:0/3600874672 shutdown_connections 2024-09-19T06:56:37.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff050664740 1 -- 172.21.15.12:0/3600874672 wait complete. 2024-09-19T06:56:37.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff050664740 20 client.20025 trim_cache size 0 max 16384 2024-09-19T06:56:37.892 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:56:37.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 -- 172.21.15.12:0/2980135497 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0340a33b0 msgr2=0x7ff0340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:37.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0340a33b0 0x7ff0340a5870 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff0400ee820 tx=0x7ff0400dd040 comp rx=0 tx=0).stop 2024-09-19T06:56:37.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 -- 172.21.15.12:0/2980135497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff048102ef0 msgr2=0x7ff04819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:37.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff048102ef0 0x7ff04819cd70 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7ff04002ae70 tx=0x7ff04002f5d0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 -- 172.21.15.12:0/2980135497 shutdown_connections 2024-09-19T06:56:37.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff048102ef0 0x7ff04819cd70 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff048102570 0x7ff0481989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7ff0340a33b0 0x7ff0340a5870 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 --2- 172.21.15.12:0/2980135497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff048100e20 0x7ff0481984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:37.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 -- 172.21.15.12:0/2980135497 >> 172.21.15.12:0/2980135497 conn(0x7ff0480fc7d0 msgr2=0x7ff048106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:37.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 -- 172.21.15.12:0/2980135497 shutdown_connections 2024-09-19T06:56:37.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:37.885+0000 7ff04e28b640 1 -- 172.21.15.12:0/2980135497 wait complete. 2024-09-19T06:56:38.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:38 smithi012 ceph-mon[30937]: pgmap v517: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 136 KiB/s wr, 43 op/s 2024-09-19T06:56:38.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:38 smithi173 ceph-mon[35349]: pgmap v517: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 136 KiB/s wr, 43 op/s 2024-09-19T06:56:38.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:38 smithi016 ceph-mon[34911]: pgmap v517: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 136 KiB/s wr, 43 op/s 2024-09-19T06:56:38.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:56:38.970 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:39.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.431+0000 7f41662a7640 1 -- 172.21.15.12:0/3916244689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4160101420 msgr2=0x7f416010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.431+0000 7f41662a7640 1 --2- 172.21.15.12:0/3916244689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4160101420 0x7f416010d950 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f4158009cd0 tx=0x7f415802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.431+0000 7f41662a7640 1 -- 172.21.15.12:0/3916244689 shutdown_connections 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.431+0000 7f41662a7640 1 --2- 172.21.15.12:0/3916244689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4160101420 0x7f416010d950 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.431+0000 7f41662a7640 1 --2- 172.21.15.12:0/3916244689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4160100a80 0x7f4160100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.431+0000 7f41662a7640 1 --2- 172.21.15.12:0/3916244689 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4160106a80 0x7f4160106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.431+0000 7f41662a7640 1 -- 172.21.15.12:0/3916244689 >> 172.21.15.12:0/3916244689 conn(0x7f41600fc7a0 msgr2=0x7f41600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.431+0000 7f41662a7640 1 -- 172.21.15.12:0/3916244689 shutdown_connections 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.431+0000 7f41662a7640 1 -- 172.21.15.12:0/3916244689 wait complete. 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.432+0000 7f41662a7640 1 Processor -- start 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.432+0000 7f41662a7640 1 -- start start 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.432+0000 7f41662a7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4160100a80 0x7f4160102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f41662a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4160101420 0x7f4160102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f41662a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4160106a80 0x7f41601030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f41662a7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4160110ef0 con 0x7f4160106a80 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f41662a7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4160110d70 con 0x7f4160101420 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f41662a7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4160111070 con 0x7f4160100a80 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f4164844640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4160106a80 0x7f41601030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f4164844640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4160106a80 0x7f41601030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34064/0 (socket says 172.21.15.12:34064) 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f4164844640 1 -- 172.21.15.12:0/446346134 learned_addr learned my addr 172.21.15.12:0/446346134 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f415f7fe640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4160101420 0x7f4160102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f415ffff640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4160100a80 0x7f4160102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f4164844640 1 -- 172.21.15.12:0/446346134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4160100a80 msgr2=0x7f4160102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f4164844640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4160100a80 0x7f4160102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f4164844640 1 -- 172.21.15.12:0/446346134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4160101420 msgr2=0x7f4160102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f4164844640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4160101420 0x7f4160102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f4164844640 1 -- 172.21.15.12:0/446346134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41601a6960 con 0x7f4160106a80 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f4164844640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4160106a80 0x7f41601030d0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f4158033040 tx=0x7f4158031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f415d7fa640 1 -- 172.21.15.12:0/446346134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158004040 con 0x7f4160106a80 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f41662a7640 1 -- 172.21.15.12:0/446346134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41601a6bf0 con 0x7f4160106a80 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f415d7fa640 1 -- 172.21.15.12:0/446346134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41580046c0 con 0x7f4160106a80 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.433+0000 7f415d7fa640 1 -- 172.21.15.12:0/446346134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158046480 con 0x7f4160106a80 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.434+0000 7f41662a7640 1 -- 172.21.15.12:0/446346134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41601a7130 con 0x7f4160106a80 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.436+0000 7f415d7fa640 1 -- 172.21.15.12:0/446346134 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f41580305a0 con 0x7f4160106a80 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.436+0000 7f4168680740 1 Processor -- start 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.436+0000 7f4168680740 1 -- start start 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f4168680740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d7b40 0x5562364d6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f4168680740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364d65d0 0x5562364d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f4168680740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364e1370 0x5562364e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f4168680740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55623643c2f0 con 0x5562364d7b40 2024-09-19T06:56:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f4168680740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5562363e3cf0 con 0x5562364d65d0 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f4168680740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5562364382b0 con 0x5562364e1370 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d7b40 0x5562364d6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d7b40 0x5562364d6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34072/0 (socket says 172.21.15.12:34072) 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 -- 172.21.15.12:0/561465654 learned_addr learned my addr 172.21.15.12:0/561465654 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415ffff640 1 --2- 172.21.15.12:0/561465654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364d65d0 0x5562364d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 --2- 172.21.15.12:0/561465654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364e1370 0x5562364e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 -- 172.21.15.12:0/561465654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364e1370 msgr2=0x5562364e3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 --2- 172.21.15.12:0/561465654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364e1370 0x5562364e3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 -- 172.21.15.12:0/561465654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364d65d0 msgr2=0x5562364d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 --2- 172.21.15.12:0/561465654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364d65d0 0x5562364d6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 -- 172.21.15.12:0/561465654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562363c83a0 con 0x5562364d7b40 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415d7fa640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41480a33b0 0x7f41480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415d7fa640 1 -- 172.21.15.12:0/446346134 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f415802e030 con 0x7f4160106a80 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 --2- 172.21.15.12:0/561465654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d7b40 0x5562364d6090 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f4154004650 tx=0x7f41540097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a12379dfbba9c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f415f7fe640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41480a33b0 0x7f41480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.437+0000 7f41467fc640 1 -- 172.21.15.12:0/561465654 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154011470 con 0x5562364d7b40 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f41467fc640 1 -- 172.21.15.12:0/561465654 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f415400f980 con 0x5562364d7b40 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f41467fc640 1 -- 172.21.15.12:0/561465654 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154022c90 con 0x5562364d7b40 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f4168680740 1 -- 172.21.15.12:0/561465654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d7b40 msgr2=0x5562364d6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f415f7fe640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41480a33b0 0x7f41480a5870 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f41540133d0 tx=0x7f4154022f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f4168680740 1 --2- 172.21.15.12:0/561465654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d7b40 0x5562364d6090 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f4154004650 tx=0x7f41540097b0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f4168680740 1 -- 172.21.15.12:0/561465654 shutdown_connections 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f4168680740 1 --2- 172.21.15.12:0/561465654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364e1370 0x5562364e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f4168680740 1 --2- 172.21.15.12:0/561465654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364d65d0 0x5562364d6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f4168680740 1 --2- 172.21.15.12:0/561465654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d7b40 0x5562364d6090 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f4168680740 1 -- 172.21.15.12:0/561465654 >> 172.21.15.12:0/561465654 conn(0x55623649f310 msgr2=0x5562364d2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f4168680740 1 -- 172.21.15.12:0/561465654 shutdown_connections 2024-09-19T06:56:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.438+0000 7f4168680740 1 -- 172.21.15.12:0/561465654 wait complete. 2024-09-19T06:56:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f4168680740 1 -- start start 2024-09-19T06:56:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f4168680740 1 Processor -- start 2024-09-19T06:56:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f4168680740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f4168680740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f4168680740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364de480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f4168680740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5562364e4070 con 0x5562364d65d0 2024-09-19T06:56:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f4168680740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5562363f7060 con 0x5562364e1370 2024-09-19T06:56:39.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f4168680740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5562364e41f0 con 0x5562364d7b40 2024-09-19T06:56:39.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f4168680740 10 client.0 _ll_register_callbacks cb 0x55623614a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:39.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f415ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f415ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34082/0 (socket says 172.21.15.12:34082) 2024-09-19T06:56:39.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f415ffff640 1 -- 172.21.15.12:0/1222446181 learned_addr learned my addr 172.21.15.12:0/1222446181 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:39.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.439+0000 7f4164844640 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364de480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f415f7fe640 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f415ffff640 1 -- 172.21.15.12:0/1222446181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 msgr2=0x5562364ddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:39.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f415ffff640 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364ddf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f415ffff640 1 -- 172.21.15.12:0/1222446181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 msgr2=0x5562364de480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:39.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f415ffff640 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364de480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f415ffff640 1 -- 172.21.15.12:0/1222446181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562361ad3c0 con 0x5562364d65d0 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f415ffff640 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e0c40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f41500104d0 tx=0x7f4150010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50afae9f3950c89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f413f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f413f7fe640 1 -- 172.21.15.12:0/1222446181 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415001a020 con 0x5562364d65d0 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f4168680740 1 -- 172.21.15.12:0/1222446181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f415400f980 con 0x5562364d65d0 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f413f7fe640 1 -- 172.21.15.12:0/1222446181 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f4150016690 con 0x5562364d65d0 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f413f7fe640 1 -- 172.21.15.12:0/1222446181 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f4150025050 con 0x5562364d65d0 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f4168680740 10 client.20037 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f4168680740 1 -- 172.21.15.12:0/1222446181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5562364efb10 con 0x5562364d65d0 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.440+0000 7f413f7fe640 1 -- 172.21.15.12:0/1222446181 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f415400f980 con 0x5562364d65d0 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.441+0000 7f413f7fe640 1 -- 172.21.15.12:0/1222446181 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7f4150014b20 con 0x5562364d65d0 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.441+0000 7f4168680740 10 client.20037 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.441+0000 7f4168680740 10 client.20037 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.441+0000 7f4168680740 20 client.20037 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.441+0000 7f4168680740 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5562364f0fd0 0x5562364f3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.441+0000 7f4168680740 4 client.20037 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.441+0000 7f4168680740 1 -- 172.21.15.12:0/1222446181 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556236449860 con 0x5562364f0fd0 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.441+0000 7f415f7fe640 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5562364f0fd0 0x5562364f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.441+0000 7f415f7fe640 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5562364f0fd0 0x5562364f3470 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9430252b792a4c0 server_cookie=9059a2c49835f9e9 in_seq=0 out_seq=0 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.441+0000 7f413f7fe640 10 client.20037 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f413f7fe640 1 -- 172.21.15.12:0/1222446181 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556236449860 con 0x5562364f0fd0 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f413f7fe640 10 client.20037 handle_command_reply: tid=0 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 client.20037 shutdown 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 -- 172.21.15.12:0/1222446181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 msgr2=0x5562364e0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e0c40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f41500104d0 tx=0x7f4150010990 comp rx=0 tx=0).stop 2024-09-19T06:56:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 -- 172.21.15.12:0/1222446181 shutdown_connections 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x5562364f0fd0 0x5562364f3470 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364ddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 --2- 172.21.15.12:0/1222446181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e0c40 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 -- 172.21.15.12:0/1222446181 >> 172.21.15.12:0/1222446181 conn(0x55623649f310 msgr2=0x5562364d8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f413f7fe640 0 client.20037 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 -- 172.21.15.12:0/1222446181 shutdown_connections 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.442+0000 7f4168680740 1 -- 172.21.15.12:0/1222446181 wait complete. 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.443+0000 7f4168680740 20 client.20037 trim_cache size 0 max 16384 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f4168680740 1 Processor -- start 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f4168680740 1 -- start start 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f4168680740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f4168680740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364ed340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f4168680740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364d9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f4168680740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41601afcf0 con 0x5562364d65d0 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f4168680740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41601b1920 con 0x5562364e1370 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f4168680740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41601b03c0 con 0x5562364d7b40 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f415ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f415ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364d2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34094/0 (socket says 172.21.15.12:34094) 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f415ffff640 1 -- 172.21.15.12:0/4089967830 learned_addr learned my addr 172.21.15.12:0/4089967830 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f4164844640 1 --2- 172.21.15.12:0/4089967830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364d9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f415ffff640 1 -- 172.21.15.12:0/4089967830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 msgr2=0x5562364ed340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f415ffff640 1 --2- 172.21.15.12:0/4089967830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f415ffff640 1 -- 172.21.15.12:0/4089967830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 msgr2=0x5562364d9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f415ffff640 1 --2- 172.21.15.12:0/4089967830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364d9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f415ffff640 1 -- 172.21.15.12:0/4089967830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562364e3f50 con 0x5562364d65d0 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f4164844640 1 --2- 172.21.15.12:0/4089967830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364d9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.456+0000 7f415ffff640 1 --2- 172.21.15.12:0/4089967830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364d2e10 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f4150016040 tx=0x7f415000bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7acec2c950fefd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4145ffb640 1 -- 172.21.15.12:0/4089967830 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415002d020 con 0x5562364d65d0 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4145ffb640 1 -- 172.21.15.12:0/4089967830 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4150012e60 con 0x5562364d65d0 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4145ffb640 1 -- 172.21.15.12:0/4089967830 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415001a050 con 0x5562364d65d0 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4168680740 1 -- 172.21.15.12:0/4089967830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 msgr2=0x5562364d2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4168680740 1 --2- 172.21.15.12:0/4089967830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364d2e10 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f4150016040 tx=0x7f415000bb50 comp rx=0 tx=0).stop 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4168680740 1 -- 172.21.15.12:0/4089967830 shutdown_connections 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4168680740 1 --2- 172.21.15.12:0/4089967830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364d9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4168680740 1 --2- 172.21.15.12:0/4089967830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364ed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4168680740 1 --2- 172.21.15.12:0/4089967830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364d2e10 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4168680740 1 -- 172.21.15.12:0/4089967830 >> 172.21.15.12:0/4089967830 conn(0x55623649f310 msgr2=0x5562364d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4168680740 1 -- 172.21.15.12:0/4089967830 shutdown_connections 2024-09-19T06:56:39.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.457+0000 7f4168680740 1 -- 172.21.15.12:0/4089967830 wait complete. 2024-09-19T06:56:39.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f4168680740 1 -- start start 2024-09-19T06:56:39.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f4168680740 1 Processor -- start 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f4168680740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f4168680740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364e99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f4168680740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364da5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f4168680740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f41601b1190 con 0x5562364d65d0 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f4168680740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41601b0ac0 con 0x5562364e1370 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f4168680740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41601adcf0 con 0x5562364d7b40 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f4168680740 10 client.0 _ll_register_callbacks cb 0x7f415000b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f415ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f415ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34100/0 (socket says 172.21.15.12:34100) 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f415ffff640 1 -- 172.21.15.12:0/2001561269 learned_addr learned my addr 172.21.15.12:0/2001561269 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.458+0000 7f4164844640 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364da5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f415f7fe640 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364e99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f415ffff640 1 -- 172.21.15.12:0/2001561269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 msgr2=0x5562364e99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f415ffff640 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364e99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f415ffff640 1 -- 172.21.15.12:0/2001561269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 msgr2=0x5562364da5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f415ffff640 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364da5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f415ffff640 1 -- 172.21.15.12:0/2001561269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562364daaf0 con 0x5562364d65d0 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f415f7fe640 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364e99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f415ffff640 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e94b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f4150000c00 tx=0x7f4150006d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c67a5a51ff7ae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f413f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f413f7fe640 1 -- 172.21.15.12:0/2001561269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150037060 con 0x5562364d65d0 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f413f7fe640 1 -- 172.21.15.12:0/2001561269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f4150012b60 con 0x5562364d65d0 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f4168680740 1 -- 172.21.15.12:0/2001561269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4150012e60 con 0x5562364d65d0 2024-09-19T06:56:39.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f413f7fe640 1 -- 172.21.15.12:0/2001561269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f415003e050 con 0x5562364d65d0 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f4168680740 10 client.20043 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f4168680740 1 -- 172.21.15.12:0/2001561269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55623655b550 con 0x5562364d65d0 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f413f7fe640 1 -- 172.21.15.12:0/2001561269 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4150012e60 con 0x5562364d65d0 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.459+0000 7f413f7fe640 1 -- 172.21.15.12:0/2001561269 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7f41500065a0 con 0x5562364d65d0 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f4168680740 10 client.20043 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f4168680740 10 client.20043 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f4168680740 20 client.20043 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f4168680740 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55623655bbd0 0x55623655dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f4168680740 4 client.20043 mds_command: new command op to 24481 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f4168680740 1 -- 172.21.15.12:0/2001561269 --> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556236443d70 con 0x55623655bbd0 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f415f7fe640 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55623655bbd0 0x55623655dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f415f7fe640 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55623655bbd0 0x55623655dff0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c8917216679404b server_cookie=5f63b8af9a56db52 in_seq=0 out_seq=0 2024-09-19T06:56:39.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f413f7fe640 10 client.20043 ms_handle_connect on v2:172.21.15.173:6836/3674805378 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f413f7fe640 1 -- 172.21.15.12:0/2001561269 <== mds.2 v2:172.21.15.173:6836/3674805378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556236443d70 con 0x55623655bbd0 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f413f7fe640 10 client.20043 handle_command_reply: tid=0 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.460+0000 7f4168680740 1 client.20043 shutdown 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 1 -- 172.21.15.12:0/2001561269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 msgr2=0x5562364e94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e94b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f4150000c00 tx=0x7f4150006d10 comp rx=0 tx=0).stop 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 1 -- 172.21.15.12:0/2001561269 shutdown_connections 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.173:6836/3674805378,v1:172.21.15.173:6837/3674805378] conn(0x55623655bbd0 0x55623655dff0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5562364e1370 0x5562364da5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5562364d7b40 0x5562364e99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 1 --2- 172.21.15.12:0/2001561269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5562364d65d0 0x5562364e94b0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 1 -- 172.21.15.12:0/2001561269 >> 172.21.15.12:0/2001561269 conn(0x55623649f310 msgr2=0x5562364d14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f413f7fe640 0 client.20043 ms_handle_reset on v2:172.21.15.173:6836/3674805378 2024-09-19T06:56:39.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 1 -- 172.21.15.12:0/2001561269 shutdown_connections 2024-09-19T06:56:39.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 1 -- 172.21.15.12:0/2001561269 wait complete. 2024-09-19T06:56:39.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f4168680740 20 client.20043 trim_cache size 0 max 16384 2024-09-19T06:56:39.478 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f41662a7640 1 -- 172.21.15.12:0/446346134 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41480a33b0 msgr2=0x7f41480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f41662a7640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41480a33b0 0x7f41480a5870 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f41540133d0 tx=0x7f4154022f90 comp rx=0 tx=0).stop 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f41662a7640 1 -- 172.21.15.12:0/446346134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4160106a80 msgr2=0x7f41601030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.461+0000 7f41662a7640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4160106a80 0x7f41601030d0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f4158033040 tx=0x7f4158031e60 comp rx=0 tx=0).stop 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.462+0000 7f41662a7640 1 -- 172.21.15.12:0/446346134 shutdown_connections 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.462+0000 7f41662a7640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4160106a80 0x7f41601030d0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.462+0000 7f41662a7640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4160101420 0x7f4160102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.462+0000 7f41662a7640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f41480a33b0 0x7f41480a5870 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.462+0000 7f41662a7640 1 --2- 172.21.15.12:0/446346134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4160100a80 0x7f4160102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.462+0000 7f41662a7640 1 -- 172.21.15.12:0/446346134 >> 172.21.15.12:0/446346134 conn(0x7f41600fc7a0 msgr2=0x7f416006a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.462+0000 7f41662a7640 1 -- 172.21.15.12:0/446346134 shutdown_connections 2024-09-19T06:56:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:39.462+0000 7f41662a7640 1 -- 172.21.15.12:0/446346134 wait complete. 2024-09-19T06:56:40.077 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:40 smithi012 ceph-mon[30937]: pgmap v518: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-09-19T06:56:40.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:56:40.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:40 smithi173 ceph-mon[35349]: pgmap v518: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-09-19T06:56:40.365 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:40.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:40 smithi016 ceph-mon[34911]: pgmap v518: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-09-19T06:56:40.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.847+0000 7f9fa6afb640 1 -- 172.21.15.12:0/2451473173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0101de0 msgr2=0x7f9fa01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:40.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.847+0000 7f9fa6afb640 1 --2- 172.21.15.12:0/2451473173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0101de0 0x7f9fa01021c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009900 tx=0x7f9f9c02a410 comp rx=0 tx=0).stop 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.847+0000 7f9fa6afb640 1 -- 172.21.15.12:0/2451473173 shutdown_connections 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.847+0000 7f9fa6afb640 1 --2- 172.21.15.12:0/2451473173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa0106f10 0x7f9fa010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.847+0000 7f9fa6afb640 1 --2- 172.21.15.12:0/2451473173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fa0102790 0x7f9fa01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.847+0000 7f9fa6afb640 1 --2- 172.21.15.12:0/2451473173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0101de0 0x7f9fa01021c0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.847+0000 7f9fa6afb640 1 -- 172.21.15.12:0/2451473173 >> 172.21.15.12:0/2451473173 conn(0x7f9fa00fd8c0 msgr2=0x7f9fa00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.847+0000 7f9fa6afb640 1 -- 172.21.15.12:0/2451473173 shutdown_connections 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.847+0000 7f9fa6afb640 1 -- 172.21.15.12:0/2451473173 wait complete. 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9fa6afb640 1 Processor -- start 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9fa6afb640 1 -- start start 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9fa6afb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa0101de0 0x7f9fa00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9fa6afb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0102790 0x7f9fa0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9fa6afb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fa0106f10 0x7f9fa0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9fa6afb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0111f70 con 0x7f9fa0102790 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9fa6afb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0111df0 con 0x7f9fa0106f10 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9fa6afb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa01120f0 con 0x7f9fa0101de0 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0102790 0x7f9fa0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0102790 0x7f9fa0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40974/0 (socket says 172.21.15.12:40974) 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9f97fff640 1 -- 172.21.15.12:0/865576780 learned_addr learned my addr 172.21.15.12:0/865576780 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.848+0000 7f9fa5098640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fa0106f10 0x7f9fa0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9fa4897640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa0101de0 0x7f9fa00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9f97fff640 1 -- 172.21.15.12:0/865576780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa0101de0 msgr2=0x7f9fa00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9f97fff640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa0101de0 0x7f9fa00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9f97fff640 1 -- 172.21.15.12:0/865576780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fa0106f10 msgr2=0x7f9fa0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9f97fff640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fa0106f10 0x7f9fa0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9f97fff640 1 -- 172.21.15.12:0/865576780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa01a6990 con 0x7f9fa0102790 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9f97fff640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0102790 0x7f9fa0074a30 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000d950 tx=0x7f9f9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9f95ffb640 1 -- 172.21.15.12:0/865576780 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f90017030 con 0x7f9fa0102790 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9fa6afb640 1 -- 172.21.15.12:0/865576780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa01a6c80 con 0x7f9fa0102790 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9f95ffb640 1 -- 172.21.15.12:0/865576780 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f90004020 con 0x7f9fa0102790 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9f95ffb640 1 -- 172.21.15.12:0/865576780 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f900047a0 con 0x7f9fa0102790 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.849+0000 7f9fa6afb640 1 -- 172.21.15.12:0/865576780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa01a71c0 con 0x7f9fa0102790 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.851+0000 7f9f95ffb640 1 -- 172.21.15.12:0/865576780 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9f900041d0 con 0x7f9fa0102790 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa8ed4740 1 Processor -- start 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa8ed4740 1 -- start start 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e85090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e855d0 0x5575e0e85a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 0x5575e0e92760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5575e0deb2f0 con 0x5575e0e86b40 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5575e0d92cf0 con 0x5575e0e90370 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5575e0de72b0 con 0x5575e0e855d0 2024-09-19T06:56:40.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa5098640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e85090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa5098640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e85090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40978/0 (socket says 172.21.15.12:40978) 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa5098640 1 -- 172.21.15.12:0/1127720583 learned_addr learned my addr 172.21.15.12:0/1127720583 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9f95ffb640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f880a33b0 0x7f9f880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa5098640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f880a33b0 0x7f9f880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9fa4897640 1 --2- 172.21.15.12:0/1127720583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e855d0 0x5575e0e85a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.852+0000 7f9f97fff640 1 --2- 172.21.15.12:0/1127720583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 0x5575e0e92760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9f95ffb640 1 -- 172.21.15.12:0/865576780 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f9f900cf7a0 con 0x7f9fa0102790 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9fa5098640 1 -- 172.21.15.12:0/1127720583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e855d0 msgr2=0x5575e0e85a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9fa5098640 1 --2- 172.21.15.12:0/1127720583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e855d0 0x5575e0e85a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9fa5098640 1 -- 172.21.15.12:0/1127720583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 msgr2=0x5575e0e92760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9fa5098640 1 --2- 172.21.15.12:0/1127720583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 0x5575e0e92760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9fa5098640 1 -- 172.21.15.12:0/1127720583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e0d773a0 con 0x5575e0e86b40 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9f97fff640 1 --2- 172.21.15.12:0/1127720583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 0x5575e0e92760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:40.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9fa5098640 1 --2- 172.21.15.12:0/1127720583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e85090 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f9f98014a60 tx=0x7f9f98014f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb76d3027ea303 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9f86ffd640 1 -- 172.21.15.12:0/1127720583 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9801ec50 con 0x5575e0e86b40 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9f86ffd640 1 -- 172.21.15.12:0/1127720583 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f98023070 con 0x5575e0e86b40 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9f86ffd640 1 -- 172.21.15.12:0/1127720583 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98005530 con 0x5575e0e86b40 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.853+0000 7f9fa5098640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f880a33b0 0x7f9f880a5870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9f98022000 tx=0x7f9f9801e000 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1127720583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 msgr2=0x5575e0e85090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1127720583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e85090 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f9f98014a60 tx=0x7f9f98014f20 comp rx=0 tx=0).stop 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1127720583 shutdown_connections 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1127720583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 0x5575e0e92760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1127720583 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e855d0 0x5575e0e85a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1127720583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e85090 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1127720583 >> 172.21.15.12:0/1127720583 conn(0x5575e0e4e310 msgr2=0x5575e0e81c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1127720583 shutdown_connections 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1127720583 wait complete. 2024-09-19T06:56:40.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 -- start start 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.854+0000 7f9fa8ed4740 1 Processor -- start 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e855d0 0x5575e0e8fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e8d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 0x5575e0e8d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5575e0e93070 con 0x5575e0e86b40 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5575e0da6060 con 0x5575e0e90370 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5575e0e931f0 con 0x5575e0e855d0 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa8ed4740 10 client.0 _ll_register_callbacks cb 0x5575e0af98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e8d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e8d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40984/0 (socket says 172.21.15.12:40984) 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f97fff640 1 -- 172.21.15.12:0/2244085300 learned_addr learned my addr 172.21.15.12:0/2244085300 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa5098640 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 0x5575e0e8d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa4897640 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e855d0 0x5575e0e8fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f97fff640 1 -- 172.21.15.12:0/2244085300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e855d0 msgr2=0x5575e0e8fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f97fff640 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e855d0 0x5575e0e8fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f97fff640 1 -- 172.21.15.12:0/2244085300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 msgr2=0x5575e0e8d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f97fff640 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 0x5575e0e8d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f97fff640 1 -- 172.21.15.12:0/2244085300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e0b5c3c0 con 0x5575e0e86b40 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa5098640 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 0x5575e0e8d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f97fff640 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e8d000 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f9f900cd450 tx=0x7f9f90021c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc34083bc74487b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f7ffff640 1 -- 172.21.15.12:0/2244085300 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9009c0e0 con 0x5575e0e86b40 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9f7ffff640 1 -- 172.21.15.12:0/2244085300 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f9f90098050 con 0x5575e0e86b40 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.855+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/2244085300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f98023070 con 0x5575e0e86b40 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9f7ffff640 1 -- 172.21.15.12:0/2244085300 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f9f9009b9e0 con 0x5575e0e86b40 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9fa8ed4740 10 client.20055 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:40.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/2244085300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5575e0e9eaf0 con 0x5575e0e86b40 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9f7ffff640 1 -- 172.21.15.12:0/2244085300 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f98023070 con 0x5575e0e86b40 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9f7ffff640 1 -- 172.21.15.12:0/2244085300 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7f9f90084ce0 con 0x5575e0e86b40 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9fa8ed4740 10 client.20055 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9fa8ed4740 10 client.20055 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9fa8ed4740 20 client.20055 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5575e0e9ffb0 0x5575e0ea23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9fa8ed4740 4 client.20055 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.856+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/2244085300 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575e0df8860 con 0x5575e0e9ffb0 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.857+0000 7f9fa4897640 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5575e0e9ffb0 0x5575e0ea23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.857+0000 7f9fa4897640 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5575e0e9ffb0 0x5575e0ea23a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a47e86e94b9ef045 server_cookie=cf9a526d7acd4197 in_seq=0 out_seq=0 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.857+0000 7f9f7ffff640 10 client.20055 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9f7ffff640 1 -- 172.21.15.12:0/2244085300 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575e0df8860 con 0x5575e0e9ffb0 2024-09-19T06:56:40.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9f7ffff640 10 client.20055 handle_command_reply: tid=0 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 client.20055 shutdown 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/2244085300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 msgr2=0x5575e0e8d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e8d000 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f9f900cd450 tx=0x7f9f90021c30 comp rx=0 tx=0).stop 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/2244085300 shutdown_connections 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5575e0e9ffb0 0x5575e0ea23a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e90370 0x5575e0e8d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e8d000 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/2244085300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e855d0 0x5575e0e8fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9f7ffff640 0 client.20055 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/2244085300 >> 172.21.15.12:0/2244085300 conn(0x5575e0e4e310 msgr2=0x5575e0e87930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/2244085300 shutdown_connections 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/2244085300 wait complete. 2024-09-19T06:56:40.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.858+0000 7f9fa8ed4740 20 client.20055 trim_cache size 0 max 16384 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9fa8ed4740 1 Processor -- start 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9fa8ed4740 1 -- start start 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e855d0 0x5575e0e9c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e88120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 0x5575e0e88660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa01afdc0 con 0x5575e0e86b40 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa01b19f0 con 0x5575e0e855d0 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa01b0490 con 0x5575e0e90370 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e88120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e88120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40996/0 (socket says 172.21.15.12:40996) 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.871+0000 7f9f97fff640 1 -- 172.21.15.12:0/1292045488 learned_addr learned my addr 172.21.15.12:0/1292045488 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9fa4897640 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e855d0 0x5575e0e9c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9fa5098640 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 0x5575e0e88660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9f97fff640 1 -- 172.21.15.12:0/1292045488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 msgr2=0x5575e0e88660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9f97fff640 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 0x5575e0e88660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9f97fff640 1 -- 172.21.15.12:0/1292045488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e855d0 msgr2=0x5575e0e9c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9f97fff640 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e855d0 0x5575e0e9c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9f97fff640 1 -- 172.21.15.12:0/1292045488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e0e8b550 con 0x5575e0e86b40 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9fa5098640 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 0x5575e0e88660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9fa4897640 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e855d0 0x5575e0e9c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9f97fff640 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e88120 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f9f9009b970 tx=0x7f9f90009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556af964ee8c2469 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9f867fc640 1 -- 172.21.15.12:0/1292045488 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9009b340 con 0x5575e0e86b40 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9f867fc640 1 -- 172.21.15.12:0/1292045488 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f9009c0e0 con 0x5575e0e86b40 2024-09-19T06:56:40.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.872+0000 7f9f867fc640 1 -- 172.21.15.12:0/1292045488 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9009ae30 con 0x5575e0e86b40 2024-09-19T06:56:40.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1292045488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 msgr2=0x5575e0e88120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:40.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e88120 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f9f9009b970 tx=0x7f9f90009740 comp rx=0 tx=0).stop 2024-09-19T06:56:40.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1292045488 shutdown_connections 2024-09-19T06:56:40.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 0x5575e0e88660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e86b40 0x5575e0e88120 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1292045488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e855d0 0x5575e0e9c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1292045488 >> 172.21.15.12:0/1292045488 conn(0x5575e0e4e310 msgr2=0x5575e0e8c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1292045488 shutdown_connections 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1292045488 wait complete. 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 -- start start 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.873+0000 7f9fa8ed4740 1 Processor -- start 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e855d0 0x5575e0e8a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e86b40 0x5575e0e8a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa8ed4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 0x5575e0e8ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa01b1260 con 0x5575e0e855d0 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa01b0b90 con 0x5575e0e86b40 2024-09-19T06:56:40.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa8ed4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa01addc0 con 0x5575e0e90370 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa8ed4740 10 client.0 _ll_register_callbacks cb 0x7f9f900046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa4897640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e855d0 0x5575e0e8a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa4897640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e855d0 0x5575e0e8a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41008/0 (socket says 172.21.15.12:41008) 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa4897640 1 -- 172.21.15.12:0/1588425566 learned_addr learned my addr 172.21.15.12:0/1588425566 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9f97fff640 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e86b40 0x5575e0e8a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa5098640 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 0x5575e0e8ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa4897640 1 -- 172.21.15.12:0/1588425566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 msgr2=0x5575e0e8ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa4897640 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 0x5575e0e8ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa4897640 1 -- 172.21.15.12:0/1588425566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e86b40 msgr2=0x5575e0e8a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa4897640 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e86b40 0x5575e0e8a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa4897640 1 -- 172.21.15.12:0/1588425566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e0f09df0 con 0x5575e0e855d0 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa5098640 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 0x5575e0e8ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:40.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9fa4897640 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e855d0 0x5575e0e8a1d0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009900 tx=0x7f9f9c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb04e3020fd43ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.874+0000 7f9f7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9f7ffff640 1 -- 172.21.15.12:0/1588425566 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c035070 con 0x5575e0e855d0 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9f7ffff640 1 -- 172.21.15.12:0/1588425566 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f9f9c005040 con 0x5575e0e855d0 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1588425566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f9009c0e0 con 0x5575e0e855d0 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9f7ffff640 1 -- 172.21.15.12:0/1588425566 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f9f9c052050 con 0x5575e0e855d0 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9fa8ed4740 10 client.20061 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1588425566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5575e0f0b060 con 0x5575e0e855d0 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9f7ffff640 1 -- 172.21.15.12:0/1588425566 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f9009c0e0 con 0x5575e0e855d0 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9f7ffff640 1 -- 172.21.15.12:0/1588425566 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7f9f9c0035f0 con 0x5575e0e855d0 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9fa8ed4740 10 client.20061 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9fa8ed4740 10 client.20061 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9fa8ed4740 20 client.20061 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:40.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5575e0f0b7d0 0x5575e0f0dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9fa8ed4740 4 client.20061 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.875+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1588425566 --> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5575e0df2d70 con 0x5575e0f0b7d0 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9f97fff640 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5575e0f0b7d0 0x5575e0f0dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9f97fff640 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5575e0f0b7d0 0x5575e0f0dbc0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83128805def87414 server_cookie=65ebf5dbb50614bd in_seq=0 out_seq=0 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9f7ffff640 10 client.20061 ms_handle_connect on v2:172.21.15.173:6838/2051533953 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9f7ffff640 1 -- 172.21.15.12:0/1588425566 <== mds.1 v2:172.21.15.173:6838/2051533953 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5575e0df2d70 con 0x5575e0f0b7d0 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9f7ffff640 10 client.20061 handle_command_reply: tid=0 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9fa8ed4740 1 client.20061 shutdown 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1588425566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e855d0 msgr2=0x5575e0e8a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e855d0 0x5575e0e8a1d0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009900 tx=0x7f9f9c004040 comp rx=0 tx=0).stop 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1588425566 shutdown_connections 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.173:6838/2051533953,v1:172.21.15.173:6839/2051533953] conn(0x5575e0f0b7d0 0x5575e0f0dbc0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5575e0e90370 0x5575e0e8ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5575e0e86b40 0x5575e0e8a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9fa8ed4740 1 --2- 172.21.15.12:0/1588425566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0e855d0 0x5575e0e8a1d0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1588425566 >> 172.21.15.12:0/1588425566 conn(0x5575e0e4e310 msgr2=0x5575e0e8e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:40.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.876+0000 7f9f7ffff640 0 client.20061 ms_handle_reset on v2:172.21.15.173:6838/2051533953 2024-09-19T06:56:40.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1588425566 shutdown_connections 2024-09-19T06:56:40.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa8ed4740 1 -- 172.21.15.12:0/1588425566 wait complete. 2024-09-19T06:56:40.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa8ed4740 20 client.20061 trim_cache size 0 max 16384 2024-09-19T06:56:40.892 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:56:40.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa6afb640 1 -- 172.21.15.12:0/865576780 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f880a33b0 msgr2=0x7f9f880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:40.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa6afb640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f880a33b0 0x7f9f880a5870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9f98022000 tx=0x7f9f9801e000 comp rx=0 tx=0).stop 2024-09-19T06:56:40.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa6afb640 1 -- 172.21.15.12:0/865576780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0102790 msgr2=0x7f9fa0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:40.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa6afb640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0102790 0x7f9fa0074a30 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000d950 tx=0x7f9f9000de10 comp rx=0 tx=0).stop 2024-09-19T06:56:40.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa6afb640 1 -- 172.21.15.12:0/865576780 shutdown_connections 2024-09-19T06:56:40.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa6afb640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fa0106f10 0x7f9fa0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa6afb640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0102790 0x7f9fa0074a30 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa6afb640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9f880a33b0 0x7f9f880a5870 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa6afb640 1 --2- 172.21.15.12:0/865576780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa0101de0 0x7f9fa00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:40.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.877+0000 7f9fa6afb640 1 -- 172.21.15.12:0/865576780 >> 172.21.15.12:0/865576780 conn(0x7f9fa00fd8c0 msgr2=0x7f9fa00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:40.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.878+0000 7f9fa6afb640 1 -- 172.21.15.12:0/865576780 shutdown_connections 2024-09-19T06:56:40.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:40.878+0000 7f9fa6afb640 1 -- 172.21.15.12:0/865576780 wait complete. 2024-09-19T06:56:41.765 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:56:42.028 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:42.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:42 smithi012 ceph-mon[30937]: pgmap v519: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-19T06:56:42.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:42 smithi173 ceph-mon[35349]: pgmap v519: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-19T06:56:42.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:42 smithi016 ceph-mon[34911]: pgmap v519: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 KiB/s wr, 18 op/s 2024-09-19T06:56:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.513+0000 7f7e5231b640 1 -- 172.21.15.12:0/733126549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4c10c170 msgr2=0x7f7e4c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.513+0000 7f7e5231b640 1 --2- 172.21.15.12:0/733126549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4c10c170 0x7f7e4c10e610 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009ca0 tx=0x7f7e4402a950 comp rx=0 tx=0).stop 2024-09-19T06:56:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.513+0000 7f7e5231b640 1 -- 172.21.15.12:0/733126549 shutdown_connections 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.513+0000 7f7e5231b640 1 --2- 172.21.15.12:0/733126549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4c10c170 0x7f7e4c10e610 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.513+0000 7f7e5231b640 1 --2- 172.21.15.12:0/733126549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e4c103660 0x7f7e4c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.513+0000 7f7e5231b640 1 --2- 172.21.15.12:0/733126549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e4c102d40 0x7f7e4c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.513+0000 7f7e5231b640 1 -- 172.21.15.12:0/733126549 >> 172.21.15.12:0/733126549 conn(0x7f7e4c0fc7a0 msgr2=0x7f7e4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.513+0000 7f7e5231b640 1 -- 172.21.15.12:0/733126549 shutdown_connections 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.514+0000 7f7e5231b640 1 -- 172.21.15.12:0/733126549 wait complete. 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.514+0000 7f7e5231b640 1 Processor -- start 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.514+0000 7f7e5231b640 1 -- start start 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.514+0000 7f7e5231b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e4c102d40 0x7f7e4c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.514+0000 7f7e5231b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4c103660 0x7f7e4c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.514+0000 7f7e5231b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e4c10c170 0x7f7e4c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.514+0000 7f7e5231b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c111fb0 con 0x7f7e4c103660 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.514+0000 7f7e5231b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c111e30 con 0x7f7e4c102d40 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.514+0000 7f7e5231b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c112130 con 0x7f7e4c10c170 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e4b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4c103660 0x7f7e4c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e4b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4c103660 0x7f7e4c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41020/0 (socket says 172.21.15.12:41020) 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/1478334844 learned_addr learned my addr 172.21.15.12:0/1478334844 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e4c102d40 0x7f7e4c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e508b8640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e4c10c170 0x7f7e4c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/1478334844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e4c10c170 msgr2=0x7f7e4c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e4c10c170 0x7f7e4c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/1478334844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e4c102d40 msgr2=0x7f7e4c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e4c102d40 0x7f7e4c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/1478334844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c19d3e0 con 0x7f7e4c103660 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4c103660 0x7f7e4c198970 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000b3f0 tx=0x7f7e4000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e497fa640 1 -- 172.21.15.12:0/1478334844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40015020 con 0x7f7e4c103660 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e497fa640 1 -- 172.21.15.12:0/1478334844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e40011d10 con 0x7f7e4c103660 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e5231b640 1 -- 172.21.15.12:0/1478334844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4c19d6d0 con 0x7f7e4c103660 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e497fa640 1 -- 172.21.15.12:0/1478334844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000f2e0 con 0x7f7e4c103660 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.515+0000 7f7e5231b640 1 -- 172.21.15.12:0/1478334844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4c1a4fb0 con 0x7f7e4c103660 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.518+0000 7f7e497fa640 1 -- 172.21.15.12:0/1478334844 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7e40018020 con 0x7f7e4c103660 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.518+0000 7f7e546f4740 1 Processor -- start 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.518+0000 7f7e546f4740 1 -- start start 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.518+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543fb40 0x5602a543e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.518+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543e5d0 0x5602a543ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.518+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 0x5602a544fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.518+0000 7f7e546f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5602a53a42f0 con 0x5602a543e5d0 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.518+0000 7f7e546f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5602a534bcf0 con 0x5602a543fb40 2024-09-19T06:56:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.518+0000 7f7e546f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5602a53a02b0 con 0x5602a544d780 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.518+0000 7f7e4bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543e5d0 0x5602a543ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e4bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543e5d0 0x5602a543ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41030/0 (socket says 172.21.15.12:41030) 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e4bfff640 1 -- 172.21.15.12:0/2347057727 learned_addr learned my addr 172.21.15.12:0/2347057727 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e508b8640 1 --2- 172.21.15.12:0/2347057727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543fb40 0x5602a543e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/2347057727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 0x5602a544fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e4bfff640 1 -- 172.21.15.12:0/2347057727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 msgr2=0x5602a544fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/2347057727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 0x5602a544fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e4bfff640 1 -- 172.21.15.12:0/2347057727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543fb40 msgr2=0x5602a543e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/2347057727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543fb40 0x5602a543e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e4bfff640 1 -- 172.21.15.12:0/2347057727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a53303a0 con 0x5602a543e5d0 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e497fa640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e340a33b0 0x7f7e340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/2347057727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 0x5602a544fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:42.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e508b8640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e340a33b0 0x7f7e340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/2347057727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543e5d0 0x5602a543ea10 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00bd10 tx=0x7f7e3c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c55f2b1ec0b053c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e497fa640 1 -- 172.21.15.12:0/1478334844 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f7e400cf500 con 0x7f7e4c103660 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e327fc640 1 -- 172.21.15.12:0/2347057727 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c004030 con 0x5602a543e5d0 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e327fc640 1 -- 172.21.15.12:0/2347057727 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e3c0041d0 con 0x5602a543e5d0 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.519+0000 7f7e327fc640 1 -- 172.21.15.12:0/2347057727 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0117c0 con 0x5602a543e5d0 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.520+0000 7f7e546f4740 1 -- 172.21.15.12:0/2347057727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543e5d0 msgr2=0x5602a543ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.520+0000 7f7e508b8640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e340a33b0 0x7f7e340a5870 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009430 tx=0x7f7e44009360 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.520+0000 7f7e546f4740 1 --2- 172.21.15.12:0/2347057727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543e5d0 0x5602a543ea10 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00bd10 tx=0x7f7e3c0107a0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.520+0000 7f7e546f4740 1 -- 172.21.15.12:0/2347057727 shutdown_connections 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.520+0000 7f7e546f4740 1 --2- 172.21.15.12:0/2347057727 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 0x5602a544fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.520+0000 7f7e546f4740 1 --2- 172.21.15.12:0/2347057727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543e5d0 0x5602a543ea10 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.520+0000 7f7e546f4740 1 --2- 172.21.15.12:0/2347057727 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543fb40 0x5602a543e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.520+0000 7f7e546f4740 1 -- 172.21.15.12:0/2347057727 >> 172.21.15.12:0/2347057727 conn(0x5602a5407310 msgr2=0x5602a543ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.520+0000 7f7e546f4740 1 -- 172.21.15.12:0/2347057727 shutdown_connections 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.520+0000 7f7e546f4740 1 -- 172.21.15.12:0/2347057727 wait complete. 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.521+0000 7f7e546f4740 1 -- start start 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.521+0000 7f7e546f4740 1 Processor -- start 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.521+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543e5d0 0x5602a544d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.521+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a544a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.521+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 0x5602a544a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.521+0000 7f7e546f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5602a5450480 con 0x5602a543fb40 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.521+0000 7f7e546f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5602a535f060 con 0x5602a543e5d0 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.521+0000 7f7e546f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5602a5450600 con 0x5602a544d780 2024-09-19T06:56:42.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e546f4740 10 client.0 _ll_register_callbacks cb 0x5602a50b28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e508b8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 0x5602a544a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e4b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a544a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e508b8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 0x5602a544a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:38290/0 (socket says 172.21.15.12:38290) 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e4bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543e5d0 0x5602a544d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e508b8640 1 -- 172.21.15.12:0/3144182606 learned_addr learned my addr 172.21.15.12:0/3144182606 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/3144182606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 msgr2=0x5602a544a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 0x5602a544a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/3144182606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543e5d0 msgr2=0x5602a544d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543e5d0 0x5602a544d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/3144182606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602a51153c0 con 0x5602a543fb40 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543e5d0 0x5602a544d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a544a400 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f7e400cccc0 tx=0x7f7e4009b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c460cefdcdeae7b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/3144182606 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40010eb0 con 0x5602a543fb40 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/3144182606 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f7e40097ec0 con 0x5602a543fb40 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.522+0000 7f7e546f4740 1 -- 172.21.15.12:0/3144182606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e3c0041d0 con 0x5602a543fb40 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/3144182606 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f7e4009bf50 con 0x5602a543fb40 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e546f4740 10 client.20073 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e546f4740 1 -- 172.21.15.12:0/3144182606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5602a5441310 con 0x5602a543fb40 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/3144182606 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e3c0041d0 con 0x5602a543fb40 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/3144182606 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7f7e4009cb80 con 0x5602a543fb40 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e546f4740 10 client.20073 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e546f4740 10 client.20073 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e546f4740 20 client.20073 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e546f4740 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602a54427a0 0x5602a5444bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e546f4740 4 client.20073 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e546f4740 1 -- 172.21.15.12:0/3144182606 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602a53b1860 con 0x5602a54427a0 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.523+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602a54427a0 0x5602a5444bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.524+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602a54427a0 0x5602a5444bc0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75ade21e7efab945 server_cookie=943c9b97dd262589 in_seq=0 out_seq=0 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.524+0000 7f7e2b7fe640 10 client.20073 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.524+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/3144182606 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602a53b1860 con 0x5602a54427a0 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.524+0000 7f7e2b7fe640 10 client.20073 handle_command_reply: tid=0 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 client.20073 shutdown 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 -- 172.21.15.12:0/3144182606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 msgr2=0x5602a544a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a544a400 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f7e400cccc0 tx=0x7f7e4009b450 comp rx=0 tx=0).stop 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 -- 172.21.15.12:0/3144182606 shutdown_connections 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602a54427a0 0x5602a5444bc0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a544d780 0x5602a544a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a544a400 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 --2- 172.21.15.12:0/3144182606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543e5d0 0x5602a544d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 -- 172.21.15.12:0/3144182606 >> 172.21.15.12:0/3144182606 conn(0x5602a5407310 msgr2=0x5602a5440960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e2b7fe640 0 client.20073 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 -- 172.21.15.12:0/3144182606 shutdown_connections 2024-09-19T06:56:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 1 -- 172.21.15.12:0/3144182606 wait complete. 2024-09-19T06:56:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.525+0000 7f7e546f4740 20 client.20073 trim_cache size 0 max 16384 2024-09-19T06:56:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e546f4740 1 Processor -- start 2024-09-19T06:56:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e546f4740 1 -- start start 2024-09-19T06:56:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a543e5d0 0x5602a543ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543fb40 0x5602a5445460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a544d780 0x5602a54459a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e546f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ab9c0 con 0x5602a544d780 2024-09-19T06:56:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e546f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ad5f0 con 0x5602a543fb40 2024-09-19T06:56:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e546f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ac090 con 0x5602a543e5d0 2024-09-19T06:56:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e508b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a544d780 0x5602a54459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e508b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a544d780 0x5602a54459a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41062/0 (socket says 172.21.15.12:41062) 2024-09-19T06:56:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e508b8640 1 -- 172.21.15.12:0/2103214017 learned_addr learned my addr 172.21.15.12:0/2103214017 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/2103214017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543fb40 0x5602a5445460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/2103214017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a543e5d0 0x5602a543ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e508b8640 1 -- 172.21.15.12:0/2103214017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a543e5d0 msgr2=0x5602a543ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e508b8640 1 --2- 172.21.15.12:0/2103214017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a543e5d0 0x5602a543ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e508b8640 1 -- 172.21.15.12:0/2103214017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543fb40 msgr2=0x5602a5445460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e508b8640 1 --2- 172.21.15.12:0/2103214017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543fb40 0x5602a5445460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.539+0000 7f7e508b8640 1 -- 172.21.15.12:0/2103214017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a543f760 con 0x5602a544d780 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.540+0000 7f7e508b8640 1 --2- 172.21.15.12:0/2103214017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a544d780 0x5602a54459a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009ca0 tx=0x7f7e44040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c71ea9583ff597 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.540+0000 7f7e31ffb640 1 -- 172.21.15.12:0/2103214017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44034040 con 0x5602a544d780 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.540+0000 7f7e31ffb640 1 -- 172.21.15.12:0/2103214017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e44004040 con 0x5602a544d780 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.540+0000 7f7e31ffb640 1 -- 172.21.15.12:0/2103214017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44030710 con 0x5602a544d780 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 -- 172.21.15.12:0/2103214017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a544d780 msgr2=0x5602a54459a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 --2- 172.21.15.12:0/2103214017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a544d780 0x5602a54459a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009ca0 tx=0x7f7e44040000 comp rx=0 tx=0).stop 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 -- 172.21.15.12:0/2103214017 shutdown_connections 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 --2- 172.21.15.12:0/2103214017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a544d780 0x5602a54459a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 --2- 172.21.15.12:0/2103214017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a543fb40 0x5602a5445460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 --2- 172.21.15.12:0/2103214017 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a543e5d0 0x5602a543ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 -- 172.21.15.12:0/2103214017 >> 172.21.15.12:0/2103214017 conn(0x5602a5407310 msgr2=0x5602a543a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 -- 172.21.15.12:0/2103214017 shutdown_connections 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 -- 172.21.15.12:0/2103214017 wait complete. 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 -- start start 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.541+0000 7f7e546f4740 1 Processor -- start 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a543e5d0 0x5602a545e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a545e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e546f4740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a544d780 0x5602a54bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e546f4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ace60 con 0x5602a543fb40 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e546f4740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ac790 con 0x5602a544d780 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e546f4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1a99c0 con 0x5602a543e5d0 2024-09-19T06:56:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e546f4740 10 client.0 _ll_register_callbacks cb 0x7f7e4000b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e4b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a545e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e4b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a545e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41076/0 (socket says 172.21.15.12:41076) 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/964616259 learned_addr learned my addr 172.21.15.12:0/964616259 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e508b8640 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a544d780 0x5602a54bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a543e5d0 0x5602a545e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/964616259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a543e5d0 msgr2=0x5602a545e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a543e5d0 0x5602a545e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/964616259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a544d780 msgr2=0x5602a54bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a544d780 0x5602a54bbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e4b7fe640 1 -- 172.21.15.12:0/964616259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602a54bc420 con 0x5602a543fb40 2024-09-19T06:56:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e508b8640 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a544d780 0x5602a54bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e4b7fe640 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a545e970 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f7e400cf8b0 tx=0x7f7e400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d4689098ec78d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.542+0000 7f7e2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/964616259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40084d50 con 0x5602a543fb40 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/964616259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f7e4009aca0 con 0x5602a543fb40 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e546f4740 1 -- 172.21.15.12:0/964616259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e44004040 con 0x5602a543fb40 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/964616259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f7e4009b620 con 0x5602a543fb40 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e546f4740 10 client.20079 fetch_fsmap learned FSMap version 56 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e546f4740 1 -- 172.21.15.12:0/964616259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5602a54c37a0 con 0x5602a543fb40 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/964616259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e44004040 con 0x5602a543fb40 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/964616259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8382+0+0 (secure 0 0 0) 0x7f7e400975a0 con 0x5602a543fb40 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e546f4740 10 client.20079 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T06:56:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e546f4740 10 client.20079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:56:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e546f4740 20 client.20079 populate_metadata read hostname 'smithi012' 2024-09-19T06:56:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e546f4740 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602a54c3f80 0x5602a54c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e546f4740 4 client.20079 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:56:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.543+0000 7f7e546f4740 1 -- 172.21.15.12:0/964616259 --> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5602a53abd70 con 0x5602a54c3f80 2024-09-19T06:56:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.544+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602a54c3f80 0x5602a54c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.544+0000 7f7e4bfff640 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602a54c3f80 0x5602a54c63a0 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4449a51e6cc96150 server_cookie=dc170c5169fab64e in_seq=0 out_seq=0 2024-09-19T06:56:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.544+0000 7f7e2b7fe640 10 client.20079 ms_handle_connect on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.544+0000 7f7e2b7fe640 1 -- 172.21.15.12:0/964616259 <== mds.0 v2:172.21.15.16:6838/2939093038 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5602a53abd70 con 0x5602a54c3f80 2024-09-19T06:56:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.544+0000 7f7e2b7fe640 10 client.20079 handle_command_reply: tid=0 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.544+0000 7f7e546f4740 1 client.20079 shutdown 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.544+0000 7f7e546f4740 1 -- 172.21.15.12:0/964616259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 msgr2=0x5602a545e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.544+0000 7f7e546f4740 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a545e970 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f7e400cf8b0 tx=0x7f7e400046c0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.544+0000 7f7e546f4740 1 -- 172.21.15.12:0/964616259 shutdown_connections 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.544+0000 7f7e546f4740 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.16:6838/2939093038,v1:172.21.15.16:6839/2939093038] conn(0x5602a54c3f80 0x5602a54c63a0 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e546f4740 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5602a544d780 0x5602a54bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e546f4740 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5602a543fb40 0x5602a545e970 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e546f4740 1 --2- 172.21.15.12:0/964616259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5602a543e5d0 0x5602a545e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e546f4740 1 -- 172.21.15.12:0/964616259 >> 172.21.15.12:0/964616259 conn(0x5602a5407310 msgr2=0x5602a5445460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e2b7fe640 0 client.20079 ms_handle_reset on v2:172.21.15.16:6838/2939093038 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e546f4740 1 -- 172.21.15.12:0/964616259 shutdown_connections 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e546f4740 1 -- 172.21.15.12:0/964616259 wait complete. 2024-09-19T06:56:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e546f4740 20 client.20079 trim_cache size 0 max 16384 2024-09-19T06:56:42.554 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e5231b640 1 -- 172.21.15.12:0/1478334844 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e340a33b0 msgr2=0x7f7e340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e5231b640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e340a33b0 0x7f7e340a5870 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009430 tx=0x7f7e44009360 comp rx=0 tx=0).stop 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e5231b640 1 -- 172.21.15.12:0/1478334844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4c103660 msgr2=0x7f7e4c198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.545+0000 7f7e5231b640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4c103660 0x7f7e4c198970 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000b3f0 tx=0x7f7e4000b8b0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.546+0000 7f7e5231b640 1 -- 172.21.15.12:0/1478334844 shutdown_connections 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.546+0000 7f7e5231b640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7e340a33b0 0x7f7e340a5870 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.546+0000 7f7e5231b640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e4c10c170 0x7f7e4c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.546+0000 7f7e5231b640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4c103660 0x7f7e4c198970 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.546+0000 7f7e5231b640 1 --2- 172.21.15.12:0/1478334844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e4c102d40 0x7f7e4c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.546+0000 7f7e5231b640 1 -- 172.21.15.12:0/1478334844 >> 172.21.15.12:0/1478334844 conn(0x7f7e4c0fc7a0 msgr2=0x7f7e4c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.546+0000 7f7e5231b640 1 -- 172.21.15.12:0/1478334844 shutdown_connections 2024-09-19T06:56:42.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:42.546+0000 7f7e5231b640 1 -- 172.21.15.12:0/1478334844 wait complete. 2024-09-19T06:56:43.343 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T06:56:43.343 INFO:tasks.fwd_scrub:done joining 2024-09-19T06:56:43.344 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T06:56:43.355 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:56:43.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.463+0000 7f4b30dbd640 1 -- 172.21.15.12:0/503651105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b2c102d10 msgr2=0x7f4b2c1030f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:43.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.463+0000 7f4b30dbd640 1 --2- 172.21.15.12:0/503651105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b2c102d10 0x7f4b2c1030f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009900 tx=0x7f4b1c02a480 comp rx=0 tx=0).stop 2024-09-19T06:56:43.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.463+0000 7f4b30dbd640 1 -- 172.21.15.12:0/503651105 shutdown_connections 2024-09-19T06:56:43.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.463+0000 7f4b30dbd640 1 --2- 172.21.15.12:0/503651105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b2c10c0e0 0x7f4b2c10e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.463+0000 7f4b30dbd640 1 --2- 172.21.15.12:0/503651105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b2c103630 0x7f4b2c10bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.463+0000 7f4b30dbd640 1 --2- 172.21.15.12:0/503651105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b2c102d10 0x7f4b2c1030f0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.463+0000 7f4b30dbd640 1 -- 172.21.15.12:0/503651105 >> 172.21.15.12:0/503651105 conn(0x7f4b2c077a10 msgr2=0x7f4b2c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:43.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.463+0000 7f4b30dbd640 1 -- 172.21.15.12:0/503651105 shutdown_connections 2024-09-19T06:56:43.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.463+0000 7f4b30dbd640 1 -- 172.21.15.12:0/503651105 wait complete. 2024-09-19T06:56:43.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b30dbd640 1 Processor -- start 2024-09-19T06:56:43.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b30dbd640 1 -- start start 2024-09-19T06:56:43.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b30dbd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b2c102d10 0x7f4b2c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:43.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b30dbd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b2c103630 0x7f4b2c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b30dbd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b2c10c0e0 0x7f4b2c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b30dbd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c111e80 con 0x7f4b2c102d10 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b30dbd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c111d00 con 0x7f4b2c103630 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b30dbd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c112000 con 0x7f4b2c10c0e0 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b2a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b2c102d10 0x7f4b2c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b2a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b2c102d10 0x7f4b2c1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41096/0 (socket says 172.21.15.12:41096) 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b2a59c640 1 -- 172.21.15.12:0/4200905082 learned_addr learned my addr 172.21.15.12:0/4200905082 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b2ad9d640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b2c10c0e0 0x7f4b2c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.464+0000 7f4b23fff640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b2c103630 0x7f4b2c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b2a59c640 1 -- 172.21.15.12:0/4200905082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b2c10c0e0 msgr2=0x7f4b2c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b2a59c640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b2c10c0e0 0x7f4b2c19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b2a59c640 1 -- 172.21.15.12:0/4200905082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b2c103630 msgr2=0x7f4b2c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:43.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b2a59c640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b2c103630 0x7f4b2c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b2a59c640 1 -- 172.21.15.12:0/4200905082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c19d3c0 con 0x7f4b2c102d10 2024-09-19T06:56:43.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b23fff640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b2c103630 0x7f4b2c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:43.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b2a59c640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b2c102d10 0x7f4b2c1983d0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c006010 tx=0x7f4b1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:43.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b237fe640 1 -- 172.21.15.12:0/4200905082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c03f030 con 0x7f4b2c102d10 2024-09-19T06:56:43.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b30dbd640 1 -- 172.21.15.12:0/4200905082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2c19d650 con 0x7f4b2c102d10 2024-09-19T06:56:43.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b237fe640 1 -- 172.21.15.12:0/4200905082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b1c003ce0 con 0x7f4b2c102d10 2024-09-19T06:56:43.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b237fe640 1 -- 172.21.15.12:0/4200905082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c035070 con 0x7f4b2c102d10 2024-09-19T06:56:43.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.465+0000 7f4b30dbd640 1 -- 172.21.15.12:0/4200905082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2c1a4f40 con 0x7f4b2c102d10 2024-09-19T06:56:43.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.466+0000 7f4b30dbd640 1 -- 172.21.15.12:0/4200905082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2c1030f0 con 0x7f4b2c102d10 2024-09-19T06:56:43.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.467+0000 7f4b237fe640 1 -- 172.21.15.12:0/4200905082 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4b1c042030 con 0x7f4b2c102d10 2024-09-19T06:56:43.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.468+0000 7f4b237fe640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b180a3440 0x7f4b180a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:43.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.468+0000 7f4b237fe640 1 -- 172.21.15.12:0/4200905082 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f4b1c0f04f0 con 0x7f4b2c102d10 2024-09-19T06:56:43.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.468+0000 7f4b23fff640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b180a3440 0x7f4b180a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:43.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.468+0000 7f4b23fff640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b180a3440 0x7f4b180a5900 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4b14005d00 tx=0x7f4b14009550 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:43.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.471+0000 7f4b237fe640 1 -- 172.21.15.12:0/4200905082 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b1c0bce90 con 0x7f4b2c102d10 2024-09-19T06:56:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.647+0000 7f4b30dbd640 1 -- 172.21.15.12:0/4200905082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b2c107190 con 0x7f4b2c102d10 2024-09-19T06:56:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.649+0000 7f4b237fe640 1 -- 172.21.15.12:0/4200905082 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+23392 (secure 0 0 0) 0x7f4b1c0bc790 con 0x7f4b2c102d10 2024-09-19T06:56:43.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:43.651 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":106,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:56:14.969145+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":1}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6801/4060248487":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/3390758821":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1769692721":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/2160320420":"2024-09-20T06:40:08.069301+0000","172.21.15.12:6800/4060248487":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2954657663":"2024-09-20T06:40:08.069301+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:56:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 -- 172.21.15.12:0/4200905082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b180a3440 msgr2=0x7f4b180a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b180a3440 0x7f4b180a5900 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4b14005d00 tx=0x7f4b14009550 comp rx=0 tx=0).stop 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 -- 172.21.15.12:0/4200905082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b2c102d10 msgr2=0x7f4b2c1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b2c102d10 0x7f4b2c1983d0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c006010 tx=0x7f4b1c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 -- 172.21.15.12:0/4200905082 shutdown_connections 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f4b180a3440 0x7f4b180a5900 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b2c10c0e0 0x7f4b2c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b2c103630 0x7f4b2c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 --2- 172.21.15.12:0/4200905082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b2c102d10 0x7f4b2c1983d0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 -- 172.21.15.12:0/4200905082 >> 172.21.15.12:0/4200905082 conn(0x7f4b2c077a10 msgr2=0x7f4b2c0fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 -- 172.21.15.12:0/4200905082 shutdown_connections 2024-09-19T06:56:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.651+0000 7f4b30dbd640 1 -- 172.21.15.12:0/4200905082 wait complete. 2024-09-19T06:56:43.664 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:33:40.130755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:38:10.971934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:38:13.015596+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:56:43.665 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:56:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 -- 172.21.15.12:0/2211668105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0cc103610 msgr2=0x7fb0cc10baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 --2- 172.21.15.12:0/2211668105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0cc103610 0x7fb0cc10baf0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009900 tx=0x7fb0c002a480 comp rx=0 tx=0).stop 2024-09-19T06:56:43.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 -- 172.21.15.12:0/2211668105 shutdown_connections 2024-09-19T06:56:43.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 --2- 172.21.15.12:0/2211668105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0cc10c0c0 0x7fb0cc10e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 --2- 172.21.15.12:0/2211668105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0cc103610 0x7fb0cc10baf0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 --2- 172.21.15.12:0/2211668105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0cc102cf0 0x7fb0cc1030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 -- 172.21.15.12:0/2211668105 >> 172.21.15.12:0/2211668105 conn(0x7fb0cc0779d0 msgr2=0x7fb0cc0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:43.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 -- 172.21.15.12:0/2211668105 shutdown_connections 2024-09-19T06:56:43.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 -- 172.21.15.12:0/2211668105 wait complete. 2024-09-19T06:56:43.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 Processor -- start 2024-09-19T06:56:43.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.770+0000 7fb0d2837640 1 -- start start 2024-09-19T06:56:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0d2837640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0cc102cf0 0x7fb0cc100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0d2837640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0cc103610 0x7fb0cc100e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0d2837640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0cc10c0c0 0x7fb0cc1013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0d2837640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc111e90 con 0x7fb0cc102cf0 2024-09-19T06:56:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0d2837640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc111d10 con 0x7fb0cc103610 2024-09-19T06:56:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0d2837640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc112010 con 0x7fb0cc10c0c0 2024-09-19T06:56:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0cc102cf0 0x7fb0cc100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0cc102cf0 0x7fb0cc100940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41118/0 (socket says 172.21.15.12:41118) 2024-09-19T06:56:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cbfff640 1 -- 172.21.15.12:0/1573941772 learned_addr learned my addr 172.21.15.12:0/1573941772 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cb7fe640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0cc103610 0x7fb0cc100e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0d0dd4640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0cc10c0c0 0x7fb0cc1013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cbfff640 1 -- 172.21.15.12:0/1573941772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0cc10c0c0 msgr2=0x7fb0cc1013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cbfff640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0cc10c0c0 0x7fb0cc1013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cbfff640 1 -- 172.21.15.12:0/1573941772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0cc103610 msgr2=0x7fb0cc100e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cbfff640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0cc103610 0x7fb0cc100e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cbfff640 1 -- 172.21.15.12:0/1573941772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0cc1a6900 con 0x7fb0cc102cf0 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cb7fe640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0cc103610 0x7fb0cc100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0d0dd4640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0cc10c0c0 0x7fb0cc1013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.771+0000 7fb0cbfff640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0cc102cf0 0x7fb0cc100940 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00e9f0 tx=0x7fb0bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.772+0000 7fb0c97fa640 1 -- 172.21.15.12:0/1573941772 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc00cd80 con 0x7fb0cc102cf0 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.772+0000 7fb0d2837640 1 -- 172.21.15.12:0/1573941772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0cc1a6bf0 con 0x7fb0cc102cf0 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.772+0000 7fb0c97fa640 1 -- 172.21.15.12:0/1573941772 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0bc005500 con 0x7fb0cc102cf0 2024-09-19T06:56:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.772+0000 7fb0c97fa640 1 -- 172.21.15.12:0/1573941772 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc010690 con 0x7fb0cc102cf0 2024-09-19T06:56:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.772+0000 7fb0d2837640 1 -- 172.21.15.12:0/1573941772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0cc1a7140 con 0x7fb0cc102cf0 2024-09-19T06:56:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.773+0000 7fb0d2837640 1 -- 172.21.15.12:0/1573941772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0cc1030d0 con 0x7fb0cc102cf0 2024-09-19T06:56:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.774+0000 7fb0c97fa640 1 -- 172.21.15.12:0/1573941772 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb0bc0046c0 con 0x7fb0cc102cf0 2024-09-19T06:56:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.774+0000 7fb0c97fa640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0b40a33c0 0x7fb0b40a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.774+0000 7fb0c97fa640 1 -- 172.21.15.12:0/1573941772 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7fb0bc0d0520 con 0x7fb0cc102cf0 2024-09-19T06:56:43.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.775+0000 7fb0cb7fe640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0b40a33c0 0x7fb0b40a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:43.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.775+0000 7fb0cb7fe640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0b40a33c0 0x7fb0b40a5880 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0000c00 tx=0x7fb0c0032c30 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:43.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.778+0000 7fb0c97fa640 1 -- 172.21.15.12:0/1573941772 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0bc054210 con 0x7fb0cc102cf0 2024-09-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.953+0000 7fb0d2837640 1 -- 172.21.15.12:0/1573941772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb0cc02d7c0 con 0x7fb0cc102cf0 2024-09-19T06:56:43.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.953+0000 7fb0c97fa640 1 -- 172.21.15.12:0/1573941772 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) ==== 93+0+10 (secure 0 0 0) 0x7fb0bc09ce60 con 0x7fb0cc102cf0 2024-09-19T06:56:43.955 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-19T06:56:43.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 -- 172.21.15.12:0/1573941772 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0b40a33c0 msgr2=0x7fb0b40a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0b40a33c0 0x7fb0b40a5880 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0000c00 tx=0x7fb0c0032c30 comp rx=0 tx=0).stop 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 -- 172.21.15.12:0/1573941772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0cc102cf0 msgr2=0x7fb0cc100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0cc102cf0 0x7fb0cc100940 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00e9f0 tx=0x7fb0bc00edf0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 -- 172.21.15.12:0/1573941772 shutdown_connections 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fb0b40a33c0 0x7fb0b40a5880 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0cc10c0c0 0x7fb0cc1013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0cc103610 0x7fb0cc100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 --2- 172.21.15.12:0/1573941772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0cc102cf0 0x7fb0cc100940 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 -- 172.21.15.12:0/1573941772 >> 172.21.15.12:0/1573941772 conn(0x7fb0cc0779d0 msgr2=0x7fb0cc0fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 -- 172.21.15.12:0/1573941772 shutdown_connections 2024-09-19T06:56:43.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:43.955+0000 7fb0d2837640 1 -- 172.21.15.12:0/1573941772 wait complete. 2024-09-19T06:56:43.967 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:56:44.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 -- 172.21.15.12:0/3094472000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2470101320 msgr2=0x7f247010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 --2- 172.21.15.12:0/3094472000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2470101320 0x7f247010d850 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2458009930 tx=0x7f245802a420 comp rx=0 tx=0).stop 2024-09-19T06:56:44.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 -- 172.21.15.12:0/3094472000 shutdown_connections 2024-09-19T06:56:44.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 --2- 172.21.15.12:0/3094472000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2470101320 0x7f247010d850 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 --2- 172.21.15.12:0/3094472000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2470100980 0x7f2470100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 --2- 172.21.15.12:0/3094472000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2470106990 0x7f2470106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 -- 172.21.15.12:0/3094472000 >> 172.21.15.12:0/3094472000 conn(0x7f24700779d0 msgr2=0x7f24700fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 -- 172.21.15.12:0/3094472000 shutdown_connections 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 -- 172.21.15.12:0/3094472000 wait complete. 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 Processor -- start 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.074+0000 7f2476e42640 1 -- start start 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2476e42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2470100980 0x7f2470199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2476e42640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2470101320 0x7f2470199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2476e42640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2470106990 0x7f24701a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2476e42640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2470110e20 con 0x7f2470100980 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2476e42640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2470110ca0 con 0x7f2470101320 2024-09-19T06:56:44.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2476e42640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2470110fa0 con 0x7f2470106990 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2474bde640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2470100980 0x7f2470199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2474bde640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2470100980 0x7f2470199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41132/0 (socket says 172.21.15.12:41132) 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2474bde640 1 -- 172.21.15.12:0/2302742886 learned_addr learned my addr 172.21.15.12:0/2302742886 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f24753df640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2470106990 0x7f24701a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f246ffff640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2470101320 0x7f2470199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2474bde640 1 -- 172.21.15.12:0/2302742886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2470106990 msgr2=0x7f24701a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2474bde640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2470106990 0x7f24701a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2474bde640 1 -- 172.21.15.12:0/2302742886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2470101320 msgr2=0x7f2470199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2474bde640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2470101320 0x7f2470199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2474bde640 1 -- 172.21.15.12:0/2302742886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24701a4810 con 0x7f2470100980 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2474bde640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2470100980 0x7f2470199250 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f246800b4a0 tx=0x7f246800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f246dffb640 1 -- 172.21.15.12:0/2302742886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468014070 con 0x7f2470100980 2024-09-19T06:56:44.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f2476e42640 1 -- 172.21.15.12:0/2302742886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24701a49e0 con 0x7f2470100980 2024-09-19T06:56:44.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f246dffb640 1 -- 172.21.15.12:0/2302742886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2468010af0 con 0x7f2470100980 2024-09-19T06:56:44.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.075+0000 7f246dffb640 1 -- 172.21.15.12:0/2302742886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468017d10 con 0x7f2470100980 2024-09-19T06:56:44.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.076+0000 7f2476e42640 1 -- 172.21.15.12:0/2302742886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24701a4eb0 con 0x7f2470100980 2024-09-19T06:56:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.077+0000 7f2476e42640 1 -- 172.21.15.12:0/2302742886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2470100de0 con 0x7f2470100980 2024-09-19T06:56:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.078+0000 7f246dffb640 1 -- 172.21.15.12:0/2302742886 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2468017070 con 0x7f2470100980 2024-09-19T06:56:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.079+0000 7f246dffb640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f245c0a33c0 0x7f245c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.079+0000 7f246ffff640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f245c0a33c0 0x7f245c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.079+0000 7f246dffb640 1 -- 172.21.15.12:0/2302742886 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f24680cf4d0 con 0x7f2470100980 2024-09-19T06:56:44.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.079+0000 7f246ffff640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f245c0a33c0 0x7f245c0a5880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2470069ed0 tx=0x7f2460009870 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:44.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.082+0000 7f246dffb640 1 -- 172.21.15.12:0/2302742886 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f246809bf20 con 0x7f2470100980 2024-09-19T06:56:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.260+0000 7f2476e42640 1 -- 172.21.15.12:0/2302742886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f24701a50e0 con 0x7f2470100980 2024-09-19T06:56:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.260+0000 7f246dffb640 1 -- 172.21.15.12:0/2302742886 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v106) ==== 104+0+11 (secure 0 0 0) 0x7f246809b820 con 0x7f2470100980 2024-09-19T06:56:44.261 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-09-19T06:56:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.262+0000 7f2476e42640 1 -- 172.21.15.12:0/2302742886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f245c0a33c0 msgr2=0x7f245c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.262+0000 7f2476e42640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f245c0a33c0 0x7f245c0a5880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2470069ed0 tx=0x7f2460009870 comp rx=0 tx=0).stop 2024-09-19T06:56:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.262+0000 7f2476e42640 1 -- 172.21.15.12:0/2302742886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2470100980 msgr2=0x7f2470199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.262+0000 7f2476e42640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2470100980 0x7f2470199250 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f246800b4a0 tx=0x7f246800b960 comp rx=0 tx=0).stop 2024-09-19T06:56:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.263+0000 7f2476e42640 1 -- 172.21.15.12:0/2302742886 shutdown_connections 2024-09-19T06:56:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.263+0000 7f2476e42640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f245c0a33c0 0x7f245c0a5880 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.263+0000 7f2476e42640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2470106990 0x7f24701a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.263+0000 7f2476e42640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2470101320 0x7f2470199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.263+0000 7f2476e42640 1 --2- 172.21.15.12:0/2302742886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2470100980 0x7f2470199250 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.263+0000 7f2476e42640 1 -- 172.21.15.12:0/2302742886 >> 172.21.15.12:0/2302742886 conn(0x7f24700779d0 msgr2=0x7f24700ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.263+0000 7f2476e42640 1 -- 172.21.15.12:0/2302742886 shutdown_connections 2024-09-19T06:56:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.263+0000 7f2476e42640 1 -- 172.21.15.12:0/2302742886 wait complete. 2024-09-19T06:56:44.274 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:44 smithi012 ceph-mon[30937]: pgmap v520: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-09-19T06:56:44.274 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:44 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/4200905082' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:56:44.274 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:44 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1573941772' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:56:44.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:56:44.310 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:44 smithi016 ceph-mon[34911]: pgmap v520: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-09-19T06:56:44.311 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:44 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/4200905082' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:56:44.311 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:44 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1573941772' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:56:44.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:44 smithi173 ceph-mon[35349]: pgmap v520: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-09-19T06:56:44.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:44 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/4200905082' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:56:44.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:44 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1573941772' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:56:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.380+0000 7f9c6c847640 1 -- 172.21.15.12:0/1743767693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c6810c0d0 msgr2=0x7f9c6810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.380+0000 7f9c6c847640 1 --2- 172.21.15.12:0/1743767693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c6810c0d0 0x7f9c6810e550 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009ca0 tx=0x7f9c6002a950 comp rx=0 tx=0).stop 2024-09-19T06:56:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.380+0000 7f9c6c847640 1 -- 172.21.15.12:0/1743767693 shutdown_connections 2024-09-19T06:56:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.380+0000 7f9c6c847640 1 --2- 172.21.15.12:0/1743767693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c6810c0d0 0x7f9c6810e550 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.380+0000 7f9c6c847640 1 --2- 172.21.15.12:0/1743767693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c681035a0 0x7f9c6810ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.380+0000 7f9c6c847640 1 --2- 172.21.15.12:0/1743767693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c68102c80 0x7f9c68103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.380+0000 7f9c6c847640 1 -- 172.21.15.12:0/1743767693 >> 172.21.15.12:0/1743767693 conn(0x7f9c680fc690 msgr2=0x7f9c680feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.380+0000 7f9c6c847640 1 -- 172.21.15.12:0/1743767693 shutdown_connections 2024-09-19T06:56:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.380+0000 7f9c6c847640 1 -- 172.21.15.12:0/1743767693 wait complete. 2024-09-19T06:56:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c6c847640 1 Processor -- start 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c6c847640 1 -- start start 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c6c847640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c68102c80 0x7f9c68198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c6c847640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c681035a0 0x7f9c68198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c6c847640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c6810c0d0 0x7f9c6819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c6c847640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9c68111ef0 con 0x7f9c681035a0 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c6c847640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c68111d70 con 0x7f9c6810c0d0 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c6c847640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9c68112070 con 0x7f9c68102c80 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c5ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c681035a0 0x7f9c68198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c5ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c681035a0 0x7f9c68198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41158/0 (socket says 172.21.15.12:41158) 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.381+0000 7f9c5ffff640 1 -- 172.21.15.12:0/1507763060 learned_addr learned my addr 172.21.15.12:0/1507763060 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c6659c640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c68102c80 0x7f9c68198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c66d9d640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c6810c0d0 0x7f9c6819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c5ffff640 1 -- 172.21.15.12:0/1507763060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c68102c80 msgr2=0x7f9c68198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c5ffff640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c68102c80 0x7f9c68198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c5ffff640 1 -- 172.21.15.12:0/1507763060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c6810c0d0 msgr2=0x7f9c6819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c5ffff640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c6810c0d0 0x7f9c6819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c5ffff640 1 -- 172.21.15.12:0/1507763060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6819d4f0 con 0x7f9c681035a0 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c5ffff640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c681035a0 0x7f9c68198a40 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000b3f0 tx=0x7f9c5000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c5f7fe640 1 -- 172.21.15.12:0/1507763060 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50015020 con 0x7f9c681035a0 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c6c847640 1 -- 172.21.15.12:0/1507763060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c6819d7e0 con 0x7f9c681035a0 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c5f7fe640 1 -- 172.21.15.12:0/1507763060 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c50011d10 con 0x7f9c681035a0 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c5f7fe640 1 -- 172.21.15.12:0/1507763060 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000f2e0 con 0x7f9c681035a0 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.382+0000 7f9c6c847640 1 -- 172.21.15.12:0/1507763060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c681a5070 con 0x7f9c681035a0 2024-09-19T06:56:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.383+0000 7f9c6c847640 1 -- 172.21.15.12:0/1507763060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c68103060 con 0x7f9c681035a0 2024-09-19T06:56:44.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.384+0000 7f9c5f7fe640 1 -- 172.21.15.12:0/1507763060 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9c50018020 con 0x7f9c681035a0 2024-09-19T06:56:44.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.385+0000 7f9c5f7fe640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9c540a33c0 0x7f9c540a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.385+0000 7f9c6659c640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9c540a33c0 0x7f9c540a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.385+0000 7f9c5f7fe640 1 -- 172.21.15.12:0/1507763060 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f9c500cf650 con 0x7f9c681035a0 2024-09-19T06:56:44.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.386+0000 7f9c6659c640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9c540a33c0 0x7f9c540a5880 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9c58005fd0 tx=0x7f9c58005850 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:44.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.389+0000 7f9c5f7fe640 1 -- 172.21.15.12:0/1507763060 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c5001f020 con 0x7f9c681035a0 2024-09-19T06:56:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.566+0000 7f9c6c847640 1 -- 172.21.15.12:0/1507763060 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9c68107150 con 0x7f9c681035a0 2024-09-19T06:56:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.567+0000 7f9c5f7fe640 1 -- 172.21.15.12:0/1507763060 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v106) ==== 100+0+11 (secure 0 0 0) 0x7f9c5009c040 con 0x7f9c681035a0 2024-09-19T06:56:44.568 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-09-19T06:56:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 -- 172.21.15.12:0/1507763060 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9c540a33c0 msgr2=0x7f9c540a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9c540a33c0 0x7f9c540a5880 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9c58005fd0 tx=0x7f9c58005850 comp rx=0 tx=0).stop 2024-09-19T06:56:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 -- 172.21.15.12:0/1507763060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c681035a0 msgr2=0x7f9c68198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c681035a0 0x7f9c68198a40 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000b3f0 tx=0x7f9c5000b8b0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 -- 172.21.15.12:0/1507763060 shutdown_connections 2024-09-19T06:56:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c6810c0d0 0x7f9c6819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c681035a0 0x7f9c68198a40 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f9c540a33c0 0x7f9c540a5880 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 --2- 172.21.15.12:0/1507763060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9c68102c80 0x7f9c68198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 -- 172.21.15.12:0/1507763060 >> 172.21.15.12:0/1507763060 conn(0x7f9c680fc690 msgr2=0x7f9c680fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 -- 172.21.15.12:0/1507763060 shutdown_connections 2024-09-19T06:56:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.569+0000 7f9c6c847640 1 -- 172.21.15.12:0/1507763060 wait complete. 2024-09-19T06:56:44.581 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T06:56:44.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.683+0000 7f4475a74640 1 -- 172.21.15.12:0/2396091832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44701069d0 msgr2=0x7f4470106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.683+0000 7f4475a74640 1 --2- 172.21.15.12:0/2396091832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44701069d0 0x7f4470106db0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f4460009930 tx=0x7f446002a420 comp rx=0 tx=0).stop 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.683+0000 7f4475a74640 1 -- 172.21.15.12:0/2396091832 shutdown_connections 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.683+0000 7f4475a74640 1 --2- 172.21.15.12:0/2396091832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4470101360 0x7f447010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.683+0000 7f4475a74640 1 --2- 172.21.15.12:0/2396091832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44701009c0 0x7f4470100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.683+0000 7f4475a74640 1 --2- 172.21.15.12:0/2396091832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44701069d0 0x7f4470106db0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.683+0000 7f4475a74640 1 -- 172.21.15.12:0/2396091832 >> 172.21.15.12:0/2396091832 conn(0x7f44700fc6a0 msgr2=0x7f44700feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.683+0000 7f4475a74640 1 -- 172.21.15.12:0/2396091832 shutdown_connections 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.683+0000 7f4475a74640 1 -- 172.21.15.12:0/2396091832 wait complete. 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f4475a74640 1 Processor -- start 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f4475a74640 1 -- start start 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f4475a74640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701009c0 0x7f4470198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f4475a74640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4470101360 0x7f4470198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f4475a74640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44701069d0 0x7f447019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f4475a74640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4470111f80 con 0x7f44701069d0 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f4475a74640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4470111e00 con 0x7f4470101360 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f4475a74640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4470112100 con 0x7f44701009c0 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f446ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44701069d0 0x7f447019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f446ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44701069d0 0x7f447019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41176/0 (socket says 172.21.15.12:41176) 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f446ffff640 1 -- 172.21.15.12:0/3702047204 learned_addr learned my addr 172.21.15.12:0/3702047204 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f446effd640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4470101360 0x7f4470198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.684+0000 7f446f7fe640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701009c0 0x7f4470198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f446ffff640 1 -- 172.21.15.12:0/3702047204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701009c0 msgr2=0x7f4470198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f446ffff640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701009c0 0x7f4470198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f446ffff640 1 -- 172.21.15.12:0/3702047204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4470101360 msgr2=0x7f4470198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f446ffff640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4470101360 0x7f4470198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f446ffff640 1 -- 172.21.15.12:0/3702047204 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447019d580 con 0x7f44701069d0 2024-09-19T06:56:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f446f7fe640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701009c0 0x7f4470198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f446ffff640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44701069d0 0x7f447019ce50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f446800b970 tx=0x7f446800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f446cff9640 1 -- 172.21.15.12:0/3702047204 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468019070 con 0x7f44701069d0 2024-09-19T06:56:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f446cff9640 1 -- 172.21.15.12:0/3702047204 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4468014440 con 0x7f44701069d0 2024-09-19T06:56:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f446cff9640 1 -- 172.21.15.12:0/3702047204 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44680075d0 con 0x7f44701069d0 2024-09-19T06:56:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f4475a74640 1 -- 172.21.15.12:0/3702047204 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447019d870 con 0x7f44701069d0 2024-09-19T06:56:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.685+0000 7f4475a74640 1 -- 172.21.15.12:0/3702047204 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44701a5100 con 0x7f44701069d0 2024-09-19T06:56:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.686+0000 7f4475a74640 1 -- 172.21.15.12:0/3702047204 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4470100ea0 con 0x7f44701069d0 2024-09-19T06:56:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.687+0000 7f446cff9640 1 -- 172.21.15.12:0/3702047204 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f446801c070 con 0x7f44701069d0 2024-09-19T06:56:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.688+0000 7f446cff9640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44580a33c0 0x7f44580a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.688+0000 7f446cff9640 1 -- 172.21.15.12:0/3702047204 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f44680cf300 con 0x7f44701069d0 2024-09-19T06:56:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.688+0000 7f446f7fe640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44580a33c0 0x7f44580a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.688+0000 7f446f7fe640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44580a33c0 0x7f44580a5880 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4460000c00 tx=0x7f4460032d50 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:44.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.692+0000 7f446cff9640 1 -- 172.21.15.12:0/3702047204 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f446809bcf0 con 0x7f44701069d0 2024-09-19T06:56:44.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.917+0000 7f4475a74640 1 -- 172.21.15.12:0/3702047204 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f4470108f90 con 0x7f44701069d0 2024-09-19T06:56:44.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.925+0000 7f446cff9640 1 -- 172.21.15.12:0/3702047204 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742866 (secure 0 0 0) 0x7f446809b5f0 con 0x7f44701069d0 2024-09-19T06:56:44.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 25, 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "active_gid": 15243, 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "active_name": "x", 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addrs": { 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2024-09-19T06:56:44.936 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 743507810 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 743507810 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addr": "172.21.15.12:6801/743507810", 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "active_change": "2024-09-19T06:40:08.069635+0000", 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "available": true, 2024-09-19T06:56:44.937 INFO:teuthology.orchestra.run.smithi012.stdout: "standbys": [ 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 15240, 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "y", 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:44.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:44.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:44.940 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.945 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.946 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.947 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:44.948 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.949 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.950 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-19T06:56:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-19T06:56:44.952 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:44.953 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:44.954 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.955 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.956 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:56:44.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-19T06:56:44.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.959 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.960 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.961 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.964 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.965 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:44.966 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.967 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:44.968 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.969 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.971 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.972 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-19T06:56:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-19T06:56:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:44.973 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.974 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-19T06:56:44.975 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.976 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.977 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-19T06:56:44.978 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:44.979 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-19T06:56:44.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:56:44.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-19T06:56:44.982 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:44.983 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.984 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.985 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:44.986 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:56:44.987 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:44.988 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.989 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:56:44.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:56:44.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.994 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.995 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.996 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.998 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:44.999 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:45.000 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-19T06:56:45.001 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:56:45.002 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.003 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.004 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.005 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.006 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.007 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-19T06:56:45.008 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.009 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.010 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.011 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:56:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:56:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-19T06:56:45.012 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.013 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.016 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.017 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.018 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.021 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.022 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.023 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.024 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-19T06:56:45.025 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:56:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.026 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.028 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.029 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.030 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.031 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.032 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.033 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.035 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-19T06:56:45.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-19T06:56:45.037 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-19T06:56:45.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.039 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:56:45.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.042 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.044 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.045 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.047 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.048 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.049 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.050 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.051 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.052 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.053 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.054 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.056 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.057 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.058 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.059 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.060 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.061 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.062 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:56:45.063 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:56:45.064 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:56:45.065 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.066 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.068 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.069 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.070 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.072 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.073 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.074 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.075 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:56:45.076 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:56:45.077 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.079 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.084 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.085 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.086 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.087 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.088 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-19T06:56:45.089 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.090 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.091 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.092 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.093 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.094 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.095 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:56:45.096 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.097 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-19T06:56:45.098 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-19T06:56:45.099 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.103 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.104 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.105 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.106 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.107 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.108 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.109 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.111 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.112 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-19T06:56:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-19T06:56:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.113 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.114 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.117 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.119 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.120 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.121 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.122 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-19T06:56:45.124 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.125 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.127 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.128 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:56:45.129 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:56:45.130 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:56:45.131 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.133 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.134 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.135 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.137 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.138 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.140 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.141 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.143 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.144 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.145 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.146 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.147 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.148 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.149 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-19T06:56:45.150 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-19T06:56:45.151 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-19T06:56:45.152 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-19T06:56:45.153 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-19T06:56:45.154 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.155 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.156 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.157 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.158 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.159 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.160 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.163 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.164 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.167 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.168 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.169 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:56:45.170 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.171 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.174 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.175 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.176 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.177 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.178 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.179 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.180 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.181 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.183 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.184 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-19T06:56:45.185 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.186 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.188 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.189 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.190 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.192 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.193 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-19T06:56:45.194 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.195 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.196 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.197 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.198 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.199 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.200 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.201 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.202 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.203 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.204 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.206 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.207 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.209 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.210 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.211 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.212 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.213 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.214 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.215 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.216 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.217 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.218 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.221 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.222 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.223 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.224 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-19T06:56:45.225 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.226 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.227 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.229 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.230 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.231 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-19T06:56:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.234 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.235 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.236 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.237 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.238 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.239 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.240 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.241 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.242 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.243 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.244 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.245 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.247 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.248 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.249 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.250 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.251 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.252 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-19T06:56:45.253 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.254 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.255 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-19T06:56:45.256 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-19T06:56:45.257 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.258 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.260 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.261 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.262 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.263 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.264 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.268 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.269 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.270 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.272 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.273 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.274 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.275 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.276 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.277 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.278 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-19T06:56:45.279 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.280 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.281 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.282 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.283 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.284 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.285 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.286 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.287 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.288 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.289 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.290 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.291 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:56:45.292 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.293 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.294 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.295 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.296 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.297 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.301 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.302 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.304 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.305 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.306 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.307 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.308 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.309 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.310 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-19T06:56:45.311 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:56:45.312 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.313 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.314 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.315 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.317 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.318 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-19T06:56:45.319 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.321 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.322 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.323 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.324 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.326 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.327 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.328 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.329 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:56:45.331 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.332 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.333 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.334 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.339 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.340 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.341 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.342 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.343 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.345 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-19T06:56:45.346 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-19T06:56:45.347 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.348 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.350 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.351 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.352 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.353 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.354 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.355 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.356 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.357 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.358 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-19T06:56:45.359 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.360 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.361 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.362 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.363 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.364 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.365 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.366 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.368 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.371 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.372 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-19T06:56:45.373 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-19T06:56:45.374 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-19T06:56:45.375 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.377 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-19T06:56:45.378 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.379 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.380 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.382 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.383 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.384 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.385 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-19T06:56:45.386 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-19T06:56:45.387 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.388 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.389 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 24928, 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "z", 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.390 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.391 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.392 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.393 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.394 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.395 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.396 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.398 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.399 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-19T06:56:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-19T06:56:45.401 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.402 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.404 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.405 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.406 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.412 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:56:45.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:56:45.414 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.415 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.416 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.417 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.418 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.419 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.420 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.421 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-19T06:56:45.422 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:45.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-19T06:56:45.424 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.425 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.426 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.427 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-19T06:56:45.428 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.429 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.430 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.431 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:56:45.432 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.433 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:56:45.434 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.435 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.437 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:45.438 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:56:45.439 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-19T06:56:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.441 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.442 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.443 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.444 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:56:45.445 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.446 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.447 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.448 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-19T06:56:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-19T06:56:45.450 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-19T06:56:45.451 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-19T06:56:45.452 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.453 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.454 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.455 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.456 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.457 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:56:45.458 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.459 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.460 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.461 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:56:45.462 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.463 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.464 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-19T06:56:45.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.466 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.467 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.468 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.469 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.470 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.472 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:56:45.473 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.474 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.475 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.476 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.477 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.478 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.479 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.480 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-19T06:56:45.481 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.482 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.483 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.485 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.486 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.487 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.488 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.489 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.490 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.491 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-19T06:56:45.492 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.494 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.495 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.496 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.497 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.498 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.499 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.500 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.502 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.503 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.504 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.505 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:56:45.506 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:56:45.507 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:56:45.508 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.509 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.512 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.513 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.514 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.515 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.516 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.517 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.518 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.519 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.520 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.521 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.522 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.523 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.524 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.525 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.526 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.527 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.528 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.529 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.530 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.531 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:56:45.532 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.534 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:56:45.535 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.538 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.539 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.540 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.541 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.542 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.543 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.544 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:45.545 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.546 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.547 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.548 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.549 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-19T06:56:45.550 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.551 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.552 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.553 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.554 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.555 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.556 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.557 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.558 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.559 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.563 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-19T06:56:45.564 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-19T06:56:45.566 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-19T06:56:45.567 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.569 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.570 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.571 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.572 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.573 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.574 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-19T06:56:45.575 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-19T06:56:45.576 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.577 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.579 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:56:45.580 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.581 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-19T06:56:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.583 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.584 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.585 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.586 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.587 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.588 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.589 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.590 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.591 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:56:45.592 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.593 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:56:45.594 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.595 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.596 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.597 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.598 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.600 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.601 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.602 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-19T06:56:45.603 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-19T06:56:45.604 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.605 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.607 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.608 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.609 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.610 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.611 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.612 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.613 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.615 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.618 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.619 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-09-19T06:56:45.620 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:56:45.621 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.622 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.623 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.624 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.625 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.626 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.627 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.628 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:56:45.629 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.630 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.631 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.632 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.633 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.635 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.636 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.637 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-19T06:56:45.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-19T06:56:45.639 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.640 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.642 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.643 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.646 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.647 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-19T06:56:45.648 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.649 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.650 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.651 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.652 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.653 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.654 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.655 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.656 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.657 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.658 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.659 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-19T06:56:45.660 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.661 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.662 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.663 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.664 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.667 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.668 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.670 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.671 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.672 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.673 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.674 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.675 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.676 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.677 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.678 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.679 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.680 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.682 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.683 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.685 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.686 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.687 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-19T06:56:45.688 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.691 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.692 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.694 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.695 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.696 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.697 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.698 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.699 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:56:45.700 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.701 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.702 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.703 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.704 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.706 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.707 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.708 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.709 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.710 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-19T06:56:45.711 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.712 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.713 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.714 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.715 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.717 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.718 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.719 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.722 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.723 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.724 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.725 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.726 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.727 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.728 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.729 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.730 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.731 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.732 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.733 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.734 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.735 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.736 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.737 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.738 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.739 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.740 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.741 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.742 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.743 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.744 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.745 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-19T06:56:45.746 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.747 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.749 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.750 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.751 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.752 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.753 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.754 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.755 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.756 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.757 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-19T06:56:45.758 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-19T06:56:45.759 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-19T06:56:45.760 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.761 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.762 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.763 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.764 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.765 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.766 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.767 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.768 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.769 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.770 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.771 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.772 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.773 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.774 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.775 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.776 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.777 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.780 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.783 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.784 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-19T06:56:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.786 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.787 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.788 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.789 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.791 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.793 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.794 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:56:45.795 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.796 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.797 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.798 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.799 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.800 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.801 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.803 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.804 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-19T06:56:45.805 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-19T06:56:45.806 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.807 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.808 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.809 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.810 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.811 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.812 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.813 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.814 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.815 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.817 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.818 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.820 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.821 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.822 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.824 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.825 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.826 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.827 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.828 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:45.830 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.831 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.832 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.833 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.834 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.835 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.836 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.839 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.840 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.841 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-19T06:56:45.842 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-19T06:56:45.844 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.844 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.844 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.844 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-19T06:56:45.844 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.844 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.844 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.844 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.844 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.844 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.845 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: "modules": [ 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: "dashboard", 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: "iostat", 2024-09-19T06:56:45.846 INFO:teuthology.orchestra.run.smithi012.stdout: "nfs", 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "restful", 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_schedule" 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.847 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.849 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.850 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.851 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.852 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.853 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.854 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-19T06:56:45.855 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-19T06:56:45.856 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.858 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.859 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.860 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.861 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-19T06:56:45.862 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.863 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:56:45.864 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.865 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-19T06:56:45.866 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.867 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-19T06:56:45.868 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-19T06:56:45.869 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.870 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.871 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.872 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.873 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.874 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.875 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-19T06:56:45.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-19T06:56:45.877 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-19T06:56:45.878 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.879 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.880 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:45.881 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.882 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.883 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.885 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:56:45.886 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.887 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.888 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.889 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.890 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.891 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.892 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.894 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.895 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:56:45.896 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.897 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.898 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.899 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.900 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.901 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.902 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:56:45.903 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.904 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.905 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.906 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.907 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.908 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.909 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:56:45.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-19T06:56:45.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-19T06:56:45.912 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.914 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-19T06:56:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-19T06:56:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-19T06:56:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.915 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:56:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-19T06:56:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-19T06:56:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.916 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-19T06:56:45.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-19T06:56:45.918 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-19T06:56:45.919 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.924 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.925 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.926 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.927 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.928 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.929 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.930 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.931 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.932 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.933 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.934 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-19T06:56:45.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.939 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.940 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:56:45.941 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:56:45.942 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:56:45.943 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.944 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.945 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.946 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.947 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.948 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-19T06:56:45.949 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.950 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.952 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.953 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.954 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:45.955 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:45.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-19T06:56:45.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.958 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.959 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.960 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.961 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.962 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:56:45.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:56:45.965 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.966 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.968 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.969 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.970 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.971 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.972 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.973 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.974 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-19T06:56:45.975 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.976 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.977 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.978 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:56:45.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:56:45.980 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.981 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.984 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.985 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.986 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.987 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.988 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.989 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.990 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.991 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:56:45.992 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.993 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.994 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.995 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.996 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.997 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:45.998 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:45.999 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-19T06:56:46.000 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.001 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.003 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.004 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.005 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.007 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.008 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-19T06:56:46.009 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-19T06:56:46.010 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.011 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.012 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.013 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.014 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.016 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.017 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.018 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.019 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.020 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.021 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.022 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.023 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.024 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-19T06:56:46.025 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.026 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.027 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.029 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.030 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.031 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.032 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-19T06:56:46.033 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.034 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.035 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.036 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.037 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.039 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.040 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.041 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.042 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.043 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.044 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.045 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.046 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-19T06:56:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-19T06:56:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.048 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.049 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.050 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.051 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:56:46.052 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.053 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.054 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.055 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.056 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.057 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.058 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.059 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.060 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.061 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.062 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.063 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.064 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-19T06:56:46.065 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-19T06:56:46.066 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.068 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.070 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.071 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.072 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.073 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.074 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.076 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.077 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.078 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.079 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.082 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.083 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.084 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.089 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.090 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.091 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.094 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.095 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.096 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:56:46.097 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:56:46.098 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.099 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.100 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.101 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.102 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.105 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.106 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.107 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.108 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.109 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.111 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.112 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.113 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.114 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.115 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.116 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.117 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.118 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.121 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.122 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.125 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.126 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.128 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.129 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.133 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.134 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.136 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-19T06:56:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.137 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.138 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.139 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.140 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.141 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:46.143 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-19T06:56:46.144 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.145 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.146 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.148 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.149 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.151 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.152 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-19T06:56:46.153 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:46.154 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.155 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.156 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:56:46.157 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.158 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.159 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.161 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.162 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.163 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-19T06:56:46.164 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-19T06:56:46.165 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-19T06:56:46.166 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.167 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.168 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.169 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-19T06:56:46.170 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.172 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.174 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.175 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.176 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.177 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:56:46.178 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-19T06:56:46.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.181 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.182 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.183 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.184 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.185 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.186 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.187 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.188 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.189 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-19T06:56:46.190 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.191 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.192 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.194 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.195 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.196 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.197 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.198 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.199 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.200 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.202 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.204 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.205 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.206 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.207 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.211 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.213 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.214 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.215 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.216 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.217 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.218 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.219 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.220 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.221 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-19T06:56:46.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-19T06:56:46.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.224 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.225 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.226 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.227 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.228 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.229 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.230 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.231 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.232 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.234 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.236 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.238 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.239 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.240 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-19T06:56:46.241 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.243 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.244 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.245 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.246 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.248 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.249 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.250 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.251 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:56:46.252 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:56:46.253 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:56:46.254 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.255 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.255 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.255 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-19T06:56:46.255 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-19T06:56:46.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.255 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-19T06:56:46.256 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-19T06:56:46.257 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-19T06:56:46.258 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.260 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.262 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.263 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.264 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.265 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.267 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.268 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.269 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.270 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.272 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.273 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.274 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.275 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.277 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.278 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.279 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-19T06:56:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:56:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-19T06:56:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-19T06:56:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-19T06:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: "services": { 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: "dashboard": "https://172.21.15.12:8443/" 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: "always_on_modules": { 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: "octopus": [ 2024-09-19T06:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "pacific": [ 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-19T06:56:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "quincy": [ 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-19T06:56:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "reef": [ 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-19T06:56:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "squid": [ 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-19T06:56:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: "last_failure_osd_epoch": 86, 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: "active_clients": [ 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 189872534 2024-09-19T06:56:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "libcephsqlite", 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1968358897 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 172284778 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-19T06:56:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1060514546 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2262371261 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 79681107 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-19T06:56:46.309 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:56:46.310 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:45 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2302742886' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:56:46.311 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:45 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1507763060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:56:46.311 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:45 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3702047204' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:56:46.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:45 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2302742886' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:56:46.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:45 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1507763060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:56:46.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:45 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3702047204' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 -- 172.21.15.12:0/3702047204 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44580a33c0 msgr2=0x7f44580a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44580a33c0 0x7f44580a5880 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4460000c00 tx=0x7f4460032d50 comp rx=0 tx=0).stop 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 -- 172.21.15.12:0/3702047204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44701069d0 msgr2=0x7f447019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44701069d0 0x7f447019ce50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f446800b970 tx=0x7f446800bd70 comp rx=0 tx=0).stop 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 -- 172.21.15.12:0/3702047204 shutdown_connections 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f44701069d0 0x7f447019ce50 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4470101360 0x7f4470198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f44580a33c0 0x7f44580a5880 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 --2- 172.21.15.12:0/3702047204 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44701009c0 0x7f4470198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 -- 172.21.15.12:0/3702047204 >> 172.21.15.12:0/3702047204 conn(0x7f44700fc6a0 msgr2=0x7f44700fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:46.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 -- 172.21.15.12:0/3702047204 shutdown_connections 2024-09-19T06:56:46.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:56:44.930+0000 7f4475a74640 1 -- 172.21.15.12:0/3702047204 wait complete. 2024-09-19T06:56:46.373 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T06:56:46.373 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T06:56:46.373 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:45 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2302742886' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:56:46.373 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:45 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1507763060' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:56:46.374 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:45 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3702047204' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:56:46.374 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:46 smithi173 ceph-mon[35349]: pgmap v521: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-09-19T06:56:46.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:46 smithi012 ceph-mon[30937]: pgmap v521: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-09-19T06:56:46.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:46 smithi016 ceph-mon[34911]: pgmap v521: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-09-19T06:56:46.643 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:47.172 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:56:47.172 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:56:47.172 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 2411, 2024-09-19T06:56:47.172 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 2413, 2024-09-19T06:56:47.172 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 2408533, 2024-09-19T06:56:47.172 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 766699, 2024-09-19T06:56:47.173 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 6, 2024-09-19T06:56:47.173 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 2, 2024-09-19T06:56:47.173 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.244456256, 2024-09-19T06:56:47.173 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.068272340, 2024-09-19T06:56:47.173 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.062467429, 2024-09-19T06:56:47.173 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.093883702, 2024-09-19T06:56:47.173 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:47.174 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 2411, 2024-09-19T06:56:47.174 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.130284639, 2024-09-19T06:56:47.174 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000054037 2024-09-19T06:56:47.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.174 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:47.174 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.174 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.174 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 1382, 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 1343, 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 1950304, 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 512920, 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 5, 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 3, 2024-09-19T06:56:47.175 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.154509439, 2024-09-19T06:56:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.049376544, 2024-09-19T06:56:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.069551917, 2024-09-19T06:56:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.039225307, 2024-09-19T06:56:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1342, 2024-09-19T06:56:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.067964927, 2024-09-19T06:56:47.177 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000050644 2024-09-19T06:56:47.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.177 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:47.177 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.177 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.177 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.177 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 1700208, 2024-09-19T06:56:47.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 190400 2024-09-19T06:56:47.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.178 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:56:47.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 8, 2024-09-19T06:56:47.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 234, 2024-09-19T06:56:47.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 3772, 2024-09-19T06:56:47.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 659278, 2024-09-19T06:56:47.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 8, 2024-09-19T06:56:47.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 4, 2024-09-19T06:56:47.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.020712941, 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.012800125, 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.005554417, 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000026978, 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 232, 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.022936510, 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000098864 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.179 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 3504, 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 658960 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 1, 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-MDSRank": { 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-19T06:56:47.180 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 5602, 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.182391729, 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000032558 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-PurgeQueue": { 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.181 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-19T06:56:47.182 INFO:teuthology.orchestra.run.smithi012.stdout: "request": 0, 2024-09-19T06:56:47.182 INFO:teuthology.orchestra.run.smithi012.stdout: "reply": 0, 2024-09-19T06:56:47.182 INFO:teuthology.orchestra.run.smithi012.stdout: "reply_latency": { 2024-09-19T06:56:47.182 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.182 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.182 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.182 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_reply": 0, 2024-09-19T06:56:47.182 INFO:teuthology.orchestra.run.smithi012.stdout: "forward": 0, 2024-09-19T06:56:47.182 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_complete": 0, 2024-09-19T06:56:47.183 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_keys": 0, 2024-09-19T06:56:47.183 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_commit": 0, 2024-09-19T06:56:47.183 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_split": 0, 2024-09-19T06:56:47.183 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_merge": 0, 2024-09-19T06:56:47.183 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes": 494, 2024-09-19T06:56:47.183 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_top": 121, 2024-09-19T06:56:47.183 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_bottom": 373, 2024-09-19T06:56:47.183 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pin_tail": 0, 2024-09-19T06:56:47.184 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pinned": 322, 2024-09-19T06:56:47.184 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_expired": 0, 2024-09-19T06:56:47.184 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_with_caps": 0, 2024-09-19T06:56:47.184 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": 0, 2024-09-19T06:56:47.184 INFO:teuthology.orchestra.run.smithi012.stdout: "subtrees": 21, 2024-09-19T06:56:47.184 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse": 0, 2024-09-19T06:56:47.184 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_hit": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_forward": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_discover": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_remote_ino": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_lock": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "load_cent": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "q": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "exported": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "exported_inodes": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "imported": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "imported_inodes": 0, 2024-09-19T06:56:47.185 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_dir_fetch": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_peer_discover": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rfiles": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rbytes": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rsnaps": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_set_tag": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_file_inodes": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:56:47.187 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_cap_release": 0, 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "process_request_cap_release": 0 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache": { 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update": 0, 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update_receipt": 0, 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_try_discover": 0, 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_send_discover": 0, 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_handle_discover": 0, 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays": 0, 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_delayed": 0, 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:56:47.188 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_created": 0, 2024-09-19T06:56:47.189 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_enqueued": 0, 2024-09-19T06:56:47.189 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_reintegrated": 0, 2024-09-19T06:56:47.189 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_migrated": 0, 2024-09-19T06:56:47.189 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_processing": 0, 2024-09-19T06:56:47.189 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:56:47.189 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:56:47.189 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_started": 0, 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_completed": 0, 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_exportdir": 0, 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_flush": 0, 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragstats": 0, 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_inodestats": 0 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log": { 2024-09-19T06:56:47.190 INFO:teuthology.orchestra.run.smithi012.stdout: "evlrg": 0, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "evadd": 0, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "evex": 0, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "evtrm": 0, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "ev": 1420, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "evexg": 0, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "evexd": 0, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "segadd": 0, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "segex": 0, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "segtrm": 0, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "seg": 3, 2024-09-19T06:56:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: "segmjr": 2, 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi012.stdout: "segexg": 0, 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi012.stdout: "segexd": 0, 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi012.stdout: "expos": 4194304, 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi012.stdout: "wrpos": 5893520, 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi012.stdout: "rdpos": 5892946, 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi012.stdout: "jlat": { 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: "replayed": 1420 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_mem": { 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 451, 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: "ino+": 453, 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: "ino-": 2, 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: "dir": 30, 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: "dir+": 32, 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi012.stdout: "dir-": 2, 2024-09-19T06:56:47.194 INFO:teuthology.orchestra.run.smithi012.stdout: "dn": 494, 2024-09-19T06:56:47.194 INFO:teuthology.orchestra.run.smithi012.stdout: "dn+": 494, 2024-09-19T06:56:47.194 INFO:teuthology.orchestra.run.smithi012.stdout: "dn-": 0, 2024-09-19T06:56:47.194 INFO:teuthology.orchestra.run.smithi012.stdout: "cap": 0, 2024-09-19T06:56:47.194 INFO:teuthology.orchestra.run.smithi012.stdout: "cap+": 0, 2024-09-19T06:56:47.194 INFO:teuthology.orchestra.run.smithi012.stdout: "cap-": 0, 2024-09-19T06:56:47.194 INFO:teuthology.orchestra.run.smithi012.stdout: "rss": 54640, 2024-09-19T06:56:47.194 INFO:teuthology.orchestra.run.smithi012.stdout: "heap": 215328 2024-09-19T06:56:47.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.195 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_server": { 2024-09-19T06:56:47.195 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_client_request": 0, 2024-09-19T06:56:47.195 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_server_request": 0, 2024-09-19T06:56:47.195 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_request": 0, 2024-09-19T06:56:47.195 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_session": 0, 2024-09-19T06:56:47.195 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_peer_request": 0, 2024-09-19T06:56:47.195 INFO:teuthology.orchestra.run.smithi012.stdout: "req_create_latency": { 2024-09-19T06:56:47.195 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.195 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.196 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.196 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getattr_latency": { 2024-09-19T06:56:47.196 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.196 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.196 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.196 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getfilelock_latency": { 2024-09-19T06:56:47.196 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.196 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: "req_link_latency": { 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookup_latency": { 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.197 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookuphash_latency": { 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupino_latency": { 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.198 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupname_latency": { 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupparent_latency": { 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupsnap_latency": { 2024-09-19T06:56:47.199 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.200 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.200 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.200 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lssnap_latency": { 2024-09-19T06:56:47.200 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.200 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.200 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.200 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mkdir_latency": { 2024-09-19T06:56:47.201 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.201 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.201 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.201 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mknod_latency": { 2024-09-19T06:56:47.201 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mksnap_latency": { 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: "req_open_latency": { 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.202 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: "req_readdir_latency": { 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rename_latency": { 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: "req_renamesnap_latency": { 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: "req_snapdiff_latency": { 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.204 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmdir_latency": { 2024-09-19T06:56:47.205 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.205 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.205 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.205 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmsnap_latency": { 2024-09-19T06:56:47.205 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.205 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.205 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.205 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmxattr_latency": { 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setattr_latency": { 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setdirlayout_latency": { 2024-09-19T06:56:47.206 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.207 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.207 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.207 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setfilelock_latency": { 2024-09-19T06:56:47.207 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.207 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.207 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.208 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setlayout_latency": { 2024-09-19T06:56:47.208 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.208 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.208 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.208 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setxattr_latency": { 2024-09-19T06:56:47.208 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.208 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.208 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: "req_symlink_latency": { 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: "req_unlink_latency": { 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.209 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getvxattr_latency": { 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_sessions": { 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: "session_count": 2, 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: "session_add": 4, 2024-09-19T06:56:47.210 INFO:teuthology.orchestra.run.smithi012.stdout: "session_remove": 2, 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_open": 3, 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_stale": 0, 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: "total_load": 0, 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: "average_load": 0, 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: "avg_session_uptime": 2543, 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: "mdthresh_evicted": 0 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-19T06:56:47.211 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:56:47.212 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:56:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:56:47.214 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 207345, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 517, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-19T06:56:47.215 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 8704, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 191, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 1445307, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 16728, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-19T06:56:47.216 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-19T06:56:47.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.217 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter": { 2024-09-19T06:56:47.217 INFO:teuthology.orchestra.run.smithi012.stdout: "op_active": 0, 2024-09-19T06:56:47.217 INFO:teuthology.orchestra.run.smithi012.stdout: "op_laggy": 0, 2024-09-19T06:56:47.217 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send": 3426, 2024-09-19T06:56:47.217 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send_bytes": 21, 2024-09-19T06:56:47.217 INFO:teuthology.orchestra.run.smithi012.stdout: "op_resend": 3, 2024-09-19T06:56:47.217 INFO:teuthology.orchestra.run.smithi012.stdout: "op_reply": 3426, 2024-09-19T06:56:47.217 INFO:teuthology.orchestra.run.smithi012.stdout: "op_latency": { 2024-09-19T06:56:47.217 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 3426, 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 4.680959641, 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001366304 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "op_inflight": 0, 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "oplen_avg": { 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 3426, 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 3427 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "op": 3426, 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "op_r": 3426, 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "op_w": 0, 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "op_rmw": 0, 2024-09-19T06:56:47.218 INFO:teuthology.orchestra.run.smithi012.stdout: "op_pg": 0, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_stat": 2107, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_create": 0, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_read": 1317, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_write": 0, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writefull": 0, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writesame": 0, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_append": 0, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_zero": 0, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_truncate": 0, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_delete": 0, 2024-09-19T06:56:47.219 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_mapext": 0, 2024-09-19T06:56:47.220 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_sparse_read": 0, 2024-09-19T06:56:47.220 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_clonerange": 0, 2024-09-19T06:56:47.220 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_getxattr": 1, 2024-09-19T06:56:47.220 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_setxattr": 0, 2024-09-19T06:56:47.220 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:56:47.220 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_rmxattr": 0, 2024-09-19T06:56:47.220 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:56:47.220 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_call": 0, 2024-09-19T06:56:47.220 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_watch": 0, 2024-09-19T06:56:47.220 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_notify": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_other": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_active": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_send": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_resend": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_ping": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_active": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_send": 0, 2024-09-19T06:56:47.221 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_resend": 0, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_active": 0, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_send": 0, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_resend": 0, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_active": 0, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_send": 0, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_resend": 0, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "command_active": 0, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "command_send": 0, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "command_resend": 0, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "map_epoch": 106, 2024-09-19T06:56:47.222 INFO:teuthology.orchestra.run.smithi012.stdout: "map_full": 0, 2024-09-19T06:56:47.223 INFO:teuthology.orchestra.run.smithi012.stdout: "map_inc": 23, 2024-09-19T06:56:47.223 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_sessions": 5, 2024-09-19T06:56:47.223 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_open": 7, 2024-09-19T06:56:47.223 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_close": 2, 2024-09-19T06:56:47.223 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_laggy": 0, 2024-09-19T06:56:47.223 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_wr": 0, 2024-09-19T06:56:47.223 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_rd": 2, 2024-09-19T06:56:47.223 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_del": 0 2024-09-19T06:56:47.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.223 INFO:teuthology.orchestra.run.smithi012.stdout: "oft": { 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_objs": 0, 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_updates": 0, 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_removes": 0 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: "osd-slow-ops": { 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_ops_count": 0 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: "purge_queue": { 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops": 0, 2024-09-19T06:56:47.224 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing": 0, 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_high_water": 0, 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed_ops": 0, 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed": 0, 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_item_in_journal": 0 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:47.225 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 3797, 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 3999065, 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 3797, 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 3797, 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 3999065, 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.226 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_bytes": { 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 3426, 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 1699221, 2024-09-19T06:56:47.227 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 3426, 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 1699221, 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_ops": { 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 1024, 2024-09-19T06:56:47.228 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 3426, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 3426, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 3426, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 3426, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.229 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:47.230 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle-0x55afe3386b40": { 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-19T06:56:47.231 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:47.233 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:47.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:47.233 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:47.233 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:56:48.032 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-19T06:56:48.032 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-19T06:56:48.032 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-19T06:56:48.032 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-19T06:56:48.032 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-19T06:56:48.032 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:56:48.032 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:56:48.032 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T06:56:48.033 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T06:56:48.096 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:48 smithi012 ceph-mon[30937]: pgmap v522: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-19T06:56:48.328 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:48.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:48 smithi173 ceph-mon[35349]: pgmap v522: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-19T06:56:48.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:48 smithi016 ceph-mon[34911]: pgmap v522: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-19T06:56:48.896 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 316, 2024-09-19T06:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 306, 2024-09-19T06:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 1475360, 2024-09-19T06:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 188720, 2024-09-19T06:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2024-09-19T06:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2024-09-19T06:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.059282711, 2024-09-19T06:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.021444531, 2024-09-19T06:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.049342635, 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 305, 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.016446341, 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000053922 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.898 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 1475360, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 188720 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 3, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 235, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 480, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 277472, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 6, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 3, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.018633124, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.013320849, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.002067721, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:56:48.899 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 232, 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.012776418, 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000055070 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 277472 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.900 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 4, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 4, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 3024, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 448, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.002486634, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000041593, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.002414380, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 3, 2024-09-19T06:56:48.901 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.004286303, 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001428767 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2024-09-19T06:56:48.902 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:56:48.903 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:56:48.904 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:56:48.905 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148771, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 32, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:56:48.906 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 319, 2024-09-19T06:56:48.907 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 1430751, 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 319, 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 319, 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 1430751, 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:48.908 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:56:49.693 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T06:56:49.694 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T06:56:49.694 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T06:56:49.694 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T06:56:49.694 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T06:56:49.694 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T06:56:49.694 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T06:56:49.694 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T06:56:49.694 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T06:56:50.004 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:50.269 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:50 smithi012 ceph-mon[30937]: pgmap v523: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-19T06:56:50.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:50 smithi173 ceph-mon[35349]: pgmap v523: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-19T06:56:50.483 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:56:50.483 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:56:50.483 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 2108, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 2110, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 617243, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 670345, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 8, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 2, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.218369074, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.071049442, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.049862865, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.075462587, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 2108, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.087244746, 2024-09-19T06:56:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000041387 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:56:50.485 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 1295, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 1524, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 1355845, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 983199, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 8, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 3, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.125278190, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.043814733, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.033781895, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.035382331, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1521, 2024-09-19T06:56:50.486 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.066281683, 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000043577 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 571968 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 377, 2024-09-19T06:56:50.487 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 336, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 1705124, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 193093, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 5, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 3, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.058996193, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.023270855, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.049752566, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000062983, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 336, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.023848640, 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000070978 2024-09-19T06:56:50.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 1703776, 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 192128 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 1, 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.489 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-MDSRank": { 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 5635, 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.179822586, 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000031911 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-PurgeQueue": { 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.490 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: "request": 0, 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: "reply": 0, 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: "reply_latency": { 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_reply": 0, 2024-09-19T06:56:50.491 INFO:teuthology.orchestra.run.smithi012.stdout: "forward": 0, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_complete": 0, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_keys": 0, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_commit": 0, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_split": 0, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_merge": 0, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes": 432, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_top": 137, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_bottom": 295, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pin_tail": 0, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pinned": 236, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_expired": 0, 2024-09-19T06:56:50.492 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_with_caps": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "subtrees": 15, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_hit": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_forward": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_discover": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_remote_ino": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_lock": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "load_cent": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "q": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "exported": 0, 2024-09-19T06:56:50.493 INFO:teuthology.orchestra.run.smithi012.stdout: "exported_inodes": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "imported": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "imported_inodes": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_dir_fetch": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_peer_discover": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rfiles": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rbytes": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rsnaps": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_set_tag": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:56:50.494 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_file_inodes": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_cap_release": 0, 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: "process_request_cap_release": 0 2024-09-19T06:56:50.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache": { 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update_receipt": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_try_discover": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_send_discover": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_handle_discover": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_delayed": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_created": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_enqueued": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_reintegrated": 0, 2024-09-19T06:56:50.496 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_migrated": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_processing": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_started": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_completed": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_exportdir": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_flush": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragstats": 0, 2024-09-19T06:56:50.497 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_inodestats": 0 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log": { 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "evlrg": 0, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "evadd": 0, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "evex": 0, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "evtrm": 0, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "ev": 715, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "evexg": 0, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "evexd": 0, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "segadd": 0, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "segex": 0, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "segtrm": 0, 2024-09-19T06:56:50.498 INFO:teuthology.orchestra.run.smithi012.stdout: "seg": 2, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "segmjr": 2, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "segexg": 0, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "segexd": 0, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "expos": 4194304, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "wrpos": 5214151, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "rdpos": 5213577, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "jlat": { 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "replayed": 715 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.499 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_mem": { 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 379, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "ino+": 398, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "ino-": 19, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "dir": 23, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "dir+": 24, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "dir-": 1, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "dn": 432, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "dn+": 432, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "dn-": 0, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "cap": 0, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "cap+": 0, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "cap-": 0, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "rss": 53568, 2024-09-19T06:56:50.500 INFO:teuthology.orchestra.run.smithi012.stdout: "heap": 215328 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_server": { 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_client_request": 0, 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_server_request": 0, 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_request": 0, 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_session": 0, 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_peer_request": 0, 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "req_create_latency": { 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.501 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getattr_latency": { 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getfilelock_latency": { 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "req_link_latency": { 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.502 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookup_latency": { 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookuphash_latency": { 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupino_latency": { 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupname_latency": { 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupparent_latency": { 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.504 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupsnap_latency": { 2024-09-19T06:56:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lssnap_latency": { 2024-09-19T06:56:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.505 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mkdir_latency": { 2024-09-19T06:56:50.506 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.506 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.506 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.506 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mknod_latency": { 2024-09-19T06:56:50.506 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.506 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.506 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mksnap_latency": { 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "req_open_latency": { 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "req_readdir_latency": { 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.507 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rename_latency": { 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: "req_renamesnap_latency": { 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "req_snapdiff_latency": { 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmdir_latency": { 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmsnap_latency": { 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.509 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmxattr_latency": { 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setattr_latency": { 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.510 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setdirlayout_latency": { 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setfilelock_latency": { 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setlayout_latency": { 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setxattr_latency": { 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "req_symlink_latency": { 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "req_unlink_latency": { 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.512 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getvxattr_latency": { 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_sessions": { 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: "session_count": 1, 2024-09-19T06:56:50.513 INFO:teuthology.orchestra.run.smithi012.stdout: "session_add": 3, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "session_remove": 2, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_open": 2, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_stale": 0, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "total_load": 0, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "average_load": 0, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "avg_session_uptime": 3060, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "mdthresh_evicted": 0 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:56:50.514 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:56:50.515 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-19T06:56:50.516 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 219990, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 429, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:56:50.517 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 8704, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 191, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 1204647, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 9583, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-19T06:56:50.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter": { 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "op_active": 0, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "op_laggy": 0, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send": 3404, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send_bytes": 21, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "op_resend": 3, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "op_reply": 3404, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "op_latency": { 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 3404, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 8.238929281, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.002420367 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "op_inflight": 0, 2024-09-19T06:56:50.519 INFO:teuthology.orchestra.run.smithi012.stdout: "oplen_avg": { 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 3404, 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 3405 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "op": 3404, 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "op_r": 3404, 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "op_w": 0, 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "op_rmw": 0, 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "op_pg": 0, 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_stat": 2107, 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_create": 0, 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_read": 1295, 2024-09-19T06:56:50.520 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_write": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writefull": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writesame": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_append": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_zero": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_truncate": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_delete": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_mapext": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_sparse_read": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_clonerange": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_getxattr": 1, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_setxattr": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:56:50.521 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_rmxattr": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_call": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_watch": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_notify": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_other": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_active": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_send": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_resend": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_ping": 0, 2024-09-19T06:56:50.522 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_active": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_send": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_resend": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_active": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_send": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_resend": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_active": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_send": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_resend": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "command_active": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "command_send": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "command_resend": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "map_epoch": 106, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "map_full": 0, 2024-09-19T06:56:50.523 INFO:teuthology.orchestra.run.smithi012.stdout: "map_inc": 23, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_sessions": 7, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_open": 10, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_close": 3, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_laggy": 0, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_wr": 0, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_rd": 2, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_del": 0 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "oft": { 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_objs": 0, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_updates": 0, 2024-09-19T06:56:50.524 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_removes": 0 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: "osd-slow-ops": { 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_ops_count": 0 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: "purge_queue": { 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops": 0, 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing": 0, 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_high_water": 0, 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed_ops": 0, 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed": 0, 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_item_in_journal": 0 2024-09-19T06:56:50.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 3776, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 3316497, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 3776, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 3776, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 3316497, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_bytes": { 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 3404, 2024-09-19T06:56:50.527 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 1019852, 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 3404, 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 1019852, 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_ops": { 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 1024, 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-19T06:56:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 3404, 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 3404, 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 3404, 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 3404, 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:56:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:50.530 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-19T06:56:50.530 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:50.530 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-19T06:56:50.530 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-19T06:56:50.530 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:50.530 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:50.530 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-19T06:56:50.530 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-19T06:56:50.530 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle-0x55f388b74b40": { 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-19T06:56:50.531 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:50.532 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:56:50.533 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:50 smithi016 ceph-mon[34911]: pgmap v523: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 KiB/s wr, 9 op/s 2024-09-19T06:56:51.411 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-19T06:56:51.411 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-19T06:56:51.411 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-19T06:56:51.411 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-19T06:56:51.411 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-19T06:56:51.411 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:56:51.411 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:56:51.411 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T06:56:51.412 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T06:56:51.673 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:56:52.176 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-19T06:56:52.176 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:56:52.177 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 4, 2024-09-19T06:56:52.177 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 4, 2024-09-19T06:56:52.177 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 3024, 2024-09-19T06:56:52.177 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 448, 2024-09-19T06:56:52.177 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2024-09-19T06:56:52.177 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2024-09-19T06:56:52.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.003214500, 2024-09-19T06:56:52.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000036967, 2024-09-19T06:56:52.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.002202163, 2024-09-19T06:56:52.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:56:52.178 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:52.179 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 3, 2024-09-19T06:56:52.179 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.004058680, 2024-09-19T06:56:52.179 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.001352893 2024-09-19T06:56:52.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.179 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:52.179 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:52.180 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:52.180 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:52.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.180 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T06:56:52.180 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:56:52.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.181 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:56:52.181 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 318, 2024-09-19T06:56:52.181 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 308, 2024-09-19T06:56:52.181 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 1475904, 2024-09-19T06:56:52.181 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 190000, 2024-09-19T06:56:52.182 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2024-09-19T06:56:52.182 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2024-09-19T06:56:52.182 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.062978212, 2024-09-19T06:56:52.182 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.024930549, 2024-09-19T06:56:52.182 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.050839288, 2024-09-19T06:56:52.182 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:56:52.183 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:52.183 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 307, 2024-09-19T06:56:52.183 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.016157091, 2024-09-19T06:56:52.183 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000052628 2024-09-19T06:56:52.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.183 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:52.184 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:52.184 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:52.184 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:52.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.184 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 1475904, 2024-09-19T06:56:52.184 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 190000 2024-09-19T06:56:52.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.185 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:56:52.185 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 3, 2024-09-19T06:56:52.185 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 236, 2024-09-19T06:56:52.185 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 480, 2024-09-19T06:56:52.186 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 277648, 2024-09-19T06:56:52.186 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 6, 2024-09-19T06:56:52.186 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 3, 2024-09-19T06:56:52.186 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.019530391, 2024-09-19T06:56:52.186 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.014415467, 2024-09-19T06:56:52.186 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.002418203, 2024-09-19T06:56:52.186 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:56:52.187 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:52.187 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 233, 2024-09-19T06:56:52.187 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.026867990, 2024-09-19T06:56:52.187 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000115313 2024-09-19T06:56:52.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.187 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:52.188 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:52.188 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:52.188 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:52.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.188 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-19T06:56:52.189 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 277648 2024-09-19T06:56:52.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.189 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-19T06:56:52.189 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2024-09-19T06:56:52.189 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-19T06:56:52.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.189 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-19T06:56:52.190 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:56:52.190 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-19T06:56:52.190 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:56:52.190 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:56:52.190 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:56:52.190 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:56:52.190 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:56:52.190 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:56:52.190 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:56:52.191 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:56:52.191 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:56:52.191 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:56:52.191 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:56:52.191 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:56:52.191 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:56:52.191 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-19T06:56:52.191 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:56:52.192 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-19T06:56:52.192 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:56:52.192 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:56:52.192 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:56:52.192 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:56:52.192 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:56:52.192 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:56:52.193 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:56:52.193 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-19T06:56:52.193 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:56:52.193 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:56:52.193 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:56:52.193 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-19T06:56:52.193 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-19T06:56:52.194 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-19T06:56:52.194 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:56:52.194 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:56:52.194 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:56:52.194 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:56:52.194 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148748, 2024-09-19T06:56:52.194 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 32, 2024-09-19T06:56:52.194 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:56:52.194 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-19T06:56:52.194 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-19T06:56:52.195 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-19T06:56:52.195 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:56:52.195 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-19T06:56:52.196 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-19T06:56:52.197 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 321, 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 1431011, 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 321, 2024-09-19T06:56:52.198 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 321, 2024-09-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 1431011, 2024-09-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-19T06:56:52.199 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-19T06:56:52.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:52 smithi173 ceph-mon[35349]: pgmap v524: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.4 KiB/s wr, 13 op/s 2024-09-19T06:56:52.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:52 smithi012 ceph-mon[30937]: pgmap v524: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.4 KiB/s wr, 13 op/s 2024-09-19T06:56:52.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:52 smithi016 ceph-mon[34911]: pgmap v524: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.4 KiB/s wr, 13 op/s 2024-09-19T06:56:52.879 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T06:56:52.879 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T06:56:52.879 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-19T06:56:52.879 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-19T06:56:52.879 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T06:56:52.879 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T06:56:52.879 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T06:56:52.879 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T06:56:52.880 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T06:56:53.143 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:56:53.661 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-19T06:56:53.662 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:56:53.662 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 11800, 2024-09-19T06:56:53.662 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 15206, 2024-09-19T06:56:53.662 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 4237121, 2024-09-19T06:56:53.662 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 19510287, 2024-09-19T06:56:53.662 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 11, 2024-09-19T06:56:53.662 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 6, 2024-09-19T06:56:53.662 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.878421946, 2024-09-19T06:56:53.663 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.361702502, 2024-09-19T06:56:53.663 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.422037004, 2024-09-19T06:56:53.663 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.121872165, 2024-09-19T06:56:53.663 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:53.663 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 15204, 2024-09-19T06:56:53.663 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 1.170467938, 2024-09-19T06:56:53.663 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000076984 2024-09-19T06:56:53.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.663 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:53.664 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 16515, 2024-09-19T06:56:53.664 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.003183974, 2024-09-19T06:56:53.664 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000192 2024-09-19T06:56:53.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.664 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T06:56:53.664 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 453680 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 14568, 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 17135, 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 5881666, 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 18997154, 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 28, 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 7, 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 1.001991962, 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.345375335, 2024-09-19T06:56:53.665 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.617988143, 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.189374981, 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 17134, 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 1.836526903, 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000107186 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 20806, 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.003862411, 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000185 2024-09-19T06:56:53.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 511728, 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 285952 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 8401, 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 9069, 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 5380612, 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 13718478, 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 366, 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 7, 2024-09-19T06:56:53.667 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.736494742, 2024-09-19T06:56:53.668 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.235151483, 2024-09-19T06:56:53.668 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.452316242, 2024-09-19T06:56:53.668 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.093734169, 2024-09-19T06:56:53.668 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:53.668 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 9067, 2024-09-19T06:56:53.668 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 1.022238033, 2024-09-19T06:56:53.668 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000112742 2024-09-19T06:56:53.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.668 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:53.669 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 10997, 2024-09-19T06:56:53.669 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.002342373, 2024-09-19T06:56:53.669 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000213 2024-09-19T06:56:53.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.669 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 1891920, 2024-09-19T06:56:53.669 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 258224 2024-09-19T06:56:53.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.669 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-19T06:56:53.669 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 1, 2024-09-19T06:56:53.670 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-19T06:56:53.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.670 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-MDSRank": { 2024-09-19T06:56:53.670 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-19T06:56:53.670 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-19T06:56:53.670 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 9891, 2024-09-19T06:56:53.670 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 3.997565149, 2024-09-19T06:56:53.670 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000404161 2024-09-19T06:56:53.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:53.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.671 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-PurgeQueue": { 2024-09-19T06:56:53.671 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-19T06:56:53.671 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-19T06:56:53.671 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 112, 2024-09-19T06:56:53.671 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.003340374, 2024-09-19T06:56:53.672 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000029824 2024-09-19T06:56:53.672 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:53.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.672 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-09-19T06:56:53.672 INFO:teuthology.orchestra.run.smithi016.stdout: "request": 2345, 2024-09-19T06:56:53.672 INFO:teuthology.orchestra.run.smithi016.stdout: "reply": 2080, 2024-09-19T06:56:53.672 INFO:teuthology.orchestra.run.smithi016.stdout: "reply_latency": { 2024-09-19T06:56:53.672 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 2080, 2024-09-19T06:56:53.672 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 6.409374600, 2024-09-19T06:56:53.672 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.003081430 2024-09-19T06:56:53.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.673 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_reply": 0, 2024-09-19T06:56:53.673 INFO:teuthology.orchestra.run.smithi016.stdout: "forward": 265, 2024-09-19T06:56:53.673 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_complete": 16, 2024-09-19T06:56:53.673 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_keys": 7, 2024-09-19T06:56:53.673 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_commit": 752, 2024-09-19T06:56:53.673 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_split": 3, 2024-09-19T06:56:53.673 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_merge": 0, 2024-09-19T06:56:53.673 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes": 129, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_top": 20, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_bottom": 98, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pin_tail": 11, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pinned": 97, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_expired": 1748, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_with_caps": 31, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": 31, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "subtrees": 25, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse": 3039, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_hit": 2200, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_forward": 259, 2024-09-19T06:56:53.674 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_discover": 8, 2024-09-19T06:56:53.675 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_dir_fetch": 1, 2024-09-19T06:56:53.675 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_remote_ino": 0, 2024-09-19T06:56:53.675 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_lock": 54, 2024-09-19T06:56:53.675 INFO:teuthology.orchestra.run.smithi016.stdout: "load_cent": 268, 2024-09-19T06:56:53.675 INFO:teuthology.orchestra.run.smithi016.stdout: "q": 0, 2024-09-19T06:56:53.675 INFO:teuthology.orchestra.run.smithi016.stdout: "exported": 22, 2024-09-19T06:56:53.675 INFO:teuthology.orchestra.run.smithi016.stdout: "exported_inodes": 1693, 2024-09-19T06:56:53.675 INFO:teuthology.orchestra.run.smithi016.stdout: "imported": 4, 2024-09-19T06:56:53.675 INFO:teuthology.orchestra.run.smithi016.stdout: "imported_inodes": 635, 2024-09-19T06:56:53.675 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_dir_fetch": 0, 2024-09-19T06:56:53.676 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_backtrace_fetch": 6174, 2024-09-19T06:56:53.676 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_peer_discover": 0, 2024-09-19T06:56:53.676 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rfiles": 1011, 2024-09-19T06:56:53.676 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rbytes": 1466414659, 2024-09-19T06:56:53.676 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rsnaps": 6, 2024-09-19T06:56:53.676 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_fetch": 6174, 2024-09-19T06:56:53.676 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_set_tag": 0, 2024-09-19T06:56:53.676 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:56:53.676 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_inodes": 560, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_base_inodes": 20, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dirfrag_rstats": 540, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_file_inodes": 5614, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_inode_file_caps": 56, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_revoke": 1272, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_grant": 1625, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:56:53.677 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps": 2531, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps_dirty": 1144, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_cap_release": 43, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "process_request_cap_release": 200 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache": { 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update": 163, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update_receipt": 246, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_try_discover": 124, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_send_discover": 284, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_handle_discover": 773, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays": 0, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_delayed": 0, 2024-09-19T06:56:53.678 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:56:53.679 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_created": 53, 2024-09-19T06:56:53.679 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_enqueued": 25, 2024-09-19T06:56:53.679 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_reintegrated": 28, 2024-09-19T06:56:53.679 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_migrated": 0, 2024-09-19T06:56:53.679 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_processing": 0, 2024-09-19T06:56:53.679 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:56:53.679 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:56:53.679 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_started": 0, 2024-09-19T06:56:53.679 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_completed": 0, 2024-09-19T06:56:53.679 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_path": 14, 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_inode": 5476, 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_enqueue_scrub": 20, 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_exportdir": 22, 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_flush": 0, 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragmentdir": 3, 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragstats": 0, 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_inodestats": 0 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log": { 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: "evlrg": 0, 2024-09-19T06:56:53.680 INFO:teuthology.orchestra.run.smithi016.stdout: "evadd": 4398, 2024-09-19T06:56:53.681 INFO:teuthology.orchestra.run.smithi016.stdout: "evex": 4377, 2024-09-19T06:56:53.681 INFO:teuthology.orchestra.run.smithi016.stdout: "evtrm": 4377, 2024-09-19T06:56:53.681 INFO:teuthology.orchestra.run.smithi016.stdout: "ev": 21, 2024-09-19T06:56:53.681 INFO:teuthology.orchestra.run.smithi016.stdout: "evexg": 0, 2024-09-19T06:56:53.681 INFO:teuthology.orchestra.run.smithi016.stdout: "evexd": 23, 2024-09-19T06:56:53.681 INFO:teuthology.orchestra.run.smithi016.stdout: "segadd": 83, 2024-09-19T06:56:53.681 INFO:teuthology.orchestra.run.smithi016.stdout: "segex": 82, 2024-09-19T06:56:53.681 INFO:teuthology.orchestra.run.smithi016.stdout: "segtrm": 82, 2024-09-19T06:56:53.681 INFO:teuthology.orchestra.run.smithi016.stdout: "seg": 1, 2024-09-19T06:56:53.682 INFO:teuthology.orchestra.run.smithi016.stdout: "segmjr": 1, 2024-09-19T06:56:53.682 INFO:teuthology.orchestra.run.smithi016.stdout: "segexg": 0, 2024-09-19T06:56:53.682 INFO:teuthology.orchestra.run.smithi016.stdout: "segexd": 1, 2024-09-19T06:56:53.682 INFO:teuthology.orchestra.run.smithi016.stdout: "expos": 29815929, 2024-09-19T06:56:53.682 INFO:teuthology.orchestra.run.smithi016.stdout: "wrpos": 30221149, 2024-09-19T06:56:53.682 INFO:teuthology.orchestra.run.smithi016.stdout: "rdpos": 0, 2024-09-19T06:56:53.682 INFO:teuthology.orchestra.run.smithi016.stdout: "jlat": { 2024-09-19T06:56:53.682 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 2656, 2024-09-19T06:56:53.682 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 12.675379375, 2024-09-19T06:56:53.682 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.004772356 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: "replayed": 0 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_mem": { 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: "ino": 123, 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: "ino+": 1852, 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: "ino-": 1729, 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: "dir": 71, 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: "dir+": 261, 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: "dir-": 190, 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: "dn": 129, 2024-09-19T06:56:53.683 INFO:teuthology.orchestra.run.smithi016.stdout: "dn+": 2186, 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: "dn-": 2057, 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: "cap": 31, 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: "cap+": 1134, 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: "cap-": 1103, 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: "rss": 72324, 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: "heap": 231712 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_server": { 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_client_request": 2576, 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_server_request": 1092, 2024-09-19T06:56:53.684 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_request": 2345, 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_session": 303, 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_peer_request": 2175, 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: "req_create_latency": { 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 1026, 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 4.661903926, 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.004543766 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getattr_latency": { 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 170, 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.056737128, 2024-09-19T06:56:53.685 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000333747 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getfilelock_latency": { 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: "req_link_latency": { 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 28, 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.046387570, 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.001656698 2024-09-19T06:56:53.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookup_latency": { 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 200, 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.636287166, 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.003181435 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookuphash_latency": { 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupino_latency": { 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.687 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.688 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.688 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupname_latency": { 2024-09-19T06:56:53.688 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.688 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.688 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.688 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupparent_latency": { 2024-09-19T06:56:53.688 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.688 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.689 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.689 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupsnap_latency": { 2024-09-19T06:56:53.689 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.689 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.689 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.690 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lssnap_latency": { 2024-09-19T06:56:53.690 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 16, 2024-09-19T06:56:53.690 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.002463151, 2024-09-19T06:56:53.690 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000153946 2024-09-19T06:56:53.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.690 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mkdir_latency": { 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 37, 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.320786784, 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.008669913 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mknod_latency": { 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mksnap_latency": { 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 16, 2024-09-19T06:56:53.691 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.077545833, 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.004846614 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: "req_open_latency": { 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 432, 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.104352370, 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000241556 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: "req_readdir_latency": { 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 42, 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.082882413, 2024-09-19T06:56:53.692 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.001973390 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rename_latency": { 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 54, 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.250169980, 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.004632777 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: "req_renamesnap_latency": { 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: "req_snapdiff_latency": { 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmdir_latency": { 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 2, 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.018118539, 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.009059269 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmsnap_latency": { 2024-09-19T06:56:53.694 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 10, 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.044028941, 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.004402894 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmxattr_latency": { 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setattr_latency": { 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 1, 2024-09-19T06:56:53.695 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000719738, 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000719738 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setdirlayout_latency": { 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setfilelock_latency": { 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.696 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.697 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setlayout_latency": { 2024-09-19T06:56:53.697 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.697 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.697 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.697 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setxattr_latency": { 2024-09-19T06:56:53.697 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 7, 2024-09-19T06:56:53.697 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.019852828, 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.002836118 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: "req_symlink_latency": { 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: "req_unlink_latency": { 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 39, 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.087138233, 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.002234313 2024-09-19T06:56:53.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.699 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:56:53.699 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:56:53.699 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getvxattr_latency": { 2024-09-19T06:56:53.699 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.699 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.699 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:53.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.699 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_sessions": { 2024-09-19T06:56:53.699 INFO:teuthology.orchestra.run.smithi016.stdout: "session_count": 2, 2024-09-19T06:56:53.700 INFO:teuthology.orchestra.run.smithi016.stdout: "session_add": 5, 2024-09-19T06:56:53.700 INFO:teuthology.orchestra.run.smithi016.stdout: "session_remove": 3, 2024-09-19T06:56:53.700 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_open": 2, 2024-09-19T06:56:53.700 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_stale": 0, 2024-09-19T06:56:53.700 INFO:teuthology.orchestra.run.smithi016.stdout: "total_load": 68, 2024-09-19T06:56:53.700 INFO:teuthology.orchestra.run.smithi016.stdout: "average_load": 34, 2024-09-19T06:56:53.700 INFO:teuthology.orchestra.run.smithi016.stdout: "avg_session_uptime": 980, 2024-09-19T06:56:53.700 INFO:teuthology.orchestra.run.smithi016.stdout: "mdthresh_evicted": 0 2024-09-19T06:56:53.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.700 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:56:53.701 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:56:53.702 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:56:53.702 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:56:53.702 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:56:53.702 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:56:53.702 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-19T06:56:53.702 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:56:53.702 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-19T06:56:53.702 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:56:53.702 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:56:53.702 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-19T06:56:53.703 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-19T06:56:53.704 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:56:53.704 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:56:53.704 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:56:53.704 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:56:53.704 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 322992, 2024-09-19T06:56:53.704 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 218, 2024-09-19T06:56:53.704 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:56:53.704 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-19T06:56:53.704 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-19T06:56:53.704 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-19T06:56:53.705 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:56:53.705 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-19T06:56:53.705 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:56:53.705 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-19T06:56:53.705 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 8704, 2024-09-19T06:56:53.705 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 191, 2024-09-19T06:56:53.705 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:56:53.705 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:56:53.705 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-19T06:56:53.705 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 591020, 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 6494, 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter": { 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "op_active": 0, 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "op_laggy": 0, 2024-09-19T06:56:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send": 11778, 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send_bytes": 30763778, 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: "op_resend": 33, 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: "op_reply": 11778, 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: "op_latency": { 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 11778, 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 98.213529808, 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.008338727 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: "op_inflight": 0, 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: "oplen_avg": { 2024-09-19T06:56:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 11778, 2024-09-19T06:56:53.708 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 15461 2024-09-19T06:56:53.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.708 INFO:teuthology.orchestra.run.smithi016.stdout: "op": 11778, 2024-09-19T06:56:53.708 INFO:teuthology.orchestra.run.smithi016.stdout: "op_r": 6248, 2024-09-19T06:56:53.708 INFO:teuthology.orchestra.run.smithi016.stdout: "op_w": 5530, 2024-09-19T06:56:53.708 INFO:teuthology.orchestra.run.smithi016.stdout: "op_rmw": 0, 2024-09-19T06:56:53.708 INFO:teuthology.orchestra.run.smithi016.stdout: "op_pg": 0, 2024-09-19T06:56:53.708 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_stat": 681, 2024-09-19T06:56:53.708 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_create": 1070, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_read": 31, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_write": 2667, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writefull": 271, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writesame": 0, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_append": 0, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_zero": 0, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_truncate": 3, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_delete": 563, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_mapext": 0, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_sparse_read": 0, 2024-09-19T06:56:53.709 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_clonerange": 0, 2024-09-19T06:56:53.710 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_getxattr": 6216, 2024-09-19T06:56:53.710 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_setxattr": 2140, 2024-09-19T06:56:53.710 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:56:53.710 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_rmxattr": 0, 2024-09-19T06:56:53.710 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:56:53.710 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_call": 0, 2024-09-19T06:56:53.710 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_watch": 0, 2024-09-19T06:56:53.710 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_notify": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_other": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_active": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_send": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_resend": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_ping": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_active": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_send": 0, 2024-09-19T06:56:53.711 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_resend": 0, 2024-09-19T06:56:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_active": 0, 2024-09-19T06:56:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_send": 0, 2024-09-19T06:56:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_resend": 0, 2024-09-19T06:56:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_active": 0, 2024-09-19T06:56:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_send": 0, 2024-09-19T06:56:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_resend": 0, 2024-09-19T06:56:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: "command_active": 0, 2024-09-19T06:56:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: "command_send": 0, 2024-09-19T06:56:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: "command_resend": 0, 2024-09-19T06:56:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: "map_epoch": 106, 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: "map_full": 0, 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: "map_inc": 25, 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_sessions": 12, 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_open": 12, 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_close": 0, 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_laggy": 0, 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_wr": 1701, 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_rd": 46, 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_del": 72 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.713 INFO:teuthology.orchestra.run.smithi016.stdout: "oft": { 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_objs": 1, 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_updates": 0, 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_removes": 0 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: "osd-slow-ops": { 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_ops_count": 4464 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: "purge_queue": { 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops": 0, 2024-09-19T06:56:53.714 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops_high_water": 13, 2024-09-19T06:56:53.715 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing": 0, 2024-09-19T06:56:53.715 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_high_water": 6, 2024-09-19T06:56:53.715 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed_ops": 39, 2024-09-19T06:56:53.715 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed": 25, 2024-09-19T06:56:53.715 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_item_in_journal": 0 2024-09-19T06:56:53.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.715 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:56:53.715 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:53.715 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-19T06:56:53.715 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 34765, 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 12276524, 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 34765, 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 34765, 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 12276524, 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.716 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_bytes": { 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:53.717 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 11778, 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 30766067, 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 11778, 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 30766067, 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_ops": { 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:53.718 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 1024, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 11778, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 11778, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 11778, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 11778, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.719 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 25, 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 2573, 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:53.720 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 25, 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 11, 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 2573, 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:53.721 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle-0x55a161c6c960": { 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 4398, 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 26026845, 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 4398, 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 2656, 2024-09-19T06:56:53.722 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 26026845, 2024-09-19T06:56:53.723 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:53.723 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:53.723 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:53.723 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:53.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:53.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:53.723 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-19T06:56:54.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:54 smithi173 ceph-mon[35349]: pgmap v525: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-19T06:56:54.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:54 smithi012 ceph-mon[30937]: pgmap v525: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-19T06:56:54.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:54 smithi016 ceph-mon[34911]: pgmap v525: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-19T06:56:54.641 INFO:tasks.check_counter:Daemon mds.b mds.exported=22 2024-09-19T06:56:54.642 INFO:tasks.check_counter:Daemon mds.b mds.imported=4 2024-09-19T06:56:54.642 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=163 2024-09-19T06:56:54.642 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=246 2024-09-19T06:56:54.642 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T06:56:54.642 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=16 2024-09-19T06:56:54.642 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=10 2024-09-19T06:56:54.642 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T06:56:54.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T06:56:54.894 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:56:55.438 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 1323, 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 1325, 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 4434107, 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 420778, 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 7, 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 2, 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.110458362, 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.040470674, 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.029662635, 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.029564859, 2024-09-19T06:56:55.439 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 1323, 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.046344794, 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000035030 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:56:55.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 386, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 542, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 1730930, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 645649, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 5, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 3, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.065403507, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.027274729, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.051841148, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.000053925, 2024-09-19T06:56:55.441 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 542, 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.039234313, 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000072388 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 1730416, 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 645008 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.442 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 2095, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 2126, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 614194, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 791476, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 6, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 4, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.192428788, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.055321396, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.048823387, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.067852214, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 2123, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.083902585, 2024-09-19T06:56:55.443 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000039520 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 125584 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 1, 2024-09-19T06:56:55.444 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-MDSRank": { 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 5744, 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.149472639, 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000026022 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-PurgeQueue": { 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.445 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: "request": 0, 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: "reply": 0, 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: "reply_latency": { 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_reply": 0, 2024-09-19T06:56:55.446 INFO:teuthology.orchestra.run.smithi016.stdout: "forward": 0, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_complete": 0, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_keys": 0, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_commit": 0, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_split": 0, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_merge": 0, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes": 404, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_top": 42, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_bottom": 362, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pin_tail": 0, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pinned": 343, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_expired": 0, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_with_caps": 0, 2024-09-19T06:56:55.447 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "subtrees": 14, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_hit": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_forward": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_discover": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_remote_ino": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_lock": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "load_cent": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "q": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "exported": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "exported_inodes": 0, 2024-09-19T06:56:55.448 INFO:teuthology.orchestra.run.smithi016.stdout: "imported": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "imported_inodes": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_dir_fetch": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_peer_discover": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rfiles": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rbytes": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rsnaps": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_set_tag": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:56:55.449 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_file_inodes": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_cap_release": 0, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "process_request_cap_release": 0 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.450 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache": { 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update_receipt": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_try_discover": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_send_discover": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_handle_discover": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_delayed": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_created": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_enqueued": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_reintegrated": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_migrated": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_processing": 0, 2024-09-19T06:56:55.451 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_started": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_completed": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_exportdir": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_flush": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragstats": 0, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_inodestats": 0 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.452 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log": { 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "evlrg": 0, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "evadd": 0, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "evex": 0, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "evtrm": 0, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "ev": 1778, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "evexg": 0, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "evexd": 0, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "segadd": 0, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "segex": 0, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "segtrm": 0, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "seg": 3, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "segmjr": 2, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "segexg": 0, 2024-09-19T06:56:55.453 INFO:teuthology.orchestra.run.smithi016.stdout: "segexd": 0, 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "expos": 4194304, 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "wrpos": 8284682, 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rdpos": 8284108, 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "jlat": { 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "replayed": 1778 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_mem": { 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "ino": 170, 2024-09-19T06:56:55.454 INFO:teuthology.orchestra.run.smithi016.stdout: "ino+": 533, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "ino-": 363, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "dir": 26, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "dir+": 32, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "dir-": 6, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "dn": 404, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "dn+": 572, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "dn-": 168, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "cap": 0, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "cap+": 0, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "cap-": 0, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rss": 50392, 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: "heap": 215328 2024-09-19T06:56:55.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_server": { 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_client_request": 0, 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_server_request": 0, 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_request": 0, 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_session": 0, 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_peer_request": 0, 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "req_create_latency": { 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getattr_latency": { 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getfilelock_latency": { 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "req_link_latency": { 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookup_latency": { 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookuphash_latency": { 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupino_latency": { 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.458 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupname_latency": { 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupparent_latency": { 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.459 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupsnap_latency": { 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lssnap_latency": { 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.460 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mkdir_latency": { 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mknod_latency": { 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.461 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mksnap_latency": { 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: "req_open_latency": { 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "req_readdir_latency": { 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rename_latency": { 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "req_renamesnap_latency": { 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.463 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: "req_snapdiff_latency": { 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmdir_latency": { 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.464 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmsnap_latency": { 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmxattr_latency": { 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setattr_latency": { 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setdirlayout_latency": { 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setfilelock_latency": { 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.466 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.467 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setlayout_latency": { 2024-09-19T06:56:55.467 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.467 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.467 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.468 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setxattr_latency": { 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "req_symlink_latency": { 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "req_unlink_latency": { 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.469 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getvxattr_latency": { 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_sessions": { 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "session_count": 1, 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "session_add": 2, 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "session_remove": 1, 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_open": 2, 2024-09-19T06:56:55.470 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_stale": 0, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "total_load": 0, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "average_load": 0, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "avg_session_uptime": 3540, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "mdthresh_evicted": 0 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:56:55.472 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:56:55.473 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 197866, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 260, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 8704, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 191, 2024-09-19T06:56:55.474 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 780915, 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 13955, 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.475 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter": { 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "op_active": 0, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "op_laggy": 0, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send": 3419, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send_bytes": 21, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "op_resend": 3, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "op_reply": 3419, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "op_latency": { 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 3419, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 12.445808713, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.003640189 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "op_inflight": 0, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "oplen_avg": { 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 3419, 2024-09-19T06:56:55.476 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 3420 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "op": 3419, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "op_r": 3419, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "op_w": 0, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "op_rmw": 0, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "op_pg": 0, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_stat": 2094, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_create": 0, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_read": 1323, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_write": 0, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writefull": 0, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writesame": 0, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_append": 0, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_zero": 0, 2024-09-19T06:56:55.477 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_truncate": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_delete": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_mapext": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_sparse_read": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_clonerange": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_getxattr": 1, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_setxattr": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_rmxattr": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_call": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_watch": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_notify": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls": 0, 2024-09-19T06:56:55.478 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_other": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_active": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_send": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_resend": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_ping": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_active": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_send": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_resend": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_active": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_send": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_resend": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_active": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_send": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_resend": 0, 2024-09-19T06:56:55.479 INFO:teuthology.orchestra.run.smithi016.stdout: "command_active": 0, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "command_send": 0, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "command_resend": 0, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "map_epoch": 106, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "map_full": 0, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "map_inc": 23, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_sessions": 5, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_open": 7, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_close": 2, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_laggy": 0, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_wr": 0, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_rd": 2, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_del": 0 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "oft": { 2024-09-19T06:56:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_objs": 0, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_updates": 0, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_removes": 0 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "osd-slow-ops": { 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_ops_count": 0 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "purge_queue": { 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops": 0, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing": 0, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_high_water": 0, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed_ops": 0, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed": 0, 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_item_in_journal": 0 2024-09-19T06:56:55.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 3800, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 6414913, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 3800, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 3800, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 6414913, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.482 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_bytes": { 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 3419, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 4090383, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 3419, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 4090383, 2024-09-19T06:56:55.483 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_ops": { 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 1024, 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:55.484 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 3419, 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 3419, 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 3419, 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 3419, 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:55.485 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 0, 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 0, 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:55.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle-0x55ffd0420b40": { 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 0, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 0, 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:55.487 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:55.488 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:55.488 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:55.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:55.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:55.488 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-19T06:56:56.272 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T06:56:56.273 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T06:56:56.273 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-19T06:56:56.273 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-19T06:56:56.273 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-19T06:56:56.273 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:56:56.273 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:56:56.273 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T06:56:56.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T06:56:56.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:56 smithi173 ceph-mon[35349]: pgmap v526: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-19T06:56:56.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:56 smithi012 ceph-mon[30937]: pgmap v526: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-19T06:56:56.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:56 smithi016 ceph-mon[34911]: pgmap v526: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-19T06:56:56.524 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:56:57.012 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-19T06:56:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:56:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 1775, 2024-09-19T06:56:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 1775, 2024-09-19T06:56:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 8932817, 2024-09-19T06:56:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 563636, 2024-09-19T06:56:57.012 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 6, 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 2, 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.164199131, 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.057551273, 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.044077781, 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.047534701, 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 1774, 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.090331406, 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000050919 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.013 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 1368, 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 1600, 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 9637207, 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 1010182, 2024-09-19T06:56:57.014 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 7, 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 5, 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.109968608, 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.030972506, 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.036483377, 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.032746053, 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 1597, 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.054013609, 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000033821 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:57.015 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 575728 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 991, 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 947, 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 10269759, 2024-09-19T06:56:57.016 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 388377, 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 4, 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 3, 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.105202543, 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.032081393, 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.067564534, 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.016504991, 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 946, 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.036237758, 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000038306 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:57.017 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 1727120, 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 193760 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 1, 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.018 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-MDSRank": { 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 6340, 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.168042224, 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000026505 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-PurgeQueue": { 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.019 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: "request": 0, 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: "reply": 0, 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: "reply_latency": { 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.020 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_reply": 0, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "forward": 0, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_complete": 0, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_keys": 0, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_commit": 0, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_split": 0, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_merge": 0, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes": 172, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_top": 67, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_bottom": 105, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pin_tail": 0, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pinned": 77, 2024-09-19T06:56:57.021 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_expired": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_with_caps": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "subtrees": 24, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_hit": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_forward": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_discover": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_remote_ino": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_lock": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "load_cent": 0, 2024-09-19T06:56:57.022 INFO:teuthology.orchestra.run.smithi016.stdout: "q": 0, 2024-09-19T06:56:57.023 INFO:teuthology.orchestra.run.smithi016.stdout: "exported": 0, 2024-09-19T06:56:57.023 INFO:teuthology.orchestra.run.smithi016.stdout: "exported_inodes": 0, 2024-09-19T06:56:57.023 INFO:teuthology.orchestra.run.smithi016.stdout: "imported": 0, 2024-09-19T06:56:57.023 INFO:teuthology.orchestra.run.smithi016.stdout: "imported_inodes": 0, 2024-09-19T06:56:57.023 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_dir_fetch": 0, 2024-09-19T06:56:57.023 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:56:57.023 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_peer_discover": 0, 2024-09-19T06:56:57.023 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rfiles": 1011, 2024-09-19T06:56:57.023 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rbytes": 1466414659, 2024-09-19T06:56:57.023 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rsnaps": 6, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_set_tag": 0, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_file_inodes": 0, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:56:57.024 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps": 0, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_cap_release": 0, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "process_request_cap_release": 0 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache": { 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update": 0, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update_receipt": 0, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_try_discover": 0, 2024-09-19T06:56:57.025 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_send_discover": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_handle_discover": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_delayed": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_created": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_enqueued": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_reintegrated": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_migrated": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_processing": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:56:57.026 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_started": 0, 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_completed": 0, 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_exportdir": 0, 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_flush": 0, 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragstats": 0, 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_inodestats": 0 2024-09-19T06:56:57.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log": { 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "evlrg": 0, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "evadd": 0, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "evex": 0, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "evtrm": 0, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "ev": 4398, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "evexg": 0, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "evexd": 0, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "segadd": 0, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "segex": 0, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "segtrm": 0, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "seg": 2, 2024-09-19T06:56:57.028 INFO:teuthology.orchestra.run.smithi016.stdout: "segmjr": 75, 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: "segexg": 0, 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: "segexd": 0, 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: "expos": 29815929, 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: "wrpos": 30221149, 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: "rdpos": 30205525, 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: "jlat": { 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: "replayed": 4398 2024-09-19T06:56:57.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_mem": { 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "ino": 109, 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "ino+": 1781, 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "ino-": 1672, 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "dir": 47, 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "dir+": 133, 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "dir-": 86, 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "dn": 172, 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "dn+": 1849, 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "dn-": 1677, 2024-09-19T06:56:57.030 INFO:teuthology.orchestra.run.smithi016.stdout: "cap": 0, 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "cap+": 0, 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "cap-": 0, 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "rss": 54364, 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "heap": 215328 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_server": { 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_client_request": 0, 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_server_request": 0, 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_request": 0, 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_session": 0, 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_peer_request": 0, 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "req_create_latency": { 2024-09-19T06:56:57.031 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getattr_latency": { 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getfilelock_latency": { 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.032 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "req_link_latency": { 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookup_latency": { 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookuphash_latency": { 2024-09-19T06:56:57.033 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupino_latency": { 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupname_latency": { 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.034 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupparent_latency": { 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupsnap_latency": { 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lssnap_latency": { 2024-09-19T06:56:57.035 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.036 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.036 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.036 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mkdir_latency": { 2024-09-19T06:56:57.036 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mknod_latency": { 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mksnap_latency": { 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.037 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "req_open_latency": { 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "req_readdir_latency": { 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rename_latency": { 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.038 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "req_renamesnap_latency": { 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "req_snapdiff_latency": { 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmdir_latency": { 2024-09-19T06:56:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmsnap_latency": { 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmxattr_latency": { 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setattr_latency": { 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setdirlayout_latency": { 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.041 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setfilelock_latency": { 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setlayout_latency": { 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setxattr_latency": { 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.042 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: "req_symlink_latency": { 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: "req_unlink_latency": { 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getvxattr_latency": { 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_sessions": { 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: "session_count": 2, 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: "session_add": 5, 2024-09-19T06:56:57.044 INFO:teuthology.orchestra.run.smithi016.stdout: "session_remove": 3, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_open": 4, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_stale": 0, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "total_load": 0, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "average_load": 0, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "avg_session_uptime": 3538, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "mdthresh_evicted": 0 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:56:57.045 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-19T06:56:57.046 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-19T06:56:57.047 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 203612, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 201, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-19T06:56:57.048 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 8704, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 191, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 507679, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 4291, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-19T06:56:57.049 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter": { 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "op_active": 0, 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "op_laggy": 0, 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send": 3749, 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send_bytes": 26, 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "op_resend": 4, 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "op_reply": 3749, 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "op_latency": { 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 3749, 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 3.701943197, 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000987448 2024-09-19T06:56:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "op_inflight": 0, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "oplen_avg": { 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 3749, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 3750 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "op": 3749, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "op_r": 3749, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "op_w": 0, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "op_rmw": 0, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "op_pg": 0, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_stat": 2209, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_create": 0, 2024-09-19T06:56:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_read": 1537, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_write": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writefull": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writesame": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_append": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_zero": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_truncate": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_delete": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_mapext": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_sparse_read": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_clonerange": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_getxattr": 2, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_setxattr": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:56:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_rmxattr": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_call": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_watch": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_notify": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_other": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_active": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_send": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_resend": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_ping": 0, 2024-09-19T06:56:57.053 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_active": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_send": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_resend": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_active": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_send": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_resend": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_active": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_send": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_resend": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "command_active": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "command_send": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "command_resend": 0, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "map_epoch": 106, 2024-09-19T06:56:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: "map_full": 0, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "map_inc": 23, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_sessions": 6, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_open": 6, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_close": 0, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_laggy": 0, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_wr": 0, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_rd": 2, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_del": 0 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "oft": { 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_objs": 0, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:56:57.055 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_updates": 0, 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_removes": 0 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "osd-slow-ops": { 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_ops_count": 0 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "purge_queue": { 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops": 0, 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing": 0, 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_high_water": 0, 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed_ops": 0, 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed": 0, 2024-09-19T06:56:57.056 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_item_in_journal": 0 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 4130, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 28445771, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 4130, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 4130, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 28445771, 2024-09-19T06:56:57.057 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_bytes": { 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:57.058 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 3749, 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 26067901, 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 3749, 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 26067901, 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_ops": { 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 1024, 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:57.059 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 3749, 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 3749, 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 3749, 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 3749, 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 0, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 0, 2024-09-19T06:56:57.061 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle-0x560255d64b40": { 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:57.062 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 0, 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 0, 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:57.063 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-19T06:56:57.795 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T06:56:57.795 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T06:56:57.795 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-19T06:56:57.795 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-19T06:56:57.795 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-19T06:56:57.795 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:56:57.795 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:56:57.795 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T06:56:57.796 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T06:56:58.049 INFO:teuthology.orchestra.run.smithi016.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:56:58.302 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:56:58 smithi016 ceph-mon[34911]: pgmap v527: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2024-09-19T06:56:58.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:56:58 smithi173 ceph-mon[35349]: pgmap v527: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2024-09-19T06:56:58.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:56:58 smithi012 ceph-mon[30937]: pgmap v527: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2024-09-19T06:56:58.533 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 1860, 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 2064, 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 1052325, 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 2274630, 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 13, 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 5, 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.151059868, 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.058232723, 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.038363906, 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.037096385, 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:58.534 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 2062, 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.098678613, 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000047855 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 228, 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000041582, 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000182 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 451504 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:56:58.535 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 3071, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 3502, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 1570199, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 1826317, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 23, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 8, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.208937145, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.074960195, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.102435388, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.032292428, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 3498, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.252000118, 2024-09-19T06:56:58.536 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000072041 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 2905, 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000571357, 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000196 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 7424, 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 129872 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_messages": 6810, 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages": 4694, 2024-09-19T06:56:58.537 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_bytes": 4593991, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_bytes": 2275802, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_created_connections": 44, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_active_connections": 5, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_total_time": 0.464768750, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_send_time": 0.193458881, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_recv_time": 0.313967209, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_running_fast_dispatch_time": 0.024894047, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 4695, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.237254266, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000050533 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:56:58.538 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 8525, 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.001527005, 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000179 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_recv_encrypted_bytes": 1724784, 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "msgr_send_encrypted_bytes": 217056 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "cct": { 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "total_workers": 1, 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "unhealthy_workers": 0 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-MDSRank": { 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-19T06:56:58.539 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 3483, 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.682370141, 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000195914 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "finisher-PurgeQueue": { 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "queue_len": 0, 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "complete_latency": { 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 88, 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.003550104, 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000040342 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:58.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": { 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "request": 431, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "reply": 413, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "reply_latency": { 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 413, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 5.786954268, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.014011995 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_reply": 0, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "forward": 18, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_complete": 0, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_fetch_keys": 0, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_commit": 19, 2024-09-19T06:56:58.541 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_split": 1, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_merge": 0, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes": 427, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_top": 58, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_bottom": 369, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pin_tail": 0, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_pinned": 343, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_expired": 4, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "inodes_with_caps": 203, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": 203, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "subtrees": 36, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse": 915, 2024-09-19T06:56:58.542 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_hit": 805, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_forward": 17, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_discover": 25, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_remote_ino": 0, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "traverse_lock": 0, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "load_cent": 119, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "q": 0, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "exported": 0, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "exported_inodes": 0, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "imported": 6, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "imported_inodes": 252, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_dir_fetch": 0, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_backtrace_fetch": 3611, 2024-09-19T06:56:58.543 INFO:teuthology.orchestra.run.smithi016.stdout: "openino_peer_discover": 0, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rfiles": 1030, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rbytes": 1718859367, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "root_rsnaps": 6, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_fetch": 3611, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_set_tag": 0, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "scrub_file_inodes": 3611, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:56:58.544 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_revoke": 267, 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_grant": 522, 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps": 532, 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_caps_dirty": 111, 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_cap_release": 38, 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "process_request_cap_release": 63 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache": { 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update": 84, 2024-09-19T06:56:58.545 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_update_receipt": 406, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_try_discover": 215, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_send_discover": 362, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "dir_handle_discover": 100, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays": 0, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_delayed": 0, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_created": 19, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_enqueued": 19, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_reintegrated": 0, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "strays_migrated": 0, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_processing": 0, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:56:58.546 INFO:teuthology.orchestra.run.smithi016.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_started": 0, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "recovery_completed": 0, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_path": 14, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_quiesce_inode": 2917, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_exportdir": 0, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_flush": 0, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragmentdir": 1, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_fragstats": 0, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "ireq_inodestats": 0 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log": { 2024-09-19T06:56:58.547 INFO:teuthology.orchestra.run.smithi016.stdout: "evlrg": 0, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "evadd": 715, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "evex": 0, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "evtrm": 0, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "ev": 715, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "evexg": 0, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "evexd": 0, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "segadd": 2, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "segex": 0, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "segtrm": 0, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "seg": 2, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "segmjr": 2, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "segexg": 0, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "segexd": 0, 2024-09-19T06:56:58.548 INFO:teuthology.orchestra.run.smithi016.stdout: "expos": 4194304, 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "wrpos": 5214151, 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "rdpos": 0, 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "jlat": { 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 314, 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 2.734426177, 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.008708363 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "replayed": 0 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_mem": { 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "ino": 402, 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "ino+": 423, 2024-09-19T06:56:58.549 INFO:teuthology.orchestra.run.smithi016.stdout: "ino-": 21, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "dir": 72, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "dir+": 235, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "dir-": 163, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "dn": 427, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "dn+": 458, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "dn-": 31, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "cap": 203, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "cap+": 301, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "cap-": 98, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "rss": 58200, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "heap": 223520 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.550 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_server": { 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_client_request": 517, 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "dispatch_server_request": 0, 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_request": 431, 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_client_session": 22, 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "handle_peer_request": 35, 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "req_create_latency": { 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 20, 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.034258150, 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.001712907 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getattr_latency": { 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 163, 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 5.625030488, 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.034509389 2024-09-19T06:56:58.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getfilelock_latency": { 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "req_link_latency": { 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookup_latency": { 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 143, 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.052470993, 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000366930 2024-09-19T06:56:58.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookuphash_latency": { 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupino_latency": { 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupname_latency": { 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.553 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupparent_latency": { 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lookupsnap_latency": { 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "req_lssnap_latency": { 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mkdir_latency": { 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mknod_latency": { 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.555 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "req_mksnap_latency": { 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "req_open_latency": { 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 52, 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.036281891, 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000697728 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "req_readdir_latency": { 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 16, 2024-09-19T06:56:58.556 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.007376305, 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000461019 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rename_latency": { 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "req_renamesnap_latency": { 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "req_snapdiff_latency": { 2024-09-19T06:56:58.557 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmdir_latency": { 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmsnap_latency": { 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "req_rmxattr_latency": { 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setattr_latency": { 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setdirlayout_latency": { 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.559 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setfilelock_latency": { 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setlayout_latency": { 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "req_setxattr_latency": { 2024-09-19T06:56:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "req_symlink_latency": { 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "req_unlink_latency": { 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 19, 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.031536441, 2024-09-19T06:56:58.561 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.001659812 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "req_getvxattr_latency": { 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_sessions": { 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "session_count": 1, 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "session_add": 3, 2024-09-19T06:56:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: "session_remove": 2, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_open": 1, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "sessions_stale": 0, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "total_load": 47, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "average_load": 47, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "avg_session_uptime": 1008, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "mdthresh_evicted": 0 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool": { 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "bloom_filter_items": 0, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:56:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_items": 0, 2024-09-19T06:56:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blob_items": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_txc_items": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_writing_items": 0, 2024-09-19T06:56:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_bytes": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_items": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_bytes": 288984, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_anon_items": 363, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "buffer_meta_items": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bytes": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_items": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:56:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mapbl_items": 0, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pglog_items": 0, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_bytes": 8704, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_items": 191, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_bytes": 0, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "pgmap_items": 0, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_bytes": 1395410, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_co_items": 10872, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_bytes": 0, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_1_items": 0, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_bytes": 0, 2024-09-19T06:56:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: "unittest_2_items": 0 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter": { 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "op_active": 0, 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "op_laggy": 0, 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send": 4199, 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "op_send_bytes": 1138745, 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "op_resend": 33, 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "op_reply": 4199, 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "op_latency": { 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 4199, 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 8.917862952, 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.002123806 2024-09-19T06:56:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "op_inflight": 0, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "oplen_avg": { 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 4199, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 4359 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "op": 4199, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "op_r": 3621, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "op_w": 578, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "op_rmw": 0, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "op_pg": 0, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_stat": 0, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_create": 10, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_read": 10, 2024-09-19T06:56:58.569 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_write": 324, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writefull": 71, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_writesame": 0, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_append": 0, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_zero": 0, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_truncate": 0, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_delete": 32, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_mapext": 0, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_sparse_read": 0, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_clonerange": 0, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_getxattr": 3611, 2024-09-19T06:56:58.570 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_setxattr": 20, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_rmxattr": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_call": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_watch": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_notify": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "osdop_other": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_active": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_send": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_resend": 0, 2024-09-19T06:56:58.571 INFO:teuthology.orchestra.run.smithi016.stdout: "linger_ping": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_active": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_send": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "poolop_resend": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_active": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_send": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "poolstat_resend": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_active": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_send": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "statfs_resend": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "command_active": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "command_send": 0, 2024-09-19T06:56:58.572 INFO:teuthology.orchestra.run.smithi016.stdout: "command_resend": 0, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "map_epoch": 106, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "map_full": 0, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "map_inc": 23, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_sessions": 12, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_open": 12, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_session_close": 0, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_laggy": 0, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_wr": 232, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_rd": 0, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_del": 49 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "oft": { 2024-09-19T06:56:58.573 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_objs": 1, 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_updates": 0, 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "omap_total_removes": 0 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "osd-slow-ops": { 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "slow_ops_count": 2909 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "purge_queue": { 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops": 0, 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_ops_high_water": 6, 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing": 0, 2024-09-19T06:56:58.574 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executing_high_water": 6, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed_ops": 19, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_executed": 19, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "pq_item_in_journal": 0 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 11737, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 6134199, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 11737, 2024-09-19T06:56:58.575 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 11737, 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 6134199, 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_bytes": { 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 104857600, 2024-09-19T06:56:58.576 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 4199, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 1141024, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 4199, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 1141024, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-objecter_ops": { 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 1024, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 0, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 0, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 0, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 4199, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 4199, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 4199, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 4199, 2024-09-19T06:56:58.578 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 19, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 2279, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 19, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:58.579 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 10, 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 2279, 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "throttle-write_buf_throttle-0x55c2e8a02960": { 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "val": 0, 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "max": 3758096384, 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "get_started": 0, 2024-09-19T06:56:58.580 INFO:teuthology.orchestra.run.smithi016.stdout: "get": 715, 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "get_sum": 1019847, 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_fail": 0, 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "get_or_fail_success": 715, 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "take": 0, 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "take_sum": 0, 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "put": 314, 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "put_sum": 1019847, 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "wait": { 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "avgcount": 0, 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "sum": 0.000000000, 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: "avgtime": 0.000000000 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-09-19T06:56:58.581 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-09-19T06:56:59.276 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-19T06:56:59.276 INFO:tasks.check_counter:Daemon mds.k mds.imported=6 2024-09-19T06:56:59.276 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=84 2024-09-19T06:56:59.276 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=406 2024-09-19T06:56:59.277 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=6 2024-09-19T06:56:59.277 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:56:59.277 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:56:59.277 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T06:56:59.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T06:56:59.535 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:57:00.032 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-19T06:57:00.032 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:00.032 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 9005, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 8861, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 4764328, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 7680934, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 10, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.558454982, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.219191086, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.376781788, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.029998465, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8862, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.382825330, 2024-09-19T06:57:00.033 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000043198 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 14207, 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.002681377, 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000188 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 1740544, 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 225888 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 2256, 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2327, 2024-09-19T06:57:00.034 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1373917, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 1424710, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 14, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.171639963, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.073923400, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.072596154, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.025661049, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2326, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.094780820, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000040748 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.035 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2140, 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000407127, 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000190 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 126224 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1440, 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 1679, 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 762588, 2024-09-19T06:57:00.036 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 1689649, 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 55, 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 10, 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.116999956, 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.036259654, 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.051951659, 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.021455480, 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1674, 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.086521041, 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000051685 2024-09-19T06:57:00.037 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.038 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:00.038 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 753, 2024-09-19T06:57:00.038 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000153812, 2024-09-19T06:57:00.038 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000204 2024-09-19T06:57:00.038 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.038 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T06:57:00.038 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 453808 2024-09-19T06:57:00.038 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.038 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2521, 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.839928924, 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000333172 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-19T06:57:00.039 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 831, 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.026583933, 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000031990 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 1046, 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 965, 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 965, 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 42.928893257, 2024-09-19T06:57:00.040 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.044485899 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 81, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 3, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 19, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 1, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 201, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 38, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 147, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 16, 2024-09-19T06:57:00.041 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 146, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 193, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 85, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 85, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 51, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 2535, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 2005, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 81, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 32, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 74, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 1112, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 1, 2024-09-19T06:57:00.042 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 4, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 163, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 9, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 163, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 1782, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 1030, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 1718859367, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 6, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 1782, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:57:00.043 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 72, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 72, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 1710, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 6, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 451, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 1113, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 1047, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 329, 2024-09-19T06:57:00.044 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 174, 2024-09-19T06:57:00.045 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 898 2024-09-19T06:57:00.045 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.045 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-19T06:57:00.045 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 242, 2024-09-19T06:57:00.045 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 272, 2024-09-19T06:57:00.045 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 149, 2024-09-19T06:57:00.045 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 221, 2024-09-19T06:57:00.045 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 253, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 4, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 218, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 214, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 14, 2024-09-19T06:57:00.046 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 1577, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 4, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 1, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 1778, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-19T06:57:00.047 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 1778, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 3, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 3, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 8284682, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-19T06:57:00.048 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 519, 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6.942923102, 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.013377501 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 188, 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 569, 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 381, 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 90, 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 185, 2024-09-19T06:57:00.049 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 95, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 204, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 612, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 408, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 85, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 442, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 357, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 61676, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 223520 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 1754, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 25, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 1046, 2024-09-19T06:57:00.050 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 30, 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 474, 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 214, 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 35.893683433, 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.167727492 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 15, 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.018480249, 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001232016 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.051 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3, 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.020004519, 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.006668173 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 269, 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6.402416814, 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.023800806 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.052 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000104794, 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000104794 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.053 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-19T06:57:00.054 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 227, 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.091986392, 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000405226 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 18, 2024-09-19T06:57:00.056 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.007070786, 2024-09-19T06:57:00.057 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000392821 2024-09-19T06:57:00.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.057 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-19T06:57:00.057 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 200, 2024-09-19T06:57:00.057 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.462768524, 2024-09-19T06:57:00.057 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002313842 2024-09-19T06:57:00.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.057 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-19T06:57:00.057 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.057 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.058 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-19T06:57:00.059 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.060 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-19T06:57:00.061 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 18, 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.032377746, 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001798763 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.062 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 2, 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 1, 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 105, 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 105, 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 989, 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-19T06:57:00.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:00.064 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:00.065 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 438300, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 309, 2024-09-19T06:57:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 88, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 1, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 8704, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 191, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-19T06:57:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 830776, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 15937, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 3097, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 4258225, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 33, 2024-09-19T06:57:00.068 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 3097, 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3097, 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 11.941740606, 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.003855905 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3097, 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 3323 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 3097, 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 1891, 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 1206, 2024-09-19T06:57:00.069 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 106, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 625, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 148, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 1, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 226, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-19T06:57:00.070 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 1783, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-19T06:57:00.071 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-19T06:57:00.072 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 106, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 23, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 12, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 12, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 294, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 6, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 104 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.073 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 1571 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 6, 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 6, 2024-09-19T06:57:00.074 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 214, 2024-09-19T06:57:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 214, 2024-09-19T06:57:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-19T06:57:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-19T06:57:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 12697, 2024-09-19T06:57:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 5732679, 2024-09-19T06:57:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:00.076 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 12697, 2024-09-19T06:57:00.076 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:00.076 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:00.076 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 12697, 2024-09-19T06:57:00.076 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 5732679, 2024-09-19T06:57:00.077 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:00.077 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.077 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.077 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.077 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:00.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.077 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-19T06:57:00.078 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:00.078 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-19T06:57:00.078 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:00.078 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:00.078 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:00.079 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:00.079 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:00.079 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 3097, 2024-09-19T06:57:00.079 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 4280495, 2024-09-19T06:57:00.079 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 3097, 2024-09-19T06:57:00.080 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 4280495, 2024-09-19T06:57:00.080 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:00.080 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.080 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.080 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.080 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:00.080 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.081 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-19T06:57:00.081 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:00.081 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-19T06:57:00.081 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:00.081 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:00.081 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:00.082 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:00.082 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:00.082 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 3097, 2024-09-19T06:57:00.082 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 3097, 2024-09-19T06:57:00.082 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 3097, 2024-09-19T06:57:00.082 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 3097, 2024-09-19T06:57:00.082 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:00.083 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.083 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.083 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.083 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:00.083 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.083 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:57:00.084 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:00.084 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-19T06:57:00.084 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:00.084 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 214, 2024-09-19T06:57:00.084 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 22318, 2024-09-19T06:57:00.084 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:00.084 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 214, 2024-09-19T06:57:00.084 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:00.084 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 106, 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 22318, 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x55b943bc8960": { 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:00.085 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 1778, 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 4090378, 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 1778, 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 519, 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 4090378, 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:00.086 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-19T06:57:00.198 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:00 smithi173 ceph-mon[35349]: pgmap v528: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-19T06:57:00.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:00 smithi012 ceph-mon[30937]: pgmap v528: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-19T06:57:00.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:00 smithi016 ceph-mon[34911]: pgmap v528: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-19T06:57:00.835 INFO:tasks.check_counter:Daemon mds.c mds.exported=4 2024-09-19T06:57:00.836 INFO:tasks.check_counter:Daemon mds.c mds.imported=9 2024-09-19T06:57:00.836 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=242 2024-09-19T06:57:00.836 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=272 2024-09-19T06:57:00.836 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-19T06:57:00.836 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:57:00.836 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:57:00.836 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T06:57:00.836 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T06:57:01.091 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 3515, 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 3515, 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 7493409, 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 1116953, 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 6, 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.268285628, 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.083647567, 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.071137023, 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.094499652, 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3514, 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.123634820, 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000035183 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.705 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 382, 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 338, 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1728060, 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 195578, 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 3, 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.055361431, 2024-09-19T06:57:01.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.020624942, 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.050535523, 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000067363, 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 337, 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.021821199, 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000064751 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.707 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 1727504, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 194880 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 4, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 238, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 748, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 666350, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 8, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.013926540, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.008786827, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.002672197, 2024-09-19T06:57:01.708 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000109915, 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 235, 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.016289008, 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000069314 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.709 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 666032 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 5951, 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.138001438, 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000023189 2024-09-19T06:57:01.710 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 0, 2024-09-19T06:57:01.711 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 0, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 0, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-19T06:57:01.712 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 1133, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 412, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 721, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 545, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 40, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 0, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 0, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-09-19T06:57:01.713 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 0, 2024-09-19T06:57:01.714 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:57:01.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 0, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 0 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-09-19T06:57:01.716 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:57:01.717 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 0, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-19T06:57:01.718 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 2309, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 0, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 4, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 10701978, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 10697052, 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-19T06:57:01.719 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 2309 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 731, 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 1350, 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 619, 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 66, 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 105, 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 39, 2024-09-19T06:57:01.720 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 1133, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 1808, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 675, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 0, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 0, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 52936, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 215328 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 0, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 0, 2024-09-19T06:57:01.721 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 0, 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-19T06:57:01.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.723 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.724 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-19T06:57:01.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.726 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.726 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.726 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.726 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.728 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-19T06:57:01.730 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.731 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-19T06:57:01.732 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.733 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 2, 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 3, 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 1, 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 2, 2024-09-19T06:57:01.734 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 0, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 0, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 2259, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:01.735 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:01.736 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-19T06:57:01.737 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 216278, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 972, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:01.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 8704, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 191, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 2773529, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 62312, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.739 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 3514, 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 21, 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 3, 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 3514, 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3514, 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 2.649942333, 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000754109 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-19T06:57:01.740 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3514, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 3515 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 3514, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 3514, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 0, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 2143, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 0, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 1369, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 0, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 0, 2024-09-19T06:57:01.741 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 1, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:57:01.742 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-19T06:57:01.743 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 106, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 23, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 4, 2024-09-19T06:57:01.744 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 5, 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 1, 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 0, 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 2, 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 0 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 0, 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.745 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:01.746 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 3897, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 8849074, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 3897, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 3897, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 8849074, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.747 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 3514, 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 6507679, 2024-09-19T06:57:01.748 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 3514, 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 6507679, 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:01.749 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 3514, 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 3514, 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 3514, 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 3514, 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:57:01.750 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-19T06:57:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-19T06:57:01.751 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x555dfd68ab40": { 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:01.752 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:01.753 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-19T06:57:02.333 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:02 smithi173 ceph-mon[35349]: pgmap v529: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-19T06:57:02.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:02 smithi012 ceph-mon[30937]: pgmap v529: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-19T06:57:02.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:02 smithi016 ceph-mon[34911]: pgmap v529: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-19T06:57:02.525 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T06:57:02.525 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T06:57:02.525 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-19T06:57:02.525 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-19T06:57:02.525 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-19T06:57:02.525 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:57:02.525 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:57:02.525 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T06:57:02.526 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T06:57:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:57:03.302 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-19T06:57:03.302 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:03.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 2005, 2024-09-19T06:57:03.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2190, 2024-09-19T06:57:03.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1110157, 2024-09-19T06:57:03.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 1586092, 2024-09-19T06:57:03.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 51, 2024-09-19T06:57:03.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 7, 2024-09-19T06:57:03.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.143826774, 2024-09-19T06:57:03.302 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.045745599, 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.059963800, 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.028445824, 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2188, 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.093432535, 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000042702 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1069, 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000218889, 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000204 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.303 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 2208, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 9712 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 9777, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 8992, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 6282749, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 10275894, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 11, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.616463085, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.244886802, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.347985324, 2024-09-19T06:57:03.304 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.075839811, 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 8991, 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.404475891, 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000044986 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 10258, 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.002148172, 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000209 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 1745728, 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 671696 2024-09-19T06:57:03.305 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 6804, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 7980, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 3044685, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 4420438, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 17, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.386419475, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.161001513, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.217446099, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.032943321, 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:03.306 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 7978, 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.308140835, 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000038623 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 9677, 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.001630098, 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000168 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 4112, 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 126416 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-19T06:57:03.307 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6774, 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.668475639, 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000246305 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-19T06:57:03.308 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2, 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000012197, 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000006098 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 1489, 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 1397, 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1397, 2024-09-19T06:57:03.309 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 7.052660596, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.005048432 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 92, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 6, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 19, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 1, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 1065, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 75, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 956, 2024-09-19T06:57:03.310 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 34, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 953, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 686, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 573, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 573, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 45, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 4842, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 3653, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 76, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 34, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-19T06:57:03.311 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 340, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 1502, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 1, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 4, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 649, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 6, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 1202, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 5421, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 1030, 2024-09-19T06:57:03.312 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 1718859367, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 6, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 5421, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 59, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 59, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 5362, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 770, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 1054, 2024-09-19T06:57:03.313 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:57:03.314 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:57:03.314 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:57:03.314 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 1438, 2024-09-19T06:57:03.314 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 478, 2024-09-19T06:57:03.314 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 56, 2024-09-19T06:57:03.314 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 839 2024-09-19T06:57:03.314 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.314 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-19T06:57:03.314 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 191, 2024-09-19T06:57:03.315 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 406, 2024-09-19T06:57:03.315 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 217, 2024-09-19T06:57:03.315 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 394, 2024-09-19T06:57:03.315 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 349, 2024-09-19T06:57:03.315 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 8, 2024-09-19T06:57:03.315 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-19T06:57:03.315 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:57:03.315 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 189, 2024-09-19T06:57:03.315 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-09-19T06:57:03.315 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 181, 2024-09-19T06:57:03.316 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-19T06:57:03.316 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-19T06:57:03.316 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:57:03.316 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:57:03.316 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-19T06:57:03.316 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-19T06:57:03.316 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 14, 2024-09-19T06:57:03.316 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 3475, 2024-09-19T06:57:03.316 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:57:03.316 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 5, 2024-09-19T06:57:03.317 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-19T06:57:03.317 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 1, 2024-09-19T06:57:03.317 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-19T06:57:03.317 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-19T06:57:03.317 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.317 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-19T06:57:03.317 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-19T06:57:03.317 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 2310, 2024-09-19T06:57:03.317 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-19T06:57:03.317 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 2310, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 4, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 4, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 10707979, 2024-09-19T06:57:03.318 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1244, 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 4.728467441, 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.003801018 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 738, 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 1378, 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 640, 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 83, 2024-09-19T06:57:03.319 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 277, 2024-09-19T06:57:03.320 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 194, 2024-09-19T06:57:03.320 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 1072, 2024-09-19T06:57:03.320 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 1842, 2024-09-19T06:57:03.320 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 770, 2024-09-19T06:57:03.320 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 573, 2024-09-19T06:57:03.320 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 854, 2024-09-19T06:57:03.321 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 281, 2024-09-19T06:57:03.321 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 64412, 2024-09-19T06:57:03.321 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 223520 2024-09-19T06:57:03.321 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.321 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-19T06:57:03.321 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 3091, 2024-09-19T06:57:03.322 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 52, 2024-09-19T06:57:03.322 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 1489, 2024-09-19T06:57:03.322 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 398, 2024-09-19T06:57:03.322 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 685, 2024-09-19T06:57:03.322 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-19T06:57:03.322 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 36, 2024-09-19T06:57:03.323 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.064922170, 2024-09-19T06:57:03.323 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001803393 2024-09-19T06:57:03.323 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.323 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-19T06:57:03.323 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 21, 2024-09-19T06:57:03.323 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.005478034, 2024-09-19T06:57:03.323 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000260858 2024-09-19T06:57:03.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.324 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-19T06:57:03.324 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.324 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.324 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.324 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.325 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-19T06:57:03.325 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 188, 2024-09-19T06:57:03.325 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.424900455, 2024-09-19T06:57:03.325 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002260108 2024-09-19T06:57:03.325 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.325 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-19T06:57:03.326 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 627, 2024-09-19T06:57:03.326 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 4.907605998, 2024-09-19T06:57:03.326 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.007827122 2024-09-19T06:57:03.326 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.326 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-19T06:57:03.326 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.327 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.327 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.327 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.327 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-19T06:57:03.327 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-09-19T06:57:03.327 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000159690, 2024-09-19T06:57:03.328 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000159690 2024-09-19T06:57:03.328 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.328 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-19T06:57:03.328 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.328 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.329 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.329 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.329 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-19T06:57:03.329 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.329 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.329 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.330 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.330 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-19T06:57:03.330 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.330 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.330 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.330 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.331 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-19T06:57:03.331 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.331 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.331 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.331 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.332 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-19T06:57:03.332 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.332 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.332 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.332 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.332 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-19T06:57:03.333 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.333 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.333 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.333 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.333 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-19T06:57:03.333 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.334 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.334 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.334 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.334 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-19T06:57:03.334 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 108, 2024-09-19T06:57:03.334 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.062455854, 2024-09-19T06:57:03.335 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000578294 2024-09-19T06:57:03.335 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.335 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-19T06:57:03.335 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 46, 2024-09-19T06:57:03.335 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.027734138, 2024-09-19T06:57:03.336 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000602916 2024-09-19T06:57:03.336 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.336 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-19T06:57:03.336 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 181, 2024-09-19T06:57:03.336 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.175960536, 2024-09-19T06:57:03.336 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.006497019 2024-09-19T06:57:03.337 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.337 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-19T06:57:03.337 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.337 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.337 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.338 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.338 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-19T06:57:03.338 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.338 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.338 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.338 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.339 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-19T06:57:03.339 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.339 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.339 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.339 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.339 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-19T06:57:03.340 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.340 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.340 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.340 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.340 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-19T06:57:03.340 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.341 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.341 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.341 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.341 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-19T06:57:03.341 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.342 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.342 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.342 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.342 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-19T06:57:03.343 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.343 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.343 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.343 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.343 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-19T06:57:03.344 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.344 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.344 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.344 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.344 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-19T06:57:03.344 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.345 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.345 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.345 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.345 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-19T06:57:03.345 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.345 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.346 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.346 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.346 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-19T06:57:03.346 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.346 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.347 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.347 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.347 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-19T06:57:03.347 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 189, 2024-09-19T06:57:03.347 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.383443721, 2024-09-19T06:57:03.347 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002028802 2024-09-19T06:57:03.348 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.348 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:57:03.348 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:57:03.348 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-19T06:57:03.348 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.348 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.349 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.350 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:03.350 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.351 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-19T06:57:03.351 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 2, 2024-09-19T06:57:03.351 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 3, 2024-09-19T06:57:03.351 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 1, 2024-09-19T06:57:03.351 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 2, 2024-09-19T06:57:03.351 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-19T06:57:03.352 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 240, 2024-09-19T06:57:03.352 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 120, 2024-09-19T06:57:03.352 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 974, 2024-09-19T06:57:03.352 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-19T06:57:03.352 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.353 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-19T06:57:03.353 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:03.353 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:03.353 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:03.353 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:03.354 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:03.354 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:03.354 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:03.354 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:03.354 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:03.354 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:03.355 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:03.355 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:03.355 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:03.355 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:03.355 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:03.356 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:03.356 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:03.356 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:03.356 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:03.356 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:03.357 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:03.357 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:03.357 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:03.357 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:03.357 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:03.357 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:03.358 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:03.358 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:03.358 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:03.358 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:03.358 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:03.359 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-19T06:57:03.359 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:03.359 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:03.359 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:03.359 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:03.359 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 859877, 2024-09-19T06:57:03.360 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 972, 2024-09-19T06:57:03.360 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:03.360 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:03.360 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-19T06:57:03.360 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-19T06:57:03.360 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:03.360 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:03.361 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:03.361 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:03.361 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 8704, 2024-09-19T06:57:03.361 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 191, 2024-09-19T06:57:03.361 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:03.361 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:03.362 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:03.362 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-19T06:57:03.362 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 3129477, 2024-09-19T06:57:03.362 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 76460, 2024-09-19T06:57:03.362 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:03.363 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-19T06:57:03.363 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:03.363 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-19T06:57:03.363 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.363 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-19T06:57:03.364 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-19T06:57:03.364 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-19T06:57:03.364 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 6971, 2024-09-19T06:57:03.364 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 6703039, 2024-09-19T06:57:03.364 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 33, 2024-09-19T06:57:03.364 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 6971, 2024-09-19T06:57:03.364 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-19T06:57:03.364 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6971, 2024-09-19T06:57:03.365 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 19.171581306, 2024-09-19T06:57:03.365 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002750190 2024-09-19T06:57:03.365 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.365 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-19T06:57:03.365 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-19T06:57:03.365 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6971, 2024-09-19T06:57:03.365 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 7226 2024-09-19T06:57:03.365 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.365 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 6971, 2024-09-19T06:57:03.365 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 5427, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 1544, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 0, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 1244, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 60, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 1, 2024-09-19T06:57:03.366 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 7, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 5421, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-19T06:57:03.367 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-19T06:57:03.368 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 106, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 24, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 12, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 12, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-19T06:57:03.369 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 375, 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 12, 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 76 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 3437 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.370 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:03.371 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 18582, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 8738975, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 18582, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 18582, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 8738975, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.372 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 6971, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 6702943, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 6971, 2024-09-19T06:57:03.373 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 6702943, 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:03.374 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 6971, 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 6971, 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 6971, 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 6971, 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.376 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x555cadd5a960": { 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 6001, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 2310, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 6513675, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 2310, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1244, 2024-09-19T06:57:03.377 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 6507674, 2024-09-19T06:57:03.378 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:03.378 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:03.378 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:03.378 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:03.378 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:03.378 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:03.378 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-19T06:57:04.002 INFO:tasks.check_counter:Daemon mds.i mds.exported=4 2024-09-19T06:57:04.003 INFO:tasks.check_counter:Daemon mds.i mds.imported=6 2024-09-19T06:57:04.003 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=191 2024-09-19T06:57:04.003 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=406 2024-09-19T06:57:04.003 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T06:57:04.003 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:57:04.003 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:57:04.003 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T06:57:04.003 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T06:57:04.245 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:57:04.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:04 smithi173 ceph-mon[35349]: pgmap v530: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:57:04.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:04 smithi012 ceph-mon[30937]: pgmap v530: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:57:04.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:04 smithi016 ceph-mon[34911]: pgmap v530: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:57:04.745 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-19T06:57:04.745 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:57:04.745 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 2492, 2024-09-19T06:57:04.745 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2299, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 3137141, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 1714555, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 53, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 5, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.202821827, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.071911121, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.133598277, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.017823001, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2297, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.120687145, 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000052541 2024-09-19T06:57:04.746 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1772, 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000347900, 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000196 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 1738800, 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 223856 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 8677, 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 7487, 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 3436721, 2024-09-19T06:57:04.747 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 5234456, 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 13, 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.514296241, 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.201047898, 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.336639539, 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.040362225, 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 7488, 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.301597210, 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000040277 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:04.748 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 12265, 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.002141090, 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000174 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 126560 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1462, 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 1726, 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 822040, 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 1036067, 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 15, 2024-09-19T06:57:04.749 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 7, 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.102400431, 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.037265778, 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.027977227, 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.026913057, 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1722, 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.082802693, 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000048085 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 89, 2024-09-19T06:57:04.750 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000023690, 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000266 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 4336, 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 474816 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3528, 2024-09-19T06:57:04.751 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.653581994, 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000185255 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 17, 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000401735, 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000023631 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-19T06:57:04.752 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 1029, 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 914, 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 914, 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 10.992618225, 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.012026934 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 115, 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 27, 2024-09-19T06:57:04.753 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 2, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 502, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 92, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 410, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 364, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 9, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 185, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 185, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 42, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 1781, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 1611, 2024-09-19T06:57:04.754 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 112, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 33, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 1126, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 1, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 5, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 253, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 3157, 2024-09-19T06:57:04.755 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 1030, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 1718859367, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 6, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 3157, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 3157, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:57:04.756 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 526, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 927, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 9, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 962, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 224, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 25, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 44 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 129, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 391, 2024-09-19T06:57:04.757 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 207, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 361, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 147, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 3, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 5, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 2, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-19T06:57:04.758 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 14, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 2598, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 2, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-19T06:57:04.759 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 1420, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 1420, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 3, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 3, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-19T06:57:04.760 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 5893520, 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 512, 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 2.755447430, 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.005381733 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 482, 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 486, 2024-09-19T06:57:04.761 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 4, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 79, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 235, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 156, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 507, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 532, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 25, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 185, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 335, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 150, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 58412, 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 223520 2024-09-19T06:57:04.762 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 1147, 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 19, 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 1029, 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 37, 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 54, 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.004293882, 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.004293882 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-19T06:57:04.763 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 417, 2024-09-19T06:57:04.764 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 10.502705116, 2024-09-19T06:57:04.764 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.025186343 2024-09-19T06:57:04.764 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.764 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-19T06:57:04.764 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.764 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.764 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 5, 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.034739584, 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.006947916 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 322, 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.261059915, 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000810745 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-19T06:57:04.765 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-19T06:57:04.766 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.767 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.768 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 135, 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.085147519, 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000630722 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 20, 2024-09-19T06:57:04.769 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.008118408, 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000405920 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.770 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.771 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 9, 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.084843529, 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.009427058 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-19T06:57:04.772 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.773 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.773 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.773 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-19T06:57:04.773 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.773 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.773 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.773 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.773 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-19T06:57:04.773 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.774 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 5, 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.011710272, 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002342054 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.775 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 2, 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 4, 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 2, 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 2, 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 103, 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 51, 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 971, 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:57:04.776 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:57:04.777 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:57:04.778 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-19T06:57:04.778 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:57:04.778 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-19T06:57:04.778 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:57:04.778 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:57:04.778 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:57:04.778 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:57:04.778 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:57:04.779 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 401982, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 409, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 8704, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 191, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:57:04.780 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 1671848, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 19651, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 3889, 2024-09-19T06:57:04.781 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 1878061, 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 33, 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 3889, 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3889, 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 11.132758057, 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002862627 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3889, 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 4021 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 3889, 2024-09-19T06:57:04.782 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 3158, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 731, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 1, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 513, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 67, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 16, 2024-09-19T06:57:04.783 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 3157, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:57:04.784 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 10, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-19T06:57:04.785 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 106, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 23, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 12, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 12, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 192, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 35 2024-09-19T06:57:04.786 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.787 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-19T06:57:04.787 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-19T06:57:04.787 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:57:04.787 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-19T06:57:04.787 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-19T06:57:04.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.787 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-19T06:57:04.787 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 2591 2024-09-19T06:57:04.787 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.787 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 2, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 2, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 2, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 2, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 12628, 2024-09-19T06:57:04.788 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 6232736, 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 12628, 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 12628, 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 6232736, 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.789 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 3889, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 1878327, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 3889, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 1878327, 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:04.790 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 3889, 2024-09-19T06:57:04.791 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 3889, 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 3889, 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 3889, 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:04.792 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 2, 2024-09-19T06:57:04.793 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 266, 2024-09-19T06:57:04.793 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:04.793 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 2, 2024-09-19T06:57:04.793 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:04.793 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:04.793 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1, 2024-09-19T06:57:04.793 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 266, 2024-09-19T06:57:04.793 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:04.793 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x55872509e960": { 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 1420, 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 1699216, 2024-09-19T06:57:04.794 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 1420, 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 512, 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 1699216, 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-19T06:57:04.795 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-19T06:57:05.571 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-19T06:57:05.572 INFO:tasks.check_counter:Daemon mds.l mds.imported=5 2024-09-19T06:57:05.572 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=129 2024-09-19T06:57:05.572 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=391 2024-09-19T06:57:05.572 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=6 2024-09-19T06:57:05.572 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:57:05.572 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:57:05.572 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T06:57:05.586 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T06:57:05.587 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:57:05.587 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:57:05.608 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-19T06:57:05.609 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:57:05.669 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T06:57:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:06.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:06 smithi173 ceph-mon[35349]: pgmap v531: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:57:06.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:06 smithi012 ceph-mon[30937]: pgmap v531: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:57:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.465+0000 7fd680b12640 1 -- 172.21.15.12:0/169079335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd67c101de0 msgr2=0x7fd67c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.465+0000 7fd680b12640 1 --2- 172.21.15.12:0/169079335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd67c101de0 0x7fd67c1021c0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009900 tx=0x7fd66c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.466+0000 7fd680b12640 1 -- 172.21.15.12:0/169079335 shutdown_connections 2024-09-19T06:57:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.466+0000 7fd680b12640 1 --2- 172.21.15.12:0/169079335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c106f10 0x7fd67c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.466+0000 7fd680b12640 1 --2- 172.21.15.12:0/169079335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd67c102790 0x7fd67c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.466+0000 7fd680b12640 1 --2- 172.21.15.12:0/169079335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd67c101de0 0x7fd67c1021c0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.466+0000 7fd680b12640 1 -- 172.21.15.12:0/169079335 >> 172.21.15.12:0/169079335 conn(0x7fd67c0fd8c0 msgr2=0x7fd67c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:06.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.466+0000 7fd680b12640 1 -- 172.21.15.12:0/169079335 shutdown_connections 2024-09-19T06:57:06.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.466+0000 7fd680b12640 1 -- 172.21.15.12:0/169079335 wait complete. 2024-09-19T06:57:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.466+0000 7fd680b12640 1 Processor -- start 2024-09-19T06:57:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.466+0000 7fd680b12640 1 -- start start 2024-09-19T06:57:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd680b12640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd67c101de0 0x7fd67c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd680b12640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c102790 0x7fd67c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd680b12640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd67c106f10 0x7fd67c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd680b12640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c111f70 con 0x7fd67c101de0 2024-09-19T06:57:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd680b12640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c111df0 con 0x7fd67c102790 2024-09-19T06:57:06.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd680b12640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c1120f0 con 0x7fd67c106f10 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd67a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd67c101de0 0x7fd67c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd67a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd67c101de0 0x7fd67c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54226/0 (socket says 172.21.15.12:54226) 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd67a59c640 1 -- 172.21.15.12:0/1382102527 learned_addr learned my addr 172.21.15.12:0/1382102527 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd679d9b640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c102790 0x7fd67c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd67ad9d640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd67c106f10 0x7fd67c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd67a59c640 1 -- 172.21.15.12:0/1382102527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd67c106f10 msgr2=0x7fd67c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd67a59c640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd67c106f10 0x7fd67c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd67a59c640 1 -- 172.21.15.12:0/1382102527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c102790 msgr2=0x7fd67c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd67a59c640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c102790 0x7fd67c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.467+0000 7fd67a59c640 1 -- 172.21.15.12:0/1382102527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c1a67b0 con 0x7fd67c101de0 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.468+0000 7fd67a59c640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd67c101de0 0x7fd67c0744f0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd66c005ab0 tx=0x7fd66c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:06.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.468+0000 7fd66b7fe640 1 -- 172.21.15.12:0/1382102527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c03f030 con 0x7fd67c101de0 2024-09-19T06:57:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.468+0000 7fd680b12640 1 -- 172.21.15.12:0/1382102527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c1a6a40 con 0x7fd67c101de0 2024-09-19T06:57:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.468+0000 7fd66b7fe640 1 -- 172.21.15.12:0/1382102527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd66c003ce0 con 0x7fd67c101de0 2024-09-19T06:57:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.468+0000 7fd66b7fe640 1 -- 172.21.15.12:0/1382102527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c035070 con 0x7fd67c101de0 2024-09-19T06:57:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.468+0000 7fd680b12640 1 -- 172.21.15.12:0/1382102527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c1a6f70 con 0x7fd67c101de0 2024-09-19T06:57:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.469+0000 7fd680b12640 1 -- 172.21.15.12:0/1382102527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67c1021c0 con 0x7fd67c101de0 2024-09-19T06:57:06.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.470+0000 7fd66b7fe640 1 -- 172.21.15.12:0/1382102527 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd66c042030 con 0x7fd67c101de0 2024-09-19T06:57:06.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.471+0000 7fd66b7fe640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd6640a33b0 0x7fd6640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:06.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.471+0000 7fd679d9b640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd6640a33b0 0x7fd6640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:06.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.471+0000 7fd66b7fe640 1 -- 172.21.15.12:0/1382102527 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7fd66c0f0b00 con 0x7fd67c101de0 2024-09-19T06:57:06.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.471+0000 7fd679d9b640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd6640a33b0 0x7fd6640a5870 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd670005e10 tx=0x7fd670005da0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.474+0000 7fd66b7fe640 1 -- 172.21.15.12:0/1382102527 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd66c0bd3e0 con 0x7fd67c101de0 2024-09-19T06:57:06.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:06 smithi016 ceph-mon[34911]: pgmap v531: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:57:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.660+0000 7fd680b12640 1 -- 172.21.15.12:0/1382102527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd67c1a71a0 con 0x7fd67c101de0 2024-09-19T06:57:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.661+0000 7fd66b7fe640 1 -- 172.21.15.12:0/1382102527 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v106) ==== 81+0+944 (secure 0 0 0) 0x7fd66c0bcce0 con 0x7fd67c101de0 2024-09-19T06:57:06.662 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/4060248487 2024-09-20T06:40:08.069301+0000 2024-09-19T06:57:06.662 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3390758821 2024-09-20T06:40:08.069301+0000 2024-09-19T06:57:06.662 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/509408594 2024-09-20T06:30:56.926561+0000 2024-09-19T06:57:06.662 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1625397880 2024-09-20T06:30:56.926561+0000 2024-09-19T06:57:06.662 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/4034653914 2024-09-20T06:30:56.926561+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/1073027972 2024-09-20T06:31:21.622973+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1745599596 2024-09-20T06:30:56.926561+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/4034653914 2024-09-20T06:30:56.926561+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2279004208 2024-09-20T06:31:21.622973+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1769692721 2024-09-20T06:40:08.069301+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2160320420 2024-09-20T06:40:08.069301+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/4060248487 2024-09-20T06:40:08.069301+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/321072458 2024-09-20T06:31:21.622973+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3149948455 2024-09-20T06:31:21.622973+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/1073027972 2024-09-20T06:31:21.622973+0000 2024-09-19T06:57:06.663 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2954657663 2024-09-20T06:40:08.069301+0000 2024-09-19T06:57:06.664 INFO:teuthology.orchestra.run.smithi012.stderr:listed 16 entries 2024-09-19T06:57:06.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 -- 172.21.15.12:0/1382102527 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd6640a33b0 msgr2=0x7fd6640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:06.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd6640a33b0 0x7fd6640a5870 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd670005e10 tx=0x7fd670005da0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 -- 172.21.15.12:0/1382102527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd67c101de0 msgr2=0x7fd67c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:06.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd67c101de0 0x7fd67c0744f0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd66c005ab0 tx=0x7fd66c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 -- 172.21.15.12:0/1382102527 shutdown_connections 2024-09-19T06:57:06.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7fd6640a33b0 0x7fd6640a5870 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd67c106f10 0x7fd67c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c102790 0x7fd67c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 --2- 172.21.15.12:0/1382102527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd67c101de0 0x7fd67c0744f0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:06.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 -- 172.21.15.12:0/1382102527 >> 172.21.15.12:0/1382102527 conn(0x7fd67c0fd8c0 msgr2=0x7fd67c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:06.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 -- 172.21.15.12:0/1382102527 shutdown_connections 2024-09-19T06:57:06.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:06.663+0000 7fd680b12640 1 -- 172.21.15.12:0/1382102527 wait complete. 2024-09-19T06:57:07.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:07 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/1382102527' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:57:07.348 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:07 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/1382102527' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:57:07.349 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T06:57:07.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:57:07.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /tmp/cephfs 2024-09-19T06:57:07.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:07 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/1382102527' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:57:07.511 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T06:57:07.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:57:07.511 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-19T06:57:07.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:57:07.569 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-19T06:57:07.624 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-19T06:57:07.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:57:07.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-19T06:57:07.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:57:07.706 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-19T06:57:07.821 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T06:57:07.832 INFO:tasks.cephadm:Teardown begin 2024-09-19T06:57:07.832 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T06:57:07.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:57:08.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:08 smithi173 ceph-mon[35349]: pgmap v532: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-19T06:57:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:08.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:08 smithi012 ceph-mon[30937]: pgmap v532: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-19T06:57:08.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:08 smithi016 ceph-mon[34911]: pgmap v532: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-19T06:57:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.864+0000 7f18d0b38640 1 -- 172.21.15.12:0/1119697199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc102570 msgr2=0x7f18cc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.864+0000 7f18d0b38640 1 --2- 172.21.15.12:0/1119697199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc102570 0x7f18cc1029b0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009900 tx=0x7f18b402a480 comp rx=0 tx=0).stop 2024-09-19T06:57:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.864+0000 7f18d0b38640 1 -- 172.21.15.12:0/1119697199 shutdown_connections 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.864+0000 7f18d0b38640 1 --2- 172.21.15.12:0/1119697199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18cc102ef0 0x7f18cc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.864+0000 7f18d0b38640 1 --2- 172.21.15.12:0/1119697199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc102570 0x7f18cc1029b0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.864+0000 7f18d0b38640 1 --2- 172.21.15.12:0/1119697199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18cc100e20 0x7f18cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.864+0000 7f18d0b38640 1 -- 172.21.15.12:0/1119697199 >> 172.21.15.12:0/1119697199 conn(0x7f18cc0fc7d0 msgr2=0x7f18cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.864+0000 7f18d0b38640 1 -- 172.21.15.12:0/1119697199 shutdown_connections 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.864+0000 7f18d0b38640 1 -- 172.21.15.12:0/1119697199 wait complete. 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18d0b38640 1 Processor -- start 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18d0b38640 1 -- start start 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18d0b38640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc100e20 0x7f18cc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18d0b38640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18cc102570 0x7f18cc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18d0b38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18cc102ef0 0x7f18cc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18d0b38640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc110fa0 con 0x7f18cc100e20 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18d0b38640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc110e20 con 0x7f18cc102ef0 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18d0b38640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc111120 con 0x7f18cc102570 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18ca59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc100e20 0x7f18cc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18ca59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc100e20 0x7f18cc198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54232/0 (socket says 172.21.15.12:54232) 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18ca59c640 1 -- 172.21.15.12:0/2695560170 learned_addr learned my addr 172.21.15.12:0/2695560170 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18c9d9b640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18cc102570 0x7f18cc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18cad9d640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18cc102ef0 0x7f18cc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18ca59c640 1 -- 172.21.15.12:0/2695560170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18cc102570 msgr2=0x7f18cc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18ca59c640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18cc102570 0x7f18cc198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18ca59c640 1 -- 172.21.15.12:0/2695560170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18cc102ef0 msgr2=0x7f18cc19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18ca59c640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18cc102ef0 0x7f18cc19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.865+0000 7f18ca59c640 1 -- 172.21.15.12:0/2695560170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc19d4e0 con 0x7f18cc100e20 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.866+0000 7f18ca59c640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc100e20 0x7f18cc198530 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f18c400d950 tx=0x7f18c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.866+0000 7f18c37fe640 1 -- 172.21.15.12:0/2695560170 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4017070 con 0x7f18cc100e20 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.866+0000 7f18c37fe640 1 -- 172.21.15.12:0/2695560170 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18c4009c30 con 0x7f18cc100e20 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.866+0000 7f18d0b38640 1 -- 172.21.15.12:0/2695560170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc19d7d0 con 0x7f18cc100e20 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.866+0000 7f18c37fe640 1 -- 172.21.15.12:0/2695560170 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c400f6b0 con 0x7f18cc100e20 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.866+0000 7f18d0b38640 1 -- 172.21.15.12:0/2695560170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc1a50b0 con 0x7f18cc100e20 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.867+0000 7f18d0b38640 1 -- 172.21.15.12:0/2695560170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc101200 con 0x7f18cc100e20 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.868+0000 7f18c37fe640 1 -- 172.21.15.12:0/2695560170 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f18c40109d0 con 0x7f18cc100e20 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.869+0000 7f18c37fe640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b80a3430 0x7f18b80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.869+0000 7f18c37fe640 1 -- 172.21.15.12:0/2695560170 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8687+0+0 (secure 0 0 0) 0x7f18c40cfa40 con 0x7f18cc100e20 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.869+0000 7f18c9d9b640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b80a3430 0x7f18b80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.870+0000 7f18c9d9b640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b80a3430 0x7f18b80a58f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0ff060 tx=0x7f18b4005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:08.872+0000 7f18c37fe640 1 -- 172.21.15.12:0/2695560170 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f18c4009de0 con 0x7f18cc100e20 2024-09-19T06:57:09.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.093+0000 7f18d0b38640 1 -- 172.21.15.12:0/2695560170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18cc10a0a0 con 0x7f18cc100e20 2024-09-19T06:57:09.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.098+0000 7f18c37fe640 1 -- 172.21.15.12:0/2695560170 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11979 (secure 0 0 0) 0x7f18c409c400 con 0x7f18cc100e20 2024-09-19T06:57:09.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:57:09.101 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":56,"btime":"2024-09-19T06:56:24:987787+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:56:24.422127+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:57:09.101 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 56 2024-09-19T06:57:09.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.106+0000 7f18d0b38640 1 -- 172.21.15.12:0/2695560170 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b80a3430 msgr2=0x7f18b80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:09.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.106+0000 7f18d0b38640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b80a3430 0x7f18b80a58f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0ff060 tx=0x7f18b4005a20 comp rx=0 tx=0).stop 2024-09-19T06:57:09.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.106+0000 7f18d0b38640 1 -- 172.21.15.12:0/2695560170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc100e20 msgr2=0x7f18cc198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:09.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.106+0000 7f18d0b38640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc100e20 0x7f18cc198530 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f18c400d950 tx=0x7f18c400de10 comp rx=0 tx=0).stop 2024-09-19T06:57:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.108+0000 7f18d0b38640 1 -- 172.21.15.12:0/2695560170 shutdown_connections 2024-09-19T06:57:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.108+0000 7f18d0b38640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18cc102ef0 0x7f18cc19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.108+0000 7f18d0b38640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f18b80a3430 0x7f18b80a58f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.108+0000 7f18d0b38640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18cc102570 0x7f18cc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.108+0000 7f18d0b38640 1 --2- 172.21.15.12:0/2695560170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc100e20 0x7f18cc198530 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.108+0000 7f18d0b38640 1 -- 172.21.15.12:0/2695560170 >> 172.21.15.12:0/2695560170 conn(0x7f18cc0fc7d0 msgr2=0x7f18cc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:09.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.108+0000 7f18d0b38640 1 -- 172.21.15.12:0/2695560170 shutdown_connections 2024-09-19T06:57:09.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:09.109+0000 7f18d0b38640 1 -- 172.21.15.12:0/2695560170 wait complete. 2024-09-19T06:57:09.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:57:10.185 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:10.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:10 smithi012 ceph-mon[30937]: pgmap v533: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T06:57:10.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:10 smithi012 ceph-mon[30937]: osdmap e107: 12 total, 12 up, 12 in 2024-09-19T06:57:10.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:10 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2695560170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:10.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:10 smithi016 ceph-mon[34911]: pgmap v533: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T06:57:10.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:10 smithi016 ceph-mon[34911]: osdmap e107: 12 total, 12 up, 12 in 2024-09-19T06:57:10.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:10 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2695560170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:10.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:10 smithi173 ceph-mon[35349]: pgmap v533: 97 pgs: 97 active+clean; 3.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T06:57:10.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:10 smithi173 ceph-mon[35349]: osdmap e107: 12 total, 12 up, 12 in 2024-09-19T06:57:10.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:10 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2695560170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.715+0000 7f8adfe9a640 1 -- 172.21.15.12:0/325233211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ad81082a0 msgr2=0x7f8ad810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.715+0000 7f8adfe9a640 1 --2- 172.21.15.12:0/325233211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ad81082a0 0x7f8ad810ec40 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009cd0 tx=0x7f8ad002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:57:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.715+0000 7f8adfe9a640 1 -- 172.21.15.12:0/325233211 shutdown_connections 2024-09-19T06:57:10.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.715+0000 7f8adfe9a640 1 --2- 172.21.15.12:0/325233211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ad81082a0 0x7f8ad810ec40 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.715+0000 7f8adfe9a640 1 --2- 172.21.15.12:0/325233211 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad81036e0 0x7f8ad8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.715+0000 7f8adfe9a640 1 --2- 172.21.15.12:0/325233211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ad8102d30 0x7f8ad8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.715+0000 7f8adfe9a640 1 -- 172.21.15.12:0/325233211 >> 172.21.15.12:0/325233211 conn(0x7f8ad80fc7d0 msgr2=0x7f8ad80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.715+0000 7f8adfe9a640 1 -- 172.21.15.12:0/325233211 shutdown_connections 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.715+0000 7f8adfe9a640 1 -- 172.21.15.12:0/325233211 wait complete. 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8adfe9a640 1 Processor -- start 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8adfe9a640 1 -- start start 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8adfe9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ad8102d30 0x7f8ad8198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8adfe9a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad81036e0 0x7f8ad8198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8adfe9a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ad81082a0 0x7f8ad819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8adfe9a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad81120d0 con 0x7f8ad8102d30 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8adfe9a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8111f50 con 0x7f8ad81036e0 2024-09-19T06:57:10.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8adfe9a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8112250 con 0x7f8ad81082a0 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8addc36640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ad8102d30 0x7f8ad8198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8addc36640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ad8102d30 0x7f8ad8198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41622/0 (socket says 172.21.15.12:41622) 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8addc36640 1 -- 172.21.15.12:0/3452521745 learned_addr learned my addr 172.21.15.12:0/3452521745 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8ade437640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ad81082a0 0x7f8ad819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8add435640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad81036e0 0x7f8ad8198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8addc36640 1 -- 172.21.15.12:0/3452521745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ad81082a0 msgr2=0x7f8ad819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8addc36640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ad81082a0 0x7f8ad819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8addc36640 1 -- 172.21.15.12:0/3452521745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad81036e0 msgr2=0x7f8ad8198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8addc36640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad81036e0 0x7f8ad8198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.716+0000 7f8addc36640 1 -- 172.21.15.12:0/3452521745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad819d5c0 con 0x7f8ad8102d30 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.717+0000 7f8addc36640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ad8102d30 0x7f8ad8198610 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400d950 tx=0x7f8ad400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:10.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.717+0000 7f8aceffd640 1 -- 172.21.15.12:0/3452521745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4017070 con 0x7f8ad8102d30 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.717+0000 7f8adfe9a640 1 -- 172.21.15.12:0/3452521745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad819d8b0 con 0x7f8ad8102d30 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.717+0000 7f8aceffd640 1 -- 172.21.15.12:0/3452521745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ad4009c30 con 0x7f8ad8102d30 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.717+0000 7f8aceffd640 1 -- 172.21.15.12:0/3452521745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400f6b0 con 0x7f8ad8102d30 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.717+0000 7f8adfe9a640 1 -- 172.21.15.12:0/3452521745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad81a5190 con 0x7f8ad8102d30 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.718+0000 7f8adfe9a640 1 -- 172.21.15.12:0/3452521745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad8103110 con 0x7f8ad8102d30 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.719+0000 7f8aceffd640 1 -- 172.21.15.12:0/3452521745 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8ad40109d0 con 0x7f8ad8102d30 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.720+0000 7f8aceffd640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ac40a33b0 0x7f8ac40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.720+0000 7f8add435640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ac40a33b0 0x7f8ac40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.720+0000 7f8aceffd640 1 -- 172.21.15.12:0/3452521745 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8731+0+0 (secure 0 0 0) 0x7f8ad40cf970 con 0x7f8ad8102d30 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.720+0000 7f8add435640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ac40a33b0 0x7f8ac40a5870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80fdd10 tx=0x7f8ac800b390 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:10.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.723+0000 7f8aceffd640 1 -- 172.21.15.12:0/3452521745 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ad4009de0 con 0x7f8ad8102d30 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.935+0000 7f8adfe9a640 1 -- 172.21.15.12:0/3452521745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ad810a2b0 con 0x7f8ad8102d30 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.936+0000 7f8aceffd640 1 -- 172.21.15.12:0/3452521745 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11979 (secure 0 0 0) 0x7f8ad409bc30 con 0x7f8ad8102d30 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":56,"btime":"2024-09-19T06:56:24:987787+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1831354583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1831354583},{"type":"v1","addr":"172.21.15.12:6835","nonce":1831354583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2426691660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2426691660},{"type":"v1","addr":"172.21.15.12:6837","nonce":2426691660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:38:14.665545+0000","modified":"2024-09-19T06:56:24.422127+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24481,"mds_3":24439,"mds_4":24431},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6839/523853421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":523853421},{"type":"v1","addr":"172.21.15.12:6839","nonce":523853421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/1524660797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":1524660797},{"type":"v1","addr":"172.21.15.12:6841","nonce":1524660797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.16:6833/2120245692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2120245692},{"type":"v1","addr":"172.21.15.16:6833","nonce":2120245692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.173:6833/1987793831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1987793831},{"type":"v1","addr":"172.21.15.173:6833","nonce":1987793831}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6835/549418858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":549418858},{"type":"v1","addr":"172.21.15.16:6835","nonce":549418858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/2501878004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":2501878004},{"type":"v1","addr":"172.21.15.173:6835","nonce":2501878004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.16:6837/2891393100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6836","nonce":2891393100},{"type":"v1","addr":"172.21.15.16:6837","nonce":2891393100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/3674805378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3674805378},{"type":"v1","addr":"172.21.15.173:6837","nonce":3674805378}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.173:6839/2051533953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2051533953},{"type":"v1","addr":"172.21.15.173:6839","nonce":2051533953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6839/2939093038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6838","nonce":2939093038},{"type":"v1","addr":"172.21.15.16:6839","nonce":2939093038}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24431,24509,24439,24481,24502]},"id":1}]} 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 56 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 -- 172.21.15.12:0/3452521745 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ac40a33b0 msgr2=0x7f8ac40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ac40a33b0 0x7f8ac40a5870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80fdd10 tx=0x7f8ac800b390 comp rx=0 tx=0).stop 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 -- 172.21.15.12:0/3452521745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ad8102d30 msgr2=0x7f8ad8198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ad8102d30 0x7f8ad8198610 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400d950 tx=0x7f8ad400de10 comp rx=0 tx=0).stop 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 -- 172.21.15.12:0/3452521745 shutdown_connections 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f8ac40a33b0 0x7f8ac40a5870 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ad81082a0 0x7f8ad819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad81036e0 0x7f8ad8198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 --2- 172.21.15.12:0/3452521745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ad8102d30 0x7f8ad8198610 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 -- 172.21.15.12:0/3452521745 >> 172.21.15.12:0/3452521745 conn(0x7f8ad80fc7d0 msgr2=0x7f8ad80fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 -- 172.21.15.12:0/3452521745 shutdown_connections 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:10.938+0000 7f8adfe9a640 1 -- 172.21.15.12:0/3452521745 wait complete. 2024-09-19T06:57:11.245 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:11 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3452521745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:11.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:11 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3452521745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:11.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:11 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3452521745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:57:11.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:57:11.846 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:12.235 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:12 smithi012 ceph-mon[30937]: pgmap v535: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 96 KiB/s wr, 34 op/s 2024-09-19T06:57:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.318+0000 7f56bd018640 1 -- 172.21.15.12:0/2412157918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8101de0 msgr2=0x7f56b81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.318+0000 7f56bd018640 1 --2- 172.21.15.12:0/2412157918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8101de0 0x7f56b81021c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009900 tx=0x7f56a802a410 comp rx=0 tx=0).stop 2024-09-19T06:57:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.318+0000 7f56bd018640 1 -- 172.21.15.12:0/2412157918 shutdown_connections 2024-09-19T06:57:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.318+0000 7f56bd018640 1 --2- 172.21.15.12:0/2412157918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56b8106f10 0x7f56b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.318+0000 7f56bd018640 1 --2- 172.21.15.12:0/2412157918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56b8102790 0x7f56b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.318+0000 7f56bd018640 1 --2- 172.21.15.12:0/2412157918 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8101de0 0x7f56b81021c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.318+0000 7f56bd018640 1 -- 172.21.15.12:0/2412157918 >> 172.21.15.12:0/2412157918 conn(0x7f56b80fd8c0 msgr2=0x7f56b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.318+0000 7f56bd018640 1 -- 172.21.15.12:0/2412157918 shutdown_connections 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.318+0000 7f56bd018640 1 -- 172.21.15.12:0/2412157918 wait complete. 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.319+0000 7f56bd018640 1 Processor -- start 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.319+0000 7f56bd018640 1 -- start start 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.319+0000 7f56bd018640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56b8101de0 0x7f56b8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.319+0000 7f56bd018640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8102790 0x7f56b8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.319+0000 7f56bd018640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56b8106f10 0x7f56b819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.319+0000 7f56bd018640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8111f70 con 0x7f56b8101de0 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.319+0000 7f56bd018640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8111df0 con 0x7f56b8106f10 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.319+0000 7f56bd018640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f56b81120f0 con 0x7f56b8102790 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56b8101de0 0x7f56b8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:12.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8102790 0x7f56b8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56b8101de0 0x7f56b8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41650/0 (socket says 172.21.15.12:41650) 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8102790 0x7f56b8198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.12:39144/0 (socket says 172.21.15.12:39144) 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b6d9d640 1 -- 172.21.15.12:0/3802867050 learned_addr learned my addr 172.21.15.12:0/3802867050 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b759e640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56b8106f10 0x7f56b819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b659c640 1 -- 172.21.15.12:0/3802867050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56b8106f10 msgr2=0x7f56b819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b659c640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56b8106f10 0x7f56b819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b659c640 1 -- 172.21.15.12:0/3802867050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56b8101de0 msgr2=0x7f56b8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b659c640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56b8101de0 0x7f56b8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b659c640 1 -- 172.21.15.12:0/3802867050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b819d400 con 0x7f56b8102790 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b6d9d640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56b8101de0 0x7f56b8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56b659c640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8102790 0x7f56b8198990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00e9f0 tx=0x7f56ac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f569ffff640 1 -- 172.21.15.12:0/3802867050 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac00ccc0 con 0x7f56b8102790 2024-09-19T06:57:12.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f569ffff640 1 -- 172.21.15.12:0/3802867050 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56ac010910 con 0x7f56b8102790 2024-09-19T06:57:12.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f569ffff640 1 -- 172.21.15.12:0/3802867050 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac018960 con 0x7f56b8102790 2024-09-19T06:57:12.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.320+0000 7f56bd018640 1 -- 172.21.15.12:0/3802867050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b819d6f0 con 0x7f56b8102790 2024-09-19T06:57:12.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.321+0000 7f56bd018640 1 -- 172.21.15.12:0/3802867050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b81a4fd0 con 0x7f56b8102790 2024-09-19T06:57:12.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.322+0000 7f56bd018640 1 -- 172.21.15.12:0/3802867050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b81021c0 con 0x7f56b8102790 2024-09-19T06:57:12.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.323+0000 7f569ffff640 1 -- 172.21.15.12:0/3802867050 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f56ac010ac0 con 0x7f56b8102790 2024-09-19T06:57:12.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.323+0000 7f569ffff640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56a00a3430 0x7f56a00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:12.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.323+0000 7f569ffff640 1 -- 172.21.15.12:0/3802867050 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8731+0+0 (secure 0 0 0) 0x7f56ac0d0190 con 0x7f56b8102790 2024-09-19T06:57:12.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.323+0000 7f56b6d9d640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56a00a3430 0x7f56a00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:12.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.324+0000 7f56b6d9d640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56a00a3430 0x7f56a00a58f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f56a80096c0 tx=0x7f56a8005a20 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:12.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.327+0000 7f569ffff640 1 -- 172.21.15.12:0/3802867050 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f56ac09caa0 con 0x7f56b8102790 2024-09-19T06:57:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.505+0000 7f56bd018640 1 -- 172.21.15.12:0/3802867050 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56b810a0f0 con 0x7f56b8102790 2024-09-19T06:57:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.507+0000 7f569ffff640 1 -- 172.21.15.12:0/3802867050 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+23460 (secure 0 0 0) 0x7f56ac09c3a0 con 0x7f56b8102790 2024-09-19T06:57:12.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-19T06:57:12.509 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":107,"fsid":"8bf314c8-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:30:34.142933+0000","modified":"2024-09-19T06:57:09.074120+0000","last_up_change":"2024-09-19T06:37:22.524581+0000","last_in_change":"2024-09-19T06:36:59.866021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:33:40.130755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:38:10.971934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:38:13.015596+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":29,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b91bda9f-2b6e-4186-b0fe-7e0b5a50121a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6803","nonce":3065119058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6805","nonce":3065119058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6809","nonce":3065119058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3065119058},{"type":"v1","addr":"172.21.15.12:6807","nonce":3065119058}]},"public_addr":"172.21.15.12:6803/3065119058","cluster_addr":"172.21.15.12:6805/3065119058","heartbeat_back_addr":"172.21.15.12:6809/3065119058","heartbeat_front_addr":"172.21.15.12:6807/3065119058","state":["exists","up"]},{"osd":1,"uuid":"07e58c8d-382e-4acb-b271-116ef907125d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6801","nonce":610562255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6803","nonce":610562255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6807","nonce":610562255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":610562255},{"type":"v1","addr":"172.21.15.16:6805","nonce":610562255}]},"public_addr":"172.21.15.16:6801/610562255","cluster_addr":"172.21.15.16:6803/610562255","heartbeat_back_addr":"172.21.15.16:6807/610562255","heartbeat_front_addr":"172.21.15.16:6805/610562255","state":["exists","up"]},{"osd":2,"uuid":"7438fe31-c81a-4f07-a580-8cccad16f0ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6801","nonce":3671051069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6803","nonce":3671051069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6807","nonce":3671051069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3671051069},{"type":"v1","addr":"172.21.15.173:6805","nonce":3671051069}]},"public_addr":"172.21.15.173:6801/3671051069","cluster_addr":"172.21.15.173:6803/3671051069","heartbeat_back_addr":"172.21.15.173:6807/3671051069","heartbeat_front_addr":"172.21.15.173:6805/3671051069","state":["exists","up"]},{"osd":3,"uuid":"ba9ac3c0-f7da-4ee8-9102-3909f8b8504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6811","nonce":808998365}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6813","nonce":808998365}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6817","nonce":808998365}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":808998365},{"type":"v1","addr":"172.21.15.12:6815","nonce":808998365}]},"public_addr":"172.21.15.12:6811/808998365","cluster_addr":"172.21.15.12:6813/808998365","heartbeat_back_addr":"172.21.15.12:6817/808998365","heartbeat_front_addr":"172.21.15.12:6815/808998365","state":["exists","up"]},{"osd":4,"uuid":"20aad675-3694-46a0-a7f3-d3ebd60aee5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6809","nonce":250959464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6811","nonce":250959464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6815","nonce":250959464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":250959464},{"type":"v1","addr":"172.21.15.16:6813","nonce":250959464}]},"public_addr":"172.21.15.16:6809/250959464","cluster_addr":"172.21.15.16:6811/250959464","heartbeat_back_addr":"172.21.15.16:6815/250959464","heartbeat_front_addr":"172.21.15.16:6813/250959464","state":["exists","up"]},{"osd":5,"uuid":"583dbaf5-4f1f-45a1-b839-67a5d21c483d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6809","nonce":2756003691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6811","nonce":2756003691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6815","nonce":2756003691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":2756003691},{"type":"v1","addr":"172.21.15.173:6813","nonce":2756003691}]},"public_addr":"172.21.15.173:6809/2756003691","cluster_addr":"172.21.15.173:6811/2756003691","heartbeat_back_addr":"172.21.15.173:6815/2756003691","heartbeat_front_addr":"172.21.15.173:6813/2756003691","state":["exists","up"]},{"osd":6,"uuid":"f0b6ef77-21e2-4950-a37f-57ccbf9101d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6819","nonce":2461755084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6821","nonce":2461755084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6825","nonce":2461755084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":2461755084},{"type":"v1","addr":"172.21.15.12:6823","nonce":2461755084}]},"public_addr":"172.21.15.12:6819/2461755084","cluster_addr":"172.21.15.12:6821/2461755084","heartbeat_back_addr":"172.21.15.12:6825/2461755084","heartbeat_front_addr":"172.21.15.12:6823/2461755084","state":["exists","up"]},{"osd":7,"uuid":"657d94ae-3aee-432c-84c1-1535d2806aa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6817","nonce":3670688861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6819","nonce":3670688861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6823","nonce":3670688861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3670688861},{"type":"v1","addr":"172.21.15.16:6821","nonce":3670688861}]},"public_addr":"172.21.15.16:6817/3670688861","cluster_addr":"172.21.15.16:6819/3670688861","heartbeat_back_addr":"172.21.15.16:6823/3670688861","heartbeat_front_addr":"172.21.15.16:6821/3670688861","state":["exists","up"]},{"osd":8,"uuid":"0b9a65b1-8d6f-4d35-baff-4cda4fc99e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6817","nonce":332186577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6819","nonce":332186577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6823","nonce":332186577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":332186577},{"type":"v1","addr":"172.21.15.173:6821","nonce":332186577}]},"public_addr":"172.21.15.173:6817/332186577","cluster_addr":"172.21.15.173:6819/332186577","heartbeat_back_addr":"172.21.15.173:6823/332186577","heartbeat_front_addr":"172.21.15.173:6821/332186577","state":["exists","up"]},{"osd":9,"uuid":"74fa5ae1-a2ed-45df-9456-d1b8b9cdd961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6827","nonce":32889284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6829","nonce":32889284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6833","nonce":32889284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":32889284},{"type":"v1","addr":"172.21.15.12:6831","nonce":32889284}]},"public_addr":"172.21.15.12:6827/32889284","cluster_addr":"172.21.15.12:6829/32889284","heartbeat_back_addr":"172.21.15.12:6833/32889284","heartbeat_front_addr":"172.21.15.12:6831/32889284","state":["exists","up"]},{"osd":10,"uuid":"d2491092-90ed-40f4-ac16-0b21acb8da6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6825","nonce":2551433772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6827","nonce":2551433772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6831","nonce":2551433772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2551433772},{"type":"v1","addr":"172.21.15.16:6829","nonce":2551433772}]},"public_addr":"172.21.15.16:6825/2551433772","cluster_addr":"172.21.15.16:6827/2551433772","heartbeat_back_addr":"172.21.15.16:6831/2551433772","heartbeat_front_addr":"172.21.15.16:6829/2551433772","state":["exists","up"]},{"osd":11,"uuid":"8e5cfd54-d273-4af7-b672-7c3ffef495c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6825","nonce":3706383850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6827","nonce":3706383850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6831","nonce":3706383850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":3706383850},{"type":"v1","addr":"172.21.15.173:6829","nonce":3706383850}]},"public_addr":"172.21.15.173:6825/3706383850","cluster_addr":"172.21.15.173:6827/3706383850","heartbeat_back_addr":"172.21.15.173:6831/3706383850","heartbeat_front_addr":"172.21.15.173:6829/3706383850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:32:48.262733+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:13.141494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:33:37.242347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:03.490590+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:27.920474+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:52.431589+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:18.111657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:42.188187+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:06.464718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:32.500547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:57.417940+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:37:21.040948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":5,"to":1}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6801/4060248487":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/3390758821":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/509408594":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/1625397880":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6800/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1745599596":"2024-09-20T06:30:56.926561+0000","172.21.15.12:6801/4034653914":"2024-09-20T06:30:56.926561+0000","172.21.15.12:0/2279004208":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/1769692721":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/2160320420":"2024-09-20T06:40:08.069301+0000","172.21.15.12:6800/4060248487":"2024-09-20T06:40:08.069301+0000","172.21.15.12:0/321072458":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/3149948455":"2024-09-20T06:31:21.622973+0000","172.21.15.12:6800/1073027972":"2024-09-20T06:31:21.622973+0000","172.21.15.12:0/2954657663":"2024-09-20T06:40:08.069301+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":16,"length":1},{"begin":29,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":16,"length":1},{"begin":29,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:57:12.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:12 smithi016 ceph-mon[34911]: pgmap v535: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 96 KiB/s wr, 34 op/s 2024-09-19T06:57:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.509+0000 7f56bd018640 1 -- 172.21.15.12:0/3802867050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56a00a3430 msgr2=0x7f56a00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.509+0000 7f56bd018640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56a00a3430 0x7f56a00a58f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f56a80096c0 tx=0x7f56a8005a20 comp rx=0 tx=0).stop 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.509+0000 7f56bd018640 1 -- 172.21.15.12:0/3802867050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8102790 msgr2=0x7f56b8198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.509+0000 7f56bd018640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8102790 0x7f56b8198990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00e9f0 tx=0x7f56ac00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.509+0000 7f56bd018640 1 -- 172.21.15.12:0/3802867050 shutdown_connections 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.509+0000 7f56bd018640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56b8106f10 0x7f56b819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.509+0000 7f56bd018640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56a00a3430 0x7f56a00a58f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.509+0000 7f56bd018640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8102790 0x7f56b8198990 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.509+0000 7f56bd018640 1 --2- 172.21.15.12:0/3802867050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56b8101de0 0x7f56b8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.509+0000 7f56bd018640 1 -- 172.21.15.12:0/3802867050 >> 172.21.15.12:0/3802867050 conn(0x7f56b80fd8c0 msgr2=0x7f56b80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.510+0000 7f56bd018640 1 -- 172.21.15.12:0/3802867050 shutdown_connections 2024-09-19T06:57:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:12.510+0000 7f56bd018640 1 -- 172.21.15.12:0/3802867050 wait complete. 2024-09-19T06:57:12.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:12 smithi173 ceph-mon[35349]: pgmap v535: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 96 KiB/s wr, 34 op/s 2024-09-19T06:57:13.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T06:57:13.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:13 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3802867050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:57:13.401 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:13.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:13 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3802867050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:57:13.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:13 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3802867050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:57:13.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.924+0000 7f7a2daa3640 1 -- 172.21.15.12:0/3875192815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a28074f40 msgr2=0x7f7a2810de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:13.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.924+0000 7f7a2daa3640 1 --2- 172.21.15.12:0/3875192815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a28074f40 0x7f7a2810de80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009900 tx=0x7f7a1c02a480 comp rx=0 tx=0).stop 2024-09-19T06:57:13.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.924+0000 7f7a2daa3640 1 -- 172.21.15.12:0/3875192815 shutdown_connections 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.924+0000 7f7a2daa3640 1 --2- 172.21.15.12:0/3875192815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a2810e3c0 0x7f7a28110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.924+0000 7f7a2daa3640 1 --2- 172.21.15.12:0/3875192815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a28074f40 0x7f7a2810de80 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.924+0000 7f7a2daa3640 1 --2- 172.21.15.12:0/3875192815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a28074620 0x7f7a28074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.924+0000 7f7a2daa3640 1 -- 172.21.15.12:0/3875192815 >> 172.21.15.12:0/3875192815 conn(0x7f7a280fd8c0 msgr2=0x7f7a280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.924+0000 7f7a2daa3640 1 -- 172.21.15.12:0/3875192815 shutdown_connections 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.924+0000 7f7a2daa3640 1 -- 172.21.15.12:0/3875192815 wait complete. 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.925+0000 7f7a2daa3640 1 Processor -- start 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.925+0000 7f7a2daa3640 1 -- start start 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.925+0000 7f7a2daa3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a28074620 0x7f7a2819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.925+0000 7f7a2daa3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a28074f40 0x7f7a2819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:13.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.925+0000 7f7a2daa3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a2810e3c0 0x7f7a2819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.925+0000 7f7a2daa3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a28114160 con 0x7f7a28074f40 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.925+0000 7f7a2daa3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7a28113fe0 con 0x7f7a2810e3c0 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.925+0000 7f7a2daa3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7a281142e0 con 0x7f7a28074620 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a26ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a28074f40 0x7f7a2819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a26ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a28074f40 0x7f7a2819ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41680/0 (socket says 172.21.15.12:41680) 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a26ffd640 1 -- 172.21.15.12:0/2125793146 learned_addr learned my addr 172.21.15.12:0/2125793146 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a277fe640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a28074620 0x7f7a2819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a27fff640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a2810e3c0 0x7f7a2819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a26ffd640 1 -- 172.21.15.12:0/2125793146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a28074620 msgr2=0x7f7a2819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a26ffd640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a28074620 0x7f7a2819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a26ffd640 1 -- 172.21.15.12:0/2125793146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a2810e3c0 msgr2=0x7f7a2819efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a26ffd640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a2810e3c0 0x7f7a2819efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:13.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a26ffd640 1 -- 172.21.15.12:0/2125793146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2819f6b0 con 0x7f7a28074f40 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a26ffd640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a28074f40 0x7f7a2819ac40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c006010 tx=0x7f7a1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a24ff9640 1 -- 172.21.15.12:0/2125793146 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c03f030 con 0x7f7a28074f40 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a2daa3640 1 -- 172.21.15.12:0/2125793146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a2819f940 con 0x7f7a28074f40 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a24ff9640 1 -- 172.21.15.12:0/2125793146 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a1c003ce0 con 0x7f7a28074f40 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a24ff9640 1 -- 172.21.15.12:0/2125793146 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c035070 con 0x7f7a28074f40 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.926+0000 7f7a2daa3640 1 -- 172.21.15.12:0/2125793146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a281a7280 con 0x7f7a28074f40 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.928+0000 7f7a2daa3640 1 -- 172.21.15.12:0/2125793146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a28075cd0 con 0x7f7a28074f40 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.929+0000 7f7a24ff9640 1 -- 172.21.15.12:0/2125793146 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7a1c042030 con 0x7f7a28074f40 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.930+0000 7f7a24ff9640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a100a33b0 0x7f7a100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.930+0000 7f7a277fe640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a100a33b0 0x7f7a100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.930+0000 7f7a24ff9640 1 -- 172.21.15.12:0/2125793146 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8731+0+0 (secure 0 0 0) 0x7f7a1c0f0510 con 0x7f7a28074f40 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.930+0000 7f7a277fe640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a100a33b0 0x7f7a100a5870 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7a18005d00 tx=0x7f7a1800b410 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:13.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:13.934+0000 7f7a24ff9640 1 -- 172.21.15.12:0/2125793146 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7a1c0bce80 con 0x7f7a28074f40 2024-09-19T06:57:14.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.149+0000 7f7a2daa3640 1 -- 172.21.15.12:0/2125793146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7a28109540 con 0x7f7a28074f40 2024-09-19T06:57:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.151+0000 7f7a24ff9640 1 -- 172.21.15.12:0/2125793146 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) ==== 161+0+0 (secure 0 0 0) 0x7f7a1c0bc780 con 0x7f7a28074f40 2024-09-19T06:57:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T06:57:14.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.153+0000 7f7a2daa3640 1 -- 172.21.15.12:0/2125793146 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a100a33b0 msgr2=0x7f7a100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:14.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a100a33b0 0x7f7a100a5870 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7a18005d00 tx=0x7f7a1800b410 comp rx=0 tx=0).stop 2024-09-19T06:57:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 -- 172.21.15.12:0/2125793146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a28074f40 msgr2=0x7f7a2819ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a28074f40 0x7f7a2819ac40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c006010 tx=0x7f7a1c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:57:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 -- 172.21.15.12:0/2125793146 shutdown_connections 2024-09-19T06:57:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a2810e3c0 0x7f7a2819efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a28074f40 0x7f7a2819ac40 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f7a100a33b0 0x7f7a100a5870 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 --2- 172.21.15.12:0/2125793146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7a28074620 0x7f7a2819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 -- 172.21.15.12:0/2125793146 >> 172.21.15.12:0/2125793146 conn(0x7f7a280fd8c0 msgr2=0x7f7a280fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 -- 172.21.15.12:0/2125793146 shutdown_connections 2024-09-19T06:57:14.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:14.154+0000 7f7a2daa3640 1 -- 172.21.15.12:0/2125793146 wait complete. 2024-09-19T06:57:14.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:14 smithi012 ceph-mon[30937]: pgmap v536: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 96 KiB/s wr, 34 op/s 2024-09-19T06:57:14.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a[30933]: 2024-09-19T06:57:14.149+0000 7fa01129a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:57:14.379 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:57:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-a[72519]: ignoring --setuser ceph since I am not root 2024-09-19T06:57:14.379 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:57:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-a[72519]: ignoring --setgroup ceph since I am not root 2024-09-19T06:57:14.379 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:57:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-a[72519]: starting mds.a at 2024-09-19T06:57:14.379 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:57:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-a[72519]: 2024-09-19T06:57:14.207+0000 7f930ca84640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6838/0: (98) Address already in use 2024-09-19T06:57:14.379 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:57:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g[72117]: ignoring --setuser ceph since I am not root 2024-09-19T06:57:14.380 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:57:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g[72117]: ignoring --setgroup ceph since I am not root 2024-09-19T06:57:14.380 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:57:14 smithi012 ceph-mds[72133]: -- 172.21.15.12:0/670483187 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d209283860 con 0x55d209261400 2024-09-19T06:57:14.380 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:57:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g[72117]: starting mds.g at 2024-09-19T06:57:14.409 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-mon[34911]: pgmap v536: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 96 KiB/s wr, 34 op/s 2024-09-19T06:57:14.410 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h[63976]: ignoring --setuser ceph since I am not root 2024-09-19T06:57:14.410 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h[63976]: ignoring --setgroup ceph since I am not root 2024-09-19T06:57:14.410 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-mds[63980]: -- 172.21.15.16:0/3251820315 <== mon.2 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555859e4f860 con 0x555859e2c800 2024-09-19T06:57:14.410 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h[63976]: starting mds.h at 2024-09-19T06:57:14.410 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: ignoring --setuser ceph since I am not root 2024-09-19T06:57:14.410 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: ignoring --setgroup ceph since I am not root 2024-09-19T06:57:14.410 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: starting mds.b at 2024-09-19T06:57:14.411 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e[63674]: ignoring --setuser ceph since I am not root 2024-09-19T06:57:14.411 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e[63674]: ignoring --setgroup ceph since I am not root 2024-09-19T06:57:14.411 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-mds[63678]: -- 172.21.15.16:0/2896549110 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac2c443860 con 0x55ac2c421400 2024-09-19T06:57:14.411 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e[63674]: starting mds.e at 2024-09-19T06:57:14.411 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k[63368]: ignoring --setuser ceph since I am not root 2024-09-19T06:57:14.411 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k[63368]: ignoring --setgroup ceph since I am not root 2024-09-19T06:57:14.411 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-mds[63372]: -- 172.21.15.16:0/2796026079 <== mon.2 v2:172.21.15.16:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561c829d5860 con 0x561c829b2800 2024-09-19T06:57:14.411 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:57:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k[63368]: starting mds.k at 2024-09-19T06:57:14.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-mon[35349]: pgmap v536: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 96 KiB/s wr, 34 op/s 2024-09-19T06:57:14.583 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f[65248]: ignoring --setuser ceph since I am not root 2024-09-19T06:57:14.583 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f[65248]: ignoring --setgroup ceph since I am not root 2024-09-19T06:57:14.583 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-mds[65252]: -- 172.21.15.173:0/854472353 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55916c047860 con 0x55916c025000 2024-09-19T06:57:14.583 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f[65248]: starting mds.f at 2024-09-19T06:57:14.583 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c[65545]: ignoring --setuser ceph since I am not root 2024-09-19T06:57:14.583 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c[65545]: ignoring --setgroup ceph since I am not root 2024-09-19T06:57:14.584 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c[65545]: starting mds.c at 2024-09-19T06:57:14.584 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i[65848]: ignoring --setuser ceph since I am not root 2024-09-19T06:57:14.584 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i[65848]: ignoring --setgroup ceph since I am not root 2024-09-19T06:57:14.584 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-mds[65852]: -- 172.21.15.173:0/2621376314 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d39ae7b860 con 0x55d39ae58800 2024-09-19T06:57:14.584 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i[65848]: starting mds.i at 2024-09-19T06:57:14.584 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l[64943]: ignoring --setuser ceph since I am not root 2024-09-19T06:57:14.584 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l[64943]: ignoring --setgroup ceph since I am not root 2024-09-19T06:57:14.585 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-mds[64947]: -- 172.21.15.173:0/4137681160 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590da373c20 con 0x5590da350800 2024-09-19T06:57:14.585 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:57:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l[64943]: starting mds.l at 2024-09-19T06:57:14.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T06:57:15.090 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:15.362 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:15 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2125793146' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:57:15.362 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:15 smithi012 ceph-mon[30937]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:57:15.362 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:15 smithi012 ceph-mon[30937]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:57:15.362 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:15 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2125793146' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:57:15.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:15 smithi012 ceph-mon[30937]: osdmap e108: 12 total, 12 up, 12 in 2024-09-19T06:57:15.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:15 smithi012 ceph-mon[30937]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T06:57:15.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:15 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:57:15.425 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:15 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2125793146' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:57:15.425 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:15 smithi016 ceph-mon[34911]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:57:15.425 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:15 smithi016 ceph-mon[34911]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:57:15.425 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:15 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2125793146' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:57:15.425 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:15 smithi016 ceph-mon[34911]: osdmap e108: 12 total, 12 up, 12 in 2024-09-19T06:57:15.426 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:15 smithi016 ceph-mon[34911]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T06:57:15.426 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:15 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:57:15.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.566+0000 7f56e50ba640 1 -- 172.21.15.12:0/1032239362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0100e20 msgr2=0x7f56e0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:15.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.566+0000 7f56e50ba640 1 --2- 172.21.15.12:0/1032239362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0100e20 0x7f56e0101200 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009ca0 tx=0x7f56d002a950 comp rx=0 tx=0).stop 2024-09-19T06:57:15.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.567+0000 7f56e50ba640 1 -- 172.21.15.12:0/1032239362 shutdown_connections 2024-09-19T06:57:15.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.567+0000 7f56e50ba640 1 --2- 172.21.15.12:0/1032239362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e0102ef0 0x7f56e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:15.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.567+0000 7f56e50ba640 1 --2- 172.21.15.12:0/1032239362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56e0102570 0x7f56e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:15.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.567+0000 7f56e50ba640 1 --2- 172.21.15.12:0/1032239362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0100e20 0x7f56e0101200 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:15.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.567+0000 7f56e50ba640 1 -- 172.21.15.12:0/1032239362 >> 172.21.15.12:0/1032239362 conn(0x7f56e00fc7d0 msgr2=0x7f56e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:15.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.567+0000 7f56e50ba640 1 -- 172.21.15.12:0/1032239362 shutdown_connections 2024-09-19T06:57:15.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.567+0000 7f56e50ba640 1 -- 172.21.15.12:0/1032239362 wait complete. 2024-09-19T06:57:15.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.567+0000 7f56e50ba640 1 Processor -- start 2024-09-19T06:57:15.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56e50ba640 1 -- start start 2024-09-19T06:57:15.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56e50ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56e0100e20 0x7f56e0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56e50ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102570 0x7f56e0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56e50ba640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e0102ef0 0x7f56e01a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56e50ba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0110fa0 con 0x7f56e0102570 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56e50ba640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0110e20 con 0x7f56e0100e20 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56e50ba640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0111120 con 0x7f56e0102ef0 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56de59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102570 0x7f56e0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56ded9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56e0100e20 0x7f56e0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56de59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102570 0x7f56e0199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41758/0 (socket says 172.21.15.12:41758) 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56de59c640 1 -- 172.21.15.12:0/535435376 learned_addr learned my addr 172.21.15.12:0/535435376 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56df59e640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e0102ef0 0x7f56e01a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:15.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56ded9d640 1 -- 172.21.15.12:0/535435376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e0102ef0 msgr2=0x7f56e01a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56ded9d640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e0102ef0 0x7f56e01a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56ded9d640 1 -- 172.21.15.12:0/535435376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102570 msgr2=0x7f56e0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56ded9d640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102570 0x7f56e0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56ded9d640 1 -- 172.21.15.12:0/535435376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e01a4910 con 0x7f56e0100e20 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.568+0000 7f56de59c640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102570 0x7f56e0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.569+0000 7f56ded9d640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56e0100e20 0x7f56e0199350 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f56d0006010 tx=0x7f56d002f5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.569+0000 7f56c7fff640 1 -- 172.21.15.12:0/535435376 <== mon.2 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0034040 con 0x7f56e0100e20 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.569+0000 7f56e50ba640 1 -- 172.21.15.12:0/535435376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e01a4ae0 con 0x7f56e0100e20 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.569+0000 7f56c7fff640 1 -- 172.21.15.12:0/535435376 <== mon.2 v2:172.21.15.16:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56d0030920 con 0x7f56e0100e20 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.569+0000 7f56c7fff640 1 -- 172.21.15.12:0/535435376 <== mon.2 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0004750 con 0x7f56e0100e20 2024-09-19T06:57:15.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.569+0000 7f56e50ba640 1 -- 172.21.15.12:0/535435376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e01a4f90 con 0x7f56e0100e20 2024-09-19T06:57:15.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.570+0000 7f56e50ba640 1 -- 172.21.15.12:0/535435376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e0101200 con 0x7f56e0100e20 2024-09-19T06:57:15.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.571+0000 7f56c7fff640 1 -- 172.21.15.12:0/535435376 <== mon.2 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f56d0037020 con 0x7f56e0100e20 2024-09-19T06:57:15.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.572+0000 7f56c7fff640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56c80a33b0 0x7f56c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:15.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.572+0000 7f56de59c640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56c80a33b0 0x7f56c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:15.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.572+0000 7f56c7fff640 1 -- 172.21.15.12:0/535435376 <== mon.2 v2:172.21.15.16:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9117+0+0 (secure 0 0 0) 0x7f56d00f0cb0 con 0x7f56e0100e20 2024-09-19T06:57:15.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.572+0000 7f56de59c640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56c80a33b0 0x7f56c80a5870 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f56e006aac0 tx=0x7f56d4005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:15.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.576+0000 7f56c7fff640 1 -- 172.21.15.12:0/535435376 <== mon.2 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f56d00bd4f0 con 0x7f56e0100e20 2024-09-19T06:57:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:15 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2125793146' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:57:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:15 smithi173 ceph-mon[35349]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:57:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:15 smithi173 ceph-mon[35349]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:57:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:15 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2125793146' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:57:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:15 smithi173 ceph-mon[35349]: osdmap e108: 12 total, 12 up, 12 in 2024-09-19T06:57:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:15 smithi173 ceph-mon[35349]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T06:57:15.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:15 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:57:15.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:15.788+0000 7f56e50ba640 1 -- 172.21.15.12:0/535435376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f56e0109090 con 0x7f56e0100e20 2024-09-19T06:57:16.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.165+0000 7f56c7fff640 1 -- 172.21.15.12:0/535435376 <== mon.2 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) ==== 104+0+0 (secure 0 0 0) 0x7f56d00bcdf0 con 0x7f56e0100e20 2024-09-19T06:57:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 -- 172.21.15.12:0/535435376 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56c80a33b0 msgr2=0x7f56c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56c80a33b0 0x7f56c80a5870 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f56e006aac0 tx=0x7f56d4005f90 comp rx=0 tx=0).stop 2024-09-19T06:57:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 -- 172.21.15.12:0/535435376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56e0100e20 msgr2=0x7f56e0199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56e0100e20 0x7f56e0199350 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f56d0006010 tx=0x7f56d002f5d0 comp rx=0 tx=0).stop 2024-09-19T06:57:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 -- 172.21.15.12:0/535435376 shutdown_connections 2024-09-19T06:57:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f56c80a33b0 0x7f56c80a5870 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56e0102ef0 0x7f56e01a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:16.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56e0102570 0x7f56e0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 --2- 172.21.15.12:0/535435376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56e0100e20 0x7f56e0199350 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 -- 172.21.15.12:0/535435376 >> 172.21.15.12:0/535435376 conn(0x7f56e00fc7d0 msgr2=0x7f56e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 -- 172.21.15.12:0/535435376 shutdown_connections 2024-09-19T06:57:16.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:16.168+0000 7f56e50ba640 1 -- 172.21.15.12:0/535435376 wait complete. 2024-09-19T06:57:16.484 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: pgmap v538: 97 pgs: 97 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6832/3902593164,v1:172.21.15.173:6833/3902593164] up:boot 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.16:6832/1249464157,v1:172.21.15.16:6834/1249464157] up:boot 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.16:6833/2108087661,v1:172.21.15.16:6835/2108087661] up:boot 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6834/1568651528,v1:172.21.15.173:6835/1568651528] up:boot 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.12:6838/60724553,v1:172.21.15.12:6840/60724553] up:boot 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.16:6836/1174012538,v1:172.21.15.16:6837/1174012538] up:boot 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.12:6839/2666562263,v1:172.21.15.12:6841/2666562263] up:boot 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6836/3915266314,v1:172.21.15.173:6837/3915266314] up:boot 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.16:6838/1824719127,v1:172.21.15.16:6839/1824719127] up:boot 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: mds.? [v2:172.21.15.173:6838/211322239,v1:172.21.15.173:6839/211322239] up:boot 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:57:16.485 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:57:16.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:57:16.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:57:16.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:57:16.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:57:16.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:57:16.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:57:16.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:57:16.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:57:16.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/535435376' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:57:16.486 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:16 smithi173 ceph-mon[35349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: pgmap v538: 97 pgs: 97 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6832/3902593164,v1:172.21.15.173:6833/3902593164] up:boot 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.16:6832/1249464157,v1:172.21.15.16:6834/1249464157] up:boot 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.16:6833/2108087661,v1:172.21.15.16:6835/2108087661] up:boot 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6834/1568651528,v1:172.21.15.173:6835/1568651528] up:boot 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.12:6838/60724553,v1:172.21.15.12:6840/60724553] up:boot 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.16:6836/1174012538,v1:172.21.15.16:6837/1174012538] up:boot 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.12:6839/2666562263,v1:172.21.15.12:6841/2666562263] up:boot 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6836/3915266314,v1:172.21.15.173:6837/3915266314] up:boot 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.16:6838/1824719127,v1:172.21.15.16:6839/1824719127] up:boot 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: mds.? [v2:172.21.15.173:6838/211322239,v1:172.21.15.173:6839/211322239] up:boot 2024-09-19T06:57:16.509 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/535435376' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:57:16.510 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:16 smithi016 ceph-mon[34911]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: pgmap v538: 97 pgs: 97 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6832/3902593164,v1:172.21.15.173:6833/3902593164] up:boot 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.16:6832/1249464157,v1:172.21.15.16:6834/1249464157] up:boot 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.16:6833/2108087661,v1:172.21.15.16:6835/2108087661] up:boot 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6834/1568651528,v1:172.21.15.173:6835/1568651528] up:boot 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.12:6838/60724553,v1:172.21.15.12:6840/60724553] up:boot 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.16:6836/1174012538,v1:172.21.15.16:6837/1174012538] up:boot 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.12:6839/2666562263,v1:172.21.15.12:6841/2666562263] up:boot 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6836/3915266314,v1:172.21.15.173:6837/3915266314] up:boot 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.16:6838/1824719127,v1:172.21.15.16:6839/1824719127] up:boot 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: mds.? [v2:172.21.15.173:6838/211322239,v1:172.21.15.173:6839/211322239] up:boot 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T06:57:16.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='mgr.15243 172.21.15.12:0/68518755' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/535435376' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:57:16.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:16 smithi012 ceph-mon[30937]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:57:16.868 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T06:57:17.131 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:17.501 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:17 smithi173 ceph-mon[35349]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:57:17.501 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:17 smithi173 ceph-mon[35349]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:57:17.501 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:17 smithi173 ceph-mon[35349]: Cluster is now healthy 2024-09-19T06:57:17.501 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:17 smithi173 ceph-mon[35349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:57:17.501 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:17 smithi173 ceph-mon[35349]: fsmap 12 up:standby 2024-09-19T06:57:17.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:17 smithi016 ceph-mon[34911]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:57:17.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:17 smithi016 ceph-mon[34911]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:57:17.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:17 smithi016 ceph-mon[34911]: Cluster is now healthy 2024-09-19T06:57:17.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:17 smithi016 ceph-mon[34911]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:57:17.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:17 smithi016 ceph-mon[34911]: fsmap 12 up:standby 2024-09-19T06:57:17.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:17 smithi012 ceph-mon[30937]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:57:17.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:17 smithi012 ceph-mon[30937]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:57:17.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:17 smithi012 ceph-mon[30937]: Cluster is now healthy 2024-09-19T06:57:17.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:17 smithi012 ceph-mon[30937]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:57:17.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:17 smithi012 ceph-mon[30937]: fsmap 12 up:standby 2024-09-19T06:57:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 -- 172.21.15.12:0/234845021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f522c102d20 msgr2=0x7f522c103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:17.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 --2- 172.21.15.12:0/234845021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f522c102d20 0x7f522c103100 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f521c009900 tx=0x7f521c02a480 comp rx=0 tx=0).stop 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 -- 172.21.15.12:0/234845021 shutdown_connections 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 --2- 172.21.15.12:0/234845021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f522c10c150 0x7f522c10e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 --2- 172.21.15.12:0/234845021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f522c103640 0x7f522c10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 --2- 172.21.15.12:0/234845021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f522c102d20 0x7f522c103100 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 -- 172.21.15.12:0/234845021 >> 172.21.15.12:0/234845021 conn(0x7f522c0fc780 msgr2=0x7f522c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 -- 172.21.15.12:0/234845021 shutdown_connections 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 -- 172.21.15.12:0/234845021 wait complete. 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 Processor -- start 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.605+0000 7f5232aa0640 1 -- start start 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f5232aa0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f522c102d20 0x7f522c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f5232aa0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f522c103640 0x7f522c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:17.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f5232aa0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f522c10c150 0x7f522c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f5232aa0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f522c111f50 con 0x7f522c103640 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f5232aa0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f522c111dd0 con 0x7f522c10c150 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f5232aa0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1120d0 con 0x7f522c102d20 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f522bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f522c103640 0x7f522c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f522bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f522c103640 0x7f522c1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41772/0 (socket says 172.21.15.12:41772) 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f522bfff640 1 -- 172.21.15.12:0/2630608225 learned_addr learned my addr 172.21.15.12:0/2630608225 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f523083c640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f522c102d20 0x7f522c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f523103d640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f522c10c150 0x7f522c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f522bfff640 1 -- 172.21.15.12:0/2630608225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f522c102d20 msgr2=0x7f522c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f522bfff640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f522c102d20 0x7f522c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f522bfff640 1 -- 172.21.15.12:0/2630608225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f522c10c150 msgr2=0x7f522c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f522bfff640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f522c10c150 0x7f522c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f522bfff640 1 -- 172.21.15.12:0/2630608225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c19d440 con 0x7f522c103640 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f523103d640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f522c10c150 0x7f522c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f522bfff640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f522c103640 0x7f522c1989d0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f522000e9f0 tx=0x7f522000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f5229ffb640 1 -- 172.21.15.12:0/2630608225 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522000ccc0 con 0x7f522c103640 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f5229ffb640 1 -- 172.21.15.12:0/2630608225 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f522000ce60 con 0x7f522c103640 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f5232aa0640 1 -- 172.21.15.12:0/2630608225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522c19d730 con 0x7f522c103640 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.606+0000 7f5229ffb640 1 -- 172.21.15.12:0/2630608225 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5220010690 con 0x7f522c103640 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.607+0000 7f5232aa0640 1 -- 172.21.15.12:0/2630608225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522c1a5010 con 0x7f522c103640 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.608+0000 7f5232aa0640 1 -- 172.21.15.12:0/2630608225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522c103100 con 0x7f522c103640 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.609+0000 7f5229ffb640 1 -- 172.21.15.12:0/2630608225 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f52200046c0 con 0x7f522c103640 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.610+0000 7f5229ffb640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f52140a3430 0x7f52140a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.610+0000 7f523083c640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f52140a3430 0x7f52140a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.610+0000 7f5229ffb640 1 -- 172.21.15.12:0/2630608225 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9117+0+0 (secure 0 0 0) 0x7f52200d0300 con 0x7f522c103640 2024-09-19T06:57:17.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.610+0000 7f523083c640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f52140a3430 0x7f52140a58f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f521c009230 tx=0x7f521c0058d0 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:17.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.614+0000 7f5229ffb640 1 -- 172.21.15.12:0/2630608225 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f522009ca90 con 0x7f522c103640 2024-09-19T06:57:17.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:17.792+0000 7f5232aa0640 1 -- 172.21.15.12:0/2630608225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f522c02d7c0 con 0x7f522c103640 2024-09-19T06:57:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.165+0000 7f5229ffb640 1 -- 172.21.15.12:0/2630608225 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) ==== 181+0+0 (secure 0 0 0) 0x7f522009c390 con 0x7f522c103640 2024-09-19T06:57:18.166 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-19T06:57:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.168+0000 7f5232aa0640 1 -- 172.21.15.12:0/2630608225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f52140a3430 msgr2=0x7f52140a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.168+0000 7f5232aa0640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f52140a3430 0x7f52140a58f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f521c009230 tx=0x7f521c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.168+0000 7f5232aa0640 1 -- 172.21.15.12:0/2630608225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f522c103640 msgr2=0x7f522c1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.168+0000 7f5232aa0640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f522c103640 0x7f522c1989d0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f522000e9f0 tx=0x7f522000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.169+0000 7f5232aa0640 1 -- 172.21.15.12:0/2630608225 shutdown_connections 2024-09-19T06:57:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.169+0000 7f5232aa0640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f522c10c150 0x7f522c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.169+0000 7f5232aa0640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f522c103640 0x7f522c1989d0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.169+0000 7f5232aa0640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f52140a3430 0x7f52140a58f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.169+0000 7f5232aa0640 1 --2- 172.21.15.12:0/2630608225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f522c102d20 0x7f522c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.169+0000 7f5232aa0640 1 -- 172.21.15.12:0/2630608225 >> 172.21.15.12:0/2630608225 conn(0x7f522c0fc780 msgr2=0x7f522c0fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.170+0000 7f5232aa0640 1 -- 172.21.15.12:0/2630608225 shutdown_connections 2024-09-19T06:57:18.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:18.170+0000 7f5232aa0640 1 -- 172.21.15.12:0/2630608225 wait complete. 2024-09-19T06:57:18.479 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:18 smithi012 ceph-mon[30937]: pgmap v539: 97 pgs: 97 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 16 op/s 2024-09-19T06:57:18.479 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:18 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2630608225' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:57:18.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:18 smithi016 ceph-mon[34911]: pgmap v539: 97 pgs: 97 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 16 op/s 2024-09-19T06:57:18.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:18 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2630608225' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:57:18.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:18 smithi173 ceph-mon[35349]: pgmap v539: 97 pgs: 97 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 16 op/s 2024-09-19T06:57:18.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:18 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2630608225' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:57:18.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T06:57:19.211 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:57:19.442 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:19 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/2630608225' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:57:19.442 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:19 smithi012 ceph-mon[30937]: osdmap e109: 12 total, 12 up, 12 in 2024-09-19T06:57:19.442 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:19 smithi012 ceph-mon[30937]: pgmap v541: 65 pgs: 65 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:57:19.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:19 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/2630608225' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:57:19.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:19 smithi016 ceph-mon[34911]: osdmap e109: 12 total, 12 up, 12 in 2024-09-19T06:57:19.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:19 smithi016 ceph-mon[34911]: pgmap v541: 65 pgs: 65 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:57:19.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:19 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/2630608225' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:57:19.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:19 smithi173 ceph-mon[35349]: osdmap e109: 12 total, 12 up, 12 in 2024-09-19T06:57:19.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:19 smithi173 ceph-mon[35349]: pgmap v541: 65 pgs: 65 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:57:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.704+0000 7f4867f3e640 1 -- 172.21.15.12:0/624997435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4860100e20 msgr2=0x7f4860101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.704+0000 7f4867f3e640 1 --2- 172.21.15.12:0/624997435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4860100e20 0x7f4860101200 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f4850009ca0 tx=0x7f485002a950 comp rx=0 tx=0).stop 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.704+0000 7f4867f3e640 1 -- 172.21.15.12:0/624997435 shutdown_connections 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.704+0000 7f4867f3e640 1 --2- 172.21.15.12:0/624997435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860102ef0 0x7f486010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.704+0000 7f4867f3e640 1 --2- 172.21.15.12:0/624997435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4860102570 0x7f48601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.704+0000 7f4867f3e640 1 --2- 172.21.15.12:0/624997435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4860100e20 0x7f4860101200 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.704+0000 7f4867f3e640 1 -- 172.21.15.12:0/624997435 >> 172.21.15.12:0/624997435 conn(0x7f48600fc7d0 msgr2=0x7f48600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.704+0000 7f4867f3e640 1 -- 172.21.15.12:0/624997435 shutdown_connections 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.704+0000 7f4867f3e640 1 -- 172.21.15.12:0/624997435 wait complete. 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4867f3e640 1 Processor -- start 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4867f3e640 1 -- start start 2024-09-19T06:57:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4867f3e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4860100e20 0x7f486019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4867f3e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860102570 0x7f486019f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4867f3e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4860102ef0 0x7f48601a3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4867f3e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4860110f80 con 0x7f4860100e20 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4867f3e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4860110e00 con 0x7f4860102ef0 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4867f3e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4860111100 con 0x7f4860102570 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4865cda640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4860100e20 0x7f486019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4865cda640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4860100e20 0x7f486019edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41790/0 (socket says 172.21.15.12:41790) 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.705+0000 7f4865cda640 1 -- 172.21.15.12:0/3100529245 learned_addr learned my addr 172.21.15.12:0/3100529245 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f48654d9640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860102570 0x7f486019f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f48664db640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4860102ef0 0x7f48601a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f4865cda640 1 -- 172.21.15.12:0/3100529245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860102570 msgr2=0x7f486019f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f4865cda640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860102570 0x7f486019f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f4865cda640 1 -- 172.21.15.12:0/3100529245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4860102ef0 msgr2=0x7f48601a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f4865cda640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4860102ef0 0x7f48601a3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f4865cda640 1 -- 172.21.15.12:0/3100529245 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48601a3b50 con 0x7f4860100e20 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f4865cda640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4860100e20 0x7f486019edd0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f4850005cc0 tx=0x7f485002f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f485effd640 1 -- 172.21.15.12:0/3100529245 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4850034040 con 0x7f4860100e20 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f4867f3e640 1 -- 172.21.15.12:0/3100529245 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48601a3de0 con 0x7f4860100e20 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f485effd640 1 -- 172.21.15.12:0/3100529245 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4850030920 con 0x7f4860100e20 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f485effd640 1 -- 172.21.15.12:0/3100529245 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4850004790 con 0x7f4860100e20 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.706+0000 7f4867f3e640 1 -- 172.21.15.12:0/3100529245 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48601ab700 con 0x7f4860100e20 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.707+0000 7f4867f3e640 1 -- 172.21.15.12:0/3100529245 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4860101200 con 0x7f4860100e20 2024-09-19T06:57:19.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.709+0000 7f485effd640 1 -- 172.21.15.12:0/3100529245 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4850037020 con 0x7f4860100e20 2024-09-19T06:57:19.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.709+0000 7f485effd640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f48480a33b0 0x7f48480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.709+0000 7f48654d9640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f48480a33b0 0x7f48480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.709+0000 7f485effd640 1 -- 172.21.15.12:0/3100529245 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 8447+0+0 (secure 0 0 0) 0x7f48500f0c20 con 0x7f4860100e20 2024-09-19T06:57:19.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.710+0000 7f48654d9640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f48480a33b0 0x7f48480a5870 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f486010def0 tx=0x7f4854005f90 comp rx=0 tx=0).ready entity=mgr.15243 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:19.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.713+0000 7f485effd640 1 -- 172.21.15.12:0/3100529245 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48500bd760 con 0x7f4860100e20 2024-09-19T06:57:19.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.894+0000 7f4867f3e640 1 -- 172.21.15.12:0/3100529245 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f486019feb0 con 0x7f4860100e20 2024-09-19T06:57:19.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.991+0000 7f485effd640 1 -- 172.21.15.12:0/3100529245 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) ==== 169+0+0 (secure 0 0 0) 0x7f48500dd120 con 0x7f4860100e20 2024-09-19T06:57:19.992 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-19T06:57:19.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.995+0000 7f4867f3e640 1 -- 172.21.15.12:0/3100529245 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f48480a33b0 msgr2=0x7f48480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.995+0000 7f4867f3e640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f48480a33b0 0x7f48480a5870 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f486010def0 tx=0x7f4854005f90 comp rx=0 tx=0).stop 2024-09-19T06:57:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.995+0000 7f4867f3e640 1 -- 172.21.15.12:0/3100529245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4860100e20 msgr2=0x7f486019edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.995+0000 7f4867f3e640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4860100e20 0x7f486019edd0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f4850005cc0 tx=0x7f485002f630 comp rx=0 tx=0).stop 2024-09-19T06:57:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.995+0000 7f4867f3e640 1 -- 172.21.15.12:0/3100529245 shutdown_connections 2024-09-19T06:57:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.995+0000 7f4867f3e640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4860102ef0 0x7f48601a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.995+0000 7f4867f3e640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.12:6800/743507810,v1:172.21.15.12:6801/743507810] conn(0x7f48480a33b0 0x7f48480a5870 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.995+0000 7f4867f3e640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4860102570 0x7f486019f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.995+0000 7f4867f3e640 1 --2- 172.21.15.12:0/3100529245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4860100e20 0x7f486019edd0 secure :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f4850005cc0 tx=0x7f485002f630 comp rx=0 tx=0).stop 2024-09-19T06:57:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.995+0000 7f4867f3e640 1 -- 172.21.15.12:0/3100529245 >> 172.21.15.12:0/3100529245 conn(0x7f48600fc7d0 msgr2=0x7f486006a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:19.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.996+0000 7f4867f3e640 1 -- 172.21.15.12:0/3100529245 shutdown_connections 2024-09-19T06:57:19.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-19T06:57:19.996+0000 7f4867f3e640 1 -- 172.21.15.12:0/3100529245 wait complete. 2024-09-19T06:57:20.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:20 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3100529245' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:57:20.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:20 smithi012 ceph-mon[30937]: from='client.? 172.21.15.12:0/3100529245' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:57:20.379 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:20 smithi012 ceph-mon[30937]: osdmap e110: 12 total, 12 up, 12 in 2024-09-19T06:57:20.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:20 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3100529245' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:57:20.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:20 smithi016 ceph-mon[34911]: from='client.? 172.21.15.12:0/3100529245' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:57:20.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:20 smithi016 ceph-mon[34911]: osdmap e110: 12 total, 12 up, 12 in 2024-09-19T06:57:20.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:20 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3100529245' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:57:20.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:20 smithi173 ceph-mon[35349]: from='client.? 172.21.15.12:0/3100529245' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:57:20.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:20 smithi173 ceph-mon[35349]: osdmap e110: 12 total, 12 up, 12 in 2024-09-19T06:57:20.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:57:20.788 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:57:20.830 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:57:20.869 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T06:57:20.869 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:57:20.895 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:57:20.919 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:57:20.941 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T06:57:20.941 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T06:57:20.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:57:21.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:20 smithi012 systemd[1]: Stopping Ceph mon.a for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:57:21.289 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:21 smithi012 ceph-mon[30937]: pgmap v543: 1 pgs: 1 active+clean; 577 KiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:57:21.508 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:21 smithi016 ceph-mon[34911]: pgmap v543: 1 pgs: 1 active+clean; 577 KiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:57:21.582 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:21 smithi173 ceph-mon[35349]: pgmap v543: 1 pgs: 1 active+clean; 577 KiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:57:21.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:21 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a[30933]: 2024-09-19T06:57:21.286+0000 7fa016aa5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:57:21.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:21 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a[30933]: 2024-09-19T06:57:21.287+0000 7fa016aa5640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T06:57:21.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:21 smithi012 podman[127647]: 2024-09-19 06:57:21.328394481 +0000 UTC m=+0.161447743 container died 56166a7b626f5015fce66fdcbd95c1e43a2cf1f47092837c31bbd4693cf04430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:57:21.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:21 smithi012 podman[127647]: 2024-09-19 06:57:21.702772673 +0000 UTC m=+0.535825933 container cleanup 56166a7b626f5015fce66fdcbd95c1e43a2cf1f47092837c31bbd4693cf04430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:57:21.879 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 19 06:57:21 smithi012 bash[127647]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:57:22.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T06:57:22.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:57:22.302 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T06:57:22.303 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T06:57:22.303 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.b 2024-09-19T06:57:22.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:22 smithi016 systemd[1]: Stopping Ceph mon.b for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:57:22.851 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-b[34907]: 2024-09-19T06:57:22.584+0000 7f2cc1018640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:57:22.852 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-b[34907]: 2024-09-19T06:57:22.584+0000 7f2cc1018640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:57:23.136 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:22 smithi016 podman[70997]: 2024-09-19 06:57:22.85084658 +0000 UTC m=+0.362459052 container died 8ddc26cc182fce4746e61ff4afc1ead812e6ba9086d9fbe118c246c52e0234b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T06:57:23.461 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:23 smithi016 podman[70997]: 2024-09-19 06:57:23.234899619 +0000 UTC m=+0.746512078 container cleanup 8ddc26cc182fce4746e61ff4afc1ead812e6ba9086d9fbe118c246c52e0234b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:57:23.461 INFO:journalctl@ceph.mon.b.smithi016.stdout:Sep 19 06:57:23 smithi016 bash[70997]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-b 2024-09-19T06:57:23.623 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T06:57:23.671 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:57:23.671 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T06:57:23.671 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T06:57:23.671 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.c 2024-09-19T06:57:23.955 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:23 smithi173 systemd[1]: Stopping Ceph mon.c for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:57:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-c[35345]: 2024-09-19T06:57:23.954+0000 7fd5d79a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:57:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-c[35345]: 2024-09-19T06:57:23.954+0000 7fd5d79a3640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:57:24.332 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:24 smithi173 podman[72270]: 2024-09-19 06:57:24.158219798 +0000 UTC m=+0.301216519 container died fadca08d8e989038c503d07193248e62e4a3541f94f32b29e893a4c727345844 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T06:57:24.782 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:24 smithi173 podman[72270]: 2024-09-19 06:57:24.546485573 +0000 UTC m=+0.689482293 container cleanup fadca08d8e989038c503d07193248e62e4a3541f94f32b29e893a4c727345844 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T06:57:24.782 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 19 06:57:24 smithi173 bash[72270]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mon-c 2024-09-19T06:57:24.908 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T06:57:24.952 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:57:24.952 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T06:57:24.952 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T06:57:24.953 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:57:25.275 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:57:24 smithi012 systemd[1]: Stopping Ceph mgr.x for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:57:25.609 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:57:25 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:57:25.273+0000 7f4d32309640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:57:25.609 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:57:25 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x[31163]: 2024-09-19T06:57:25.273+0000 7f4d32309640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-19T06:57:25.609 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:57:25 smithi012 podman[127770]: 2024-09-19 06:57:25.305098402 +0000 UTC m=+0.157833220 container died 0b352ea0c27cee8c717b3e67bf8f1b03b2e4daf5bb5bcd421db202dc7aa09eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T06:57:25.879 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:57:25 smithi012 podman[127770]: 2024-09-19 06:57:25.791993212 +0000 UTC m=+0.644728060 container cleanup 0b352ea0c27cee8c717b3e67bf8f1b03b2e4daf5bb5bcd421db202dc7aa09eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:57:25.879 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:57:25 smithi012 bash[127770]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x 2024-09-19T06:57:26.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T06:57:26.247 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:57:25 smithi012 podman[127782]: 2024-09-19 06:57:25.985658742 +0000 UTC m=+0.670625516 container remove 0b352ea0c27cee8c717b3e67bf8f1b03b2e4daf5bb5bcd421db202dc7aa09eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T06:57:26.248 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:57:26 smithi012 systemd[1]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-19T06:57:26.248 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:57:26 smithi012 systemd[1]: Stopped Ceph mgr.x for 8bf314c8-7650-11ef-bceb-c7b262605968. 2024-09-19T06:57:26.248 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 19 06:57:26 smithi012 systemd[1]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.x.service: Consumed 59.869s CPU time. 2024-09-19T06:57:26.262 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:57:26.262 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T06:57:26.262 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T06:57:26.262 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.y 2024-09-19T06:57:26.508 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:57:26 smithi016 systemd[1]: Stopping Ceph mgr.y for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:57:26.914 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:57:26 smithi016 podman[71120]: 2024-09-19 06:57:26.609825321 +0000 UTC m=+0.146760313 container died 3a4caf458dc7844d16a70f7f6ef58f802f0157c5f530ea27224b25aab8c707a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T06:57:27.249 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:57:26 smithi016 podman[71120]: 2024-09-19 06:57:26.997363793 +0000 UTC m=+0.534298774 container cleanup 3a4caf458dc7844d16a70f7f6ef58f802f0157c5f530ea27224b25aab8c707a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T06:57:27.249 INFO:journalctl@ceph.mgr.y.smithi016.stdout:Sep 19 06:57:26 smithi016 bash[71120]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-y 2024-09-19T06:57:27.386 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T06:57:27.421 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:57:27.421 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T06:57:27.421 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T06:57:27.421 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.z 2024-09-19T06:57:27.832 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:57:27 smithi173 systemd[1]: Stopping Ceph mgr.z for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:57:28.127 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:57:27 smithi173 podman[72392]: 2024-09-19 06:57:27.857560448 +0000 UTC m=+0.247699147 container died b767e544145e2465e00d1f31aa51039cab2aa23289ebd6e7befe9adc93971e9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T06:57:28.487 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:57:28 smithi173 podman[72392]: 2024-09-19 06:57:28.201610948 +0000 UTC m=+0.591749648 container cleanup b767e544145e2465e00d1f31aa51039cab2aa23289ebd6e7befe9adc93971e9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:57:28.487 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 19 06:57:28 smithi173 bash[72392]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mgr-z 2024-09-19T06:57:28.631 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T06:57:28.664 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:57:28.664 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T06:57:28.664 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T06:57:28.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.0 2024-09-19T06:57:28.948 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:28 smithi012 systemd[1]: Stopping Ceph osd.0 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:57:29.379 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0[44703]: 2024-09-19T06:57:28.946+0000 7fc64aa72640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:57:29.379 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0[44703]: 2024-09-19T06:57:28.946+0000 7fc64aa72640 -1 osd.0 110 *** Got signal Terminated *** 2024-09-19T06:57:29.379 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0[44703]: 2024-09-19T06:57:28.946+0000 7fc64aa72640 -1 osd.0 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:57:34.814 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:34 smithi012 podman[127890]: 2024-09-19 06:57:34.504921432 +0000 UTC m=+5.657012334 container died d0b27272be7a00ca115a0f297218ecb665c201bfbdcd97663c701da30dec93f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T06:57:35.129 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:34 smithi012 podman[127890]: 2024-09-19 06:57:34.988374446 +0000 UTC m=+6.140465378 container cleanup d0b27272be7a00ca115a0f297218ecb665c201bfbdcd97663c701da30dec93f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:57:35.129 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:34 smithi012 bash[127890]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0 2024-09-19T06:57:35.414 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:35 smithi012 podman[127906]: 2024-09-19 06:57:35.148267139 +0000 UTC m=+0.643679367 container remove d0b27272be7a00ca115a0f297218ecb665c201bfbdcd97663c701da30dec93f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:57:35.681 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:35 smithi012 podman[127996]: 2024-09-19 06:57:35.464104673 +0000 UTC m=+0.016324044 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:57:35.681 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:35 smithi012 podman[127996]: 2024-09-19 06:57:35.574268738 +0000 UTC m=+0.126488141 container create 363e857cbd441898b2a23fd121c90e5cd1f76410b837b106ecdf122048ab2704 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T06:57:36.048 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:35 smithi012 podman[127996]: 2024-09-19 06:57:35.843629416 +0000 UTC m=+0.395848785 container init 363e857cbd441898b2a23fd121c90e5cd1f76410b837b106ecdf122048ab2704 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:57:36.048 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:35 smithi012 podman[127996]: 2024-09-19 06:57:35.847471751 +0000 UTC m=+0.399691120 container start 363e857cbd441898b2a23fd121c90e5cd1f76410b837b106ecdf122048ab2704 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T06:57:36.048 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:35 smithi012 podman[127996]: 2024-09-19 06:57:35.926708871 +0000 UTC m=+0.478928247 container attach 363e857cbd441898b2a23fd121c90e5cd1f76410b837b106ecdf122048ab2704 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T06:57:36.338 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 19 06:57:36 smithi012 podman[127996]: 2024-09-19 06:57:36.048110159 +0000 UTC m=+0.600329525 container died 363e857cbd441898b2a23fd121c90e5cd1f76410b837b106ecdf122048ab2704 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:57:36.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T06:57:36.790 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:57:36.791 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T06:57:36.791 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T06:57:36.791 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.1 2024-09-19T06:57:37.119 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:36 smithi016 systemd[1]: Stopping Ceph osd.1 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:57:37.508 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:37 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1[39404]: 2024-09-19T06:57:37.118+0000 7f5f745c1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:57:37.508 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:37 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1[39404]: 2024-09-19T06:57:37.118+0000 7f5f745c1640 -1 osd.1 110 *** Got signal Terminated *** 2024-09-19T06:57:37.509 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:37 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1[39404]: 2024-09-19T06:57:37.118+0000 7f5f745c1640 -1 osd.1 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:57:43.008 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:42 smithi016 podman[71244]: 2024-09-19 06:57:42.741226466 +0000 UTC m=+5.745072000 container died 5d1ab319e244bc298763e68244cc80d5808d7f2ccba5260eab71df794d020052 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T06:57:43.354 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:43 smithi016 podman[71244]: 2024-09-19 06:57:43.093093871 +0000 UTC m=+6.096939398 container cleanup 5d1ab319e244bc298763e68244cc80d5808d7f2ccba5260eab71df794d020052 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:57:43.354 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:43 smithi016 bash[71244]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1 2024-09-19T06:57:43.713 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:43 smithi016 podman[71258]: 2024-09-19 06:57:43.352908674 +0000 UTC m=+0.615688835 container remove 5d1ab319e244bc298763e68244cc80d5808d7f2ccba5260eab71df794d020052 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T06:57:44.008 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:43 smithi016 podman[71346]: 2024-09-19 06:57:43.615825496 +0000 UTC m=+0.016513098 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:57:44.008 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:43 smithi016 podman[71346]: 2024-09-19 06:57:43.720351911 +0000 UTC m=+0.121039498 container create 9f8c9fa7e2f9afc39ff2fe25b4449fafef4e3011558226575522e5f2c85a8ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T06:57:44.284 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:44 smithi016 podman[71346]: 2024-09-19 06:57:44.04035826 +0000 UTC m=+0.441045857 container init 9f8c9fa7e2f9afc39ff2fe25b4449fafef4e3011558226575522e5f2c85a8ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:57:44.284 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:44 smithi016 podman[71346]: 2024-09-19 06:57:44.043960892 +0000 UTC m=+0.444648480 container start 9f8c9fa7e2f9afc39ff2fe25b4449fafef4e3011558226575522e5f2c85a8ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:57:44.284 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:44 smithi016 podman[71346]: 2024-09-19 06:57:44.131282869 +0000 UTC m=+0.531970476 container attach 9f8c9fa7e2f9afc39ff2fe25b4449fafef4e3011558226575522e5f2c85a8ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:57:44.284 INFO:journalctl@ceph.osd.1.smithi016.stdout:Sep 19 06:57:44 smithi016 podman[71346]: 2024-09-19 06:57:44.250663637 +0000 UTC m=+0.651351233 container died 9f8c9fa7e2f9afc39ff2fe25b4449fafef4e3011558226575522e5f2c85a8ab6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T06:57:44.869 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T06:57:44.907 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:57:44.907 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T06:57:44.907 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T06:57:44.907 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.2 2024-09-19T06:57:45.190 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:44 smithi173 systemd[1]: Stopping Ceph osd.2 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:57:45.582 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:45 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2[40312]: 2024-09-19T06:57:45.188+0000 7fed335e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:57:45.582 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:45 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2[40312]: 2024-09-19T06:57:45.188+0000 7fed335e6640 -1 osd.2 110 *** Got signal Terminated *** 2024-09-19T06:57:45.582 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:45 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2[40312]: 2024-09-19T06:57:45.188+0000 7fed335e6640 -1 osd.2 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:57:50.987 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:50 smithi173 podman[72516]: 2024-09-19 06:57:50.701842004 +0000 UTC m=+5.605575914 container died 53b60990d47901033d36965d945d8ffeb0b69e37ba899de31e1238ee719485f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T06:57:51.324 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:51 smithi173 podman[72516]: 2024-09-19 06:57:51.06433566 +0000 UTC m=+5.968069571 container cleanup 53b60990d47901033d36965d945d8ffeb0b69e37ba899de31e1238ee719485f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:57:51.324 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:51 smithi173 bash[72516]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2 2024-09-19T06:57:51.582 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:51 smithi173 podman[72534]: 2024-09-19 06:57:51.323914926 +0000 UTC m=+0.622374477 container remove 53b60990d47901033d36965d945d8ffeb0b69e37ba899de31e1238ee719485f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T06:57:51.902 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:51 smithi173 podman[72622]: 2024-09-19 06:57:51.641581339 +0000 UTC m=+0.089864883 container create c948e4bb2bf24be66151718773c21fe4b75cb51be7de8cebb63c756a9024b850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T06:57:51.902 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:51 smithi173 podman[72622]: 2024-09-19 06:57:51.567227615 +0000 UTC m=+0.015511105 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:57:52.333 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:51 smithi173 podman[72622]: 2024-09-19 06:57:51.90222793 +0000 UTC m=+0.350511418 container init c948e4bb2bf24be66151718773c21fe4b75cb51be7de8cebb63c756a9024b850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T06:57:52.333 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:51 smithi173 podman[72622]: 2024-09-19 06:57:51.905895916 +0000 UTC m=+0.354179405 container start c948e4bb2bf24be66151718773c21fe4b75cb51be7de8cebb63c756a9024b850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:57:52.333 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:51 smithi173 podman[72622]: 2024-09-19 06:57:51.985637255 +0000 UTC m=+0.433920755 container attach c948e4bb2bf24be66151718773c21fe4b75cb51be7de8cebb63c756a9024b850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T06:57:52.333 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 19 06:57:52 smithi173 podman[72622]: 2024-09-19 06:57:52.096827708 +0000 UTC m=+0.545111197 container died c948e4bb2bf24be66151718773c21fe4b75cb51be7de8cebb63c756a9024b850 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T06:57:52.740 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T06:57:52.779 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:57:52.779 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T06:57:52.779 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T06:57:52.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.3 2024-09-19T06:57:53.083 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:52 smithi012 systemd[1]: Stopping Ceph osd.3 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:57:53.378 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:53 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3[51647]: 2024-09-19T06:57:53.081+0000 7f75af023640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:57:53.379 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:53 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3[51647]: 2024-09-19T06:57:53.081+0000 7f75af023640 -1 osd.3 110 *** Got signal Terminated *** 2024-09-19T06:57:53.379 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:53 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3[51647]: 2024-09-19T06:57:53.081+0000 7f75af023640 -1 osd.3 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:57:56.082 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:57:55 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:57:55.767+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:57:56.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:57:55 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:57:55.817+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:57:57.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:57:56 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:57:56.816+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:57:57.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:57:56 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:57:56.861+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:57:57.878 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:57 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3[51647]: 2024-09-19T06:57:57.627+0000 7f75ab628640 -1 osd.3 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:31.339476+0000 front 2024-09-19T06:57:31.339501+0000 (oldest deadline 2024-09-19T06:57:57.239641+0000) 2024-09-19T06:57:57.879 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:57:57 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:57:57.776+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:57:57.879 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:57:57 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:57:57.747+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:57:58.082 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:57:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:57:57.607+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:57:58.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:57:57 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:57:57.909+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:57:58.561 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:57:58 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:57:58.242+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:57:58.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:57:58 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:57:58.560+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:57:59.004 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:58 smithi012 podman[128098]: 2024-09-19 06:57:58.704196243 +0000 UTC m=+5.724264172 container died e63b96eac20df76fb27917545320f6f0e59aecef29d6b8a481ec990be4a768a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:57:59.005 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:57:58 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:57:58.755+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:57:59.005 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:57:58 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:57:58.796+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:57:59.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:57:58 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:57:58.952+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:57:59.379 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:59 smithi012 podman[128098]: 2024-09-19 06:57:59.190656196 +0000 UTC m=+6.210724114 container cleanup e63b96eac20df76fb27917545320f6f0e59aecef29d6b8a481ec990be4a768a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T06:57:59.379 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:59 smithi012 bash[128098]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3 2024-09-19T06:57:59.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:57:59 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:57:59.238+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:57:59.739 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:59 smithi012 podman[128126]: 2024-09-19 06:57:59.467247085 +0000 UTC m=+0.758136993 container remove e63b96eac20df76fb27917545320f6f0e59aecef29d6b8a481ec990be4a768a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T06:58:00.082 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:57:59 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:57:59.607+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:00.112 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:57:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:57:59.738+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:00.113 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:57:59 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:57:59.791+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:00.113 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:59 smithi012 podman[128214]: 2024-09-19 06:57:59.723072642 +0000 UTC m=+0.016526767 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:00.113 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:57:59 smithi012 podman[128214]: 2024-09-19 06:57:59.843137515 +0000 UTC m=+0.136591629 container create 1b3830ff6da6aa0fccb0f85aad7377b93d447184061374e46c319c1b3007cd3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:58:00.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:57:59 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:57:59.981+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:00.379 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:58:00 smithi012 podman[128214]: 2024-09-19 06:58:00.112116333 +0000 UTC m=+0.405570451 container init 1b3830ff6da6aa0fccb0f85aad7377b93d447184061374e46c319c1b3007cd3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T06:58:00.379 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:58:00 smithi012 podman[128214]: 2024-09-19 06:58:00.115835304 +0000 UTC m=+0.409289416 container start 1b3830ff6da6aa0fccb0f85aad7377b93d447184061374e46c319c1b3007cd3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-19T06:58:00.379 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:58:00 smithi012 podman[128214]: 2024-09-19 06:58:00.220637064 +0000 UTC m=+0.514091193 container attach 1b3830ff6da6aa0fccb0f85aad7377b93d447184061374e46c319c1b3007cd3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T06:58:00.379 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 19 06:58:00 smithi012 podman[128214]: 2024-09-19 06:58:00.317862721 +0000 UTC m=+0.611316852 container died 1b3830ff6da6aa0fccb0f85aad7377b93d447184061374e46c319c1b3007cd3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T06:58:00.575 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:00 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:00.250+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:00.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:00 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:00.574+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:01.058 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:00 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:00.738+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:01.058 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:00 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:00.834+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:01.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T06:58:01.128 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:01.128 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T06:58:01.129 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T06:58:01.129 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.4 2024-09-19T06:58:01.258 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:01 smithi016 systemd[1]: Stopping Ceph osd.4 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:58:01.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:00 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:00.935+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:01.582 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:01 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:01.538+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:01.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:01 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:01.299+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:01.758 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:01 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4[45913]: 2024-09-19T06:58:01.421+0000 7fd69fd88640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:01.758 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:01 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4[45913]: 2024-09-19T06:58:01.421+0000 7fd69fd88640 -1 osd.4 110 *** Got signal Terminated *** 2024-09-19T06:58:01.758 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:01 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4[45913]: 2024-09-19T06:58:01.421+0000 7fd69fd88640 -1 osd.4 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:02.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:01 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:01.787+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:02.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:01 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:01.787+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:02.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:01 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:01.896+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:02.531 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:02.252+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:02.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:02.529+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:03.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:02.772+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:03.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:02 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:02.744+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:03.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:02 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:02.873+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:03.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:03.262+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:03.579 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:03.488+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:03.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:03 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:03.577+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:04.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:03.796+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:04.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:03 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:03.767+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:04.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:03 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:03.901+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:04.517 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:04 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:04.215+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:04.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:04 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:04.515+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:04.833 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:04 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:04.553+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:05.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:04 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:04.753+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:05.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:04 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:04.798+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:05.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:05 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:05.011+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:05.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:04 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:04.869+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:05.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:04 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:04.869+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:05.524 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:05 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:05.189+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:05.524 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:05 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:05.189+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:05.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:05 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:05.523+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:05.833 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:05 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:05.587+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:06.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:05 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:05.729+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:06.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:05 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:05.801+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:06.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:05 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:05.991+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:06.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:05 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:05.894+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:06.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:05 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:05.894+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:06.542 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:06.189+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:06.542 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:06.189+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:06.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:06.540+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:06.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:06 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:06.563+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:07.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:06.719+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:07.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:06.821+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:07.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:06 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:06.821+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:07.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:06.992+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:07.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:06.856+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:07.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:06 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:06.856+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:07.259 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:07 smithi016 podman[71463]: 2024-09-19 06:58:07.092938293 +0000 UTC m=+5.767303409 container died 20346f2c89eb2b670437d12ac521cb9e42ea6108f084bed359987b4e7a419da5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T06:58:07.510 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:07 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:07.235+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:07.510 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:07 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:07.235+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:07.706 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:07 smithi016 podman[71463]: 2024-09-19 06:58:07.463089635 +0000 UTC m=+6.137454747 container cleanup 20346f2c89eb2b670437d12ac521cb9e42ea6108f084bed359987b4e7a419da5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T06:58:07.706 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:07 smithi016 bash[71463]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4 2024-09-19T06:58:07.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:07 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:07.508+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:07.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:07 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:07.583+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:07.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:07 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:07.583+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.476263+0000 front 2024-09-19T06:57:41.476366+0000 (oldest deadline 2024-09-19T06:58:07.276850+0000) 2024-09-19T06:58:08.008 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:07 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:07.949+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:08.008 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:07 smithi016 podman[71480]: 2024-09-19 06:58:07.705960878 +0000 UTC m=+0.611629239 container remove 20346f2c89eb2b670437d12ac521cb9e42ea6108f084bed359987b4e7a419da5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:08.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:07 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:07.858+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:08.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:07 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:07.858+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:08.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:07 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:07.839+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:08.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:07 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:07.839+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:08.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:07 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:07.749+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:08.326 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:08 smithi016 podman[71572]: 2024-09-19 06:58:07.927635801 +0000 UTC m=+0.016181965 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:08.327 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:08 smithi016 podman[71572]: 2024-09-19 06:58:08.040268808 +0000 UTC m=+0.128815014 container create 201476926de44b1a267e64d82c4ed1a6e8fca4a8ebf8e66955b7f0c84be8adef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:08.327 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:08 smithi016 podman[71572]: 2024-09-19 06:58:08.251569981 +0000 UTC m=+0.340116143 container init 201476926de44b1a267e64d82c4ed1a6e8fca4a8ebf8e66955b7f0c84be8adef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T06:58:08.327 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:08 smithi016 podman[71572]: 2024-09-19 06:58:08.255225843 +0000 UTC m=+0.343772008 container start 201476926de44b1a267e64d82c4ed1a6e8fca4a8ebf8e66955b7f0c84be8adef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T06:58:08.327 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:08 smithi016 podman[71572]: 2024-09-19 06:58:08.32602614 +0000 UTC m=+0.414572302 container attach 201476926de44b1a267e64d82c4ed1a6e8fca4a8ebf8e66955b7f0c84be8adef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T06:58:08.556 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:08 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:08.459+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:08.556 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:08 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:08.228+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:08.556 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:08 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:08.228+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:08.729 INFO:journalctl@ceph.osd.4.smithi016.stdout:Sep 19 06:58:08 smithi016 podman[71572]: 2024-09-19 06:58:08.446767136 +0000 UTC m=+0.535313302 container died 201476926de44b1a267e64d82c4ed1a6e8fca4a8ebf8e66955b7f0c84be8adef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T06:58:08.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:08 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:08.554+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:08.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:08 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:08.554+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.476263+0000 front 2024-09-19T06:57:41.476366+0000 (oldest deadline 2024-09-19T06:58:07.276850+0000) 2024-09-19T06:58:08.988 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:08 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:08.947+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:08.988 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:08 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:08.816+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:08.989 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:08 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:08.816+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:09.014 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T06:58:09.055 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:09.055 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T06:58:09.055 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T06:58:09.055 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.5 2024-09-19T06:58:09.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:08.733+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:09.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:08.733+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:09.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:08.885+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:09.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:08 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:08.885+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:09.376 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:09 smithi173 systemd[1]: Stopping Ceph osd.5 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:58:09.377 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:09 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:09.218+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:09.377 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:09 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:09.218+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:09.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:09 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:09.484+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:09.833 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:09 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:09.374+0000 7fb9e7819640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:09.833 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:09 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:09.374+0000 7fb9e7819640 -1 osd.5 110 *** Got signal Terminated *** 2024-09-19T06:58:09.833 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:09 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:09.374+0000 7fb9e7819640 -1 osd.5 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:09.833 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:09 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:09.510+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:09.833 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:09 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:09.510+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.476263+0000 front 2024-09-19T06:57:41.476366+0000 (oldest deadline 2024-09-19T06:58:07.276850+0000) 2024-09-19T06:58:10.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:09 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:09.752+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:10.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:09 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:09.752+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:10.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:09 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:09.850+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:10.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:09 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:09.850+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:10.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:09 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:09.917+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:10.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:09 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:09.771+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:10.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:09 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:09.771+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:10.505 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:10 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:10.474+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:10.505 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:10 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:10.474+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.476263+0000 front 2024-09-19T06:57:41.476366+0000 (oldest deadline 2024-09-19T06:58:07.276850+0000) 2024-09-19T06:58:10.505 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:10 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:10.225+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:10.505 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:10 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:10.225+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:10.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:10 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:10.503+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:11.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:10.801+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:11.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:10.801+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:11.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:10.817+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:11.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:10.817+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:11.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:10 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:10.896+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:11.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:10 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:10.820+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:11.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:10 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:10.820+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:11.469 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:11 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:11.182+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:11.469 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:11 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:11.182+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:11.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:11 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:11.468+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:11.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:11 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:11.472+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:11.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:11 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:11.472+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.476263+0000 front 2024-09-19T06:57:41.476366+0000 (oldest deadline 2024-09-19T06:58:07.276850+0000) 2024-09-19T06:58:11.833 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:11 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:11.472+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.277201+0000 front 2024-09-19T06:57:47.277179+0000 (oldest deadline 2024-09-19T06:58:10.777410+0000) 2024-09-19T06:58:12.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:11 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:11.798+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:12.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:11 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:11.798+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:12.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:11 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:11.793+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:12.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:11 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:11.793+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:12.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:11 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:11.932+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:12.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:11 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:11.812+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:12.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:11 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:11.812+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:12.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:11 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:11.812+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:12.497 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:12 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:12.212+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:12.497 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:12 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:12.212+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:12.498 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:12 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:12.452+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:12.498 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:12 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:12.452+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:12.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:12 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:12.496+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:12.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:12 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:12.496+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.476263+0000 front 2024-09-19T06:57:41.476366+0000 (oldest deadline 2024-09-19T06:58:07.276850+0000) 2024-09-19T06:58:12.832 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:12 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:12.496+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.277201+0000 front 2024-09-19T06:57:47.277179+0000 (oldest deadline 2024-09-19T06:58:10.777410+0000) 2024-09-19T06:58:13.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:12 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:12.825+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:13.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:12 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:12.825+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:13.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:12 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:12.759+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:13.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:12 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:12.759+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:13.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:12 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:12.964+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:13.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:12 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:12.964+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:13.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:12 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:12.845+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:13.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:12 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:12.845+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:13.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:12 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:12.845+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:13.582 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:13 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:13.458+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:13.582 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:13 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:13.458+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:13.583 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:13 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:13.479+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.374372+0000 front 2024-09-19T06:57:33.374288+0000 (oldest deadline 2024-09-19T06:57:56.874381+0000) 2024-09-19T06:58:13.583 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:13 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:13.479+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.476263+0000 front 2024-09-19T06:57:41.476366+0000 (oldest deadline 2024-09-19T06:58:07.276850+0000) 2024-09-19T06:58:13.583 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:13 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5[46820]: 2024-09-19T06:58:13.479+0000 7fb9dfe16640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.277201+0000 front 2024-09-19T06:57:47.277179+0000 (oldest deadline 2024-09-19T06:58:10.777410+0000) 2024-09-19T06:58:13.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:13 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:13.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:13.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:13 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:13.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:13.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:13 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:13.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:14.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:13 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:13.866+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:14.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:13 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:13.866+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:14.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:13 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:13.722+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:14.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:13 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:13.722+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:14.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:13 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:13.722+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.333479+0000 front 2024-09-19T06:57:48.333466+0000 (oldest deadline 2024-09-19T06:58:13.534258+0000) 2024-09-19T06:58:14.159 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:13 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:13.919+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:14.160 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:13 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:13.919+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:14.160 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:13 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:13.843+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:14.160 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:13 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:13.843+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:14.160 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:13 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:13.843+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:14.487 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:14.215+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:14.488 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:14.215+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:14.488 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:14.215+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:14.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:14.486+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:14.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:14 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:14.486+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:15.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:14.906+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:15.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:14.906+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:15.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:14.906+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:15.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:14.741+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:15.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:14.741+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:15.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:14 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:14.741+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.333479+0000 front 2024-09-19T06:57:48.333466+0000 (oldest deadline 2024-09-19T06:58:13.534258+0000) 2024-09-19T06:58:15.186 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:14 smithi173 podman[72736]: 2024-09-19 06:58:14.880044686 +0000 UTC m=+5.633047651 container died c1caeb40596061e94f50e5a82caa8ff07d316893dbb85500e653c7b64e9aab22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T06:58:15.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:14.845+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:15.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:14.845+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:15.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:14.845+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:15.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:14.889+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:15.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:14 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:14.889+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:15.477 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:15 smithi173 podman[72736]: 2024-09-19 06:58:15.292778697 +0000 UTC m=+6.045781662 container cleanup c1caeb40596061e94f50e5a82caa8ff07d316893dbb85500e653c7b64e9aab22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:58:15.477 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:15 smithi173 bash[72736]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5 2024-09-19T06:58:15.478 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:15 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:15.252+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:15.478 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:15 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:15.252+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:15.478 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:15 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:15.252+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:15.795 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:15 smithi173 podman[72752]: 2024-09-19 06:58:15.47717804 +0000 UTC m=+0.595053021 container remove c1caeb40596061e94f50e5a82caa8ff07d316893dbb85500e653c7b64e9aab22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T06:58:15.795 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:15 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:15.535+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:15.796 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:15 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:15.535+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:16.082 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:15 smithi173 podman[72840]: 2024-09-19 06:58:15.697202497 +0000 UTC m=+0.015787683 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:16.082 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:15 smithi173 podman[72840]: 2024-09-19 06:58:15.803019746 +0000 UTC m=+0.121604910 container create 02920fcba0fd0078aea971629382d78c5a336cd292d35d6a86bbbeb309370735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T06:58:16.082 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:16 smithi173 podman[72840]: 2024-09-19 06:58:16.038765285 +0000 UTC m=+0.357350463 container init 02920fcba0fd0078aea971629382d78c5a336cd292d35d6a86bbbeb309370735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T06:58:16.082 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:16 smithi173 podman[72840]: 2024-09-19 06:58:16.042026362 +0000 UTC m=+0.360611525 container start 02920fcba0fd0078aea971629382d78c5a336cd292d35d6a86bbbeb309370735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T06:58:16.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:15 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:15.890+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:16.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:15 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:15.890+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:16.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:15 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:15.890+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:16.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:15 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:15.787+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:16.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:15 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:15.787+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:16.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:15 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:15.787+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.333479+0000 front 2024-09-19T06:57:48.333466+0000 (oldest deadline 2024-09-19T06:58:13.534258+0000) 2024-09-19T06:58:16.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:15 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:15.871+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:16.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:15 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:15.871+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:16.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:15 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:15.846+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:16.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:15 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:15.846+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:16.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:15 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:15.846+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:16.503 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:16 smithi173 podman[72840]: 2024-09-19 06:58:16.122234694 +0000 UTC m=+0.440819892 container attach 02920fcba0fd0078aea971629382d78c5a336cd292d35d6a86bbbeb309370735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T06:58:16.503 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 19 06:58:16 smithi173 podman[72840]: 2024-09-19 06:58:16.228547767 +0000 UTC m=+0.547132944 container died 02920fcba0fd0078aea971629382d78c5a336cd292d35d6a86bbbeb309370735 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T06:58:16.504 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:16 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:16.266+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:16.504 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:16 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:16.266+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:16.504 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:16 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:16.266+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:16.768 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:16 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:16.502+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:16.768 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:16 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:16.502+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:16.789 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T06:58:16.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:16.829 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T06:58:16.829 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T06:58:16.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.6 2024-09-19T06:58:17.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:16.872+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:17.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:16.872+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:17.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:16.872+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:17.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:16.794+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:17.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:16.794+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:17.130 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:16 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:16.794+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.333479+0000 front 2024-09-19T06:57:48.333466+0000 (oldest deadline 2024-09-19T06:58:13.534258+0000) 2024-09-19T06:58:17.130 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:16 smithi012 systemd[1]: Stopping Ceph osd.6 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:58:17.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:16 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:16.835+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:17.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:16 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:16.835+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:17.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:16 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:16.855+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:17.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:16 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:16.855+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:17.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:16 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:16.855+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:17.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:17 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:17.291+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:17.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:17 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:17.291+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:17.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:17 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:17.291+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:17.583 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:17 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:17.528+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:17.583 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:17 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:17.528+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:17.632 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:17.141+0000 7fde91a45640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:17.632 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:17.141+0000 7fde91a45640 -1 osd.6 110 *** Got signal Terminated *** 2024-09-19T06:58:17.632 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:17.141+0000 7fde91a45640 -1 osd.6 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:18.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:17.757+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:18.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:17.757+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:18.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:17.757+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.333479+0000 front 2024-09-19T06:57:48.333466+0000 (oldest deadline 2024-09-19T06:58:13.534258+0000) 2024-09-19T06:58:18.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:17.867+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:18.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:17.867+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:18.130 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:17 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:17.867+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:18.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:17 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:17.859+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:18.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:17 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:17.859+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:18.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:17 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:17.859+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:18.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:17 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:17.813+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:18.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:17 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:17.813+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:18.579 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:18 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:18.278+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:18.579 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:18 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:18.278+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:18.579 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:18 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:18.278+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:18.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:18 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:18.578+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:18.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:18 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:18.578+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:19.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:18 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:18.717+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:19.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:18 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:18.717+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:19.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:18 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:18.717+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.333479+0000 front 2024-09-19T06:57:48.333466+0000 (oldest deadline 2024-09-19T06:58:13.534258+0000) 2024-09-19T06:58:19.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:18 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:18.910+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:19.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:18 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:18.910+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:19.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:18 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:18.910+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:19.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:18 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:18.849+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:19.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:18 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:18.849+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:19.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:18 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:18.853+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:19.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:18 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:18.853+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:19.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:18 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:18.853+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:19.566 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:19 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:19.280+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:19.566 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:19 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:19.280+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:19.566 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:19 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:19.280+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:19.566 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:19 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:19.280+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:19.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:19 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:19.565+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:19.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:19 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:19.565+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:20.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:19.736+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:20.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:19.736+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:20.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:19.736+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.333479+0000 front 2024-09-19T06:57:48.333466+0000 (oldest deadline 2024-09-19T06:58:13.534258+0000) 2024-09-19T06:58:20.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:19.880+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:20.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:19.880+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:20.130 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:19.880+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:20.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:19 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:19.846+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:20.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:19 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:19.846+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:20.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:19 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:19.844+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:20.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:19 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:19.844+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:20.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:19 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:19.844+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:20.569 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:20.266+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:20.569 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:20.266+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:20.569 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:20.266+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:20.569 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:20.266+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:20.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:20.568+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:20.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:20.568+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:20.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:20 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:20.568+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:21.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:20.747+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:21.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:20.747+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:21.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:20.747+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.333479+0000 front 2024-09-19T06:57:48.333466+0000 (oldest deadline 2024-09-19T06:58:13.534258+0000) 2024-09-19T06:58:21.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:20.896+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:21.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:20.896+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:21.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:20.896+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:21.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:20 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:20.896+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:21.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:20 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:20.825+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:21.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:20 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:20.825+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:21.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:20 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:20.825+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:21.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:20 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:20.883+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:21.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:20 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:20.883+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:21.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:20 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:20.883+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:54.874721+0000 front 2024-09-19T06:57:54.874637+0000 (oldest deadline 2024-09-19T06:58:20.174709+0000) 2024-09-19T06:58:21.564 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:21.294+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:21.564 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:21.294+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:21.564 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:21.294+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:21.565 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:21.294+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:21.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:21.563+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:21.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:21.563+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:21.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:21 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:21.563+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:22.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:21 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:21.731+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:32.730053+0000 front 2024-09-19T06:57:32.730068+0000 (oldest deadline 2024-09-19T06:57:55.030214+0000) 2024-09-19T06:58:22.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:21 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:21.731+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:41.932686+0000 front 2024-09-19T06:57:41.932471+0000 (oldest deadline 2024-09-19T06:58:06.632290+0000) 2024-09-19T06:58:22.129 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:21 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6[58597]: 2024-09-19T06:58:21.731+0000 7fde8a042640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.333479+0000 front 2024-09-19T06:57:48.333466+0000 (oldest deadline 2024-09-19T06:58:13.534258+0000) 2024-09-19T06:58:22.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:21 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:21.858+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:22.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:21 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:21.858+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:22.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:21 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:21.858+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:22.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:21 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:21.858+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:22.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:21 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:21.783+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:22.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:21 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:21.783+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:22.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:21 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:21.783+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:22.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:21 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:21.888+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:22.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:21 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:21.888+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:22.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:21 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:21.888+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:54.874721+0000 front 2024-09-19T06:57:54.874637+0000 (oldest deadline 2024-09-19T06:58:20.174709+0000) 2024-09-19T06:58:22.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:22 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:22.286+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:22.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:22 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:22.286+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:22.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:22 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:22.286+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:22.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:22 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:22.286+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:23.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:22 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:22.607+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:23.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:22 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:22.607+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:23.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:22 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:22.607+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:23.092 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:22 smithi012 podman[128316]: 2024-09-19 06:58:22.785962534 +0000 UTC m=+5.748463308 container died 8a2c938ed5b18b1baa2155b6173968a5719b701330019bd827c827792db17bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T06:58:23.093 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:22 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:22.867+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:23.093 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:22 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:22.867+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:23.093 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:22 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:22.867+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:23.093 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:22 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:22.867+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:23.258 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:22.778+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:23.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:22.778+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:23.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:22.778+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:23.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:22.913+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:23.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:22.913+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:23.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:22 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:22.913+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:54.874721+0000 front 2024-09-19T06:57:54.874637+0000 (oldest deadline 2024-09-19T06:58:20.174709+0000) 2024-09-19T06:58:23.378 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:23 smithi012 podman[128316]: 2024-09-19 06:58:23.266942523 +0000 UTC m=+6.229443296 container cleanup 8a2c938ed5b18b1baa2155b6173968a5719b701330019bd827c827792db17bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T06:58:23.379 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:23 smithi012 bash[128316]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6 2024-09-19T06:58:23.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:23.256+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:23.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:23.256+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:23.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:23.256+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:23.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:23.256+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:23.841 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:23 smithi012 podman[128335]: 2024-09-19 06:58:23.518493799 +0000 UTC m=+0.724684686 container remove 8a2c938ed5b18b1baa2155b6173968a5719b701330019bd827c827792db17bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:58:24.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:23.740+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:24.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:23.740+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:24.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:23.740+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:24.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:23.936+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:24.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:23.936+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:24.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:23.936+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:54.874721+0000 front 2024-09-19T06:57:54.874637+0000 (oldest deadline 2024-09-19T06:58:20.174709+0000) 2024-09-19T06:58:24.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:23.598+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:24.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:23.598+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:24.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:23 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:23.598+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:24.122 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:23 smithi012 podman[128423]: 2024-09-19 06:58:23.743423974 +0000 UTC m=+0.016361461 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:24.122 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:23 smithi012 podman[128423]: 2024-09-19 06:58:23.861127961 +0000 UTC m=+0.134065430 container create 6d892b6ad88dfbf44c841a5f39b43a70d806f2980c00d530d3c26b4df708dd10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:24.123 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:23.876+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:24.123 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:23.876+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:24.123 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:23.876+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:24.123 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:23 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:23.876+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:24.379 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:24 smithi012 podman[128423]: 2024-09-19 06:58:24.122338942 +0000 UTC m=+0.395276419 container init 6d892b6ad88dfbf44c841a5f39b43a70d806f2980c00d530d3c26b4df708dd10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T06:58:24.379 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:24 smithi012 podman[128423]: 2024-09-19 06:58:24.12593897 +0000 UTC m=+0.398876437 container start 6d892b6ad88dfbf44c841a5f39b43a70d806f2980c00d530d3c26b4df708dd10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T06:58:24.379 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:24 smithi012 podman[128423]: 2024-09-19 06:58:24.213936046 +0000 UTC m=+0.486873524 container attach 6d892b6ad88dfbf44c841a5f39b43a70d806f2980c00d530d3c26b4df708dd10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:58:24.379 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 19 06:58:24 smithi012 podman[128423]: 2024-09-19 06:58:24.317620908 +0000 UTC m=+0.590558387 container died 6d892b6ad88dfbf44c841a5f39b43a70d806f2980c00d530d3c26b4df708dd10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T06:58:24.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:24.220+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:24.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:24.220+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:24.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:24.220+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:24.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:24.220+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:25.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:24.622+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:25.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:24.622+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:25.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:24 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:24.622+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:25.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:24 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:24.856+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:25.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:24 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:24.856+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:25.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:24 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:24.856+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:25.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:24 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:24.856+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:25.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T06:58:25.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:24 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:24.894+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:25.258 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:24 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:24.894+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:25.259 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:24 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:24.894+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:54.874721+0000 front 2024-09-19T06:57:54.874637+0000 (oldest deadline 2024-09-19T06:58:20.174709+0000) 2024-09-19T06:58:25.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:24 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:24.784+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:25.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:24 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:24.784+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:25.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:24 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:24.784+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:25.259 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:24 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:24.784+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:25.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:25.270 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T06:58:25.270 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T06:58:25.271 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.7 2024-09-19T06:58:25.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:25 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:25.212+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:25.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:25 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:25.212+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:25.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:25 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:25.212+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:25.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:25 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:25.212+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:25.583 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:25 smithi016 systemd[1]: Stopping Ceph osd.7 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:58:25.870 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:25.738+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:25.870 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:25.738+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:25.870 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:25.738+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:25.870 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:25.738+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:25.871 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:25.582+0000 7f0ffb696640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:25.871 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:25.582+0000 7f0ffb696640 -1 osd.7 110 *** Got signal Terminated *** 2024-09-19T06:58:25.871 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:25.582+0000 7f0ffb696640 -1 osd.7 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:25.871 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:25.869+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:25.871 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:25.869+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:25.871 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:25 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:25.869+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:54.874721+0000 front 2024-09-19T06:57:54.874637+0000 (oldest deadline 2024-09-19T06:58:20.174709+0000) 2024-09-19T06:58:26.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:25 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:25.638+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:26.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:25 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:25.638+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:26.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:25 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:25.638+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:26.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:25 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:25.866+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:26.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:25 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:25.866+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:26.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:25 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:25.866+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:26.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:25 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:25.866+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:26.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:26 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:26.163+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:26.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:26 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:26.163+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:26.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:26 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:26.163+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:26.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:26 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:26.163+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:27.008 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:26.843+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:27.008 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:26.843+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:27.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:26.843+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:54.874721+0000 front 2024-09-19T06:57:54.874637+0000 (oldest deadline 2024-09-19T06:58:20.174709+0000) 2024-09-19T06:58:27.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:26.699+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:27.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:26.699+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:27.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:26.699+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:27.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:26 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:26.699+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:27.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:26 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:26.632+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:27.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:26 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:26.632+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:27.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:26 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:26.632+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:27.128 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:26 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:26.868+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:27.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:26 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:26.868+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:27.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:26 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:26.868+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:27.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:26 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:26.868+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:27.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:27 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:27.183+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:27.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:27 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:27.183+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:27.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:27 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:27.183+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:27.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:27 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:27.183+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:28.008 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:27 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:27.884+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:28.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:27 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:27.884+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:28.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:27 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:27.884+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:54.874721+0000 front 2024-09-19T06:57:54.874637+0000 (oldest deadline 2024-09-19T06:58:20.174709+0000) 2024-09-19T06:58:28.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:27 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:27.696+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:28.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:27 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:27.696+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:28.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:27 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:27.696+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:28.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:27 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:27.696+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:28.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:27 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:27.589+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:28.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:27 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:27.589+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:28.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:27 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:27.589+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:28.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:27 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:27.894+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:28.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:27 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:27.894+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:28.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:27 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:27.894+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:28.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:27 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:27.894+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:28.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:28 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:28.169+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:28.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:28 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:28.169+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:28.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:28 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:28.169+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:28.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:28 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:28.169+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:28.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:28 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:28.169+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:29.008 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:28.897+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:29.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:28.897+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:29.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:28.897+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:54.874721+0000 front 2024-09-19T06:57:54.874637+0000 (oldest deadline 2024-09-19T06:58:20.174709+0000) 2024-09-19T06:58:29.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:28.897+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.475734+0000 front 2024-09-19T06:58:05.475668+0000 (oldest deadline 2024-09-19T06:58:28.375800+0000) 2024-09-19T06:58:29.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:28.668+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:29.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:28.668+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:29.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:28.668+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:29.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:28.668+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:29.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:28 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:28.668+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:29.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:28 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:28.613+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:29.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:28 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:28.613+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:29.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:28 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:28.613+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:29.378 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:28.881+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:29.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:28.881+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:29.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:28.881+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:29.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:28 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:28.881+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:29.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:29 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:29.143+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:29.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:29 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:29.143+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:29.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:29 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:29.143+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:29.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:29 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:29.143+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:29.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:29 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:29.143+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:30.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:29 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:29.858+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.672410+0000 front 2024-09-19T06:57:39.672443+0000 (oldest deadline 2024-09-19T06:58:04.372570+0000) 2024-09-19T06:58:30.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:29 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:29.858+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:46.673503+0000 front 2024-09-19T06:57:46.673529+0000 (oldest deadline 2024-09-19T06:58:11.973555+0000) 2024-09-19T06:58:30.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:29 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:29.858+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:54.874721+0000 front 2024-09-19T06:57:54.874637+0000 (oldest deadline 2024-09-19T06:58:20.174709+0000) 2024-09-19T06:58:30.009 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:29 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7[52448]: 2024-09-19T06:58:29.858+0000 7f0ff7c9b640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.475734+0000 front 2024-09-19T06:58:05.475668+0000 (oldest deadline 2024-09-19T06:58:28.375800+0000) 2024-09-19T06:58:30.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:29 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:29.659+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:30.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:29 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:29.659+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:30.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:29 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:29.659+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:30.010 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:29 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:29.659+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:30.010 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:29 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:29.659+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:30.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:29 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:29.654+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:30.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:29 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:29.654+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:30.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:29 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:29.654+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:30.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:29 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:29.912+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:30.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:29 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:29.912+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:30.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:29 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:29.912+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:30.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:29 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:29.912+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:30.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:29 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:29.912+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:30.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:30 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:30.114+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:30.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:30 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:30.114+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:30.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:30 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:30.114+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:30.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:30 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:30.114+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:30.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:30 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:30.114+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:31.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:30 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:30.667+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:31.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:30 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:30.667+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:31.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:30 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:30.667+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:31.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:30 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:30.667+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:31.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:30 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:30.667+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:31.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:30 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:30.645+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:31.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:30 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:30.645+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:31.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:30 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:30.645+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:31.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:30 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:30.645+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.289755+0000 front 2024-09-19T06:58:05.289938+0000 (oldest deadline 2024-09-19T06:58:30.589753+0000) 2024-09-19T06:58:31.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:30 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:30.870+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:31.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:30 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:30.870+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:31.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:30 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:30.870+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:31.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:30 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:30.870+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:31.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:30 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:30.870+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:31.450 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:31 smithi016 podman[71688]: 2024-09-19 06:58:31.146884963 +0000 UTC m=+5.675954327 container died c4d3e7e84046646579c7efb21055eef551964e1a87c3a995efbfb436b9fa969e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T06:58:31.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:31 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:31.105+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:31.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:31 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:31.105+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:31.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:31 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:31.105+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:31.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:31 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:31.105+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:31.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:31 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:31.105+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:31.715 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:31 smithi016 podman[71688]: 2024-09-19 06:58:31.557801833 +0000 UTC m=+6.086871196 container cleanup c4d3e7e84046646579c7efb21055eef551964e1a87c3a995efbfb436b9fa969e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T06:58:31.715 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:31 smithi016 bash[71688]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7 2024-09-19T06:58:32.008 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:31 smithi016 podman[71703]: 2024-09-19 06:58:31.750810979 +0000 UTC m=+0.593808167 container remove c4d3e7e84046646579c7efb21055eef551964e1a87c3a995efbfb436b9fa969e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:58:32.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:31 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:31.714+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:32.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:31 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:31.714+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:32.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:31 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:31.714+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:32.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:31 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:31.714+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:32.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:31 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:31.714+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:32.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:31 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:31.643+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:32.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:31 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:31.643+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:32.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:31 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:31.643+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:32.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:31 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:31.643+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.289755+0000 front 2024-09-19T06:58:05.289938+0000 (oldest deadline 2024-09-19T06:58:30.589753+0000) 2024-09-19T06:58:32.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:31 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:31.857+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:32.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:31 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:31.857+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:32.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:31 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:31.857+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:32.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:31 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:31.857+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:32.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:31 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:31.857+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:32.396 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:32 smithi016 podman[71791]: 2024-09-19 06:58:31.980522425 +0000 UTC m=+0.015906741 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:32.396 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:32 smithi016 podman[71791]: 2024-09-19 06:58:32.110248472 +0000 UTC m=+0.145632839 container create e9e130d79ce76548e12c3a0827fa61d417898a80a4f29feb4dad5ac09b961970 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:58:32.396 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:32 smithi016 podman[71791]: 2024-09-19 06:58:32.320926908 +0000 UTC m=+0.356311235 container init e9e130d79ce76548e12c3a0827fa61d417898a80a4f29feb4dad5ac09b961970 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:32.396 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:32 smithi016 podman[71791]: 2024-09-19 06:58:32.324179074 +0000 UTC m=+0.359563395 container start e9e130d79ce76548e12c3a0827fa61d417898a80a4f29feb4dad5ac09b961970 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T06:58:32.396 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:32 smithi016 podman[71791]: 2024-09-19 06:58:32.395679702 +0000 UTC m=+0.431064030 container attach e9e130d79ce76548e12c3a0827fa61d417898a80a4f29feb4dad5ac09b961970 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:58:32.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:32 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:32.138+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:32.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:32 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:32.138+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:32.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:32 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:32.138+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:32.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:32 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:32.138+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:32.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:32 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:32.138+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:32.699 INFO:journalctl@ceph.osd.7.smithi016.stdout:Sep 19 06:58:32 smithi016 podman[71791]: 2024-09-19 06:58:32.517753008 +0000 UTC m=+0.553137324 container died e9e130d79ce76548e12c3a0827fa61d417898a80a4f29feb4dad5ac09b961970 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T06:58:32.699 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:32 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:32.698+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:32.699 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:32 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:32.698+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:32.700 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:32 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:32.698+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:32.700 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:32 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:32.698+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:32.700 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:32 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:32.698+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:33.073 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T06:58:33.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:32 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:32.627+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:33.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:32 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:32.627+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:33.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:32 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:32.627+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:33.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:32 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:32.627+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.289755+0000 front 2024-09-19T06:58:05.289938+0000 (oldest deadline 2024-09-19T06:58:30.589753+0000) 2024-09-19T06:58:33.115 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:33.115 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T06:58:33.115 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T06:58:33.115 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.8 2024-09-19T06:58:33.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:32 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:32.876+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:33.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:32 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:32.876+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:33.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:32 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:32.876+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:33.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:32 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:32.876+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:33.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:32 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:32.876+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:33.396 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:33 smithi173 systemd[1]: Stopping Ceph osd.8 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:58:33.396 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:33.140+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:33.396 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:33.140+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:33.396 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:33.140+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:33.396 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:33.140+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:33.397 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:33.140+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:33.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:33.395+0000 7fb413b42640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:33.832 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:33.395+0000 7fb413b42640 -1 osd.8 110 *** Got signal Terminated *** 2024-09-19T06:58:33.833 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:33.395+0000 7fb413b42640 -1 osd.8 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:33.833 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:33.629+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:33.833 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:33.629+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:33.833 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:33.629+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:33.833 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:33 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:33.629+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.289755+0000 front 2024-09-19T06:58:05.289938+0000 (oldest deadline 2024-09-19T06:58:30.589753+0000) 2024-09-19T06:58:34.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:33 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:33.666+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:34.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:33 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:33.666+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:34.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:33 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:33.666+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:34.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:33 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:33.666+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:34.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:33 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:33.666+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:34.378 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:33 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:33.897+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:34.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:33 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:33.897+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:34.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:33 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:33.897+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:34.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:33 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:33.897+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:34.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:33 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:33.897+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:34.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:34 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:34.156+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:34.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:34 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:34.156+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:34.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:34 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:34.156+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:34.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:34 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:34.156+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:34.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:34 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:34.156+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:35.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:34 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:34.665+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:35.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:34 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:34.665+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:35.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:34 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:34.665+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:35.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:34 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:34.665+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:35.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:34 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:34.665+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:35.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:34 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:34.659+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:35.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:34 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:34.660+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:35.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:34 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:34.660+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:35.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:34 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:34.660+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.289755+0000 front 2024-09-19T06:58:05.289938+0000 (oldest deadline 2024-09-19T06:58:30.589753+0000) 2024-09-19T06:58:35.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:34 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:34.895+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:35.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:34 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:34.895+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:35.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:34 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:34.895+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:35.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:34 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:34.895+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:35.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:34 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:34.895+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:35.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:35 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:35.107+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:35.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:35 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:35.107+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:35.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:35 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:35.107+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:35.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:35 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:35.107+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:35.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:35 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:35.107+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:36.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:35 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:35.687+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:36.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:35 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:35.687+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:36.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:35 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:35.687+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:36.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:35 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:35.687+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:36.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:35 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:35.687+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:36.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:35 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:35.652+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:36.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:35 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:35.652+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:36.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:35 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:35.652+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:36.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:35 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:35.652+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.289755+0000 front 2024-09-19T06:58:05.289938+0000 (oldest deadline 2024-09-19T06:58:30.589753+0000) 2024-09-19T06:58:36.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:35 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:35.854+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:36.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:35 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:35.854+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:36.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:35 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:35.854+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:36.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:35 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:35.854+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:36.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:35 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:35.854+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:36.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:36 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:36.133+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:36.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:36 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:36.133+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:36.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:36 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:36.133+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:36.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:36 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:36.133+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:36.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:36 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:36.133+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:37.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:36 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:36.645+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:37.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:36 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:36.645+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:37.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:36 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:36.645+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:37.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:36 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:36.645+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:37.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:36 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:36.645+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:37.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:36 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:36.645+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:37.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:36 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:36.609+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:37.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:36 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:36.609+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:37.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:36 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:36.609+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:37.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:36 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:36.609+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.289755+0000 front 2024-09-19T06:58:05.289938+0000 (oldest deadline 2024-09-19T06:58:30.589753+0000) 2024-09-19T06:58:37.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:36 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:36.818+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:37.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:36 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:36.818+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:37.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:36 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:36.818+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:37.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:36 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:36.818+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:37.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:36 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:36.818+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:37.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:37.126+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:37.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:37.126+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:37.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:37.126+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:37.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:37.126+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:37.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:37.126+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:37.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:37.126+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:38.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:37 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:37.660+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:38.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:37 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:37.660+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:38.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:37 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:37.660+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:38.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:37 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:37.660+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:38.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:37 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:37.660+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:38.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:37 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:37.660+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:38.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:37.613+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.284828+0000 front 2024-09-19T06:57:39.284967+0000 (oldest deadline 2024-09-19T06:58:03.384997+0000) 2024-09-19T06:58:38.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:37.613+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.186433+0000 front 2024-09-19T06:57:49.186478+0000 (oldest deadline 2024-09-19T06:58:11.486559+0000) 2024-09-19T06:58:38.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:37.613+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.287852+0000 front 2024-09-19T06:57:57.287653+0000 (oldest deadline 2024-09-19T06:58:19.587724+0000) 2024-09-19T06:58:38.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:37.613+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.289755+0000 front 2024-09-19T06:58:05.289938+0000 (oldest deadline 2024-09-19T06:58:30.589753+0000) 2024-09-19T06:58:38.083 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:37 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8[53768]: 2024-09-19T06:58:37.613+0000 7fb410147640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:10.590267+0000 front 2024-09-19T06:58:10.590306+0000 (oldest deadline 2024-09-19T06:58:37.590859+0000) 2024-09-19T06:58:38.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:37 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:37.863+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:38.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:37 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:37.863+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:38.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:37 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:37.863+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:38.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:37 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:37.863+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:38.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:37 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:37.863+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:38.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:37 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:37.863+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:12.741577+0000 front 2024-09-19T06:58:12.741510+0000 (oldest deadline 2024-09-19T06:58:37.441480+0000) 2024-09-19T06:58:38.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:38 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:38.119+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:38.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:38 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:38.119+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:38.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:38 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:38.119+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:38.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:38 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:38.119+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:38.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:38 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:38.119+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:38.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:38 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:38.119+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:39.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:38 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:38.670+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:39.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:38 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:38.670+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:39.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:38 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:38.670+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:39.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:38 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:38.670+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:39.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:38 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:38.670+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:39.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:38 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:38.670+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:39.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:38 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:38.838+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:39.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:38 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:38.838+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:39.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:38 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:38.838+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:39.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:38 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:38.838+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:39.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:38 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:38.838+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:39.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:38 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:38.838+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:12.741577+0000 front 2024-09-19T06:58:12.741510+0000 (oldest deadline 2024-09-19T06:58:37.441480+0000) 2024-09-19T06:58:39.295 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:38 smithi173 podman[72955]: 2024-09-19 06:58:38.976393755 +0000 UTC m=+5.672345954 container died 38469e1dc77961bbbe305b98b4b85a24f08d8dda210bfe166ce72764151d6440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T06:58:39.295 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:39 smithi173 podman[72955]: 2024-09-19 06:58:39.294938263 +0000 UTC m=+5.990890461 container cleanup 38469e1dc77961bbbe305b98b4b85a24f08d8dda210bfe166ce72764151d6440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T06:58:39.295 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:39 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:39.164+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:39.296 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:39 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:39.164+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:39.296 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:39 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:39.164+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:39.296 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:39 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:39.164+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:39.296 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:39 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:39.164+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:39.296 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:39 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:39.164+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:39.582 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:39 smithi173 bash[72955]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8 2024-09-19T06:58:39.582 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:39 smithi173 podman[72970]: 2024-09-19 06:58:39.479611451 +0000 UTC m=+0.495902969 container remove 38469e1dc77961bbbe305b98b4b85a24f08d8dda210bfe166ce72764151d6440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:40.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:39 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:39.629+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:40.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:39 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:39.629+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:40.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:39 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:39.629+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:40.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:39 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:39.629+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:40.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:39 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:39.629+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:40.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:39 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:39.629+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:40.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:39 smithi173 podman[73059]: 2024-09-19 06:58:39.797360411 +0000 UTC m=+0.111932719 container create 70585a0609d896f592b6b0fa41d4a1630fde27faf997efdbf729430694a0381a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T06:58:40.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:39 smithi173 podman[73059]: 2024-09-19 06:58:39.700952739 +0000 UTC m=+0.015525062 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:40.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:40 smithi173 podman[73059]: 2024-09-19 06:58:40.025004954 +0000 UTC m=+0.339577270 container init 70585a0609d896f592b6b0fa41d4a1630fde27faf997efdbf729430694a0381a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:58:40.082 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:40 smithi173 podman[73059]: 2024-09-19 06:58:40.02868417 +0000 UTC m=+0.343256481 container start 70585a0609d896f592b6b0fa41d4a1630fde27faf997efdbf729430694a0381a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T06:58:40.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:39 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:39.843+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:40.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:39 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:39.843+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:40.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:39 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:39.843+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:40.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:39 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:39.843+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:40.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:39 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:39.843+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:40.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:39 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:39.843+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:12.741577+0000 front 2024-09-19T06:58:12.741510+0000 (oldest deadline 2024-09-19T06:58:37.441480+0000) 2024-09-19T06:58:40.582 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:40 smithi173 podman[73059]: 2024-09-19 06:58:40.108032069 +0000 UTC m=+0.422604377 container attach 70585a0609d896f592b6b0fa41d4a1630fde27faf997efdbf729430694a0381a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T06:58:40.582 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:40 smithi173 podman[73059]: 2024-09-19 06:58:40.218064253 +0000 UTC m=+0.532636572 container died 70585a0609d896f592b6b0fa41d4a1630fde27faf997efdbf729430694a0381a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:58:40.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:40 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:40.166+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:40.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:40 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:40.166+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:40.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:40 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:40.166+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:40.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:40 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:40.166+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:40.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:40 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:40.166+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:40.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:40 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:40.166+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:40.908 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 19 06:58:40 smithi173 podman[73082]: 2024-09-19 06:58:40.886636539 +0000 UTC m=+0.662850841 container remove 70585a0609d896f592b6b0fa41d4a1630fde27faf997efdbf729430694a0381a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T06:58:40.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T06:58:40.952 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:40.952 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T06:58:40.952 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T06:58:40.952 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.9 2024-09-19T06:58:41.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:40 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:40.676+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:41.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:40 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:40.676+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:41.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:40 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:40.676+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:41.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:40 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:40.676+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:41.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:40 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:40.676+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:41.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:40 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:40.676+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:41.265 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:40 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:40.883+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:41.266 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:40 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:40.883+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:41.266 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:40 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:40.883+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:41.266 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:40 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:40.883+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:41.266 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:40 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:40.883+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:41.266 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:40 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:40.883+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:12.741577+0000 front 2024-09-19T06:58:12.741510+0000 (oldest deadline 2024-09-19T06:58:37.441480+0000) 2024-09-19T06:58:41.266 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:41 smithi012 systemd[1]: Stopping Ceph osd.9 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:58:41.266 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:41.260+0000 7f22745b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:41.266 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:41.260+0000 7f22745b0640 -1 osd.9 110 *** Got signal Terminated *** 2024-09-19T06:58:41.266 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:41.260+0000 7f22745b0640 -1 osd.9 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:41.332 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:41 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:41.149+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:41.332 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:41 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:41.149+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:41.332 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:41 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:41.149+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:41.332 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:41 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:41.149+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:41.333 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:41 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:41.149+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:41.333 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:41 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:41.149+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:42.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:41 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:41.635+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:42.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:41 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:41.635+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:42.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:41 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:41.635+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:42.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:41 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:41.635+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:42.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:41 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:41.635+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:42.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:41 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:41.635+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:42.261 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:42 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:42.132+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:42.261 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:42 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:42.132+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:42.262 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:42 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:42.132+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:42.262 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:42 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:42.132+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:42.262 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:42 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:42.132+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:42.262 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:42 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:42.132+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:42.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:41.890+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:42.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:41.890+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:42.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:41.890+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:42.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:41.890+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:42.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:41.890+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:42.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:41 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:41.890+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:12.741577+0000 front 2024-09-19T06:58:12.741510+0000 (oldest deadline 2024-09-19T06:58:37.441480+0000) 2024-09-19T06:58:43.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:42 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:42.619+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:43.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:42 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:42.619+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:43.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:42 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:42.619+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:43.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:42 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:42.619+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:43.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:42 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:42.619+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:43.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:42 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:42.619+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:43.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:42.877+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:43.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:42.877+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:43.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:42.877+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:43.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:42.877+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:43.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:42.877+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:43.130 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:42 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:42.877+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:12.741577+0000 front 2024-09-19T06:58:12.741510+0000 (oldest deadline 2024-09-19T06:58:37.441480+0000) 2024-09-19T06:58:43.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:43 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:43.155+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:43.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:43 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:43.155+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:43.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:43 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:43.155+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:43.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:43 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:43.155+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:43.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:43 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:43.155+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:43.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:43 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:43.155+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:44.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:43 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:43.612+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:44.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:43 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:43.612+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:44.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:43 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:43.612+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:44.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:43 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:43.612+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:44.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:43 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:43.612+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:44.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:43 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:43.612+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:44.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:43 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:43.923+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:44.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:43 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:43.923+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:44.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:43 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:43.923+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:44.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:43 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:43.923+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:44.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:43 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:43.923+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:44.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:43 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:43.923+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:12.741577+0000 front 2024-09-19T06:58:12.741510+0000 (oldest deadline 2024-09-19T06:58:37.441480+0000) 2024-09-19T06:58:44.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:44 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:44.180+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:44.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:44 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:44.180+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:44.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:44 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:44.180+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:44.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:44 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:44.180+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:44.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:44 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:44.180+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:44.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:44 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:44.180+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:44.759 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:44 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:44.592+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:44.759 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:44 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:44.592+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:44.759 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:44 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:44.592+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:44.759 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:44 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:44.592+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:44.759 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:44 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:44.592+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:44.759 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:44 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:44.592+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:44.759 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:44 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:44.592+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:45.378 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:44 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:44.879+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:45.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:44 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:44.879+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:45.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:44 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:44.879+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:45.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:44 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:44.879+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:45.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:44 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:44.879+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:45.379 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:44 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:44.879+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:12.741577+0000 front 2024-09-19T06:58:12.741510+0000 (oldest deadline 2024-09-19T06:58:37.441480+0000) 2024-09-19T06:58:45.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:45 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:45.211+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:45.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:45 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:45.211+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:45.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:45 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:45.211+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:45.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:45 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:45.211+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:45.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:45 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:45.211+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:45.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:45 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:45.211+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:46.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:45 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:45.614+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:46.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:45 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:45.614+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:46.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:45 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:45.614+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:46.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:45 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:45.614+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:46.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:45 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:45.614+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:46.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:45 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:45.614+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:46.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:45 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:45.614+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:46.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:45.869+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.535675+0000 front 2024-09-19T06:57:33.535632+0000 (oldest deadline 2024-09-19T06:57:57.035892+0000) 2024-09-19T06:58:46.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:45.869+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:37.036684+0000 front 2024-09-19T06:57:37.036764+0000 (oldest deadline 2024-09-19T06:58:08.237266+0000) 2024-09-19T06:58:46.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:45.869+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:48.238038+0000 front 2024-09-19T06:57:48.237913+0000 (oldest deadline 2024-09-19T06:58:14.137903+0000) 2024-09-19T06:58:46.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:45.869+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:57.038565+0000 front 2024-09-19T06:57:57.038596+0000 (oldest deadline 2024-09-19T06:58:20.538881+0000) 2024-09-19T06:58:46.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:45.869+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.140676+0000 front 2024-09-19T06:58:05.140790+0000 (oldest deadline 2024-09-19T06:58:29.240621+0000) 2024-09-19T06:58:46.129 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:45 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9[65353]: 2024-09-19T06:58:45.869+0000 7f2270bb5640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:12.741577+0000 front 2024-09-19T06:58:12.741510+0000 (oldest deadline 2024-09-19T06:58:37.441480+0000) 2024-09-19T06:58:46.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:46 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:46.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:46.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:46 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:46.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:46.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:46 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:46.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:46.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:46 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:46.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:46.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:46 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:46.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:46.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:46 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:46.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:47.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:46 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:46.615+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:47.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:46 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:46.615+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:47.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:46 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:46.615+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:47.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:46 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:46.615+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:47.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:46 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:46.615+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:47.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:46 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:46.615+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:47.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:46 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:46.615+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:47.327 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:46 smithi012 podman[128537]: 2024-09-19 06:58:46.911909158 +0000 UTC m=+5.752433141 container died 0eef60692fe7a1f5cc6c6cfb78b4c53b8e972e7b8bfe065e89ee461406597ec9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:58:47.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:47 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:47.213+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:47.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:47 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:47.213+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:47.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:47 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:47.213+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:47.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:47 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:47.213+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:47.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:47 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:47.213+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:47.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:47 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:47.213+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:47.628 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:47 smithi012 podman[128537]: 2024-09-19 06:58:47.510059386 +0000 UTC m=+6.350583411 container cleanup 0eef60692fe7a1f5cc6c6cfb78b4c53b8e972e7b8bfe065e89ee461406597ec9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T06:58:47.629 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:47 smithi012 bash[128537]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9 2024-09-19T06:58:48.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:47 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:47.580+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:48.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:47 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:47.580+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:48.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:47 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:47.580+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:48.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:47 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:47.580+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:48.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:47 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:47.580+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:48.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:47 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:47.580+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:48.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:47 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:47.580+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:48.063 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:47 smithi012 podman[128555]: 2024-09-19 06:58:47.719732171 +0000 UTC m=+0.799005912 container remove 0eef60692fe7a1f5cc6c6cfb78b4c53b8e972e7b8bfe065e89ee461406597ec9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T06:58:48.315 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:48 smithi012 podman[128645]: 2024-09-19 06:58:47.965686921 +0000 UTC m=+0.016046926 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:48.315 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:48 smithi012 podman[128645]: 2024-09-19 06:58:48.087041018 +0000 UTC m=+0.137401003 container create bbaf9f6367b33cbdab90b8ed1454c1ada8ee4cd2e8c6453be6f838cdfa601a3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T06:58:48.315 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:48 smithi012 podman[128645]: 2024-09-19 06:58:48.314896681 +0000 UTC m=+0.365256681 container init bbaf9f6367b33cbdab90b8ed1454c1ada8ee4cd2e8c6453be6f838cdfa601a3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T06:58:48.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:48 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:48.224+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:48.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:48 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:48.224+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:48.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:48 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:48.224+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:48.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:48 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:48.224+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:48.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:48 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:48.224+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:48.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:48 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:48.224+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:48.629 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:48 smithi012 podman[128645]: 2024-09-19 06:58:48.318484657 +0000 UTC m=+0.368844643 container start bbaf9f6367b33cbdab90b8ed1454c1ada8ee4cd2e8c6453be6f838cdfa601a3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T06:58:48.629 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:48 smithi012 podman[128645]: 2024-09-19 06:58:48.406415533 +0000 UTC m=+0.456775540 container attach bbaf9f6367b33cbdab90b8ed1454c1ada8ee4cd2e8c6453be6f838cdfa601a3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9-deactivate, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:58:48.629 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 19 06:58:48 smithi012 podman[128645]: 2024-09-19 06:58:48.517342927 +0000 UTC m=+0.567702931 container died bbaf9f6367b33cbdab90b8ed1454c1ada8ee4cd2e8c6453be6f838cdfa601a3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:58:49.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:48 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:48.601+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:49.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:48 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:48.601+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:49.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:48 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:48.601+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:49.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:48 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:48.601+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:49.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:48 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:48.601+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:49.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:48 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:48.601+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:49.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:48 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:48.601+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:49.185 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T06:58:49.232 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:49.232 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T06:58:49.232 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T06:58:49.232 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.10 2024-09-19T06:58:49.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:49 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:49.234+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:49.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:49 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:49.234+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:49.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:49 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:49.234+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:49.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:49 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:49.234+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:49.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:49 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:49.234+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:49.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:49 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:49.234+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:49.594 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 systemd[1]: Stopping Ceph osd.10 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:58:49.594 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:49.593+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:50.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:49.593+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:50.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:49.593+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:50.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:49.593+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:50.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:49.593+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:50.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:49.593+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:50.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:49.593+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:50.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:49.662+0000 7fb209148640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:50.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:49.662+0000 7fb209148640 -1 osd.10 110 *** Got signal Terminated *** 2024-09-19T06:58:50.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:49 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:49.662+0000 7fb209148640 -1 osd.10 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:50.484 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:50 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:50.216+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:50.484 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:50 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:50.216+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:50.484 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:50 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:50.216+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:50.484 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:50 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:50.216+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:50.484 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:50 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:50.216+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:50.484 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:50 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:50.216+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:51.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:50 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:50.632+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:51.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:50 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:50.632+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:51.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:50 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:50.632+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:51.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:50 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:50.632+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:51.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:50 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:50.632+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:51.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:50 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:50.632+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:51.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:50 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:50.632+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:51.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:51 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:51.222+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:51.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:51 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:51.222+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:51.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:51 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:51.222+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:51.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:51 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:51.222+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:51.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:51 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:51.222+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:51.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:51 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:51.222+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:52.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:51 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:51.638+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:52.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:51 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:51.638+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:52.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:51 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:51.638+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:52.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:51 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:51.638+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:52.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:51 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:51.638+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:52.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:51 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:51.638+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:52.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:51 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:51.638+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:52.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:52 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:52.177+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:52.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:52 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:52.177+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:52.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:52 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:52.177+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:52.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:52 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:52.177+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:52.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:52 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:52.177+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:52.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:52 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:52.177+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:52.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:52 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:52.177+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:58:53.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:52 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:52.671+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:53.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:52 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:52.671+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:53.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:52 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:52.671+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:53.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:52 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:52.671+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:53.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:52 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:52.671+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:53.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:52 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:52.671+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:53.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:52 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:52.671+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:53.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:53 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:53.204+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:53.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:53 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:53.204+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:53.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:53 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:53.204+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:53.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:53 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:53.204+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:53.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:53 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:53.204+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:53.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:53 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:53.204+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:53.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:53 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:53.204+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:58:54.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:53 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:53.663+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:54.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:53 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:53.663+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:54.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:53 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:53.663+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:54.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:53 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:53.663+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:54.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:53 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:53.663+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:54.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:53 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:53.663+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:54.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:53 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:53.663+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:54.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:54 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:54.203+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:54.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:54 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:54.203+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:54.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:54 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:54.203+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:54.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:54 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:54.203+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:54.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:54 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:54.203+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:54.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:54 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:54.203+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:54.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:54 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:54.203+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:58:55.008 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:54 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:54.654+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:30.389157+0000 front 2024-09-19T06:57:30.389252+0000 (oldest deadline 2024-09-19T06:57:55.689210+0000) 2024-09-19T06:58:55.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:54 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:54.654+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:40.989995+0000 front 2024-09-19T06:57:40.990154+0000 (oldest deadline 2024-09-19T06:58:04.490168+0000) 2024-09-19T06:58:55.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:54 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:54.654+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:47.991412+0000 front 2024-09-19T06:57:47.991194+0000 (oldest deadline 2024-09-19T06:58:10.891182+0000) 2024-09-19T06:58:55.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:54 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:54.654+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:56.692892+0000 front 2024-09-19T06:57:56.692799+0000 (oldest deadline 2024-09-19T06:58:24.293122+0000) 2024-09-19T06:58:55.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:54 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:54.654+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:04.293423+0000 front 2024-09-19T06:58:04.293445+0000 (oldest deadline 2024-09-19T06:58:27.793577+0000) 2024-09-19T06:58:55.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:54 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:54.654+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:13.694484+0000 front 2024-09-19T06:58:13.694521+0000 (oldest deadline 2024-09-19T06:58:36.594514+0000) 2024-09-19T06:58:55.009 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:54 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10[59043]: 2024-09-19T06:58:54.654+0000 7fb201745640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-19T06:58:19.396287+0000 front 2024-09-19T06:58:19.396235+0000 (oldest deadline 2024-09-19T06:58:43.996396+0000) 2024-09-19T06:58:55.436 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:55 smithi016 podman[71917]: 2024-09-19 06:58:55.136471623 +0000 UTC m=+5.697890383 container died fe150c5f8eb1c07ed074a7d3d28d94219cc290e1959533e6f36be0226c8194b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T06:58:55.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:55 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:55.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:55.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:55 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:55.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:55.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:55 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:55.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:55.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:55 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:55.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:55.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:55 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:55.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:55.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:55 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:55.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:55.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:55 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:55.198+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:58:55.758 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:55 smithi016 podman[71917]: 2024-09-19 06:58:55.643590349 +0000 UTC m=+6.205009104 container cleanup fe150c5f8eb1c07ed074a7d3d28d94219cc290e1959533e6f36be0226c8194b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T06:58:55.758 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:55 smithi016 bash[71917]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10 2024-09-19T06:58:56.193 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:55 smithi016 podman[71934]: 2024-09-19 06:58:55.845199717 +0000 UTC m=+0.704441760 container remove fe150c5f8eb1c07ed074a7d3d28d94219cc290e1959533e6f36be0226c8194b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T06:58:56.462 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:56 smithi016 podman[72018]: 2024-09-19 06:58:56.096548833 +0000 UTC m=+0.017198931 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:58:56.462 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:56 smithi016 podman[72018]: 2024-09-19 06:58:56.19591355 +0000 UTC m=+0.116563637 container create 22eba65ebd950ba67dbce391cb4926ff7d2c8051633fe859bf8e505c59375f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T06:58:56.462 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:56 smithi016 podman[72018]: 2024-09-19 06:58:56.373054296 +0000 UTC m=+0.293704384 container init 22eba65ebd950ba67dbce391cb4926ff7d2c8051633fe859bf8e505c59375f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T06:58:56.462 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:56 smithi016 podman[72018]: 2024-09-19 06:58:56.376341614 +0000 UTC m=+0.296991702 container start 22eba65ebd950ba67dbce391cb4926ff7d2c8051633fe859bf8e505c59375f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:58:56.462 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:56 smithi016 podman[72018]: 2024-09-19 06:58:56.461536185 +0000 UTC m=+0.382186294 container attach 22eba65ebd950ba67dbce391cb4926ff7d2c8051633fe859bf8e505c59375f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T06:58:56.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:56 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:56.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:56.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:56 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:56.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:56.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:56 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:56.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:56.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:56 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:56.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:56.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:56 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:56.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:56.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:56 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:56.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:56.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:56 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:56.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:58:56.758 INFO:journalctl@ceph.osd.10.smithi016.stdout:Sep 19 06:58:56 smithi016 podman[72018]: 2024-09-19 06:58:56.571624134 +0000 UTC m=+0.492274222 container died 22eba65ebd950ba67dbce391cb4926ff7d2c8051633fe859bf8e505c59375f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T06:58:57.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T06:58:57.437 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:58:57.438 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T06:58:57.438 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T06:58:57.438 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.11 2024-09-19T06:58:57.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:57.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:57.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:57.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:57.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:57.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:57.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:57.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:57.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:57.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:57.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:57.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:57.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:57.244+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:58:57.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 systemd[1]: Stopping Ceph osd.11 for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:58:58.082 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:57.721+0000 7f0aef2c3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:58.082 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:57.721+0000 7f0aef2c3640 -1 osd.11 110 *** Got signal Terminated *** 2024-09-19T06:58:58.082 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:57 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:57.721+0000 7f0aef2c3640 -1 osd.11 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:58:58.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:58 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:58.221+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:58.609 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:58 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:58.221+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:58.609 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:58 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:58.221+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:58.609 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:58 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:58.221+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:58.609 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:58 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:58.221+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:58.609 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:58 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:58.221+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:58.609 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:58 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:58.221+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:58:59.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:59 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:59.231+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:58:59.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:59 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:59.231+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:58:59.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:59 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:59.231+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:58:59.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:59 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:59.231+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:58:59.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:59 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:59.231+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:58:59.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:59 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:59.231+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:58:59.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:58:59 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:58:59.231+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:59:00.541 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:00 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:00.196+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:59:00.541 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:00 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:00.196+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:59:00.541 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:00 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:00.196+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:59:00.541 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:00 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:00.196+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:59:00.541 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:00 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:00.196+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:59:00.541 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:00 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:00.196+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:59:00.541 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:00 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:00.196+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:59:01.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:01 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:01.208+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:59:01.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:01 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:01.208+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:59:01.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:01 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:01.208+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:59:01.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:01 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:01.208+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:59:01.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:01 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:01.208+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:59:01.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:01 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:01.208+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:59:01.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:01 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:01.208+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:59:02.582 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:02.236+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-19T06:57:33.451934+0000 front 2024-09-19T06:57:33.451884+0000 (oldest deadline 2024-09-19T06:57:58.152073+0000) 2024-09-19T06:59:02.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:02.236+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6804 osd.1 since back 2024-09-19T06:57:39.253130+0000 front 2024-09-19T06:57:39.253184+0000 (oldest deadline 2024-09-19T06:58:04.552979+0000) 2024-09-19T06:59:02.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:02.236+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-19T06:57:49.555479+0000 front 2024-09-19T06:57:49.555446+0000 (oldest deadline 2024-09-19T06:58:13.055434+0000) 2024-09-19T06:59:02.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:02.236+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-19T06:57:53.055994+0000 front 2024-09-19T06:57:53.055976+0000 (oldest deadline 2024-09-19T06:58:18.956014+0000) 2024-09-19T06:59:02.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:02.236+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6812 osd.4 since back 2024-09-19T06:58:05.158761+0000 front 2024-09-19T06:58:05.158668+0000 (oldest deadline 2024-09-19T06:58:27.458488+0000) 2024-09-19T06:59:02.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:02.236+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-19T06:58:11.559519+0000 front 2024-09-19T06:58:11.559447+0000 (oldest deadline 2024-09-19T06:58:36.259567+0000) 2024-09-19T06:59:02.583 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:02 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11[60694]: 2024-09-19T06:59:02.236+0000 7f0aeb8c8640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.16:6820 osd.7 since back 2024-09-19T06:58:30.062938+0000 front 2024-09-19T06:58:30.062885+0000 (oldest deadline 2024-09-19T06:58:51.762861+0000) 2024-09-19T06:59:03.648 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:03 smithi173 podman[73174]: 2024-09-19 06:59:03.371239952 +0000 UTC m=+5.736882093 container died 1c38c3442a214bf7fc6251d6952dc887bde8983f00929e28488ca75f2355684b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T06:59:03.991 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:03 smithi173 podman[73174]: 2024-09-19 06:59:03.730355517 +0000 UTC m=+6.095997701 container cleanup 1c38c3442a214bf7fc6251d6952dc887bde8983f00929e28488ca75f2355684b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T06:59:03.991 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:03 smithi173 bash[73174]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11 2024-09-19T06:59:04.333 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:03 smithi173 podman[73194]: 2024-09-19 06:59:03.989939161 +0000 UTC m=+0.614273748 container remove 1c38c3442a214bf7fc6251d6952dc887bde8983f00929e28488ca75f2355684b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:59:04.618 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:04 smithi173 podman[73280]: 2024-09-19 06:59:04.33235673 +0000 UTC m=+0.105877424 container create 499a54de68fcbee2abccd2aaeb60ac9f3add7b93f7927abf6a64c2b832746b0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T06:59:04.618 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:04 smithi173 podman[73280]: 2024-09-19 06:59:04.242596533 +0000 UTC m=+0.016117231 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:59:04.618 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:04 smithi173 podman[73280]: 2024-09-19 06:59:04.543282115 +0000 UTC m=+0.316802806 container init 499a54de68fcbee2abccd2aaeb60ac9f3add7b93f7927abf6a64c2b832746b0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T06:59:04.619 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:04 smithi173 podman[73280]: 2024-09-19 06:59:04.546446637 +0000 UTC m=+0.319967329 container start 499a54de68fcbee2abccd2aaeb60ac9f3add7b93f7927abf6a64c2b832746b0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T06:59:04.619 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:04 smithi173 podman[73280]: 2024-09-19 06:59:04.618292566 +0000 UTC m=+0.391813269 container attach 499a54de68fcbee2abccd2aaeb60ac9f3add7b93f7927abf6a64c2b832746b0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:59:05.021 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 19 06:59:04 smithi173 podman[73280]: 2024-09-19 06:59:04.735940864 +0000 UTC m=+0.509461558 container died 499a54de68fcbee2abccd2aaeb60ac9f3add7b93f7927abf6a64c2b832746b0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T06:59:05.293 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T06:59:05.332 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:05.332 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T06:59:05.332 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T06:59:05.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.a 2024-09-19T06:59:05.629 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:59:05 smithi012 systemd[1]: Stopping Ceph mds.a for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:06.129 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:59:05 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-a[72519]: 2024-09-19T06:59:05.636+0000 7f930aa80640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:06.129 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:59:05 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-a[72519]: 2024-09-19T06:59:05.636+0000 7f930aa80640 -1 mds.a *** got signal Terminated *** 2024-09-19T06:59:09.945 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:59:09 smithi012 podman[128762]: 2024-09-19 06:59:09.648243747 +0000 UTC m=+4.115764452 container died d6be61aaa3fcb9e99777a2bf2020558652baa31ee82fa9b509b500044e45fba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T06:59:10.379 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:59:10 smithi012 podman[128762]: 2024-09-19 06:59:10.119277298 +0000 UTC m=+4.586798031 container cleanup d6be61aaa3fcb9e99777a2bf2020558652baa31ee82fa9b509b500044e45fba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T06:59:10.379 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 19 06:59:10 smithi012 bash[128762]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-a 2024-09-19T06:59:10.560 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T06:59:10.595 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:10.596 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T06:59:10.596 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T06:59:10.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.d 2024-09-19T06:59:11.129 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:59:10 smithi012 systemd[1]: Stopping Ceph mds.d for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:11.129 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:59:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-d[71331]: 2024-09-19T06:59:10.923+0000 7ffa2fef3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:11.129 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:59:10 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-d[71331]: 2024-09-19T06:59:10.923+0000 7ffa2fef3640 -1 mds.d *** got signal Terminated *** 2024-09-19T06:59:14.356 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:59:13 smithi012 podman[128882]: 2024-09-19 06:59:13.941322502 +0000 UTC m=+3.122842473 container died 16d7996e63df0c488f38e02b1099031d1234ee423cf30bb27f19831c1f133210 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:14.357 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:59:14 smithi012 podman[128882]: 2024-09-19 06:59:14.356296461 +0000 UTC m=+3.537816423 container cleanup 16d7996e63df0c488f38e02b1099031d1234ee423cf30bb27f19831c1f133210 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T06:59:14.628 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:59:14 smithi012 bash[128882]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-d 2024-09-19T06:59:14.629 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 19 06:59:14 smithi012 podman[128896]: 2024-09-19 06:59:14.574449817 +0000 UTC m=+0.630635819 container remove 16d7996e63df0c488f38e02b1099031d1234ee423cf30bb27f19831c1f133210 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:59:14.794 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T06:59:14.828 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:14.828 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T06:59:14.828 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T06:59:14.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.g 2024-09-19T06:59:15.128 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:59:14 smithi012 systemd[1]: Stopping Ceph mds.g for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:15.629 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:59:15 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g[72117]: 2024-09-19T06:59:15.168+0000 7f3f2f7c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:15.629 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:59:15 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g[72117]: 2024-09-19T06:59:15.168+0000 7f3f2f7c5640 -1 mds.g *** got signal Terminated *** 2024-09-19T06:59:18.537 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:59:18 smithi012 podman[129003]: 2024-09-19 06:59:18.22757719 +0000 UTC m=+3.169438550 container died b8ed9b1e4cfd2b960634983e7be886f7d3faec6b91b164cedadc7f67244e2c9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:18.879 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:59:18 smithi012 podman[129003]: 2024-09-19 06:59:18.702172939 +0000 UTC m=+3.644034283 container cleanup b8ed9b1e4cfd2b960634983e7be886f7d3faec6b91b164cedadc7f67244e2c9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:59:18.879 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 19 06:59:18 smithi012 bash[129003]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-g 2024-09-19T06:59:19.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T06:59:19.171 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:19.171 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T06:59:19.172 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T06:59:19.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.j 2024-09-19T06:59:19.498 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:59:19 smithi012 systemd[1]: Stopping Ceph mds.j for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:19.878 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:59:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-j[70932]: 2024-09-19T06:59:19.497+0000 7f4eff6b2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:19.879 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:59:19 smithi012 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-j[70932]: 2024-09-19T06:59:19.497+0000 7f4eff6b2640 -1 mds.j *** got signal Terminated *** 2024-09-19T06:59:22.591 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:59:22 smithi012 podman[129123]: 2024-09-19 06:59:22.30993873 +0000 UTC m=+2.914308819 container died b79df0ecf29ca36165467983933d5c58b948aa7758094d6413043ba47d3286f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T06:59:22.878 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:59:22 smithi012 podman[129123]: 2024-09-19 06:59:22.756230007 +0000 UTC m=+3.360600093 container cleanup b79df0ecf29ca36165467983933d5c58b948aa7758094d6413043ba47d3286f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-j, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T06:59:22.879 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 19 06:59:22 smithi012 bash[129123]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-j 2024-09-19T06:59:23.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T06:59:23.209 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:23.210 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T06:59:23.210 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T06:59:23.210 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.b 2024-09-19T06:59:23.508 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:59:23 smithi016 systemd[1]: Stopping Ceph mds.b for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:24.008 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:59:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: 2024-09-19T06:59:23.510+0000 7fa952815640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:24.008 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:59:23 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b[64279]: 2024-09-19T06:59:23.510+0000 7fa952815640 -1 mds.b *** got signal Terminated *** 2024-09-19T06:59:26.508 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:59:26 smithi016 podman[72121]: 2024-09-19 06:59:26.221043435 +0000 UTC m=+2.811164064 container died b5e9449ec3259d991d376e29f7a48a819b96c4bafb37391ee9f0a7b977e64aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:59:26.937 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:59:26 smithi016 podman[72121]: 2024-09-19 06:59:26.677300339 +0000 UTC m=+3.267420957 container cleanup b5e9449ec3259d991d376e29f7a48a819b96c4bafb37391ee9f0a7b977e64aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T06:59:26.937 INFO:journalctl@ceph.mds.b.smithi016.stdout:Sep 19 06:59:26 smithi016 bash[72121]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-b 2024-09-19T06:59:27.126 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T06:59:27.163 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:27.163 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T06:59:27.163 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T06:59:27.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.e 2024-09-19T06:59:27.508 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:59:27 smithi016 systemd[1]: Stopping Ceph mds.e for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:28.008 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:59:27 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e[63674]: 2024-09-19T06:59:27.614+0000 7fc37829c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:28.008 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:59:27 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e[63674]: 2024-09-19T06:59:27.614+0000 7fc37829c640 -1 mds.e *** got signal Terminated *** 2024-09-19T06:59:30.508 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:59:30 smithi016 podman[72257]: 2024-09-19 06:59:30.220177096 +0000 UTC m=+2.821054575 container died f0d1477f8ec71263c0c7f9c8d17bce6c2a94d7091494c4d474c57378d485043e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T06:59:30.966 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:59:30 smithi016 podman[72257]: 2024-09-19 06:59:30.672597387 +0000 UTC m=+3.273474907 container cleanup f0d1477f8ec71263c0c7f9c8d17bce6c2a94d7091494c4d474c57378d485043e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:59:30.967 INFO:journalctl@ceph.mds.e.smithi016.stdout:Sep 19 06:59:30 smithi016 bash[72257]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-e 2024-09-19T06:59:31.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T06:59:31.158 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:31.158 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T06:59:31.158 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T06:59:31.158 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.h 2024-09-19T06:59:31.486 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:59:31 smithi016 systemd[1]: Stopping Ceph mds.h for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:31.758 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:59:31 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h[63976]: 2024-09-19T06:59:31.484+0000 7f4797db3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:31.758 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:59:31 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h[63976]: 2024-09-19T06:59:31.484+0000 7f4797db3640 -1 mds.h *** got signal Terminated *** 2024-09-19T06:59:34.494 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:59:34 smithi016 podman[72382]: 2024-09-19 06:59:34.222753071 +0000 UTC m=+2.841598765 container died 8dc3901a3abdfe9e76ec8cbf52637a66664b846cdeceea034a899f6ff13f31b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T06:59:34.758 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:59:34 smithi016 podman[72382]: 2024-09-19 06:59:34.576744607 +0000 UTC m=+3.195590346 container cleanup 8dc3901a3abdfe9e76ec8cbf52637a66664b846cdeceea034a899f6ff13f31b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T06:59:34.758 INFO:journalctl@ceph.mds.h.smithi016.stdout:Sep 19 06:59:34 smithi016 bash[72382]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-h 2024-09-19T06:59:34.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T06:59:35.015 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:35.015 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T06:59:35.015 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T06:59:35.015 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.k 2024-09-19T06:59:35.258 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:59:35 smithi016 systemd[1]: Stopping Ceph mds.k for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:35.758 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:59:35 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k[63368]: 2024-09-19T06:59:35.463+0000 7f76bba29640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:35.758 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:59:35 smithi016 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k[63368]: 2024-09-19T06:59:35.463+0000 7f76bba29640 -1 mds.k *** got signal Terminated *** 2024-09-19T06:59:38.498 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:59:38 smithi016 podman[72504]: 2024-09-19 06:59:38.230584984 +0000 UTC m=+2.995818604 container died 2b0605a75a93da61cbab7322ff89d1fc15a78ab7d27d3ed380c9b9d594771e98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T06:59:38.758 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:59:38 smithi016 podman[72504]: 2024-09-19 06:59:38.705697998 +0000 UTC m=+3.470931620 container cleanup 2b0605a75a93da61cbab7322ff89d1fc15a78ab7d27d3ed380c9b9d594771e98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T06:59:38.758 INFO:journalctl@ceph.mds.k.smithi016.stdout:Sep 19 06:59:38 smithi016 bash[72504]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-k 2024-09-19T06:59:39.095 DEBUG:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T06:59:39.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:39.126 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T06:59:39.126 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T06:59:39.127 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.c 2024-09-19T06:59:39.523 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:59:39 smithi173 systemd[1]: Stopping Ceph mds.c for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:39.787 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:59:39 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c[65545]: 2024-09-19T06:59:39.520+0000 7fd6118d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:39.788 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:59:39 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c[65545]: 2024-09-19T06:59:39.520+0000 7fd6118d5640 -1 mds.c *** got signal Terminated *** 2024-09-19T06:59:42.489 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:59:42 smithi173 podman[73381]: 2024-09-19 06:59:42.231715685 +0000 UTC m=+2.906861331 container died ac9838b1d70aefcb9d9a674ee19e965e8b999a9c5801bdc825344a27b457194e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T06:59:42.832 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:59:42 smithi173 podman[73381]: 2024-09-19 06:59:42.579559918 +0000 UTC m=+3.254705558 container cleanup ac9838b1d70aefcb9d9a674ee19e965e8b999a9c5801bdc825344a27b457194e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:59:42.832 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 19 06:59:42 smithi173 bash[73381]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-c 2024-09-19T06:59:43.018 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T06:59:43.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:43.054 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T06:59:43.054 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T06:59:43.054 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.f 2024-09-19T06:59:43.387 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:59:43 smithi173 systemd[1]: Stopping Ceph mds.f for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:43.832 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:59:43 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f[65248]: 2024-09-19T06:59:43.385+0000 7f34c232a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:43.832 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:59:43 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f[65248]: 2024-09-19T06:59:43.385+0000 7f34c232a640 -1 mds.f *** got signal Terminated *** 2024-09-19T06:59:46.519 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:59:46 smithi173 podman[73514]: 2024-09-19 06:59:46.216663574 +0000 UTC m=+2.940578995 container died df73eaf33d65bbcf309b127d11cf38166f57d5d6823cf410805df58d56e1fbc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T06:59:46.818 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:59:46 smithi173 podman[73514]: 2024-09-19 06:59:46.608952984 +0000 UTC m=+3.332868400 container cleanup df73eaf33d65bbcf309b127d11cf38166f57d5d6823cf410805df58d56e1fbc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T06:59:46.819 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 19 06:59:46 smithi173 bash[73514]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-f 2024-09-19T06:59:46.963 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T06:59:46.997 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:46.997 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T06:59:46.997 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T06:59:46.997 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.i 2024-09-19T06:59:47.332 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:59:47 smithi173 systemd[1]: Stopping Ceph mds.i for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:47.332 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:59:47 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i[65848]: 2024-09-19T06:59:47.303+0000 7f28f3856640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:47.333 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:59:47 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i[65848]: 2024-09-19T06:59:47.303+0000 7f28f3856640 -1 mds.i *** got signal Terminated *** 2024-09-19T06:59:50.498 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:59:50 smithi173 podman[73637]: 2024-09-19 06:59:50.224411122 +0000 UTC m=+3.006872999 container died bdfdc3d17e553fe804bc552006a8b22e78b756351b6b0160f6dc13aa29e384af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T06:59:50.811 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:59:50 smithi173 podman[73637]: 2024-09-19 06:59:50.579909843 +0000 UTC m=+3.362371708 container cleanup bdfdc3d17e553fe804bc552006a8b22e78b756351b6b0160f6dc13aa29e384af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T06:59:50.811 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 19 06:59:50 smithi173 bash[73637]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-i 2024-09-19T06:59:50.999 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T06:59:51.030 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:51.030 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T06:59:51.030 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T06:59:51.031 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.l 2024-09-19T06:59:51.359 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:59:51 smithi173 systemd[1]: Stopping Ceph mds.l for 8bf314c8-7650-11ef-bceb-c7b262605968... 2024-09-19T06:59:51.832 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:59:51 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l[64943]: 2024-09-19T06:59:51.358+0000 7f394be5f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:59:51.832 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:59:51 smithi173 ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l[64943]: 2024-09-19T06:59:51.358+0000 7f394be5f640 -1 mds.l *** got signal Terminated *** 2024-09-19T06:59:54.485 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:59:54 smithi173 podman[73758]: 2024-09-19 06:59:54.218021107 +0000 UTC m=+2.963279192 container died 65c61c6c3f8c9499984d2ea638096e5d08ead3f2262bd9f09248af41288aa370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T06:59:54.832 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:59:54 smithi173 podman[73758]: 2024-09-19 06:59:54.575261723 +0000 UTC m=+3.320519797 container cleanup 65c61c6c3f8c9499984d2ea638096e5d08ead3f2262bd9f09248af41288aa370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:59:54.833 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 19 06:59:54 smithi173 bash[73758]: ceph-8bf314c8-7650-11ef-bceb-c7b262605968-mds-l 2024-09-19T06:59:54.959 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8bf314c8-7650-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T06:59:54.992 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:59:54.992 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T06:59:54.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:59:55.212 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T06:59:57.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:59:58.061 INFO:teuthology.orchestra.run.smithi016.stdout:Deleting cluster with fsid: 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T07:00:00.577 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:00:00.779 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T07:00:03.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:00:03.334 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:00:03.368 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:00:03.395 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T07:00:03.397 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740/remote/smithi012/crash 2024-09-19T07:00:03.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:00:03.436 INFO:teuthology.orchestra.run.smithi012.stderr:tar: /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:00:03.436 INFO:teuthology.orchestra.run.smithi012.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:00:03.438 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740/remote/smithi016/crash 2024-09-19T07:00:03.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:00:03.481 INFO:teuthology.orchestra.run.smithi016.stderr:tar: /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:00:03.481 INFO:teuthology.orchestra.run.smithi016.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:00:03.483 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740/remote/smithi173/crash 2024-09-19T07:00:03.484 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:00:03.519 INFO:teuthology.orchestra.run.smithi173.stderr:tar: /var/lib/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:00:03.519 INFO:teuthology.orchestra.run.smithi173.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:00:03.520 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T07:00:03.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T07:00:03.561 INFO:teuthology.orchestra.run.smithi012.stdout:2024-09-19T06:41:51.896656+0000 mds.b (mds.0) 14 : cluster [WRN] Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-09-19T07:00:03.561 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-19T07:00:03.562 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[SEC\]' /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T07:00:03.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]' /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T07:00:03.718 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[WRN\]' /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T07:00:03.792 INFO:teuthology.orchestra.run.smithi012.stdout:2024-09-19T06:41:51.896656+0000 mds.b (mds.0) 14 : cluster [WRN] Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-09-19T07:00:03.793 INFO:tasks.cephadm:Compressing logs... 2024-09-19T07:00:03.793 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:00:03.835 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:00:03.838 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:00:03.858 INFO:teuthology.orchestra.run.smithi012.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T07:00:03.858 INFO:teuthology.orchestra.run.smithi012.stderr:: No such file or directory 2024-09-19T07:00:03.858 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T07:00:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:00:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:00:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T07:00:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:00:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T07:00:03.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T07:00:03.862 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T07:00:03.862 INFO:teuthology.orchestra.run.smithi012.stderr: 84.4% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:00:03.862 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:00:03.865 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:00:03.865 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T07:00:03.867 INFO:teuthology.orchestra.run.smithi173.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:: No such file or directory 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr: 81.5% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T07:00:03.868 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log: 90.4% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:00:03.871 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log: 87.1% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:00:03.871 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T07:00:03.872 INFO:teuthology.orchestra.run.smithi016.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T07:00:03.872 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T07:00:03.872 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T07:00:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T07:00:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:00:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T07:00:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T07:00:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T07:00:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:00:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:00:03.873 INFO:teuthology.orchestra.run.smithi016.stderr: 90.4% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:00:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T07:00:03.874 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.cephadm.log: 81.6% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:00:03.874 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:00:03.875 INFO:teuthology.orchestra.run.smithi173.stderr: 87.1% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:00:03.875 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T07:00:03.876 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T07:00:03.877 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.d.log: 91.1% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:00:03.877 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T07:00:03.877 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mgr.x.log: 94.5% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T07:00:03.877 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T07:00:03.878 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T07:00:03.878 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:00:03.881 INFO:teuthology.orchestra.run.smithi016.stderr: 90.8% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:00:03.883 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.5% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T07:00:03.883 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:00:03.885 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T07:00:03.886 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T07:00:03.891 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.h.log: 92.2%/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log: 87.1% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:00:03.891 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T07:00:03.892 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T07:00:03.896 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.3% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T07:00:03.901 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T07:00:03.906 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:00:03.910 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:00:03.925 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:00:03.927 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:00:03.932 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:00:04.002 INFO:teuthology.orchestra.run.smithi012.stderr: 93.2% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T07:00:04.028 INFO:teuthology.orchestra.run.smithi012.stderr: 93.2% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T07:00:04.218 INFO:teuthology.orchestra.run.smithi016.stderr: 93.2% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T07:00:04.299 INFO:teuthology.orchestra.run.smithi173.stderr: 94.2% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T07:00:04.356 INFO:teuthology.orchestra.run.smithi012.stderr: 90.4% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T07:00:04.507 INFO:teuthology.orchestra.run.smithi016.stderr: 91.7% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T07:00:04.515 INFO:teuthology.orchestra.run.smithi016.stderr: 94.1% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T07:00:04.640 INFO:teuthology.orchestra.run.smithi173.stderr: 91.5% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T07:00:05.114 INFO:teuthology.orchestra.run.smithi012.stderr: 90.3% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T07:00:05.732 INFO:teuthology.orchestra.run.smithi016.stderr: 94.8% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T07:00:05.969 INFO:teuthology.orchestra.run.smithi173.stderr: 94.6% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T07:00:06.423 INFO:teuthology.orchestra.run.smithi173.stderr: 93.9% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T07:00:08.016 INFO:teuthology.orchestra.run.smithi173.stderr: 94.6% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T07:00:09.555 INFO:teuthology.orchestra.run.smithi016.stderr: 94.5% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T07:00:14.812 INFO:teuthology.orchestra.run.smithi173.stderr: 94.3% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T07:00:16.698 INFO:teuthology.orchestra.run.smithi173.stderr: 94.3% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T07:00:17.140 INFO:teuthology.orchestra.run.smithi016.stderr: 94.2% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T07:00:17.737 INFO:teuthology.orchestra.run.smithi012.stderr: 94.1% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T07:00:18.345 INFO:teuthology.orchestra.run.smithi016.stderr: 93.8% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T07:00:18.974 INFO:teuthology.orchestra.run.smithi012.stderr: 94.1% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T07:00:19.873 INFO:teuthology.orchestra.run.smithi173.stderr: 94.1% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T07:00:20.744 INFO:teuthology.orchestra.run.smithi173.stderr: 94.4% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T07:00:20.746 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-19T07:00:20.746 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m16.892s 2024-09-19T07:00:20.746 INFO:teuthology.orchestra.run.smithi173.stderr:user 1m3.791s 2024-09-19T07:00:20.746 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m2.341s 2024-09-19T07:00:21.674 INFO:teuthology.orchestra.run.smithi016.stderr: 94.0% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T07:00:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 94.2% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T07:00:25.063 INFO:teuthology.orchestra.run.smithi012.stderr: 94.2% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T07:00:25.065 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-19T07:00:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m21.217s 2024-09-19T07:00:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:user 1m8.172s 2024-09-19T07:00:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m2.520s 2024-09-19T07:00:26.531 INFO:teuthology.orchestra.run.smithi016.stderr: 94.0% -- replaced with /var/log/ceph/8bf314c8-7650-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T07:00:26.533 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-09-19T07:00:26.533 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m22.680s 2024-09-19T07:00:26.533 INFO:teuthology.orchestra.run.smithi016.stderr:user 1m14.474s 2024-09-19T07:00:26.533 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m2.436s 2024-09-19T07:00:26.533 INFO:tasks.cephadm:Archiving logs... 2024-09-19T07:00:26.533 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740/remote/smithi012/log 2024-09-19T07:00:26.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:00:36.747 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740/remote/smithi016/log 2024-09-19T07:00:36.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:00:46.864 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740/remote/smithi173/log 2024-09-19T07:00:46.865 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:00:55.050 INFO:tasks.cephadm:Removing cluster... 2024-09-19T07:00:55.051 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 --force 2024-09-19T07:00:55.269 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T07:00:55.647 DEBUG:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 --force 2024-09-19T07:00:55.857 INFO:teuthology.orchestra.run.smithi016.stdout:Deleting cluster with fsid: 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T07:00:56.200 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8bf314c8-7650-11ef-bceb-c7b262605968 --force 2024-09-19T07:00:56.402 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: 8bf314c8-7650-11ef-bceb-c7b262605968 2024-09-19T07:00:56.729 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T07:00:56.730 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:56.747 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:56.764 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:00:56.780 INFO:tasks.cephadm:Teardown complete 2024-09-19T07:00:56.780 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T07:00:56.793 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T07:00:56.793 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:00:56.796 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:00:56.807 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:00:56.912 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T07:00:56.924 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T07:00:56.925 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:00:56.928 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:00:56.931 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:00:56.940 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:00:56.944 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:00:56.944 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:00:56.944 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-19T07:00:56.944 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 +440us[ +461us] +/- 42ms 2024-09-19T07:00:56.944 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -939us[ -919us] +/- 69ms 2024-09-19T07:00:56.945 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +251us[ +271us] +/- 67ms 2024-09-19T07:00:56.945 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:00:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:00:56.948 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:00:56.948 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-09-19T07:00:56.948 INFO:teuthology.orchestra.run.smithi016.stdout:^* hv01.front.sepia.ceph.com 3 7 377 62 +464us[ +447us] +/- 42ms 2024-09-19T07:00:56.948 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -958us[ -958us] +/- 69ms 2024-09-19T07:00:56.948 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +246us[ +246us] +/- 67ms 2024-09-19T07:00:56.948 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:00:56.950 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:00:56.950 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-09-19T07:00:56.950 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 +455us[ +485us] +/- 42ms 2024-09-19T07:00:56.950 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -933us[ -933us] +/- 69ms 2024-09-19T07:00:56.950 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +256us[ +286us] +/- 67ms 2024-09-19T07:00:56.950 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:00:56.951 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T07:00:56.963 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T07:00:56.963 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T07:00:56.975 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:00:57.074 DEBUG:teuthology.orchestra.run.smithi016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:00:57.148 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:00:57.215 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:00:57.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:00:57.246 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:00:57.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:00:57.275 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:00:57.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:00:57.303 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T07:00:57.316 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T07:00:57.329 INFO:teuthology.task.internal:Duration was 2257.773913 seconds 2024-09-19T07:00:57.329 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T07:00:57.342 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T07:00:57.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:00:57.345 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:00:57.347 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:00:57.383 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:00:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:00:57.386 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:00:57.806 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T07:00:57.806 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-09-19T07:00:57.807 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:00:57.829 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-09-19T07:00:57.829 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:00:57.881 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-09-19T07:00:57.881 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:00:57.915 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T07:00:57.915 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:00:57.918 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:00:57.924 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:00:57.981 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T07:00:57.982 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:00:57.986 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:00:57.994 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:00:59.656 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T07:00:59.668 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T07:00:59.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:00:59.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:00:59.724 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:00:59.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T07:00:59.770 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:00:59.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:00:59.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:00:59.795 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-09-19T07:00:59.799 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-09-19T07:00:59.821 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-09-19T07:00:59.914 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:00:59.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:00:59.930 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:00:59.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:00:59.947 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:00:59.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:00:59.974 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T07:00:59.987 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T07:00:59.988 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740/remote/smithi012 2024-09-19T07:00:59.988 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:01:00.066 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740/remote/smithi016 2024-09-19T07:01:00.066 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:01:00.108 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911740/remote/smithi173 2024-09-19T07:01:00.108 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:01:00.150 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T07:01:00.150 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:01:00.152 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:01:00.155 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:01:00.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T07:01:00.216 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T07:01:00.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T07:01:00.235 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T07:01:00.557 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:01:00.562 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:01:00.568 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:01:00.576 INFO:teuthology.orchestra.run.smithi012.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:01 /home/ubuntu/cephtest 2024-09-19T07:01:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:01 /home/ubuntu/cephtest 2024-09-19T07:01:00.589 INFO:teuthology.orchestra.run.smithi173.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:01 /home/ubuntu/cephtest 2024-09-19T07:01:00.590 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T07:01:00.636 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T07:01:00.709 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} duration: 2257.7739129066467 failure_reason: '"2024-09-19T06:41:51.896656+0000 mds.b (mds.0) 14 : cluster [WRN] Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/3ca5c5ec-f562-4091-a1fa-b3df0ffa3235/postgres/data/pg_wal) see mds.b log and `damage ls` output for details" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-09-19T07:01:00.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T07:01:00.831 INFO:teuthology.run:FAIL